2023-10-08T12:09:11.508 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T12:09:11.508 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/dbench}} --verbose --name pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931 -- /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931/orig.config.yaml 2023-10-08T12:09:11.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T12:09:11.671 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931 branch: wip-batrick-testing-20231007.154158 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/dbench}} email: pdonnell@redhat.com first_in_suite: false job_id: '7417931' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20231007.154158 ceph: cephfs: session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_client_delegate_inos_pct: 50 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231007.154158 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8022 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de sleep_before_teardown: 0 subset: 128/256 suite: fs suite_branch: wip-batrick-testing-20231007.154158 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_20:01:29 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T12:09:11.673 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa; will attempt to use it 2023-10-08T12:09:11.673 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks 2023-10-08T12:09:11.674 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T12:09:11.675 INFO:teuthology.task.internal:Checking packages... 2023-10-08T12:09:11.708 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de' 2023-10-08T12:09:11.708 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T12:09:11.709 INFO:teuthology.packaging:ref: None 2023-10-08T12:09:11.709 INFO:teuthology.packaging:tag: None 2023-10-08T12:09:11.709 INFO:teuthology.packaging:branch: wip-batrick-testing-20231007.154158 2023-10-08T12:09:11.709 INFO:teuthology.packaging:sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:09:11.709 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20231007.154158 2023-10-08T12:09:11.874 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6639.g7b3143ba 2023-10-08T12:09:11.876 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T12:09:11.882 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T12:09:11.882 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T12:09:11.928 INFO:teuthology.task.internal:Saving configuration 2023-10-08T12:09:11.949 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T12:09:11.963 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T12:09:11.989 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:04:14.376255', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T12:09:12.014 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:04:14.379125', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T12:09:12.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:04:14.377807', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T12:09:12.036 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T12:09:12.042 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-08T12:09:12.043 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-08T12:09:12.043 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-08T12:09:12.043 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T12:09:12.165 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f107e92ab80>, signals=[15]) 2023-10-08T12:09:12.165 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T12:09:12.171 INFO:teuthology.task.internal:Opening connections... 2023-10-08T12:09:12.171 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2023-10-08T12:09:12.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:09:12.241 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2023-10-08T12:09:12.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:09:12.308 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2023-10-08T12:09:12.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:09:12.376 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T12:09:12.383 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-10-08T12:09:12.406 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-10-08T12:09:12.406 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-08T12:09:12.467 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T12:09:12.467 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T12:09:12.467 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2023-10-08T12:09:12.467 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2023-10-08T12:09:12.467 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6" 2023-10-08T12:09:12.467 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-10-08T12:09:12.467 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T12:09:12.467 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-08T12:09:12.468 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T12:09:12.468 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T12:09:12.468 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T12:09:12.468 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T12:09:12.468 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:09:12.468 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T12:09:12.468 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T12:09:12.468 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T12:09:12.468 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T12:09:12.469 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-08T12:09:12.487 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-10-08T12:09:12.506 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-10-08T12:09:12.506 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-10-08T12:09:12.563 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T12:09:12.563 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T12:09:12.564 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-10-08T12:09:12.564 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-10-08T12:09:12.564 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-10-08T12:09:12.564 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-10-08T12:09:12.564 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T12:09:12.564 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-10-08T12:09:12.564 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T12:09:12.564 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T12:09:12.564 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T12:09:12.564 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T12:09:12.565 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:09:12.565 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T12:09:12.565 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T12:09:12.565 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T12:09:12.565 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T12:09:12.565 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-10-08T12:09:12.587 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2023-10-08T12:09:12.607 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2023-10-08T12:09:12.607 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-10-08T12:09:12.665 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T12:09:12.665 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T12:09:12.666 INFO:teuthology.orchestra.run.smithi173.stdout:ID="rhel" 2023-10-08T12:09:12.666 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="fedora" 2023-10-08T12:09:12.666 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8.6" 2023-10-08T12:09:12.666 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2023-10-08T12:09:12.666 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T12:09:12.666 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-10-08T12:09:12.666 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T12:09:12.666 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T12:09:12.666 INFO:teuthology.orchestra.run.smithi173.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T12:09:12.666 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T12:09:12.667 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:09:12.667 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T12:09:12.667 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T12:09:12.667 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T12:09:12.667 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T12:09:12.667 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-10-08T12:09:12.687 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T12:09:12.697 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T12:09:12.720 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T12:09:12.721 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2023-10-08T12:09:12.723 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2023-10-08T12:09:12.727 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2023-10-08T12:09:12.745 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T12:09:12.752 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T12:09:12.753 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2023-10-08T12:09:12.783 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2023-10-08T12:09:12.786 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2023-10-08T12:09:12.813 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T12:09:12.893 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T12:09:12.908 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-08T12:09:12.908 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-10-08T12:09:12.908 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-10-08T12:09:12.908 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T12:09:12.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:09:12.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-08T12:09:13.098 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T12:09:13.098 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-08T12:09:13.099 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2023-10-08T12:09:13.119 INFO:teuthology.orchestra.run.smithi059.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T12:09:13.119 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T12:09:13.120 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-08T12:09:13.120 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum upgrade -y linux-firmware 2023-10-08T12:09:14.486 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-10-08T12:09:14.486 INFO:teuthology.orchestra.run.smithi059.stdout:Unable to read consumer identity 2023-10-08T12:09:15.866 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-10-08T12:09:16.517 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2023-10-08T12:09:20.201 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 654 kB/s | 24 kB 00:00 2023-10-08T12:09:20.980 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-08T12:09:20.982 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2023-10-08T12:09:20.982 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-08T12:09:21.089 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-08T12:09:21.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T12:09:21.312 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-08T12:09:21.312 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-08T12:09:21.315 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi059.front.sepia.ceph.com to complete... 2023-10-08T12:09:34.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08 12:09:34 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-08T12:09:34.155 INFO:teuthology.orchestra.run.smithi059.stderr:FINISHED --2023-10-08 12:09:34-- 2023-10-08T12:09:34.155 INFO:teuthology.orchestra.run.smithi059.stderr:Total wall clock time: 13s 2023-10-08T12:09:34.155 INFO:teuthology.orchestra.run.smithi059.stderr:Downloaded: 1 files, 363M in 13s (28.9 MB/s) 2023-10-08T12:09:34.157 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-08T12:09:34.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-08T12:09:35.822 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying... ######################################## 2023-10-08T12:09:35.878 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing... ######################################## 2023-10-08T12:09:35.977 INFO:teuthology.orchestra.run.smithi059.stdout:Updating / installing... 2023-10-08T12:10:16.607 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-08T12:10:41.763 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-08T12:10:41.764 DEBUG:teuthology.orchestra.run.smithi059:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-08T12:10:41.821 INFO:teuthology.orchestra.run.smithi059.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-08T12:10:41.821 INFO:teuthology.orchestra.run.smithi059.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-08T12:10:41.821 INFO:teuthology.orchestra.run.smithi059.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-08T12:10:41.822 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-08T12:10:41.822 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-08T12:10:41.822 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-08T12:10:41.822 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-08T12:10:41.822 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-08T12:10:41.822 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-08T12:10:41.822 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-08T12:10:41.822 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-08T12:10:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-08T12:10:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-08T12:10:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-08T12:10:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-08T12:10:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-08T12:10:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-08T12:10:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-08T12:10:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-08T12:10:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-08T12:10:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-08T12:10:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-08T12:10:41.824 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-08T12:10:41.824 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-08T12:10:41.824 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-08T12:10:41.824 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-08T12:10:41.824 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-08T12:10:41.824 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-08T12:10:41.825 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-08T12:10:41.825 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-08T12:10:41.825 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-08T12:10:41.825 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-08T12:10:41.825 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-08T12:10:41.825 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-08T12:10:41.825 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-08T12:10:41.825 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-08T12:10:41.825 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-08T12:10:41.825 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-08T12:10:41.826 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-08T12:10:41.826 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-08T12:10:41.826 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-08T12:10:41.826 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-08T12:10:41.826 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-08T12:10:41.826 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-08T12:10:41.826 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-08T12:10:41.826 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-08T12:10:41.826 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-08T12:10:41.826 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-08T12:10:41.827 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-08T12:10:41.827 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-08T12:10:41.827 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-08T12:10:41.827 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-08T12:10:41.827 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-08T12:10:41.827 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-08T12:10:41.827 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-08T12:10:41.827 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-08T12:10:41.828 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-08T12:10:41.828 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-08T12:10:41.828 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-08T12:10:41.828 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-08T12:10:41.828 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-08T12:10:41.828 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-08T12:10:41.828 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-08T12:10:41.828 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-08T12:10:41.828 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-08T12:10:41.828 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-08T12:10:41.828 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-08T12:10:41.829 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-08T12:10:41.829 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-08T12:10:41.829 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-08T12:10:41.829 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-08T12:10:41.829 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-08T12:10:41.829 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-08T12:10:41.829 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-08T12:10:41.830 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-08T12:10:41.830 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-08T12:10:41.830 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-08T12:10:41.830 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-08T12:10:41.830 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-08T12:10:41.830 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-08T12:10:41.830 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-08T12:10:41.830 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-08T12:10:41.830 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-08T12:10:41.830 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-08T12:10:41.831 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-08T12:10:41.831 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-08T12:10:41.831 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-08T12:10:41.831 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-08T12:10:41.831 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-08T12:10:41.831 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-08T12:10:41.832 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-08T12:10:41.832 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-08T12:10:41.832 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-08T12:10:41.832 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-08T12:10:41.832 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-08T12:10:41.832 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-08T12:10:41.832 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-08T12:10:41.832 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-08T12:10:41.832 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-08T12:10:41.832 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-08T12:10:41.832 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-08T12:10:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-08T12:10:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-08T12:10:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-08T12:10:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-08T12:10:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-08T12:10:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-08T12:10:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-08T12:10:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-08T12:10:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-08T12:10:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-08T12:10:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-08T12:10:41.834 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-08T12:10:41.834 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-08T12:10:41.834 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-08T12:10:41.834 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-08T12:10:41.834 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-08T12:10:41.834 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-08T12:10:41.834 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-08T12:10:41.834 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-08T12:10:41.834 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-08T12:10:41.834 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-08T12:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-08T12:10:41.836 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-08T12:10:41.836 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-08T12:10:41.836 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-08T12:10:41.836 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-08T12:10:41.836 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-08T12:10:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-08T12:10:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-08T12:10:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-08T12:10:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-08T12:10:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-08T12:10:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-08T12:10:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-08T12:10:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-08T12:10:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-08T12:10:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-08T12:10:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-08T12:10:41.838 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-08T12:10:41.838 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-08T12:10:41.838 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-08T12:10:41.838 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-08T12:10:41.838 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-08T12:10:41.838 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-08T12:10:41.838 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-08T12:10:41.838 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-08T12:10:41.838 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-08T12:10:41.838 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-08T12:10:41.838 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-08T12:10:41.839 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-08T12:10:41.840 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-08T12:10:41.840 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-08T12:10:41.840 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-08T12:10:41.840 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-08T12:10:41.840 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-08T12:10:41.840 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-08T12:10:41.840 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-08T12:10:41.840 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-08T12:10:41.840 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-08T12:10:41.840 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-08T12:10:41.840 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-08T12:10:41.841 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-08T12:10:41.841 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-08T12:10:41.841 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-08T12:10:41.842 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-08T12:10:41.842 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-08T12:10:41.842 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-08T12:10:41.842 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-08T12:10:41.842 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-08T12:10:41.842 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-08T12:10:41.843 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-08T12:10:41.843 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-08T12:10:41.843 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-08T12:10:41.843 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-08T12:10:41.843 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-08T12:10:41.843 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-08T12:10:41.843 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-08T12:10:41.844 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-08T12:10:41.844 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-08T12:10:41.844 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-08T12:10:41.844 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-08T12:10:41.844 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-08T12:10:41.844 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-08T12:10:41.844 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-08T12:10:41.844 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-08T12:10:41.844 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-08T12:10:41.844 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-08T12:10:41.845 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-08T12:10:41.845 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-08T12:10:41.845 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-08T12:10:41.845 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-08T12:10:41.845 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-08T12:10:41.845 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-08T12:10:41.845 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-08T12:10:41.845 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-08T12:10:41.845 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-08T12:10:41.845 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-08T12:10:41.846 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-08T12:10:41.846 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-08T12:10:41.846 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-08T12:10:41.846 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-08T12:10:41.846 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-08T12:10:41.846 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-08T12:10:41.846 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-08T12:10:41.846 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-08T12:10:41.846 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-08T12:10:41.846 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-08T12:10:41.846 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-08T12:10:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-08T12:10:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-08T12:10:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-08T12:10:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-08T12:10:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-08T12:10:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-08T12:10:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-08T12:10:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-08T12:10:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-08T12:10:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-08T12:10:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-08T12:10:41.848 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-08T12:10:41.848 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-08T12:10:41.848 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-08T12:10:41.848 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-08T12:10:41.848 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-08T12:10:41.848 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-08T12:10:41.848 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-08T12:10:41.848 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-08T12:10:41.848 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-08T12:10:41.848 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-08T12:10:41.848 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-08T12:10:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-08T12:10:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-08T12:10:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-08T12:10:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-08T12:10:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-08T12:10:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-08T12:10:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-08T12:10:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-08T12:10:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-08T12:10:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-08T12:10:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-08T12:10:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-08T12:10:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-08T12:10:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-08T12:10:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-08T12:10:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-08T12:10:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-08T12:10:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-08T12:10:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-08T12:10:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-08T12:10:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-08T12:10:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-08T12:10:41.851 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-08T12:10:41.852 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-08T12:10:41.852 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-08T12:10:41.852 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-08T12:10:41.852 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-08T12:10:41.852 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-08T12:10:41.852 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-08T12:10:41.852 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-08T12:10:41.852 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-08T12:10:41.852 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-08T12:10:41.852 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-08T12:10:41.852 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-08T12:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-08T12:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-08T12:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-08T12:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-08T12:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-08T12:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-08T12:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-08T12:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-08T12:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-08T12:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-08T12:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-08T12:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-08T12:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-08T12:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-08T12:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-08T12:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-08T12:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-08T12:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-08T12:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-08T12:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-08T12:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-08T12:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-08T12:10:41.855 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-08T12:10:41.855 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-08T12:10:41.855 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-08T12:10:41.855 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-08T12:10:41.855 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-08T12:10:41.855 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-08T12:10:41.855 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-08T12:10:41.855 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-08T12:10:41.855 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-08T12:10:41.855 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-08T12:10:41.855 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-08T12:10:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-08T12:10:41.857 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-08T12:10:41.857 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-08T12:10:41.857 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-08T12:10:41.857 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-08T12:10:41.857 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-08T12:10:41.857 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-08T12:10:41.857 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-08T12:10:41.857 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-08T12:10:41.857 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-08T12:10:41.857 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-08T12:10:41.857 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-08T12:10:41.858 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-08T12:10:41.858 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-08T12:10:41.858 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-08T12:10:41.858 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-08T12:10:41.858 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-08T12:10:41.858 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-08T12:10:41.858 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-08T12:10:41.858 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-08T12:10:41.858 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-08T12:10:41.858 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-08T12:10:41.858 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-08T12:10:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-08T12:10:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-08T12:10:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-08T12:10:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-08T12:10:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-08T12:10:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-08T12:10:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-08T12:10:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-08T12:10:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-08T12:10:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-08T12:10:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-08T12:10:41.860 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-08T12:10:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-08T12:10:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-08T12:10:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-08T12:10:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-08T12:10:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-08T12:10:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-08T12:10:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-08T12:10:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-08T12:10:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-08T12:10:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-08T12:10:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-08T12:10:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-08T12:10:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-08T12:10:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-08T12:10:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-08T12:10:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-08T12:10:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-08T12:10:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-08T12:10:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-08T12:10:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-08T12:10:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-08T12:10:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-08T12:10:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-08T12:10:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-08T12:10:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-08T12:10:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-08T12:10:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-08T12:10:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-08T12:10:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-08T12:10:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-08T12:10:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-08T12:10:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-08T12:10:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-08T12:10:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-08T12:10:41.865 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-08T12:10:41.866 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-08T12:10:41.866 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-08T12:10:41.866 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-08T12:10:41.866 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-08T12:10:41.866 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-08T12:10:41.866 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-08T12:10:41.866 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-08T12:10:41.866 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-08T12:10:41.866 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-08T12:10:41.866 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-08T12:10:41.866 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-08T12:10:41.867 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-08T12:10:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-08T12:10:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-08T12:10:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-08T12:10:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-08T12:10:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-08T12:10:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-08T12:10:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-08T12:10:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-08T12:10:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-08T12:10:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-08T12:10:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-08T12:10:41.869 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-08T12:10:41.869 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-08T12:10:41.869 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-08T12:10:41.869 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-08T12:10:41.869 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-08T12:10:41.869 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-08T12:10:41.869 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-08T12:10:41.869 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-08T12:10:41.870 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-08T12:10:41.870 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-08T12:10:41.870 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-08T12:10:41.870 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-08T12:10:41.870 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-08T12:10:41.870 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-08T12:10:41.870 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-08T12:10:41.870 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-08T12:10:41.870 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-08T12:10:41.870 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-08T12:10:41.870 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-08T12:10:41.871 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-08T12:10:41.871 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-08T12:10:41.871 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-08T12:10:41.871 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-08T12:10:41.871 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-08T12:10:41.871 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-08T12:10:41.871 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-08T12:10:41.871 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-08T12:10:41.871 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-08T12:10:41.871 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-08T12:10:41.872 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-08T12:10:41.872 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-08T12:10:41.872 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-08T12:10:41.872 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-08T12:10:41.872 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-08T12:10:41.872 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-08T12:10:41.872 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-08T12:10:41.873 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-08T12:10:41.874 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-08T12:10:41.875 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-08T12:10:41.875 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-08T12:10:41.875 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-08T12:10:41.875 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-08T12:10:41.875 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-08T12:10:41.875 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-08T12:10:41.877 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-08T12:10:41.877 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-08T12:10:41.877 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-08T12:10:41.878 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-08T12:10:41.878 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-08T12:10:41.878 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-08T12:10:41.878 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-08T12:10:41.878 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-08T12:10:41.878 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-08T12:10:41.878 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-08T12:10:41.878 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-08T12:10:41.878 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-08T12:10:41.878 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-08T12:10:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-08T12:10:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-08T12:10:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-08T12:10:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-08T12:10:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-08T12:10:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-08T12:10:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-08T12:10:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-08T12:10:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-08T12:10:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-08T12:10:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-08T12:10:41.880 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-08T12:10:41.880 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-08T12:10:41.880 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-08T12:10:41.880 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-08T12:10:41.880 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-08T12:10:41.880 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-08T12:10:41.880 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-08T12:10:41.880 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-08T12:10:41.880 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-08T12:10:41.880 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-08T12:10:41.880 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-08T12:10:41.881 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-08T12:10:41.881 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-08T12:10:41.881 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-08T12:10:41.881 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-08T12:10:41.881 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-08T12:10:41.881 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-08T12:10:41.881 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-08T12:10:41.881 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-08T12:10:41.881 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-08T12:10:41.881 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-08T12:10:41.882 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-08T12:10:41.882 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-08T12:10:41.882 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-08T12:10:41.882 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-08T12:10:41.882 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-08T12:10:41.882 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-08T12:10:41.882 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-08T12:10:41.882 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-08T12:10:41.882 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-08T12:10:41.883 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-08T12:10:41.883 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-08T12:10:41.883 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-08T12:10:41.883 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-08T12:10:41.883 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-08T12:10:41.883 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-08T12:10:41.883 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-08T12:10:41.884 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-08T12:10:41.884 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-08T12:10:41.884 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-08T12:10:41.884 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-08T12:10:41.884 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-08T12:10:41.884 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-08T12:10:41.884 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-08T12:10:41.884 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-08T12:10:41.884 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-08T12:10:41.884 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-08T12:10:41.885 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-08T12:10:41.885 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-08T12:10:41.885 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-08T12:10:41.885 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-08T12:10:41.885 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-08T12:10:41.885 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-08T12:10:41.885 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-08T12:10:41.885 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-08T12:10:41.885 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-08T12:10:41.885 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-08T12:10:41.885 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-08T12:10:41.886 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-08T12:10:41.886 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-08T12:10:41.886 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-08T12:10:41.886 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-08T12:10:41.886 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-08T12:10:41.886 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-08T12:10:41.886 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-08T12:10:41.886 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-08T12:10:41.886 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-08T12:10:41.886 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-08T12:10:41.887 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-08T12:10:41.887 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-08T12:10:41.887 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-08T12:10:41.887 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-08T12:10:41.887 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-08T12:10:41.887 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-08T12:10:41.887 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-08T12:10:41.887 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-08T12:10:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-08T12:10:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-08T12:10:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-08T12:10:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-08T12:10:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-08T12:10:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-08T12:10:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-08T12:10:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-08T12:10:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-08T12:10:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-08T12:10:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-08T12:10:41.889 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-08T12:10:41.889 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-08T12:10:41.889 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-08T12:10:41.889 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-08T12:10:41.889 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-08T12:10:41.889 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-08T12:10:41.890 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-08T12:10:41.890 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-08T12:10:41.890 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-08T12:10:41.890 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-08T12:10:41.890 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-08T12:10:41.890 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-08T12:10:41.890 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-08T12:10:41.890 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-08T12:10:41.890 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-08T12:10:41.890 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-08T12:10:41.891 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-08T12:10:41.891 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-08T12:10:41.891 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-08T12:10:41.891 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-08T12:10:41.891 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-08T12:10:41.891 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-08T12:10:41.891 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-08T12:10:41.891 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-08T12:10:41.892 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-08T12:10:41.892 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-08T12:10:41.892 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-08T12:10:41.892 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-08T12:10:41.892 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-08T12:10:41.892 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-08T12:10:41.892 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-08T12:10:41.892 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-08T12:10:41.892 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-08T12:10:41.892 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-08T12:10:41.893 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-08T12:10:41.893 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-08T12:10:41.893 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-08T12:10:41.893 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-08T12:10:41.893 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-08T12:10:41.893 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-08T12:10:41.893 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-08T12:10:41.893 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-08T12:10:41.893 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-08T12:10:41.894 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-08T12:10:41.894 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-08T12:10:41.894 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-08T12:10:41.894 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-08T12:10:41.894 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-08T12:10:41.894 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-08T12:10:41.894 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-08T12:10:41.895 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-08T12:10:41.895 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-08T12:10:41.895 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-08T12:10:41.895 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-08T12:10:41.895 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-08T12:10:41.895 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-08T12:10:41.895 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-08T12:10:41.895 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-08T12:10:41.895 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-08T12:10:41.896 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-08T12:10:41.896 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-08T12:10:41.896 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-08T12:10:41.896 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-08T12:10:41.896 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-08T12:10:41.896 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-08T12:10:41.896 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-08T12:10:41.897 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-08T12:10:41.897 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-08T12:10:41.897 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-08T12:10:41.897 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-08T12:10:41.897 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-08T12:10:41.897 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-08T12:10:41.897 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-08T12:10:41.898 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-08T12:10:41.898 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-08T12:10:41.898 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-08T12:10:41.898 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-08T12:10:41.898 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-08T12:10:41.898 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-08T12:10:41.898 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-08T12:10:41.898 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-08T12:10:41.898 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-08T12:10:41.899 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-08T12:10:41.899 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-08T12:10:41.899 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-08T12:10:41.899 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-08T12:10:41.899 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-08T12:10:41.899 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-08T12:10:41.899 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-08T12:10:41.899 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-08T12:10:41.899 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-08T12:10:41.899 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-08T12:10:41.900 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-08T12:10:41.900 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-08T12:10:41.900 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-08T12:10:41.900 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-08T12:10:41.900 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-08T12:10:41.900 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-08T12:10:41.900 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-08T12:10:41.900 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-08T12:10:41.900 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-08T12:10:41.901 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-08T12:10:41.901 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-08T12:10:41.901 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-08T12:10:41.901 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-08T12:10:41.901 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-08T12:10:41.901 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-08T12:10:41.901 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-08T12:10:41.901 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-08T12:10:41.901 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-08T12:10:41.901 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-08T12:10:41.902 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-08T12:10:41.902 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-08T12:10:41.902 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-08T12:10:41.902 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-08T12:10:41.902 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-08T12:10:41.902 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-08T12:10:41.902 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-08T12:10:41.902 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-08T12:10:41.902 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-08T12:10:41.902 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-08T12:10:41.902 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-08T12:10:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-08T12:10:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-08T12:10:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-08T12:10:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-08T12:10:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-08T12:10:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-08T12:10:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-08T12:10:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-08T12:10:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-08T12:10:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-08T12:10:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-08T12:10:41.904 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-08T12:10:41.904 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-08T12:10:41.904 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-08T12:10:41.904 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-08T12:10:41.904 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-08T12:10:41.904 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-08T12:10:41.904 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-08T12:10:41.904 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-08T12:10:41.904 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-08T12:10:41.904 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-08T12:10:41.904 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-08T12:10:41.905 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-08T12:10:41.905 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-08T12:10:41.905 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-08T12:10:41.905 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-08T12:10:41.905 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-08T12:10:41.905 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-08T12:10:41.905 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-08T12:10:41.905 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-08T12:10:41.905 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-08T12:10:41.905 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-08T12:10:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-08T12:10:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-08T12:10:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-08T12:10:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-08T12:10:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-08T12:10:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-08T12:10:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-08T12:10:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-08T12:10:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-08T12:10:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-08T12:10:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-08T12:10:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-08T12:10:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-08T12:10:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-08T12:10:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-08T12:10:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-08T12:10:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-08T12:10:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-08T12:10:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-08T12:10:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-08T12:10:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-08T12:10:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-08T12:10:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-08T12:10:41.909 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-08T12:10:41.909 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-08T12:10:41.909 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-08T12:10:41.909 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-08T12:10:41.909 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-08T12:10:41.909 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-08T12:10:41.909 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-08T12:10:41.909 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-08T12:10:41.909 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-08T12:10:41.909 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-08T12:10:41.909 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-08T12:10:41.910 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-08T12:10:41.910 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-08T12:10:41.910 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-08T12:10:41.910 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-08T12:10:41.910 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-08T12:10:41.910 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-08T12:10:41.910 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-08T12:10:41.910 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-08T12:10:41.910 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-08T12:10:41.910 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-08T12:10:41.910 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-08T12:10:41.911 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-08T12:10:41.911 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-08T12:10:41.911 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-08T12:10:41.911 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-08T12:10:41.911 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-08T12:10:41.911 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-08T12:10:41.911 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-08T12:10:41.911 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-08T12:10:41.911 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-08T12:10:41.912 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-08T12:10:41.912 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-08T12:10:41.912 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-08T12:10:41.912 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-08T12:10:41.912 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-08T12:10:41.912 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-08T12:10:41.912 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-08T12:10:41.912 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-08T12:10:41.912 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-08T12:10:41.912 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-08T12:10:41.912 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-08T12:10:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-08T12:10:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-08T12:10:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-08T12:10:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-08T12:10:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-08T12:10:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-08T12:10:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-08T12:10:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-08T12:10:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-08T12:10:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-08T12:10:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-08T12:10:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-08T12:10:41.915 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-08T12:10:41.915 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-08T12:10:41.915 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-08T12:10:41.915 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-08T12:10:41.915 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-08T12:10:41.915 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-08T12:10:41.915 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-08T12:10:41.915 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-08T12:10:41.915 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-08T12:10:41.915 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-08T12:10:41.915 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-08T12:10:41.916 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-08T12:10:41.916 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-08T12:10:41.916 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-08T12:10:41.916 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-08T12:10:41.916 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-08T12:10:41.916 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-08T12:10:41.916 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-08T12:10:41.916 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-08T12:10:41.916 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-08T12:10:41.916 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-08T12:10:41.916 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-08T12:10:41.917 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-08T12:10:41.917 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-08T12:10:41.917 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-08T12:10:41.917 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-08T12:10:41.917 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-08T12:10:41.917 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-08T12:10:41.917 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-08T12:10:41.917 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-08T12:10:41.918 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-08T12:10:41.918 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-08T12:10:41.918 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-08T12:10:41.918 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-08T12:10:41.918 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-08T12:10:41.918 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-08T12:10:41.918 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-08T12:10:41.918 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-08T12:10:41.919 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-08T12:10:41.919 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-08T12:10:41.919 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-08T12:10:41.919 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-08T12:10:41.919 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-08T12:10:41.919 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-08T12:10:41.920 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-08T12:10:41.920 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-08T12:10:41.920 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-08T12:10:41.920 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-08T12:10:41.920 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-08T12:10:41.920 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-08T12:10:41.920 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-08T12:10:41.920 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-08T12:10:41.920 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-08T12:10:41.920 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-08T12:10:41.920 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-08T12:10:41.921 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-08T12:10:41.921 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-08T12:10:41.921 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-08T12:10:41.921 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-08T12:10:41.921 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-08T12:10:41.921 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-08T12:10:41.921 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-08T12:10:41.921 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-08T12:10:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-08T12:10:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-08T12:10:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-08T12:10:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-08T12:10:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-08T12:10:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-08T12:10:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-08T12:10:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-08T12:10:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-08T12:10:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-08T12:10:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-08T12:10:41.923 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-08T12:10:41.923 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-08T12:10:41.923 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-08T12:10:41.923 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-08T12:10:41.923 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-08T12:10:41.923 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-08T12:10:41.923 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-08T12:10:41.923 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-08T12:10:41.924 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-08T12:10:41.924 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-08T12:10:41.924 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-08T12:10:41.924 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-08T12:10:41.924 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-08T12:10:41.924 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-08T12:10:41.924 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-08T12:10:41.924 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-08T12:10:41.924 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-08T12:10:41.924 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-08T12:10:41.925 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-08T12:10:41.925 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-08T12:10:41.925 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-08T12:10:41.925 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-08T12:10:41.925 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-08T12:10:41.925 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-08T12:10:41.925 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-08T12:10:41.925 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-08T12:10:41.925 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-08T12:10:41.926 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-08T12:10:41.926 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-08T12:10:41.926 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-08T12:10:41.926 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-08T12:10:41.926 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-08T12:10:41.926 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-08T12:10:41.926 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-08T12:10:41.926 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-08T12:10:41.926 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-08T12:10:41.927 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-08T12:10:41.927 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-08T12:10:41.927 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-08T12:10:41.927 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-08T12:10:41.927 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-08T12:10:41.927 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-08T12:10:41.927 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-08T12:10:41.928 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-08T12:10:41.928 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-08T12:10:41.928 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-08T12:10:41.928 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-08T12:10:41.928 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-08T12:10:41.928 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-08T12:10:41.928 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-08T12:10:41.929 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-08T12:10:41.929 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-08T12:10:41.929 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-08T12:10:41.929 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-08T12:10:41.929 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-08T12:10:41.929 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-08T12:10:41.929 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-08T12:10:41.929 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-08T12:10:41.930 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-08T12:10:41.930 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-08T12:10:41.930 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-08T12:10:41.930 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-08T12:10:41.930 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-08T12:10:41.930 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-08T12:10:41.930 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-08T12:10:41.930 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-08T12:10:41.930 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-08T12:10:41.930 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-08T12:10:41.931 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-08T12:10:41.932 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-08T12:10:41.932 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-08T12:10:41.932 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-08T12:10:41.932 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-08T12:10:41.932 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-08T12:10:41.932 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-08T12:10:41.932 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-08T12:10:41.932 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-08T12:10:41.932 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-08T12:10:41.932 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-08T12:10:41.932 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-08T12:10:41.933 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-08T12:10:41.933 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-08T12:10:41.933 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-08T12:10:41.933 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-08T12:10:41.933 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-08T12:10:41.933 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-08T12:10:41.933 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-08T12:10:41.933 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-08T12:10:41.934 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-08T12:10:41.934 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-08T12:10:41.934 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-08T12:10:41.934 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-08T12:10:41.934 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-08T12:10:41.934 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-08T12:10:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-08T12:10:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-08T12:10:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-08T12:10:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-08T12:10:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-08T12:10:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-08T12:10:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-08T12:10:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-08T12:10:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-08T12:10:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-08T12:10:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-08T12:10:41.936 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-08T12:10:41.936 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-08T12:10:41.936 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-08T12:10:41.936 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-08T12:10:41.936 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-08T12:10:41.936 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-08T12:10:41.936 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-08T12:10:41.936 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-08T12:10:41.936 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-08T12:10:41.936 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-08T12:10:41.936 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-08T12:10:41.937 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-08T12:10:41.937 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-08T12:10:41.937 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-08T12:10:41.937 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-08T12:10:41.937 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-08T12:10:41.937 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-08T12:10:41.937 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-08T12:10:41.937 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-08T12:10:41.937 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-08T12:10:41.937 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-08T12:10:41.938 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-08T12:10:41.938 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-08T12:10:41.938 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-08T12:10:41.938 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-08T12:10:41.938 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-08T12:10:41.938 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-08T12:10:41.938 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-08T12:10:41.938 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-08T12:10:41.938 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-08T12:10:41.938 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-08T12:10:41.939 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-08T12:10:41.939 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-08T12:10:41.939 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-08T12:10:41.939 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-08T12:10:41.939 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-08T12:10:41.939 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-08T12:10:41.939 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-08T12:10:41.939 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-08T12:10:41.939 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-08T12:10:41.939 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-08T12:10:41.940 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-08T12:10:41.940 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-08T12:10:41.940 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-08T12:10:41.940 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-08T12:10:41.940 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-08T12:10:41.940 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-08T12:10:41.940 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-08T12:10:41.940 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-08T12:10:41.940 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-08T12:10:41.941 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-08T12:10:41.941 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-08T12:10:41.941 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-08T12:10:41.941 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-08T12:10:41.941 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-08T12:10:41.941 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-08T12:10:41.941 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-08T12:10:41.941 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-08T12:10:41.941 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-08T12:10:41.941 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-08T12:10:41.941 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-08T12:10:41.942 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-08T12:10:41.942 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-08T12:10:41.942 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-08T12:10:41.942 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-08T12:10:41.942 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-08T12:10:41.942 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-08T12:10:41.942 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-08T12:10:41.942 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-08T12:10:41.942 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-08T12:10:41.942 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-08T12:10:41.942 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-08T12:10:41.943 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-08T12:10:41.943 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-08T12:10:41.943 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-08T12:10:41.943 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-08T12:10:41.943 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-08T12:10:41.943 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-08T12:10:41.943 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-08T12:10:41.943 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-08T12:10:41.943 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-08T12:10:41.943 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-08T12:10:41.943 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-08T12:10:41.944 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-08T12:10:41.944 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-08T12:10:41.944 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-08T12:10:41.944 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-08T12:10:41.944 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-08T12:10:41.944 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-08T12:10:41.944 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-08T12:10:41.944 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-08T12:10:41.944 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-08T12:10:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-08T12:10:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-08T12:10:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-08T12:10:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-08T12:10:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-08T12:10:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-08T12:10:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-08T12:10:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-08T12:10:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-08T12:10:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-08T12:10:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-08T12:10:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-08T12:10:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-08T12:10:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-08T12:10:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-08T12:10:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-08T12:10:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-08T12:10:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-08T12:10:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-08T12:10:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-08T12:10:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-08T12:10:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-08T12:10:41.947 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-08T12:10:41.947 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-08T12:10:41.947 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-08T12:10:41.947 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-08T12:10:41.947 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-08T12:10:41.947 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-08T12:10:41.947 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-08T12:10:41.947 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-08T12:10:41.947 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-08T12:10:41.947 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-08T12:10:41.948 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-08T12:10:41.948 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-08T12:10:41.948 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-08T12:10:41.948 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-08T12:10:41.948 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-08T12:10:41.948 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-08T12:10:41.948 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-08T12:10:41.948 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-08T12:10:41.948 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-08T12:10:41.948 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-08T12:10:41.948 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-08T12:10:41.949 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-08T12:10:41.950 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-08T12:10:41.950 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-08T12:10:41.950 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-08T12:10:41.950 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-08T12:10:41.950 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-08T12:10:41.950 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-08T12:10:41.950 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-08T12:10:41.950 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-08T12:10:41.950 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-08T12:10:41.950 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-08T12:10:41.950 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-08T12:10:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-08T12:10:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-08T12:10:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-08T12:10:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-08T12:10:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-08T12:10:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-08T12:10:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-08T12:10:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-08T12:10:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-08T12:10:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-08T12:10:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-08T12:10:41.952 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-08T12:10:41.953 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-08T12:10:41.954 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-08T12:10:41.954 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-08T12:10:41.954 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-08T12:10:41.954 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-08T12:10:41.954 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-08T12:10:41.954 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-08T12:10:41.954 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-08T12:10:41.954 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-08T12:10:41.954 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-08T12:10:41.955 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-08T12:10:41.955 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-08T12:10:41.955 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-08T12:10:41.955 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-08T12:10:41.955 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-08T12:10:41.955 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-08T12:10:41.955 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-08T12:10:41.955 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-08T12:10:41.955 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-08T12:10:41.955 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-08T12:10:41.956 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-08T12:10:41.956 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-08T12:10:41.956 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-08T12:10:41.956 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-08T12:10:41.956 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-08T12:10:41.956 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-08T12:10:41.956 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-08T12:10:41.956 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-08T12:10:41.956 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-08T12:10:41.956 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-08T12:10:41.956 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-08T12:10:41.957 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-08T12:10:41.957 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-08T12:10:41.957 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-08T12:10:41.957 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-08T12:10:41.957 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-08T12:10:41.957 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-08T12:10:41.957 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-08T12:10:41.957 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-08T12:10:41.957 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-08T12:10:41.957 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-08T12:10:41.957 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-08T12:10:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-08T12:10:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-08T12:10:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-08T12:10:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-08T12:10:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-08T12:10:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-08T12:10:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-08T12:10:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-08T12:10:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-08T12:10:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-08T12:10:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-08T12:10:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-08T12:10:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-08T12:10:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-08T12:10:41.962 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-08T12:10:41.962 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-08T12:10:41.962 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-08T12:10:41.962 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-08T12:10:41.962 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-08T12:10:41.962 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-08T12:10:41.962 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-08T12:10:41.962 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-08T12:10:41.962 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-08T12:10:41.962 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-08T12:10:41.962 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-08T12:10:41.963 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-08T12:10:41.963 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-08T12:10:41.963 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-08T12:10:41.963 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-08T12:10:41.963 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-08T12:10:41.963 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-08T12:10:41.963 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-08T12:10:41.963 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-08T12:10:41.963 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-08T12:10:41.963 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-08T12:10:41.963 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-08T12:10:41.964 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-08T12:10:41.964 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-08T12:10:41.964 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-08T12:10:41.964 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-08T12:10:41.964 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-08T12:10:41.964 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-08T12:10:41.964 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-08T12:10:41.964 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-08T12:10:41.964 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-08T12:10:41.964 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-08T12:10:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-08T12:10:41.966 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-08T12:10:41.966 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-08T12:10:41.966 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-08T12:10:41.966 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-08T12:10:41.966 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-08T12:10:41.966 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-08T12:10:41.966 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-08T12:10:41.966 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-08T12:10:41.966 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-08T12:10:41.966 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-08T12:10:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-08T12:10:41.968 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-08T12:10:41.969 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-08T12:10:41.969 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-08T12:10:41.969 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-08T12:10:41.969 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-08T12:10:41.969 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-08T12:10:41.969 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-08T12:10:41.969 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-08T12:10:41.969 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-08T12:10:41.969 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-08T12:10:41.969 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-08T12:10:41.969 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-08T12:10:41.970 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-08T12:10:41.971 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-08T12:10:41.972 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-08T12:10:41.972 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-08T12:10:41.972 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-08T12:10:41.972 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-08T12:10:41.972 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-08T12:10:41.972 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-08T12:10:41.972 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-08T12:10:41.972 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-08T12:10:41.972 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-08T12:10:41.972 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-08T12:10:41.972 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-08T12:10:41.973 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-08T12:10:41.974 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-08T12:10:41.974 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-08T12:10:41.974 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-08T12:10:41.974 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-08T12:10:41.974 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-08T12:10:41.974 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-08T12:10:41.974 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-08T12:10:41.974 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-08T12:10:41.974 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-08T12:10:41.974 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-08T12:10:41.974 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-08T12:10:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-08T12:10:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-08T12:10:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-08T12:10:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-08T12:10:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-08T12:10:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-08T12:10:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-08T12:10:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-08T12:10:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-08T12:10:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-08T12:10:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-08T12:10:41.976 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-08T12:10:41.977 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-08T12:10:41.978 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-08T12:10:41.978 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-08T12:10:41.978 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-08T12:10:41.978 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-08T12:10:41.978 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-08T12:10:41.978 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-08T12:10:41.978 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-08T12:10:41.978 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-08T12:10:41.978 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-08T12:10:41.978 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-08T12:10:41.978 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-08T12:10:41.979 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-08T12:10:41.979 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-08T12:10:41.979 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-08T12:10:41.979 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-08T12:10:41.979 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-08T12:10:41.979 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-08T12:10:41.979 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-08T12:10:41.979 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-08T12:10:41.979 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-08T12:10:41.979 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-08T12:10:41.980 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-08T12:10:41.980 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-08T12:10:41.980 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-08T12:10:41.980 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-08T12:10:41.980 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-08T12:10:41.980 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-08T12:10:41.980 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-08T12:10:41.980 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-08T12:10:41.980 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-08T12:10:41.980 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-08T12:10:41.981 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-08T12:10:41.981 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-08T12:10:41.981 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-08T12:10:41.981 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-08T12:10:41.981 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-08T12:10:41.981 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-08T12:10:41.981 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-08T12:10:41.981 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-08T12:10:41.981 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-08T12:10:41.981 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-08T12:10:41.981 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-08T12:10:41.982 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-08T12:10:41.982 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-08T12:10:41.982 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-08T12:10:41.982 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-08T12:10:41.982 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-08T12:10:41.982 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-08T12:10:41.982 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-08T12:10:41.982 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-08T12:10:41.982 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-08T12:10:41.982 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-08T12:10:41.982 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-08T12:10:41.983 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-08T12:10:41.984 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-08T12:10:41.984 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-08T12:10:41.984 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-08T12:10:41.984 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-08T12:10:41.984 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-08T12:10:41.984 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-08T12:10:41.984 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-08T12:10:41.984 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-08T12:10:41.984 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-08T12:10:41.985 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-08T12:10:41.985 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-08T12:10:41.985 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-08T12:10:41.985 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-08T12:10:41.985 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-08T12:10:41.985 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-08T12:10:41.985 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-08T12:10:41.985 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-08T12:10:41.985 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-08T12:10:41.985 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-08T12:10:41.986 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-08T12:10:41.986 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-08T12:10:41.986 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-08T12:10:41.986 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-08T12:10:41.986 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-08T12:10:41.986 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-08T12:10:41.986 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-08T12:10:41.986 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-08T12:10:41.986 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-08T12:10:41.986 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-08T12:10:41.987 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-08T12:10:41.987 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-08T12:10:41.987 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-08T12:10:41.987 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-08T12:10:41.987 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-08T12:10:41.987 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-08T12:10:41.987 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-08T12:10:41.987 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-08T12:10:41.987 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-08T12:10:41.987 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-08T12:10:41.987 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-08T12:10:41.988 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-08T12:10:41.989 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-08T12:10:41.989 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-08T12:10:41.989 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-08T12:10:41.989 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-08T12:10:41.989 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-08T12:10:41.989 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-08T12:10:41.989 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-08T12:10:41.989 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-08T12:10:41.989 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-08T12:10:41.989 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-08T12:10:41.990 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-08T12:10:41.990 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-08T12:10:41.990 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-08T12:10:41.990 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-08T12:10:41.990 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-08T12:10:41.990 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-08T12:10:41.990 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-08T12:10:41.990 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-08T12:10:41.990 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-08T12:10:41.990 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-08T12:10:41.990 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-08T12:10:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-08T12:10:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-08T12:10:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-08T12:10:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-08T12:10:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-08T12:10:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-08T12:10:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-08T12:10:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-08T12:10:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-08T12:10:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-08T12:10:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-08T12:10:41.992 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-08T12:10:41.993 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-08T12:10:41.993 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-08T12:10:41.993 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-08T12:10:41.993 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-08T12:10:41.993 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-08T12:10:41.993 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-08T12:10:41.993 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-08T12:10:41.993 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-08T12:10:41.993 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-08T12:10:41.993 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-08T12:10:41.993 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-08T12:10:41.994 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-08T12:10:41.994 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-08T12:10:41.994 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-08T12:10:41.994 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-08T12:10:41.994 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-08T12:10:41.994 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-08T12:10:41.994 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-08T12:10:41.994 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-08T12:10:41.994 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-08T12:10:41.994 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-08T12:10:41.994 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-08T12:10:41.995 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-08T12:10:41.996 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-08T12:10:41.996 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-08T12:10:41.996 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-08T12:10:41.996 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-08T12:10:41.996 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-08T12:10:41.996 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-08T12:10:41.996 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-08T12:10:41.996 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-08T12:10:41.996 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-08T12:10:41.996 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-08T12:10:41.997 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-08T12:10:41.997 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-08T12:10:41.997 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-08T12:10:41.997 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-08T12:10:41.997 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-08T12:10:41.997 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-08T12:10:41.997 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-08T12:10:41.997 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-08T12:10:41.997 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-08T12:10:41.997 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-08T12:10:41.997 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-08T12:10:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-08T12:10:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-08T12:10:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-08T12:10:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-08T12:10:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-08T12:10:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-08T12:10:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-08T12:10:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-08T12:10:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-08T12:10:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-08T12:10:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-08T12:10:41.999 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-08T12:10:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-08T12:10:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-08T12:10:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-08T12:10:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-08T12:10:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-08T12:10:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-08T12:10:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-08T12:10:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-08T12:10:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-08T12:10:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-08T12:10:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-08T12:10:42.001 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-08T12:10:42.001 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-08T12:10:42.001 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-08T12:10:42.002 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-08T12:10:42.002 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-08T12:10:42.002 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-08T12:10:42.002 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-08T12:10:42.002 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-08T12:10:42.002 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-08T12:10:42.002 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-08T12:10:42.002 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-08T12:10:42.002 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-08T12:10:42.002 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-08T12:10:42.003 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-08T12:10:42.003 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-08T12:10:42.003 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-08T12:10:42.003 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-08T12:10:42.003 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-08T12:10:42.003 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-08T12:10:42.003 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-08T12:10:42.003 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-08T12:10:42.003 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-08T12:10:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-08T12:10:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-08T12:10:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-08T12:10:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-08T12:10:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-08T12:10:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-08T12:10:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-08T12:10:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-08T12:10:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-08T12:10:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-08T12:10:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-08T12:10:42.005 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-08T12:10:42.005 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-08T12:10:42.005 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-08T12:10:42.005 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-08T12:10:42.005 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-08T12:10:42.005 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-08T12:10:42.005 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-08T12:10:42.005 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-08T12:10:42.005 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-08T12:10:42.006 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-08T12:10:42.006 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-08T12:10:42.006 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-08T12:10:42.006 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-08T12:10:42.006 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-08T12:10:42.006 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-08T12:10:42.006 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-08T12:10:42.006 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-08T12:10:42.006 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-08T12:10:42.006 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-08T12:10:42.007 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-08T12:10:42.008 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-08T12:10:42.008 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-08T12:10:42.008 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-08T12:10:42.008 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-08T12:10:42.008 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-08T12:10:42.008 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-08T12:10:42.008 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-08T12:10:42.008 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-08T12:10:42.008 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-08T12:10:42.008 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-08T12:10:42.008 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-08T12:10:42.009 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-08T12:10:42.009 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-08T12:10:42.009 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-08T12:10:42.009 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-08T12:10:42.009 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-08T12:10:42.009 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-08T12:10:42.009 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-08T12:10:42.009 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-08T12:10:42.009 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-08T12:10:42.009 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-08T12:10:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-08T12:10:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-08T12:10:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-08T12:10:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-08T12:10:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-08T12:10:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-08T12:10:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-08T12:10:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-08T12:10:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-08T12:10:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-08T12:10:42.011 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-08T12:10:42.011 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-08T12:10:42.011 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-08T12:10:42.011 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-08T12:10:42.011 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-08T12:10:42.011 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-08T12:10:42.011 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-08T12:10:42.011 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-08T12:10:42.011 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-08T12:10:42.011 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-08T12:10:42.011 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-08T12:10:42.012 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-08T12:10:42.012 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-08T12:10:42.012 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-08T12:10:42.012 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-08T12:10:42.012 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-08T12:10:42.012 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-08T12:10:42.012 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-08T12:10:42.012 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-08T12:10:42.012 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-08T12:10:42.012 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-08T12:10:42.012 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-08T12:10:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-08T12:10:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-08T12:10:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-08T12:10:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-08T12:10:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-08T12:10:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-08T12:10:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-08T12:10:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-08T12:10:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-08T12:10:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-08T12:10:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-08T12:10:42.014 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-08T12:10:42.014 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-08T12:10:42.014 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-08T12:10:42.014 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-08T12:10:42.014 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-08T12:10:42.014 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-08T12:10:42.014 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-08T12:10:42.014 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-08T12:10:42.014 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-08T12:10:42.014 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-08T12:10:42.014 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-08T12:10:42.015 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-08T12:10:42.015 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-08T12:10:42.015 DEBUG:teuthology.orchestra.run.smithi059:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-08T12:10:42.044 INFO:teuthology.orchestra.run.smithi059.stdout:postinstall scriptlet (using /bin/sh): 2023-10-08T12:10:42.044 INFO:teuthology.orchestra.run.smithi059.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-08T12:10:42.044 INFO:teuthology.orchestra.run.smithi059.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T12:10:42.044 INFO:teuthology.orchestra.run.smithi059.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T12:10:42.044 INFO:teuthology.orchestra.run.smithi059.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-08T12:10:42.044 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T12:10:42.045 INFO:teuthology.orchestra.run.smithi059.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T12:10:42.045 INFO:teuthology.orchestra.run.smithi059.stdout:fi 2023-10-08T12:10:42.045 INFO:teuthology.orchestra.run.smithi059.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-08T12:10:42.045 INFO:teuthology.orchestra.run.smithi059.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-08T12:10:42.045 INFO:teuthology.orchestra.run.smithi059.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-08T12:10:42.045 INFO:teuthology.orchestra.run.smithi059.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-08T12:10:42.045 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-08T12:10:42.045 INFO:teuthology.orchestra.run.smithi059.stdout:fi 2023-10-08T12:10:42.045 INFO:teuthology.orchestra.run.smithi059.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-08T12:10:42.045 INFO:teuthology.orchestra.run.smithi059.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-08T12:10:42.045 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-08T12:10:42.046 INFO:teuthology.orchestra.run.smithi059.stdout:fi 2023-10-08T12:10:42.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -qi grub2-tools 2023-10-08T12:10:42.127 INFO:teuthology.orchestra.run.smithi059.stdout:Name : grub2-tools 2023-10-08T12:10:42.128 INFO:teuthology.orchestra.run.smithi059.stdout:Epoch : 1 2023-10-08T12:10:42.128 INFO:teuthology.orchestra.run.smithi059.stdout:Version : 2.02 2023-10-08T12:10:42.128 INFO:teuthology.orchestra.run.smithi059.stdout:Release : 123.el8 2023-10-08T12:10:42.128 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: x86_64 2023-10-08T12:10:42.128 INFO:teuthology.orchestra.run.smithi059.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-08T12:10:42.128 INFO:teuthology.orchestra.run.smithi059.stdout:Group : System Environment/Base 2023-10-08T12:10:42.128 INFO:teuthology.orchestra.run.smithi059.stdout:Size : 9265450 2023-10-08T12:10:42.128 INFO:teuthology.orchestra.run.smithi059.stdout:License : GPLv3+ 2023-10-08T12:10:42.128 INFO:teuthology.orchestra.run.smithi059.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-08T12:10:42.128 INFO:teuthology.orchestra.run.smithi059.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout:Relocations : (not relocatable) 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout:Packager : Red Hat, Inc. 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout:Vendor : Red Hat, Inc. 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout:Summary : Support tools for GRUB. 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout:Description : 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-08T12:10:42.129 INFO:teuthology.orchestra.run.smithi059.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-08T12:10:42.130 INFO:teuthology.orchestra.run.smithi059.stdout:hardware devices. 2023-10-08T12:10:42.130 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:10:42.130 INFO:teuthology.orchestra.run.smithi059.stdout:This subpackage provides tools for support of all platforms. 2023-10-08T12:10:42.131 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-08T12:10:42.131 INFO:teuthology.task.kernel:Updating grub on smithi059 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-08T12:10:42.131 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-08T12:10:44.955 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2023-10-08T12:10:47.150 INFO:teuthology.orchestra.run.smithi059.stderr:done 2023-10-08T12:10:47.152 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-10-08T12:10:47.170 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.PMK9uINi91 2023-10-08T12:10:47.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PMK9uINi91 2023-10-08T12:10:47.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.PMK9uINi91 2023-10-08T12:10:47.422 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.PMK9uINi91 is 6KB 2023-10-08T12:10:47.473 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.PMK9uINi91 2023-10-08T12:10:47.489 DEBUG:teuthology.orchestra.run.smithi059:> sudo /bin/ls /boot/loader/entries || true 2023-10-08T12:10:47.649 INFO:teuthology.orchestra.run.smithi059.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-08T12:10:47.649 INFO:teuthology.orchestra.run.smithi059.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-08T12:10:47.649 INFO:teuthology.orchestra.run.smithi059.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-10-08T12:10:47.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-10-08T12:10:47.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2023-10-08T12:11:17.768 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-08T12:11:17.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-08T12:11:17.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:12:17.772 DEBUG:teuthology.orchestra.remote:timed out 2023-10-08T12:12:26.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-08T12:12:26.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:12:30.200 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-08T12:12:30.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-08T12:12:30.737 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-08T12:12:30.737 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2023-10-08T12:12:30.781 INFO:teuthology.orchestra.run.smithi059.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-08T12:12:30.781 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-08T12:12:30.781 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T12:12:30.782 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-08T12:12:31.783 DEBUG:teuthology.parallel:result is None 2023-10-08T12:12:31.783 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T12:12:31.791 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T12:12:31.791 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T12:12:31.796 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T12:12:31.799 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T12:12:31.841 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T12:12:31.849 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T12:12:31.881 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T12:12:31.881 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T12:12:31.886 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T12:12:31.888 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T12:12:31.946 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T12:12:31.953 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T12:12:31.953 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T12:12:31.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:12:31.974 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T12:12:31.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:12:31.993 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T12:12:31.997 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T12:12:32.016 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T12:12:32.051 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:12:32.065 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:12:32.078 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:12:32.096 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:12:32.222 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:12:32.326 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:12:32.330 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T12:12:32.337 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T12:12:32.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T12:12:32.342 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T12:12:32.344 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T12:12:32.411 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T12:12:32.426 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T12:12:32.426 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T12:12:32.431 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T12:12:32.435 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T12:12:32.469 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:12:32.581 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:12:32.656 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:12:32.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:12:32.798 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:12:32.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T12:12:32.867 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:12:32.914 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:12:32.965 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:12:33.054 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:12:33.099 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-08T12:12:33.100 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T12:12:33.178 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:12:33.226 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:12:33.278 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:12:33.364 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:12:33.407 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-08T12:12:33.408 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T12:12:33.489 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2023-10-08T12:12:33.494 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2023-10-08T12:12:33.496 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2023-10-08T12:12:33.567 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T12:12:33.595 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T12:12:33.616 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T12:12:33.981 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T12:12:33.993 INFO:teuthology.task.internal:Starting timer... 2023-10-08T12:12:33.993 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T12:12:34.039 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T12:12:34.099 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T12:12:34.100 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2023-10-08T12:12:34.226 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2023-10-08T12:12:34.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2023-10-08T12:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2023-10-08T12:12:34.288 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2023-10-08T12:12:34.360 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2023-10-08T12:12:34.362 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T12:12:34.362 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2023-10-08T12:12:34.417 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2023-10-08T12:12:34.418 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2023-10-08T12:12:34.441 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2023-10-08T12:12:34.442 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2023-10-08T12:12:34.464 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2023-10-08T12:12:34.465 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2023-10-08T12:12:34.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T12:12:34.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:12:34.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T12:12:34.567 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:12:34.567 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T12:12:34.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:12:34.595 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T12:12:34.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2023-10-08T12:12:34.671 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2023-10-08T12:12:34.699 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2023-10-08T12:12:34.733 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T12:12:34.744 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-08T12:12:34.744 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T12:12:34.760 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T12:12:34.761 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi092.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T12:26:35.742 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2023-10-08T12:26:35.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-08T12:26:35.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:26:35.834 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-08T12:26:35.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-08T12:26:35.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-08T12:26:35.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:26:35.977 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-10-08T12:26:36.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-08T12:26:36.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-10-08T12:26:36.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:26:36.118 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-10-08T12:26:36.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-10-08T12:26:36.147 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T12:26:36.157 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T12:26:36.157 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T12:26:36.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T12:26:36.162 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T12:26:36.162 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T12:26:36.164 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T12:26:36.164 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T12:26:36.199 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T12:26:36.217 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T12:26:36.221 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T12:26:36.234 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T12:26:36.237 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T12:26:36.269 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T12:26:36.291 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2023-10-08T12:26:36.305 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2023-10-08T12:26:36.308 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2023-10-08T12:26:36.321 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2023-10-08T12:26:36.322 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T12:26:36.336 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T12:26:36.339 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T12:26:36.350 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T12:26:36.371 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2023-10-08T12:26:36.401 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2023-10-08T12:26:36.417 INFO:teuthology.orchestra.run.smithi173.stderr:bash: ntpq: command not found 2023-10-08T12:26:36.420 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-10-08T12:26:36.420 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T12:26:36.421 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2023-10-08T12:26:36.421 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.421 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.421 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.421 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.423 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T12:26:36.423 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-08T12:26:36.423 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.423 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.424 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.424 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.436 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T12:26:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T12:26:36.563 INFO:teuthology.orchestra.run.smithi059.stderr:bash: ntpq: command not found 2023-10-08T12:26:36.571 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T12:26:36.571 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2023-10-08T12:26:36.571 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.571 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.571 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.571 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:26:36.572 INFO:teuthology.run_tasks:Running task pexec... 2023-10-08T12:26:36.582 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-08T12:26:36.582 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi059.front.sepia.ceph.com 2023-10-08T12:26:36.582 DEBUG:teuthology.orchestra.run.smithi059:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T12:26:36.583 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi092.front.sepia.ceph.com 2023-10-08T12:26:36.583 DEBUG:teuthology.orchestra.run.smithi092:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T12:26:36.583 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi173.front.sepia.ceph.com 2023-10-08T12:26:36.583 DEBUG:teuthology.orchestra.run.smithi173:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T12:26:36.955 INFO:teuthology.orchestra.run.smithi173.stdout:Updating Subscription Management repositories. 2023-10-08T12:26:36.980 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-08T12:26:37.100 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-10-08T12:26:38.394 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:05:13 ago on Sun 08 Oct 2023 12:21:24 PM UTC. 2023-10-08T12:26:38.459 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:05:13 ago on Sun 08 Oct 2023 12:21:25 PM UTC. 2023-10-08T12:26:38.556 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:02:05 ago on Sun 08 Oct 2023 12:24:33 PM UTC. 2023-10-08T12:26:40.236 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-08T12:26:40.237 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-08T12:26:40.237 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2023-10-08T12:26:40.237 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-08T12:26:40.238 INFO:teuthology.orchestra.run.smithi092.stdout:Resetting modules: 2023-10-08T12:26:40.238 INFO:teuthology.orchestra.run.smithi092.stdout: container-tools 2023-10-08T12:26:40.238 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:26:40.238 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-08T12:26:40.238 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-08T12:26:40.238 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:26:40.270 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-10-08T12:26:40.271 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-10-08T12:26:40.271 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2023-10-08T12:26:40.271 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-10-08T12:26:40.271 INFO:teuthology.orchestra.run.smithi173.stdout:Resetting modules: 2023-10-08T12:26:40.272 INFO:teuthology.orchestra.run.smithi173.stdout: container-tools 2023-10-08T12:26:40.272 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:26:40.272 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-10-08T12:26:40.272 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-10-08T12:26:40.272 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:26:40.556 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-08T12:26:40.557 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-08T12:26:40.558 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2023-10-08T12:26:40.558 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-08T12:26:40.558 INFO:teuthology.orchestra.run.smithi059.stdout:Resetting modules: 2023-10-08T12:26:40.558 INFO:teuthology.orchestra.run.smithi059.stdout: container-tools 2023-10-08T12:26:40.558 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:26:40.558 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-10-08T12:26:40.558 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-08T12:26:40.558 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:26:41.228 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:05:15 ago on Sun 08 Oct 2023 12:21:25 PM UTC. 2023-10-08T12:26:41.238 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:05:16 ago on Sun 08 Oct 2023 12:21:24 PM UTC. 2023-10-08T12:26:41.842 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:02:08 ago on Sun 08 Oct 2023 12:24:33 PM UTC. 2023-10-08T12:26:49.242 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-08T12:26:49.866 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-10-08T12:26:50.048 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-08T12:26:50.494 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-08T12:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:02:18 ago on Sun 08 Oct 2023 12:24:33 PM UTC. 2023-10-08T12:26:51.987 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:05:26 ago on Sun 08 Oct 2023 12:21:25 PM UTC. 2023-10-08T12:26:53.636 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-10-08T12:26:53.720 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-08T12:26:53.734 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-08T12:26:53.825 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================================ 2023-10-08T12:26:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-10-08T12:26:53.825 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================================ 2023-10-08T12:26:53.825 INFO:teuthology.orchestra.run.smithi059.stdout:Installing group/module packages: 2023-10-08T12:26:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T12:26:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T12:26:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T12:26:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T12:26:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T12:26:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T12:26:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T12:26:53.826 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-10-08T12:26:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T12:26:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T12:26:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T12:26:53.826 INFO:teuthology.orchestra.run.smithi059.stdout:Installing module profiles: 2023-10-08T12:26:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: container-tools/common 2023-10-08T12:26:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:26:53.827 INFO:teuthology.orchestra.run.smithi059.stdout:Enabling module streams: 2023-10-08T12:26:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: container-tools rhel8 2023-10-08T12:26:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:26:53.827 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-10-08T12:26:53.827 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================================ 2023-10-08T12:26:53.827 INFO:teuthology.orchestra.run.smithi059.stdout:Install 10 Packages 2023-10-08T12:26:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:26:53.828 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 18 M 2023-10-08T12:26:53.828 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 65 M 2023-10-08T12:26:53.828 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-10-08T12:26:53.831 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================================ 2023-10-08T12:26:53.831 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-10-08T12:26:53.831 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================================ 2023-10-08T12:26:53.831 INFO:teuthology.orchestra.run.smithi092.stdout:Installing group/module packages: 2023-10-08T12:26:53.831 INFO:teuthology.orchestra.run.smithi092.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T12:26:53.831 INFO:teuthology.orchestra.run.smithi092.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T12:26:53.831 INFO:teuthology.orchestra.run.smithi092.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T12:26:53.831 INFO:teuthology.orchestra.run.smithi092.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T12:26:53.831 INFO:teuthology.orchestra.run.smithi092.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T12:26:53.831 INFO:teuthology.orchestra.run.smithi092.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T12:26:53.832 INFO:teuthology.orchestra.run.smithi092.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T12:26:53.832 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-10-08T12:26:53.832 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T12:26:53.832 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T12:26:53.832 INFO:teuthology.orchestra.run.smithi092.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T12:26:53.832 INFO:teuthology.orchestra.run.smithi092.stdout:Installing module profiles: 2023-10-08T12:26:53.832 INFO:teuthology.orchestra.run.smithi092.stdout: container-tools/common 2023-10-08T12:26:53.832 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:26:53.832 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling module streams: 2023-10-08T12:26:53.832 INFO:teuthology.orchestra.run.smithi092.stdout: container-tools rhel8 2023-10-08T12:26:53.832 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:26:53.833 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-08T12:26:53.833 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================================ 2023-10-08T12:26:53.833 INFO:teuthology.orchestra.run.smithi092.stdout:Install 10 Packages 2023-10-08T12:26:53.833 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:26:53.833 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 18 M 2023-10-08T12:26:53.833 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 65 M 2023-10-08T12:26:53.834 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-10-08T12:26:54.073 INFO:teuthology.orchestra.run.smithi059.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 384 kB/s | 94 kB 00:00 2023-10-08T12:26:54.097 INFO:teuthology.orchestra.run.smithi173.stdout:Updating Subscription Management repositories. 2023-10-08T12:26:54.099 INFO:teuthology.orchestra.run.smithi092.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 153 kB/s | 41 kB 00:00 2023-10-08T12:26:54.116 INFO:teuthology.orchestra.run.smithi092.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 88 kB/s | 25 kB 00:00 2023-10-08T12:26:54.157 INFO:teuthology.orchestra.run.smithi059.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 76 kB/s | 25 kB 00:00 2023-10-08T12:26:54.182 INFO:teuthology.orchestra.run.smithi059.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 115 kB/s | 41 kB 00:00 2023-10-08T12:26:54.266 INFO:teuthology.orchestra.run.smithi092.stdout:(3/10): udica-0.2.6-4.module+el8.6.0+16771+28df 296 kB/s | 49 kB 00:00 2023-10-08T12:26:54.300 INFO:teuthology.orchestra.run.smithi092.stdout:(4/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.8 MB/s | 524 kB 00:00 2023-10-08T12:26:54.324 INFO:teuthology.orchestra.run.smithi059.stdout:(4/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.1 MB/s | 524 kB 00:00 2023-10-08T12:26:54.326 INFO:teuthology.orchestra.run.smithi092.stdout:(5/10): python3-pyxdg-0.25-16.el8.noarch.rpm 191 kB/s | 94 kB 00:00 2023-10-08T12:26:54.341 INFO:teuthology.orchestra.run.smithi059.stdout:(5/10): udica-0.2.6-4.module+el8.6.0+16771+28df 184 kB/s | 49 kB 00:00 2023-10-08T12:26:54.542 INFO:teuthology.orchestra.run.smithi059.stdout:(6/10): buildah-1.26.2-1.module+el8.6.0+16771+2 22 MB/s | 8.0 MB 00:00 2023-10-08T12:26:54.542 INFO:teuthology.orchestra.run.smithi092.stdout:(6/10): buildah-1.26.2-1.module+el8.6.0+16771+2 29 MB/s | 8.0 MB 00:00 2023-10-08T12:26:54.568 INFO:teuthology.orchestra.run.smithi092.stdout:(7/10): python3-podman-4.0.1-1.module+el8.6.0+1 559 kB/s | 149 kB 00:00 2023-10-08T12:26:54.593 INFO:teuthology.orchestra.run.smithi092.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 797 kB/s | 213 kB 00:00 2023-10-08T12:26:54.594 INFO:teuthology.orchestra.run.smithi059.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 842 kB/s | 213 kB 00:00 2023-10-08T12:26:54.626 INFO:teuthology.orchestra.run.smithi059.stdout:(8/10): python3-podman-4.0.1-1.module+el8.6.0+1 497 kB/s | 149 kB 00:00 2023-10-08T12:26:54.851 INFO:teuthology.orchestra.run.smithi059.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 8.6 MB/s | 2.2 MB 00:00 2023-10-08T12:26:54.851 INFO:teuthology.orchestra.run.smithi092.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 7.7 MB/s | 2.2 MB 00:00 2023-10-08T12:26:54.952 INFO:teuthology.orchestra.run.smithi092.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 17 MB/s | 7.0 MB 00:00 2023-10-08T12:26:54.953 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:26:54.953 INFO:teuthology.orchestra.run.smithi092.stdout:Total 16 MB/s | 18 MB 00:01 2023-10-08T12:26:55.018 INFO:teuthology.orchestra.run.smithi059.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 15 MB/s | 7.0 MB 00:00 2023-10-08T12:26:55.018 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:26:55.018 INFO:teuthology.orchestra.run.smithi059.stdout:Total 15 MB/s | 18 MB 00:01 2023-10-08T12:26:55.154 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-10-08T12:26:55.172 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-10-08T12:26:55.172 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-10-08T12:26:55.355 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-10-08T12:26:55.361 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-10-08T12:26:55.362 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-10-08T12:26:55.383 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-10-08T12:26:55.383 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-10-08T12:26:55.624 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:05:31 ago on Sun 08 Oct 2023 12:21:24 PM UTC. 2023-10-08T12:26:55.898 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-10-08T12:26:55.899 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-10-08T12:26:55.903 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-10-08T12:26:56.080 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T12:26:56.229 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:26:56.415 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T12:26:56.505 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-10-08T12:26:56.635 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T12:26:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T12:26:56.841 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:26:56.966 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T12:26:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T12:26:57.320 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T12:26:57.351 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-10-08T12:26:57.443 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================================================ 2023-10-08T12:26:57.444 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-10-08T12:26:57.444 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================================================ 2023-10-08T12:26:57.444 INFO:teuthology.orchestra.run.smithi173.stdout:Installing group/module packages: 2023-10-08T12:26:57.444 INFO:teuthology.orchestra.run.smithi173.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T12:26:57.444 INFO:teuthology.orchestra.run.smithi173.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T12:26:57.444 INFO:teuthology.orchestra.run.smithi173.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T12:26:57.444 INFO:teuthology.orchestra.run.smithi173.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T12:26:57.444 INFO:teuthology.orchestra.run.smithi173.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T12:26:57.444 INFO:teuthology.orchestra.run.smithi173.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T12:26:57.445 INFO:teuthology.orchestra.run.smithi173.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T12:26:57.445 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-10-08T12:26:57.445 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T12:26:57.445 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T12:26:57.445 INFO:teuthology.orchestra.run.smithi173.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T12:26:57.445 INFO:teuthology.orchestra.run.smithi173.stdout:Installing module profiles: 2023-10-08T12:26:57.445 INFO:teuthology.orchestra.run.smithi173.stdout: container-tools/common 2023-10-08T12:26:57.445 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:26:57.445 INFO:teuthology.orchestra.run.smithi173.stdout:Enabling module streams: 2023-10-08T12:26:57.445 INFO:teuthology.orchestra.run.smithi173.stdout: container-tools rhel8 2023-10-08T12:26:57.445 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:26:57.446 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-10-08T12:26:57.446 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================================================ 2023-10-08T12:26:57.446 INFO:teuthology.orchestra.run.smithi173.stdout:Install 10 Packages 2023-10-08T12:26:57.446 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:26:57.446 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 18 M 2023-10-08T12:26:57.447 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 65 M 2023-10-08T12:26:57.447 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-10-08T12:26:57.641 INFO:teuthology.orchestra.run.smithi173.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 127 kB/s | 25 kB 00:00 2023-10-08T12:26:57.680 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T12:26:57.690 INFO:teuthology.orchestra.run.smithi173.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 167 kB/s | 41 kB 00:00 2023-10-08T12:26:57.716 INFO:teuthology.orchestra.run.smithi173.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 347 kB/s | 94 kB 00:00 2023-10-08T12:26:57.719 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T12:26:57.750 INFO:teuthology.orchestra.run.smithi173.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 454 kB/s | 49 kB 00:00 2023-10-08T12:26:57.801 INFO:teuthology.orchestra.run.smithi173.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 4.6 MB/s | 524 kB 00:00 2023-10-08T12:26:57.893 INFO:teuthology.orchestra.run.smithi173.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.0 MB/s | 149 kB 00:00 2023-10-08T12:26:58.026 INFO:teuthology.orchestra.run.smithi173.stdout:(7/10): buildah-1.26.2-1.module+el8.6.0+16771+2 26 MB/s | 8.0 MB 00:00 2023-10-08T12:26:58.051 INFO:teuthology.orchestra.run.smithi173.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 851 kB/s | 213 kB 00:00 2023-10-08T12:26:58.202 INFO:teuthology.orchestra.run.smithi173.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 23 MB/s | 7.0 MB 00:00 2023-10-08T12:26:58.252 INFO:teuthology.orchestra.run.smithi173.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 9.7 MB/s | 2.2 MB 00:00 2023-10-08T12:26:58.252 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:26:58.253 INFO:teuthology.orchestra.run.smithi173.stdout:Total 23 MB/s | 18 MB 00:00 2023-10-08T12:26:58.450 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-10-08T12:26:58.468 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-10-08T12:26:58.468 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-10-08T12:26:58.543 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T12:26:58.577 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T12:26:58.650 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-10-08T12:26:58.654 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-10-08T12:26:58.770 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T12:26:58.928 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T12:26:59.114 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:26:59.173 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-10-08T12:26:59.356 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T12:26:59.383 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:26:59.383 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T12:26:59.383 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:26:59.383 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T12:26:59.383 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T12:26:59.383 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T12:26:59.384 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T12:26:59.384 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T12:26:59.384 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T12:26:59.384 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T12:26:59.503 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:26:59.672 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T12:26:59.673 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T12:26:59.884 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T12:26:59.943 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T12:27:00.121 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T12:27:00.232 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T12:27:00.362 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:27:00.601 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T12:27:00.602 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:05:35 ago on Sun 08 Oct 2023 12:21:25 PM UTC. 2023-10-08T12:27:00.764 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:27:00.764 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T12:27:00.764 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:27:00.765 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T12:27:00.765 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T12:27:00.765 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T12:27:00.765 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T12:27:00.765 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T12:27:00.765 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T12:27:00.765 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T12:27:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T12:27:01.904 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T12:27:02.163 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T12:27:02.294 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T12:27:02.295 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:02:28 ago on Sun 08 Oct 2023 12:24:33 PM UTC. 2023-10-08T12:27:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T12:27:02.479 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:27:02.750 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:27:02.751 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T12:27:02.751 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:27:02.751 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T12:27:02.751 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T12:27:02.751 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T12:27:02.751 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T12:27:02.751 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T12:27:02.751 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T12:27:02.751 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T12:27:03.954 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T12:27:03.954 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:05:39 ago on Sun 08 Oct 2023 12:21:24 PM UTC. 2023-10-08T12:27:07.658 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-10-08T12:27:07.861 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:27:07.861 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-10-08T12:27:07.861 INFO:teuthology.orchestra.run.smithi092.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:07.861 INFO:teuthology.orchestra.run.smithi092.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:27:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T12:27:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T12:27:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T12:27:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:27:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T12:27:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:27:07.862 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-08T12:27:08.023 DEBUG:teuthology.parallel:result is None 2023-10-08T12:27:11.681 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2023-10-08T12:27:11.918 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:27:11.919 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-10-08T12:27:11.919 INFO:teuthology.orchestra.run.smithi059.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:11.919 INFO:teuthology.orchestra.run.smithi059.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:27:11.919 INFO:teuthology.orchestra.run.smithi059.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:11.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T12:27:11.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T12:27:11.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T12:27:11.919 INFO:teuthology.orchestra.run.smithi059.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:11.919 INFO:teuthology.orchestra.run.smithi059.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:11.919 INFO:teuthology.orchestra.run.smithi059.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:27:11.920 INFO:teuthology.orchestra.run.smithi059.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T12:27:11.920 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:27:11.920 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-08T12:27:12.160 DEBUG:teuthology.parallel:result is None 2023-10-08T12:27:12.670 INFO:teuthology.orchestra.run.smithi173.stdout:Installed products updated. 2023-10-08T12:27:12.877 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:27:12.878 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-10-08T12:27:12.878 INFO:teuthology.orchestra.run.smithi173.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:12.878 INFO:teuthology.orchestra.run.smithi173.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:27:12.878 INFO:teuthology.orchestra.run.smithi173.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:12.878 INFO:teuthology.orchestra.run.smithi173.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T12:27:12.878 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T12:27:12.878 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T12:27:12.878 INFO:teuthology.orchestra.run.smithi173.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:12.878 INFO:teuthology.orchestra.run.smithi173.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:27:12.878 INFO:teuthology.orchestra.run.smithi173.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:27:12.878 INFO:teuthology.orchestra.run.smithi173.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T12:27:12.879 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:27:12.879 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-10-08T12:27:13.070 DEBUG:teuthology.parallel:result is None 2023-10-08T12:27:13.070 INFO:teuthology.run_tasks:Running task install... 2023-10-08T12:27:13.078 DEBUG:teuthology.task.install:project ceph 2023-10-08T12:27:13.078 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}} 2023-10-08T12:27:13.079 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'} 2023-10-08T12:27:13.079 INFO:teuthology.task.install:Using flavor: default 2023-10-08T12:27:13.084 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T12:27:13.085 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T12:27:13.085 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T12:27:13.085 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:27:13.088 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T12:27:13.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:27:13.089 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T12:27:13.089 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:27:13.239 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T12:27:13.239 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T12:27:13.240 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T12:27:13.240 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T12:27:13.349 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T12:27:13.350 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-08T12:27:13.350 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T12:27:13.376 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T12:27:13.377 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T12:27:13.407 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T12:27:13.407 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T12:27:13.445 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T12:27:13.496 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T12:27:13.496 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:27:13.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T12:27:13.523 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T12:27:13.572 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T12:27:13.573 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T12:27:13.589 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2023-10-08T12:27:13.590 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2023-10-08T12:27:13.669 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T12:27:13.669 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-08T12:27:13.670 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T12:27:13.686 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T12:27:13.696 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T12:27:13.696 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T12:27:13.764 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T12:27:13.784 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T12:27:13.840 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T12:27:13.852 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2023-10-08T12:27:13.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2023-10-08T12:27:13.905 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2023-10-08T12:27:13.907 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2023-10-08T12:27:13.977 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-08T12:27:14.320 INFO:teuthology.orchestra.run.smithi173.stdout:Updating Subscription Management repositories. 2023-10-08T12:27:14.334 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-10-08T12:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:44 files removed 2023-10-08T12:27:15.228 INFO:teuthology.orchestra.run.smithi173.stdout:44 files removed 2023-10-08T12:27:15.276 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T12:27:15.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T12:27:15.431 INFO:teuthology.orchestra.run.smithi059.stdout:44 files removed 2023-10-08T12:27:15.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T12:27:15.610 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-08T12:27:15.620 INFO:teuthology.orchestra.run.smithi173.stdout:Updating Subscription Management repositories. 2023-10-08T12:27:15.971 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-10-08T12:27:17.005 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 313 kB/s | 81 kB 00:00 2023-10-08T12:27:17.299 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 160 kB/s | 81 kB 00:00 2023-10-08T12:27:17.541 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 45 kB/s | 9.4 kB 00:00 2023-10-08T12:27:17.555 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 187 kB/s | 81 kB 00:00 2023-10-08T12:27:17.617 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-10-08T12:27:18.022 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 22 kB/s | 9.4 kB 00:00 2023-10-08T12:27:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 3.8 kB/s | 1.5 kB 00:00 2023-10-08T12:27:18.158 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 2.5 kB/s | 1.5 kB 00:00 2023-10-08T12:27:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:Copr repo for python3-asyncssh owned by ceph 10 kB/s | 3.5 kB 00:00 2023-10-08T12:27:18.449 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 3.7 kB/s | 1.5 kB 00:00 2023-10-08T12:27:18.500 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-10-08T12:27:18.825 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 9.8 kB/s | 3.5 kB 00:00 2023-10-08T12:27:19.385 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-10-08T12:27:19.541 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-10-08T12:27:21.286 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 6.5 MB/s | 16 MB 00:02 2023-10-08T12:27:22.876 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 429 kB/s | 24 kB 00:00 2023-10-08T12:27:22.989 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 390 kB/s | 24 kB 00:00 2023-10-08T12:27:24.112 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 41 MB/s | 47 MB 00:01 2023-10-08T12:27:24.232 INFO:teuthology.orchestra.run.smithi173.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 45 MB/s | 53 MB 00:01 2023-10-08T12:27:25.692 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 168 kB/s | 24 kB 00:00 2023-10-08T12:27:27.094 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 40 MB/s | 53 MB 00:01 2023-10-08T12:27:32.288 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 53 MB 00:01 2023-10-08T12:27:32.938 INFO:teuthology.orchestra.run.smithi173.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 33 MB/s | 47 MB 00:01 2023-10-08T12:27:36.979 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 29 MB/s | 47 MB 00:01 2023-10-08T12:27:43.560 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:27:43.560 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:27:43.574 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T12:27:43.576 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T12:27:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:27:43.578 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:27:43.580 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:27:43.583 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:27:43.584 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:27:43.714 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-08T12:27:43.727 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-08T12:27:43.727 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-10-08T12:27:43.727 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-08T12:27:43.727 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-10-08T12:27:43.727 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T12:27:43.727 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T12:27:43.727 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T12:27:43.727 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T12:27:43.727 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T12:27:43.728 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T12:27:43.728 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T12:27:43.728 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T12:27:43.728 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T12:27:43.728 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T12:27:43.728 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T12:27:43.728 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T12:27:43.728 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T12:27:43.728 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T12:27:43.728 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T12:27:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T12:27:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T12:27:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T12:27:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T12:27:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T12:27:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T12:27:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T12:27:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T12:27:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T12:27:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T12:27:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T12:27:43.730 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T12:27:43.730 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T12:27:43.730 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T12:27:43.730 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T12:27:43.730 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T12:27:43.730 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T12:27:43.730 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T12:27:43.730 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T12:27:43.730 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T12:27:43.730 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T12:27:43.731 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T12:27:43.731 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-10-08T12:27:43.731 INFO:teuthology.orchestra.run.smithi092.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T12:27:43.731 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:27:43.731 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:27:43.731 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-10-08T12:27:43.731 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T12:27:43.731 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T12:27:43.731 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T12:27:43.731 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T12:27:43.731 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T12:27:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T12:27:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T12:27:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T12:27:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T12:27:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T12:27:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T12:27:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T12:27:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T12:27:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T12:27:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T12:27:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T12:27:43.733 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T12:27:43.733 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T12:27:43.733 INFO:teuthology.orchestra.run.smithi092.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T12:27:43.733 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T12:27:43.733 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T12:27:43.733 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T12:27:43.733 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T12:27:43.733 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T12:27:43.733 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T12:27:43.733 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T12:27:43.733 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T12:27:43.734 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T12:27:43.734 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T12:27:43.734 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T12:27:43.734 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T12:27:43.734 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T12:27:43.734 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T12:27:43.734 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T12:27:43.734 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T12:27:43.734 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T12:27:43.734 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T12:27:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T12:27:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T12:27:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T12:27:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T12:27:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T12:27:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T12:27:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T12:27:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T12:27:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T12:27:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T12:27:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T12:27:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T12:27:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T12:27:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:27:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T12:27:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T12:27:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:27:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T12:27:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T12:27:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T12:27:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T12:27:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T12:27:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T12:27:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T12:27:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T12:27:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T12:27:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T12:27:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T12:27:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T12:27:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T12:27:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T12:27:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T12:27:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T12:27:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T12:27:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T12:27:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:27:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T12:27:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T12:27:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T12:27:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T12:27:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T12:27:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T12:27:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T12:27:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T12:27:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T12:27:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T12:27:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T12:27:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T12:27:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T12:27:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T12:27:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T12:27:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T12:27:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T12:27:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T12:27:43.739 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling module streams: 2023-10-08T12:27:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql 10 2023-10-08T12:27:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:27:43.740 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-08T12:27:43.740 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-08T12:27:43.740 INFO:teuthology.orchestra.run.smithi092.stdout:Install 128 Packages 2023-10-08T12:27:43.740 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 3 Packages 2023-10-08T12:27:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:27:43.741 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 209 M 2023-10-08T12:27:43.741 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-10-08T12:27:44.074 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:27:44.075 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:27:44.089 INFO:teuthology.orchestra.run.smithi173.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T12:27:44.091 INFO:teuthology.orchestra.run.smithi173.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T12:27:44.092 INFO:teuthology.orchestra.run.smithi173.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:27:44.093 INFO:teuthology.orchestra.run.smithi173.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:27:44.095 INFO:teuthology.orchestra.run.smithi173.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:27:44.098 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:27:44.099 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:27:44.234 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-10-08T12:27:44.237 INFO:teuthology.orchestra.run.smithi092.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 51 kB/s | 6.4 kB 00:00 2023-10-08T12:27:44.246 INFO:teuthology.orchestra.run.smithi173.stdout:=========================================================================================================================== 2023-10-08T12:27:44.246 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-10-08T12:27:44.246 INFO:teuthology.orchestra.run.smithi173.stdout:=========================================================================================================================== 2023-10-08T12:27:44.246 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-10-08T12:27:44.246 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T12:27:44.246 INFO:teuthology.orchestra.run.smithi173.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T12:27:44.247 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T12:27:44.247 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T12:27:44.247 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T12:27:44.247 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T12:27:44.247 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T12:27:44.247 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T12:27:44.247 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T12:27:44.247 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T12:27:44.247 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T12:27:44.247 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T12:27:44.247 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T12:27:44.248 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T12:27:44.248 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T12:27:44.248 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T12:27:44.248 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T12:27:44.248 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T12:27:44.248 INFO:teuthology.orchestra.run.smithi173.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T12:27:44.248 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T12:27:44.248 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T12:27:44.248 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T12:27:44.248 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T12:27:44.249 INFO:teuthology.orchestra.run.smithi173.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T12:27:44.249 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T12:27:44.249 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T12:27:44.249 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T12:27:44.249 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T12:27:44.249 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T12:27:44.249 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T12:27:44.249 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T12:27:44.249 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T12:27:44.249 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T12:27:44.249 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T12:27:44.250 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T12:27:44.250 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T12:27:44.250 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T12:27:44.250 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2023-10-08T12:27:44.250 INFO:teuthology.orchestra.run.smithi173.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T12:27:44.250 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:27:44.250 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:27:44.250 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-10-08T12:27:44.250 INFO:teuthology.orchestra.run.smithi173.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T12:27:44.250 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T12:27:44.251 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T12:27:44.251 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T12:27:44.251 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T12:27:44.251 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T12:27:44.251 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T12:27:44.251 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T12:27:44.251 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T12:27:44.251 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T12:27:44.251 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T12:27:44.251 INFO:teuthology.orchestra.run.smithi173.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T12:27:44.251 INFO:teuthology.orchestra.run.smithi173.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T12:27:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T12:27:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T12:27:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T12:27:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T12:27:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T12:27:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T12:27:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T12:27:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T12:27:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T12:27:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T12:27:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T12:27:44.253 INFO:teuthology.orchestra.run.smithi173.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T12:27:44.253 INFO:teuthology.orchestra.run.smithi173.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T12:27:44.253 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T12:27:44.253 INFO:teuthology.orchestra.run.smithi173.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T12:27:44.253 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T12:27:44.253 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T12:27:44.253 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T12:27:44.253 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T12:27:44.253 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T12:27:44.253 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T12:27:44.253 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T12:27:44.254 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T12:27:44.254 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T12:27:44.254 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T12:27:44.254 INFO:teuthology.orchestra.run.smithi173.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T12:27:44.254 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T12:27:44.254 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T12:27:44.254 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T12:27:44.254 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T12:27:44.254 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T12:27:44.254 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T12:27:44.254 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T12:27:44.255 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T12:27:44.255 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T12:27:44.255 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T12:27:44.255 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T12:27:44.255 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:27:44.255 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T12:27:44.255 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T12:27:44.255 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:27:44.255 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T12:27:44.255 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T12:27:44.255 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T12:27:44.256 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T12:27:44.256 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T12:27:44.256 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T12:27:44.256 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T12:27:44.256 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T12:27:44.256 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T12:27:44.256 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T12:27:44.256 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T12:27:44.256 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T12:27:44.256 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T12:27:44.256 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T12:27:44.257 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T12:27:44.257 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T12:27:44.257 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T12:27:44.257 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T12:27:44.257 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:27:44.257 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T12:27:44.257 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T12:27:44.257 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T12:27:44.257 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T12:27:44.258 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T12:27:44.258 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T12:27:44.258 INFO:teuthology.orchestra.run.smithi173.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T12:27:44.258 INFO:teuthology.orchestra.run.smithi173.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T12:27:44.258 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T12:27:44.258 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T12:27:44.258 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T12:27:44.258 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T12:27:44.258 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T12:27:44.258 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T12:27:44.258 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T12:27:44.259 INFO:teuthology.orchestra.run.smithi173.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T12:27:44.259 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T12:27:44.259 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T12:27:44.259 INFO:teuthology.orchestra.run.smithi173.stdout:Enabling module streams: 2023-10-08T12:27:44.259 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql 10 2023-10-08T12:27:44.259 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:27:44.259 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-10-08T12:27:44.259 INFO:teuthology.orchestra.run.smithi173.stdout:=========================================================================================================================== 2023-10-08T12:27:44.259 INFO:teuthology.orchestra.run.smithi173.stdout:Install 128 Packages 2023-10-08T12:27:44.259 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 3 Packages 2023-10-08T12:27:44.260 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:27:44.260 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 209 M 2023-10-08T12:27:44.260 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-10-08T12:27:44.776 INFO:teuthology.orchestra.run.smithi173.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 13 kB/s | 6.4 kB 00:00 2023-10-08T12:27:45.087 INFO:teuthology.orchestra.run.smithi092.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.1 MB/s | 918 kB 00:00 2023-10-08T12:27:45.262 INFO:teuthology.orchestra.run.smithi092.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 956 kB/s | 167 kB 00:00 2023-10-08T12:27:46.335 INFO:teuthology.orchestra.run.smithi173.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 589 kB/s | 918 kB 00:01 2023-10-08T12:27:46.610 INFO:teuthology.orchestra.run.smithi173.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 609 kB/s | 167 kB 00:00 2023-10-08T12:27:46.772 INFO:teuthology.orchestra.run.smithi092.stdout:(4/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 1.5 MB/s | 2.3 MB 00:01 2023-10-08T12:27:47.846 INFO:teuthology.orchestra.run.smithi092.stdout:(5/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 1.4 MB/s | 5.4 MB 00:03 2023-10-08T12:27:48.171 INFO:teuthology.orchestra.run.smithi092.stdout:(6/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 1.2 MB/s | 1.6 MB 00:01 2023-10-08T12:27:49.019 INFO:teuthology.orchestra.run.smithi173.stdout:(4/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 1.1 MB/s | 5.4 MB 00:04 2023-10-08T12:27:49.069 INFO:teuthology.orchestra.run.smithi173.stdout:(5/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 964 kB/s | 2.3 MB 00:02 2023-10-08T12:27:49.449 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:27:49.450 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:27:49.465 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T12:27:49.467 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T12:27:49.468 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:27:49.469 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:27:49.472 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:27:49.475 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:27:49.476 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:27:49.624 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-08T12:27:49.637 INFO:teuthology.orchestra.run.smithi059.stdout:=========================================================================================================================== 2023-10-08T12:27:49.637 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-10-08T12:27:49.638 INFO:teuthology.orchestra.run.smithi059.stdout:=========================================================================================================================== 2023-10-08T12:27:49.638 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2023-10-08T12:27:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T12:27:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T12:27:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T12:27:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T12:27:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T12:27:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T12:27:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T12:27:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T12:27:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T12:27:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T12:27:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T12:27:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T12:27:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T12:27:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T12:27:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T12:27:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T12:27:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T12:27:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T12:27:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T12:27:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T12:27:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T12:27:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T12:27:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T12:27:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T12:27:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T12:27:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T12:27:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T12:27:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T12:27:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T12:27:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T12:27:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T12:27:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T12:27:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T12:27:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T12:27:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T12:27:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T12:27:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T12:27:49.641 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2023-10-08T12:27:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T12:27:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:27:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:27:49.642 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-10-08T12:27:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T12:27:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T12:27:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T12:27:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T12:27:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T12:27:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T12:27:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T12:27:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T12:27:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T12:27:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T12:27:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T12:27:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T12:27:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T12:27:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T12:27:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T12:27:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T12:27:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T12:27:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T12:27:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T12:27:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T12:27:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T12:27:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T12:27:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T12:27:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T12:27:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T12:27:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T12:27:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T12:27:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T12:27:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T12:27:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T12:27:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T12:27:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T12:27:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T12:27:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T12:27:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T12:27:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T12:27:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T12:27:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T12:27:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T12:27:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T12:27:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T12:27:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T12:27:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T12:27:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T12:27:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T12:27:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T12:27:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T12:27:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T12:27:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T12:27:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T12:27:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:27:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T12:27:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T12:27:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T12:27:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T12:27:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T12:27:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T12:27:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T12:27:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T12:27:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T12:27:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T12:27:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:27:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T12:27:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T12:27:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T12:27:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T12:27:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T12:27:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T12:27:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T12:27:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T12:27:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T12:27:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T12:27:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T12:27:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T12:27:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T12:27:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T12:27:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T12:27:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T12:27:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T12:27:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T12:27:49.650 INFO:teuthology.orchestra.run.smithi059.stdout:Enabling module streams: 2023-10-08T12:27:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql 10 2023-10-08T12:27:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:27:49.650 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-10-08T12:27:49.650 INFO:teuthology.orchestra.run.smithi059.stdout:=========================================================================================================================== 2023-10-08T12:27:49.650 INFO:teuthology.orchestra.run.smithi059.stdout:Install 128 Packages 2023-10-08T12:27:49.650 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 3 Packages 2023-10-08T12:27:49.651 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:27:49.651 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 209 M 2023-10-08T12:27:49.651 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-10-08T12:27:50.488 INFO:teuthology.orchestra.run.smithi059.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 12 kB/s | 6.4 kB 00:00 2023-10-08T12:27:50.611 INFO:teuthology.orchestra.run.smithi173.stdout:(6/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 1.0 MB/s | 1.6 MB 00:01 2023-10-08T12:27:51.295 INFO:teuthology.orchestra.run.smithi092.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 1.3 MB/s | 4.6 MB 00:03 2023-10-08T12:27:54.072 INFO:teuthology.orchestra.run.smithi059.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 256 kB/s | 918 kB 00:03 2023-10-08T12:27:54.630 INFO:teuthology.orchestra.run.smithi059.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 300 kB/s | 167 kB 00:00 2023-10-08T12:27:56.006 INFO:teuthology.orchestra.run.smithi059.stdout:(4/131): ceph-common-18.0.0-6639.g7b3143ba.el8. 3.7 MB/s | 23 MB 00:06 2023-10-08T12:27:56.452 INFO:teuthology.orchestra.run.smithi173.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 641 kB/s | 4.6 MB 00:07 2023-10-08T12:27:56.614 INFO:teuthology.orchestra.run.smithi059.stdout:(5/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 2.7 MB/s | 1.6 MB 00:00 2023-10-08T12:27:57.956 INFO:teuthology.orchestra.run.smithi059.stdout:(6/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 3.4 MB/s | 4.6 MB 00:01 2023-10-08T12:27:58.395 INFO:teuthology.orchestra.run.smithi092.stdout:(8/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el8 2.0 MB/s | 14 MB 00:07 2023-10-08T12:27:58.398 INFO:teuthology.orchestra.run.smithi059.stdout:(7/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 655 kB/s | 5.4 MB 00:08 2023-10-08T12:27:58.462 INFO:teuthology.orchestra.run.smithi092.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 366 kB/s | 24 kB 00:00 2023-10-08T12:27:59.456 INFO:teuthology.orchestra.run.smithi059.stdout:(8/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 491 kB/s | 2.3 MB 00:04 2023-10-08T12:27:59.598 INFO:teuthology.orchestra.run.smithi059.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 172 kB/s | 24 kB 00:00 2023-10-08T12:28:01.851 INFO:teuthology.orchestra.run.smithi173.stdout:(8/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x86 1.6 MB/s | 18 MB 00:11 2023-10-08T12:28:01.962 INFO:teuthology.orchestra.run.smithi173.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 220 kB/s | 24 kB 00:00 2023-10-08T12:28:02.086 INFO:teuthology.orchestra.run.smithi092.stdout:(10/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 1.3 MB/s | 18 MB 00:13 2023-10-08T12:28:02.482 INFO:teuthology.orchestra.run.smithi059.stdout:(10/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 4.0 MB/s | 18 MB 00:04 2023-10-08T12:28:02.537 INFO:teuthology.orchestra.run.smithi092.stdout:(11/131): ceph-common-18.0.0-6639.g7b3143ba.el8 1.2 MB/s | 23 MB 00:18 2023-10-08T12:28:02.562 INFO:teuthology.orchestra.run.smithi092.stdout:(12/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 550 kB/s | 261 kB 00:00 2023-10-08T12:28:02.565 INFO:teuthology.orchestra.run.smithi059.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 3.1 MB/s | 261 kB 00:00 2023-10-08T12:28:02.654 INFO:teuthology.orchestra.run.smithi092.stdout:(13/131): libcephfs-devel-18.0.0-6639.g7b3143ba 265 kB/s | 31 kB 00:00 2023-10-08T12:28:02.665 INFO:teuthology.orchestra.run.smithi059.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 310 kB/s | 31 kB 00:00 2023-10-08T12:28:02.888 INFO:teuthology.orchestra.run.smithi092.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 790 kB/s | 184 kB 00:00 2023-10-08T12:28:03.013 INFO:teuthology.orchestra.run.smithi092.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 1.1 MB/s | 139 kB 00:00 2023-10-08T12:28:03.049 INFO:teuthology.orchestra.run.smithi059.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 2.1 MB/s | 840 kB 00:00 2023-10-08T12:28:03.213 INFO:teuthology.orchestra.run.smithi092.stdout:(16/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 1.3 MB/s | 840 kB 00:00 2023-10-08T12:28:03.263 INFO:teuthology.orchestra.run.smithi092.stdout:(17/131): libradosstriper1-18.0.0-6639.g7b3143b 2.0 MB/s | 518 kB 00:00 2023-10-08T12:28:03.372 INFO:teuthology.orchestra.run.smithi092.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 413 kB/s | 45 kB 00:00 2023-10-08T12:28:03.480 INFO:teuthology.orchestra.run.smithi092.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 1.1 MB/s | 125 kB 00:00 2023-10-08T12:28:03.499 INFO:teuthology.orchestra.run.smithi059.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 410 kB/s | 184 kB 00:00 2023-10-08T12:28:03.589 INFO:teuthology.orchestra.run.smithi092.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 1.8 MB/s | 197 kB 00:00 2023-10-08T12:28:03.591 INFO:teuthology.orchestra.run.smithi059.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 1.5 MB/s | 139 kB 00:00 2023-10-08T12:28:03.773 INFO:teuthology.orchestra.run.smithi092.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 2.0 MB/s | 371 kB 00:00 2023-10-08T12:28:03.859 INFO:teuthology.orchestra.run.smithi059.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 1.9 MB/s | 518 kB 00:00 2023-10-08T12:28:03.938 INFO:teuthology.orchestra.run.smithi092.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 2.2 MB/s | 365 kB 00:00 2023-10-08T12:28:04.040 INFO:teuthology.orchestra.run.smithi092.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 1.0 MB/s | 107 kB 00:00 2023-10-08T12:28:04.148 INFO:teuthology.orchestra.run.smithi092.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 871 kB/s | 94 kB 00:00 2023-10-08T12:28:05.107 INFO:teuthology.orchestra.run.smithi092.stdout:(25/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 3.7 MB/s | 3.6 MB 00:00 2023-10-08T12:28:05.224 INFO:teuthology.orchestra.run.smithi092.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 1.5 MB/s | 179 kB 00:00 2023-10-08T12:28:05.341 INFO:teuthology.orchestra.run.smithi092.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 198 kB/s | 23 kB 00:00 2023-10-08T12:28:05.475 INFO:teuthology.orchestra.run.smithi092.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 990 kB/s | 132 kB 00:00 2023-10-08T12:28:06.017 INFO:teuthology.orchestra.run.smithi092.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 3.3 MB/s | 1.8 MB 00:00 2023-10-08T12:28:06.275 INFO:teuthology.orchestra.run.smithi059.stdout:(17/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 2.9 MB/s | 6.9 MB 00:02 2023-10-08T12:28:06.342 INFO:teuthology.orchestra.run.smithi059.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 676 kB/s | 45 kB 00:00 2023-10-08T12:28:06.426 INFO:teuthology.orchestra.run.smithi059.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 1.5 MB/s | 125 kB 00:00 2023-10-08T12:28:06.518 INFO:teuthology.orchestra.run.smithi059.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 2.1 MB/s | 197 kB 00:00 2023-10-08T12:28:06.542 INFO:teuthology.orchestra.run.smithi092.stdout:(30/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 2.1 MB/s | 6.9 MB 00:03 2023-10-08T12:28:06.668 INFO:teuthology.orchestra.run.smithi059.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 2.4 MB/s | 371 kB 00:00 2023-10-08T12:28:06.675 INFO:teuthology.orchestra.run.smithi092.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 1.8 MB/s | 242 kB 00:00 2023-10-08T12:28:06.759 INFO:teuthology.orchestra.run.smithi092.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 569 kB/s | 47 kB 00:00 2023-10-08T12:28:06.818 INFO:teuthology.orchestra.run.smithi059.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 2.4 MB/s | 365 kB 00:00 2023-10-08T12:28:06.834 INFO:teuthology.orchestra.run.smithi092.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 194 kB/s | 15 kB 00:00 2023-10-08T12:28:06.885 INFO:teuthology.orchestra.run.smithi059.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 1.6 MB/s | 107 kB 00:00 2023-10-08T12:28:06.961 INFO:teuthology.orchestra.run.smithi059.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.2 MB/s | 94 kB 00:00 2023-10-08T12:28:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 1.9 MB/s | 261 kB 00:00 2023-10-08T12:28:07.109 INFO:teuthology.orchestra.run.smithi092.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 1.3 MB/s | 190 kB 00:00 2023-10-08T12:28:07.185 INFO:teuthology.orchestra.run.smithi092.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 241 kB/s | 18 kB 00:00 2023-10-08T12:28:07.953 INFO:teuthology.orchestra.run.smithi059.stdout:(25/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 3.6 MB/s | 3.6 MB 00:00 2023-10-08T12:28:08.028 INFO:teuthology.orchestra.run.smithi059.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 2.3 MB/s | 179 kB 00:00 2023-10-08T12:28:08.077 INFO:teuthology.orchestra.run.smithi092.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 343 kB/s | 306 kB 00:00 2023-10-08T12:28:08.086 INFO:teuthology.orchestra.run.smithi059.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 395 kB/s | 23 kB 00:00 2023-10-08T12:28:08.153 INFO:teuthology.orchestra.run.smithi059.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 1.9 MB/s | 132 kB 00:00 2023-10-08T12:28:08.244 INFO:teuthology.orchestra.run.smithi092.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 3.3 MB/s | 7.4 MB 00:02 2023-10-08T12:28:08.269 INFO:teuthology.orchestra.run.smithi092.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 306 kB/s | 59 kB 00:00 2023-10-08T12:28:08.544 INFO:teuthology.orchestra.run.smithi092.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-10-08T12:28:08.545 INFO:teuthology.orchestra.run.smithi059.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 4.5 MB/s | 1.8 MB 00:00 2023-10-08T12:28:08.678 INFO:teuthology.orchestra.run.smithi092.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 327 kB/s | 44 kB 00:00 2023-10-08T12:28:08.828 INFO:teuthology.orchestra.run.smithi092.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-10-08T12:28:08.854 INFO:teuthology.orchestra.run.smithi092.stdout:(43/131): libunwind-1.3.1-3.el8.x86_64.rpm 123 kB/s | 75 kB 00:00 2023-10-08T12:28:08.954 INFO:teuthology.orchestra.run.smithi092.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 264 kB/s | 33 kB 00:00 2023-10-08T12:28:08.988 INFO:teuthology.orchestra.run.smithi092.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 122 kB/s | 16 kB 00:00 2023-10-08T12:28:09.096 INFO:teuthology.orchestra.run.smithi092.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-10-08T12:28:09.246 INFO:teuthology.orchestra.run.smithi092.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 542 kB/s | 81 kB 00:00 2023-10-08T12:28:09.372 INFO:teuthology.orchestra.run.smithi092.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-10-08T12:28:09.405 INFO:teuthology.orchestra.run.smithi092.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 922 kB/s | 384 kB 00:00 2023-10-08T12:28:09.514 INFO:teuthology.orchestra.run.smithi092.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 124 kB/s | 18 kB 00:00 2023-10-08T12:28:09.647 INFO:teuthology.orchestra.run.smithi092.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 366 kB/s | 49 kB 00:00 2023-10-08T12:28:09.781 INFO:teuthology.orchestra.run.smithi092.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 441 kB/s | 59 kB 00:00 2023-10-08T12:28:09.815 INFO:teuthology.orchestra.run.smithi092.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 2.8 MB/s | 1.2 MB 00:00 2023-10-08T12:28:09.904 INFO:teuthology.orchestra.run.smithi059.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 5.5 MB/s | 7.4 MB 00:01 2023-10-08T12:28:09.906 INFO:teuthology.orchestra.run.smithi092.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 481 kB/s | 60 kB 00:00 2023-10-08T12:28:09.957 INFO:teuthology.orchestra.run.smithi092.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.0 MB/s | 283 kB 00:00 2023-10-08T12:28:09.987 INFO:teuthology.orchestra.run.smithi059.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 2.9 MB/s | 242 kB 00:00 2023-10-08T12:28:10.021 INFO:teuthology.orchestra.run.smithi059.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 1.4 MB/s | 47 kB 00:00 2023-10-08T12:28:10.032 INFO:teuthology.orchestra.run.smithi092.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 124 kB/s | 16 kB 00:00 2023-10-08T12:28:10.063 INFO:teuthology.orchestra.run.smithi059.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 353 kB/s | 15 kB 00:00 2023-10-08T12:28:10.082 INFO:teuthology.orchestra.run.smithi092.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 268 kB/s | 34 kB 00:00 2023-10-08T12:28:10.147 INFO:teuthology.orchestra.run.smithi059.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 3.1 MB/s | 261 kB 00:00 2023-10-08T12:28:10.183 INFO:teuthology.orchestra.run.smithi092.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2023-10-08T12:28:10.208 INFO:teuthology.orchestra.run.smithi092.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 513 kB/s | 64 kB 00:00 2023-10-08T12:28:10.213 INFO:teuthology.orchestra.run.smithi059.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 2.8 MB/s | 190 kB 00:00 2023-10-08T12:28:10.264 INFO:teuthology.orchestra.run.smithi059.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 363 kB/s | 18 kB 00:00 2023-10-08T12:28:10.308 INFO:teuthology.orchestra.run.smithi092.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 149 kB/s | 19 kB 00:00 2023-10-08T12:28:10.333 INFO:teuthology.orchestra.run.smithi092.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 191 kB/s | 24 kB 00:00 2023-10-08T12:28:10.434 INFO:teuthology.orchestra.run.smithi092.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 234 kB/s | 29 kB 00:00 2023-10-08T12:28:10.459 INFO:teuthology.orchestra.run.smithi092.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 219 kB/s | 27 kB 00:00 2023-10-08T12:28:10.593 INFO:teuthology.orchestra.run.smithi092.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 1.6 MB/s | 255 kB 00:00 2023-10-08T12:28:10.610 INFO:teuthology.orchestra.run.smithi092.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2023-10-08T12:28:10.727 INFO:teuthology.orchestra.run.smithi092.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 459 kB/s | 61 kB 00:00 2023-10-08T12:28:10.752 INFO:teuthology.orchestra.run.smithi092.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 601 kB/s | 85 kB 00:00 2023-10-08T12:28:10.797 INFO:teuthology.orchestra.run.smithi059.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 574 kB/s | 306 kB 00:00 2023-10-08T12:28:10.860 INFO:teuthology.orchestra.run.smithi092.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 172 kB/s | 23 kB 00:00 2023-10-08T12:28:10.894 INFO:teuthology.orchestra.run.smithi092.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2023-10-08T12:28:10.898 INFO:teuthology.orchestra.run.smithi059.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 590 kB/s | 59 kB 00:00 2023-10-08T12:28:10.989 INFO:teuthology.orchestra.run.smithi059.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 822 kB/s | 75 kB 00:00 2023-10-08T12:28:11.045 INFO:teuthology.orchestra.run.smithi092.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 5.9 MB/s | 1.7 MB 00:00 2023-10-08T12:28:11.140 INFO:teuthology.orchestra.run.smithi059.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.1 MB/s | 476 kB 00:00 2023-10-08T12:28:11.240 INFO:teuthology.orchestra.run.smithi059.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2023-10-08T12:28:11.287 INFO:teuthology.orchestra.run.smithi092.stdout:(71/131): python3-scipy-1.0.0-21.module+el8.5.0 35 MB/s | 14 MB 00:00 2023-10-08T12:28:11.303 INFO:teuthology.orchestra.run.smithi092.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 426 kB/s | 110 kB 00:00 2023-10-08T12:28:11.324 INFO:teuthology.orchestra.run.smithi059.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-10-08T12:28:11.416 INFO:teuthology.orchestra.run.smithi059.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 359 kB/s | 33 kB 00:00 2023-10-08T12:28:11.508 INFO:teuthology.orchestra.run.smithi059.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 178 kB/s | 16 kB 00:00 2023-10-08T12:28:11.618 INFO:teuthology.orchestra.run.smithi059.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-10-08T12:28:11.708 INFO:teuthology.orchestra.run.smithi059.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.1 MB/s | 384 kB 00:00 2023-10-08T12:28:11.779 INFO:teuthology.orchestra.run.smithi092.stdout:(73/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 3.7 MB/s | 49 MB 00:13 2023-10-08T12:28:11.792 INFO:teuthology.orchestra.run.smithi059.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 975 kB/s | 81 kB 00:00 2023-10-08T12:28:11.804 INFO:teuthology.orchestra.run.smithi092.stdout:(74/131): python3-pytz-2017.2-9.el8.noarch.rpm 105 kB/s | 54 kB 00:00 2023-10-08T12:28:11.838 INFO:teuthology.orchestra.run.smithi092.stdout:(75/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 485 kB/s | 259 kB 00:00 2023-10-08T12:28:11.863 INFO:teuthology.orchestra.run.smithi092.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 735 kB/s | 39 kB 00:00 2023-10-08T12:28:11.876 INFO:teuthology.orchestra.run.smithi059.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 134 kB/s | 11 kB 00:00 2023-10-08T12:28:11.922 INFO:teuthology.orchestra.run.smithi092.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 8.1 MB/s | 688 kB 00:00 2023-10-08T12:28:11.955 INFO:teuthology.orchestra.run.smithi092.stdout:(78/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.8 MB/s | 323 kB 00:00 2023-10-08T12:28:11.980 INFO:teuthology.orchestra.run.smithi092.stdout:(79/131): python3-jinja2-2.10.1-3.el8.noarch.rp 4.5 MB/s | 538 kB 00:00 2023-10-08T12:28:11.993 INFO:teuthology.orchestra.run.smithi059.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 151 kB/s | 18 kB 00:00 2023-10-08T12:28:12.039 INFO:teuthology.orchestra.run.smithi092.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2023-10-08T12:28:12.097 INFO:teuthology.orchestra.run.smithi092.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 6.0 MB/s | 713 kB 00:00 2023-10-08T12:28:12.114 INFO:teuthology.orchestra.run.smithi092.stdout:(82/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-08T12:28:12.151 INFO:teuthology.orchestra.run.smithi059.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 7.4 MB/s | 1.2 MB 00:00 2023-10-08T12:28:12.223 INFO:teuthology.orchestra.run.smithi092.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 26 MB/s | 4.8 MB 00:00 2023-10-08T12:28:12.235 INFO:teuthology.orchestra.run.smithi059.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 585 kB/s | 49 kB 00:00 2023-10-08T12:28:12.240 INFO:teuthology.orchestra.run.smithi092.stdout:(84/131): python3-jsonpatch-1.21-2.el8.noarch.r 187 kB/s | 27 kB 00:00 2023-10-08T12:28:12.259 INFO:teuthology.orchestra.run.smithi173.stdout:(10/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 4.8 MB/s | 49 MB 00:10 2023-10-08T12:28:12.290 INFO:teuthology.orchestra.run.smithi092.stdout:(85/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-10-08T12:28:12.351 INFO:teuthology.orchestra.run.smithi173.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 2.8 MB/s | 261 kB 00:00 2023-10-08T12:28:12.352 INFO:teuthology.orchestra.run.smithi059.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 504 kB/s | 59 kB 00:00 2023-10-08T12:28:12.382 INFO:teuthology.orchestra.run.smithi092.stdout:(86/131): python3-numpy-1.14.3-10.el8.x86_64.rp 26 MB/s | 3.7 MB 00:00 2023-10-08T12:28:12.393 INFO:teuthology.orchestra.run.smithi173.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 748 kB/s | 31 kB 00:00 2023-10-08T12:28:12.407 INFO:teuthology.orchestra.run.smithi092.stdout:(87/131): python3-prettytable-0.7.2-14.el8.noar 239 kB/s | 44 kB 00:00 2023-10-08T12:28:12.441 INFO:teuthology.orchestra.run.smithi092.stdout:(88/131): python3-werkzeug-0.12.2-4.el8.noarch. 3.0 MB/s | 457 kB 00:00 2023-10-08T12:28:12.444 INFO:teuthology.orchestra.run.smithi059.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 659 kB/s | 60 kB 00:00 2023-10-08T12:28:12.516 INFO:teuthology.orchestra.run.smithi092.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 588 kB/s | 64 kB 00:00 2023-10-08T12:28:12.518 INFO:teuthology.orchestra.run.smithi173.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 6.6 MB/s | 840 kB 00:00 2023-10-08T12:28:12.533 INFO:teuthology.orchestra.run.smithi092.stdout:(90/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2023-10-08T12:28:12.536 INFO:teuthology.orchestra.run.smithi059.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-10-08T12:28:12.568 INFO:teuthology.orchestra.run.smithi173.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 3.6 MB/s | 184 kB 00:00 2023-10-08T12:28:12.592 INFO:teuthology.orchestra.run.smithi092.stdout:(91/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 839 kB/s | 126 kB 00:00 2023-10-08T12:28:12.618 INFO:teuthology.orchestra.run.smithi173.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 2.7 MB/s | 139 kB 00:00 2023-10-08T12:28:12.639 INFO:teuthology.orchestra.run.smithi092.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 164 kB/s | 20 kB 00:00 2023-10-08T12:28:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 729 kB/s | 103 kB 00:00 2023-10-08T12:28:12.685 INFO:teuthology.orchestra.run.smithi173.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 7.6 MB/s | 518 kB 00:00 2023-10-08T12:28:12.751 INFO:teuthology.orchestra.run.smithi092.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-10-08T12:28:12.769 INFO:teuthology.orchestra.run.smithi059.stdout:(55/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el 989 kB/s | 14 MB 00:14 2023-10-08T12:28:12.794 INFO:teuthology.orchestra.run.smithi059.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 60 kB/s | 16 kB 00:00 2023-10-08T12:28:12.801 INFO:teuthology.orchestra.run.smithi092.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.5 MB/s | 198 kB 00:00 2023-10-08T12:28:12.860 INFO:teuthology.orchestra.run.smithi092.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-10-08T12:28:12.895 INFO:teuthology.orchestra.run.smithi059.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-10-08T12:28:12.987 INFO:teuthology.orchestra.run.smithi059.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 701 kB/s | 64 kB 00:00 2023-10-08T12:28:13.087 INFO:teuthology.orchestra.run.smithi059.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-10-08T12:28:13.127 INFO:teuthology.orchestra.run.smithi092.stdout:(97/131): openblas-threads-0.3.15-3.el8.x86_64. 10 MB/s | 4.9 MB 00:00 2023-10-08T12:28:13.146 INFO:teuthology.orchestra.run.smithi059.stdout:(60/131): python3-repoze-lru-0.7-6.el8.noarch.r 89 kB/s | 34 kB 00:00 2023-10-08T12:28:13.161 INFO:teuthology.orchestra.run.smithi092.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 1.2 MB/s | 354 kB 00:00 2023-10-08T12:28:13.188 INFO:teuthology.orchestra.run.smithi059.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 239 kB/s | 24 kB 00:00 2023-10-08T12:28:13.236 INFO:teuthology.orchestra.run.smithi092.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 9.8 MB/s | 4.7 MB 00:00 2023-10-08T12:28:13.246 INFO:teuthology.orchestra.run.smithi059.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 292 kB/s | 29 kB 00:00 2023-10-08T12:28:13.286 INFO:teuthology.orchestra.run.smithi173.stdout:(17/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 12 MB/s | 6.9 MB 00:00 2023-10-08T12:28:13.288 INFO:teuthology.orchestra.run.smithi059.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 275 kB/s | 27 kB 00:00 2023-10-08T12:28:13.303 INFO:teuthology.orchestra.run.smithi092.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.6 MB/s | 808 kB 00:00 2023-10-08T12:28:13.328 INFO:teuthology.orchestra.run.smithi173.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 1.1 MB/s | 45 kB 00:00 2023-10-08T12:28:13.378 INFO:teuthology.orchestra.run.smithi092.stdout:(101/131): postgresql-server-10.21-2.module+el8 20 MB/s | 5.1 MB 00:00 2023-10-08T12:28:13.397 INFO:teuthology.orchestra.run.smithi059.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-10-08T12:28:13.420 INFO:teuthology.orchestra.run.smithi092.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 8.2 MB/s | 1.5 MB 00:00 2023-10-08T12:28:13.445 INFO:teuthology.orchestra.run.smithi092.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 333 kB/s | 47 kB 00:00 2023-10-08T12:28:13.470 INFO:teuthology.orchestra.run.smithi092.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.1 MB/s | 200 kB 00:00 2023-10-08T12:28:13.514 INFO:teuthology.orchestra.run.smithi059.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 956 kB/s | 255 kB 00:00 2023-10-08T12:28:13.521 INFO:teuthology.orchestra.run.smithi092.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 424 kB/s | 43 kB 00:00 2023-10-08T12:28:13.539 INFO:teuthology.orchestra.run.smithi059.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 432 kB/s | 61 kB 00:00 2023-10-08T12:28:13.563 INFO:teuthology.orchestra.run.smithi092.stdout:(106/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-08T12:28:13.569 INFO:teuthology.orchestra.run.smithi173.stdout:(19/131): ceph-common-18.0.0-6639.g7b3143ba.el8 789 kB/s | 23 MB 00:29 2023-10-08T12:28:13.595 INFO:teuthology.orchestra.run.smithi173.stdout:(20/131): python3-ceph-common-18.0.0-6639.g7b31 470 kB/s | 125 kB 00:00 2023-10-08T12:28:13.613 INFO:teuthology.orchestra.run.smithi092.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 338 kB/s | 48 kB 00:00 2023-10-08T12:28:13.614 INFO:teuthology.orchestra.run.smithi059.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 854 kB/s | 85 kB 00:00 2023-10-08T12:28:13.638 INFO:teuthology.orchestra.run.smithi092.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 742 kB/s | 87 kB 00:00 2023-10-08T12:28:13.640 INFO:teuthology.orchestra.run.smithi059.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 230 kB/s | 23 kB 00:00 2023-10-08T12:28:13.657 INFO:teuthology.orchestra.run.smithi059.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2023-10-08T12:28:13.661 INFO:teuthology.orchestra.run.smithi173.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 5.4 MB/s | 371 kB 00:00 2023-10-08T12:28:13.689 INFO:teuthology.orchestra.run.smithi092.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 340 kB/s | 43 kB 00:00 2023-10-08T12:28:13.722 INFO:teuthology.orchestra.run.smithi092.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 1.0 MB/s | 109 kB 00:00 2023-10-08T12:28:13.728 INFO:teuthology.orchestra.run.smithi173.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 5.4 MB/s | 365 kB 00:00 2023-10-08T12:28:13.779 INFO:teuthology.orchestra.run.smithi173.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 2.1 MB/s | 107 kB 00:00 2023-10-08T12:28:13.807 INFO:teuthology.orchestra.run.smithi059.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 312 kB/s | 47 kB 00:00 2023-10-08T12:28:13.821 INFO:teuthology.orchestra.run.smithi173.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 2.2 MB/s | 94 kB 00:00 2023-10-08T12:28:13.822 INFO:teuthology.orchestra.run.smithi092.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2023-10-08T12:28:13.846 INFO:teuthology.orchestra.run.smithi173.stdout:(25/131): python3-cephfs-18.0.0-6639.g7b3143ba. 714 kB/s | 197 kB 00:00 2023-10-08T12:28:13.856 INFO:teuthology.orchestra.run.smithi092.stdout:(112/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-10-08T12:28:13.881 INFO:teuthology.orchestra.run.smithi092.stdout:(113/131): libaio-devel-0.3.112-1.el8.x86_64.rp 118 kB/s | 19 kB 00:00 2023-10-08T12:28:13.923 INFO:teuthology.orchestra.run.smithi092.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.5 MB/s | 155 kB 00:00 2023-10-08T12:28:13.941 INFO:teuthology.orchestra.run.smithi059.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.5 MB/s | 200 kB 00:00 2023-10-08T12:28:13.983 INFO:teuthology.orchestra.run.smithi059.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 4.7 MB/s | 1.7 MB 00:00 2023-10-08T12:28:13.999 INFO:teuthology.orchestra.run.smithi092.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 3.8 MB/s | 559 kB 00:00 2023-10-08T12:28:14.013 INFO:teuthology.orchestra.run.smithi173.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 1.0 MB/s | 179 kB 00:00 2023-10-08T12:28:14.024 INFO:teuthology.orchestra.run.smithi092.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 126 kB/s | 18 kB 00:00 2023-10-08T12:28:14.058 INFO:teuthology.orchestra.run.smithi092.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2023-10-08T12:28:14.113 INFO:teuthology.orchestra.run.smithi173.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 231 kB/s | 23 kB 00:00 2023-10-08T12:28:14.125 INFO:teuthology.orchestra.run.smithi059.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 232 kB/s | 43 kB 00:00 2023-10-08T12:28:14.141 INFO:teuthology.orchestra.run.smithi092.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2023-10-08T12:28:14.158 INFO:teuthology.orchestra.run.smithi059.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-10-08T12:28:14.197 INFO:teuthology.orchestra.run.smithi173.stdout:(28/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 9.5 MB/s | 3.6 MB 00:00 2023-10-08T12:28:14.216 INFO:teuthology.orchestra.run.smithi092.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 12 MB/s | 2.3 MB 00:00 2023-10-08T12:28:14.222 INFO:teuthology.orchestra.run.smithi173.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 1.2 MB/s | 132 kB 00:00 2023-10-08T12:28:14.242 INFO:teuthology.orchestra.run.smithi092.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 393 kB/s | 72 kB 00:00 2023-10-08T12:28:14.242 INFO:teuthology.orchestra.run.smithi059.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 413 kB/s | 48 kB 00:00 2023-10-08T12:28:14.259 INFO:teuthology.orchestra.run.smithi059.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 870 kB/s | 87 kB 00:00 2023-10-08T12:28:14.267 INFO:teuthology.orchestra.run.smithi092.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 660 kB/s | 83 kB 00:00 2023-10-08T12:28:14.359 INFO:teuthology.orchestra.run.smithi092.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 421 kB/s | 60 kB 00:00 2023-10-08T12:28:14.364 INFO:teuthology.orchestra.run.smithi173.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 11 MB/s | 1.8 MB 00:00 2023-10-08T12:28:14.392 INFO:teuthology.orchestra.run.smithi092.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 653 kB/s | 98 kB 00:00 2023-10-08T12:28:14.416 INFO:teuthology.orchestra.run.smithi173.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 4.6 MB/s | 242 kB 00:00 2023-10-08T12:28:14.434 INFO:teuthology.orchestra.run.smithi059.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 222 kB/s | 43 kB 00:00 2023-10-08T12:28:14.450 INFO:teuthology.orchestra.run.smithi173.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 1.4 MB/s | 47 kB 00:00 2023-10-08T12:28:14.459 INFO:teuthology.orchestra.run.smithi059.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 545 kB/s | 109 kB 00:00 2023-10-08T12:28:14.468 INFO:teuthology.orchestra.run.smithi092.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 287 kB/s | 58 kB 00:00 2023-10-08T12:28:14.485 INFO:teuthology.orchestra.run.smithi173.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 438 kB/s | 15 kB 00:00 2023-10-08T12:28:14.526 INFO:teuthology.orchestra.run.smithi173.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 6.1 MB/s | 261 kB 00:00 2023-10-08T12:28:14.543 INFO:teuthology.orchestra.run.smithi059.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2023-10-08T12:28:14.560 INFO:teuthology.orchestra.run.smithi092.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 192 kB/s | 39 kB 00:00 2023-10-08T12:28:14.576 INFO:teuthology.orchestra.run.smithi173.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 3.7 MB/s | 190 kB 00:00 2023-10-08T12:28:14.593 INFO:teuthology.orchestra.run.smithi092.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 3.1 MB/s | 644 kB 00:00 2023-10-08T12:28:14.611 INFO:teuthology.orchestra.run.smithi059.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.6 MB/s | 560 kB 00:00 2023-10-08T12:28:14.618 INFO:teuthology.orchestra.run.smithi173.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 436 kB/s | 18 kB 00:00 2023-10-08T12:28:14.619 INFO:teuthology.orchestra.run.smithi092.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.1 MB/s | 171 kB 00:00 2023-10-08T12:28:14.669 INFO:teuthology.orchestra.run.smithi059.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 149 kB/s | 19 kB 00:00 2023-10-08T12:28:14.686 INFO:teuthology.orchestra.run.smithi092.stdout:(128/131): NetworkManager-initscripts-updown-1. 1.1 MB/s | 138 kB 00:00 2023-10-08T12:28:14.727 INFO:teuthology.orchestra.run.smithi059.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.3 MB/s | 155 kB 00:00 2023-10-08T12:28:14.769 INFO:teuthology.orchestra.run.smithi059.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 5.5 MB/s | 559 kB 00:00 2023-10-08T12:28:14.803 INFO:teuthology.orchestra.run.smithi092.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 6.7 MB/s | 798 kB 00:00 2023-10-08T12:28:14.836 INFO:teuthology.orchestra.run.smithi059.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 165 kB/s | 18 kB 00:00 2023-10-08T12:28:14.878 INFO:teuthology.orchestra.run.smithi059.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-10-08T12:28:14.912 INFO:teuthology.orchestra.run.smithi059.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2023-10-08T12:28:14.990 INFO:teuthology.orchestra.run.smithi059.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 939 kB/s | 72 kB 00:00 2023-10-08T12:28:15.062 INFO:teuthology.orchestra.run.smithi092.stdout:(130/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 8.4 MB/s | 3.7 MB 00:00 2023-10-08T12:28:15.062 INFO:teuthology.orchestra.run.smithi059.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 13 MB/s | 2.3 MB 00:00 2023-10-08T12:28:15.121 INFO:teuthology.orchestra.run.smithi059.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 630 kB/s | 83 kB 00:00 2023-10-08T12:28:15.147 INFO:teuthology.orchestra.run.smithi059.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 715 kB/s | 60 kB 00:00 2023-10-08T12:28:15.222 INFO:teuthology.orchestra.run.smithi059.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 981 kB/s | 98 kB 00:00 2023-10-08T12:28:15.289 INFO:teuthology.orchestra.run.smithi059.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 406 kB/s | 58 kB 00:00 2023-10-08T12:28:15.343 INFO:teuthology.orchestra.run.smithi173.stdout:(37/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el 753 kB/s | 14 MB 00:18 2023-10-08T12:28:15.368 INFO:teuthology.orchestra.run.smithi173.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 408 kB/s | 306 kB 00:00 2023-10-08T12:28:15.370 INFO:teuthology.orchestra.run.smithi092.stdout:(131/131): librados2-18.0.0-6639.g7b3143ba.el8. 4.8 MB/s | 3.7 MB 00:00 2023-10-08T12:28:15.372 INFO:teuthology.orchestra.run.smithi059.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 257 kB/s | 39 kB 00:00 2023-10-08T12:28:15.373 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:28:15.373 INFO:teuthology.orchestra.run.smithi092.stdout:Total 6.6 MB/s | 209 MB 00:31 2023-10-08T12:28:15.414 INFO:teuthology.orchestra.run.smithi059.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 5.0 MB/s | 644 kB 00:00 2023-10-08T12:28:15.490 INFO:teuthology.orchestra.run.smithi059.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.4 MB/s | 171 kB 00:00 2023-10-08T12:28:15.607 INFO:teuthology.orchestra.run.smithi059.stdout:(96/131): NetworkManager-initscripts-updown-1.3 718 kB/s | 138 kB 00:00 2023-10-08T12:28:15.749 INFO:teuthology.orchestra.run.smithi059.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 778 kB/s | 110 kB 00:00 2023-10-08T12:28:15.786 INFO:teuthology.orchestra.run.smithi173.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 133 kB/s | 59 kB 00:00 2023-10-08T12:28:15.802 INFO:teuthology.orchestra.run.smithi173.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 173 kB/s | 75 kB 00:00 2023-10-08T12:28:15.891 INFO:teuthology.orchestra.run.smithi059.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 383 kB/s | 54 kB 00:00 2023-10-08T12:28:15.919 INFO:teuthology.orchestra.run.smithi173.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-10-08T12:28:16.050 INFO:teuthology.orchestra.run.smithi059.stdout:(99/131): python3-scipy-1.0.0-21.module+el8.5.0 24 MB/s | 14 MB 00:00 2023-10-08T12:28:16.116 INFO:teuthology.orchestra.run.smithi059.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2023-10-08T12:28:16.128 INFO:teuthology.orchestra.run.smithi173.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 890 kB/s | 185 kB 00:00 2023-10-08T12:28:16.192 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-10-08T12:28:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-10-08T12:28:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-10-08T12:28:16.400 INFO:teuthology.orchestra.run.smithi059.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 923 kB/s | 323 kB 00:00 2023-10-08T12:28:16.420 INFO:teuthology.orchestra.run.smithi173.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 113 kB/s | 33 kB 00:00 2023-10-08T12:28:16.425 INFO:teuthology.orchestra.run.smithi059.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 126 kB/s | 39 kB 00:00 2023-10-08T12:28:16.445 INFO:teuthology.orchestra.run.smithi173.stdout:(44/131): python3-asyncssh-2.7.0-2.el8.noarch.r 722 kB/s | 476 kB 00:00 2023-10-08T12:28:16.501 INFO:teuthology.orchestra.run.smithi059.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 6.7 MB/s | 688 kB 00:00 2023-10-08T12:28:16.546 INFO:teuthology.orchestra.run.smithi173.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-10-08T12:28:16.568 INFO:teuthology.orchestra.run.smithi059.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 3.7 MB/s | 538 kB 00:00 2023-10-08T12:28:16.668 INFO:teuthology.orchestra.run.smithi059.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 940 kB/s | 157 kB 00:00 2023-10-08T12:28:16.751 INFO:teuthology.orchestra.run.smithi059.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-10-08T12:28:16.802 INFO:teuthology.orchestra.run.smithi059.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 5.2 MB/s | 713 kB 00:00 2023-10-08T12:28:16.902 INFO:teuthology.orchestra.run.smithi059.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 266 kB/s | 27 kB 00:00 2023-10-08T12:28:16.921 INFO:teuthology.orchestra.run.smithi173.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 363 kB/s | 173 kB 00:00 2023-10-08T12:28:16.946 INFO:teuthology.orchestra.run.smithi173.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 961 kB/s | 384 kB 00:00 2023-10-08T12:28:17.019 INFO:teuthology.orchestra.run.smithi059.stdout:(109/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-10-08T12:28:17.030 INFO:teuthology.orchestra.run.smithi173.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 750 kB/s | 81 kB 00:00 2023-10-08T12:28:17.078 INFO:teuthology.orchestra.run.smithi059.stdout:(110/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-10-08T12:28:17.113 INFO:teuthology.orchestra.run.smithi173.stdout:(49/131): ceph-mgr-diskprediction-local-18.0.0- 2.6 MB/s | 7.4 MB 00:02 2023-10-08T12:28:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 376 kB/s | 44 kB 00:00 2023-10-08T12:28:17.138 INFO:teuthology.orchestra.run.smithi173.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 58 kB/s | 11 kB 00:00 2023-10-08T12:28:17.188 INFO:teuthology.orchestra.run.smithi173.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 111 kB/s | 18 kB 00:00 2023-10-08T12:28:17.287 INFO:teuthology.orchestra.run.smithi059.stdout:(112/131): python3-numpy-1.14.3-10.el8.x86_64.r 18 MB/s | 3.7 MB 00:00 2023-10-08T12:28:17.306 INFO:teuthology.orchestra.run.smithi173.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 499 kB/s | 59 kB 00:00 2023-10-08T12:28:17.329 INFO:teuthology.orchestra.run.smithi059.stdout:(113/131): python3-werkzeug-0.12.2-4.el8.noarch 2.3 MB/s | 457 kB 00:00 2023-10-08T12:28:17.339 INFO:teuthology.orchestra.run.smithi173.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 5.2 MB/s | 1.2 MB 00:00 2023-10-08T12:28:17.404 INFO:teuthology.orchestra.run.smithi059.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.9 MB/s | 225 kB 00:00 2023-10-08T12:28:17.423 INFO:teuthology.orchestra.run.smithi173.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 516 kB/s | 60 kB 00:00 2023-10-08T12:28:17.449 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-10-08T12:28:17.453 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-10-08T12:28:17.456 INFO:teuthology.orchestra.run.smithi173.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-10-08T12:28:17.488 INFO:teuthology.orchestra.run.smithi059.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 404 kB/s | 64 kB 00:00 2023-10-08T12:28:17.530 INFO:teuthology.orchestra.run.smithi059.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.0 MB/s | 126 kB 00:00 2023-10-08T12:28:17.532 INFO:teuthology.orchestra.run.smithi173.stdout:(56/131): python3-logutils-0.3.5-11.el8.noarch. 124 kB/s | 49 kB 00:00 2023-10-08T12:28:17.557 INFO:teuthology.orchestra.run.smithi173.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 116 kB/s | 16 kB 00:00 2023-10-08T12:28:17.582 INFO:teuthology.orchestra.run.smithi173.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 268 kB/s | 34 kB 00:00 2023-10-08T12:28:17.622 INFO:teuthology.orchestra.run.smithi059.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 150 kB/s | 20 kB 00:00 2023-10-08T12:28:17.680 INFO:teuthology.orchestra.run.smithi059.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 689 kB/s | 103 kB 00:00 2023-10-08T12:28:17.707 INFO:teuthology.orchestra.run.smithi173.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 150 kB/s | 19 kB 00:00 2023-10-08T12:28:17.730 INFO:teuthology.orchestra.run.smithi059.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 6.4 MB/s | 709 kB 00:00 2023-10-08T12:28:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 977 kB/s | 196 kB 00:00 2023-10-08T12:28:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:(61/131): python3-rsa-4.9-2.el8.noarch.rpm 319 kB/s | 64 kB 00:00 2023-10-08T12:28:17.781 INFO:teuthology.orchestra.run.smithi059.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-10-08T12:28:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 219 kB/s | 24 kB 00:00 2023-10-08T12:28:17.842 INFO:teuthology.orchestra.run.smithi173.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2023-10-08T12:28:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 253 kB/s | 27 kB 00:00 2023-10-08T12:28:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-10-08T12:28:17.982 INFO:teuthology.orchestra.run.smithi059.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 18 MB/s | 4.9 MB 00:00 2023-10-08T12:28:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-10-08T12:28:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 522 kB/s | 61 kB 00:00 2023-10-08T12:28:18.040 INFO:teuthology.orchestra.run.smithi059.stdout:(122/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-08T12:28:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 784 kB/s | 85 kB 00:00 2023-10-08T12:28:18.065 INFO:teuthology.orchestra.run.smithi059.stdout:(123/131): jq-1.6-3.el8.x86_64.rpm 1.7 MB/s | 202 kB 00:00 2023-10-08T12:28:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 196 kB/s | 23 kB 00:00 2023-10-08T12:28:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-10-08T12:28:18.098 INFO:teuthology.orchestra.run.smithi059.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-10-08T12:28:18.182 INFO:teuthology.orchestra.run.smithi059.stdout:(125/131): postgresql-contrib-10.21-2.module+el 9.5 MB/s | 808 kB 00:00 2023-10-08T12:28:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 374 kB/s | 47 kB 00:00 2023-10-08T12:28:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.5 MB/s | 200 kB 00:00 2023-10-08T12:28:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-10-08T12:28:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-10-08T12:28:18.291 INFO:teuthology.orchestra.run.smithi059.stdout:(126/131): postgresql-server-10.21-2.module+el8 22 MB/s | 5.1 MB 00:00 2023-10-08T12:28:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 719 kB/s | 48 kB 00:00 2023-10-08T12:28:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-10-08T12:28:18.358 INFO:teuthology.orchestra.run.smithi059.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 8.6 MB/s | 1.5 MB 00:00 2023-10-08T12:28:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 729 kB/s | 43 kB 00:00 2023-10-08T12:28:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-10-08T12:28:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-10-08T12:28:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-10-08T12:28:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2023-10-08T12:28:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:(82/131): thrift-0.13.0-2.el8.x86_64.rpm 3.3 MB/s | 1.7 MB 00:00 2023-10-08T12:28:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2023-10-08T12:28:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:(84/131): python3-cryptography-3.2.1-5.el8.x86_ 5.4 MB/s | 559 kB 00:00 2023-10-08T12:28:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:(85/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 213 kB/s | 18 kB 00:00 2023-10-08T12:28:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2023-10-08T12:28:18.691 INFO:teuthology.orchestra.run.smithi173.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.1 MB/s | 605 kB 00:00 2023-10-08T12:28:18.708 INFO:teuthology.orchestra.run.smithi173.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 863 kB/s | 72 kB 00:00 2023-10-08T12:28:18.733 INFO:teuthology.orchestra.run.smithi173.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-08T12:28:18.759 INFO:teuthology.orchestra.run.smithi173.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-08T12:28:18.784 INFO:teuthology.orchestra.run.smithi173.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-08T12:28:18.809 INFO:teuthology.orchestra.run.smithi173.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-08T12:28:18.833 INFO:teuthology.orchestra.run.smithi059.stdout:(128/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 7.8 MB/s | 3.7 MB 00:00 2023-10-08T12:28:18.834 INFO:teuthology.orchestra.run.smithi173.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 769 kB/s | 39 kB 00:00 2023-10-08T12:28:18.868 INFO:teuthology.orchestra.run.smithi173.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-10-08T12:28:18.892 INFO:teuthology.orchestra.run.smithi059.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 14 MB/s | 798 kB 00:00 2023-10-08T12:28:18.893 INFO:teuthology.orchestra.run.smithi173.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-10-08T12:28:18.918 INFO:teuthology.orchestra.run.smithi173.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-08T12:28:18.969 INFO:teuthology.orchestra.run.smithi173.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.3 MB/s | 2.3 MB 00:00 2023-10-08T12:28:18.994 INFO:teuthology.orchestra.run.smithi173.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-10-08T12:28:19.011 INFO:teuthology.orchestra.run.smithi173.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-08T12:28:19.037 INFO:teuthology.orchestra.run.smithi173.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.0 MB/s | 259 kB 00:00 2023-10-08T12:28:19.070 INFO:teuthology.orchestra.run.smithi173.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-08T12:28:19.087 INFO:teuthology.orchestra.run.smithi173.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 775 kB/s | 39 kB 00:00 2023-10-08T12:28:19.165 INFO:teuthology.orchestra.run.smithi173.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 7.1 MB/s | 688 kB 00:00 2023-10-08T12:28:19.204 INFO:teuthology.orchestra.run.smithi173.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 4.5 MB/s | 538 kB 00:00 2023-10-08T12:28:19.230 INFO:teuthology.orchestra.run.smithi173.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.4 MB/s | 157 kB 00:00 2023-10-08T12:28:19.255 INFO:teuthology.orchestra.run.smithi173.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-08T12:28:19.288 INFO:teuthology.orchestra.run.smithi173.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-08T12:28:19.330 INFO:teuthology.orchestra.run.smithi173.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 640 kB/s | 27 kB 00:00 2023-10-08T12:28:19.372 INFO:teuthology.orchestra.run.smithi173.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-08T12:28:19.414 INFO:teuthology.orchestra.run.smithi173.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-10-08T12:28:19.506 INFO:teuthology.orchestra.run.smithi173.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-10-08T12:28:19.565 INFO:teuthology.orchestra.run.smithi173.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-10-08T12:28:19.607 INFO:teuthology.orchestra.run.smithi173.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-10-08T12:28:19.707 INFO:teuthology.orchestra.run.smithi173.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 13 MB/s | 3.7 MB 00:00 2023-10-08T12:28:19.732 INFO:teuthology.orchestra.run.smithi173.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 511 kB/s | 64 kB 00:00 2023-10-08T12:28:19.758 INFO:teuthology.orchestra.run.smithi173.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-10-08T12:28:19.783 INFO:teuthology.orchestra.run.smithi173.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 395 kB/s | 20 kB 00:00 2023-10-08T12:28:19.808 INFO:teuthology.orchestra.run.smithi173.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-10-08T12:28:19.850 INFO:teuthology.orchestra.run.smithi173.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-10-08T12:28:19.993 INFO:teuthology.orchestra.run.smithi173.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-10-08T12:28:20.018 INFO:teuthology.orchestra.run.smithi173.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.2 MB/s | 198 kB 00:00 2023-10-08T12:28:20.051 INFO:teuthology.orchestra.run.smithi173.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 6.0 MB/s | 202 kB 00:00 2023-10-08T12:28:20.102 INFO:teuthology.orchestra.run.smithi173.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-10-08T12:28:20.202 INFO:teuthology.orchestra.run.smithi173.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-10-08T12:28:20.269 INFO:teuthology.orchestra.run.smithi173.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-08T12:28:20.302 INFO:teuthology.orchestra.run.smithi173.stdout:(126/131): postgresql-contrib-10.21-2.module+el 7.9 MB/s | 808 kB 00:00 2023-10-08T12:28:20.361 INFO:teuthology.orchestra.run.smithi173.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-10-08T12:28:20.453 INFO:teuthology.orchestra.run.smithi173.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-10-08T12:28:20.492 INFO:teuthology.orchestra.run.smithi059.stdout:(130/131): ceph-test-18.0.0-6639.g7b3143ba.el8. 2.3 MB/s | 49 MB 00:20 2023-10-08T12:28:20.511 INFO:teuthology.orchestra.run.smithi173.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-08T12:28:20.576 INFO:teuthology.orchestra.run.smithi059.stdout:(131/131): librados2-18.0.0-6639.g7b3143ba.el8. 1.6 MB/s | 3.7 MB 00:02 2023-10-08T12:28:20.579 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:28:20.579 INFO:teuthology.orchestra.run.smithi059.stdout:Total 6.7 MB/s | 209 MB 00:30 2023-10-08T12:28:20.803 INFO:teuthology.orchestra.run.smithi173.stdout:(130/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 8.4 MB/s | 3.7 MB 00:00 2023-10-08T12:28:22.262 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-10-08T12:28:22.272 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-10-08T12:28:22.408 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-10-08T12:28:22.408 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-10-08T12:28:22.437 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T12:28:22.487 INFO:teuthology.orchestra.run.smithi173.stdout:(131/131): librados2-18.0.0-6639.g7b3143ba.el8. 1.7 MB/s | 3.7 MB 00:02 2023-10-08T12:28:22.490 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:28:22.490 INFO:teuthology.orchestra.run.smithi173.stdout:Total 5.5 MB/s | 209 MB 00:38 2023-10-08T12:28:22.592 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T12:28:22.804 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-08T12:28:22.956 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:28:23.055 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:28:23.317 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-10-08T12:28:23.340 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:28:23.437 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-10-08T12:28:23.437 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-10-08T12:28:23.748 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:28:23.939 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:28:24.072 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-10-08T12:28:24.077 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-10-08T12:28:24.349 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:28:24.539 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:28:24.578 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-10-08T12:28:24.582 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-10-08T12:28:24.674 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:28:24.855 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:28:24.949 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:28:25.148 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:28:25.350 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T12:28:25.558 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T12:28:25.940 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T12:28:26.188 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T12:28:26.330 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:28:26.442 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:28:26.581 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:28:26.663 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:28:26.821 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:28:26.948 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:28:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:28:27.743 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:28:27.922 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:28:28.501 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:28:28.671 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:28:29.355 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-10-08T12:28:29.363 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:28:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T12:28:29.600 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-10-08T12:28:29.619 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-08T12:28:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T12:28:29.791 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T12:28:29.823 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-08T12:28:29.851 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T12:28:29.974 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T12:28:30.011 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T12:28:30.050 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-08T12:28:30.152 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T12:28:30.201 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T12:28:30.227 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-08T12:28:30.266 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T12:28:30.436 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-08T12:28:30.526 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T12:28:30.664 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T12:28:30.736 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T12:28:30.885 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T12:28:30.922 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T12:28:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T12:28:31.016 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T12:28:31.168 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T12:28:31.478 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T12:28:31.558 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T12:28:31.634 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:28:31.743 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:28:31.795 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:28:31.874 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:28:31.917 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T12:28:31.968 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:28:32.088 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:28:32.101 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:28:32.199 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:28:32.235 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-08T12:28:32.265 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:28:32.356 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:28:32.423 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-08T12:28:32.489 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-08T12:28:32.574 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-08T12:28:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T12:28:32.728 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-08T12:28:32.805 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T12:28:32.924 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T12:28:32.946 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:28:33.046 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T12:28:33.330 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T12:28:33.433 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T12:28:33.560 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T12:28:33.684 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T12:28:33.734 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:28:33.834 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:28:33.866 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:28:33.934 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:28:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:28:34.093 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:28:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:28:34.239 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:28:34.471 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-08T12:28:34.475 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-08T12:28:34.640 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-08T12:28:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-08T12:28:34.701 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:28:34.815 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-08T12:28:34.873 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-08T12:28:34.975 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T12:28:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T12:28:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-08T12:28:35.130 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T12:28:35.182 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T12:28:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T12:28:35.284 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T12:28:35.334 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T12:28:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T12:28:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T12:28:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T12:28:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-08T12:28:35.895 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T12:28:36.067 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T12:28:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-08T12:28:36.082 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T12:28:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-08T12:28:36.284 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T12:28:36.423 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-08T12:28:36.617 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-08T12:28:36.654 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T12:28:36.816 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-08T12:28:36.842 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T12:28:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T12:28:37.133 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T12:28:37.165 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-08T12:28:37.448 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-08T12:28:37.556 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T12:28:37.671 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-08T12:28:37.807 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-08T12:28:37.876 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-08T12:28:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T12:28:38.031 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-08T12:28:38.074 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-08T12:28:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-08T12:28:38.294 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T12:28:38.394 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-08T12:28:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-08T12:28:38.523 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T12:28:38.619 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-08T12:28:38.679 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T12:28:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T12:28:38.800 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-08T12:28:38.891 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T12:28:38.897 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T12:28:39.015 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T12:28:39.016 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-08T12:28:39.100 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T12:28:39.173 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-08T12:28:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T12:28:39.339 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-08T12:28:39.425 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T12:28:39.645 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-08T12:28:39.907 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-08T12:28:40.141 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-08T12:28:40.350 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-08T12:28:40.535 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-08T12:28:40.687 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-08T12:28:40.842 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T12:28:40.877 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:28:40.935 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:28:41.178 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-08T12:28:41.364 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-08T12:28:41.510 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:28:41.588 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:28:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T12:28:41.791 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-08T12:28:41.850 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-08T12:28:41.944 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-08T12:28:42.093 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T12:28:42.155 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-08T12:28:42.272 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T12:28:42.442 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-08T12:28:42.547 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T12:28:42.656 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-08T12:28:42.759 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T12:28:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-08T12:28:42.910 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T12:28:42.914 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T12:28:43.046 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T12:28:43.093 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T12:28:43.197 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-08T12:28:43.219 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T12:28:43.297 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T12:28:43.448 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T12:28:43.489 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T12:28:43.495 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-08T12:28:43.613 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T12:28:43.648 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-08T12:28:43.766 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-08T12:28:43.788 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T12:28:43.825 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-08T12:28:43.932 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T12:28:43.957 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T12:28:43.974 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T12:28:44.046 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T12:28:44.155 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T12:28:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T12:28:44.252 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-08T12:28:44.358 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T12:28:44.390 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T12:28:44.511 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-08T12:28:44.558 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T12:28:44.565 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T12:28:44.674 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T12:28:44.709 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-08T12:28:44.758 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T12:28:44.787 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T12:28:44.895 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-08T12:28:44.992 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T12:28:45.003 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-08T12:28:45.066 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T12:28:45.153 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-08T12:28:45.157 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T12:28:45.160 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T12:28:45.348 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-08T12:28:45.383 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T12:28:45.433 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-08T12:28:45.543 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-08T12:28:45.665 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-08T12:28:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-08T12:28:45.799 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T12:28:45.895 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-08T12:28:45.897 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T12:28:46.073 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-08T12:28:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-08T12:28:46.263 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-08T12:28:46.288 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-08T12:28:46.447 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T12:28:46.492 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-08T12:28:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-08T12:28:46.644 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-08T12:28:46.696 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T12:28:46.836 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-08T12:28:46.909 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T12:28:46.973 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-08T12:28:46.984 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-08T12:28:47.215 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-08T12:28:47.217 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T12:28:47.225 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-08T12:28:47.433 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-08T12:28:47.468 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T12:28:47.476 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-08T12:28:47.644 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T12:28:47.686 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-08T12:28:47.890 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-08T12:28:48.013 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-08T12:28:48.215 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-08T12:28:48.216 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-08T12:28:48.435 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T12:28:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-08T12:28:48.475 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-08T12:28:48.583 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:28:48.662 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-08T12:28:48.666 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:28:48.770 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-08T12:28:48.826 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T12:28:48.869 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-08T12:28:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-08T12:28:49.044 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-08T12:28:49.327 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-08T12:28:49.343 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-08T12:28:49.559 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-08T12:28:49.618 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-08T12:28:49.774 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-08T12:28:49.886 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-08T12:28:49.999 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-08T12:28:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-08T12:28:50.218 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-08T12:28:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T12:28:50.390 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-08T12:28:50.493 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-08T12:28:51.014 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T12:28:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-08T12:28:51.186 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T12:28:51.384 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T12:28:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-08T12:28:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-08T12:28:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T12:28:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T12:28:51.836 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T12:28:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T12:28:52.035 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T12:28:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T12:28:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T12:28:52.388 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T12:28:52.491 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T12:28:52.536 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:28:52.611 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T12:28:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T12:28:52.767 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:28:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T12:28:52.861 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T12:28:52.993 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T12:28:53.054 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T12:28:53.183 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T12:28:53.353 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T12:28:53.355 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:28:53.398 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T12:28:53.572 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T12:28:53.595 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:28:53.611 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T12:28:53.678 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:28:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T12:28:53.797 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T12:28:53.799 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:28:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T12:28:54.021 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T12:28:54.206 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T12:28:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T12:28:54.673 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T12:28:54.875 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T12:28:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T12:28:55.150 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T12:28:55.285 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T12:28:55.451 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T12:28:55.730 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T12:28:56.022 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T12:28:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T12:28:56.547 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T12:28:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T12:28:57.038 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T12:28:57.414 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T12:28:57.580 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:28:57.607 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T12:28:57.682 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:28:57.856 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T12:28:57.996 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T12:28:58.309 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T12:28:58.503 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T12:28:59.427 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T12:28:59.581 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:28:59.716 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:28:59.873 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T12:29:01.679 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:29:02.814 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:29:03.403 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:29:03.719 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:29:03.938 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:29:05.254 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:29:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:29:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:29:06.470 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:29:06.612 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:29:06.755 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:29:12.643 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:29:12.643 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2023-10-08T12:29:12.643 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2023-10-08T12:29:12.643 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-10-08T12:29:12.644 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /run 2023-10-08T12:29:12.644 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2023-10-08T12:29:12.644 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2023-10-08T12:29:12.644 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2023-10-08T12:29:12.644 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2023-10-08T12:29:12.644 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-10-08T12:29:12.644 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:29:12.970 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:29:14.557 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:29:14.715 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:29:14.935 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:29:15.119 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:29:15.588 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:29:15.711 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:29:15.728 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:29:17.412 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:29:17.609 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:29:17.750 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T12:29:17.968 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T12:29:18.169 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:29:18.388 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:29:18.656 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:29:19.612 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:29:19.802 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:29:19.893 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:29:20.248 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T12:29:20.417 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:29:20.452 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:29:20.593 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:29:20.604 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:29:21.914 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T12:29:22.091 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:29:22.124 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:29:22.268 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:29:22.319 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:29:22.451 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:29:22.810 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:29:22.813 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:29:22.813 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2023-10-08T12:29:22.813 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2023-10-08T12:29:22.813 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /dev 2023-10-08T12:29:22.813 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /run 2023-10-08T12:29:22.814 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2023-10-08T12:29:22.814 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2023-10-08T12:29:22.814 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2023-10-08T12:29:22.814 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2023-10-08T12:29:22.814 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /dev 2023-10-08T12:29:22.814 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:29:22.985 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:29:23.194 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:29:24.777 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:29:24.950 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:29:25.170 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:29:25.361 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:29:25.822 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:29:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:29:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:29:27.638 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:29:27.771 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:29:27.939 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T12:29:27.968 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:29:28.083 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:29:28.086 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:29:28.086 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2023-10-08T12:29:28.086 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2023-10-08T12:29:28.086 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2023-10-08T12:29:28.087 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /run 2023-10-08T12:29:28.087 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2023-10-08T12:29:28.087 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2023-10-08T12:29:28.087 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2023-10-08T12:29:28.087 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2023-10-08T12:29:28.087 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2023-10-08T12:29:28.087 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:29:28.132 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T12:29:28.281 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:29:28.343 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T12:29:28.494 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:29:28.534 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:29:28.755 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:29:29.015 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:29:29.141 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-08T12:29:29.463 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-08T12:29:29.669 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 119/134 2023-10-08T12:29:29.879 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:29:29.972 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:29:30.046 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T12:29:30.184 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:29:30.200 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:29:30.291 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:29:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:29:30.517 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:29:30.650 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T12:29:30.813 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:29:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:29:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:29:31.011 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:29:31.089 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:29:31.100 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:29:31.587 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:29:31.794 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:29:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:29:32.370 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:29:32.429 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T12:29:32.649 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:29:32.667 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:29:32.676 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:29:32.710 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:29:32.816 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T12:29:32.859 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:29:32.903 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:29:33.100 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:29:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T12:29:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T12:29:33.477 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:29:33.692 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:29:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T12:29:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:29:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:29:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-08T12:29:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:29:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:29:34.540 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:29:34.552 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:29:34.553 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:29:34.735 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:29:34.735 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:29:34.758 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:29:34.936 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:29:34.954 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:29:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:29:35.276 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T12:29:35.501 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:29:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:29:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T12:29:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T12:29:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T12:29:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T12:29:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T12:29:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:29:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:29:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:29:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:29:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T12:29:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T12:29:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T12:29:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T12:29:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T12:29:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T12:29:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T12:29:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T12:29:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T12:29:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T12:29:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T12:29:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T12:29:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T12:29:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T12:29:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T12:29:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T12:29:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T12:29:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T12:29:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T12:29:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T12:29:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T12:29:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T12:29:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T12:29:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T12:29:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T12:29:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T12:29:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T12:29:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T12:29:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T12:29:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T12:29:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T12:29:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T12:29:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T12:29:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T12:29:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T12:29:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T12:29:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T12:29:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T12:29:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T12:29:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T12:29:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T12:29:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T12:29:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T12:29:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T12:29:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T12:29:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T12:29:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T12:29:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T12:29:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T12:29:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T12:29:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T12:29:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T12:29:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T12:29:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T12:29:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T12:29:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T12:29:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T12:29:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T12:29:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T12:29:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T12:29:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T12:29:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T12:29:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-08T12:29:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-08T12:29:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-08T12:29:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-08T12:29:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-08T12:29:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-08T12:29:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-08T12:29:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-08T12:29:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-08T12:29:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-08T12:29:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-08T12:29:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-08T12:29:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-08T12:29:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-08T12:29:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-08T12:29:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-08T12:29:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-08T12:29:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-08T12:29:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-08T12:29:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-08T12:29:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-08T12:29:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-08T12:29:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-08T12:29:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-08T12:29:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-08T12:29:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-08T12:29:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-08T12:29:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-08T12:29:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-08T12:29:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-08T12:29:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-08T12:29:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-08T12:29:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-08T12:29:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-08T12:29:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-08T12:29:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-08T12:29:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-08T12:29:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-08T12:29:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-08T12:29:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-08T12:29:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-08T12:29:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-08T12:29:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-08T12:29:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-08T12:29:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-08T12:29:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-08T12:29:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-08T12:29:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-08T12:29:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:29:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-08T12:29:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:29:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-08T12:29:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-08T12:29:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-08T12:29:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-08T12:29:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-08T12:29:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:29:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T12:29:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T12:29:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T12:29:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:29:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T12:29:35.781 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:29:35.982 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:29:37.166 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:29:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:29:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:29:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T12:29:38.110 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:29:38.110 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:06 ago on Sun 08 Oct 2023 12:27:32 PM UTC. 2023-10-08T12:29:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:29:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:29:38.325 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:29:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:29:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:29:39.230 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T12:29:39.569 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-08T12:29:39.752 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 117/134 2023-10-08T12:29:39.997 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T12:29:40.032 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-08T12:29:40.201 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T12:29:40.202 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:29:40.263 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:29:40.389 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T12:29:40.434 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:29:40.508 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:29:40.638 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-10-08T12:29:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-08T12:29:40.651 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:29:40.820 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T12:29:40.851 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:29:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-10-08T12:29:40.852 INFO:teuthology.orchestra.run.smithi092.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T12:29:40.852 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.852 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-10-08T12:29:40.852 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T12:29:40.852 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T12:29:40.852 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T12:29:40.853 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.853 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.853 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.853 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.853 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:40.853 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.853 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.853 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.853 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:40.853 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:40.854 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:40.854 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:40.854 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:40.854 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.854 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.854 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:40.854 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.855 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.855 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.855 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:40.855 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:40.855 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.855 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:40.855 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T12:29:40.855 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T12:29:40.855 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T12:29:40.855 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T12:29:40.856 INFO:teuthology.orchestra.run.smithi092.stdout: jq-1.6-3.el8.x86_64 2023-10-08T12:29:40.856 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T12:29:40.856 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T12:29:40.856 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T12:29:40.856 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.856 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.856 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.856 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T12:29:40.856 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:29:40.856 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T12:29:40.857 INFO:teuthology.orchestra.run.smithi092.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T12:29:40.857 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:29:40.857 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T12:29:40.857 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.857 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.857 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T12:29:40.857 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.857 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T12:29:40.857 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T12:29:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T12:29:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T12:29:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T12:29:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T12:29:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T12:29:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T12:29:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T12:29:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T12:29:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T12:29:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T12:29:40.859 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T12:29:40.859 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T12:29:40.859 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:29:40.859 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:29:40.859 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:29:40.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T12:29:40.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T12:29:40.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T12:29:40.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T12:29:40.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T12:29:40.859 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.860 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.860 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.860 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T12:29:40.860 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T12:29:40.860 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T12:29:40.860 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T12:29:40.860 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T12:29:40.860 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T12:29:40.860 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T12:29:40.860 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T12:29:40.861 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T12:29:40.861 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T12:29:40.861 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T12:29:40.861 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T12:29:40.861 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T12:29:40.861 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T12:29:40.861 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T12:29:40.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T12:29:40.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T12:29:40.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T12:29:40.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T12:29:40.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T12:29:40.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T12:29:40.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T12:29:40.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T12:29:40.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T12:29:40.862 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T12:29:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T12:29:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T12:29:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T12:29:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T12:29:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T12:29:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T12:29:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T12:29:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T12:29:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T12:29:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T12:29:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T12:29:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T12:29:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T12:29:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T12:29:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T12:29:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T12:29:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T12:29:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T12:29:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T12:29:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T12:29:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T12:29:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T12:29:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T12:29:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T12:29:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T12:29:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-08T12:29:40.866 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-08T12:29:41.017 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:29:41.032 DEBUG:teuthology.parallel:result is None 2023-10-08T12:29:41.102 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:29:41.259 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:29:43.297 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:29:43.574 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:29:43.591 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:29:43.766 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T12:29:44.123 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T12:29:44.443 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T12:29:44.819 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T12:29:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T12:29:45.130 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T12:29:45.349 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T12:29:45.361 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T12:29:45.548 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T12:29:45.556 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T12:29:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-08T12:29:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:29:45.893 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:29:45.893 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:29:46.153 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:29:46.364 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:29:46.762 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:29:46.861 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:29:46.861 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T12:29:46.861 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T12:29:46.861 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T12:29:46.861 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T12:29:46.861 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T12:29:46.862 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:29:46.862 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:29:46.862 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:29:46.862 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:29:46.862 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T12:29:46.862 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T12:29:46.862 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T12:29:46.862 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T12:29:46.863 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T12:29:46.863 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T12:29:46.863 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T12:29:46.863 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T12:29:46.863 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T12:29:46.863 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T12:29:46.863 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T12:29:46.863 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T12:29:46.863 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T12:29:46.863 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T12:29:46.864 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T12:29:46.864 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T12:29:46.864 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T12:29:46.864 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T12:29:46.864 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T12:29:46.864 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T12:29:46.864 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T12:29:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T12:29:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T12:29:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T12:29:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T12:29:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T12:29:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T12:29:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T12:29:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T12:29:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T12:29:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T12:29:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T12:29:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T12:29:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T12:29:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T12:29:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T12:29:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T12:29:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T12:29:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T12:29:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T12:29:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T12:29:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T12:29:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T12:29:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T12:29:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T12:29:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T12:29:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T12:29:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T12:29:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T12:29:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T12:29:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T12:29:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T12:29:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T12:29:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T12:29:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T12:29:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T12:29:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T12:29:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T12:29:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T12:29:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T12:29:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T12:29:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T12:29:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-08T12:29:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-08T12:29:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-08T12:29:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-08T12:29:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-08T12:29:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-08T12:29:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-08T12:29:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-08T12:29:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-08T12:29:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-08T12:29:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-08T12:29:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-08T12:29:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-08T12:29:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-08T12:29:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-08T12:29:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-08T12:29:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-08T12:29:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-08T12:29:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-08T12:29:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-08T12:29:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-08T12:29:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-08T12:29:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-08T12:29:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-08T12:29:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-08T12:29:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-08T12:29:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-08T12:29:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-08T12:29:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-08T12:29:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-08T12:29:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-08T12:29:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-08T12:29:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-08T12:29:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-08T12:29:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-08T12:29:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-08T12:29:46.881 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-08T12:29:46.881 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-08T12:29:46.881 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-08T12:29:46.881 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-08T12:29:46.881 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-08T12:29:46.881 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-08T12:29:46.881 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-08T12:29:46.881 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-08T12:29:46.881 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-08T12:29:46.881 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-08T12:29:46.882 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-08T12:29:46.882 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-08T12:29:46.882 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-08T12:29:46.882 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-08T12:29:46.882 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-08T12:29:46.882 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-08T12:29:46.882 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-08T12:29:46.882 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-08T12:29:46.882 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-08T12:29:46.882 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-08T12:29:46.883 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-08T12:29:46.883 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T12:29:46.883 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T12:29:46.883 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T12:29:46.883 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:29:46.883 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T12:29:48.098 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T12:29:48.407 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-08T12:29:48.606 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 117/134 2023-10-08T12:29:48.863 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-08T12:29:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T12:29:49.267 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T12:29:49.355 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:29:49.355 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:18 ago on Sun 08 Oct 2023 12:27:31 PM UTC. 2023-10-08T12:29:49.497 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-08T12:29:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T12:29:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:29:52.155 INFO:teuthology.orchestra.run.smithi173.stdout:Installed products updated. 2023-10-08T12:29:52.369 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:29:52.370 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2023-10-08T12:29:52.370 INFO:teuthology.orchestra.run.smithi173.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T12:29:52.370 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.370 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.370 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-10-08T12:29:52.370 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T12:29:52.370 INFO:teuthology.orchestra.run.smithi173.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T12:29:52.370 INFO:teuthology.orchestra.run.smithi173.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T12:29:52.370 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.370 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.371 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.371 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.371 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:52.371 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.371 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.371 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.371 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:52.371 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:52.371 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:52.371 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:52.371 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:52.372 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.372 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.372 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:52.372 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.372 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.372 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.372 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:52.372 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:52.372 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.372 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:29:52.372 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T12:29:52.373 INFO:teuthology.orchestra.run.smithi173.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T12:29:52.373 INFO:teuthology.orchestra.run.smithi173.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T12:29:52.373 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T12:29:52.373 INFO:teuthology.orchestra.run.smithi173.stdout: jq-1.6-3.el8.x86_64 2023-10-08T12:29:52.373 INFO:teuthology.orchestra.run.smithi173.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T12:29:52.373 INFO:teuthology.orchestra.run.smithi173.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T12:29:52.373 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T12:29:52.373 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.373 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.373 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.373 INFO:teuthology.orchestra.run.smithi173.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T12:29:52.374 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:29:52.374 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T12:29:52.374 INFO:teuthology.orchestra.run.smithi173.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T12:29:52.374 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:29:52.374 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T12:29:52.374 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.375 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.375 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T12:29:52.375 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.375 INFO:teuthology.orchestra.run.smithi173.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T12:29:52.375 INFO:teuthology.orchestra.run.smithi173.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T12:29:52.375 INFO:teuthology.orchestra.run.smithi173.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T12:29:52.375 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T12:29:52.375 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T12:29:52.375 INFO:teuthology.orchestra.run.smithi173.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T12:29:52.375 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T12:29:52.375 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T12:29:52.376 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T12:29:52.376 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T12:29:52.376 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T12:29:52.376 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T12:29:52.376 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T12:29:52.376 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T12:29:52.376 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:29:52.376 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:29:52.376 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:29:52.376 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T12:29:52.376 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T12:29:52.377 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T12:29:52.377 INFO:teuthology.orchestra.run.smithi173.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T12:29:52.377 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T12:29:52.377 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.377 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.377 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.377 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T12:29:52.377 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T12:29:52.377 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T12:29:52.377 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T12:29:52.378 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T12:29:52.378 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T12:29:52.378 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T12:29:52.378 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T12:29:52.378 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T12:29:52.378 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T12:29:52.378 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T12:29:52.378 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T12:29:52.378 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T12:29:52.378 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T12:29:52.379 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T12:29:52.379 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T12:29:52.379 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T12:29:52.379 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T12:29:52.379 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T12:29:52.379 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T12:29:52.379 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T12:29:52.379 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T12:29:52.379 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T12:29:52.379 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T12:29:52.379 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T12:29:52.380 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T12:29:52.380 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T12:29:52.380 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T12:29:52.380 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T12:29:52.380 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.380 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.380 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T12:29:52.380 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T12:29:52.380 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.380 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T12:29:52.381 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T12:29:52.381 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T12:29:52.381 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T12:29:52.381 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T12:29:52.381 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T12:29:52.381 INFO:teuthology.orchestra.run.smithi173.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T12:29:52.381 INFO:teuthology.orchestra.run.smithi173.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T12:29:52.381 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T12:29:52.381 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T12:29:52.381 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T12:29:52.382 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T12:29:52.382 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T12:29:52.382 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.382 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.382 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:29:52.382 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T12:29:52.382 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T12:29:52.382 INFO:teuthology.orchestra.run.smithi173.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T12:29:52.382 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T12:29:52.383 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T12:29:52.383 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T12:29:52.383 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:29:52.383 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-10-08T12:29:52.749 DEBUG:teuthology.parallel:result is None 2023-10-08T12:29:53.476 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:29:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:29:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:29:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T12:29:54.226 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T12:29:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T12:29:54.895 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T12:29:55.082 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T12:29:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T12:29:55.432 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T12:29:55.461 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T12:29:55.674 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T12:29:55.697 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T12:29:55.861 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-08T12:29:55.861 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:29:56.081 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:29:56.081 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:29:56.334 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:29:56.567 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:29:56.867 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:29:56.868 INFO:teuthology.orchestra.run.smithi059.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-08T12:29:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:29:57.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T12:29:57.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T12:29:57.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T12:29:57.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T12:29:57.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T12:29:57.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:29:57.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T12:29:57.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T12:29:57.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T12:29:57.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T12:29:57.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T12:29:57.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T12:29:57.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T12:29:57.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T12:29:57.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T12:29:57.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T12:29:57.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T12:29:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T12:29:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T12:29:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T12:29:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T12:29:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T12:29:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T12:29:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T12:29:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T12:29:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T12:29:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T12:29:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T12:29:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T12:29:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T12:29:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T12:29:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T12:29:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T12:29:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T12:29:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T12:29:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T12:29:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T12:29:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T12:29:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T12:29:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T12:29:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T12:29:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T12:29:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T12:29:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T12:29:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T12:29:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T12:29:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T12:29:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T12:29:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T12:29:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T12:29:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T12:29:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T12:29:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T12:29:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T12:29:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T12:29:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T12:29:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T12:29:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T12:29:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T12:29:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T12:29:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-08T12:29:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-08T12:29:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-08T12:29:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-08T12:29:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-08T12:29:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-08T12:29:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-08T12:29:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-08T12:29:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-08T12:29:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-08T12:29:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-08T12:29:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-08T12:29:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-08T12:29:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-08T12:29:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-08T12:29:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-08T12:29:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-08T12:29:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-08T12:29:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-08T12:29:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-08T12:29:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-08T12:29:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-08T12:29:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-08T12:29:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-08T12:29:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-08T12:29:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-08T12:29:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-08T12:29:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-08T12:29:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-08T12:29:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-08T12:29:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-08T12:29:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-08T12:29:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-08T12:29:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-08T12:29:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-08T12:29:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-08T12:29:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-08T12:29:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-08T12:29:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-08T12:29:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-08T12:29:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-08T12:29:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-08T12:29:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-08T12:29:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-08T12:29:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-08T12:29:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-08T12:29:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T12:29:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T12:29:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T12:29:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:29:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T12:30:00.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:30:00.265 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:02:25 ago on Sun 08 Oct 2023 12:27:35 PM UTC. 2023-10-08T12:30:04.274 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2023-10-08T12:30:04.515 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:30:04.515 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2023-10-08T12:30:04.515 INFO:teuthology.orchestra.run.smithi059.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T12:30:04.515 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.515 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.515 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-10-08T12:30:04.515 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T12:30:04.515 INFO:teuthology.orchestra.run.smithi059.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T12:30:04.516 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T12:30:04.516 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.516 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.516 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.516 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.516 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:30:04.516 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.516 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.516 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.516 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:30:04.516 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:30:04.517 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:30:04.517 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:30:04.517 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:30:04.517 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.517 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.517 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:30:04.517 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.517 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.517 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.517 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:30:04.518 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:30:04.518 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.518 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:30:04.518 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T12:30:04.518 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T12:30:04.518 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T12:30:04.518 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T12:30:04.518 INFO:teuthology.orchestra.run.smithi059.stdout: jq-1.6-3.el8.x86_64 2023-10-08T12:30:04.518 INFO:teuthology.orchestra.run.smithi059.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T12:30:04.518 INFO:teuthology.orchestra.run.smithi059.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T12:30:04.518 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T12:30:04.519 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.519 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.519 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.519 INFO:teuthology.orchestra.run.smithi059.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T12:30:04.519 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:30:04.519 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T12:30:04.519 INFO:teuthology.orchestra.run.smithi059.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T12:30:04.519 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:30:04.519 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T12:30:04.519 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.519 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.520 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T12:30:04.520 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.520 INFO:teuthology.orchestra.run.smithi059.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T12:30:04.520 INFO:teuthology.orchestra.run.smithi059.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T12:30:04.520 INFO:teuthology.orchestra.run.smithi059.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T12:30:04.520 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T12:30:04.520 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T12:30:04.520 INFO:teuthology.orchestra.run.smithi059.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T12:30:04.520 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T12:30:04.520 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T12:30:04.520 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T12:30:04.521 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T12:30:04.521 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T12:30:04.521 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T12:30:04.521 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T12:30:04.521 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T12:30:04.521 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:30:04.521 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:30:04.521 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:30:04.521 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T12:30:04.521 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T12:30:04.521 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T12:30:04.522 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T12:30:04.522 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T12:30:04.522 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.522 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.522 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.522 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T12:30:04.522 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T12:30:04.522 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T12:30:04.522 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T12:30:04.522 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T12:30:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T12:30:04.524 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T12:30:04.524 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T12:30:04.524 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T12:30:04.524 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T12:30:04.524 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T12:30:04.524 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T12:30:04.524 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T12:30:04.524 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T12:30:04.524 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T12:30:04.524 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T12:30:04.524 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T12:30:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T12:30:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T12:30:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T12:30:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T12:30:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T12:30:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T12:30:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T12:30:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T12:30:04.526 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T12:30:04.526 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T12:30:04.526 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T12:30:04.526 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T12:30:04.526 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T12:30:04.526 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T12:30:04.526 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T12:30:04.526 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T12:30:04.526 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.526 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.526 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:30:04.527 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T12:30:04.527 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T12:30:04.527 INFO:teuthology.orchestra.run.smithi059.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T12:30:04.527 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T12:30:04.527 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T12:30:04.527 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T12:30:04.527 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:30:04.527 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-08T12:30:04.877 DEBUG:teuthology.parallel:result is None 2023-10-08T12:30:04.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:30:05.024 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T12:30:05.080 INFO:teuthology.orchestra.run.smithi059.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T12:30:05.081 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T12:30:05.081 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T12:30:05.081 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:30:05.227 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T12:30:05.255 INFO:teuthology.orchestra.run.smithi092.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T12:30:05.255 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T12:30:05.256 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T12:30:05.256 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:30:05.617 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T12:30:05.646 INFO:teuthology.orchestra.run.smithi173.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T12:30:05.646 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T12:30:05.646 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T12:30:05.646 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T12:30:05.646 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:30:05.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T12:30:05.743 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-08T12:30:05.743 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T12:30:05.792 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-08T12:30:05.792 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T12:30:05.841 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T12:30:05.841 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:30:05.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T12:30:05.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T12:30:06.029 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-08T12:30:06.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T12:30:06.062 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T12:30:06.135 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-08T12:30:06.136 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T12:30:06.169 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T12:30:06.240 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T12:30:06.240 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:30:06.240 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T12:30:06.309 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T12:30:06.417 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-08T12:30:06.418 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T12:30:06.451 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T12:30:06.520 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-08T12:30:06.521 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T12:30:06.553 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T12:30:06.623 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T12:30:06.624 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:30:06.624 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T12:30:06.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T12:30:06.801 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-08T12:30:06.801 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T12:30:06.832 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T12:30:06.900 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-08T12:30:06.900 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T12:30:06.933 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T12:30:07.003 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-08T12:30:07.087 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_client_delegate_inos_pct': 50}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'subvols': {'create': 2}} 2023-10-08T12:30:07.087 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:30:07.087 INFO:tasks.cephadm:Cluster fsid is 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:30:07.088 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-08T12:30:07.088 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.59', 'mon.b': '172.21.15.92', 'mon.c': '172.21.15.173'} 2023-10-08T12:30:07.088 INFO:tasks.cephadm:First mon is mon.a on smithi059 2023-10-08T12:30:07.088 INFO:tasks.cephadm:First mgr is x 2023-10-08T12:30:07.088 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-08T12:30:07.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname $(hostname -s) 2023-10-08T12:30:07.159 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname $(hostname -s) 2023-10-08T12:30:07.191 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname $(hostname -s) 2023-10-08T12:30:07.224 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-08T12:30:07.224 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:30:07.574 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73096/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6639-g7b3143ba', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6639.g7b3143ba'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-07 17:16:01.199993', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20231007.154158', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-10-08T12:30:07.898 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-batrick-testing-20231007.154158, sha1 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:30:07.898 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm 2023-10-08T12:30:07.898 DEBUG:teuthology.orchestra.run.smithi059:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T12:30:08.706 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 12:30 /home/ubuntu/cephtest/cephadm 2023-10-08T12:30:08.706 DEBUG:teuthology.orchestra.run.smithi092:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T12:30:09.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 12:30 /home/ubuntu/cephtest/cephadm 2023-10-08T12:30:09.178 DEBUG:teuthology.orchestra.run.smithi173:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T12:30:09.661 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 12:30 /home/ubuntu/cephtest/cephadm 2023-10-08T12:30:09.661 DEBUG:teuthology.orchestra.run.smithi059:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T12:30:09.712 DEBUG:teuthology.orchestra.run.smithi092:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T12:30:09.733 DEBUG:teuthology.orchestra.run.smithi173:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T12:30:09.770 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de on all hosts... 2023-10-08T12:30:09.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T12:30:09.774 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T12:30:09.777 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T12:30:11.308 INFO:teuthology.orchestra.run.smithi092.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:30:13.263 INFO:teuthology.orchestra.run.smithi173.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:30:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:30:42.018 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-08T12:30:42.018 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T12:30:42.018 INFO:teuthology.orchestra.run.smithi092.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T12:30:42.018 INFO:teuthology.orchestra.run.smithi092.stdout: "repo_digests": [ 2023-10-08T12:30:42.018 INFO:teuthology.orchestra.run.smithi092.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T12:30:42.018 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-10-08T12:30:42.019 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-08T12:30:44.055 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-10-08T12:30:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T12:30:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T12:30:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: "repo_digests": [ 2023-10-08T12:30:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T12:30:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2023-10-08T12:30:44.056 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-10-08T12:30:45.694 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:30:45.695 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T12:30:45.695 INFO:teuthology.orchestra.run.smithi059.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T12:30:45.695 INFO:teuthology.orchestra.run.smithi059.stdout: "repo_digests": [ 2023-10-08T12:30:45.695 INFO:teuthology.orchestra.run.smithi059.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T12:30:45.695 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T12:30:45.695 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:30:45.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph 2023-10-08T12:30:45.798 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph 2023-10-08T12:30:45.834 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph 2023-10-08T12:30:45.870 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /etc/ceph 2023-10-08T12:30:45.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /etc/ceph 2023-10-08T12:30:45.968 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /etc/ceph 2023-10-08T12:30:45.997 INFO:tasks.cephadm:Writing seed config... 2023-10-08T12:30:45.999 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-10-08T12:30:45.999 INFO:tasks.cephadm: override: [mds] mds_client_delegate_inos_pct = 50 2023-10-08T12:30:45.999 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-08T12:30:45.999 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-08T12:30:45.999 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-08T12:30:45.999 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-08T12:30:45.999 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-08T12:30:45.999 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-08T12:30:45.999 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-08T12:30:45.999 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-08T12:30:46.000 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-08T12:30:46.001 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-10-08T12:30:46.001 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:30:46.001 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-08T12:30:46.044 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6a005028-65d6-11ee-8db5-212e2dc638e7 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_client_delegate_inos_pct = 50 2023-10-08T12:30:46.044 DEBUG:teuthology.orchestra.run.smithi059:mon.a> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.a.service 2023-10-08T12:30:46.088 DEBUG:teuthology.orchestra.run.smithi059:mgr.x> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.x.service 2023-10-08T12:30:46.132 INFO:tasks.cephadm:Bootstrapping... 2023-10-08T12:30:46.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de -v bootstrap --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.59 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:30:46.156 INFO:journalctl@ceph.mon.a.smithi059.stdout:-- Logs begin at Sun 2023-10-08 12:12:12 UTC. -- 2023-10-08T12:30:46.204 INFO:journalctl@ceph.mgr.x.smithi059.stdout:-- Logs begin at Sun 2023-10-08 12:12:12 UTC. -- 2023-10-08T12:30:46.372 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:30:46.373 INFO:teuthology.orchestra.run.smithi059.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', '-v', 'bootstrap', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.59', '--skip-admin-label'] 2023-10-08T12:30:46.546 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stdout 4.1.1 2023-10-08T12:30:46.547 INFO:teuthology.orchestra.run.smithi059.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-08T12:30:46.547 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying podman|docker is present... 2023-10-08T12:30:46.718 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stdout 4.1.1 2023-10-08T12:30:46.718 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying lvm2 is present... 2023-10-08T12:30:46.718 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying time synchronization is in place... 2023-10-08T12:30:46.733 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-08T12:30:46.733 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-08T12:30:46.746 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-08T12:30:46.746 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2023-10-08T12:30:46.760 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout enabled 2023-10-08T12:30:46.773 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout active 2023-10-08T12:30:46.773 INFO:teuthology.orchestra.run.smithi059.stdout:Unit chronyd.service is enabled and running 2023-10-08T12:30:46.773 INFO:teuthology.orchestra.run.smithi059.stdout:Repeating the final host check... 2023-10-08T12:30:46.944 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stdout 4.1.1 2023-10-08T12:30:46.944 INFO:teuthology.orchestra.run.smithi059.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-08T12:30:46.944 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl is present 2023-10-08T12:30:46.944 INFO:teuthology.orchestra.run.smithi059.stdout:lvcreate is present 2023-10-08T12:30:46.958 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-08T12:30:46.958 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-08T12:30:46.971 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-08T12:30:46.971 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2023-10-08T12:30:46.984 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout enabled 2023-10-08T12:30:46.998 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout active 2023-10-08T12:30:46.998 INFO:teuthology.orchestra.run.smithi059.stdout:Unit chronyd.service is enabled and running 2023-10-08T12:30:46.998 INFO:teuthology.orchestra.run.smithi059.stdout:Host looks OK 2023-10-08T12:30:46.998 INFO:teuthology.orchestra.run.smithi059.stdout:Cluster fsid: 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:30:46.998 INFO:teuthology.orchestra.run.smithi059.stdout:Acquiring lock 139773303119152 on /run/cephadm/6a005028-65d6-11ee-8db5-212e2dc638e7.lock 2023-10-08T12:30:46.998 INFO:teuthology.orchestra.run.smithi059.stdout:Lock 139773303119152 acquired on /run/cephadm/6a005028-65d6-11ee-8db5-212e2dc638e7.lock 2023-10-08T12:30:46.999 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying IP 172.21.15.59 port 3300 ... 2023-10-08T12:30:46.999 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying IP 172.21.15.59 port 6789 ... 2023-10-08T12:30:46.999 INFO:teuthology.orchestra.run.smithi059.stdout:Base mon IP(s) is [172.21.15.59:3300, 172.21.15.59:6789], mon addrv is [v2:172.21.15.59:3300,v1:172.21.15.59:6789] 2023-10-08T12:30:47.007 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-10-08T12:30:47.007 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.59 metric 100 2023-10-08T12:30:47.014 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-08T12:30:47.014 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-10-08T12:30:47.014 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1754sec hoplimit 64 pref medium 2023-10-08T12:30:47.020 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-08T12:30:47.021 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-08T12:30:47.021 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-08T12:30:47.021 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-10-08T12:30:47.021 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-08T12:30:47.021 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-08T12:30:47.022 INFO:teuthology.orchestra.run.smithi059.stdout:Mon IP `172.21.15.59` is in CIDR network `172.21.0.0/20` 2023-10-08T12:30:47.022 INFO:teuthology.orchestra.run.smithi059.stdout:Mon IP `172.21.15.59` is in CIDR network `172.21.0.0/20` 2023-10-08T12:30:47.022 INFO:teuthology.orchestra.run.smithi059.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-08T12:30:47.022 INFO:teuthology.orchestra.run.smithi059.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-08T12:30:47.024 INFO:teuthology.orchestra.run.smithi059.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:30:47.497 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stdout 09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492 2023-10-08T12:30:47.497 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:30:47.497 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Getting image source signatures 2023-10-08T12:30:47.498 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Copying blob sha256:1016a809630cb60ade9603521911a0725a35bac1f67b6518836ae2dd33bb1dad 2023-10-08T12:30:47.498 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Copying blob sha256:be9ed931e0f930233626f1c4d225977fbcc33e056e1a8fc67c7f63553d9455a2 2023-10-08T12:30:47.498 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Copying config sha256:09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492 2023-10-08T12:30:47.498 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-08T12:30:47.498 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Storing signatures 2023-10-08T12:30:48.473 INFO:teuthology.orchestra.run.smithi059.stdout:ceph: stdout ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T12:30:48.473 INFO:teuthology.orchestra.run.smithi059.stdout:Ceph version: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T12:30:48.473 INFO:teuthology.orchestra.run.smithi059.stdout:Extracting ceph user uid/gid from container image... 2023-10-08T12:30:49.348 INFO:teuthology.orchestra.run.smithi059.stdout:stat: stdout 167 167 2023-10-08T12:30:49.349 INFO:teuthology.orchestra.run.smithi059.stdout:Creating initial keys... 2023-10-08T12:30:50.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph-authtool: stdout AQD5oCJlXARaLhAAwJxo1TMHN5+ddlLfPI9PZg== 2023-10-08T12:30:51.302 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph-authtool: stdout AQD6oCJldzPKLhAA16PcU/iMfXEbxrbGuYm98g== 2023-10-08T12:30:52.684 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph-authtool: stdout AQD8oCJlO9gVCxAAVVepwS/0H1YermDv5u2H1w== 2023-10-08T12:30:52.685 INFO:teuthology.orchestra.run.smithi059.stdout:Creating initial monmap... 2023-10-08T12:30:53.562 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-08T12:30:53.563 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-08T12:30:53.563 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:30:53.563 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-08T12:30:53.563 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool for a [v2:172.21.15.59:3300,v1:172.21.15.59:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-08T12:30:53.563 INFO:teuthology.orchestra.run.smithi059.stdout:setting min_mon_release = pacific 2023-10-08T12:30:53.563 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: set fsid to 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:30:53.564 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-08T12:30:53.564 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:30:53.564 INFO:teuthology.orchestra.run.smithi059.stdout:Creating mon... 2023-10-08T12:30:54.441 INFO:teuthology.orchestra.run.smithi059.stdout:create mon.a on 2023-10-08T12:30:54.726 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-08T12:30:54.942 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-08T12:30:55.200 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6a005028-65d6-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-6a005028-65d6-11ee-8db5-212e2dc638e7.target. 2023-10-08T12:30:55.200 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6a005028-65d6-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-6a005028-65d6-11ee-8db5-212e2dc638e7.target. 2023-10-08T12:30:55.562 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.a 2023-10-08T12:30:55.563 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.a.service: Unit ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.a.service not loaded. 2023-10-08T12:30:55.770 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6a005028-65d6-11ee-8db5-212e2dc638e7.target.wants/ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@.service. 2023-10-08T12:30:56.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:55 smithi059 systemd[1]: Starting Ceph mon.a for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:30:56.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:56 smithi059 podman[97940]: 2023-10-08T12:30:57.604 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:30:57.605 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2023-10-08T12:30:57.623 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:30:57.624 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2023-10-08T12:30:57.624 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2023-10-08T12:30:57.624 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to enable service . firewalld.service is not available 2023-10-08T12:30:57.624 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mon to start... 2023-10-08T12:30:57.624 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mon... 2023-10-08T12:30:57.931 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:57 smithi059 bash[97940]: 3b91c9668f5e9251fe6c14de65f1c2f3117916a2e9a51c9e38d5c819eb4f1fe8 2023-10-08T12:30:57.932 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:57 smithi059 systemd[1]: Started Ceph mon.a for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:30:57.932 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:57 smithi059 ceph-mon[97980]: mkfs 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:30:57.932 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:57 smithi059 ceph-mon[97980]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T12:30:58.806 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout cluster: 2023-10-08T12:30:58.808 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout id: 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:30:58.808 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-08T12:30:58.808 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:30:58.808 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout services: 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.675989s) 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout data: 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout pgs: 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:mon is available 2023-10-08T12:30:58.809 INFO:teuthology.orchestra.run.smithi059.stdout:Assimilating anything we can from ceph.conf... 2023-10-08T12:30:59.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:58 smithi059 ceph-mon[97980]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T12:30:59.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:58 smithi059 ceph-mon[97980]: monmap e1: 1 mons at {a=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0]} removed_ranks: {} 2023-10-08T12:30:59.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:58 smithi059 ceph-mon[97980]: fsmap 2023-10-08T12:30:59.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:58 smithi059 ceph-mon[97980]: osdmap e1: 0 total, 0 up, 0 in 2023-10-08T12:30:59.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:58 smithi059 ceph-mon[97980]: mgrmap e1: no daemons active 2023-10-08T12:30:59.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:58 smithi059 ceph-mon[97980]: from='client.? 172.21.15.59:0/3577676713' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-08T12:30:59.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:59 smithi059 ceph-mon[97980]: from='client.? 172.21.15.59:0/1920122154' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-08T12:30:59.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:30:59 smithi059 ceph-mon[97980]: from='client.? 172.21.15.59:0/1920122154' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-08T12:30:59.990 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:30:59.990 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [global] 2023-10-08T12:30:59.990 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout fsid = 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:30:59.990 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.59:3300,v1:172.21.15.59:6789] 2023-10-08T12:30:59.990 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-08T12:30:59.990 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-08T12:30:59.990 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-08T12:30:59.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-08T12:30:59.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:30:59.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-08T12:30:59.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-08T12:30:59.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:30:59.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [osd] 2023-10-08T12:30:59.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-08T12:30:59.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-08T12:30:59.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-08T12:30:59.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-08T12:30:59.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-08T12:30:59.992 INFO:teuthology.orchestra.run.smithi059.stdout:Generating new minimal ceph.conf... 2023-10-08T12:31:01.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:00 smithi059 ceph-mon[97980]: from='client.? 172.21.15.59:0/1437691829' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:31:01.165 INFO:teuthology.orchestra.run.smithi059.stdout:Restarting the monitor... 2023-10-08T12:31:01.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:01 smithi059 systemd[1]: Stopping Ceph mon.a for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:31:02.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:01 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-a[97956]: 2023-10-08T12:31:01.668+0000 7f2ab37d1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T12:31:02.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:01 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-a[97956]: 2023-10-08T12:31:01.668+0000 7f2ab37d1700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-08T12:31:02.436 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:02 smithi059 bash[98319]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-a 2023-10-08T12:31:02.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:02 smithi059 systemd[1]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.a.service: Succeeded. 2023-10-08T12:31:02.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:02 smithi059 systemd[1]: Stopped Ceph mon.a for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:31:02.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:02 smithi059 systemd[1]: Starting Ceph mon.a for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:31:03.530 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 podman[98449]: 2023-10-08T12:31:03.540 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 bash[98449]: 07228c73346908faa1a8cb4673aa875d619a8a29745d63c219a93f5f6aadae56 2023-10-08T12:31:03.540 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T12:31:03.616 INFO:teuthology.orchestra.run.smithi059.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-08T12:31:03.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T12:31:03.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: pidfile_write: ignore empty --pid-file 2023-10-08T12:31:03.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: load: jerasure load: lrc 2023-10-08T12:31:03.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: RocksDB version: 7.9.2 2023-10-08T12:31:03.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Git sha 0 2023-10-08T12:31:03.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T12:31:03.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: DB SUMMARY 2023-10-08T12:31:03.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: DB Session ID: TGO5Z5F12A0KESBDYPEG 2023-10-08T12:31:03.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: CURRENT file: CURRENT 2023-10-08T12:31:03.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T12:31:03.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-08T12:31:03.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-08T12:31:03.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 89192 ; 2023-10-08T12:31:03.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.error_if_exists: 0 2023-10-08T12:31:03.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.create_if_missing: 0 2023-10-08T12:31:03.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.paranoid_checks: 1 2023-10-08T12:31:03.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T12:31:03.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T12:31:03.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T12:31:03.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.env: 0x556532279da0 2023-10-08T12:31:03.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T12:31:03.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.info_log: 0x556533115640 2023-10-08T12:31:03.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T12:31:03.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.statistics: (nil) 2023-10-08T12:31:03.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.use_fsync: 0 2023-10-08T12:31:03.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_log_file_size: 0 2023-10-08T12:31:03.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T12:31:03.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T12:31:03.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T12:31:03.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T12:31:03.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.allow_fallocate: 1 2023-10-08T12:31:03.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T12:31:03.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T12:31:03.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.use_direct_reads: 0 2023-10-08T12:31:03.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.db_log_dir: 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.wal_dir: 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T12:31:03.892 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.write_buffer_manager: 0x5565330cd360 2023-10-08T12:31:03.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T12:31:03.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T12:31:03.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T12:31:03.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T12:31:03.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T12:31:03.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T12:31:03.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T12:31:03.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T12:31:03.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.unordered_write: 0 2023-10-08T12:31:03.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T12:31:03.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T12:31:03.894 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T12:31:03.894 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T12:31:03.894 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.row_cache: None 2023-10-08T12:31:03.894 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.wal_filter: None 2023-10-08T12:31:03.894 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T12:31:03.894 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T12:31:03.894 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.two_write_queues: 0 2023-10-08T12:31:03.894 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T12:31:03.894 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.wal_compression: 0 2023-10-08T12:31:03.894 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.atomic_flush: 0 2023-10-08T12:31:03.894 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T12:31:03.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T12:31:03.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T12:31:03.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.log_readahead_size: 0 2023-10-08T12:31:03.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T12:31:03.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T12:31:03.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T12:31:03.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T12:31:03.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T12:31:03.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T12:31:03.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T12:31:03.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_background_jobs: 2 2023-10-08T12:31:03.896 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_background_compactions: -1 2023-10-08T12:31:03.896 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_subcompactions: 1 2023-10-08T12:31:03.896 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T12:31:03.896 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T12:31:03.896 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T12:31:03.896 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T12:31:03.896 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T12:31:03.896 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T12:31:03.896 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T12:31:03.896 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T12:31:03.896 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_open_files: -1 2023-10-08T12:31:03.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T12:31:03.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T12:31:03.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T12:31:03.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T12:31:03.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_background_flushes: -1 2023-10-08T12:31:03.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Compression algorithms supported: 2023-10-08T12:31:03.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T12:31:03.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: kZSTD supported: 0 2023-10-08T12:31:03.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: kXpressCompression supported: 0 2023-10-08T12:31:03.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T12:31:03.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: kZlibCompression supported: 1 2023-10-08T12:31:03.898 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: kSnappyCompression supported: 1 2023-10-08T12:31:03.898 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: kLZ4Compression supported: 1 2023-10-08T12:31:03.898 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: kBZip2Compression supported: 0 2023-10-08T12:31:03.898 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T12:31:03.898 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T12:31:03.898 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-08T12:31:03.898 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T12:31:03.898 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T12:31:03.898 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.merge_operator: 2023-10-08T12:31:03.898 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_filter: None 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556533115740) 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout: cache_index_and_filter_blocks: 1 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout: pin_top_level_index_and_filter: 1 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout: index_type: 0 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout: data_block_index_type: 0 2023-10-08T12:31:03.899 INFO:journalctl@ceph.mon.a.smithi059.stdout: index_shortening: 1 2023-10-08T12:31:03.900 INFO:journalctl@ceph.mon.a.smithi059.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T12:31:03.900 INFO:journalctl@ceph.mon.a.smithi059.stdout: checksum: 4 2023-10-08T12:31:03.900 INFO:journalctl@ceph.mon.a.smithi059.stdout: no_block_cache: 0 2023-10-08T12:31:03.900 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache: 0x55653316b1f0 2023-10-08T12:31:03.900 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache_name: BinnedLRUCache 2023-10-08T12:31:03.900 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache_options: 2023-10-08T12:31:03.900 INFO:journalctl@ceph.mon.a.smithi059.stdout: capacity : 536870912 2023-10-08T12:31:03.900 INFO:journalctl@ceph.mon.a.smithi059.stdout: num_shard_bits : 4 2023-10-08T12:31:03.900 INFO:journalctl@ceph.mon.a.smithi059.stdout: strict_capacity_limit : 0 2023-10-08T12:31:03.900 INFO:journalctl@ceph.mon.a.smithi059.stdout: high_pri_pool_ratio: 0.000 2023-10-08T12:31:03.900 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache_compressed: (nil) 2023-10-08T12:31:03.901 INFO:journalctl@ceph.mon.a.smithi059.stdout: persistent_cache: (nil) 2023-10-08T12:31:03.901 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_size: 4096 2023-10-08T12:31:03.901 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_size_deviation: 10 2023-10-08T12:31:03.901 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_restart_interval: 16 2023-10-08T12:31:03.901 INFO:journalctl@ceph.mon.a.smithi059.stdout: index_block_restart_interval: 1 2023-10-08T12:31:03.901 INFO:journalctl@ceph.mon.a.smithi059.stdout: metadata_block_size: 4096 2023-10-08T12:31:03.901 INFO:journalctl@ceph.mon.a.smithi059.stdout: partition_filters: 0 2023-10-08T12:31:03.901 INFO:journalctl@ceph.mon.a.smithi059.stdout: use_delta_encoding: 1 2023-10-08T12:31:03.901 INFO:journalctl@ceph.mon.a.smithi059.stdout: filter_policy: bloomfilter 2023-10-08T12:31:03.901 INFO:journalctl@ceph.mon.a.smithi059.stdout: whole_key_filtering: 1 2023-10-08T12:31:03.901 INFO:journalctl@ceph.mon.a.smithi059.stdout: verify_compression: 0 2023-10-08T12:31:03.902 INFO:journalctl@ceph.mon.a.smithi059.stdout: read_amp_bytes_per_bit: 0 2023-10-08T12:31:03.902 INFO:journalctl@ceph.mon.a.smithi059.stdout: format_version: 5 2023-10-08T12:31:03.902 INFO:journalctl@ceph.mon.a.smithi059.stdout: enable_index_compression: 1 2023-10-08T12:31:03.902 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_align: 0 2023-10-08T12:31:03.902 INFO:journalctl@ceph.mon.a.smithi059.stdout: max_auto_readahead_size: 262144 2023-10-08T12:31:03.902 INFO:journalctl@ceph.mon.a.smithi059.stdout: prepopulate_block_cache: 0 2023-10-08T12:31:03.902 INFO:journalctl@ceph.mon.a.smithi059.stdout: initial_auto_readahead_size: 8192 2023-10-08T12:31:03.902 INFO:journalctl@ceph.mon.a.smithi059.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T12:31:03.902 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T12:31:03.902 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T12:31:03.902 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compression: NoCompression 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.num_levels: 7 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T12:31:03.903 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:31:03.904 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T12:31:03.904 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T12:31:03.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:31:03.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:31:03.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T12:31:03.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T12:31:03.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T12:31:03.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T12:31:03.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:31:03.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:31:03.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T12:31:03.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T12:31:03.906 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T12:31:03.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T12:31:03.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T12:31:03.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T12:31:03.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T12:31:03.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T12:31:03.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T12:31:03.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T12:31:03.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T12:31:03.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T12:31:03.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T12:31:03.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T12:31:03.908 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T12:31:03.908 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T12:31:03.908 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T12:31:03.908 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T12:31:03.908 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T12:31:03.908 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T12:31:03.908 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T12:31:03.908 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T12:31:03.908 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T12:31:03.908 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T12:31:03.908 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.table_properties_collectors: 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.inplace_update_support: 0 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.bloom_locality: 0 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.max_successive_merges: 0 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T12:31:03.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.ttl: 2592000 2023-10-08T12:31:03.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T12:31:03.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T12:31:03.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T12:31:03.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.enable_blob_files: false 2023-10-08T12:31:03.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.min_blob_size: 0 2023-10-08T12:31:03.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T12:31:03.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T12:31:03.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T12:31:03.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T12:31:03.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T12:31:03.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T12:31:03.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T12:31:03.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T12:31:03.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-08T12:31:03.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-08T12:31:03.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5effacd8-43e3-4627-989a-643e136dde7c 2023-10-08T12:31:03.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696768263554055, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-08T12:31:03.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-08T12:31:03.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696768263556776, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85417, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 272, "table_properties": {"data_size": 83520, "index_size": 243, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11233, "raw_average_key_size": 48, "raw_value_size": 77207, "raw_average_value_size": 334, "num_data_blocks": 10, "num_entries": 231, "num_filter_entries": 231, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696768263, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5effacd8-43e3-4627-989a-643e136dde7c", "db_session_id": "TGO5Z5F12A0KESBDYPEG", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-08T12:31:03.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696768263556963, "job": 1, "event": "recovery_finished"} 2023-10-08T12:31:03.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-08T12:31:03.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T12:31:03.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556533208000 2023-10-08T12:31:03.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: DB pointer 0x5565331f4000 2023-10-08T12:31:03.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T12:31:03.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T12:31:03.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** DB Stats ** 2023-10-08T12:31:03.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:31:03.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T12:31:03.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:31:03.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:31:03.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T12:31:03.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** Compaction Stats [default] ** 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: L0 2/0 85.25 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 45.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: Sum 2/0 85.25 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 45.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 45.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** Compaction Stats [default] ** 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:31:03.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T12:31:03.914 INFO:journalctl@ceph.mon.a.smithi059.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 45.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-10-08T12:31:03.914 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2023-10-08T12:31:03.914 INFO:journalctl@ceph.mon.a.smithi059.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T12:31:03.914 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2023-10-08T12:31:03.914 INFO:journalctl@ceph.mon.a.smithi059.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:31:03.914 INFO:journalctl@ceph.mon.a.smithi059.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T12:31:03.914 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T12:31:03.914 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T12:31:03.914 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T12:31:03.914 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative compaction: 0.00 GB write, 7.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval compaction: 0.00 GB write, 7.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout: Block cache BinnedLRUCache@0x55653316b1f0#7 capacity: 512.00 MB usage: 1.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: starting mon.a rank 0 at public addrs [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] at bind addrs [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: mon.a@-1(???) e1 preinit fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: mon.a@-1(???).mds e1 new map 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: mon.a@-1(???).mds e1 print_map 2023-10-08T12:31:03.915 INFO:journalctl@ceph.mon.a.smithi059.stdout: e1 2023-10-08T12:31:03.916 INFO:journalctl@ceph.mon.a.smithi059.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T12:31:03.916 INFO:journalctl@ceph.mon.a.smithi059.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:31:03.916 INFO:journalctl@ceph.mon.a.smithi059.stdout: legacy client fscid: -1 2023-10-08T12:31:03.916 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2023-10-08T12:31:03.916 INFO:journalctl@ceph.mon.a.smithi059.stdout: No filesystems configured 2023-10-08T12:31:03.916 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T12:31:03.916 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:31:03.916 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:31:03.916 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:31:03.916 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-08T12:31:03.916 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 systemd[1]: Started Ceph mon.a for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:31:03.917 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T12:31:03.917 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: monmap e1: 1 mons at {a=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0]} removed_ranks: {} 2023-10-08T12:31:03.917 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: fsmap 2023-10-08T12:31:03.917 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: osdmap e1: 0 total, 0 up, 0 in 2023-10-08T12:31:03.917 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:03 smithi059 ceph-mon[98489]: mgrmap e1: no daemons active 2023-10-08T12:31:04.697 INFO:teuthology.orchestra.run.smithi059.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-08T12:31:04.722 INFO:teuthology.orchestra.run.smithi059.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:31:04.722 INFO:teuthology.orchestra.run.smithi059.stdout:Creating mgr... 2023-10-08T12:31:04.723 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-08T12:31:04.723 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-08T12:31:05.118 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.x 2023-10-08T12:31:05.118 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.x.service: Unit ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.x.service not loaded. 2023-10-08T12:31:05.325 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6a005028-65d6-11ee-8db5-212e2dc638e7.target.wants/ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@.service. 2023-10-08T12:31:05.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:05 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2242064750' entity='client.admin' 2023-10-08T12:31:05.515 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:05 smithi059 systemd[1]: Starting Ceph mgr.x for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:31:06.129 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:05 smithi059 podman[98719]: 2023-10-08T12:31:06.241 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:31:06.241 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2023-10-08T12:31:06.257 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:31:06.257 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2023-10-08T12:31:06.257 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2023-10-08T12:31:06.257 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to enable service . firewalld.service is not available 2023-10-08T12:31:06.276 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:31:06.276 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2023-10-08T12:31:06.293 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:31:06.293 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2023-10-08T12:31:06.293 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2023-10-08T12:31:06.293 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-08T12:31:06.293 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr to start... 2023-10-08T12:31:06.293 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr... 2023-10-08T12:31:06.425 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:06 smithi059 bash[98719]: ef5151d459898c5f49933a89f6ef0029bfa7bccecf905fc12aea8bb761d6b3a9 2023-10-08T12:31:06.426 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:06 smithi059 systemd[1]: Started Ceph mgr.x for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:31:06.426 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:06.313+0000 7f3023ea2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:31:06.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:06.425+0000 7f3023ea2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:31:06.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:06.544+0000 7f3023ea2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:31:06.765 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:06.673+0000 7f3023ea2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:31:07.166 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:06.915+0000 7f3023ea2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:31:07.166 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:07 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1864158777' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T12:31:07.475 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:31:07.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:31:07.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsid": "6a005028-65d6-11ee-8db5-212e2dc638e7", 2023-10-08T12:31:07.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T12:31:07.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T12:31:07.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T12:31:07.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T12:31:07.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:07.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T12:31:07.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T12:31:07.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 0 2023-10-08T12:31:07.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:31:07.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T12:31:07.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T12:31:07.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:31:07.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-10-08T12:31:07.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T12:31:07.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:07.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T12:31:07.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T12:31:07.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T12:31:07.483 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T12:31:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T12:31:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T12:31:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T12:31:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T12:31:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T12:31:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T12:31:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T12:31:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T12:31:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:07.485 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T12:31:07.486 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:07.486 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T12:30:57.613510+0000", 2023-10-08T12:31:07.486 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:31:07.486 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:07.486 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T12:31:07.486 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:31:07.486 INFO:teuthology.orchestra.run.smithi059.stdout:mgr not available, waiting (1/15)... 2023-10-08T12:31:07.705 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:07 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:07.418+0000 7f3023ea2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:31:07.705 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:07 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:07.586+0000 7f3023ea2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:31:08.014 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:07 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:07.705+0000 7f3023ea2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:31:08.014 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:07 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:07.833+0000 7f3023ea2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:31:08.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:08 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:08.395+0000 7f3023ea2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:31:09.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:09.306+0000 7f3023ea2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:31:09.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:09.415+0000 7f3023ea2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:31:10.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:10 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:10.426+0000 7f3023ea2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:31:10.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:10 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:10.550+0000 7f3023ea2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:31:11.157 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:10 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:10.781+0000 7f3023ea2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:31:11.441 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:11 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:11.157+0000 7f3023ea2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:31:11.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:11 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:11.441+0000 7f3023ea2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:31:11.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:11 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:11.640+0000 7f3023ea2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:31:12.514 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:12 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:12.017+0000 7f3023ea2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:31:13.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:13 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:13.000+0000 7f3023ea2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:31:13.588 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:13 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:13.180+0000 7f3023ea2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:31:13.588 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:13 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:13.437+0000 7f3023ea2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:31:13.876 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:13 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:13.588+0000 7f3023ea2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:31:14.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:13 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:13.876+0000 7f3023ea2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:31:15.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:14.989+0000 7f3023ea2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:31:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: Activating manager daemon x 2023-10-08T12:31:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: mgrmap e2: x(active, starting, since 0.00447789s) 2023-10-08T12:31:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: from='mgr.14100 172.21.15.59:0/3611526454' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:31:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: from='mgr.14100 172.21.15.59:0/3611526454' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:31:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: from='mgr.14100 172.21.15.59:0/3611526454' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:31:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: from='mgr.14100 172.21.15.59:0/3611526454' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:31:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: from='mgr.14100 172.21.15.59:0/3611526454' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:31:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: Manager daemon x is now available 2023-10-08T12:31:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: from='mgr.14100 172.21.15.59:0/3611526454' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:31:15.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: from='mgr.14100 172.21.15.59:0/3611526454' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:31:15.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: from='mgr.14100 172.21.15.59:0/3611526454' entity='mgr.x' 2023-10-08T12:31:15.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: from='mgr.14100 172.21.15.59:0/3611526454' entity='mgr.x' 2023-10-08T12:31:15.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:15 smithi059 ceph-mon[98489]: from='mgr.14100 172.21.15.59:0/3611526454' entity='mgr.x' 2023-10-08T12:31:15.985 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:31:15.985 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:31:15.985 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsid": "6a005028-65d6-11ee-8db5-212e2dc638e7", 2023-10-08T12:31:15.985 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T12:31:15.985 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T12:31:15.985 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T12:31:15.985 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T12:31:15.985 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:15.985 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 0 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T12:31:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:15.987 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T12:31:15.987 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:15.987 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T12:31:15.987 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T12:31:15.987 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T12:31:15.990 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T12:31:15.990 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T12:31:15.990 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T12:31:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:31:15.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:31:15.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:15.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T12:31:15.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:15.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T12:30:57.613510+0000", 2023-10-08T12:31:15.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:31:15.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:15.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T12:31:15.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:31:15.993 INFO:teuthology.orchestra.run.smithi059.stdout:mgr not available, waiting (2/15)... 2023-10-08T12:31:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:16 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3141560872' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T12:31:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:16 smithi059 ceph-mon[98489]: mgrmap e3: x(active, since 1.00797s) 2023-10-08T12:31:18.328 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:18 smithi059 ceph-mon[98489]: mgrmap e4: x(active, since 2s) 2023-10-08T12:31:19.475 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:31:19.475 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:31:19.475 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsid": "6a005028-65d6-11ee-8db5-212e2dc638e7", 2023-10-08T12:31:19.476 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T12:31:19.476 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T12:31:19.476 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T12:31:19.476 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T12:31:19.476 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:19.476 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T12:31:19.476 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T12:31:19.476 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 0 2023-10-08T12:31:19.476 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:31:19.476 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T12:31:19.476 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T12:31:19.477 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:31:19.477 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2023-10-08T12:31:19.477 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T12:31:19.477 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:19.477 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T12:31:19.477 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T12:31:19.477 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:19.477 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T12:31:19.477 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:19.477 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T12:31:19.477 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T12:31:19.478 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T12:31:19.479 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T12:31:19.479 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T12:31:19.479 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:19.479 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T12:31:19.479 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:19.479 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T12:31:19.479 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T12:31:19.479 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:19.479 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T12:31:19.480 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T12:31:19.480 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T12:31:19.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T12:31:19.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T12:31:19.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T12:31:19.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T12:31:19.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:31:19.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:31:19.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:19.481 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T12:31:19.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:31:19.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T12:30:57.613510+0000", 2023-10-08T12:31:19.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:31:19.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:31:19.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T12:31:19.482 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:31:19.483 INFO:teuthology.orchestra.run.smithi059.stdout:mgr is available 2023-10-08T12:31:19.748 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:19 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/208060689' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T12:31:20.758 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:31:20.758 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [global] 2023-10-08T12:31:20.758 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout fsid = 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:31:20.758 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-08T12:31:20.758 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-08T12:31:20.758 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-08T12:31:20.758 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-08T12:31:20.758 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:31:20.758 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-08T12:31:20.759 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-08T12:31:20.759 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2023-10-08T12:31:20.759 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [osd] 2023-10-08T12:31:20.759 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-08T12:31:20.759 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-08T12:31:20.759 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-08T12:31:20.759 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-08T12:31:20.759 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-08T12:31:20.759 INFO:teuthology.orchestra.run.smithi059.stdout:Enabling cephadm module... 2023-10-08T12:31:21.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:20 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3226192952' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-08T12:31:21.932 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:21 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/199153882' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-08T12:31:21.932 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:21 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: ignoring --setuser ceph since I am not root 2023-10-08T12:31:21.933 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:21 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: ignoring --setgroup ceph since I am not root 2023-10-08T12:31:22.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:21 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:21.931+0000 7fcfc9547200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:31:22.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:22 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:22.037+0000 7fcfc9547200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:31:22.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:22 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:22.168+0000 7fcfc9547200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:31:22.673 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:22 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:22.309+0000 7fcfc9547200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:31:22.673 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:22 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:22.544+0000 7fcfc9547200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:31:23.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:22 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/199153882' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-08T12:31:23.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:22 smithi059 ceph-mon[98489]: mgrmap e5: x(active, since 6s) 2023-10-08T12:31:23.322 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:23 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:23.023+0000 7fcfc9547200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:31:23.322 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:23 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:23.197+0000 7fcfc9547200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:31:23.626 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:31:23.627 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-08T12:31:23.628 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T12:31:23.628 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-08T12:31:23.628 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-08T12:31:23.628 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:31:23.628 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for the mgr to restart... 2023-10-08T12:31:23.628 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr epoch 5... 2023-10-08T12:31:23.673 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:23 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:23.321+0000 7fcfc9547200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:31:23.673 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:23 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:23.450+0000 7fcfc9547200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:31:23.941 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:23 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/982934483' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-08T12:31:24.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:24 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:24.018+0000 7fcfc9547200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:31:25.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:24 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:24.894+0000 7fcfc9547200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:31:25.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:25 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:25.003+0000 7fcfc9547200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:31:26.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:25 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:25.994+0000 7fcfc9547200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:31:26.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:26 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:26.117+0000 7fcfc9547200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:31:26.722 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:26 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:26.348+0000 7fcfc9547200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:31:27.003 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:26 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:26.721+0000 7fcfc9547200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:31:27.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:27 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:27.002+0000 7fcfc9547200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:31:27.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:27 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:27.202+0000 7fcfc9547200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:31:28.014 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:27 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:27.554+0000 7fcfc9547200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:31:28.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:28 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:28.509+0000 7fcfc9547200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:31:28.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:28 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:28.687+0000 7fcfc9547200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:31:29.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:28 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:28.942+0000 7fcfc9547200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:31:29.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:29 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:29.092+0000 7fcfc9547200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:31:29.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:29 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:29.378+0000 7fcfc9547200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:31:30.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:30.484+0000 7fcfc9547200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:31:30.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: Active manager daemon x restarted 2023-10-08T12:31:30.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: Activating manager daemon x 2023-10-08T12:31:30.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: osdmap e2: 0 total, 0 up, 0 in 2023-10-08T12:31:30.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: mgrmap e6: x(active, starting, since 0.00406463s) 2023-10-08T12:31:30.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:31:30.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:31:30.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:31:30.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:31:30.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:31:30.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: Manager daemon x is now available 2023-10-08T12:31:30.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:30.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:30.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:31:30.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:31:30.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:30 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:31:32.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:31 smithi059 ceph-mon[98489]: Found migration_current of "None". Setting to last migration. 2023-10-08T12:31:32.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:31 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:31:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:31 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:31:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:31 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:31 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:31 smithi059 ceph-mon[98489]: mgrmap e7: x(active, since 1.00644s) 2023-10-08T12:31:32.023 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:31:32.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-08T12:31:32.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-08T12:31:32.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:31:32.024 INFO:teuthology.orchestra.run.smithi059.stdout:mgr epoch 5 is available 2023-10-08T12:31:32.024 INFO:teuthology.orchestra.run.smithi059.stdout:Setting orchestrator backend to cephadm... 2023-10-08T12:31:32.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:32 smithi059 ceph-mon[98489]: [08/Oct/2023:12:31:31] ENGINE Bus STARTING 2023-10-08T12:31:32.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:32 smithi059 ceph-mon[98489]: [08/Oct/2023:12:31:31] ENGINE Serving on https://172.21.15.59:7150 2023-10-08T12:31:32.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:32 smithi059 ceph-mon[98489]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-08T12:31:32.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:32 smithi059 ceph-mon[98489]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-08T12:31:32.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:32 smithi059 ceph-mon[98489]: [08/Oct/2023:12:31:31] ENGINE Serving on http://172.21.15.59:8765 2023-10-08T12:31:32.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:32 smithi059 ceph-mon[98489]: [08/Oct/2023:12:31:31] ENGINE Bus STARTED 2023-10-08T12:31:32.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:32 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:31:33.748 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:33 smithi059 ceph-mon[98489]: mgrmap e8: x(active, since 2s) 2023-10-08T12:31:33.748 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:33 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:33.748 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:33 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:31:34.778 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-08T12:31:34.779 INFO:teuthology.orchestra.run.smithi059.stdout:Generating ssh key... 2023-10-08T12:31:35.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:34 smithi059 ceph-mon[98489]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:31:35.854 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-mon[98489]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:31:36.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: Generating public/private rsa key pair. 2023-10-08T12:31:36.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: Your identification has been saved in /tmp/tmph537ja1t/key. 2023-10-08T12:31:36.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: Your public key has been saved in /tmp/tmph537ja1t/key.pub. 2023-10-08T12:31:36.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: The key fingerprint is: 2023-10-08T12:31:36.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: SHA256:/x9BgQvCErbHGde4SQuRVMsVltTuFW6Iwjr8I2fYvMo ceph-6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:31:36.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: The key's randomart image is: 2023-10-08T12:31:36.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: +---[RSA 3072]----+ 2023-10-08T12:31:36.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: | o+++o+==. | 2023-10-08T12:31:36.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: | ..o==+++ .o | 2023-10-08T12:31:36.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: | ..=+o=.o+ .| 2023-10-08T12:31:36.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: | . o+..o.o.| 2023-10-08T12:31:36.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: | . S . .o. | 2023-10-08T12:31:36.266 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: | + . .. | 2023-10-08T12:31:36.266 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: | * . . | 2023-10-08T12:31:36.266 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: | .o B . . | 2023-10-08T12:31:36.266 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: | E=.o ... | 2023-10-08T12:31:36.266 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: +----[SHA256]-----+ 2023-10-08T12:31:36.726 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:36 smithi059 ceph-mon[98489]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:31:36.726 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:36 smithi059 ceph-mon[98489]: Generating ssh key... 2023-10-08T12:31:36.726 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:36 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:36.726 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:36 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:37.740 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGjqC4zB/GIxNliKwHiABfr7kBQdg6/O+dtTASu21A3tUk2DA7XcvVHmz7QNnfYUlyhShmUUSd872eiTApKtpAcIJxPIRfvbZy9cI0YimcL+NFmkeyVuOc/kSNiehXSBQJ3oB4SiO6pVUQPS/iQn2nf+3Xftlhu2KcHqWnrCp5bMzPe9zvhbTIEdSx+qGRyv9zha7zuXF6RVqBESeoaorzzqDIbyGigh2d7GYh2c6F2inug6lraYUTUPtY95KKeAgGEJbYrKjxzxUrvAlWmmyDgymX5Spaqs4NuLPTHByfpTeTxMqJU2PM3hQQt/7niPJBGCDq+dMB/6Xu58hMHI5LskiYl5mjmu16pMQB7ZkKa/ldS5fXGd3DCrFmvWIanT5nfnEsDeLYKDJZJqO6n4N0xzJC+4ET1s8hJIxGA/aW7BacTP7rRDPqGQj6cezP8hdKbdM70wlGxyf9kjgM9OlahMJDVfsTb9HPEnzX3Cj1UbKvWKbG6Xrv4vQMTEMiM8s= ceph-6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:31:37.740 INFO:teuthology.orchestra.run.smithi059.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-08T12:31:37.740 INFO:teuthology.orchestra.run.smithi059.stdout:Adding key to root@localhost authorized_keys... 2023-10-08T12:31:37.742 INFO:teuthology.orchestra.run.smithi059.stdout:Adding host smithi059... 2023-10-08T12:31:38.000 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:37 smithi059 ceph-mon[98489]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:31:39.829 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:39 smithi059 ceph-mon[98489]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi059", "addr": "172.21.15.59", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:31:41.003 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:40 smithi059 ceph-mon[98489]: Deploying cephadm binary to smithi059 2023-10-08T12:31:42.330 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout Added host 'smithi059' with addr '172.21.15.59' 2023-10-08T12:31:42.330 INFO:teuthology.orchestra.run.smithi059.stdout:Deploying unmanaged mon service... 2023-10-08T12:31:43.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:42 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:43.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:42 smithi059 ceph-mon[98489]: Added host smithi059 2023-10-08T12:31:43.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:42 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:31:43.822 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-08T12:31:43.822 INFO:teuthology.orchestra.run.smithi059.stdout:Deploying unmanaged mgr service... 2023-10-08T12:31:44.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:44 smithi059 ceph-mon[98489]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:31:44.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:44 smithi059 ceph-mon[98489]: Saving service mon spec with placement count:5 2023-10-08T12:31:44.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:44 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:45.554 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-08T12:31:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:45 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:45 smithi059 ceph-mon[98489]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:31:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:45 smithi059 ceph-mon[98489]: Saving service mgr spec with placement count:2 2023-10-08T12:31:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:45 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:45 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:47.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:47 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3113459422' entity='client.admin' 2023-10-08T12:31:48.315 INFO:teuthology.orchestra.run.smithi059.stdout:Enabling the dashboard module... 2023-10-08T12:31:49.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:48 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3401033627' entity='client.admin' 2023-10-08T12:31:49.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:48 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:50.092 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:49 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2591133283' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-08T12:31:50.092 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:49 smithi059 ceph-mon[98489]: from='mgr.14118 172.21.15.59:0/2538017097' entity='mgr.x' 2023-10-08T12:31:50.093 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:49 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: ignoring --setuser ceph since I am not root 2023-10-08T12:31:50.093 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:49 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: ignoring --setgroup ceph since I am not root 2023-10-08T12:31:50.375 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:50 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:50.143+0000 7eff0a180200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:31:50.376 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:50 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:50.256+0000 7eff0a180200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:31:50.698 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:50 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:50.375+0000 7eff0a180200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:31:50.698 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:50 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:50.529+0000 7eff0a180200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:31:51.014 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:50 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:50.785+0000 7eff0a180200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:31:51.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:50 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2591133283' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-08T12:31:51.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:50 smithi059 ceph-mon[98489]: mgrmap e9: x(active, since 19s) 2023-10-08T12:31:51.388 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:51 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:51.274+0000 7eff0a180200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:31:51.721 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:51 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:51.456+0000 7eff0a180200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:31:51.721 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:51 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:51.590+0000 7eff0a180200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:31:52.014 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:51 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:51.720+0000 7eff0a180200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:31:52.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:51 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3297891126' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-08T12:31:52.187 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:31:52.187 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-08T12:31:52.187 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T12:31:52.187 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-08T12:31:52.187 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-08T12:31:52.188 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:31:52.188 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for the mgr to restart... 2023-10-08T12:31:52.188 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr epoch 9... 2023-10-08T12:31:52.514 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:52 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:52.286+0000 7eff0a180200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:31:53.514 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:53 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:53.172+0000 7eff0a180200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:31:53.514 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:53 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:53.280+0000 7eff0a180200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:31:54.629 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:54 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:54.273+0000 7eff0a180200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:31:54.630 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:54 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:54.396+0000 7eff0a180200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:31:55.005 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:54 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:54.628+0000 7eff0a180200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:31:55.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:55 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:55.004+0000 7eff0a180200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:31:55.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:55 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:55.286+0000 7eff0a180200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:31:55.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:55 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:55.485+0000 7eff0a180200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:31:56.264 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:55 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:55.841+0000 7eff0a180200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:31:57.238 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:56 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:56.800+0000 7eff0a180200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:31:57.238 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:56 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:56.980+0000 7eff0a180200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:31:57.514 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:57 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:57.237+0000 7eff0a180200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:31:57.515 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:57 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:57.388+0000 7eff0a180200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:31:58.014 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:57 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:57.674+0000 7eff0a180200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:31:59.265 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:31:58 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:31:58.779+0000 7eff0a180200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:32:00.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: Active manager daemon x restarted 2023-10-08T12:32:00.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: Activating manager daemon x 2023-10-08T12:32:00.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: osdmap e3: 0 total, 0 up, 0 in 2023-10-08T12:32:00.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: mgrmap e10: x(active, starting, since 0.00826017s) 2023-10-08T12:32:00.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:32:00.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:32:00.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:32:00.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:32:00.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:32:00.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: Manager daemon x is now available 2023-10-08T12:32:00.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:00.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:00.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:32:00.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:31:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:32:00.281 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:32:00.281 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-08T12:32:00.282 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-08T12:32:00.282 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:32:00.282 INFO:teuthology.orchestra.run.smithi059.stdout:mgr epoch 9 is available 2023-10-08T12:32:00.282 INFO:teuthology.orchestra.run.smithi059.stdout:Generating a dashboard self-signed certificate... 2023-10-08T12:32:01.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:00 smithi059 ceph-mon[98489]: [08/Oct/2023:12:31:59] ENGINE Bus STARTING 2023-10-08T12:32:01.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:00 smithi059 ceph-mon[98489]: [08/Oct/2023:12:31:59] ENGINE Serving on https://172.21.15.59:7150 2023-10-08T12:32:01.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:00 smithi059 ceph-mon[98489]: [08/Oct/2023:12:31:59] ENGINE Serving on http://172.21.15.59:8765 2023-10-08T12:32:01.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:00 smithi059 ceph-mon[98489]: [08/Oct/2023:12:31:59] ENGINE Bus STARTED 2023-10-08T12:32:01.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:00 smithi059 ceph-mon[98489]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-08T12:32:01.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:00 smithi059 ceph-mon[98489]: mgrmap e11: x(active, since 1.01011s) 2023-10-08T12:32:01.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:00 smithi059 ceph-mon[98489]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-08T12:32:02.151 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:01 smithi059 ceph-mon[98489]: mgrmap e12: x(active, since 2s) 2023-10-08T12:32:02.151 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:01 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:02.151 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:01 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:02.152 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:01 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:02.161 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-08T12:32:02.161 INFO:teuthology.orchestra.run.smithi059.stdout:Creating initial admin user... 2023-10-08T12:32:03.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:02 smithi059 ceph-mon[98489]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:32:03.642 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$NC7tWkDW9qALg5ZZk89M9.B9QyGG.fA6Hgd80wPELMGd4kZ4bJlNy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1696768323, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-08T12:32:03.643 INFO:teuthology.orchestra.run.smithi059.stdout:Fetching dashboard port number... 2023-10-08T12:32:04.487 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:04 smithi059 ceph-mon[98489]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:32:04.487 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:04 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:04.487 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:04 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:05.222 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 8443 2023-10-08T12:32:05.243 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:32:05.243 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2023-10-08T12:32:05.259 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:32:05.259 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2023-10-08T12:32:05.259 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2023-10-08T12:32:05.260 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-08T12:32:05.262 INFO:teuthology.orchestra.run.smithi059.stdout:Ceph Dashboard is now available at: 2023-10-08T12:32:05.262 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:05.263 INFO:teuthology.orchestra.run.smithi059.stdout: URL: https://smithi059.front.sepia.ceph.com:8443/ 2023-10-08T12:32:05.263 INFO:teuthology.orchestra.run.smithi059.stdout: User: admin 2023-10-08T12:32:05.263 INFO:teuthology.orchestra.run.smithi059.stdout: Password: unwjelo9u7 2023-10-08T12:32:05.263 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:05.263 INFO:teuthology.orchestra.run.smithi059.stdout:Saving cluster configuration to /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config directory 2023-10-08T12:32:05.264 INFO:teuthology.orchestra.run.smithi059.stdout:Enabling autotune for osd_memory_target 2023-10-08T12:32:05.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:05 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1040552958' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-08T12:32:06.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:06 smithi059 ceph-mon[98489]: mgrmap e13: x(active, since 6s) 2023-10-08T12:32:08.115 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-08T12:32:08.116 INFO:teuthology.orchestra.run.smithi059.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-08T12:32:08.116 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:08.117 INFO:teuthology.orchestra.run.smithi059.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:08.117 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:08.117 INFO:teuthology.orchestra.run.smithi059.stdout:Or, if you are only running a single cluster on this host: 2023-10-08T12:32:08.117 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:08.117 INFO:teuthology.orchestra.run.smithi059.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-08T12:32:08.117 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:08.117 INFO:teuthology.orchestra.run.smithi059.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-08T12:32:08.117 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:08.117 INFO:teuthology.orchestra.run.smithi059.stdout: ceph telemetry on 2023-10-08T12:32:08.117 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:08.117 INFO:teuthology.orchestra.run.smithi059.stdout:For more information see: 2023-10-08T12:32:08.118 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:08.118 INFO:teuthology.orchestra.run.smithi059.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-08T12:32:08.118 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:08.118 INFO:teuthology.orchestra.run.smithi059.stdout:Bootstrap complete. 2023-10-08T12:32:08.175 INFO:tasks.cephadm:Fetching config... 2023-10-08T12:32:08.175 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:32:08.176 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-08T12:32:08.220 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-08T12:32:08.220 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:32:08.220 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-08T12:32:08.304 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-08T12:32:08.304 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:32:08.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-08T12:32:08.415 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-08T12:32:08.415 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:32:08.415 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-08T12:32:08.503 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-08T12:32:08.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGjqC4zB/GIxNliKwHiABfr7kBQdg6/O+dtTASu21A3tUk2DA7XcvVHmz7QNnfYUlyhShmUUSd872eiTApKtpAcIJxPIRfvbZy9cI0YimcL+NFmkeyVuOc/kSNiehXSBQJ3oB4SiO6pVUQPS/iQn2nf+3Xftlhu2KcHqWnrCp5bMzPe9zvhbTIEdSx+qGRyv9zha7zuXF6RVqBESeoaorzzqDIbyGigh2d7GYh2c6F2inug6lraYUTUPtY95KKeAgGEJbYrKjxzxUrvAlWmmyDgymX5Spaqs4NuLPTHByfpTeTxMqJU2PM3hQQt/7niPJBGCDq+dMB/6Xu58hMHI5LskiYl5mjmu16pMQB7ZkKa/ldS5fXGd3DCrFmvWIanT5nfnEsDeLYKDJZJqO6n4N0xzJC+4ET1s8hJIxGA/aW7BacTP7rRDPqGQj6cezP8hdKbdM70wlGxyf9kjgM9OlahMJDVfsTb9HPEnzX3Cj1UbKvWKbG6Xrv4vQMTEMiM8s= ceph-6a005028-65d6-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T12:32:08.648 INFO:teuthology.orchestra.run.smithi059.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGjqC4zB/GIxNliKwHiABfr7kBQdg6/O+dtTASu21A3tUk2DA7XcvVHmz7QNnfYUlyhShmUUSd872eiTApKtpAcIJxPIRfvbZy9cI0YimcL+NFmkeyVuOc/kSNiehXSBQJ3oB4SiO6pVUQPS/iQn2nf+3Xftlhu2KcHqWnrCp5bMzPe9zvhbTIEdSx+qGRyv9zha7zuXF6RVqBESeoaorzzqDIbyGigh2d7GYh2c6F2inug6lraYUTUPtY95KKeAgGEJbYrKjxzxUrvAlWmmyDgymX5Spaqs4NuLPTHByfpTeTxMqJU2PM3hQQt/7niPJBGCDq+dMB/6Xu58hMHI5LskiYl5mjmu16pMQB7ZkKa/ldS5fXGd3DCrFmvWIanT5nfnEsDeLYKDJZJqO6n4N0xzJC+4ET1s8hJIxGA/aW7BacTP7rRDPqGQj6cezP8hdKbdM70wlGxyf9kjgM9OlahMJDVfsTb9HPEnzX3Cj1UbKvWKbG6Xrv4vQMTEMiM8s= ceph-6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:32:08.681 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGjqC4zB/GIxNliKwHiABfr7kBQdg6/O+dtTASu21A3tUk2DA7XcvVHmz7QNnfYUlyhShmUUSd872eiTApKtpAcIJxPIRfvbZy9cI0YimcL+NFmkeyVuOc/kSNiehXSBQJ3oB4SiO6pVUQPS/iQn2nf+3Xftlhu2KcHqWnrCp5bMzPe9zvhbTIEdSx+qGRyv9zha7zuXF6RVqBESeoaorzzqDIbyGigh2d7GYh2c6F2inug6lraYUTUPtY95KKeAgGEJbYrKjxzxUrvAlWmmyDgymX5Spaqs4NuLPTHByfpTeTxMqJU2PM3hQQt/7niPJBGCDq+dMB/6Xu58hMHI5LskiYl5mjmu16pMQB7ZkKa/ldS5fXGd3DCrFmvWIanT5nfnEsDeLYKDJZJqO6n4N0xzJC+4ET1s8hJIxGA/aW7BacTP7rRDPqGQj6cezP8hdKbdM70wlGxyf9kjgM9OlahMJDVfsTb9HPEnzX3Cj1UbKvWKbG6Xrv4vQMTEMiM8s= ceph-6a005028-65d6-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T12:32:08.727 INFO:teuthology.orchestra.run.smithi092.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGjqC4zB/GIxNliKwHiABfr7kBQdg6/O+dtTASu21A3tUk2DA7XcvVHmz7QNnfYUlyhShmUUSd872eiTApKtpAcIJxPIRfvbZy9cI0YimcL+NFmkeyVuOc/kSNiehXSBQJ3oB4SiO6pVUQPS/iQn2nf+3Xftlhu2KcHqWnrCp5bMzPe9zvhbTIEdSx+qGRyv9zha7zuXF6RVqBESeoaorzzqDIbyGigh2d7GYh2c6F2inug6lraYUTUPtY95KKeAgGEJbYrKjxzxUrvAlWmmyDgymX5Spaqs4NuLPTHByfpTeTxMqJU2PM3hQQt/7niPJBGCDq+dMB/6Xu58hMHI5LskiYl5mjmu16pMQB7ZkKa/ldS5fXGd3DCrFmvWIanT5nfnEsDeLYKDJZJqO6n4N0xzJC+4ET1s8hJIxGA/aW7BacTP7rRDPqGQj6cezP8hdKbdM70wlGxyf9kjgM9OlahMJDVfsTb9HPEnzX3Cj1UbKvWKbG6Xrv4vQMTEMiM8s= ceph-6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:32:08.741 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGjqC4zB/GIxNliKwHiABfr7kBQdg6/O+dtTASu21A3tUk2DA7XcvVHmz7QNnfYUlyhShmUUSd872eiTApKtpAcIJxPIRfvbZy9cI0YimcL+NFmkeyVuOc/kSNiehXSBQJ3oB4SiO6pVUQPS/iQn2nf+3Xftlhu2KcHqWnrCp5bMzPe9zvhbTIEdSx+qGRyv9zha7zuXF6RVqBESeoaorzzqDIbyGigh2d7GYh2c6F2inug6lraYUTUPtY95KKeAgGEJbYrKjxzxUrvAlWmmyDgymX5Spaqs4NuLPTHByfpTeTxMqJU2PM3hQQt/7niPJBGCDq+dMB/6Xu58hMHI5LskiYl5mjmu16pMQB7ZkKa/ldS5fXGd3DCrFmvWIanT5nfnEsDeLYKDJZJqO6n4N0xzJC+4ET1s8hJIxGA/aW7BacTP7rRDPqGQj6cezP8hdKbdM70wlGxyf9kjgM9OlahMJDVfsTb9HPEnzX3Cj1UbKvWKbG6Xrv4vQMTEMiM8s= ceph-6a005028-65d6-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T12:32:08.786 INFO:teuthology.orchestra.run.smithi173.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGjqC4zB/GIxNliKwHiABfr7kBQdg6/O+dtTASu21A3tUk2DA7XcvVHmz7QNnfYUlyhShmUUSd872eiTApKtpAcIJxPIRfvbZy9cI0YimcL+NFmkeyVuOc/kSNiehXSBQJ3oB4SiO6pVUQPS/iQn2nf+3Xftlhu2KcHqWnrCp5bMzPe9zvhbTIEdSx+qGRyv9zha7zuXF6RVqBESeoaorzzqDIbyGigh2d7GYh2c6F2inug6lraYUTUPtY95KKeAgGEJbYrKjxzxUrvAlWmmyDgymX5Spaqs4NuLPTHByfpTeTxMqJU2PM3hQQt/7niPJBGCDq+dMB/6Xu58hMHI5LskiYl5mjmu16pMQB7ZkKa/ldS5fXGd3DCrFmvWIanT5nfnEsDeLYKDJZJqO6n4N0xzJC+4ET1s8hJIxGA/aW7BacTP7rRDPqGQj6cezP8hdKbdM70wlGxyf9kjgM9OlahMJDVfsTb9HPEnzX3Cj1UbKvWKbG6Xrv4vQMTEMiM8s= ceph-6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:32:08.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-08T12:32:09.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:08 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3269035601' entity='client.admin' 2023-10-08T12:32:09.541 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:32:12.441 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-08T12:32:12.441 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-08T12:32:13.261 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:32:13.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:12 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3456157161' entity='client.admin' 2023-10-08T12:32:13.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:12 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:13.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:12 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:13.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:12 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:32:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:12 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:14 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:14 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:15.444 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi092 2023-10-08T12:32:15.444 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-08T12:32:15.444 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/etc/ceph/ceph.conf 2023-10-08T12:32:15.464 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-08T12:32:15.465 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:15.523 INFO:tasks.cephadm:Adding host smithi092 to orchestrator... 2023-10-08T12:32:15.523 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi092 2023-10-08T12:32:16.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:15 smithi059 ceph-mon[98489]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:32:16.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:15 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:15 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:15 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:15 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:32:17.197 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:16 smithi059 ceph-mon[98489]: Updating smithi059:/etc/ceph/ceph.conf 2023-10-08T12:32:17.197 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:16 smithi059 ceph-mon[98489]: Updating smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:18.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:17 smithi059 ceph-mon[98489]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:17 smithi059 ceph-mon[98489]: Updating smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:32:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:17 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:17 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:17 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:20.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:19 smithi059 ceph-mon[98489]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi092", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:32:20.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:19 smithi059 ceph-mon[98489]: Deploying cephadm binary to smithi092 2023-10-08T12:32:20.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:19 smithi059 ceph-mon[98489]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:20.636 INFO:teuthology.orchestra.run.smithi059.stdout:Added host 'smithi092' with addr '172.21.15.92' 2023-10-08T12:32:21.066 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-08T12:32:21.806 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:32:22.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:21 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:22.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:21 smithi059 ceph-mon[98489]: Added host smithi092 2023-10-08T12:32:22.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:21 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:22.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:21 smithi059 ceph-mon[98489]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:22.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:21 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:23.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:22 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:23.540 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:23.540 INFO:teuthology.orchestra.run.smithi059.stdout:[{"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}, {"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}] 2023-10-08T12:32:24.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:23 smithi059 ceph-mon[98489]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:24.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:23 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:24.093 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi173 2023-10-08T12:32:24.093 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-08T12:32:24.093 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.conf 2023-10-08T12:32:24.114 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-08T12:32:24.114 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:24.173 INFO:tasks.cephadm:Adding host smithi173 to orchestrator... 2023-10-08T12:32:24.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi173 2023-10-08T12:32:24.907 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:32:25.149 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:24 smithi059 ceph-mon[98489]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:32:26.209 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:25 smithi059 ceph-mon[98489]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:26 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:26 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:26 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:26 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:26 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:32:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:26 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:26 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:26 smithi059 ceph-mon[98489]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-08T12:32:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:26 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:26 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:27.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:26 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:28.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:27 smithi059 ceph-mon[98489]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:27 smithi059 ceph-mon[98489]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:27 smithi059 ceph-mon[98489]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:32:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:27 smithi059 ceph-mon[98489]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:32:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:27 smithi059 ceph-mon[98489]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:29.180 INFO:teuthology.orchestra.run.smithi059.stdout:Added host 'smithi173' with addr '172.21.15.173' 2023-10-08T12:32:29.205 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:28 smithi059 ceph-mon[98489]: Deploying cephadm binary to smithi173 2023-10-08T12:32:29.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-08T12:32:30.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:29 smithi059 ceph-mon[98489]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:30.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:29 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:30.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:29 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:30.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:29 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:32:31.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:30 smithi059 ceph-mon[98489]: Added host smithi173 2023-10-08T12:32:31.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:30 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:31 smithi059 ceph-mon[98489]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:31 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:32.173 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:32:32.173 INFO:teuthology.orchestra.run.smithi059.stdout:[{"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}, {"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.173", "hostname": "smithi173", "labels": [], "status": ""}] 2023-10-08T12:32:32.620 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-08T12:32:32.620 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd crush tunables default 2023-10-08T12:32:33.358 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:32:33.970 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:33 smithi059 ceph-mon[98489]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:32:33.971 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:33 smithi059 ceph-mon[98489]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2023-10-08T12:32:35.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:35.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:35.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:35.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:35.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:32:35.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:35.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:35.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: Updating smithi173:/etc/ceph/ceph.conf 2023-10-08T12:32:35.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:35.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:35.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/851065165' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T12:32:35.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:35.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:35.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:35 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:36.035 INFO:tasks.cephadm:Adding mon.a on smithi059 2023-10-08T12:32:36.036 INFO:tasks.cephadm:Adding mon.b on smithi092 2023-10-08T12:32:36.036 INFO:tasks.cephadm:Adding mon.c on smithi173 2023-10-08T12:32:36.036 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch apply mon '3;smithi059:172.21.15.59=a;smithi092:172.21.15.92=b;smithi173:172.21.15.173=c' 2023-10-08T12:32:36.619 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:36 smithi059 ceph-mon[98489]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:36 smithi059 ceph-mon[98489]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:32:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:36 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/851065165' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T12:32:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:36 smithi059 ceph-mon[98489]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:38.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:37 smithi059 ceph-mon[98489]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:38.043 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mon update... 2023-10-08T12:32:38.491 DEBUG:teuthology.orchestra.run.smithi092:mon.b> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.b.service 2023-10-08T12:32:38.494 DEBUG:teuthology.orchestra.run.smithi173:mon.c> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.c.service 2023-10-08T12:32:38.496 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T12:32:38.496 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T12:32:38.526 INFO:journalctl@ceph.mon.c.smithi173.stdout:-- Logs begin at Sun 2023-10-08 12:08:19 UTC. -- 2023-10-08T12:32:38.530 INFO:journalctl@ceph.mon.b.smithi092.stdout:-- Logs begin at Sun 2023-10-08 12:08:21 UTC. -- 2023-10-08T12:32:39.463 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:39.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:39 smithi059 ceph-mon[98489]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi059:172.21.15.59=a;smithi092:172.21.15.92=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:32:39.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:39 smithi059 ceph-mon[98489]: Saving service mon spec with placement smithi059:172.21.15.59=a;smithi092:172.21.15.92=b;smithi173:172.21.15.173=c;count:3 2023-10-08T12:32:39.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:39 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:39.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:39 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:39.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:39 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:39.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:39 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:39.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:39 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:39.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:39 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:32:39.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:39 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:39.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:39 smithi059 ceph-mon[98489]: Deploying daemon mon.c on smithi173 2023-10-08T12:32:39.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:39 smithi059 ceph-mon[98489]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:41.360 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:40 smithi173 systemd[1]: Starting Ceph mon.c for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:32:41.446 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:32:41.447 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","modified":"2023-10-08T12:30:53.091034Z","created":"2023-10-08T12:30:53.091034Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-08T12:32:41.449 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2023-10-08T12:32:41.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 podman[135127]: 2023-10-08T12:32:41.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 bash[135127]: 65a094cad362372e88bf6f2bd3aceeba6e02e7f37909b997e61b8b6903c34971 2023-10-08T12:32:41.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T12:32:41.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T12:32:41.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: pidfile_write: ignore empty --pid-file 2023-10-08T12:32:41.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: load: jerasure load: lrc 2023-10-08T12:32:41.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: RocksDB version: 7.9.2 2023-10-08T12:32:41.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Git sha 0 2023-10-08T12:32:41.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T12:32:41.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: DB SUMMARY 2023-10-08T12:32:41.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: DB Session ID: LRI00WN1E1COZPWEF8DY 2023-10-08T12:32:41.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: CURRENT file: CURRENT 2023-10-08T12:32:41.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T12:32:41.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-08T12:32:41.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-10-08T12:32:41.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-10-08T12:32:41.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.error_if_exists: 0 2023-10-08T12:32:41.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.create_if_missing: 0 2023-10-08T12:32:41.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.paranoid_checks: 1 2023-10-08T12:32:41.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T12:32:41.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T12:32:41.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T12:32:41.613 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.env: 0x56273d178da0 2023-10-08T12:32:41.613 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T12:32:41.613 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.info_log: 0x56273de65640 2023-10-08T12:32:41.613 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T12:32:41.613 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.statistics: (nil) 2023-10-08T12:32:41.613 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.use_fsync: 0 2023-10-08T12:32:41.613 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_log_file_size: 0 2023-10-08T12:32:41.613 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T12:32:41.613 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T12:32:41.613 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T12:32:41.613 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T12:32:41.614 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.allow_fallocate: 1 2023-10-08T12:32:41.614 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T12:32:41.614 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T12:32:41.614 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.use_direct_reads: 0 2023-10-08T12:32:41.614 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T12:32:41.614 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T12:32:41.614 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.db_log_dir: 2023-10-08T12:32:41.616 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.wal_dir: 2023-10-08T12:32:41.616 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T12:32:41.616 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T12:32:41.616 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T12:32:41.617 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T12:32:41.617 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T12:32:41.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T12:32:41.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T12:32:41.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T12:32:41.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.write_buffer_manager: 0x56273de1d360 2023-10-08T12:32:41.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T12:32:41.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T12:32:41.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T12:32:41.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T12:32:41.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T12:32:41.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T12:32:41.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T12:32:41.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T12:32:41.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.unordered_write: 0 2023-10-08T12:32:41.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T12:32:41.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T12:32:41.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T12:32:41.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T12:32:41.621 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.row_cache: None 2023-10-08T12:32:41.621 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.wal_filter: None 2023-10-08T12:32:41.621 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T12:32:41.622 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T12:32:41.622 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.two_write_queues: 0 2023-10-08T12:32:41.622 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T12:32:41.622 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.wal_compression: 0 2023-10-08T12:32:41.622 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.atomic_flush: 0 2023-10-08T12:32:41.622 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T12:32:41.622 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T12:32:41.622 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T12:32:41.622 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.log_readahead_size: 0 2023-10-08T12:32:41.623 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T12:32:41.623 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T12:32:41.623 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T12:32:41.623 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T12:32:41.623 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T12:32:41.623 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T12:32:41.623 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T12:32:41.623 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_background_jobs: 2 2023-10-08T12:32:41.624 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_background_compactions: -1 2023-10-08T12:32:41.624 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_subcompactions: 1 2023-10-08T12:32:41.624 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T12:32:41.624 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T12:32:41.624 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T12:32:41.624 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T12:32:41.624 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T12:32:41.624 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T12:32:41.624 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T12:32:41.625 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T12:32:41.625 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_open_files: -1 2023-10-08T12:32:41.625 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T12:32:41.625 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T12:32:41.625 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T12:32:41.625 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T12:32:41.625 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_background_flushes: -1 2023-10-08T12:32:41.625 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Compression algorithms supported: 2023-10-08T12:32:41.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T12:32:41.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: kZSTD supported: 0 2023-10-08T12:32:41.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: kXpressCompression supported: 0 2023-10-08T12:32:41.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T12:32:41.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: kZlibCompression supported: 1 2023-10-08T12:32:41.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: kSnappyCompression supported: 1 2023-10-08T12:32:41.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: kLZ4Compression supported: 1 2023-10-08T12:32:41.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: kBZip2Compression supported: 0 2023-10-08T12:32:41.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T12:32:41.627 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T12:32:41.627 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-10-08T12:32:41.627 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T12:32:41.627 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T12:32:41.627 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.merge_operator: 2023-10-08T12:32:41.627 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_filter: None 2023-10-08T12:32:41.627 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T12:32:41.627 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T12:32:41.627 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T12:32:41.627 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T12:32:41.627 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56273de65740) 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks: 1 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_top_level_index_and_filter: 1 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_type: 0 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_index_type: 0 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_shortening: 1 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: checksum: 4 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: no_block_cache: 0 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache: 0x56273debb1f0 2023-10-08T12:32:41.628 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_name: BinnedLRUCache 2023-10-08T12:32:41.629 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_options: 2023-10-08T12:32:41.629 INFO:journalctl@ceph.mon.c.smithi173.stdout: capacity : 536870912 2023-10-08T12:32:41.629 INFO:journalctl@ceph.mon.c.smithi173.stdout: num_shard_bits : 4 2023-10-08T12:32:41.629 INFO:journalctl@ceph.mon.c.smithi173.stdout: strict_capacity_limit : 0 2023-10-08T12:32:41.629 INFO:journalctl@ceph.mon.c.smithi173.stdout: high_pri_pool_ratio: 0.000 2023-10-08T12:32:41.629 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_compressed: (nil) 2023-10-08T12:32:41.629 INFO:journalctl@ceph.mon.c.smithi173.stdout: persistent_cache: (nil) 2023-10-08T12:32:41.629 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size: 4096 2023-10-08T12:32:41.629 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size_deviation: 10 2023-10-08T12:32:41.629 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_restart_interval: 16 2023-10-08T12:32:41.629 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_block_restart_interval: 1 2023-10-08T12:32:41.630 INFO:journalctl@ceph.mon.c.smithi173.stdout: metadata_block_size: 4096 2023-10-08T12:32:41.630 INFO:journalctl@ceph.mon.c.smithi173.stdout: partition_filters: 0 2023-10-08T12:32:41.630 INFO:journalctl@ceph.mon.c.smithi173.stdout: use_delta_encoding: 1 2023-10-08T12:32:41.630 INFO:journalctl@ceph.mon.c.smithi173.stdout: filter_policy: bloomfilter 2023-10-08T12:32:41.630 INFO:journalctl@ceph.mon.c.smithi173.stdout: whole_key_filtering: 1 2023-10-08T12:32:41.631 INFO:journalctl@ceph.mon.c.smithi173.stdout: verify_compression: 0 2023-10-08T12:32:41.631 INFO:journalctl@ceph.mon.c.smithi173.stdout: read_amp_bytes_per_bit: 0 2023-10-08T12:32:41.631 INFO:journalctl@ceph.mon.c.smithi173.stdout: format_version: 5 2023-10-08T12:32:41.631 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_index_compression: 1 2023-10-08T12:32:41.631 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_align: 0 2023-10-08T12:32:41.631 INFO:journalctl@ceph.mon.c.smithi173.stdout: max_auto_readahead_size: 262144 2023-10-08T12:32:41.631 INFO:journalctl@ceph.mon.c.smithi173.stdout: prepopulate_block_cache: 0 2023-10-08T12:32:41.631 INFO:journalctl@ceph.mon.c.smithi173.stdout: initial_auto_readahead_size: 8192 2023-10-08T12:32:41.631 INFO:journalctl@ceph.mon.c.smithi173.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T12:32:41.631 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T12:32:41.632 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T12:32:41.632 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compression: NoCompression 2023-10-08T12:32:41.632 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T12:32:41.632 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T12:32:41.632 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T12:32:41.632 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.num_levels: 7 2023-10-08T12:32:41.632 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T12:32:41.632 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T12:32:41.632 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T12:32:41.632 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T12:32:41.633 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T12:32:41.633 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T12:32:41.633 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T12:32:41.633 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:32:41.633 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T12:32:41.633 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T12:32:41.633 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:32:41.633 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:32:41.633 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T12:32:41.633 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T12:32:41.633 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T12:32:41.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T12:32:41.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:32:41.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:32:41.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T12:32:41.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T12:32:41.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:32:41.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T12:32:41.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T12:32:41.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T12:32:41.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T12:32:41.635 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T12:32:41.635 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T12:32:41.635 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T12:32:41.635 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T12:32:41.635 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T12:32:41.635 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T12:32:41.635 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T12:32:41.635 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T12:32:41.635 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T12:32:41.635 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T12:32:41.636 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T12:32:41.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T12:32:41.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T12:32:41.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T12:32:41.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T12:32:41.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T12:32:41.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T12:32:41.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.table_properties_collectors: 2023-10-08T12:32:41.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.inplace_update_support: 0 2023-10-08T12:32:41.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T12:32:41.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T12:32:41.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T12:32:41.638 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T12:32:41.638 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.bloom_locality: 0 2023-10-08T12:32:41.638 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.max_successive_merges: 0 2023-10-08T12:32:41.638 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T12:32:41.638 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T12:32:41.638 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T12:32:41.638 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T12:32:41.638 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.ttl: 2592000 2023-10-08T12:32:41.638 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T12:32:41.638 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T12:32:41.638 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.enable_blob_files: false 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.min_blob_size: 0 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-08T12:32:41.639 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4a0217e7-79dd-4487-8472-bf6b52de5644 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696768361604158, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696768361604563, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696768361, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4a0217e7-79dd-4487-8472-bf6b52de5644", "db_session_id": "LRI00WN1E1COZPWEF8DY", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696768361604635, "job": 1, "event": "recovery_finished"} 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56273df58000 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: DB pointer 0x56273df44000 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T12:32:41.640 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** DB Stats ** 2023-10-08T12:32:41.641 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:32:41.641 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T12:32:41.641 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:32:41.641 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:32:41.641 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T12:32:41.641 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:32:41.641 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:32:41.641 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2023-10-08T12:32:41.641 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2023-10-08T12:32:41.641 INFO:journalctl@ceph.mon.c.smithi173.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:32:41.641 INFO:journalctl@ceph.mon.c.smithi173.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2023-10-08T12:32:41.642 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: Block cache BinnedLRUCache@0x56273debb1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2023-10-08T12:32:41.643 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T12:32:41.644 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-10-08T12:32:41.644 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: using public_addr v2:172.21.15.173:0/0 -> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2023-10-08T12:32:41.644 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: starting mon.c rank -1 at public addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] at bind addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:32:41.644 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(???) e0 preinit fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:32:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).mds e1 new map 2023-10-08T12:32:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-08T12:32:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout: e1 2023-10-08T12:32:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T12:32:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:32:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: legacy client fscid: -1 2023-10-08T12:32:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2023-10-08T12:32:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: No filesystems configured 2023-10-08T12:32:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-08T12:32:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-08T12:32:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-08T12:32:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-08T12:32:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-08T12:32:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-08T12:32:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T12:32:41.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:32:41.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:32:41.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:32:41.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:32:41.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:41.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:32:41.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:41.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:41.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-08T12:32:41.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:41.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:41.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:32:41.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:32:41.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:41.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Deploying cephadm binary to smithi173 2023-10-08T12:32:41.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:41.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:41.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Added host smithi173 2023-10-08T12:32:41.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:41.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:32:41.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:41.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:32:41.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:41.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:41.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Updating smithi173:/etc/ceph/ceph.conf 2023-10-08T12:32:41.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:41.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:41.974 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/851065165' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T12:32:41.974 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.974 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.974 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.974 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:41.974 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:32:41.974 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/851065165' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T12:32:41.974 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:41.974 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:41.974 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi059:172.21.15.59=a;smithi092:172.21.15.92=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:32:41.975 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Saving service mon spec with placement smithi059:172.21.15.59=a;smithi092:172.21.15.92=b;smithi173:172.21.15.173=c;count:3 2023-10-08T12:32:41.975 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.975 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:41.975 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:41.975 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:41.975 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:41.975 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:32:41.975 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:41.975 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: Deploying daemon mon.c on smithi173 2023-10-08T12:32:41.975 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:41.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 ceph-mon[135182]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-08T12:32:41.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:41 smithi173 systemd[1]: Started Ceph mon.c for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:32:43.094 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T12:32:43.095 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T12:32:43.662 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:32:47.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:32:47.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: mon.a calling monitor election 2023-10-08T12:32:47.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:47.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: mon.c calling monitor election 2023-10-08T12:32:47.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:47.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:32:47.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: monmap e2: 2 mons at {a=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0],c=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} 2023-10-08T12:32:47.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: fsmap 2023-10-08T12:32:47.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:47.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: mgrmap e13: x(active, since 47s) 2023-10-08T12:32:47.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: overall HEALTH_OK 2023-10-08T12:32:47.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:47.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:47.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:47.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:32:47.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:46 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:32:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: mon.a calling monitor election 2023-10-08T12:32:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: mon.c calling monitor election 2023-10-08T12:32:47.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:47.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:47.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:32:47.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: monmap e2: 2 mons at {a=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0],c=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} 2023-10-08T12:32:47.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: fsmap 2023-10-08T12:32:47.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:47.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: mgrmap e13: x(active, since 47s) 2023-10-08T12:32:47.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: overall HEALTH_OK 2023-10-08T12:32:47.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:47.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:47.221 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:47.221 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:32:47.221 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:46 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:48.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:47 smithi059 ceph-mon[98489]: Deploying daemon mon.b on smithi092 2023-10-08T12:32:48.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:47 smithi059 ceph-mon[98489]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:48.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:47 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:48.136 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:32:48.136 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","modified":"2023-10-08T12:32:41.639147Z","created":"2023-10-08T12:30:53.091034Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-08T12:32:48.138 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2023-10-08T12:32:48.161 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:47 smithi173 ceph-mon[135182]: Deploying daemon mon.b on smithi092 2023-10-08T12:32:48.161 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:47 smithi173 ceph-mon[135182]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:48.161 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:47 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:48 smithi173 ceph-mon[135182]: from='client.? 172.21.15.173:0/880633519' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:32:49.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:48 smithi059 ceph-mon[98489]: from='client.? 172.21.15.173:0/880633519' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:32:49.363 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 systemd[1]: Starting Ceph mon.b for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:32:49.513 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T12:32:49.513 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T12:32:49.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 podman[134053]: 2023-10-08T12:32:49.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T12:32:49.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T12:32:49.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 bash[134053]: e6d5bdfbc5c7539305e6c8eceded9bc3ec94cc4828ca0444d5bc470a0229aff9 2023-10-08T12:32:49.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pidfile_write: ignore empty --pid-file 2023-10-08T12:32:49.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: load: jerasure load: lrc 2023-10-08T12:32:49.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: RocksDB version: 7.9.2 2023-10-08T12:32:49.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Git sha 0 2023-10-08T12:32:49.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T12:32:49.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: DB SUMMARY 2023-10-08T12:32:49.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: DB Session ID: M0CCNX9H7I9W8EWATW0B 2023-10-08T12:32:49.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: CURRENT file: CURRENT 2023-10-08T12:32:49.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T12:32:49.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-08T12:32:49.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-08T12:32:49.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-08T12:32:49.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.error_if_exists: 0 2023-10-08T12:32:49.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.create_if_missing: 0 2023-10-08T12:32:49.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.paranoid_checks: 1 2023-10-08T12:32:49.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T12:32:49.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T12:32:49.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T12:32:49.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.env: 0x556c7b1cbda0 2023-10-08T12:32:49.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T12:32:49.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.info_log: 0x556c7c78d640 2023-10-08T12:32:49.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T12:32:49.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.statistics: (nil) 2023-10-08T12:32:49.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.use_fsync: 0 2023-10-08T12:32:49.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_log_file_size: 0 2023-10-08T12:32:49.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T12:32:49.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T12:32:49.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T12:32:49.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T12:32:49.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.allow_fallocate: 1 2023-10-08T12:32:49.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T12:32:49.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.use_direct_reads: 0 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.db_log_dir: 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.wal_dir: 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 systemd[1]: Started Ceph mon.b for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T12:32:49.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.write_buffer_manager: 0x556c7c745360 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T12:32:49.632 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.unordered_write: 0 2023-10-08T12:32:49.633 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T12:32:49.633 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T12:32:49.633 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T12:32:49.633 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T12:32:49.633 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.row_cache: None 2023-10-08T12:32:49.633 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.wal_filter: None 2023-10-08T12:32:49.633 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T12:32:49.633 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T12:32:49.633 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.two_write_queues: 0 2023-10-08T12:32:49.633 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T12:32:49.633 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.wal_compression: 0 2023-10-08T12:32:49.634 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.atomic_flush: 0 2023-10-08T12:32:49.634 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T12:32:49.634 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T12:32:49.634 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T12:32:49.634 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.log_readahead_size: 0 2023-10-08T12:32:49.634 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T12:32:49.634 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T12:32:49.634 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T12:32:49.636 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T12:32:49.636 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T12:32:49.636 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T12:32:49.636 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T12:32:49.636 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_background_jobs: 2 2023-10-08T12:32:49.636 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_background_compactions: -1 2023-10-08T12:32:49.636 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_subcompactions: 1 2023-10-08T12:32:49.636 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T12:32:49.637 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T12:32:49.637 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T12:32:49.637 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T12:32:49.637 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T12:32:49.637 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T12:32:49.637 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T12:32:49.637 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T12:32:49.637 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_open_files: -1 2023-10-08T12:32:49.637 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T12:32:49.637 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T12:32:49.637 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T12:32:49.638 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T12:32:49.638 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_background_flushes: -1 2023-10-08T12:32:49.638 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Compression algorithms supported: 2023-10-08T12:32:49.638 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T12:32:49.638 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: kZSTD supported: 0 2023-10-08T12:32:49.638 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: kXpressCompression supported: 0 2023-10-08T12:32:49.638 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T12:32:49.638 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: kZlibCompression supported: 1 2023-10-08T12:32:49.638 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: kSnappyCompression supported: 1 2023-10-08T12:32:49.638 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: kLZ4Compression supported: 1 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: kBZip2Compression supported: 0 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.merge_operator: 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_filter: None 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T12:32:49.639 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556c7c78d740) 2023-10-08T12:32:49.640 INFO:journalctl@ceph.mon.b.smithi092.stdout: cache_index_and_filter_blocks: 1 2023-10-08T12:32:49.640 INFO:journalctl@ceph.mon.b.smithi092.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T12:32:49.640 INFO:journalctl@ceph.mon.b.smithi092.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T12:32:49.640 INFO:journalctl@ceph.mon.b.smithi092.stdout: pin_top_level_index_and_filter: 1 2023-10-08T12:32:49.640 INFO:journalctl@ceph.mon.b.smithi092.stdout: index_type: 0 2023-10-08T12:32:49.640 INFO:journalctl@ceph.mon.b.smithi092.stdout: data_block_index_type: 0 2023-10-08T12:32:49.640 INFO:journalctl@ceph.mon.b.smithi092.stdout: index_shortening: 1 2023-10-08T12:32:49.640 INFO:journalctl@ceph.mon.b.smithi092.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T12:32:49.640 INFO:journalctl@ceph.mon.b.smithi092.stdout: checksum: 4 2023-10-08T12:32:49.640 INFO:journalctl@ceph.mon.b.smithi092.stdout: no_block_cache: 0 2023-10-08T12:32:49.640 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache: 0x556c7c7e31f0 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache_name: BinnedLRUCache 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache_options: 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: capacity : 536870912 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: num_shard_bits : 4 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: strict_capacity_limit : 0 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: high_pri_pool_ratio: 0.000 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache_compressed: (nil) 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: persistent_cache: (nil) 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_size: 4096 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_size_deviation: 10 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_restart_interval: 16 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: index_block_restart_interval: 1 2023-10-08T12:32:49.641 INFO:journalctl@ceph.mon.b.smithi092.stdout: metadata_block_size: 4096 2023-10-08T12:32:49.642 INFO:journalctl@ceph.mon.b.smithi092.stdout: partition_filters: 0 2023-10-08T12:32:49.642 INFO:journalctl@ceph.mon.b.smithi092.stdout: use_delta_encoding: 1 2023-10-08T12:32:49.642 INFO:journalctl@ceph.mon.b.smithi092.stdout: filter_policy: bloomfilter 2023-10-08T12:32:49.642 INFO:journalctl@ceph.mon.b.smithi092.stdout: whole_key_filtering: 1 2023-10-08T12:32:49.642 INFO:journalctl@ceph.mon.b.smithi092.stdout: verify_compression: 0 2023-10-08T12:32:49.642 INFO:journalctl@ceph.mon.b.smithi092.stdout: read_amp_bytes_per_bit: 0 2023-10-08T12:32:49.642 INFO:journalctl@ceph.mon.b.smithi092.stdout: format_version: 5 2023-10-08T12:32:49.642 INFO:journalctl@ceph.mon.b.smithi092.stdout: enable_index_compression: 1 2023-10-08T12:32:49.642 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_align: 0 2023-10-08T12:32:49.642 INFO:journalctl@ceph.mon.b.smithi092.stdout: max_auto_readahead_size: 262144 2023-10-08T12:32:49.642 INFO:journalctl@ceph.mon.b.smithi092.stdout: prepopulate_block_cache: 0 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout: initial_auto_readahead_size: 8192 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compression: NoCompression 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.num_levels: 7 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T12:32:49.643 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T12:32:49.644 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T12:32:49.645 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T12:32:49.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T12:32:49.647 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T12:32:49.647 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T12:32:49.647 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T12:32:49.647 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T12:32:49.647 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T12:32:49.647 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T12:32:49.647 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T12:32:49.647 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T12:32:49.647 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T12:32:49.647 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.table_properties_collectors: 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.inplace_update_support: 0 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.bloom_locality: 0 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.max_successive_merges: 0 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T12:32:49.648 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.ttl: 2592000 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.enable_blob_files: false 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.min_blob_size: 0 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T12:32:49.649 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 135f9932-b0a1-4c43-a402-4c5f8884399b 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696768369560026, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696768369560449, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696768369, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "135f9932-b0a1-4c43-a402-4c5f8884399b", "db_session_id": "M0CCNX9H7I9W8EWATW0B", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696768369560516, "job": 1, "event": "recovery_finished"} 2023-10-08T12:32:49.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-08T12:32:49.651 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T12:32:49.651 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556c7c880000 2023-10-08T12:32:49.651 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: DB pointer 0x556c7c86c000 2023-10-08T12:32:49.651 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T12:32:49.651 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T12:32:49.651 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** DB Stats ** 2023-10-08T12:32:49.651 INFO:journalctl@ceph.mon.b.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:32:49.651 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T12:32:49.651 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:32:49.651 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:32:49.651 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T12:32:49.652 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:32:49.652 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:32:49.652 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-08T12:32:49.652 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** Compaction Stats [default] ** 2023-10-08T12:32:49.652 INFO:journalctl@ceph.mon.b.smithi092.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:32:49.652 INFO:journalctl@ceph.mon.b.smithi092.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T12:32:49.652 INFO:journalctl@ceph.mon.b.smithi092.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:32:49.652 INFO:journalctl@ceph.mon.b.smithi092.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:32:49.652 INFO:journalctl@ceph.mon.b.smithi092.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:32:49.652 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-08T12:32:49.652 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** Compaction Stats [default] ** 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T12:32:49.653 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:32:49.654 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:32:49.654 INFO:journalctl@ceph.mon.b.smithi092.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T12:32:49.654 INFO:journalctl@ceph.mon.b.smithi092.stdout: Block cache BinnedLRUCache@0x556c7c7e31f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-08T12:32:49.654 INFO:journalctl@ceph.mon.b.smithi092.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-08T12:32:49.654 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-08T12:32:49.654 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T12:32:49.654 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-08T12:32:49.654 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: using public_addr v2:172.21.15.92:0/0 -> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] 2023-10-08T12:32:49.654 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: starting mon.b rank -1 at public addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] at bind addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:32:49.654 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(???) e0 preinit fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:32:49.654 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).mds e1 new map 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout: e1 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout: legacy client fscid: -1 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout: No filesystems configured 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-08T12:32:49.655 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-08T12:32:49.656 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-08T12:32:49.656 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T12:32:49.656 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:32:49.656 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:32:49.656 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:32:49.656 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:32:49.656 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:49.656 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.656 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.656 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.656 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:32:49.657 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:49.658 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Deploying cephadm binary to smithi173 2023-10-08T12:32:49.658 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:49.658 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.658 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:49.658 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.658 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Added host smithi173 2023-10-08T12:32:49.658 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.658 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:49.658 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.658 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:32:49.658 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Updating smithi173:/etc/ceph/ceph.conf 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/851065165' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T12:32:49.659 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/851065165' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi059:172.21.15.59=a;smithi092:172.21.15.92=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Saving service mon spec with placement smithi059:172.21.15.59=a;smithi092:172.21.15.92=b;smithi173:172.21.15.173=c;count:3 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:49.660 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Deploying daemon mon.c on smithi173 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.a calling monitor election 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:49.661 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.c calling monitor election 2023-10-08T12:32:49.662 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:49.662 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:49.662 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:49.662 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:49.662 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:32:49.662 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: monmap e2: 2 mons at {a=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0],c=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} 2023-10-08T12:32:49.662 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: fsmap 2023-10-08T12:32:49.662 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:49.662 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mgrmap e13: x(active, since 47s) 2023-10-08T12:32:49.662 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: overall HEALTH_OK 2023-10-08T12:32:49.662 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.663 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.663 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:49.663 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:32:49.663 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:49.663 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: Deploying daemon mon.b on smithi092 2023-10-08T12:32:49.663 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:49.663 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:49.663 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: from='client.? 172.21.15.173:0/880633519' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:32:49.663 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:49 smithi092 ceph-mon[134093]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-08T12:32:50.080 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:32:54.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: mon.c calling monitor election 2023-10-08T12:32:54.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:32:54.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: mon.a calling monitor election 2023-10-08T12:32:54.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:54.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:54.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:54.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:54.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:54.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: monmap e3: 3 mons at {a=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: fsmap 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: mgrmap e13: x(active, since 55s) 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T12:32:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: mon.b (rank 2) addr [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] is down (out of quorum) 2023-10-08T12:32:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:54 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:54.970 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-08T12:32:54.970 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":3,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","modified":"2023-10-08T12:32:49.591650Z","created":"2023-10-08T12:30:53.091034Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-08T12:32:54.972 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 3 2023-10-08T12:32:55.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: mon.c calling monitor election 2023-10-08T12:32:55.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:32:55.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: mon.a calling monitor election 2023-10-08T12:32:55.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:55.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:55.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:55.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:55.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:55.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:55.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:55.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:55.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:55.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:32:55.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: monmap e3: 3 mons at {a=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} 2023-10-08T12:32:55.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: fsmap 2023-10-08T12:32:55.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:55.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: mgrmap e13: x(active, since 55s) 2023-10-08T12:32:55.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T12:32:55.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T12:32:55.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T12:32:55.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: mon.b (rank 2) addr [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] is down (out of quorum) 2023-10-08T12:32:55.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:55.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:54 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:55.432 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-08T12:32:55.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-08T12:32:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:55 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:55.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:55 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:55.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:55 smithi173 ceph-mon[135182]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:55.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:55 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:55.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:55 smithi173 ceph-mon[135182]: from='client.? 172.21.15.173:0/1801459583' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:32:55.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:55 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:55.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:55 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:55.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:55 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:55.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:55 smithi059 ceph-mon[98489]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:55.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:55 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:55.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:55 smithi059 ceph-mon[98489]: from='client.? 172.21.15.173:0/1801459583' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:32:55.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:55 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:56.181 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:32:56.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: mon.c calling monitor election 2023-10-08T12:32:56.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:32:56.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: mon.a calling monitor election 2023-10-08T12:32:56.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:56.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:32:56.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:56.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:56.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:56.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:56.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:56.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:56.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:56.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:32:56.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: monmap e3: 3 mons at {a=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} 2023-10-08T12:32:56.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: fsmap 2023-10-08T12:32:56.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:56.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: mgrmap e13: x(active, since 55s) 2023-10-08T12:32:56.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T12:32:56.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T12:32:56.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T12:32:56.879 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: mon.b (rank 2) addr [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] is down (out of quorum) 2023-10-08T12:32:56.879 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:56.879 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:56.879 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:56.879 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:56.879 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:56.879 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:56.879 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='client.? 172.21.15.173:0/1801459583' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:32:56.879 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:56 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:57.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: mon.b calling monitor election 2023-10-08T12:32:57.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: Updating smithi059:/etc/ceph/ceph.conf 2023-10-08T12:32:57.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-08T12:32:57.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: Updating smithi173:/etc/ceph/ceph.conf 2023-10-08T12:32:57.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: mon.b calling monitor election 2023-10-08T12:32:57.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: mon.c calling monitor election 2023-10-08T12:32:57.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: mon.a calling monitor election 2023-10-08T12:32:57.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T12:32:57.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: monmap e3: 3 mons at {a=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} 2023-10-08T12:32:57.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: fsmap 2023-10-08T12:32:57.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:57.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: mgrmap e13: x(active, since 57s) 2023-10-08T12:32:57.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T12:32:57.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: Cluster is now healthy 2023-10-08T12:32:57.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: overall HEALTH_OK 2023-10-08T12:32:57.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:57.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:57.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:57.767 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.767 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.767 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.767 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.767 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.767 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.767 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:57.767 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:57 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.947 INFO:teuthology.orchestra.run.smithi059.stdout:# minimal ceph.conf for 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:32:57.948 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2023-10-08T12:32:57.948 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:32:57.948 INFO:teuthology.orchestra.run.smithi059.stdout: mon_host = [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2023-10-08T12:32:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: mon.b calling monitor election 2023-10-08T12:32:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: Updating smithi059:/etc/ceph/ceph.conf 2023-10-08T12:32:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-08T12:32:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: Updating smithi173:/etc/ceph/ceph.conf 2023-10-08T12:32:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: mon.b calling monitor election 2023-10-08T12:32:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: mon.c calling monitor election 2023-10-08T12:32:57.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: mon.a calling monitor election 2023-10-08T12:32:57.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T12:32:57.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: monmap e3: 3 mons at {a=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} 2023-10-08T12:32:57.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: fsmap 2023-10-08T12:32:57.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:57.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: mgrmap e13: x(active, since 57s) 2023-10-08T12:32:57.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T12:32:57.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: Cluster is now healthy 2023-10-08T12:32:57.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: overall HEALTH_OK 2023-10-08T12:32:57.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:57.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:57.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:57.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:57.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:57.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:57 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: mon.b calling monitor election 2023-10-08T12:32:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: Updating smithi059:/etc/ceph/ceph.conf 2023-10-08T12:32:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-08T12:32:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: Updating smithi173:/etc/ceph/ceph.conf 2023-10-08T12:32:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: mon.b calling monitor election 2023-10-08T12:32:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: mon.c calling monitor election 2023-10-08T12:32:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: mon.a calling monitor election 2023-10-08T12:32:58.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T12:32:58.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: monmap e3: 3 mons at {a=[v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0],b=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0],c=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} 2023-10-08T12:32:58.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: fsmap 2023-10-08T12:32:58.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:32:58.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: mgrmap e13: x(active, since 57s) 2023-10-08T12:32:58.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T12:32:58.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: Cluster is now healthy 2023-10-08T12:32:58.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: overall HEALTH_OK 2023-10-08T12:32:58.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:58.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:58.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:32:58.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.130 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.130 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.130 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.130 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.130 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.130 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:32:58.131 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:57 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.367 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-08T12:32:58.368 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:32:58.368 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T12:32:58.444 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:32:58.445 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:58.559 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-08T12:32:58.559 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T12:32:58.597 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-08T12:32:58.597 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:58.670 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-08T12:32:58.671 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T12:32:58.707 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-08T12:32:58.707 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:32:58.778 INFO:tasks.cephadm:enabling module snap_schedule 2023-10-08T12:32:58.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T12:32:58.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:58 smithi173 ceph-mon[135182]: Updating smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:58 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:58 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:58 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:58 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:58 smithi173 ceph-mon[135182]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T12:32:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:58 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:32:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:58 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:32:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:58 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:58 smithi173 ceph-mon[135182]: Reconfiguring daemon mon.a on smithi059 2023-10-08T12:32:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:58 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1812444695' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:58.992 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:58 smithi059 ceph-mon[98489]: Updating smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:58.992 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:58 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.992 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:58 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:58 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:58 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:58.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:58 smithi059 ceph-mon[98489]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T12:32:58.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:58 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:32:58.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:58 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:32:58.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:58 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:58.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:58 smithi059 ceph-mon[98489]: Reconfiguring daemon mon.a on smithi059 2023-10-08T12:32:58.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:58 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1812444695' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:58 smithi092 ceph-mon[134093]: Updating smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:32:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:58 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:58 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:58 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:58 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:32:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:58 smithi092 ceph-mon[134093]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T12:32:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:58 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:32:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:58 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:32:59.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:58 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:59.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:58 smithi092 ceph-mon[134093]: Reconfiguring daemon mon.a on smithi059 2023-10-08T12:32:59.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:58 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1812444695' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:59.688 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:59 smithi092 ceph-mon[134093]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:59 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:59 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:59 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:59 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:33:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:59 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:33:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:32:59 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:00.181 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:59 smithi059 ceph-mon[98489]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:00.182 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:00.182 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:00.182 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:00.182 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:33:00.182 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:33:00.182 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:32:59 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:59 smithi173 ceph-mon[135182]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:59 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:59 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:59 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:59 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:33:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:59 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:33:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:32:59 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:00.941 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:00 smithi059 ceph-mon[98489]: Reconfiguring mon.b (monmap changed)... 2023-10-08T12:33:00.941 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:00 smithi059 ceph-mon[98489]: Reconfiguring daemon mon.b on smithi092 2023-10-08T12:33:00.941 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:00 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:00.942 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:00 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:00.942 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:00 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:33:00.942 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:00 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:33:00.942 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:00 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:00 smithi092 ceph-mon[134093]: Reconfiguring mon.b (monmap changed)... 2023-10-08T12:33:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:00 smithi092 ceph-mon[134093]: Reconfiguring daemon mon.b on smithi092 2023-10-08T12:33:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:00 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:00 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:00 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:33:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:00 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:33:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:00 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:01.173 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:00 smithi173 ceph-mon[135182]: Reconfiguring mon.b (monmap changed)... 2023-10-08T12:33:01.174 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:00 smithi173 ceph-mon[135182]: Reconfiguring daemon mon.b on smithi092 2023-10-08T12:33:01.174 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:00 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:01.174 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:00 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:01.174 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:00 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:33:01.174 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:00 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:33:01.174 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:00 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:01 smithi092 ceph-mon[134093]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:33:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:01 smithi092 ceph-mon[134093]: Reconfiguring daemon mon.c on smithi173 2023-10-08T12:33:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:01 smithi092 ceph-mon[134093]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:01 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2540778439' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:33:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:01 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:33:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:01 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:01 smithi092 ceph-mon[134093]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:02.153 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:01 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: ignoring --setuser ceph since I am not root 2023-10-08T12:33:02.153 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:01 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: ignoring --setgroup ceph since I am not root 2023-10-08T12:33:02.153 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:02 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:02.151+0000 7f06de218200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:33:02.153 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:01 smithi059 ceph-mon[98489]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:33:02.153 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:01 smithi059 ceph-mon[98489]: Reconfiguring daemon mon.c on smithi173 2023-10-08T12:33:02.153 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:01 smithi059 ceph-mon[98489]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:02.153 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:01 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2540778439' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:33:02.153 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:01 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:33:02.154 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:01 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:02.154 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:01 smithi059 ceph-mon[98489]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:01 smithi173 ceph-mon[135182]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:33:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:01 smithi173 ceph-mon[135182]: Reconfiguring daemon mon.c on smithi173 2023-10-08T12:33:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:01 smithi173 ceph-mon[135182]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:01 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2540778439' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:33:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:01 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:33:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:01 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:01 smithi173 ceph-mon[135182]: from='mgr.14150 172.21.15.59:0/3397969057' entity='mgr.x' 2023-10-08T12:33:02.266 INFO:tasks.cephadm:Adding mgr.x on smithi059 2023-10-08T12:33:02.266 INFO:tasks.cephadm:Adding mgr.y on smithi092 2023-10-08T12:33:02.266 INFO:tasks.cephadm:Adding mgr.z on smithi173 2023-10-08T12:33:02.267 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch apply mgr '3;smithi059=x;smithi092=y;smithi173=z' 2023-10-08T12:33:02.509 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:02 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:02.261+0000 7f06de218200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:33:02.510 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:02 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:02.383+0000 7f06de218200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:33:02.510 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:02 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:02.508+0000 7f06de218200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:33:02.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:02 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:02.741+0000 7f06de218200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:33:02.821 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:33:03.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:02 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T12:33:03.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:02 smithi092 ceph-mon[134093]: mgrmap e14: x(active, since 63s) 2023-10-08T12:33:03.206 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:02 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T12:33:03.207 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:02 smithi173 ceph-mon[135182]: mgrmap e14: x(active, since 63s) 2023-10-08T12:33:03.211 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:02 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T12:33:03.211 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:02 smithi059 ceph-mon[98489]: mgrmap e14: x(active, since 63s) 2023-10-08T12:33:03.504 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:03 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:03.210+0000 7f06de218200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:33:03.504 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:03 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:03.382+0000 7f06de218200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:33:03.504 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:03 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:03.503+0000 7f06de218200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:33:03.764 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:03 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:03.631+0000 7f06de218200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:33:04.514 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:04 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:04.189+0000 7f06de218200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:33:05.514 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:05 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:05.064+0000 7f06de218200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:33:05.515 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:05 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:05.173+0000 7f06de218200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:33:06.514 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:06.165+0000 7f06de218200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:33:06.515 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:06.289+0000 7f06de218200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:33:06.900 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:06.522+0000 7f06de218200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:33:07.183 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:06.899+0000 7f06de218200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:33:07.515 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:07 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:07.182+0000 7f06de218200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:33:07.515 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:07 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:07.382+0000 7f06de218200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:33:08.014 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:07 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:07.740+0000 7f06de218200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:33:09.014 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:08 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:08.704+0000 7f06de218200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:33:09.015 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:08 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:08.884+0000 7f06de218200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:33:09.514 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:09.142+0000 7f06de218200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:33:09.514 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:09.293+0000 7f06de218200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:33:10.014 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:09.581+0000 7f06de218200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:33:11.013 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: Active manager daemon x restarted 2023-10-08T12:33:11.013 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: Activating manager daemon x 2023-10-08T12:33:11.013 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T12:33:11.013 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: mgrmap e15: x(active, starting, since 0.00503883s) 2023-10-08T12:33:11.013 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:33:11.014 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:33:11.014 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:33:11.014 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:33:11.014 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:33:11.014 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:33:11.014 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:33:11.014 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: Manager daemon x is now available 2023-10-08T12:33:11.014 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:11.014 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: Active manager daemon x restarted 2023-10-08T12:33:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: Activating manager daemon x 2023-10-08T12:33:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T12:33:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: mgrmap e15: x(active, starting, since 0.00503883s) 2023-10-08T12:33:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:33:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:33:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:33:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:33:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:33:11.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:33:11.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:33:11.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: Manager daemon x is now available 2023-10-08T12:33:11.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:11.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:11.016 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:33:10 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:33:10.696+0000 7f06de218200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:33:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: Active manager daemon x restarted 2023-10-08T12:33:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: Activating manager daemon x 2023-10-08T12:33:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T12:33:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: mgrmap e15: x(active, starting, since 0.00503883s) 2023-10-08T12:33:11.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:33:11.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:33:11.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:33:11.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:33:11.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:33:11.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:33:11.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:33:11.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: Manager daemon x is now available 2023-10-08T12:33:11.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:11.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:11.717 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mgr update... 2023-10-08T12:33:12.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:33:12.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:33:12.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:11 smithi059 ceph-mon[98489]: mgrmap e16: x(active, since 1.00893s) 2023-10-08T12:33:12.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:33:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:33:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:11 smithi092 ceph-mon[134093]: mgrmap e16: x(active, since 1.00893s) 2023-10-08T12:33:12.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:12.159 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:33:12.159 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:33:12.159 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:11 smithi173 ceph-mon[135182]: mgrmap e16: x(active, since 1.00893s) 2023-10-08T12:33:12.159 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:12.183 DEBUG:teuthology.orchestra.run.smithi092:mgr.y> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.y.service 2023-10-08T12:33:12.186 DEBUG:teuthology.orchestra.run.smithi173:mgr.z> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.z.service 2023-10-08T12:33:12.188 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2023-10-08T12:33:12.189 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set client client_mount_timeout 600 2023-10-08T12:33:12.193 INFO:tasks.cephadm:setting config [client] debug_client = 20 2023-10-08T12:33:12.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set client debug_client 20 2023-10-08T12:33:12.215 INFO:journalctl@ceph.mgr.y.smithi092.stdout:-- Logs begin at Sun 2023-10-08 12:08:21 UTC. -- 2023-10-08T12:33:12.239 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2023-10-08T12:33:12.240 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set client debug_ms 1 2023-10-08T12:33:12.242 INFO:journalctl@ceph.mgr.z.smithi173.stdout:-- Logs begin at Sun 2023-10-08 12:08:19 UTC. -- 2023-10-08T12:33:12.286 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2023-10-08T12:33:12.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set client rados_mon_op_timeout 900 2023-10-08T12:33:12.333 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2023-10-08T12:33:12.333 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set client rados_osd_op_timeout 900 2023-10-08T12:33:12.379 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2023-10-08T12:33:12.380 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_mds 20 2023-10-08T12:33:12.427 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2023-10-08T12:33:12.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_mds_balancer 20 2023-10-08T12:33:12.476 INFO:tasks.cephadm:setting config [mds] debug_ms = 1 2023-10-08T12:33:12.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_ms 1 2023-10-08T12:33:12.527 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2023-10-08T12:33:12.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_fragment_size_max 10000 2023-10-08T12:33:12.584 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2023-10-08T12:33:12.584 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_merge_size 5 2023-10-08T12:33:12.639 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2023-10-08T12:33:12.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_split_bits 3 2023-10-08T12:33:12.695 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2023-10-08T12:33:12.695 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_split_size 100 2023-10-08T12:33:12.773 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2023-10-08T12:33:12.773 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_debug_frag True 2023-10-08T12:33:12.827 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2023-10-08T12:33:12.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_debug_scatterstat True 2023-10-08T12:33:12.888 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2023-10-08T12:33:12.889 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_op_complaint_time 180 2023-10-08T12:33:12.931 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:12 smithi059 ceph-mon[98489]: [08/Oct/2023:12:33:11] ENGINE Bus STARTING 2023-10-08T12:33:12.931 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:12 smithi059 ceph-mon[98489]: [08/Oct/2023:12:33:11] ENGINE Serving on https://172.21.15.59:7150 2023-10-08T12:33:12.931 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:12 smithi059 ceph-mon[98489]: [08/Oct/2023:12:33:11] ENGINE Serving on http://172.21.15.59:8765 2023-10-08T12:33:12.931 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:12 smithi059 ceph-mon[98489]: [08/Oct/2023:12:33:11] ENGINE Bus STARTED 2023-10-08T12:33:12.931 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:12 smithi059 ceph-mon[98489]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi059=x;smithi092=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:33:12.931 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:12 smithi059 ceph-mon[98489]: Saving service mgr spec with placement smithi059=x;smithi092=y;smithi173=z;count:3 2023-10-08T12:33:12.931 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:12.931 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:12.931 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:12.932 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:12.945 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2023-10-08T12:33:12.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_verify_scatter True 2023-10-08T12:33:13.016 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2023-10-08T12:33:13.016 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds osd_op_complaint_time 180 2023-10-08T12:33:13.085 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2023-10-08T12:33:13.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds rados_mon_op_timeout 900 2023-10-08T12:33:13.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:12 smithi092 ceph-mon[134093]: [08/Oct/2023:12:33:11] ENGINE Bus STARTING 2023-10-08T12:33:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:12 smithi092 ceph-mon[134093]: [08/Oct/2023:12:33:11] ENGINE Serving on https://172.21.15.59:7150 2023-10-08T12:33:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:12 smithi092 ceph-mon[134093]: [08/Oct/2023:12:33:11] ENGINE Serving on http://172.21.15.59:8765 2023-10-08T12:33:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:12 smithi092 ceph-mon[134093]: [08/Oct/2023:12:33:11] ENGINE Bus STARTED 2023-10-08T12:33:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:12 smithi092 ceph-mon[134093]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi059=x;smithi092=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:33:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:12 smithi092 ceph-mon[134093]: Saving service mgr spec with placement smithi059=x;smithi092=y;smithi173=z;count:3 2023-10-08T12:33:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:13.148 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2023-10-08T12:33:13.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mds rados_osd_op_timeout 900 2023-10-08T12:33:13.212 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2023-10-08T12:33:13.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mgr debug_cephsqlite 20 2023-10-08T12:33:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:12 smithi173 ceph-mon[135182]: [08/Oct/2023:12:33:11] ENGINE Bus STARTING 2023-10-08T12:33:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:12 smithi173 ceph-mon[135182]: [08/Oct/2023:12:33:11] ENGINE Serving on https://172.21.15.59:7150 2023-10-08T12:33:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:12 smithi173 ceph-mon[135182]: [08/Oct/2023:12:33:11] ENGINE Serving on http://172.21.15.59:8765 2023-10-08T12:33:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:12 smithi173 ceph-mon[135182]: [08/Oct/2023:12:33:11] ENGINE Bus STARTED 2023-10-08T12:33:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:12 smithi173 ceph-mon[135182]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi059=x;smithi092=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:33:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:12 smithi173 ceph-mon[135182]: Saving service mgr spec with placement smithi059=x;smithi092=y;smithi173=z;count:3 2023-10-08T12:33:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:13.296 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2023-10-08T12:33:13.296 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T12:33:13.350 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2023-10-08T12:33:13.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T12:33:13.426 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2023-10-08T12:33:13.426 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set mon mon_op_complaint_time 120 2023-10-08T12:33:13.521 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2023-10-08T12:33:13.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config set osd osd_op_complaint_time 180 2023-10-08T12:33:13.600 DEBUG:tasks.cephadm:set 24 configs 2023-10-08T12:33:13.600 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi059') 2023-10-08T12:33:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:13.767 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:14.161 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:14.585 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:14.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:14 smithi092 ceph-mon[134093]: mgrmap e17: x(active, since 2s) 2023-10-08T12:33:14.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:33:14.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:33:14.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:14 smithi059 ceph-mon[98489]: mgrmap e17: x(active, since 2s) 2023-10-08T12:33:14.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:33:14.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:33:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:14 smithi173 ceph-mon[135182]: mgrmap e17: x(active, since 2s) 2023-10-08T12:33:14.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:33:14.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:14.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:33:15.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:15.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:15.986 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:15.986 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:16.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:16.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:16.231 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:17.717 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:17.775 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:18.713 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:18 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:18.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:18 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:18.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:18 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:33:18.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:18 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:18.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:18 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:18.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:18 smithi059 ceph-mon[98489]: Updating smithi059:/etc/ceph/ceph.conf 2023-10-08T12:33:18.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:18 smithi059 ceph-mon[98489]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-08T12:33:18.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:18 smithi059 ceph-mon[98489]: Updating smithi173:/etc/ceph/ceph.conf 2023-10-08T12:33:18.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:18 smithi059 ceph-mon[98489]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:33:18.717 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:18 smithi059 ceph-mon[98489]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:33:18.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:18 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:18.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:18 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:18.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:18 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:33:18.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:18 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:18.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:18 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:18.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:18 smithi092 ceph-mon[134093]: Updating smithi059:/etc/ceph/ceph.conf 2023-10-08T12:33:18.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:18 smithi092 ceph-mon[134093]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-08T12:33:18.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:18 smithi092 ceph-mon[134093]: Updating smithi173:/etc/ceph/ceph.conf 2023-10-08T12:33:18.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:18 smithi092 ceph-mon[134093]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:33:18.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:18 smithi092 ceph-mon[134093]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:33:18.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:18 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:18.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:18 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:18.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:18 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:33:18.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:18 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:18.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:18 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:18.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:18 smithi173 ceph-mon[135182]: Updating smithi059:/etc/ceph/ceph.conf 2023-10-08T12:33:18.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:18 smithi173 ceph-mon[135182]: Updating smithi092:/etc/ceph/ceph.conf 2023-10-08T12:33:18.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:18 smithi173 ceph-mon[135182]: Updating smithi173:/etc/ceph/ceph.conf 2023-10-08T12:33:18.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:18 smithi173 ceph-mon[135182]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:33:18.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:18 smithi173 ceph-mon[135182]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:33:19.781 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:19 smithi059 ceph-mon[98489]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:33:19.782 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:19 smithi059 ceph-mon[98489]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:33:19.782 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:19 smithi059 ceph-mon[98489]: Updating smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:33:19.782 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:19 smithi059 ceph-mon[98489]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:33:19.782 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:19 smithi059 ceph-mon[98489]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:33:19.782 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:19 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:19.782 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:19 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:19.782 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:19 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:19.782 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:19 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:19.782 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:19 smithi059 ceph-mon[98489]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:33:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:19 smithi173 ceph-mon[135182]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:33:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:19 smithi173 ceph-mon[135182]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:33:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:19 smithi173 ceph-mon[135182]: Updating smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:33:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:19 smithi173 ceph-mon[135182]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:33:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:19 smithi173 ceph-mon[135182]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:33:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:19 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:19 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:19 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:19 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:19 smithi173 ceph-mon[135182]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:33:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 -- 172.21.15.59:0/3794541607 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb78c038b40 msgr2=0x7fb78c03b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 --2- 172.21.15.59:0/3794541607 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb78c038b40 0x7fb78c03b000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0199180 tx=0x7fb790017040 comp rx=0 tx=0).stop 2023-10-08T12:33:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 -- 172.21.15.59:0/3794541607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0101320 msgr2=0x7fb7a0197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 --2- 172.21.15.59:0/3794541607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0101320 0x7fb7a0197cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00eb30 tx=0x7fb79c00ee40 comp rx=0 tx=0).stop 2023-10-08T12:33:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 -- 172.21.15.59:0/3794541607 shutdown_connections 2023-10-08T12:33:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 --2- 172.21.15.59:0/3794541607 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb78c038b40 0x7fb78c03b000 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 --2- 172.21.15.59:0/3794541607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7a0106580 0x7fb7a019f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 --2- 172.21.15.59:0/3794541607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0101320 0x7fb7a0197cc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 --2- 172.21.15.59:0/3794541607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7a0103c50 0x7fb7a0198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 -- 172.21.15.59:0/3794541607 >> 172.21.15.59:0/3794541607 conn(0x7fb7a00facf0 msgr2=0x7fb7a0100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 -- 172.21.15.59:0/3794541607 shutdown_connections 2023-10-08T12:33:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.047+0000 7fb7a84a3700 1 -- 172.21.15.59:0/3794541607 wait complete. 2023-10-08T12:33:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:19 smithi092 ceph-mon[134093]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:33:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:19 smithi092 ceph-mon[134093]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:33:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:19 smithi092 ceph-mon[134093]: Updating smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:33:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:19 smithi092 ceph-mon[134093]: Updating smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:33:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:19 smithi092 ceph-mon[134093]: Updating smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:33:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:19 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:20.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:19 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:20.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:19 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:20.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:19 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:20.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:19 smithi092 ceph-mon[134093]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:33:20.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.406+0000 7f578ef8a700 1 -- 172.21.15.59:0/1373905098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5788101260 msgr2=0x7f578810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:20.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.406+0000 7f578ef8a700 1 --2- 172.21.15.59:0/1373905098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5788101260 0x7f578810d650 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f578000b0a0 tx=0x7f578000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.407+0000 7f578ef8a700 1 -- 172.21.15.59:0/1373905098 shutdown_connections 2023-10-08T12:33:20.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.407+0000 7f578ef8a700 1 --2- 172.21.15.59:0/1373905098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57881057c0 0x7f5788105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.407+0000 7f578ef8a700 1 --2- 172.21.15.59:0/1373905098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5788101260 0x7f578810d650 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.407+0000 7f578ef8a700 1 --2- 172.21.15.59:0/1373905098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57881008a0 0x7f5788100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.407+0000 7f578ef8a700 1 -- 172.21.15.59:0/1373905098 >> 172.21.15.59:0/1373905098 conn(0x7f57880779e0 msgr2=0x7f5788077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:20.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.407+0000 7f578ef8a700 1 -- 172.21.15.59:0/1373905098 shutdown_connections 2023-10-08T12:33:20.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.407+0000 7f578ef8a700 1 -- 172.21.15.59:0/1373905098 wait complete. 2023-10-08T12:33:20.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.408+0000 7f578ef8a700 1 Processor -- start 2023-10-08T12:33:20.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.408+0000 7f578ef8a700 1 -- start start 2023-10-08T12:33:20.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.409+0000 7f578ef8a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57881008a0 0x7f578819ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:20.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.409+0000 7f578ef8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5788101260 0x7f578819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:20.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.409+0000 7f578ef8a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57881057c0 0x7f5788198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:20.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.409+0000 7f578ef8a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5788199200 con 0x7f5788101260 2023-10-08T12:33:20.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.409+0000 7f578ef8a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5788199370 con 0x7f57881057c0 2023-10-08T12:33:20.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.409+0000 7f578ef8a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5788199530 con 0x7f57881008a0 2023-10-08T12:33:20.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.409+0000 7f578cd26700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57881008a0 0x7f578819ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:20.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.409+0000 7f578cd26700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57881008a0 0x7f578819ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:54764/0 (socket says 172.21.15.59:54764) 2023-10-08T12:33:20.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.409+0000 7f578cd26700 1 -- 172.21.15.59:0/2041078943 learned_addr learned my addr 172.21.15.59:0/2041078943 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:20.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.409+0000 7f5787fff700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5788101260 0x7f578819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:20.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.410+0000 7f578d527700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57881057c0 0x7f5788198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.410+0000 7f578cd26700 1 -- 172.21.15.59:0/2041078943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57881057c0 msgr2=0x7f5788198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.410+0000 7f578cd26700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57881057c0 0x7f5788198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.410+0000 7f578cd26700 1 -- 172.21.15.59:0/2041078943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5788101260 msgr2=0x7f578819efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.410+0000 7f578cd26700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5788101260 0x7f578819efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.410+0000 7f578cd26700 1 -- 172.21.15.59:0/2041078943 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780009d00 con 0x7f57881008a0 2023-10-08T12:33:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.410+0000 7f5787fff700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5788101260 0x7f578819efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:33:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.411+0000 7f578cd26700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57881008a0 0x7f578819ea60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f577c00e970 tx=0x7f577c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.411+0000 7f5785ffb700 1 -- 172.21.15.59:0/2041078943 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c009790 con 0x7f57881008a0 2023-10-08T12:33:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.411+0000 7f5785ffb700 1 -- 172.21.15.59:0/2041078943 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(23 keys) v1 ==== 1018+0+0 (secure 0 0 0) 0x7f577c00eec0 con 0x7f57881008a0 2023-10-08T12:33:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.411+0000 7f578ef8a700 1 -- 172.21.15.59:0/2041078943 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5788199810 con 0x7f57881008a0 2023-10-08T12:33:20.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.411+0000 7f5785ffb700 1 -- 172.21.15.59:0/2041078943 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c003b40 con 0x7f57881008a0 2023-10-08T12:33:20.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.411+0000 7f578ef8a700 1 -- 172.21.15.59:0/2041078943 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57881a5a50 con 0x7f57881008a0 2023-10-08T12:33:20.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.413+0000 7f578ef8a700 1 -- 172.21.15.59:0/2041078943 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5788101f30 con 0x7f57881008a0 2023-10-08T12:33:20.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.413+0000 7f5785ffb700 1 -- 172.21.15.59:0/2041078943 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f577c003ca0 con 0x7f57881008a0 2023-10-08T12:33:20.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.414+0000 7f5785ffb700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5778038b90 0x7f577803b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:20.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.414+0000 7f5785ffb700 1 -- 172.21.15.59:0/2041078943 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f577c014070 con 0x7f57881008a0 2023-10-08T12:33:20.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.414+0000 7f5787fff700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5778038b90 0x7f577803b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:20.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.415+0000 7f5787fff700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5778038b90 0x7f577803b050 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f578819a240 tx=0x7f5774008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:20.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.418+0000 7f5785ffb700 1 -- 172.21.15.59:0/2041078943 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f577c00cbd0 con 0x7f57881008a0 2023-10-08T12:33:20.578 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:20.579 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.676+0000 7f578ef8a700 1 -- 172.21.15.59:0/2041078943 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) v1 -- 0x7f578804e4c0 con 0x7f57881008a0 2023-10-08T12:33:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.681+0000 7f5785ffb700 1 -- 172.21.15.59:0/2041078943 <== mon.1 v2:172.21.15.173:3300/0 7 ==== config(24 keys) v1 ==== 1043+0+0 (secure 0 0 0) 0x7f577c00cbd0 con 0x7f57881008a0 2023-10-08T12:33:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.681+0000 7f5785ffb700 1 -- 172.21.15.59:0/2041078943 <== mon.1 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v12)=0 v12) v1 ==== 114+0+0 (secure 0 0 0) 0x7f577c020b90 con 0x7f57881008a0 2023-10-08T12:33:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 -- 172.21.15.59:0/2041078943 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5778038b90 msgr2=0x7f577803b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5778038b90 0x7f577803b050 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f578819a240 tx=0x7f5774008040 comp rx=0 tx=0).stop 2023-10-08T12:33:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 -- 172.21.15.59:0/2041078943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57881008a0 msgr2=0x7f578819ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57881008a0 0x7f578819ea60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f577c00e970 tx=0x7f577c00ec80 comp rx=0 tx=0).stop 2023-10-08T12:33:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 -- 172.21.15.59:0/2041078943 shutdown_connections 2023-10-08T12:33:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5778038b90 0x7f577803b050 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57881057c0 0x7f5788198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57881008a0 0x7f578819ea60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 --2- 172.21.15.59:0/2041078943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5788101260 0x7f578819efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:20.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 -- 172.21.15.59:0/2041078943 >> 172.21.15.59:0/2041078943 conn(0x7f57880779e0 msgr2=0x7f578810c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:20.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 -- 172.21.15.59:0/2041078943 shutdown_connections 2023-10-08T12:33:20.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.684+0000 7f578ef8a700 1 -- 172.21.15.59:0/2041078943 wait complete. 2023-10-08T12:33:20.927 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:20 smithi059 ceph-mon[98489]: Updating smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:33:20.927 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:20 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/711616782' entity='client.admin' 2023-10-08T12:33:20.927 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:20 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:20.927 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:20 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:20.927 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:20 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:20.927 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:20 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:20.927 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:20 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:33:20.928 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:20 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:33:20.928 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:20 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:33:20.928 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:20 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:20.928 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:20 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:20 smithi173 ceph-mon[135182]: Updating smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:33:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:20 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/711616782' entity='client.admin' 2023-10-08T12:33:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:20 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:20 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:20 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:20 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:20 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:33:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:20 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:33:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:20 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:33:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:20 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:20 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:20 smithi092 ceph-mon[134093]: Updating smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:33:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:20 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/711616782' entity='client.admin' 2023-10-08T12:33:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:20 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:20 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:20 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:20 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:20 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:33:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:20 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:33:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:20 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:33:21.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:20 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:21.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:20 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:21.718 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:21 smithi173 systemd[1]: Starting Ceph mgr.z for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:33:21.921 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:21 smithi059 ceph-mon[98489]: Deploying daemon mgr.z on smithi173 2023-10-08T12:33:21.921 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:21 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:21.921 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:21 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:22.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.463+0000 7fba96081700 1 -- 172.21.15.59:0/1482882199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba9010d300 msgr2=0x7fba9010f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.463+0000 7fba96081700 1 --2- 172.21.15.59:0/1482882199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba9010d300 0x7fba9010f6f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fba8800b0a0 tx=0x7fba8800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.464+0000 7fba96081700 1 -- 172.21.15.59:0/1482882199 shutdown_connections 2023-10-08T12:33:22.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.464+0000 7fba96081700 1 --2- 172.21.15.59:0/1482882199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba90068190 0x7fba90068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.464+0000 7fba96081700 1 --2- 172.21.15.59:0/1482882199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba9010d300 0x7fba9010f6f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.464+0000 7fba96081700 1 --2- 172.21.15.59:0/1482882199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba90068ab0 0x7fba9010cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.464+0000 7fba96081700 1 -- 172.21.15.59:0/1482882199 >> 172.21.15.59:0/1482882199 conn(0x7fba90075790 msgr2=0x7fba90075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:22.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.464+0000 7fba96081700 1 -- 172.21.15.59:0/1482882199 shutdown_connections 2023-10-08T12:33:22.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.464+0000 7fba96081700 1 -- 172.21.15.59:0/1482882199 wait complete. 2023-10-08T12:33:22.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.465+0000 7fba96081700 1 Processor -- start 2023-10-08T12:33:22.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.465+0000 7fba96081700 1 -- start start 2023-10-08T12:33:22.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.465+0000 7fba96081700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba90068190 0x7fba90198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.465+0000 7fba96081700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba90068ab0 0x7fba901993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.465+0000 7fba96081700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9010d300 0x7fba9019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.465+0000 7fba96081700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9019dd90 con 0x7fba90068ab0 2023-10-08T12:33:22.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.465+0000 7fba96081700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9019df00 con 0x7fba90068190 2023-10-08T12:33:22.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.465+0000 7fba96081700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9019e0c0 con 0x7fba9010d300 2023-10-08T12:33:22.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba90068ab0 0x7fba901993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9010d300 0x7fba9019d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9010d300 0x7fba9019d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56604/0 (socket says 172.21.15.59:56604) 2023-10-08T12:33:22.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8ffff700 1 -- 172.21.15.59:0/2521575018 learned_addr learned my addr 172.21.15.59:0/2521575018 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:22.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8f7fe700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba90068190 0x7fba90198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8ffff700 1 -- 172.21.15.59:0/2521575018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba90068190 msgr2=0x7fba90198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8ffff700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba90068190 0x7fba90198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8ffff700 1 -- 172.21.15.59:0/2521575018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba90068ab0 msgr2=0x7fba901993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8ffff700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba90068ab0 0x7fba901993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8ffff700 1 -- 172.21.15.59:0/2521575018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88009d00 con 0x7fba9010d300 2023-10-08T12:33:22.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8effd700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba90068ab0 0x7fba901993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:22.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8ffff700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9010d300 0x7fba9019d780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fba8800b070 tx=0x7fba880078c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:22.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8cff9700 1 -- 172.21.15.59:0/2521575018 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8800e040 con 0x7fba9010d300 2023-10-08T12:33:22.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8cff9700 1 -- 172.21.15.59:0/2521575018 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba8801d470 con 0x7fba9010d300 2023-10-08T12:33:22.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba96081700 1 -- 172.21.15.59:0/2521575018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9019e340 con 0x7fba9010d300 2023-10-08T12:33:22.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.466+0000 7fba8cff9700 1 -- 172.21.15.59:0/2521575018 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88003ea0 con 0x7fba9010d300 2023-10-08T12:33:22.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.467+0000 7fba96081700 1 -- 172.21.15.59:0/2521575018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba901a5c00 con 0x7fba9010d300 2023-10-08T12:33:22.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.467+0000 7fba96081700 1 -- 172.21.15.59:0/2521575018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba90108520 con 0x7fba9010d300 2023-10-08T12:33:22.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.468+0000 7fba8cff9700 1 -- 172.21.15.59:0/2521575018 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7fba88003a00 con 0x7fba9010d300 2023-10-08T12:33:22.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.468+0000 7fba8cff9700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fba78038b40 0x7fba7803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.468+0000 7fba8cff9700 1 -- 172.21.15.59:0/2521575018 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fba8804c8d0 con 0x7fba9010d300 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.468+0000 7fba8f7fe700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fba78038b40 0x7fba7803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.469+0000 7fba8f7fe700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fba78038b40 0x7fba7803b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fba80009bf0 tx=0x7fba80009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.473+0000 7fba8cff9700 1 -- 172.21.15.59:0/2521575018 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fba8801d850 con 0x7fba9010d300 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.700+0000 7fba96081700 1 -- 172.21.15.59:0/2521575018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7fba900ffcf0 con 0x7fba9010d300 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.705+0000 7fba8cff9700 1 -- 172.21.15.59:0/2521575018 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v14)=0 v14) v1 ==== 108+0+0 (secure 0 0 0) 0x7fba88011390 con 0x7fba9010d300 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 -- 172.21.15.59:0/2521575018 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fba78038b40 msgr2=0x7fba7803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fba78038b40 0x7fba7803b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fba80009bf0 tx=0x7fba80009260 comp rx=0 tx=0).stop 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 -- 172.21.15.59:0/2521575018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9010d300 msgr2=0x7fba9019d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9010d300 0x7fba9019d780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fba8800b070 tx=0x7fba880078c0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 -- 172.21.15.59:0/2521575018 shutdown_connections 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fba78038b40 0x7fba7803b000 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba90068190 0x7fba90198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9010d300 0x7fba9019d780 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 --2- 172.21.15.59:0/2521575018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba90068ab0 0x7fba901993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 -- 172.21.15.59:0/2521575018 >> 172.21.15.59:0/2521575018 conn(0x7fba90075790 msgr2=0x7fba9010e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:22.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 -- 172.21.15.59:0/2521575018 shutdown_connections 2023-10-08T12:33:22.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.708+0000 7fba96081700 1 -- 172.21.15.59:0/2521575018 wait complete. 2023-10-08T12:33:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.074+0000 7fd58c6b0700 1 -- 172.21.15.59:0/1927330784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd584072a20 msgr2=0x7fd584072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.074+0000 7fd58c6b0700 1 --2- 172.21.15.59:0/1927330784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd584072a20 0x7fd584072e00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd5800098f0 tx=0x7fd580009c00 comp rx=0 tx=0).stop 2023-10-08T12:33:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.075+0000 7fd58c6b0700 1 -- 172.21.15.59:0/1927330784 shutdown_connections 2023-10-08T12:33:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.075+0000 7fd58c6b0700 1 --2- 172.21.15.59:0/1927330784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd58410d250 0x7fd58410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.075+0000 7fd58c6b0700 1 --2- 172.21.15.59:0/1927330784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd584072a20 0x7fd584072e00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.075+0000 7fd58c6b0700 1 --2- 172.21.15.59:0/1927330784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd584073340 0x7fd58410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.075+0000 7fd58c6b0700 1 -- 172.21.15.59:0/1927330784 >> 172.21.15.59:0/1927330784 conn(0x7fd5840779e0 msgr2=0x7fd584077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.075+0000 7fd58c6b0700 1 -- 172.21.15.59:0/1927330784 shutdown_connections 2023-10-08T12:33:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.075+0000 7fd58c6b0700 1 -- 172.21.15.59:0/1927330784 wait complete. 2023-10-08T12:33:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.076+0000 7fd58c6b0700 1 Processor -- start 2023-10-08T12:33:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.076+0000 7fd58c6b0700 1 -- start start 2023-10-08T12:33:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.076+0000 7fd58c6b0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd584072a20 0x7fd584198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.076+0000 7fd58c6b0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584073340 0x7fd584199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.076+0000 7fd58c6b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd58410d250 0x7fd58419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.076+0000 7fd58c6b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58419dd10 con 0x7fd58410d250 2023-10-08T12:33:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.076+0000 7fd58c6b0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58419de80 con 0x7fd584073340 2023-10-08T12:33:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.076+0000 7fd58c6b0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58419e040 con 0x7fd584072a20 2023-10-08T12:33:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd58a44c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd584072a20 0x7fd584198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd58a44c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd584072a20 0x7fd584198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56628/0 (socket says 172.21.15.59:56628) 2023-10-08T12:33:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd58ac4d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd58410d250 0x7fd58419d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd58a44c700 1 -- 172.21.15.59:0/3766493105 learned_addr learned my addr 172.21.15.59:0/3766493105 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:22.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd589c4b700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584073340 0x7fd584199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd58a44c700 1 -- 172.21.15.59:0/3766493105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584073340 msgr2=0x7fd584199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd58a44c700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584073340 0x7fd584199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd58a44c700 1 -- 172.21.15.59:0/3766493105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd58410d250 msgr2=0x7fd58419d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd58a44c700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd58410d250 0x7fd58419d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd58a44c700 1 -- 172.21.15.59:0/3766493105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd580009520 con 0x7fd584072a20 2023-10-08T12:33:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd589c4b700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584073340 0x7fd584199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:33:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.077+0000 7fd58a44c700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd584072a20 0x7fd584198e10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd580009230 tx=0x7fd58000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.078+0000 7fd57b7fe700 1 -- 172.21.15.59:0/3766493105 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58001c070 con 0x7fd584072a20 2023-10-08T12:33:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.078+0000 7fd58c6b0700 1 -- 172.21.15.59:0/3766493105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58419e2c0 con 0x7fd584072a20 2023-10-08T12:33:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.078+0000 7fd58c6b0700 1 -- 172.21.15.59:0/3766493105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5841a5b80 con 0x7fd584072a20 2023-10-08T12:33:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.078+0000 7fd57b7fe700 1 -- 172.21.15.59:0/3766493105 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5800054e0 con 0x7fd584072a20 2023-10-08T12:33:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.078+0000 7fd57b7fe700 1 -- 172.21.15.59:0/3766493105 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580003a90 con 0x7fd584072a20 2023-10-08T12:33:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.079+0000 7fd57b7fe700 1 -- 172.21.15.59:0/3766493105 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7fd580003bf0 con 0x7fd584072a20 2023-10-08T12:33:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.079+0000 7fd58c6b0700 1 -- 172.21.15.59:0/3766493105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd584108460 con 0x7fd584072a20 2023-10-08T12:33:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.079+0000 7fd57b7fe700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd570038b40 0x7fd57003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.080+0000 7fd57b7fe700 1 -- 172.21.15.59:0/3766493105 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd58004d1d0 con 0x7fd584072a20 2023-10-08T12:33:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.080+0000 7fd589c4b700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd570038b40 0x7fd57003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.080+0000 7fd589c4b700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd570038b40 0x7fd57003b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd58419a370 tx=0x7fd574009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.085+0000 7fd57b7fe700 1 -- 172.21.15.59:0/3766493105 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd580028770 con 0x7fd584072a20 2023-10-08T12:33:22.116 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:22.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:21 smithi092 ceph-mon[134093]: Deploying daemon mgr.z on smithi173 2023-10-08T12:33:22.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:21 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:22.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:21 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:22.133 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.875+0000 7f8a97df6700 1 -- 172.21.15.59:0/687192018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a901057c0 msgr2=0x7f8a90105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.875+0000 7f8a97df6700 1 --2- 172.21.15.59:0/687192018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a901057c0 0x7f8a90105ba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009990 tx=0x7f8a8c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.875+0000 7f8a97df6700 1 -- 172.21.15.59:0/687192018 shutdown_connections 2023-10-08T12:33:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.875+0000 7f8a97df6700 1 --2- 172.21.15.59:0/687192018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a90101260 0x7f8a9010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.875+0000 7f8a97df6700 1 --2- 172.21.15.59:0/687192018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a901057c0 0x7f8a90105ba0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.875+0000 7f8a97df6700 1 --2- 172.21.15.59:0/687192018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a901008a0 0x7f8a90100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.875+0000 7f8a97df6700 1 -- 172.21.15.59:0/687192018 >> 172.21.15.59:0/687192018 conn(0x7f8a900779e0 msgr2=0x7f8a90077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.876+0000 7f8a97df6700 1 -- 172.21.15.59:0/687192018 shutdown_connections 2023-10-08T12:33:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.876+0000 7f8a97df6700 1 -- 172.21.15.59:0/687192018 wait complete. 2023-10-08T12:33:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a97df6700 1 Processor -- start 2023-10-08T12:33:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a97df6700 1 -- start start 2023-10-08T12:33:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a97df6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a901008a0 0x7f8a9019e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a97df6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a90101260 0x7f8a9019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a97df6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a901057c0 0x7f8a90198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a97df6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a90199170 con 0x7f8a90101260 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a97df6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a901992e0 con 0x7f8a901057c0 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a97df6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a901994a0 con 0x7f8a901008a0 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a95391700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a90101260 0x7f8a9019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a95b92700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a901008a0 0x7f8a9019e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a95b92700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a901008a0 0x7f8a9019e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56590/0 (socket says 172.21.15.59:56590) 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.877+0000 7f8a95b92700 1 -- 172.21.15.59:0/2894541423 learned_addr learned my addr 172.21.15.59:0/2894541423 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.878+0000 7f8a96393700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a901057c0 0x7f8a90198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.878+0000 7f8a95b92700 1 -- 172.21.15.59:0/2894541423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a901057c0 msgr2=0x7f8a90198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.878+0000 7f8a95b92700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a901057c0 0x7f8a90198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.878+0000 7f8a95b92700 1 -- 172.21.15.59:0/2894541423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a90101260 msgr2=0x7f8a9019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.878+0000 7f8a95b92700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a90101260 0x7f8a9019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.878+0000 7f8a95b92700 1 -- 172.21.15.59:0/2894541423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c0095f0 con 0x7f8a901008a0 2023-10-08T12:33:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.878+0000 7f8a95b92700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a901008a0 0x7f8a9019e9d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c005740 tx=0x7f8a8c005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.878+0000 7f8a86ffd700 1 -- 172.21.15.59:0/2894541423 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c01d070 con 0x7f8a901008a0 2023-10-08T12:33:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.878+0000 7f8a86ffd700 1 -- 172.21.15.59:0/2894541423 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(24 keys) v1 ==== 1043+0+0 (secure 0 0 0) 0x7f8a8c00bca0 con 0x7f8a901008a0 2023-10-08T12:33:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.878+0000 7f8a97df6700 1 -- 172.21.15.59:0/2894541423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a90199720 con 0x7f8a901008a0 2023-10-08T12:33:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.878+0000 7f8a86ffd700 1 -- 172.21.15.59:0/2894541423 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c022c50 con 0x7f8a901008a0 2023-10-08T12:33:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.879+0000 7f8a97df6700 1 -- 172.21.15.59:0/2894541423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a901a59c0 con 0x7f8a901008a0 2023-10-08T12:33:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.880+0000 7f8a86ffd700 1 -- 172.21.15.59:0/2894541423 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f8a8c00f460 con 0x7f8a901008a0 2023-10-08T12:33:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.880+0000 7f8a97df6700 1 -- 172.21.15.59:0/2894541423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a90101f30 con 0x7f8a901008a0 2023-10-08T12:33:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.880+0000 7f8a86ffd700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a7c038b40 0x7f8a7c03b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.880+0000 7f8a86ffd700 1 -- 172.21.15.59:0/2894541423 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f8a8c04ce20 con 0x7f8a901008a0 2023-10-08T12:33:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.882+0000 7f8a95391700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a7c038b40 0x7f8a7c03b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.882+0000 7f8a95391700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a7c038b40 0x7f8a7c03b000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8a90199cd0 tx=0x7f8a80009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:20.885+0000 7f8a86ffd700 1 -- 172.21.15.59:0/2894541423 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8a8c080100 con 0x7f8a901008a0 2023-10-08T12:33:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.117+0000 7f8a97df6700 1 -- 172.21.15.59:0/2894541423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f8a9004e4c0 con 0x7f8a901008a0 2023-10-08T12:33:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.122+0000 7f8a86ffd700 1 -- 172.21.15.59:0/2894541423 <== mon.1 v2:172.21.15.173:3300/0 7 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8a8c016990 con 0x7f8a901008a0 2023-10-08T12:33:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.122+0000 7f8a86ffd700 1 -- 172.21.15.59:0/2894541423 <== mon.1 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8a8c027020 con 0x7f8a901008a0 2023-10-08T12:33:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 -- 172.21.15.59:0/2894541423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a7c038b40 msgr2=0x7f8a7c03b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a7c038b40 0x7f8a7c03b000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8a90199cd0 tx=0x7f8a80009260 comp rx=0 tx=0).stop 2023-10-08T12:33:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 -- 172.21.15.59:0/2894541423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a901008a0 msgr2=0x7f8a9019e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a901008a0 0x7f8a9019e9d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c005740 tx=0x7f8a8c005770 comp rx=0 tx=0).stop 2023-10-08T12:33:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 -- 172.21.15.59:0/2894541423 shutdown_connections 2023-10-08T12:33:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a7c038b40 0x7f8a7c03b000 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a901057c0 0x7f8a90198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a901008a0 0x7f8a9019e9d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 --2- 172.21.15.59:0/2894541423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a90101260 0x7f8a9019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 -- 172.21.15.59:0/2894541423 >> 172.21.15.59:0/2894541423 conn(0x7f8a900779e0 msgr2=0x7f8a9010cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:22.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 -- 172.21.15.59:0/2894541423 shutdown_connections 2023-10-08T12:33:22.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:21.125+0000 7f8a97df6700 1 -- 172.21.15.59:0/2894541423 wait complete. 2023-10-08T12:33:22.180 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:21 smithi173 podman[138189]: 2023-10-08T12:33:22.180 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:21 smithi173 ceph-mon[135182]: Deploying daemon mgr.z on smithi173 2023-10-08T12:33:22.180 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:21 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:22.180 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:21 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:22.301 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:22.303 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:22.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.389+0000 7fd58c6b0700 1 -- 172.21.15.59:0/3766493105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7fd58404e4c0 con 0x7fd584072a20 2023-10-08T12:33:22.406 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:22.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.407+0000 7fd57b7fe700 1 -- 172.21.15.59:0/3766493105 <== mon.1 v2:172.21.15.173:3300/0 7 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd580020e70 con 0x7fd584072a20 2023-10-08T12:33:22.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.407+0000 7fd57b7fe700 1 -- 172.21.15.59:0/3766493105 <== mon.1 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd58001f350 con 0x7fd584072a20 2023-10-08T12:33:22.414 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:22.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.419+0000 7fd58c6b0700 1 -- 172.21.15.59:0/3766493105 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd570038b40 msgr2=0x7fd57003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.419+0000 7fd58c6b0700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd570038b40 0x7fd57003b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd58419a370 tx=0x7fd574009260 comp rx=0 tx=0).stop 2023-10-08T12:33:22.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.419+0000 7fd58c6b0700 1 -- 172.21.15.59:0/3766493105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd584072a20 msgr2=0x7fd584198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:22.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.419+0000 7fd58c6b0700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd584072a20 0x7fd584198e10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd580009230 tx=0x7fd58000fa00 comp rx=0 tx=0).stop 2023-10-08T12:33:22.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.419+0000 7fd58c6b0700 1 -- 172.21.15.59:0/3766493105 shutdown_connections 2023-10-08T12:33:22.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.419+0000 7fd58c6b0700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd570038b40 0x7fd57003b000 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd58419a370 tx=0x7fd574009260 comp rx=0 tx=0).stop 2023-10-08T12:33:22.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.419+0000 7fd58c6b0700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd58410d250 0x7fd58419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.419+0000 7fd58c6b0700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd584072a20 0x7fd584198e10 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd580009230 tx=0x7fd58000fa00 comp rx=0 tx=0).stop 2023-10-08T12:33:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.419+0000 7fd58c6b0700 1 --2- 172.21.15.59:0/3766493105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584073340 0x7fd584199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:22.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.419+0000 7fd58c6b0700 1 -- 172.21.15.59:0/3766493105 >> 172.21.15.59:0/3766493105 conn(0x7fd5840779e0 msgr2=0x7fd5840fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:22.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.427+0000 7fd58c6b0700 1 -- 172.21.15.59:0/3766493105 shutdown_connections 2023-10-08T12:33:22.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.427+0000 7fd58c6b0700 1 -- 172.21.15.59:0/3766493105 wait complete. 2023-10-08T12:33:22.467 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:22 smithi173 ceph-mgr[138229]: -- 172.21.15.173:0/778098551 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a5fedf31e0 con 0x55a5fedc8c00 2023-10-08T12:33:22.467 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:22 smithi173 bash[138189]: 967eb75d653ae7712dc4f95ab032fa22372907fdb0b4bb41d18f4f57114bf3ca 2023-10-08T12:33:22.468 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:22 smithi173 systemd[1]: Started Ceph mgr.z for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:33:22.468 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:22.316+0000 7f6bda3dc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:33:22.468 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:22.394+0000 7f6bda3dc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:33:22.747 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:22.483+0000 7f6bda3dc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:33:22.747 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:22.576+0000 7f6bda3dc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:33:22.747 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:22.746+0000 7f6bda3dc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:33:23.428 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:23.111+0000 7f6bda3dc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:33:23.429 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:23.245+0000 7f6bda3dc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:33:23.429 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:23.334+0000 7f6bda3dc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:33:23.429 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:23.428+0000 7f6bda3dc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:33:23.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:23.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:23.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:23.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:33:23.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:33:23.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:33:23.430 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:23.430 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-mon[135182]: Deploying daemon mgr.y on smithi092 2023-10-08T12:33:23.430 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:23.430 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:23.430 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/46255736' entity='client.admin' 2023-10-08T12:33:23.559 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:23 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:23.559 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:23 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:23.560 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:23 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:23.560 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:23 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:33:23.560 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:23 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:33:23.560 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:23 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:33:23.560 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:23 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:23.560 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:23 smithi092 ceph-mon[134093]: Deploying daemon mgr.y on smithi092 2023-10-08T12:33:23.560 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:23 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:23.560 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:23 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:23.560 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:23 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/46255736' entity='client.admin' 2023-10-08T12:33:23.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:23 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:23 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:23 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:23 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:33:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:23 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:33:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:23 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:33:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:23 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:23 smithi059 ceph-mon[98489]: Deploying daemon mgr.y on smithi092 2023-10-08T12:33:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:23 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:23 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:23 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/46255736' entity='client.admin' 2023-10-08T12:33:23.877 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:23 smithi092 systemd[1]: Starting Ceph mgr.y for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:33:23.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.791+0000 7f33acb91700 1 -- 172.21.15.59:0/1710557305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33a8073340 msgr2=0x7f33a810cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:23.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.791+0000 7f33acb91700 1 --2- 172.21.15.59:0/1710557305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33a8073340 0x7f33a810cd10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f339c0098f0 tx=0x7f339c009c00 comp rx=0 tx=0).stop 2023-10-08T12:33:23.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.791+0000 7f33acb91700 1 -- 172.21.15.59:0/1710557305 shutdown_connections 2023-10-08T12:33:23.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.791+0000 7f33acb91700 1 --2- 172.21.15.59:0/1710557305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a810d250 0x7f33a810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:23.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.791+0000 7f33acb91700 1 --2- 172.21.15.59:0/1710557305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a8072a20 0x7f33a8072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:23.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.791+0000 7f33acb91700 1 --2- 172.21.15.59:0/1710557305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33a8073340 0x7f33a810cd10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.791+0000 7f33acb91700 1 -- 172.21.15.59:0/1710557305 >> 172.21.15.59:0/1710557305 conn(0x7f33a80779e0 msgr2=0x7f33a8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.792+0000 7f33acb91700 1 -- 172.21.15.59:0/1710557305 shutdown_connections 2023-10-08T12:33:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.792+0000 7f33acb91700 1 -- 172.21.15.59:0/1710557305 wait complete. 2023-10-08T12:33:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.792+0000 7f33acb91700 1 Processor -- start 2023-10-08T12:33:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.793+0000 7f33acb91700 1 -- start start 2023-10-08T12:33:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.793+0000 7f33acb91700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a8072a20 0x7f33a8199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.793+0000 7f33acb91700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33a8073340 0x7f33a8199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.793+0000 7f33acb91700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a810d250 0x7f33a819d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.793+0000 7f33acb91700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a819df10 con 0x7f33a8073340 2023-10-08T12:33:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.793+0000 7f33acb91700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a819e080 con 0x7f33a810d250 2023-10-08T12:33:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.793+0000 7f33acb91700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a819e240 con 0x7f33a8072a20 2023-10-08T12:33:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.793+0000 7f33a5d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33a8073340 0x7f33a8199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.793+0000 7f33a659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a8072a20 0x7f33a8199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.793+0000 7f33a5d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33a8073340 0x7f33a8199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34202/0 (socket says 172.21.15.59:34202) 2023-10-08T12:33:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.793+0000 7f33a5d9b700 1 -- 172.21.15.59:0/46255736 learned_addr learned my addr 172.21.15.59:0/46255736 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33a6d9d700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a810d250 0x7f33a819d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33a5d9b700 1 -- 172.21.15.59:0/46255736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a8072a20 msgr2=0x7f33a8199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33a5d9b700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a8072a20 0x7f33a8199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33a5d9b700 1 -- 172.21.15.59:0/46255736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a810d250 msgr2=0x7f33a819d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33a5d9b700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a810d250 0x7f33a819d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33a5d9b700 1 -- 172.21.15.59:0/46255736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980095f0 con 0x7f33a8073340 2023-10-08T12:33:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33a659c700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a8072a20 0x7f33a8199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33a5d9b700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33a8073340 0x7f33a8199550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f339c005950 tx=0x7f339c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33977fe700 1 -- 172.21.15.59:0/46255736 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c01c070 con 0x7f33a8073340 2023-10-08T12:33:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33977fe700 1 -- 172.21.15.59:0/46255736 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f339c00bb20 con 0x7f33a8073340 2023-10-08T12:33:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33acb91700 1 -- 172.21.15.59:0/46255736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c009520 con 0x7f33a8073340 2023-10-08T12:33:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.794+0000 7f33977fe700 1 -- 172.21.15.59:0/46255736 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c0038e0 con 0x7f33a8073340 2023-10-08T12:33:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.795+0000 7f33acb91700 1 -- 172.21.15.59:0/46255736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a819e740 con 0x7f33a8073340 2023-10-08T12:33:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.796+0000 7f33977fe700 1 -- 172.21.15.59:0/46255736 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f339c020030 con 0x7f33a8073340 2023-10-08T12:33:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.796+0000 7f33acb91700 1 -- 172.21.15.59:0/46255736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a8108460 con 0x7f33a8073340 2023-10-08T12:33:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.796+0000 7f33977fe700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3390038b40 0x7f339003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.796+0000 7f33977fe700 1 -- 172.21.15.59:0/46255736 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f339c04c760 con 0x7f33a8073340 2023-10-08T12:33:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.796+0000 7f33a659c700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3390038b40 0x7f339003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.797+0000 7f33a659c700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3390038b40 0x7f339003b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3398005fd0 tx=0x7f3398009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.801+0000 7f33977fe700 1 -- 172.21.15.59:0/46255736 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f339c021560 con 0x7f33a8073340 2023-10-08T12:33:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.029+0000 7f33acb91700 1 -- 172.21.15.59:0/46255736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7f33a80740b0 con 0x7f33a8073340 2023-10-08T12:33:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.032+0000 7f33977fe700 1 -- 172.21.15.59:0/46255736 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v17)=0 v17) v1 ==== 117+0+0 (secure 0 0 0) 0x7f339c00e3e0 con 0x7f33a8073340 2023-10-08T12:33:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 -- 172.21.15.59:0/46255736 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3390038b40 msgr2=0x7f339003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3390038b40 0x7f339003b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3398005fd0 tx=0x7f3398009310 comp rx=0 tx=0).stop 2023-10-08T12:33:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 -- 172.21.15.59:0/46255736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33a8073340 msgr2=0x7f33a8199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33a8073340 0x7f33a8199550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f339c005950 tx=0x7f339c00fa00 comp rx=0 tx=0).stop 2023-10-08T12:33:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 -- 172.21.15.59:0/46255736 shutdown_connections 2023-10-08T12:33:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3390038b40 0x7f339003b000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a810d250 0x7f33a819d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a8072a20 0x7f33a8199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 --2- 172.21.15.59:0/46255736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33a8073340 0x7f33a8199550 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 -- 172.21.15.59:0/46255736 >> 172.21.15.59:0/46255736 conn(0x7f33a80779e0 msgr2=0x7f33a80feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 -- 172.21.15.59:0/46255736 shutdown_connections 2023-10-08T12:33:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:23.035+0000 7f33acb91700 1 -- 172.21.15.59:0/46255736 wait complete. 2023-10-08T12:33:24.217 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:23.849+0000 7f6bda3dc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:33:24.359 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:24 smithi092 podman[136415]: 2023-10-08T12:33:24.359 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:24 smithi092 bash[136415]: 44948e4c2dae11b61629f9b8428e61075ac57fab2bf0809f46d981c0a695c4ff 2023-10-08T12:33:24.359 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:24 smithi092 ceph-mgr[136455]: -- 172.21.15.92:0/3191256522 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56552c36d1e0 con 0x56552c342800 2023-10-08T12:33:24.610 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:24 smithi092 systemd[1]: Started Ceph mgr.y for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:33:24.610 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:24.439+0000 7f5576d7e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:33:24.610 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:24.519+0000 7f5576d7e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:33:24.611 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:24.609+0000 7f5576d7e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:33:24.877 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:24.707+0000 7f5576d7e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:33:24.967 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:24 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:24.515+0000 7f6bda3dc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:33:24.967 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:24 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:24.596+0000 7f6bda3dc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:33:25.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.694+0000 7fe9a2c94700 1 -- 172.21.15.59:0/4279615330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c1067c0 msgr2=0x7fe99c106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:25.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.694+0000 7fe9a2c94700 1 --2- 172.21.15.59:0/4279615330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c1067c0 0x7fe99c106ba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe9900098f0 tx=0x7fe990009c00 comp rx=0 tx=0).stop 2023-10-08T12:33:25.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.694+0000 7fe9a2c94700 1 -- 172.21.15.59:0/4279615330 shutdown_connections 2023-10-08T12:33:25.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.694+0000 7fe9a2c94700 1 --2- 172.21.15.59:0/4279615330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe99c068b30 0x7fe99c10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:25.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.694+0000 7fe9a2c94700 1 --2- 172.21.15.59:0/4279615330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c1067c0 0x7fe99c106ba0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:25.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.694+0000 7fe9a2c94700 1 --2- 172.21.15.59:0/4279615330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe99c068190 0x7fe99c0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.694+0000 7fe9a2c94700 1 -- 172.21.15.59:0/4279615330 >> 172.21.15.59:0/4279615330 conn(0x7fe99c075790 msgr2=0x7fe99c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.694+0000 7fe9a2c94700 1 -- 172.21.15.59:0/4279615330 shutdown_connections 2023-10-08T12:33:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.694+0000 7fe9a2c94700 1 -- 172.21.15.59:0/4279615330 wait complete. 2023-10-08T12:33:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.695+0000 7fe9a2c94700 1 Processor -- start 2023-10-08T12:33:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe9a2c94700 1 -- start start 2023-10-08T12:33:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe9a2c94700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe99c068190 0x7fe99c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe9a2c94700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe99c068b30 0x7fe99c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe9a2c94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c1067c0 0x7fe99c19d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe9a2c94700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c19ddb0 con 0x7fe99c1067c0 2023-10-08T12:33:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe9a2c94700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c19df20 con 0x7fe99c068190 2023-10-08T12:33:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe9a2c94700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c19e0e0 con 0x7fe99c068b30 2023-10-08T12:33:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe9a0a30700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe99c068190 0x7fe99c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe99bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe99c068b30 0x7fe99c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe9a0a30700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe99c068190 0x7fe99c198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54066/0 (socket says 172.21.15.59:54066) 2023-10-08T12:33:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe9a0a30700 1 -- 172.21.15.59:0/2733815758 learned_addr learned my addr 172.21.15.59:0/2733815758 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.696+0000 7fe9a1231700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c1067c0 0x7fe99c19d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.697+0000 7fe9a0a30700 1 -- 172.21.15.59:0/2733815758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe99c068b30 msgr2=0x7fe99c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.697+0000 7fe9a0a30700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe99c068b30 0x7fe99c1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.697+0000 7fe9a0a30700 1 -- 172.21.15.59:0/2733815758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c1067c0 msgr2=0x7fe99c19d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.697+0000 7fe9a0a30700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c1067c0 0x7fe99c19d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.697+0000 7fe9a0a30700 1 -- 172.21.15.59:0/2733815758 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe990009520 con 0x7fe99c068190 2023-10-08T12:33:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.697+0000 7fe9a0a30700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe99c068190 0x7fe99c198eb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe990005950 tx=0x7fe990010ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.697+0000 7fe999ffb700 1 -- 172.21.15.59:0/2733815758 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99001c070 con 0x7fe99c068190 2023-10-08T12:33:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.697+0000 7fe999ffb700 1 -- 172.21.15.59:0/2733815758 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe99000bba0 con 0x7fe99c068190 2023-10-08T12:33:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.697+0000 7fe999ffb700 1 -- 172.21.15.59:0/2733815758 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990003a00 con 0x7fe99c068190 2023-10-08T12:33:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.697+0000 7fe9a2c94700 1 -- 172.21.15.59:0/2733815758 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c19e360 con 0x7fe99c068190 2023-10-08T12:33:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.698+0000 7fe9a2c94700 1 -- 172.21.15.59:0/2733815758 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c1a5a50 con 0x7fe99c068190 2023-10-08T12:33:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.698+0000 7fe999ffb700 1 -- 172.21.15.59:0/2733815758 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7fe990020030 con 0x7fe99c068190 2023-10-08T12:33:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.699+0000 7fe9a2c94700 1 -- 172.21.15.59:0/2733815758 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c0fed60 con 0x7fe99c068190 2023-10-08T12:33:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.699+0000 7fe999ffb700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe98c038b40 0x7fe98c03b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.699+0000 7fe999ffb700 1 -- 172.21.15.59:0/2733815758 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe99004c470 con 0x7fe99c068190 2023-10-08T12:33:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.699+0000 7fe99bfff700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe98c038b40 0x7fe98c03b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.700+0000 7fe99bfff700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe98c038b40 0x7fe98c03b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe99c19a410 tx=0x7fe988009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.705+0000 7fe999ffb700 1 -- 172.21.15.59:0/2733815758 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe990003b60 con 0x7fe99c068190 2023-10-08T12:33:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.921+0000 7fe9a2c94700 1 -- 172.21.15.59:0/2733815758 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7fe99c19a1c0 con 0x7fe99c068190 2023-10-08T12:33:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.926+0000 7fe999ffb700 1 -- 172.21.15.59:0/2733815758 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) v1 ==== 106+0+0 (secure 0 0 0) 0x7fe99000ebd0 con 0x7fe99c068190 2023-10-08T12:33:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 -- 172.21.15.59:0/2733815758 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe98c038b40 msgr2=0x7fe98c03b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe98c038b40 0x7fe98c03b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe99c19a410 tx=0x7fe988009310 comp rx=0 tx=0).stop 2023-10-08T12:33:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 -- 172.21.15.59:0/2733815758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe99c068190 msgr2=0x7fe99c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe99c068190 0x7fe99c198eb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe990005950 tx=0x7fe990010ff0 comp rx=0 tx=0).stop 2023-10-08T12:33:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 -- 172.21.15.59:0/2733815758 shutdown_connections 2023-10-08T12:33:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe98c038b40 0x7fe98c03b000 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe99c068190 0x7fe99c198eb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99c1067c0 0x7fe99c19d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 --2- 172.21.15.59:0/2733815758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe99c068b30 0x7fe99c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 -- 172.21.15.59:0/2733815758 >> 172.21.15.59:0/2733815758 conn(0x7fe99c075790 msgr2=0x7fe99c10bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 -- 172.21.15.59:0/2733815758 shutdown_connections 2023-10-08T12:33:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:22.929+0000 7fe9a2c94700 1 -- 172.21.15.59:0/2733815758 wait complete. 2023-10-08T12:33:25.267 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:24.885+0000 7f5576d7e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:33:25.267 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:25.265+0000 7f5576d7e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:33:25.595 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:25.400+0000 7f5576d7e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:33:25.595 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:25.498+0000 7f5576d7e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:33:25.595 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.595 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.595 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.595 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.595 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:25.690 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:25 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:25.414+0000 7f6bda3dc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:33:25.690 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:25 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:25.512+0000 7f6bda3dc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:33:25.690 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.691 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.691 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.691 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.691 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:25.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:25.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:25.876 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:25.593+0000 7f5576d7e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:33:25.967 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:25 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:25.689+0000 7f6bda3dc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:33:26.376 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:26.039+0000 7f5576d7e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:33:26.380 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:25 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:25.995+0000 7f6bda3dc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:33:26.380 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:26.230+0000 7f6bda3dc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:33:26.648 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:26.379+0000 7f6bda3dc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:33:26.792 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi059') 2023-10-08T12:33:26.792 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi059') 2023-10-08T12:33:26.793 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi059') 2023-10-08T12:33:26.793 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi059') 2023-10-08T12:33:26.793 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi059') 2023-10-08T12:33:26.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.865+0000 7fb2e765c700 1 -- 172.21.15.59:0/3276603518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0074770 msgr2=0x7fb2e0072a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:26.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.865+0000 7fb2e765c700 1 --2- 172.21.15.59:0/3276603518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0074770 0x7fb2e0072a20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009990 tx=0x7fb2dc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:33:26.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.865+0000 7fb2e765c700 1 -- 172.21.15.59:0/3276603518 shutdown_connections 2023-10-08T12:33:26.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.865+0000 7fb2e765c700 1 --2- 172.21.15.59:0/3276603518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0074770 0x7fb2e0072a20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:26.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.865+0000 7fb2e765c700 1 --2- 172.21.15.59:0/3276603518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e0111570 0x7fb2e01139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:26.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.865+0000 7fb2e765c700 1 --2- 172.21.15.59:0/3276603518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e0072f60 0x7fb2e00733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:26.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.865+0000 7fb2e765c700 1 -- 172.21.15.59:0/3276603518 >> 172.21.15.59:0/3276603518 conn(0x7fb2e00779e0 msgr2=0x7fb2e0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:26.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.865+0000 7fb2e765c700 1 -- 172.21.15.59:0/3276603518 shutdown_connections 2023-10-08T12:33:26.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.865+0000 7fb2e765c700 1 -- 172.21.15.59:0/3276603518 wait complete. 2023-10-08T12:33:26.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.867+0000 7fb2e765c700 1 Processor -- start 2023-10-08T12:33:26.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.867+0000 7fb2e765c700 1 -- start start 2023-10-08T12:33:26.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.868+0000 7fb2e765c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e0072f60 0x7fb2e019d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:26.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.868+0000 7fb2e765c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e0074770 0x7fb2e019d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:26.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.868+0000 7fb2e765c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0111570 0x7fb2e01a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:26.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.868+0000 7fb2e765c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e01a21b0 con 0x7fb2e0072f60 2023-10-08T12:33:26.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.868+0000 7fb2e765c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e01a2320 con 0x7fb2e0111570 2023-10-08T12:33:26.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.868+0000 7fb2e765c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e01a24e0 con 0x7fb2e0074770 2023-10-08T12:33:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.868+0000 7fb2e4bf7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e0074770 0x7fb2e019d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.868+0000 7fb2e4bf7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e0074770 0x7fb2e019d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56690/0 (socket says 172.21.15.59:56690) 2023-10-08T12:33:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.868+0000 7fb2e4bf7700 1 -- 172.21.15.59:0/741515040 learned_addr learned my addr 172.21.15.59:0/741515040 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.868+0000 7fb2e5bf9700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0111570 0x7fb2e01a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.869+0000 7fb2e5bf9700 1 -- 172.21.15.59:0/741515040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e0074770 msgr2=0x7fb2e019d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.869+0000 7fb2e5bf9700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e0074770 0x7fb2e019d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.869+0000 7fb2e5bf9700 1 -- 172.21.15.59:0/741515040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e0072f60 msgr2=0x7fb2e019d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.869+0000 7fb2e5bf9700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e0072f60 0x7fb2e019d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.869+0000 7fb2e5bf9700 1 -- 172.21.15.59:0/741515040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc0095f0 con 0x7fb2e0111570 2023-10-08T12:33:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.869+0000 7fb2e4bf7700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e0074770 0x7fb2e019d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.869+0000 7fb2e5bf9700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0111570 0x7fb2e01a1ba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800ef90 tx=0x7fb2d800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.869+0000 7fb2d67fc700 1 -- 172.21.15.59:0/741515040 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8018070 con 0x7fb2e0111570 2023-10-08T12:33:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.869+0000 7fb2d67fc700 1 -- 172.21.15.59:0/741515040 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2d800f040 con 0x7fb2e0111570 2023-10-08T12:33:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.869+0000 7fb2d67fc700 1 -- 172.21.15.59:0/741515040 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800cc30 con 0x7fb2e0111570 2023-10-08T12:33:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.869+0000 7fb2e765c700 1 -- 172.21.15.59:0/741515040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e01a2760 con 0x7fb2e0111570 2023-10-08T12:33:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.870+0000 7fb2e765c700 1 -- 172.21.15.59:0/741515040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e01aa020 con 0x7fb2e0111570 2023-10-08T12:33:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.871+0000 7fb2e765c700 1 -- 172.21.15.59:0/741515040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e00740b0 con 0x7fb2e0111570 2023-10-08T12:33:26.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.872+0000 7fb2d67fc700 1 -- 172.21.15.59:0/741515040 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7fb2d8003a00 con 0x7fb2e0111570 2023-10-08T12:33:26.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.873+0000 7fb2d67fc700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2cc038b40 0x7fb2cc03b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:26.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.873+0000 7fb2d67fc700 1 -- 172.21.15.59:0/741515040 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb2d804b210 con 0x7fb2e0111570 2023-10-08T12:33:26.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.874+0000 7fb2e53f8700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2cc038b40 0x7fb2cc03b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:26.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.874+0000 7fb2e53f8700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2cc038b40 0x7fb2cc03b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0098e0 tx=0x7fb2dc005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:26.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:26.877+0000 7fb2d67fc700 1 -- 172.21.15.59:0/741515040 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb2d80092e0 con 0x7fb2e0111570 2023-10-08T12:33:26.967 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:26.648+0000 7f6bda3dc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:33:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:33:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:33:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:27.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:33:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:33:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:27.056 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:27.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.110+0000 7fb2e765c700 1 -- 172.21.15.59:0/741515040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7fb2e019e5c0 con 0x7fb2e0111570 2023-10-08T12:33:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.117+0000 7fb2d67fc700 1 -- 172.21.15.59:0/741515040 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v18)=0 v18) v1 ==== 116+0+0 (secure 0 0 0) 0x7fb2d801dc00 con 0x7fb2e0111570 2023-10-08T12:33:27.126 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:26.710+0000 7f5576d7e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:33:27.127 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:26.792+0000 7f5576d7e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:33:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:33:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:33:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:27.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 -- 172.21.15.59:0/741515040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2cc038b40 msgr2=0x7fb2cc03b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:27.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2cc038b40 0x7fb2cc03b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0098e0 tx=0x7fb2dc005fb0 comp rx=0 tx=0).stop 2023-10-08T12:33:27.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 -- 172.21.15.59:0/741515040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0111570 msgr2=0x7fb2e01a1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:27.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0111570 0x7fb2e01a1ba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800ef90 tx=0x7fb2d800c3a0 comp rx=0 tx=0).stop 2023-10-08T12:33:27.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 -- 172.21.15.59:0/741515040 shutdown_connections 2023-10-08T12:33:27.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2cc038b40 0x7fb2cc03b000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:27.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0111570 0x7fb2e01a1ba0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:27.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e0072f60 0x7fb2e019d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:27.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 --2- 172.21.15.59:0/741515040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e0074770 0x7fb2e019d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:27.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 -- 172.21.15.59:0/741515040 >> 172.21.15.59:0/741515040 conn(0x7fb2e00779e0 msgr2=0x7fb2e0110100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:27.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 -- 172.21.15.59:0/741515040 shutdown_connections 2023-10-08T12:33:27.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:27.124+0000 7fb2e765c700 1 -- 172.21.15.59:0/741515040 wait complete. 2023-10-08T12:33:27.197 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi059') 2023-10-08T12:33:27.197 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi059') 2023-10-08T12:33:27.671 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:27.350+0000 7f6bda3dc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:33:27.671 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:27.480+0000 7f6bda3dc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:33:27.827 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:27 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:27.560+0000 7f5576d7e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:33:27.827 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:27 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:27.651+0000 7f5576d7e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:33:27.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:27 smithi092 ceph-mon[134093]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T12:33:27.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:27 smithi092 ceph-mon[134093]: Reconfiguring daemon mgr.x on smithi059 2023-10-08T12:33:27.827 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:27 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:27.967 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:27.671+0000 7f6bda3dc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:33:27.968 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:27.784+0000 7f6bda3dc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:33:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:27 smithi173 ceph-mon[135182]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T12:33:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:27 smithi173 ceph-mon[135182]: Reconfiguring daemon mgr.x on smithi059 2023-10-08T12:33:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:27 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:28.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:27 smithi059 ceph-mon[98489]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T12:33:28.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:27 smithi059 ceph-mon[98489]: Reconfiguring daemon mgr.x on smithi059 2023-10-08T12:33:28.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:27 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:28.106 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:27 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:27.825+0000 7f5576d7e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:33:28.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi059') 2023-10-08T12:33:28.377 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:28 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:28.105+0000 7f5576d7e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:33:28.377 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:28 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:28.329+0000 7f5576d7e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:33:28.467 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:28 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:28.001+0000 7f6bda3dc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:33:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:28.741 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:28 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:28.477+0000 7f5576d7e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:33:29.126 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:28 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:28.741+0000 7f5576d7e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:33:29.217 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 12:33:28 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z[138205]: 2023-10-08T12:33:28.859+0000 7f6bda3dc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:33:29.707 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:29 smithi059 ceph-mon[98489]: Standby manager daemon z started 2023-10-08T12:33:29.707 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:29 smithi059 ceph-mon[98489]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T12:33:29.707 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:29 smithi059 ceph-mon[98489]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:33:29.707 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:29 smithi059 ceph-mon[98489]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T12:33:29.707 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:29 smithi059 ceph-mon[98489]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:33:29.708 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:29 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3905834421' entity='client.admin' 2023-10-08T12:33:29.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.897+0000 7f2c2c775700 1 -- 172.21.15.59:0/4240627841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c241008a0 msgr2=0x7f2c24100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:29.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.897+0000 7f2c2c775700 1 --2- 172.21.15.59:0/4240627841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c241008a0 0x7f2c24100d20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009990 tx=0x7f2c14009ca0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.897+0000 7f2c2c775700 1 -- 172.21.15.59:0/4240627841 shutdown_connections 2023-10-08T12:33:29.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.897+0000 7f2c2c775700 1 --2- 172.21.15.59:0/4240627841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c24101260 0x7f2c2410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.897+0000 7f2c2c775700 1 --2- 172.21.15.59:0/4240627841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c241057c0 0x7f2c24105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.897+0000 7f2c2c775700 1 --2- 172.21.15.59:0/4240627841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c241008a0 0x7f2c24100d20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.897+0000 7f2c2c775700 1 -- 172.21.15.59:0/4240627841 >> 172.21.15.59:0/4240627841 conn(0x7f2c240779e0 msgr2=0x7f2c24077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:29.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.898+0000 7f2c2c775700 1 -- 172.21.15.59:0/4240627841 shutdown_connections 2023-10-08T12:33:29.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.898+0000 7f2c2c775700 1 -- 172.21.15.59:0/4240627841 wait complete. 2023-10-08T12:33:29.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.899+0000 7f2c2c775700 1 Processor -- start 2023-10-08T12:33:29.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.899+0000 7f2c2c775700 1 -- start start 2023-10-08T12:33:29.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.899+0000 7f2c2c775700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c241008a0 0x7f2c24072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:29.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.899+0000 7f2c2c775700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c24101260 0x7f2c24073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:29.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.899+0000 7f2c2c775700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c241057c0 0x7f2c24073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:29.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.899+0000 7f2c2c775700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c24074ab0 con 0x7f2c241008a0 2023-10-08T12:33:29.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.899+0000 7f2c2c775700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2419ad70 con 0x7f2c24101260 2023-10-08T12:33:29.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.899+0000 7f2c2c775700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2419af30 con 0x7f2c241057c0 2023-10-08T12:33:29.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.899+0000 7f2c2a511700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c241008a0 0x7f2c24072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:29.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.899+0000 7f2c2a511700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c241008a0 0x7f2c24072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34226/0 (socket says 172.21.15.59:34226) 2023-10-08T12:33:29.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.899+0000 7f2c2a511700 1 -- 172.21.15.59:0/3905834421 learned_addr learned my addr 172.21.15.59:0/3905834421 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:29.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c2ad12700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c241057c0 0x7f2c24073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:29.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c29d10700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c24101260 0x7f2c24073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:29.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c2a511700 1 -- 172.21.15.59:0/3905834421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c241057c0 msgr2=0x7f2c24073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:29.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c2a511700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c241057c0 0x7f2c24073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c2a511700 1 -- 172.21.15.59:0/3905834421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c24101260 msgr2=0x7f2c24073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:29.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c2a511700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c24101260 0x7f2c24073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c2a511700 1 -- 172.21.15.59:0/3905834421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140095f0 con 0x7f2c241008a0 2023-10-08T12:33:29.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c2ad12700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c241057c0 0x7f2c24073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:29.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c2a511700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c241008a0 0x7f2c24072af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000c990 tx=0x7f2c2000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:29.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c1b7fe700 1 -- 172.21.15.59:0/3905834421 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20007940 con 0x7f2c241008a0 2023-10-08T12:33:29.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c1b7fe700 1 -- 172.21.15.59:0/3905834421 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c2000f450 con 0x7f2c241008a0 2023-10-08T12:33:29.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.900+0000 7f2c2c775700 1 -- 172.21.15.59:0/3905834421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2419b210 con 0x7f2c241008a0 2023-10-08T12:33:29.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.901+0000 7f2c1b7fe700 1 -- 172.21.15.59:0/3905834421 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20018660 con 0x7f2c241008a0 2023-10-08T12:33:29.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.901+0000 7f2c2c775700 1 -- 172.21.15.59:0/3905834421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2419b6e0 con 0x7f2c241008a0 2023-10-08T12:33:29.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.902+0000 7f2c1b7fe700 1 -- 172.21.15.59:0/3905834421 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f2c2000f8c0 con 0x7f2c241008a0 2023-10-08T12:33:29.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.902+0000 7f2c2c775700 1 -- 172.21.15.59:0/3905834421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c24108da0 con 0x7f2c241008a0 2023-10-08T12:33:29.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.903+0000 7f2c1b7fe700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c10038b80 0x7f2c1003b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:29.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.903+0000 7f2c1b7fe700 1 -- 172.21.15.59:0/3905834421 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f2c2004b2d0 con 0x7f2c241008a0 2023-10-08T12:33:29.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.903+0000 7f2c29d10700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c10038b80 0x7f2c1003b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:29.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.904+0000 7f2c29d10700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c10038b80 0x7f2c1003b040 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c24074360 tx=0x7f2c14005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:29.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:28.908+0000 7f2c1b7fe700 1 -- 172.21.15.59:0/3905834421 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2c2001f710 con 0x7f2c241008a0 2023-10-08T12:33:29.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.123+0000 7f2c2c775700 1 -- 172.21.15.59:0/3905834421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7f2c24073fd0 con 0x7f2c241008a0 2023-10-08T12:33:29.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.127+0000 7f2c1b7fe700 1 -- 172.21.15.59:0/3905834421 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v19)=0 v19) v1 ==== 127+0+0 (secure 0 0 0) 0x7f2c2000e3b0 con 0x7f2c241008a0 2023-10-08T12:33:29.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 -- 172.21.15.59:0/3905834421 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c10038b80 msgr2=0x7f2c1003b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:29.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c10038b80 0x7f2c1003b040 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c24074360 tx=0x7f2c14005fb0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 -- 172.21.15.59:0/3905834421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c241008a0 msgr2=0x7f2c24072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:29.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c241008a0 0x7f2c24072af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000c990 tx=0x7f2c2000cca0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 -- 172.21.15.59:0/3905834421 shutdown_connections 2023-10-08T12:33:29.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c10038b80 0x7f2c1003b040 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c241057c0 0x7f2c24073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c241008a0 0x7f2c24072af0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 --2- 172.21.15.59:0/3905834421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c24101260 0x7f2c24073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:29.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 -- 172.21.15.59:0/3905834421 >> 172.21.15.59:0/3905834421 conn(0x7f2c240779e0 msgr2=0x7f2c240fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:29.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 -- 172.21.15.59:0/3905834421 shutdown_connections 2023-10-08T12:33:29.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.129+0000 7f2c2c775700 1 -- 172.21.15.59:0/3905834421 wait complete. 2023-10-08T12:33:29.770 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:29 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:29.442+0000 7f5576d7e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:33:29.771 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:29 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:29.575+0000 7f5576d7e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:33:29.771 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:29 smithi092 ceph-mon[134093]: Standby manager daemon z started 2023-10-08T12:33:29.771 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:29 smithi092 ceph-mon[134093]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T12:33:29.771 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:29 smithi092 ceph-mon[134093]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:33:29.771 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:29 smithi092 ceph-mon[134093]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T12:33:29.771 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:29 smithi092 ceph-mon[134093]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:33:29.772 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:29 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3905834421' entity='client.admin' 2023-10-08T12:33:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:29 smithi173 ceph-mon[135182]: Standby manager daemon z started 2023-10-08T12:33:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:29 smithi173 ceph-mon[135182]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T12:33:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:29 smithi173 ceph-mon[135182]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:33:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:29 smithi173 ceph-mon[135182]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T12:33:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:29 smithi173 ceph-mon[135182]: from='mgr.? 172.21.15.173:0/1609257646' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:33:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:29 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3905834421' entity='client.admin' 2023-10-08T12:33:30.102 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:29 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:29.769+0000 7f5576d7e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:33:30.103 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:29 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:29.882+0000 7f5576d7e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:33:30.376 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:30 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:30.101+0000 7f5576d7e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:33:30.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.725+0000 7f89512db700 1 -- 172.21.15.59:0/531661328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c10d250 msgr2=0x7f894c10f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:30.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.725+0000 7f89512db700 1 --2- 172.21.15.59:0/531661328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c10d250 0x7f894c10f640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8944009f90 tx=0x7f894400b330 comp rx=0 tx=0).stop 2023-10-08T12:33:30.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.725+0000 7f89512db700 1 -- 172.21.15.59:0/531661328 shutdown_connections 2023-10-08T12:33:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.725+0000 7f89512db700 1 --2- 172.21.15.59:0/531661328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c10d250 0x7f894c10f640 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.725+0000 7f89512db700 1 --2- 172.21.15.59:0/531661328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f894c072a20 0x7f894c072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.725+0000 7f89512db700 1 --2- 172.21.15.59:0/531661328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f894c073340 0x7f894c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.725+0000 7f89512db700 1 -- 172.21.15.59:0/531661328 >> 172.21.15.59:0/531661328 conn(0x7f894c0779e0 msgr2=0x7f894c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.725+0000 7f89512db700 1 -- 172.21.15.59:0/531661328 shutdown_connections 2023-10-08T12:33:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.725+0000 7f89512db700 1 -- 172.21.15.59:0/531661328 wait complete. 2023-10-08T12:33:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.726+0000 7f89512db700 1 Processor -- start 2023-10-08T12:33:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.727+0000 7f89512db700 1 -- start start 2023-10-08T12:33:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.727+0000 7f89512db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c072a20 0x7f894c198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.727+0000 7f89512db700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f894c073340 0x7f894c1994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:30.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.727+0000 7f89512db700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f894c10d250 0x7f894c19d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:30.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.727+0000 7f89512db700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c19dea0 con 0x7f894c072a20 2023-10-08T12:33:30.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.727+0000 7f89512db700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c19e010 con 0x7f894c10d250 2023-10-08T12:33:30.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.727+0000 7f89512db700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c19e1d0 con 0x7f894c073340 2023-10-08T12:33:30.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.727+0000 7f894affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c072a20 0x7f894c198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:30.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.727+0000 7f894affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c072a20 0x7f894c198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34240/0 (socket says 172.21.15.59:34240) 2023-10-08T12:33:30.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.727+0000 7f894affd700 1 -- 172.21.15.59:0/2618233660 learned_addr learned my addr 172.21.15.59:0/2618233660 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:30.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.728+0000 7f894b7fe700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f894c10d250 0x7f894c19d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:30.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.728+0000 7f894a7fc700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f894c073340 0x7f894c1994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:30.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.728+0000 7f894affd700 1 -- 172.21.15.59:0/2618233660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f894c073340 msgr2=0x7f894c1994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:30.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.728+0000 7f894affd700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f894c073340 0x7f894c1994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:30.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.728+0000 7f894affd700 1 -- 172.21.15.59:0/2618233660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f894c10d250 msgr2=0x7f894c19d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:30.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.728+0000 7f894affd700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f894c10d250 0x7f894c19d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:30.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.728+0000 7f894affd700 1 -- 172.21.15.59:0/2618233660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89400095f0 con 0x7f894c072a20 2023-10-08T12:33:30.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.728+0000 7f894b7fe700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f894c10d250 0x7f894c19d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:30.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.728+0000 7f894affd700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c072a20 0x7f894c198fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f893c00b550 tx=0x7f893c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:30.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.728+0000 7f8933fff700 1 -- 172.21.15.59:0/2618233660 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c011830 con 0x7f894c072a20 2023-10-08T12:33:30.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.729+0000 7f8933fff700 1 -- 172.21.15.59:0/2618233660 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f893c011e50 con 0x7f894c072a20 2023-10-08T12:33:30.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.729+0000 7f89512db700 1 -- 172.21.15.59:0/2618233660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8944009c40 con 0x7f894c072a20 2023-10-08T12:33:30.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.729+0000 7f8933fff700 1 -- 172.21.15.59:0/2618233660 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c00f2e0 con 0x7f894c072a20 2023-10-08T12:33:30.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.729+0000 7f89512db700 1 -- 172.21.15.59:0/2618233660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894c1a5b40 con 0x7f894c072a20 2023-10-08T12:33:30.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.730+0000 7f89512db700 1 -- 172.21.15.59:0/2618233660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894c108460 con 0x7f894c072a20 2023-10-08T12:33:30.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.731+0000 7f8933fff700 1 -- 172.21.15.59:0/2618233660 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) v1 ==== 90808+0+0 (secure 0 0 0) 0x7f893c011990 con 0x7f894c072a20 2023-10-08T12:33:30.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.732+0000 7f8933fff700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f893406cfc0 0x7f893406f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:30.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.732+0000 7f8933fff700 1 -- 172.21.15.59:0/2618233660 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f893c08ad80 con 0x7f894c072a20 2023-10-08T12:33:30.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.735+0000 7f894a7fc700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f893406cfc0 0x7f893406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:30.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.736+0000 7f894a7fc700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f893406cfc0 0x7f893406f480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f894c19a500 tx=0x7f8940009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:30.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.737+0000 7f8933fff700 1 -- 172.21.15.59:0/2618233660 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f893c0560e0 con 0x7f894c072a20 2023-10-08T12:33:30.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.991+0000 7f89512db700 1 -- 172.21.15.59:0/2618233660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f894c04e4c0 con 0x7f894c072a20 2023-10-08T12:33:30.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.995+0000 7f8933fff700 1 -- 172.21.15.59:0/2618233660 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v20)=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7f893c059700 con 0x7f894c072a20 2023-10-08T12:33:30.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 -- 172.21.15.59:0/2618233660 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f893406cfc0 msgr2=0x7f893406f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:30.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f893406cfc0 0x7f893406f480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f894c19a500 tx=0x7f8940009310 comp rx=0 tx=0).stop 2023-10-08T12:33:30.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 -- 172.21.15.59:0/2618233660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c072a20 msgr2=0x7f894c198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:30.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c072a20 0x7f894c198fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f893c00b550 tx=0x7f893c00b860 comp rx=0 tx=0).stop 2023-10-08T12:33:30.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 -- 172.21.15.59:0/2618233660 shutdown_connections 2023-10-08T12:33:30.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f893406cfc0 0x7f893406f480 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:30.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f894c10d250 0x7f894c19d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:30.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c072a20 0x7f894c198fa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:30.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 --2- 172.21.15.59:0/2618233660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f894c073340 0x7f894c1994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:30.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 -- 172.21.15.59:0/2618233660 >> 172.21.15.59:0/2618233660 conn(0x7f894c0779e0 msgr2=0x7f894c0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:30.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 -- 172.21.15.59:0/2618233660 shutdown_connections 2023-10-08T12:33:30.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:29.997+0000 7f89512db700 1 -- 172.21.15.59:0/2618233660 wait complete. 2023-10-08T12:33:30.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:30 smithi092 ceph-mon[134093]: mgrmap e18: x(active, since 18s), standbys: z 2023-10-08T12:33:30.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:30 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T12:33:30.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:30 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2618233660' entity='client.admin' 2023-10-08T12:33:30.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:30 smithi173 ceph-mon[135182]: mgrmap e18: x(active, since 18s), standbys: z 2023-10-08T12:33:30.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:30 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T12:33:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:30 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2618233660' entity='client.admin' 2023-10-08T12:33:31.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:30 smithi059 ceph-mon[98489]: mgrmap e18: x(active, since 18s), standbys: z 2023-10-08T12:33:31.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:30 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T12:33:31.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:30 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2618233660' entity='client.admin' 2023-10-08T12:33:31.376 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 12:33:30 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y[136431]: 2023-10-08T12:33:30.960+0000 7f5576d7e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:33:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.883+0000 7fadf1392700 1 -- 172.21.15.59:0/143711237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadec1008a0 msgr2=0x7fadec100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.883+0000 7fadf1392700 1 --2- 172.21.15.59:0/143711237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadec1008a0 0x7fadec100d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fade00098f0 tx=0x7fade0009c00 comp rx=0 tx=0).stop 2023-10-08T12:33:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.883+0000 7fadf1392700 1 -- 172.21.15.59:0/143711237 shutdown_connections 2023-10-08T12:33:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.883+0000 7fadf1392700 1 --2- 172.21.15.59:0/143711237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec101260 0x7fadec10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.883+0000 7fadf1392700 1 --2- 172.21.15.59:0/143711237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadec1057c0 0x7fadec105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.883+0000 7fadf1392700 1 --2- 172.21.15.59:0/143711237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadec1008a0 0x7fadec100d20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.883+0000 7fadf1392700 1 -- 172.21.15.59:0/143711237 >> 172.21.15.59:0/143711237 conn(0x7fadec0779e0 msgr2=0x7fadec077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.883+0000 7fadf1392700 1 -- 172.21.15.59:0/143711237 shutdown_connections 2023-10-08T12:33:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.883+0000 7fadf1392700 1 -- 172.21.15.59:0/143711237 wait complete. 2023-10-08T12:33:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.884+0000 7fadf1392700 1 Processor -- start 2023-10-08T12:33:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadf1392700 1 -- start start 2023-10-08T12:33:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadf1392700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec1008a0 0x7fadec198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadf1392700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadec101260 0x7fadec1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadf1392700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadec1057c0 0x7fadec19d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadf1392700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec19dd80 con 0x7fadec1008a0 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadf1392700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec19def0 con 0x7fadec1057c0 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadf1392700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec19e0b0 con 0x7fadec101260 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadeaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec1008a0 0x7fadec198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadeaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec1008a0 0x7fadec198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51074/0 (socket says 172.21.15.59:51074) 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadeaffd700 1 -- 172.21.15.59:0/1628662705 learned_addr learned my addr 172.21.15.59:0/1628662705 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadea7fc700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadec101260 0x7fadec1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.885+0000 7fadeb7fe700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadec1057c0 0x7fadec19d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadeaffd700 1 -- 172.21.15.59:0/1628662705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadec101260 msgr2=0x7fadec1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadeaffd700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadec101260 0x7fadec1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadeaffd700 1 -- 172.21.15.59:0/1628662705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadec1057c0 msgr2=0x7fadec19d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadeaffd700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadec1057c0 0x7fadec19d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadeaffd700 1 -- 172.21.15.59:0/1628662705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade0009520 con 0x7fadec1008a0 2023-10-08T12:33:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadea7fc700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadec101260 0x7fadec1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadeb7fe700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadec1057c0 0x7fadec19d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadeaffd700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec1008a0 0x7fadec198e80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faddc00e970 tx=0x7faddc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadd3fff700 1 -- 172.21.15.59:0/1628662705 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc009790 con 0x7fadec1008a0 2023-10-08T12:33:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadf1392700 1 -- 172.21.15.59:0/1628662705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec19e390 con 0x7fadec1008a0 2023-10-08T12:33:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadd3fff700 1 -- 172.21.15.59:0/1628662705 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faddc00c7e0 con 0x7fadec1008a0 2023-10-08T12:33:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.886+0000 7fadd3fff700 1 -- 172.21.15.59:0/1628662705 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc003c70 con 0x7fadec1008a0 2023-10-08T12:33:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.887+0000 7fadf1392700 1 -- 172.21.15.59:0/1628662705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec1a5bf0 con 0x7fadec1008a0 2023-10-08T12:33:31.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.888+0000 7fadf1392700 1 -- 172.21.15.59:0/1628662705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec101f30 con 0x7fadec1008a0 2023-10-08T12:33:31.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.889+0000 7fadd3fff700 1 -- 172.21.15.59:0/1628662705 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) v1 ==== 90808+0+0 (secure 0 0 0) 0x7faddc00cc50 con 0x7fadec1008a0 2023-10-08T12:33:31.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.890+0000 7fadd3fff700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fadd406cfc0 0x7fadd406f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:31.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.890+0000 7fadd3fff700 1 -- 172.21.15.59:0/1628662705 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7faddc014070 con 0x7fadec1008a0 2023-10-08T12:33:31.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.890+0000 7fadea7fc700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fadd406cfc0 0x7fadd406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:31.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.891+0000 7fadea7fc700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fadd406cfc0 0x7fadd406f480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fade00098c0 tx=0x7fade0019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:31.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:30.894+0000 7fadd3fff700 1 -- 172.21.15.59:0/1628662705 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faddc0567d0 con 0x7fadec1008a0 2023-10-08T12:33:31.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.109+0000 7fadf1392700 1 -- 172.21.15.59:0/1628662705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7fadec19a1c0 con 0x7fadec1008a0 2023-10-08T12:33:31.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.113+0000 7fadd3fff700 1 -- 172.21.15.59:0/1628662705 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v21)=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7faddc003dd0 con 0x7fadec1008a0 2023-10-08T12:33:31.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.116+0000 7fadf1392700 1 -- 172.21.15.59:0/1628662705 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fadd406cfc0 msgr2=0x7fadd406f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.116+0000 7fadf1392700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fadd406cfc0 0x7fadd406f480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fade00098c0 tx=0x7fade0019040 comp rx=0 tx=0).stop 2023-10-08T12:33:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.116+0000 7fadf1392700 1 -- 172.21.15.59:0/1628662705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec1008a0 msgr2=0x7fadec198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.116+0000 7fadf1392700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec1008a0 0x7fadec198e80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faddc00e970 tx=0x7faddc00ec80 comp rx=0 tx=0).stop 2023-10-08T12:33:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.117+0000 7fadf1392700 1 -- 172.21.15.59:0/1628662705 shutdown_connections 2023-10-08T12:33:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.117+0000 7fadf1392700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fadd406cfc0 0x7fadd406f480 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.117+0000 7fadf1392700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadec1057c0 0x7fadec19d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.117+0000 7fadf1392700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec1008a0 0x7fadec198e80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.117+0000 7fadf1392700 1 --2- 172.21.15.59:0/1628662705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadec101260 0x7fadec1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.117+0000 7fadf1392700 1 -- 172.21.15.59:0/1628662705 >> 172.21.15.59:0/1628662705 conn(0x7fadec0779e0 msgr2=0x7fadec10ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.117+0000 7fadf1392700 1 -- 172.21.15.59:0/1628662705 shutdown_connections 2023-10-08T12:33:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:31.117+0000 7fadf1392700 1 -- 172.21.15.59:0/1628662705 wait complete. 2023-10-08T12:33:31.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:31 smithi059 ceph-mon[98489]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:31.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:31 smithi059 ceph-mon[98489]: Standby manager daemon y started 2023-10-08T12:33:31.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:31 smithi059 ceph-mon[98489]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T12:33:31.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:31 smithi059 ceph-mon[98489]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:33:31.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:31 smithi059 ceph-mon[98489]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T12:33:31.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:31 smithi059 ceph-mon[98489]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:33:31.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:31 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1628662705' entity='client.admin' 2023-10-08T12:33:31.876 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:31 smithi092 ceph-mon[134093]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:31.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:31 smithi092 ceph-mon[134093]: Standby manager daemon y started 2023-10-08T12:33:31.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:31 smithi092 ceph-mon[134093]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T12:33:31.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:31 smithi092 ceph-mon[134093]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:33:31.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:31 smithi092 ceph-mon[134093]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T12:33:31.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:31 smithi092 ceph-mon[134093]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:33:31.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:31 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1628662705' entity='client.admin' 2023-10-08T12:33:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:31 smithi173 ceph-mon[135182]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:31 smithi173 ceph-mon[135182]: Standby manager daemon y started 2023-10-08T12:33:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:31 smithi173 ceph-mon[135182]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T12:33:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:31 smithi173 ceph-mon[135182]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:33:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:31 smithi173 ceph-mon[135182]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T12:33:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:31 smithi173 ceph-mon[135182]: from='mgr.? 172.21.15.92:0/2531306221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:33:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:31 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1628662705' entity='client.admin' 2023-10-08T12:33:32.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:32 smithi059 ceph-mon[98489]: mgrmap e19: x(active, since 20s), standbys: z, y 2023-10-08T12:33:32.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:32 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T12:33:32.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:32 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1201007411' entity='client.admin' 2023-10-08T12:33:32.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:32 smithi092 ceph-mon[134093]: mgrmap e19: x(active, since 20s), standbys: z, y 2023-10-08T12:33:32.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:32 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T12:33:32.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:32 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1201007411' entity='client.admin' 2023-10-08T12:33:32.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.917+0000 7feb8e2eb700 1 -- 172.21.15.59:0/874906217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb88100110 msgr2=0x7feb8810c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:32.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.917+0000 7feb8e2eb700 1 --2- 172.21.15.59:0/874906217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb88100110 0x7feb8810c580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feb8000b0a0 tx=0x7feb8000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:33:32.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.917+0000 7feb8e2eb700 1 -- 172.21.15.59:0/874906217 shutdown_connections 2023-10-08T12:33:32.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.917+0000 7feb8e2eb700 1 --2- 172.21.15.59:0/874906217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb88100110 0x7feb8810c580 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:32.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.917+0000 7feb8e2eb700 1 --2- 172.21.15.59:0/874906217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb881056b0 0x7feb88105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:32.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.917+0000 7feb8e2eb700 1 --2- 172.21.15.59:0/874906217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb880ff750 0x7feb880ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:32.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.917+0000 7feb8e2eb700 1 -- 172.21.15.59:0/874906217 >> 172.21.15.59:0/874906217 conn(0x7feb88075790 msgr2=0x7feb88075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:32.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.917+0000 7feb8e2eb700 1 -- 172.21.15.59:0/874906217 shutdown_connections 2023-10-08T12:33:32.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.917+0000 7feb8e2eb700 1 -- 172.21.15.59:0/874906217 wait complete. 2023-10-08T12:33:32.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.918+0000 7feb8e2eb700 1 Processor -- start 2023-10-08T12:33:32.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.918+0000 7feb8e2eb700 1 -- start start 2023-10-08T12:33:32.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8e2eb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb880ff750 0x7feb88101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:32.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8e2eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb88100110 0x7feb881017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:32.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8e2eb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb881056b0 0x7feb88101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:32.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8e2eb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb881a5030 con 0x7feb88100110 2023-10-08T12:33:32.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8e2eb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb881a51a0 con 0x7feb881056b0 2023-10-08T12:33:32.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8e2eb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb881a5360 con 0x7feb880ff750 2023-10-08T12:33:32.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb877fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb88100110 0x7feb881017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:32.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8c888700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb881056b0 0x7feb88101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:32.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8c888700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb881056b0 0x7feb88101d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50076/0 (socket says 172.21.15.59:50076) 2023-10-08T12:33:32.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb87fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb880ff750 0x7feb88101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:32.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8c888700 1 -- 172.21.15.59:0/62746076 learned_addr learned my addr 172.21.15.59:0/62746076 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:32.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8c888700 1 -- 172.21.15.59:0/62746076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb880ff750 msgr2=0x7feb88101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:32.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8c888700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb880ff750 0x7feb88101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:32.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8c888700 1 -- 172.21.15.59:0/62746076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb88100110 msgr2=0x7feb881017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:32.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8c888700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb88100110 0x7feb881017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:32.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.919+0000 7feb8c888700 1 -- 172.21.15.59:0/62746076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80009d00 con 0x7feb881056b0 2023-10-08T12:33:32.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.920+0000 7feb8c888700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb881056b0 0x7feb88101d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feb8000b070 tx=0x7feb80007930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:32.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.920+0000 7feb857fa700 1 -- 172.21.15.59:0/62746076 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000e040 con 0x7feb881056b0 2023-10-08T12:33:32.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.920+0000 7feb8e2eb700 1 -- 172.21.15.59:0/62746076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb881a55e0 con 0x7feb881056b0 2023-10-08T12:33:32.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.920+0000 7feb8e2eb700 1 -- 172.21.15.59:0/62746076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb881a5aa0 con 0x7feb881056b0 2023-10-08T12:33:32.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.920+0000 7feb857fa700 1 -- 172.21.15.59:0/62746076 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb80009b80 con 0x7feb881056b0 2023-10-08T12:33:32.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.920+0000 7feb857fa700 1 -- 172.21.15.59:0/62746076 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80005040 con 0x7feb881056b0 2023-10-08T12:33:32.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.921+0000 7feb8e2eb700 1 -- 172.21.15.59:0/62746076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb74005320 con 0x7feb881056b0 2023-10-08T12:33:32.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.923+0000 7feb857fa700 1 -- 172.21.15.59:0/62746076 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7feb8001d470 con 0x7feb881056b0 2023-10-08T12:33:32.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.925+0000 7feb857fa700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feb700a1540 0x7feb700a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:32.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.925+0000 7feb857fa700 1 -- 172.21.15.59:0/62746076 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7feb800cc5d0 con 0x7feb881056b0 2023-10-08T12:33:32.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.925+0000 7feb87fff700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feb700a1540 0x7feb700a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:32.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.925+0000 7feb87fff700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feb700a1540 0x7feb700a3a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feb7800abd0 tx=0x7feb7800a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:32.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.928+0000 7feb857fa700 1 -- 172.21.15.59:0/62746076 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feb80097820 con 0x7feb881056b0 2023-10-08T12:33:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:32 smithi173 ceph-mon[135182]: mgrmap e19: x(active, since 20s), standbys: z, y 2023-10-08T12:33:32.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:32 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T12:33:32.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:32 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1201007411' entity='client.admin' 2023-10-08T12:33:33.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi059') 2023-10-08T12:33:33.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.165+0000 7feb8e2eb700 1 -- 172.21.15.59:0/62746076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7feb74005190 con 0x7feb881056b0 2023-10-08T12:33:33.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.171+0000 7feb857fa700 1 -- 172.21.15.59:0/62746076 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v23)=0 v23) v1 ==== 121+0+0 (secure 0 0 0) 0x7feb8009ae40 con 0x7feb881056b0 2023-10-08T12:33:33.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.173+0000 7feb8e2eb700 1 -- 172.21.15.59:0/62746076 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feb700a1540 msgr2=0x7feb700a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:33.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.173+0000 7feb8e2eb700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feb700a1540 0x7feb700a3a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feb7800abd0 tx=0x7feb7800a380 comp rx=0 tx=0).stop 2023-10-08T12:33:33.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.173+0000 7feb8e2eb700 1 -- 172.21.15.59:0/62746076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb881056b0 msgr2=0x7feb88101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:33.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.173+0000 7feb8e2eb700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb881056b0 0x7feb88101d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feb8000b070 tx=0x7feb80007930 comp rx=0 tx=0).stop 2023-10-08T12:33:33.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.173+0000 7feb8e2eb700 1 -- 172.21.15.59:0/62746076 shutdown_connections 2023-10-08T12:33:33.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.173+0000 7feb8e2eb700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feb700a1540 0x7feb700a3a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.173+0000 7feb8e2eb700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb881056b0 0x7feb88101d00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.173+0000 7feb8e2eb700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb880ff750 0x7feb88101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.173+0000 7feb8e2eb700 1 --2- 172.21.15.59:0/62746076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb88100110 0x7feb881017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.173+0000 7feb8e2eb700 1 -- 172.21.15.59:0/62746076 >> 172.21.15.59:0/62746076 conn(0x7feb88075790 msgr2=0x7feb88068470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:33.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.174+0000 7feb8e2eb700 1 -- 172.21.15.59:0/62746076 shutdown_connections 2023-10-08T12:33:33.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:33.174+0000 7feb8e2eb700 1 -- 172.21.15.59:0/62746076 wait complete. 2023-10-08T12:33:33.284 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:33.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.357+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1442513487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc181005f0 msgr2=0x7fbc18100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.357+0000 7fbc1dc8f700 1 --2- 172.21.15.59:0/1442513487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc181005f0 0x7fbc18100a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009990 tx=0x7fbc04009ca0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.357+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1442513487 shutdown_connections 2023-10-08T12:33:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.357+0000 7fbc1dc8f700 1 --2- 172.21.15.59:0/1442513487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc18106680 0x7fbc18106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.357+0000 7fbc1dc8f700 1 --2- 172.21.15.59:0/1442513487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18100fb0 0x7fbc1810d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.357+0000 7fbc1dc8f700 1 --2- 172.21.15.59:0/1442513487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc181005f0 0x7fbc18100a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.357+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1442513487 >> 172.21.15.59:0/1442513487 conn(0x7fbc180fc120 msgr2=0x7fbc180fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.357+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1442513487 shutdown_connections 2023-10-08T12:33:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.357+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1442513487 wait complete. 2023-10-08T12:33:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.358+0000 7fbc1dc8f700 1 Processor -- start 2023-10-08T12:33:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.358+0000 7fbc1dc8f700 1 -- start start 2023-10-08T12:33:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1dc8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc181005f0 0x7fbc1819e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1dc8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc18100fb0 0x7fbc1819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1dc8f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18106680 0x7fbc18198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1dc8f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181990c0 con 0x7fbc181005f0 2023-10-08T12:33:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1dc8f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18199230 con 0x7fbc18100fb0 2023-10-08T12:33:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1dc8f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181993f0 con 0x7fbc18106680 2023-10-08T12:33:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1cc8d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc181005f0 0x7fbc1819e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1cc8d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc181005f0 0x7fbc1819e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51090/0 (socket says 172.21.15.59:51090) 2023-10-08T12:33:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1cc8d700 1 -- 172.21.15.59:0/1201007411 learned_addr learned my addr 172.21.15.59:0/1201007411 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1d48e700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18106680 0x7fbc18198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc17fff700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc18100fb0 0x7fbc1819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1cc8d700 1 -- 172.21.15.59:0/1201007411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18106680 msgr2=0x7fbc18198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1cc8d700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18106680 0x7fbc18198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1cc8d700 1 -- 172.21.15.59:0/1201007411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc18100fb0 msgr2=0x7fbc1819ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1cc8d700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc18100fb0 0x7fbc1819ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.359+0000 7fbc1cc8d700 1 -- 172.21.15.59:0/1201007411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc040095f0 con 0x7fbc181005f0 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.360+0000 7fbc1d48e700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18106680 0x7fbc18198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.360+0000 7fbc17fff700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc18100fb0 0x7fbc1819ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.360+0000 7fbc1cc8d700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc181005f0 0x7fbc1819e920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00e970 tx=0x7fbc0c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.360+0000 7fbc15ffb700 1 -- 172.21.15.59:0/1201007411 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c009790 con 0x7fbc181005f0 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.360+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1201007411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc181996d0 con 0x7fbc181005f0 2023-10-08T12:33:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.360+0000 7fbc15ffb700 1 -- 172.21.15.59:0/1201007411 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc0c0044e0 con 0x7fbc181005f0 2023-10-08T12:33:33.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.360+0000 7fbc15ffb700 1 -- 172.21.15.59:0/1201007411 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c003e30 con 0x7fbc181005f0 2023-10-08T12:33:33.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.360+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1201007411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc181a5910 con 0x7fbc181005f0 2023-10-08T12:33:33.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.361+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1201007411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc18101d30 con 0x7fbc181005f0 2023-10-08T12:33:33.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.363+0000 7fbc15ffb700 1 -- 172.21.15.59:0/1201007411 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fbc0c004000 con 0x7fbc181005f0 2023-10-08T12:33:33.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.364+0000 7fbc15ffb700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc080a1440 0x7fbc080a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:33.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.365+0000 7fbc15ffb700 1 -- 172.21.15.59:0/1201007411 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fbc0c014070 con 0x7fbc181005f0 2023-10-08T12:33:33.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.365+0000 7fbc17fff700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc080a1440 0x7fbc080a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:33.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.365+0000 7fbc17fff700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc080a1440 0x7fbc080a3900 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc04006010 tx=0x7fbc0400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:33.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.369+0000 7fbc15ffb700 1 -- 172.21.15.59:0/1201007411 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbc0c096660 con 0x7fbc181005f0 2023-10-08T12:33:33.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.584+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1201007411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7fbc181998c0 con 0x7fbc181005f0 2023-10-08T12:33:33.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.589+0000 7fbc15ffb700 1 -- 172.21.15.59:0/1201007411 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbc0c099c80 con 0x7fbc181005f0 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.591+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1201007411 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc080a1440 msgr2=0x7fbc080a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.591+0000 7fbc1dc8f700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc080a1440 0x7fbc080a3900 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc04006010 tx=0x7fbc0400b260 comp rx=0 tx=0).stop 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.591+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1201007411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc181005f0 msgr2=0x7fbc1819e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.591+0000 7fbc1dc8f700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc181005f0 0x7fbc1819e920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00e970 tx=0x7fbc0c00ed30 comp rx=0 tx=0).stop 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.591+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1201007411 shutdown_connections 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.591+0000 7fbc1dc8f700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc080a1440 0x7fbc080a3900 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.591+0000 7fbc1dc8f700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18106680 0x7fbc18198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.591+0000 7fbc1dc8f700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc181005f0 0x7fbc1819e920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.591+0000 7fbc1dc8f700 1 --2- 172.21.15.59:0/1201007411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc18100fb0 0x7fbc1819ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.591+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1201007411 >> 172.21.15.59:0/1201007411 conn(0x7fbc180fc120 msgr2=0x7fbc180fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.591+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1201007411 shutdown_connections 2023-10-08T12:33:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:32.592+0000 7fbc1dc8f700 1 -- 172.21.15.59:0/1201007411 wait complete. 2023-10-08T12:33:33.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:33 smithi092 ceph-mon[134093]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:33.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:33 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:33.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:33 smithi059 ceph-mon[98489]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:33.905 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:33 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:33.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:33 smithi173 ceph-mon[135182]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:33 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:34.037 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:34.094 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi059') 2023-10-08T12:33:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.470+0000 7fe5c3951700 1 -- 172.21.15.59:0/957822646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5bc1067a0 msgr2=0x7fe5bc106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.470+0000 7fe5c3951700 1 --2- 172.21.15.59:0/957822646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5bc1067a0 0x7fe5bc106b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80098f0 tx=0x7fe5b8009c00 comp rx=0 tx=0).stop 2023-10-08T12:33:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.471+0000 7fe5c3951700 1 -- 172.21.15.59:0/957822646 shutdown_connections 2023-10-08T12:33:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.471+0000 7fe5c3951700 1 --2- 172.21.15.59:0/957822646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5bc068b30 0x7fe5bc10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.471+0000 7fe5c3951700 1 --2- 172.21.15.59:0/957822646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5bc1067a0 0x7fe5bc106b80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.471+0000 7fe5c3951700 1 --2- 172.21.15.59:0/957822646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5bc068190 0x7fe5bc0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.471+0000 7fe5c3951700 1 -- 172.21.15.59:0/957822646 >> 172.21.15.59:0/957822646 conn(0x7fe5bc075790 msgr2=0x7fe5bc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.471+0000 7fe5c3951700 1 -- 172.21.15.59:0/957822646 shutdown_connections 2023-10-08T12:33:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.471+0000 7fe5c3951700 1 -- 172.21.15.59:0/957822646 wait complete. 2023-10-08T12:33:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.472+0000 7fe5c3951700 1 Processor -- start 2023-10-08T12:33:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.472+0000 7fe5c3951700 1 -- start start 2023-10-08T12:33:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.472+0000 7fe5c3951700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5bc068190 0x7fe5bc198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.472+0000 7fe5c3951700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5bc068b30 0x7fe5bc1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.472+0000 7fe5c3951700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5bc1067a0 0x7fe5bc19d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.472+0000 7fe5c3951700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc19ddb0 con 0x7fe5bc1067a0 2023-10-08T12:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.472+0000 7fe5c3951700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc19df20 con 0x7fe5bc068190 2023-10-08T12:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.472+0000 7fe5c3951700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc19e0e0 con 0x7fe5bc068b30 2023-10-08T12:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.473+0000 7fe5c16ed700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5bc068190 0x7fe5bc198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.473+0000 7fe5c1eee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5bc1067a0 0x7fe5bc19d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.473+0000 7fe5c16ed700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5bc068190 0x7fe5bc198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50092/0 (socket says 172.21.15.59:50092) 2023-10-08T12:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.473+0000 7fe5c16ed700 1 -- 172.21.15.59:0/3800430348 learned_addr learned my addr 172.21.15.59:0/3800430348 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.473+0000 7fe5c0eec700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5bc068b30 0x7fe5bc1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.473+0000 7fe5c1eee700 1 -- 172.21.15.59:0/3800430348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5bc068b30 msgr2=0x7fe5bc1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.473+0000 7fe5c1eee700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5bc068b30 0x7fe5bc1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.473+0000 7fe5c1eee700 1 -- 172.21.15.59:0/3800430348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5bc068190 msgr2=0x7fe5bc198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.473+0000 7fe5c1eee700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5bc068190 0x7fe5bc198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.473+0000 7fe5c1eee700 1 -- 172.21.15.59:0/3800430348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac0095f0 con 0x7fe5bc1067a0 2023-10-08T12:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.473+0000 7fe5c16ed700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5bc068190 0x7fe5bc198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.474+0000 7fe5c1eee700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5bc1067a0 0x7fe5bc19d7a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400efc0 tx=0x7fe5b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.474+0000 7fe5b27fc700 1 -- 172.21.15.59:0/3800430348 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4018070 con 0x7fe5bc1067a0 2023-10-08T12:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.474+0000 7fe5b27fc700 1 -- 172.21.15.59:0/3800430348 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5b400f040 con 0x7fe5bc1067a0 2023-10-08T12:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.474+0000 7fe5b27fc700 1 -- 172.21.15.59:0/3800430348 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400cd40 con 0x7fe5bc1067a0 2023-10-08T12:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.474+0000 7fe5c3951700 1 -- 172.21.15.59:0/3800430348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b8009520 con 0x7fe5bc1067a0 2023-10-08T12:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.474+0000 7fe5c3951700 1 -- 172.21.15.59:0/3800430348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc1a5a50 con 0x7fe5bc1067a0 2023-10-08T12:33:34.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.476+0000 7fe5c3951700 1 -- 172.21.15.59:0/3800430348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc0fed60 con 0x7fe5bc1067a0 2023-10-08T12:33:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.480+0000 7fe5b27fc700 1 -- 172.21.15.59:0/3800430348 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fe5b4003a00 con 0x7fe5bc1067a0 2023-10-08T12:33:34.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.483+0000 7fe5b27fc700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5a80a1540 0x7fe5a80a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.483+0000 7fe5b27fc700 1 -- 172.21.15.59:0/3800430348 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe5b40cb670 con 0x7fe5bc1067a0 2023-10-08T12:33:34.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.486+0000 7fe5b27fc700 1 -- 172.21.15.59:0/3800430348 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe5b40968c0 con 0x7fe5bc1067a0 2023-10-08T12:33:34.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.487+0000 7fe5c16ed700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5a80a1540 0x7fe5a80a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.488+0000 7fe5c16ed700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5a80a1540 0x7fe5a80a3a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009fd0 tx=0x7fe5b8019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:34.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.711+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/2278660404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2ac1057c0 msgr2=0x7ff2ac105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.711+0000 7ff2b0d8a700 1 --2- 172.21.15.59:0/2278660404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2ac1057c0 0x7ff2ac105ba0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009990 tx=0x7ff29c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.712+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/2278660404 shutdown_connections 2023-10-08T12:33:34.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.712+0000 7ff2b0d8a700 1 --2- 172.21.15.59:0/2278660404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac101260 0x7ff2ac10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.712+0000 7ff2b0d8a700 1 --2- 172.21.15.59:0/2278660404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2ac1057c0 0x7ff2ac105ba0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.712+0000 7ff2b0d8a700 1 --2- 172.21.15.59:0/2278660404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac1008a0 0x7ff2ac100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.712+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/2278660404 >> 172.21.15.59:0/2278660404 conn(0x7ff2ac0779e0 msgr2=0x7ff2ac077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:34.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.712+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/2278660404 shutdown_connections 2023-10-08T12:33:34.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.712+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/2278660404 wait complete. 2023-10-08T12:33:34.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.713+0000 7ff2b0d8a700 1 Processor -- start 2023-10-08T12:33:34.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.714+0000 7ff2b0d8a700 1 -- start start 2023-10-08T12:33:34.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.714+0000 7ff2b0d8a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac1008a0 0x7ff2ac19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.714+0000 7ff2b0d8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac101260 0x7ff2ac19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.714+0000 7ff2b0d8a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2ac1057c0 0x7ff2ac196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.714+0000 7ff2b0d8a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac197120 con 0x7ff2ac101260 2023-10-08T12:33:34.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.714+0000 7ff2b0d8a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac197290 con 0x7ff2ac1008a0 2023-10-08T12:33:34.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.714+0000 7ff2b0d8a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac197450 con 0x7ff2ac1057c0 2023-10-08T12:33:34.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2aa59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac1008a0 0x7ff2ac19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2aa59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac1008a0 0x7ff2ac19c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50124/0 (socket says 172.21.15.59:50124) 2023-10-08T12:33:34.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2aa59c700 1 -- 172.21.15.59:0/4253813154 learned_addr learned my addr 172.21.15.59:0/4253813154 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:34.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2a9d9b700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac101260 0x7ff2ac19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2aad9d700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2ac1057c0 0x7ff2ac196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2aa59c700 1 -- 172.21.15.59:0/4253813154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2ac1057c0 msgr2=0x7ff2ac196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2aa59c700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2ac1057c0 0x7ff2ac196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2aa59c700 1 -- 172.21.15.59:0/4253813154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac101260 msgr2=0x7ff2ac19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2aa59c700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac101260 0x7ff2ac19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2aa59c700 1 -- 172.21.15.59:0/4253813154 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a4009c40 con 0x7ff2ac1008a0 2023-10-08T12:33:34.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2aad9d700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2ac1057c0 0x7ff2ac196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:33:34.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.715+0000 7ff2aa59c700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac1008a0 0x7ff2ac19c930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff29c000c00 tx=0x7ff29c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:34.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.716+0000 7ff29b7fe700 1 -- 172.21.15.59:0/4253813154 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c01d070 con 0x7ff2ac1008a0 2023-10-08T12:33:34.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.716+0000 7ff29b7fe700 1 -- 172.21.15.59:0/4253813154 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff29c021410 con 0x7ff2ac1008a0 2023-10-08T12:33:34.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.716+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/4253813154 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c0095f0 con 0x7ff2ac1008a0 2023-10-08T12:33:34.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.716+0000 7ff29b7fe700 1 -- 172.21.15.59:0/4253813154 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c017650 con 0x7ff2ac1008a0 2023-10-08T12:33:34.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.716+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/4253813154 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ac1a3750 con 0x7ff2ac1008a0 2023-10-08T12:33:34.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.717+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/4253813154 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ac108d80 con 0x7ff2ac1008a0 2023-10-08T12:33:34.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.719+0000 7ff29b7fe700 1 -- 172.21.15.59:0/4253813154 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7ff29c021580 con 0x7ff2ac1008a0 2023-10-08T12:33:34.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.721+0000 7ff29b7fe700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2940a14c0 0x7ff2940a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.721+0000 7ff29b7fe700 1 -- 172.21.15.59:0/4253813154 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff29c0cc500 con 0x7ff2ac1008a0 2023-10-08T12:33:34.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.722+0000 7ff2a9d9b700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2940a14c0 0x7ff2940a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.722+0000 7ff2a9d9b700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2940a14c0 0x7ff2940a3980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac197c30 tx=0x7ff2a0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:34.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.723+0000 7ff29b7fe700 1 -- 172.21.15.59:0/4253813154 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff29c097750 con 0x7ff2ac1008a0 2023-10-08T12:33:34.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.727+0000 7fe5c3951700 1 -- 172.21.15.59:0/3800430348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7fe5bc101ee0 con 0x7fe5bc1067a0 2023-10-08T12:33:34.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.731+0000 7fe5b27fc700 1 -- 172.21.15.59:0/3800430348 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v24)=0 v24) v1 ==== 115+0+0 (secure 0 0 0) 0x7fe5b4099ee0 con 0x7fe5bc1067a0 2023-10-08T12:33:34.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.734+0000 7fe5c3951700 1 -- 172.21.15.59:0/3800430348 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5a80a1540 msgr2=0x7fe5a80a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.734+0000 7fe5c3951700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5a80a1540 0x7fe5a80a3a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009fd0 tx=0x7fe5b8019040 comp rx=0 tx=0).stop 2023-10-08T12:33:34.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.734+0000 7fe5c3951700 1 -- 172.21.15.59:0/3800430348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5bc1067a0 msgr2=0x7fe5bc19d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.734+0000 7fe5c3951700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5bc1067a0 0x7fe5bc19d7a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400efc0 tx=0x7fe5b400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.735+0000 7fe5c3951700 1 -- 172.21.15.59:0/3800430348 shutdown_connections 2023-10-08T12:33:34.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.735+0000 7fe5c3951700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5a80a1540 0x7fe5a80a3a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.735+0000 7fe5c3951700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5bc068190 0x7fe5bc198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.735+0000 7fe5c3951700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5bc1067a0 0x7fe5bc19d7a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.735+0000 7fe5c3951700 1 --2- 172.21.15.59:0/3800430348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5bc068b30 0x7fe5bc1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.735+0000 7fe5c3951700 1 -- 172.21.15.59:0/3800430348 >> 172.21.15.59:0/3800430348 conn(0x7fe5bc075790 msgr2=0x7fe5bc10bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:34.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.736+0000 7fe5c3951700 1 -- 172.21.15.59:0/3800430348 shutdown_connections 2023-10-08T12:33:34.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.736+0000 7fe5c3951700 1 -- 172.21.15.59:0/3800430348 wait complete. 2023-10-08T12:33:34.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.845+0000 7f482e02e700 1 -- 172.21.15.59:0/1585717472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4828072a20 msgr2=0x7f4828072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.845+0000 7f482e02e700 1 --2- 172.21.15.59:0/1585717472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4828072a20 0x7f4828072e00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4818009990 tx=0x7f4818009ca0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.845+0000 7f482e02e700 1 -- 172.21.15.59:0/1585717472 shutdown_connections 2023-10-08T12:33:34.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.845+0000 7f482e02e700 1 --2- 172.21.15.59:0/1585717472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4828072a20 0x7f4828072e00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.845+0000 7f482e02e700 1 --2- 172.21.15.59:0/1585717472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482810d250 0x7f482810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.845+0000 7f482e02e700 1 --2- 172.21.15.59:0/1585717472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4828073340 0x7f482810cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.845+0000 7f482e02e700 1 -- 172.21.15.59:0/1585717472 >> 172.21.15.59:0/1585717472 conn(0x7f48280779e0 msgr2=0x7f4828077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:34.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.846+0000 7f482e02e700 1 -- 172.21.15.59:0/1585717472 shutdown_connections 2023-10-08T12:33:34.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.846+0000 7f482e02e700 1 -- 172.21.15.59:0/1585717472 wait complete. 2023-10-08T12:33:34.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.847+0000 7f482e02e700 1 Processor -- start 2023-10-08T12:33:34.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.847+0000 7f482e02e700 1 -- start start 2023-10-08T12:33:34.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.848+0000 7f482e02e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4828072a20 0x7f4828198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.848+0000 7f482e02e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4828073340 0x7f4828199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.848+0000 7f482e02e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482810d250 0x7f482819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.848+0000 7f482e02e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482819ddc0 con 0x7f4828073340 2023-10-08T12:33:34.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.848+0000 7f482e02e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482819df30 con 0x7f4828072a20 2023-10-08T12:33:34.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.848+0000 7f482e02e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482819e0f0 con 0x7f482810d250 2023-10-08T12:33:34.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.848+0000 7f4826ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4828073340 0x7f4828199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.848+0000 7f4826ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4828073340 0x7f4828199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51166/0 (socket says 172.21.15.59:51166) 2023-10-08T12:33:34.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.848+0000 7f4826ffd700 1 -- 172.21.15.59:0/619014423 learned_addr learned my addr 172.21.15.59:0/619014423 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f48277fe700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4828072a20 0x7f4828198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f4827fff700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482810d250 0x7f482819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f4826ffd700 1 -- 172.21.15.59:0/619014423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482810d250 msgr2=0x7f482819d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f4826ffd700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482810d250 0x7f482819d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f4826ffd700 1 -- 172.21.15.59:0/619014423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4828072a20 msgr2=0x7f4828198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f4826ffd700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4828072a20 0x7f4828198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f4826ffd700 1 -- 172.21.15.59:0/619014423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c009520 con 0x7f4828073340 2023-10-08T12:33:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f48277fe700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4828072a20 0x7f4828198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:33:34.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f4826ffd700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4828073340 0x7f4828199400 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f481c00eb30 tx=0x7f481c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:34.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f4824ff9700 1 -- 172.21.15.59:0/619014423 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c009880 con 0x7f4828073340 2023-10-08T12:33:34.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f482e02e700 1 -- 172.21.15.59:0/619014423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48180095f0 con 0x7f4828073340 2023-10-08T12:33:34.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f4824ff9700 1 -- 172.21.15.59:0/619014423 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f481c0044e0 con 0x7f4828073340 2023-10-08T12:33:34.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f4824ff9700 1 -- 172.21.15.59:0/619014423 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c010430 con 0x7f4828073340 2023-10-08T12:33:34.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.849+0000 7f482e02e700 1 -- 172.21.15.59:0/619014423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48281a5a60 con 0x7f4828073340 2023-10-08T12:33:34.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.851+0000 7f482e02e700 1 -- 172.21.15.59:0/619014423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4828108460 con 0x7f4828073340 2023-10-08T12:33:34.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.854+0000 7f4824ff9700 1 -- 172.21.15.59:0/619014423 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f481c003ee0 con 0x7f4828073340 2023-10-08T12:33:34.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.856+0000 7f4824ff9700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48100a1440 0x7f48100a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:34.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.856+0000 7f4824ff9700 1 -- 172.21.15.59:0/619014423 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f481c014070 con 0x7f4828073340 2023-10-08T12:33:34.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.856+0000 7f48277fe700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48100a1440 0x7f48100a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:34.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.857+0000 7f48277fe700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48100a1440 0x7f48100a3900 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4818006010 tx=0x7f481800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:34.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.860+0000 7f4824ff9700 1 -- 172.21.15.59:0/619014423 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f481c0968a0 con 0x7f4828073340 2023-10-08T12:33:34.926 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:34.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.963+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/4253813154 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7ff2ac101f30 con 0x7ff2ac1008a0 2023-10-08T12:33:34.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.968+0000 7ff29b7fe700 1 -- 172.21.15.59:0/4253813154 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v25)=0 v25) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff29c0260c0 con 0x7ff2ac1008a0 2023-10-08T12:33:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.971+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/4253813154 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2940a14c0 msgr2=0x7ff2940a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.971+0000 7ff2b0d8a700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2940a14c0 0x7ff2940a3980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac197c30 tx=0x7ff2a0009260 comp rx=0 tx=0).stop 2023-10-08T12:33:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.971+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/4253813154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac1008a0 msgr2=0x7ff2ac19c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.971+0000 7ff2b0d8a700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac1008a0 0x7ff2ac19c930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff29c000c00 tx=0x7ff29c004730 comp rx=0 tx=0).stop 2023-10-08T12:33:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.971+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/4253813154 shutdown_connections 2023-10-08T12:33:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.971+0000 7ff2b0d8a700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2940a14c0 0x7ff2940a3980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.971+0000 7ff2b0d8a700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac1008a0 0x7ff2ac19c930 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.971+0000 7ff2b0d8a700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2ac1057c0 0x7ff2ac196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.971+0000 7ff2b0d8a700 1 --2- 172.21.15.59:0/4253813154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ac101260 0x7ff2ac19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.971+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/4253813154 >> 172.21.15.59:0/4253813154 conn(0x7ff2ac0779e0 msgr2=0x7ff2ac0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.972+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/4253813154 shutdown_connections 2023-10-08T12:33:34.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:34.972+0000 7ff2b0d8a700 1 -- 172.21.15.59:0/4253813154 wait complete. 2023-10-08T12:33:35.042 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:35.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.109+0000 7f482e02e700 1 -- 172.21.15.59:0/619014423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f482804e530 con 0x7f4828073340 2023-10-08T12:33:35.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.113+0000 7f4824ff9700 1 -- 172.21.15.59:0/619014423 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v26)=0 v26) v1 ==== 133+0+0 (secure 0 0 0) 0x7f482804e530 con 0x7f4828073340 2023-10-08T12:33:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.116+0000 7f482e02e700 1 -- 172.21.15.59:0/619014423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48100a1440 msgr2=0x7f48100a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.116+0000 7f482e02e700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48100a1440 0x7f48100a3900 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4818006010 tx=0x7f481800b260 comp rx=0 tx=0).stop 2023-10-08T12:33:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.116+0000 7f482e02e700 1 -- 172.21.15.59:0/619014423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4828073340 msgr2=0x7f4828199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.116+0000 7f482e02e700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4828073340 0x7f4828199400 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f481c00eb30 tx=0x7f481c00eef0 comp rx=0 tx=0).stop 2023-10-08T12:33:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.116+0000 7f482e02e700 1 -- 172.21.15.59:0/619014423 shutdown_connections 2023-10-08T12:33:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.116+0000 7f482e02e700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48100a1440 0x7f48100a3900 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4818006010 tx=0x7f481800b260 comp rx=0 tx=0).stop 2023-10-08T12:33:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.116+0000 7f482e02e700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4828072a20 0x7f4828198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.116+0000 7f482e02e700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482810d250 0x7f482819d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.116+0000 7f482e02e700 1 --2- 172.21.15.59:0/619014423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4828073340 0x7f4828199400 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.116+0000 7f482e02e700 1 -- 172.21.15.59:0/619014423 >> 172.21.15.59:0/619014423 conn(0x7f48280779e0 msgr2=0x7f48280fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.117+0000 7f482e02e700 1 -- 172.21.15.59:0/619014423 shutdown_connections 2023-10-08T12:33:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:35.117+0000 7f482e02e700 1 -- 172.21.15.59:0/619014423 wait complete. 2023-10-08T12:33:36.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:35 smithi059 ceph-mon[98489]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:36.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:35 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3800430348' entity='client.admin' 2023-10-08T12:33:36.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:35 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:36.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:35 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/619014423' entity='client.admin' 2023-10-08T12:33:36.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:35 smithi092 ceph-mon[134093]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:36.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:35 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3800430348' entity='client.admin' 2023-10-08T12:33:36.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:35 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:36.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:35 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/619014423' entity='client.admin' 2023-10-08T12:33:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:35 smithi173 ceph-mon[135182]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:35 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3800430348' entity='client.admin' 2023-10-08T12:33:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:35 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:35 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/619014423' entity='client.admin' 2023-10-08T12:33:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.040+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/371172797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e781057c0 msgr2=0x7f0e78105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.040+0000 7f0e7dfbd700 1 --2- 172.21.15.59:0/371172797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e781057c0 0x7f0e78105ba0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009990 tx=0x7f0e68009ca0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.040+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/371172797 shutdown_connections 2023-10-08T12:33:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.040+0000 7f0e7dfbd700 1 --2- 172.21.15.59:0/371172797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e78101260 0x7f0e7810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.040+0000 7f0e7dfbd700 1 --2- 172.21.15.59:0/371172797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e781057c0 0x7f0e78105ba0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.040+0000 7f0e7dfbd700 1 --2- 172.21.15.59:0/371172797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e781008a0 0x7f0e78100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.040+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/371172797 >> 172.21.15.59:0/371172797 conn(0x7f0e780779e0 msgr2=0x7f0e78077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.040+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/371172797 shutdown_connections 2023-10-08T12:33:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.040+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/371172797 wait complete. 2023-10-08T12:33:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.041+0000 7f0e7dfbd700 1 Processor -- start 2023-10-08T12:33:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.041+0000 7f0e7dfbd700 1 -- start start 2023-10-08T12:33:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e7dfbd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e781008a0 0x7f0e78198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e7dfbd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e78101260 0x7f0e781993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e7dfbd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e781057c0 0x7f0e7819d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e7dfbd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7819dda0 con 0x7f0e781057c0 2023-10-08T12:33:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e7dfbd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7819df10 con 0x7f0e78101260 2023-10-08T12:33:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e7dfbd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7819e0d0 con 0x7f0e781008a0 2023-10-08T12:33:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e777fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e781008a0 0x7f0e78198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e777fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e781008a0 0x7f0e78198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44740/0 (socket says 172.21.15.59:44740) 2023-10-08T12:33:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e777fe700 1 -- 172.21.15.59:0/1858287955 learned_addr learned my addr 172.21.15.59:0/1858287955 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e777fe700 1 -- 172.21.15.59:0/1858287955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e78101260 msgr2=0x7f0e781993e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:33:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e777fe700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e78101260 0x7f0e781993e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e777fe700 1 -- 172.21.15.59:0/1858287955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e781057c0 msgr2=0x7f0e7819d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.042+0000 7f0e777fe700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e781057c0 0x7f0e7819d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.043+0000 7f0e777fe700 1 -- 172.21.15.59:0/1858287955 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680095f0 con 0x7f0e781008a0 2023-10-08T12:33:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.043+0000 7f0e777fe700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e781008a0 0x7f0e78198ea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0e68000c00 tx=0x7f0e68005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.043+0000 7f0e74ff9700 1 -- 172.21.15.59:0/1858287955 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6801d070 con 0x7f0e781008a0 2023-10-08T12:33:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.043+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/1858287955 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7819e350 con 0x7f0e781008a0 2023-10-08T12:33:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.043+0000 7f0e74ff9700 1 -- 172.21.15.59:0/1858287955 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e68022470 con 0x7f0e781008a0 2023-10-08T12:33:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.043+0000 7f0e74ff9700 1 -- 172.21.15.59:0/1858287955 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68017650 con 0x7f0e781008a0 2023-10-08T12:33:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.043+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/1858287955 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e781a5c10 con 0x7f0e781008a0 2023-10-08T12:33:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.045+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/1858287955 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e78101f30 con 0x7f0e781008a0 2023-10-08T12:33:37.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.047+0000 7f0e74ff9700 1 -- 172.21.15.59:0/1858287955 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f0e680225e0 con 0x7f0e781008a0 2023-10-08T12:33:37.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.049+0000 7f0e74ff9700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e600a14c0 0x7f0e600a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:37.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.049+0000 7f0e74ff9700 1 -- 172.21.15.59:0/1858287955 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f0e680cc340 con 0x7f0e781008a0 2023-10-08T12:33:37.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.053+0000 7f0e76ffd700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e600a14c0 0x7f0e600a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:37.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.053+0000 7f0e74ff9700 1 -- 172.21.15.59:0/1858287955 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0e6805d100 con 0x7f0e781008a0 2023-10-08T12:33:37.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.053+0000 7f0e76ffd700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e600a14c0 0x7f0e600a3980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0e7819a400 tx=0x7f0e6c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.331+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/1858287955 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7f0e7804e4c0 con 0x7f0e781008a0 2023-10-08T12:33:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.337+0000 7f0e74ff9700 1 -- 172.21.15.59:0/1858287955 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v27)=0 v27) v1 ==== 116+0+0 (secure 0 0 0) 0x7f0e68095e60 con 0x7f0e781008a0 2023-10-08T12:33:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.340+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/1858287955 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e600a14c0 msgr2=0x7f0e600a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.340+0000 7f0e7dfbd700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e600a14c0 0x7f0e600a3980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0e7819a400 tx=0x7f0e6c009260 comp rx=0 tx=0).stop 2023-10-08T12:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.340+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/1858287955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e781008a0 msgr2=0x7f0e78198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.340+0000 7f0e7dfbd700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e781008a0 0x7f0e78198ea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0e68000c00 tx=0x7f0e68005740 comp rx=0 tx=0).stop 2023-10-08T12:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.340+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/1858287955 shutdown_connections 2023-10-08T12:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.340+0000 7f0e7dfbd700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e600a14c0 0x7f0e600a3980 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.340+0000 7f0e7dfbd700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e781057c0 0x7f0e7819d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.340+0000 7f0e7dfbd700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e781008a0 0x7f0e78198ea0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.340+0000 7f0e7dfbd700 1 --2- 172.21.15.59:0/1858287955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e78101260 0x7f0e781993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.341+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/1858287955 >> 172.21.15.59:0/1858287955 conn(0x7f0e780779e0 msgr2=0x7f0e7810ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:37.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.341+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/1858287955 shutdown_connections 2023-10-08T12:33:37.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.341+0000 7f0e7dfbd700 1 -- 172.21.15.59:0/1858287955 wait complete. 2023-10-08T12:33:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.303+0000 7f38a8916700 1 -- 172.21.15.59:0/2064747257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a41017a0 msgr2=0x7f38a4101b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.303+0000 7f38a8916700 1 --2- 172.21.15.59:0/2064747257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a41017a0 0x7f38a4101b80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f38940099c0 tx=0x7f3894009cd0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.309+0000 7f38a8916700 1 -- 172.21.15.59:0/2064747257 shutdown_connections 2023-10-08T12:33:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.309+0000 7f38a8916700 1 --2- 172.21.15.59:0/2064747257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38a4106d30 0x7f38a410d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.309+0000 7f38a8916700 1 --2- 172.21.15.59:0/2064747257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a41017a0 0x7f38a4101b80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.309+0000 7f38a8916700 1 --2- 172.21.15.59:0/2064747257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38a4102150 0x7f38a4106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.309+0000 7f38a8916700 1 -- 172.21.15.59:0/2064747257 >> 172.21.15.59:0/2064747257 conn(0x7f38a40fb030 msgr2=0x7f38a40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.309+0000 7f38a8916700 1 -- 172.21.15.59:0/2064747257 shutdown_connections 2023-10-08T12:33:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.309+0000 7f38a8916700 1 -- 172.21.15.59:0/2064747257 wait complete. 2023-10-08T12:33:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.310+0000 7f38a8916700 1 Processor -- start 2023-10-08T12:33:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.311+0000 7f38a8916700 1 -- start start 2023-10-08T12:33:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.311+0000 7f38a8916700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38a41017a0 0x7f38a4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.311+0000 7f38a8916700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a4102150 0x7f38a4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.311+0000 7f38a8916700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38a4106d30 0x7f38a419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.311+0000 7f38a8916700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a419dcc0 con 0x7f38a4102150 2023-10-08T12:33:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.311+0000 7f38a8916700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a419de30 con 0x7f38a41017a0 2023-10-08T12:33:37.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.311+0000 7f38a8916700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a419dff0 con 0x7f38a4106d30 2023-10-08T12:33:37.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.312+0000 7f38a37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38a41017a0 0x7f38a4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:37.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.312+0000 7f38a3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38a4106d30 0x7f38a419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:37.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.312+0000 7f38a37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38a41017a0 0x7f38a4198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50182/0 (socket says 172.21.15.59:50182) 2023-10-08T12:33:37.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.312+0000 7f38a37fe700 1 -- 172.21.15.59:0/723430379 learned_addr learned my addr 172.21.15.59:0/723430379 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:37.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.312+0000 7f38a37fe700 1 -- 172.21.15.59:0/723430379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38a4106d30 msgr2=0x7f38a419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.312+0000 7f38a37fe700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38a4106d30 0x7f38a419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.312+0000 7f38a37fe700 1 -- 172.21.15.59:0/723430379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a4102150 msgr2=0x7f38a4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.312+0000 7f38a37fe700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a4102150 0x7f38a4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.312+0000 7f38a37fe700 1 -- 172.21.15.59:0/723430379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898009520 con 0x7f38a41017a0 2023-10-08T12:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.312+0000 7f38a37fe700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38a41017a0 0x7f38a4198dc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f38940036c0 tx=0x7f389400f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.313+0000 7f38a0ff9700 1 -- 172.21.15.59:0/723430379 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389401d070 con 0x7f38a41017a0 2023-10-08T12:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.313+0000 7f38a8916700 1 -- 172.21.15.59:0/723430379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38940095f0 con 0x7f38a41017a0 2023-10-08T12:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.313+0000 7f38a0ff9700 1 -- 172.21.15.59:0/723430379 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3894022470 con 0x7f38a41017a0 2023-10-08T12:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.313+0000 7f38a0ff9700 1 -- 172.21.15.59:0/723430379 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894017650 con 0x7f38a41017a0 2023-10-08T12:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.313+0000 7f38a8916700 1 -- 172.21.15.59:0/723430379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a41a5960 con 0x7f38a41017a0 2023-10-08T12:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.314+0000 7f38a8916700 1 -- 172.21.15.59:0/723430379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a410adc0 con 0x7f38a41017a0 2023-10-08T12:33:37.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.316+0000 7f38a0ff9700 1 -- 172.21.15.59:0/723430379 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f38940225e0 con 0x7f38a41017a0 2023-10-08T12:33:37.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.318+0000 7f38a0ff9700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f388c0a14c0 0x7f388c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:37.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.318+0000 7f38a0ff9700 1 -- 172.21.15.59:0/723430379 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f38940cc320 con 0x7f38a41017a0 2023-10-08T12:33:37.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.319+0000 7f38a2ffd700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f388c0a14c0 0x7f388c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:37.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.319+0000 7f38a0ff9700 1 -- 172.21.15.59:0/723430379 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f38940975f0 con 0x7f38a41017a0 2023-10-08T12:33:37.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.320+0000 7f38a2ffd700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f388c0a14c0 0x7f388c0a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3898005d90 tx=0x7f3898005ce0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:37.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.586+0000 7f38a8916700 1 -- 172.21.15.59:0/723430379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f38a404e4c0 con 0x7f38a41017a0 2023-10-08T12:33:37.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.593+0000 7f38a0ff9700 1 -- 172.21.15.59:0/723430379 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) v1 ==== 121+0+0 (secure 0 0 0) 0x7f38940270c0 con 0x7f38a41017a0 2023-10-08T12:33:37.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 -- 172.21.15.59:0/723430379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f388c0a14c0 msgr2=0x7f388c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:37.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f388c0a14c0 0x7f388c0a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3898005d90 tx=0x7f3898005ce0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 -- 172.21.15.59:0/723430379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38a41017a0 msgr2=0x7f38a4198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:37.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38a41017a0 0x7f38a4198dc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f38940036c0 tx=0x7f389400f690 comp rx=0 tx=0).stop 2023-10-08T12:33:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 -- 172.21.15.59:0/723430379 shutdown_connections 2023-10-08T12:33:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f388c0a14c0 0x7f388c0a3980 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38a41017a0 0x7f38a4198dc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38a4106d30 0x7f38a419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 --2- 172.21.15.59:0/723430379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a4102150 0x7f38a4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 -- 172.21.15.59:0/723430379 >> 172.21.15.59:0/723430379 conn(0x7f38a40fb030 msgr2=0x7f38a40fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 -- 172.21.15.59:0/723430379 shutdown_connections 2023-10-08T12:33:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:37.596+0000 7f38a8916700 1 -- 172.21.15.59:0/723430379 wait complete. 2023-10-08T12:33:37.874 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:37 smithi059 ceph-mon[98489]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:37.874 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:37.874 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:37.874 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:37.875 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:37.875 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:37.875 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:37.875 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:37 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:37.875 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:37 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:37 smithi092 ceph-mon[134093]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:38.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:38.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:37 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:38.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:37 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:37 smithi173 ceph-mon[135182]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:38.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:38.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:38.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:37 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:38.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:37 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.028+0000 7f041d110700 1 -- 172.21.15.59:0/2161078473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0418100190 msgr2=0x7f0418100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.028+0000 7f041d110700 1 --2- 172.21.15.59:0/2161078473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0418100190 0x7f0418100570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0408009990 tx=0x7f0408009ca0 comp rx=0 tx=0).stop 2023-10-08T12:33:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.028+0000 7f041d110700 1 -- 172.21.15.59:0/2161078473 shutdown_connections 2023-10-08T12:33:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.028+0000 7f041d110700 1 --2- 172.21.15.59:0/2161078473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0418100190 0x7f0418100570 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.028+0000 7f041d110700 1 --2- 172.21.15.59:0/2161078473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041810d200 0x7f041810f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.028+0000 7f041d110700 1 --2- 172.21.15.59:0/2161078473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0418100ab0 0x7f041810ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.028+0000 7f041d110700 1 -- 172.21.15.59:0/2161078473 >> 172.21.15.59:0/2161078473 conn(0x7f04180767f0 msgr2=0x7f0418076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.028+0000 7f041d110700 1 -- 172.21.15.59:0/2161078473 shutdown_connections 2023-10-08T12:33:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.029+0000 7f041d110700 1 -- 172.21.15.59:0/2161078473 wait complete. 2023-10-08T12:33:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.029+0000 7f041d110700 1 Processor -- start 2023-10-08T12:33:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f041d110700 1 -- start start 2023-10-08T12:33:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f041d110700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0418100190 0x7f0418198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f041d110700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0418100ab0 0x7f0418199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f041d110700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041810d200 0x7f041819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f041d110700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041819dd00 con 0x7f0418100190 2023-10-08T12:33:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f041d110700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041819de70 con 0x7f0418100ab0 2023-10-08T12:33:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f041d110700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041819e030 con 0x7f041810d200 2023-10-08T12:33:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f0416d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0418100190 0x7f0418198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f0416d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0418100190 0x7f0418198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51196/0 (socket says 172.21.15.59:51196) 2023-10-08T12:33:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f0416d9d700 1 -- 172.21.15.59:0/3076007928 learned_addr learned my addr 172.21.15.59:0/3076007928 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f041659c700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0418100ab0 0x7f0418199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:38.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.030+0000 7f041759e700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041810d200 0x7f041819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:38.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.031+0000 7f0416d9d700 1 -- 172.21.15.59:0/3076007928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041810d200 msgr2=0x7f041819d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:38.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.031+0000 7f0416d9d700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041810d200 0x7f041819d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:38.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.031+0000 7f0416d9d700 1 -- 172.21.15.59:0/3076007928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0418100ab0 msgr2=0x7f0418199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:38.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.031+0000 7f0416d9d700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0418100ab0 0x7f0418199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:38.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.031+0000 7f0416d9d700 1 -- 172.21.15.59:0/3076007928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04080095f0 con 0x7f0418100190 2023-10-08T12:33:38.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.031+0000 7f041659c700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0418100ab0 0x7f0418199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:33:38.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.031+0000 7f0416d9d700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0418100190 0x7f0418198e00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0408005910 tx=0x7f0408004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:38.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.031+0000 7f03fffff700 1 -- 172.21.15.59:0/3076007928 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040801d070 con 0x7f0418100190 2023-10-08T12:33:38.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.031+0000 7f041d110700 1 -- 172.21.15.59:0/3076007928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041819e2b0 con 0x7f0418100190 2023-10-08T12:33:38.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.031+0000 7f03fffff700 1 -- 172.21.15.59:0/3076007928 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0408022470 con 0x7f0418100190 2023-10-08T12:33:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.031+0000 7f03fffff700 1 -- 172.21.15.59:0/3076007928 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408017650 con 0x7f0418100190 2023-10-08T12:33:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.032+0000 7f041d110700 1 -- 172.21.15.59:0/3076007928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04181a5b70 con 0x7f0418100190 2023-10-08T12:33:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.033+0000 7f03fdffb700 1 -- 172.21.15.59:0/3076007928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f80052f0 con 0x7f0418100190 2023-10-08T12:33:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.035+0000 7f03fffff700 1 -- 172.21.15.59:0/3076007928 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f04080225e0 con 0x7f0418100190 2023-10-08T12:33:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.036+0000 7f03fffff700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04000a1440 0x7f04000a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.036+0000 7f03fffff700 1 -- 172.21.15.59:0/3076007928 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f04080cc890 con 0x7f0418100190 2023-10-08T12:33:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.036+0000 7f041659c700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04000a1440 0x7f04000a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.037+0000 7f041659c700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04000a1440 0x7f04000a3900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f041819a360 tx=0x7f040c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.041+0000 7f03fffff700 1 -- 172.21.15.59:0/3076007928 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0408097ae0 con 0x7f0418100190 2023-10-08T12:33:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.252+0000 7f03fdffb700 1 -- 172.21.15.59:0/3076007928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f03f8005160 con 0x7f0418100190 2023-10-08T12:33:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.256+0000 7f03fffff700 1 -- 172.21.15.59:0/3076007928 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v29)=0 v29) v1 ==== 120+0+0 (secure 0 0 0) 0x7f040809b100 con 0x7f0418100190 2023-10-08T12:33:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 -- 172.21.15.59:0/3076007928 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04000a1440 msgr2=0x7f04000a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04000a1440 0x7f04000a3900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f041819a360 tx=0x7f040c009260 comp rx=0 tx=0).stop 2023-10-08T12:33:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 -- 172.21.15.59:0/3076007928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0418100190 msgr2=0x7f0418198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0418100190 0x7f0418198e00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0408005910 tx=0x7f0408004730 comp rx=0 tx=0).stop 2023-10-08T12:33:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 -- 172.21.15.59:0/3076007928 shutdown_connections 2023-10-08T12:33:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04000a1440 0x7f04000a3900 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041810d200 0x7f041819d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0418100190 0x7f0418198e00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 --2- 172.21.15.59:0/3076007928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0418100ab0 0x7f0418199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 -- 172.21.15.59:0/3076007928 >> 172.21.15.59:0/3076007928 conn(0x7f04180767f0 msgr2=0x7f041810e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 -- 172.21.15.59:0/3076007928 shutdown_connections 2023-10-08T12:33:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:38.259+0000 7f03fdffb700 1 -- 172.21.15.59:0/3076007928 wait complete. 2023-10-08T12:33:39.004 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi059') 2023-10-08T12:33:39.005 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi059') 2023-10-08T12:33:39.005 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi059') 2023-10-08T12:33:39.005 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi059') 2023-10-08T12:33:39.005 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi059') 2023-10-08T12:33:39.456 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:39 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3076007928' entity='client.admin' 2023-10-08T12:33:39.456 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:39 smithi059 ceph-mon[98489]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:39.626 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:39 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3076007928' entity='client.admin' 2023-10-08T12:33:39.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:39 smithi092 ceph-mon[134093]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:39.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:39 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3076007928' entity='client.admin' 2023-10-08T12:33:39.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:39 smithi173 ceph-mon[135182]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:40.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.399+0000 7f10a5d14700 1 -- 172.21.15.59:0/1887115900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a0103250 msgr2=0x7f10a0103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:40.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.399+0000 7f10a5d14700 1 --2- 172.21.15.59:0/1887115900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a0103250 0x7f10a0103700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f109800b0a0 tx=0x7f109800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.399+0000 7f10a5d14700 1 -- 172.21.15.59:0/1887115900 shutdown_connections 2023-10-08T12:33:40.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.399+0000 7f10a5d14700 1 --2- 172.21.15.59:0/1887115900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a0103250 0x7f10a0103700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.399+0000 7f10a5d14700 1 --2- 172.21.15.59:0/1887115900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a01056f0 0x7f10a0068190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.399+0000 7f10a5d14700 1 --2- 172.21.15.59:0/1887115900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a00686d0 0x7f10a0068b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.399+0000 7f10a5d14700 1 -- 172.21.15.59:0/1887115900 >> 172.21.15.59:0/1887115900 conn(0x7f10a0075790 msgr2=0x7f10a0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:40.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.400+0000 7f10a5d14700 1 -- 172.21.15.59:0/1887115900 shutdown_connections 2023-10-08T12:33:40.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.400+0000 7f10a5d14700 1 -- 172.21.15.59:0/1887115900 wait complete. 2023-10-08T12:33:40.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.401+0000 7f10a5d14700 1 Processor -- start 2023-10-08T12:33:40.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.401+0000 7f10a5d14700 1 -- start start 2023-10-08T12:33:40.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.401+0000 7f10a5d14700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a00686d0 0x7f10a019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:40.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.401+0000 7f10a5d14700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a0103250 0x7f10a019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:40.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.401+0000 7f10a5d14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a01056f0 0x7f10a01a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:40.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.401+0000 7f10a5d14700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a01a2060 con 0x7f10a01056f0 2023-10-08T12:33:40.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.401+0000 7f10a5d14700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a01a21d0 con 0x7f10a00686d0 2023-10-08T12:33:40.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.401+0000 7f10a5d14700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a01a2390 con 0x7f10a0103250 2023-10-08T12:33:40.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.402+0000 7f109f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a00686d0 0x7f10a019d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:40.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.402+0000 7f109ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a01056f0 0x7f10a01a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:40.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.402+0000 7f109f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a00686d0 0x7f10a019d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50214/0 (socket says 172.21.15.59:50214) 2023-10-08T12:33:40.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.402+0000 7f109f7fe700 1 -- 172.21.15.59:0/798980182 learned_addr learned my addr 172.21.15.59:0/798980182 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:40.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.402+0000 7f109effd700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a0103250 0x7f10a019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:40.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.402+0000 7f109f7fe700 1 -- 172.21.15.59:0/798980182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a0103250 msgr2=0x7f10a019d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:40.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.402+0000 7f109f7fe700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a0103250 0x7f10a019d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.402+0000 7f109f7fe700 1 -- 172.21.15.59:0/798980182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a01056f0 msgr2=0x7f10a01a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.402+0000 7f109f7fe700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a01056f0 0x7f10a01a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.402+0000 7f109f7fe700 1 -- 172.21.15.59:0/798980182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1098009d00 con 0x7f10a00686d0 2023-10-08T12:33:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.402+0000 7f109f7fe700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a00686d0 0x7f10a019d1b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f109000e9a0 tx=0x7f109000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.403+0000 7f109cff9700 1 -- 172.21.15.59:0/798980182 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090009790 con 0x7f10a00686d0 2023-10-08T12:33:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.403+0000 7f109cff9700 1 -- 172.21.15.59:0/798980182 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1090010430 con 0x7f10a00686d0 2023-10-08T12:33:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.403+0000 7f10a5d14700 1 -- 172.21.15.59:0/798980182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a01a2670 con 0x7f10a00686d0 2023-10-08T12:33:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.403+0000 7f109cff9700 1 -- 172.21.15.59:0/798980182 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090018680 con 0x7f10a00686d0 2023-10-08T12:33:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.403+0000 7f10a5d14700 1 -- 172.21.15.59:0/798980182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a01a9ed0 con 0x7f10a00686d0 2023-10-08T12:33:40.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.404+0000 7f10a5d14700 1 -- 172.21.15.59:0/798980182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a00ffd30 con 0x7f10a00686d0 2023-10-08T12:33:40.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.406+0000 7f109cff9700 1 -- 172.21.15.59:0/798980182 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f109000ca10 con 0x7f10a00686d0 2023-10-08T12:33:40.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.407+0000 7f109cff9700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10880a1440 0x7f10880a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.407+0000 7f109cff9700 1 -- 172.21.15.59:0/798980182 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f1090014070 con 0x7f10a00686d0 2023-10-08T12:33:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.407+0000 7f109effd700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10880a1440 0x7f10880a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.408+0000 7f109effd700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10880a1440 0x7f10880a3900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10a019e6c0 tx=0x7f1094009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.411+0000 7f109cff9700 1 -- 172.21.15.59:0/798980182 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f10900964b0 con 0x7f10a00686d0 2023-10-08T12:33:40.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.642+0000 7f10a5d14700 1 -- 172.21.15.59:0/798980182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) v1 -- 0x7f10a004e4c0 con 0x7f10a00686d0 2023-10-08T12:33:40.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.648+0000 7f109cff9700 1 -- 172.21.15.59:0/798980182 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v30)=0 v30) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1090099ad0 con 0x7f10a00686d0 2023-10-08T12:33:40.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 -- 172.21.15.59:0/798980182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10880a1440 msgr2=0x7f10880a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:40.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10880a1440 0x7f10880a3900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10a019e6c0 tx=0x7f1094009260 comp rx=0 tx=0).stop 2023-10-08T12:33:40.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 -- 172.21.15.59:0/798980182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a00686d0 msgr2=0x7f10a019d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a00686d0 0x7f10a019d1b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f109000e9a0 tx=0x7f109000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 -- 172.21.15.59:0/798980182 shutdown_connections 2023-10-08T12:33:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10880a1440 0x7f10880a3900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a00686d0 0x7f10a019d1b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a01056f0 0x7f10a01a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 --2- 172.21.15.59:0/798980182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a0103250 0x7f10a019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 -- 172.21.15.59:0/798980182 >> 172.21.15.59:0/798980182 conn(0x7f10a0075790 msgr2=0x7f10a0102230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 -- 172.21.15.59:0/798980182 shutdown_connections 2023-10-08T12:33:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.651+0000 7f10a5d14700 1 -- 172.21.15.59:0/798980182 wait complete. 2023-10-08T12:33:40.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.895+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2920962809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d481057c0 msgr2=0x7f7d48105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:40.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.895+0000 7f7d4ded0700 1 --2- 172.21.15.59:0/2920962809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d481057c0 0x7f7d48105ba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009990 tx=0x7f7d38009ca0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.895+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2920962809 shutdown_connections 2023-10-08T12:33:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.895+0000 7f7d4ded0700 1 --2- 172.21.15.59:0/2920962809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d48101260 0x7f7d4810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.895+0000 7f7d4ded0700 1 --2- 172.21.15.59:0/2920962809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d481057c0 0x7f7d48105ba0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.895+0000 7f7d4ded0700 1 --2- 172.21.15.59:0/2920962809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d481008a0 0x7f7d48100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.895+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2920962809 >> 172.21.15.59:0/2920962809 conn(0x7f7d480779e0 msgr2=0x7f7d48077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.895+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2920962809 shutdown_connections 2023-10-08T12:33:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.895+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2920962809 wait complete. 2023-10-08T12:33:40.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.896+0000 7f7d4ded0700 1 Processor -- start 2023-10-08T12:33:40.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.896+0000 7f7d4ded0700 1 -- start start 2023-10-08T12:33:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d4ded0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d481008a0 0x7f7d48198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d4ded0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d48101260 0x7f7d48199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d4ded0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d481057c0 0x7f7d4819d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d4ded0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4819ddd0 con 0x7f7d48101260 2023-10-08T12:33:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d4ded0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4819df40 con 0x7f7d481008a0 2023-10-08T12:33:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d4ded0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4819e100 con 0x7f7d481057c0 2023-10-08T12:33:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d477fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d481008a0 0x7f7d48198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d46ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d48101260 0x7f7d48199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d477fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d481008a0 0x7f7d48198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48716/0 (socket says 172.21.15.59:48716) 2023-10-08T12:33:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d477fe700 1 -- 172.21.15.59:0/2892425187 learned_addr learned my addr 172.21.15.59:0/2892425187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:40.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d47fff700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d481057c0 0x7f7d4819d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:40.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d477fe700 1 -- 172.21.15.59:0/2892425187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d481057c0 msgr2=0x7f7d4819d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:40.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d477fe700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d481057c0 0x7f7d4819d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d477fe700 1 -- 172.21.15.59:0/2892425187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d48101260 msgr2=0x7f7d48199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:40.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d477fe700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d48101260 0x7f7d48199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:40.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d477fe700 1 -- 172.21.15.59:0/2892425187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d380095f0 con 0x7f7d481008a0 2023-10-08T12:33:40.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.897+0000 7f7d46ffd700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d48101260 0x7f7d48199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:40.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.898+0000 7f7d477fe700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d481008a0 0x7f7d48198ed0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000c00 tx=0x7f7d38005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:40.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.898+0000 7f7d44ff9700 1 -- 172.21.15.59:0/2892425187 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3801d070 con 0x7f7d481008a0 2023-10-08T12:33:40.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.898+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2892425187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4819e380 con 0x7f7d481008a0 2023-10-08T12:33:40.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.898+0000 7f7d44ff9700 1 -- 172.21.15.59:0/2892425187 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d38022470 con 0x7f7d481008a0 2023-10-08T12:33:40.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.898+0000 7f7d44ff9700 1 -- 172.21.15.59:0/2892425187 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38017650 con 0x7f7d481008a0 2023-10-08T12:33:40.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.898+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2892425187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d481a5c40 con 0x7f7d481008a0 2023-10-08T12:33:40.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.899+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2892425187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d48101f30 con 0x7f7d481008a0 2023-10-08T12:33:40.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.901+0000 7f7d44ff9700 1 -- 172.21.15.59:0/2892425187 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f7d3800fad0 con 0x7f7d481008a0 2023-10-08T12:33:40.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.902+0000 7f7d44ff9700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d300a1440 0x7f7d300a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:40.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.903+0000 7f7d44ff9700 1 -- 172.21.15.59:0/2892425187 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f7d380cc5a0 con 0x7f7d481008a0 2023-10-08T12:33:40.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.903+0000 7f7d46ffd700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d300a1440 0x7f7d300a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:40.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.903+0000 7f7d46ffd700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d300a1440 0x7f7d300a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7d4819a430 tx=0x7f7d3c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:40.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:40.904+0000 7f7d44ff9700 1 -- 172.21.15.59:0/2892425187 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7d380977f0 con 0x7f7d481008a0 2023-10-08T12:33:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.087+0000 7fa316a5f700 1 -- 172.21.15.59:0/1808059983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31010ce30 msgr2=0x7fa31010f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.087+0000 7fa316a5f700 1 --2- 172.21.15.59:0/1808059983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31010ce30 0x7fa31010f2a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa30800b0a0 tx=0x7fa30800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.087+0000 7fa316a5f700 1 -- 172.21.15.59:0/1808059983 shutdown_connections 2023-10-08T12:33:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.087+0000 7fa316a5f700 1 --2- 172.21.15.59:0/1808059983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa310072c20 0x7fa310073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.087+0000 7fa316a5f700 1 --2- 172.21.15.59:0/1808059983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa31010ce30 0x7fa31010f2a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.087+0000 7fa316a5f700 1 --2- 172.21.15.59:0/1808059983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa310073540 0x7fa31010c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.087+0000 7fa316a5f700 1 -- 172.21.15.59:0/1808059983 >> 172.21.15.59:0/1808059983 conn(0x7fa3100fc120 msgr2=0x7fa3100fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.088+0000 7fa316a5f700 1 -- 172.21.15.59:0/1808059983 shutdown_connections 2023-10-08T12:33:41.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.088+0000 7fa316a5f700 1 -- 172.21.15.59:0/1808059983 wait complete. 2023-10-08T12:33:41.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.089+0000 7fa316a5f700 1 Processor -- start 2023-10-08T12:33:41.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.089+0000 7fa316a5f700 1 -- start start 2023-10-08T12:33:41.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.090+0000 7fa316a5f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa310072c20 0x7fa310198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:41.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.090+0000 7fa316a5f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa310073540 0x7fa310199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:41.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.090+0000 7fa316a5f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa31010ce30 0x7fa31019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:41.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.090+0000 7fa316a5f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31019dca0 con 0x7fa310073540 2023-10-08T12:33:41.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.090+0000 7fa316a5f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31019de10 con 0x7fa310072c20 2023-10-08T12:33:41.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.090+0000 7fa316a5f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31019dfd0 con 0x7fa31010ce30 2023-10-08T12:33:41.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.090+0000 7fa31525c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa310073540 0x7fa310199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:41.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.090+0000 7fa31525c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa310073540 0x7fa310199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50026/0 (socket says 172.21.15.59:50026) 2023-10-08T12:33:41.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.090+0000 7fa31525c700 1 -- 172.21.15.59:0/3106567197 learned_addr learned my addr 172.21.15.59:0/3106567197 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:41.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.090+0000 7fa31625e700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa31010ce30 0x7fa31019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:41.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.090+0000 7fa315a5d700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa310072c20 0x7fa310198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.091+0000 7fa31525c700 1 -- 172.21.15.59:0/3106567197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa31010ce30 msgr2=0x7fa31019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.091+0000 7fa31525c700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa31010ce30 0x7fa31019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.091+0000 7fa31525c700 1 -- 172.21.15.59:0/3106567197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa310072c20 msgr2=0x7fa310198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.091+0000 7fa31525c700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa310072c20 0x7fa310198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.091+0000 7fa31525c700 1 -- 172.21.15.59:0/3106567197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa308009d00 con 0x7fa310073540 2023-10-08T12:33:41.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.091+0000 7fa31525c700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa310073540 0x7fa310199330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa30000e9a0 tx=0x7fa30000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:41.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.091+0000 7fa306ffd700 1 -- 172.21.15.59:0/3106567197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300009790 con 0x7fa310073540 2023-10-08T12:33:41.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.091+0000 7fa316a5f700 1 -- 172.21.15.59:0/3106567197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31019e2b0 con 0x7fa310073540 2023-10-08T12:33:41.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.091+0000 7fa306ffd700 1 -- 172.21.15.59:0/3106567197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa300010430 con 0x7fa310073540 2023-10-08T12:33:41.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.091+0000 7fa306ffd700 1 -- 172.21.15.59:0/3106567197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300018680 con 0x7fa310073540 2023-10-08T12:33:41.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.091+0000 7fa316a5f700 1 -- 172.21.15.59:0/3106567197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3101a5b10 con 0x7fa310073540 2023-10-08T12:33:41.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.092+0000 7fa316a5f700 1 -- 172.21.15.59:0/3106567197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa310108040 con 0x7fa310073540 2023-10-08T12:33:41.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.094+0000 7fa306ffd700 1 -- 172.21.15.59:0/3106567197 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fa3000105a0 con 0x7fa310073540 2023-10-08T12:33:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.096+0000 7fa306ffd700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2fc0a1440 0x7fa2fc0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.096+0000 7fa306ffd700 1 -- 172.21.15.59:0/3106567197 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa300014070 con 0x7fa310073540 2023-10-08T12:33:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.096+0000 7fa315a5d700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2fc0a1440 0x7fa2fc0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.097+0000 7fa315a5d700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2fc0a1440 0x7fa2fc0a3900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009c60 tx=0x7fa30c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:41.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.102+0000 7fa306ffd700 1 -- 172.21.15.59:0/3106567197 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa3000966a0 con 0x7fa310073540 2023-10-08T12:33:41.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.125+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2892425187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f7d4804e4c0 con 0x7f7d481008a0 2023-10-08T12:33:41.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.130+0000 7f7d44ff9700 1 -- 172.21.15.59:0/2892425187 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7d3809ae10 con 0x7f7d481008a0 2023-10-08T12:33:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.133+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2892425187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d300a1440 msgr2=0x7f7d300a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.133+0000 7f7d4ded0700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d300a1440 0x7f7d300a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7d4819a430 tx=0x7f7d3c009260 comp rx=0 tx=0).stop 2023-10-08T12:33:41.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.133+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2892425187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d481008a0 msgr2=0x7f7d48198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:41.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.133+0000 7f7d4ded0700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d481008a0 0x7f7d48198ed0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000c00 tx=0x7f7d38005740 comp rx=0 tx=0).stop 2023-10-08T12:33:41.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.133+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2892425187 shutdown_connections 2023-10-08T12:33:41.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.133+0000 7f7d4ded0700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d300a1440 0x7f7d300a3900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.133+0000 7f7d4ded0700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d481008a0 0x7f7d48198ed0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.133+0000 7f7d4ded0700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d481057c0 0x7f7d4819d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.133+0000 7f7d4ded0700 1 --2- 172.21.15.59:0/2892425187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d48101260 0x7f7d48199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.133+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2892425187 >> 172.21.15.59:0/2892425187 conn(0x7f7d480779e0 msgr2=0x7f7d4810ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:41.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.134+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2892425187 shutdown_connections 2023-10-08T12:33:41.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.134+0000 7f7d4ded0700 1 -- 172.21.15.59:0/2892425187 wait complete. 2023-10-08T12:33:41.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.343+0000 7fa316a5f700 1 -- 172.21.15.59:0/3106567197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7fa31019a0b0 con 0x7fa310073540 2023-10-08T12:33:41.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.346+0000 7fa306ffd700 1 -- 172.21.15.59:0/3106567197 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v32)=0 v32) v1 ==== 119+0+0 (secure 0 0 0) 0x7fa300099cc0 con 0x7fa310073540 2023-10-08T12:33:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 -- 172.21.15.59:0/3106567197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2fc0a1440 msgr2=0x7fa2fc0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2fc0a1440 0x7fa2fc0a3900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009c60 tx=0x7fa30c009260 comp rx=0 tx=0).stop 2023-10-08T12:33:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 -- 172.21.15.59:0/3106567197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa310073540 msgr2=0x7fa310199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa310073540 0x7fa310199330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa30000e9a0 tx=0x7fa30000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 -- 172.21.15.59:0/3106567197 shutdown_connections 2023-10-08T12:33:41.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2fc0a1440 0x7fa2fc0a3900 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa310072c20 0x7fa310198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa31010ce30 0x7fa31019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 --2- 172.21.15.59:0/3106567197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa310073540 0x7fa310199330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 -- 172.21.15.59:0/3106567197 >> 172.21.15.59:0/3106567197 conn(0x7fa3100fc120 msgr2=0x7fa3100fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:41.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 -- 172.21.15.59:0/3106567197 shutdown_connections 2023-10-08T12:33:41.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.349+0000 7fa316a5f700 1 -- 172.21.15.59:0/3106567197 wait complete. 2023-10-08T12:33:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.946+0000 7f500eb7a700 1 -- 172.21.15.59:0/3446973207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5008111570 msgr2=0x7f50081139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.946+0000 7f500eb7a700 1 --2- 172.21.15.59:0/3446973207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5008111570 0x7f50081139a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f500000b0a0 tx=0x7f500000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.946+0000 7f500eb7a700 1 -- 172.21.15.59:0/3446973207 shutdown_connections 2023-10-08T12:33:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.946+0000 7f500eb7a700 1 --2- 172.21.15.59:0/3446973207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5008074770 0x7f5008072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.946+0000 7f500eb7a700 1 --2- 172.21.15.59:0/3446973207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5008111570 0x7f50081139a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.946+0000 7f500eb7a700 1 --2- 172.21.15.59:0/3446973207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008072f60 0x7f50080733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.946+0000 7f500eb7a700 1 -- 172.21.15.59:0/3446973207 >> 172.21.15.59:0/3446973207 conn(0x7f50080779e0 msgr2=0x7f5008077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:41.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.946+0000 7f500eb7a700 1 -- 172.21.15.59:0/3446973207 shutdown_connections 2023-10-08T12:33:41.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.946+0000 7f500eb7a700 1 -- 172.21.15.59:0/3446973207 wait complete. 2023-10-08T12:33:41.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.947+0000 7f500eb7a700 1 Processor -- start 2023-10-08T12:33:41.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.947+0000 7f500eb7a700 1 -- start start 2023-10-08T12:33:41.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.947+0000 7f500eb7a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5008072f60 0x7f500819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:41.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.947+0000 7f500eb7a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008074770 0x7f500819d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:41.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.947+0000 7f500eb7a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5008111570 0x7f50081a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:41.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500eb7a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50081a2310 con 0x7f5008072f60 2023-10-08T12:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500eb7a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50081a2480 con 0x7f5008111570 2023-10-08T12:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500eb7a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50081a2640 con 0x7f5008074770 2023-10-08T12:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500c916700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5008072f60 0x7f500819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500c916700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5008072f60 0x7f500819d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50038/0 (socket says 172.21.15.59:50038) 2023-10-08T12:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500c916700 1 -- 172.21.15.59:0/202738461 learned_addr learned my addr 172.21.15.59:0/202738461 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f5007fff700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008074770 0x7f500819d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500d117700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5008111570 0x7f50081a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500c916700 1 -- 172.21.15.59:0/202738461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008074770 msgr2=0x7f500819d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500c916700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008074770 0x7f500819d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500c916700 1 -- 172.21.15.59:0/202738461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5008111570 msgr2=0x7f50081a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500c916700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5008111570 0x7f50081a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:41.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500c916700 1 -- 172.21.15.59:0/202738461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5000009d00 con 0x7f5008072f60 2023-10-08T12:33:41.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.948+0000 7f500d117700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5008111570 0x7f50081a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:41.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.949+0000 7f500c916700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5008072f60 0x7f500819d410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00e9a0 tx=0x7f4ffc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:41.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.949+0000 7f5005ffb700 1 -- 172.21.15.59:0/202738461 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc009790 con 0x7f5008072f60 2023-10-08T12:33:41.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.949+0000 7f5005ffb700 1 -- 172.21.15.59:0/202738461 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ffc010430 con 0x7f5008072f60 2023-10-08T12:33:41.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.949+0000 7f5005ffb700 1 -- 172.21.15.59:0/202738461 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc018680 con 0x7f5008072f60 2023-10-08T12:33:41.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.949+0000 7f500eb7a700 1 -- 172.21.15.59:0/202738461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50081a2920 con 0x7f5008072f60 2023-10-08T12:33:41.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.949+0000 7f500eb7a700 1 -- 172.21.15.59:0/202738461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50081aa180 con 0x7f5008072f60 2023-10-08T12:33:41.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.950+0000 7f500eb7a700 1 -- 172.21.15.59:0/202738461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50080740b0 con 0x7f5008072f60 2023-10-08T12:33:41.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.952+0000 7f5005ffb700 1 -- 172.21.15.59:0/202738461 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f4ffc0105a0 con 0x7f5008072f60 2023-10-08T12:33:41.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.954+0000 7f5005ffb700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ff80a14c0 0x7f4ff80a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:41.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.954+0000 7f5005ffb700 1 -- 172.21.15.59:0/202738461 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4ffc014070 con 0x7f5008072f60 2023-10-08T12:33:41.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.954+0000 7f5007fff700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ff80a14c0 0x7f4ff80a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:41.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.955+0000 7f5007fff700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ff80a14c0 0x7f4ff80a3980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f500819e970 tx=0x7f4ff4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:41.956 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:41.956 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:41.956 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:41.956 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:41.957 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:41.957 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:41.957 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' 2023-10-08T12:33:41.957 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:41.957 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:41.957 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:41.957 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:41.957 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:41 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3106567197' entity='client.admin' 2023-10-08T12:33:41.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:41.957+0000 7f5005ffb700 1 -- 172.21.15.59:0/202738461 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4ffc096430 con 0x7f5008072f60 2023-10-08T12:33:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' 2023-10-08T12:33:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:41 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3106567197' entity='client.admin' 2023-10-08T12:33:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:42.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' 2023-10-08T12:33:42.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:42.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:42.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:42.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:33:42.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:41 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3106567197' entity='client.admin' 2023-10-08T12:33:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.191+0000 7f500eb7a700 1 -- 172.21.15.59:0/202738461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7f500819e720 con 0x7f5008072f60 2023-10-08T12:33:42.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.195+0000 7f5005ffb700 1 -- 172.21.15.59:0/202738461 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v33)=0 v33) v1 ==== 121+0+0 (secure 0 0 0) 0x7f4ffc099a50 con 0x7f5008072f60 2023-10-08T12:33:42.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 -- 172.21.15.59:0/202738461 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ff80a14c0 msgr2=0x7f4ff80a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:42.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ff80a14c0 0x7f4ff80a3980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f500819e970 tx=0x7f4ff4009260 comp rx=0 tx=0).stop 2023-10-08T12:33:42.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 -- 172.21.15.59:0/202738461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5008072f60 msgr2=0x7f500819d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5008072f60 0x7f500819d410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00e9a0 tx=0x7f4ffc00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 -- 172.21.15.59:0/202738461 shutdown_connections 2023-10-08T12:33:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ff80a14c0 0x7f4ff80a3980 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5008111570 0x7f50081a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5008072f60 0x7f500819d410 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 --2- 172.21.15.59:0/202738461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008074770 0x7f500819d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 -- 172.21.15.59:0/202738461 >> 172.21.15.59:0/202738461 conn(0x7f50080779e0 msgr2=0x7f50081101a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 -- 172.21.15.59:0/202738461 shutdown_connections 2023-10-08T12:33:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:42.198+0000 7f500eb7a700 1 -- 172.21.15.59:0/202738461 wait complete. 2023-10-08T12:33:42.426 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi059') 2023-10-08T12:33:42.426 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi059') 2023-10-08T12:33:42.426 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi059') 2023-10-08T12:33:42.426 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi059') 2023-10-08T12:33:42.426 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi059') 2023-10-08T12:33:42.427 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi059') 2023-10-08T12:33:42.427 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi059') 2023-10-08T12:33:42.771 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a005028-65d6-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi059') 2023-10-08T12:33:42.771 INFO:tasks.cephadm:Deploying OSDs... 2023-10-08T12:33:42.772 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:33:42.772 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T12:33:42.815 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T12:33:42.815 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2023-10-08T12:33:42.899 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T12:33:42.899 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:42.899 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-08T12:33:42.899 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:42.899 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:42.899 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-08 12:32:11.753300660 +0000 2023-10-08T12:33:42.899 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-08 12:25:53.389204378 +0000 2023-10-08T12:33:42.899 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-08 12:25:53.389204378 +0000 2023-10-08T12:33:42.899 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2023-10-08 12:25:53.362204704 +0000 2023-10-08T12:33:42.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T12:33:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-08T12:33:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-08T12:33:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000290711 s, 1.8 MB/s 2023-10-08T12:33:43.009 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T12:33:43.055 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2023-10-08T12:33:43.138 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T12:33:43.138 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:43.138 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-08T12:33:43.138 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:43.138 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:43.139 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-08 12:32:11.843299556 +0000 2023-10-08T12:33:43.139 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-08 12:25:54.224194292 +0000 2023-10-08T12:33:43.139 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-08 12:25:54.224194292 +0000 2023-10-08T12:33:43.139 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2023-10-08 12:25:54.196194630 +0000 2023-10-08T12:33:43.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T12:33:43.246 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-08T12:33:43.246 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-08T12:33:43.246 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000297676 s, 1.7 MB/s 2023-10-08T12:33:43.248 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T12:33:43.293 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2023-10-08T12:33:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T12:33:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:43.378 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-08T12:33:43.378 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:43.378 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:43.378 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-08 12:32:11.934298439 +0000 2023-10-08T12:33:43.378 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-08 12:25:55.052184291 +0000 2023-10-08T12:33:43.378 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-08 12:25:55.052184291 +0000 2023-10-08T12:33:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2023-10-08 12:25:55.024184629 +0000 2023-10-08T12:33:43.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T12:33:43.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:43 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/202738461' entity='client.admin' 2023-10-08T12:33:43.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:43 smithi173 ceph-mon[135182]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:43.476 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:43 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/202738461' entity='client.admin' 2023-10-08T12:33:43.476 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:43 smithi059 ceph-mon[98489]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:43.483 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-08T12:33:43.483 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-08T12:33:43.483 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.00029347 s, 1.7 MB/s 2023-10-08T12:33:43.485 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T12:33:43.530 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2023-10-08T12:33:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T12:33:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:43.614 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-08T12:33:43.614 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:43.614 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:43.614 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-08 12:32:12.017297421 +0000 2023-10-08T12:33:43.615 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-08 12:25:55.877174326 +0000 2023-10-08T12:33:43.615 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-08 12:25:55.877174326 +0000 2023-10-08T12:33:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2023-10-08 12:25:55.849174664 +0000 2023-10-08T12:33:43.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T12:33:43.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:43 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/202738461' entity='client.admin' 2023-10-08T12:33:43.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:43 smithi092 ceph-mon[134093]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:43.720 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-08T12:33:43.720 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-08T12:33:43.720 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000490073 s, 1.0 MB/s 2023-10-08T12:33:43.725 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T12:33:43.770 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-08T12:33:43.770 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T12:33:43.791 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T12:33:43.791 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2023-10-08T12:33:43.852 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T12:33:43.852 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:43.852 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 394353 Links: 1 2023-10-08T12:33:43.852 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:43.852 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:43.853 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-08 12:33:23.729912603 +0000 2023-10-08T12:33:43.853 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-08 12:22:41.117202121 +0000 2023-10-08T12:33:43.853 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-08 12:22:41.117202121 +0000 2023-10-08T12:33:43.853 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-08T12:33:43.853 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T12:33:43.926 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-08T12:33:43.926 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-08T12:33:43.926 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000284751 s, 1.8 MB/s 2023-10-08T12:33:43.927 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T12:33:43.989 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2023-10-08T12:33:44.048 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T12:33:44.048 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:44.048 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 390296 Links: 1 2023-10-08T12:33:44.048 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:44.048 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:44.048 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-08 12:33:23.730912575 +0000 2023-10-08T12:33:44.048 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-08 12:22:41.623187720 +0000 2023-10-08T12:33:44.048 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-08 12:22:41.623187720 +0000 2023-10-08T12:33:44.048 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-08T12:33:44.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T12:33:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-08T12:33:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-08T12:33:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000254702 s, 2.0 MB/s 2023-10-08T12:33:44.119 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T12:33:44.179 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2023-10-08T12:33:44.238 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T12:33:44.238 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:44.238 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 396450 Links: 1 2023-10-08T12:33:44.238 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:44.239 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:44.239 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-08 12:33:23.730912575 +0000 2023-10-08T12:33:44.239 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-08 12:22:42.135173148 +0000 2023-10-08T12:33:44.239 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-08 12:22:42.135173148 +0000 2023-10-08T12:33:44.239 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-08T12:33:44.239 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T12:33:44.306 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-08T12:33:44.306 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-08T12:33:44.307 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000241855 s, 2.1 MB/s 2023-10-08T12:33:44.308 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T12:33:44.366 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2023-10-08T12:33:44.425 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T12:33:44.425 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:44.425 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 390361 Links: 1 2023-10-08T12:33:44.425 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:44.425 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:44.425 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-08 12:33:23.730912575 +0000 2023-10-08T12:33:44.425 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-08 12:22:42.644158661 +0000 2023-10-08T12:33:44.425 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-08 12:22:42.644158661 +0000 2023-10-08T12:33:44.425 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-08T12:33:44.426 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T12:33:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-08T12:33:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-08T12:33:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000227563 s, 2.2 MB/s 2023-10-08T12:33:44.493 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T12:33:44.551 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-08T12:33:44.551 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T12:33:44.572 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T12:33:44.572 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2023-10-08T12:33:44.634 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T12:33:44.634 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:44.634 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 388780 Links: 1 2023-10-08T12:33:44.634 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:44.634 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:44.634 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-10-08 12:33:21.481168701 +0000 2023-10-08T12:33:44.634 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-10-08 12:22:41.104490958 +0000 2023-10-08T12:33:44.634 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-10-08 12:22:41.104490958 +0000 2023-10-08T12:33:44.634 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-10-08T12:33:44.635 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T12:33:44.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-10-08T12:33:44.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-10-08T12:33:44.707 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000252391 s, 2.0 MB/s 2023-10-08T12:33:44.708 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T12:33:44.768 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2023-10-08T12:33:44.828 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T12:33:44.828 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:44.828 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 393761 Links: 1 2023-10-08T12:33:44.829 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:44.829 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:44.829 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-10-08 12:33:21.481168701 +0000 2023-10-08T12:33:44.829 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-10-08 12:22:41.619479784 +0000 2023-10-08T12:33:44.829 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-10-08 12:22:41.619479784 +0000 2023-10-08T12:33:44.829 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-10-08T12:33:44.830 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T12:33:44.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-10-08T12:33:44.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-10-08T12:33:44.897 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000235949 s, 2.2 MB/s 2023-10-08T12:33:44.898 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T12:33:44.956 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2023-10-08T12:33:45.015 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T12:33:45.015 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:45.015 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 384680 Links: 1 2023-10-08T12:33:45.015 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:45.015 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:45.015 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-10-08 12:33:21.482168678 +0000 2023-10-08T12:33:45.015 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-10-08 12:22:42.132468654 +0000 2023-10-08T12:33:45.015 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-10-08 12:22:42.132468654 +0000 2023-10-08T12:33:45.016 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-10-08T12:33:45.016 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T12:33:45.082 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-10-08T12:33:45.082 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-10-08T12:33:45.082 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000231538 s, 2.2 MB/s 2023-10-08T12:33:45.083 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T12:33:45.142 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2023-10-08T12:33:45.199 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T12:33:45.199 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:33:45.199 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 396290 Links: 1 2023-10-08T12:33:45.199 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:33:45.199 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:33:45.199 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-10-08 12:33:21.482168678 +0000 2023-10-08T12:33:45.200 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-10-08 12:22:42.652457372 +0000 2023-10-08T12:33:45.200 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-10-08 12:22:42.652457372 +0000 2023-10-08T12:33:45.200 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-10-08T12:33:45.200 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T12:33:45.264 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-10-08T12:33:45.264 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-10-08T12:33:45.264 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000269263 s, 1.9 MB/s 2023-10-08T12:33:45.265 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T12:33:45.323 INFO:tasks.cephadm:Deploying osd.0 on smithi059 with /dev/vg_nvme/lv_4... 2023-10-08T12:33:45.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T12:33:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:46.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:45 smithi092 ceph-mon[134093]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:45 smithi173 ceph-mon[135182]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:45 smithi059 ceph-mon[98489]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:48.014 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T12:33:48.014 INFO:teuthology.orchestra.run.smithi059.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T12:33:48.014 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10+0 records in 2023-10-08T12:33:48.014 INFO:teuthology.orchestra.run.smithi059.stderr:10+0 records out 2023-10-08T12:33:48.014 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0294903 s, 356 MB/s 2023-10-08T12:33:48.014 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping successful for: 2023-10-08T12:33:48.050 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:47 smithi059 ceph-mon[98489]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:48.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:47 smithi092 ceph-mon[134093]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:47 smithi173 ceph-mon[135182]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:48.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi059:vg_nvme/lv_4 2023-10-08T12:33:49.282 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:33:49.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:49 smithi059 ceph-mon[98489]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:49.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:49 smithi092 ceph-mon[134093]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:49 smithi173 ceph-mon[135182]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:50.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.796+0000 7f4ac7485700 1 -- 172.21.15.59:0/2366446075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac01057c0 msgr2=0x7f4ac0105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:50.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.796+0000 7f4ac7485700 1 --2- 172.21.15.59:0/2366446075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac01057c0 0x7f4ac0105ba0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009990 tx=0x7f4abc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:33:50.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.796+0000 7f4ac7485700 1 -- 172.21.15.59:0/2366446075 shutdown_connections 2023-10-08T12:33:50.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.796+0000 7f4ac7485700 1 --2- 172.21.15.59:0/2366446075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ac0101260 0x7f4ac010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:50.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.796+0000 7f4ac7485700 1 --2- 172.21.15.59:0/2366446075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac01057c0 0x7f4ac0105ba0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:50.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.796+0000 7f4ac7485700 1 --2- 172.21.15.59:0/2366446075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac01008a0 0x7f4ac0100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:50.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.796+0000 7f4ac7485700 1 -- 172.21.15.59:0/2366446075 >> 172.21.15.59:0/2366446075 conn(0x7f4ac00779e0 msgr2=0x7f4ac0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:50.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.796+0000 7f4ac7485700 1 -- 172.21.15.59:0/2366446075 shutdown_connections 2023-10-08T12:33:50.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.796+0000 7f4ac7485700 1 -- 172.21.15.59:0/2366446075 wait complete. 2023-10-08T12:33:50.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.797+0000 7f4ac7485700 1 Processor -- start 2023-10-08T12:33:50.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.797+0000 7f4ac7485700 1 -- start start 2023-10-08T12:33:50.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.798+0000 7f4ac7485700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac01008a0 0x7f4ac0198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:50.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.798+0000 7f4ac7485700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac0101260 0x7f4ac0199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:50.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.798+0000 7f4ac7485700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ac01057c0 0x7f4ac019d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:50.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.798+0000 7f4ac7485700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac019dd40 con 0x7f4ac0101260 2023-10-08T12:33:50.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.798+0000 7f4ac7485700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac019deb0 con 0x7f4ac01008a0 2023-10-08T12:33:50.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.798+0000 7f4ac7485700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac019e070 con 0x7f4ac01057c0 2023-10-08T12:33:50.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.798+0000 7f4ac4a20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac0101260 0x7f4ac0199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:50.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.798+0000 7f4ac5221700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac01008a0 0x7f4ac0198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:50.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.798+0000 7f4ac4a20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac0101260 0x7f4ac0199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41164/0 (socket says 172.21.15.59:41164) 2023-10-08T12:33:50.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.798+0000 7f4ac4a20700 1 -- 172.21.15.59:0/2008166682 learned_addr learned my addr 172.21.15.59:0/2008166682 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:33:50.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.798+0000 7f4ac5a22700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ac01057c0 0x7f4ac019d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:50.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ac4a20700 1 -- 172.21.15.59:0/2008166682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ac01057c0 msgr2=0x7f4ac019d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:50.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ac4a20700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ac01057c0 0x7f4ac019d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:50.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ac4a20700 1 -- 172.21.15.59:0/2008166682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac01008a0 msgr2=0x7f4ac0198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:50.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ac4a20700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac01008a0 0x7f4ac0198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:50.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ac4a20700 1 -- 172.21.15.59:0/2008166682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc0095f0 con 0x7f4ac0101260 2023-10-08T12:33:50.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ac5221700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac01008a0 0x7f4ac0198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:50.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ac5a22700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ac01057c0 0x7f4ac019d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:33:50.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ac4a20700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac0101260 0x7f4ac0199440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000d980 tx=0x7f4ab000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:50.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ab67fc700 1 -- 172.21.15.59:0/2008166682 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0004220 con 0x7f4ac0101260 2023-10-08T12:33:50.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ac7485700 1 -- 172.21.15.59:0/2008166682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac019e350 con 0x7f4ac0101260 2023-10-08T12:33:50.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ab67fc700 1 -- 172.21.15.59:0/2008166682 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ab0007640 con 0x7f4ac0101260 2023-10-08T12:33:50.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ab67fc700 1 -- 172.21.15.59:0/2008166682 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0005610 con 0x7f4ac0101260 2023-10-08T12:33:50.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.799+0000 7f4ac7485700 1 -- 172.21.15.59:0/2008166682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac01a5bb0 con 0x7f4ac0101260 2023-10-08T12:33:50.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.800+0000 7f4ac7485700 1 -- 172.21.15.59:0/2008166682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac0101f30 con 0x7f4ac0101260 2023-10-08T12:33:50.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.802+0000 7f4ab67fc700 1 -- 172.21.15.59:0/2008166682 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f4ab0004750 con 0x7f4ac0101260 2023-10-08T12:33:50.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.804+0000 7f4ab67fc700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4aac0a1440 0x7f4aac0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:50.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.804+0000 7f4ab67fc700 1 -- 172.21.15.59:0/2008166682 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4ab00cb030 con 0x7f4ac0101260 2023-10-08T12:33:50.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.804+0000 7f4ac5221700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4aac0a1440 0x7f4aac0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:50.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.804+0000 7f4ac5221700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4aac0a1440 0x7f4aac0a3900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4abc006010 tx=0x7f4abc00b540 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:50.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:50.808+0000 7f4ab67fc700 1 -- 172.21.15.59:0/2008166682 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4ab00961f0 con 0x7f4ac0101260 2023-10-08T12:33:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:33:51.026+0000 7f4ac7485700 1 -- 172.21.15.59:0/2008166682 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ac019a230 con 0x7f4aac0a1440 2023-10-08T12:33:52.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:51 smithi092 ceph-mon[134093]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:52.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:33:52.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:33:52.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:52.166 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:51 smithi059 ceph-mon[98489]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:52.166 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:33:52.166 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:33:52.167 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:51 smithi173 ceph-mon[135182]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:33:52.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:33:52.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:53.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:52 smithi092 ceph-mon[134093]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:33:53.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:52 smithi173 ceph-mon[135182]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:33:53.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:52 smithi059 ceph-mon[98489]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:33:54.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:53 smithi092 ceph-mon[134093]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:53 smithi173 ceph-mon[135182]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:53 smithi059 ceph-mon[98489]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:55.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:54 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4274566917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5340c12-0b40-4986-9508-e0a83f131b0a"}]: dispatch 2023-10-08T12:33:55.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:54 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4274566917' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5340c12-0b40-4986-9508-e0a83f131b0a"}]': finished 2023-10-08T12:33:55.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:54 smithi092 ceph-mon[134093]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T12:33:55.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:33:55.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:54 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4274566917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5340c12-0b40-4986-9508-e0a83f131b0a"}]: dispatch 2023-10-08T12:33:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:54 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4274566917' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5340c12-0b40-4986-9508-e0a83f131b0a"}]': finished 2023-10-08T12:33:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:54 smithi173 ceph-mon[135182]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T12:33:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:33:55.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:54 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4274566917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5340c12-0b40-4986-9508-e0a83f131b0a"}]: dispatch 2023-10-08T12:33:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:54 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4274566917' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5340c12-0b40-4986-9508-e0a83f131b0a"}]': finished 2023-10-08T12:33:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:54 smithi059 ceph-mon[98489]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T12:33:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:33:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:55 smithi092 ceph-mon[134093]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:55 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3010415511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:33:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:55 smithi173 ceph-mon[135182]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:55 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3010415511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:33:56.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:55 smithi059 ceph-mon[98489]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:56.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:55 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3010415511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:33:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:57 smithi092 ceph-mon[134093]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:57 smithi173 ceph-mon[135182]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:58.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:57 smithi059 ceph-mon[98489]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:59.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:33:59 smithi092 ceph-mon[134093]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:59.901 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:33:59 smithi059 ceph-mon[98489]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:33:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:33:59 smithi173 ceph-mon[135182]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:01 smithi092 ceph-mon[134093]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:01 smithi173 ceph-mon[135182]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:02.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:01 smithi059 ceph-mon[98489]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:03.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:02 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T12:34:03.130 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:02 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:03.130 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:02 smithi092 ceph-mon[134093]: Deploying daemon osd.0 on smithi059 2023-10-08T12:34:03.158 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:02 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T12:34:03.158 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:02 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:03.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:02 smithi059 ceph-mon[98489]: Deploying daemon osd.0 on smithi059 2023-10-08T12:34:03.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:02 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T12:34:03.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:02 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:02 smithi173 ceph-mon[135182]: Deploying daemon osd.0 on smithi059 2023-10-08T12:34:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:03 smithi092 ceph-mon[134093]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:03 smithi173 ceph-mon[135182]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:04.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:03 smithi059 ceph-mon[98489]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:05 smithi092 ceph-mon[134093]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:05 smithi173 ceph-mon[135182]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:06.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:05 smithi059 ceph-mon[98489]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:08.056 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:07 smithi059 ceph-mon[98489]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:07 smithi092 ceph-mon[134093]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:07 smithi173 ceph-mon[135182]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:09.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:09 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:09.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:09 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:09.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:09 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:09.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:09 smithi173 ceph-mon[135182]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:09.511 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:09 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:09.511 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:09 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:09.511 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:09 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:09.511 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:09 smithi059 ceph-mon[98489]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:09.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:09 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:09.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:09 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:09.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:09 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:09.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:09 smithi092 ceph-mon[134093]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:12.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.090+0000 7f4ab67fc700 1 -- 172.21.15.59:0/2008166682 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4ac019a230 con 0x7f4aac0a1440 2023-10-08T12:34:12.091 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 0 on host 'smithi059' 2023-10-08T12:34:12.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.092+0000 7f4ac7485700 1 -- 172.21.15.59:0/2008166682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4aac0a1440 msgr2=0x7f4aac0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:12.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.092+0000 7f4ac7485700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4aac0a1440 0x7f4aac0a3900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4abc006010 tx=0x7f4abc00b540 comp rx=0 tx=0).stop 2023-10-08T12:34:12.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.092+0000 7f4ac7485700 1 -- 172.21.15.59:0/2008166682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac0101260 msgr2=0x7f4ac0199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:12.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.092+0000 7f4ac7485700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac0101260 0x7f4ac0199440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000d980 tx=0x7f4ab000dc90 comp rx=0 tx=0).stop 2023-10-08T12:34:12.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.092+0000 7f4ac7485700 1 -- 172.21.15.59:0/2008166682 shutdown_connections 2023-10-08T12:34:12.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.092+0000 7f4ac7485700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4aac0a1440 0x7f4aac0a3900 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.092+0000 7f4ac7485700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac01008a0 0x7f4ac0198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.092+0000 7f4ac7485700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ac01057c0 0x7f4ac019d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.092+0000 7f4ac7485700 1 --2- 172.21.15.59:0/2008166682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac0101260 0x7f4ac0199440 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.092+0000 7f4ac7485700 1 -- 172.21.15.59:0/2008166682 >> 172.21.15.59:0/2008166682 conn(0x7f4ac00779e0 msgr2=0x7f4ac00fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:12.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.092+0000 7f4ac7485700 1 -- 172.21.15.59:0/2008166682 shutdown_connections 2023-10-08T12:34:12.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:12.093+0000 7f4ac7485700 1 -- 172.21.15.59:0/2008166682 wait complete. 2023-10-08T12:34:12.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:11 smithi059 ceph-mon[98489]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:12.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:12.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:12.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:12.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:12.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:11 smithi092 ceph-mon[134093]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:11 smithi173 ceph-mon[135182]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:12.714 DEBUG:teuthology.orchestra.run.smithi059:osd.0> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.0.service 2023-10-08T12:34:12.721 INFO:tasks.cephadm:Deploying osd.1 on smithi092 with /dev/vg_nvme/lv_4... 2023-10-08T12:34:12.721 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T12:34:12.793 INFO:journalctl@ceph.osd.0.smithi059.stdout:-- Logs begin at Sun 2023-10-08 12:12:12 UTC. -- 2023-10-08T12:34:13.298 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:34:13.327 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:13 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:13.327 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:13 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:13.327 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:13 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:13.327 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:13 smithi059 ceph-mon[98489]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:34:13.327 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:13 smithi059 ceph-mon[98489]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:13.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:13 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:13 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:13 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:13 smithi092 ceph-mon[134093]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:34:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:13 smithi092 ceph-mon[134093]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:13.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:13 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:13 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:13 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:13 smithi173 ceph-mon[135182]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:34:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:13 smithi173 ceph-mon[135182]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:14.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:14 smithi092 ceph-mon[134093]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T12:34:14.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:14 smithi092 ceph-mon[134093]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T12:34:14.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:14 smithi092 ceph-mon[134093]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:34:14.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:14 smithi059 ceph-mon[98489]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T12:34:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:14 smithi059 ceph-mon[98489]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T12:34:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:14 smithi059 ceph-mon[98489]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:34:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:14.265 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 12:34:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-0[123447]: 2023-10-08T12:34:14.068+0000 7fca3e9eb700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T12:34:14.265 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 12:34:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-0[123447]: 2023-10-08T12:34:14.075+0000 7fca367d8700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:34:14.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:14 smithi173 ceph-mon[135182]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T12:34:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:14 smithi173 ceph-mon[135182]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T12:34:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:14 smithi173 ceph-mon[135182]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:34:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:14.786 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T12:34:14.786 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T12:34:14.786 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-08T12:34:14.786 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-08T12:34:14.786 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111666 s, 939 MB/s 2023-10-08T12:34:14.786 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-08T12:34:15.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_4 2023-10-08T12:34:15.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:15 smithi092 ceph-mon[134093]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:34:15.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:15 smithi092 ceph-mon[134093]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T12:34:15.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:15.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:15.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:15 smithi092 ceph-mon[134093]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:15.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:15 smithi173 ceph-mon[135182]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:34:15.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:15 smithi173 ceph-mon[135182]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T12:34:15.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:15.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:15.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:15 smithi173 ceph-mon[135182]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:15.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:15 smithi059 ceph-mon[98489]: from='osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:34:15.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:15 smithi059 ceph-mon[98489]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T12:34:15.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:15.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:15.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:15 smithi059 ceph-mon[98489]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:34:15.705 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:34:16.168 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:16 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:34:16.168 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:16 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:34:16.169 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:16 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:16.169 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:16 smithi092 ceph-mon[134093]: osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555] boot 2023-10-08T12:34:16.169 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:16 smithi092 ceph-mon[134093]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T12:34:16.169 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:16 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:16.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:16 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:34:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:16 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:34:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:16 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:16 smithi173 ceph-mon[135182]: osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555] boot 2023-10-08T12:34:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:16 smithi173 ceph-mon[135182]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T12:34:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:16 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:16 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:34:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:16 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:34:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:16 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:16 smithi059 ceph-mon[98489]: osd.0 [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555] boot 2023-10-08T12:34:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:16 smithi059 ceph-mon[98489]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T12:34:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:16 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:34:16.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.807+0000 7fa5476f2700 1 -- 172.21.15.92:0/801023261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5400ff750 msgr2=0x7fa5400ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:16.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.807+0000 7fa5476f2700 1 --2- 172.21.15.92:0/801023261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5400ff750 0x7fa5400ffbd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009990 tx=0x7fa53c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:34:16.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.807+0000 7fa5476f2700 1 -- 172.21.15.92:0/801023261 shutdown_connections 2023-10-08T12:34:16.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.807+0000 7fa5476f2700 1 --2- 172.21.15.92:0/801023261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa540100110 0x7fa54010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:16.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.807+0000 7fa5476f2700 1 --2- 172.21.15.92:0/801023261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5401056b0 0x7fa540105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:16.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.807+0000 7fa5476f2700 1 --2- 172.21.15.92:0/801023261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5400ff750 0x7fa5400ffbd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:16.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.807+0000 7fa5476f2700 1 -- 172.21.15.92:0/801023261 >> 172.21.15.92:0/801023261 conn(0x7fa540075790 msgr2=0x7fa540075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:16.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.807+0000 7fa5476f2700 1 -- 172.21.15.92:0/801023261 shutdown_connections 2023-10-08T12:34:16.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.807+0000 7fa5476f2700 1 -- 172.21.15.92:0/801023261 wait complete. 2023-10-08T12:34:16.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa5476f2700 1 Processor -- start 2023-10-08T12:34:16.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa5476f2700 1 -- start start 2023-10-08T12:34:16.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa5476f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5400ff750 0x7fa54019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:16.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa5476f2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa540100110 0x7fa54019bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:16.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa5476f2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401056b0 0x7fa5401959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:16.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa5476f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa540196040 con 0x7fa5400ff750 2023-10-08T12:34:16.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa5476f2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5401961b0 con 0x7fa5401056b0 2023-10-08T12:34:16.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa5476f2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa540196370 con 0x7fa540100110 2023-10-08T12:34:16.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa545c8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401056b0 0x7fa5401959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:16.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa545c8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401056b0 0x7fa5401959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36162/0 (socket says 172.21.15.92:36162) 2023-10-08T12:34:16.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa545c8f700 1 -- 172.21.15.92:0/3131065243 learned_addr learned my addr 172.21.15.92:0/3131065243 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-08T12:34:16.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa544c8d700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa540100110 0x7fa54019bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:16.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa545c8f700 1 -- 172.21.15.92:0/3131065243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa540100110 msgr2=0x7fa54019bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:16.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa545c8f700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa540100110 0x7fa54019bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:16.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa545c8f700 1 -- 172.21.15.92:0/3131065243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5400ff750 msgr2=0x7fa54019b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:16.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa545c8f700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5400ff750 0x7fa54019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:16.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa545c8f700 1 -- 172.21.15.92:0/3131065243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0095f0 con 0x7fa5401056b0 2023-10-08T12:34:16.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.808+0000 7fa544c8d700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa540100110 0x7fa54019bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:34:16.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.809+0000 7fa545c8f700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401056b0 0x7fa5401959e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa53800cfb0 tx=0x7fa53800e330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:16.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.809+0000 7fa5367fc700 1 -- 172.21.15.92:0/3131065243 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538011070 con 0x7fa5401056b0 2023-10-08T12:34:16.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.809+0000 7fa5367fc700 1 -- 172.21.15.92:0/3131065243 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa538007b30 con 0x7fa5401056b0 2023-10-08T12:34:16.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.809+0000 7fa5476f2700 1 -- 172.21.15.92:0/3131065243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa540196650 con 0x7fa5401056b0 2023-10-08T12:34:16.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.809+0000 7fa5367fc700 1 -- 172.21.15.92:0/3131065243 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53800adf0 con 0x7fa5401056b0 2023-10-08T12:34:16.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.809+0000 7fa5476f2700 1 -- 172.21.15.92:0/3131065243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540068360 con 0x7fa5401056b0 2023-10-08T12:34:16.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.810+0000 7fa5476f2700 1 -- 172.21.15.92:0/3131065243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa540100df0 con 0x7fa5401056b0 2023-10-08T12:34:16.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.811+0000 7fa5367fc700 1 -- 172.21.15.92:0/3131065243 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fa53800c2e0 con 0x7fa5401056b0 2023-10-08T12:34:16.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.811+0000 7fa5367fc700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa52c0a1440 0x7fa52c0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:16.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.811+0000 7fa5367fc700 1 -- 172.21.15.92:0/3131065243 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fa5380cd480 con 0x7fa5401056b0 2023-10-08T12:34:16.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.812+0000 7fa54548e700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa52c0a1440 0x7fa52c0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:16.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.812+0000 7fa54548e700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa52c0a1440 0x7fa52c0a3900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa5300097b0 tx=0x7fa530006d20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:16.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:16.815+0000 7fa5367fc700 1 -- 172.21.15.92:0/3131065243 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa538098480 con 0x7fa5401056b0 2023-10-08T12:34:17.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:17.011+0000 7fa5476f2700 1 -- 172.21.15.92:0/3131065243 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa54010f6a0 con 0x7fa52c0a1440 2023-10-08T12:34:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T12:34:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi059 2023-10-08T12:34:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:34:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi059 to 17272M 2023-10-08T12:34:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:17.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:17.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:34:17.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:34:17.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:17.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T12:34:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi059 2023-10-08T12:34:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:34:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi059 to 17272M 2023-10-08T12:34:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:17.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:34:17.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:34:17.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:17.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T12:34:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi059 2023-10-08T12:34:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:34:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi059 to 17272M 2023-10-08T12:34:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:34:17.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:34:17.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:18 smithi092 ceph-mon[134093]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:34:18.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:18 smithi059 ceph-mon[98489]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:34:18.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:18 smithi173 ceph-mon[135182]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:34:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:19 smithi092 ceph-mon[134093]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:19 smithi092 ceph-mon[134093]: from='client.? 172.21.15.92:0/3354674228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a81a353e-18b3-4793-912d-cd6a9809bcbb"}]: dispatch 2023-10-08T12:34:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:19 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a81a353e-18b3-4793-912d-cd6a9809bcbb"}]: dispatch 2023-10-08T12:34:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:19 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a81a353e-18b3-4793-912d-cd6a9809bcbb"}]': finished 2023-10-08T12:34:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:19 smithi092 ceph-mon[134093]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T12:34:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:19 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:19 smithi173 ceph-mon[135182]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:19 smithi173 ceph-mon[135182]: from='client.? 172.21.15.92:0/3354674228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a81a353e-18b3-4793-912d-cd6a9809bcbb"}]: dispatch 2023-10-08T12:34:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:19 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a81a353e-18b3-4793-912d-cd6a9809bcbb"}]: dispatch 2023-10-08T12:34:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:19 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a81a353e-18b3-4793-912d-cd6a9809bcbb"}]': finished 2023-10-08T12:34:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:19 smithi173 ceph-mon[135182]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T12:34:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:19 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:19 smithi059 ceph-mon[98489]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:19 smithi059 ceph-mon[98489]: from='client.? 172.21.15.92:0/3354674228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a81a353e-18b3-4793-912d-cd6a9809bcbb"}]: dispatch 2023-10-08T12:34:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:19 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a81a353e-18b3-4793-912d-cd6a9809bcbb"}]: dispatch 2023-10-08T12:34:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:19 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a81a353e-18b3-4793-912d-cd6a9809bcbb"}]': finished 2023-10-08T12:34:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:19 smithi059 ceph-mon[98489]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T12:34:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:19 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:20.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:20 smithi092 ceph-mon[134093]: from='client.? 172.21.15.92:0/103338294' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:34:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:20 smithi173 ceph-mon[135182]: from='client.? 172.21.15.92:0/103338294' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:34:21.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:20 smithi059 ceph-mon[98489]: from='client.? 172.21.15.92:0/103338294' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:34:21.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:21 smithi092 ceph-mon[134093]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:21 smithi173 ceph-mon[135182]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:22.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:21 smithi059 ceph-mon[98489]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:24.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:23 smithi092 ceph-mon[134093]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:24.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:23 smithi173 ceph-mon[135182]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:24.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:23 smithi059 ceph-mon[98489]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:26.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:25 smithi092 ceph-mon[134093]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:25 smithi173 ceph-mon[135182]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:26.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:25 smithi059 ceph-mon[98489]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:27.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T12:34:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:26 smithi092 ceph-mon[134093]: Deploying daemon osd.1 on smithi092 2023-10-08T12:34:27.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T12:34:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:26 smithi173 ceph-mon[135182]: Deploying daemon osd.1 on smithi092 2023-10-08T12:34:27.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T12:34:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:26 smithi059 ceph-mon[98489]: Deploying daemon osd.1 on smithi092 2023-10-08T12:34:27.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:27 smithi092 ceph-mon[134093]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:28.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:27 smithi173 ceph-mon[135182]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:28.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:27 smithi059 ceph-mon[98489]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:29.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:29 smithi092 ceph-mon[134093]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:29 smithi173 ceph-mon[135182]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:30.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:29 smithi059 ceph-mon[98489]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:31.282 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:31.282 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:31.282 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:31.282 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:31 smithi092 ceph-mon[134093]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:31.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:31.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:31.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:31.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:31 smithi173 ceph-mon[135182]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:31.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:31.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:31.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:31.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:31 smithi059 ceph-mon[98489]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:32.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.572+0000 7fa5367fc700 1 -- 172.21.15.92:0/3131065243 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa54010f6a0 con 0x7fa52c0a1440 2023-10-08T12:34:32.574 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 1 on host 'smithi092' 2023-10-08T12:34:32.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 -- 172.21.15.92:0/3131065243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa52c0a1440 msgr2=0x7fa52c0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:32.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa52c0a1440 0x7fa52c0a3900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa5300097b0 tx=0x7fa530006d20 comp rx=0 tx=0).stop 2023-10-08T12:34:32.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 -- 172.21.15.92:0/3131065243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401056b0 msgr2=0x7fa5401959e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:32.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401056b0 0x7fa5401959e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa53800cfb0 tx=0x7fa53800e330 comp rx=0 tx=0).stop 2023-10-08T12:34:32.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 -- 172.21.15.92:0/3131065243 shutdown_connections 2023-10-08T12:34:32.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa52c0a1440 0x7fa52c0a3900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:32.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401056b0 0x7fa5401959e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:32.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5400ff750 0x7fa54019b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:32.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 --2- 172.21.15.92:0/3131065243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa540100110 0x7fa54019bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:32.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 -- 172.21.15.92:0/3131065243 >> 172.21.15.92:0/3131065243 conn(0x7fa540075790 msgr2=0x7fa5400fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:32.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 -- 172.21.15.92:0/3131065243 shutdown_connections 2023-10-08T12:34:32.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:34:32.574+0000 7fa5476f2700 1 -- 172.21.15.92:0/3131065243 wait complete. 2023-10-08T12:34:32.909 DEBUG:teuthology.orchestra.run.smithi092:osd.1> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.1.service 2023-10-08T12:34:32.911 INFO:tasks.cephadm:Deploying osd.2 on smithi173 with /dev/vg_nvme/lv_4... 2023-10-08T12:34:32.912 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T12:34:32.942 INFO:journalctl@ceph.osd.1.smithi092.stdout:-- Logs begin at Sun 2023-10-08 12:08:21 UTC. -- 2023-10-08T12:34:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:33.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:33.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:33 smithi173 ceph-mon[135182]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:33.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:33.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:33 smithi059 ceph-mon[98489]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:33 smithi092 ceph-mon[134093]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:33.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:33.478 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:34:34.127 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 12:34:33 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-1[140323]: 2023-10-08T12:34:33.965+0000 7fb5895ac640 -1 osd.1 0 log_to_monitors true 2023-10-08T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:34 smithi173 ceph-mon[135182]: from='osd.1 [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:34:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:34 smithi173 ceph-mon[135182]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:34:34.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:34 smithi092 ceph-mon[134093]: from='osd.1 [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:34:34.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:34 smithi092 ceph-mon[134093]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:34:34.955 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T12:34:34.955 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T12:34:34.955 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2023-10-08T12:34:34.955 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2023-10-08T12:34:34.955 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110718 s, 947 MB/s 2023-10-08T12:34:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2023-10-08T12:34:35.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:34 smithi059 ceph-mon[98489]: from='osd.1 [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:34:35.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:34 smithi059 ceph-mon[98489]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:34:35.320 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi173:vg_nvme/lv_4 2023-10-08T12:34:35.877 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 12:34:35 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-1[140323]: 2023-10-08T12:34:35.637+0000 7fb57ec23700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T12:34:35.877 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 12:34:35 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-1[140323]: 2023-10-08T12:34:35.642+0000 7fb57aa18700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:34:35.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:35 smithi092 ceph-mon[134093]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T12:34:35.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:35 smithi092 ceph-mon[134093]: from='osd.1 [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:34:35.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:35 smithi092 ceph-mon[134093]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T12:34:35.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:35.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:35 smithi092 ceph-mon[134093]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:34:35.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:35 smithi092 ceph-mon[134093]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:35.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:35.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:35.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:34:35.880 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:34:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:35 smithi173 ceph-mon[135182]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T12:34:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:35 smithi173 ceph-mon[135182]: from='osd.1 [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:34:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:35 smithi173 ceph-mon[135182]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T12:34:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:35 smithi173 ceph-mon[135182]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:34:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:35 smithi173 ceph-mon[135182]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:34:36.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:35 smithi059 ceph-mon[98489]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T12:34:36.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:35 smithi059 ceph-mon[98489]: from='osd.1 [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:34:36.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:35 smithi059 ceph-mon[98489]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T12:34:36.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:36.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:35 smithi059 ceph-mon[98489]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:34:36.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:35 smithi059 ceph-mon[98489]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:36.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:36.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:36.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:34:36.662 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:36 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi092 2023-10-08T12:34:36.662 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:36 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi092 to 17168M 2023-10-08T12:34:36.662 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:36.662 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:36.662 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:36.662 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:36 smithi173 ceph-mon[135182]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:34:36.662 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:36 smithi173 ceph-mon[135182]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T12:34:36.663 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:36.663 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:36.663 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:37.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:36 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi092 2023-10-08T12:34:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:36 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi092 to 17168M 2023-10-08T12:34:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:36 smithi059 ceph-mon[98489]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:34:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:36 smithi059 ceph-mon[98489]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T12:34:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:37.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:36 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi092 2023-10-08T12:34:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:36 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi092 to 17168M 2023-10-08T12:34:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:36 smithi092 ceph-mon[134093]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:34:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:36 smithi092 ceph-mon[134093]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T12:34:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:37.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:37.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:37.155 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.154+0000 7fc103dd4700 1 -- 172.21.15.173:0/3512144440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0fc0ff750 msgr2=0x7fc0fc0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:37.155 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.154+0000 7fc103dd4700 1 --2- 172.21.15.173:0/3512144440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0fc0ff750 0x7fc0fc0ffbd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009990 tx=0x7fc0f8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:34:37.155 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.154+0000 7fc103dd4700 1 -- 172.21.15.173:0/3512144440 shutdown_connections 2023-10-08T12:34:37.155 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.154+0000 7fc103dd4700 1 --2- 172.21.15.173:0/3512144440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0fc1056b0 0x7fc0fc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:37.155 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.154+0000 7fc103dd4700 1 --2- 172.21.15.173:0/3512144440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc100110 0x7fc0fc10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:37.155 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.154+0000 7fc103dd4700 1 --2- 172.21.15.173:0/3512144440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0fc0ff750 0x7fc0fc0ffbd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:37.155 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.154+0000 7fc103dd4700 1 -- 172.21.15.173:0/3512144440 >> 172.21.15.173:0/3512144440 conn(0x7fc0fc075790 msgr2=0x7fc0fc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:37.155 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.154+0000 7fc103dd4700 1 -- 172.21.15.173:0/3512144440 shutdown_connections 2023-10-08T12:34:37.155 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.154+0000 7fc103dd4700 1 -- 172.21.15.173:0/3512144440 wait complete. 2023-10-08T12:34:37.156 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc103dd4700 1 Processor -- start 2023-10-08T12:34:37.156 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc103dd4700 1 -- start start 2023-10-08T12:34:37.157 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc103dd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0fc0ff750 0x7fc0fc19c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:37.157 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc103dd4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0fc100110 0x7fc0fc19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:37.158 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc103dd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc1056b0 0x7fc0fc196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:37.158 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc103dd4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc197130 con 0x7fc0fc1056b0 2023-10-08T12:34:37.158 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc103dd4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc1972a0 con 0x7fc0fc0ff750 2023-10-08T12:34:37.158 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc103dd4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc197460 con 0x7fc0fc100110 2023-10-08T12:34:37.158 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc10136f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0fc100110 0x7fc0fc19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:37.158 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc10136f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0fc100110 0x7fc0fc19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44116/0 (socket says 172.21.15.173:44116) 2023-10-08T12:34:37.158 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc10136f700 1 -- 172.21.15.173:0/4064021097 learned_addr learned my addr 172.21.15.173:0/4064021097 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-08T12:34:37.158 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc102371700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc1056b0 0x7fc0fc196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:37.158 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc101b70700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0fc0ff750 0x7fc0fc19c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:37.158 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc10136f700 1 -- 172.21.15.173:0/4064021097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0fc0ff750 msgr2=0x7fc0fc19c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc10136f700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0fc0ff750 0x7fc0fc19c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc10136f700 1 -- 172.21.15.173:0/4064021097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc1056b0 msgr2=0x7fc0fc196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc10136f700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc1056b0 0x7fc0fc196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc10136f700 1 -- 172.21.15.173:0/4064021097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f80095f0 con 0x7fc0fc100110 2023-10-08T12:34:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.155+0000 7fc101b70700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0fc0ff750 0x7fc0fc19c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:34:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.156+0000 7fc10136f700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0fc100110 0x7fc0fc19ce80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80098e0 tx=0x7fc0f800f720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.156+0000 7fc0f2ffd700 1 -- 172.21.15.173:0/4064021097 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f801d070 con 0x7fc0fc100110 2023-10-08T12:34:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.156+0000 7fc0f2ffd700 1 -- 172.21.15.173:0/4064021097 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0f800fb90 con 0x7fc0fc100110 2023-10-08T12:34:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.156+0000 7fc0f2ffd700 1 -- 172.21.15.173:0/4064021097 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8017650 con 0x7fc0fc100110 2023-10-08T12:34:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.156+0000 7fc103dd4700 1 -- 172.21.15.173:0/4064021097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0fc1976e0 con 0x7fc0fc100110 2023-10-08T12:34:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.156+0000 7fc103dd4700 1 -- 172.21.15.173:0/4064021097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0fc1a3930 con 0x7fc0fc100110 2023-10-08T12:34:37.160 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.157+0000 7fc103dd4700 1 -- 172.21.15.173:0/4064021097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0fc100df0 con 0x7fc0fc100110 2023-10-08T12:34:37.160 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.158+0000 7fc0f2ffd700 1 -- 172.21.15.173:0/4064021097 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fc0f800fd00 con 0x7fc0fc100110 2023-10-08T12:34:37.160 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.158+0000 7fc0f2ffd700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc0e80a14c0 0x7fc0e80a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:37.161 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.159+0000 7fc0f2ffd700 1 -- 172.21.15.173:0/4064021097 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2524+0+0 (secure 0 0 0) 0x7fc0f80cc670 con 0x7fc0fc100110 2023-10-08T12:34:37.161 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.159+0000 7fc101b70700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc0e80a14c0 0x7fc0e80a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:37.161 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.159+0000 7fc101b70700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc0e80a14c0 0x7fc0e80a3980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009b50 tx=0x7fc0ec009550 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:37.163 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.163+0000 7fc0f2ffd700 1 -- 172.21.15.173:0/4064021097 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc0f80974e0 con 0x7fc0fc100110 2023-10-08T12:34:37.359 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:37.358+0000 7fc103dd4700 1 -- 172.21.15.173:0/4064021097 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0fc197f40 con 0x7fc0e80a14c0 2023-10-08T12:34:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:37 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:34:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:37 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:34:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:37 smithi173 ceph-mon[135182]: osd.1 [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167] boot 2023-10-08T12:34:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:37 smithi173 ceph-mon[135182]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T12:34:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:37 smithi173 ceph-mon[135182]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:34:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:34:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:38.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:37 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:34:38.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:37 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:34:38.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:38.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:37 smithi059 ceph-mon[98489]: osd.1 [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167] boot 2023-10-08T12:34:38.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:37 smithi059 ceph-mon[98489]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T12:34:38.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:38.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:37 smithi059 ceph-mon[98489]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:38.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:34:38.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:34:38.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:37 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:34:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:37 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:34:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:37 smithi092 ceph-mon[134093]: osd.1 [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167] boot 2023-10-08T12:34:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:37 smithi092 ceph-mon[134093]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T12:34:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:34:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:37 smithi092 ceph-mon[134093]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:34:38.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:34:38.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:34:38.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:38.920 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:38 smithi173 ceph-mon[135182]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:34:38.920 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:38 smithi173 ceph-mon[135182]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T12:34:39.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:38 smithi059 ceph-mon[98489]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:34:39.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:38 smithi059 ceph-mon[98489]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T12:34:39.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:38 smithi092 ceph-mon[134093]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:34:39.130 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:38 smithi092 ceph-mon[134093]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T12:34:39.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:39 smithi173 ceph-mon[135182]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:40.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:39 smithi059 ceph-mon[98489]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:40.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:39 smithi092 ceph-mon[134093]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:40 smithi173 ceph-mon[135182]: from='client.? 172.21.15.173:0/3646474896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0e0de-0540-4276-902c-0026e2feec5c"}]: dispatch 2023-10-08T12:34:40.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:40 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0e0de-0540-4276-902c-0026e2feec5c"}]: dispatch 2023-10-08T12:34:40.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:40 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59e0e0de-0540-4276-902c-0026e2feec5c"}]': finished 2023-10-08T12:34:40.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:40 smithi173 ceph-mon[135182]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T12:34:40.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:40 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:40.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:40 smithi173 ceph-mon[135182]: from='client.? 172.21.15.173:0/3323752622' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:34:41.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:40 smithi059 ceph-mon[98489]: from='client.? 172.21.15.173:0/3646474896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0e0de-0540-4276-902c-0026e2feec5c"}]: dispatch 2023-10-08T12:34:41.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:40 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0e0de-0540-4276-902c-0026e2feec5c"}]: dispatch 2023-10-08T12:34:41.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:40 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59e0e0de-0540-4276-902c-0026e2feec5c"}]': finished 2023-10-08T12:34:41.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:40 smithi059 ceph-mon[98489]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T12:34:41.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:40 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:41.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:40 smithi059 ceph-mon[98489]: from='client.? 172.21.15.173:0/3323752622' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:34:41.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:40 smithi092 ceph-mon[134093]: from='client.? 172.21.15.173:0/3646474896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0e0de-0540-4276-902c-0026e2feec5c"}]: dispatch 2023-10-08T12:34:41.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:40 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0e0de-0540-4276-902c-0026e2feec5c"}]: dispatch 2023-10-08T12:34:41.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:40 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59e0e0de-0540-4276-902c-0026e2feec5c"}]': finished 2023-10-08T12:34:41.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:40 smithi092 ceph-mon[134093]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T12:34:41.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:40 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:41.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:40 smithi092 ceph-mon[134093]: from='client.? 172.21.15.173:0/3323752622' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:34:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:41 smithi173 ceph-mon[135182]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:42.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:41 smithi059 ceph-mon[98489]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:42.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:41 smithi092 ceph-mon[134093]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:43 smithi173 ceph-mon[135182]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:44.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:43 smithi092 ceph-mon[134093]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:44.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:43 smithi059 ceph-mon[98489]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:46.093 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:45 smithi173 ceph-mon[135182]: pgmap v51: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:46.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:45 smithi092 ceph-mon[134093]: pgmap v51: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:45 smithi059 ceph-mon[98489]: pgmap v51: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:46.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:46 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T12:34:46.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:46 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:47.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:46 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T12:34:47.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:46 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:47.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:46 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T12:34:47.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:46 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:48.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:47 smithi092 ceph-mon[134093]: Deploying daemon osd.2 on smithi173 2023-10-08T12:34:48.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:47 smithi092 ceph-mon[134093]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:48.161 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:47 smithi173 ceph-mon[135182]: Deploying daemon osd.2 on smithi173 2023-10-08T12:34:48.161 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:47 smithi173 ceph-mon[135182]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:48.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:47 smithi059 ceph-mon[98489]: Deploying daemon osd.2 on smithi173 2023-10-08T12:34:48.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:47 smithi059 ceph-mon[98489]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:49.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:49 smithi092 ceph-mon[134093]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:49.962 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:49 smithi173 ceph-mon[135182]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:50.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:49 smithi059 ceph-mon[98489]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:51.353 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:51.354 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:51.354 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:51.354 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:51 smithi173 ceph-mon[135182]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:51.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:51.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:51.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:51.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:51 smithi059 ceph-mon[98489]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:51.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:51.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:51.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:51.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:51 smithi092 ceph-mon[134093]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:52.923 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.923+0000 7fc0f2ffd700 1 -- 172.21.15.173:0/4064021097 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc0fc197f40 con 0x7fc0e80a14c0 2023-10-08T12:34:52.923 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 2 on host 'smithi173' 2023-10-08T12:34:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 -- 172.21.15.173:0/4064021097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc0e80a14c0 msgr2=0x7fc0e80a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc0e80a14c0 0x7fc0e80a3980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009b50 tx=0x7fc0ec009550 comp rx=0 tx=0).stop 2023-10-08T12:34:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 -- 172.21.15.173:0/4064021097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0fc100110 msgr2=0x7fc0fc19ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0fc100110 0x7fc0fc19ce80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80098e0 tx=0x7fc0f800f720 comp rx=0 tx=0).stop 2023-10-08T12:34:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 -- 172.21.15.173:0/4064021097 shutdown_connections 2023-10-08T12:34:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc0e80a14c0 0x7fc0e80a3980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0fc0ff750 0x7fc0fc19c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc1056b0 0x7fc0fc196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 --2- 172.21.15.173:0/4064021097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0fc100110 0x7fc0fc19ce80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 -- 172.21.15.173:0/4064021097 >> 172.21.15.173:0/4064021097 conn(0x7fc0fc075790 msgr2=0x7fc0fc0fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 -- 172.21.15.173:0/4064021097 shutdown_connections 2023-10-08T12:34:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:34:52.925+0000 7fc103dd4700 1 -- 172.21.15.173:0/4064021097 wait complete. 2023-10-08T12:34:53.354 DEBUG:teuthology.orchestra.run.smithi173:osd.2> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.2.service 2023-10-08T12:34:53.356 INFO:tasks.cephadm:Deploying osd.3 on smithi059 with /dev/vg_nvme/lv_3... 2023-10-08T12:34:53.357 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T12:34:53.385 INFO:journalctl@ceph.osd.2.smithi173.stdout:-- Logs begin at Sun 2023-10-08 12:08:19 UTC. -- 2023-10-08T12:34:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:53.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:53.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:53 smithi173 ceph-mon[135182]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:53.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:53.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:53.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:53.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:53 smithi059 ceph-mon[98489]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:53.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:53.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:53.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:53.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:53 smithi092 ceph-mon[134093]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:53.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:53.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:54.105 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:34:54.406 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 12:34:54 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-2[142189]: 2023-10-08T12:34:54.181+0000 7f2a2c951640 -1 osd.2 0 log_to_monitors true 2023-10-08T12:34:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:54 smithi173 ceph-mon[135182]: from='osd.2 [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:34:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:54 smithi173 ceph-mon[135182]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:34:54.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:54 smithi059 ceph-mon[98489]: from='osd.2 [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:34:54.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:54 smithi059 ceph-mon[98489]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:34:55.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:54 smithi092 ceph-mon[134093]: from='osd.2 [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:34:55.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:54 smithi092 ceph-mon[134093]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:34:55.968 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 12:34:55 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-2[142189]: 2023-10-08T12:34:55.629+0000 7f2a21fc8700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T12:34:55.968 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 12:34:55 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-2[142189]: 2023-10-08T12:34:55.635+0000 7f2a19db5700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:34:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:55 smithi173 ceph-mon[135182]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T12:34:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:55 smithi173 ceph-mon[135182]: from='osd.2 [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:34:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:55 smithi173 ceph-mon[135182]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T12:34:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:55 smithi173 ceph-mon[135182]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:34:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:55 smithi173 ceph-mon[135182]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:55 smithi173 ceph-mon[135182]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:34:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:55 smithi173 ceph-mon[135182]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T12:34:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:56.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:55 smithi059 ceph-mon[98489]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T12:34:56.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:55 smithi059 ceph-mon[98489]: from='osd.2 [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:34:56.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:55 smithi059 ceph-mon[98489]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T12:34:56.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:56.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:55 smithi059 ceph-mon[98489]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:34:56.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:55 smithi059 ceph-mon[98489]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:56.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:55 smithi059 ceph-mon[98489]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:34:56.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:55 smithi059 ceph-mon[98489]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T12:34:56.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:55 smithi092 ceph-mon[134093]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T12:34:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:55 smithi092 ceph-mon[134093]: from='osd.2 [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:34:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:55 smithi092 ceph-mon[134093]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T12:34:56.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:56.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:55 smithi092 ceph-mon[134093]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:34:56.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:55 smithi092 ceph-mon[134093]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:56.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:55 smithi092 ceph-mon[134093]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:34:56.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:55 smithi092 ceph-mon[134093]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T12:34:56.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:56.418 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T12:34:56.418 INFO:teuthology.orchestra.run.smithi059.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T12:34:56.419 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10+0 records in 2023-10-08T12:34:56.419 INFO:teuthology.orchestra.run.smithi059.stderr:10+0 records out 2023-10-08T12:34:56.419 INFO:teuthology.orchestra.run.smithi059.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0299778 s, 350 MB/s 2023-10-08T12:34:56.419 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping successful for: 2023-10-08T12:34:56.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:56.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:56.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:56.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:34:56.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:56.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:56.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:56.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:56.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:56.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi059:vg_nvme/lv_3 2023-10-08T12:34:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:34:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:34:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:34:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:57.636 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:34:57.914 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:57 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:34:57.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:57 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:34:57.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:57 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi173 2023-10-08T12:34:57.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:57 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi173 to 17168M 2023-10-08T12:34:57.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:57 smithi059 ceph-mon[98489]: osd.2 [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029] boot 2023-10-08T12:34:57.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:57 smithi059 ceph-mon[98489]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T12:34:57.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:57.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:57 smithi059 ceph-mon[98489]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:57.915 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:34:57.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:57 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:34:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:57 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:34:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:57 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi173 2023-10-08T12:34:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:57 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi173 to 17168M 2023-10-08T12:34:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:57 smithi173 ceph-mon[135182]: osd.2 [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029] boot 2023-10-08T12:34:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:57 smithi173 ceph-mon[135182]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T12:34:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:57 smithi173 ceph-mon[135182]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:34:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:57 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:34:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:57 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:34:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:57 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi173 2023-10-08T12:34:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:57 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi173 to 17168M 2023-10-08T12:34:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:57 smithi092 ceph-mon[134093]: osd.2 [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029] boot 2023-10-08T12:34:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:57 smithi092 ceph-mon[134093]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T12:34:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:34:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:57 smithi092 ceph-mon[134093]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:34:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:34:58.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:58 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T12:34:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:58 smithi173 ceph-mon[135182]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T12:34:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:58 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:34:59.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:58 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T12:34:59.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:58 smithi059 ceph-mon[98489]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T12:34:59.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:58 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:34:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:58 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T12:34:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:58 smithi092 ceph-mon[134093]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T12:34:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:58 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:34:59.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.353+0000 7f8c63c49700 1 -- 172.21.15.59:0/883487313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c5c072f60 msgr2=0x7f8c5c0733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:59.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.353+0000 7f8c63c49700 1 --2- 172.21.15.59:0/883487313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c5c072f60 0x7f8c5c0733e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009990 tx=0x7f8c4c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:34:59.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.353+0000 7f8c63c49700 1 -- 172.21.15.59:0/883487313 shutdown_connections 2023-10-08T12:34:59.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.353+0000 7f8c63c49700 1 --2- 172.21.15.59:0/883487313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c5c074770 0x7f8c5c072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:59.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.353+0000 7f8c63c49700 1 --2- 172.21.15.59:0/883487313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c5c111570 0x7f8c5c1139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:59.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.353+0000 7f8c63c49700 1 --2- 172.21.15.59:0/883487313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c5c072f60 0x7f8c5c0733e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:59.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.353+0000 7f8c63c49700 1 -- 172.21.15.59:0/883487313 >> 172.21.15.59:0/883487313 conn(0x7f8c5c0779e0 msgr2=0x7f8c5c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:59.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.353+0000 7f8c63c49700 1 -- 172.21.15.59:0/883487313 shutdown_connections 2023-10-08T12:34:59.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.353+0000 7f8c63c49700 1 -- 172.21.15.59:0/883487313 wait complete. 2023-10-08T12:34:59.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.354+0000 7f8c63c49700 1 Processor -- start 2023-10-08T12:34:59.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.355+0000 7f8c63c49700 1 -- start start 2023-10-08T12:34:59.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.355+0000 7f8c63c49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c5c072f60 0x7f8c5c19d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.355+0000 7f8c63c49700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c5c074770 0x7f8c5c19d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.355+0000 7f8c63c49700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c5c111570 0x7f8c5c1a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.355+0000 7f8c63c49700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c1a2260 con 0x7f8c5c072f60 2023-10-08T12:34:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.355+0000 7f8c63c49700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c1a23d0 con 0x7f8c5c074770 2023-10-08T12:34:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.355+0000 7f8c63c49700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c1a2590 con 0x7f8c5c111570 2023-10-08T12:34:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.355+0000 7f8c619e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c5c072f60 0x7f8c5c19d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.355+0000 7f8c619e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c5c072f60 0x7f8c5c19d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34834/0 (socket says 172.21.15.59:34834) 2023-10-08T12:34:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.355+0000 7f8c619e5700 1 -- 172.21.15.59:0/3184569280 learned_addr learned my addr 172.21.15.59:0/3184569280 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:34:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.355+0000 7f8c611e4700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c5c074770 0x7f8c5c19d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:59.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.356+0000 7f8c621e6700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c5c111570 0x7f8c5c1a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:59.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.356+0000 7f8c619e5700 1 -- 172.21.15.59:0/3184569280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c5c111570 msgr2=0x7f8c5c1a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:59.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.356+0000 7f8c619e5700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c5c111570 0x7f8c5c1a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:59.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.356+0000 7f8c619e5700 1 -- 172.21.15.59:0/3184569280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c5c074770 msgr2=0x7f8c5c19d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:59.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.356+0000 7f8c619e5700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c5c074770 0x7f8c5c19d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:59.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.356+0000 7f8c619e5700 1 -- 172.21.15.59:0/3184569280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c58009520 con 0x7f8c5c072f60 2023-10-08T12:34:59.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.356+0000 7f8c619e5700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c5c072f60 0x7f8c5c19d360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800eb30 tx=0x7f8c5800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:59.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.356+0000 7f8c52ffd700 1 -- 172.21.15.59:0/3184569280 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58009880 con 0x7f8c5c072f60 2023-10-08T12:34:59.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.356+0000 7f8c63c49700 1 -- 172.21.15.59:0/3184569280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c54009c40 con 0x7f8c5c072f60 2023-10-08T12:34:59.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.356+0000 7f8c52ffd700 1 -- 172.21.15.59:0/3184569280 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c580044e0 con 0x7f8c5c072f60 2023-10-08T12:34:59.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.356+0000 7f8c52ffd700 1 -- 172.21.15.59:0/3184569280 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58003d80 con 0x7f8c5c072f60 2023-10-08T12:34:59.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.357+0000 7f8c63c49700 1 -- 172.21.15.59:0/3184569280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4c0095f0 con 0x7f8c5c072f60 2023-10-08T12:34:59.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.358+0000 7f8c63c49700 1 -- 172.21.15.59:0/3184569280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c0740b0 con 0x7f8c5c072f60 2023-10-08T12:34:59.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.360+0000 7f8c52ffd700 1 -- 172.21.15.59:0/3184569280 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f8c58003f00 con 0x7f8c5c072f60 2023-10-08T12:34:59.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.362+0000 7f8c52ffd700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8c480a14c0 0x7f8c480a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:59.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.362+0000 7f8c52ffd700 1 -- 172.21.15.59:0/3184569280 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3452+0+0 (secure 0 0 0) 0x7f8c58014070 con 0x7f8c5c072f60 2023-10-08T12:34:59.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.363+0000 7f8c611e4700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8c480a14c0 0x7f8c480a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.363+0000 7f8c611e4700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8c480a14c0 0x7f8c480a3980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c19e8c0 tx=0x7f8c4c005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:59.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.364+0000 7f8c52ffd700 1 -- 172.21.15.59:0/3184569280 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8c58096980 con 0x7f8c5c072f60 2023-10-08T12:34:59.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:34:59.585+0000 7f8c63c49700 1 -- 172.21.15.59:0/3184569280 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c5c19e750 con 0x7f8c480a14c0 2023-10-08T12:34:59.666 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 12:34:59 smithi059 sudo[128881]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:34:59.666 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 12:34:59 smithi059 sudo[128881]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:34:59.666 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 12:34:59 smithi059 sudo[128881]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:34:59.666 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 12:34:59 smithi059 sudo[128881]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:34:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T12:34:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:59 smithi173 ceph-mon[135182]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T12:34:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:59 smithi173 ceph-mon[135182]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:34:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:34:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:34:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:34:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:00.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T12:35:00.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:59 smithi059 ceph-mon[98489]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T12:35:00.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:59 smithi059 ceph-mon[98489]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:00.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:35:00.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:35:00.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:34:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:00.015 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 12:34:59 smithi059 sudo[128968]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:35:00.015 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 12:34:59 smithi059 sudo[128968]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:35:00.015 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 12:34:59 smithi059 sudo[128968]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:35:00.015 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 12:34:59 smithi059 sudo[128968]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:35:00.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T12:35:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:59 smithi092 ceph-mon[134093]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T12:35:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:59 smithi092 ceph-mon[134093]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:35:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:35:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:34:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:00.402 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 12:35:00 smithi092 sudo[145897]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:35:00.402 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 12:35:00 smithi092 sudo[145897]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:35:00.402 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 12:35:00 smithi092 sudo[145897]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:35:00.402 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 12:35:00 smithi092 sudo[145897]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:35:00.669 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 12:35:00 smithi092 sudo[145900]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:35:00.669 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 12:35:00 smithi092 sudo[145900]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:35:00.669 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 12:35:00 smithi092 sudo[145900]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:35:00.669 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 12:35:00 smithi092 sudo[145900]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:35:00.925 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 12:35:00 smithi173 sudo[146858]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:35:00.925 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 12:35:00 smithi173 sudo[146858]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:35:00.925 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 12:35:00 smithi173 sudo[146858]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:35:00.925 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 12:35:00 smithi173 sudo[146858]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:35:00.925 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:00 smithi173 ceph-mon[135182]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:35:00.925 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:00 smithi173 ceph-mon[135182]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T12:35:00.925 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:00 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:00.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:00 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:00.953 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:00 smithi059 ceph-mon[98489]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:35:00.953 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:00 smithi059 ceph-mon[98489]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T12:35:00.953 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:00 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:00.953 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:00 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:00 smithi092 ceph-mon[134093]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:35:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:00 smithi092 ceph-mon[134093]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T12:35:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:00 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:00 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:01.217 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 12:35:00 smithi173 sudo[146861]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:35:01.218 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 12:35:00 smithi173 sudo[146861]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:35:01.218 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 12:35:00 smithi173 sudo[146861]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:35:01.218 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 12:35:00 smithi173 sudo[146861]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:35:01.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:01 smithi059 sudo[129077]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:35:01.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:01 smithi059 sudo[129077]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:35:01.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:01 smithi059 sudo[129077]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:35:01.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:01 smithi059 sudo[129077]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:35:02.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:02.082+0000 7f8c52ffd700 1 -- 172.21.15.59:0/3184569280 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8c580041b0 con 0x7f8c5c072f60 2023-10-08T12:35:02.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:02 smithi059 sudo[129125]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:35:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:02 smithi059 sudo[129125]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:35:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:02 smithi059 sudo[129125]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:35:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:02 smithi059 sudo[129125]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:35:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:02 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:02 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:02.562 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:02 smithi173 sudo[146864]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:35:02.562 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:02 smithi173 sudo[146864]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:35:02.563 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:02 smithi173 sudo[146864]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:35:02.563 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:02 smithi173 sudo[146864]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:35:02.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:02 smithi173 sudo[146867]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:35:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:02 smithi173 sudo[146867]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:35:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:02 smithi173 sudo[146867]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:35:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:02 smithi173 sudo[146867]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:35:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:02 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:03.057 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:02 smithi092 sudo[145903]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:35:03.058 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:02 smithi092 sudo[145903]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:35:03.058 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:02 smithi092 sudo[145903]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:35:03.058 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:02 smithi092 sudo[145903]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:35:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 sudo[145906]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:35:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 sudo[145906]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:35:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 sudo[145906]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:35:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 sudo[145906]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:35:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:35:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:35:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:35:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:35:03.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:35:03.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:35:03.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:35:03.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: mgrmap e20: x(active, since 111s), standbys: z, y 2023-10-08T12:35:03.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:35:03.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:35:03.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:35:03.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:35:03.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:35:03.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:35:03.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:35:03.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:03.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:03 smithi092 ceph-mon[134093]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:35:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:35:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:35:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:35:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:35:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:35:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:35:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:35:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: mgrmap e20: x(active, since 111s), standbys: z, y 2023-10-08T12:35:03.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:35:03.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:35:03.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:35:03.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:35:03.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:35:03.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:35:03.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:35:03.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:03.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:03 smithi173 ceph-mon[135182]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:35:03.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:35:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:35:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:35:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:35:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:35:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:35:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:35:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: mgrmap e20: x(active, since 111s), standbys: z, y 2023-10-08T12:35:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:35:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:35:03.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:35:03.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:35:03.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:35:03.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:35:03.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:35:03.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:03.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:03 smithi059 ceph-mon[98489]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:35:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:04 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4224595907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6ce7d51-2782-4f16-9a52-a8dff84acc46"}]: dispatch 2023-10-08T12:35:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:04 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6ce7d51-2782-4f16-9a52-a8dff84acc46"}]: dispatch 2023-10-08T12:35:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:04 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6ce7d51-2782-4f16-9a52-a8dff84acc46"}]': finished 2023-10-08T12:35:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:04 smithi092 ceph-mon[134093]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T12:35:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:04 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4224595907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6ce7d51-2782-4f16-9a52-a8dff84acc46"}]: dispatch 2023-10-08T12:35:04.648 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:04 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6ce7d51-2782-4f16-9a52-a8dff84acc46"}]: dispatch 2023-10-08T12:35:04.648 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:04 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6ce7d51-2782-4f16-9a52-a8dff84acc46"}]': finished 2023-10-08T12:35:04.648 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:04 smithi173 ceph-mon[135182]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T12:35:04.648 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:04.649 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:04 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4224595907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6ce7d51-2782-4f16-9a52-a8dff84acc46"}]: dispatch 2023-10-08T12:35:04.649 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:04 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6ce7d51-2782-4f16-9a52-a8dff84acc46"}]: dispatch 2023-10-08T12:35:04.649 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:04 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6ce7d51-2782-4f16-9a52-a8dff84acc46"}]': finished 2023-10-08T12:35:04.649 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:04 smithi059 ceph-mon[98489]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T12:35:04.649 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:05.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:05 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/311725231' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:35:05.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:05 smithi092 ceph-mon[134093]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:05.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:05 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/311725231' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:35:05.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:05 smithi173 ceph-mon[135182]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:05.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:05 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/311725231' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:35:05.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:05 smithi059 ceph-mon[98489]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:07 smithi092 ceph-mon[134093]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:07 smithi173 ceph-mon[135182]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:08.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:07 smithi059 ceph-mon[98489]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:09 smithi173 ceph-mon[135182]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T12:35:10.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:09 smithi059 ceph-mon[98489]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T12:35:10.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:09 smithi092 ceph-mon[134093]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T12:35:12.074 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:11 smithi059 ceph-mon[98489]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T12:35:12.075 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T12:35:12.075 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:11 smithi092 ceph-mon[134093]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T12:35:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T12:35:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:11 smithi173 ceph-mon[135182]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T12:35:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T12:35:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:12 smithi092 ceph-mon[134093]: Deploying daemon osd.3 on smithi059 2023-10-08T12:35:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:12 smithi173 ceph-mon[135182]: Deploying daemon osd.3 on smithi059 2023-10-08T12:35:13.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:12 smithi059 ceph-mon[98489]: Deploying daemon osd.3 on smithi059 2023-10-08T12:35:14.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:13 smithi059 ceph-mon[98489]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T12:35:14.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:13 smithi092 ceph-mon[134093]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T12:35:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:13 smithi173 ceph-mon[135182]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T12:35:16.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:15 smithi059 ceph-mon[98489]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 896 B/s rd, 23 KiB/s wr, 2 op/s 2023-10-08T12:35:16.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:15 smithi092 ceph-mon[134093]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 896 B/s rd, 23 KiB/s wr, 2 op/s 2023-10-08T12:35:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:15 smithi173 ceph-mon[135182]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 896 B/s rd, 23 KiB/s wr, 2 op/s 2023-10-08T12:35:18.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:17 smithi059 ceph-mon[98489]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T12:35:18.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:18.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:17 smithi092 ceph-mon[134093]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T12:35:18.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:17 smithi173 ceph-mon[135182]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T12:35:18.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:19.062 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:18 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:19.062 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:18 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:19.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:18 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:19.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:18 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:19.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:18 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:19.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:18 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:20.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:19 smithi092 ceph-mon[134093]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T12:35:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:19 smithi173 ceph-mon[135182]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T12:35:20.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:19 smithi059 ceph-mon[98489]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T12:35:21.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.497+0000 7f8c52ffd700 1 -- 172.21.15.59:0/3184569280 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8c5c19e750 con 0x7f8c480a14c0 2023-10-08T12:35:21.499 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 3 on host 'smithi059' 2023-10-08T12:35:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.500+0000 7f8c63c49700 1 -- 172.21.15.59:0/3184569280 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8c480a14c0 msgr2=0x7f8c480a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.500+0000 7f8c63c49700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8c480a14c0 0x7f8c480a3980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c19e8c0 tx=0x7f8c4c005fd0 comp rx=0 tx=0).stop 2023-10-08T12:35:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.500+0000 7f8c63c49700 1 -- 172.21.15.59:0/3184569280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c5c072f60 msgr2=0x7f8c5c19d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:21.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.500+0000 7f8c63c49700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c5c072f60 0x7f8c5c19d360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800eb30 tx=0x7f8c5800ee40 comp rx=0 tx=0).stop 2023-10-08T12:35:21.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.500+0000 7f8c63c49700 1 -- 172.21.15.59:0/3184569280 shutdown_connections 2023-10-08T12:35:21.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.500+0000 7f8c63c49700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8c480a14c0 0x7f8c480a3980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:21.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.500+0000 7f8c63c49700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c5c111570 0x7f8c5c1a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:21.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.500+0000 7f8c63c49700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c5c072f60 0x7f8c5c19d360 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:21.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.500+0000 7f8c63c49700 1 --2- 172.21.15.59:0/3184569280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c5c074770 0x7f8c5c19d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:21.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.500+0000 7f8c63c49700 1 -- 172.21.15.59:0/3184569280 >> 172.21.15.59:0/3184569280 conn(0x7f8c5c0779e0 msgr2=0x7f8c5c1101c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:21.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.500+0000 7f8c63c49700 1 -- 172.21.15.59:0/3184569280 shutdown_connections 2023-10-08T12:35:21.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:35:21.501+0000 7f8c63c49700 1 -- 172.21.15.59:0/3184569280 wait complete. 2023-10-08T12:35:21.749 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.750 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.750 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:21.750 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:21.750 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.750 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:21 smithi059 ceph-mon[98489]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:21.750 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.751 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.751 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:21.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:21.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:21.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:21 smithi092 ceph-mon[134093]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:21.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:21.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:21.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:21 smithi173 ceph-mon[135182]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:21.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:21.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:22.091 DEBUG:teuthology.orchestra.run.smithi059:osd.3> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.3.service 2023-10-08T12:35:22.095 INFO:tasks.cephadm:Deploying osd.4 on smithi092 with /dev/vg_nvme/lv_3... 2023-10-08T12:35:22.096 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T12:35:22.194 INFO:journalctl@ceph.osd.3.smithi059.stdout:-- Logs begin at Sun 2023-10-08 12:12:12 UTC. -- 2023-10-08T12:35:22.680 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:35:22.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:22 smithi059 ceph-mon[98489]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T12:35:22.860 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:22 smithi092 ceph-mon[134093]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T12:35:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:22 smithi173 ceph-mon[135182]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T12:35:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:23 smithi059 ceph-mon[98489]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T12:35:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:23 smithi059 ceph-mon[98489]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T12:35:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:23 smithi059 ceph-mon[98489]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:35:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:23 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:23.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:23 smithi059 ceph-mon[98489]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:23.766 INFO:journalctl@ceph.osd.3.smithi059.stdout:Oct 08 12:35:23 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-3[131406]: 2023-10-08T12:35:23.515+0000 7f13a5662700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T12:35:23.766 INFO:journalctl@ceph.osd.3.smithi059.stdout:Oct 08 12:35:23 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-3[131406]: 2023-10-08T12:35:23.526+0000 7f139fc54700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:35:23.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:23 smithi092 ceph-mon[134093]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T12:35:23.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:23 smithi092 ceph-mon[134093]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T12:35:23.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:23 smithi092 ceph-mon[134093]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:35:23.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:23 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:23.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:23 smithi092 ceph-mon[134093]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:23.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:23 smithi173 ceph-mon[135182]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T12:35:23.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:23 smithi173 ceph-mon[135182]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T12:35:23.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:23 smithi173 ceph-mon[135182]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:35:23.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:23 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:23.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:23 smithi173 ceph-mon[135182]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:35:24.057 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T12:35:24.057 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T12:35:24.057 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-08T12:35:24.057 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-08T12:35:24.057 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0148644 s, 705 MB/s 2023-10-08T12:35:24.057 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-08T12:35:24.438 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_3 2023-10-08T12:35:24.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:24 smithi092 ceph-mon[134093]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:35:24.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:24 smithi092 ceph-mon[134093]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T12:35:24.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:24 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:24.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:24 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:24.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:24 smithi092 ceph-mon[134093]: osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592] boot 2023-10-08T12:35:24.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:24 smithi092 ceph-mon[134093]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T12:35:24.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:24 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:24.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:24 smithi173 ceph-mon[135182]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:35:24.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:24 smithi173 ceph-mon[135182]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T12:35:24.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:24 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:24.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:24 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:24.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:24 smithi173 ceph-mon[135182]: osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592] boot 2023-10-08T12:35:24.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:24 smithi173 ceph-mon[135182]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T12:35:24.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:24 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:24.996 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:35:25.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:24 smithi059 ceph-mon[98489]: from='osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:35:25.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:24 smithi059 ceph-mon[98489]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T12:35:25.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:24 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:25.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:24 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:25.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:24 smithi059 ceph-mon[98489]: osd.3 [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592] boot 2023-10-08T12:35:25.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:24 smithi059 ceph-mon[98489]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T12:35:25.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:24 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:35:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:25 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:35:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:25 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:35:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:25 smithi173 ceph-mon[135182]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T12:35:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:25 smithi173 ceph-mon[135182]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:25.977 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:25 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:35:25.977 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:25 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:35:25.977 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:25 smithi092 ceph-mon[134093]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T12:35:25.978 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:25 smithi092 ceph-mon[134093]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:26.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:25 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:35:26.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:25 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:35:26.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:25 smithi059 ceph-mon[98489]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T12:35:26.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:25 smithi059 ceph-mon[98489]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:26.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.376+0000 7f4341fa1700 1 -- 172.21.15.92:0/3835074485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c1058d0 msgr2=0x7f433c105cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:26.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.376+0000 7f4341fa1700 1 --2- 172.21.15.92:0/3835074485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c1058d0 0x7f433c105cb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4330009990 tx=0x7f4330009ca0 comp rx=0 tx=0).stop 2023-10-08T12:35:26.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.376+0000 7f4341fa1700 1 -- 172.21.15.92:0/3835074485 shutdown_connections 2023-10-08T12:35:26.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.376+0000 7f4341fa1700 1 --2- 172.21.15.92:0/3835074485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c1058d0 0x7f433c105cb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:26.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.376+0000 7f4341fa1700 1 --2- 172.21.15.92:0/3835074485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c0ffb30 0x7f433c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:26.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.376+0000 7f4341fa1700 1 --2- 172.21.15.92:0/3835074485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f433c0ff190 0x7f433c0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:26.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.376+0000 7f4341fa1700 1 -- 172.21.15.92:0/3835074485 >> 172.21.15.92:0/3835074485 conn(0x7f433c074a10 msgr2=0x7f433c074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:26.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.376+0000 7f4341fa1700 1 -- 172.21.15.92:0/3835074485 shutdown_connections 2023-10-08T12:35:26.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.376+0000 7f4341fa1700 1 -- 172.21.15.92:0/3835074485 wait complete. 2023-10-08T12:35:26.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f4341fa1700 1 Processor -- start 2023-10-08T12:35:26.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f4341fa1700 1 -- start start 2023-10-08T12:35:26.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f4341fa1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f433c0ff190 0x7f433c100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:26.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f4341fa1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c0ffb30 0x7f433c1008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:26.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f4341fa1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c1058d0 0x7f433c100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:26.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f4341fa1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c1a5010 con 0x7f433c0ff190 2023-10-08T12:35:26.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f4341fa1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c1a5180 con 0x7f433c0ffb30 2023-10-08T12:35:26.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f4341fa1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c1a5340 con 0x7f433c1058d0 2023-10-08T12:35:26.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f433affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c0ffb30 0x7f433c1008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f433affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c0ffb30 0x7f433c1008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36234/0 (socket says 172.21.15.92:36234) 2023-10-08T12:35:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f433affd700 1 -- 172.21.15.92:0/96735335 learned_addr learned my addr 172.21.15.92:0/96735335 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-08T12:35:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.377+0000 7f433b7fe700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f433c0ff190 0x7f433c100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f433bfff700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c1058d0 0x7f433c100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f433affd700 1 -- 172.21.15.92:0/96735335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c1058d0 msgr2=0x7f433c100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f433affd700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c1058d0 0x7f433c100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f433affd700 1 -- 172.21.15.92:0/96735335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f433c0ff190 msgr2=0x7f433c100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f433affd700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f433c0ff190 0x7f433c100370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f433affd700 1 -- 172.21.15.92:0/96735335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43300095f0 con 0x7f433c0ffb30 2023-10-08T12:35:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f433bfff700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c1058d0 0x7f433c100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:35:26.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f433affd700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c0ffb30 0x7f433c1008b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f432c00d950 tx=0x7f432c00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f4338ff9700 1 -- 172.21.15.92:0/96735335 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c009940 con 0x7f433c0ffb30 2023-10-08T12:35:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f4341fa1700 1 -- 172.21.15.92:0/96735335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c1a5620 con 0x7f433c0ffb30 2023-10-08T12:35:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f4338ff9700 1 -- 172.21.15.92:0/96735335 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f432c010460 con 0x7f433c0ffb30 2023-10-08T12:35:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f4338ff9700 1 -- 172.21.15.92:0/96735335 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c00f620 con 0x7f433c0ffb30 2023-10-08T12:35:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.378+0000 7f4341fa1700 1 -- 172.21.15.92:0/96735335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c1a5b20 con 0x7f433c0ffb30 2023-10-08T12:35:26.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.379+0000 7f4341fa1700 1 -- 172.21.15.92:0/96735335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433c108d30 con 0x7f433c0ffb30 2023-10-08T12:35:26.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.380+0000 7f4338ff9700 1 -- 172.21.15.92:0/96735335 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f432c0108d0 con 0x7f433c0ffb30 2023-10-08T12:35:26.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.380+0000 7f4338ff9700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f43240a1550 0x7f43240a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:26.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.381+0000 7f4338ff9700 1 -- 172.21.15.92:0/96735335 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3913+0+0 (secure 0 0 0) 0x7f432c0cbb60 con 0x7f433c0ffb30 2023-10-08T12:35:26.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.381+0000 7f433b7fe700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f43240a1550 0x7f43240a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:26.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.381+0000 7f433b7fe700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f43240a1550 0x7f43240a3a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4330006010 tx=0x7f4330005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:26.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.384+0000 7f4338ff9700 1 -- 172.21.15.92:0/96735335 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f432c096250 con 0x7f433c0ffb30 2023-10-08T12:35:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:26.581+0000 7f4341fa1700 1 -- 172.21.15.92:0/96735335 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f433c101800 con 0x7f43240a1550 2023-10-08T12:35:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T12:35:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi059 2023-10-08T12:35:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi059 to 8636M 2023-10-08T12:35:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:35:26.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:35:26.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:27.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T12:35:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi059 2023-10-08T12:35:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi059 to 8636M 2023-10-08T12:35:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:27.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:27.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:27.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:35:27.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:35:27.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T12:35:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi059 2023-10-08T12:35:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi059 to 8636M 2023-10-08T12:35:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:35:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:35:27.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:28.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:27 smithi092 ceph-mon[134093]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:35:28.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:27 smithi092 ceph-mon[134093]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:28.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:27 smithi092 ceph-mon[134093]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T12:35:28.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:27 smithi173 ceph-mon[135182]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:35:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:27 smithi173 ceph-mon[135182]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:27 smithi173 ceph-mon[135182]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T12:35:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:27 smithi059 ceph-mon[98489]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:35:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:27 smithi059 ceph-mon[98489]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:27 smithi059 ceph-mon[98489]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T12:35:29.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:28 smithi092 ceph-mon[134093]: osdmap e30: 4 total, 4 up, 4 in 2023-10-08T12:35:29.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:28 smithi173 ceph-mon[135182]: osdmap e30: 4 total, 4 up, 4 in 2023-10-08T12:35:29.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:28 smithi059 ceph-mon[98489]: osdmap e30: 4 total, 4 up, 4 in 2023-10-08T12:35:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:29 smithi092 ceph-mon[134093]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 141 KiB/s, 0 objects/s recovering 2023-10-08T12:35:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:29 smithi092 ceph-mon[134093]: from='client.? 172.21.15.92:0/2417272204' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6e0c7a3-d272-4904-93fa-3eb06fc83324"}]: dispatch 2023-10-08T12:35:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:29 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6e0c7a3-d272-4904-93fa-3eb06fc83324"}]: dispatch 2023-10-08T12:35:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:29 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6e0c7a3-d272-4904-93fa-3eb06fc83324"}]': finished 2023-10-08T12:35:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:29 smithi092 ceph-mon[134093]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T12:35:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:29 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:30.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:29 smithi092 ceph-mon[134093]: from='client.? 172.21.15.92:0/4047674704' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:35:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:29 smithi173 ceph-mon[135182]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 141 KiB/s, 0 objects/s recovering 2023-10-08T12:35:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:29 smithi173 ceph-mon[135182]: from='client.? 172.21.15.92:0/2417272204' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6e0c7a3-d272-4904-93fa-3eb06fc83324"}]: dispatch 2023-10-08T12:35:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:29 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6e0c7a3-d272-4904-93fa-3eb06fc83324"}]: dispatch 2023-10-08T12:35:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:29 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6e0c7a3-d272-4904-93fa-3eb06fc83324"}]': finished 2023-10-08T12:35:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:29 smithi173 ceph-mon[135182]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T12:35:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:29 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:29 smithi173 ceph-mon[135182]: from='client.? 172.21.15.92:0/4047674704' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:35:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:29 smithi059 ceph-mon[98489]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 141 KiB/s, 0 objects/s recovering 2023-10-08T12:35:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:29 smithi059 ceph-mon[98489]: from='client.? 172.21.15.92:0/2417272204' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6e0c7a3-d272-4904-93fa-3eb06fc83324"}]: dispatch 2023-10-08T12:35:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:29 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6e0c7a3-d272-4904-93fa-3eb06fc83324"}]: dispatch 2023-10-08T12:35:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:29 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6e0c7a3-d272-4904-93fa-3eb06fc83324"}]': finished 2023-10-08T12:35:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:29 smithi059 ceph-mon[98489]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T12:35:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:29 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:29 smithi059 ceph-mon[98489]: from='client.? 172.21.15.92:0/4047674704' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:35:32.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:31 smithi092 ceph-mon[134093]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2023-10-08T12:35:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:31 smithi173 ceph-mon[135182]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2023-10-08T12:35:32.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:31 smithi059 ceph-mon[98489]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2023-10-08T12:35:33.985 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:33 smithi092 ceph-mon[134093]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:35:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:33 smithi173 ceph-mon[135182]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:35:34.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:33 smithi059 ceph-mon[98489]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:35:36.042 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:35 smithi092 ceph-mon[134093]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-08T12:35:36.042 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T12:35:36.042 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:35 smithi173 ceph-mon[135182]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-08T12:35:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T12:35:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:36.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:35 smithi059 ceph-mon[98489]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-08T12:35:36.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T12:35:36.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:36 smithi092 ceph-mon[134093]: Deploying daemon osd.4 on smithi092 2023-10-08T12:35:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:36 smithi173 ceph-mon[135182]: Deploying daemon osd.4 on smithi092 2023-10-08T12:35:37.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:36 smithi059 ceph-mon[98489]: Deploying daemon osd.4 on smithi092 2023-10-08T12:35:38.085 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:37 smithi092 ceph-mon[134093]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:37 smithi173 ceph-mon[135182]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:38.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:37 smithi059 ceph-mon[98489]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:39 smithi173 ceph-mon[135182]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:39.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:39 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:39.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:39 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:39.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:39 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:40.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:39 smithi059 ceph-mon[98489]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:40.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:39 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:40.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:39 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:40.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:39 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:40.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:39 smithi092 ceph-mon[134093]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:39 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:39 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:39 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:41.795 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 4 on host 'smithi092' 2023-10-08T12:35:41.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.794+0000 7f4338ff9700 1 -- 172.21.15.92:0/96735335 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f433c101800 con 0x7f43240a1550 2023-10-08T12:35:41.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.796+0000 7f4341fa1700 1 -- 172.21.15.92:0/96735335 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f43240a1550 msgr2=0x7f43240a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.796+0000 7f4341fa1700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f43240a1550 0x7f43240a3a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4330006010 tx=0x7f4330005960 comp rx=0 tx=0).stop 2023-10-08T12:35:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.796+0000 7f4341fa1700 1 -- 172.21.15.92:0/96735335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c0ffb30 msgr2=0x7f433c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.796+0000 7f4341fa1700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c0ffb30 0x7f433c1008b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f432c00d950 tx=0x7f432c00dc60 comp rx=0 tx=0).stop 2023-10-08T12:35:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.797+0000 7f4341fa1700 1 -- 172.21.15.92:0/96735335 shutdown_connections 2023-10-08T12:35:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.797+0000 7f4341fa1700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f43240a1550 0x7f43240a3a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.797+0000 7f4341fa1700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c1058d0 0x7f433c100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.797+0000 7f4341fa1700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f433c0ff190 0x7f433c100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.797+0000 7f4341fa1700 1 --2- 172.21.15.92:0/96735335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f433c0ffb30 0x7f433c1008b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.797+0000 7f4341fa1700 1 -- 172.21.15.92:0/96735335 >> 172.21.15.92:0/96735335 conn(0x7f433c074a10 msgr2=0x7f433c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:41.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.797+0000 7f4341fa1700 1 -- 172.21.15.92:0/96735335 shutdown_connections 2023-10-08T12:35:41.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:35:41.797+0000 7f4341fa1700 1 -- 172.21.15.92:0/96735335 wait complete. 2023-10-08T12:35:42.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:41 smithi092 ceph-mon[134093]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.183 DEBUG:teuthology.orchestra.run.smithi092:osd.4> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.4.service 2023-10-08T12:35:42.185 INFO:tasks.cephadm:Deploying osd.5 on smithi173 with /dev/vg_nvme/lv_3... 2023-10-08T12:35:42.185 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T12:35:42.214 INFO:journalctl@ceph.osd.4.smithi092.stdout:-- Logs begin at Sun 2023-10-08 12:08:21 UTC. -- 2023-10-08T12:35:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:41 smithi173 ceph-mon[135182]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:41 smithi059 ceph-mon[98489]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:42.762 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:35:43.627 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 08 12:35:43 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-4[148962]: 2023-10-08T12:35:43.369+0000 7fd5f940e640 -1 osd.4 0 log_to_monitors true 2023-10-08T12:35:44.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:43 smithi092 ceph-mon[134093]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:44.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:43 smithi092 ceph-mon[134093]: from='osd.4 [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:35:44.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:43 smithi092 ceph-mon[134093]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:35:44.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:43 smithi173 ceph-mon[135182]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:44.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:43 smithi173 ceph-mon[135182]: from='osd.4 [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:35:44.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:43 smithi173 ceph-mon[135182]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:35:44.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:43 smithi059 ceph-mon[98489]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:44.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:43 smithi059 ceph-mon[98489]: from='osd.4 [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:35:44.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:43 smithi059 ceph-mon[98489]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:35:44.274 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T12:35:44.274 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T12:35:44.274 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2023-10-08T12:35:44.274 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2023-10-08T12:35:44.274 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0157583 s, 665 MB/s 2023-10-08T12:35:44.274 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2023-10-08T12:35:44.618 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi173:vg_nvme/lv_3 2023-10-08T12:35:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:44 smithi173 ceph-mon[135182]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T12:35:44.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:44 smithi173 ceph-mon[135182]: from='osd.4 [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:35:44.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:44 smithi173 ceph-mon[135182]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T12:35:44.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:44 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:44.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:44 smithi173 ceph-mon[135182]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:35:45.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:44 smithi092 ceph-mon[134093]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T12:35:45.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:44 smithi092 ceph-mon[134093]: from='osd.4 [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:35:45.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:44 smithi092 ceph-mon[134093]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T12:35:45.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:44 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:45.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:44 smithi092 ceph-mon[134093]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:35:45.127 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 08 12:35:44 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-4[148962]: 2023-10-08T12:35:44.811+0000 7fd5eea85700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T12:35:45.127 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 08 12:35:44 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-4[148962]: 2023-10-08T12:35:44.817+0000 7fd5e8075700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:35:45.218 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:35:45.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:44 smithi059 ceph-mon[98489]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T12:35:45.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:44 smithi059 ceph-mon[98489]: from='osd.4 [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:35:45.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:44 smithi059 ceph-mon[98489]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T12:35:45.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:44 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:45.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:44 smithi059 ceph-mon[98489]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:35:46.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:46.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:35:46.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: osdmap e33: 5 total, 4 up, 5 in 2023-10-08T12:35:46.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:46.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:46.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi092 2023-10-08T12:35:46.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:46.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:46.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi092 to 8584M 2023-10-08T12:35:46.086 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.086 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:46.086 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:46.086 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.086 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:46.086 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:46.086 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:46.086 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:46.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:35:46.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: osdmap e33: 5 total, 4 up, 5 in 2023-10-08T12:35:46.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:46.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:46.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi092 2023-10-08T12:35:46.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi092 to 8584M 2023-10-08T12:35:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:46.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:35:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: osdmap e33: 5 total, 4 up, 5 in 2023-10-08T12:35:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi092 2023-10-08T12:35:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:46.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:35:46.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi092 to 8584M 2023-10-08T12:35:46.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:46.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:46.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:46.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:46.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:46.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:35:46.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.505+0000 7f3b2459b700 1 -- 172.21.15.173:0/4132467524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b1c0ffb50 msgr2=0x7f3b1c10bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:46.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.505+0000 7f3b2459b700 1 --2- 172.21.15.173:0/4132467524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b1c0ffb50 0x7f3b1c10bd10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400b0a0 tx=0x7f3b1400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:35:46.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.505+0000 7f3b2459b700 1 -- 172.21.15.173:0/4132467524 shutdown_connections 2023-10-08T12:35:46.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.505+0000 7f3b2459b700 1 --2- 172.21.15.173:0/4132467524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b1c103e70 0x7f3b1c104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:46.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.505+0000 7f3b2459b700 1 --2- 172.21.15.173:0/4132467524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b1c0ffb50 0x7f3b1c10bd10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:46.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.505+0000 7f3b2459b700 1 --2- 172.21.15.173:0/4132467524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1c0ff190 0x7f3b1c0ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:46.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.505+0000 7f3b2459b700 1 -- 172.21.15.173:0/4132467524 >> 172.21.15.173:0/4132467524 conn(0x7f3b1c074a10 msgr2=0x7f3b1c074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.505+0000 7f3b2459b700 1 -- 172.21.15.173:0/4132467524 shutdown_connections 2023-10-08T12:35:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.505+0000 7f3b2459b700 1 -- 172.21.15.173:0/4132467524 wait complete. 2023-10-08T12:35:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.505+0000 7f3b2459b700 1 Processor -- start 2023-10-08T12:35:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.505+0000 7f3b2459b700 1 -- start start 2023-10-08T12:35:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b2459b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b1c0ff190 0x7f3b1c100b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b2459b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b1c0ffb50 0x7f3b1c1010b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b2459b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1c103e70 0x7f3b1c1015f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b2459b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c1a50d0 con 0x7f3b1c103e70 2023-10-08T12:35:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b2459b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c1a5240 con 0x7f3b1c0ffb50 2023-10-08T12:35:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b2459b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c1a5400 con 0x7f3b1c0ff190 2023-10-08T12:35:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b22337700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b1c0ff190 0x7f3b1c100b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b22337700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b1c0ff190 0x7f3b1c100b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44196/0 (socket says 172.21.15.173:44196) 2023-10-08T12:35:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b22337700 1 -- 172.21.15.173:0/699903913 learned_addr learned my addr 172.21.15.173:0/699903913 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-08T12:35:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b21b36700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b1c0ffb50 0x7f3b1c1010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b22337700 1 -- 172.21.15.173:0/699903913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b1c0ffb50 msgr2=0x7f3b1c1010b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b22337700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b1c0ffb50 0x7f3b1c1010b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b22337700 1 -- 172.21.15.173:0/699903913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1c103e70 msgr2=0x7f3b1c1015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b22337700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1c103e70 0x7f3b1c1015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b22337700 1 -- 172.21.15.173:0/699903913 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14009d00 con 0x7f3b1c0ff190 2023-10-08T12:35:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b22337700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b1c0ff190 0x7f3b1c100b70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00c990 tx=0x7f3b0c00cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b137fe700 1 -- 172.21.15.173:0/699903913 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c007b00 con 0x7f3b1c0ff190 2023-10-08T12:35:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b137fe700 1 -- 172.21.15.173:0/699903913 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b0c007c60 con 0x7f3b1c0ff190 2023-10-08T12:35:46.511 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b137fe700 1 -- 172.21.15.173:0/699903913 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c018660 con 0x7f3b1c0ff190 2023-10-08T12:35:46.511 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b2459b700 1 -- 172.21.15.173:0/699903913 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1c1a56e0 con 0x7f3b1c0ff190 2023-10-08T12:35:46.511 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.506+0000 7f3b2459b700 1 -- 172.21.15.173:0/699903913 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1c1a5be0 con 0x7f3b1c0ff190 2023-10-08T12:35:46.512 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.507+0000 7f3b2459b700 1 -- 172.21.15.173:0/699903913 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1c108b80 con 0x7f3b1c0ff190 2023-10-08T12:35:46.512 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.508+0000 7f3b137fe700 1 -- 172.21.15.173:0/699903913 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3b0c00f450 con 0x7f3b1c0ff190 2023-10-08T12:35:46.512 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.509+0000 7f3b137fe700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b080a15d0 0x7f3b080a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:46.512 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.509+0000 7f3b137fe700 1 -- 172.21.15.173:0/699903913 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4316+0+0 (secure 0 0 0) 0x7f3b0c0cbd90 con 0x7f3b1c0ff190 2023-10-08T12:35:46.512 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.509+0000 7f3b21b36700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b080a15d0 0x7f3b080a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:46.512 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.510+0000 7f3b21b36700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b080a15d0 0x7f3b080a3a90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3b18006fd0 tx=0x7f3b18008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:46.514 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.513+0000 7f3b137fe700 1 -- 172.21.15.173:0/699903913 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b0c0963a0 con 0x7f3b1c0ff190 2023-10-08T12:35:46.711 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:35:46.710+0000 7f3b2459b700 1 -- 172.21.15.173:0/699903913 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b1c102050 con 0x7f3b080a15d0 2023-10-08T12:35:47.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:46 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:35:47.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:46 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:35:47.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:46 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:47.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:46 smithi092 ceph-mon[134093]: osd.4 [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480] boot 2023-10-08T12:35:47.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:46 smithi092 ceph-mon[134093]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T12:35:47.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:46 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:47.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:46 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:35:47.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:46 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:35:47.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:46 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:46 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:35:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:46 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:35:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:46 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:46 smithi173 ceph-mon[135182]: osd.4 [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480] boot 2023-10-08T12:35:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:46 smithi173 ceph-mon[135182]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T12:35:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:46 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:46 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:35:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:46 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:35:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:46 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:47.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:46 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:35:47.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:46 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:35:47.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:46 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:47.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:46 smithi059 ceph-mon[98489]: osd.4 [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480] boot 2023-10-08T12:35:47.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:46 smithi059 ceph-mon[98489]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T12:35:47.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:46 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:35:47.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:46 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:35:47.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:46 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:35:47.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:46 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:48.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:47 smithi092 ceph-mon[134093]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:35:48.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:47 smithi092 ceph-mon[134093]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:48.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:47 smithi092 ceph-mon[134093]: osdmap e35: 5 total, 5 up, 5 in 2023-10-08T12:35:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:47 smithi173 ceph-mon[135182]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:35:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:47 smithi173 ceph-mon[135182]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:47 smithi173 ceph-mon[135182]: osdmap e35: 5 total, 5 up, 5 in 2023-10-08T12:35:48.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:47 smithi059 ceph-mon[98489]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:35:48.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:47 smithi059 ceph-mon[98489]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:35:48.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:47 smithi059 ceph-mon[98489]: osdmap e35: 5 total, 5 up, 5 in 2023-10-08T12:35:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:49 smithi173 ceph-mon[135182]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:49 smithi173 ceph-mon[135182]: from='client.? 172.21.15.173:0/1094580834' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "486b651d-5ecc-4757-8c84-0d0fa61e123a"}]: dispatch 2023-10-08T12:35:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:49 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "486b651d-5ecc-4757-8c84-0d0fa61e123a"}]: dispatch 2023-10-08T12:35:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:49 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "486b651d-5ecc-4757-8c84-0d0fa61e123a"}]': finished 2023-10-08T12:35:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:49 smithi173 ceph-mon[135182]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T12:35:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:35:50.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:49 smithi059 ceph-mon[98489]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:50.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:49 smithi059 ceph-mon[98489]: from='client.? 172.21.15.173:0/1094580834' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "486b651d-5ecc-4757-8c84-0d0fa61e123a"}]: dispatch 2023-10-08T12:35:50.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:49 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "486b651d-5ecc-4757-8c84-0d0fa61e123a"}]: dispatch 2023-10-08T12:35:50.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:49 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "486b651d-5ecc-4757-8c84-0d0fa61e123a"}]': finished 2023-10-08T12:35:50.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:49 smithi059 ceph-mon[98489]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T12:35:50.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:35:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:49 smithi092 ceph-mon[134093]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:49 smithi092 ceph-mon[134093]: from='client.? 172.21.15.173:0/1094580834' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "486b651d-5ecc-4757-8c84-0d0fa61e123a"}]: dispatch 2023-10-08T12:35:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:49 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "486b651d-5ecc-4757-8c84-0d0fa61e123a"}]: dispatch 2023-10-08T12:35:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:49 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "486b651d-5ecc-4757-8c84-0d0fa61e123a"}]': finished 2023-10-08T12:35:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:49 smithi092 ceph-mon[134093]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T12:35:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:35:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:50 smithi173 ceph-mon[135182]: from='client.? 172.21.15.173:0/3155446448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:35:51.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:50 smithi059 ceph-mon[98489]: from='client.? 172.21.15.173:0/3155446448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:35:51.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:50 smithi092 ceph-mon[134093]: from='client.? 172.21.15.173:0/3155446448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:35:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:51 smithi173 ceph-mon[135182]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:52.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:51 smithi059 ceph-mon[98489]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:52.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:51 smithi092 ceph-mon[134093]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:54.055 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:53 smithi173 ceph-mon[135182]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:54.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:53 smithi092 ceph-mon[134093]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:54.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:53 smithi059 ceph-mon[98489]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:55 smithi092 ceph-mon[134093]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T12:35:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:55 smithi173 ceph-mon[135182]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T12:35:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:55 smithi059 ceph-mon[98489]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T12:35:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:56 smithi173 ceph-mon[135182]: Deploying daemon osd.5 on smithi173 2023-10-08T12:35:57.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:56 smithi092 ceph-mon[134093]: Deploying daemon osd.5 on smithi173 2023-10-08T12:35:57.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:56 smithi059 ceph-mon[98489]: Deploying daemon osd.5 on smithi173 2023-10-08T12:35:58.103 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:57 smithi173 ceph-mon[135182]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:57 smithi092 ceph-mon[134093]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:58.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:57 smithi059 ceph-mon[98489]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:35:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:35:59 smithi173 ceph-mon[135182]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:00.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:35:59 smithi059 ceph-mon[98489]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:00.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:35:59 smithi092 ceph-mon[134093]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:00 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:00 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:00.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:00 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:01.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:00 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:01.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:00 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:01.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:00 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:01.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:00 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:01.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:00 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:01.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:00 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:01 smithi173 ceph-mon[135182]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:02.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:01 smithi059 ceph-mon[98489]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:01 smithi092 ceph-mon[134093]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:02.728 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.727+0000 7f3b137fe700 1 -- 172.21.15.173:0/699903913 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3b1c102050 con 0x7f3b080a15d0 2023-10-08T12:36:02.729 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 5 on host 'smithi173' 2023-10-08T12:36:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 -- 172.21.15.173:0/699903913 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b080a15d0 msgr2=0x7f3b080a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b080a15d0 0x7f3b080a3a90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3b18006fd0 tx=0x7f3b18008040 comp rx=0 tx=0).stop 2023-10-08T12:36:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 -- 172.21.15.173:0/699903913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b1c0ff190 msgr2=0x7f3b1c100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b1c0ff190 0x7f3b1c100b70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00c990 tx=0x7f3b0c00cd50 comp rx=0 tx=0).stop 2023-10-08T12:36:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 -- 172.21.15.173:0/699903913 shutdown_connections 2023-10-08T12:36:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b080a15d0 0x7f3b080a3a90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1c103e70 0x7f3b1c1015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b1c0ff190 0x7f3b1c100b70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 --2- 172.21.15.173:0/699903913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b1c0ffb50 0x7f3b1c1010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 -- 172.21.15.173:0/699903913 >> 172.21.15.173:0/699903913 conn(0x7f3b1c074a10 msgr2=0x7f3b1c105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:02.732 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 -- 172.21.15.173:0/699903913 shutdown_connections 2023-10-08T12:36:02.732 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:02.729+0000 7f3b2459b700 1 -- 172.21.15.173:0/699903913 wait complete. 2023-10-08T12:36:03.115 DEBUG:teuthology.orchestra.run.smithi173:osd.5> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.5.service 2023-10-08T12:36:03.117 INFO:tasks.cephadm:Deploying osd.6 on smithi059 with /dev/vg_nvme/lv_2... 2023-10-08T12:36:03.117 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T12:36:03.150 INFO:journalctl@ceph.osd.5.smithi173.stdout:-- Logs begin at Sun 2023-10-08 12:08:19 UTC. -- 2023-10-08T12:36:03.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:03 smithi173 ceph-mon[135182]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:03.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:03.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:03 smithi059 ceph-mon[98489]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:03.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:03.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:03.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:03.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:03.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:03 smithi092 ceph-mon[134093]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:36:04.175 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 12:36:03 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T12:36:03.885+0000 7f8c18f92640 -1 osd.5 0 log_to_monitors true 2023-10-08T12:36:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:04 smithi173 ceph-mon[135182]: from='osd.5 [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:36:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:04 smithi173 ceph-mon[135182]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:36:04.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:04 smithi059 ceph-mon[98489]: from='osd.5 [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:36:04.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:04 smithi059 ceph-mon[98489]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:36:05.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:04 smithi092 ceph-mon[134093]: from='osd.5 [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:36:05.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:04 smithi092 ceph-mon[134093]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:36:05.957 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T12:36:05.957 INFO:teuthology.orchestra.run.smithi059.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T12:36:05.957 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10+0 records in 2023-10-08T12:36:05.957 INFO:teuthology.orchestra.run.smithi059.stderr:10+0 records out 2023-10-08T12:36:05.957 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.031608 s, 332 MB/s 2023-10-08T12:36:05.957 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping successful for: 2023-10-08T12:36:05.967 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 12:36:05 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T12:36:05.697+0000 7f8c0e609700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T12:36:05.967 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 12:36:05 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T12:36:05.703+0000 7f8c0a3fe700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:36:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:05 smithi173 ceph-mon[135182]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T12:36:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:05 smithi173 ceph-mon[135182]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T12:36:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:05 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:05 smithi173 ceph-mon[135182]: from='osd.5 [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:36:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:05 smithi173 ceph-mon[135182]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:36:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:05 smithi173 ceph-mon[135182]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:05.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:05 smithi059 ceph-mon[98489]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T12:36:05.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:05 smithi059 ceph-mon[98489]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T12:36:05.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:05 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:05.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:05 smithi059 ceph-mon[98489]: from='osd.5 [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:36:05.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:05 smithi059 ceph-mon[98489]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:36:05.993 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:05 smithi059 ceph-mon[98489]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:05 smithi092 ceph-mon[134093]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T12:36:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:05 smithi092 ceph-mon[134093]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T12:36:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:05 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:05 smithi092 ceph-mon[134093]: from='osd.5 [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:36:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:05 smithi092 ceph-mon[134093]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:36:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:05 smithi092 ceph-mon[134093]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:06.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi059:vg_nvme/lv_2 2023-10-08T12:36:06.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:36:06.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: osdmap e38: 6 total, 5 up, 6 in 2023-10-08T12:36:06.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:06.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:06.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi173 2023-10-08T12:36:06.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:06.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:06.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:06.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:06.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi173 to 8584M 2023-10-08T12:36:06.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:06.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:06.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:06.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:06.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:36:06.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: osdmap e38: 6 total, 5 up, 6 in 2023-10-08T12:36:06.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:06.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:06.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi173 2023-10-08T12:36:06.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:06.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:06.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:06.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:06.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi173 to 8584M 2023-10-08T12:36:06.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:06.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:06.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:06.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:07.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:36:07.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: osdmap e38: 6 total, 5 up, 6 in 2023-10-08T12:36:07.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:07.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:07.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi173 2023-10-08T12:36:07.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:07.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:07.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:07.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:07.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi173 to 8584M 2023-10-08T12:36:07.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:07.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:07.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:07.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:07.288 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:36:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:07 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:36:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:07 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:36:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:07 smithi173 ceph-mon[135182]: osd.5 [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573] boot 2023-10-08T12:36:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:07 smithi173 ceph-mon[135182]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T12:36:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:07 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:07 smithi173 ceph-mon[135182]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:07.983 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:07 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:36:07.984 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:07 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:36:07.984 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:07 smithi059 ceph-mon[98489]: osd.5 [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573] boot 2023-10-08T12:36:07.984 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:07 smithi059 ceph-mon[98489]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T12:36:07.984 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:07 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:07.984 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:07 smithi059 ceph-mon[98489]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:07 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:36:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:07 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:36:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:07 smithi092 ceph-mon[134093]: osd.5 [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573] boot 2023-10-08T12:36:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:07 smithi092 ceph-mon[134093]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T12:36:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:07 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:36:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:07 smithi092 ceph-mon[134093]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:36:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:08 smithi173 ceph-mon[135182]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T12:36:09.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:08 smithi059 ceph-mon[98489]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T12:36:09.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.024+0000 7f99e63f9700 1 -- 172.21.15.59:0/1817235449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99e0101200 msgr2=0x7f99e010d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:09.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.024+0000 7f99e63f9700 1 --2- 172.21.15.59:0/1817235449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99e0101200 0x7f99e010d630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f99d800b0a0 tx=0x7f99d800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:36:09.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.024+0000 7f99e63f9700 1 -- 172.21.15.59:0/1817235449 shutdown_connections 2023-10-08T12:36:09.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.024+0000 7f99e63f9700 1 --2- 172.21.15.59:0/1817235449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99e01056a0 0x7f99e0105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:09.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.024+0000 7f99e63f9700 1 --2- 172.21.15.59:0/1817235449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99e0101200 0x7f99e010d630 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:09.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.024+0000 7f99e63f9700 1 --2- 172.21.15.59:0/1817235449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e0100840 0x7f99e0100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:09.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.024+0000 7f99e63f9700 1 -- 172.21.15.59:0/1817235449 >> 172.21.15.59:0/1817235449 conn(0x7f99e0077950 msgr2=0x7f99e0077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:09.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.024+0000 7f99e63f9700 1 -- 172.21.15.59:0/1817235449 shutdown_connections 2023-10-08T12:36:09.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.024+0000 7f99e63f9700 1 -- 172.21.15.59:0/1817235449 wait complete. 2023-10-08T12:36:09.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.025+0000 7f99e63f9700 1 Processor -- start 2023-10-08T12:36:09.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.025+0000 7f99e63f9700 1 -- start start 2023-10-08T12:36:09.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.026+0000 7f99e63f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99e0100840 0x7f99e0196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.026+0000 7f99e63f9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e0101200 0x7f99e0197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.026+0000 7f99e63f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99e01056a0 0x7f99e019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.026+0000 7f99e63f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e019ab30 con 0x7f99e0100840 2023-10-08T12:36:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.026+0000 7f99e63f9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e019aca0 con 0x7f99e01056a0 2023-10-08T12:36:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.026+0000 7f99e63f9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e019ae60 con 0x7f99e0101200 2023-10-08T12:36:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.026+0000 7f99df7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e0101200 0x7f99e0197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.026+0000 7f99df7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e0101200 0x7f99e0197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38612/0 (socket says 172.21.15.59:38612) 2023-10-08T12:36:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.026+0000 7f99dffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99e0100840 0x7f99e0196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.026+0000 7f99df7fe700 1 -- 172.21.15.59:0/1313832733 learned_addr learned my addr 172.21.15.59:0/1313832733 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:36:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.026+0000 7f99e4996700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99e01056a0 0x7f99e019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.027+0000 7f99df7fe700 1 -- 172.21.15.59:0/1313832733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99e01056a0 msgr2=0x7f99e019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:09.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.027+0000 7f99df7fe700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99e01056a0 0x7f99e019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:09.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.027+0000 7f99df7fe700 1 -- 172.21.15.59:0/1313832733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99e0100840 msgr2=0x7f99e0196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:09.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.027+0000 7f99df7fe700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99e0100840 0x7f99e0196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:09.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.027+0000 7f99df7fe700 1 -- 172.21.15.59:0/1313832733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8009d00 con 0x7f99e0101200 2023-10-08T12:36:09.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.027+0000 7f99df7fe700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e0101200 0x7f99e0197230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99d400e9a0 tx=0x7f99d400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:09.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.027+0000 7f99dd7fa700 1 -- 172.21.15.59:0/1313832733 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4009790 con 0x7f99e0101200 2023-10-08T12:36:09.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.027+0000 7f99e63f9700 1 -- 172.21.15.59:0/1313832733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e019b140 con 0x7f99e0101200 2023-10-08T12:36:09.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.027+0000 7f99dd7fa700 1 -- 172.21.15.59:0/1313832733 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99d400cbd0 con 0x7f99e0101200 2023-10-08T12:36:09.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.027+0000 7f99dd7fa700 1 -- 172.21.15.59:0/1313832733 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4018680 con 0x7f99e0101200 2023-10-08T12:36:09.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.027+0000 7f99e63f9700 1 -- 172.21.15.59:0/1313832733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e01a3a90 con 0x7f99e0101200 2023-10-08T12:36:09.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.028+0000 7f99e63f9700 1 -- 172.21.15.59:0/1313832733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e0108d10 con 0x7f99e0101200 2023-10-08T12:36:09.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.031+0000 7f99dd7fa700 1 -- 172.21.15.59:0/1313832733 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f99d400cd40 con 0x7f99e0101200 2023-10-08T12:36:09.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.032+0000 7f99dd7fa700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f99c80a14d0 0x7f99c80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:09.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.032+0000 7f99dd7fa700 1 -- 172.21.15.59:0/1313832733 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4777+0+0 (secure 0 0 0) 0x7f99d4014070 con 0x7f99e0101200 2023-10-08T12:36:09.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.032+0000 7f99dffff700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f99c80a14d0 0x7f99c80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:09.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.033+0000 7f99dffff700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f99c80a14d0 0x7f99c80a3990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009be0 tx=0x7f99d0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:09.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.034+0000 7f99dd7fa700 1 -- 172.21.15.59:0/1313832733 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f99d4096910 con 0x7f99e0101200 2023-10-08T12:36:09.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:08 smithi092 ceph-mon[134093]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T12:36:09.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:09.253+0000 7f99e63f9700 1 -- 172.21.15.59:0/1313832733 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f99e0197fc0 con 0x7f99c80a14d0 2023-10-08T12:36:10.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:09 smithi059 ceph-mon[98489]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T12:36:10.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:09 smithi059 ceph-mon[98489]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:10.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:09 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:36:10.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:09 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:36:10.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:09 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:09 smithi092 ceph-mon[134093]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T12:36:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:09 smithi092 ceph-mon[134093]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:09 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:36:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:09 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:36:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:09 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:09 smithi173 ceph-mon[135182]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T12:36:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:09 smithi173 ceph-mon[135182]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:09 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:36:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:09 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:36:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:09 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:10 smithi059 ceph-mon[98489]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:36:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:10 smithi059 ceph-mon[98489]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T12:36:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:10 smithi092 ceph-mon[134093]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:36:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:10 smithi092 ceph-mon[134093]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T12:36:11.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:10 smithi173 ceph-mon[135182]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:36:11.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:10 smithi173 ceph-mon[135182]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T12:36:12.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:11 smithi059 ceph-mon[98489]: osdmap e43: 6 total, 6 up, 6 in 2023-10-08T12:36:12.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:11 smithi059 ceph-mon[98489]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:12.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:11 smithi092 ceph-mon[134093]: osdmap e43: 6 total, 6 up, 6 in 2023-10-08T12:36:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:11 smithi092 ceph-mon[134093]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:11 smithi173 ceph-mon[135182]: osdmap e43: 6 total, 6 up, 6 in 2023-10-08T12:36:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:11 smithi173 ceph-mon[135182]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:13.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:12 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1595536772' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5"}]: dispatch 2023-10-08T12:36:13.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:12 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1595536772' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5"}]': finished 2023-10-08T12:36:13.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:12 smithi059 ceph-mon[98489]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T12:36:13.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:13.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:12 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1595536772' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5"}]: dispatch 2023-10-08T12:36:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:12 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1595536772' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5"}]': finished 2023-10-08T12:36:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:12 smithi092 ceph-mon[134093]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T12:36:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:12 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1595536772' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5"}]: dispatch 2023-10-08T12:36:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:12 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1595536772' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5"}]': finished 2023-10-08T12:36:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:12 smithi173 ceph-mon[135182]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T12:36:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:14.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:13 smithi059 ceph-mon[98489]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 143 KiB/s, 0 objects/s recovering 2023-10-08T12:36:14.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:13 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3396337333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:36:14.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:13 smithi092 ceph-mon[134093]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 143 KiB/s, 0 objects/s recovering 2023-10-08T12:36:14.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:13 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3396337333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:36:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:13 smithi173 ceph-mon[135182]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 143 KiB/s, 0 objects/s recovering 2023-10-08T12:36:14.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:13 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3396337333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:36:16.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:15 smithi059 ceph-mon[98489]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:36:16.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:15 smithi092 ceph-mon[134093]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:36:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:15 smithi173 ceph-mon[135182]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:36:18.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:17 smithi059 ceph-mon[98489]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-10-08T12:36:18.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:17 smithi092 ceph-mon[134093]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-10-08T12:36:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:17 smithi173 ceph-mon[135182]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-10-08T12:36:19.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:19 smithi173 ceph-mon[135182]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:36:20.010 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:19 smithi059 ceph-mon[98489]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:36:20.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:19 smithi092 ceph-mon[134093]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:36:20.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:20 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T12:36:20.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:20 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:20 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T12:36:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:20 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:20 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T12:36:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:20 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:21.899 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:21 smithi059 ceph-mon[98489]: Deploying daemon osd.6 on smithi059 2023-10-08T12:36:21.899 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:21 smithi059 ceph-mon[98489]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T12:36:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:21 smithi173 ceph-mon[135182]: Deploying daemon osd.6 on smithi059 2023-10-08T12:36:21.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:21 smithi173 ceph-mon[135182]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T12:36:22.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:21 smithi092 ceph-mon[134093]: Deploying daemon osd.6 on smithi059 2023-10-08T12:36:22.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:21 smithi092 ceph-mon[134093]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T12:36:24.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:23 smithi059 ceph-mon[98489]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T12:36:24.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:23 smithi092 ceph-mon[134093]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T12:36:24.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:23 smithi173 ceph-mon[135182]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T12:36:26.073 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:25 smithi059 ceph-mon[98489]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:26.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:25 smithi092 ceph-mon[134093]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:25 smithi173 ceph-mon[135182]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:28.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:27 smithi092 ceph-mon[134093]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:28.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:28.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:28.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:27 smithi173 ceph-mon[135182]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:28.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:27 smithi059 ceph-mon[98489]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:29 smithi173 ceph-mon[135182]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:30.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:29 smithi059 ceph-mon[98489]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:30.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:29 smithi092 ceph-mon[134093]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:31.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.076+0000 7f99dd7fa700 1 -- 172.21.15.59:0/1313832733 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f99e0197fc0 con 0x7f99c80a14d0 2023-10-08T12:36:31.077 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 6 on host 'smithi059' 2023-10-08T12:36:31.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 -- 172.21.15.59:0/1313832733 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f99c80a14d0 msgr2=0x7f99c80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:31.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f99c80a14d0 0x7f99c80a3990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009be0 tx=0x7f99d0009260 comp rx=0 tx=0).stop 2023-10-08T12:36:31.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 -- 172.21.15.59:0/1313832733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e0101200 msgr2=0x7f99e0197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:31.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e0101200 0x7f99e0197230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99d400e9a0 tx=0x7f99d400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:36:31.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 -- 172.21.15.59:0/1313832733 shutdown_connections 2023-10-08T12:36:31.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f99c80a14d0 0x7f99c80a3990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:31.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99e01056a0 0x7f99e019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:31.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99e0100840 0x7f99e0196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:31.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 --2- 172.21.15.59:0/1313832733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e0101200 0x7f99e0197230 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:31.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 -- 172.21.15.59:0/1313832733 >> 172.21.15.59:0/1313832733 conn(0x7f99e0077950 msgr2=0x7f99e00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:31.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 -- 172.21.15.59:0/1313832733 shutdown_connections 2023-10-08T12:36:31.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:36:31.079+0000 7f99e63f9700 1 -- 172.21.15.59:0/1313832733 wait complete. 2023-10-08T12:36:31.719 DEBUG:teuthology.orchestra.run.smithi059:osd.6> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.6.service 2023-10-08T12:36:31.724 INFO:tasks.cephadm:Deploying osd.7 on smithi092 with /dev/vg_nvme/lv_2... 2023-10-08T12:36:31.724 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T12:36:31.797 INFO:journalctl@ceph.osd.6.smithi059.stdout:-- Logs begin at Sun 2023-10-08 12:12:12 UTC. -- 2023-10-08T12:36:31.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:31.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:31.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:31.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:31.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:31.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:31 smithi092 ceph-mon[134093]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:31.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:31.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:31.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:31.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:31 smithi092 ceph-mon[134093]: from='osd.6 [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T12:36:31.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:31 smithi092 ceph-mon[134093]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T12:36:31.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:31 smithi173 ceph-mon[135182]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:31 smithi173 ceph-mon[135182]: from='osd.6 [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T12:36:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:31 smithi173 ceph-mon[135182]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T12:36:32.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:31 smithi059 ceph-mon[98489]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:31 smithi059 ceph-mon[98489]: from='osd.6 [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T12:36:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:31 smithi059 ceph-mon[98489]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T12:36:32.320 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:36:33.325 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:33 smithi059 ceph-mon[98489]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T12:36:33.325 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:33 smithi059 ceph-mon[98489]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T12:36:33.325 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:33.325 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:33 smithi059 ceph-mon[98489]: from='osd.6 [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:36:33.325 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:33 smithi059 ceph-mon[98489]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:36:33.325 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:33 smithi059 ceph-mon[98489]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:33.325 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 12:36:33 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T12:36:33.046+0000 7f32a03dd700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T12:36:33.326 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 12:36:33 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T12:36:33.059+0000 7f32999cd700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:36:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:33 smithi092 ceph-mon[134093]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T12:36:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:33 smithi092 ceph-mon[134093]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T12:36:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:33 smithi092 ceph-mon[134093]: from='osd.6 [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:36:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:33 smithi092 ceph-mon[134093]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:36:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:33 smithi092 ceph-mon[134093]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:33 smithi173 ceph-mon[135182]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T12:36:33.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:33 smithi173 ceph-mon[135182]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T12:36:33.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:33.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:33 smithi173 ceph-mon[135182]: from='osd.6 [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:36:33.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:33 smithi173 ceph-mon[135182]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:36:33.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:33 smithi173 ceph-mon[135182]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:33.691 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T12:36:33.691 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T12:36:33.691 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-08T12:36:33.691 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-08T12:36:33.691 INFO:teuthology.orchestra.run.smithi092.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112652 s, 931 MB/s 2023-10-08T12:36:33.691 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-08T12:36:34.077 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_2 2023-10-08T12:36:34.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:34 smithi092 ceph-mon[134093]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:36:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:34 smithi092 ceph-mon[134093]: osdmap e46: 7 total, 6 up, 7 in 2023-10-08T12:36:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:34 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:34 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:34.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:34 smithi173 ceph-mon[135182]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:36:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:34 smithi173 ceph-mon[135182]: osdmap e46: 7 total, 6 up, 7 in 2023-10-08T12:36:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:34 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:34 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:34.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:34 smithi059 ceph-mon[98489]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:36:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:34 smithi059 ceph-mon[98489]: osdmap e46: 7 total, 6 up, 7 in 2023-10-08T12:36:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:34 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:34 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:34.632 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:36:35.058 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:35 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:36:35.058 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:35 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:36:35.058 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:35 smithi092 ceph-mon[134093]: osd.6 [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527] boot 2023-10-08T12:36:35.058 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:35 smithi092 ceph-mon[134093]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T12:36:35.058 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:35.058 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:35 smithi092 ceph-mon[134093]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:35.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:35 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:36:35.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:35 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:36:35.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:35 smithi173 ceph-mon[135182]: osd.6 [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527] boot 2023-10-08T12:36:35.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:35 smithi173 ceph-mon[135182]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T12:36:35.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:35.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:35 smithi173 ceph-mon[135182]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:35.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:35 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:36:35.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:35 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:36:35.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:35 smithi059 ceph-mon[98489]: osd.6 [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527] boot 2023-10-08T12:36:35.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:35 smithi059 ceph-mon[98489]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T12:36:35.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:36:35.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:35 smithi059 ceph-mon[98489]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:36:35.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.725+0000 7f31e5ff7700 1 -- 172.21.15.92:0/3304101414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e00ff750 msgr2=0x7f31e00ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:35.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.725+0000 7f31e5ff7700 1 --2- 172.21.15.92:0/3304101414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e00ff750 0x7f31e00ffbd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009990 tx=0x7f31d0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:35.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.725+0000 7f31e5ff7700 1 -- 172.21.15.92:0/3304101414 shutdown_connections 2023-10-08T12:36:35.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.725+0000 7f31e5ff7700 1 --2- 172.21.15.92:0/3304101414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31e0100110 0x7f31e010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:35.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.725+0000 7f31e5ff7700 1 --2- 172.21.15.92:0/3304101414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e01056b0 0x7f31e0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:35.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.725+0000 7f31e5ff7700 1 --2- 172.21.15.92:0/3304101414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e00ff750 0x7f31e00ffbd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:35.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.725+0000 7f31e5ff7700 1 -- 172.21.15.92:0/3304101414 >> 172.21.15.92:0/3304101414 conn(0x7f31e0075790 msgr2=0x7f31e0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:35.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.725+0000 7f31e5ff7700 1 -- 172.21.15.92:0/3304101414 shutdown_connections 2023-10-08T12:36:35.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.725+0000 7f31e5ff7700 1 -- 172.21.15.92:0/3304101414 wait complete. 2023-10-08T12:36:35.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31e5ff7700 1 Processor -- start 2023-10-08T12:36:35.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31e5ff7700 1 -- start start 2023-10-08T12:36:35.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31e5ff7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e00ff750 0x7f31e019c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:35.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31e5ff7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e0100110 0x7f31e019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:35.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31e5ff7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31e01056b0 0x7f31e0196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:35.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31e5ff7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0197170 con 0x7f31e00ff750 2023-10-08T12:36:35.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31e5ff7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e01972e0 con 0x7f31e0100110 2023-10-08T12:36:35.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31e5ff7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e01974a0 con 0x7f31e01056b0 2023-10-08T12:36:35.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31deffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e0100110 0x7f31e019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:35.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31deffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e0100110 0x7f31e019cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36348/0 (socket says 172.21.15.92:36348) 2023-10-08T12:36:35.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31deffd700 1 -- 172.21.15.92:0/157228401 learned_addr learned my addr 172.21.15.92:0/157228401 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-08T12:36:35.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31df7fe700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e00ff750 0x7f31e019c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:35.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31deffd700 1 -- 172.21.15.92:0/157228401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31e01056b0 msgr2=0x7f31e0196b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:35.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31dffff700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31e01056b0 0x7f31e0196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:35.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31deffd700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31e01056b0 0x7f31e0196b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:35.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31deffd700 1 -- 172.21.15.92:0/157228401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e00ff750 msgr2=0x7f31e019c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:35.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31deffd700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e00ff750 0x7f31e019c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:35.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31deffd700 1 -- 172.21.15.92:0/157228401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00095f0 con 0x7f31e0100110 2023-10-08T12:36:35.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.726+0000 7f31df7fe700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e00ff750 0x7f31e019c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:35.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.727+0000 7f31deffd700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e0100110 0x7f31e019cf10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f31d0000c00 tx=0x7f31d000f880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:35.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.727+0000 7f31dcff9700 1 -- 172.21.15.92:0/157228401 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d001d070 con 0x7f31e0100110 2023-10-08T12:36:35.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.727+0000 7f31dcff9700 1 -- 172.21.15.92:0/157228401 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31d000fde0 con 0x7f31e0100110 2023-10-08T12:36:35.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.727+0000 7f31e5ff7700 1 -- 172.21.15.92:0/157228401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e0197720 con 0x7f31e0100110 2023-10-08T12:36:35.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.727+0000 7f31dcff9700 1 -- 172.21.15.92:0/157228401 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0017770 con 0x7f31e0100110 2023-10-08T12:36:35.731 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.727+0000 7f31e5ff7700 1 -- 172.21.15.92:0/157228401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e01a39c0 con 0x7f31e0100110 2023-10-08T12:36:35.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.728+0000 7f31e5ff7700 1 -- 172.21.15.92:0/157228401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e0108ce0 con 0x7f31e0100110 2023-10-08T12:36:35.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.729+0000 7f31dcff9700 1 -- 172.21.15.92:0/157228401 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f31d0022aa0 con 0x7f31e0100110 2023-10-08T12:36:35.732 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.729+0000 7f31dcff9700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31cc0a1550 0x7f31cc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:35.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.729+0000 7f31dcff9700 1 -- 172.21.15.92:0/157228401 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5180+0+0 (secure 0 0 0) 0x7f31d00cd7d0 con 0x7f31e0100110 2023-10-08T12:36:35.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.729+0000 7f31df7fe700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31cc0a1550 0x7f31cc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:35.733 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.730+0000 7f31df7fe700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31cc0a1550 0x7f31cc0a3a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31c80099d0 tx=0x7f31c8008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:35.734 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.733+0000 7f31dcff9700 1 -- 172.21.15.92:0/157228401 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f31d0097b00 con 0x7f31e0100110 2023-10-08T12:36:35.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:35.931+0000 7f31e5ff7700 1 -- 172.21.15.92:0/157228401 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f31e0197fd0 con 0x7f31cc0a1550 2023-10-08T12:36:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: osdmap e48: 7 total, 7 up, 7 in 2023-10-08T12:36:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi059 2023-10-08T12:36:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi059 to 5757M 2023-10-08T12:36:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:36:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:36:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:36:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:36.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: osdmap e48: 7 total, 7 up, 7 in 2023-10-08T12:36:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi059 2023-10-08T12:36:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi059 to 5757M 2023-10-08T12:36:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:36:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:36:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:36:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: osdmap e48: 7 total, 7 up, 7 in 2023-10-08T12:36:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi059 2023-10-08T12:36:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi059 to 5757M 2023-10-08T12:36:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:36.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:36.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:36.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:36:36.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:36:36.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:36:36.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:37.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:37 smithi092 ceph-mon[134093]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:37.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:37 smithi173 ceph-mon[135182]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:37.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:37 smithi059 ceph-mon[98489]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:38 smithi059 ceph-mon[98489]: from='client.? 172.21.15.92:0/1429355445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d05083d7-e1a9-4bfb-947c-2c5533d36805"}]: dispatch 2023-10-08T12:36:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:38 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d05083d7-e1a9-4bfb-947c-2c5533d36805"}]: dispatch 2023-10-08T12:36:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:38 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d05083d7-e1a9-4bfb-947c-2c5533d36805"}]': finished 2023-10-08T12:36:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:38 smithi059 ceph-mon[98489]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T12:36:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:38 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:38.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:38 smithi092 ceph-mon[134093]: from='client.? 172.21.15.92:0/1429355445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d05083d7-e1a9-4bfb-947c-2c5533d36805"}]: dispatch 2023-10-08T12:36:38.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:38 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d05083d7-e1a9-4bfb-947c-2c5533d36805"}]: dispatch 2023-10-08T12:36:38.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:38 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d05083d7-e1a9-4bfb-947c-2c5533d36805"}]': finished 2023-10-08T12:36:38.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:38 smithi092 ceph-mon[134093]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T12:36:38.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:38 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:38.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:38 smithi173 ceph-mon[135182]: from='client.? 172.21.15.92:0/1429355445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d05083d7-e1a9-4bfb-947c-2c5533d36805"}]: dispatch 2023-10-08T12:36:38.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:38 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d05083d7-e1a9-4bfb-947c-2c5533d36805"}]: dispatch 2023-10-08T12:36:38.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:38 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d05083d7-e1a9-4bfb-947c-2c5533d36805"}]': finished 2023-10-08T12:36:38.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:38 smithi173 ceph-mon[135182]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T12:36:38.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:38 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:39 smithi173 ceph-mon[135182]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:39.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:39 smithi173 ceph-mon[135182]: from='client.? 172.21.15.92:0/313026648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:36:40.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:39 smithi059 ceph-mon[98489]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:40.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:39 smithi059 ceph-mon[98489]: from='client.? 172.21.15.92:0/313026648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:36:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:39 smithi092 ceph-mon[134093]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:39 smithi092 ceph-mon[134093]: from='client.? 172.21.15.92:0/313026648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:36:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:41 smithi092 ceph-mon[134093]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:41 smithi173 ceph-mon[135182]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:41 smithi059 ceph-mon[98489]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:44.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:43 smithi092 ceph-mon[134093]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:43 smithi173 ceph-mon[135182]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:44.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:43 smithi059 ceph-mon[98489]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:44.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:44 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T12:36:44.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:44 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:45.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:44 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T12:36:45.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:44 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:45.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:44 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T12:36:45.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:44 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:46.067 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:45 smithi092 ceph-mon[134093]: Deploying daemon osd.7 on smithi092 2023-10-08T12:36:46.067 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:45 smithi092 ceph-mon[134093]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:45 smithi173 ceph-mon[135182]: Deploying daemon osd.7 on smithi092 2023-10-08T12:36:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:45 smithi173 ceph-mon[135182]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:45 smithi059 ceph-mon[98489]: Deploying daemon osd.7 on smithi092 2023-10-08T12:36:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:45 smithi059 ceph-mon[98489]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:48.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:47 smithi092 ceph-mon[134093]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:47 smithi173 ceph-mon[135182]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:48.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:47 smithi059 ceph-mon[98489]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:49.859 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:49 smithi092 ceph-mon[134093]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:49.860 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:49.860 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:49.860 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:49 smithi173 ceph-mon[135182]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:50.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:50.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:50.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:49 smithi059 ceph-mon[98489]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:51.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.299+0000 7f31dcff9700 1 -- 172.21.15.92:0/157228401 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f31e0197fd0 con 0x7f31cc0a1550 2023-10-08T12:36:51.301 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 7 on host 'smithi092' 2023-10-08T12:36:51.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 -- 172.21.15.92:0/157228401 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31cc0a1550 msgr2=0x7f31cc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:51.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31cc0a1550 0x7f31cc0a3a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31c80099d0 tx=0x7f31c8008040 comp rx=0 tx=0).stop 2023-10-08T12:36:51.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 -- 172.21.15.92:0/157228401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e0100110 msgr2=0x7f31e019cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:51.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e0100110 0x7f31e019cf10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f31d0000c00 tx=0x7f31d000f880 comp rx=0 tx=0).stop 2023-10-08T12:36:51.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 -- 172.21.15.92:0/157228401 shutdown_connections 2023-10-08T12:36:51.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31cc0a1550 0x7f31cc0a3a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:51.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31e01056b0 0x7f31e0196b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:51.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e00ff750 0x7f31e019c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:51.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 --2- 172.21.15.92:0/157228401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e0100110 0x7f31e019cf10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:51.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 -- 172.21.15.92:0/157228401 >> 172.21.15.92:0/157228401 conn(0x7f31e0075790 msgr2=0x7f31e0068530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:51.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 -- 172.21.15.92:0/157228401 shutdown_connections 2023-10-08T12:36:51.304 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:36:51.302+0000 7f31e5ff7700 1 -- 172.21.15.92:0/157228401 wait complete. 2023-10-08T12:36:51.610 DEBUG:teuthology.orchestra.run.smithi092:osd.7> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.7.service 2023-10-08T12:36:51.612 INFO:tasks.cephadm:Deploying osd.8 on smithi173 with /dev/vg_nvme/lv_2... 2023-10-08T12:36:51.613 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T12:36:51.641 INFO:journalctl@ceph.osd.7.smithi092.stdout:-- Logs begin at Sun 2023-10-08 12:08:21 UTC. -- 2023-10-08T12:36:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:51 smithi092 ceph-mon[134093]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:51 smithi173 ceph-mon[135182]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:52.181 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:36:52.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:51 smithi059 ceph-mon[98489]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:52.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:52.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:52.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:52.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:52.984 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:52 smithi092 ceph-mon[134093]: from='osd.7 [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:36:52.984 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:52 smithi092 ceph-mon[134093]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:36:52.984 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 12:36:52 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T12:36:52.755+0000 7fddfe103640 -1 osd.7 0 log_to_monitors true 2023-10-08T12:36:53.185 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:52 smithi173 ceph-mon[135182]: from='osd.7 [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:36:53.186 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:52 smithi173 ceph-mon[135182]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:36:53.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:52 smithi059 ceph-mon[98489]: from='osd.7 [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:36:53.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:52 smithi059 ceph-mon[98489]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:36:53.875 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T12:36:53.875 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T12:36:53.875 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2023-10-08T12:36:53.875 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2023-10-08T12:36:53.876 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109588 s, 957 MB/s 2023-10-08T12:36:53.876 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2023-10-08T12:36:54.127 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 12:36:53 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T12:36:53.829+0000 7fddf377a700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T12:36:54.127 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 12:36:53 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T12:36:53.840+0000 7fddebd68700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:36:54.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:53 smithi092 ceph-mon[134093]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:54.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:53 smithi092 ceph-mon[134093]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T12:36:54.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:53 smithi092 ceph-mon[134093]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T12:36:54.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:54.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:53 smithi092 ceph-mon[134093]: from='osd.7 [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:36:54.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:53 smithi092 ceph-mon[134093]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:36:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:53 smithi173 ceph-mon[135182]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:53 smithi173 ceph-mon[135182]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T12:36:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:53 smithi173 ceph-mon[135182]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T12:36:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:53 smithi173 ceph-mon[135182]: from='osd.7 [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:36:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:53 smithi173 ceph-mon[135182]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:36:54.225 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi173:vg_nvme/lv_2 2023-10-08T12:36:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:53 smithi059 ceph-mon[98489]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:53 smithi059 ceph-mon[98489]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T12:36:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:53 smithi059 ceph-mon[98489]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T12:36:54.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:54.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:53 smithi059 ceph-mon[98489]: from='osd.7 [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:36:54.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:53 smithi059 ceph-mon[98489]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:36:54.785 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:36:54.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:36:54.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: osdmap e51: 8 total, 7 up, 8 in 2023-10-08T12:36:54.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:54.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:54.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:54.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: osd.7 [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685] boot 2023-10-08T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:55.195 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:36:55.195 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: osdmap e51: 8 total, 7 up, 8 in 2023-10-08T12:36:55.195 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:55.195 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:55.195 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:55.195 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:55.195 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:55.196 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:55.196 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:55.196 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:55.196 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:55.196 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:55.196 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:55.196 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: osd.7 [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685] boot 2023-10-08T12:36:55.196 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T12:36:55.196 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:36:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: osdmap e51: 8 total, 7 up, 8 in 2023-10-08T12:36:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:55.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:55.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:55.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:55.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:55.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:55.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: osd.7 [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685] boot 2023-10-08T12:36:55.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T12:36:55.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:36:55.907 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:55 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:36:55.908 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:55 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:36:55.908 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:55 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi092 2023-10-08T12:36:55.908 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:55 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi092 to 5722M 2023-10-08T12:36:55.908 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:55 smithi173 ceph-mon[135182]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:55.908 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:55.908 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:55.908 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:55.908 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:55.908 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:55 smithi173 ceph-mon[135182]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T12:36:56.098 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.097+0000 7f1a04233700 1 -- 172.21.15.173:0/4116076234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19fc1056b0 msgr2=0x7f19fc105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:56.098 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.097+0000 7f1a04233700 1 --2- 172.21.15.173:0/4116076234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19fc1056b0 0x7f19fc105a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009990 tx=0x7f19f8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:56.098 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.097+0000 7f1a04233700 1 -- 172.21.15.173:0/4116076234 shutdown_connections 2023-10-08T12:36:56.098 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.097+0000 7f1a04233700 1 --2- 172.21.15.173:0/4116076234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19fc100110 0x7f19fc10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:56.098 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.097+0000 7f1a04233700 1 --2- 172.21.15.173:0/4116076234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19fc1056b0 0x7f19fc105a90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:56.098 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.097+0000 7f1a04233700 1 --2- 172.21.15.173:0/4116076234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc0ff750 0x7f19fc0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:56.098 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.097+0000 7f1a04233700 1 -- 172.21.15.173:0/4116076234 >> 172.21.15.173:0/4116076234 conn(0x7f19fc075790 msgr2=0x7f19fc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:56.098 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.097+0000 7f1a04233700 1 -- 172.21.15.173:0/4116076234 shutdown_connections 2023-10-08T12:36:56.099 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.097+0000 7f1a04233700 1 -- 172.21.15.173:0/4116076234 wait complete. 2023-10-08T12:36:56.100 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a04233700 1 Processor -- start 2023-10-08T12:36:56.100 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a04233700 1 -- start start 2023-10-08T12:36:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a04233700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19fc0ff750 0x7f19fc196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a04233700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc100110 0x7f19fc1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a04233700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19fc1056b0 0x7f19fc19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a04233700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc19ab60 con 0x7f19fc100110 2023-10-08T12:36:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a04233700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc19acd0 con 0x7f19fc1056b0 2023-10-08T12:36:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a04233700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc19ae90 con 0x7f19fc0ff750 2023-10-08T12:36:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a01fcf700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19fc0ff750 0x7f19fc196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a01fcf700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19fc0ff750 0x7f19fc196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44310/0 (socket says 172.21.15.173:44310) 2023-10-08T12:36:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a01fcf700 1 -- 172.21.15.173:0/1367537243 learned_addr learned my addr 172.21.15.173:0/1367537243 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-08T12:36:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a017ce700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc100110 0x7f19fc1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a01fcf700 1 -- 172.21.15.173:0/1367537243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19fc1056b0 msgr2=0x7f19fc19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.098+0000 7f1a027d0700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19fc1056b0 0x7f19fc19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f1a01fcf700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19fc1056b0 0x7f19fc19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f1a01fcf700 1 -- 172.21.15.173:0/1367537243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc100110 msgr2=0x7f19fc1972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f1a01fcf700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc100110 0x7f19fc1972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f1a01fcf700 1 -- 172.21.15.173:0/1367537243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80095f0 con 0x7f19fc0ff750 2023-10-08T12:36:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f1a017ce700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc100110 0x7f19fc1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:36:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f1a027d0700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19fc1056b0 0x7f19fc19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:36:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f1a01fcf700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19fc0ff750 0x7f19fc196d70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19f8000c00 tx=0x7f19f800f7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f19f2ffd700 1 -- 172.21.15.173:0/1367537243 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f801d070 con 0x7f19fc0ff750 2023-10-08T12:36:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f19f2ffd700 1 -- 172.21.15.173:0/1367537243 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19f800fca0 con 0x7f19fc0ff750 2023-10-08T12:36:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f1a04233700 1 -- 172.21.15.173:0/1367537243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19fc19b110 con 0x7f19fc0ff750 2023-10-08T12:36:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f19f2ffd700 1 -- 172.21.15.173:0/1367537243 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8017750 con 0x7f19fc0ff750 2023-10-08T12:36:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.099+0000 7f1a04233700 1 -- 172.21.15.173:0/1367537243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19fc19b3e0 con 0x7f19fc0ff750 2023-10-08T12:36:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.100+0000 7f1a04233700 1 -- 172.21.15.173:0/1367537243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19fc108c70 con 0x7f19fc0ff750 2023-10-08T12:36:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.101+0000 7f19f2ffd700 1 -- 172.21.15.173:0/1367537243 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f19f8022470 con 0x7f19fc0ff750 2023-10-08T12:36:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.101+0000 7f19f2ffd700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e80a14d0 0x7f19e80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:56.104 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.102+0000 7f19f2ffd700 1 -- 172.21.15.173:0/1367537243 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5641+0+0 (secure 0 0 0) 0x7f19f80cdc10 con 0x7f19fc0ff750 2023-10-08T12:36:56.104 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.102+0000 7f1a017ce700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e80a14d0 0x7f19e80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:56.104 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.102+0000 7f1a017ce700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e80a14d0 0x7f19e80a3990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19fc198240 tx=0x7f19ec008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:56.105 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.105+0000 7f19f2ffd700 1 -- 172.21.15.173:0/1367537243 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f19f8097d70 con 0x7f19fc0ff750 2023-10-08T12:36:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:55 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:36:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:55 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:36:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:55 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi092 2023-10-08T12:36:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:55 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi092 to 5722M 2023-10-08T12:36:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:55 smithi092 ceph-mon[134093]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:55 smithi092 ceph-mon[134093]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T12:36:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:55 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:36:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:55 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:36:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:55 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi092 2023-10-08T12:36:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:55 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi092 to 5722M 2023-10-08T12:36:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:55 smithi059 ceph-mon[98489]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:36:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:56.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:36:56.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:55 smithi059 ceph-mon[98489]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T12:36:56.304 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:36:56.304+0000 7f1a04233700 1 -- 172.21.15.173:0/1367537243 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f19fc198060 con 0x7f19e80a14d0 2023-10-08T12:36:57.098 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:36:57.098 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:36:57.098 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:36:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:36:57.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:57.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:36:57.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:36:57.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:57 smithi092 ceph-mon[134093]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:36:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:57 smithi092 ceph-mon[134093]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:36:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:57 smithi092 ceph-mon[134093]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T12:36:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:57 smithi173 ceph-mon[135182]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:36:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:57 smithi173 ceph-mon[135182]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:36:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:57 smithi173 ceph-mon[135182]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T12:36:58.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:57 smithi059 ceph-mon[98489]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:36:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:57 smithi059 ceph-mon[98489]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:36:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:57 smithi059 ceph-mon[98489]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T12:36:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:58 smithi092 ceph-mon[134093]: osdmap e55: 8 total, 8 up, 8 in 2023-10-08T12:36:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:58 smithi092 ceph-mon[134093]: from='client.? 172.21.15.173:0/517137593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1865ed29-0774-44e9-bc01-344d59472acc"}]: dispatch 2023-10-08T12:36:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:58 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1865ed29-0774-44e9-bc01-344d59472acc"}]: dispatch 2023-10-08T12:36:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:58 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1865ed29-0774-44e9-bc01-344d59472acc"}]': finished 2023-10-08T12:36:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:58 smithi092 ceph-mon[134093]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T12:36:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:58 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:36:59.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:58 smithi173 ceph-mon[135182]: osdmap e55: 8 total, 8 up, 8 in 2023-10-08T12:36:59.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:58 smithi173 ceph-mon[135182]: from='client.? 172.21.15.173:0/517137593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1865ed29-0774-44e9-bc01-344d59472acc"}]: dispatch 2023-10-08T12:36:59.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:58 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1865ed29-0774-44e9-bc01-344d59472acc"}]: dispatch 2023-10-08T12:36:59.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:58 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1865ed29-0774-44e9-bc01-344d59472acc"}]': finished 2023-10-08T12:36:59.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:58 smithi173 ceph-mon[135182]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T12:36:59.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:58 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:36:59.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:58 smithi059 ceph-mon[98489]: osdmap e55: 8 total, 8 up, 8 in 2023-10-08T12:36:59.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:58 smithi059 ceph-mon[98489]: from='client.? 172.21.15.173:0/517137593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1865ed29-0774-44e9-bc01-344d59472acc"}]: dispatch 2023-10-08T12:36:59.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:58 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1865ed29-0774-44e9-bc01-344d59472acc"}]: dispatch 2023-10-08T12:36:59.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:58 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1865ed29-0774-44e9-bc01-344d59472acc"}]': finished 2023-10-08T12:36:59.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:58 smithi059 ceph-mon[98489]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T12:36:59.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:58 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:59 smithi092 ceph-mon[134093]: pgmap v158: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:36:59 smithi092 ceph-mon[134093]: from='client.? 172.21.15.173:0/950740396' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:37:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:59 smithi173 ceph-mon[135182]: pgmap v158: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:36:59 smithi173 ceph-mon[135182]: from='client.? 172.21.15.173:0/950740396' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:37:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:59 smithi059 ceph-mon[98489]: pgmap v158: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:36:59 smithi059 ceph-mon[98489]: from='client.? 172.21.15.173:0/950740396' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:37:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:01 smithi092 ceph-mon[134093]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:01 smithi173 ceph-mon[135182]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:02.286 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:01 smithi059 ceph-mon[98489]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:03 smithi092 ceph-mon[134093]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:03 smithi173 ceph-mon[135182]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:04.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:03 smithi059 ceph-mon[98489]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:05 smithi092 ceph-mon[134093]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:05 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T12:37:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:05 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:06.174 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:05 smithi173 ceph-mon[135182]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:06.174 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:05 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T12:37:06.174 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:05 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:06.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:05 smithi059 ceph-mon[98489]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:06.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:05 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T12:37:06.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:05 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:06.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:06 smithi173 ceph-mon[135182]: Deploying daemon osd.8 on smithi173 2023-10-08T12:37:07.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:06 smithi092 ceph-mon[134093]: Deploying daemon osd.8 on smithi173 2023-10-08T12:37:07.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:06 smithi059 ceph-mon[98489]: Deploying daemon osd.8 on smithi173 2023-10-08T12:37:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:07 smithi173 ceph-mon[135182]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:07 smithi092 ceph-mon[134093]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:08.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:07 smithi059 ceph-mon[98489]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:09.665 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:09 smithi173 ceph-mon[135182]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:09.665 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:09 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:09.666 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:09 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:09.666 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:09 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:10.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:09 smithi059 ceph-mon[98489]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:10.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:09 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:10.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:09 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:10.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:09 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:09 smithi092 ceph-mon[134093]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:09 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:09 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:09 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:11 smithi173 ceph-mon[135182]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:11 smithi092 ceph-mon[134093]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:12.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:11 smithi059 ceph-mon[98489]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:12.468 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.468+0000 7f19f2ffd700 1 -- 172.21.15.173:0/1367537243 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f19fc198060 con 0x7f19e80a14d0 2023-10-08T12:37:12.469 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 8 on host 'smithi173' 2023-10-08T12:37:12.471 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.470+0000 7f1a04233700 1 -- 172.21.15.173:0/1367537243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e80a14d0 msgr2=0x7f19e80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:12.471 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.470+0000 7f1a04233700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e80a14d0 0x7f19e80a3990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19fc198240 tx=0x7f19ec008040 comp rx=0 tx=0).stop 2023-10-08T12:37:12.471 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.470+0000 7f1a04233700 1 -- 172.21.15.173:0/1367537243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19fc0ff750 msgr2=0x7f19fc196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:12.471 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.470+0000 7f1a04233700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19fc0ff750 0x7f19fc196d70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19f8000c00 tx=0x7f19f800f7b0 comp rx=0 tx=0).stop 2023-10-08T12:37:12.471 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.471+0000 7f1a04233700 1 -- 172.21.15.173:0/1367537243 shutdown_connections 2023-10-08T12:37:12.471 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.471+0000 7f1a04233700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e80a14d0 0x7f19e80a3990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:12.471 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.471+0000 7f1a04233700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19fc1056b0 0x7f19fc19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:12.471 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.471+0000 7f1a04233700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19fc0ff750 0x7f19fc196d70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:12.471 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.471+0000 7f1a04233700 1 --2- 172.21.15.173:0/1367537243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc100110 0x7f19fc1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:12.471 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.471+0000 7f1a04233700 1 -- 172.21.15.173:0/1367537243 >> 172.21.15.173:0/1367537243 conn(0x7f19fc075790 msgr2=0x7f19fc068570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:12.472 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.471+0000 7f1a04233700 1 -- 172.21.15.173:0/1367537243 shutdown_connections 2023-10-08T12:37:12.472 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:37:12.471+0000 7f1a04233700 1 -- 172.21.15.173:0/1367537243 wait complete. 2023-10-08T12:37:12.877 DEBUG:teuthology.orchestra.run.smithi173:osd.8> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.8.service 2023-10-08T12:37:12.879 INFO:tasks.cephadm:Deploying osd.9 on smithi059 with /dev/vg_nvme/lv_1... 2023-10-08T12:37:12.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T12:37:12.912 INFO:journalctl@ceph.osd.8.smithi173.stdout:-- Logs begin at Sun 2023-10-08 12:08:19 UTC. -- 2023-10-08T12:37:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:13.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:13.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:13.631 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:37:13.657 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 12:37:13 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T12:37:13.466+0000 7f40b3eaf640 -1 osd.8 0 log_to_monitors true 2023-10-08T12:37:13.925 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:13 smithi173 ceph-mon[135182]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:13.925 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:13 smithi173 ceph-mon[135182]: from='osd.8 [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:37:13.925 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:13 smithi173 ceph-mon[135182]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:37:14.209 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:13 smithi059 ceph-mon[98489]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:14.209 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:13 smithi059 ceph-mon[98489]: from='osd.8 [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:37:14.210 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:13 smithi059 ceph-mon[98489]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:37:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:13 smithi092 ceph-mon[134093]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:13 smithi092 ceph-mon[134093]: from='osd.8 [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:37:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:13 smithi092 ceph-mon[134093]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:37:15.683 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T12:37:15.683 INFO:teuthology.orchestra.run.smithi059.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T12:37:15.683 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10+0 records in 2023-10-08T12:37:15.683 INFO:teuthology.orchestra.run.smithi059.stderr:10+0 records out 2023-10-08T12:37:15.683 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0324519 s, 323 MB/s 2023-10-08T12:37:15.683 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping successful for: 2023-10-08T12:37:15.717 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T12:37:15.459+0000 7f40a9526700 -1 osd.8 0 waiting for initial osdmap 2023-10-08T12:37:15.718 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T12:37:15.472+0000 7f40a3317700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:37:15.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T12:37:15.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T12:37:15.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:15.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='osd.8 [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:37:15.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:37:15.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:15.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:15.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:15.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:15.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:15.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:15.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:15.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:15.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:15 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:15.720 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T12:37:15.720 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T12:37:15.720 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:15.720 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='osd.8 [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:37:15.720 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:37:15.720 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:15.720 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:15.720 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:15.721 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:15.721 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:15.721 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:15.721 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:15.721 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:15.721 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:15 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:15.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T12:37:15.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T12:37:15.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:15.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='osd.8 [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:37:15.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:37:15.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:15.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:15.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:15.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:15.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:15.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:15.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:15.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:15.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:15 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:16.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi059:vg_nvme/lv_1 2023-10-08T12:37:16.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:16 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi173 2023-10-08T12:37:16.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:16 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi173 to 5722M 2023-10-08T12:37:16.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:16 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:16.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:16 smithi173 ceph-mon[135182]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:37:16.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:16 smithi173 ceph-mon[135182]: osdmap e58: 9 total, 8 up, 9 in 2023-10-08T12:37:16.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:16 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:16.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:16 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:16.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:16 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi173 2023-10-08T12:37:16.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:16 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi173 to 5722M 2023-10-08T12:37:16.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:16 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:16.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:16 smithi059 ceph-mon[98489]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:37:16.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:16 smithi059 ceph-mon[98489]: osdmap e58: 9 total, 8 up, 9 in 2023-10-08T12:37:16.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:16 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:16.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:16 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:16.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:16 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi173 2023-10-08T12:37:16.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:16 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi173 to 5722M 2023-10-08T12:37:16.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:16 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:16.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:16 smithi092 ceph-mon[134093]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:37:16.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:16 smithi092 ceph-mon[134093]: osdmap e58: 9 total, 8 up, 9 in 2023-10-08T12:37:16.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:16 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:16.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:16 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:16.952 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:37:17.600 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:17 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:37:17.625 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:17 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:37:17.625 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:17 smithi059 ceph-mon[98489]: osd.8 [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392] boot 2023-10-08T12:37:17.625 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:17 smithi059 ceph-mon[98489]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T12:37:17.625 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:17.625 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:17 smithi059 ceph-mon[98489]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:17.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:17 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:37:17.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:17 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:37:17.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:17 smithi092 ceph-mon[134093]: osd.8 [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392] boot 2023-10-08T12:37:17.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:17 smithi092 ceph-mon[134093]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T12:37:17.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:17.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:17 smithi092 ceph-mon[134093]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:17 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:37:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:17 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:37:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:17 smithi173 ceph-mon[135182]: osd.8 [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392] boot 2023-10-08T12:37:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:17 smithi173 ceph-mon[135182]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T12:37:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:37:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:17 smithi173 ceph-mon[135182]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:37:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.609+0000 7f9244d4d700 1 -- 172.21.15.59:0/1250417523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92401057c0 msgr2=0x7f9240105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.609+0000 7f9244d4d700 1 --2- 172.21.15.59:0/1250417523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92401057c0 0x7f9240105ba0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9230009990 tx=0x7f9230009ca0 comp rx=0 tx=0).stop 2023-10-08T12:37:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.609+0000 7f9244d4d700 1 -- 172.21.15.59:0/1250417523 shutdown_connections 2023-10-08T12:37:18.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.609+0000 7f9244d4d700 1 --2- 172.21.15.59:0/1250417523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9240101260 0x7f924010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:18.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.609+0000 7f9244d4d700 1 --2- 172.21.15.59:0/1250417523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92401057c0 0x7f9240105ba0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:18.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.609+0000 7f9244d4d700 1 --2- 172.21.15.59:0/1250417523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92401008a0 0x7f9240100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:18.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.609+0000 7f9244d4d700 1 -- 172.21.15.59:0/1250417523 >> 172.21.15.59:0/1250417523 conn(0x7f92400779e0 msgr2=0x7f9240077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:18.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.609+0000 7f9244d4d700 1 -- 172.21.15.59:0/1250417523 shutdown_connections 2023-10-08T12:37:18.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.609+0000 7f9244d4d700 1 -- 172.21.15.59:0/1250417523 wait complete. 2023-10-08T12:37:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.610+0000 7f9244d4d700 1 Processor -- start 2023-10-08T12:37:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.610+0000 7f9244d4d700 1 -- start start 2023-10-08T12:37:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f9244d4d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92401008a0 0x7f9240198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f9244d4d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9240101260 0x7f9240199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f9244d4d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92401057c0 0x7f924019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f9244d4d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924019dd20 con 0x7f92401008a0 2023-10-08T12:37:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f9244d4d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924019de90 con 0x7f92401057c0 2023-10-08T12:37:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f9244d4d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924019e050 con 0x7f9240101260 2023-10-08T12:37:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92401008a0 0x7f9240198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92401057c0 0x7f924019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92401057c0 0x7f924019d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:37586/0 (socket says 172.21.15.59:37586) 2023-10-08T12:37:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92401008a0 0x7f9240198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47826/0 (socket says 172.21.15.59:47826) 2023-10-08T12:37:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923ed9d700 1 -- 172.21.15.59:0/119170564 learned_addr learned my addr 172.21.15.59:0/119170564 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:37:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923dd9b700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9240101260 0x7f9240199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923e59c700 1 -- 172.21.15.59:0/119170564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9240101260 msgr2=0x7f9240199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923e59c700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9240101260 0x7f9240199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923e59c700 1 -- 172.21.15.59:0/119170564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92401057c0 msgr2=0x7f924019d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923e59c700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92401057c0 0x7f924019d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923e59c700 1 -- 172.21.15.59:0/119170564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92300095f0 con 0x7f92401008a0 2023-10-08T12:37:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.611+0000 7f923ed9d700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92401057c0 0x7f924019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.612+0000 7f923e59c700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92401008a0 0x7f9240198e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f92300098e0 tx=0x7f9230004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.612+0000 7f922f7fe700 1 -- 172.21.15.59:0/119170564 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923001d070 con 0x7f92401008a0 2023-10-08T12:37:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.612+0000 7f922f7fe700 1 -- 172.21.15.59:0/119170564 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9230022470 con 0x7f92401008a0 2023-10-08T12:37:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.612+0000 7f9244d4d700 1 -- 172.21.15.59:0/119170564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924019e2d0 con 0x7f92401008a0 2023-10-08T12:37:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.612+0000 7f922f7fe700 1 -- 172.21.15.59:0/119170564 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230017650 con 0x7f92401008a0 2023-10-08T12:37:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.612+0000 7f9244d4d700 1 -- 172.21.15.59:0/119170564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924019e570 con 0x7f92401008a0 2023-10-08T12:37:18.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.614+0000 7f9244d4d700 1 -- 172.21.15.59:0/119170564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9240101f30 con 0x7f92401008a0 2023-10-08T12:37:18.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.615+0000 7f922f7fe700 1 -- 172.21.15.59:0/119170564 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f92300225e0 con 0x7f92401008a0 2023-10-08T12:37:18.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.617+0000 7f922f7fe700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92280a14d0 0x7f92280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:18.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.617+0000 7f922f7fe700 1 -- 172.21.15.59:0/119170564 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f92300cde20 con 0x7f92401008a0 2023-10-08T12:37:18.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.617+0000 7f923dd9b700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92280a14d0 0x7f92280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:18.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.618+0000 7f923dd9b700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92280a14d0 0x7f92280a3990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f924019a380 tx=0x7f9234009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:18.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.619+0000 7f922f7fe700 1 -- 172.21.15.59:0/119170564 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9230097dc0 con 0x7f92401008a0 2023-10-08T12:37:18.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:18 smithi059 ceph-mon[98489]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T12:37:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:18.846+0000 7f9244d4d700 1 -- 172.21.15.59:0/119170564 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9240110710 con 0x7f92280a14d0 2023-10-08T12:37:18.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:18 smithi092 ceph-mon[134093]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T12:37:18.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:18 smithi173 ceph-mon[135182]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T12:37:19.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:19 smithi059 ceph-mon[98489]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T12:37:19.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:19 smithi059 ceph-mon[98489]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T12:37:19.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:19 smithi059 ceph-mon[98489]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:19.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:19 smithi059 ceph-mon[98489]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:37:19.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:19 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:37:19.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:19 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:37:19.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:19 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:19 smithi092 ceph-mon[134093]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T12:37:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:19 smithi092 ceph-mon[134093]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T12:37:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:19 smithi092 ceph-mon[134093]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:19 smithi092 ceph-mon[134093]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:37:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:19 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:37:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:19 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:37:19.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:19 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:19.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:19 smithi173 ceph-mon[135182]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T12:37:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:19 smithi173 ceph-mon[135182]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T12:37:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:19 smithi173 ceph-mon[135182]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:19 smithi173 ceph-mon[135182]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:37:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:19 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:37:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:19 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:37:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:19 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:20 smithi173 ceph-mon[135182]: osdmap e63: 9 total, 9 up, 9 in 2023-10-08T12:37:21.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:20 smithi059 ceph-mon[98489]: osdmap e63: 9 total, 9 up, 9 in 2023-10-08T12:37:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:20 smithi092 ceph-mon[134093]: osdmap e63: 9 total, 9 up, 9 in 2023-10-08T12:37:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:21 smithi173 ceph-mon[135182]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T12:37:22.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:21 smithi059 ceph-mon[98489]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T12:37:22.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:21 smithi092 ceph-mon[134093]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T12:37:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:22 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3716808779' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6"}]: dispatch 2023-10-08T12:37:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:22 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3716808779' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6"}]': finished 2023-10-08T12:37:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:22 smithi173 ceph-mon[135182]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T12:37:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:23.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:22 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3716808779' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6"}]: dispatch 2023-10-08T12:37:23.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:22 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3716808779' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6"}]': finished 2023-10-08T12:37:23.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:22 smithi059 ceph-mon[98489]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T12:37:23.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:23.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:22 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3716808779' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6"}]: dispatch 2023-10-08T12:37:23.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:22 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3716808779' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6"}]': finished 2023-10-08T12:37:23.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:22 smithi092 ceph-mon[134093]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T12:37:23.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:23.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:23 smithi173 ceph-mon[135182]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 135 KiB/s, 0 objects/s recovering 2023-10-08T12:37:23.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:23 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2577997027' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:37:24.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:23 smithi059 ceph-mon[98489]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 135 KiB/s, 0 objects/s recovering 2023-10-08T12:37:24.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:23 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2577997027' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:37:24.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:23 smithi092 ceph-mon[134093]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 135 KiB/s, 0 objects/s recovering 2023-10-08T12:37:24.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:23 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2577997027' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:37:26.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:25 smithi092 ceph-mon[134093]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2023-10-08T12:37:26.215 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:25 smithi059 ceph-mon[98489]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2023-10-08T12:37:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:25 smithi173 ceph-mon[135182]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2023-10-08T12:37:28.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:27 smithi092 ceph-mon[134093]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:37:28.197 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:27 smithi059 ceph-mon[98489]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:37:28.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:27 smithi173 ceph-mon[135182]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:37:29.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:29 smithi059 ceph-mon[98489]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-10-08T12:37:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:29 smithi173 ceph-mon[135182]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-10-08T12:37:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:29 smithi092 ceph-mon[134093]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-10-08T12:37:30.941 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:30 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T12:37:30.941 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:30 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:30.942 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:30 smithi059 ceph-mon[98489]: Deploying daemon osd.9 on smithi059 2023-10-08T12:37:30.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:30 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T12:37:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:30 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:30 smithi173 ceph-mon[135182]: Deploying daemon osd.9 on smithi059 2023-10-08T12:37:31.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:30 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T12:37:31.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:30 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:31.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:30 smithi092 ceph-mon[134093]: Deploying daemon osd.9 on smithi059 2023-10-08T12:37:31.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:31 smithi059 ceph-mon[98489]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:31.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:31 smithi173 ceph-mon[135182]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:32.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:31 smithi092 ceph-mon[134093]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:33.895 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:33 smithi059 ceph-mon[98489]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:34.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:33 smithi092 ceph-mon[134093]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:33 smithi173 ceph-mon[135182]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:36.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:35 smithi092 ceph-mon[134093]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:36.202 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:35 smithi059 ceph-mon[98489]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:35 smithi173 ceph-mon[135182]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:37.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:37.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:37.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:37.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:37.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:37 smithi092 ceph-mon[134093]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:37 smithi173 ceph-mon[135182]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:38.247 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:37 smithi059 ceph-mon[98489]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:39 smithi173 ceph-mon[135182]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:39.987 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:39 smithi059 ceph-mon[98489]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:39 smithi092 ceph-mon[134093]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.556+0000 7f922f7fe700 1 -- 172.21.15.59:0/119170564 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9240110710 con 0x7f92280a14d0 2023-10-08T12:37:40.558 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 9 on host 'smithi059' 2023-10-08T12:37:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 -- 172.21.15.59:0/119170564 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92280a14d0 msgr2=0x7f92280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92280a14d0 0x7f92280a3990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f924019a380 tx=0x7f9234009260 comp rx=0 tx=0).stop 2023-10-08T12:37:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 -- 172.21.15.59:0/119170564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92401008a0 msgr2=0x7f9240198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92401008a0 0x7f9240198e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f92300098e0 tx=0x7f9230004730 comp rx=0 tx=0).stop 2023-10-08T12:37:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 -- 172.21.15.59:0/119170564 shutdown_connections 2023-10-08T12:37:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92280a14d0 0x7f92280a3990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92401057c0 0x7f924019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92401008a0 0x7f9240198e20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 --2- 172.21.15.59:0/119170564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9240101260 0x7f9240199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 -- 172.21.15.59:0/119170564 >> 172.21.15.59:0/119170564 conn(0x7f92400779e0 msgr2=0x7f924010ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 -- 172.21.15.59:0/119170564 shutdown_connections 2023-10-08T12:37:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:37:40.559+0000 7f9244d4d700 1 -- 172.21.15.59:0/119170564 wait complete. 2023-10-08T12:37:41.086 DEBUG:teuthology.orchestra.run.smithi059:osd.9> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.9.service 2023-10-08T12:37:41.091 INFO:tasks.cephadm:Deploying osd.10 on smithi092 with /dev/vg_nvme/lv_1... 2023-10-08T12:37:41.091 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T12:37:41.166 INFO:journalctl@ceph.osd.9.smithi059.stdout:-- Logs begin at Sun 2023-10-08 12:12:12 UTC. -- 2023-10-08T12:37:41.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:41.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:41.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:41.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:41 smithi092 ceph-mon[134093]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T12:37:41.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:41 smithi092 ceph-mon[134093]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:41.695 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:37:41.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:41.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:41.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:41.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:41 smithi173 ceph-mon[135182]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T12:37:41.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:41 smithi173 ceph-mon[135182]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:41.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:41.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:41.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:41.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:41.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:41 smithi059 ceph-mon[98489]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T12:37:41.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:41 smithi059 ceph-mon[98489]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:42.698 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 12:37:42 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T12:37:42.523+0000 7f498630f700 -1 osd.9 0 waiting for initial osdmap 2023-10-08T12:37:42.698 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 12:37:42 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T12:37:42.537+0000 7f4980100700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:37:42.699 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:42 smithi059 ceph-mon[98489]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T12:37:42.699 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:42 smithi059 ceph-mon[98489]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T12:37:42.699 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:42 smithi059 ceph-mon[98489]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:37:42.699 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:42 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:42.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:42 smithi092 ceph-mon[134093]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T12:37:42.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:42 smithi092 ceph-mon[134093]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T12:37:42.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:42 smithi092 ceph-mon[134093]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:37:42.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:42 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:42 smithi173 ceph-mon[135182]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T12:37:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:42 smithi173 ceph-mon[135182]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T12:37:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:42 smithi173 ceph-mon[135182]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2023-10-08T12:37:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:42 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:43.051 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T12:37:43.052 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T12:37:43.052 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2023-10-08T12:37:43.052 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2023-10-08T12:37:43.052 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111447 s, 941 MB/s 2023-10-08T12:37:43.052 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2023-10-08T12:37:43.546 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi092:vg_nvme/lv_1 2023-10-08T12:37:43.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:43 smithi092 ceph-mon[134093]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:37:43.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:43 smithi092 ceph-mon[134093]: osdmap e66: 10 total, 9 up, 10 in 2023-10-08T12:37:43.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:43 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:43.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:43 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:43.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:43 smithi092 ceph-mon[134093]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:43 smithi173 ceph-mon[135182]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:37:43.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:43 smithi173 ceph-mon[135182]: osdmap e66: 10 total, 9 up, 10 in 2023-10-08T12:37:43.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:43 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:43.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:43 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:43.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:43 smithi173 ceph-mon[135182]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:44.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:43 smithi059 ceph-mon[98489]: from='osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2023-10-08T12:37:44.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:43 smithi059 ceph-mon[98489]: osdmap e66: 10 total, 9 up, 10 in 2023-10-08T12:37:44.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:43 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:44.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:43 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:44.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:43 smithi059 ceph-mon[98489]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:37:44.108 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:37:44.598 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:44 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:37:44.598 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:44 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:37:44.598 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:44 smithi092 ceph-mon[134093]: osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237] boot 2023-10-08T12:37:44.598 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:44 smithi092 ceph-mon[134093]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T12:37:44.599 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:44 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:44.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:44 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:37:44.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:44 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:37:44.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:44 smithi173 ceph-mon[135182]: osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237] boot 2023-10-08T12:37:44.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:44 smithi173 ceph-mon[135182]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T12:37:44.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:44 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:45.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:44 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:37:45.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:44 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:37:45.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:44 smithi059 ceph-mon[98489]: osd.9 [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237] boot 2023-10-08T12:37:45.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:44 smithi059 ceph-mon[98489]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T12:37:45.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:44 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:37:45.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.271+0000 7f3cb16fa700 1 -- 172.21.15.92:0/1325202037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac073340 msgr2=0x7f3cac10cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:45.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.271+0000 7f3cb16fa700 1 --2- 172.21.15.92:0/1325202037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac073340 0x7f3cac10cd10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009990 tx=0x7f3c9c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:37:45.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.271+0000 7f3cb16fa700 1 -- 172.21.15.92:0/1325202037 shutdown_connections 2023-10-08T12:37:45.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.271+0000 7f3cb16fa700 1 --2- 172.21.15.92:0/1325202037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cac10d250 0x7f3cac10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:45.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.271+0000 7f3cb16fa700 1 --2- 172.21.15.92:0/1325202037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac072a20 0x7f3cac072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:45.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.271+0000 7f3cb16fa700 1 --2- 172.21.15.92:0/1325202037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac073340 0x7f3cac10cd10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:45.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.271+0000 7f3cb16fa700 1 -- 172.21.15.92:0/1325202037 >> 172.21.15.92:0/1325202037 conn(0x7f3cac077910 msgr2=0x7f3cac077d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:45.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.271+0000 7f3cb16fa700 1 -- 172.21.15.92:0/1325202037 shutdown_connections 2023-10-08T12:37:45.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.271+0000 7f3cb16fa700 1 -- 172.21.15.92:0/1325202037 wait complete. 2023-10-08T12:37:45.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.271+0000 7f3cb16fa700 1 Processor -- start 2023-10-08T12:37:45.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3cb16fa700 1 -- start start 2023-10-08T12:37:45.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3cb16fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac072a20 0x7f3cac198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:45.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3cb16fa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac073340 0x7f3cac1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:45.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3cb16fa700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cac10d250 0x7f3cac19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:45.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3cb16fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac19dca0 con 0x7f3cac072a20 2023-10-08T12:37:45.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3cb16fa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac19de10 con 0x7f3cac073340 2023-10-08T12:37:45.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3cb16fa700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac19dfd0 con 0x7f3cac10d250 2023-10-08T12:37:45.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3caa7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac073340 0x7f3cac1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:45.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3caa7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac073340 0x7f3cac1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36494/0 (socket says 172.21.15.92:36494) 2023-10-08T12:37:45.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3caa7fc700 1 -- 172.21.15.92:0/4161387130 learned_addr learned my addr 172.21.15.92:0/4161387130 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-08T12:37:45.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3caaffd700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac072a20 0x7f3cac198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:45.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3cab7fe700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cac10d250 0x7f3cac19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:45.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3caa7fc700 1 -- 172.21.15.92:0/4161387130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cac10d250 msgr2=0x7f3cac19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:45.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3caa7fc700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cac10d250 0x7f3cac19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:45.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3caa7fc700 1 -- 172.21.15.92:0/4161387130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac072a20 msgr2=0x7f3cac198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:45.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3caa7fc700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac072a20 0x7f3cac198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:45.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3caa7fc700 1 -- 172.21.15.92:0/4161387130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c0095f0 con 0x7f3cac073340 2023-10-08T12:37:45.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3caa7fc700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac073340 0x7f3cac1992e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0098e0 tx=0x7f3c9c00f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:45.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.272+0000 7f3c93fff700 1 -- 172.21.15.92:0/4161387130 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c01d070 con 0x7f3cac073340 2023-10-08T12:37:45.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.273+0000 7f3cb16fa700 1 -- 172.21.15.92:0/4161387130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac19e250 con 0x7f3cac073340 2023-10-08T12:37:45.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.273+0000 7f3c93fff700 1 -- 172.21.15.92:0/4161387130 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c9c022470 con 0x7f3cac073340 2023-10-08T12:37:45.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.273+0000 7f3cb16fa700 1 -- 172.21.15.92:0/4161387130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac1a5b10 con 0x7f3cac073340 2023-10-08T12:37:45.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.273+0000 7f3c93fff700 1 -- 172.21.15.92:0/4161387130 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c017650 con 0x7f3cac073340 2023-10-08T12:37:45.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.273+0000 7f3cb16fa700 1 -- 172.21.15.92:0/4161387130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac108460 con 0x7f3cac073340 2023-10-08T12:37:45.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.275+0000 7f3c93fff700 1 -- 172.21.15.92:0/4161387130 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3c9c0225e0 con 0x7f3cac073340 2023-10-08T12:37:45.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.276+0000 7f3c93fff700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3c940a1550 0x7f3c940a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:45.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.276+0000 7f3c93fff700 1 -- 172.21.15.92:0/4161387130 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6476+0+0 (secure 0 0 0) 0x7f3c9c0cd940 con 0x7f3cac073340 2023-10-08T12:37:45.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.276+0000 7f3caaffd700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3c940a1550 0x7f3c940a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:45.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.276+0000 7f3caaffd700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3c940a1550 0x7f3c940a3a10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0005950 tx=0x7f3ca000b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:45.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.279+0000 7f3c93fff700 1 -- 172.21.15.92:0/4161387130 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3c9c097760 con 0x7f3cac073340 2023-10-08T12:37:45.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:37:45.480+0000 7f3cb16fa700 1 -- 172.21.15.92:0/4161387130 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cac04e530 con 0x7f3c940a1550 2023-10-08T12:37:45.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: osdmap e68: 10 total, 10 up, 10 in 2023-10-08T12:37:45.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:45.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:45.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:45.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:45.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:45.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:45.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:45.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:45.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:45.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:45.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:45.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:37:45.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:37:45.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: osdmap e68: 10 total, 10 up, 10 in 2023-10-08T12:37:45.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:45.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:45.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:45.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:45.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:45.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:45.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:45.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:45.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:45.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:45.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:45.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:37:45.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:37:45.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:46.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: osdmap e68: 10 total, 10 up, 10 in 2023-10-08T12:37:46.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:46.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:46.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:46.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:46.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:46.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:46.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:46.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:37:46.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:37:46.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:46.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:46 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi059 2023-10-08T12:37:46.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:46 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi059 to 4318M 2023-10-08T12:37:46.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:46 smithi092 ceph-mon[134093]: from='client.24506 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:37:46.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:46 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi059 2023-10-08T12:37:46.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:46 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi059 to 4318M 2023-10-08T12:37:46.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:46 smithi173 ceph-mon[135182]: from='client.24506 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:37:47.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:46 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi059 2023-10-08T12:37:47.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:46 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi059 to 4318M 2023-10-08T12:37:47.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:46 smithi059 ceph-mon[98489]: from='client.24506 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:37:47.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:47 smithi092 ceph-mon[134093]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:47 smithi173 ceph-mon[135182]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:48.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:47 smithi059 ceph-mon[98489]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:48.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:48 smithi092 ceph-mon[134093]: from='client.? 172.21.15.92:0/53463966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d721b22c-e46e-4550-b90f-cdc148a73e09"}]: dispatch 2023-10-08T12:37:48.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:48 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d721b22c-e46e-4550-b90f-cdc148a73e09"}]: dispatch 2023-10-08T12:37:48.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:48 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d721b22c-e46e-4550-b90f-cdc148a73e09"}]': finished 2023-10-08T12:37:48.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:48 smithi092 ceph-mon[134093]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T12:37:48.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:48 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:37:48.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:48 smithi092 ceph-mon[134093]: from='client.? 172.21.15.92:0/2439321908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:37:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:48 smithi173 ceph-mon[135182]: from='client.? 172.21.15.92:0/53463966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d721b22c-e46e-4550-b90f-cdc148a73e09"}]: dispatch 2023-10-08T12:37:48.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:48 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d721b22c-e46e-4550-b90f-cdc148a73e09"}]: dispatch 2023-10-08T12:37:48.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:48 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d721b22c-e46e-4550-b90f-cdc148a73e09"}]': finished 2023-10-08T12:37:48.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:48 smithi173 ceph-mon[135182]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T12:37:48.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:48 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:37:48.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:48 smithi173 ceph-mon[135182]: from='client.? 172.21.15.92:0/2439321908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:37:49.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:48 smithi059 ceph-mon[98489]: from='client.? 172.21.15.92:0/53463966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d721b22c-e46e-4550-b90f-cdc148a73e09"}]: dispatch 2023-10-08T12:37:49.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:48 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d721b22c-e46e-4550-b90f-cdc148a73e09"}]: dispatch 2023-10-08T12:37:49.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:48 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d721b22c-e46e-4550-b90f-cdc148a73e09"}]': finished 2023-10-08T12:37:49.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:48 smithi059 ceph-mon[98489]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T12:37:49.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:48 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:37:49.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:48 smithi059 ceph-mon[98489]: from='client.? 172.21.15.92:0/2439321908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:37:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:49 smithi173 ceph-mon[135182]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:50.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:49 smithi059 ceph-mon[98489]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:49 smithi092 ceph-mon[134093]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:52.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:51 smithi092 ceph-mon[134093]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:51 smithi173 ceph-mon[135182]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:52.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:51 smithi059 ceph-mon[98489]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:53.966 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:53 smithi092 ceph-mon[134093]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:53 smithi173 ceph-mon[135182]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:54.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:53 smithi059 ceph-mon[98489]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:54.911 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T12:37:54.911 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:55.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T12:37:55.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:55.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T12:37:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:56.072 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:55 smithi092 ceph-mon[134093]: Deploying daemon osd.10 on smithi092 2023-10-08T12:37:56.072 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:55 smithi092 ceph-mon[134093]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:55 smithi173 ceph-mon[135182]: Deploying daemon osd.10 on smithi092 2023-10-08T12:37:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:55 smithi173 ceph-mon[135182]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:56.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:55 smithi059 ceph-mon[98489]: Deploying daemon osd.10 on smithi092 2023-10-08T12:37:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:55 smithi059 ceph-mon[98489]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:57 smithi092 ceph-mon[134093]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:57 smithi173 ceph-mon[135182]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:58.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:57 smithi059 ceph-mon[98489]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:37:59 smithi092 ceph-mon[134093]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:59.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:59.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:59.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:59.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:37:59 smithi173 ceph-mon[135182]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:37:59.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:59.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:59.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:37:59.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:37:59 smithi059 ceph-mon[98489]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:38:00.544 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 10 on host 'smithi092' 2023-10-08T12:38:00.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.543+0000 7f3c93fff700 1 -- 172.21.15.92:0/4161387130 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f3cac04e530 con 0x7f3c940a1550 2023-10-08T12:38:00.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 -- 172.21.15.92:0/4161387130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3c940a1550 msgr2=0x7f3c940a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:00.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3c940a1550 0x7f3c940a3a10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0005950 tx=0x7f3ca000b410 comp rx=0 tx=0).stop 2023-10-08T12:38:00.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 -- 172.21.15.92:0/4161387130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac073340 msgr2=0x7f3cac1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:00.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac073340 0x7f3cac1992e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0098e0 tx=0x7f3c9c00f670 comp rx=0 tx=0).stop 2023-10-08T12:38:00.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 -- 172.21.15.92:0/4161387130 shutdown_connections 2023-10-08T12:38:00.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3c940a1550 0x7f3c940a3a10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:00.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cac10d250 0x7f3cac19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:00.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac072a20 0x7f3cac198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:00.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 --2- 172.21.15.92:0/4161387130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac073340 0x7f3cac1992e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:00.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 -- 172.21.15.92:0/4161387130 >> 172.21.15.92:0/4161387130 conn(0x7f3cac077910 msgr2=0x7f3cac0fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:00.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 -- 172.21.15.92:0/4161387130 shutdown_connections 2023-10-08T12:38:00.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-08T12:38:00.545+0000 7f3cb16fa700 1 -- 172.21.15.92:0/4161387130 wait complete. 2023-10-08T12:38:00.884 DEBUG:teuthology.orchestra.run.smithi092:osd.10> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.10.service 2023-10-08T12:38:00.886 INFO:tasks.cephadm:Deploying osd.11 on smithi173 with /dev/vg_nvme/lv_1... 2023-10-08T12:38:00.887 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T12:38:00.915 INFO:journalctl@ceph.osd.10.smithi092.stdout:-- Logs begin at Sun 2023-10-08 12:08:21 UTC. -- 2023-10-08T12:38:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:38:01.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:01 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:01.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:01 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:01.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:01 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:01.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:01 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:01.833 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:01 smithi092 ceph-mon[134093]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:38:01.862 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:01 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:01.863 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:01 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:01.863 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:01 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:01.863 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:01 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:01.863 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:01 smithi173 ceph-mon[135182]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:38:02.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:01 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:02.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:01 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:02.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:01 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:02.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:01 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:02.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:01 smithi059 ceph-mon[98489]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:38:02.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 12:38:02 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T12:38:02.051+0000 7f127353a640 -1 osd.10 0 log_to_monitors true 2023-10-08T12:38:02.606 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:02 smithi092 ceph-mon[134093]: from='osd.10 [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:38:02.606 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:02 smithi092 ceph-mon[134093]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:38:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:02 smithi173 ceph-mon[135182]: from='osd.10 [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:38:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:02 smithi173 ceph-mon[135182]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:38:03.005 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T12:38:03.005 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T12:38:03.006 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2023-10-08T12:38:03.006 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2023-10-08T12:38:03.006 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108864 s, 963 MB/s 2023-10-08T12:38:03.006 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2023-10-08T12:38:03.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:02 smithi059 ceph-mon[98489]: from='osd.10 [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:38:03.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:02 smithi059 ceph-mon[98489]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:38:03.412 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi173:vg_nvme/lv_1 2023-10-08T12:38:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:03 smithi173 ceph-mon[135182]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T12:38:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:03 smithi173 ceph-mon[135182]: from='osd.10 [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:38:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:03 smithi173 ceph-mon[135182]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T12:38:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:03 smithi173 ceph-mon[135182]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:38:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:03 smithi173 ceph-mon[135182]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:38:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:03 smithi173 ceph-mon[135182]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:38:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:03 smithi173 ceph-mon[135182]: osdmap e71: 11 total, 10 up, 11 in 2023-10-08T12:38:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:03.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 12:38:03 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T12:38:03.606+0000 7f1268bb1700 -1 osd.10 0 waiting for initial osdmap 2023-10-08T12:38:03.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 12:38:03 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T12:38:03.620+0000 7f126099e700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:38:03.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:03 smithi092 ceph-mon[134093]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T12:38:03.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:03 smithi092 ceph-mon[134093]: from='osd.10 [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:38:03.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:03 smithi092 ceph-mon[134093]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T12:38:03.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:03.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:03 smithi092 ceph-mon[134093]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:38:03.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:03 smithi092 ceph-mon[134093]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:38:03.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:03 smithi092 ceph-mon[134093]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:38:03.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:03 smithi092 ceph-mon[134093]: osdmap e71: 11 total, 10 up, 11 in 2023-10-08T12:38:03.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:03.970 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:38:04.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:03 smithi059 ceph-mon[98489]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T12:38:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:03 smithi059 ceph-mon[98489]: from='osd.10 [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:38:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:03 smithi059 ceph-mon[98489]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T12:38:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:03 smithi059 ceph-mon[98489]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2023-10-08T12:38:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:03 smithi059 ceph-mon[98489]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:38:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:03 smithi059 ceph-mon[98489]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2023-10-08T12:38:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:03 smithi059 ceph-mon[98489]: osdmap e71: 11 total, 10 up, 11 in 2023-10-08T12:38:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:04.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:04.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi092 2023-10-08T12:38:04.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:04.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:04.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:04.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:04.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:04.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:04.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:04.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:04.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:04.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:04.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:04.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:04.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:04.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:04.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:04 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:04.964 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:04.964 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi092 2023-10-08T12:38:04.964 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:04.964 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:04.964 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:04.964 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:04.964 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:04.964 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:04.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:04.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:04.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:04.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:04.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:04.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:04.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:04.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:04.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:04 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:05.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:05.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi092 2023-10-08T12:38:05.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:05.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:05.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:05.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:05.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:05.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:05.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:05.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:05.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:05.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:05.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:05.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:05.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:05.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:05.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:04 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.143+0000 7f5d5ab97700 1 -- 172.21.15.173:0/1411969156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d541056b0 msgr2=0x7f5d54105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.143+0000 7f5d5ab97700 1 --2- 172.21.15.173:0/1411969156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d541056b0 0x7f5d54105a90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009990 tx=0x7f5d48009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.143+0000 7f5d5ab97700 1 -- 172.21.15.173:0/1411969156 shutdown_connections 2023-10-08T12:38:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.143+0000 7f5d5ab97700 1 --2- 172.21.15.173:0/1411969156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d54100110 0x7f5d5410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.143+0000 7f5d5ab97700 1 --2- 172.21.15.173:0/1411969156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d541056b0 0x7f5d54105a90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.143+0000 7f5d5ab97700 1 --2- 172.21.15.173:0/1411969156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d540ff750 0x7f5d540ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.143+0000 7f5d5ab97700 1 -- 172.21.15.173:0/1411969156 >> 172.21.15.173:0/1411969156 conn(0x7f5d54075790 msgr2=0x7f5d54075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.143+0000 7f5d5ab97700 1 -- 172.21.15.173:0/1411969156 shutdown_connections 2023-10-08T12:38:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d5ab97700 1 -- 172.21.15.173:0/1411969156 wait complete. 2023-10-08T12:38:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d5ab97700 1 Processor -- start 2023-10-08T12:38:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d5ab97700 1 -- start start 2023-10-08T12:38:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d5ab97700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d540ff750 0x7f5d54197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d5ab97700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d54100110 0x7f5d54197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d5ab97700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d541056b0 0x7f5d541a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d5ab97700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54198850 con 0x7f5d54100110 2023-10-08T12:38:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d5ab97700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541a3010 con 0x7f5d540ff750 2023-10-08T12:38:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d5ab97700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541a3150 con 0x7f5d541056b0 2023-10-08T12:38:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d58933700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d540ff750 0x7f5d54197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d59134700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d541056b0 0x7f5d541a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d58933700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d540ff750 0x7f5d54197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.173:48810/0 (socket says 172.21.15.173:48810) 2023-10-08T12:38:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.144+0000 7f5d58933700 1 -- 172.21.15.173:0/2729027647 learned_addr learned my addr 172.21.15.173:0/2729027647 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-08T12:38:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.145+0000 7f5d59134700 1 -- 172.21.15.173:0/2729027647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d540ff750 msgr2=0x7f5d54197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.145+0000 7f5d59134700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d540ff750 0x7f5d54197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.145+0000 7f5d59134700 1 -- 172.21.15.173:0/2729027647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d54100110 msgr2=0x7f5d54197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.145+0000 7f5d59134700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d54100110 0x7f5d54197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.145+0000 7f5d59134700 1 -- 172.21.15.173:0/2729027647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d480095f0 con 0x7f5d541056b0 2023-10-08T12:38:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.145+0000 7f5d59134700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d541056b0 0x7f5d541a2ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c00ab40 tx=0x7f5d4c00ae50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.145+0000 7f5d51ffb700 1 -- 172.21.15.173:0/2729027647 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c00f070 con 0x7f5d541056b0 2023-10-08T12:38:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.145+0000 7f5d5ab97700 1 -- 172.21.15.173:0/2729027647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d54195900 con 0x7f5d541056b0 2023-10-08T12:38:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.145+0000 7f5d51ffb700 1 -- 172.21.15.173:0/2729027647 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d4c007a70 con 0x7f5d541056b0 2023-10-08T12:38:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.145+0000 7f5d51ffb700 1 -- 172.21.15.173:0/2729027647 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c005280 con 0x7f5d541056b0 2023-10-08T12:38:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.145+0000 7f5d5ab97700 1 -- 172.21.15.173:0/2729027647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d54195db0 con 0x7f5d541056b0 2023-10-08T12:38:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.146+0000 7f5d5ab97700 1 -- 172.21.15.173:0/2729027647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d54107cb0 con 0x7f5d541056b0 2023-10-08T12:38:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.147+0000 7f5d51ffb700 1 -- 172.21.15.173:0/2729027647 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5d4c004ad0 con 0x7f5d541056b0 2023-10-08T12:38:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.148+0000 7f5d51ffb700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5d440a14d0 0x7f5d440a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.148+0000 7f5d51ffb700 1 -- 172.21.15.173:0/2729027647 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6909+0+0 (secure 0 0 0) 0x7f5d4c0cbc70 con 0x7f5d541056b0 2023-10-08T12:38:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.148+0000 7f5d58933700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5d440a14d0 0x7f5d440a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.149+0000 7f5d58933700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5d440a14d0 0x7f5d440a3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800b5c0 tx=0x7f5d48009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:05.153 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.152+0000 7f5d51ffb700 1 -- 172.21.15.173:0/2729027647 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5d4c0958e0 con 0x7f5d541056b0 2023-10-08T12:38:05.350 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:05.348+0000 7f5d5ab97700 1 -- 172.21.15.173:0/2729027647 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d54068750 con 0x7f5d440a14d0 2023-10-08T12:38:05.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:05 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:38:05.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:05 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:38:05.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:05 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi092 to 4292M 2023-10-08T12:38:05.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:05 smithi092 ceph-mon[134093]: osd.10 [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812] boot 2023-10-08T12:38:05.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:05 smithi092 ceph-mon[134093]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T12:38:05.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:05 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:05.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:05 smithi092 ceph-mon[134093]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:38:05.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:05 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:38:05.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:05 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:38:05.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:05 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:05 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:38:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:05 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:38:05.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:05 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi092 to 4292M 2023-10-08T12:38:05.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:05 smithi173 ceph-mon[135182]: osd.10 [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812] boot 2023-10-08T12:38:05.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:05 smithi173 ceph-mon[135182]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T12:38:05.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:05 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:05.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:05 smithi173 ceph-mon[135182]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:38:05.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:05 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:38:05.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:05 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:38:05.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:05 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:06.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:05 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:38:06.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:05 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:38:06.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:05 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi092 to 4292M 2023-10-08T12:38:06.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:05 smithi059 ceph-mon[98489]: osd.10 [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812] boot 2023-10-08T12:38:06.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:05 smithi059 ceph-mon[98489]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T12:38:06.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:05 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:38:06.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:05 smithi059 ceph-mon[98489]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:38:06.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:05 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:38:06.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:05 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:38:06.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:05 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:06.931 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:06 smithi173 ceph-mon[135182]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:38:06.931 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:06 smithi173 ceph-mon[135182]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T12:38:07.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:06 smithi059 ceph-mon[98489]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:38:07.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:06 smithi059 ceph-mon[98489]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T12:38:07.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:06 smithi092 ceph-mon[134093]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:38:07.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:06 smithi092 ceph-mon[134093]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T12:38:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:07 smithi173 ceph-mon[135182]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T12:38:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:07 smithi173 ceph-mon[135182]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:08.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:07 smithi059 ceph-mon[98489]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T12:38:08.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:07 smithi059 ceph-mon[98489]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:07 smithi092 ceph-mon[134093]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T12:38:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:07 smithi092 ceph-mon[134093]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:08 smithi173 ceph-mon[135182]: osdmap e75: 11 total, 11 up, 11 in 2023-10-08T12:38:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:08 smithi173 ceph-mon[135182]: from='client.? 172.21.15.173:0/583038021' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efc98d79-da04-4983-9ba6-929f1024786f"}]: dispatch 2023-10-08T12:38:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:08 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efc98d79-da04-4983-9ba6-929f1024786f"}]: dispatch 2023-10-08T12:38:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:08 smithi173 ceph-mon[135182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efc98d79-da04-4983-9ba6-929f1024786f"}]': finished 2023-10-08T12:38:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:08 smithi173 ceph-mon[135182]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T12:38:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:08 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:08 smithi173 ceph-mon[135182]: from='client.? 172.21.15.173:0/3389856717' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:38:09.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:08 smithi059 ceph-mon[98489]: osdmap e75: 11 total, 11 up, 11 in 2023-10-08T12:38:09.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:08 smithi059 ceph-mon[98489]: from='client.? 172.21.15.173:0/583038021' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efc98d79-da04-4983-9ba6-929f1024786f"}]: dispatch 2023-10-08T12:38:09.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:08 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efc98d79-da04-4983-9ba6-929f1024786f"}]: dispatch 2023-10-08T12:38:09.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:08 smithi059 ceph-mon[98489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efc98d79-da04-4983-9ba6-929f1024786f"}]': finished 2023-10-08T12:38:09.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:08 smithi059 ceph-mon[98489]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T12:38:09.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:08 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:09.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:08 smithi059 ceph-mon[98489]: from='client.? 172.21.15.173:0/3389856717' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:38:09.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:08 smithi092 ceph-mon[134093]: osdmap e75: 11 total, 11 up, 11 in 2023-10-08T12:38:09.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:08 smithi092 ceph-mon[134093]: from='client.? 172.21.15.173:0/583038021' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efc98d79-da04-4983-9ba6-929f1024786f"}]: dispatch 2023-10-08T12:38:09.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:08 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efc98d79-da04-4983-9ba6-929f1024786f"}]: dispatch 2023-10-08T12:38:09.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:08 smithi092 ceph-mon[134093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efc98d79-da04-4983-9ba6-929f1024786f"}]': finished 2023-10-08T12:38:09.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:08 smithi092 ceph-mon[134093]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T12:38:09.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:08 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:09.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:08 smithi092 ceph-mon[134093]: from='client.? 172.21.15.173:0/3389856717' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:38:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:09 smithi173 ceph-mon[135182]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:10.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:09 smithi059 ceph-mon[98489]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:10.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:09 smithi092 ceph-mon[134093]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:12.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:11 smithi092 ceph-mon[134093]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2023-10-08T12:38:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:11 smithi173 ceph-mon[135182]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2023-10-08T12:38:12.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:11 smithi059 ceph-mon[98489]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2023-10-08T12:38:14.104 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:13 smithi173 ceph-mon[135182]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2023-10-08T12:38:14.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:13 smithi092 ceph-mon[134093]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2023-10-08T12:38:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:13 smithi059 ceph-mon[98489]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2023-10-08T12:38:15.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T12:38:15.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:15.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T12:38:15.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:15.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T12:38:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:16.070 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:15 smithi173 ceph-mon[135182]: Deploying daemon osd.11 on smithi173 2023-10-08T12:38:16.070 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:15 smithi173 ceph-mon[135182]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:38:16.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:15 smithi092 ceph-mon[134093]: Deploying daemon osd.11 on smithi173 2023-10-08T12:38:16.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:15 smithi092 ceph-mon[134093]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:38:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:15 smithi059 ceph-mon[98489]: Deploying daemon osd.11 on smithi173 2023-10-08T12:38:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:15 smithi059 ceph-mon[98489]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:38:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:17 smithi173 ceph-mon[135182]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-10-08T12:38:18.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:17 smithi092 ceph-mon[134093]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-10-08T12:38:18.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:17 smithi059 ceph-mon[98489]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-10-08T12:38:19.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:19 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:19.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:19 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:19.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:19 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:19.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:19 smithi173 ceph-mon[135182]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-10-08T12:38:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:19 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:19 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:19.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:19 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:19.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:19 smithi092 ceph-mon[134093]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-10-08T12:38:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:19 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:19 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:19 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:19 smithi059 ceph-mon[98489]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-10-08T12:38:21.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.415+0000 7f5d51ffb700 1 -- 172.21.15.173:0/2729027647 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f5d54068750 con 0x7f5d440a14d0 2023-10-08T12:38:21.415 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 11 on host 'smithi173' 2023-10-08T12:38:21.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.417+0000 7f5d5ab97700 1 -- 172.21.15.173:0/2729027647 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5d440a14d0 msgr2=0x7f5d440a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:21.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.417+0000 7f5d5ab97700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5d440a14d0 0x7f5d440a3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800b5c0 tx=0x7f5d48009ee0 comp rx=0 tx=0).stop 2023-10-08T12:38:21.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.417+0000 7f5d5ab97700 1 -- 172.21.15.173:0/2729027647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d541056b0 msgr2=0x7f5d541a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:21.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.417+0000 7f5d5ab97700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d541056b0 0x7f5d541a2ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c00ab40 tx=0x7f5d4c00ae50 comp rx=0 tx=0).stop 2023-10-08T12:38:21.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.417+0000 7f5d5ab97700 1 -- 172.21.15.173:0/2729027647 shutdown_connections 2023-10-08T12:38:21.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.417+0000 7f5d5ab97700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5d440a14d0 0x7f5d440a3990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:21.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.417+0000 7f5d5ab97700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d540ff750 0x7f5d54197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:21.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.417+0000 7f5d5ab97700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d541056b0 0x7f5d541a2ad0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:21.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.417+0000 7f5d5ab97700 1 --2- 172.21.15.173:0/2729027647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d54100110 0x7f5d54197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:21.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.417+0000 7f5d5ab97700 1 -- 172.21.15.173:0/2729027647 >> 172.21.15.173:0/2729027647 conn(0x7f5d54075790 msgr2=0x7f5d540fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:21.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.418+0000 7f5d5ab97700 1 -- 172.21.15.173:0/2729027647 shutdown_connections 2023-10-08T12:38:21.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:21.418+0000 7f5d5ab97700 1 -- 172.21.15.173:0/2729027647 wait complete. 2023-10-08T12:38:21.856 DEBUG:teuthology.orchestra.run.smithi173:osd.11> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.11.service 2023-10-08T12:38:21.858 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-08T12:38:21.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-08T12:38:21.897 INFO:journalctl@ceph.osd.11.smithi173.stdout:-- Logs begin at Sun 2023-10-08 12:08:19 UTC. -- 2023-10-08T12:38:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:22 smithi173 ceph-mon[135182]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:38:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:22 smithi059 ceph-mon[98489]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:38:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:22 smithi092 ceph-mon[134093]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:38:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:22.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:22.612 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:38:22.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 12:38:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T12:38:22.604+0000 7fbb3cd36640 -1 osd.11 0 log_to_monitors true 2023-10-08T12:38:23.350 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:23 smithi059 ceph-mon[98489]: from='osd.11 [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:38:23.350 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:23 smithi059 ceph-mon[98489]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:38:23.350 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:23 smithi059 ceph-mon[98489]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:23 smithi092 ceph-mon[134093]: from='osd.11 [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:38:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:23 smithi092 ceph-mon[134093]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:38:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:23 smithi092 ceph-mon[134093]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:23.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:23 smithi173 ceph-mon[135182]: from='osd.11 [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:38:23.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:23 smithi173 ceph-mon[135182]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:38:23.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:23 smithi173 ceph-mon[135182]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:24 smithi173 ceph-mon[135182]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T12:38:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:24 smithi173 ceph-mon[135182]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T12:38:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:24 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:24 smithi173 ceph-mon[135182]: from='osd.11 [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:38:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:24 smithi173 ceph-mon[135182]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:38:24.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 12:38:24 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T12:38:24.063+0000 7fbb32bae700 -1 osd.11 0 waiting for initial osdmap 2023-10-08T12:38:24.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 12:38:24 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T12:38:24.075+0000 7fbb2b19c700 -1 osd.11 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:38:24.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.334+0000 7f5a60809700 1 -- 172.21.15.59:0/1021916685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a5c073340 msgr2=0x7f5a5c10cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:24.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.334+0000 7f5a60809700 1 --2- 172.21.15.59:0/1021916685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a5c073340 0x7f5a5c10cd10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009990 tx=0x7f5a50009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:24.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.335+0000 7f5a60809700 1 -- 172.21.15.59:0/1021916685 shutdown_connections 2023-10-08T12:38:24.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.335+0000 7f5a60809700 1 --2- 172.21.15.59:0/1021916685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a5c10d250 0x7f5a5c10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:24.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.335+0000 7f5a60809700 1 --2- 172.21.15.59:0/1021916685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a5c072a20 0x7f5a5c072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:24.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.335+0000 7f5a60809700 1 --2- 172.21.15.59:0/1021916685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a5c073340 0x7f5a5c10cd10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:24.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.335+0000 7f5a60809700 1 -- 172.21.15.59:0/1021916685 >> 172.21.15.59:0/1021916685 conn(0x7f5a5c0779e0 msgr2=0x7f5a5c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:24.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.335+0000 7f5a60809700 1 -- 172.21.15.59:0/1021916685 shutdown_connections 2023-10-08T12:38:24.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.335+0000 7f5a60809700 1 -- 172.21.15.59:0/1021916685 wait complete. 2023-10-08T12:38:24.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.336+0000 7f5a60809700 1 Processor -- start 2023-10-08T12:38:24.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.336+0000 7f5a60809700 1 -- start start 2023-10-08T12:38:24.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.337+0000 7f5a60809700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a5c072a20 0x7f5a5c198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:24.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.337+0000 7f5a60809700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a5c073340 0x7f5a5c199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:24.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.337+0000 7f5a60809700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a5c10d250 0x7f5a5c19d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:24.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.337+0000 7f5a60809700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c19dd80 con 0x7f5a5c073340 2023-10-08T12:38:24.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.337+0000 7f5a60809700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c19def0 con 0x7f5a5c072a20 2023-10-08T12:38:24.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.337+0000 7f5a60809700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c19e0b0 con 0x7f5a5c10d250 2023-10-08T12:38:24.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.337+0000 7f5a59d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a5c073340 0x7f5a5c199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:24.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.337+0000 7f5a5a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a5c072a20 0x7f5a5c198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:24.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.337+0000 7f5a59d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a5c073340 0x7f5a5c199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42310/0 (socket says 172.21.15.59:42310) 2023-10-08T12:38:24.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.337+0000 7f5a59d9b700 1 -- 172.21.15.59:0/1533833194 learned_addr learned my addr 172.21.15.59:0/1533833194 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:24.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.338+0000 7f5a5ad9d700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a5c10d250 0x7f5a5c19d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:24.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.338+0000 7f5a5a59c700 1 -- 172.21.15.59:0/1533833194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a5c10d250 msgr2=0x7f5a5c19d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:24.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.338+0000 7f5a5a59c700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a5c10d250 0x7f5a5c19d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:24.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.338+0000 7f5a5a59c700 1 -- 172.21.15.59:0/1533833194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a5c073340 msgr2=0x7f5a5c199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:24.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.338+0000 7f5a5a59c700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a5c073340 0x7f5a5c199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:24.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.338+0000 7f5a5a59c700 1 -- 172.21.15.59:0/1533833194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a500095f0 con 0x7f5a5c072a20 2023-10-08T12:38:24.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.338+0000 7f5a59d9b700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a5c073340 0x7f5a5c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:24.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.338+0000 7f5a5a59c700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a5c072a20 0x7f5a5c198ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00e9f0 tx=0x7f5a4c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:24.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.339+0000 7f5a4b7fe700 1 -- 172.21.15.59:0/1533833194 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c00c9c0 con 0x7f5a5c072a20 2023-10-08T12:38:24.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.339+0000 7f5a60809700 1 -- 172.21.15.59:0/1533833194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5c19e390 con 0x7f5a5c072a20 2023-10-08T12:38:24.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.339+0000 7f5a4b7fe700 1 -- 172.21.15.59:0/1533833194 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a4c010430 con 0x7f5a5c072a20 2023-10-08T12:38:24.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.339+0000 7f5a4b7fe700 1 -- 172.21.15.59:0/1533833194 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c018680 con 0x7f5a5c072a20 2023-10-08T12:38:24.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.339+0000 7f5a60809700 1 -- 172.21.15.59:0/1533833194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5c1a5bf0 con 0x7f5a5c072a20 2023-10-08T12:38:24.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.341+0000 7f5a60809700 1 -- 172.21.15.59:0/1533833194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5c108460 con 0x7f5a5c072a20 2023-10-08T12:38:24.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.343+0000 7f5a4b7fe700 1 -- 172.21.15.59:0/1533833194 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5a4c010860 con 0x7f5a5c072a20 2023-10-08T12:38:24.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.344+0000 7f5a4b7fe700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a440a1550 0x7f5a440a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:24.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.344+0000 7f5a4b7fe700 1 -- 172.21.15.59:0/1533833194 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7062+0+0 (secure 0 0 0) 0x7f5a4c014070 con 0x7f5a5c072a20 2023-10-08T12:38:24.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.344+0000 7f5a59d9b700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a440a1550 0x7f5a440a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:24.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.345+0000 7f5a59d9b700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a440a1550 0x7f5a440a3a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c19a3e0 tx=0x7f5a50005bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:24.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.348+0000 7f5a4b7fe700 1 -- 172.21.15.59:0/1533833194 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5a4c052100 con 0x7f5a5c072a20 2023-10-08T12:38:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:24 smithi092 ceph-mon[134093]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T12:38:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:24 smithi092 ceph-mon[134093]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T12:38:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:24 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:24 smithi092 ceph-mon[134093]: from='osd.11 [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:38:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:24 smithi092 ceph-mon[134093]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:38:24.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:24 smithi059 ceph-mon[98489]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T12:38:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:24 smithi059 ceph-mon[98489]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T12:38:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:24 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:24 smithi059 ceph-mon[98489]: from='osd.11 [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:38:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:24 smithi059 ceph-mon[98489]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2023-10-08T12:38:24.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.558+0000 7f5a60809700 1 -- 172.21.15.59:0/1533833194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f5a5c19a190 con 0x7f5a5c072a20 2023-10-08T12:38:24.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.559+0000 7f5a4b7fe700 1 -- 172.21.15.59:0/1533833194 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) v1 ==== 74+0+133 (secure 0 0 0) 0x7f5a4c096460 con 0x7f5a5c072a20 2023-10-08T12:38:24.560 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:24.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 -- 172.21.15.59:0/1533833194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a440a1550 msgr2=0x7f5a440a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:24.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a440a1550 0x7f5a440a3a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c19a3e0 tx=0x7f5a50005bc0 comp rx=0 tx=0).stop 2023-10-08T12:38:24.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 -- 172.21.15.59:0/1533833194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a5c072a20 msgr2=0x7f5a5c198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:24.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a5c072a20 0x7f5a5c198ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00e9f0 tx=0x7f5a4c00ed00 comp rx=0 tx=0).stop 2023-10-08T12:38:24.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 -- 172.21.15.59:0/1533833194 shutdown_connections 2023-10-08T12:38:24.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a440a1550 0x7f5a440a3a10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:24.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a5c072a20 0x7f5a5c198ed0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:24.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a5c10d250 0x7f5a5c19d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:24.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 --2- 172.21.15.59:0/1533833194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a5c073340 0x7f5a5c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:24.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 -- 172.21.15.59:0/1533833194 >> 172.21.15.59:0/1533833194 conn(0x7f5a5c0779e0 msgr2=0x7f5a5c0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:24.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 -- 172.21.15.59:0/1533833194 shutdown_connections 2023-10-08T12:38:24.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:24.561+0000 7f5a60809700 1 -- 172.21.15.59:0/1533833194 wait complete. 2023-10-08T12:38:25.098 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":78,"num_osds":12,"num_up_osds":11,"osd_up_since":1696768684,"num_in_osds":12,"osd_in_since":1696768687,"num_remapped_pgs":0} 2023-10-08T12:38:25.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:38:25.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: osdmap e78: 12 total, 11 up, 12 in 2023-10-08T12:38:25.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:25.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:25.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: Detected new or changed devices on smithi173 2023-10-08T12:38:25.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi173 to 4292M 2023-10-08T12:38:25.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:25.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:25.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1533833194' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:38:25.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:25 smithi092 ceph-mon[134093]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:25.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:38:25.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: osdmap e78: 12 total, 11 up, 12 in 2023-10-08T12:38:25.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:25.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:25.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: Detected new or changed devices on smithi173 2023-10-08T12:38:25.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi173 to 4292M 2023-10-08T12:38:25.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:25.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:25.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1533833194' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:38:25.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:25 smithi173 ceph-mon[135182]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:25.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2023-10-08T12:38:25.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: osdmap e78: 12 total, 11 up, 12 in 2023-10-08T12:38:25.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:25.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:25.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: Detected new or changed devices on smithi173 2023-10-08T12:38:25.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:38:25.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi173 to 4292M 2023-10-08T12:38:25.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:25.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:25.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:25.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1533833194' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:38:25.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:25 smithi059 ceph-mon[98489]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:38:26.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-08T12:38:26.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:26 smithi092 ceph-mon[134093]: purged_snaps scrub starts 2023-10-08T12:38:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:26 smithi092 ceph-mon[134093]: purged_snaps scrub ok 2023-10-08T12:38:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:26 smithi092 ceph-mon[134093]: osd.11 [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233] boot 2023-10-08T12:38:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:26 smithi092 ceph-mon[134093]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T12:38:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:26 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:26 smithi173 ceph-mon[135182]: purged_snaps scrub starts 2023-10-08T12:38:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:26 smithi173 ceph-mon[135182]: purged_snaps scrub ok 2023-10-08T12:38:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:26 smithi173 ceph-mon[135182]: osd.11 [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233] boot 2023-10-08T12:38:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:26 smithi173 ceph-mon[135182]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T12:38:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:26 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:26 smithi059 ceph-mon[98489]: purged_snaps scrub starts 2023-10-08T12:38:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:26 smithi059 ceph-mon[98489]: purged_snaps scrub ok 2023-10-08T12:38:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:26 smithi059 ceph-mon[98489]: osd.11 [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233] boot 2023-10-08T12:38:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:26 smithi059 ceph-mon[98489]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T12:38:26.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:26 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:38:26.848 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:38:27.378 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:27 smithi059 ceph-mon[98489]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T12:38:27.378 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:27 smithi059 ceph-mon[98489]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:27.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:27 smithi092 ceph-mon[134093]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T12:38:27.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:27 smithi092 ceph-mon[134093]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:27 smithi173 ceph-mon[135182]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T12:38:27.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:27 smithi173 ceph-mon[135182]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.547+0000 7f3b10ac1700 1 -- 172.21.15.59:0/4182632684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c1057c0 msgr2=0x7f3b0c105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.547+0000 7f3b10ac1700 1 --2- 172.21.15.59:0/4182632684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c1057c0 0x7f3b0c105ba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009990 tx=0x7f3afc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.547+0000 7f3b10ac1700 1 -- 172.21.15.59:0/4182632684 shutdown_connections 2023-10-08T12:38:28.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.547+0000 7f3b10ac1700 1 --2- 172.21.15.59:0/4182632684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c101260 0x7f3b0c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.547+0000 7f3b10ac1700 1 --2- 172.21.15.59:0/4182632684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c1057c0 0x7f3b0c105ba0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.547+0000 7f3b10ac1700 1 --2- 172.21.15.59:0/4182632684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b0c1008a0 0x7f3b0c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.547+0000 7f3b10ac1700 1 -- 172.21.15.59:0/4182632684 >> 172.21.15.59:0/4182632684 conn(0x7f3b0c0779e0 msgr2=0x7f3b0c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:28.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.547+0000 7f3b10ac1700 1 -- 172.21.15.59:0/4182632684 shutdown_connections 2023-10-08T12:38:28.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.547+0000 7f3b10ac1700 1 -- 172.21.15.59:0/4182632684 wait complete. 2023-10-08T12:38:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.548+0000 7f3b10ac1700 1 Processor -- start 2023-10-08T12:38:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.548+0000 7f3b10ac1700 1 -- start start 2023-10-08T12:38:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.549+0000 7f3b10ac1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1008a0 0x7f3b0c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.549+0000 7f3b10ac1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c101260 0x7f3b0c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.549+0000 7f3b10ac1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b0c1057c0 0x7f3b0c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.549+0000 7f3b10ac1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c1a4fe0 con 0x7f3b0c101260 2023-10-08T12:38:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.549+0000 7f3b10ac1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c1a5150 con 0x7f3b0c1008a0 2023-10-08T12:38:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.549+0000 7f3b10ac1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c1a5310 con 0x7f3b0c1057c0 2023-10-08T12:38:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.549+0000 7f3b0ad9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b0c1057c0 0x7f3b0c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.549+0000 7f3b09d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c101260 0x7f3b0c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.549+0000 7f3b0ad9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b0c1057c0 0x7f3b0c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41654/0 (socket says 172.21.15.59:41654) 2023-10-08T12:38:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.549+0000 7f3b0ad9d700 1 -- 172.21.15.59:0/3710017338 learned_addr learned my addr 172.21.15.59:0/3710017338 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.549+0000 7f3b0a59c700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1008a0 0x7f3b0c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3b0ad9d700 1 -- 172.21.15.59:0/3710017338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1008a0 msgr2=0x7f3b0c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3b0ad9d700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1008a0 0x7f3b0c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3b0ad9d700 1 -- 172.21.15.59:0/3710017338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c101260 msgr2=0x7f3b0c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3b0ad9d700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c101260 0x7f3b0c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3b0ad9d700 1 -- 172.21.15.59:0/3710017338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc0095f0 con 0x7f3b0c1057c0 2023-10-08T12:38:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3b09d9b700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c101260 0x7f3b0c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:28.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3b0ad9d700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b0c1057c0 0x7f3b0c073570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400efc0 tx=0x7f3b0400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:28.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3afb7fe700 1 -- 172.21.15.59:0/3710017338 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04018070 con 0x7f3b0c1057c0 2023-10-08T12:38:28.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3b10ac1700 1 -- 172.21.15.59:0/3710017338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c1a5590 con 0x7f3b0c1057c0 2023-10-08T12:38:28.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3afb7fe700 1 -- 172.21.15.59:0/3710017338 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b0400f040 con 0x7f3b0c1057c0 2023-10-08T12:38:28.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3afb7fe700 1 -- 172.21.15.59:0/3710017338 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400cbc0 con 0x7f3b0c1057c0 2023-10-08T12:38:28.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.550+0000 7f3b10ac1700 1 -- 172.21.15.59:0/3710017338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c1a5a90 con 0x7f3b0c1057c0 2023-10-08T12:38:28.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.551+0000 7f3b10ac1700 1 -- 172.21.15.59:0/3710017338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c108d80 con 0x7f3b0c1057c0 2023-10-08T12:38:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.554+0000 7f3afb7fe700 1 -- 172.21.15.59:0/3710017338 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3b0400cd40 con 0x7f3b0c1057c0 2023-10-08T12:38:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.555+0000 7f3afb7fe700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3af40a14d0 0x7f3af40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.555+0000 7f3afb7fe700 1 -- 172.21.15.59:0/3710017338 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f3b040cccf0 con 0x7f3b0c1057c0 2023-10-08T12:38:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.556+0000 7f3b0a59c700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3af40a14d0 0x7f3af40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.556+0000 7f3b0a59c700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3af40a14d0 0x7f3af40a3990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3afc006010 tx=0x7f3afc005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:28.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.557+0000 7f3afb7fe700 1 -- 172.21.15.59:0/3710017338 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b04096710 con 0x7f3b0c1057c0 2023-10-08T12:38:28.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.770+0000 7f3b10ac1700 1 -- 172.21.15.59:0/3710017338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f3b0c101f30 con 0x7f3b0c1057c0 2023-10-08T12:38:28.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.771+0000 7f3afb7fe700 1 -- 172.21.15.59:0/3710017338 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7f3b04099d30 con 0x7f3b0c1057c0 2023-10-08T12:38:28.772 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:28.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.773+0000 7f3b10ac1700 1 -- 172.21.15.59:0/3710017338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3af40a14d0 msgr2=0x7f3af40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.773+0000 7f3b10ac1700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3af40a14d0 0x7f3af40a3990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3afc006010 tx=0x7f3afc005960 comp rx=0 tx=0).stop 2023-10-08T12:38:28.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.773+0000 7f3b10ac1700 1 -- 172.21.15.59:0/3710017338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b0c1057c0 msgr2=0x7f3b0c073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.773+0000 7f3b10ac1700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b0c1057c0 0x7f3b0c073570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400efc0 tx=0x7f3b0400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.773+0000 7f3b10ac1700 1 -- 172.21.15.59:0/3710017338 shutdown_connections 2023-10-08T12:38:28.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.773+0000 7f3b10ac1700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3af40a14d0 0x7f3af40a3990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.773+0000 7f3b10ac1700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1008a0 0x7f3b0c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.773+0000 7f3b10ac1700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b0c1057c0 0x7f3b0c073570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.773+0000 7f3b10ac1700 1 --2- 172.21.15.59:0/3710017338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c101260 0x7f3b0c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.773+0000 7f3b10ac1700 1 -- 172.21.15.59:0/3710017338 >> 172.21.15.59:0/3710017338 conn(0x7f3b0c0779e0 msgr2=0x7f3b0c0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:28.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.774+0000 7f3b10ac1700 1 -- 172.21.15.59:0/3710017338 shutdown_connections 2023-10-08T12:38:28.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:28.774+0000 7f3b10ac1700 1 -- 172.21.15.59:0/3710017338 wait complete. 2023-10-08T12:38:29.326 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1696768705,"num_in_osds":12,"osd_in_since":1696768687,"num_remapped_pgs":0} 2023-10-08T12:38:29.358 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T12:38:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:29 smithi173 ceph-mon[135182]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:29 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3710017338' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:38:30.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:29 smithi059 ceph-mon[98489]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:30.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:29 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3710017338' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:38:30.096 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:38:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:29 smithi092 ceph-mon[134093]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:30.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:29 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3710017338' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:38:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.704+0000 7fa114839700 1 -- 172.21.15.59:0/1243644151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa110101260 msgr2=0x7fa11010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.704+0000 7fa114839700 1 --2- 172.21.15.59:0/1243644151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa110101260 0x7fa11010d650 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa108009f90 tx=0x7fa10800b330 comp rx=0 tx=0).stop 2023-10-08T12:38:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.705+0000 7fa114839700 1 -- 172.21.15.59:0/1243644151 shutdown_connections 2023-10-08T12:38:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.705+0000 7fa114839700 1 --2- 172.21.15.59:0/1243644151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa110101260 0x7fa11010d650 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.705+0000 7fa114839700 1 --2- 172.21.15.59:0/1243644151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1101057c0 0x7fa110105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.705+0000 7fa114839700 1 --2- 172.21.15.59:0/1243644151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1101008a0 0x7fa110100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.705+0000 7fa114839700 1 -- 172.21.15.59:0/1243644151 >> 172.21.15.59:0/1243644151 conn(0x7fa1100779e0 msgr2=0x7fa110077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.705+0000 7fa114839700 1 -- 172.21.15.59:0/1243644151 shutdown_connections 2023-10-08T12:38:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.705+0000 7fa114839700 1 -- 172.21.15.59:0/1243644151 wait complete. 2023-10-08T12:38:31.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.706+0000 7fa114839700 1 Processor -- start 2023-10-08T12:38:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.706+0000 7fa114839700 1 -- start start 2023-10-08T12:38:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.706+0000 7fa114839700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1101008a0 0x7fa110196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.706+0000 7fa114839700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa110101260 0x7fa110197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.706+0000 7fa114839700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1101057c0 0x7fa11019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.706+0000 7fa114839700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11019ab30 con 0x7fa110101260 2023-10-08T12:38:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.706+0000 7fa114839700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11019aca0 con 0x7fa1101008a0 2023-10-08T12:38:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.706+0000 7fa114839700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11019ae60 con 0x7fa1101057c0 2023-10-08T12:38:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa10dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa110101260 0x7fa110197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa10dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa110101260 0x7fa110197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42928/0 (socket says 172.21.15.59:42928) 2023-10-08T12:38:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa10dd9b700 1 -- 172.21.15.59:0/4034459537 learned_addr learned my addr 172.21.15.59:0/4034459537 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa10e59c700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1101008a0 0x7fa110196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa10ed9d700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1101057c0 0x7fa11019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa10dd9b700 1 -- 172.21.15.59:0/4034459537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1101057c0 msgr2=0x7fa11019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa10dd9b700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1101057c0 0x7fa11019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa10dd9b700 1 -- 172.21.15.59:0/4034459537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1101008a0 msgr2=0x7fa110196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa10dd9b700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1101008a0 0x7fa110196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa10dd9b700 1 -- 172.21.15.59:0/4034459537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa104009520 con 0x7fa110101260 2023-10-08T12:38:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa10dd9b700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa110101260 0x7fa110197230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa10400eb30 tx=0x7fa10400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.707+0000 7fa0ff7fe700 1 -- 172.21.15.59:0/4034459537 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104009880 con 0x7fa110101260 2023-10-08T12:38:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.708+0000 7fa114839700 1 -- 172.21.15.59:0/4034459537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1000095f0 con 0x7fa110101260 2023-10-08T12:38:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.708+0000 7fa0ff7fe700 1 -- 172.21.15.59:0/4034459537 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1040044e0 con 0x7fa110101260 2023-10-08T12:38:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.708+0000 7fa0ff7fe700 1 -- 172.21.15.59:0/4034459537 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104003d80 con 0x7fa110101260 2023-10-08T12:38:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.708+0000 7fa114839700 1 -- 172.21.15.59:0/4034459537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa108009c40 con 0x7fa110101260 2023-10-08T12:38:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.709+0000 7fa114839700 1 -- 172.21.15.59:0/4034459537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa110108da0 con 0x7fa110101260 2023-10-08T12:38:31.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.712+0000 7fa0ff7fe700 1 -- 172.21.15.59:0/4034459537 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa104003f00 con 0x7fa110101260 2023-10-08T12:38:31.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.714+0000 7fa0ff7fe700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0f80a14d0 0x7fa0f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.714+0000 7fa0ff7fe700 1 -- 172.21.15.59:0/4034459537 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fa104014070 con 0x7fa110101260 2023-10-08T12:38:31.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.714+0000 7fa10e59c700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0f80a14d0 0x7fa0f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.715+0000 7fa10e59c700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0f80a14d0 0x7fa0f80a3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa110101930 tx=0x7fa100009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.716+0000 7fa0ff7fe700 1 -- 172.21.15.59:0/4034459537 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa104096a10 con 0x7fa110101260 2023-10-08T12:38:31.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.928+0000 7fa114839700 1 -- 172.21.15.59:0/4034459537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa110101f30 con 0x7fa110101260 2023-10-08T12:38:31.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.929+0000 7fa0ff7fe700 1 -- 172.21.15.59:0/4034459537 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18699 (secure 0 0 0) 0x7fa10400fe60 con 0x7fa110101260 2023-10-08T12:38:31.931 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:31.931 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":80,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:38:26.292105+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:38:31.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 -- 172.21.15.59:0/4034459537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0f80a14d0 msgr2=0x7fa0f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0f80a14d0 0x7fa0f80a3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa110101930 tx=0x7fa100009310 comp rx=0 tx=0).stop 2023-10-08T12:38:31.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 -- 172.21.15.59:0/4034459537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa110101260 msgr2=0x7fa110197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa110101260 0x7fa110197230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa10400eb30 tx=0x7fa10400ee40 comp rx=0 tx=0).stop 2023-10-08T12:38:31.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 -- 172.21.15.59:0/4034459537 shutdown_connections 2023-10-08T12:38:31.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0f80a14d0 0x7fa0f80a3990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1101008a0 0x7fa110196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1101057c0 0x7fa11019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 --2- 172.21.15.59:0/4034459537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa110101260 0x7fa110197230 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 -- 172.21.15.59:0/4034459537 >> 172.21.15.59:0/4034459537 conn(0x7fa1100779e0 msgr2=0x7fa1100fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:31.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 -- 172.21.15.59:0/4034459537 shutdown_connections 2023-10-08T12:38:31.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:31.932+0000 7fa114839700 1 -- 172.21.15.59:0/4034459537 wait complete. 2023-10-08T12:38:32.071 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:31 smithi059 ceph-mon[98489]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:32.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:31 smithi092 ceph-mon[134093]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:31 smithi173 ceph-mon[135182]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:32.375 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:38:32.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-08T12:38:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:38:33.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:32 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4034459537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:38:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:32 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4034459537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:38:33.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:32 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4034459537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:38:33.973 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:33 smithi059 ceph-mon[98489]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:34.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:33 smithi092 ceph-mon[134093]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:33 smithi173 ceph-mon[135182]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:34.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.589+0000 7fad67c0a700 1 -- 172.21.15.59:0/1476195313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad6010d250 msgr2=0x7fad6010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.589+0000 7fad67c0a700 1 --2- 172.21.15.59:0/1476195313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad6010d250 0x7fad6010f640 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fad5800b0a0 tx=0x7fad5800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:38:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.589+0000 7fad67c0a700 1 -- 172.21.15.59:0/1476195313 shutdown_connections 2023-10-08T12:38:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.589+0000 7fad67c0a700 1 --2- 172.21.15.59:0/1476195313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad6010d250 0x7fad6010f640 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.589+0000 7fad67c0a700 1 --2- 172.21.15.59:0/1476195313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad60072a20 0x7fad60072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.589+0000 7fad67c0a700 1 --2- 172.21.15.59:0/1476195313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad60073340 0x7fad6010cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.589+0000 7fad67c0a700 1 -- 172.21.15.59:0/1476195313 >> 172.21.15.59:0/1476195313 conn(0x7fad600779e0 msgr2=0x7fad60077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.589+0000 7fad67c0a700 1 -- 172.21.15.59:0/1476195313 shutdown_connections 2023-10-08T12:38:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.589+0000 7fad67c0a700 1 -- 172.21.15.59:0/1476195313 wait complete. 2023-10-08T12:38:34.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.590+0000 7fad67c0a700 1 Processor -- start 2023-10-08T12:38:34.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.590+0000 7fad67c0a700 1 -- start start 2023-10-08T12:38:34.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.591+0000 7fad67c0a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad60072a20 0x7fad60199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:34.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.591+0000 7fad67c0a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad60073340 0x7fad601995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:34.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.591+0000 7fad67c0a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad6010d250 0x7fad6019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:34.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.591+0000 7fad67c0a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6019df60 con 0x7fad60073340 2023-10-08T12:38:34.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.591+0000 7fad67c0a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6019e0d0 con 0x7fad60072a20 2023-10-08T12:38:34.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.591+0000 7fad67c0a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6019e290 con 0x7fad6010d250 2023-10-08T12:38:34.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.591+0000 7fad651a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad60073340 0x7fad601995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:34.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.591+0000 7fad651a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad60073340 0x7fad601995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42952/0 (socket says 172.21.15.59:42952) 2023-10-08T12:38:34.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.591+0000 7fad651a5700 1 -- 172.21.15.59:0/1745744578 learned_addr learned my addr 172.21.15.59:0/1745744578 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:34.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.591+0000 7fad661a7700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad6010d250 0x7fad6019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:34.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.591+0000 7fad659a6700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad60072a20 0x7fad60199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad651a5700 1 -- 172.21.15.59:0/1745744578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad6010d250 msgr2=0x7fad6019d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad651a5700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad6010d250 0x7fad6019d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad651a5700 1 -- 172.21.15.59:0/1745744578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad60072a20 msgr2=0x7fad60199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad651a5700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad60072a20 0x7fad60199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad651a5700 1 -- 172.21.15.59:0/1745744578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009520 con 0x7fad60073340 2023-10-08T12:38:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad661a7700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad6010d250 0x7fad6019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad651a5700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad60073340 0x7fad601995a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fad5000eb30 tx=0x7fad5000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad56ffd700 1 -- 172.21.15.59:0/1745744578 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50009880 con 0x7fad60073340 2023-10-08T12:38:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad67c0a700 1 -- 172.21.15.59:0/1745744578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad58009d00 con 0x7fad60073340 2023-10-08T12:38:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad56ffd700 1 -- 172.21.15.59:0/1745744578 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad500044e0 con 0x7fad60073340 2023-10-08T12:38:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad56ffd700 1 -- 172.21.15.59:0/1745744578 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50003d80 con 0x7fad60073340 2023-10-08T12:38:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.592+0000 7fad67c0a700 1 -- 172.21.15.59:0/1745744578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad601a5c00 con 0x7fad60073340 2023-10-08T12:38:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.593+0000 7fad67c0a700 1 -- 172.21.15.59:0/1745744578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad60108460 con 0x7fad60073340 2023-10-08T12:38:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.595+0000 7fad56ffd700 1 -- 172.21.15.59:0/1745744578 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fad50003f00 con 0x7fad60073340 2023-10-08T12:38:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.597+0000 7fad56ffd700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad4c0a14d0 0x7fad4c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.597+0000 7fad56ffd700 1 -- 172.21.15.59:0/1745744578 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fad50014070 con 0x7fad60073340 2023-10-08T12:38:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.597+0000 7fad659a6700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad4c0a14d0 0x7fad4c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.598+0000 7fad659a6700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad4c0a14d0 0x7fad4c0a3990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009c60 tx=0x7fad5c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:34.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.599+0000 7fad56ffd700 1 -- 172.21.15.59:0/1745744578 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fad500969b0 con 0x7fad60073340 2023-10-08T12:38:34.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.807+0000 7fad67c0a700 1 -- 172.21.15.59:0/1745744578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad6019a370 con 0x7fad60073340 2023-10-08T12:38:34.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.808+0000 7fad56ffd700 1 -- 172.21.15.59:0/1745744578 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad5000fe60 con 0x7fad60073340 2023-10-08T12:38:34.809 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T12:38:34.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.810+0000 7fad67c0a700 1 -- 172.21.15.59:0/1745744578 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad4c0a14d0 msgr2=0x7fad4c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:34.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.810+0000 7fad67c0a700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad4c0a14d0 0x7fad4c0a3990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009c60 tx=0x7fad5c009260 comp rx=0 tx=0).stop 2023-10-08T12:38:34.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.810+0000 7fad67c0a700 1 -- 172.21.15.59:0/1745744578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad60073340 msgr2=0x7fad601995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:34.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.810+0000 7fad67c0a700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad60073340 0x7fad601995a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fad5000eb30 tx=0x7fad5000ee40 comp rx=0 tx=0).stop 2023-10-08T12:38:34.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.810+0000 7fad67c0a700 1 -- 172.21.15.59:0/1745744578 shutdown_connections 2023-10-08T12:38:34.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.810+0000 7fad67c0a700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad4c0a14d0 0x7fad4c0a3990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:34.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.810+0000 7fad67c0a700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad60072a20 0x7fad60199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:34.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.810+0000 7fad67c0a700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad6010d250 0x7fad6019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:34.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.810+0000 7fad67c0a700 1 --2- 172.21.15.59:0/1745744578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad60073340 0x7fad601995a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:34.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.810+0000 7fad67c0a700 1 -- 172.21.15.59:0/1745744578 >> 172.21.15.59:0/1745744578 conn(0x7fad600779e0 msgr2=0x7fad600fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:34.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.811+0000 7fad67c0a700 1 -- 172.21.15.59:0/1745744578 shutdown_connections 2023-10-08T12:38:34.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:34.811+0000 7fad67c0a700 1 -- 172.21.15.59:0/1745744578 wait complete. 2023-10-08T12:38:35.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:34 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1745744578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:38:35.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:34 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1745744578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:38:35.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:34 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1745744578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:38:35.298 INFO:tasks.cephadm:Adding mds.a on smithi059 2023-10-08T12:38:35.298 INFO:tasks.cephadm:Adding mds.d on smithi059 2023-10-08T12:38:35.298 INFO:tasks.cephadm:Adding mds.g on smithi059 2023-10-08T12:38:35.298 INFO:tasks.cephadm:Adding mds.j on smithi059 2023-10-08T12:38:35.298 INFO:tasks.cephadm:Adding mds.b on smithi092 2023-10-08T12:38:35.298 INFO:tasks.cephadm:Adding mds.e on smithi092 2023-10-08T12:38:35.298 INFO:tasks.cephadm:Adding mds.h on smithi092 2023-10-08T12:38:35.298 INFO:tasks.cephadm:Adding mds.k on smithi092 2023-10-08T12:38:35.299 INFO:tasks.cephadm:Adding mds.c on smithi173 2023-10-08T12:38:35.299 INFO:tasks.cephadm:Adding mds.f on smithi173 2023-10-08T12:38:35.299 INFO:tasks.cephadm:Adding mds.i on smithi173 2023-10-08T12:38:35.299 INFO:tasks.cephadm:Adding mds.l on smithi173 2023-10-08T12:38:35.299 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph orch apply mds all '12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l' 2023-10-08T12:38:35.874 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:38:36.100 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:35 smithi173 ceph-mon[135182]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:36.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:35 smithi092 ceph-mon[134093]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:36.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:35 smithi059 ceph-mon[98489]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:37.069 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.067+0000 7f3b6e024700 1 -- 172.21.15.173:0/407517714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b681067a0 msgr2=0x7f3b68106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:37.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.067+0000 7f3b6e024700 1 --2- 172.21.15.173:0/407517714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b681067a0 0x7f3b68106b80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009990 tx=0x7f3b50009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:37.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.067+0000 7f3b6e024700 1 -- 172.21.15.173:0/407517714 shutdown_connections 2023-10-08T12:38:37.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.067+0000 7f3b6e024700 1 --2- 172.21.15.173:0/407517714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b68068b30 0x7f3b6810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:37.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.067+0000 7f3b6e024700 1 --2- 172.21.15.173:0/407517714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b681067a0 0x7f3b68106b80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:37.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.067+0000 7f3b6e024700 1 --2- 172.21.15.173:0/407517714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b68068190 0x7f3b680685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:37.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.067+0000 7f3b6e024700 1 -- 172.21.15.173:0/407517714 >> 172.21.15.173:0/407517714 conn(0x7f3b68075790 msgr2=0x7f3b68075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:37.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.067+0000 7f3b6e024700 1 -- 172.21.15.173:0/407517714 shutdown_connections 2023-10-08T12:38:37.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.067+0000 7f3b6e024700 1 -- 172.21.15.173:0/407517714 wait complete. 2023-10-08T12:38:37.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b6e024700 1 Processor -- start 2023-10-08T12:38:37.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b6e024700 1 -- start start 2023-10-08T12:38:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b6e024700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68068190 0x7f3b6819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b6e024700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b68068b30 0x7f3b6819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b6e024700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b681067a0 0x7f3b68196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b6e024700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68197130 con 0x7f3b68068b30 2023-10-08T12:38:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b6e024700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b681972a0 con 0x7f3b681067a0 2023-10-08T12:38:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b6e024700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68197460 con 0x7f3b68068190 2023-10-08T12:38:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b677fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68068190 0x7f3b6819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b677fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68068190 0x7f3b6819c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44588/0 (socket says 172.21.15.173:44588) 2023-10-08T12:38:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b677fe700 1 -- 172.21.15.173:0/3836920857 learned_addr learned my addr 172.21.15.173:0/3836920857 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-08T12:38:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b67fff700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b681067a0 0x7f3b68196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b66ffd700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b68068b30 0x7f3b6819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b677fe700 1 -- 172.21.15.173:0/3836920857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b681067a0 msgr2=0x7f3b68196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b677fe700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b681067a0 0x7f3b68196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b677fe700 1 -- 172.21.15.173:0/3836920857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b68068b30 msgr2=0x7f3b6819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b677fe700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b68068b30 0x7f3b6819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b677fe700 1 -- 172.21.15.173:0/3836920857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b500095f0 con 0x7f3b68068190 2023-10-08T12:38:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.068+0000 7f3b66ffd700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b68068b30 0x7f3b6819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:38:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.069+0000 7f3b677fe700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68068190 0x7f3b6819c990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b500098e0 tx=0x7f3b5000f720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.069+0000 7f3b64ff9700 1 -- 172.21.15.173:0/3836920857 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5001d070 con 0x7f3b68068190 2023-10-08T12:38:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.069+0000 7f3b64ff9700 1 -- 172.21.15.173:0/3836920857 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b5000fb90 con 0x7f3b68068190 2023-10-08T12:38:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.069+0000 7f3b64ff9700 1 -- 172.21.15.173:0/3836920857 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50017650 con 0x7f3b68068190 2023-10-08T12:38:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.069+0000 7f3b6e024700 1 -- 172.21.15.173:0/3836920857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b681976e0 con 0x7f3b68068190 2023-10-08T12:38:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.069+0000 7f3b6e024700 1 -- 172.21.15.173:0/3836920857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b681a3980 con 0x7f3b68068190 2023-10-08T12:38:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.070+0000 7f3b6e024700 1 -- 172.21.15.173:0/3836920857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b68108d50 con 0x7f3b68068190 2023-10-08T12:38:37.074 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.071+0000 7f3b64ff9700 1 -- 172.21.15.173:0/3836920857 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3b5000fd00 con 0x7f3b68068190 2023-10-08T12:38:37.074 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.071+0000 7f3b64ff9700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b540a14d0 0x7f3b540a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:37.074 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.072+0000 7f3b64ff9700 1 -- 172.21.15.173:0/3836920857 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f3b500cdae0 con 0x7f3b68068190 2023-10-08T12:38:37.074 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.072+0000 7f3b66ffd700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b540a14d0 0x7f3b540a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:37.074 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.073+0000 7f3b66ffd700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b540a14d0 0x7f3b540a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3b58005fd0 tx=0x7f3b58005ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.076+0000 7f3b64ff9700 1 -- 172.21.15.173:0/3836920857 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b500975a0 con 0x7f3b68068190 2023-10-08T12:38:37.274 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.274+0000 7f3b6e024700 1 -- 172.21.15.173:0/3836920857 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b68197870 con 0x7f3b540a14d0 2023-10-08T12:38:37.283 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.283+0000 7f3b64ff9700 1 -- 172.21.15.173:0/3836920857 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f3b68197870 con 0x7f3b540a14d0 2023-10-08T12:38:37.283 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mds.all update... 2023-10-08T12:38:37.285 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 -- 172.21.15.173:0/3836920857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b540a14d0 msgr2=0x7f3b540a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:37.286 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b540a14d0 0x7f3b540a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3b58005fd0 tx=0x7f3b58005ee0 comp rx=0 tx=0).stop 2023-10-08T12:38:37.286 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 -- 172.21.15.173:0/3836920857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68068190 msgr2=0x7f3b6819c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:37.286 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68068190 0x7f3b6819c990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b500098e0 tx=0x7f3b5000f720 comp rx=0 tx=0).stop 2023-10-08T12:38:37.286 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 -- 172.21.15.173:0/3836920857 shutdown_connections 2023-10-08T12:38:37.286 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b540a14d0 0x7f3b540a3990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:37.286 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b681067a0 0x7f3b68196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:37.286 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68068190 0x7f3b6819c990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:37.286 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 --2- 172.21.15.173:0/3836920857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b68068b30 0x7f3b6819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:37.286 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 -- 172.21.15.173:0/3836920857 >> 172.21.15.173:0/3836920857 conn(0x7f3b68075790 msgr2=0x7f3b680fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:37.287 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 -- 172.21.15.173:0/3836920857 shutdown_connections 2023-10-08T12:38:37.287 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-08T12:38:37.285+0000 7f3b6e024700 1 -- 172.21.15.173:0/3836920857 wait complete. 2023-10-08T12:38:37.629 DEBUG:teuthology.orchestra.run.smithi059:mds.a> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.a.service 2023-10-08T12:38:37.634 DEBUG:teuthology.orchestra.run.smithi059:mds.d> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.d.service 2023-10-08T12:38:37.681 DEBUG:teuthology.orchestra.run.smithi059:mds.g> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.g.service 2023-10-08T12:38:37.716 INFO:journalctl@ceph.mds.a.smithi059.stdout:-- Logs begin at Sun 2023-10-08 12:12:12 UTC. -- 2023-10-08T12:38:37.722 DEBUG:teuthology.orchestra.run.smithi059:mds.j> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.j.service 2023-10-08T12:38:37.757 INFO:journalctl@ceph.mds.d.smithi059.stdout:-- Logs begin at Sun 2023-10-08 12:12:12 UTC. -- 2023-10-08T12:38:37.760 DEBUG:teuthology.orchestra.run.smithi092:mds.b> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.b.service 2023-10-08T12:38:37.762 DEBUG:teuthology.orchestra.run.smithi092:mds.e> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.e.service 2023-10-08T12:38:37.794 INFO:journalctl@ceph.mds.g.smithi059.stdout:-- Logs begin at Sun 2023-10-08 12:12:12 UTC. -- 2023-10-08T12:38:37.799 INFO:journalctl@ceph.mds.b.smithi092.stdout:-- Logs begin at Sun 2023-10-08 12:08:21 UTC. -- 2023-10-08T12:38:37.800 DEBUG:teuthology.orchestra.run.smithi092:mds.h> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.h.service 2023-10-08T12:38:37.829 INFO:journalctl@ceph.mds.e.smithi092.stdout:-- Logs begin at Sun 2023-10-08 12:08:21 UTC. -- 2023-10-08T12:38:37.830 DEBUG:teuthology.orchestra.run.smithi092:mds.k> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.k.service 2023-10-08T12:38:37.831 INFO:journalctl@ceph.mds.j.smithi059.stdout:-- Logs begin at Sun 2023-10-08 12:12:12 UTC. -- 2023-10-08T12:38:37.857 INFO:journalctl@ceph.mds.h.smithi092.stdout:-- Logs begin at Sun 2023-10-08 12:08:21 UTC. -- 2023-10-08T12:38:37.858 DEBUG:teuthology.orchestra.run.smithi173:mds.c> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.c.service 2023-10-08T12:38:37.860 DEBUG:teuthology.orchestra.run.smithi173:mds.f> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.f.service 2023-10-08T12:38:37.882 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:37 smithi173 ceph-mon[135182]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:37.882 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:37.882 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:37.882 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:37.883 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:37.883 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:37.883 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:37.883 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:37.883 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:37.884 DEBUG:teuthology.orchestra.run.smithi173:mds.i> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.i.service 2023-10-08T12:38:37.885 INFO:journalctl@ceph.mds.k.smithi092.stdout:-- Logs begin at Sun 2023-10-08 12:08:21 UTC. -- 2023-10-08T12:38:37.888 INFO:journalctl@ceph.mds.c.smithi173.stdout:-- Logs begin at Sun 2023-10-08 12:08:19 UTC. -- 2023-10-08T12:38:37.889 DEBUG:teuthology.orchestra.run.smithi173:mds.l> sudo journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.l.service 2023-10-08T12:38:37.910 INFO:journalctl@ceph.mds.f.smithi173.stdout:-- Logs begin at Sun 2023-10-08 12:08:19 UTC. -- 2023-10-08T12:38:37.910 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-08T12:38:37.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:38:37.914 INFO:journalctl@ceph.mds.i.smithi173.stdout:-- Logs begin at Sun 2023-10-08 12:08:19 UTC. -- 2023-10-08T12:38:37.936 INFO:journalctl@ceph.mds.l.smithi173.stdout:-- Logs begin at Sun 2023-10-08 12:08:19 UTC. -- 2023-10-08T12:38:37.972 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:37 smithi059 ceph-mon[98489]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:37.972 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:37.972 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:37.972 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:37.972 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:37.972 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:37.972 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:37.972 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:37.973 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:37 smithi092 ceph-mon[134093]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:38.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.147+0000 7fc475fff700 1 -- 172.21.15.59:0/4014468184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc470100630 msgr2=0x7fc470100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.147+0000 7fc475fff700 1 --2- 172.21.15.59:0/4014468184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc470100630 0x7fc470100ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc4640098f0 tx=0x7fc464009c00 comp rx=0 tx=0).stop 2023-10-08T12:38:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.147+0000 7fc475fff700 1 -- 172.21.15.59:0/4014468184 shutdown_connections 2023-10-08T12:38:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.147+0000 7fc475fff700 1 --2- 172.21.15.59:0/4014468184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc470100ff0 0x7fc47010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.147+0000 7fc475fff700 1 --2- 172.21.15.59:0/4014468184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc470106640 0x7fc470106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.147+0000 7fc475fff700 1 --2- 172.21.15.59:0/4014468184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc470100630 0x7fc470100ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.147+0000 7fc475fff700 1 -- 172.21.15.59:0/4014468184 >> 172.21.15.59:0/4014468184 conn(0x7fc4700fc140 msgr2=0x7fc4700fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.147+0000 7fc475fff700 1 -- 172.21.15.59:0/4014468184 shutdown_connections 2023-10-08T12:38:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.147+0000 7fc475fff700 1 -- 172.21.15.59:0/4014468184 wait complete. 2023-10-08T12:38:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.148+0000 7fc475fff700 1 Processor -- start 2023-10-08T12:38:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.148+0000 7fc475fff700 1 -- start start 2023-10-08T12:38:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.149+0000 7fc475fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc470100630 0x7fc47019c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.149+0000 7fc475fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc470100ff0 0x7fc47019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.149+0000 7fc475fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc470106640 0x7fc470196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.149+0000 7fc475fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470196f60 con 0x7fc470106640 2023-10-08T12:38:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.149+0000 7fc475fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4701970d0 con 0x7fc470100630 2023-10-08T12:38:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.149+0000 7fc475fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470197290 con 0x7fc470100ff0 2023-10-08T12:38:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.149+0000 7fc46effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc470100ff0 0x7fc47019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.149+0000 7fc46effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc470100ff0 0x7fc47019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56390/0 (socket says 172.21.15.59:56390) 2023-10-08T12:38:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.149+0000 7fc46effd700 1 -- 172.21.15.59:0/599040781 learned_addr learned my addr 172.21.15.59:0/599040781 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.149+0000 7fc46ffff700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc470106640 0x7fc470196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.149+0000 7fc46f7fe700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc470100630 0x7fc47019c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.150+0000 7fc46effd700 1 -- 172.21.15.59:0/599040781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc470100630 msgr2=0x7fc47019c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.150+0000 7fc46effd700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc470100630 0x7fc47019c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.150+0000 7fc46effd700 1 -- 172.21.15.59:0/599040781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc470106640 msgr2=0x7fc470196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.150+0000 7fc46effd700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc470106640 0x7fc470196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.150+0000 7fc46effd700 1 -- 172.21.15.59:0/599040781 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4600095f0 con 0x7fc470100ff0 2023-10-08T12:38:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.150+0000 7fc46effd700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc470100ff0 0x7fc47019cd10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc46400fa00 tx=0x7fc46400fa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.150+0000 7fc46cff9700 1 -- 172.21.15.59:0/599040781 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46401c070 con 0x7fc470100ff0 2023-10-08T12:38:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.150+0000 7fc46cff9700 1 -- 172.21.15.59:0/599040781 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc464005040 con 0x7fc470100ff0 2023-10-08T12:38:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.150+0000 7fc475fff700 1 -- 172.21.15.59:0/599040781 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc464009520 con 0x7fc470100ff0 2023-10-08T12:38:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.150+0000 7fc46cff9700 1 -- 172.21.15.59:0/599040781 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464004a90 con 0x7fc470100ff0 2023-10-08T12:38:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.150+0000 7fc475fff700 1 -- 172.21.15.59:0/599040781 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4701a35e0 con 0x7fc470100ff0 2023-10-08T12:38:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.151+0000 7fc475fff700 1 -- 172.21.15.59:0/599040781 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc470108c50 con 0x7fc470100ff0 2023-10-08T12:38:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.154+0000 7fc46cff9700 1 -- 172.21.15.59:0/599040781 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc4640051b0 con 0x7fc470100ff0 2023-10-08T12:38:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.155+0000 7fc46cff9700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc4580a14d0 0x7fc4580a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.155+0000 7fc46cff9700 1 -- 172.21.15.59:0/599040781 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fc4640ce5f0 con 0x7fc470100ff0 2023-10-08T12:38:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.155+0000 7fc46f7fe700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc4580a14d0 0x7fc4580a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.156+0000 7fc46f7fe700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc4580a14d0 0x7fc4580a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc460005fd0 tx=0x7fc460009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:38.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.157+0000 7fc46cff9700 1 -- 172.21.15.59:0/599040781 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc464098010 con 0x7fc470100ff0 2023-10-08T12:38:38.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.373+0000 7fc475fff700 1 -- 172.21.15.59:0/599040781 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc470197dc0 con 0x7fc470100ff0 2023-10-08T12:38:38.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.374+0000 7fc46cff9700 1 -- 172.21.15.59:0/599040781 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18699 (secure 0 0 0) 0x7fc46409b630 con 0x7fc470100ff0 2023-10-08T12:38:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:38.376 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":80,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:38:26.292105+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:38:38.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 -- 172.21.15.59:0/599040781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc4580a14d0 msgr2=0x7fc4580a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:38.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc4580a14d0 0x7fc4580a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc460005fd0 tx=0x7fc460009310 comp rx=0 tx=0).stop 2023-10-08T12:38:38.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 -- 172.21.15.59:0/599040781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc470100ff0 msgr2=0x7fc47019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:38.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc470100ff0 0x7fc47019cd10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc46400fa00 tx=0x7fc46400fa30 comp rx=0 tx=0).stop 2023-10-08T12:38:38.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 -- 172.21.15.59:0/599040781 shutdown_connections 2023-10-08T12:38:38.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc4580a14d0 0x7fc4580a3990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc470100630 0x7fc47019c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc470106640 0x7fc470196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 --2- 172.21.15.59:0/599040781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc470100ff0 0x7fc47019cd10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 -- 172.21.15.59:0/599040781 >> 172.21.15.59:0/599040781 conn(0x7fc4700fc140 msgr2=0x7fc4700fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:38.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 -- 172.21.15.59:0/599040781 shutdown_connections 2023-10-08T12:38:38.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.377+0000 7fc475fff700 1 -- 172.21.15.59:0/599040781 wait complete. 2023-10-08T12:38:38.398 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:38:38.399 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:38:38.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.604+0000 7f94c39ff700 1 -- 172.21.15.59:0/2023465360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94bc100730 msgr2=0x7f94bc100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:38.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.604+0000 7f94c39ff700 1 --2- 172.21.15.59:0/2023465360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94bc100730 0x7f94bc100bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0098f0 tx=0x7f94ac009c00 comp rx=0 tx=0).stop 2023-10-08T12:38:38.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.604+0000 7f94c39ff700 1 -- 172.21.15.59:0/2023465360 shutdown_connections 2023-10-08T12:38:38.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.604+0000 7f94c39ff700 1 --2- 172.21.15.59:0/2023465360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94bc1010f0 0x7f94bc10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.604+0000 7f94c39ff700 1 --2- 172.21.15.59:0/2023465360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94bc106740 0x7f94bc106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.604+0000 7f94c39ff700 1 --2- 172.21.15.59:0/2023465360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94bc100730 0x7f94bc100bb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.604+0000 7f94c39ff700 1 -- 172.21.15.59:0/2023465360 >> 172.21.15.59:0/2023465360 conn(0x7f94bc0fc200 msgr2=0x7f94bc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:38.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.605+0000 7f94c39ff700 1 -- 172.21.15.59:0/2023465360 shutdown_connections 2023-10-08T12:38:38.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.605+0000 7f94c39ff700 1 -- 172.21.15.59:0/2023465360 wait complete. 2023-10-08T12:38:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.606+0000 7f94c39ff700 1 Processor -- start 2023-10-08T12:38:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.606+0000 7f94c39ff700 1 -- start start 2023-10-08T12:38:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.606+0000 7f94c39ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94bc100730 0x7f94bc198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.606+0000 7f94c39ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94bc1010f0 0x7f94bc1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.606+0000 7f94c39ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94bc106740 0x7f94bc19d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.606+0000 7f94c39ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc19dda0 con 0x7f94bc1010f0 2023-10-08T12:38:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.606+0000 7f94c39ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc19df10 con 0x7f94bc100730 2023-10-08T12:38:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.606+0000 7f94c39ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc19e0d0 con 0x7f94bc106740 2023-10-08T12:38:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.606+0000 7f94c0f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94bc1010f0 0x7f94bc1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.606+0000 7f94c0f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94bc1010f0 0x7f94bc1993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42990/0 (socket says 172.21.15.59:42990) 2023-10-08T12:38:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.606+0000 7f94c0f9a700 1 -- 172.21.15.59:0/8700852 learned_addr learned my addr 172.21.15.59:0/8700852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94c179b700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94bc100730 0x7f94bc198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94c0f9a700 1 -- 172.21.15.59:0/8700852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94bc106740 msgr2=0x7f94bc19d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94c0f9a700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94bc106740 0x7f94bc19d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94c0f9a700 1 -- 172.21.15.59:0/8700852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94bc100730 msgr2=0x7f94bc198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94c0f9a700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94bc100730 0x7f94bc198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94c0f9a700 1 -- 172.21.15.59:0/8700852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b4009c40 con 0x7f94bc1010f0 2023-10-08T12:38:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94c0f9a700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94bc1010f0 0x7f94bc1993c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f94ac005950 tx=0x7f94ac010ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94b27fc700 1 -- 172.21.15.59:0/8700852 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac01c070 con 0x7f94bc1010f0 2023-10-08T12:38:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94b27fc700 1 -- 172.21.15.59:0/8700852 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94ac00bb20 con 0x7f94bc1010f0 2023-10-08T12:38:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94c39ff700 1 -- 172.21.15.59:0/8700852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b80095f0 con 0x7f94bc1010f0 2023-10-08T12:38:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94b27fc700 1 -- 172.21.15.59:0/8700852 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac003a00 con 0x7f94bc1010f0 2023-10-08T12:38:38.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.607+0000 7f94c39ff700 1 -- 172.21.15.59:0/8700852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac009520 con 0x7f94bc1010f0 2023-10-08T12:38:38.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.608+0000 7f94c39ff700 1 -- 172.21.15.59:0/8700852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94bc101e70 con 0x7f94bc1010f0 2023-10-08T12:38:38.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.610+0000 7f94b27fc700 1 -- 172.21.15.59:0/8700852 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f94ac020030 con 0x7f94bc1010f0 2023-10-08T12:38:38.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.611+0000 7f94b27fc700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94a80a1550 0x7f94a80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:38.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.612+0000 7f94b27fc700 1 -- 172.21.15.59:0/8700852 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f94ac0cd7d0 con 0x7f94bc1010f0 2023-10-08T12:38:38.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.612+0000 7f94c179b700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94a80a1550 0x7f94a80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:38.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.612+0000 7f94c179b700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94a80a1550 0x7f94a80a3a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f94b8005fd0 tx=0x7f94b8009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.615+0000 7f94b27fc700 1 -- 172.21.15.59:0/8700852 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f94ac0971f0 con 0x7f94bc1010f0 2023-10-08T12:38:38.818 INFO:journalctl@ceph.mds.l.smithi173.stdout:Oct 08 12:38:38 smithi173 systemd[1]: Starting Ceph mds.l for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:38:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.826+0000 7f94c39ff700 1 -- 172.21.15.59:0/8700852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94bc110700 con 0x7f94bc1010f0 2023-10-08T12:38:38.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.826+0000 7f94b27fc700 1 -- 172.21.15.59:0/8700852 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94ac09a810 con 0x7f94bc1010f0 2023-10-08T12:38:38.827 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T12:38:38.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.828+0000 7f94c39ff700 1 -- 172.21.15.59:0/8700852 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94a80a1550 msgr2=0x7f94a80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:38.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.828+0000 7f94c39ff700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94a80a1550 0x7f94a80a3a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f94b8005fd0 tx=0x7f94b8009310 comp rx=0 tx=0).stop 2023-10-08T12:38:38.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.828+0000 7f94c39ff700 1 -- 172.21.15.59:0/8700852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94bc1010f0 msgr2=0x7f94bc1993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:38.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.828+0000 7f94c39ff700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94bc1010f0 0x7f94bc1993c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f94ac005950 tx=0x7f94ac010ff0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.829+0000 7f94c39ff700 1 -- 172.21.15.59:0/8700852 shutdown_connections 2023-10-08T12:38:38.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.829+0000 7f94c39ff700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94a80a1550 0x7f94a80a3a10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.829+0000 7f94c39ff700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94bc100730 0x7f94bc198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.829+0000 7f94c39ff700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94bc106740 0x7f94bc19d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.829+0000 7f94c39ff700 1 --2- 172.21.15.59:0/8700852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94bc1010f0 0x7f94bc1993c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:38.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.829+0000 7f94c39ff700 1 -- 172.21.15.59:0/8700852 >> 172.21.15.59:0/8700852 conn(0x7f94bc0fc200 msgr2=0x7f94bc0fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:38.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.829+0000 7f94c39ff700 1 -- 172.21.15.59:0/8700852 shutdown_connections 2023-10-08T12:38:38.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:38.829+0000 7f94c39ff700 1 -- 172.21.15.59:0/8700852 wait complete. 2023-10-08T12:38:38.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:38:39.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.052+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2958050971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb4106660 msgr2=0x7f8bb4106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:39.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.052+0000 7f8bb8bff700 1 --2- 172.21.15.59:0/2958050971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb4106660 0x7f8bb4106a40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009990 tx=0x7f8ba4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:39.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.052+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2958050971 shutdown_connections 2023-10-08T12:38:39.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.052+0000 7f8bb8bff700 1 --2- 172.21.15.59:0/2958050971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bb4100f80 0x7f8bb410d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:39.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.052+0000 7f8bb8bff700 1 --2- 172.21.15.59:0/2958050971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb4106660 0x7f8bb4106a40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:39.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.052+0000 7f8bb8bff700 1 --2- 172.21.15.59:0/2958050971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bb41005c0 0x7f8bb4100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:39.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.052+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2958050971 >> 172.21.15.59:0/2958050971 conn(0x7f8bb40fc0b0 msgr2=0x7f8bb40fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:39.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.052+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2958050971 shutdown_connections 2023-10-08T12:38:39.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.052+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2958050971 wait complete. 2023-10-08T12:38:39.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.053+0000 7f8bb8bff700 1 Processor -- start 2023-10-08T12:38:39.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.053+0000 7f8bb8bff700 1 -- start start 2023-10-08T12:38:39.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb8bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb41005c0 0x7f8bb419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:39.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb8bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bb4100f80 0x7f8bb419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:39.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb8bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bb4106660 0x7f8bb4196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:39.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb8bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4196ec0 con 0x7f8bb41005c0 2023-10-08T12:38:39.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb8bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4197030 con 0x7f8bb4100f80 2023-10-08T12:38:39.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb8bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41971f0 con 0x7f8bb4106660 2023-10-08T12:38:39.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb41005c0 0x7f8bb419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:39.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8babfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bb4100f80 0x7f8bb419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:39.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb41005c0 0x7f8bb419c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43002/0 (socket says 172.21.15.59:43002) 2023-10-08T12:38:39.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb259c700 1 -- 172.21.15.59:0/2076494951 learned_addr learned my addr 172.21.15.59:0/2076494951 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:39.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8babfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bb4100f80 0x7f8bb419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:36042/0 (socket says 172.21.15.59:36042) 2023-10-08T12:38:39.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb2d9d700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bb4106660 0x7f8bb4196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb259c700 1 -- 172.21.15.59:0/2076494951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bb4106660 msgr2=0x7f8bb4196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb259c700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bb4106660 0x7f8bb4196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb259c700 1 -- 172.21.15.59:0/2076494951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bb4100f80 msgr2=0x7f8bb419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb259c700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bb4100f80 0x7f8bb419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8bb259c700 1 -- 172.21.15.59:0/2076494951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba40095f0 con 0x7f8bb41005c0 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.054+0000 7f8babfff700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bb4100f80 0x7f8bb419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.055+0000 7f8bb259c700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb41005c0 0x7f8bb419c720 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4000c00 tx=0x7f8ba4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.055+0000 7f8bab7fe700 1 -- 172.21.15.59:0/2076494951 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba401d070 con 0x7f8bb41005c0 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.055+0000 7f8bab7fe700 1 -- 172.21.15.59:0/2076494951 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ba4021410 con 0x7f8bb41005c0 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.055+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2076494951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb4197470 con 0x7f8bb41005c0 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.055+0000 7f8bab7fe700 1 -- 172.21.15.59:0/2076494951 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4017650 con 0x7f8bb41005c0 2023-10-08T12:38:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.055+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2076494951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb41a3710 con 0x7f8bb41005c0 2023-10-08T12:38:39.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.056+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2076494951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb4108bc0 con 0x7f8bb41005c0 2023-10-08T12:38:39.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.058+0000 7f8bab7fe700 1 -- 172.21.15.59:0/2076494951 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8ba4021580 con 0x7f8bb41005c0 2023-10-08T12:38:39.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.059+0000 7f8bab7fe700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8ba00a1550 0x7f8ba00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:39.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.060+0000 7f8bab7fe700 1 -- 172.21.15.59:0/2076494951 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f8ba40cdb70 con 0x7f8bb41005c0 2023-10-08T12:38:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.060+0000 7f8babfff700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8ba00a1550 0x7f8ba00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.061+0000 7f8babfff700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8ba00a1550 0x7f8ba00a3a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4197c70 tx=0x7f8b9c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:39.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.064+0000 7f8bab7fe700 1 -- 172.21.15.59:0/2076494951 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8ba4097590 con 0x7f8bb41005c0 2023-10-08T12:38:39.110 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:38 smithi173 ceph-mon[135182]: from='client.24574 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:38:39.111 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:38 smithi173 ceph-mon[135182]: Saving service mds.all spec with placement smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2023-10-08T12:38:39.111 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:38 smithi173 ceph-mon[135182]: Deploying daemon mds.l on smithi173 2023-10-08T12:38:39.111 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:38 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/599040781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:38:39.111 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:38 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/8700852' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:38:39.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:38 smithi092 ceph-mon[134093]: from='client.24574 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:38:39.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:38 smithi092 ceph-mon[134093]: Saving service mds.all spec with placement smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2023-10-08T12:38:39.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:38 smithi092 ceph-mon[134093]: Deploying daemon mds.l on smithi173 2023-10-08T12:38:39.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:38 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/599040781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:38:39.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:38 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/8700852' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:38:39.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:38 smithi059 ceph-mon[98489]: from='client.24574 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:38:39.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:38 smithi059 ceph-mon[98489]: Saving service mds.all spec with placement smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2023-10-08T12:38:39.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:38 smithi059 ceph-mon[98489]: Deploying daemon mds.l on smithi173 2023-10-08T12:38:39.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:38 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/599040781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:38:39.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:38 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/8700852' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:38:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.322+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2076494951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bb4101d00 con 0x7f8bb41005c0 2023-10-08T12:38:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.322+0000 7f8bab7fe700 1 -- 172.21.15.59:0/2076494951 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f8ba4095e60 con 0x7f8bb41005c0 2023-10-08T12:38:39.323 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:39.324 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-08T12:38:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2076494951 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8ba00a1550 msgr2=0x7f8ba00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8ba00a1550 0x7f8ba00a3a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4197c70 tx=0x7f8b9c009260 comp rx=0 tx=0).stop 2023-10-08T12:38:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2076494951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb41005c0 msgr2=0x7f8bb419c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb41005c0 0x7f8bb419c720 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4000c00 tx=0x7f8ba4004730 comp rx=0 tx=0).stop 2023-10-08T12:38:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2076494951 shutdown_connections 2023-10-08T12:38:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8ba00a1550 0x7f8ba00a3a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bb4106660 0x7f8bb4196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb41005c0 0x7f8bb419c720 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 --2- 172.21.15.59:0/2076494951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bb4100f80 0x7f8bb419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2076494951 >> 172.21.15.59:0/2076494951 conn(0x7f8bb40fc0b0 msgr2=0x7f8bb40fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2076494951 shutdown_connections 2023-10-08T12:38:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:39.325+0000 7f8bb8bff700 1 -- 172.21.15.59:0/2076494951 wait complete. 2023-10-08T12:38:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 1 2023-10-08T12:38:39.399 INFO:journalctl@ceph.mds.l.smithi173.stdout:Oct 08 12:38:39 smithi173 podman[172443]: 2023-10-08T12:38:39.717 INFO:journalctl@ceph.mds.l.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mds[172483]: -- 172.21.15.173:0/3753651488 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f2e6a471e0 con 0x55f2e6a1c800 2023-10-08T12:38:39.718 INFO:journalctl@ceph.mds.l.smithi173.stdout:Oct 08 12:38:39 smithi173 bash[172443]: e54231eebb46840e7c288f20f90a7a9c77f407bf070bf2ce97b534e93be47e8d 2023-10-08T12:38:39.718 INFO:journalctl@ceph.mds.l.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-l[172459]: starting mds.l at 2023-10-08T12:38:39.718 INFO:journalctl@ceph.mds.l.smithi173.stdout:Oct 08 12:38:39 smithi173 systemd[1]: Started Ceph mds.l for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:38:40.107 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:39 smithi092 ceph-mon[134093]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:40.107 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:39 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2076494951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:40.108 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:39 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.173:6832/3717916833,v1:172.21.15.173:6833/3717916833] up:boot 2023-10-08T12:38:40.108 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:39 smithi092 ceph-mon[134093]: fsmap 1 up:standby 2023-10-08T12:38:40.108 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:39 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T12:38:40.108 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:39 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:40.108 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:39 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:40.108 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:39 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:40.109 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:39 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:40.109 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:39 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:40.109 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:39 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mon[135182]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2076494951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.173:6832/3717916833,v1:172.21.15.173:6833/3717916833] up:boot 2023-10-08T12:38:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mon[135182]: fsmap 1 up:standby 2023-10-08T12:38:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T12:38:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:39 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:39 smithi059 ceph-mon[98489]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:39 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2076494951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:39 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.173:6832/3717916833,v1:172.21.15.173:6833/3717916833] up:boot 2023-10-08T12:38:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:39 smithi059 ceph-mon[98489]: fsmap 1 up:standby 2023-10-08T12:38:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:39 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T12:38:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:39 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:39 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:40.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:39 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:40.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:39 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:40.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:39 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:40.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:39 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:41.127 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 08 12:38:40 smithi092 systemd[1]: Starting Ceph mds.k for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:38:41.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:40 smithi092 ceph-mon[134093]: Deploying daemon mds.k on smithi092 2023-10-08T12:38:41.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:40 smithi173 ceph-mon[135182]: Deploying daemon mds.k on smithi092 2023-10-08T12:38:41.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:40 smithi059 ceph-mon[98489]: Deploying daemon mds.k on smithi092 2023-10-08T12:38:41.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:38:41.558 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 08 12:38:41 smithi092 podman[172542]: 2023-10-08T12:38:41.559 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 08 12:38:41 smithi092 bash[172542]: 2c9f251746b03f76af0fb521fd40321e99748568837bc465fa651799ffb1353e 2023-10-08T12:38:41.559 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 08 12:38:41 smithi092 ceph-mds[172582]: -- 172.21.15.92:0/3477675473 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56472d1d71e0 con 0x56472d1ac800 2023-10-08T12:38:41.559 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 08 12:38:41 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-k[172558]: starting mds.k at 2023-10-08T12:38:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.559+0000 7f5a589ff700 1 -- 172.21.15.59:0/3450234842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a54100630 msgr2=0x7f5a54100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.559+0000 7f5a589ff700 1 --2- 172.21.15.59:0/3450234842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a54100630 0x7f5a54100ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009990 tx=0x7f5a48009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.559+0000 7f5a589ff700 1 -- 172.21.15.59:0/3450234842 shutdown_connections 2023-10-08T12:38:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.559+0000 7f5a589ff700 1 --2- 172.21.15.59:0/3450234842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a54100ff0 0x7f5a5410d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.559+0000 7f5a589ff700 1 --2- 172.21.15.59:0/3450234842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a54106640 0x7f5a54106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.559+0000 7f5a589ff700 1 --2- 172.21.15.59:0/3450234842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a54100630 0x7f5a54100ab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.559+0000 7f5a589ff700 1 -- 172.21.15.59:0/3450234842 >> 172.21.15.59:0/3450234842 conn(0x7f5a540fc140 msgr2=0x7f5a540fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.559+0000 7f5a589ff700 1 -- 172.21.15.59:0/3450234842 shutdown_connections 2023-10-08T12:38:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.559+0000 7f5a589ff700 1 -- 172.21.15.59:0/3450234842 wait complete. 2023-10-08T12:38:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.560+0000 7f5a589ff700 1 Processor -- start 2023-10-08T12:38:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.560+0000 7f5a589ff700 1 -- start start 2023-10-08T12:38:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a589ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a54100630 0x7f5a54072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a589ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a54100ff0 0x7f5a54073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a589ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a54106640 0x7f5a54073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a589ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a541a4e60 con 0x7f5a54100630 2023-10-08T12:38:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a589ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a541a4fd0 con 0x7f5a54106640 2023-10-08T12:38:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a589ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a541a5190 con 0x7f5a54100ff0 2023-10-08T12:38:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a5259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a54100630 0x7f5a54072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a52d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a54106640 0x7f5a54073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a5259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a54100630 0x7f5a54072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48756/0 (socket says 172.21.15.59:48756) 2023-10-08T12:38:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a5259c700 1 -- 172.21.15.59:0/1893836504 learned_addr learned my addr 172.21.15.59:0/1893836504 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a51d9b700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a54100ff0 0x7f5a54073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a52d9d700 1 -- 172.21.15.59:0/1893836504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a54100ff0 msgr2=0x7f5a54073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a52d9d700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a54100ff0 0x7f5a54073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a52d9d700 1 -- 172.21.15.59:0/1893836504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a54100630 msgr2=0x7f5a54072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a52d9d700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a54100630 0x7f5a54072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a52d9d700 1 -- 172.21.15.59:0/1893836504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a480095f0 con 0x7f5a54106640 2023-10-08T12:38:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.561+0000 7f5a5259c700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a54100630 0x7f5a54072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.562+0000 7f5a52d9d700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a54106640 0x7f5a54073570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00efc0 tx=0x7f5a4c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.562+0000 7f5a437fe700 1 -- 172.21.15.59:0/1893836504 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c018070 con 0x7f5a54106640 2023-10-08T12:38:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.562+0000 7f5a589ff700 1 -- 172.21.15.59:0/1893836504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a541a5410 con 0x7f5a54106640 2023-10-08T12:38:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.562+0000 7f5a437fe700 1 -- 172.21.15.59:0/1893836504 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a4c00f040 con 0x7f5a54106640 2023-10-08T12:38:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.562+0000 7f5a437fe700 1 -- 172.21.15.59:0/1893836504 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c00cd40 con 0x7f5a54106640 2023-10-08T12:38:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.562+0000 7f5a589ff700 1 -- 172.21.15.59:0/1893836504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a541a58a0 con 0x7f5a54106640 2023-10-08T12:38:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.563+0000 7f5a589ff700 1 -- 172.21.15.59:0/1893836504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a54108c50 con 0x7f5a54106640 2023-10-08T12:38:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.565+0000 7f5a437fe700 1 -- 172.21.15.59:0/1893836504 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5a4c003a00 con 0x7f5a54106640 2023-10-08T12:38:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.566+0000 7f5a437fe700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a3c0a14d0 0x7f5a3c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.566+0000 7f5a437fe700 1 -- 172.21.15.59:0/1893836504 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f5a4c0cc750 con 0x7f5a54106640 2023-10-08T12:38:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.566+0000 7f5a5259c700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a3c0a14d0 0x7f5a3c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.567+0000 7f5a5259c700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a3c0a14d0 0x7f5a3c0a3990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a44011550 tx=0x7f5a44009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.568+0000 7f5a437fe700 1 -- 172.21.15.59:0/1893836504 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5a4c096170 con 0x7f5a54106640 2023-10-08T12:38:41.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.834+0000 7f5a589ff700 1 -- 172.21.15.59:0/1893836504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a54101d70 con 0x7f5a54106640 2023-10-08T12:38:41.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.835+0000 7f5a437fe700 1 -- 172.21.15.59:0/1893836504 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7f5a4c099790 con 0x7f5a54106640 2023-10-08T12:38:41.836 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T12:38:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.837+0000 7f5a589ff700 1 -- 172.21.15.59:0/1893836504 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a3c0a14d0 msgr2=0x7f5a3c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.837+0000 7f5a589ff700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a3c0a14d0 0x7f5a3c0a3990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a44011550 tx=0x7f5a44009260 comp rx=0 tx=0).stop 2023-10-08T12:38:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.837+0000 7f5a589ff700 1 -- 172.21.15.59:0/1893836504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a54106640 msgr2=0x7f5a54073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.837+0000 7f5a589ff700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a54106640 0x7f5a54073570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00efc0 tx=0x7f5a4c00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:38:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.838+0000 7f5a589ff700 1 -- 172.21.15.59:0/1893836504 shutdown_connections 2023-10-08T12:38:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.838+0000 7f5a589ff700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5a3c0a14d0 0x7f5a3c0a3990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.838+0000 7f5a589ff700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a54106640 0x7f5a54073570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.838+0000 7f5a589ff700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a54100630 0x7f5a54072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.838+0000 7f5a589ff700 1 --2- 172.21.15.59:0/1893836504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a54100ff0 0x7f5a54073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.838+0000 7f5a589ff700 1 -- 172.21.15.59:0/1893836504 >> 172.21.15.59:0/1893836504 conn(0x7f5a540fc140 msgr2=0x7f5a540fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.838+0000 7f5a589ff700 1 -- 172.21.15.59:0/1893836504 shutdown_connections 2023-10-08T12:38:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:41.838+0000 7f5a589ff700 1 -- 172.21.15.59:0/1893836504 wait complete. 2023-10-08T12:38:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 2 2023-10-08T12:38:41.850 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 08 12:38:41 smithi092 systemd[1]: Started Ceph mds.k for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:38:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:41 smithi092 ceph-mon[134093]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:42.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:41 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1893836504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:41 smithi173 ceph-mon[135182]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:41 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1893836504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:42.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:41 smithi059 ceph-mon[98489]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:41 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1893836504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:42.864 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:42 smithi059 ceph-mon[98489]: Deploying daemon mds.j on smithi059 2023-10-08T12:38:42.864 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:42 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.92:6832/2525965671,v1:172.21.15.92:6833/2525965671] up:boot 2023-10-08T12:38:42.865 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:42 smithi059 ceph-mon[98489]: fsmap 2 up:standby 2023-10-08T12:38:43.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:42 smithi092 ceph-mon[134093]: Deploying daemon mds.j on smithi059 2023-10-08T12:38:43.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:42 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.92:6832/2525965671,v1:172.21.15.92:6833/2525965671] up:boot 2023-10-08T12:38:43.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:42 smithi092 ceph-mon[134093]: fsmap 2 up:standby 2023-10-08T12:38:43.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:42 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T12:38:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:42 smithi173 ceph-mon[135182]: Deploying daemon mds.j on smithi059 2023-10-08T12:38:43.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:42 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.92:6832/2525965671,v1:172.21.15.92:6833/2525965671] up:boot 2023-10-08T12:38:43.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:42 smithi173 ceph-mon[135182]: fsmap 2 up:standby 2023-10-08T12:38:43.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:42 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T12:38:43.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:42 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T12:38:43.860 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:38:43.971 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:43 smithi059 ceph-mon[98489]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:44.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.099+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3234250839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d0101000 msgr2=0x7fc1d010d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:44.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.099+0000 7fc1d51ff700 1 --2- 172.21.15.59:0/3234250839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d0101000 0x7fc1d010d510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800b0a0 tx=0x7fc1c800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:38:44.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.099+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3234250839 shutdown_connections 2023-10-08T12:38:44.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.099+0000 7fc1d51ff700 1 --2- 172.21.15.59:0/3234250839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d0101000 0x7fc1d010d510 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:44.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.099+0000 7fc1d51ff700 1 --2- 172.21.15.59:0/3234250839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1d0106650 0x7fc1d0106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:44.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.099+0000 7fc1d51ff700 1 --2- 172.21.15.59:0/3234250839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1d0100640 0x7fc1d0100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:44.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.100+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3234250839 >> 172.21.15.59:0/3234250839 conn(0x7fc1d00fc170 msgr2=0x7fc1d00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:44.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.100+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3234250839 shutdown_connections 2023-10-08T12:38:44.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.100+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3234250839 wait complete. 2023-10-08T12:38:44.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.101+0000 7fc1d51ff700 1 Processor -- start 2023-10-08T12:38:44.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.101+0000 7fc1d51ff700 1 -- start start 2023-10-08T12:38:44.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.101+0000 7fc1d51ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1d0100640 0x7fc1d019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:44.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.101+0000 7fc1d51ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1d0101000 0x7fc1d019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:44.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.101+0000 7fc1d51ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d0106650 0x7fc1d0198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:44.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.101+0000 7fc1d51ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d01990f0 con 0x7fc1d0100640 2023-10-08T12:38:44.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.101+0000 7fc1d51ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0199260 con 0x7fc1d0101000 2023-10-08T12:38:44.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.101+0000 7fc1d51ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0199420 con 0x7fc1d0106650 2023-10-08T12:38:44.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1ced9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1d0100640 0x7fc1d019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:44.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1ced9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1d0100640 0x7fc1d019e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48778/0 (socket says 172.21.15.59:48778) 2023-10-08T12:38:44.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1ced9d700 1 -- 172.21.15.59:0/3718541628 learned_addr learned my addr 172.21.15.59:0/3718541628 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:44.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1ce59c700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1d0101000 0x7fc1d019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:44.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1cf59e700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d0106650 0x7fc1d0198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:44.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1ced9d700 1 -- 172.21.15.59:0/3718541628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d0106650 msgr2=0x7fc1d0198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:44.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1ced9d700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d0106650 0x7fc1d0198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:44.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1ced9d700 1 -- 172.21.15.59:0/3718541628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1d0101000 msgr2=0x7fc1d019eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:44.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1ced9d700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1d0101000 0x7fc1d019eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:44.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1ced9d700 1 -- 172.21.15.59:0/3718541628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c8009d00 con 0x7fc1d0100640 2023-10-08T12:38:44.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1ced9d700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1d0100640 0x7fc1d019e960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000e9a0 tx=0x7fc1c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:44.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.102+0000 7fc1b7fff700 1 -- 172.21.15.59:0/3718541628 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0009790 con 0x7fc1d0100640 2023-10-08T12:38:44.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.103+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3718541628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d0199700 con 0x7fc1d0100640 2023-10-08T12:38:44.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.103+0000 7fc1b7fff700 1 -- 172.21.15.59:0/3718541628 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1c0010430 con 0x7fc1d0100640 2023-10-08T12:38:44.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.103+0000 7fc1b7fff700 1 -- 172.21.15.59:0/3718541628 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0018680 con 0x7fc1d0100640 2023-10-08T12:38:44.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.103+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3718541628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d01a5950 con 0x7fc1d0100640 2023-10-08T12:38:44.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.104+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3718541628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d0101d80 con 0x7fc1d0100640 2023-10-08T12:38:44.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.106+0000 7fc1b7fff700 1 -- 172.21.15.59:0/3718541628 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc1c00105a0 con 0x7fc1d0100640 2023-10-08T12:38:44.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.107+0000 7fc1b7fff700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1b80a14d0 0x7fc1b80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:44.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.107+0000 7fc1b7fff700 1 -- 172.21.15.59:0/3718541628 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fc1c0014070 con 0x7fc1d0100640 2023-10-08T12:38:44.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.108+0000 7fc1ce59c700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1b80a14d0 0x7fc1b80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:44.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.108+0000 7fc1ce59c700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1b80a14d0 0x7fc1b80a3990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0199c50 tx=0x7fc1c4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:44.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.115+0000 7fc1b7fff700 1 -- 172.21.15.59:0/3718541628 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc1c0052100 con 0x7fc1d0100640 2023-10-08T12:38:44.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:43 smithi092 ceph-mon[134093]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:43 smithi173 ceph-mon[135182]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:44.264 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 12:38:43 smithi059 systemd[1]: Starting Ceph mds.j for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:38:44.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.394+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3718541628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1d0067450 con 0x7fc1d0100640 2023-10-08T12:38:44.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.395+0000 7fc1b7fff700 1 -- 172.21.15.59:0/3718541628 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7fc1d0067450 con 0x7fc1d0100640 2023-10-08T12:38:44.396 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:44.396 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T12:38:44.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.397+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3718541628 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1b80a14d0 msgr2=0x7fc1b80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:44.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.397+0000 7fc1d51ff700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1b80a14d0 0x7fc1b80a3990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0199c50 tx=0x7fc1c4009260 comp rx=0 tx=0).stop 2023-10-08T12:38:44.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.397+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3718541628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1d0100640 msgr2=0x7fc1d019e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.397+0000 7fc1d51ff700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1d0100640 0x7fc1d019e960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000e9a0 tx=0x7fc1c000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:38:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.397+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3718541628 shutdown_connections 2023-10-08T12:38:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.397+0000 7fc1d51ff700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1b80a14d0 0x7fc1b80a3990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.397+0000 7fc1d51ff700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d0106650 0x7fc1d0198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.397+0000 7fc1d51ff700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1d0100640 0x7fc1d019e960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.397+0000 7fc1d51ff700 1 --2- 172.21.15.59:0/3718541628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1d0101000 0x7fc1d019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.397+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3718541628 >> 172.21.15.59:0/3718541628 conn(0x7fc1d00fc170 msgr2=0x7fc1d010bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.397+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3718541628 shutdown_connections 2023-10-08T12:38:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:44.398+0000 7fc1d51ff700 1 -- 172.21.15.59:0/3718541628 wait complete. 2023-10-08T12:38:44.400 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 3 2023-10-08T12:38:44.724 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 12:38:44 smithi059 podman[154351]: 2023-10-08T12:38:45.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:44 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3718541628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:45.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:44 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3718541628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:45.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:44 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3718541628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:45.265 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 12:38:44 smithi059 bash[154351]: b87d9941426be94717a3ffedd9f64b987cfae0431d0d89d2f7a9e4692d6eb37e 2023-10-08T12:38:45.265 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 12:38:44 smithi059 ceph-mds[154393]: -- 172.21.15.59:0/2187088672 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558c80f7b1e0 con 0x558c80f50800 2023-10-08T12:38:45.265 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 12:38:44 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-j[154369]: starting mds.j at 2023-10-08T12:38:45.265 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 12:38:44 smithi059 systemd[1]: Started Ceph mds.j for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:38:46.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:45 smithi092 ceph-mon[134093]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:46.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:45 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.59:6834/353168083,v1:172.21.15.59:6835/353168083] up:boot 2023-10-08T12:38:46.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:45 smithi092 ceph-mon[134093]: fsmap 3 up:standby 2023-10-08T12:38:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T12:38:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:46.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:46.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:45 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:46.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:45 smithi092 ceph-mon[134093]: Deploying daemon mds.d on smithi059 2023-10-08T12:38:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:45 smithi173 ceph-mon[135182]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:45 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.59:6834/353168083,v1:172.21.15.59:6835/353168083] up:boot 2023-10-08T12:38:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:45 smithi173 ceph-mon[135182]: fsmap 3 up:standby 2023-10-08T12:38:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T12:38:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:46.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:45 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:46.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:45 smithi173 ceph-mon[135182]: Deploying daemon mds.d on smithi059 2023-10-08T12:38:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:45 smithi059 ceph-mon[98489]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:45 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.59:6834/353168083,v1:172.21.15.59:6835/353168083] up:boot 2023-10-08T12:38:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:45 smithi059 ceph-mon[98489]: fsmap 3 up:standby 2023-10-08T12:38:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T12:38:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:45 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:45 smithi059 ceph-mon[98489]: Deploying daemon mds.d on smithi059 2023-10-08T12:38:46.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:38:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.631+0000 7f315f7ff700 1 -- 172.21.15.59:0/1257213086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3158100ff0 msgr2=0x7f315810d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.631+0000 7f315f7ff700 1 --2- 172.21.15.59:0/1257213086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3158100ff0 0x7f315810d500 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f315000b0a0 tx=0x7f315000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:38:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.631+0000 7f315f7ff700 1 -- 172.21.15.59:0/1257213086 shutdown_connections 2023-10-08T12:38:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.631+0000 7f315f7ff700 1 --2- 172.21.15.59:0/1257213086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3158106640 0x7f3158106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.631+0000 7f315f7ff700 1 --2- 172.21.15.59:0/1257213086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3158100ff0 0x7f315810d500 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.631+0000 7f315f7ff700 1 --2- 172.21.15.59:0/1257213086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3158100630 0x7f3158100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.631+0000 7f315f7ff700 1 -- 172.21.15.59:0/1257213086 >> 172.21.15.59:0/1257213086 conn(0x7f31580fc140 msgr2=0x7f31580fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.631+0000 7f315f7ff700 1 -- 172.21.15.59:0/1257213086 shutdown_connections 2023-10-08T12:38:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.631+0000 7f315f7ff700 1 -- 172.21.15.59:0/1257213086 wait complete. 2023-10-08T12:38:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.632+0000 7f315f7ff700 1 Processor -- start 2023-10-08T12:38:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.632+0000 7f315f7ff700 1 -- start start 2023-10-08T12:38:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.632+0000 7f315f7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3158100630 0x7f315819c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.632+0000 7f315f7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3158100ff0 0x7f315819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.632+0000 7f315f7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3158106640 0x7f3158196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315f7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3158196f70 con 0x7f3158100ff0 2023-10-08T12:38:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315f7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31581970e0 con 0x7f3158106640 2023-10-08T12:38:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315f7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31581972a0 con 0x7f3158100630 2023-10-08T12:38:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315cd9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3158100ff0 0x7f315819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315cd9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3158100ff0 0x7f315819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48814/0 (socket says 172.21.15.59:48814) 2023-10-08T12:38:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315cd9a700 1 -- 172.21.15.59:0/2917976728 learned_addr learned my addr 172.21.15.59:0/2917976728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315dd9c700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3158106640 0x7f3158196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315d59b700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3158100630 0x7f315819c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315cd9a700 1 -- 172.21.15.59:0/2917976728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3158100630 msgr2=0x7f315819c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315cd9a700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3158100630 0x7f315819c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315cd9a700 1 -- 172.21.15.59:0/2917976728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3158106640 msgr2=0x7f3158196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315cd9a700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3158106640 0x7f3158196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315cd9a700 1 -- 172.21.15.59:0/2917976728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150009d00 con 0x7f3158100ff0 2023-10-08T12:38:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.633+0000 7f315dd9c700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3158106640 0x7f3158196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.634+0000 7f315cd9a700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3158100ff0 0x7f315819ccd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f314800e9a0 tx=0x7f314800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.634+0000 7f314e7fc700 1 -- 172.21.15.59:0/2917976728 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148009790 con 0x7f3158100ff0 2023-10-08T12:38:46.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.634+0000 7f315f7ff700 1 -- 172.21.15.59:0/2917976728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3158197580 con 0x7f3158100ff0 2023-10-08T12:38:46.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.634+0000 7f314e7fc700 1 -- 172.21.15.59:0/2917976728 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3148010430 con 0x7f3158100ff0 2023-10-08T12:38:46.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.634+0000 7f314e7fc700 1 -- 172.21.15.59:0/2917976728 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148018680 con 0x7f3158100ff0 2023-10-08T12:38:46.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.634+0000 7f315f7ff700 1 -- 172.21.15.59:0/2917976728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31581a3780 con 0x7f3158100ff0 2023-10-08T12:38:46.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.635+0000 7f315f7ff700 1 -- 172.21.15.59:0/2917976728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3158108c50 con 0x7f3158100ff0 2023-10-08T12:38:46.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.637+0000 7f314e7fc700 1 -- 172.21.15.59:0/2917976728 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f31480105a0 con 0x7f3158100ff0 2023-10-08T12:38:46.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.640+0000 7f314e7fc700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31440a14d0 0x7f31440a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:46.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.640+0000 7f314e7fc700 1 -- 172.21.15.59:0/2917976728 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f3148014070 con 0x7f3158100ff0 2023-10-08T12:38:46.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.640+0000 7f315d59b700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31440a14d0 0x7f31440a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:46.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.640+0000 7f315d59b700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31440a14d0 0x7f31440a3990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3154009be0 tx=0x7f3154009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:46.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.642+0000 7f314e7fc700 1 -- 172.21.15.59:0/2917976728 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3148096760 con 0x7f3158100ff0 2023-10-08T12:38:46.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.919+0000 7f315f7ff700 1 -- 172.21.15.59:0/2917976728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3158101d70 con 0x7f3158100ff0 2023-10-08T12:38:46.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.920+0000 7f314e7fc700 1 -- 172.21.15.59:0/2917976728 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2907 (secure 0 0 0) 0x7f3148026b70 con 0x7f3158100ff0 2023-10-08T12:38:46.921 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:46.921 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2023-10-08T12:38:46.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.922+0000 7f315f7ff700 1 -- 172.21.15.59:0/2917976728 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31440a14d0 msgr2=0x7f31440a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:46.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.922+0000 7f315f7ff700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31440a14d0 0x7f31440a3990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3154009be0 tx=0x7f3154009260 comp rx=0 tx=0).stop 2023-10-08T12:38:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.922+0000 7f315f7ff700 1 -- 172.21.15.59:0/2917976728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3158100ff0 msgr2=0x7f315819ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.922+0000 7f315f7ff700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3158100ff0 0x7f315819ccd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f314800e9a0 tx=0x7f314800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:38:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.922+0000 7f315f7ff700 1 -- 172.21.15.59:0/2917976728 shutdown_connections 2023-10-08T12:38:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.922+0000 7f315f7ff700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f31440a14d0 0x7f31440a3990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.922+0000 7f315f7ff700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3158106640 0x7f3158196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.922+0000 7f315f7ff700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3158100630 0x7f315819c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.922+0000 7f315f7ff700 1 --2- 172.21.15.59:0/2917976728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3158100ff0 0x7f315819ccd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.922+0000 7f315f7ff700 1 -- 172.21.15.59:0/2917976728 >> 172.21.15.59:0/2917976728 conn(0x7f31580fc140 msgr2=0x7f31580fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.923+0000 7f315f7ff700 1 -- 172.21.15.59:0/2917976728 shutdown_connections 2023-10-08T12:38:46.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:46.923+0000 7f315f7ff700 1 -- 172.21.15.59:0/2917976728 wait complete. 2023-10-08T12:38:46.925 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 4 2023-10-08T12:38:47.765 INFO:journalctl@ceph.mds.d.smithi059.stdout:Oct 08 12:38:47 smithi059 systemd[1]: Starting Ceph mds.d for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:38:48.064 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:47 smithi059 ceph-mon[98489]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:48.065 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:47 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2917976728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:48.065 INFO:journalctl@ceph.mds.d.smithi059.stdout:Oct 08 12:38:47 smithi059 podman[154737]: 2023-10-08T12:38:48.065 INFO:journalctl@ceph.mds.d.smithi059.stdout:Oct 08 12:38:48 smithi059 bash[154737]: 9d55d253066187a01b3b27a8c1482d6b1ea10213c5741b08000858ab0e5e5c10 2023-10-08T12:38:48.065 INFO:journalctl@ceph.mds.d.smithi059.stdout:Oct 08 12:38:48 smithi059 ceph-mds[154777]: -- 172.21.15.59:0/4200385049 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558a6a0911e0 con 0x558a6a067000 2023-10-08T12:38:48.065 INFO:journalctl@ceph.mds.d.smithi059.stdout:Oct 08 12:38:48 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-d[154753]: starting mds.d at 2023-10-08T12:38:48.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:47 smithi092 ceph-mon[134093]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:48.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:47 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2917976728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:47 smithi173 ceph-mon[135182]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:47 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2917976728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:48.514 INFO:journalctl@ceph.mds.d.smithi059.stdout:Oct 08 12:38:48 smithi059 systemd[1]: Started Ceph mds.d for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:38:48.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:38:49.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.155+0000 7fc19d1ff700 1 -- 172.21.15.59:0/1105274969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc198100630 msgr2=0x7fc198100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:49.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.155+0000 7fc19d1ff700 1 --2- 172.21.15.59:0/1105274969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc198100630 0x7fc198100ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc1800098f0 tx=0x7fc180009c00 comp rx=0 tx=0).stop 2023-10-08T12:38:49.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.155+0000 7fc19d1ff700 1 -- 172.21.15.59:0/1105274969 shutdown_connections 2023-10-08T12:38:49.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.155+0000 7fc19d1ff700 1 --2- 172.21.15.59:0/1105274969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc198100ff0 0x7fc19810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:49.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.155+0000 7fc19d1ff700 1 --2- 172.21.15.59:0/1105274969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc198106640 0x7fc198106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:49.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.155+0000 7fc19d1ff700 1 --2- 172.21.15.59:0/1105274969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc198100630 0x7fc198100ab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:49.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.155+0000 7fc19d1ff700 1 -- 172.21.15.59:0/1105274969 >> 172.21.15.59:0/1105274969 conn(0x7fc1980fc140 msgr2=0x7fc1980fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:49.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.155+0000 7fc19d1ff700 1 -- 172.21.15.59:0/1105274969 shutdown_connections 2023-10-08T12:38:49.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.155+0000 7fc19d1ff700 1 -- 172.21.15.59:0/1105274969 wait complete. 2023-10-08T12:38:49.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.157+0000 7fc19d1ff700 1 Processor -- start 2023-10-08T12:38:49.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.157+0000 7fc19d1ff700 1 -- start start 2023-10-08T12:38:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc19d1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc198100630 0x7fc19819ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc19d1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc198100ff0 0x7fc19819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc19d1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc198106640 0x7fc198198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc19d1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc198199200 con 0x7fc198100ff0 2023-10-08T12:38:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc19d1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc198199370 con 0x7fc198106640 2023-10-08T12:38:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc19d1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc198199530 con 0x7fc198100630 2023-10-08T12:38:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc18ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc198100ff0 0x7fc19819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc18ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc198100ff0 0x7fc19819efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48848/0 (socket says 172.21.15.59:48848) 2023-10-08T12:38:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc18ffff700 1 -- 172.21.15.59:0/3717875157 learned_addr learned my addr 172.21.15.59:0/3717875157 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc19759e700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc198106640 0x7fc198198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc196d9d700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc198100630 0x7fc19819ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc18ffff700 1 -- 172.21.15.59:0/3717875157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc198100630 msgr2=0x7fc19819ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc18ffff700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc198100630 0x7fc19819ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc18ffff700 1 -- 172.21.15.59:0/3717875157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc198106640 msgr2=0x7fc198198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc18ffff700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc198106640 0x7fc198198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.158+0000 7fc18ffff700 1 -- 172.21.15.59:0/3717875157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180009520 con 0x7fc198100ff0 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.159+0000 7fc18ffff700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc198100ff0 0x7fc19819efb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc180005950 tx=0x7fc18000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.159+0000 7fc194d99700 1 -- 172.21.15.59:0/3717875157 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18001c070 con 0x7fc198100ff0 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.159+0000 7fc194d99700 1 -- 172.21.15.59:0/3717875157 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc18000bbd0 con 0x7fc198100ff0 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.159+0000 7fc19d1ff700 1 -- 172.21.15.59:0/3717875157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1981997b0 con 0x7fc198100ff0 2023-10-08T12:38:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.159+0000 7fc194d99700 1 -- 172.21.15.59:0/3717875157 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc180003970 con 0x7fc198100ff0 2023-10-08T12:38:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.159+0000 7fc19d1ff700 1 -- 172.21.15.59:0/3717875157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1981a5a60 con 0x7fc198100ff0 2023-10-08T12:38:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.160+0000 7fc19d1ff700 1 -- 172.21.15.59:0/3717875157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc198101d70 con 0x7fc198100ff0 2023-10-08T12:38:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.162+0000 7fc194d99700 1 -- 172.21.15.59:0/3717875157 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc180020030 con 0x7fc198100ff0 2023-10-08T12:38:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.163+0000 7fc194d99700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1840a1550 0x7fc1840a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.164+0000 7fc194d99700 1 -- 172.21.15.59:0/3717875157 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fc1800cd760 con 0x7fc198100ff0 2023-10-08T12:38:49.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.164+0000 7fc196d9d700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1840a1550 0x7fc1840a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:49.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.164+0000 7fc196d9d700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1840a1550 0x7fc1840a3a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc188005fd0 tx=0x7fc188009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.167+0000 7fc194d99700 1 -- 172.21.15.59:0/3717875157 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc180097180 con 0x7fc198100ff0 2023-10-08T12:38:49.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:49.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:49.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:49.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:49.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:49.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:49.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:49 smithi059 ceph-mon[98489]: Deploying daemon mds.e on smithi092 2023-10-08T12:38:49.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:49 smithi059 ceph-mon[98489]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:49.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:49 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.59:6836/1582249232,v1:172.21.15.59:6837/1582249232] up:boot 2023-10-08T12:38:49.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:49 smithi059 ceph-mon[98489]: fsmap 4 up:standby 2023-10-08T12:38:49.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T12:38:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:49 smithi092 ceph-mon[134093]: Deploying daemon mds.e on smithi092 2023-10-08T12:38:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:49 smithi092 ceph-mon[134093]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:49 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.59:6836/1582249232,v1:172.21.15.59:6837/1582249232] up:boot 2023-10-08T12:38:49.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:49 smithi092 ceph-mon[134093]: fsmap 4 up:standby 2023-10-08T12:38:49.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T12:38:49.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.424+0000 7fc19d1ff700 1 -- 172.21.15.59:0/3717875157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc198067450 con 0x7fc198100ff0 2023-10-08T12:38:49.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.424+0000 7fc194d99700 1 -- 172.21.15.59:0/3717875157 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3698 (secure 0 0 0) 0x7fc18009a7a0 con 0x7fc198100ff0 2023-10-08T12:38:49.426 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:49.426 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2023-10-08T12:38:49.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 -- 172.21.15.59:0/3717875157 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1840a1550 msgr2=0x7fc1840a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:49.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1840a1550 0x7fc1840a3a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc188005fd0 tx=0x7fc188009310 comp rx=0 tx=0).stop 2023-10-08T12:38:49.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 -- 172.21.15.59:0/3717875157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc198100ff0 msgr2=0x7fc19819efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:49.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc198100ff0 0x7fc19819efb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc180005950 tx=0x7fc18000fa00 comp rx=0 tx=0).stop 2023-10-08T12:38:49.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 -- 172.21.15.59:0/3717875157 shutdown_connections 2023-10-08T12:38:49.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1840a1550 0x7fc1840a3a10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:49.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc198106640 0x7fc198198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:49.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc198100630 0x7fc19819ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:49.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 --2- 172.21.15.59:0/3717875157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc198100ff0 0x7fc19819efb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:49.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 -- 172.21.15.59:0/3717875157 >> 172.21.15.59:0/3717875157 conn(0x7fc1980fc140 msgr2=0x7fc19810be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:49.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 -- 172.21.15.59:0/3717875157 shutdown_connections 2023-10-08T12:38:49.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:49.427+0000 7fc19d1ff700 1 -- 172.21.15.59:0/3717875157 wait complete. 2023-10-08T12:38:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 5 2023-10-08T12:38:49.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:49.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:49 smithi173 ceph-mon[135182]: Deploying daemon mds.e on smithi092 2023-10-08T12:38:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:49 smithi173 ceph-mon[135182]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:49 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.59:6836/1582249232,v1:172.21.15.59:6837/1582249232] up:boot 2023-10-08T12:38:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:49 smithi173 ceph-mon[135182]: fsmap 4 up:standby 2023-10-08T12:38:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T12:38:49.877 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 08 12:38:49 smithi092 systemd[1]: Starting Ceph mds.e for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:38:50.344 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:50 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3717875157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:50.344 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 08 12:38:50 smithi092 podman[172883]: 2023-10-08T12:38:50.344 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 08 12:38:50 smithi092 bash[172883]: 5675e54d9b90606df01ace4e71509b48e64ba453aad38a97986f44d2a5a0e543 2023-10-08T12:38:50.344 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 08 12:38:50 smithi092 ceph-mds[172923]: -- 172.21.15.92:0/1634808109 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55639dcd11e0 con 0x55639dca6800 2023-10-08T12:38:50.344 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 08 12:38:50 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-e[172899]: starting mds.e at 2023-10-08T12:38:50.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:50 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3717875157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:50.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:50 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3717875157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:50.627 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 08 12:38:50 smithi092 systemd[1]: Started Ceph mds.e for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:38:51.447 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:38:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.662+0000 7facf19ff700 1 -- 172.21.15.59:0/576618947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec100630 msgr2=0x7facec100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.662+0000 7facf19ff700 1 --2- 172.21.15.59:0/576618947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec100630 0x7facec100ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7face0009990 tx=0x7face0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.662+0000 7facf19ff700 1 -- 172.21.15.59:0/576618947 shutdown_connections 2023-10-08T12:38:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.662+0000 7facf19ff700 1 --2- 172.21.15.59:0/576618947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facec100ff0 0x7facec10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.662+0000 7facf19ff700 1 --2- 172.21.15.59:0/576618947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facec106640 0x7facec106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.662+0000 7facf19ff700 1 --2- 172.21.15.59:0/576618947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec100630 0x7facec100ab0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.662+0000 7facf19ff700 1 -- 172.21.15.59:0/576618947 >> 172.21.15.59:0/576618947 conn(0x7facec0fc1a0 msgr2=0x7facec0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.662+0000 7facf19ff700 1 -- 172.21.15.59:0/576618947 shutdown_connections 2023-10-08T12:38:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.662+0000 7facf19ff700 1 -- 172.21.15.59:0/576618947 wait complete. 2023-10-08T12:38:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.663+0000 7facf19ff700 1 Processor -- start 2023-10-08T12:38:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.663+0000 7facf19ff700 1 -- start start 2023-10-08T12:38:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.663+0000 7facf19ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec100630 0x7facec19c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.663+0000 7facf19ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facec100ff0 0x7facec19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.663+0000 7facf19ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facec106640 0x7facec196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7facf19ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec196f90 con 0x7facec100630 2023-10-08T12:38:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7facf19ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec197100 con 0x7facec106640 2023-10-08T12:38:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7facf19ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec1972c0 con 0x7facec100ff0 2023-10-08T12:38:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7faceaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec100630 0x7facec19c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7faceaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec100630 0x7facec19c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54056/0 (socket says 172.21.15.59:54056) 2023-10-08T12:38:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7faceaffd700 1 -- 172.21.15.59:0/1402782013 learned_addr learned my addr 172.21.15.59:0/1402782013 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7facea7fc700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facec100ff0 0x7facec19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7faceb7fe700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facec106640 0x7facec196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7faceaffd700 1 -- 172.21.15.59:0/1402782013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facec100ff0 msgr2=0x7facec19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7faceaffd700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facec100ff0 0x7facec19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7faceaffd700 1 -- 172.21.15.59:0/1402782013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facec106640 msgr2=0x7facec196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7faceaffd700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facec106640 0x7facec196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7faceaffd700 1 -- 172.21.15.59:0/1402782013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc009520 con 0x7facec100630 2023-10-08T12:38:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7faceaffd700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec100630 0x7facec19c800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7facdc00eb30 tx=0x7facdc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.664+0000 7facf09fd700 1 -- 172.21.15.59:0/1402782013 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc009880 con 0x7facec100630 2023-10-08T12:38:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.665+0000 7facf19ff700 1 -- 172.21.15.59:0/1402782013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face00095f0 con 0x7facec100630 2023-10-08T12:38:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.665+0000 7facf09fd700 1 -- 172.21.15.59:0/1402782013 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facdc0044e0 con 0x7facec100630 2023-10-08T12:38:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.665+0000 7facf09fd700 1 -- 172.21.15.59:0/1402782013 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc003e90 con 0x7facec100630 2023-10-08T12:38:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.665+0000 7facf19ff700 1 -- 172.21.15.59:0/1402782013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facec1a3610 con 0x7facec100630 2023-10-08T12:38:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.666+0000 7facf19ff700 1 -- 172.21.15.59:0/1402782013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec108c50 con 0x7facec100630 2023-10-08T12:38:51.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.668+0000 7facf09fd700 1 -- 172.21.15.59:0/1402782013 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7facdc004000 con 0x7facec100630 2023-10-08T12:38:51.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.669+0000 7facf09fd700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7facd40a14d0 0x7facd40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:51.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.669+0000 7facf09fd700 1 -- 172.21.15.59:0/1402782013 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7facdc014070 con 0x7facec100630 2023-10-08T12:38:51.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.669+0000 7facea7fc700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7facd40a14d0 0x7facd40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:51.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.670+0000 7facea7fc700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7facd40a14d0 0x7facd40a3990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7facec197af0 tx=0x7face000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.673+0000 7facf09fd700 1 -- 172.21.15.59:0/1402782013 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7facdc096800 con 0x7facec100630 2023-10-08T12:38:51.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:51 smithi173 ceph-mon[135182]: Deploying daemon mds.f on smithi173 2023-10-08T12:38:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:51 smithi173 ceph-mon[135182]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:51 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.92:6834/798745329,v1:172.21.15.92:6835/798745329] up:boot 2023-10-08T12:38:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:51 smithi173 ceph-mon[135182]: fsmap 5 up:standby 2023-10-08T12:38:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:51 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T12:38:51.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:51.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:51.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:51.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:51.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:51.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:51.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:51 smithi059 ceph-mon[98489]: Deploying daemon mds.f on smithi173 2023-10-08T12:38:51.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:51 smithi059 ceph-mon[98489]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:51.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:51 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.92:6834/798745329,v1:172.21.15.92:6835/798745329] up:boot 2023-10-08T12:38:51.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:51 smithi059 ceph-mon[98489]: fsmap 5 up:standby 2023-10-08T12:38:51.766 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:51 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T12:38:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:51 smithi092 ceph-mon[134093]: Deploying daemon mds.f on smithi173 2023-10-08T12:38:51.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:51 smithi092 ceph-mon[134093]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:51.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:51 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.92:6834/798745329,v1:172.21.15.92:6835/798745329] up:boot 2023-10-08T12:38:51.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:51 smithi092 ceph-mon[134093]: fsmap 5 up:standby 2023-10-08T12:38:51.878 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:51 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T12:38:51.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.930+0000 7facf19ff700 1 -- 172.21.15.59:0/1402782013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facec101d70 con 0x7facec100630 2023-10-08T12:38:51.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.931+0000 7facf09fd700 1 -- 172.21.15.59:0/1402782013 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7facdc099e20 con 0x7facec100630 2023-10-08T12:38:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:51.932 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-08T12:38:51.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.933+0000 7facf19ff700 1 -- 172.21.15.59:0/1402782013 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7facd40a14d0 msgr2=0x7facd40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.933+0000 7facf19ff700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7facd40a14d0 0x7facd40a3990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7facec197af0 tx=0x7face000b260 comp rx=0 tx=0).stop 2023-10-08T12:38:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.933+0000 7facf19ff700 1 -- 172.21.15.59:0/1402782013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec100630 msgr2=0x7facec19c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.933+0000 7facf19ff700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec100630 0x7facec19c800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7facdc00eb30 tx=0x7facdc00ee40 comp rx=0 tx=0).stop 2023-10-08T12:38:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.934+0000 7facf19ff700 1 -- 172.21.15.59:0/1402782013 shutdown_connections 2023-10-08T12:38:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.934+0000 7facf19ff700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7facd40a14d0 0x7facd40a3990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.934+0000 7facf19ff700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facec106640 0x7facec196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.934+0000 7facf19ff700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec100630 0x7facec19c800 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.934+0000 7facf19ff700 1 --2- 172.21.15.59:0/1402782013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facec100ff0 0x7facec19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.934+0000 7facf19ff700 1 -- 172.21.15.59:0/1402782013 >> 172.21.15.59:0/1402782013 conn(0x7facec0fc1a0 msgr2=0x7facec0fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.934+0000 7facf19ff700 1 -- 172.21.15.59:0/1402782013 shutdown_connections 2023-10-08T12:38:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:51.934+0000 7facf19ff700 1 -- 172.21.15.59:0/1402782013 wait complete. 2023-10-08T12:38:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-10-08T12:38:52.218 INFO:journalctl@ceph.mds.f.smithi173.stdout:Oct 08 12:38:51 smithi173 systemd[1]: Starting Ceph mds.f for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:38:52.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:52 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1402782013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:52.547 INFO:journalctl@ceph.mds.f.smithi173.stdout:Oct 08 12:38:52 smithi173 podman[172781]: 2023-10-08T12:38:52.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:52 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1402782013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:52.877 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:52 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1402782013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:52.968 INFO:journalctl@ceph.mds.f.smithi173.stdout:Oct 08 12:38:52 smithi173 ceph-mds[172821]: -- 172.21.15.173:0/4136585243 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562bd3b431e0 con 0x562bd3b18800 2023-10-08T12:38:52.968 INFO:journalctl@ceph.mds.f.smithi173.stdout:Oct 08 12:38:52 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-f[172797]: starting mds.f at 2023-10-08T12:38:52.968 INFO:journalctl@ceph.mds.f.smithi173.stdout:Oct 08 12:38:52 smithi173 bash[172781]: 66eaf123a46d5c66a329f9cb65e7a1ae007f31f2e5b24d7d25a439ed5a7768f2 2023-10-08T12:38:52.968 INFO:journalctl@ceph.mds.f.smithi173.stdout:Oct 08 12:38:52 smithi173 systemd[1]: Started Ceph mds.f for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:38:53.892 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:53.892 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:53.892 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:53.892 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:53.893 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:53.893 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:53.893 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:53 smithi173 ceph-mon[135182]: Deploying daemon mds.c on smithi173 2023-10-08T12:38:53.893 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:53 smithi173 ceph-mon[135182]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:53.893 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:53 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.173:6834/1081657553,v1:172.21.15.173:6835/1081657553] up:boot 2023-10-08T12:38:53.893 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:53 smithi173 ceph-mon[135182]: fsmap 6 up:standby 2023-10-08T12:38:53.893 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T12:38:53.955 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:38:54.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:54.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:54.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:54.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:54.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:54.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:54.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:53 smithi059 ceph-mon[98489]: Deploying daemon mds.c on smithi173 2023-10-08T12:38:54.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:53 smithi059 ceph-mon[98489]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:54.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:53 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.173:6834/1081657553,v1:172.21.15.173:6835/1081657553] up:boot 2023-10-08T12:38:54.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:53 smithi059 ceph-mon[98489]: fsmap 6 up:standby 2023-10-08T12:38:54.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T12:38:54.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:54.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:54.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:54.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:54.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:54.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:54.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:53 smithi092 ceph-mon[134093]: Deploying daemon mds.c on smithi173 2023-10-08T12:38:54.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:53 smithi092 ceph-mon[134093]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:54.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:53 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.173:6834/1081657553,v1:172.21.15.173:6835/1081657553] up:boot 2023-10-08T12:38:54.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:53 smithi092 ceph-mon[134093]: fsmap 6 up:standby 2023-10-08T12:38:54.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T12:38:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.168+0000 7f3a727ff700 1 -- 172.21.15.59:0/3055301279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c072c20 msgr2=0x7f3a6c073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.168+0000 7f3a727ff700 1 --2- 172.21.15.59:0/3055301279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c072c20 0x7f3a6c073000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009990 tx=0x7f3a5c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.168+0000 7f3a727ff700 1 -- 172.21.15.59:0/3055301279 shutdown_connections 2023-10-08T12:38:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.168+0000 7f3a727ff700 1 --2- 172.21.15.59:0/3055301279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a6c10ce70 0x7f3a6c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.168+0000 7f3a727ff700 1 --2- 172.21.15.59:0/3055301279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c072c20 0x7f3a6c073000 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.168+0000 7f3a727ff700 1 --2- 172.21.15.59:0/3055301279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6c073540 0x7f3a6c10c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.168+0000 7f3a727ff700 1 -- 172.21.15.59:0/3055301279 >> 172.21.15.59:0/3055301279 conn(0x7f3a6c0fc140 msgr2=0x7f3a6c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.168+0000 7f3a727ff700 1 -- 172.21.15.59:0/3055301279 shutdown_connections 2023-10-08T12:38:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.168+0000 7f3a727ff700 1 -- 172.21.15.59:0/3055301279 wait complete. 2023-10-08T12:38:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.169+0000 7f3a727ff700 1 Processor -- start 2023-10-08T12:38:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.170+0000 7f3a727ff700 1 -- start start 2023-10-08T12:38:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.170+0000 7f3a727ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c072c20 0x7f3a6c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.170+0000 7f3a727ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a6c073540 0x7f3a6c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.170+0000 7f3a727ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6c10ce70 0x7f3a6c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.170+0000 7f3a727ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c19dcb0 con 0x7f3a6c10ce70 2023-10-08T12:38:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.170+0000 7f3a727ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c19de20 con 0x7f3a6c073540 2023-10-08T12:38:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.170+0000 7f3a727ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c19dfe0 con 0x7f3a6c072c20 2023-10-08T12:38:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a6bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c072c20 0x7f3a6c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a6bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c072c20 0x7f3a6c198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:39036/0 (socket says 172.21.15.59:39036) 2023-10-08T12:38:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a6bfff700 1 -- 172.21.15.59:0/2265329262 learned_addr learned my addr 172.21.15.59:0/2265329262 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a70d9c700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6c10ce70 0x7f3a6c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a6b7fe700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a6c073540 0x7f3a6c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a6bfff700 1 -- 172.21.15.59:0/2265329262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a6c073540 msgr2=0x7f3a6c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a6bfff700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a6c073540 0x7f3a6c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a6bfff700 1 -- 172.21.15.59:0/2265329262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6c10ce70 msgr2=0x7f3a6c19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a6bfff700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6c10ce70 0x7f3a6c19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a6bfff700 1 -- 172.21.15.59:0/2265329262 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a60009520 con 0x7f3a6c072c20 2023-10-08T12:38:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a6b7fe700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a6c073540 0x7f3a6c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.171+0000 7f3a6bfff700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c072c20 0x7f3a6c198d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c005910 tx=0x7f3a5c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.172+0000 7f3a697fa700 1 -- 172.21.15.59:0/2265329262 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c01d070 con 0x7f3a6c072c20 2023-10-08T12:38:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.172+0000 7f3a697fa700 1 -- 172.21.15.59:0/2265329262 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a5c022470 con 0x7f3a6c072c20 2023-10-08T12:38:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.172+0000 7f3a727ff700 1 -- 172.21.15.59:0/2265329262 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c0095f0 con 0x7f3a6c072c20 2023-10-08T12:38:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.172+0000 7f3a697fa700 1 -- 172.21.15.59:0/2265329262 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c017650 con 0x7f3a6c072c20 2023-10-08T12:38:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.172+0000 7f3a727ff700 1 -- 172.21.15.59:0/2265329262 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c1a5920 con 0x7f3a6c072c20 2023-10-08T12:38:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.173+0000 7f3a727ff700 1 -- 172.21.15.59:0/2265329262 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c108080 con 0x7f3a6c072c20 2023-10-08T12:38:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.175+0000 7f3a697fa700 1 -- 172.21.15.59:0/2265329262 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3a5c0225e0 con 0x7f3a6c072c20 2023-10-08T12:38:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.176+0000 7f3a697fa700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a540a14d0 0x7f3a540a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.176+0000 7f3a697fa700 1 -- 172.21.15.59:0/2265329262 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f3a5c0cdc10 con 0x7f3a6c072c20 2023-10-08T12:38:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.177+0000 7f3a6b7fe700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a540a14d0 0x7f3a540a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.177+0000 7f3a6b7fe700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a540a14d0 0x7f3a540a3990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009fd0 tx=0x7f3a60009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.179+0000 7f3a697fa700 1 -- 172.21.15.59:0/2265329262 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3a5c097630 con 0x7f3a6c072c20 2023-10-08T12:38:54.182 INFO:journalctl@ceph.mds.c.smithi173.stdout:Oct 08 12:38:54 smithi173 systemd[1]: Starting Ceph mds.c for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:38:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.436+0000 7f3a727ff700 1 -- 172.21.15.59:0/2265329262 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a6c0742d0 con 0x7f3a6c072c20 2023-10-08T12:38:54.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.437+0000 7f3a697fa700 1 -- 172.21.15.59:0/2265329262 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5280 (secure 0 0 0) 0x7f3a5c09ac50 con 0x7f3a6c072c20 2023-10-08T12:38:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:54.439 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-08T12:38:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 -- 172.21.15.59:0/2265329262 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a540a14d0 msgr2=0x7f3a540a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a540a14d0 0x7f3a540a3990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009fd0 tx=0x7f3a60009260 comp rx=0 tx=0).stop 2023-10-08T12:38:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 -- 172.21.15.59:0/2265329262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c072c20 msgr2=0x7f3a6c198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c072c20 0x7f3a6c198d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c005910 tx=0x7f3a5c004730 comp rx=0 tx=0).stop 2023-10-08T12:38:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 -- 172.21.15.59:0/2265329262 shutdown_connections 2023-10-08T12:38:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a540a14d0 0x7f3a540a3990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6c10ce70 0x7f3a6c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c072c20 0x7f3a6c198d90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 --2- 172.21.15.59:0/2265329262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a6c073540 0x7f3a6c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 -- 172.21.15.59:0/2265329262 >> 172.21.15.59:0/2265329262 conn(0x7f3a6c0fc140 msgr2=0x7f3a6c0fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 -- 172.21.15.59:0/2265329262 shutdown_connections 2023-10-08T12:38:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:54.440+0000 7f3a727ff700 1 -- 172.21.15.59:0/2265329262 wait complete. 2023-10-08T12:38:54.444 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2023-10-08T12:38:54.764 INFO:journalctl@ceph.mds.c.smithi173.stdout:Oct 08 12:38:54 smithi173 podman[173123]: 2023-10-08T12:38:54.765 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:54 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2265329262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:54.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:54 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2265329262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:55.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:54 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2265329262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:55.218 INFO:journalctl@ceph.mds.c.smithi173.stdout:Oct 08 12:38:54 smithi173 ceph-mds[173163]: -- 172.21.15.173:0/4206301928 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5655369451e0 con 0x56553691a800 2023-10-08T12:38:55.218 INFO:journalctl@ceph.mds.c.smithi173.stdout:Oct 08 12:38:54 smithi173 bash[173123]: e26c4b22b8ba160b8224cea768c46443b97deb5b8b42605e1811e7cff52260f0 2023-10-08T12:38:55.218 INFO:journalctl@ceph.mds.c.smithi173.stdout:Oct 08 12:38:54 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-c[173139]: starting mds.c at 2023-10-08T12:38:55.218 INFO:journalctl@ceph.mds.c.smithi173.stdout:Oct 08 12:38:54 smithi173 systemd[1]: Started Ceph mds.c for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:38:56.113 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:55 smithi092 ceph-mon[134093]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:56.113 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:56.113 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:56.113 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:56.114 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:56.114 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:56.114 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:56.114 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:55 smithi092 ceph-mon[134093]: Deploying daemon mds.h on smithi092 2023-10-08T12:38:56.114 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:55 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.173:6836/1001466762,v1:172.21.15.173:6837/1001466762] up:boot 2023-10-08T12:38:56.114 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:55 smithi092 ceph-mon[134093]: fsmap 7 up:standby 2023-10-08T12:38:56.114 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T12:38:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:55 smithi173 ceph-mon[135182]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:55 smithi173 ceph-mon[135182]: Deploying daemon mds.h on smithi092 2023-10-08T12:38:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:55 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.173:6836/1001466762,v1:172.21.15.173:6837/1001466762] up:boot 2023-10-08T12:38:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:55 smithi173 ceph-mon[135182]: fsmap 7 up:standby 2023-10-08T12:38:56.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T12:38:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:55 smithi059 ceph-mon[98489]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:55 smithi059 ceph-mon[98489]: Deploying daemon mds.h on smithi092 2023-10-08T12:38:56.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:55 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.173:6836/1001466762,v1:172.21.15.173:6837/1001466762] up:boot 2023-10-08T12:38:56.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:55 smithi059 ceph-mon[98489]: fsmap 7 up:standby 2023-10-08T12:38:56.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T12:38:56.377 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 08 12:38:56 smithi092 systemd[1]: Starting Ceph mds.h for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:38:56.461 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:38:56.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.675+0000 7fe641fff700 1 -- 172.21.15.59:0/3781707563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe63c072c20 msgr2=0x7fe63c073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:56.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.675+0000 7fe641fff700 1 --2- 172.21.15.59:0/3781707563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe63c072c20 0x7fe63c073000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009990 tx=0x7fe62c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.675+0000 7fe641fff700 1 -- 172.21.15.59:0/3781707563 shutdown_connections 2023-10-08T12:38:56.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.675+0000 7fe641fff700 1 --2- 172.21.15.59:0/3781707563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe63c10ce70 0x7fe63c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.675+0000 7fe641fff700 1 --2- 172.21.15.59:0/3781707563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe63c072c20 0x7fe63c073000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.675+0000 7fe641fff700 1 --2- 172.21.15.59:0/3781707563 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe63c073540 0x7fe63c10c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.675+0000 7fe641fff700 1 -- 172.21.15.59:0/3781707563 >> 172.21.15.59:0/3781707563 conn(0x7fe63c0fc1a0 msgr2=0x7fe63c0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:56.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.675+0000 7fe641fff700 1 -- 172.21.15.59:0/3781707563 shutdown_connections 2023-10-08T12:38:56.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.675+0000 7fe641fff700 1 -- 172.21.15.59:0/3781707563 wait complete. 2023-10-08T12:38:56.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.676+0000 7fe641fff700 1 Processor -- start 2023-10-08T12:38:56.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.676+0000 7fe641fff700 1 -- start start 2023-10-08T12:38:56.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe641fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe63c072c20 0x7fe63c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:56.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe641fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe63c073540 0x7fe63c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:56.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe641fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe63c10ce70 0x7fe63c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:56.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe641fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c19dc90 con 0x7fe63c073540 2023-10-08T12:38:56.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe641fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c19de00 con 0x7fe63c072c20 2023-10-08T12:38:56.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe641fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c19dfc0 con 0x7fe63c10ce70 2023-10-08T12:38:56.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe633fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe63c073540 0x7fe63c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:56.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe633fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe63c073540 0x7fe63c1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54094/0 (socket says 172.21.15.59:54094) 2023-10-08T12:38:56.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe63b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe63c072c20 0x7fe63c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:56.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe633fff700 1 -- 172.21.15.59:0/3362073832 learned_addr learned my addr 172.21.15.59:0/3362073832 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:56.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe63bfff700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe63c10ce70 0x7fe63c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:56.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe633fff700 1 -- 172.21.15.59:0/3362073832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe63c10ce70 msgr2=0x7fe63c19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:56.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe633fff700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe63c10ce70 0x7fe63c19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe633fff700 1 -- 172.21.15.59:0/3362073832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe63c072c20 msgr2=0x7fe63c198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:56.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe633fff700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe63c072c20 0x7fe63c198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.677+0000 7fe633fff700 1 -- 172.21.15.59:0/3362073832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c0095f0 con 0x7fe63c073540 2023-10-08T12:38:56.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.678+0000 7fe633fff700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe63c073540 0x7fe63c1992b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe62400e9a0 tx=0x7fe62400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:56.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.678+0000 7fe6397fa700 1 -- 172.21.15.59:0/3362073832 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624009790 con 0x7fe63c073540 2023-10-08T12:38:56.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.678+0000 7fe641fff700 1 -- 172.21.15.59:0/3362073832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c19e2a0 con 0x7fe63c073540 2023-10-08T12:38:56.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.678+0000 7fe6397fa700 1 -- 172.21.15.59:0/3362073832 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe624010430 con 0x7fe63c073540 2023-10-08T12:38:56.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.678+0000 7fe6397fa700 1 -- 172.21.15.59:0/3362073832 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624018680 con 0x7fe63c073540 2023-10-08T12:38:56.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.678+0000 7fe641fff700 1 -- 172.21.15.59:0/3362073832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c1a5ae0 con 0x7fe63c073540 2023-10-08T12:38:56.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.679+0000 7fe641fff700 1 -- 172.21.15.59:0/3362073832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c108080 con 0x7fe63c073540 2023-10-08T12:38:56.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.681+0000 7fe6397fa700 1 -- 172.21.15.59:0/3362073832 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe6240105a0 con 0x7fe63c073540 2023-10-08T12:38:56.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.682+0000 7fe6397fa700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6280a14d0 0x7fe6280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:56.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.683+0000 7fe6397fa700 1 -- 172.21.15.59:0/3362073832 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fe624014070 con 0x7fe63c073540 2023-10-08T12:38:56.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.683+0000 7fe63b7fe700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6280a14d0 0x7fe6280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:56.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.683+0000 7fe63b7fe700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6280a14d0 0x7fe6280a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00b2e0 tx=0x7fe62c005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:56.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.686+0000 7fe6397fa700 1 -- 172.21.15.59:0/3362073832 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe624052100 con 0x7fe63c073540 2023-10-08T12:38:56.821 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 08 12:38:56 smithi092 podman[173224]: 2023-10-08T12:38:56.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.958+0000 7fe641fff700 1 -- 172.21.15.59:0/3362073832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe63c0742d0 con 0x7fe63c073540 2023-10-08T12:38:56.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.958+0000 7fe6397fa700 1 -- 172.21.15.59:0/3362073832 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6074 (secure 0 0 0) 0x7fe624096560 con 0x7fe63c073540 2023-10-08T12:38:56.959 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:56.959 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-08T12:38:56.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.962+0000 7fe641fff700 1 -- 172.21.15.59:0/3362073832 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6280a14d0 msgr2=0x7fe6280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.962+0000 7fe641fff700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6280a14d0 0x7fe6280a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00b2e0 tx=0x7fe62c005fd0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.962+0000 7fe641fff700 1 -- 172.21.15.59:0/3362073832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe63c073540 msgr2=0x7fe63c1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.962+0000 7fe641fff700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe63c073540 0x7fe63c1992b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe62400e9a0 tx=0x7fe62400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.962+0000 7fe641fff700 1 -- 172.21.15.59:0/3362073832 shutdown_connections 2023-10-08T12:38:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.962+0000 7fe641fff700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6280a14d0 0x7fe6280a3990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.962+0000 7fe641fff700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe63c072c20 0x7fe63c198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.962+0000 7fe641fff700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe63c10ce70 0x7fe63c19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.963+0000 7fe641fff700 1 --2- 172.21.15.59:0/3362073832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe63c073540 0x7fe63c1992b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.963+0000 7fe641fff700 1 -- 172.21.15.59:0/3362073832 >> 172.21.15.59:0/3362073832 conn(0x7fe63c0fc1a0 msgr2=0x7fe63c0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.963+0000 7fe641fff700 1 -- 172.21.15.59:0/3362073832 shutdown_connections 2023-10-08T12:38:56.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:56.963+0000 7fe641fff700 1 -- 172.21.15.59:0/3362073832 wait complete. 2023-10-08T12:38:56.965 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-10-08T12:38:57.127 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 08 12:38:56 smithi092 ceph-mds[173264]: -- 172.21.15.92:0/1216100049 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5570d47a91e0 con 0x5570d477e800 2023-10-08T12:38:57.127 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 08 12:38:56 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-h[173240]: starting mds.h at 2023-10-08T12:38:57.127 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 08 12:38:56 smithi092 bash[173224]: 2b99b4dc099a689ec0f21b9ca9ceeed26dcfc0d584238c97294d50d37315b3e2 2023-10-08T12:38:57.127 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 08 12:38:56 smithi092 systemd[1]: Started Ceph mds.h for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:38:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: Deploying daemon mds.i on smithi173 2023-10-08T12:38:58.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3362073832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:58.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.92:6836/3270985909,v1:172.21.15.92:6837/3270985909] up:boot 2023-10-08T12:38:58.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: fsmap 8 up:standby 2023-10-08T12:38:58.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T12:38:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: Deploying daemon mds.i on smithi173 2023-10-08T12:38:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3362073832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:58.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.92:6836/3270985909,v1:172.21.15.92:6837/3270985909] up:boot 2023-10-08T12:38:58.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: fsmap 8 up:standby 2023-10-08T12:38:58.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T12:38:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:58.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: Deploying daemon mds.i on smithi173 2023-10-08T12:38:58.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3362073832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:58.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.92:6836/3270985909,v1:172.21.15.92:6837/3270985909] up:boot 2023-10-08T12:38:58.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: fsmap 8 up:standby 2023-10-08T12:38:58.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T12:38:58.718 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 12:38:58 smithi173 systemd[1]: Starting Ceph mds.i for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:38:58.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:38:59.105 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 12:38:58 smithi173 podman[173460]: 2023-10-08T12:38:59.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.198+0000 7f93c55ff700 1 -- 172.21.15.59:0/1703743909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c0100630 msgr2=0x7f93c0100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.198+0000 7f93c55ff700 1 --2- 172.21.15.59:0/1703743909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c0100630 0x7f93c0100ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009990 tx=0x7f93a8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.198+0000 7f93c55ff700 1 -- 172.21.15.59:0/1703743909 shutdown_connections 2023-10-08T12:38:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.198+0000 7f93c55ff700 1 --2- 172.21.15.59:0/1703743909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93c0106640 0x7f93c0106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.198+0000 7f93c55ff700 1 --2- 172.21.15.59:0/1703743909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93c0100ff0 0x7f93c010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.198+0000 7f93c55ff700 1 --2- 172.21.15.59:0/1703743909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c0100630 0x7f93c0100ab0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.198+0000 7f93c55ff700 1 -- 172.21.15.59:0/1703743909 >> 172.21.15.59:0/1703743909 conn(0x7f93c00fc1a0 msgr2=0x7f93c00fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.198+0000 7f93c55ff700 1 -- 172.21.15.59:0/1703743909 shutdown_connections 2023-10-08T12:38:59.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.198+0000 7f93c55ff700 1 -- 172.21.15.59:0/1703743909 wait complete. 2023-10-08T12:38:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.199+0000 7f93c55ff700 1 Processor -- start 2023-10-08T12:38:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93c55ff700 1 -- start start 2023-10-08T12:38:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93c55ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c0100630 0x7f93c019e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93c55ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93c0100ff0 0x7f93c019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93c55ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93c0106640 0x7f93c0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93c55ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0199160 con 0x7f93c0100630 2023-10-08T12:38:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93c55ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c01992d0 con 0x7f93c0106640 2023-10-08T12:38:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93c55ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0199490 con 0x7f93c0100ff0 2023-10-08T12:38:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93beffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c0100630 0x7f93c019e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93b7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93c0100ff0 0x7f93c019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93beffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c0100630 0x7f93c019e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54112/0 (socket says 172.21.15.59:54112) 2023-10-08T12:38:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93beffd700 1 -- 172.21.15.59:0/423051936 learned_addr learned my addr 172.21.15.59:0/423051936 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:38:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.200+0000 7f93bf7fe700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93c0106640 0x7f93c0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93beffd700 1 -- 172.21.15.59:0/423051936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93c0100ff0 msgr2=0x7f93c019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93beffd700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93c0100ff0 0x7f93c019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93beffd700 1 -- 172.21.15.59:0/423051936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93c0106640 msgr2=0x7f93c0198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93beffd700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93c0106640 0x7f93c0198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93beffd700 1 -- 172.21.15.59:0/423051936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80095f0 con 0x7f93c0100630 2023-10-08T12:38:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93b7fff700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93c0100ff0 0x7f93c019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93beffd700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c0100630 0x7f93c019e9d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f93b000e9a0 tx=0x7f93b000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93bcff9700 1 -- 172.21.15.59:0/423051936 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0009790 con 0x7f93c0100630 2023-10-08T12:38:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93bcff9700 1 -- 172.21.15.59:0/423051936 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93b000cbd0 con 0x7f93c0100630 2023-10-08T12:38:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93bcff9700 1 -- 172.21.15.59:0/423051936 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0018680 con 0x7f93c0100630 2023-10-08T12:38:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93c55ff700 1 -- 172.21.15.59:0/423051936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c0199770 con 0x7f93c0100630 2023-10-08T12:38:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.201+0000 7f93c55ff700 1 -- 172.21.15.59:0/423051936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c01a59c0 con 0x7f93c0100630 2023-10-08T12:38:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.202+0000 7f93c55ff700 1 -- 172.21.15.59:0/423051936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c0101d70 con 0x7f93c0100630 2023-10-08T12:38:59.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.204+0000 7f93bcff9700 1 -- 172.21.15.59:0/423051936 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f93b000cd40 con 0x7f93c0100630 2023-10-08T12:38:59.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.205+0000 7f93bcff9700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f93ac0a1550 0x7f93ac0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:59.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.206+0000 7f93bcff9700 1 -- 172.21.15.59:0/423051936 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f93b0014070 con 0x7f93c0100630 2023-10-08T12:38:59.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.206+0000 7f93b7fff700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f93ac0a1550 0x7f93ac0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:59.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.206+0000 7f93b7fff700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f93ac0a1550 0x7f93ac0a3a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f93c0199cc0 tx=0x7f93a800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:59.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.210+0000 7f93bcff9700 1 -- 172.21.15.59:0/423051936 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f93b0052100 con 0x7f93c0100630 2023-10-08T12:38:59.468 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 12:38:59 smithi173 ceph-mds[173500]: -- 172.21.15.173:0/433843496 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559dfcfc71e0 con 0x559dfcf9d000 2023-10-08T12:38:59.468 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 12:38:59 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-i[173476]: starting mds.i at 2023-10-08T12:38:59.468 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 12:38:59 smithi173 bash[173460]: 13ab3c41efa3e6dca0cca2983577329006d7908ae9389f4801255e6da21704a9 2023-10-08T12:38:59.468 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 12:38:59 smithi173 systemd[1]: Started Ceph mds.i for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:38:59.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.476+0000 7f93c55ff700 1 -- 172.21.15.59:0/423051936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93c0067450 con 0x7f93c0100630 2023-10-08T12:38:59.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.477+0000 7f93bcff9700 1 -- 172.21.15.59:0/423051936 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6865 (secure 0 0 0) 0x7f93b0096530 con 0x7f93c0100630 2023-10-08T12:38:59.478 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:38:59.478 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-10-08T12:38:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 -- 172.21.15.59:0/423051936 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f93ac0a1550 msgr2=0x7f93ac0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f93ac0a1550 0x7f93ac0a3a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f93c0199cc0 tx=0x7f93a800b260 comp rx=0 tx=0).stop 2023-10-08T12:38:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 -- 172.21.15.59:0/423051936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c0100630 msgr2=0x7f93c019e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c0100630 0x7f93c019e9d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f93b000e9a0 tx=0x7f93b000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:38:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 -- 172.21.15.59:0/423051936 shutdown_connections 2023-10-08T12:38:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f93ac0a1550 0x7f93ac0a3a10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93c0106640 0x7f93c0198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c0100630 0x7f93c019e9d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 --2- 172.21.15.59:0/423051936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93c0100ff0 0x7f93c019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 -- 172.21.15.59:0/423051936 >> 172.21.15.59:0/423051936 conn(0x7f93c00fc1a0 msgr2=0x7f93c010be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 -- 172.21.15.59:0/423051936 shutdown_connections 2023-10-08T12:38:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:38:59.479+0000 7f93c55ff700 1 -- 172.21.15.59:0/423051936 wait complete. 2023-10-08T12:38:59.482 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2023-10-08T12:38:59.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:59 smithi059 ceph-mon[98489]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:59.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:59.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:59.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:59.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:59.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:59.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:59.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:38:59 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/423051936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:59 smithi173 ceph-mon[135182]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:38:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:38:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:38:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:38:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:38:59 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/423051936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:59 smithi092 ceph-mon[134093]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:39:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:39:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:00.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:38:59 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/423051936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:00.961 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:00 smithi059 ceph-mon[98489]: Deploying daemon mds.g on smithi059 2023-10-08T12:39:00.961 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:00 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.173:6838/2951536251,v1:172.21.15.173:6839/2951536251] up:boot 2023-10-08T12:39:00.961 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:00 smithi059 ceph-mon[98489]: fsmap 9 up:standby 2023-10-08T12:39:00.961 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:00 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T12:39:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:00 smithi173 ceph-mon[135182]: Deploying daemon mds.g on smithi059 2023-10-08T12:39:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:00 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.173:6838/2951536251,v1:172.21.15.173:6839/2951536251] up:boot 2023-10-08T12:39:00.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:00 smithi173 ceph-mon[135182]: fsmap 9 up:standby 2023-10-08T12:39:00.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:00 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T12:39:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:00 smithi092 ceph-mon[134093]: Deploying daemon mds.g on smithi059 2023-10-08T12:39:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:00 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.173:6838/2951536251,v1:172.21.15.173:6839/2951536251] up:boot 2023-10-08T12:39:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:00 smithi092 ceph-mon[134093]: fsmap 9 up:standby 2023-10-08T12:39:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:00 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T12:39:01.500 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:39:01.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.779+0000 7f2c58dff700 1 -- 172.21.15.59:0/4010837954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c54100ff0 msgr2=0x7f2c5410d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:01.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.779+0000 7f2c58dff700 1 --2- 172.21.15.59:0/4010837954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c54100ff0 0x7f2c5410d500 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00b0a0 tx=0x7f2c4c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:01.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.780+0000 7f2c58dff700 1 -- 172.21.15.59:0/4010837954 shutdown_connections 2023-10-08T12:39:01.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.780+0000 7f2c58dff700 1 --2- 172.21.15.59:0/4010837954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c54106640 0x7f2c54106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:01.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.780+0000 7f2c58dff700 1 --2- 172.21.15.59:0/4010837954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c54100ff0 0x7f2c5410d500 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:01.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.780+0000 7f2c58dff700 1 --2- 172.21.15.59:0/4010837954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c54100630 0x7f2c54100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:01.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.780+0000 7f2c58dff700 1 -- 172.21.15.59:0/4010837954 >> 172.21.15.59:0/4010837954 conn(0x7f2c540fc140 msgr2=0x7f2c540fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:01.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.780+0000 7f2c58dff700 1 -- 172.21.15.59:0/4010837954 shutdown_connections 2023-10-08T12:39:01.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.780+0000 7f2c58dff700 1 -- 172.21.15.59:0/4010837954 wait complete. 2023-10-08T12:39:01.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.781+0000 7f2c58dff700 1 Processor -- start 2023-10-08T12:39:01.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.781+0000 7f2c58dff700 1 -- start start 2023-10-08T12:39:01.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.782+0000 7f2c58dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c54100630 0x7f2c54072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:01.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.782+0000 7f2c58dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c54100ff0 0x7f2c54073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.782+0000 7f2c58dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c54106640 0x7f2c54073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.782+0000 7f2c58dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c54074a70 con 0x7f2c54106640 2023-10-08T12:39:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.782+0000 7f2c58dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c541a9470 con 0x7f2c54100630 2023-10-08T12:39:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.782+0000 7f2c58dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c541a95e0 con 0x7f2c54100ff0 2023-10-08T12:39:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.782+0000 7f2c5259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c54100630 0x7f2c54072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.782+0000 7f2c52d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c54106640 0x7f2c54073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.782+0000 7f2c51d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c54100ff0 0x7f2c54073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.782+0000 7f2c52d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c54106640 0x7f2c54073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54742/0 (socket says 172.21.15.59:54742) 2023-10-08T12:39:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.782+0000 7f2c52d9d700 1 -- 172.21.15.59:0/2609193932 learned_addr learned my addr 172.21.15.59:0/2609193932 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:01.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.783+0000 7f2c5259c700 1 -- 172.21.15.59:0/2609193932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c54100ff0 msgr2=0x7f2c54073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.783+0000 7f2c5259c700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c54100ff0 0x7f2c54073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.783+0000 7f2c5259c700 1 -- 172.21.15.59:0/2609193932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c54106640 msgr2=0x7f2c54073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.783+0000 7f2c5259c700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c54106640 0x7f2c54073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.783+0000 7f2c5259c700 1 -- 172.21.15.59:0/2609193932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c009d00 con 0x7f2c54100630 2023-10-08T12:39:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.783+0000 7f2c51d9b700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c54100ff0 0x7f2c54073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.783+0000 7f2c52d9d700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c54106640 0x7f2c54073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.783+0000 7f2c5259c700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c54100630 0x7f2c54072af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400e9f0 tx=0x7f2c4400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.783+0000 7f2c437fe700 1 -- 172.21.15.59:0/2609193932 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4400c9c0 con 0x7f2c54100630 2023-10-08T12:39:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.783+0000 7f2c58dff700 1 -- 172.21.15.59:0/2609193932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c541a98c0 con 0x7f2c54100630 2023-10-08T12:39:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.784+0000 7f2c437fe700 1 -- 172.21.15.59:0/2609193932 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c44010430 con 0x7f2c54100630 2023-10-08T12:39:01.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.784+0000 7f2c58dff700 1 -- 172.21.15.59:0/2609193932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c541a9e20 con 0x7f2c54100630 2023-10-08T12:39:01.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.784+0000 7f2c437fe700 1 -- 172.21.15.59:0/2609193932 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44018680 con 0x7f2c54100630 2023-10-08T12:39:01.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.785+0000 7f2c58dff700 1 -- 172.21.15.59:0/2609193932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c54108c50 con 0x7f2c54100630 2023-10-08T12:39:01.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.786+0000 7f2c437fe700 1 -- 172.21.15.59:0/2609193932 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f2c44010810 con 0x7f2c54100630 2023-10-08T12:39:01.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.788+0000 7f2c437fe700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c3c0a1550 0x7f2c3c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:01.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.788+0000 7f2c437fe700 1 -- 172.21.15.59:0/2609193932 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f2c44014070 con 0x7f2c54100630 2023-10-08T12:39:01.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.788+0000 7f2c51d9b700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c3c0a1550 0x7f2c3c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:01.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.789+0000 7f2c51d9b700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c3c0a1550 0x7f2c3c0a3a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2c540741d0 tx=0x7f2c48009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:01.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:01.790+0000 7f2c437fe700 1 -- 172.21.15.59:0/2609193932 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2c44052100 con 0x7f2c54100630 2023-10-08T12:39:01.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:01 smithi173 ceph-mon[135182]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:02.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:01 smithi059 ceph-mon[98489]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:02.015 INFO:journalctl@ceph.mds.g.smithi059.stdout:Oct 08 12:39:01 smithi059 systemd[1]: Starting Ceph mds.g for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:39:02.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.063+0000 7f2c58dff700 1 -- 172.21.15.59:0/2609193932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c54101d70 con 0x7f2c54100630 2023-10-08T12:39:02.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.065+0000 7f2c437fe700 1 -- 172.21.15.59:0/2609193932 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7661 (secure 0 0 0) 0x7f2c44096410 con 0x7f2c54100630 2023-10-08T12:39:02.065 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:02.066 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T12:39:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 -- 172.21.15.59:0/2609193932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c3c0a1550 msgr2=0x7f2c3c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c3c0a1550 0x7f2c3c0a3a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2c540741d0 tx=0x7f2c48009260 comp rx=0 tx=0).stop 2023-10-08T12:39:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 -- 172.21.15.59:0/2609193932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c54100630 msgr2=0x7f2c54072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c54100630 0x7f2c54072af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400e9f0 tx=0x7f2c4400ed00 comp rx=0 tx=0).stop 2023-10-08T12:39:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 -- 172.21.15.59:0/2609193932 shutdown_connections 2023-10-08T12:39:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2c3c0a1550 0x7f2c3c0a3a10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c54100630 0x7f2c54072af0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c54106640 0x7f2c54073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 --2- 172.21.15.59:0/2609193932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c54100ff0 0x7f2c54073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 -- 172.21.15.59:0/2609193932 >> 172.21.15.59:0/2609193932 conn(0x7f2c540fc140 msgr2=0x7f2c540fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 -- 172.21.15.59:0/2609193932 shutdown_connections 2023-10-08T12:39:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:02.067+0000 7f2c58dff700 1 -- 172.21.15.59:0/2609193932 wait complete. 2023-10-08T12:39:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 10 2023-10-08T12:39:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:01 smithi092 ceph-mon[134093]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:02.384 INFO:journalctl@ceph.mds.g.smithi059.stdout:Oct 08 12:39:02 smithi059 podman[155347]: 2023-10-08T12:39:02.716 INFO:journalctl@ceph.mds.g.smithi059.stdout:Oct 08 12:39:02 smithi059 bash[155347]: c85105f342eaf07640d67b283fcd378c16f7920d7e910f3acbd309d50fe15a44 2023-10-08T12:39:02.716 INFO:journalctl@ceph.mds.g.smithi059.stdout:Oct 08 12:39:02 smithi059 ceph-mds[155389]: -- 172.21.15.59:0/3271920447 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b23d0bb1e0 con 0x55b23d091000 2023-10-08T12:39:02.716 INFO:journalctl@ceph.mds.g.smithi059.stdout:Oct 08 12:39:02 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-g[155365]: starting mds.g at 2023-10-08T12:39:02.716 INFO:journalctl@ceph.mds.g.smithi059.stdout:Oct 08 12:39:02 smithi059 systemd[1]: Started Ceph mds.g for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:39:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:02 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2609193932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:02 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:02 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:02 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:02 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:39:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:02 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:39:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:02 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:03.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:02 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2609193932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:03.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:02 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:03.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:02 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:03.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:02 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:03.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:02 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:39:03.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:02 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:39:03.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:02 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:03.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:02 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2609193932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:03.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:02 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:03.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:02 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:03.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:02 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:03.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:02 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:39:03.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:02 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:39:03.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:02 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:03.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:03 smithi059 ceph-mon[98489]: Deploying daemon mds.a on smithi059 2023-10-08T12:39:03.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:03 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.59:6838/3140194439,v1:172.21.15.59:6839/3140194439] up:boot 2023-10-08T12:39:03.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:03 smithi059 ceph-mon[98489]: fsmap 10 up:standby 2023-10-08T12:39:03.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:03 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T12:39:03.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:03 smithi059 ceph-mon[98489]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:04.089 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:39:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:03 smithi092 ceph-mon[134093]: Deploying daemon mds.a on smithi059 2023-10-08T12:39:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:03 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.59:6838/3140194439,v1:172.21.15.59:6839/3140194439] up:boot 2023-10-08T12:39:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:03 smithi092 ceph-mon[134093]: fsmap 10 up:standby 2023-10-08T12:39:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:03 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T12:39:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:03 smithi092 ceph-mon[134093]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:03 smithi173 ceph-mon[135182]: Deploying daemon mds.a on smithi059 2023-10-08T12:39:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:03 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.59:6838/3140194439,v1:172.21.15.59:6839/3140194439] up:boot 2023-10-08T12:39:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:03 smithi173 ceph-mon[135182]: fsmap 10 up:standby 2023-10-08T12:39:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:03 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T12:39:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:03 smithi173 ceph-mon[135182]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.299+0000 7f9f669ff700 1 -- 172.21.15.59:0/3941258872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f60073540 msgr2=0x7f9f6010c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.299+0000 7f9f669ff700 1 --2- 172.21.15.59:0/3941258872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f60073540 0x7f9f6010c930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009990 tx=0x7f9f48009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.299+0000 7f9f669ff700 1 -- 172.21.15.59:0/3941258872 shutdown_connections 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.299+0000 7f9f669ff700 1 --2- 172.21.15.59:0/3941258872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f6010ce70 0x7f9f6010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.299+0000 7f9f669ff700 1 --2- 172.21.15.59:0/3941258872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f60072c20 0x7f9f60073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.299+0000 7f9f669ff700 1 --2- 172.21.15.59:0/3941258872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f60073540 0x7f9f6010c930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.299+0000 7f9f669ff700 1 -- 172.21.15.59:0/3941258872 >> 172.21.15.59:0/3941258872 conn(0x7f9f600fc140 msgr2=0x7f9f600fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.299+0000 7f9f669ff700 1 -- 172.21.15.59:0/3941258872 shutdown_connections 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.299+0000 7f9f669ff700 1 -- 172.21.15.59:0/3941258872 wait complete. 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.301+0000 7f9f669ff700 1 Processor -- start 2023-10-08T12:39:04.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.301+0000 7f9f669ff700 1 -- start start 2023-10-08T12:39:04.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.301+0000 7f9f669ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f60072c20 0x7f9f60198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f669ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f60073540 0x7f9f601992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f669ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f6010ce70 0x7f9f6019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f669ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6019dc90 con 0x7f9f60073540 2023-10-08T12:39:04.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f669ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6019de00 con 0x7f9f6010ce70 2023-10-08T12:39:04.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f669ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6019dfc0 con 0x7f9f60072c20 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f64f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f6010ce70 0x7f9f6019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f57fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f60073540 0x7f9f601992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f64f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f6010ce70 0x7f9f6019d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44244/0 (socket says 172.21.15.59:44244) 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f64f9c700 1 -- 172.21.15.59:0/1689534144 learned_addr learned my addr 172.21.15.59:0/1689534144 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f5ffff700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f60072c20 0x7f9f60198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f64f9c700 1 -- 172.21.15.59:0/1689534144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f60072c20 msgr2=0x7f9f60198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f64f9c700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f60072c20 0x7f9f60198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f64f9c700 1 -- 172.21.15.59:0/1689534144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f60073540 msgr2=0x7f9f601992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f64f9c700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f60073540 0x7f9f601992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f64f9c700 1 -- 172.21.15.59:0/1689534144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f480095f0 con 0x7f9f6010ce70 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.302+0000 7f9f57fff700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f60073540 0x7f9f601992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:04.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.303+0000 7f9f64f9c700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f6010ce70 0x7f9f6019d650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800ef30 tx=0x7f9f5800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.303+0000 7f9f5dffb700 1 -- 172.21.15.59:0/1689534144 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f58018070 con 0x7f9f6010ce70 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.303+0000 7f9f5dffb700 1 -- 172.21.15.59:0/1689534144 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f5800f040 con 0x7f9f6010ce70 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.303+0000 7f9f5dffb700 1 -- 172.21.15.59:0/1689534144 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5800cd00 con 0x7f9f6010ce70 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.303+0000 7f9f669ff700 1 -- 172.21.15.59:0/1689534144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6019e240 con 0x7f9f6010ce70 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.303+0000 7f9f669ff700 1 -- 172.21.15.59:0/1689534144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f601a5ae0 con 0x7f9f6010ce70 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.304+0000 7f9f669ff700 1 -- 172.21.15.59:0/1689534144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f60108080 con 0x7f9f6010ce70 2023-10-08T12:39:04.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.306+0000 7f9f5dffb700 1 -- 172.21.15.59:0/1689534144 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f9f58003a00 con 0x7f9f6010ce70 2023-10-08T12:39:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.308+0000 7f9f5dffb700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9f4c0a14d0 0x7f9f4c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.308+0000 7f9f5dffb700 1 -- 172.21.15.59:0/1689534144 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f9f580cc610 con 0x7f9f6010ce70 2023-10-08T12:39:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.308+0000 7f9f5ffff700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9f4c0a14d0 0x7f9f4c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.308+0000 7f9f5ffff700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9f4c0a14d0 0x7f9f4c0a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f50009c60 tx=0x7f9f50009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.309+0000 7f9f5dffb700 1 -- 172.21.15.59:0/1689534144 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9f58096030 con 0x7f9f6010ce70 2023-10-08T12:39:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.612+0000 7f9f669ff700 1 -- 172.21.15.59:0/1689534144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f600742d0 con 0x7f9f6010ce70 2023-10-08T12:39:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.614+0000 7f9f5dffb700 1 -- 172.21.15.59:0/1689534144 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8453 (secure 0 0 0) 0x7f9f58099650 con 0x7f9f6010ce70 2023-10-08T12:39:04.615 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:04.615 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T12:39:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 -- 172.21.15.59:0/1689534144 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9f4c0a14d0 msgr2=0x7f9f4c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9f4c0a14d0 0x7f9f4c0a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f50009c60 tx=0x7f9f50009260 comp rx=0 tx=0).stop 2023-10-08T12:39:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 -- 172.21.15.59:0/1689534144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f6010ce70 msgr2=0x7f9f6019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f6010ce70 0x7f9f6019d650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800ef30 tx=0x7f9f5800c3a0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 -- 172.21.15.59:0/1689534144 shutdown_connections 2023-10-08T12:39:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9f4c0a14d0 0x7f9f4c0a3990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f6010ce70 0x7f9f6019d650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f60072c20 0x7f9f60198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 --2- 172.21.15.59:0/1689534144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f60073540 0x7f9f601992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 -- 172.21.15.59:0/1689534144 >> 172.21.15.59:0/1689534144 conn(0x7f9f600fc140 msgr2=0x7f9f600fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 -- 172.21.15.59:0/1689534144 shutdown_connections 2023-10-08T12:39:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:04.616+0000 7f9f669ff700 1 -- 172.21.15.59:0/1689534144 wait complete. 2023-10-08T12:39:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 11 2023-10-08T12:39:04.901 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:04 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1689534144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:05.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:04 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1689534144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:05.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:04 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1689534144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:05.265 INFO:journalctl@ceph.mds.a.smithi059.stdout:Oct 08 12:39:04 smithi059 systemd[1]: Starting Ceph mds.a for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:39:05.674 INFO:journalctl@ceph.mds.a.smithi059.stdout:Oct 08 12:39:05 smithi059 podman[155741]: 2023-10-08T12:39:05.674 INFO:journalctl@ceph.mds.a.smithi059.stdout:Oct 08 12:39:05 smithi059 bash[155741]: b6b4cc04cef5a502030609585caa7653da3c5245cea49d9410c4be052039bde2 2023-10-08T12:39:05.674 INFO:journalctl@ceph.mds.a.smithi059.stdout:Oct 08 12:39:05 smithi059 ceph-mds[155782]: -- 172.21.15.59:0/557300392 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56451d34d1e0 con 0x56451d322c00 2023-10-08T12:39:05.674 INFO:journalctl@ceph.mds.a.smithi059.stdout:Oct 08 12:39:05 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-a[155757]: starting mds.a at 2023-10-08T12:39:06.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:05 smithi059 ceph-mon[98489]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:06.015 INFO:journalctl@ceph.mds.a.smithi059.stdout:Oct 08 12:39:05 smithi059 systemd[1]: Started Ceph mds.a for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:39:06.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:05 smithi092 ceph-mon[134093]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:05 smithi173 ceph-mon[135182]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:06.638 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:39:06.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.859+0000 7f2d807ff700 1 -- 172.21.15.59:0/2996799126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78106640 msgr2=0x7f2d78106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.859+0000 7f2d807ff700 1 --2- 172.21.15.59:0/2996799126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78106640 0x7f2d78106a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009990 tx=0x7f2d74009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.859+0000 7f2d807ff700 1 -- 172.21.15.59:0/2996799126 shutdown_connections 2023-10-08T12:39:06.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.859+0000 7f2d807ff700 1 --2- 172.21.15.59:0/2996799126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d78100ff0 0x7f2d7810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.859+0000 7f2d807ff700 1 --2- 172.21.15.59:0/2996799126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78106640 0x7f2d78106a20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.859+0000 7f2d807ff700 1 --2- 172.21.15.59:0/2996799126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d78100630 0x7f2d78100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.859+0000 7f2d807ff700 1 -- 172.21.15.59:0/2996799126 >> 172.21.15.59:0/2996799126 conn(0x7f2d780fc140 msgr2=0x7f2d780fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.859+0000 7f2d807ff700 1 -- 172.21.15.59:0/2996799126 shutdown_connections 2023-10-08T12:39:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.859+0000 7f2d807ff700 1 -- 172.21.15.59:0/2996799126 wait complete. 2023-10-08T12:39:06.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.860+0000 7f2d807ff700 1 Processor -- start 2023-10-08T12:39:06.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.860+0000 7f2d807ff700 1 -- start start 2023-10-08T12:39:06.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.860+0000 7f2d807ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d78100630 0x7f2d78072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.860+0000 7f2d807ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78100ff0 0x7f2d78073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d807ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d78106640 0x7f2d78073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d807ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d781a4eb0 con 0x7f2d78100ff0 2023-10-08T12:39:06.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d807ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d781a5020 con 0x7f2d78100630 2023-10-08T12:39:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d807ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d781a51e0 con 0x7f2d78106640 2023-10-08T12:39:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d7e59b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d78100630 0x7f2d78072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d7e59b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d78100630 0x7f2d78072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44288/0 (socket says 172.21.15.59:44288) 2023-10-08T12:39:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d7e59b700 1 -- 172.21.15.59:0/1907412187 learned_addr learned my addr 172.21.15.59:0/1907412187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d7dd9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78100ff0 0x7f2d78073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d7ed9c700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d78106640 0x7f2d78073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d7e59b700 1 -- 172.21.15.59:0/1907412187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d78106640 msgr2=0x7f2d78073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d7e59b700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d78106640 0x7f2d78073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d7e59b700 1 -- 172.21.15.59:0/1907412187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78100ff0 msgr2=0x7f2d78073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d7e59b700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78100ff0 0x7f2d78073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d7e59b700 1 -- 172.21.15.59:0/1907412187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740095f0 con 0x7f2d78100630 2023-10-08T12:39:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.861+0000 7f2d7e59b700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d78100630 0x7f2d78072af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2d74005910 tx=0x7f2d74004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.862+0000 7f2d6f7fe700 1 -- 172.21.15.59:0/1907412187 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7401d070 con 0x7f2d78100630 2023-10-08T12:39:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.862+0000 7f2d6f7fe700 1 -- 172.21.15.59:0/1907412187 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d74022470 con 0x7f2d78100630 2023-10-08T12:39:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.862+0000 7f2d807ff700 1 -- 172.21.15.59:0/1907412187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d781a5460 con 0x7f2d78100630 2023-10-08T12:39:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.862+0000 7f2d6f7fe700 1 -- 172.21.15.59:0/1907412187 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74017650 con 0x7f2d78100630 2023-10-08T12:39:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.862+0000 7f2d807ff700 1 -- 172.21.15.59:0/1907412187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d781a5990 con 0x7f2d78100630 2023-10-08T12:39:06.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.863+0000 7f2d807ff700 1 -- 172.21.15.59:0/1907412187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d78108c30 con 0x7f2d78100630 2023-10-08T12:39:06.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.866+0000 7f2d6f7fe700 1 -- 172.21.15.59:0/1907412187 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f2d740225e0 con 0x7f2d78100630 2023-10-08T12:39:06.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.867+0000 7f2d6f7fe700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2d640a1550 0x7f2d640a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.867+0000 7f2d6f7fe700 1 -- 172.21.15.59:0/1907412187 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f2d740cdcd0 con 0x7f2d78100630 2023-10-08T12:39:06.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.867+0000 7f2d7dd9a700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2d640a1550 0x7f2d640a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.867+0000 7f2d7dd9a700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2d640a1550 0x7f2d640a3a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d78074220 tx=0x7f2d68009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:06.871+0000 7f2d6f7fe700 1 -- 172.21.15.59:0/1907412187 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2d740976f0 con 0x7f2d78100630 2023-10-08T12:39:07.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:06 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.59:6840/3603700494,v1:172.21.15.59:6841/3603700494] up:boot 2023-10-08T12:39:07.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:06 smithi059 ceph-mon[98489]: fsmap 11 up:standby 2023-10-08T12:39:07.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T12:39:07.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:07.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:07.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:07.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:39:07.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:39:07.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:06 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:07.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:06 smithi059 ceph-mon[98489]: Deploying daemon mds.b on smithi092 2023-10-08T12:39:07.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:06 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.59:6840/3603700494,v1:172.21.15.59:6841/3603700494] up:boot 2023-10-08T12:39:07.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:06 smithi092 ceph-mon[134093]: fsmap 11 up:standby 2023-10-08T12:39:07.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T12:39:07.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:07.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:07.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:07.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:39:07.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:39:07.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:06 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:07.034 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:06 smithi092 ceph-mon[134093]: Deploying daemon mds.b on smithi092 2023-10-08T12:39:07.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.131+0000 7f2d807ff700 1 -- 172.21.15.59:0/1907412187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d78074020 con 0x7f2d78100630 2023-10-08T12:39:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.132+0000 7f2d6f7fe700 1 -- 172.21.15.59:0/1907412187 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9245 (secure 0 0 0) 0x7f2d7409ad10 con 0x7f2d78100630 2023-10-08T12:39:07.133 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:07.133 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T12:39:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 -- 172.21.15.59:0/1907412187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2d640a1550 msgr2=0x7f2d640a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2d640a1550 0x7f2d640a3a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d78074220 tx=0x7f2d68009260 comp rx=0 tx=0).stop 2023-10-08T12:39:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 -- 172.21.15.59:0/1907412187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d78100630 msgr2=0x7f2d78072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d78100630 0x7f2d78072af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2d74005910 tx=0x7f2d74004730 comp rx=0 tx=0).stop 2023-10-08T12:39:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 -- 172.21.15.59:0/1907412187 shutdown_connections 2023-10-08T12:39:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2d640a1550 0x7f2d640a3a10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d78100630 0x7f2d78072af0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d78106640 0x7f2d78073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 --2- 172.21.15.59:0/1907412187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78100ff0 0x7f2d78073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 -- 172.21.15.59:0/1907412187 >> 172.21.15.59:0/1907412187 conn(0x7f2d780fc140 msgr2=0x7f2d780fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 -- 172.21.15.59:0/1907412187 shutdown_connections 2023-10-08T12:39:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:07.135+0000 7f2d807ff700 1 -- 172.21.15.59:0/1907412187 wait complete. 2023-10-08T12:39:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 12 2023-10-08T12:39:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:06 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.59:6840/3603700494,v1:172.21.15.59:6841/3603700494] up:boot 2023-10-08T12:39:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:06 smithi173 ceph-mon[135182]: fsmap 11 up:standby 2023-10-08T12:39:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T12:39:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:39:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:39:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:06 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:07.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:06 smithi173 ceph-mon[135182]: Deploying daemon mds.b on smithi092 2023-10-08T12:39:07.377 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 12:39:07 smithi092 systemd[1]: Starting Ceph mds.b for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T12:39:07.845 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:07 smithi092 ceph-mon[134093]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:07.846 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:07 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1907412187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:07.846 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 12:39:07 smithi092 podman[173562]: 2023-10-08T12:39:07.846 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 12:39:07 smithi092 bash[173562]: 915ab5d93a93129629711137fb2a30f8fb36fe8def51c9041e2c62053d28a2f9 2023-10-08T12:39:07.846 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 12:39:07 smithi092 ceph-mds[173602]: -- 172.21.15.92:0/641580816 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560f23e531e0 con 0x560f23e29000 2023-10-08T12:39:07.846 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 12:39:07 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-b[173578]: starting mds.b at 2023-10-08T12:39:08.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:07 smithi059 ceph-mon[98489]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:08.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:07 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1907412187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:08.126 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 12:39:07 smithi092 systemd[1]: Started Ceph mds.b for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T12:39:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:07 smithi173 ceph-mon[135182]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:07 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1907412187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:09.155 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:39:09.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:08 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:08 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:08 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:08 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:08 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:08 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:39:09.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:08 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] up:boot 2023-10-08T12:39:09.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:08 smithi173 ceph-mon[135182]: fsmap 12 up:standby 2023-10-08T12:39:09.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:08 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T12:39:09.220 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:08 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.220 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:08 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.220 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:08 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.220 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:08 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.220 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:08 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.220 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:08 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:39:09.220 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:08 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] up:boot 2023-10-08T12:39:09.220 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:08 smithi059 ceph-mon[98489]: fsmap 12 up:standby 2023-10-08T12:39:09.220 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:08 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T12:39:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.370+0000 7fbde01ff700 1 -- 172.21.15.59:0/1906629170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdd8100ff0 msgr2=0x7fbdd810d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.370+0000 7fbde01ff700 1 --2- 172.21.15.59:0/1906629170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdd8100ff0 0x7fbdd810d500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009f90 tx=0x7fbdd000b330 comp rx=0 tx=0).stop 2023-10-08T12:39:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.370+0000 7fbde01ff700 1 -- 172.21.15.59:0/1906629170 shutdown_connections 2023-10-08T12:39:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.370+0000 7fbde01ff700 1 --2- 172.21.15.59:0/1906629170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdd8106640 0x7fbdd8106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.370+0000 7fbde01ff700 1 --2- 172.21.15.59:0/1906629170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdd8100ff0 0x7fbdd810d500 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.370+0000 7fbde01ff700 1 --2- 172.21.15.59:0/1906629170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd8100630 0x7fbdd8100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.370+0000 7fbde01ff700 1 -- 172.21.15.59:0/1906629170 >> 172.21.15.59:0/1906629170 conn(0x7fbdd80fc1a0 msgr2=0x7fbdd80fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.370+0000 7fbde01ff700 1 -- 172.21.15.59:0/1906629170 shutdown_connections 2023-10-08T12:39:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.370+0000 7fbde01ff700 1 -- 172.21.15.59:0/1906629170 wait complete. 2023-10-08T12:39:09.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.371+0000 7fbde01ff700 1 Processor -- start 2023-10-08T12:39:09.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.371+0000 7fbde01ff700 1 -- start start 2023-10-08T12:39:09.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbde01ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd8100630 0x7fbdd819e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:09.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbde01ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdd8100ff0 0x7fbdd819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:09.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbde01ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdd8106640 0x7fbdd8198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:09.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbde01ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8199130 con 0x7fbdd8100630 2023-10-08T12:39:09.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbde01ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd81992a0 con 0x7fbdd8100ff0 2023-10-08T12:39:09.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbde01ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8199460 con 0x7fbdd8106640 2023-10-08T12:39:09.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbdde79c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdd8106640 0x7fbdd8198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:09.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbdddf9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd8100630 0x7fbdd819e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:09.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbdde79c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdd8106640 0x7fbdd8198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:57172/0 (socket says 172.21.15.59:57172) 2023-10-08T12:39:09.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbdde79c700 1 -- 172.21.15.59:0/154737877 learned_addr learned my addr 172.21.15.59:0/154737877 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:09.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbdde79c700 1 -- 172.21.15.59:0/154737877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdd8100ff0 msgr2=0x7fbdd819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:09.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.372+0000 7fbddd79a700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdd8100ff0 0x7fbdd819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:09.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbdde79c700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdd8100ff0 0x7fbdd819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbdde79c700 1 -- 172.21.15.59:0/154737877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd8100630 msgr2=0x7fbdd819e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:09.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbdde79c700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd8100630 0x7fbdd819e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbdde79c700 1 -- 172.21.15.59:0/154737877 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd0009c40 con 0x7fbdd8106640 2023-10-08T12:39:09.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbddd79a700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdd8100ff0 0x7fbdd819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:39:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbdddf9b700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd8100630 0x7fbdd819e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbdde79c700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdd8106640 0x7fbdd8198ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0008fb0 tx=0x7fbdd00094f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbdceffd700 1 -- 172.21.15.59:0/154737877 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000e040 con 0x7fbdd8106640 2023-10-08T12:39:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbde01ff700 1 -- 172.21.15.59:0/154737877 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd81996e0 con 0x7fbdd8106640 2023-10-08T12:39:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbdceffd700 1 -- 172.21.15.59:0/154737877 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdd000bbf0 con 0x7fbdd8106640 2023-10-08T12:39:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbde01ff700 1 -- 172.21.15.59:0/154737877 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd81a5940 con 0x7fbdd8106640 2023-10-08T12:39:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.373+0000 7fbdceffd700 1 -- 172.21.15.59:0/154737877 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0005040 con 0x7fbdd8106640 2023-10-08T12:39:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.375+0000 7fbde01ff700 1 -- 172.21.15.59:0/154737877 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd8101d70 con 0x7fbdd8106640 2023-10-08T12:39:09.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:08 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:08 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:08 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:08 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:08 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:09.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:08 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:39:09.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:08 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] up:boot 2023-10-08T12:39:09.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:08 smithi092 ceph-mon[134093]: fsmap 12 up:standby 2023-10-08T12:39:09.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:08 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T12:39:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.378+0000 7fbdceffd700 1 -- 172.21.15.59:0/154737877 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fbdd001d470 con 0x7fbdd8106640 2023-10-08T12:39:09.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.379+0000 7fbdceffd700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbdc40a1550 0x7fbdc40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:09.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.379+0000 7fbdceffd700 1 -- 172.21.15.59:0/154737877 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fbdd00cdba0 con 0x7fbdd8106640 2023-10-08T12:39:09.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.379+0000 7fbdddf9b700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbdc40a1550 0x7fbdc40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:09.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.380+0000 7fbdddf9b700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbdc40a1550 0x7fbdc40a3a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009fd0 tx=0x7fbdd4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:09.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.383+0000 7fbdceffd700 1 -- 172.21.15.59:0/154737877 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbdd0097660 con 0x7fbdd8106640 2023-10-08T12:39:09.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.654+0000 7fbde01ff700 1 -- 172.21.15.59:0/154737877 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdd8110570 con 0x7fbdd8106640 2023-10-08T12:39:09.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.655+0000 7fbdceffd700 1 -- 172.21.15.59:0/154737877 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10037 (secure 0 0 0) 0x7fbdd009ac80 con 0x7fbdd8106640 2023-10-08T12:39:09.655 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:09.655 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-10-08T12:39:09.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 -- 172.21.15.59:0/154737877 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbdc40a1550 msgr2=0x7fbdc40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:09.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbdc40a1550 0x7fbdc40a3a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009fd0 tx=0x7fbdd4009260 comp rx=0 tx=0).stop 2023-10-08T12:39:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 -- 172.21.15.59:0/154737877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdd8106640 msgr2=0x7fbdd8198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdd8106640 0x7fbdd8198ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0008fb0 tx=0x7fbdd00094f0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 -- 172.21.15.59:0/154737877 shutdown_connections 2023-10-08T12:39:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbdc40a1550 0x7fbdc40a3a10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdd8106640 0x7fbdd8198ad0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdd8100630 0x7fbdd819e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 --2- 172.21.15.59:0/154737877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdd8100ff0 0x7fbdd819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 -- 172.21.15.59:0/154737877 >> 172.21.15.59:0/154737877 conn(0x7fbdd80fc1a0 msgr2=0x7fbdd80fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 -- 172.21.15.59:0/154737877 shutdown_connections 2023-10-08T12:39:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.657+0000 7fbde01ff700 1 -- 172.21.15.59:0/154737877 wait complete. 2023-10-08T12:39:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 13 2023-10-08T12:39:09.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:39:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.902+0000 7f51e83ff700 1 -- 172.21.15.59:0/1188147578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51e00fff10 msgr2=0x7f51e010c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.902+0000 7f51e83ff700 1 --2- 172.21.15.59:0/1188147578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51e00fff10 0x7f51e010c3d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51d800b0a0 tx=0x7f51d800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.902+0000 7f51e83ff700 1 -- 172.21.15.59:0/1188147578 shutdown_connections 2023-10-08T12:39:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.902+0000 7f51e83ff700 1 --2- 172.21.15.59:0/1188147578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51e00fff10 0x7f51e010c3d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.902+0000 7f51e83ff700 1 --2- 172.21.15.59:0/1188147578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e0105610 0x7f51e01059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.902+0000 7f51e83ff700 1 --2- 172.21.15.59:0/1188147578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51e00ff550 0x7f51e00ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.902+0000 7f51e83ff700 1 -- 172.21.15.59:0/1188147578 >> 172.21.15.59:0/1188147578 conn(0x7f51e00fb060 msgr2=0x7f51e00fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:09.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.902+0000 7f51e83ff700 1 -- 172.21.15.59:0/1188147578 shutdown_connections 2023-10-08T12:39:09.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.902+0000 7f51e83ff700 1 -- 172.21.15.59:0/1188147578 wait complete. 2023-10-08T12:39:09.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.903+0000 7f51e83ff700 1 Processor -- start 2023-10-08T12:39:09.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.904+0000 7f51e83ff700 1 -- start start 2023-10-08T12:39:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.904+0000 7f51e83ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51e00ff550 0x7f51e010cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.904+0000 7f51e83ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51e00fff10 0x7f51e010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.904+0000 7f51e83ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e0105610 0x7f51e010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.904+0000 7f51e83ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e01a5000 con 0x7f51e0105610 2023-10-08T12:39:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.904+0000 7f51e83ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e01a5170 con 0x7f51e00fff10 2023-10-08T12:39:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.904+0000 7f51e83ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e01a5330 con 0x7f51e00ff550 2023-10-08T12:39:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e599a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51e00fff10 0x7f51e010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e699c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e0105610 0x7f51e010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e599a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51e00fff10 0x7f51e010d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44320/0 (socket says 172.21.15.59:44320) 2023-10-08T12:39:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e619b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51e00ff550 0x7f51e010cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e599a700 1 -- 172.21.15.59:0/1957353753 learned_addr learned my addr 172.21.15.59:0/1957353753 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e599a700 1 -- 172.21.15.59:0/1957353753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51e00ff550 msgr2=0x7f51e010cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e599a700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51e00ff550 0x7f51e010cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e599a700 1 -- 172.21.15.59:0/1957353753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e0105610 msgr2=0x7f51e010d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e599a700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e0105610 0x7f51e010d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e599a700 1 -- 172.21.15.59:0/1957353753 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8009d00 con 0x7f51e00fff10 2023-10-08T12:39:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e599a700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51e00fff10 0x7f51e010d060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51d000e9a0 tx=0x7f51d000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:09.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51d77fe700 1 -- 172.21.15.59:0/1957353753 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0009790 con 0x7f51e00fff10 2023-10-08T12:39:09.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51d77fe700 1 -- 172.21.15.59:0/1957353753 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51d0010430 con 0x7f51e00fff10 2023-10-08T12:39:09.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51d77fe700 1 -- 172.21.15.59:0/1957353753 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0018680 con 0x7f51e00fff10 2023-10-08T12:39:09.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.905+0000 7f51e83ff700 1 -- 172.21.15.59:0/1957353753 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e01a5610 con 0x7f51e00fff10 2023-10-08T12:39:09.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.906+0000 7f51e83ff700 1 -- 172.21.15.59:0/1957353753 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e01a5b20 con 0x7f51e00fff10 2023-10-08T12:39:09.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.908+0000 7f51e83ff700 1 -- 172.21.15.59:0/1957353753 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e0107ab0 con 0x7f51e00fff10 2023-10-08T12:39:09.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.910+0000 7f51d77fe700 1 -- 172.21.15.59:0/1957353753 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f51d00105a0 con 0x7f51e00fff10 2023-10-08T12:39:09.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.911+0000 7f51d77fe700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51cc0a1550 0x7f51cc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:09.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.911+0000 7f51d77fe700 1 -- 172.21.15.59:0/1957353753 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f51d0014070 con 0x7f51e00fff10 2023-10-08T12:39:09.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.911+0000 7f51e619b700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51cc0a1550 0x7f51cc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:09.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.912+0000 7f51e619b700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51cc0a1550 0x7f51cc0a3a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009be0 tx=0x7f51dc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:09.915+0000 7f51d77fe700 1 -- 172.21.15.59:0/1957353753 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f51d0096510 con 0x7f51e00fff10 2023-10-08T12:39:10.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:09 smithi059 ceph-mon[98489]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:10.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:09 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/154737877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:10.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.144+0000 7f51e83ff700 1 -- 172.21.15.59:0/1957353753 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51e010e000 con 0x7f51e00fff10 2023-10-08T12:39:10.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.145+0000 7f51d77fe700 1 -- 172.21.15.59:0/1957353753 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f51d0099b30 con 0x7f51e00fff10 2023-10-08T12:39:10.146 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:10.146 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":80,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:38:26.292105+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:39:10.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.147+0000 7f51e83ff700 1 -- 172.21.15.59:0/1957353753 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51cc0a1550 msgr2=0x7f51cc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.147+0000 7f51e83ff700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51cc0a1550 0x7f51cc0a3a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009be0 tx=0x7f51dc009260 comp rx=0 tx=0).stop 2023-10-08T12:39:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.147+0000 7f51e83ff700 1 -- 172.21.15.59:0/1957353753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51e00fff10 msgr2=0x7f51e010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.147+0000 7f51e83ff700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51e00fff10 0x7f51e010d060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51d000e9a0 tx=0x7f51d000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.147+0000 7f51e83ff700 1 -- 172.21.15.59:0/1957353753 shutdown_connections 2023-10-08T12:39:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.147+0000 7f51e83ff700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51cc0a1550 0x7f51cc0a3a10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.147+0000 7f51e83ff700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e0105610 0x7f51e010d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.147+0000 7f51e83ff700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51e00ff550 0x7f51e010cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.147+0000 7f51e83ff700 1 --2- 172.21.15.59:0/1957353753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51e00fff10 0x7f51e010d060 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.147+0000 7f51e83ff700 1 -- 172.21.15.59:0/1957353753 >> 172.21.15.59:0/1957353753 conn(0x7f51e00fb060 msgr2=0x7f51e00fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.148+0000 7f51e83ff700 1 -- 172.21.15.59:0/1957353753 shutdown_connections 2023-10-08T12:39:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.148+0000 7f51e83ff700 1 -- 172.21.15.59:0/1957353753 wait complete. 2023-10-08T12:39:10.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:39:10.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:39:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:09 smithi173 ceph-mon[135182]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:09 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/154737877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:10.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:09 smithi092 ceph-mon[134093]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:10.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:09 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/154737877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.378+0000 7f774ddff700 1 -- 172.21.15.59:0/197407110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7748100730 msgr2=0x7f7748100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.378+0000 7f774ddff700 1 --2- 172.21.15.59:0/197407110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7748100730 0x7f7748100bb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f773c009990 tx=0x7f773c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.378+0000 7f774ddff700 1 -- 172.21.15.59:0/197407110 shutdown_connections 2023-10-08T12:39:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.378+0000 7f774ddff700 1 --2- 172.21.15.59:0/197407110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77481010f0 0x7f774810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.378+0000 7f774ddff700 1 --2- 172.21.15.59:0/197407110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7748106740 0x7f7748106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.378+0000 7f774ddff700 1 --2- 172.21.15.59:0/197407110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7748100730 0x7f7748100bb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.378+0000 7f774ddff700 1 -- 172.21.15.59:0/197407110 >> 172.21.15.59:0/197407110 conn(0x7f77480fc200 msgr2=0x7f77480fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.378+0000 7f774ddff700 1 -- 172.21.15.59:0/197407110 shutdown_connections 2023-10-08T12:39:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.378+0000 7f774ddff700 1 -- 172.21.15.59:0/197407110 wait complete. 2023-10-08T12:39:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.379+0000 7f774ddff700 1 Processor -- start 2023-10-08T12:39:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.379+0000 7f774ddff700 1 -- start start 2023-10-08T12:39:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f774ddff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7748100730 0x7f774819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f774ddff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77481010f0 0x7f774819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f774ddff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7748106740 0x7f7748196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f774ddff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7748197060 con 0x7f7748100730 2023-10-08T12:39:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f774ddff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77481971d0 con 0x7f77481010f0 2023-10-08T12:39:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f774ddff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7748197390 con 0x7f7748106740 2023-10-08T12:39:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f77477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7748100730 0x7f774819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f7746ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77481010f0 0x7f774819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f77477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7748100730 0x7f774819c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54850/0 (socket says 172.21.15.59:54850) 2023-10-08T12:39:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f77477fe700 1 -- 172.21.15.59:0/380348897 learned_addr learned my addr 172.21.15.59:0/380348897 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f7747fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7748106740 0x7f7748196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f77477fe700 1 -- 172.21.15.59:0/380348897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7748106740 msgr2=0x7f7748196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f77477fe700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7748106740 0x7f7748196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f77477fe700 1 -- 172.21.15.59:0/380348897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77481010f0 msgr2=0x7f774819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f77477fe700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77481010f0 0x7f774819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.380+0000 7f77477fe700 1 -- 172.21.15.59:0/380348897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7740009c40 con 0x7f7748100730 2023-10-08T12:39:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.381+0000 7f77477fe700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7748100730 0x7f774819c8d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f773800eb30 tx=0x7f773800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.381+0000 7f7744ff9700 1 -- 172.21.15.59:0/380348897 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738009880 con 0x7f7748100730 2023-10-08T12:39:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.381+0000 7f7744ff9700 1 -- 172.21.15.59:0/380348897 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77380044e0 con 0x7f7748100730 2023-10-08T12:39:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.381+0000 7f774ddff700 1 -- 172.21.15.59:0/380348897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7738009520 con 0x7f7748100730 2023-10-08T12:39:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.381+0000 7f7744ff9700 1 -- 172.21.15.59:0/380348897 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738003d80 con 0x7f7748100730 2023-10-08T12:39:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.381+0000 7f774ddff700 1 -- 172.21.15.59:0/380348897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c0095f0 con 0x7f7748100730 2023-10-08T12:39:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.382+0000 7f774ddff700 1 -- 172.21.15.59:0/380348897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7748108d50 con 0x7f7748100730 2023-10-08T12:39:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.384+0000 7f7744ff9700 1 -- 172.21.15.59:0/380348897 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f7738003ee0 con 0x7f7748100730 2023-10-08T12:39:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.386+0000 7f7744ff9700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f77300a1550 0x7f77300a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.386+0000 7f7744ff9700 1 -- 172.21.15.59:0/380348897 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f7738014070 con 0x7f7748100730 2023-10-08T12:39:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.386+0000 7f7746ffd700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f77300a1550 0x7f77300a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.387+0000 7f7746ffd700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f77300a1550 0x7f77300a3a10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7748197bc0 tx=0x7f773c005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:10.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.390+0000 7f7744ff9700 1 -- 172.21.15.59:0/380348897 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7738096720 con 0x7f7748100730 2023-10-08T12:39:10.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.619+0000 7f774ddff700 1 -- 172.21.15.59:0/380348897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7748197ec0 con 0x7f7748100730 2023-10-08T12:39:10.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.620+0000 7f7744ff9700 1 -- 172.21.15.59:0/380348897 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7738004190 con 0x7f7748100730 2023-10-08T12:39:10.620 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T12:39:10.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 -- 172.21.15.59:0/380348897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f77300a1550 msgr2=0x7f77300a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:10.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f77300a1550 0x7f77300a3a10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7748197bc0 tx=0x7f773c005fd0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 -- 172.21.15.59:0/380348897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7748100730 msgr2=0x7f774819c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7748100730 0x7f774819c8d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f773800eb30 tx=0x7f773800ee40 comp rx=0 tx=0).stop 2023-10-08T12:39:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 -- 172.21.15.59:0/380348897 shutdown_connections 2023-10-08T12:39:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f77300a1550 0x7f77300a3a10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7748106740 0x7f7748196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7748100730 0x7f774819c8d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 --2- 172.21.15.59:0/380348897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77481010f0 0x7f774819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 -- 172.21.15.59:0/380348897 >> 172.21.15.59:0/380348897 conn(0x7f77480fc200 msgr2=0x7f77480fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 -- 172.21.15.59:0/380348897 shutdown_connections 2023-10-08T12:39:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.622+0000 7f774ddff700 1 -- 172.21.15.59:0/380348897 wait complete. 2023-10-08T12:39:10.641 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T12:39:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.868+0000 7fc6195ff700 1 -- 172.21.15.59:0/2099933768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc61410ac40 msgr2=0x7fc61410d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.868+0000 7fc6195ff700 1 --2- 172.21.15.59:0/2099933768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc61410ac40 0x7fc61410d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009f90 tx=0x7fc60c00b330 comp rx=0 tx=0).stop 2023-10-08T12:39:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.868+0000 7fc6195ff700 1 -- 172.21.15.59:0/2099933768 shutdown_connections 2023-10-08T12:39:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.868+0000 7fc6195ff700 1 --2- 172.21.15.59:0/2099933768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc61410ac40 0x7fc61410d0c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.868+0000 7fc6195ff700 1 --2- 172.21.15.59:0/2099933768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc614101870 0x7fc614101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.868+0000 7fc6195ff700 1 --2- 172.21.15.59:0/2099933768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc614102190 0x7fc61410a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.868+0000 7fc6195ff700 1 -- 172.21.15.59:0/2099933768 >> 172.21.15.59:0/2099933768 conn(0x7fc6140fb030 msgr2=0x7fc6140fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.868+0000 7fc6195ff700 1 -- 172.21.15.59:0/2099933768 shutdown_connections 2023-10-08T12:39:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.868+0000 7fc6195ff700 1 -- 172.21.15.59:0/2099933768 wait complete. 2023-10-08T12:39:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.869+0000 7fc6195ff700 1 Processor -- start 2023-10-08T12:39:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.869+0000 7fc6195ff700 1 -- start start 2023-10-08T12:39:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.870+0000 7fc6195ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc614101870 0x7fc614198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.870+0000 7fc6195ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc614102190 0x7fc614199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.870+0000 7fc6195ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc61410ac40 0x7fc61419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.870+0000 7fc6195ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61419dd10 con 0x7fc614102190 2023-10-08T12:39:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.870+0000 7fc6195ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61419de80 con 0x7fc614101870 2023-10-08T12:39:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.870+0000 7fc6195ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61419e040 con 0x7fc61410ac40 2023-10-08T12:39:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.870+0000 7fc6127fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc614102190 0x7fc614199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.870+0000 7fc6127fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc614102190 0x7fc614199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48048/0 (socket says 172.21.15.59:48048) 2023-10-08T12:39:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.870+0000 7fc6127fc700 1 -- 172.21.15.59:0/3917521759 learned_addr learned my addr 172.21.15.59:0/3917521759 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.870+0000 7fc612ffd700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc614101870 0x7fc614198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.870+0000 7fc6137fe700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc61410ac40 0x7fc61419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc612ffd700 1 -- 172.21.15.59:0/3917521759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc61410ac40 msgr2=0x7fc61419d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc612ffd700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc61410ac40 0x7fc61419d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc612ffd700 1 -- 172.21.15.59:0/3917521759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc614102190 msgr2=0x7fc614199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc612ffd700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc614102190 0x7fc614199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc612ffd700 1 -- 172.21.15.59:0/3917521759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c009c40 con 0x7fc614101870 2023-10-08T12:39:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc6127fc700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc614102190 0x7fc614199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc612ffd700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc614101870 0x7fc614198e40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc60400e9c0 tx=0x7fc60400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc5fbfff700 1 -- 172.21.15.59:0/3917521759 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60400c9c0 con 0x7fc614101870 2023-10-08T12:39:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc5fbfff700 1 -- 172.21.15.59:0/3917521759 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc604010430 con 0x7fc614101870 2023-10-08T12:39:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc5fbfff700 1 -- 172.21.15.59:0/3917521759 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604018680 con 0x7fc614101870 2023-10-08T12:39:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc6195ff700 1 -- 172.21.15.59:0/3917521759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61419e320 con 0x7fc614101870 2023-10-08T12:39:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.871+0000 7fc6195ff700 1 -- 172.21.15.59:0/3917521759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6141a5b60 con 0x7fc614101870 2023-10-08T12:39:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.873+0000 7fc6195ff700 1 -- 172.21.15.59:0/3917521759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc614068090 con 0x7fc614101870 2023-10-08T12:39:10.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.874+0000 7fc5fbfff700 1 -- 172.21.15.59:0/3917521759 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc604010860 con 0x7fc614101870 2023-10-08T12:39:10.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.876+0000 7fc5fbfff700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5fc0a14d0 0x7fc5fc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:10.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.877+0000 7fc5fbfff700 1 -- 172.21.15.59:0/3917521759 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fc604014070 con 0x7fc614101870 2023-10-08T12:39:10.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.877+0000 7fc6127fc700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5fc0a14d0 0x7fc5fc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:10.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.877+0000 7fc6127fc700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5fc0a14d0 0x7fc5fc0a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc61419a340 tx=0x7fc608009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:10.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:10.879+0000 7fc5fbfff700 1 -- 172.21.15.59:0/3917521759 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc604052100 con 0x7fc614101870 2023-10-08T12:39:11.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.116+0000 7fc6195ff700 1 -- 172.21.15.59:0/3917521759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc614067450 con 0x7fc614101870 2023-10-08T12:39:11.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.117+0000 7fc5fbfff700 1 -- 172.21.15.59:0/3917521759 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc604096410 con 0x7fc614101870 2023-10-08T12:39:11.117 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:11.117 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2023-10-08T12:39:11.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T12:39:11.117 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2023-10-08T12:39:11.117 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2023-10-08T12:39:11.117 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:39:11.118 INFO:teuthology.orchestra.run.smithi059.stdout:] 2023-10-08T12:39:11.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 -- 172.21.15.59:0/3917521759 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5fc0a14d0 msgr2=0x7fc5fc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:11.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5fc0a14d0 0x7fc5fc0a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc61419a340 tx=0x7fc608009260 comp rx=0 tx=0).stop 2023-10-08T12:39:11.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 -- 172.21.15.59:0/3917521759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc614101870 msgr2=0x7fc614198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:11.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc614101870 0x7fc614198e40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc60400e9c0 tx=0x7fc60400ecd0 comp rx=0 tx=0).stop 2023-10-08T12:39:11.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 -- 172.21.15.59:0/3917521759 shutdown_connections 2023-10-08T12:39:11.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5fc0a14d0 0x7fc5fc0a3990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:11.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc614101870 0x7fc614198e40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:11.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc61410ac40 0x7fc61419d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:11.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 --2- 172.21.15.59:0/3917521759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc614102190 0x7fc614199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:11.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 -- 172.21.15.59:0/3917521759 >> 172.21.15.59:0/3917521759 conn(0x7fc6140fb030 msgr2=0x7fc6141005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:11.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 -- 172.21.15.59:0/3917521759 shutdown_connections 2023-10-08T12:39:11.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.120+0000 7fc6195ff700 1 -- 172.21.15.59:0/3917521759 wait complete. 2023-10-08T12:39:11.143 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T12:39:11.144 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T12:39:11.206 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:10 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1957353753' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:11.206 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:10 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/380348897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:39:11.206 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.206 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.206 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.206 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:10 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1957353753' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:11.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:10 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/380348897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:39:11.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.372+0000 7fa8dfdff700 1 -- 172.21.15.59:0/1481147317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d8072c20 msgr2=0x7fa8d8073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.372+0000 7fa8dfdff700 1 --2- 172.21.15.59:0/1481147317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d8072c20 0x7fa8d8073000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40098f0 tx=0x7fa8d4009c00 comp rx=0 tx=0).stop 2023-10-08T12:39:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.372+0000 7fa8dfdff700 1 -- 172.21.15.59:0/1481147317 shutdown_connections 2023-10-08T12:39:11.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.372+0000 7fa8dfdff700 1 --2- 172.21.15.59:0/1481147317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d810cf70 0x7fa8d810f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:11.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.372+0000 7fa8dfdff700 1 --2- 172.21.15.59:0/1481147317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d8072c20 0x7fa8d8073000 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:11.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.372+0000 7fa8dfdff700 1 --2- 172.21.15.59:0/1481147317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d8073540 0x7fa8d810ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:11.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.372+0000 7fa8dfdff700 1 -- 172.21.15.59:0/1481147317 >> 172.21.15.59:0/1481147317 conn(0x7fa8d80fc200 msgr2=0x7fa8d80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:11.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.372+0000 7fa8dfdff700 1 -- 172.21.15.59:0/1481147317 shutdown_connections 2023-10-08T12:39:11.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.372+0000 7fa8dfdff700 1 -- 172.21.15.59:0/1481147317 wait complete. 2023-10-08T12:39:11.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:10 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1957353753' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:11.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:10 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/380348897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:39:11.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.373+0000 7fa8dfdff700 1 Processor -- start 2023-10-08T12:39:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.373+0000 7fa8dfdff700 1 -- start start 2023-10-08T12:39:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8dfdff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d8072c20 0x7fa8d8198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8dfdff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d8073540 0x7fa8d81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8dfdff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d810cf70 0x7fa8d819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8dfdff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d819dd90 con 0x7fa8d810cf70 2023-10-08T12:39:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8dfdff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d819df00 con 0x7fa8d8072c20 2023-10-08T12:39:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8dfdff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d819e0c0 con 0x7fa8d8073540 2023-10-08T12:39:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8ddb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d8072c20 0x7fa8d8198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8dd39a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d8073540 0x7fa8d81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8ddb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d8072c20 0x7fa8d8198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51118/0 (socket says 172.21.15.59:51118) 2023-10-08T12:39:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8ddb9b700 1 -- 172.21.15.59:0/457418299 learned_addr learned my addr 172.21.15.59:0/457418299 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8de39c700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d810cf70 0x7fa8d819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8ddb9b700 1 -- 172.21.15.59:0/457418299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d8073540 msgr2=0x7fa8d81993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8ddb9b700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d8073540 0x7fa8d81993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8ddb9b700 1 -- 172.21.15.59:0/457418299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d810cf70 msgr2=0x7fa8d819d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8ddb9b700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d810cf70 0x7fa8d819d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8ddb9b700 1 -- 172.21.15.59:0/457418299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4009520 con 0x7fa8d8072c20 2023-10-08T12:39:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.374+0000 7fa8dd39a700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d8073540 0x7fa8d81993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.375+0000 7fa8ddb9b700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d8072c20 0x7fa8d8198e70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4005950 tx=0x7fa8d400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.375+0000 7fa8ceffd700 1 -- 172.21.15.59:0/457418299 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d401c070 con 0x7fa8d8072c20 2023-10-08T12:39:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.375+0000 7fa8ceffd700 1 -- 172.21.15.59:0/457418299 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8d400bb20 con 0x7fa8d8072c20 2023-10-08T12:39:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.375+0000 7fa8ceffd700 1 -- 172.21.15.59:0/457418299 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40038e0 con 0x7fa8d8072c20 2023-10-08T12:39:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.375+0000 7fa8dfdff700 1 -- 172.21.15.59:0/457418299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d819e340 con 0x7fa8d8072c20 2023-10-08T12:39:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.375+0000 7fa8dfdff700 1 -- 172.21.15.59:0/457418299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d819e5c0 con 0x7fa8d8072c20 2023-10-08T12:39:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.376+0000 7fa8dfdff700 1 -- 172.21.15.59:0/457418299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d8108180 con 0x7fa8d8072c20 2023-10-08T12:39:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.380+0000 7fa8ceffd700 1 -- 172.21.15.59:0/457418299 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa8d4020030 con 0x7fa8d8072c20 2023-10-08T12:39:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.381+0000 7fa8ceffd700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8c40a14d0 0x7fa8c40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.382+0000 7fa8ceffd700 1 -- 172.21.15.59:0/457418299 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fa8d40cd680 con 0x7fa8d8072c20 2023-10-08T12:39:11.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.382+0000 7fa8dd39a700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8c40a14d0 0x7fa8c40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:11.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.382+0000 7fa8ceffd700 1 -- 172.21.15.59:0/457418299 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa8d40970a0 con 0x7fa8d8072c20 2023-10-08T12:39:11.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.383+0000 7fa8dd39a700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8c40a14d0 0x7fa8c40a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa8d819a3c0 tx=0x7fa8c8009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:11.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:11.604+0000 7fa8dfdff700 1 -- 172.21.15.59:0/457418299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa8d80742d0 con 0x7fa8d8072c20 2023-10-08T12:39:12.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.194+0000 7fa8ceffd700 1 -- 172.21.15.59:0/457418299 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa8d409a6c0 con 0x7fa8d8072c20 2023-10-08T12:39:12.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 -- 172.21.15.59:0/457418299 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8c40a14d0 msgr2=0x7fa8c40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:12.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8c40a14d0 0x7fa8c40a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa8d819a3c0 tx=0x7fa8c8009310 comp rx=0 tx=0).stop 2023-10-08T12:39:12.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 -- 172.21.15.59:0/457418299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d8072c20 msgr2=0x7fa8d8198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:12.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d8072c20 0x7fa8d8198e70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4005950 tx=0x7fa8d400fa00 comp rx=0 tx=0).stop 2023-10-08T12:39:12.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 -- 172.21.15.59:0/457418299 shutdown_connections 2023-10-08T12:39:12.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8c40a14d0 0x7fa8c40a3990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:12.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d8072c20 0x7fa8d8198e70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:12.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d810cf70 0x7fa8d819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:12.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 --2- 172.21.15.59:0/457418299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d8073540 0x7fa8d81993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:12.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 -- 172.21.15.59:0/457418299 >> 172.21.15.59:0/457418299 conn(0x7fa8d80fc200 msgr2=0x7fa8d80fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:12.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 -- 172.21.15.59:0/457418299 shutdown_connections 2023-10-08T12:39:12.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.198+0000 7fa8dfdff700 1 -- 172.21.15.59:0/457418299 wait complete. 2023-10-08T12:39:12.200 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2023-10-08T12:39:12.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T12:39:12.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.431+0000 7f803adff700 1 -- 172.21.15.59:0/4150912487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8034073540 msgr2=0x7f803410ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.431+0000 7f803adff700 1 --2- 172.21.15.59:0/4150912487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8034073540 0x7f803410ca30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8024009990 tx=0x7f8024009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.431+0000 7f803adff700 1 -- 172.21.15.59:0/4150912487 shutdown_connections 2023-10-08T12:39:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.431+0000 7f803adff700 1 --2- 172.21.15.59:0/4150912487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8034072c20 0x7f8034073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.431+0000 7f803adff700 1 --2- 172.21.15.59:0/4150912487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f803410cf70 0x7f803410f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.431+0000 7f803adff700 1 --2- 172.21.15.59:0/4150912487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8034073540 0x7f803410ca30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.431+0000 7f803adff700 1 -- 172.21.15.59:0/4150912487 >> 172.21.15.59:0/4150912487 conn(0x7f80340fc200 msgr2=0x7f80340fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.431+0000 7f803adff700 1 -- 172.21.15.59:0/4150912487 shutdown_connections 2023-10-08T12:39:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.432+0000 7f803adff700 1 -- 172.21.15.59:0/4150912487 wait complete. 2023-10-08T12:39:12.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.432+0000 7f803adff700 1 Processor -- start 2023-10-08T12:39:12.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f803adff700 1 -- start start 2023-10-08T12:39:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f803adff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8034072c20 0x7f8034198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f803adff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8034073540 0x7f80341993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f803adff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f803410cf70 0x7f803419d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f803adff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803419dd90 con 0x7f8034072c20 2023-10-08T12:39:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f803adff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803419df00 con 0x7f803410cf70 2023-10-08T12:39:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f803adff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803419e0c0 con 0x7f8034073540 2023-10-08T12:39:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f802bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8034073540 0x7f80341993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f802bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8034073540 0x7f80341993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:50360/0 (socket says 172.21.15.59:50360) 2023-10-08T12:39:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f802bfff700 1 -- 172.21.15.59:0/3932822381 learned_addr learned my addr 172.21.15.59:0/3932822381 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f8038b9b700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8034072c20 0x7f8034198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.433+0000 7f803939c700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f803410cf70 0x7f803419d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.434+0000 7f8038b9b700 1 -- 172.21.15.59:0/3932822381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8034073540 msgr2=0x7f80341993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.434+0000 7f8038b9b700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8034073540 0x7f80341993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.434+0000 7f8038b9b700 1 -- 172.21.15.59:0/3932822381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f803410cf70 msgr2=0x7f803419d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.434+0000 7f8038b9b700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f803410cf70 0x7f803419d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.434+0000 7f8038b9b700 1 -- 172.21.15.59:0/3932822381 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240095f0 con 0x7f8034072c20 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.434+0000 7f803939c700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f803410cf70 0x7f803419d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.434+0000 7f8038b9b700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8034072c20 0x7f8034198e70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f803000e9f0 tx=0x7f803000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.434+0000 7f8029ffb700 1 -- 172.21.15.59:0/3932822381 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803000c9c0 con 0x7f8034072c20 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.434+0000 7f8029ffb700 1 -- 172.21.15.59:0/3932822381 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8030010430 con 0x7f8034072c20 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.434+0000 7f803adff700 1 -- 172.21.15.59:0/3932822381 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803419e3a0 con 0x7f8034072c20 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.434+0000 7f8029ffb700 1 -- 172.21.15.59:0/3932822381 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030018680 con 0x7f8034072c20 2023-10-08T12:39:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.435+0000 7f803adff700 1 -- 172.21.15.59:0/3932822381 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80341a5be0 con 0x7f8034072c20 2023-10-08T12:39:12.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.436+0000 7f803adff700 1 -- 172.21.15.59:0/3932822381 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8034108180 con 0x7f8034072c20 2023-10-08T12:39:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.440+0000 7f8029ffb700 1 -- 172.21.15.59:0/3932822381 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8030010860 con 0x7f8034072c20 2023-10-08T12:39:12.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.441+0000 7f8029ffb700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f801c0a14d0 0x7f801c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:12.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.441+0000 7f8029ffb700 1 -- 172.21.15.59:0/3932822381 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7712+0+0 (secure 0 0 0) 0x7f8030014070 con 0x7f8034072c20 2023-10-08T12:39:12.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.441+0000 7f802bfff700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f801c0a14d0 0x7f801c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:12.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.442+0000 7f802bfff700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f801c0a14d0 0x7f801c0a3990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f803419a3c0 tx=0x7f802400b280 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.444+0000 7f8029ffb700 1 -- 172.21.15.59:0/3932822381 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8030096690 con 0x7f8034072c20 2023-10-08T12:39:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:12 smithi173 ceph-mon[135182]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:12.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:12 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:12.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:12 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3917521759' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T12:39:12.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:12 smithi059 ceph-mon[98489]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:12.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:12 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:12.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:12 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3917521759' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T12:39:12.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:12 smithi092 ceph-mon[134093]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:12.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:12 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:12.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:12 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3917521759' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T12:39:12.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:12.663+0000 7f803adff700 1 -- 172.21.15.59:0/3932822381 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f80340742d0 con 0x7f8034072c20 2023-10-08T12:39:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.195+0000 7f8029ffb700 1 -- 172.21.15.59:0/3932822381 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8030099cb0 con 0x7f8034072c20 2023-10-08T12:39:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.199+0000 7f803adff700 1 -- 172.21.15.59:0/3932822381 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f801c0a14d0 msgr2=0x7f801c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.199+0000 7f803adff700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f801c0a14d0 0x7f801c0a3990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f803419a3c0 tx=0x7f802400b280 comp rx=0 tx=0).stop 2023-10-08T12:39:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.199+0000 7f803adff700 1 -- 172.21.15.59:0/3932822381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8034072c20 msgr2=0x7f8034198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.199+0000 7f803adff700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8034072c20 0x7f8034198e70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f803000e9f0 tx=0x7f803000ed00 comp rx=0 tx=0).stop 2023-10-08T12:39:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.199+0000 7f803adff700 1 -- 172.21.15.59:0/3932822381 shutdown_connections 2023-10-08T12:39:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.199+0000 7f803adff700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f801c0a14d0 0x7f801c0a3990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.199+0000 7f803adff700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f803410cf70 0x7f803419d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.199+0000 7f803adff700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8034072c20 0x7f8034198e70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.199+0000 7f803adff700 1 --2- 172.21.15.59:0/3932822381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8034073540 0x7f80341993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.199+0000 7f803adff700 1 -- 172.21.15.59:0/3932822381 >> 172.21.15.59:0/3932822381 conn(0x7f80340fc200 msgr2=0x7f80340fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.200+0000 7f803adff700 1 -- 172.21.15.59:0/3932822381 shutdown_connections 2023-10-08T12:39:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.202+0000 7f803adff700 1 -- 172.21.15.59:0/3932822381 wait complete. 2023-10-08T12:39:13.217 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2023-10-08T12:39:13.238 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T12:39:13.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.449+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2487837592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff258101100 msgr2=0x7ff25810d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:13.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.449+0000 7ff25f1ff700 1 --2- 172.21.15.59:0/2487837592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff258101100 0x7ff25810d610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff25000b0a0 tx=0x7ff25000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:13.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.449+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2487837592 shutdown_connections 2023-10-08T12:39:13.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.449+0000 7ff25f1ff700 1 --2- 172.21.15.59:0/2487837592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff258106750 0x7ff258106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:13.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.449+0000 7ff25f1ff700 1 --2- 172.21.15.59:0/2487837592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff258101100 0x7ff25810d610 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:13.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.449+0000 7ff25f1ff700 1 --2- 172.21.15.59:0/2487837592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258100740 0x7ff258100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:13.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.449+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2487837592 >> 172.21.15.59:0/2487837592 conn(0x7ff2580fc230 msgr2=0x7ff2580fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:13.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.449+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2487837592 shutdown_connections 2023-10-08T12:39:13.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.449+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2487837592 wait complete. 2023-10-08T12:39:13.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.450+0000 7ff25f1ff700 1 Processor -- start 2023-10-08T12:39:13.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.450+0000 7ff25f1ff700 1 -- start start 2023-10-08T12:39:13.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.450+0000 7ff25f1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258100740 0x7ff258198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:13.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.450+0000 7ff25f1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff258101100 0x7ff2581993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:13.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.450+0000 7ff25f1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff258106750 0x7ff25819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:13.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.450+0000 7ff25f1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25819dd00 con 0x7ff258106750 2023-10-08T12:39:13.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.450+0000 7ff25f1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25819de70 con 0x7ff258101100 2023-10-08T12:39:13.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.450+0000 7ff25f1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25819e030 con 0x7ff258100740 2023-10-08T12:39:13.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff25d79c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff258106750 0x7ff25819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:13.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff25d79c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff258106750 0x7ff25819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48094/0 (socket says 172.21.15.59:48094) 2023-10-08T12:39:13.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff25d79c700 1 -- 172.21.15.59:0/2014330617 learned_addr learned my addr 172.21.15.59:0/2014330617 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:13.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff25cf9b700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258100740 0x7ff258198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:13.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff257fff700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff258101100 0x7ff2581993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:13.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff25d79c700 1 -- 172.21.15.59:0/2014330617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258100740 msgr2=0x7ff258198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:13.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff25d79c700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258100740 0x7ff258198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:13.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff25d79c700 1 -- 172.21.15.59:0/2014330617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff258101100 msgr2=0x7ff2581993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:13.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff25d79c700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff258101100 0x7ff2581993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:13.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff25d79c700 1 -- 172.21.15.59:0/2014330617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c009520 con 0x7ff258106750 2023-10-08T12:39:13.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff257fff700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff258101100 0x7ff2581993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:13.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.451+0000 7ff25d79c700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff258106750 0x7ff25819d6c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff25000b070 tx=0x7ff2500077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:13.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.452+0000 7ff255ffb700 1 -- 172.21.15.59:0/2014330617 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25000e040 con 0x7ff258106750 2023-10-08T12:39:13.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.452+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2014330617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff250009d00 con 0x7ff258106750 2023-10-08T12:39:13.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.452+0000 7ff255ffb700 1 -- 172.21.15.59:0/2014330617 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2500094c0 con 0x7ff258106750 2023-10-08T12:39:13.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.452+0000 7ff255ffb700 1 -- 172.21.15.59:0/2014330617 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2500044e0 con 0x7ff258106750 2023-10-08T12:39:13.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.452+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2014330617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2581a5970 con 0x7ff258106750 2023-10-08T12:39:13.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.453+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2014330617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff258101e80 con 0x7ff258106750 2023-10-08T12:39:13.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.455+0000 7ff255ffb700 1 -- 172.21.15.59:0/2014330617 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff250004640 con 0x7ff258106750 2023-10-08T12:39:13.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.456+0000 7ff255ffb700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2480a14d0 0x7ff2480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:13.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.456+0000 7ff255ffb700 1 -- 172.21.15.59:0/2014330617 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8094+0+0 (secure 0 0 0) 0x7ff2500ce230 con 0x7ff258106750 2023-10-08T12:39:13.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.457+0000 7ff25cf9b700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2480a14d0 0x7ff2480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:13.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.457+0000 7ff25cf9b700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2480a14d0 0x7ff2480a3990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009d50 tx=0x7ff24c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:13.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.459+0000 7ff255ffb700 1 -- 172.21.15.59:0/2014330617 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff250097960 con 0x7ff258106750 2023-10-08T12:39:13.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:13 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/457418299' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T12:39:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:13 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T12:39:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:13 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:13 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:13 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T12:39:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:13 smithi173 ceph-mon[135182]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T12:39:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:13 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3932822381' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T12:39:13.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:13 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/457418299' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T12:39:13.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:13 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T12:39:13.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:13 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:13.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:13 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:13.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:13 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T12:39:13.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:13 smithi059 ceph-mon[98489]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T12:39:13.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:13 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3932822381' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T12:39:13.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:13 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/457418299' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T12:39:13.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:13 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T12:39:13.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:13 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:13.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:13 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:13.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:13 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T12:39:13.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:13 smithi092 ceph-mon[134093]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T12:39:13.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:13 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3932822381' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T12:39:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:13.721+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2014330617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff2581106b0 con 0x7ff258106750 2023-10-08T12:39:14.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:14 smithi173 ceph-mon[135182]: pgmap v250: 33 pgs: 15 creating+peering, 1 active+clean, 17 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:39:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:14 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3932822381' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T12:39:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:14 smithi173 ceph-mon[135182]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T12:39:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:14 smithi173 ceph-mon[135182]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T12:39:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:14 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:39:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:14 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2014330617' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T12:39:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:14 smithi173 ceph-mon[135182]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-08T12:39:14.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:14 smithi059 ceph-mon[98489]: pgmap v250: 33 pgs: 15 creating+peering, 1 active+clean, 17 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:39:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:14 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3932822381' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T12:39:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:14 smithi059 ceph-mon[98489]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T12:39:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:14 smithi059 ceph-mon[98489]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T12:39:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:14 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:39:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:14 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2014330617' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T12:39:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:14 smithi059 ceph-mon[98489]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-08T12:39:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:14 smithi092 ceph-mon[134093]: pgmap v250: 33 pgs: 15 creating+peering, 1 active+clean, 17 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:39:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:14 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3932822381' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T12:39:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:14 smithi092 ceph-mon[134093]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T12:39:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:14.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:14 smithi092 ceph-mon[134093]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T12:39:14.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:14 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:39:14.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:14 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2014330617' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T12:39:14.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:14 smithi092 ceph-mon[134093]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-08T12:39:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.695+0000 7ff255ffb700 1 -- 172.21.15.59:0/2014330617 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff25009af80 con 0x7ff258106750 2023-10-08T12:39:14.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.699+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2014330617 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2480a14d0 msgr2=0x7ff2480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:14.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.699+0000 7ff25f1ff700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2480a14d0 0x7ff2480a3990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009d50 tx=0x7ff24c009260 comp rx=0 tx=0).stop 2023-10-08T12:39:14.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.699+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2014330617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff258106750 msgr2=0x7ff25819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:14.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.699+0000 7ff25f1ff700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff258106750 0x7ff25819d6c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff25000b070 tx=0x7ff2500077f0 comp rx=0 tx=0).stop 2023-10-08T12:39:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.699+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2014330617 shutdown_connections 2023-10-08T12:39:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.699+0000 7ff25f1ff700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff2480a14d0 0x7ff2480a3990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.699+0000 7ff25f1ff700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff258106750 0x7ff25819d6c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.699+0000 7ff25f1ff700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258100740 0x7ff258198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.699+0000 7ff25f1ff700 1 --2- 172.21.15.59:0/2014330617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff258101100 0x7ff2581993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.699+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2014330617 >> 172.21.15.59:0/2014330617 conn(0x7ff2580fc230 msgr2=0x7ff25810ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.699+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2014330617 shutdown_connections 2023-10-08T12:39:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.700+0000 7ff25f1ff700 1 -- 172.21.15.59:0/2014330617 wait complete. 2023-10-08T12:39:14.703 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T12:39:14.724 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:39:14.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.941+0000 7f594afff700 1 -- 172.21.15.59:0/235117402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5944100ff0 msgr2=0x7f594410d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:14.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.941+0000 7f594afff700 1 --2- 172.21.15.59:0/235117402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5944100ff0 0x7f594410d500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f593c00b0a0 tx=0x7f593c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:14.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.941+0000 7f594afff700 1 -- 172.21.15.59:0/235117402 shutdown_connections 2023-10-08T12:39:14.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.941+0000 7f594afff700 1 --2- 172.21.15.59:0/235117402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944106640 0x7f5944106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:14.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.941+0000 7f594afff700 1 --2- 172.21.15.59:0/235117402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5944100ff0 0x7f594410d500 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:14.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.941+0000 7f594afff700 1 --2- 172.21.15.59:0/235117402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5944100630 0x7f5944100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:14.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.941+0000 7f594afff700 1 -- 172.21.15.59:0/235117402 >> 172.21.15.59:0/235117402 conn(0x7f59440fc1a0 msgr2=0x7f59440fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:14.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.941+0000 7f594afff700 1 -- 172.21.15.59:0/235117402 shutdown_connections 2023-10-08T12:39:14.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.941+0000 7f594afff700 1 -- 172.21.15.59:0/235117402 wait complete. 2023-10-08T12:39:14.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.943+0000 7f594afff700 1 Processor -- start 2023-10-08T12:39:14.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.943+0000 7f594afff700 1 -- start start 2023-10-08T12:39:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.943+0000 7f594afff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5944100630 0x7f594419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f594afff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944100ff0 0x7f594419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f594afff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5944106640 0x7f59441968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f594afff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944196f10 con 0x7f5944100630 2023-10-08T12:39:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f594afff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944197080 con 0x7f5944100ff0 2023-10-08T12:39:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f594afff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944197240 con 0x7f5944106640 2023-10-08T12:39:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f5943fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944100ff0 0x7f594419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f5943fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944100ff0 0x7f594419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51168/0 (socket says 172.21.15.59:51168) 2023-10-08T12:39:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f5948d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5944100630 0x7f594419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f5943fff700 1 -- 172.21.15.59:0/3969296725 learned_addr learned my addr 172.21.15.59:0/3969296725 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f594959c700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5944106640 0x7f59441968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f5943fff700 1 -- 172.21.15.59:0/3969296725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5944106640 msgr2=0x7f59441968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f5943fff700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5944106640 0x7f59441968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f5943fff700 1 -- 172.21.15.59:0/3969296725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5944100630 msgr2=0x7f594419c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f5943fff700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5944100630 0x7f594419c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.944+0000 7f5943fff700 1 -- 172.21.15.59:0/3969296725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938009520 con 0x7f5944100ff0 2023-10-08T12:39:14.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.945+0000 7f5943fff700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944100ff0 0x7f594419cc60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f593000e9a0 tx=0x7f593000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:14.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.945+0000 7f5941ffb700 1 -- 172.21.15.59:0/3969296725 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930009790 con 0x7f5944100ff0 2023-10-08T12:39:14.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.945+0000 7f5941ffb700 1 -- 172.21.15.59:0/3969296725 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5930010430 con 0x7f5944100ff0 2023-10-08T12:39:14.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.945+0000 7f5941ffb700 1 -- 172.21.15.59:0/3969296725 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930018680 con 0x7f5944100ff0 2023-10-08T12:39:14.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.945+0000 7f594afff700 1 -- 172.21.15.59:0/3969296725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c009d00 con 0x7f5944100ff0 2023-10-08T12:39:14.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.945+0000 7f594afff700 1 -- 172.21.15.59:0/3969296725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59441a3530 con 0x7f5944100ff0 2023-10-08T12:39:14.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.946+0000 7f594afff700 1 -- 172.21.15.59:0/3969296725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5944108c50 con 0x7f5944100ff0 2023-10-08T12:39:14.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.948+0000 7f5941ffb700 1 -- 172.21.15.59:0/3969296725 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f59300105a0 con 0x7f5944100ff0 2023-10-08T12:39:14.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.950+0000 7f5941ffb700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59340a1550 0x7f59340a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:14.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.951+0000 7f5941ffb700 1 -- 172.21.15.59:0/3969296725 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f5930014070 con 0x7f5944100ff0 2023-10-08T12:39:14.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.951+0000 7f5948d9b700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59340a1550 0x7f59340a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:14.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.951+0000 7f5948d9b700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59340a1550 0x7f59340a3a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5938009d70 tx=0x7f5938009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:14.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:14.951+0000 7f5941ffb700 1 -- 172.21.15.59:0/3969296725 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5930096550 con 0x7f5944100ff0 2023-10-08T12:39:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.184+0000 7f594afff700 1 -- 172.21.15.59:0/3969296725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5944197d40 con 0x7f5944100ff0 2023-10-08T12:39:15.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.186+0000 7f5941ffb700 1 -- 172.21.15.59:0/3969296725 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22409 (secure 0 0 0) 0x7f5930099b70 con 0x7f5944100ff0 2023-10-08T12:39:15.187 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:15.187 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":83,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:39:13.721839+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:39:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 -- 172.21.15.59:0/3969296725 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59340a1550 msgr2=0x7f59340a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59340a1550 0x7f59340a3a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5938009d70 tx=0x7f5938009260 comp rx=0 tx=0).stop 2023-10-08T12:39:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 -- 172.21.15.59:0/3969296725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944100ff0 msgr2=0x7f594419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944100ff0 0x7f594419cc60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f593000e9a0 tx=0x7f593000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 -- 172.21.15.59:0/3969296725 shutdown_connections 2023-10-08T12:39:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59340a1550 0x7f59340a3a10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5944106640 0x7f59441968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5944100630 0x7f594419c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 --2- 172.21.15.59:0/3969296725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944100ff0 0x7f594419cc60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 -- 172.21.15.59:0/3969296725 >> 172.21.15.59:0/3969296725 conn(0x7f59440fc1a0 msgr2=0x7f59440fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 -- 172.21.15.59:0/3969296725 shutdown_connections 2023-10-08T12:39:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.190+0000 7f594afff700 1 -- 172.21.15.59:0/3969296725 wait complete. 2023-10-08T12:39:15.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:39:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.426+0000 7fa83619d700 1 -- 172.21.15.59:0/3141075265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa830072c20 msgr2=0x7fa830073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.426+0000 7fa83619d700 1 --2- 172.21.15.59:0/3141075265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa830072c20 0x7fa830073000 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0098f0 tx=0x7fa82c009c00 comp rx=0 tx=0).stop 2023-10-08T12:39:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.426+0000 7fa83619d700 1 -- 172.21.15.59:0/3141075265 shutdown_connections 2023-10-08T12:39:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.426+0000 7fa83619d700 1 --2- 172.21.15.59:0/3141075265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa83010ce30 0x7fa83010f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.426+0000 7fa83619d700 1 --2- 172.21.15.59:0/3141075265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa830072c20 0x7fa830073000 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.426+0000 7fa83619d700 1 --2- 172.21.15.59:0/3141075265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa830073540 0x7fa83010c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.426+0000 7fa83619d700 1 -- 172.21.15.59:0/3141075265 >> 172.21.15.59:0/3141075265 conn(0x7fa8300fc0e0 msgr2=0x7fa8300fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.426+0000 7fa83619d700 1 -- 172.21.15.59:0/3141075265 shutdown_connections 2023-10-08T12:39:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.426+0000 7fa83619d700 1 -- 172.21.15.59:0/3141075265 wait complete. 2023-10-08T12:39:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.428+0000 7fa83619d700 1 Processor -- start 2023-10-08T12:39:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.428+0000 7fa83619d700 1 -- start start 2023-10-08T12:39:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.428+0000 7fa83619d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa830072c20 0x7fa830198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83619d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830073540 0x7fa830199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83619d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83010ce30 0x7fa83019c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83619d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83019cb60 con 0x7fa83010ce30 2023-10-08T12:39:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83619d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83019ccd0 con 0x7fa830072c20 2023-10-08T12:39:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83619d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83019ce90 con 0x7fa830073540 2023-10-08T12:39:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83519b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa830072c20 0x7fa830198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83519b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa830072c20 0x7fa830198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51192/0 (socket says 172.21.15.59:51192) 2023-10-08T12:39:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83519b700 1 -- 172.21.15.59:0/772959086 learned_addr learned my addr 172.21.15.59:0/772959086 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83599c700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83010ce30 0x7fa83019c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83499a700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830073540 0x7fa830199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83519b700 1 -- 172.21.15.59:0/772959086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830073540 msgr2=0x7fa830199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83519b700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830073540 0x7fa830199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83519b700 1 -- 172.21.15.59:0/772959086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83010ce30 msgr2=0x7fa83019c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83519b700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83010ce30 0x7fa83019c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83519b700 1 -- 172.21.15.59:0/772959086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c009520 con 0x7fa830072c20 2023-10-08T12:39:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.429+0000 7fa83519b700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa830072c20 0x7fa830198d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa82c005950 tx=0x7fa82c010ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.430+0000 7fa8267fc700 1 -- 172.21.15.59:0/772959086 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c01c070 con 0x7fa830072c20 2023-10-08T12:39:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.430+0000 7fa83619d700 1 -- 172.21.15.59:0/772959086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83019d110 con 0x7fa830072c20 2023-10-08T12:39:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.430+0000 7fa8267fc700 1 -- 172.21.15.59:0/772959086 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa82c00bba0 con 0x7fa830072c20 2023-10-08T12:39:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.430+0000 7fa8267fc700 1 -- 172.21.15.59:0/772959086 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0039c0 con 0x7fa830072c20 2023-10-08T12:39:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.430+0000 7fa83619d700 1 -- 172.21.15.59:0/772959086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83019d3e0 con 0x7fa830072c20 2023-10-08T12:39:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.431+0000 7fa83619d700 1 -- 172.21.15.59:0/772959086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa830108040 con 0x7fa830072c20 2023-10-08T12:39:15.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.433+0000 7fa8267fc700 1 -- 172.21.15.59:0/772959086 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa82c020030 con 0x7fa830072c20 2023-10-08T12:39:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.435+0000 7fa8267fc700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa81c0a14d0 0x7fa81c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.435+0000 7fa8267fc700 1 -- 172.21.15.59:0/772959086 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fa82c0cdc50 con 0x7fa830072c20 2023-10-08T12:39:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.435+0000 7fa83499a700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa81c0a14d0 0x7fa81c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.436+0000 7fa83499a700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa81c0a14d0 0x7fa81c0a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa83019a240 tx=0x7fa820009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:15.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.439+0000 7fa8267fc700 1 -- 172.21.15.59:0/772959086 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa82c097300 con 0x7fa830072c20 2023-10-08T12:39:15.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:15 smithi173 ceph-mon[135182]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T12:39:15.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:15 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2014330617' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T12:39:15.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:15 smithi173 ceph-mon[135182]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-08T12:39:15.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:15 smithi173 ceph-mon[135182]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-08T12:39:15.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:15 smithi173 ceph-mon[135182]: pgmap v253: 97 pgs: 17 creating+peering, 14 active+clean, 66 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:15.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:15 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3969296725' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:15.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:15 smithi059 ceph-mon[98489]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T12:39:15.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:15 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2014330617' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T12:39:15.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:15 smithi059 ceph-mon[98489]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-08T12:39:15.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:15 smithi059 ceph-mon[98489]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-08T12:39:15.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:15 smithi059 ceph-mon[98489]: pgmap v253: 97 pgs: 17 creating+peering, 14 active+clean, 66 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:15.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:15 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3969296725' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:15.626 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:15 smithi092 ceph-mon[134093]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T12:39:15.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:15 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2014330617' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T12:39:15.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:15 smithi092 ceph-mon[134093]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-08T12:39:15.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:15 smithi092 ceph-mon[134093]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-08T12:39:15.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:15 smithi092 ceph-mon[134093]: pgmap v253: 97 pgs: 17 creating+peering, 14 active+clean, 66 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:39:15.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:15 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3969296725' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:15.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.694+0000 7fa83619d700 1 -- 172.21.15.59:0/772959086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8300742d0 con 0x7fa830072c20 2023-10-08T12:39:15.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.696+0000 7fa8267fc700 1 -- 172.21.15.59:0/772959086 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22396 (secure 0 0 0) 0x7fa82c09a920 con 0x7fa830072c20 2023-10-08T12:39:15.696 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:15.697 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":84,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:39:15.190640+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:39:15.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.699+0000 7fa83619d700 1 -- 172.21.15.59:0/772959086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa81c0a14d0 msgr2=0x7fa81c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.699+0000 7fa83619d700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa81c0a14d0 0x7fa81c0a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa83019a240 tx=0x7fa820009260 comp rx=0 tx=0).stop 2023-10-08T12:39:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.699+0000 7fa83619d700 1 -- 172.21.15.59:0/772959086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa830072c20 msgr2=0x7fa830198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.699+0000 7fa83619d700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa830072c20 0x7fa830198d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa82c005950 tx=0x7fa82c010ff0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.700+0000 7fa83619d700 1 -- 172.21.15.59:0/772959086 shutdown_connections 2023-10-08T12:39:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.700+0000 7fa83619d700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa81c0a14d0 0x7fa81c0a3990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.700+0000 7fa83619d700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa830072c20 0x7fa830198d30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.700+0000 7fa83619d700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83010ce30 0x7fa83019c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.700+0000 7fa83619d700 1 --2- 172.21.15.59:0/772959086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa830073540 0x7fa830199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.700+0000 7fa83619d700 1 -- 172.21.15.59:0/772959086 >> 172.21.15.59:0/772959086 conn(0x7fa8300fc0e0 msgr2=0x7fa8300fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.700+0000 7fa83619d700 1 -- 172.21.15.59:0/772959086 shutdown_connections 2023-10-08T12:39:15.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.700+0000 7fa83619d700 1 -- 172.21.15.59:0/772959086 wait complete. 2023-10-08T12:39:15.720 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T12:39:15.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.937+0000 7f6ff67ff700 1 -- 172.21.15.59:0/1082549906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff01010f0 msgr2=0x7f6ff010d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:15.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.937+0000 7f6ff67ff700 1 --2- 172.21.15.59:0/1082549906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff01010f0 0x7f6ff010d600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009f90 tx=0x7f6fe800b330 comp rx=0 tx=0).stop 2023-10-08T12:39:15.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.937+0000 7f6ff67ff700 1 -- 172.21.15.59:0/1082549906 shutdown_connections 2023-10-08T12:39:15.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.937+0000 7f6ff67ff700 1 --2- 172.21.15.59:0/1082549906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff01010f0 0x7f6ff010d600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.937+0000 7f6ff67ff700 1 --2- 172.21.15.59:0/1082549906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ff0106740 0x7f6ff0106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.937+0000 7f6ff67ff700 1 --2- 172.21.15.59:0/1082549906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0100730 0x7f6ff0100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.937+0000 7f6ff67ff700 1 -- 172.21.15.59:0/1082549906 >> 172.21.15.59:0/1082549906 conn(0x7f6ff00fc200 msgr2=0x7f6ff00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.937+0000 7f6ff67ff700 1 -- 172.21.15.59:0/1082549906 shutdown_connections 2023-10-08T12:39:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.937+0000 7f6ff67ff700 1 -- 172.21.15.59:0/1082549906 wait complete. 2023-10-08T12:39:15.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.938+0000 7f6ff67ff700 1 Processor -- start 2023-10-08T12:39:15.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.938+0000 7f6ff67ff700 1 -- start start 2023-10-08T12:39:15.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.938+0000 7f6ff67ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ff0100730 0x7f6ff0198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:15.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.938+0000 7f6ff67ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff01010f0 0x7f6ff01992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:15.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.938+0000 7f6ff67ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0106740 0x7f6ff019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:15.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.938+0000 7f6ff67ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff019dc90 con 0x7f6ff01010f0 2023-10-08T12:39:15.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.938+0000 7f6ff67ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff019de00 con 0x7f6ff0106740 2023-10-08T12:39:15.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.938+0000 7f6ff67ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff019dfc0 con 0x7f6ff0100730 2023-10-08T12:39:15.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.939+0000 7f6feffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ff0100730 0x7f6ff0198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:15.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.939+0000 7f6feffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ff0100730 0x7f6ff0198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:50428/0 (socket says 172.21.15.59:50428) 2023-10-08T12:39:15.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.939+0000 7f6feffff700 1 -- 172.21.15.59:0/2060037508 learned_addr learned my addr 172.21.15.59:0/2060037508 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:15.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.939+0000 7f6fef7fe700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff01010f0 0x7f6ff01992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:15.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.939+0000 7f6ff4d9c700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0106740 0x7f6ff019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:15.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.939+0000 7f6feffff700 1 -- 172.21.15.59:0/2060037508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0106740 msgr2=0x7f6ff019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:15.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.939+0000 7f6feffff700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0106740 0x7f6ff019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.939+0000 7f6feffff700 1 -- 172.21.15.59:0/2060037508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff01010f0 msgr2=0x7f6ff01992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:15.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.939+0000 7f6feffff700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff01010f0 0x7f6ff01992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:15.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.939+0000 7f6feffff700 1 -- 172.21.15.59:0/2060037508 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe8009c40 con 0x7f6ff0100730 2023-10-08T12:39:15.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.939+0000 7f6feffff700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ff0100730 0x7f6ff0198d70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000e9c0 tx=0x7f6fe000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:15.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.940+0000 7f6fed7fa700 1 -- 172.21.15.59:0/2060037508 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0004a30 con 0x7f6ff0100730 2023-10-08T12:39:15.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.940+0000 7f6fed7fa700 1 -- 172.21.15.59:0/2060037508 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fe000cc80 con 0x7f6ff0100730 2023-10-08T12:39:15.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.940+0000 7f6ff67ff700 1 -- 172.21.15.59:0/2060037508 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff019e2a0 con 0x7f6ff0100730 2023-10-08T12:39:15.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.940+0000 7f6fed7fa700 1 -- 172.21.15.59:0/2060037508 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00054e0 con 0x7f6ff0100730 2023-10-08T12:39:15.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.940+0000 7f6ff67ff700 1 -- 172.21.15.59:0/2060037508 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff01a5ae0 con 0x7f6ff0100730 2023-10-08T12:39:15.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.941+0000 7f6ff67ff700 1 -- 172.21.15.59:0/2060037508 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff0101e70 con 0x7f6ff0100730 2023-10-08T12:39:15.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.943+0000 7f6fed7fa700 1 -- 172.21.15.59:0/2060037508 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f6fe0004b90 con 0x7f6ff0100730 2023-10-08T12:39:15.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.944+0000 7f6fed7fa700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6fd80a1550 0x7f6fd80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:15.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.944+0000 7f6fed7fa700 1 -- 172.21.15.59:0/2060037508 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f6fe0014070 con 0x7f6ff0100730 2023-10-08T12:39:15.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.944+0000 7f6fef7fe700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6fd80a1550 0x7f6fd80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:15.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.945+0000 7f6fef7fe700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6fd80a1550 0x7f6fd80a3a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ff019a2c0 tx=0x7f6fe40073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:15.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:15.946+0000 7f6fed7fa700 1 -- 172.21.15.59:0/2060037508 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6fe0096350 con 0x7f6ff0100730 2023-10-08T12:39:16.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:16.239+0000 7f6ff67ff700 1 -- 172.21.15.59:0/2060037508 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6ff0067530 con 0x7f6ff0100730 2023-10-08T12:39:16.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:16 smithi173 ceph-mon[135182]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T12:39:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:16 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/772959086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:16 smithi173 ceph-mon[135182]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T12:39:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:16 smithi173 ceph-mon[135182]: Cluster is now healthy 2023-10-08T12:39:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:16 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] up:active 2023-10-08T12:39:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:16 smithi173 ceph-mon[135182]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:16 smithi173 ceph-mon[135182]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:16 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:16 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:16 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:16 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:16 smithi059 ceph-mon[98489]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T12:39:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:16 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/772959086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:16 smithi059 ceph-mon[98489]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T12:39:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:16 smithi059 ceph-mon[98489]: Cluster is now healthy 2023-10-08T12:39:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:16 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] up:active 2023-10-08T12:39:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:16 smithi059 ceph-mon[98489]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:16 smithi059 ceph-mon[98489]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:16 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:16 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:16.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:16 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:16.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:16 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:16 smithi092 ceph-mon[134093]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T12:39:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:16 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/772959086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:16 smithi092 ceph-mon[134093]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T12:39:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:16 smithi092 ceph-mon[134093]: Cluster is now healthy 2023-10-08T12:39:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:16 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] up:active 2023-10-08T12:39:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:16 smithi092 ceph-mon[134093]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:16 smithi092 ceph-mon[134093]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:16 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:16 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:16 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:16.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:16 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:17.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.208+0000 7f6fed7fa700 1 -- 172.21.15.59:0/2060037508 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6fe0099970 con 0x7f6ff0100730 2023-10-08T12:39:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 -- 172.21.15.59:0/2060037508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6fd80a1550 msgr2=0x7f6fd80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6fd80a1550 0x7f6fd80a3a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ff019a2c0 tx=0x7f6fe40073d0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 -- 172.21.15.59:0/2060037508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ff0100730 msgr2=0x7f6ff0198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ff0100730 0x7f6ff0198d70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000e9c0 tx=0x7f6fe000ecd0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 -- 172.21.15.59:0/2060037508 shutdown_connections 2023-10-08T12:39:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6fd80a1550 0x7f6fd80a3a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0106740 0x7f6ff019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ff0100730 0x7f6ff0198d70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 --2- 172.21.15.59:0/2060037508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff01010f0 0x7f6ff01992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 -- 172.21.15.59:0/2060037508 >> 172.21.15.59:0/2060037508 conn(0x7f6ff00fc200 msgr2=0x7f6ff010bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 -- 172.21.15.59:0/2060037508 shutdown_connections 2023-10-08T12:39:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.211+0000 7f6ff67ff700 1 -- 172.21.15.59:0/2060037508 wait complete. 2023-10-08T12:39:17.230 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2023-10-08T12:39:17.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-08T12:39:17.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.439+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4162096781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ae8106740 msgr2=0x7f5ae8106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:17.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.439+0000 7f5aef5ff700 1 --2- 172.21.15.59:0/4162096781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ae8106740 0x7f5ae8106b20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009990 tx=0x7f5ae4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.439+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4162096781 shutdown_connections 2023-10-08T12:39:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.439+0000 7f5aef5ff700 1 --2- 172.21.15.59:0/4162096781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ae8106740 0x7f5ae8106b20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.439+0000 7f5aef5ff700 1 --2- 172.21.15.59:0/4162096781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae81010f0 0x7f5ae810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.439+0000 7f5aef5ff700 1 --2- 172.21.15.59:0/4162096781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ae8100730 0x7f5ae8100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.439+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4162096781 >> 172.21.15.59:0/4162096781 conn(0x7f5ae80fc200 msgr2=0x7f5ae80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.439+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4162096781 shutdown_connections 2023-10-08T12:39:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.439+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4162096781 wait complete. 2023-10-08T12:39:17.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.440+0000 7f5aef5ff700 1 Processor -- start 2023-10-08T12:39:17.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.441+0000 7f5aef5ff700 1 -- start start 2023-10-08T12:39:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.441+0000 7f5aef5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ae8100730 0x7f5ae8198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.441+0000 7f5aef5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae81010f0 0x7f5ae81992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.441+0000 7f5aef5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ae8106740 0x7f5ae819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.441+0000 7f5aef5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae819dca0 con 0x7f5ae81010f0 2023-10-08T12:39:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.441+0000 7f5aef5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae819de10 con 0x7f5ae8106740 2023-10-08T12:39:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.441+0000 7f5aef5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae819dfd0 con 0x7f5ae8100730 2023-10-08T12:39:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aecb9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae81010f0 0x7f5ae81992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aecb9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae81010f0 0x7f5ae81992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48188/0 (socket says 172.21.15.59:48188) 2023-10-08T12:39:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aecb9a700 1 -- 172.21.15.59:0/4037990420 learned_addr learned my addr 172.21.15.59:0/4037990420 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aed39b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ae8100730 0x7f5ae8198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aedb9c700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ae8106740 0x7f5ae819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aecb9a700 1 -- 172.21.15.59:0/4037990420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ae8100730 msgr2=0x7f5ae8198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aecb9a700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ae8100730 0x7f5ae8198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aecb9a700 1 -- 172.21.15.59:0/4037990420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ae8106740 msgr2=0x7f5ae819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aecb9a700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ae8106740 0x7f5ae819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aecb9a700 1 -- 172.21.15.59:0/4037990420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae40095f0 con 0x7f5ae81010f0 2023-10-08T12:39:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aedb9c700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ae8106740 0x7f5ae819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aed39b700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ae8100730 0x7f5ae8198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.442+0000 7f5aecb9a700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae81010f0 0x7f5ae81992c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800e9a0 tx=0x7f5ad800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.443+0000 7f5ade7fc700 1 -- 172.21.15.59:0/4037990420 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8009790 con 0x7f5ae81010f0 2023-10-08T12:39:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.443+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4037990420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae819e2b0 con 0x7f5ae81010f0 2023-10-08T12:39:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.443+0000 7f5ade7fc700 1 -- 172.21.15.59:0/4037990420 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ad800cbd0 con 0x7f5ae81010f0 2023-10-08T12:39:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.443+0000 7f5ade7fc700 1 -- 172.21.15.59:0/4037990420 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8018680 con 0x7f5ae81010f0 2023-10-08T12:39:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.443+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4037990420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae81a5af0 con 0x7f5ae81010f0 2023-10-08T12:39:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.444+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4037990420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae8101e70 con 0x7f5ae81010f0 2023-10-08T12:39:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.446+0000 7f5ade7fc700 1 -- 172.21.15.59:0/4037990420 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5ad800cd40 con 0x7f5ae81010f0 2023-10-08T12:39:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.447+0000 7f5ade7fc700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ad40a1550 0x7f5ad40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.447+0000 7f5ade7fc700 1 -- 172.21.15.59:0/4037990420 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f5ad8014070 con 0x7f5ae81010f0 2023-10-08T12:39:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.448+0000 7f5aed39b700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ad40a1550 0x7f5ad40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.448+0000 7f5aed39b700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ad40a1550 0x7f5ad40a3a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400b2e0 tx=0x7f5ae4005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.450+0000 7f5ade7fc700 1 -- 172.21.15.59:0/4037990420 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5ad80968b0 con 0x7f5ae81010f0 2023-10-08T12:39:17.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:17 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2060037508' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T12:39:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:17 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T12:39:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:17 smithi173 ceph-mon[135182]: pgmap v255: 97 pgs: 17 creating+peering, 56 active+clean, 24 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 669 B/s wr, 1 op/s 2023-10-08T12:39:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:39:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:17.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:17 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2060037508' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T12:39:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:17 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T12:39:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:17 smithi059 ceph-mon[98489]: pgmap v255: 97 pgs: 17 creating+peering, 56 active+clean, 24 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 669 B/s wr, 1 op/s 2023-10-08T12:39:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:39:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:17.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:17 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2060037508' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T12:39:17.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:17 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T12:39:17.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:17 smithi092 ceph-mon[134093]: pgmap v255: 97 pgs: 17 creating+peering, 56 active+clean, 24 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 669 B/s wr, 1 op/s 2023-10-08T12:39:17.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:17.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:17.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:17.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:39:17.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:39:17.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:17.711+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4037990420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f5ae81106a0 con 0x7f5ae81010f0 2023-10-08T12:39:18.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.212+0000 7f5ade7fc700 1 -- 172.21.15.59:0/4037990420 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) v1 ==== 121+0+0 (secure 0 0 0) 0x7f5ad80260c0 con 0x7f5ae81010f0 2023-10-08T12:39:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.215+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4037990420 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ad40a1550 msgr2=0x7f5ad40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.215+0000 7f5aef5ff700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ad40a1550 0x7f5ad40a3a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400b2e0 tx=0x7f5ae4005fd0 comp rx=0 tx=0).stop 2023-10-08T12:39:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.215+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4037990420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae81010f0 msgr2=0x7f5ae81992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.215+0000 7f5aef5ff700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae81010f0 0x7f5ae81992c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800e9a0 tx=0x7f5ad800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:39:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.215+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4037990420 shutdown_connections 2023-10-08T12:39:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.215+0000 7f5aef5ff700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ad40a1550 0x7f5ad40a3a10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.215+0000 7f5aef5ff700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ae8106740 0x7f5ae819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.215+0000 7f5aef5ff700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ae8100730 0x7f5ae8198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.215+0000 7f5aef5ff700 1 --2- 172.21.15.59:0/4037990420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae81010f0 0x7f5ae81992c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.215+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4037990420 >> 172.21.15.59:0/4037990420 conn(0x7f5ae80fc200 msgr2=0x7f5ae810b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.216+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4037990420 shutdown_connections 2023-10-08T12:39:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.216+0000 7f5aef5ff700 1 -- 172.21.15.59:0/4037990420 wait complete. 2023-10-08T12:39:18.238 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-08T12:39:18.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.446+0000 7f808e1ff700 1 -- 172.21.15.59:0/1487465117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80880734b0 msgr2=0x7f8088111200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:18.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.446+0000 7f808e1ff700 1 --2- 172.21.15.59:0/1487465117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80880734b0 0x7f8088111200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f807c0098f0 tx=0x7f807c009c00 comp rx=0 tx=0).stop 2023-10-08T12:39:18.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.446+0000 7f808e1ff700 1 -- 172.21.15.59:0/1487465117 shutdown_connections 2023-10-08T12:39:18.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.447+0000 7f808e1ff700 1 --2- 172.21.15.59:0/1487465117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088111740 0x7f8088113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:18.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.447+0000 7f808e1ff700 1 --2- 172.21.15.59:0/1487465117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8088072b90 0x7f8088072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:18.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.447+0000 7f808e1ff700 1 --2- 172.21.15.59:0/1487465117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80880734b0 0x7f8088111200 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:18.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.447+0000 7f808e1ff700 1 -- 172.21.15.59:0/1487465117 >> 172.21.15.59:0/1487465117 conn(0x7f80880fc200 msgr2=0x7f80880fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:18.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.447+0000 7f808e1ff700 1 -- 172.21.15.59:0/1487465117 shutdown_connections 2023-10-08T12:39:18.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.447+0000 7f808e1ff700 1 -- 172.21.15.59:0/1487465117 wait complete. 2023-10-08T12:39:18.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.448+0000 7f808e1ff700 1 Processor -- start 2023-10-08T12:39:18.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.448+0000 7f808e1ff700 1 -- start start 2023-10-08T12:39:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f808e1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8088072b90 0x7f808819d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f808e1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80880734b0 0x7f808819d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f808e1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088111740 0x7f80881a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f808e1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80881a21a0 con 0x7f80880734b0 2023-10-08T12:39:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f808e1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80881a2310 con 0x7f8088111740 2023-10-08T12:39:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f808e1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80881a24d0 con 0x7f8088072b90 2023-10-08T12:39:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f8086ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80880734b0 0x7f808819d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f80877fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8088072b90 0x7f808819d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f8086ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80880734b0 0x7f808819d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48216/0 (socket says 172.21.15.59:48216) 2023-10-08T12:39:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f8086ffd700 1 -- 172.21.15.59:0/1725259792 learned_addr learned my addr 172.21.15.59:0/1725259792 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f8087fff700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088111740 0x7f80881a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f8086ffd700 1 -- 172.21.15.59:0/1725259792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8088072b90 msgr2=0x7f808819d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f8086ffd700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8088072b90 0x7f808819d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f8086ffd700 1 -- 172.21.15.59:0/1725259792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088111740 msgr2=0x7f80881a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.449+0000 7f8086ffd700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088111740 0x7f80881a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.450+0000 7f8086ffd700 1 -- 172.21.15.59:0/1725259792 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c009520 con 0x7f80880734b0 2023-10-08T12:39:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.450+0000 7f80877fe700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8088072b90 0x7f808819d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.450+0000 7f8086ffd700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80880734b0 0x7f808819d7c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f807c00fa00 tx=0x7f807c00fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.450+0000 7f8084ff9700 1 -- 172.21.15.59:0/1725259792 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c01c070 con 0x7f80880734b0 2023-10-08T12:39:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.450+0000 7f8084ff9700 1 -- 172.21.15.59:0/1725259792 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f807c00bb20 con 0x7f80880734b0 2023-10-08T12:39:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.450+0000 7f808e1ff700 1 -- 172.21.15.59:0/1725259792 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80881a2750 con 0x7f80880734b0 2023-10-08T12:39:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.450+0000 7f8084ff9700 1 -- 172.21.15.59:0/1725259792 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c004930 con 0x7f80880734b0 2023-10-08T12:39:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.450+0000 7f808e1ff700 1 -- 172.21.15.59:0/1725259792 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80881a9ff0 con 0x7f80880734b0 2023-10-08T12:39:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.451+0000 7f808e1ff700 1 -- 172.21.15.59:0/1725259792 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8088103c20 con 0x7f80880734b0 2023-10-08T12:39:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.453+0000 7f8084ff9700 1 -- 172.21.15.59:0/1725259792 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f807c020070 con 0x7f80880734b0 2023-10-08T12:39:18.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.455+0000 7f8084ff9700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f80700a14d0 0x7f80700a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:18.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.456+0000 7f8084ff9700 1 -- 172.21.15.59:0/1725259792 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f807c0cd900 con 0x7f80880734b0 2023-10-08T12:39:18.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.456+0000 7f80877fe700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f80700a14d0 0x7f80700a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:18.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.456+0000 7f80877fe700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f80700a14d0 0x7f80700a3990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8078005fd0 tx=0x7f8078009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:18.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.460+0000 7f8084ff9700 1 -- 172.21.15.59:0/1725259792 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f807c096fb0 con 0x7f80880734b0 2023-10-08T12:39:18.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:18 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T12:39:18.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:18 smithi173 ceph-mon[135182]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:18.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:18 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4037990420' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T12:39:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:18 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T12:39:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:18 smithi059 ceph-mon[98489]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:18 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4037990420' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T12:39:18.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:18 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T12:39:18.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:18 smithi092 ceph-mon[134093]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:18.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:18 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4037990420' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T12:39:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:18.722+0000 7f808e1ff700 1 -- 172.21.15.59:0/1725259792 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f808819e580 con 0x7f80880734b0 2023-10-08T12:39:19.126 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 12:39:18 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-b[173578]: 2023-10-08T12:39:18.744+0000 7f103fa2f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T12:39:19.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:19 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4037990420' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T12:39:19.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:19 smithi173 ceph-mon[135182]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:19.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:19 smithi173 ceph-mon[135182]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2023-10-08T12:39:19.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:19 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1725259792' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T12:39:19.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:19 smithi173 ceph-mon[135182]: pgmap v256: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 2.3 KiB/s wr, 7 op/s 2023-10-08T12:39:19.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:19 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4037990420' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T12:39:19.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:19 smithi059 ceph-mon[98489]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:19.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:19 smithi059 ceph-mon[98489]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2023-10-08T12:39:19.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:19 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1725259792' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T12:39:19.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:19 smithi059 ceph-mon[98489]: pgmap v256: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 2.3 KiB/s wr, 7 op/s 2023-10-08T12:39:19.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:19 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4037990420' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T12:39:19.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:19 smithi092 ceph-mon[134093]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:39:19.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:19 smithi092 ceph-mon[134093]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2023-10-08T12:39:19.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:19 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1725259792' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T12:39:19.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:19 smithi092 ceph-mon[134093]: pgmap v256: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 2.3 KiB/s wr, 7 op/s 2023-10-08T12:39:19.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.704+0000 7f8084ff9700 1 -- 172.21.15.59:0/1725259792 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) v1 ==== 115+0+0 (secure 0 0 0) 0x7f807c09a5d0 con 0x7f80880734b0 2023-10-08T12:39:19.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 -- 172.21.15.59:0/1725259792 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f80700a14d0 msgr2=0x7f80700a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:19.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f80700a14d0 0x7f80700a3990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8078005fd0 tx=0x7f8078009310 comp rx=0 tx=0).stop 2023-10-08T12:39:19.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 -- 172.21.15.59:0/1725259792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80880734b0 msgr2=0x7f808819d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:19.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80880734b0 0x7f808819d7c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f807c00fa00 tx=0x7f807c00fa30 comp rx=0 tx=0).stop 2023-10-08T12:39:19.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 -- 172.21.15.59:0/1725259792 shutdown_connections 2023-10-08T12:39:19.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f80700a14d0 0x7f80700a3990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:19.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088111740 0x7f80881a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:19.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8088072b90 0x7f808819d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:19.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 --2- 172.21.15.59:0/1725259792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80880734b0 0x7f808819d7c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:19.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 -- 172.21.15.59:0/1725259792 >> 172.21.15.59:0/1725259792 conn(0x7f80880fc200 msgr2=0x7f80880fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:19.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 -- 172.21.15.59:0/1725259792 shutdown_connections 2023-10-08T12:39:19.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.708+0000 7f808e1ff700 1 -- 172.21.15.59:0/1725259792 wait complete. 2023-10-08T12:39:19.728 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2023-10-08T12:39:19.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-08T12:39:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.937+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1515206751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3a0100730 msgr2=0x7ff3a0100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.937+0000 7ff3a77ff700 1 --2- 172.21.15.59:0/1515206751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3a0100730 0x7ff3a0100bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff390009990 tx=0x7ff390009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.937+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1515206751 shutdown_connections 2023-10-08T12:39:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.937+0000 7ff3a77ff700 1 --2- 172.21.15.59:0/1515206751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a01010f0 0x7ff3a010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.937+0000 7ff3a77ff700 1 --2- 172.21.15.59:0/1515206751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a0106740 0x7ff3a0106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.937+0000 7ff3a77ff700 1 --2- 172.21.15.59:0/1515206751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3a0100730 0x7ff3a0100bb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.937+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1515206751 >> 172.21.15.59:0/1515206751 conn(0x7ff3a00fc200 msgr2=0x7ff3a00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.937+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1515206751 shutdown_connections 2023-10-08T12:39:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.937+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1515206751 wait complete. 2023-10-08T12:39:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.938+0000 7ff3a77ff700 1 Processor -- start 2023-10-08T12:39:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.938+0000 7ff3a77ff700 1 -- start start 2023-10-08T12:39:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a77ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3a0100730 0x7ff3a019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a77ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a01010f0 0x7ff3a019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a77ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a0106740 0x7ff3a0196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a77ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0197080 con 0x7ff3a0100730 2023-10-08T12:39:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a77ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a01971f0 con 0x7ff3a01010f0 2023-10-08T12:39:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a77ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a01973b0 con 0x7ff3a0106740 2023-10-08T12:39:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a4d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a01010f0 0x7ff3a019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a559b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3a0100730 0x7ff3a019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a4d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a01010f0 0x7ff3a019ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51286/0 (socket says 172.21.15.59:51286) 2023-10-08T12:39:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a4d9a700 1 -- 172.21.15.59:0/1557765889 learned_addr learned my addr 172.21.15.59:0/1557765889 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a5d9c700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a0106740 0x7ff3a0196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a559b700 1 -- 172.21.15.59:0/1557765889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a0106740 msgr2=0x7ff3a0196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a559b700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a0106740 0x7ff3a0196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a559b700 1 -- 172.21.15.59:0/1557765889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a01010f0 msgr2=0x7ff3a019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a559b700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a01010f0 0x7ff3a019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a559b700 1 -- 172.21.15.59:0/1557765889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3900095f0 con 0x7ff3a0100730 2023-10-08T12:39:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.939+0000 7ff3a4d9a700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a01010f0 0x7ff3a019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.940+0000 7ff3a559b700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3a0100730 0x7ff3a019c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00d750 tx=0x7ff39c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.940+0000 7ff3967fc700 1 -- 172.21.15.59:0/1557765889 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c004020 con 0x7ff3a0100730 2023-10-08T12:39:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.940+0000 7ff3967fc700 1 -- 172.21.15.59:0/1557765889 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff39c004830 con 0x7ff3a0100730 2023-10-08T12:39:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.940+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1557765889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a0197690 con 0x7ff3a0100730 2023-10-08T12:39:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.940+0000 7ff3967fc700 1 -- 172.21.15.59:0/1557765889 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0054c0 con 0x7ff3a0100730 2023-10-08T12:39:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.940+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1557765889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a01a38e0 con 0x7ff3a0100730 2023-10-08T12:39:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.941+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1557765889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a0108d50 con 0x7ff3a0100730 2023-10-08T12:39:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.943+0000 7ff3967fc700 1 -- 172.21.15.59:0/1557765889 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff39c0049a0 con 0x7ff3a0100730 2023-10-08T12:39:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.944+0000 7ff3967fc700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff38c0a1550 0x7ff38c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.945+0000 7ff3967fc700 1 -- 172.21.15.59:0/1557765889 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7ff39c0cc5c0 con 0x7ff3a0100730 2023-10-08T12:39:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.945+0000 7ff3a4d9a700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff38c0a1550 0x7ff38c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:19.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.945+0000 7ff3a4d9a700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff38c0a1550 0x7ff38c0a3a10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0197be0 tx=0x7ff39000b560 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:19.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:19.948+0000 7ff3967fc700 1 -- 172.21.15.59:0/1557765889 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff39c095be0 con 0x7ff3a0100730 2023-10-08T12:39:20.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.194+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1557765889 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3a0197ee0 con 0x7ff38c0a1550 2023-10-08T12:39:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.237+0000 7ff3967fc700 1 -- 172.21.15.59:0/1557765889 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff3a0197ee0 con 0x7ff38c0a1550 2023-10-08T12:39:20.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.239+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1557765889 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff38c0a1550 msgr2=0x7ff38c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.239+0000 7ff3a77ff700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff38c0a1550 0x7ff38c0a3a10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0197be0 tx=0x7ff39000b560 comp rx=0 tx=0).stop 2023-10-08T12:39:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.239+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1557765889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3a0100730 msgr2=0x7ff3a019c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.239+0000 7ff3a77ff700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3a0100730 0x7ff3a019c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00d750 tx=0x7ff39c00da60 comp rx=0 tx=0).stop 2023-10-08T12:39:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.240+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1557765889 shutdown_connections 2023-10-08T12:39:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.240+0000 7ff3a77ff700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff38c0a1550 0x7ff38c0a3a10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.240+0000 7ff3a77ff700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a0106740 0x7ff3a0196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.240+0000 7ff3a77ff700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3a0100730 0x7ff3a019c8f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.240+0000 7ff3a77ff700 1 --2- 172.21.15.59:0/1557765889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a01010f0 0x7ff3a019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.240+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1557765889 >> 172.21.15.59:0/1557765889 conn(0x7ff3a00fc200 msgr2=0x7ff3a00fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:20.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.240+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1557765889 shutdown_connections 2023-10-08T12:39:20.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.240+0000 7ff3a77ff700 1 -- 172.21.15.59:0/1557765889 wait complete. 2023-10-08T12:39:20.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-08T12:39:20.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.465+0000 7f52839ff700 1 -- 172.21.15.59:0/3762718531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f527c101100 msgr2=0x7f527c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:20.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.465+0000 7f52839ff700 1 --2- 172.21.15.59:0/3762718531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f527c101100 0x7f527c10d610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f527400b0a0 tx=0x7f527400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.465+0000 7f52839ff700 1 -- 172.21.15.59:0/3762718531 shutdown_connections 2023-10-08T12:39:20.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.465+0000 7f52839ff700 1 --2- 172.21.15.59:0/3762718531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f527c101100 0x7f527c10d610 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.465+0000 7f52839ff700 1 --2- 172.21.15.59:0/3762718531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f527c106750 0x7f527c106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.465+0000 7f52839ff700 1 --2- 172.21.15.59:0/3762718531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c100740 0x7f527c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.465+0000 7f52839ff700 1 -- 172.21.15.59:0/3762718531 >> 172.21.15.59:0/3762718531 conn(0x7f527c0fc230 msgr2=0x7f527c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:20.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.465+0000 7f52839ff700 1 -- 172.21.15.59:0/3762718531 shutdown_connections 2023-10-08T12:39:20.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.465+0000 7f52839ff700 1 -- 172.21.15.59:0/3762718531 wait complete. 2023-10-08T12:39:20.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.467+0000 7f52839ff700 1 Processor -- start 2023-10-08T12:39:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.467+0000 7f52839ff700 1 -- start start 2023-10-08T12:39:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f52839ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c100740 0x7f527c19c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f52839ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f527c101100 0x7f527c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f52839ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f527c106750 0x7f527c1969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f52839ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c197030 con 0x7f527c101100 2023-10-08T12:39:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f52839ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c1971a0 con 0x7f527c100740 2023-10-08T12:39:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f52839ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c197360 con 0x7f527c106750 2023-10-08T12:39:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f5280f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f527c101100 0x7f527c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f5280f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f527c101100 0x7f527c19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48268/0 (socket says 172.21.15.59:48268) 2023-10-08T12:39:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f5280f9a700 1 -- 172.21.15.59:0/3556748037 learned_addr learned my addr 172.21.15.59:0/3556748037 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f528179b700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c100740 0x7f527c19c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f5281f9c700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f527c106750 0x7f527c1969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f5280f9a700 1 -- 172.21.15.59:0/3556748037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f527c106750 msgr2=0x7f527c1969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f5280f9a700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f527c106750 0x7f527c1969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f5280f9a700 1 -- 172.21.15.59:0/3556748037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c100740 msgr2=0x7f527c19c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f5280f9a700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c100740 0x7f527c19c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.468+0000 7f5280f9a700 1 -- 172.21.15.59:0/3556748037 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5274009d00 con 0x7f527c101100 2023-10-08T12:39:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.469+0000 7f5280f9a700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f527c101100 0x7f527c19cd10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f526c00e9a0 tx=0x7f526c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.469+0000 7f52727fc700 1 -- 172.21.15.59:0/3556748037 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c009790 con 0x7f527c101100 2023-10-08T12:39:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.469+0000 7f52839ff700 1 -- 172.21.15.59:0/3556748037 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c197640 con 0x7f527c101100 2023-10-08T12:39:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.469+0000 7f52727fc700 1 -- 172.21.15.59:0/3556748037 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f526c00cbd0 con 0x7f527c101100 2023-10-08T12:39:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.469+0000 7f52727fc700 1 -- 172.21.15.59:0/3556748037 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c018680 con 0x7f527c101100 2023-10-08T12:39:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.469+0000 7f52839ff700 1 -- 172.21.15.59:0/3556748037 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c1a3870 con 0x7f527c101100 2023-10-08T12:39:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.470+0000 7f52839ff700 1 -- 172.21.15.59:0/3556748037 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c108d60 con 0x7f527c101100 2023-10-08T12:39:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.472+0000 7f52727fc700 1 -- 172.21.15.59:0/3556748037 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f526c00cd40 con 0x7f527c101100 2023-10-08T12:39:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.474+0000 7f52727fc700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52680a1550 0x7f52680a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.474+0000 7f52727fc700 1 -- 172.21.15.59:0/3556748037 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f526c014070 con 0x7f527c101100 2023-10-08T12:39:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.474+0000 7f528179b700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52680a1550 0x7f52680a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.475+0000 7f528179b700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52680a1550 0x7f52680a3a10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f527c0fe2d0 tx=0x7f5278009190 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:20.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.479+0000 7f52727fc700 1 -- 172.21.15.59:0/3556748037 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f526c052100 con 0x7f527c101100 2023-10-08T12:39:20.514 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:39:20 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:39:20.201+0000 7f063f4ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:39:20.515 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:39:20 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:39:20.201+0000 7f063f4ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:39:20.515 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:39:20 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:39:20.201+0000 7f063f4ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:39:20.515 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:39:20 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:39:20.201+0000 7f063f4ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:39:20.515 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:39:20 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:39:20.201+0000 7f063f4ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:39:20.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.730+0000 7f52839ff700 1 -- 172.21.15.59:0/3556748037 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f527c0674e0 con 0x7f52680a1550 2023-10-08T12:39:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.734+0000 7f52727fc700 1 -- 172.21.15.59:0/3556748037 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f527c0674e0 con 0x7f52680a1550 2023-10-08T12:39:20.734 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv_0/202eee2d-2031-4e19-9e80-b87fa983295a 2023-10-08T12:39:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 -- 172.21.15.59:0/3556748037 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52680a1550 msgr2=0x7f52680a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52680a1550 0x7f52680a3a10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f527c0fe2d0 tx=0x7f5278009190 comp rx=0 tx=0).stop 2023-10-08T12:39:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 -- 172.21.15.59:0/3556748037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f527c101100 msgr2=0x7f527c19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f527c101100 0x7f527c19cd10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f526c00e9a0 tx=0x7f526c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 -- 172.21.15.59:0/3556748037 shutdown_connections 2023-10-08T12:39:20.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52680a1550 0x7f52680a3a10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c100740 0x7f527c19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f527c106750 0x7f527c1969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 --2- 172.21.15.59:0/3556748037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f527c101100 0x7f527c19cd10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 -- 172.21.15.59:0/3556748037 >> 172.21.15.59:0/3556748037 conn(0x7f527c0fc230 msgr2=0x7f527c0fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:20.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 -- 172.21.15.59:0/3556748037 shutdown_connections 2023-10-08T12:39:20.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.737+0000 7f52839ff700 1 -- 172.21.15.59:0/3556748037 wait complete. 2023-10-08T12:39:20.756 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-08T12:39:20.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.964+0000 7f20e6bff700 1 -- 172.21.15.59:0/1035147652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0100730 msgr2=0x7f20e0100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.964+0000 7f20e6bff700 1 --2- 172.21.15.59:0/1035147652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0100730 0x7f20e0100bb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0098f0 tx=0x7f20cc009c00 comp rx=0 tx=0).stop 2023-10-08T12:39:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.964+0000 7f20e6bff700 1 -- 172.21.15.59:0/1035147652 shutdown_connections 2023-10-08T12:39:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.964+0000 7f20e6bff700 1 --2- 172.21.15.59:0/1035147652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e01010f0 0x7f20e010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.964+0000 7f20e6bff700 1 --2- 172.21.15.59:0/1035147652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e0106740 0x7f20e0106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.964+0000 7f20e6bff700 1 --2- 172.21.15.59:0/1035147652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0100730 0x7f20e0100bb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.964+0000 7f20e6bff700 1 -- 172.21.15.59:0/1035147652 >> 172.21.15.59:0/1035147652 conn(0x7f20e00fc200 msgr2=0x7f20e00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.964+0000 7f20e6bff700 1 -- 172.21.15.59:0/1035147652 shutdown_connections 2023-10-08T12:39:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.964+0000 7f20e6bff700 1 -- 172.21.15.59:0/1035147652 wait complete. 2023-10-08T12:39:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.965+0000 7f20e6bff700 1 Processor -- start 2023-10-08T12:39:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.965+0000 7f20e6bff700 1 -- start start 2023-10-08T12:39:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.965+0000 7f20e6bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e0100730 0x7f20e0198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.965+0000 7f20e6bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e01010f0 0x7f20e0199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.965+0000 7f20e6bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0106740 0x7f20e019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.965+0000 7f20e6bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e019dd50 con 0x7f20e0100730 2023-10-08T12:39:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.965+0000 7f20e6bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e019dec0 con 0x7f20e0106740 2023-10-08T12:39:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.965+0000 7f20e6bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e019e080 con 0x7f20e01010f0 2023-10-08T12:39:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20e499b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e0100730 0x7f20e0198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20e499b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e0100730 0x7f20e0198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47112/0 (socket says 172.21.15.59:47112) 2023-10-08T12:39:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20e499b700 1 -- 172.21.15.59:0/3030082689 learned_addr learned my addr 172.21.15.59:0/3030082689 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20e519c700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0106740 0x7f20e019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20dffff700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e01010f0 0x7f20e0199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20e519c700 1 -- 172.21.15.59:0/3030082689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e01010f0 msgr2=0x7f20e0199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20e519c700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e01010f0 0x7f20e0199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20e519c700 1 -- 172.21.15.59:0/3030082689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e0100730 msgr2=0x7f20e0198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20e519c700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e0100730 0x7f20e0198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20e519c700 1 -- 172.21.15.59:0/3030082689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc009520 con 0x7f20e0106740 2023-10-08T12:39:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20e499b700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e0100730 0x7f20e0198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.966+0000 7f20e519c700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0106740 0x7f20e019d710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f20d8007f10 tx=0x7f20d800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.967+0000 7f20ddffb700 1 -- 172.21.15.59:0/3030082689 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8004db0 con 0x7f20e0106740 2023-10-08T12:39:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.967+0000 7f20e6bff700 1 -- 172.21.15.59:0/3030082689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e019e360 con 0x7f20e0106740 2023-10-08T12:39:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.967+0000 7f20ddffb700 1 -- 172.21.15.59:0/3030082689 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20d800f040 con 0x7f20e0106740 2023-10-08T12:39:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.967+0000 7f20e6bff700 1 -- 172.21.15.59:0/3030082689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e01a5ba0 con 0x7f20e0106740 2023-10-08T12:39:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.967+0000 7f20ddffb700 1 -- 172.21.15.59:0/3030082689 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8005910 con 0x7f20e0106740 2023-10-08T12:39:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.968+0000 7f20e6bff700 1 -- 172.21.15.59:0/3030082689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e0101e70 con 0x7f20e0106740 2023-10-08T12:39:20.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:20 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1725259792' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T12:39:20.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:20 smithi173 ceph-mon[135182]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2023-10-08T12:39:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.970+0000 7f20ddffb700 1 -- 172.21.15.59:0/3030082689 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f20d8005000 con 0x7f20e0106740 2023-10-08T12:39:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.971+0000 7f20ddffb700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20d00a1550 0x7f20d00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.971+0000 7f20ddffb700 1 -- 172.21.15.59:0/3030082689 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f20d80cc560 con 0x7f20e0106740 2023-10-08T12:39:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.971+0000 7f20e499b700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20d00a1550 0x7f20d00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.972+0000 7f20e499b700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20d00a1550 0x7f20d00a3a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f20d4005950 tx=0x7f20d4009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:20.973+0000 7f20ddffb700 1 -- 172.21.15.59:0/3030082689 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f20d8095b80 con 0x7f20e0106740 2023-10-08T12:39:21.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:20 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1725259792' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T12:39:21.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:20 smithi059 ceph-mon[98489]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2023-10-08T12:39:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:20 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1725259792' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T12:39:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:20 smithi092 ceph-mon[134093]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2023-10-08T12:39:21.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.220+0000 7f20e6bff700 1 -- 172.21.15.59:0/3030082689 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f20e0067530 con 0x7f20d00a1550 2023-10-08T12:39:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.247+0000 7f20ddffb700 1 -- 172.21.15.59:0/3030082689 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f20e0067530 con 0x7f20d00a1550 2023-10-08T12:39:21.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 -- 172.21.15.59:0/3030082689 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20d00a1550 msgr2=0x7f20d00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20d00a1550 0x7f20d00a3a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f20d4005950 tx=0x7f20d4009310 comp rx=0 tx=0).stop 2023-10-08T12:39:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 -- 172.21.15.59:0/3030082689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0106740 msgr2=0x7f20e019d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0106740 0x7f20e019d710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f20d8007f10 tx=0x7f20d800d3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 -- 172.21.15.59:0/3030082689 shutdown_connections 2023-10-08T12:39:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20d00a1550 0x7f20d00a3a10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0106740 0x7f20e019d710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e0100730 0x7f20e0198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 --2- 172.21.15.59:0/3030082689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e01010f0 0x7f20e0199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 -- 172.21.15.59:0/3030082689 >> 172.21.15.59:0/3030082689 conn(0x7f20e00fc200 msgr2=0x7f20e010bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 -- 172.21.15.59:0/3030082689 shutdown_connections 2023-10-08T12:39:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.249+0000 7f20e6bff700 1 -- 172.21.15.59:0/3030082689 wait complete. 2023-10-08T12:39:21.268 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-08T12:39:21.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.475+0000 7f4e715ff700 1 -- 172.21.15.59:0/1944216588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6c106740 msgr2=0x7f4e6c106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:21.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.475+0000 7f4e715ff700 1 --2- 172.21.15.59:0/1944216588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6c106740 0x7f4e6c106b20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009990 tx=0x7f4e5c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.475+0000 7f4e715ff700 1 -- 172.21.15.59:0/1944216588 shutdown_connections 2023-10-08T12:39:21.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.475+0000 7f4e715ff700 1 --2- 172.21.15.59:0/1944216588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e6c1010f0 0x7f4e6c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.475+0000 7f4e715ff700 1 --2- 172.21.15.59:0/1944216588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6c106740 0x7f4e6c106b20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.475+0000 7f4e715ff700 1 --2- 172.21.15.59:0/1944216588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e6c100730 0x7f4e6c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.475+0000 7f4e715ff700 1 -- 172.21.15.59:0/1944216588 >> 172.21.15.59:0/1944216588 conn(0x7f4e6c0fc200 msgr2=0x7f4e6c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:21.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.475+0000 7f4e715ff700 1 -- 172.21.15.59:0/1944216588 shutdown_connections 2023-10-08T12:39:21.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.475+0000 7f4e715ff700 1 -- 172.21.15.59:0/1944216588 wait complete. 2023-10-08T12:39:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.476+0000 7f4e715ff700 1 Processor -- start 2023-10-08T12:39:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.476+0000 7f4e715ff700 1 -- start start 2023-10-08T12:39:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e715ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e6c100730 0x7f4e6c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e715ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e6c1010f0 0x7f4e6c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e715ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6c106740 0x7f4e6c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e715ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c19dcb0 con 0x7f4e6c106740 2023-10-08T12:39:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e715ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c19de20 con 0x7f4e6c100730 2023-10-08T12:39:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e715ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c19dfe0 con 0x7f4e6c1010f0 2023-10-08T12:39:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e6affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e6c100730 0x7f4e6c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e6affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e6c100730 0x7f4e6c198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:59202/0 (socket says 172.21.15.59:59202) 2023-10-08T12:39:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e6affd700 1 -- 172.21.15.59:0/3944100581 learned_addr learned my addr 172.21.15.59:0/3944100581 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e6b7fe700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6c106740 0x7f4e6c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e6a7fc700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e6c1010f0 0x7f4e6c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e6affd700 1 -- 172.21.15.59:0/3944100581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e6c1010f0 msgr2=0x7f4e6c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e6affd700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e6c1010f0 0x7f4e6c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e6affd700 1 -- 172.21.15.59:0/3944100581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6c106740 msgr2=0x7f4e6c19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e6affd700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6c106740 0x7f4e6c19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e6affd700 1 -- 172.21.15.59:0/3944100581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e64009c40 con 0x7f4e6c100730 2023-10-08T12:39:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.477+0000 7f4e6a7fc700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e6c1010f0 0x7f4e6c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.478+0000 7f4e6affd700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e6c100730 0x7f4e6c198d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000c00 tx=0x7f4e5c005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.478+0000 7f4e53fff700 1 -- 172.21.15.59:0/3944100581 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c01d070 con 0x7f4e6c100730 2023-10-08T12:39:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.478+0000 7f4e53fff700 1 -- 172.21.15.59:0/3944100581 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e5c022470 con 0x7f4e6c100730 2023-10-08T12:39:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.478+0000 7f4e715ff700 1 -- 172.21.15.59:0/3944100581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c0095f0 con 0x7f4e6c100730 2023-10-08T12:39:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.478+0000 7f4e53fff700 1 -- 172.21.15.59:0/3944100581 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c017650 con 0x7f4e6c100730 2023-10-08T12:39:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.478+0000 7f4e715ff700 1 -- 172.21.15.59:0/3944100581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6c1a5920 con 0x7f4e6c100730 2023-10-08T12:39:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.479+0000 7f4e715ff700 1 -- 172.21.15.59:0/3944100581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6c101e70 con 0x7f4e6c100730 2023-10-08T12:39:21.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.482+0000 7f4e53fff700 1 -- 172.21.15.59:0/3944100581 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f4e5c0225e0 con 0x7f4e6c100730 2023-10-08T12:39:21.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.483+0000 7f4e53fff700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4e540a14d0 0x7f4e540a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:21.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.483+0000 7f4e53fff700 1 -- 172.21.15.59:0/3944100581 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f4e5c0ce450 con 0x7f4e6c100730 2023-10-08T12:39:21.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.483+0000 7f4e6a7fc700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4e540a14d0 0x7f4e540a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:21.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.484+0000 7f4e6a7fc700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4e540a14d0 0x7f4e540a3990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c19a2e0 tx=0x7f4e60009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:21.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.485+0000 7f4e53fff700 1 -- 172.21.15.59:0/3944100581 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4e5c097b00 con 0x7f4e6c100730 2023-10-08T12:39:21.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.726+0000 7f4e53fff700 1 -- 172.21.15.59:0/3944100581 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f4e5c097ed0 con 0x7f4e6c100730 2023-10-08T12:39:21.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.739+0000 7f4e715ff700 1 -- 172.21.15.59:0/3944100581 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e6c110650 con 0x7f4e540a14d0 2023-10-08T12:39:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.743+0000 7f4e53fff700 1 -- 172.21.15.59:0/3944100581 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f4e6c110650 con 0x7f4e540a14d0 2023-10-08T12:39:21.743 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/_nogroup/sv_1/65ebba8a-ac05-4349-97a1-9947341e5926 2023-10-08T12:39:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.745+0000 7f4e715ff700 1 -- 172.21.15.59:0/3944100581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4e540a14d0 msgr2=0x7f4e540a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.745+0000 7f4e715ff700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4e540a14d0 0x7f4e540a3990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c19a2e0 tx=0x7f4e60009260 comp rx=0 tx=0).stop 2023-10-08T12:39:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.745+0000 7f4e715ff700 1 -- 172.21.15.59:0/3944100581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e6c100730 msgr2=0x7f4e6c198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.745+0000 7f4e715ff700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e6c100730 0x7f4e6c198d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000c00 tx=0x7f4e5c005e80 comp rx=0 tx=0).stop 2023-10-08T12:39:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.745+0000 7f4e715ff700 1 -- 172.21.15.59:0/3944100581 shutdown_connections 2023-10-08T12:39:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.745+0000 7f4e715ff700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4e540a14d0 0x7f4e540a3990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.745+0000 7f4e715ff700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e6c100730 0x7f4e6c198d90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.745+0000 7f4e715ff700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6c106740 0x7f4e6c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.745+0000 7f4e715ff700 1 --2- 172.21.15.59:0/3944100581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e6c1010f0 0x7f4e6c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.745+0000 7f4e715ff700 1 -- 172.21.15.59:0/3944100581 >> 172.21.15.59:0/3944100581 conn(0x7f4e6c0fc200 msgr2=0x7f4e6c10be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:21.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.745+0000 7f4e715ff700 1 -- 172.21.15.59:0/3944100581 shutdown_connections 2023-10-08T12:39:21.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.746+0000 7f4e715ff700 1 -- 172.21.15.59:0/3944100581 wait complete. 2023-10-08T12:39:21.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:39:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:21 smithi173 ceph-mon[135182]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:21.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:21 smithi173 ceph-mon[135182]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:21.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:21 smithi173 ceph-mon[135182]: pgmap v257: 97 pgs: 97 active+clean; 596 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2023-10-08T12:39:21.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.969+0000 7f4efe7ff700 1 -- 172.21.15.59:0/2873753555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ef8106640 msgr2=0x7f4ef8106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:21.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.969+0000 7f4efe7ff700 1 --2- 172.21.15.59:0/2873753555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ef8106640 0x7f4ef8106a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009990 tx=0x7f4ee8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.969+0000 7f4efe7ff700 1 -- 172.21.15.59:0/2873753555 shutdown_connections 2023-10-08T12:39:21.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.969+0000 7f4efe7ff700 1 --2- 172.21.15.59:0/2873753555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ef8106640 0x7f4ef8106a20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.969+0000 7f4efe7ff700 1 --2- 172.21.15.59:0/2873753555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ef8100ff0 0x7f4ef810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.969+0000 7f4efe7ff700 1 --2- 172.21.15.59:0/2873753555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef8100630 0x7f4ef8100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.969+0000 7f4efe7ff700 1 -- 172.21.15.59:0/2873753555 >> 172.21.15.59:0/2873753555 conn(0x7f4ef80fc1a0 msgr2=0x7f4ef80fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:21.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.969+0000 7f4efe7ff700 1 -- 172.21.15.59:0/2873753555 shutdown_connections 2023-10-08T12:39:21.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.969+0000 7f4efe7ff700 1 -- 172.21.15.59:0/2873753555 wait complete. 2023-10-08T12:39:21.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.971+0000 7f4efe7ff700 1 Processor -- start 2023-10-08T12:39:21.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.971+0000 7f4efe7ff700 1 -- start start 2023-10-08T12:39:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efe7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ef8100630 0x7f4ef8198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efe7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ef8100ff0 0x7f4ef8199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efe7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef8106640 0x7f4ef819c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efe7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef819cb30 con 0x7f4ef8106640 2023-10-08T12:39:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efe7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef819cca0 con 0x7f4ef8100630 2023-10-08T12:39:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efe7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef819ce60 con 0x7f4ef8100ff0 2023-10-08T12:39:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efcd9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef8106640 0x7f4ef819c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efcd9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef8106640 0x7f4ef819c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47144/0 (socket says 172.21.15.59:47144) 2023-10-08T12:39:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efcd9c700 1 -- 172.21.15.59:0/598812763 learned_addr learned my addr 172.21.15.59:0/598812763 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4eeffff700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ef8100ff0 0x7f4ef8199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4ef7fff700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ef8100630 0x7f4ef8198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efcd9c700 1 -- 172.21.15.59:0/598812763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ef8100ff0 msgr2=0x7f4ef8199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efcd9c700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ef8100ff0 0x7f4ef8199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efcd9c700 1 -- 172.21.15.59:0/598812763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ef8100630 msgr2=0x7f4ef8198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efcd9c700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ef8100630 0x7f4ef8198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.972+0000 7f4efcd9c700 1 -- 172.21.15.59:0/598812763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0009520 con 0x7f4ef8106640 2023-10-08T12:39:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.973+0000 7f4efcd9c700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef8106640 0x7f4ef819c530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000ef30 tx=0x7f4ef000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.973+0000 7f4ef5ffb700 1 -- 172.21.15.59:0/598812763 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0018070 con 0x7f4ef8106640 2023-10-08T12:39:21.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.973+0000 7f4ef5ffb700 1 -- 172.21.15.59:0/598812763 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ef000f040 con 0x7f4ef8106640 2023-10-08T12:39:21.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.973+0000 7f4efe7ff700 1 -- 172.21.15.59:0/598812763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee80095f0 con 0x7f4ef8106640 2023-10-08T12:39:21.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.973+0000 7f4ef5ffb700 1 -- 172.21.15.59:0/598812763 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000cd00 con 0x7f4ef8106640 2023-10-08T12:39:21.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.973+0000 7f4efe7ff700 1 -- 172.21.15.59:0/598812763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef81a58c0 con 0x7f4ef8106640 2023-10-08T12:39:21.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.974+0000 7f4efe7ff700 1 -- 172.21.15.59:0/598812763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef8101d70 con 0x7f4ef8106640 2023-10-08T12:39:21.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.976+0000 7f4ef5ffb700 1 -- 172.21.15.59:0/598812763 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f4ef0003a00 con 0x7f4ef8106640 2023-10-08T12:39:21.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.977+0000 7f4ef5ffb700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ee40a1560 0x7f4ee40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:21.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.978+0000 7f4ef5ffb700 1 -- 172.21.15.59:0/598812763 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f4ef00cc9f0 con 0x7f4ef8106640 2023-10-08T12:39:21.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.978+0000 7f4ef7fff700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ee40a1560 0x7f4ee40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:21.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.978+0000 7f4ef7fff700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ee40a1560 0x7f4ee40a3a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800b2e0 tx=0x7f4ee8005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:21.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:21.982+0000 7f4ef5ffb700 1 -- 172.21.15.59:0/598812763 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4ef0095f40 con 0x7f4ef8106640 2023-10-08T12:39:22.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:21 smithi059 ceph-mon[98489]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:22.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:21 smithi059 ceph-mon[98489]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:22.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:21 smithi059 ceph-mon[98489]: pgmap v257: 97 pgs: 97 active+clean; 596 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2023-10-08T12:39:22.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:21 smithi092 ceph-mon[134093]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:22.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:21 smithi092 ceph-mon[134093]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:22.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:21 smithi092 ceph-mon[134093]: pgmap v257: 97 pgs: 97 active+clean; 596 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2023-10-08T12:39:22.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.247+0000 7f4efe7ff700 1 -- 172.21.15.59:0/598812763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ef8110570 con 0x7f4ef8106640 2023-10-08T12:39:22.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.248+0000 7f4ef5ffb700 1 -- 172.21.15.59:0/598812763 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f4ef0099560 con 0x7f4ef8106640 2023-10-08T12:39:22.250 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:22.250 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:39:22.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 -- 172.21.15.59:0/598812763 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ee40a1560 msgr2=0x7f4ee40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:22.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ee40a1560 0x7f4ee40a3a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800b2e0 tx=0x7f4ee8005fd0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 -- 172.21.15.59:0/598812763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef8106640 msgr2=0x7f4ef819c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:22.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef8106640 0x7f4ef819c530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000ef30 tx=0x7f4ef000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 -- 172.21.15.59:0/598812763 shutdown_connections 2023-10-08T12:39:22.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4ee40a1560 0x7f4ee40a3a20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ef8100630 0x7f4ef8198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef8106640 0x7f4ef819c530 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 --2- 172.21.15.59:0/598812763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ef8100ff0 0x7f4ef8199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 -- 172.21.15.59:0/598812763 >> 172.21.15.59:0/598812763 conn(0x7f4ef80fc1a0 msgr2=0x7f4ef810bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:22.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 -- 172.21.15.59:0/598812763 shutdown_connections 2023-10-08T12:39:22.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.251+0000 7f4efe7ff700 1 -- 172.21.15.59:0/598812763 wait complete. 2023-10-08T12:39:22.253 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:39:22.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:39:22.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.476+0000 7fc3591ff700 1 -- 172.21.15.59:0/4138778468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3540734b0 msgr2=0x7fc354111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:22.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.476+0000 7fc3591ff700 1 --2- 172.21.15.59:0/4138778468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3540734b0 0x7fc354111100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc348009990 tx=0x7fc348009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.476+0000 7fc3591ff700 1 -- 172.21.15.59:0/4138778468 shutdown_connections 2023-10-08T12:39:22.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.476+0000 7fc3591ff700 1 --2- 172.21.15.59:0/4138778468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354072b90 0x7fc354072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.476+0000 7fc3591ff700 1 --2- 172.21.15.59:0/4138778468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc354111640 0x7fc354113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.476+0000 7fc3591ff700 1 --2- 172.21.15.59:0/4138778468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3540734b0 0x7fc354111100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.476+0000 7fc3591ff700 1 -- 172.21.15.59:0/4138778468 >> 172.21.15.59:0/4138778468 conn(0x7fc3540fc140 msgr2=0x7fc3540fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:22.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.476+0000 7fc3591ff700 1 -- 172.21.15.59:0/4138778468 shutdown_connections 2023-10-08T12:39:22.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.476+0000 7fc3591ff700 1 -- 172.21.15.59:0/4138778468 wait complete. 2023-10-08T12:39:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.477+0000 7fc3591ff700 1 Processor -- start 2023-10-08T12:39:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.477+0000 7fc3591ff700 1 -- start start 2023-10-08T12:39:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.477+0000 7fc3591ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354072b90 0x7fc35419d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.477+0000 7fc3591ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3540734b0 0x7fc35419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.477+0000 7fc3591ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc354111640 0x7fc3541a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.477+0000 7fc3591ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3541a2030 con 0x7fc354111640 2023-10-08T12:39:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.477+0000 7fc3591ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3541a21a0 con 0x7fc354072b90 2023-10-08T12:39:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.477+0000 7fc3591ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3541a2360 con 0x7fc3540734b0 2023-10-08T12:39:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc35359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc354111640 0x7fc3541a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc35359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc354111640 0x7fc3541a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47156/0 (socket says 172.21.15.59:47156) 2023-10-08T12:39:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc35359e700 1 -- 172.21.15.59:0/2274836853 learned_addr learned my addr 172.21.15.59:0/2274836853 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc352d9d700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354072b90 0x7fc35419d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc35259c700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3540734b0 0x7fc35419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc35359e700 1 -- 172.21.15.59:0/2274836853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3540734b0 msgr2=0x7fc35419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc35359e700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3540734b0 0x7fc35419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc35359e700 1 -- 172.21.15.59:0/2274836853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354072b90 msgr2=0x7fc35419d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc35359e700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354072b90 0x7fc35419d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc35359e700 1 -- 172.21.15.59:0/2274836853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480095f0 con 0x7fc354111640 2023-10-08T12:39:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc35359e700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc354111640 0x7fc3541a19f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00ef90 tx=0x7fc34c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc33bfff700 1 -- 172.21.15.59:0/2274836853 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c018070 con 0x7fc354111640 2023-10-08T12:39:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc33bfff700 1 -- 172.21.15.59:0/2274836853 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc34c00f040 con 0x7fc354111640 2023-10-08T12:39:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc33bfff700 1 -- 172.21.15.59:0/2274836853 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00cda0 con 0x7fc354111640 2023-10-08T12:39:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.478+0000 7fc3591ff700 1 -- 172.21.15.59:0/2274836853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3541a25e0 con 0x7fc354111640 2023-10-08T12:39:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.479+0000 7fc3591ff700 1 -- 172.21.15.59:0/2274836853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3541a9e80 con 0x7fc354111640 2023-10-08T12:39:22.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.480+0000 7fc3591ff700 1 -- 172.21.15.59:0/2274836853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc354103b40 con 0x7fc354111640 2023-10-08T12:39:22.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.481+0000 7fc33bfff700 1 -- 172.21.15.59:0/2274836853 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fc34c003a00 con 0x7fc354111640 2023-10-08T12:39:22.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.483+0000 7fc33bfff700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc33c0a15e0 0x7fc33c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:22.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.483+0000 7fc33bfff700 1 -- 172.21.15.59:0/2274836853 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc34c0cc980 con 0x7fc354111640 2023-10-08T12:39:22.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.483+0000 7fc352d9d700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc33c0a15e0 0x7fc33c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:22.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.484+0000 7fc352d9d700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc33c0a15e0 0x7fc33c0a3aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc344007be0 tx=0x7fc3440073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:22.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.487+0000 7fc33bfff700 1 -- 172.21.15.59:0/2274836853 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc34c095ed0 con 0x7fc354111640 2023-10-08T12:39:22.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.702+0000 7fc3591ff700 1 -- 172.21.15.59:0/2274836853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3540742d0 con 0x7fc354111640 2023-10-08T12:39:22.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.704+0000 7fc33bfff700 1 -- 172.21.15.59:0/2274836853 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22396 (secure 0 0 0) 0x7fc34c0994f0 con 0x7fc354111640 2023-10-08T12:39:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:22.704 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":84,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:39:15.190640+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:39:22.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.706+0000 7fc3591ff700 1 -- 172.21.15.59:0/2274836853 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc33c0a15e0 msgr2=0x7fc33c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:22.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.706+0000 7fc3591ff700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc33c0a15e0 0x7fc33c0a3aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc344007be0 tx=0x7fc3440073d0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.706+0000 7fc3591ff700 1 -- 172.21.15.59:0/2274836853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc354111640 msgr2=0x7fc3541a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:22.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.706+0000 7fc3591ff700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc354111640 0x7fc3541a19f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00ef90 tx=0x7fc34c00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.706+0000 7fc3591ff700 1 -- 172.21.15.59:0/2274836853 shutdown_connections 2023-10-08T12:39:22.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.706+0000 7fc3591ff700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc33c0a15e0 0x7fc33c0a3aa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.706+0000 7fc3591ff700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354072b90 0x7fc35419d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.706+0000 7fc3591ff700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc354111640 0x7fc3541a19f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.706+0000 7fc3591ff700 1 --2- 172.21.15.59:0/2274836853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3540734b0 0x7fc35419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.706+0000 7fc3591ff700 1 -- 172.21.15.59:0/2274836853 >> 172.21.15.59:0/2274836853 conn(0x7fc3540fc140 msgr2=0x7fc3540fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:22.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.707+0000 7fc3591ff700 1 -- 172.21.15.59:0/2274836853 shutdown_connections 2023-10-08T12:39:22.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.707+0000 7fc3591ff700 1 -- 172.21.15.59:0/2274836853 wait complete. 2023-10-08T12:39:22.728 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T12:39:22.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:39:22.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.932+0000 7f94f81ff700 1 -- 172.21.15.59:0/52606306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f010ce70 msgr2=0x7f94f010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.932+0000 7f94f81ff700 1 --2- 172.21.15.59:0/52606306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f010ce70 0x7f94f010f2e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f94e800b0a0 tx=0x7f94e800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.932+0000 7f94f81ff700 1 -- 172.21.15.59:0/52606306 shutdown_connections 2023-10-08T12:39:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.932+0000 7f94f81ff700 1 --2- 172.21.15.59:0/52606306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f0072c20 0x7f94f0073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.932+0000 7f94f81ff700 1 --2- 172.21.15.59:0/52606306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f010ce70 0x7f94f010f2e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.932+0000 7f94f81ff700 1 --2- 172.21.15.59:0/52606306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f0073540 0x7f94f010c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.932+0000 7f94f81ff700 1 -- 172.21.15.59:0/52606306 >> 172.21.15.59:0/52606306 conn(0x7f94f00fc1a0 msgr2=0x7f94f00fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.932+0000 7f94f81ff700 1 -- 172.21.15.59:0/52606306 shutdown_connections 2023-10-08T12:39:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.932+0000 7f94f81ff700 1 -- 172.21.15.59:0/52606306 wait complete. 2023-10-08T12:39:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.933+0000 7f94f81ff700 1 Processor -- start 2023-10-08T12:39:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.933+0000 7f94f81ff700 1 -- start start 2023-10-08T12:39:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f81ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f0072c20 0x7f94f0100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f81ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f0073540 0x7f94f0100ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f81ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f010ce70 0x7f94f0101010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f81ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f01a9450 con 0x7f94f0072c20 2023-10-08T12:39:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f81ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f01a9590 con 0x7f94f010ce70 2023-10-08T12:39:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f81ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f01a9750 con 0x7f94f0073540 2023-10-08T12:39:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f5f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f0072c20 0x7f94f0100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f5f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f0072c20 0x7f94f0100590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47186/0 (socket says 172.21.15.59:47186) 2023-10-08T12:39:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f5f9b700 1 -- 172.21.15.59:0/83784490 learned_addr learned my addr 172.21.15.59:0/83784490 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f579a700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f0073540 0x7f94f0100ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f679c700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f010ce70 0x7f94f0101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f5f9b700 1 -- 172.21.15.59:0/83784490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f0073540 msgr2=0x7f94f0100ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f5f9b700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f0073540 0x7f94f0100ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f5f9b700 1 -- 172.21.15.59:0/83784490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f010ce70 msgr2=0x7f94f0101010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.934+0000 7f94f5f9b700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f010ce70 0x7f94f0101010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.935+0000 7f94f5f9b700 1 -- 172.21.15.59:0/83784490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e8009d00 con 0x7f94f0072c20 2023-10-08T12:39:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.935+0000 7f94f5f9b700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f0072c20 0x7f94f0100590 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00e9a0 tx=0x7f94ec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.935+0000 7f94e6ffd700 1 -- 172.21.15.59:0/83784490 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec009790 con 0x7f94f0072c20 2023-10-08T12:39:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.935+0000 7f94f81ff700 1 -- 172.21.15.59:0/83784490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f01a9a30 con 0x7f94f0072c20 2023-10-08T12:39:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.935+0000 7f94e6ffd700 1 -- 172.21.15.59:0/83784490 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94ec010430 con 0x7f94f0072c20 2023-10-08T12:39:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.935+0000 7f94e6ffd700 1 -- 172.21.15.59:0/83784490 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec018680 con 0x7f94f0072c20 2023-10-08T12:39:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.935+0000 7f94f81ff700 1 -- 172.21.15.59:0/83784490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f01a9f40 con 0x7f94f0072c20 2023-10-08T12:39:22.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.936+0000 7f94f81ff700 1 -- 172.21.15.59:0/83784490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f0108080 con 0x7f94f0072c20 2023-10-08T12:39:22.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.938+0000 7f94e6ffd700 1 -- 172.21.15.59:0/83784490 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f94ec0105a0 con 0x7f94f0072c20 2023-10-08T12:39:22.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.939+0000 7f94e6ffd700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94dc0a1560 0x7f94dc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:22.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.940+0000 7f94e6ffd700 1 -- 172.21.15.59:0/83784490 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f94ec014070 con 0x7f94f0072c20 2023-10-08T12:39:22.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.940+0000 7f94f579a700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94dc0a1560 0x7f94dc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:22.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.940+0000 7f94f579a700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94dc0a1560 0x7f94dc0a3a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94f0101c70 tx=0x7f94e0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:22.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:22.943+0000 7f94e6ffd700 1 -- 172.21.15.59:0/83784490 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f94ec052100 con 0x7f94f0072c20 2023-10-08T12:39:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:22 smithi173 ceph-mon[135182]: from='client.24803 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:22 smithi173 ceph-mon[135182]: mgrmap e21: x(active, since 6m), standbys: z, y 2023-10-08T12:39:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:22 smithi173 ceph-mon[135182]: from='client.24809 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:22 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/598812763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:22 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2274836853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:23.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:22 smithi059 ceph-mon[98489]: from='client.24803 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:23.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:22 smithi059 ceph-mon[98489]: mgrmap e21: x(active, since 6m), standbys: z, y 2023-10-08T12:39:23.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:22 smithi059 ceph-mon[98489]: from='client.24809 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:23.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:22 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/598812763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:23.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:22 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2274836853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:23.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:22 smithi092 ceph-mon[134093]: from='client.24803 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:23.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:22 smithi092 ceph-mon[134093]: mgrmap e21: x(active, since 6m), standbys: z, y 2023-10-08T12:39:23.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:22 smithi092 ceph-mon[134093]: from='client.24809 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:39:23.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:22 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/598812763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:23.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:22 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2274836853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.154+0000 7f94f81ff700 1 -- 172.21.15.59:0/83784490 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94f0101b00 con 0x7f94dc0a1560 2023-10-08T12:39:23.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.166+0000 7f94e6ffd700 1 -- 172.21.15.59:0/83784490 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335557 (secure 0 0 0) 0x7f94f0101b00 con 0x7f94dc0a1560 2023-10-08T12:39:23.171 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 -- 172.21.15.59:0/83784490 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94dc0a1560 msgr2=0x7f94dc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94dc0a1560 0x7f94dc0a3a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94f0101c70 tx=0x7f94e0009260 comp rx=0 tx=0).stop 2023-10-08T12:39:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 -- 172.21.15.59:0/83784490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f0072c20 msgr2=0x7f94f0100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f0072c20 0x7f94f0100590 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00e9a0 tx=0x7f94ec00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 -- 172.21.15.59:0/83784490 shutdown_connections 2023-10-08T12:39:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94dc0a1560 0x7f94dc0a3a20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f010ce70 0x7f94f0101010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f0072c20 0x7f94f0100590 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 --2- 172.21.15.59:0/83784490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f0073540 0x7f94f0100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 -- 172.21.15.59:0/83784490 >> 172.21.15.59:0/83784490 conn(0x7f94f00fc1a0 msgr2=0x7f94f00fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 -- 172.21.15.59:0/83784490 shutdown_connections 2023-10-08T12:39:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.171+0000 7f94f81ff700 1 -- 172.21.15.59:0/83784490 wait complete. 2023-10-08T12:39:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-08T12:39:23.190 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2023-10-08T12:39:22.776401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":610266,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":151,"num_read_kb":143,"num_write":233,"num_write_kb":2971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335176,"kb_used_data":10916,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606648,"statfs":{"total":1151940427776,"available":1151597207552,"internally_reserved":0,"allocated":11177984,"data_stored":7198056,"data_compressed":107388,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19898,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":24,"num_write":52,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.585430"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670437+0000","last_change":"2023-10-08T12:39:14.206423+0000","last_active":"2023-10-08T12:39:15.670437+0000","last_peered":"2023-10-08T12:39:15.670437+0000","last_clean":"2023-10-08T12:39:15.670437+0000","last_became_active":"2023-10-08T12:39:14.205454+0000","last_became_peered":"2023-10-08T12:39:14.205454+0000","last_unstale":"2023-10-08T12:39:15.670437+0000","last_undegraded":"2023-10-08T12:39:15.670437+0000","last_fullsized":"2023-10-08T12:39:15.670437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:37.669007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548773+0000","last_change":"2023-10-08T12:39:14.215711+0000","last_active":"2023-10-08T12:39:15.548773+0000","last_peered":"2023-10-08T12:39:15.548773+0000","last_clean":"2023-10-08T12:39:15.548773+0000","last_became_active":"2023-10-08T12:39:14.215283+0000","last_became_peered":"2023-10-08T12:39:14.215283+0000","last_unstale":"2023-10-08T12:39:15.548773+0000","last_undegraded":"2023-10-08T12:39:15.548773+0000","last_fullsized":"2023-10-08T12:39:15.548773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:29.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549611+0000","last_change":"2023-10-08T12:39:14.209843+0000","last_active":"2023-10-08T12:39:15.549611+0000","last_peered":"2023-10-08T12:39:15.549611+0000","last_clean":"2023-10-08T12:39:15.549611+0000","last_became_active":"2023-10-08T12:39:14.209528+0000","last_became_peered":"2023-10-08T12:39:14.209528+0000","last_unstale":"2023-10-08T12:39:15.549611+0000","last_undegraded":"2023-10-08T12:39:15.549611+0000","last_fullsized":"2023-10-08T12:39:15.549611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:54.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405655+0000","last_change":"2023-10-08T12:39:14.204891+0000","last_active":"2023-10-08T12:39:15.405655+0000","last_peered":"2023-10-08T12:39:15.405655+0000","last_clean":"2023-10-08T12:39:15.405655+0000","last_became_active":"2023-10-08T12:39:14.204075+0000","last_became_peered":"2023-10-08T12:39:14.204075+0000","last_unstale":"2023-10-08T12:39:15.405655+0000","last_undegraded":"2023-10-08T12:39:15.405655+0000","last_fullsized":"2023-10-08T12:39:15.405655+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:18.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493441+0000","last_change":"2023-10-08T12:39:14.212527+0000","last_active":"2023-10-08T12:39:15.493441+0000","last_peered":"2023-10-08T12:39:15.493441+0000","last_clean":"2023-10-08T12:39:15.493441+0000","last_became_active":"2023-10-08T12:39:14.212188+0000","last_became_peered":"2023-10-08T12:39:14.212188+0000","last_unstale":"2023-10-08T12:39:15.493441+0000","last_undegraded":"2023-10-08T12:39:15.493441+0000","last_fullsized":"2023-10-08T12:39:15.493441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:28.952210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549185+0000","last_change":"2023-10-08T12:39:14.216842+0000","last_active":"2023-10-08T12:39:15.549185+0000","last_peered":"2023-10-08T12:39:15.549185+0000","last_clean":"2023-10-08T12:39:15.549185+0000","last_became_active":"2023-10-08T12:39:14.216446+0000","last_became_peered":"2023-10-08T12:39:14.216446+0000","last_unstale":"2023-10-08T12:39:15.549185+0000","last_undegraded":"2023-10-08T12:39:15.549185+0000","last_fullsized":"2023-10-08T12:39:15.549185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:40.718246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548684+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:39:15.548684+0000","last_peered":"2023-10-08T12:39:15.548684+0000","last_clean":"2023-10-08T12:39:15.548684+0000","last_became_active":"2023-10-08T12:39:14.222410+0000","last_became_peered":"2023-10-08T12:39:14.222410+0000","last_unstale":"2023-10-08T12:39:15.548684+0000","last_undegraded":"2023-10-08T12:39:15.548684+0000","last_fullsized":"2023-10-08T12:39:15.548684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:03.599610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550066+0000","last_change":"2023-10-08T12:39:14.209422+0000","last_active":"2023-10-08T12:39:15.550066+0000","last_peered":"2023-10-08T12:39:15.550066+0000","last_clean":"2023-10-08T12:39:15.550066+0000","last_became_active":"2023-10-08T12:39:14.209073+0000","last_became_peered":"2023-10-08T12:39:14.209073+0000","last_unstale":"2023-10-08T12:39:15.550066+0000","last_undegraded":"2023-10-08T12:39:15.550066+0000","last_fullsized":"2023-10-08T12:39:15.550066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:09.587414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203646+0000","last_change":"2023-10-08T12:39:14.211228+0000","last_active":"2023-10-08T12:39:15.203646+0000","last_peered":"2023-10-08T12:39:15.203646+0000","last_clean":"2023-10-08T12:39:15.203646+0000","last_became_active":"2023-10-08T12:39:14.210940+0000","last_became_peered":"2023-10-08T12:39:14.210940+0000","last_unstale":"2023-10-08T12:39:15.203646+0000","last_undegraded":"2023-10-08T12:39:15.203646+0000","last_fullsized":"2023-10-08T12:39:15.203646+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:52.683409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549070+0000","last_change":"2023-10-08T12:39:14.207071+0000","last_active":"2023-10-08T12:39:15.549070+0000","last_peered":"2023-10-08T12:39:15.549070+0000","last_clean":"2023-10-08T12:39:15.549070+0000","last_became_active":"2023-10-08T12:39:14.206770+0000","last_became_peered":"2023-10-08T12:39:14.206770+0000","last_unstale":"2023-10-08T12:39:15.549070+0000","last_undegraded":"2023-10-08T12:39:15.549070+0000","last_fullsized":"2023-10-08T12:39:15.549070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:19.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549102+0000","last_change":"2023-10-08T12:39:14.212780+0000","last_active":"2023-10-08T12:39:15.549102+0000","last_peered":"2023-10-08T12:39:15.549102+0000","last_clean":"2023-10-08T12:39:15.549102+0000","last_became_active":"2023-10-08T12:39:14.212167+0000","last_became_peered":"2023-10-08T12:39:14.212167+0000","last_unstale":"2023-10-08T12:39:15.549102+0000","last_undegraded":"2023-10-08T12:39:15.549102+0000","last_fullsized":"2023-10-08T12:39:15.549102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:17.332257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405632+0000","last_change":"2023-10-08T12:39:14.204506+0000","last_active":"2023-10-08T12:39:15.405632+0000","last_peered":"2023-10-08T12:39:15.405632+0000","last_clean":"2023-10-08T12:39:15.405632+0000","last_became_active":"2023-10-08T12:39:14.204184+0000","last_became_peered":"2023-10-08T12:39:14.204184+0000","last_unstale":"2023-10-08T12:39:15.405632+0000","last_undegraded":"2023-10-08T12:39:15.405632+0000","last_fullsized":"2023-10-08T12:39:15.405632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:05.696554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549661+0000","last_change":"2023-10-08T12:39:14.211957+0000","last_active":"2023-10-08T12:39:15.549661+0000","last_peered":"2023-10-08T12:39:15.549661+0000","last_clean":"2023-10-08T12:39:15.549661+0000","last_became_active":"2023-10-08T12:39:14.211629+0000","last_became_peered":"2023-10-08T12:39:14.211629+0000","last_unstale":"2023-10-08T12:39:15.549661+0000","last_undegraded":"2023-10-08T12:39:15.549661+0000","last_fullsized":"2023-10-08T12:39:15.549661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:10.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549044+0000","last_change":"2023-10-08T12:39:14.207006+0000","last_active":"2023-10-08T12:39:15.549044+0000","last_peered":"2023-10-08T12:39:15.549044+0000","last_clean":"2023-10-08T12:39:15.549044+0000","last_became_active":"2023-10-08T12:39:14.206624+0000","last_became_peered":"2023-10-08T12:39:14.206624+0000","last_unstale":"2023-10-08T12:39:15.549044+0000","last_undegraded":"2023-10-08T12:39:15.549044+0000","last_fullsized":"2023-10-08T12:39:15.549044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:11.232875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548718+0000","last_change":"2023-10-08T12:39:14.213865+0000","last_active":"2023-10-08T12:39:15.548718+0000","last_peered":"2023-10-08T12:39:15.548718+0000","last_clean":"2023-10-08T12:39:15.548718+0000","last_became_active":"2023-10-08T12:39:14.207972+0000","last_became_peered":"2023-10-08T12:39:14.207972+0000","last_unstale":"2023-10-08T12:39:15.548718+0000","last_undegraded":"2023-10-08T12:39:15.548718+0000","last_fullsized":"2023-10-08T12:39:15.548718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:01.434731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203301+0000","last_change":"2023-10-08T12:39:14.206313+0000","last_active":"2023-10-08T12:39:15.203301+0000","last_peered":"2023-10-08T12:39:15.203301+0000","last_clean":"2023-10-08T12:39:15.203301+0000","last_became_active":"2023-10-08T12:39:14.206001+0000","last_became_peered":"2023-10-08T12:39:14.206001+0000","last_unstale":"2023-10-08T12:39:15.203301+0000","last_undegraded":"2023-10-08T12:39:15.203301+0000","last_fullsized":"2023-10-08T12:39:15.203301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:43.912356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670533+0000","last_change":"2023-10-08T12:39:14.205752+0000","last_active":"2023-10-08T12:39:15.670533+0000","last_peered":"2023-10-08T12:39:15.670533+0000","last_clean":"2023-10-08T12:39:15.670533+0000","last_became_active":"2023-10-08T12:39:14.204696+0000","last_became_peered":"2023-10-08T12:39:14.204696+0000","last_unstale":"2023-10-08T12:39:15.670533+0000","last_undegraded":"2023-10-08T12:39:15.670533+0000","last_fullsized":"2023-10-08T12:39:15.670533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:42.409107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201311+0000","last_change":"2023-10-08T12:39:14.203373+0000","last_active":"2023-10-08T12:39:15.201311+0000","last_peered":"2023-10-08T12:39:15.201311+0000","last_clean":"2023-10-08T12:39:15.201311+0000","last_became_active":"2023-10-08T12:39:14.202966+0000","last_became_peered":"2023-10-08T12:39:14.202966+0000","last_unstale":"2023-10-08T12:39:15.201311+0000","last_undegraded":"2023-10-08T12:39:15.201311+0000","last_fullsized":"2023-10-08T12:39:15.201311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:00.114475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.202041+0000","last_change":"2023-10-08T12:39:14.216154+0000","last_active":"2023-10-08T12:39:15.202041+0000","last_peered":"2023-10-08T12:39:15.202041+0000","last_clean":"2023-10-08T12:39:15.202041+0000","last_became_active":"2023-10-08T12:39:14.215868+0000","last_became_peered":"2023-10-08T12:39:14.215868+0000","last_unstale":"2023-10-08T12:39:15.202041+0000","last_undegraded":"2023-10-08T12:39:15.202041+0000","last_fullsized":"2023-10-08T12:39:15.202041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:53.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201161+0000","last_change":"2023-10-08T12:39:13.214538+0000","last_active":"2023-10-08T12:39:15.201161+0000","last_peered":"2023-10-08T12:39:15.201161+0000","last_clean":"2023-10-08T12:39:15.201161+0000","last_became_active":"2023-10-08T12:39:13.214162+0000","last_became_peered":"2023-10-08T12:39:13.214162+0000","last_unstale":"2023-10-08T12:39:15.201161+0000","last_undegraded":"2023-10-08T12:39:15.201161+0000","last_fullsized":"2023-10-08T12:39:15.201161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:11.500815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550308+0000","last_change":"2023-10-08T12:39:14.211308+0000","last_active":"2023-10-08T12:39:15.550308+0000","last_peered":"2023-10-08T12:39:15.550308+0000","last_clean":"2023-10-08T12:39:15.550308+0000","last_became_active":"2023-10-08T12:39:14.210961+0000","last_became_peered":"2023-10-08T12:39:14.210961+0000","last_unstale":"2023-10-08T12:39:15.550308+0000","last_undegraded":"2023-10-08T12:39:15.550308+0000","last_fullsized":"2023-10-08T12:39:15.550308+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.221981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.706784+0000","last_change":"2023-10-08T12:39:13.219982+0000","last_active":"2023-10-08T12:39:14.706784+0000","last_peered":"2023-10-08T12:39:14.706784+0000","last_clean":"2023-10-08T12:39:14.706784+0000","last_became_active":"2023-10-08T12:39:13.219668+0000","last_became_peered":"2023-10-08T12:39:13.219668+0000","last_unstale":"2023-10-08T12:39:14.706784+0000","last_undegraded":"2023-10-08T12:39:14.706784+0000","last_fullsized":"2023-10-08T12:39:14.706784+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.664553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549090+0000","last_change":"2023-10-08T12:39:14.216922+0000","last_active":"2023-10-08T12:39:15.549090+0000","last_peered":"2023-10-08T12:39:15.549090+0000","last_clean":"2023-10-08T12:39:15.549090+0000","last_became_active":"2023-10-08T12:39:14.216634+0000","last_became_peered":"2023-10-08T12:39:14.216634+0000","last_unstale":"2023-10-08T12:39:15.549090+0000","last_undegraded":"2023-10-08T12:39:15.549090+0000","last_fullsized":"2023-10-08T12:39:15.549090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:21.254178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.708415+0000","last_change":"2023-10-08T12:39:13.220262+0000","last_active":"2023-10-08T12:39:14.708415+0000","last_peered":"2023-10-08T12:39:14.708415+0000","last_clean":"2023-10-08T12:39:14.708415+0000","last_became_active":"2023-10-08T12:39:13.219917+0000","last_became_peered":"2023-10-08T12:39:13.219917+0000","last_unstale":"2023-10-08T12:39:14.708415+0000","last_undegraded":"2023-10-08T12:39:14.708415+0000","last_fullsized":"2023-10-08T12:39:14.708415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:34.368119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203329+0000","last_change":"2023-10-08T12:39:14.212620+0000","last_active":"2023-10-08T12:39:15.203329+0000","last_peered":"2023-10-08T12:39:15.203329+0000","last_clean":"2023-10-08T12:39:15.203329+0000","last_became_active":"2023-10-08T12:39:14.212128+0000","last_became_peered":"2023-10-08T12:39:14.212128+0000","last_unstale":"2023-10-08T12:39:15.203329+0000","last_undegraded":"2023-10-08T12:39:15.203329+0000","last_fullsized":"2023-10-08T12:39:15.203329+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:40.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.706405+0000","last_change":"2023-10-08T12:39:13.218291+0000","last_active":"2023-10-08T12:39:14.706405+0000","last_peered":"2023-10-08T12:39:14.706405+0000","last_clean":"2023-10-08T12:39:14.706405+0000","last_became_active":"2023-10-08T12:39:13.217907+0000","last_became_peered":"2023-10-08T12:39:13.217907+0000","last_unstale":"2023-10-08T12:39:14.706405+0000","last_undegraded":"2023-10-08T12:39:14.706405+0000","last_fullsized":"2023-10-08T12:39:14.706405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:54:46.891553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549340+0000","last_change":"2023-10-08T12:39:14.207991+0000","last_active":"2023-10-08T12:39:15.549340+0000","last_peered":"2023-10-08T12:39:15.549340+0000","last_clean":"2023-10-08T12:39:15.549340+0000","last_became_active":"2023-10-08T12:39:14.207683+0000","last_became_peered":"2023-10-08T12:39:14.207683+0000","last_unstale":"2023-10-08T12:39:15.549340+0000","last_undegraded":"2023-10-08T12:39:15.549340+0000","last_fullsized":"2023-10-08T12:39:15.549340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:47.809553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.708660+0000","last_change":"2023-10-08T12:39:13.214704+0000","last_active":"2023-10-08T12:39:14.708660+0000","last_peered":"2023-10-08T12:39:14.708660+0000","last_clean":"2023-10-08T12:39:14.708660+0000","last_became_active":"2023-10-08T12:39:13.214205+0000","last_became_peered":"2023-10-08T12:39:13.214205+0000","last_unstale":"2023-10-08T12:39:14.708660+0000","last_undegraded":"2023-10-08T12:39:14.708660+0000","last_fullsized":"2023-10-08T12:39:14.708660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:58.572620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493406+0000","last_change":"2023-10-08T12:39:14.219813+0000","last_active":"2023-10-08T12:39:15.493406+0000","last_peered":"2023-10-08T12:39:15.493406+0000","last_clean":"2023-10-08T12:39:15.493406+0000","last_became_active":"2023-10-08T12:39:14.219511+0000","last_became_peered":"2023-10-08T12:39:14.219511+0000","last_unstale":"2023-10-08T12:39:15.493406+0000","last_undegraded":"2023-10-08T12:39:15.493406+0000","last_fullsized":"2023-10-08T12:39:15.493406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:43.716871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549057+0000","last_change":"2023-10-08T12:39:13.212567+0000","last_active":"2023-10-08T12:39:15.549057+0000","last_peered":"2023-10-08T12:39:15.549057+0000","last_clean":"2023-10-08T12:39:15.549057+0000","last_became_active":"2023-10-08T12:39:13.212079+0000","last_became_peered":"2023-10-08T12:39:13.212079+0000","last_unstale":"2023-10-08T12:39:15.549057+0000","last_undegraded":"2023-10-08T12:39:15.549057+0000","last_fullsized":"2023-10-08T12:39:15.549057+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:35.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549149+0000","last_change":"2023-10-08T12:39:14.208760+0000","last_active":"2023-10-08T12:39:15.549149+0000","last_peered":"2023-10-08T12:39:15.549149+0000","last_clean":"2023-10-08T12:39:15.549149+0000","last_became_active":"2023-10-08T12:39:14.208490+0000","last_became_peered":"2023-10-08T12:39:14.208490+0000","last_unstale":"2023-10-08T12:39:15.549149+0000","last_undegraded":"2023-10-08T12:39:15.549149+0000","last_fullsized":"2023-10-08T12:39:15.549149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:19:56.423514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056781+0000","last_change":"2023-10-08T12:39:13.214197+0000","last_active":"2023-10-08T12:39:15.056781+0000","last_peered":"2023-10-08T12:39:15.056781+0000","last_clean":"2023-10-08T12:39:15.056781+0000","last_became_active":"2023-10-08T12:39:13.213829+0000","last_became_peered":"2023-10-08T12:39:13.213829+0000","last_unstale":"2023-10-08T12:39:15.056781+0000","last_undegraded":"2023-10-08T12:39:15.056781+0000","last_fullsized":"2023-10-08T12:39:15.056781+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:29:05.080370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550089+0000","last_change":"2023-10-08T12:39:14.212369+0000","last_active":"2023-10-08T12:39:15.550089+0000","last_peered":"2023-10-08T12:39:15.550089+0000","last_clean":"2023-10-08T12:39:15.550089+0000","last_became_active":"2023-10-08T12:39:14.211917+0000","last_became_peered":"2023-10-08T12:39:14.211917+0000","last_unstale":"2023-10-08T12:39:15.550089+0000","last_undegraded":"2023-10-08T12:39:15.550089+0000","last_fullsized":"2023-10-08T12:39:15.550089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:27.265251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.199098+0000","last_change":"2023-10-08T12:39:13.217339+0000","last_active":"2023-10-08T12:39:14.199098+0000","last_peered":"2023-10-08T12:39:14.199098+0000","last_clean":"2023-10-08T12:39:14.199098+0000","last_became_active":"2023-10-08T12:39:13.216973+0000","last_became_peered":"2023-10-08T12:39:13.216973+0000","last_unstale":"2023-10-08T12:39:14.199098+0000","last_undegraded":"2023-10-08T12:39:14.199098+0000","last_fullsized":"2023-10-08T12:39:14.199098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:35.899844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.200919+0000","last_change":"2023-10-08T12:39:14.218870+0000","last_active":"2023-10-08T12:39:15.200919+0000","last_peered":"2023-10-08T12:39:15.200919+0000","last_clean":"2023-10-08T12:39:15.200919+0000","last_became_active":"2023-10-08T12:39:14.217879+0000","last_became_peered":"2023-10-08T12:39:14.217879+0000","last_unstale":"2023-10-08T12:39:15.200919+0000","last_undegraded":"2023-10-08T12:39:15.200919+0000","last_fullsized":"2023-10-08T12:39:15.200919+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:06.769081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549190+0000","last_change":"2023-10-08T12:39:13.209120+0000","last_active":"2023-10-08T12:39:15.549190+0000","last_peered":"2023-10-08T12:39:15.549190+0000","last_clean":"2023-10-08T12:39:15.549190+0000","last_became_active":"2023-10-08T12:39:13.208755+0000","last_became_peered":"2023-10-08T12:39:13.208755+0000","last_unstale":"2023-10-08T12:39:15.549190+0000","last_undegraded":"2023-10-08T12:39:15.549190+0000","last_fullsized":"2023-10-08T12:39:15.549190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:48.977375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203583+0000","last_change":"2023-10-08T12:39:14.208187+0000","last_active":"2023-10-08T12:39:15.203583+0000","last_peered":"2023-10-08T12:39:15.203583+0000","last_clean":"2023-10-08T12:39:15.203583+0000","last_became_active":"2023-10-08T12:39:14.207868+0000","last_became_peered":"2023-10-08T12:39:14.207868+0000","last_unstale":"2023-10-08T12:39:15.203583+0000","last_undegraded":"2023-10-08T12:39:15.203583+0000","last_fullsized":"2023-10-08T12:39:15.203583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:50.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853939+0000","last_change":"2023-10-08T12:39:13.220447+0000","last_active":"2023-10-08T12:39:14.853939+0000","last_peered":"2023-10-08T12:39:14.853939+0000","last_clean":"2023-10-08T12:39:14.853939+0000","last_became_active":"2023-10-08T12:39:13.220032+0000","last_became_peered":"2023-10-08T12:39:13.220032+0000","last_unstale":"2023-10-08T12:39:14.853939+0000","last_undegraded":"2023-10-08T12:39:14.853939+0000","last_fullsized":"2023-10-08T12:39:14.853939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:22.223707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549247+0000","last_change":"2023-10-08T12:39:14.214899+0000","last_active":"2023-10-08T12:39:15.549247+0000","last_peered":"2023-10-08T12:39:15.549247+0000","last_clean":"2023-10-08T12:39:15.549247+0000","last_became_active":"2023-10-08T12:39:14.214536+0000","last_became_peered":"2023-10-08T12:39:14.214536+0000","last_unstale":"2023-10-08T12:39:15.549247+0000","last_undegraded":"2023-10-08T12:39:15.549247+0000","last_fullsized":"2023-10-08T12:39:15.549247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:34.166298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.706531+0000","last_change":"2023-10-08T12:39:13.219131+0000","last_active":"2023-10-08T12:39:14.706531+0000","last_peered":"2023-10-08T12:39:14.706531+0000","last_clean":"2023-10-08T12:39:14.706531+0000","last_became_active":"2023-10-08T12:39:13.218639+0000","last_became_peered":"2023-10-08T12:39:13.218639+0000","last_unstale":"2023-10-08T12:39:14.706531+0000","last_undegraded":"2023-10-08T12:39:14.706531+0000","last_fullsized":"2023-10-08T12:39:14.706531+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.316153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203386+0000","last_change":"2023-10-08T12:39:14.212352+0000","last_active":"2023-10-08T12:39:15.203386+0000","last_peered":"2023-10-08T12:39:15.203386+0000","last_clean":"2023-10-08T12:39:15.203386+0000","last_became_active":"2023-10-08T12:39:14.211342+0000","last_became_peered":"2023-10-08T12:39:14.211342+0000","last_unstale":"2023-10-08T12:39:15.203386+0000","last_undegraded":"2023-10-08T12:39:15.203386+0000","last_fullsized":"2023-10-08T12:39:15.203386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:39:00.731860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:20.230188+0000","last_change":"2023-10-08T12:39:13.209967+0000","last_active":"2023-10-08T12:39:20.230188+0000","last_peered":"2023-10-08T12:39:20.230188+0000","last_clean":"2023-10-08T12:39:20.230188+0000","last_became_active":"2023-10-08T12:39:13.209650+0000","last_became_peered":"2023-10-08T12:39:13.209650+0000","last_unstale":"2023-10-08T12:39:20.230188+0000","last_undegraded":"2023-10-08T12:39:20.230188+0000","last_fullsized":"2023-10-08T12:39:20.230188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:08.206168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18977,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":9,"num_read_kb":18,"num_write":12,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493730+0000","last_change":"2023-10-08T12:39:14.211335+0000","last_active":"2023-10-08T12:39:15.493730+0000","last_peered":"2023-10-08T12:39:15.493730+0000","last_clean":"2023-10-08T12:39:15.493730+0000","last_became_active":"2023-10-08T12:39:14.211003+0000","last_became_peered":"2023-10-08T12:39:14.211003+0000","last_unstale":"2023-10-08T12:39:15.493730+0000","last_undegraded":"2023-10-08T12:39:15.493730+0000","last_fullsized":"2023-10-08T12:39:15.493730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:00.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201926+0000","last_change":"2023-10-08T12:39:13.215379+0000","last_active":"2023-10-08T12:39:15.201926+0000","last_peered":"2023-10-08T12:39:15.201926+0000","last_clean":"2023-10-08T12:39:15.201926+0000","last_became_active":"2023-10-08T12:39:13.215036+0000","last_became_peered":"2023-10-08T12:39:13.215036+0000","last_unstale":"2023-10-08T12:39:15.201926+0000","last_undegraded":"2023-10-08T12:39:15.201926+0000","last_fullsized":"2023-10-08T12:39:15.201926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:24.690473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549022+0000","last_change":"2023-10-08T12:39:14.207907+0000","last_active":"2023-10-08T12:39:15.549022+0000","last_peered":"2023-10-08T12:39:15.549022+0000","last_clean":"2023-10-08T12:39:15.549022+0000","last_became_active":"2023-10-08T12:39:14.207620+0000","last_became_peered":"2023-10-08T12:39:14.207620+0000","last_unstale":"2023-10-08T12:39:15.549022+0000","last_undegraded":"2023-10-08T12:39:15.549022+0000","last_fullsized":"2023-10-08T12:39:15.549022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:49:11.866245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.196556+0000","last_change":"2023-10-08T12:39:13.214521+0000","last_active":"2023-10-08T12:39:14.196556+0000","last_peered":"2023-10-08T12:39:14.196556+0000","last_clean":"2023-10-08T12:39:14.196556+0000","last_became_active":"2023-10-08T12:39:13.214127+0000","last_became_peered":"2023-10-08T12:39:13.214127+0000","last_unstale":"2023-10-08T12:39:14.196556+0000","last_undegraded":"2023-10-08T12:39:14.196556+0000","last_fullsized":"2023-10-08T12:39:14.196556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:46.735663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548940+0000","last_change":"2023-10-08T12:39:14.213542+0000","last_active":"2023-10-08T12:39:15.548940+0000","last_peered":"2023-10-08T12:39:15.548940+0000","last_clean":"2023-10-08T12:39:15.548940+0000","last_became_active":"2023-10-08T12:39:14.213295+0000","last_became_peered":"2023-10-08T12:39:14.213295+0000","last_unstale":"2023-10-08T12:39:15.548940+0000","last_undegraded":"2023-10-08T12:39:15.548940+0000","last_fullsized":"2023-10-08T12:39:15.548940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:46.883656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405433+0000","last_change":"2023-10-08T12:39:13.214758+0000","last_active":"2023-10-08T12:39:15.405433+0000","last_peered":"2023-10-08T12:39:15.405433+0000","last_clean":"2023-10-08T12:39:15.405433+0000","last_became_active":"2023-10-08T12:39:13.214304+0000","last_became_peered":"2023-10-08T12:39:13.214304+0000","last_unstale":"2023-10-08T12:39:15.405433+0000","last_undegraded":"2023-10-08T12:39:15.405433+0000","last_fullsized":"2023-10-08T12:39:15.405433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:34.074248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548713+0000","last_change":"2023-10-08T12:39:14.208071+0000","last_active":"2023-10-08T12:39:15.548713+0000","last_peered":"2023-10-08T12:39:15.548713+0000","last_clean":"2023-10-08T12:39:15.548713+0000","last_became_active":"2023-10-08T12:39:14.207787+0000","last_became_peered":"2023-10-08T12:39:14.207787+0000","last_unstale":"2023-10-08T12:39:15.548713+0000","last_undegraded":"2023-10-08T12:39:15.548713+0000","last_fullsized":"2023-10-08T12:39:15.548713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:40.869575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.708642+0000","last_change":"2023-10-08T12:39:13.219105+0000","last_active":"2023-10-08T12:39:14.708642+0000","last_peered":"2023-10-08T12:39:14.708642+0000","last_clean":"2023-10-08T12:39:14.708642+0000","last_became_active":"2023-10-08T12:39:13.218767+0000","last_became_peered":"2023-10-08T12:39:13.218767+0000","last_unstale":"2023-10-08T12:39:14.708642+0000","last_undegraded":"2023-10-08T12:39:14.708642+0000","last_fullsized":"2023-10-08T12:39:14.708642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:22.763921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548972+0000","last_change":"2023-10-08T12:39:14.210037+0000","last_active":"2023-10-08T12:39:15.548972+0000","last_peered":"2023-10-08T12:39:15.548972+0000","last_clean":"2023-10-08T12:39:15.548972+0000","last_became_active":"2023-10-08T12:39:14.208140+0000","last_became_peered":"2023-10-08T12:39:14.208140+0000","last_unstale":"2023-10-08T12:39:15.548972+0000","last_undegraded":"2023-10-08T12:39:15.548972+0000","last_fullsized":"2023-10-08T12:39:15.548972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:38.475668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493819+0000","last_change":"2023-10-08T12:39:13.219229+0000","last_active":"2023-10-08T12:39:15.493819+0000","last_peered":"2023-10-08T12:39:15.493819+0000","last_clean":"2023-10-08T12:39:15.493819+0000","last_became_active":"2023-10-08T12:39:13.217964+0000","last_became_peered":"2023-10-08T12:39:13.217964+0000","last_unstale":"2023-10-08T12:39:15.493819+0000","last_undegraded":"2023-10-08T12:39:15.493819+0000","last_fullsized":"2023-10-08T12:39:15.493819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:47.480351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670304+0000","last_change":"2023-10-08T12:39:14.199562+0000","last_active":"2023-10-08T12:39:15.670304+0000","last_peered":"2023-10-08T12:39:15.670304+0000","last_clean":"2023-10-08T12:39:15.670304+0000","last_became_active":"2023-10-08T12:39:14.199235+0000","last_became_peered":"2023-10-08T12:39:14.199235+0000","last_unstale":"2023-10-08T12:39:15.670304+0000","last_undegraded":"2023-10-08T12:39:15.670304+0000","last_fullsized":"2023-10-08T12:39:15.670304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:17.181406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.192321+0000","last_change":"2023-10-08T12:39:13.212791+0000","last_active":"2023-10-08T12:39:14.192321+0000","last_peered":"2023-10-08T12:39:14.192321+0000","last_clean":"2023-10-08T12:39:14.192321+0000","last_became_active":"2023-10-08T12:39:13.212146+0000","last_became_peered":"2023-10-08T12:39:13.212146+0000","last_unstale":"2023-10-08T12:39:14.192321+0000","last_undegraded":"2023-10-08T12:39:14.192321+0000","last_fullsized":"2023-10-08T12:39:14.192321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:37.452859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.615669+0000","last_change":"2023-10-08T12:39:14.215081+0000","last_active":"2023-10-08T12:39:15.615669+0000","last_peered":"2023-10-08T12:39:15.615669+0000","last_clean":"2023-10-08T12:39:15.615669+0000","last_became_active":"2023-10-08T12:39:14.214825+0000","last_became_peered":"2023-10-08T12:39:14.214825+0000","last_unstale":"2023-10-08T12:39:15.615669+0000","last_undegraded":"2023-10-08T12:39:15.615669+0000","last_fullsized":"2023-10-08T12:39:15.615669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:05.706569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853878+0000","last_change":"2023-10-08T12:39:13.217672+0000","last_active":"2023-10-08T12:39:14.853878+0000","last_peered":"2023-10-08T12:39:14.853878+0000","last_clean":"2023-10-08T12:39:14.853878+0000","last_became_active":"2023-10-08T12:39:13.217277+0000","last_became_peered":"2023-10-08T12:39:13.217277+0000","last_unstale":"2023-10-08T12:39:14.853878+0000","last_undegraded":"2023-10-08T12:39:14.853878+0000","last_fullsized":"2023-10-08T12:39:14.853878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:41.097439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549447+0000","last_change":"2023-10-08T12:39:14.219261+0000","last_active":"2023-10-08T12:39:15.549447+0000","last_peered":"2023-10-08T12:39:15.549447+0000","last_clean":"2023-10-08T12:39:15.549447+0000","last_became_active":"2023-10-08T12:39:14.218963+0000","last_became_peered":"2023-10-08T12:39:14.218963+0000","last_unstale":"2023-10-08T12:39:15.549447+0000","last_undegraded":"2023-10-08T12:39:15.549447+0000","last_fullsized":"2023-10-08T12:39:15.549447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:19.573306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549170+0000","last_change":"2023-10-08T12:39:14.207923+0000","last_active":"2023-10-08T12:39:15.549170+0000","last_peered":"2023-10-08T12:39:15.549170+0000","last_clean":"2023-10-08T12:39:15.549170+0000","last_became_active":"2023-10-08T12:39:14.207634+0000","last_became_peered":"2023-10-08T12:39:14.207634+0000","last_unstale":"2023-10-08T12:39:15.549170+0000","last_undegraded":"2023-10-08T12:39:15.549170+0000","last_fullsized":"2023-10-08T12:39:15.549170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:39.634945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056769+0000","last_change":"2023-10-08T12:39:13.223021+0000","last_active":"2023-10-08T12:39:15.056769+0000","last_peered":"2023-10-08T12:39:15.056769+0000","last_clean":"2023-10-08T12:39:15.056769+0000","last_became_active":"2023-10-08T12:39:13.222680+0000","last_became_peered":"2023-10-08T12:39:13.222680+0000","last_unstale":"2023-10-08T12:39:15.056769+0000","last_undegraded":"2023-10-08T12:39:15.056769+0000","last_fullsized":"2023-10-08T12:39:15.056769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:40.454436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549663+0000","last_change":"2023-10-08T12:39:14.217364+0000","last_active":"2023-10-08T12:39:15.549663+0000","last_peered":"2023-10-08T12:39:15.549663+0000","last_clean":"2023-10-08T12:39:15.549663+0000","last_became_active":"2023-10-08T12:39:14.216984+0000","last_became_peered":"2023-10-08T12:39:14.216984+0000","last_unstale":"2023-10-08T12:39:15.549663+0000","last_undegraded":"2023-10-08T12:39:15.549663+0000","last_fullsized":"2023-10-08T12:39:15.549663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:11:51.818034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405564+0000","last_change":"2023-10-08T12:39:13.207687+0000","last_active":"2023-10-08T12:39:15.405564+0000","last_peered":"2023-10-08T12:39:15.405564+0000","last_clean":"2023-10-08T12:39:15.405564+0000","last_became_active":"2023-10-08T12:39:13.207270+0000","last_became_peered":"2023-10-08T12:39:13.207270+0000","last_unstale":"2023-10-08T12:39:15.405564+0000","last_undegraded":"2023-10-08T12:39:15.405564+0000","last_fullsized":"2023-10-08T12:39:15.405564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:44.673383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.200716+0000","last_change":"2023-10-08T12:38:07.696721+0000","last_active":"2023-10-08T12:39:14.200716+0000","last_peered":"2023-10-08T12:39:14.200716+0000","last_clean":"2023-10-08T12:39:14.200716+0000","last_became_active":"2023-10-08T12:38:07.696336+0000","last_became_peered":"2023-10-08T12:38:07.696336+0000","last_unstale":"2023-10-08T12:39:14.200716+0000","last_undegraded":"2023-10-08T12:39:14.200716+0000","last_fullsized":"2023-10-08T12:39:14.200716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_clean_scrub_stamp":"2023-10-08T12:34:57.643348+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:01.821924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548781+0000","last_change":"2023-10-08T12:39:14.208845+0000","last_active":"2023-10-08T12:39:15.548781+0000","last_peered":"2023-10-08T12:39:15.548781+0000","last_clean":"2023-10-08T12:39:15.548781+0000","last_became_active":"2023-10-08T12:39:14.208487+0000","last_became_peered":"2023-10-08T12:39:14.208487+0000","last_unstale":"2023-10-08T12:39:15.548781+0000","last_undegraded":"2023-10-08T12:39:15.548781+0000","last_fullsized":"2023-10-08T12:39:15.548781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:26.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853797+0000","last_change":"2023-10-08T12:39:13.216627+0000","last_active":"2023-10-08T12:39:14.853797+0000","last_peered":"2023-10-08T12:39:14.853797+0000","last_clean":"2023-10-08T12:39:14.853797+0000","last_became_active":"2023-10-08T12:39:13.216201+0000","last_became_peered":"2023-10-08T12:39:13.216201+0000","last_unstale":"2023-10-08T12:39:14.853797+0000","last_undegraded":"2023-10-08T12:39:14.853797+0000","last_fullsized":"2023-10-08T12:39:14.853797+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:19.873615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.199877+0000","last_change":"2023-10-08T12:39:13.219222+0000","last_active":"2023-10-08T12:39:14.199877+0000","last_peered":"2023-10-08T12:39:14.199877+0000","last_clean":"2023-10-08T12:39:14.199877+0000","last_became_active":"2023-10-08T12:39:13.218757+0000","last_became_peered":"2023-10-08T12:39:13.218757+0000","last_unstale":"2023-10-08T12:39:14.199877+0000","last_undegraded":"2023-10-08T12:39:14.199877+0000","last_fullsized":"2023-10-08T12:39:14.199877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:15.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549929+0000","last_change":"2023-10-08T12:39:14.221945+0000","last_active":"2023-10-08T12:39:15.549929+0000","last_peered":"2023-10-08T12:39:15.549929+0000","last_clean":"2023-10-08T12:39:15.549929+0000","last_became_active":"2023-10-08T12:39:14.221625+0000","last_became_peered":"2023-10-08T12:39:14.221625+0000","last_unstale":"2023-10-08T12:39:15.549929+0000","last_undegraded":"2023-10-08T12:39:15.549929+0000","last_fullsized":"2023-10-08T12:39:15.549929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:50.424023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201203+0000","last_change":"2023-10-08T12:39:13.213666+0000","last_active":"2023-10-08T12:39:15.201203+0000","last_peered":"2023-10-08T12:39:15.201203+0000","last_clean":"2023-10-08T12:39:15.201203+0000","last_became_active":"2023-10-08T12:39:13.213323+0000","last_became_peered":"2023-10-08T12:39:13.213323+0000","last_unstale":"2023-10-08T12:39:15.201203+0000","last_undegraded":"2023-10-08T12:39:15.201203+0000","last_fullsized":"2023-10-08T12:39:15.201203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:50:30.471672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550265+0000","last_change":"2023-10-08T12:39:14.214849+0000","last_active":"2023-10-08T12:39:15.550265+0000","last_peered":"2023-10-08T12:39:15.550265+0000","last_clean":"2023-10-08T12:39:15.550265+0000","last_became_active":"2023-10-08T12:39:14.214573+0000","last_became_peered":"2023-10-08T12:39:14.214573+0000","last_unstale":"2023-10-08T12:39:15.550265+0000","last_undegraded":"2023-10-08T12:39:15.550265+0000","last_fullsized":"2023-10-08T12:39:15.550265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:50.922519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405780+0000","last_change":"2023-10-08T12:39:13.206518+0000","last_active":"2023-10-08T12:39:15.405780+0000","last_peered":"2023-10-08T12:39:15.405780+0000","last_clean":"2023-10-08T12:39:15.405780+0000","last_became_active":"2023-10-08T12:39:13.206082+0000","last_became_peered":"2023-10-08T12:39:13.206082+0000","last_unstale":"2023-10-08T12:39:15.405780+0000","last_undegraded":"2023-10-08T12:39:15.405780+0000","last_fullsized":"2023-10-08T12:39:15.405780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:47.980651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548913+0000","last_change":"2023-10-08T12:39:14.220897+0000","last_active":"2023-10-08T12:39:15.548913+0000","last_peered":"2023-10-08T12:39:15.548913+0000","last_clean":"2023-10-08T12:39:15.548913+0000","last_became_active":"2023-10-08T12:39:14.220173+0000","last_became_peered":"2023-10-08T12:39:14.220173+0000","last_unstale":"2023-10-08T12:39:15.548913+0000","last_undegraded":"2023-10-08T12:39:15.548913+0000","last_fullsized":"2023-10-08T12:39:15.548913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:09:02.588054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.197390+0000","last_change":"2023-10-08T12:39:13.213505+0000","last_active":"2023-10-08T12:39:14.197390+0000","last_peered":"2023-10-08T12:39:14.197390+0000","last_clean":"2023-10-08T12:39:14.197390+0000","last_became_active":"2023-10-08T12:39:13.213199+0000","last_became_peered":"2023-10-08T12:39:13.213199+0000","last_unstale":"2023-10-08T12:39:14.197390+0000","last_undegraded":"2023-10-08T12:39:14.197390+0000","last_fullsized":"2023-10-08T12:39:14.197390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:49.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493387+0000","last_change":"2023-10-08T12:39:14.208080+0000","last_active":"2023-10-08T12:39:15.493387+0000","last_peered":"2023-10-08T12:39:15.493387+0000","last_clean":"2023-10-08T12:39:15.493387+0000","last_became_active":"2023-10-08T12:39:14.207788+0000","last_became_peered":"2023-10-08T12:39:14.207788+0000","last_unstale":"2023-10-08T12:39:15.493387+0000","last_undegraded":"2023-10-08T12:39:15.493387+0000","last_fullsized":"2023-10-08T12:39:15.493387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:44.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.534523+0000","last_change":"2023-10-08T12:39:13.216003+0000","last_active":"2023-10-08T12:39:14.534523+0000","last_peered":"2023-10-08T12:39:14.534523+0000","last_clean":"2023-10-08T12:39:14.534523+0000","last_became_active":"2023-10-08T12:39:13.215662+0000","last_became_peered":"2023-10-08T12:39:13.215662+0000","last_unstale":"2023-10-08T12:39:14.534523+0000","last_undegraded":"2023-10-08T12:39:14.534523+0000","last_fullsized":"2023-10-08T12:39:14.534523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:28.310430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670191+0000","last_change":"2023-10-08T12:39:14.204336+0000","last_active":"2023-10-08T12:39:15.670191+0000","last_peered":"2023-10-08T12:39:15.670191+0000","last_clean":"2023-10-08T12:39:15.670191+0000","last_became_active":"2023-10-08T12:39:14.203993+0000","last_became_peered":"2023-10-08T12:39:14.203993+0000","last_unstale":"2023-10-08T12:39:15.670191+0000","last_undegraded":"2023-10-08T12:39:15.670191+0000","last_fullsized":"2023-10-08T12:39:15.670191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:54.545166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.193182+0000","last_change":"2023-10-08T12:39:13.214767+0000","last_active":"2023-10-08T12:39:14.193182+0000","last_peered":"2023-10-08T12:39:14.193182+0000","last_clean":"2023-10-08T12:39:14.193182+0000","last_became_active":"2023-10-08T12:39:13.214431+0000","last_became_peered":"2023-10-08T12:39:13.214431+0000","last_unstale":"2023-10-08T12:39:14.193182+0000","last_undegraded":"2023-10-08T12:39:14.193182+0000","last_fullsized":"2023-10-08T12:39:14.193182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:51.062301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549952+0000","last_change":"2023-10-08T12:39:14.221040+0000","last_active":"2023-10-08T12:39:15.549952+0000","last_peered":"2023-10-08T12:39:15.549952+0000","last_clean":"2023-10-08T12:39:15.549952+0000","last_became_active":"2023-10-08T12:39:14.220724+0000","last_became_peered":"2023-10-08T12:39:14.220724+0000","last_unstale":"2023-10-08T12:39:15.549952+0000","last_undegraded":"2023-10-08T12:39:15.549952+0000","last_fullsized":"2023-10-08T12:39:15.549952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:52.824228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493423+0000","last_change":"2023-10-08T12:39:13.212244+0000","last_active":"2023-10-08T12:39:15.493423+0000","last_peered":"2023-10-08T12:39:15.493423+0000","last_clean":"2023-10-08T12:39:15.493423+0000","last_became_active":"2023-10-08T12:39:13.212028+0000","last_became_peered":"2023-10-08T12:39:13.212028+0000","last_unstale":"2023-10-08T12:39:15.493423+0000","last_undegraded":"2023-10-08T12:39:15.493423+0000","last_fullsized":"2023-10-08T12:39:15.493423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:06.111807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548953+0000","last_change":"2023-10-08T12:39:14.216665+0000","last_active":"2023-10-08T12:39:15.548953+0000","last_peered":"2023-10-08T12:39:15.548953+0000","last_clean":"2023-10-08T12:39:15.548953+0000","last_became_active":"2023-10-08T12:39:14.216330+0000","last_became_peered":"2023-10-08T12:39:14.216330+0000","last_unstale":"2023-10-08T12:39:15.548953+0000","last_undegraded":"2023-10-08T12:39:15.548953+0000","last_fullsized":"2023-10-08T12:39:15.548953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.658600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.193201+0000","last_change":"2023-10-08T12:39:13.214495+0000","last_active":"2023-10-08T12:39:14.193201+0000","last_peered":"2023-10-08T12:39:14.193201+0000","last_clean":"2023-10-08T12:39:14.193201+0000","last_became_active":"2023-10-08T12:39:13.213930+0000","last_became_peered":"2023-10-08T12:39:13.213930+0000","last_unstale":"2023-10-08T12:39:14.193201+0000","last_undegraded":"2023-10-08T12:39:14.193201+0000","last_fullsized":"2023-10-08T12:39:14.193201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:20:38.096164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549209+0000","last_change":"2023-10-08T12:39:14.212566+0000","last_active":"2023-10-08T12:39:15.549209+0000","last_peered":"2023-10-08T12:39:15.549209+0000","last_clean":"2023-10-08T12:39:15.549209+0000","last_became_active":"2023-10-08T12:39:14.211756+0000","last_became_peered":"2023-10-08T12:39:14.211756+0000","last_unstale":"2023-10-08T12:39:15.549209+0000","last_undegraded":"2023-10-08T12:39:15.549209+0000","last_fullsized":"2023-10-08T12:39:15.549209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:12.741640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549200+0000","last_change":"2023-10-08T12:39:13.217914+0000","last_active":"2023-10-08T12:39:15.549200+0000","last_peered":"2023-10-08T12:39:15.549200+0000","last_clean":"2023-10-08T12:39:15.549200+0000","last_became_active":"2023-10-08T12:39:13.217571+0000","last_became_peered":"2023-10-08T12:39:13.217571+0000","last_unstale":"2023-10-08T12:39:15.549200+0000","last_undegraded":"2023-10-08T12:39:15.549200+0000","last_fullsized":"2023-10-08T12:39:15.549200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:10.826007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548833+0000","last_change":"2023-10-08T12:39:14.214280+0000","last_active":"2023-10-08T12:39:15.548833+0000","last_peered":"2023-10-08T12:39:15.548833+0000","last_clean":"2023-10-08T12:39:15.548833+0000","last_became_active":"2023-10-08T12:39:14.213942+0000","last_became_peered":"2023-10-08T12:39:14.213942+0000","last_unstale":"2023-10-08T12:39:15.548833+0000","last_undegraded":"2023-10-08T12:39:15.548833+0000","last_fullsized":"2023-10-08T12:39:15.548833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:17:21.450265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056839+0000","last_change":"2023-10-08T12:39:13.222484+0000","last_active":"2023-10-08T12:39:15.056839+0000","last_peered":"2023-10-08T12:39:15.056839+0000","last_clean":"2023-10-08T12:39:15.056839+0000","last_became_active":"2023-10-08T12:39:13.222091+0000","last_became_peered":"2023-10-08T12:39:13.222091+0000","last_unstale":"2023-10-08T12:39:15.056839+0000","last_undegraded":"2023-10-08T12:39:15.056839+0000","last_fullsized":"2023-10-08T12:39:15.056839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:00.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549425+0000","last_change":"2023-10-08T12:39:14.207715+0000","last_active":"2023-10-08T12:39:15.549425+0000","last_peered":"2023-10-08T12:39:15.549425+0000","last_clean":"2023-10-08T12:39:15.549425+0000","last_became_active":"2023-10-08T12:39:14.207429+0000","last_became_peered":"2023-10-08T12:39:14.207429+0000","last_unstale":"2023-10-08T12:39:15.549425+0000","last_undegraded":"2023-10-08T12:39:15.549425+0000","last_fullsized":"2023-10-08T12:39:15.549425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:16.991831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670238+0000","last_change":"2023-10-08T12:39:14.200398+0000","last_active":"2023-10-08T12:39:15.670238+0000","last_peered":"2023-10-08T12:39:15.670238+0000","last_clean":"2023-10-08T12:39:15.670238+0000","last_became_active":"2023-10-08T12:39:14.200035+0000","last_became_peered":"2023-10-08T12:39:14.200035+0000","last_unstale":"2023-10-08T12:39:15.670238+0000","last_undegraded":"2023-10-08T12:39:15.670238+0000","last_fullsized":"2023-10-08T12:39:15.670238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:13.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201966+0000","last_change":"2023-10-08T12:39:14.202185+0000","last_active":"2023-10-08T12:39:15.201966+0000","last_peered":"2023-10-08T12:39:15.201966+0000","last_clean":"2023-10-08T12:39:15.201966+0000","last_became_active":"2023-10-08T12:39:14.201232+0000","last_became_peered":"2023-10-08T12:39:14.201232+0000","last_unstale":"2023-10-08T12:39:15.201966+0000","last_undegraded":"2023-10-08T12:39:15.201966+0000","last_fullsized":"2023-10-08T12:39:15.201966+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:50.949047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201847+0000","last_change":"2023-10-08T12:39:14.208014+0000","last_active":"2023-10-08T12:39:15.201847+0000","last_peered":"2023-10-08T12:39:15.201847+0000","last_clean":"2023-10-08T12:39:15.201847+0000","last_became_active":"2023-10-08T12:39:14.207579+0000","last_became_peered":"2023-10-08T12:39:14.207579+0000","last_unstale":"2023-10-08T12:39:15.201847+0000","last_undegraded":"2023-10-08T12:39:15.201847+0000","last_fullsized":"2023-10-08T12:39:15.201847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:37.352827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549736+0000","last_change":"2023-10-08T12:39:14.210834+0000","last_active":"2023-10-08T12:39:15.549736+0000","last_peered":"2023-10-08T12:39:15.549736+0000","last_clean":"2023-10-08T12:39:15.549736+0000","last_became_active":"2023-10-08T12:39:14.210486+0000","last_became_peered":"2023-10-08T12:39:14.210486+0000","last_unstale":"2023-10-08T12:39:15.549736+0000","last_undegraded":"2023-10-08T12:39:15.549736+0000","last_fullsized":"2023-10-08T12:39:15.549736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:36.252533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549923+0000","last_change":"2023-10-08T12:39:14.222630+0000","last_active":"2023-10-08T12:39:15.549923+0000","last_peered":"2023-10-08T12:39:15.549923+0000","last_clean":"2023-10-08T12:39:15.549923+0000","last_became_active":"2023-10-08T12:39:14.222300+0000","last_became_peered":"2023-10-08T12:39:14.222300+0000","last_unstale":"2023-10-08T12:39:15.549923+0000","last_undegraded":"2023-10-08T12:39:15.549923+0000","last_fullsized":"2023-10-08T12:39:15.549923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.040227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670356+0000","last_change":"2023-10-08T12:39:14.207144+0000","last_active":"2023-10-08T12:39:15.670356+0000","last_peered":"2023-10-08T12:39:15.670356+0000","last_clean":"2023-10-08T12:39:15.670356+0000","last_became_active":"2023-10-08T12:39:14.206775+0000","last_became_peered":"2023-10-08T12:39:14.206775+0000","last_unstale":"2023-10-08T12:39:15.670356+0000","last_undegraded":"2023-10-08T12:39:15.670356+0000","last_fullsized":"2023-10-08T12:39:15.670356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:55.224270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.202113+0000","last_change":"2023-10-08T12:39:14.204123+0000","last_active":"2023-10-08T12:39:15.202113+0000","last_peered":"2023-10-08T12:39:15.202113+0000","last_clean":"2023-10-08T12:39:15.202113+0000","last_became_active":"2023-10-08T12:39:14.203123+0000","last_became_peered":"2023-10-08T12:39:14.203123+0000","last_unstale":"2023-10-08T12:39:15.202113+0000","last_undegraded":"2023-10-08T12:39:15.202113+0000","last_fullsized":"2023-10-08T12:39:15.202113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:45.423095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550121+0000","last_change":"2023-10-08T12:39:14.211049+0000","last_active":"2023-10-08T12:39:15.550121+0000","last_peered":"2023-10-08T12:39:15.550121+0000","last_clean":"2023-10-08T12:39:15.550121+0000","last_became_active":"2023-10-08T12:39:14.210738+0000","last_became_peered":"2023-10-08T12:39:14.210738+0000","last_unstale":"2023-10-08T12:39:15.550121+0000","last_undegraded":"2023-10-08T12:39:15.550121+0000","last_fullsized":"2023-10-08T12:39:15.550121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:12.535857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549047+0000","last_change":"2023-10-08T12:39:14.220013+0000","last_active":"2023-10-08T12:39:15.549047+0000","last_peered":"2023-10-08T12:39:15.549047+0000","last_clean":"2023-10-08T12:39:15.549047+0000","last_became_active":"2023-10-08T12:39:14.219711+0000","last_became_peered":"2023-10-08T12:39:14.219711+0000","last_unstale":"2023-10-08T12:39:15.549047+0000","last_undegraded":"2023-10-08T12:39:15.549047+0000","last_fullsized":"2023-10-08T12:39:15.549047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:23.205074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549313+0000","last_change":"2023-10-08T12:39:14.214237+0000","last_active":"2023-10-08T12:39:15.549313+0000","last_peered":"2023-10-08T12:39:15.549313+0000","last_clean":"2023-10-08T12:39:15.549313+0000","last_became_active":"2023-10-08T12:39:14.213891+0000","last_became_peered":"2023-10-08T12:39:14.213891+0000","last_unstale":"2023-10-08T12:39:15.549313+0000","last_undegraded":"2023-10-08T12:39:15.549313+0000","last_fullsized":"2023-10-08T12:39:15.549313+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:11.348411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203309+0000","last_change":"2023-10-08T12:39:14.209037+0000","last_active":"2023-10-08T12:39:15.203309+0000","last_peered":"2023-10-08T12:39:15.203309+0000","last_clean":"2023-10-08T12:39:15.203309+0000","last_became_active":"2023-10-08T12:39:14.208728+0000","last_became_peered":"2023-10-08T12:39:14.208728+0000","last_unstale":"2023-10-08T12:39:15.203309+0000","last_undegraded":"2023-10-08T12:39:15.203309+0000","last_fullsized":"2023-10-08T12:39:15.203309+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:23.440413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549527+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:39:15.549527+0000","last_peered":"2023-10-08T12:39:15.549527+0000","last_clean":"2023-10-08T12:39:15.549527+0000","last_became_active":"2023-10-08T12:39:14.222393+0000","last_became_peered":"2023-10-08T12:39:14.222393+0000","last_unstale":"2023-10-08T12:39:15.549527+0000","last_undegraded":"2023-10-08T12:39:15.549527+0000","last_fullsized":"2023-10-08T12:39:15.549527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:19.704140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670257+0000","last_change":"2023-10-08T12:39:14.200858+0000","last_active":"2023-10-08T12:39:15.670257+0000","last_peered":"2023-10-08T12:39:15.670257+0000","last_clean":"2023-10-08T12:39:15.670257+0000","last_became_active":"2023-10-08T12:39:14.199948+0000","last_became_peered":"2023-10-08T12:39:14.199948+0000","last_unstale":"2023-10-08T12:39:15.670257+0000","last_undegraded":"2023-10-08T12:39:15.670257+0000","last_fullsized":"2023-10-08T12:39:15.670257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:10.366380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281436,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":19775,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":15,"num_read_kb":24,"num_write":51,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":93941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416398,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":444535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]},{"osd":10,"up_from":72,"seq":309237645329,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":1053866,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29499999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.495}]},{"osd":3,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46100000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.37}]},{"osd":5,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60899999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65900000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.59699999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":9,"up_from":67,"seq":287762808852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":445117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.44}]},{"osd":1,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.80500000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.84499999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.874},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.74299999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.89800000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.85599999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070490,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":444808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56299999999999994}]},{"osd":1,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72399999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.28399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.40999999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.40000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83699999999999997,"5min":0.879,"15min":0.879},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52400000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.43099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.75}]},{"osd":5,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.34499999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.625}]},{"osd":6,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.69199999999999995}]},{"osd":7,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98899999999999999,"5min":1.181,"15min":1.181},"last":0.77600000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.79600000000000004}]},{"osd":10,"last update":"Sun Oct 8 12:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.85099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":7,"up_from":52,"seq":223338299423,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":1035485,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.877,"15min":0.877},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.433,"15min":0.434},"min":{"1min":0.28899999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.42099999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61499999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.38400000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65500000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59399999999999997,"15min":0.58699999999999997},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59799999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76700000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68100000000000005,"5min":0.751,"15min":0.751},"last":0.34100000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69599999999999995,"15min":0.68899999999999995},"min":{"1min":0.55400000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.497,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.871,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.436}]},{"osd":8,"last update":"Sun Oct 8 12:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67400000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.75600000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.73199999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":6,"up_from":47,"seq":201863462947,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":444535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.754},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.44900000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.629,"15min":0.62},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.627}]},{"osd":2,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73199999999999998,"15min":0.73499999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.871,"5min":0.875,"15min":0.875},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79500000000000004}]},{"osd":3,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.501},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47399999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":0.79600000000000004,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":6.875,"5min":6.875,"15min":6.875},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.59899999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.63700000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.81000000000000005,"15min":0.80700000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.83799999999999997,"15min":0.83599999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.80100000000000005,"15min":0.78300000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83199999999999996,"15min":0.82299999999999995},"min":{"1min":0.66800000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.753}]},{"osd":8,"last update":"Sun Oct 8 12:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.95999999999999996,"15min":0.97499999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1200000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84599999999999997,"15min":0.85199999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.68899999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.874}]},{"osd":10,"last update":"Sun Oct 8 12:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.81299999999999994}]}]},{"osd":1,"up_from":14,"seq":60129542204,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":480489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.32000000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.84399999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83299999999999996,"5min":1.452,"15min":1.452},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.35899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72099999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56699999999999995,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":1.413,"15min":1.413},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59199999999999997,"15min":0.56799999999999995},"min":{"1min":0.53100000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":1.427,"15min":1.427},"last":0.70399999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.38700000000000001},"min":{"1min":0.28999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.40400000000000003,"15min":0.39000000000000001},"min":{"1min":0.317,"5min":0.245,"15min":0.245},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.46999999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65100000000000002,"15min":0.65200000000000002},"min":{"1min":0.46600000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":1.355,"15min":1.355},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.66500000000000004,"15min":0.65500000000000003},"min":{"1min":0.52000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93200000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.746}]},{"osd":7,"last update":"Sun Oct 8 12:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.79700000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.85699999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73299999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":444625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.59699999999999998,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.314,"15min":0.314},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60799999999999998,"15min":0.56100000000000005},"min":{"1min":0.434,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.997,"5min":1.046,"15min":1.046},"last":0.63200000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.628,"15min":0.57999999999999996},"min":{"1min":0.48799999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.622,"15min":0.58299999999999996},"min":{"1min":0.48899999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.998,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.745}]},{"osd":3,"last update":"Sun Oct 8 12:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.48299999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.42499999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.433,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.125,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.52300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0109999999999999,"5min":1.911,"15min":1.911},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:38:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.018,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.442},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.50600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.026,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.97299999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.50600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.873,"15min":0.879},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.048,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.873}]},{"osd":9,"last update":"Sun Oct 8 12:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.93899999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378679,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":480854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.88500000000000001,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.88700000000000001,"5min":1.194,"15min":1.194},"last":0.57199999999999995}]},{"osd":1,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.54100000000000004,"15min":0.51400000000000001},"min":{"1min":0.41999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55100000000000005,"15min":0.51500000000000001},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69099999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:38:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88400000000000001,"5min":1.073,"15min":1.073},"last":0.754},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.51000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.45100000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.435,"5min":0.378,"15min":0.378},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53900000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.40999999999999998},"min":{"1min":0.28799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.44,"15min":0.42599999999999999},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.5}]},{"osd":6,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.60699999999999998,"15min":0.59299999999999997},"min":{"1min":0.48299999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.47599999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.72299999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.873},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.80300000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.77500000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.85399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149745,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":444308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.45000000000000001,"15min":0.42399999999999999},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.48899999999999999,"15min":0.46700000000000003},"min":{"1min":0.38200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.90800000000000003,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.498}]},{"osd":1,"last update":"Sun Oct 8 12:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.62,"15min":0.60199999999999998},"min":{"1min":0.42299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":1.081,"15min":1.081},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.94399999999999995,"5min":1.05,"15min":1.05},"last":0.752}]},{"osd":2,"last update":"Sun Oct 8 12:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.47199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.53100000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.65600000000000003,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96799999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.69599999999999995,"15min":0.65900000000000003},"min":{"1min":0.50800000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73899999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98499999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.70899999999999996,"15min":0.69199999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.46000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.73199999999999998,"15min":0.71599999999999997},"min":{"1min":0.56999999999999995,"5min":0.37,"15min":0.37},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.64400000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83099999999999996,"15min":0.82899999999999996},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.78700000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.89400000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.48299999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.76100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":444557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67100000000000004,"15min":0.71999999999999997},"min":{"1min":0.439,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":6.0549999999999997,"15min":6.0549999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.373,"15min":0.35399999999999998},"min":{"1min":0.28399999999999997,"5min":0.223,"15min":0.223},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.39300000000000002,"15min":0.378},"min":{"1min":0.26600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.33100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.56100000000000005,"15min":0.52500000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.629},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57699999999999996,"15min":0.53700000000000003},"min":{"1min":0.45500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84499999999999997,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.47099999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.59499999999999997,"15min":0.54900000000000004},"min":{"1min":0.52500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.91300000000000003,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.58999999999999997,"15min":0.56399999999999995},"min":{"1min":0.442,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94299999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66300000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:38:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.61899999999999999,"15min":0.59899999999999998},"min":{"1min":0.53000000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.443},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.63200000000000001,"15min":0.61499999999999999},"min":{"1min":0.48699999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.52900000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.57299999999999995,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.54500000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.73599999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.71999999999999997}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.749},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.61199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":5,"up_from":39,"seq":167503724584,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1034877,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88600000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78200000000000003,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.46400000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.45800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.499}]},{"osd":2,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.39900000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.436},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57899999999999996}]},{"osd":3,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.624},{"interface":"front","average":{"1min":0.628,"5min":0.57099999999999995,"15min":0.55300000000000005},"min":{"1min":0.44600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.93300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.71599999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:38:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.60899999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.74299999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.90100000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.84599999999999997}]},{"osd":9,"last update":"Sun Oct 8 12:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.83099999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":19171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:39:23.199 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:39:23.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.434+0000 7f7376dff700 1 -- 172.21.15.59:0/3499720669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370106640 msgr2=0x7f7370106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:23.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.434+0000 7f7376dff700 1 --2- 172.21.15.59:0/3499720669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370106640 0x7f7370106a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7364009990 tx=0x7f7364009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.434+0000 7f7376dff700 1 -- 172.21.15.59:0/3499720669 shutdown_connections 2023-10-08T12:39:23.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.434+0000 7f7376dff700 1 --2- 172.21.15.59:0/3499720669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7370100ff0 0x7f737010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.434+0000 7f7376dff700 1 --2- 172.21.15.59:0/3499720669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370106640 0x7f7370106a20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.434+0000 7f7376dff700 1 --2- 172.21.15.59:0/3499720669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7370100630 0x7f7370100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.434+0000 7f7376dff700 1 -- 172.21.15.59:0/3499720669 >> 172.21.15.59:0/3499720669 conn(0x7f73700fc140 msgr2=0x7f73700fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.434+0000 7f7376dff700 1 -- 172.21.15.59:0/3499720669 shutdown_connections 2023-10-08T12:39:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.434+0000 7f7376dff700 1 -- 172.21.15.59:0/3499720669 wait complete. 2023-10-08T12:39:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.435+0000 7f7376dff700 1 Processor -- start 2023-10-08T12:39:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.435+0000 7f7376dff700 1 -- start start 2023-10-08T12:39:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.435+0000 7f7376dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370100630 0x7f737019e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.435+0000 7f7376dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7370100ff0 0x7f737019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.435+0000 7f7376dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7370106640 0x7f7370198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.435+0000 7f7376dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370199170 con 0x7f7370100630 2023-10-08T12:39:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.435+0000 7f7376dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73701992e0 con 0x7f7370106640 2023-10-08T12:39:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.435+0000 7f7376dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73701994a0 con 0x7f7370100ff0 2023-10-08T12:39:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.436+0000 7f7374b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370100630 0x7f737019e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.436+0000 7f7374b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370100630 0x7f737019e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47208/0 (socket says 172.21.15.59:47208) 2023-10-08T12:39:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.436+0000 7f7374b9b700 1 -- 172.21.15.59:0/865704311 learned_addr learned my addr 172.21.15.59:0/865704311 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.436+0000 7f737539c700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7370106640 0x7f7370198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.436+0000 7f736ffff700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7370100ff0 0x7f737019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.436+0000 7f7374b9b700 1 -- 172.21.15.59:0/865704311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7370100ff0 msgr2=0x7f737019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.436+0000 7f7374b9b700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7370100ff0 0x7f737019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.436+0000 7f7374b9b700 1 -- 172.21.15.59:0/865704311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7370106640 msgr2=0x7f7370198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.436+0000 7f7374b9b700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7370106640 0x7f7370198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.436+0000 7f7374b9b700 1 -- 172.21.15.59:0/865704311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c009520 con 0x7f7370100630 2023-10-08T12:39:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.436+0000 7f7374b9b700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370100630 0x7f737019e9e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7364000c00 tx=0x7f7364005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.437+0000 7f736dffb700 1 -- 172.21.15.59:0/865704311 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736401d070 con 0x7f7370100630 2023-10-08T12:39:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.437+0000 7f7376dff700 1 -- 172.21.15.59:0/865704311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73640095f0 con 0x7f7370100630 2023-10-08T12:39:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.437+0000 7f736dffb700 1 -- 172.21.15.59:0/865704311 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7364022470 con 0x7f7370100630 2023-10-08T12:39:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.437+0000 7f736dffb700 1 -- 172.21.15.59:0/865704311 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364017650 con 0x7f7370100630 2023-10-08T12:39:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.437+0000 7f7376dff700 1 -- 172.21.15.59:0/865704311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73701a57f0 con 0x7f7370100630 2023-10-08T12:39:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.438+0000 7f7376dff700 1 -- 172.21.15.59:0/865704311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7370101d70 con 0x7f7370100630 2023-10-08T12:39:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.440+0000 7f736dffb700 1 -- 172.21.15.59:0/865704311 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f73640225e0 con 0x7f7370100630 2023-10-08T12:39:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.441+0000 7f736dffb700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73600a1560 0x7f73600a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.441+0000 7f736dffb700 1 -- 172.21.15.59:0/865704311 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f73640ce950 con 0x7f7370100630 2023-10-08T12:39:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.441+0000 7f736ffff700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73600a1560 0x7f73600a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.442+0000 7f736ffff700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73600a1560 0x7f73600a3a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7370199cd0 tx=0x7f735c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:23.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.443+0000 7f736dffb700 1 -- 172.21.15.59:0/865704311 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7364097ea0 con 0x7f7370100630 2023-10-08T12:39:23.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.649+0000 7f7376dff700 1 -- 172.21.15.59:0/865704311 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7370110590 con 0x7f73600a1560 2023-10-08T12:39:23.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.660+0000 7f736dffb700 1 -- 172.21.15.59:0/865704311 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335557 (secure 0 0 0) 0x7f7370110590 con 0x7f73600a1560 2023-10-08T12:39:23.664 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:23.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 -- 172.21.15.59:0/865704311 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73600a1560 msgr2=0x7f73600a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:23.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73600a1560 0x7f73600a3a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7370199cd0 tx=0x7f735c009260 comp rx=0 tx=0).stop 2023-10-08T12:39:23.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 -- 172.21.15.59:0/865704311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370100630 msgr2=0x7f737019e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:23.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370100630 0x7f737019e9e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7364000c00 tx=0x7f7364005740 comp rx=0 tx=0).stop 2023-10-08T12:39:23.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 -- 172.21.15.59:0/865704311 shutdown_connections 2023-10-08T12:39:23.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73600a1560 0x7f73600a3a20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7370106640 0x7f7370198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370100630 0x7f737019e9e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 --2- 172.21.15.59:0/865704311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7370100ff0 0x7f737019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:23.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 -- 172.21.15.59:0/865704311 >> 172.21.15.59:0/865704311 conn(0x7f73700fc140 msgr2=0x7f737010bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:23.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 -- 172.21.15.59:0/865704311 shutdown_connections 2023-10-08T12:39:23.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:23.664+0000 7f7376dff700 1 -- 172.21.15.59:0/865704311 wait complete. 2023-10-08T12:39:23.667 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-08T12:39:23.683 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2023-10-08T12:39:22.776401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":610266,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":151,"num_read_kb":143,"num_write":233,"num_write_kb":2971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335176,"kb_used_data":10916,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606648,"statfs":{"total":1151940427776,"available":1151597207552,"internally_reserved":0,"allocated":11177984,"data_stored":7198056,"data_compressed":107388,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19898,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":24,"num_write":52,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.585430"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670437+0000","last_change":"2023-10-08T12:39:14.206423+0000","last_active":"2023-10-08T12:39:15.670437+0000","last_peered":"2023-10-08T12:39:15.670437+0000","last_clean":"2023-10-08T12:39:15.670437+0000","last_became_active":"2023-10-08T12:39:14.205454+0000","last_became_peered":"2023-10-08T12:39:14.205454+0000","last_unstale":"2023-10-08T12:39:15.670437+0000","last_undegraded":"2023-10-08T12:39:15.670437+0000","last_fullsized":"2023-10-08T12:39:15.670437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:37.669007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548773+0000","last_change":"2023-10-08T12:39:14.215711+0000","last_active":"2023-10-08T12:39:15.548773+0000","last_peered":"2023-10-08T12:39:15.548773+0000","last_clean":"2023-10-08T12:39:15.548773+0000","last_became_active":"2023-10-08T12:39:14.215283+0000","last_became_peered":"2023-10-08T12:39:14.215283+0000","last_unstale":"2023-10-08T12:39:15.548773+0000","last_undegraded":"2023-10-08T12:39:15.548773+0000","last_fullsized":"2023-10-08T12:39:15.548773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:29.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549611+0000","last_change":"2023-10-08T12:39:14.209843+0000","last_active":"2023-10-08T12:39:15.549611+0000","last_peered":"2023-10-08T12:39:15.549611+0000","last_clean":"2023-10-08T12:39:15.549611+0000","last_became_active":"2023-10-08T12:39:14.209528+0000","last_became_peered":"2023-10-08T12:39:14.209528+0000","last_unstale":"2023-10-08T12:39:15.549611+0000","last_undegraded":"2023-10-08T12:39:15.549611+0000","last_fullsized":"2023-10-08T12:39:15.549611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:54.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405655+0000","last_change":"2023-10-08T12:39:14.204891+0000","last_active":"2023-10-08T12:39:15.405655+0000","last_peered":"2023-10-08T12:39:15.405655+0000","last_clean":"2023-10-08T12:39:15.405655+0000","last_became_active":"2023-10-08T12:39:14.204075+0000","last_became_peered":"2023-10-08T12:39:14.204075+0000","last_unstale":"2023-10-08T12:39:15.405655+0000","last_undegraded":"2023-10-08T12:39:15.405655+0000","last_fullsized":"2023-10-08T12:39:15.405655+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:18.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493441+0000","last_change":"2023-10-08T12:39:14.212527+0000","last_active":"2023-10-08T12:39:15.493441+0000","last_peered":"2023-10-08T12:39:15.493441+0000","last_clean":"2023-10-08T12:39:15.493441+0000","last_became_active":"2023-10-08T12:39:14.212188+0000","last_became_peered":"2023-10-08T12:39:14.212188+0000","last_unstale":"2023-10-08T12:39:15.493441+0000","last_undegraded":"2023-10-08T12:39:15.493441+0000","last_fullsized":"2023-10-08T12:39:15.493441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:28.952210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549185+0000","last_change":"2023-10-08T12:39:14.216842+0000","last_active":"2023-10-08T12:39:15.549185+0000","last_peered":"2023-10-08T12:39:15.549185+0000","last_clean":"2023-10-08T12:39:15.549185+0000","last_became_active":"2023-10-08T12:39:14.216446+0000","last_became_peered":"2023-10-08T12:39:14.216446+0000","last_unstale":"2023-10-08T12:39:15.549185+0000","last_undegraded":"2023-10-08T12:39:15.549185+0000","last_fullsized":"2023-10-08T12:39:15.549185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:40.718246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548684+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:39:15.548684+0000","last_peered":"2023-10-08T12:39:15.548684+0000","last_clean":"2023-10-08T12:39:15.548684+0000","last_became_active":"2023-10-08T12:39:14.222410+0000","last_became_peered":"2023-10-08T12:39:14.222410+0000","last_unstale":"2023-10-08T12:39:15.548684+0000","last_undegraded":"2023-10-08T12:39:15.548684+0000","last_fullsized":"2023-10-08T12:39:15.548684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:03.599610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550066+0000","last_change":"2023-10-08T12:39:14.209422+0000","last_active":"2023-10-08T12:39:15.550066+0000","last_peered":"2023-10-08T12:39:15.550066+0000","last_clean":"2023-10-08T12:39:15.550066+0000","last_became_active":"2023-10-08T12:39:14.209073+0000","last_became_peered":"2023-10-08T12:39:14.209073+0000","last_unstale":"2023-10-08T12:39:15.550066+0000","last_undegraded":"2023-10-08T12:39:15.550066+0000","last_fullsized":"2023-10-08T12:39:15.550066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:09.587414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203646+0000","last_change":"2023-10-08T12:39:14.211228+0000","last_active":"2023-10-08T12:39:15.203646+0000","last_peered":"2023-10-08T12:39:15.203646+0000","last_clean":"2023-10-08T12:39:15.203646+0000","last_became_active":"2023-10-08T12:39:14.210940+0000","last_became_peered":"2023-10-08T12:39:14.210940+0000","last_unstale":"2023-10-08T12:39:15.203646+0000","last_undegraded":"2023-10-08T12:39:15.203646+0000","last_fullsized":"2023-10-08T12:39:15.203646+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:52.683409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549070+0000","last_change":"2023-10-08T12:39:14.207071+0000","last_active":"2023-10-08T12:39:15.549070+0000","last_peered":"2023-10-08T12:39:15.549070+0000","last_clean":"2023-10-08T12:39:15.549070+0000","last_became_active":"2023-10-08T12:39:14.206770+0000","last_became_peered":"2023-10-08T12:39:14.206770+0000","last_unstale":"2023-10-08T12:39:15.549070+0000","last_undegraded":"2023-10-08T12:39:15.549070+0000","last_fullsized":"2023-10-08T12:39:15.549070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:19.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549102+0000","last_change":"2023-10-08T12:39:14.212780+0000","last_active":"2023-10-08T12:39:15.549102+0000","last_peered":"2023-10-08T12:39:15.549102+0000","last_clean":"2023-10-08T12:39:15.549102+0000","last_became_active":"2023-10-08T12:39:14.212167+0000","last_became_peered":"2023-10-08T12:39:14.212167+0000","last_unstale":"2023-10-08T12:39:15.549102+0000","last_undegraded":"2023-10-08T12:39:15.549102+0000","last_fullsized":"2023-10-08T12:39:15.549102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:17.332257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405632+0000","last_change":"2023-10-08T12:39:14.204506+0000","last_active":"2023-10-08T12:39:15.405632+0000","last_peered":"2023-10-08T12:39:15.405632+0000","last_clean":"2023-10-08T12:39:15.405632+0000","last_became_active":"2023-10-08T12:39:14.204184+0000","last_became_peered":"2023-10-08T12:39:14.204184+0000","last_unstale":"2023-10-08T12:39:15.405632+0000","last_undegraded":"2023-10-08T12:39:15.405632+0000","last_fullsized":"2023-10-08T12:39:15.405632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:05.696554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549661+0000","last_change":"2023-10-08T12:39:14.211957+0000","last_active":"2023-10-08T12:39:15.549661+0000","last_peered":"2023-10-08T12:39:15.549661+0000","last_clean":"2023-10-08T12:39:15.549661+0000","last_became_active":"2023-10-08T12:39:14.211629+0000","last_became_peered":"2023-10-08T12:39:14.211629+0000","last_unstale":"2023-10-08T12:39:15.549661+0000","last_undegraded":"2023-10-08T12:39:15.549661+0000","last_fullsized":"2023-10-08T12:39:15.549661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:10.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549044+0000","last_change":"2023-10-08T12:39:14.207006+0000","last_active":"2023-10-08T12:39:15.549044+0000","last_peered":"2023-10-08T12:39:15.549044+0000","last_clean":"2023-10-08T12:39:15.549044+0000","last_became_active":"2023-10-08T12:39:14.206624+0000","last_became_peered":"2023-10-08T12:39:14.206624+0000","last_unstale":"2023-10-08T12:39:15.549044+0000","last_undegraded":"2023-10-08T12:39:15.549044+0000","last_fullsized":"2023-10-08T12:39:15.549044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:11.232875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548718+0000","last_change":"2023-10-08T12:39:14.213865+0000","last_active":"2023-10-08T12:39:15.548718+0000","last_peered":"2023-10-08T12:39:15.548718+0000","last_clean":"2023-10-08T12:39:15.548718+0000","last_became_active":"2023-10-08T12:39:14.207972+0000","last_became_peered":"2023-10-08T12:39:14.207972+0000","last_unstale":"2023-10-08T12:39:15.548718+0000","last_undegraded":"2023-10-08T12:39:15.548718+0000","last_fullsized":"2023-10-08T12:39:15.548718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:01.434731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203301+0000","last_change":"2023-10-08T12:39:14.206313+0000","last_active":"2023-10-08T12:39:15.203301+0000","last_peered":"2023-10-08T12:39:15.203301+0000","last_clean":"2023-10-08T12:39:15.203301+0000","last_became_active":"2023-10-08T12:39:14.206001+0000","last_became_peered":"2023-10-08T12:39:14.206001+0000","last_unstale":"2023-10-08T12:39:15.203301+0000","last_undegraded":"2023-10-08T12:39:15.203301+0000","last_fullsized":"2023-10-08T12:39:15.203301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:43.912356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670533+0000","last_change":"2023-10-08T12:39:14.205752+0000","last_active":"2023-10-08T12:39:15.670533+0000","last_peered":"2023-10-08T12:39:15.670533+0000","last_clean":"2023-10-08T12:39:15.670533+0000","last_became_active":"2023-10-08T12:39:14.204696+0000","last_became_peered":"2023-10-08T12:39:14.204696+0000","last_unstale":"2023-10-08T12:39:15.670533+0000","last_undegraded":"2023-10-08T12:39:15.670533+0000","last_fullsized":"2023-10-08T12:39:15.670533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:42.409107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201311+0000","last_change":"2023-10-08T12:39:14.203373+0000","last_active":"2023-10-08T12:39:15.201311+0000","last_peered":"2023-10-08T12:39:15.201311+0000","last_clean":"2023-10-08T12:39:15.201311+0000","last_became_active":"2023-10-08T12:39:14.202966+0000","last_became_peered":"2023-10-08T12:39:14.202966+0000","last_unstale":"2023-10-08T12:39:15.201311+0000","last_undegraded":"2023-10-08T12:39:15.201311+0000","last_fullsized":"2023-10-08T12:39:15.201311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:00.114475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.202041+0000","last_change":"2023-10-08T12:39:14.216154+0000","last_active":"2023-10-08T12:39:15.202041+0000","last_peered":"2023-10-08T12:39:15.202041+0000","last_clean":"2023-10-08T12:39:15.202041+0000","last_became_active":"2023-10-08T12:39:14.215868+0000","last_became_peered":"2023-10-08T12:39:14.215868+0000","last_unstale":"2023-10-08T12:39:15.202041+0000","last_undegraded":"2023-10-08T12:39:15.202041+0000","last_fullsized":"2023-10-08T12:39:15.202041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:53.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201161+0000","last_change":"2023-10-08T12:39:13.214538+0000","last_active":"2023-10-08T12:39:15.201161+0000","last_peered":"2023-10-08T12:39:15.201161+0000","last_clean":"2023-10-08T12:39:15.201161+0000","last_became_active":"2023-10-08T12:39:13.214162+0000","last_became_peered":"2023-10-08T12:39:13.214162+0000","last_unstale":"2023-10-08T12:39:15.201161+0000","last_undegraded":"2023-10-08T12:39:15.201161+0000","last_fullsized":"2023-10-08T12:39:15.201161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:11.500815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550308+0000","last_change":"2023-10-08T12:39:14.211308+0000","last_active":"2023-10-08T12:39:15.550308+0000","last_peered":"2023-10-08T12:39:15.550308+0000","last_clean":"2023-10-08T12:39:15.550308+0000","last_became_active":"2023-10-08T12:39:14.210961+0000","last_became_peered":"2023-10-08T12:39:14.210961+0000","last_unstale":"2023-10-08T12:39:15.550308+0000","last_undegraded":"2023-10-08T12:39:15.550308+0000","last_fullsized":"2023-10-08T12:39:15.550308+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.221981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.706784+0000","last_change":"2023-10-08T12:39:13.219982+0000","last_active":"2023-10-08T12:39:14.706784+0000","last_peered":"2023-10-08T12:39:14.706784+0000","last_clean":"2023-10-08T12:39:14.706784+0000","last_became_active":"2023-10-08T12:39:13.219668+0000","last_became_peered":"2023-10-08T12:39:13.219668+0000","last_unstale":"2023-10-08T12:39:14.706784+0000","last_undegraded":"2023-10-08T12:39:14.706784+0000","last_fullsized":"2023-10-08T12:39:14.706784+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.664553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549090+0000","last_change":"2023-10-08T12:39:14.216922+0000","last_active":"2023-10-08T12:39:15.549090+0000","last_peered":"2023-10-08T12:39:15.549090+0000","last_clean":"2023-10-08T12:39:15.549090+0000","last_became_active":"2023-10-08T12:39:14.216634+0000","last_became_peered":"2023-10-08T12:39:14.216634+0000","last_unstale":"2023-10-08T12:39:15.549090+0000","last_undegraded":"2023-10-08T12:39:15.549090+0000","last_fullsized":"2023-10-08T12:39:15.549090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:21.254178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.708415+0000","last_change":"2023-10-08T12:39:13.220262+0000","last_active":"2023-10-08T12:39:14.708415+0000","last_peered":"2023-10-08T12:39:14.708415+0000","last_clean":"2023-10-08T12:39:14.708415+0000","last_became_active":"2023-10-08T12:39:13.219917+0000","last_became_peered":"2023-10-08T12:39:13.219917+0000","last_unstale":"2023-10-08T12:39:14.708415+0000","last_undegraded":"2023-10-08T12:39:14.708415+0000","last_fullsized":"2023-10-08T12:39:14.708415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:34.368119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203329+0000","last_change":"2023-10-08T12:39:14.212620+0000","last_active":"2023-10-08T12:39:15.203329+0000","last_peered":"2023-10-08T12:39:15.203329+0000","last_clean":"2023-10-08T12:39:15.203329+0000","last_became_active":"2023-10-08T12:39:14.212128+0000","last_became_peered":"2023-10-08T12:39:14.212128+0000","last_unstale":"2023-10-08T12:39:15.203329+0000","last_undegraded":"2023-10-08T12:39:15.203329+0000","last_fullsized":"2023-10-08T12:39:15.203329+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:40.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.706405+0000","last_change":"2023-10-08T12:39:13.218291+0000","last_active":"2023-10-08T12:39:14.706405+0000","last_peered":"2023-10-08T12:39:14.706405+0000","last_clean":"2023-10-08T12:39:14.706405+0000","last_became_active":"2023-10-08T12:39:13.217907+0000","last_became_peered":"2023-10-08T12:39:13.217907+0000","last_unstale":"2023-10-08T12:39:14.706405+0000","last_undegraded":"2023-10-08T12:39:14.706405+0000","last_fullsized":"2023-10-08T12:39:14.706405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:54:46.891553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549340+0000","last_change":"2023-10-08T12:39:14.207991+0000","last_active":"2023-10-08T12:39:15.549340+0000","last_peered":"2023-10-08T12:39:15.549340+0000","last_clean":"2023-10-08T12:39:15.549340+0000","last_became_active":"2023-10-08T12:39:14.207683+0000","last_became_peered":"2023-10-08T12:39:14.207683+0000","last_unstale":"2023-10-08T12:39:15.549340+0000","last_undegraded":"2023-10-08T12:39:15.549340+0000","last_fullsized":"2023-10-08T12:39:15.549340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:47.809553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.708660+0000","last_change":"2023-10-08T12:39:13.214704+0000","last_active":"2023-10-08T12:39:14.708660+0000","last_peered":"2023-10-08T12:39:14.708660+0000","last_clean":"2023-10-08T12:39:14.708660+0000","last_became_active":"2023-10-08T12:39:13.214205+0000","last_became_peered":"2023-10-08T12:39:13.214205+0000","last_unstale":"2023-10-08T12:39:14.708660+0000","last_undegraded":"2023-10-08T12:39:14.708660+0000","last_fullsized":"2023-10-08T12:39:14.708660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:58.572620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493406+0000","last_change":"2023-10-08T12:39:14.219813+0000","last_active":"2023-10-08T12:39:15.493406+0000","last_peered":"2023-10-08T12:39:15.493406+0000","last_clean":"2023-10-08T12:39:15.493406+0000","last_became_active":"2023-10-08T12:39:14.219511+0000","last_became_peered":"2023-10-08T12:39:14.219511+0000","last_unstale":"2023-10-08T12:39:15.493406+0000","last_undegraded":"2023-10-08T12:39:15.493406+0000","last_fullsized":"2023-10-08T12:39:15.493406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:43.716871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549057+0000","last_change":"2023-10-08T12:39:13.212567+0000","last_active":"2023-10-08T12:39:15.549057+0000","last_peered":"2023-10-08T12:39:15.549057+0000","last_clean":"2023-10-08T12:39:15.549057+0000","last_became_active":"2023-10-08T12:39:13.212079+0000","last_became_peered":"2023-10-08T12:39:13.212079+0000","last_unstale":"2023-10-08T12:39:15.549057+0000","last_undegraded":"2023-10-08T12:39:15.549057+0000","last_fullsized":"2023-10-08T12:39:15.549057+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:35.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549149+0000","last_change":"2023-10-08T12:39:14.208760+0000","last_active":"2023-10-08T12:39:15.549149+0000","last_peered":"2023-10-08T12:39:15.549149+0000","last_clean":"2023-10-08T12:39:15.549149+0000","last_became_active":"2023-10-08T12:39:14.208490+0000","last_became_peered":"2023-10-08T12:39:14.208490+0000","last_unstale":"2023-10-08T12:39:15.549149+0000","last_undegraded":"2023-10-08T12:39:15.549149+0000","last_fullsized":"2023-10-08T12:39:15.549149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:19:56.423514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056781+0000","last_change":"2023-10-08T12:39:13.214197+0000","last_active":"2023-10-08T12:39:15.056781+0000","last_peered":"2023-10-08T12:39:15.056781+0000","last_clean":"2023-10-08T12:39:15.056781+0000","last_became_active":"2023-10-08T12:39:13.213829+0000","last_became_peered":"2023-10-08T12:39:13.213829+0000","last_unstale":"2023-10-08T12:39:15.056781+0000","last_undegraded":"2023-10-08T12:39:15.056781+0000","last_fullsized":"2023-10-08T12:39:15.056781+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:29:05.080370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550089+0000","last_change":"2023-10-08T12:39:14.212369+0000","last_active":"2023-10-08T12:39:15.550089+0000","last_peered":"2023-10-08T12:39:15.550089+0000","last_clean":"2023-10-08T12:39:15.550089+0000","last_became_active":"2023-10-08T12:39:14.211917+0000","last_became_peered":"2023-10-08T12:39:14.211917+0000","last_unstale":"2023-10-08T12:39:15.550089+0000","last_undegraded":"2023-10-08T12:39:15.550089+0000","last_fullsized":"2023-10-08T12:39:15.550089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:27.265251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.199098+0000","last_change":"2023-10-08T12:39:13.217339+0000","last_active":"2023-10-08T12:39:14.199098+0000","last_peered":"2023-10-08T12:39:14.199098+0000","last_clean":"2023-10-08T12:39:14.199098+0000","last_became_active":"2023-10-08T12:39:13.216973+0000","last_became_peered":"2023-10-08T12:39:13.216973+0000","last_unstale":"2023-10-08T12:39:14.199098+0000","last_undegraded":"2023-10-08T12:39:14.199098+0000","last_fullsized":"2023-10-08T12:39:14.199098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:35.899844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.200919+0000","last_change":"2023-10-08T12:39:14.218870+0000","last_active":"2023-10-08T12:39:15.200919+0000","last_peered":"2023-10-08T12:39:15.200919+0000","last_clean":"2023-10-08T12:39:15.200919+0000","last_became_active":"2023-10-08T12:39:14.217879+0000","last_became_peered":"2023-10-08T12:39:14.217879+0000","last_unstale":"2023-10-08T12:39:15.200919+0000","last_undegraded":"2023-10-08T12:39:15.200919+0000","last_fullsized":"2023-10-08T12:39:15.200919+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:06.769081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549190+0000","last_change":"2023-10-08T12:39:13.209120+0000","last_active":"2023-10-08T12:39:15.549190+0000","last_peered":"2023-10-08T12:39:15.549190+0000","last_clean":"2023-10-08T12:39:15.549190+0000","last_became_active":"2023-10-08T12:39:13.208755+0000","last_became_peered":"2023-10-08T12:39:13.208755+0000","last_unstale":"2023-10-08T12:39:15.549190+0000","last_undegraded":"2023-10-08T12:39:15.549190+0000","last_fullsized":"2023-10-08T12:39:15.549190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:48.977375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203583+0000","last_change":"2023-10-08T12:39:14.208187+0000","last_active":"2023-10-08T12:39:15.203583+0000","last_peered":"2023-10-08T12:39:15.203583+0000","last_clean":"2023-10-08T12:39:15.203583+0000","last_became_active":"2023-10-08T12:39:14.207868+0000","last_became_peered":"2023-10-08T12:39:14.207868+0000","last_unstale":"2023-10-08T12:39:15.203583+0000","last_undegraded":"2023-10-08T12:39:15.203583+0000","last_fullsized":"2023-10-08T12:39:15.203583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:50.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853939+0000","last_change":"2023-10-08T12:39:13.220447+0000","last_active":"2023-10-08T12:39:14.853939+0000","last_peered":"2023-10-08T12:39:14.853939+0000","last_clean":"2023-10-08T12:39:14.853939+0000","last_became_active":"2023-10-08T12:39:13.220032+0000","last_became_peered":"2023-10-08T12:39:13.220032+0000","last_unstale":"2023-10-08T12:39:14.853939+0000","last_undegraded":"2023-10-08T12:39:14.853939+0000","last_fullsized":"2023-10-08T12:39:14.853939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:22.223707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549247+0000","last_change":"2023-10-08T12:39:14.214899+0000","last_active":"2023-10-08T12:39:15.549247+0000","last_peered":"2023-10-08T12:39:15.549247+0000","last_clean":"2023-10-08T12:39:15.549247+0000","last_became_active":"2023-10-08T12:39:14.214536+0000","last_became_peered":"2023-10-08T12:39:14.214536+0000","last_unstale":"2023-10-08T12:39:15.549247+0000","last_undegraded":"2023-10-08T12:39:15.549247+0000","last_fullsized":"2023-10-08T12:39:15.549247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:34.166298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.706531+0000","last_change":"2023-10-08T12:39:13.219131+0000","last_active":"2023-10-08T12:39:14.706531+0000","last_peered":"2023-10-08T12:39:14.706531+0000","last_clean":"2023-10-08T12:39:14.706531+0000","last_became_active":"2023-10-08T12:39:13.218639+0000","last_became_peered":"2023-10-08T12:39:13.218639+0000","last_unstale":"2023-10-08T12:39:14.706531+0000","last_undegraded":"2023-10-08T12:39:14.706531+0000","last_fullsized":"2023-10-08T12:39:14.706531+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.316153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203386+0000","last_change":"2023-10-08T12:39:14.212352+0000","last_active":"2023-10-08T12:39:15.203386+0000","last_peered":"2023-10-08T12:39:15.203386+0000","last_clean":"2023-10-08T12:39:15.203386+0000","last_became_active":"2023-10-08T12:39:14.211342+0000","last_became_peered":"2023-10-08T12:39:14.211342+0000","last_unstale":"2023-10-08T12:39:15.203386+0000","last_undegraded":"2023-10-08T12:39:15.203386+0000","last_fullsized":"2023-10-08T12:39:15.203386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:39:00.731860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:20.230188+0000","last_change":"2023-10-08T12:39:13.209967+0000","last_active":"2023-10-08T12:39:20.230188+0000","last_peered":"2023-10-08T12:39:20.230188+0000","last_clean":"2023-10-08T12:39:20.230188+0000","last_became_active":"2023-10-08T12:39:13.209650+0000","last_became_peered":"2023-10-08T12:39:13.209650+0000","last_unstale":"2023-10-08T12:39:20.230188+0000","last_undegraded":"2023-10-08T12:39:20.230188+0000","last_fullsized":"2023-10-08T12:39:20.230188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:08.206168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18977,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":9,"num_read_kb":18,"num_write":12,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493730+0000","last_change":"2023-10-08T12:39:14.211335+0000","last_active":"2023-10-08T12:39:15.493730+0000","last_peered":"2023-10-08T12:39:15.493730+0000","last_clean":"2023-10-08T12:39:15.493730+0000","last_became_active":"2023-10-08T12:39:14.211003+0000","last_became_peered":"2023-10-08T12:39:14.211003+0000","last_unstale":"2023-10-08T12:39:15.493730+0000","last_undegraded":"2023-10-08T12:39:15.493730+0000","last_fullsized":"2023-10-08T12:39:15.493730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:00.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201926+0000","last_change":"2023-10-08T12:39:13.215379+0000","last_active":"2023-10-08T12:39:15.201926+0000","last_peered":"2023-10-08T12:39:15.201926+0000","last_clean":"2023-10-08T12:39:15.201926+0000","last_became_active":"2023-10-08T12:39:13.215036+0000","last_became_peered":"2023-10-08T12:39:13.215036+0000","last_unstale":"2023-10-08T12:39:15.201926+0000","last_undegraded":"2023-10-08T12:39:15.201926+0000","last_fullsized":"2023-10-08T12:39:15.201926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:24.690473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549022+0000","last_change":"2023-10-08T12:39:14.207907+0000","last_active":"2023-10-08T12:39:15.549022+0000","last_peered":"2023-10-08T12:39:15.549022+0000","last_clean":"2023-10-08T12:39:15.549022+0000","last_became_active":"2023-10-08T12:39:14.207620+0000","last_became_peered":"2023-10-08T12:39:14.207620+0000","last_unstale":"2023-10-08T12:39:15.549022+0000","last_undegraded":"2023-10-08T12:39:15.549022+0000","last_fullsized":"2023-10-08T12:39:15.549022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:49:11.866245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.196556+0000","last_change":"2023-10-08T12:39:13.214521+0000","last_active":"2023-10-08T12:39:14.196556+0000","last_peered":"2023-10-08T12:39:14.196556+0000","last_clean":"2023-10-08T12:39:14.196556+0000","last_became_active":"2023-10-08T12:39:13.214127+0000","last_became_peered":"2023-10-08T12:39:13.214127+0000","last_unstale":"2023-10-08T12:39:14.196556+0000","last_undegraded":"2023-10-08T12:39:14.196556+0000","last_fullsized":"2023-10-08T12:39:14.196556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:46.735663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548940+0000","last_change":"2023-10-08T12:39:14.213542+0000","last_active":"2023-10-08T12:39:15.548940+0000","last_peered":"2023-10-08T12:39:15.548940+0000","last_clean":"2023-10-08T12:39:15.548940+0000","last_became_active":"2023-10-08T12:39:14.213295+0000","last_became_peered":"2023-10-08T12:39:14.213295+0000","last_unstale":"2023-10-08T12:39:15.548940+0000","last_undegraded":"2023-10-08T12:39:15.548940+0000","last_fullsized":"2023-10-08T12:39:15.548940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:46.883656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405433+0000","last_change":"2023-10-08T12:39:13.214758+0000","last_active":"2023-10-08T12:39:15.405433+0000","last_peered":"2023-10-08T12:39:15.405433+0000","last_clean":"2023-10-08T12:39:15.405433+0000","last_became_active":"2023-10-08T12:39:13.214304+0000","last_became_peered":"2023-10-08T12:39:13.214304+0000","last_unstale":"2023-10-08T12:39:15.405433+0000","last_undegraded":"2023-10-08T12:39:15.405433+0000","last_fullsized":"2023-10-08T12:39:15.405433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:34.074248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548713+0000","last_change":"2023-10-08T12:39:14.208071+0000","last_active":"2023-10-08T12:39:15.548713+0000","last_peered":"2023-10-08T12:39:15.548713+0000","last_clean":"2023-10-08T12:39:15.548713+0000","last_became_active":"2023-10-08T12:39:14.207787+0000","last_became_peered":"2023-10-08T12:39:14.207787+0000","last_unstale":"2023-10-08T12:39:15.548713+0000","last_undegraded":"2023-10-08T12:39:15.548713+0000","last_fullsized":"2023-10-08T12:39:15.548713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:40.869575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.708642+0000","last_change":"2023-10-08T12:39:13.219105+0000","last_active":"2023-10-08T12:39:14.708642+0000","last_peered":"2023-10-08T12:39:14.708642+0000","last_clean":"2023-10-08T12:39:14.708642+0000","last_became_active":"2023-10-08T12:39:13.218767+0000","last_became_peered":"2023-10-08T12:39:13.218767+0000","last_unstale":"2023-10-08T12:39:14.708642+0000","last_undegraded":"2023-10-08T12:39:14.708642+0000","last_fullsized":"2023-10-08T12:39:14.708642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:22.763921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548972+0000","last_change":"2023-10-08T12:39:14.210037+0000","last_active":"2023-10-08T12:39:15.548972+0000","last_peered":"2023-10-08T12:39:15.548972+0000","last_clean":"2023-10-08T12:39:15.548972+0000","last_became_active":"2023-10-08T12:39:14.208140+0000","last_became_peered":"2023-10-08T12:39:14.208140+0000","last_unstale":"2023-10-08T12:39:15.548972+0000","last_undegraded":"2023-10-08T12:39:15.548972+0000","last_fullsized":"2023-10-08T12:39:15.548972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:38.475668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493819+0000","last_change":"2023-10-08T12:39:13.219229+0000","last_active":"2023-10-08T12:39:15.493819+0000","last_peered":"2023-10-08T12:39:15.493819+0000","last_clean":"2023-10-08T12:39:15.493819+0000","last_became_active":"2023-10-08T12:39:13.217964+0000","last_became_peered":"2023-10-08T12:39:13.217964+0000","last_unstale":"2023-10-08T12:39:15.493819+0000","last_undegraded":"2023-10-08T12:39:15.493819+0000","last_fullsized":"2023-10-08T12:39:15.493819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:47.480351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670304+0000","last_change":"2023-10-08T12:39:14.199562+0000","last_active":"2023-10-08T12:39:15.670304+0000","last_peered":"2023-10-08T12:39:15.670304+0000","last_clean":"2023-10-08T12:39:15.670304+0000","last_became_active":"2023-10-08T12:39:14.199235+0000","last_became_peered":"2023-10-08T12:39:14.199235+0000","last_unstale":"2023-10-08T12:39:15.670304+0000","last_undegraded":"2023-10-08T12:39:15.670304+0000","last_fullsized":"2023-10-08T12:39:15.670304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:17.181406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.192321+0000","last_change":"2023-10-08T12:39:13.212791+0000","last_active":"2023-10-08T12:39:14.192321+0000","last_peered":"2023-10-08T12:39:14.192321+0000","last_clean":"2023-10-08T12:39:14.192321+0000","last_became_active":"2023-10-08T12:39:13.212146+0000","last_became_peered":"2023-10-08T12:39:13.212146+0000","last_unstale":"2023-10-08T12:39:14.192321+0000","last_undegraded":"2023-10-08T12:39:14.192321+0000","last_fullsized":"2023-10-08T12:39:14.192321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:37.452859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.615669+0000","last_change":"2023-10-08T12:39:14.215081+0000","last_active":"2023-10-08T12:39:15.615669+0000","last_peered":"2023-10-08T12:39:15.615669+0000","last_clean":"2023-10-08T12:39:15.615669+0000","last_became_active":"2023-10-08T12:39:14.214825+0000","last_became_peered":"2023-10-08T12:39:14.214825+0000","last_unstale":"2023-10-08T12:39:15.615669+0000","last_undegraded":"2023-10-08T12:39:15.615669+0000","last_fullsized":"2023-10-08T12:39:15.615669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:05.706569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853878+0000","last_change":"2023-10-08T12:39:13.217672+0000","last_active":"2023-10-08T12:39:14.853878+0000","last_peered":"2023-10-08T12:39:14.853878+0000","last_clean":"2023-10-08T12:39:14.853878+0000","last_became_active":"2023-10-08T12:39:13.217277+0000","last_became_peered":"2023-10-08T12:39:13.217277+0000","last_unstale":"2023-10-08T12:39:14.853878+0000","last_undegraded":"2023-10-08T12:39:14.853878+0000","last_fullsized":"2023-10-08T12:39:14.853878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:41.097439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549447+0000","last_change":"2023-10-08T12:39:14.219261+0000","last_active":"2023-10-08T12:39:15.549447+0000","last_peered":"2023-10-08T12:39:15.549447+0000","last_clean":"2023-10-08T12:39:15.549447+0000","last_became_active":"2023-10-08T12:39:14.218963+0000","last_became_peered":"2023-10-08T12:39:14.218963+0000","last_unstale":"2023-10-08T12:39:15.549447+0000","last_undegraded":"2023-10-08T12:39:15.549447+0000","last_fullsized":"2023-10-08T12:39:15.549447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:19.573306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549170+0000","last_change":"2023-10-08T12:39:14.207923+0000","last_active":"2023-10-08T12:39:15.549170+0000","last_peered":"2023-10-08T12:39:15.549170+0000","last_clean":"2023-10-08T12:39:15.549170+0000","last_became_active":"2023-10-08T12:39:14.207634+0000","last_became_peered":"2023-10-08T12:39:14.207634+0000","last_unstale":"2023-10-08T12:39:15.549170+0000","last_undegraded":"2023-10-08T12:39:15.549170+0000","last_fullsized":"2023-10-08T12:39:15.549170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:39.634945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056769+0000","last_change":"2023-10-08T12:39:13.223021+0000","last_active":"2023-10-08T12:39:15.056769+0000","last_peered":"2023-10-08T12:39:15.056769+0000","last_clean":"2023-10-08T12:39:15.056769+0000","last_became_active":"2023-10-08T12:39:13.222680+0000","last_became_peered":"2023-10-08T12:39:13.222680+0000","last_unstale":"2023-10-08T12:39:15.056769+0000","last_undegraded":"2023-10-08T12:39:15.056769+0000","last_fullsized":"2023-10-08T12:39:15.056769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:40.454436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549663+0000","last_change":"2023-10-08T12:39:14.217364+0000","last_active":"2023-10-08T12:39:15.549663+0000","last_peered":"2023-10-08T12:39:15.549663+0000","last_clean":"2023-10-08T12:39:15.549663+0000","last_became_active":"2023-10-08T12:39:14.216984+0000","last_became_peered":"2023-10-08T12:39:14.216984+0000","last_unstale":"2023-10-08T12:39:15.549663+0000","last_undegraded":"2023-10-08T12:39:15.549663+0000","last_fullsized":"2023-10-08T12:39:15.549663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:11:51.818034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405564+0000","last_change":"2023-10-08T12:39:13.207687+0000","last_active":"2023-10-08T12:39:15.405564+0000","last_peered":"2023-10-08T12:39:15.405564+0000","last_clean":"2023-10-08T12:39:15.405564+0000","last_became_active":"2023-10-08T12:39:13.207270+0000","last_became_peered":"2023-10-08T12:39:13.207270+0000","last_unstale":"2023-10-08T12:39:15.405564+0000","last_undegraded":"2023-10-08T12:39:15.405564+0000","last_fullsized":"2023-10-08T12:39:15.405564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:44.673383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.200716+0000","last_change":"2023-10-08T12:38:07.696721+0000","last_active":"2023-10-08T12:39:14.200716+0000","last_peered":"2023-10-08T12:39:14.200716+0000","last_clean":"2023-10-08T12:39:14.200716+0000","last_became_active":"2023-10-08T12:38:07.696336+0000","last_became_peered":"2023-10-08T12:38:07.696336+0000","last_unstale":"2023-10-08T12:39:14.200716+0000","last_undegraded":"2023-10-08T12:39:14.200716+0000","last_fullsized":"2023-10-08T12:39:14.200716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_clean_scrub_stamp":"2023-10-08T12:34:57.643348+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:01.821924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548781+0000","last_change":"2023-10-08T12:39:14.208845+0000","last_active":"2023-10-08T12:39:15.548781+0000","last_peered":"2023-10-08T12:39:15.548781+0000","last_clean":"2023-10-08T12:39:15.548781+0000","last_became_active":"2023-10-08T12:39:14.208487+0000","last_became_peered":"2023-10-08T12:39:14.208487+0000","last_unstale":"2023-10-08T12:39:15.548781+0000","last_undegraded":"2023-10-08T12:39:15.548781+0000","last_fullsized":"2023-10-08T12:39:15.548781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:26.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853797+0000","last_change":"2023-10-08T12:39:13.216627+0000","last_active":"2023-10-08T12:39:14.853797+0000","last_peered":"2023-10-08T12:39:14.853797+0000","last_clean":"2023-10-08T12:39:14.853797+0000","last_became_active":"2023-10-08T12:39:13.216201+0000","last_became_peered":"2023-10-08T12:39:13.216201+0000","last_unstale":"2023-10-08T12:39:14.853797+0000","last_undegraded":"2023-10-08T12:39:14.853797+0000","last_fullsized":"2023-10-08T12:39:14.853797+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:19.873615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.199877+0000","last_change":"2023-10-08T12:39:13.219222+0000","last_active":"2023-10-08T12:39:14.199877+0000","last_peered":"2023-10-08T12:39:14.199877+0000","last_clean":"2023-10-08T12:39:14.199877+0000","last_became_active":"2023-10-08T12:39:13.218757+0000","last_became_peered":"2023-10-08T12:39:13.218757+0000","last_unstale":"2023-10-08T12:39:14.199877+0000","last_undegraded":"2023-10-08T12:39:14.199877+0000","last_fullsized":"2023-10-08T12:39:14.199877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:15.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549929+0000","last_change":"2023-10-08T12:39:14.221945+0000","last_active":"2023-10-08T12:39:15.549929+0000","last_peered":"2023-10-08T12:39:15.549929+0000","last_clean":"2023-10-08T12:39:15.549929+0000","last_became_active":"2023-10-08T12:39:14.221625+0000","last_became_peered":"2023-10-08T12:39:14.221625+0000","last_unstale":"2023-10-08T12:39:15.549929+0000","last_undegraded":"2023-10-08T12:39:15.549929+0000","last_fullsized":"2023-10-08T12:39:15.549929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:50.424023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201203+0000","last_change":"2023-10-08T12:39:13.213666+0000","last_active":"2023-10-08T12:39:15.201203+0000","last_peered":"2023-10-08T12:39:15.201203+0000","last_clean":"2023-10-08T12:39:15.201203+0000","last_became_active":"2023-10-08T12:39:13.213323+0000","last_became_peered":"2023-10-08T12:39:13.213323+0000","last_unstale":"2023-10-08T12:39:15.201203+0000","last_undegraded":"2023-10-08T12:39:15.201203+0000","last_fullsized":"2023-10-08T12:39:15.201203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:50:30.471672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550265+0000","last_change":"2023-10-08T12:39:14.214849+0000","last_active":"2023-10-08T12:39:15.550265+0000","last_peered":"2023-10-08T12:39:15.550265+0000","last_clean":"2023-10-08T12:39:15.550265+0000","last_became_active":"2023-10-08T12:39:14.214573+0000","last_became_peered":"2023-10-08T12:39:14.214573+0000","last_unstale":"2023-10-08T12:39:15.550265+0000","last_undegraded":"2023-10-08T12:39:15.550265+0000","last_fullsized":"2023-10-08T12:39:15.550265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:50.922519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405780+0000","last_change":"2023-10-08T12:39:13.206518+0000","last_active":"2023-10-08T12:39:15.405780+0000","last_peered":"2023-10-08T12:39:15.405780+0000","last_clean":"2023-10-08T12:39:15.405780+0000","last_became_active":"2023-10-08T12:39:13.206082+0000","last_became_peered":"2023-10-08T12:39:13.206082+0000","last_unstale":"2023-10-08T12:39:15.405780+0000","last_undegraded":"2023-10-08T12:39:15.405780+0000","last_fullsized":"2023-10-08T12:39:15.405780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:47.980651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548913+0000","last_change":"2023-10-08T12:39:14.220897+0000","last_active":"2023-10-08T12:39:15.548913+0000","last_peered":"2023-10-08T12:39:15.548913+0000","last_clean":"2023-10-08T12:39:15.548913+0000","last_became_active":"2023-10-08T12:39:14.220173+0000","last_became_peered":"2023-10-08T12:39:14.220173+0000","last_unstale":"2023-10-08T12:39:15.548913+0000","last_undegraded":"2023-10-08T12:39:15.548913+0000","last_fullsized":"2023-10-08T12:39:15.548913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:09:02.588054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.197390+0000","last_change":"2023-10-08T12:39:13.213505+0000","last_active":"2023-10-08T12:39:14.197390+0000","last_peered":"2023-10-08T12:39:14.197390+0000","last_clean":"2023-10-08T12:39:14.197390+0000","last_became_active":"2023-10-08T12:39:13.213199+0000","last_became_peered":"2023-10-08T12:39:13.213199+0000","last_unstale":"2023-10-08T12:39:14.197390+0000","last_undegraded":"2023-10-08T12:39:14.197390+0000","last_fullsized":"2023-10-08T12:39:14.197390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:49.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493387+0000","last_change":"2023-10-08T12:39:14.208080+0000","last_active":"2023-10-08T12:39:15.493387+0000","last_peered":"2023-10-08T12:39:15.493387+0000","last_clean":"2023-10-08T12:39:15.493387+0000","last_became_active":"2023-10-08T12:39:14.207788+0000","last_became_peered":"2023-10-08T12:39:14.207788+0000","last_unstale":"2023-10-08T12:39:15.493387+0000","last_undegraded":"2023-10-08T12:39:15.493387+0000","last_fullsized":"2023-10-08T12:39:15.493387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:44.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.534523+0000","last_change":"2023-10-08T12:39:13.216003+0000","last_active":"2023-10-08T12:39:14.534523+0000","last_peered":"2023-10-08T12:39:14.534523+0000","last_clean":"2023-10-08T12:39:14.534523+0000","last_became_active":"2023-10-08T12:39:13.215662+0000","last_became_peered":"2023-10-08T12:39:13.215662+0000","last_unstale":"2023-10-08T12:39:14.534523+0000","last_undegraded":"2023-10-08T12:39:14.534523+0000","last_fullsized":"2023-10-08T12:39:14.534523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:28.310430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670191+0000","last_change":"2023-10-08T12:39:14.204336+0000","last_active":"2023-10-08T12:39:15.670191+0000","last_peered":"2023-10-08T12:39:15.670191+0000","last_clean":"2023-10-08T12:39:15.670191+0000","last_became_active":"2023-10-08T12:39:14.203993+0000","last_became_peered":"2023-10-08T12:39:14.203993+0000","last_unstale":"2023-10-08T12:39:15.670191+0000","last_undegraded":"2023-10-08T12:39:15.670191+0000","last_fullsized":"2023-10-08T12:39:15.670191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:54.545166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.193182+0000","last_change":"2023-10-08T12:39:13.214767+0000","last_active":"2023-10-08T12:39:14.193182+0000","last_peered":"2023-10-08T12:39:14.193182+0000","last_clean":"2023-10-08T12:39:14.193182+0000","last_became_active":"2023-10-08T12:39:13.214431+0000","last_became_peered":"2023-10-08T12:39:13.214431+0000","last_unstale":"2023-10-08T12:39:14.193182+0000","last_undegraded":"2023-10-08T12:39:14.193182+0000","last_fullsized":"2023-10-08T12:39:14.193182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:51.062301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549952+0000","last_change":"2023-10-08T12:39:14.221040+0000","last_active":"2023-10-08T12:39:15.549952+0000","last_peered":"2023-10-08T12:39:15.549952+0000","last_clean":"2023-10-08T12:39:15.549952+0000","last_became_active":"2023-10-08T12:39:14.220724+0000","last_became_peered":"2023-10-08T12:39:14.220724+0000","last_unstale":"2023-10-08T12:39:15.549952+0000","last_undegraded":"2023-10-08T12:39:15.549952+0000","last_fullsized":"2023-10-08T12:39:15.549952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:52.824228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493423+0000","last_change":"2023-10-08T12:39:13.212244+0000","last_active":"2023-10-08T12:39:15.493423+0000","last_peered":"2023-10-08T12:39:15.493423+0000","last_clean":"2023-10-08T12:39:15.493423+0000","last_became_active":"2023-10-08T12:39:13.212028+0000","last_became_peered":"2023-10-08T12:39:13.212028+0000","last_unstale":"2023-10-08T12:39:15.493423+0000","last_undegraded":"2023-10-08T12:39:15.493423+0000","last_fullsized":"2023-10-08T12:39:15.493423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:06.111807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548953+0000","last_change":"2023-10-08T12:39:14.216665+0000","last_active":"2023-10-08T12:39:15.548953+0000","last_peered":"2023-10-08T12:39:15.548953+0000","last_clean":"2023-10-08T12:39:15.548953+0000","last_became_active":"2023-10-08T12:39:14.216330+0000","last_became_peered":"2023-10-08T12:39:14.216330+0000","last_unstale":"2023-10-08T12:39:15.548953+0000","last_undegraded":"2023-10-08T12:39:15.548953+0000","last_fullsized":"2023-10-08T12:39:15.548953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.658600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.193201+0000","last_change":"2023-10-08T12:39:13.214495+0000","last_active":"2023-10-08T12:39:14.193201+0000","last_peered":"2023-10-08T12:39:14.193201+0000","last_clean":"2023-10-08T12:39:14.193201+0000","last_became_active":"2023-10-08T12:39:13.213930+0000","last_became_peered":"2023-10-08T12:39:13.213930+0000","last_unstale":"2023-10-08T12:39:14.193201+0000","last_undegraded":"2023-10-08T12:39:14.193201+0000","last_fullsized":"2023-10-08T12:39:14.193201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:20:38.096164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549209+0000","last_change":"2023-10-08T12:39:14.212566+0000","last_active":"2023-10-08T12:39:15.549209+0000","last_peered":"2023-10-08T12:39:15.549209+0000","last_clean":"2023-10-08T12:39:15.549209+0000","last_became_active":"2023-10-08T12:39:14.211756+0000","last_became_peered":"2023-10-08T12:39:14.211756+0000","last_unstale":"2023-10-08T12:39:15.549209+0000","last_undegraded":"2023-10-08T12:39:15.549209+0000","last_fullsized":"2023-10-08T12:39:15.549209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:12.741640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549200+0000","last_change":"2023-10-08T12:39:13.217914+0000","last_active":"2023-10-08T12:39:15.549200+0000","last_peered":"2023-10-08T12:39:15.549200+0000","last_clean":"2023-10-08T12:39:15.549200+0000","last_became_active":"2023-10-08T12:39:13.217571+0000","last_became_peered":"2023-10-08T12:39:13.217571+0000","last_unstale":"2023-10-08T12:39:15.549200+0000","last_undegraded":"2023-10-08T12:39:15.549200+0000","last_fullsized":"2023-10-08T12:39:15.549200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:10.826007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548833+0000","last_change":"2023-10-08T12:39:14.214280+0000","last_active":"2023-10-08T12:39:15.548833+0000","last_peered":"2023-10-08T12:39:15.548833+0000","last_clean":"2023-10-08T12:39:15.548833+0000","last_became_active":"2023-10-08T12:39:14.213942+0000","last_became_peered":"2023-10-08T12:39:14.213942+0000","last_unstale":"2023-10-08T12:39:15.548833+0000","last_undegraded":"2023-10-08T12:39:15.548833+0000","last_fullsized":"2023-10-08T12:39:15.548833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:17:21.450265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056839+0000","last_change":"2023-10-08T12:39:13.222484+0000","last_active":"2023-10-08T12:39:15.056839+0000","last_peered":"2023-10-08T12:39:15.056839+0000","last_clean":"2023-10-08T12:39:15.056839+0000","last_became_active":"2023-10-08T12:39:13.222091+0000","last_became_peered":"2023-10-08T12:39:13.222091+0000","last_unstale":"2023-10-08T12:39:15.056839+0000","last_undegraded":"2023-10-08T12:39:15.056839+0000","last_fullsized":"2023-10-08T12:39:15.056839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:00.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549425+0000","last_change":"2023-10-08T12:39:14.207715+0000","last_active":"2023-10-08T12:39:15.549425+0000","last_peered":"2023-10-08T12:39:15.549425+0000","last_clean":"2023-10-08T12:39:15.549425+0000","last_became_active":"2023-10-08T12:39:14.207429+0000","last_became_peered":"2023-10-08T12:39:14.207429+0000","last_unstale":"2023-10-08T12:39:15.549425+0000","last_undegraded":"2023-10-08T12:39:15.549425+0000","last_fullsized":"2023-10-08T12:39:15.549425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:16.991831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670238+0000","last_change":"2023-10-08T12:39:14.200398+0000","last_active":"2023-10-08T12:39:15.670238+0000","last_peered":"2023-10-08T12:39:15.670238+0000","last_clean":"2023-10-08T12:39:15.670238+0000","last_became_active":"2023-10-08T12:39:14.200035+0000","last_became_peered":"2023-10-08T12:39:14.200035+0000","last_unstale":"2023-10-08T12:39:15.670238+0000","last_undegraded":"2023-10-08T12:39:15.670238+0000","last_fullsized":"2023-10-08T12:39:15.670238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:13.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201966+0000","last_change":"2023-10-08T12:39:14.202185+0000","last_active":"2023-10-08T12:39:15.201966+0000","last_peered":"2023-10-08T12:39:15.201966+0000","last_clean":"2023-10-08T12:39:15.201966+0000","last_became_active":"2023-10-08T12:39:14.201232+0000","last_became_peered":"2023-10-08T12:39:14.201232+0000","last_unstale":"2023-10-08T12:39:15.201966+0000","last_undegraded":"2023-10-08T12:39:15.201966+0000","last_fullsized":"2023-10-08T12:39:15.201966+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:50.949047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201847+0000","last_change":"2023-10-08T12:39:14.208014+0000","last_active":"2023-10-08T12:39:15.201847+0000","last_peered":"2023-10-08T12:39:15.201847+0000","last_clean":"2023-10-08T12:39:15.201847+0000","last_became_active":"2023-10-08T12:39:14.207579+0000","last_became_peered":"2023-10-08T12:39:14.207579+0000","last_unstale":"2023-10-08T12:39:15.201847+0000","last_undegraded":"2023-10-08T12:39:15.201847+0000","last_fullsized":"2023-10-08T12:39:15.201847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:37.352827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549736+0000","last_change":"2023-10-08T12:39:14.210834+0000","last_active":"2023-10-08T12:39:15.549736+0000","last_peered":"2023-10-08T12:39:15.549736+0000","last_clean":"2023-10-08T12:39:15.549736+0000","last_became_active":"2023-10-08T12:39:14.210486+0000","last_became_peered":"2023-10-08T12:39:14.210486+0000","last_unstale":"2023-10-08T12:39:15.549736+0000","last_undegraded":"2023-10-08T12:39:15.549736+0000","last_fullsized":"2023-10-08T12:39:15.549736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:36.252533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549923+0000","last_change":"2023-10-08T12:39:14.222630+0000","last_active":"2023-10-08T12:39:15.549923+0000","last_peered":"2023-10-08T12:39:15.549923+0000","last_clean":"2023-10-08T12:39:15.549923+0000","last_became_active":"2023-10-08T12:39:14.222300+0000","last_became_peered":"2023-10-08T12:39:14.222300+0000","last_unstale":"2023-10-08T12:39:15.549923+0000","last_undegraded":"2023-10-08T12:39:15.549923+0000","last_fullsized":"2023-10-08T12:39:15.549923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.040227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670356+0000","last_change":"2023-10-08T12:39:14.207144+0000","last_active":"2023-10-08T12:39:15.670356+0000","last_peered":"2023-10-08T12:39:15.670356+0000","last_clean":"2023-10-08T12:39:15.670356+0000","last_became_active":"2023-10-08T12:39:14.206775+0000","last_became_peered":"2023-10-08T12:39:14.206775+0000","last_unstale":"2023-10-08T12:39:15.670356+0000","last_undegraded":"2023-10-08T12:39:15.670356+0000","last_fullsized":"2023-10-08T12:39:15.670356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:55.224270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.202113+0000","last_change":"2023-10-08T12:39:14.204123+0000","last_active":"2023-10-08T12:39:15.202113+0000","last_peered":"2023-10-08T12:39:15.202113+0000","last_clean":"2023-10-08T12:39:15.202113+0000","last_became_active":"2023-10-08T12:39:14.203123+0000","last_became_peered":"2023-10-08T12:39:14.203123+0000","last_unstale":"2023-10-08T12:39:15.202113+0000","last_undegraded":"2023-10-08T12:39:15.202113+0000","last_fullsized":"2023-10-08T12:39:15.202113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:45.423095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550121+0000","last_change":"2023-10-08T12:39:14.211049+0000","last_active":"2023-10-08T12:39:15.550121+0000","last_peered":"2023-10-08T12:39:15.550121+0000","last_clean":"2023-10-08T12:39:15.550121+0000","last_became_active":"2023-10-08T12:39:14.210738+0000","last_became_peered":"2023-10-08T12:39:14.210738+0000","last_unstale":"2023-10-08T12:39:15.550121+0000","last_undegraded":"2023-10-08T12:39:15.550121+0000","last_fullsized":"2023-10-08T12:39:15.550121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:12.535857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549047+0000","last_change":"2023-10-08T12:39:14.220013+0000","last_active":"2023-10-08T12:39:15.549047+0000","last_peered":"2023-10-08T12:39:15.549047+0000","last_clean":"2023-10-08T12:39:15.549047+0000","last_became_active":"2023-10-08T12:39:14.219711+0000","last_became_peered":"2023-10-08T12:39:14.219711+0000","last_unstale":"2023-10-08T12:39:15.549047+0000","last_undegraded":"2023-10-08T12:39:15.549047+0000","last_fullsized":"2023-10-08T12:39:15.549047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:23.205074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549313+0000","last_change":"2023-10-08T12:39:14.214237+0000","last_active":"2023-10-08T12:39:15.549313+0000","last_peered":"2023-10-08T12:39:15.549313+0000","last_clean":"2023-10-08T12:39:15.549313+0000","last_became_active":"2023-10-08T12:39:14.213891+0000","last_became_peered":"2023-10-08T12:39:14.213891+0000","last_unstale":"2023-10-08T12:39:15.549313+0000","last_undegraded":"2023-10-08T12:39:15.549313+0000","last_fullsized":"2023-10-08T12:39:15.549313+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:11.348411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203309+0000","last_change":"2023-10-08T12:39:14.209037+0000","last_active":"2023-10-08T12:39:15.203309+0000","last_peered":"2023-10-08T12:39:15.203309+0000","last_clean":"2023-10-08T12:39:15.203309+0000","last_became_active":"2023-10-08T12:39:14.208728+0000","last_became_peered":"2023-10-08T12:39:14.208728+0000","last_unstale":"2023-10-08T12:39:15.203309+0000","last_undegraded":"2023-10-08T12:39:15.203309+0000","last_fullsized":"2023-10-08T12:39:15.203309+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:23.440413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549527+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:39:15.549527+0000","last_peered":"2023-10-08T12:39:15.549527+0000","last_clean":"2023-10-08T12:39:15.549527+0000","last_became_active":"2023-10-08T12:39:14.222393+0000","last_became_peered":"2023-10-08T12:39:14.222393+0000","last_unstale":"2023-10-08T12:39:15.549527+0000","last_undegraded":"2023-10-08T12:39:15.549527+0000","last_fullsized":"2023-10-08T12:39:15.549527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:19.704140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670257+0000","last_change":"2023-10-08T12:39:14.200858+0000","last_active":"2023-10-08T12:39:15.670257+0000","last_peered":"2023-10-08T12:39:15.670257+0000","last_clean":"2023-10-08T12:39:15.670257+0000","last_became_active":"2023-10-08T12:39:14.199948+0000","last_became_peered":"2023-10-08T12:39:14.199948+0000","last_unstale":"2023-10-08T12:39:15.670257+0000","last_undegraded":"2023-10-08T12:39:15.670257+0000","last_fullsized":"2023-10-08T12:39:15.670257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:10.366380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281436,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":19775,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":15,"num_read_kb":24,"num_write":51,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":93941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416398,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":444535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]},{"osd":10,"up_from":72,"seq":309237645329,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":1053866,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29499999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.495}]},{"osd":3,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46100000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.37}]},{"osd":5,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60899999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65900000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.59699999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":9,"up_from":67,"seq":287762808852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":445117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.44}]},{"osd":1,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.80500000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.84499999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.874},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.74299999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.89800000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.85599999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070490,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":444808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56299999999999994}]},{"osd":1,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72399999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.28399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.40999999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.40000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83699999999999997,"5min":0.879,"15min":0.879},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52400000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.43099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.75}]},{"osd":5,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.34499999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.625}]},{"osd":6,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.69199999999999995}]},{"osd":7,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98899999999999999,"5min":1.181,"15min":1.181},"last":0.77600000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.79600000000000004}]},{"osd":10,"last update":"Sun Oct 8 12:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.85099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":7,"up_from":52,"seq":223338299423,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":1035485,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.877,"15min":0.877},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.433,"15min":0.434},"min":{"1min":0.28899999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.42099999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61499999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.38400000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65500000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59399999999999997,"15min":0.58699999999999997},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59799999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32800000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76700000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68100000000000005,"5min":0.751,"15min":0.751},"last":0.34100000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69599999999999995,"15min":0.68899999999999995},"min":{"1min":0.55400000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.497,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.871,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.436}]},{"osd":8,"last update":"Sun Oct 8 12:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67400000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.75600000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.73199999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":6,"up_from":47,"seq":201863462947,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":444535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.754},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.44900000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.629,"15min":0.62},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.627}]},{"osd":2,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73199999999999998,"15min":0.73499999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.871,"5min":0.875,"15min":0.875},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79500000000000004}]},{"osd":3,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.501},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47399999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":0.79600000000000004,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":6.875,"5min":6.875,"15min":6.875},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.59899999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.63700000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.81000000000000005,"15min":0.80700000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.83799999999999997,"15min":0.83599999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.80100000000000005,"15min":0.78300000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83199999999999996,"15min":0.82299999999999995},"min":{"1min":0.66800000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.753}]},{"osd":8,"last update":"Sun Oct 8 12:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.95999999999999996,"15min":0.97499999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1200000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84599999999999997,"15min":0.85199999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.68899999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.874}]},{"osd":10,"last update":"Sun Oct 8 12:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.81299999999999994}]}]},{"osd":1,"up_from":14,"seq":60129542204,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":480489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.32000000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.84399999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83299999999999996,"5min":1.452,"15min":1.452},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.35899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72099999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56699999999999995,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":1.413,"15min":1.413},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59199999999999997,"15min":0.56799999999999995},"min":{"1min":0.53100000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":1.427,"15min":1.427},"last":0.70399999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.38700000000000001},"min":{"1min":0.28999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.40400000000000003,"15min":0.39000000000000001},"min":{"1min":0.317,"5min":0.245,"15min":0.245},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.46999999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65100000000000002,"15min":0.65200000000000002},"min":{"1min":0.46600000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":1.355,"15min":1.355},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.66500000000000004,"15min":0.65500000000000003},"min":{"1min":0.52000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93200000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.746}]},{"osd":7,"last update":"Sun Oct 8 12:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.79700000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.85699999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73299999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":444625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.59699999999999998,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.314,"15min":0.314},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60799999999999998,"15min":0.56100000000000005},"min":{"1min":0.434,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.997,"5min":1.046,"15min":1.046},"last":0.63200000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.628,"15min":0.57999999999999996},"min":{"1min":0.48799999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.622,"15min":0.58299999999999996},"min":{"1min":0.48899999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.998,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.745}]},{"osd":3,"last update":"Sun Oct 8 12:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.48299999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.42499999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.433,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.125,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.52300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0109999999999999,"5min":1.911,"15min":1.911},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:38:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.018,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.442},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.50600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.026,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.97299999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.50600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.873,"15min":0.879},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.048,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.873}]},{"osd":9,"last update":"Sun Oct 8 12:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.93899999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378679,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":480854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.88500000000000001,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.88700000000000001,"5min":1.194,"15min":1.194},"last":0.57199999999999995}]},{"osd":1,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.54100000000000004,"15min":0.51400000000000001},"min":{"1min":0.41999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55100000000000005,"15min":0.51500000000000001},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69099999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:38:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88400000000000001,"5min":1.073,"15min":1.073},"last":0.754},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.51000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.45100000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.435,"5min":0.378,"15min":0.378},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53900000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.40999999999999998},"min":{"1min":0.28799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.44,"15min":0.42599999999999999},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.5}]},{"osd":6,"last update":"Sun Oct 8 12:38:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.60699999999999998,"15min":0.59299999999999997},"min":{"1min":0.48299999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.47599999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.72299999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.873},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.80300000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.77500000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.85399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149745,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":444308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.45000000000000001,"15min":0.42399999999999999},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.48899999999999999,"15min":0.46700000000000003},"min":{"1min":0.38200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.90800000000000003,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.498}]},{"osd":1,"last update":"Sun Oct 8 12:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.62,"15min":0.60199999999999998},"min":{"1min":0.42299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":1.081,"15min":1.081},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.94399999999999995,"5min":1.05,"15min":1.05},"last":0.752}]},{"osd":2,"last update":"Sun Oct 8 12:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.47199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.53100000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.65600000000000003,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96799999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.69599999999999995,"15min":0.65900000000000003},"min":{"1min":0.50800000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73899999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98499999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.70899999999999996,"15min":0.69199999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.46000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.73199999999999998,"15min":0.71599999999999997},"min":{"1min":0.56999999999999995,"5min":0.37,"15min":0.37},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.64400000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83099999999999996,"15min":0.82899999999999996},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.78700000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.89400000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:38:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.48299999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.76100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":444557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67100000000000004,"15min":0.71999999999999997},"min":{"1min":0.439,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":6.0549999999999997,"15min":6.0549999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.373,"15min":0.35399999999999998},"min":{"1min":0.28399999999999997,"5min":0.223,"15min":0.223},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.39300000000000002,"15min":0.378},"min":{"1min":0.26600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.33100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.56100000000000005,"15min":0.52500000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.629},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57699999999999996,"15min":0.53700000000000003},"min":{"1min":0.45500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84499999999999997,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.47099999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.59499999999999997,"15min":0.54900000000000004},"min":{"1min":0.52500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.91300000000000003,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.58999999999999997,"15min":0.56399999999999995},"min":{"1min":0.442,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94299999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66300000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:38:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.61899999999999999,"15min":0.59899999999999998},"min":{"1min":0.53000000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.443},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.63200000000000001,"15min":0.61499999999999999},"min":{"1min":0.48699999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.52900000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.57299999999999995,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.54500000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.73599999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.71999999999999997}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.749},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.61199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":5,"up_from":39,"seq":167503724584,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1034877,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88600000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78200000000000003,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.46400000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.45800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.499}]},{"osd":2,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.39900000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.436},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57899999999999996}]},{"osd":3,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.624},{"interface":"front","average":{"1min":0.628,"5min":0.57099999999999995,"15min":0.55300000000000005},"min":{"1min":0.44600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.93300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.71599999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:38:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.60899999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.74299999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.90100000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.84599999999999997}]},{"osd":9,"last update":"Sun Oct 8 12:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.83099999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":19171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:39:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T12:39:23.693 INFO:tasks.cephadm:Setting up client nodes... 2023-10-08T12:39:23.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-08T12:39:24.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:23 smithi059 ceph-mon[98489]: pgmap v258: 97 pgs: 97 active+clean; 596 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.8 KiB/s wr, 7 op/s 2023-10-08T12:39:24.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:23 smithi092 ceph-mon[134093]: pgmap v258: 97 pgs: 97 active+clean; 596 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.8 KiB/s wr, 7 op/s 2023-10-08T12:39:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:23 smithi173 ceph-mon[135182]: pgmap v258: 97 pgs: 97 active+clean; 596 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.8 KiB/s wr, 7 op/s 2023-10-08T12:39:24.456 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:25.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:24 smithi059 ceph-mon[98489]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:39:25.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:24 smithi059 ceph-mon[98489]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:39:25.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:24 smithi092 ceph-mon[134093]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:39:25.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:24 smithi092 ceph-mon[134093]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:39:25.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:24 smithi173 ceph-mon[135182]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:39:25.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:24 smithi173 ceph-mon[135182]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:39:26.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:25 smithi059 ceph-mon[98489]: pgmap v259: 97 pgs: 97 active+clean; 596 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-10-08T12:39:26.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.048+0000 7f0371331700 1 -- 172.21.15.59:0/527613506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036c1008a0 msgr2=0x7f036c100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:26.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.048+0000 7f0371331700 1 --2- 172.21.15.59:0/527613506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036c1008a0 0x7f036c100d20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0360009990 tx=0x7f0360009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:26.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.048+0000 7f0371331700 1 -- 172.21.15.59:0/527613506 shutdown_connections 2023-10-08T12:39:26.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.048+0000 7f0371331700 1 --2- 172.21.15.59:0/527613506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f036c101260 0x7f036c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:26.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.048+0000 7f0371331700 1 --2- 172.21.15.59:0/527613506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036c105680 0x7f036c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:26.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.048+0000 7f0371331700 1 --2- 172.21.15.59:0/527613506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036c1008a0 0x7f036c100d20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:26.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.048+0000 7f0371331700 1 -- 172.21.15.59:0/527613506 >> 172.21.15.59:0/527613506 conn(0x7f036c077950 msgr2=0x7f036c077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:26.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.048+0000 7f0371331700 1 -- 172.21.15.59:0/527613506 shutdown_connections 2023-10-08T12:39:26.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.048+0000 7f0371331700 1 -- 172.21.15.59:0/527613506 wait complete. 2023-10-08T12:39:26.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.049+0000 7f0371331700 1 Processor -- start 2023-10-08T12:39:26.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.049+0000 7f0371331700 1 -- start start 2023-10-08T12:39:26.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.049+0000 7f0371331700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036c1008a0 0x7f036c198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:26.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.049+0000 7f0371331700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036c101260 0x7f036c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:26.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.049+0000 7f0371331700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f036c105680 0x7f036c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:26.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.049+0000 7f0371331700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c19dcd0 con 0x7f036c101260 2023-10-08T12:39:26.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.049+0000 7f0371331700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c19de40 con 0x7f036c1008a0 2023-10-08T12:39:26.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.049+0000 7f0371331700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c19e000 con 0x7f036c105680 2023-10-08T12:39:26.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036c1008a0 0x7f036c198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:26.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036c101260 0x7f036c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:26.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036c1008a0 0x7f036c198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:59296/0 (socket says 172.21.15.59:59296) 2023-10-08T12:39:26.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036affd700 1 -- 172.21.15.59:0/1898209241 learned_addr learned my addr 172.21.15.59:0/1898209241 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:26.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036b7fe700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f036c105680 0x7f036c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:26.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036a7fc700 1 -- 172.21.15.59:0/1898209241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f036c105680 msgr2=0x7f036c19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:26.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036a7fc700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f036c105680 0x7f036c19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:26.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036a7fc700 1 -- 172.21.15.59:0/1898209241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036c1008a0 msgr2=0x7f036c198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:26.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036a7fc700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036c1008a0 0x7f036c198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:26.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036a7fc700 1 -- 172.21.15.59:0/1898209241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c009520 con 0x7f036c101260 2023-10-08T12:39:26.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036affd700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036c1008a0 0x7f036c198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:26.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.050+0000 7f036a7fc700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036c101260 0x7f036c199310 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f03600059d0 tx=0x7f0360004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:26.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.051+0000 7f0353fff700 1 -- 172.21.15.59:0/1898209241 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036001d070 con 0x7f036c101260 2023-10-08T12:39:26.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.051+0000 7f0371331700 1 -- 172.21.15.59:0/1898209241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03600095f0 con 0x7f036c101260 2023-10-08T12:39:26.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.051+0000 7f0353fff700 1 -- 172.21.15.59:0/1898209241 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0360022470 con 0x7f036c101260 2023-10-08T12:39:26.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.051+0000 7f0353fff700 1 -- 172.21.15.59:0/1898209241 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360017650 con 0x7f036c101260 2023-10-08T12:39:26.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.051+0000 7f0371331700 1 -- 172.21.15.59:0/1898209241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c1a5970 con 0x7f036c101260 2023-10-08T12:39:26.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.052+0000 7f0371331700 1 -- 172.21.15.59:0/1898209241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036c101ea0 con 0x7f036c101260 2023-10-08T12:39:26.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.054+0000 7f0353fff700 1 -- 172.21.15.59:0/1898209241 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f03600225e0 con 0x7f036c101260 2023-10-08T12:39:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.055+0000 7f0353fff700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03540a1560 0x7f03540a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.055+0000 7f0353fff700 1 -- 172.21.15.59:0/1898209241 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f03600ce060 con 0x7f036c101260 2023-10-08T12:39:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.056+0000 7f036affd700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03540a1560 0x7f03540a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.056+0000 7f036affd700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03540a1560 0x7f03540a3a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f035c0116b0 tx=0x7f035c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.060+0000 7f0353fff700 1 -- 172.21.15.59:0/1898209241 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f036005d100 con 0x7f036c101260 2023-10-08T12:39:26.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:25 smithi092 ceph-mon[134093]: pgmap v259: 97 pgs: 97 active+clean; 596 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-10-08T12:39:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:25 smithi173 ceph-mon[135182]: pgmap v259: 97 pgs: 97 active+clean; 596 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-10-08T12:39:26.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.354+0000 7f0371331700 1 -- 172.21.15.59:0/1898209241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f036c04e4c0 con 0x7f036c101260 2023-10-08T12:39:26.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.356+0000 7f0353fff700 1 -- 172.21.15.59:0/1898209241 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f0360097610 con 0x7f036c101260 2023-10-08T12:39:26.359 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2023-10-08T12:39:26.359 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQD+oiJlSfYyFRAAlbafNAQkBwZqu9pcEUoJLA== 2023-10-08T12:39:26.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 -- 172.21.15.59:0/1898209241 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03540a1560 msgr2=0x7f03540a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:26.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03540a1560 0x7f03540a3a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f035c0116b0 tx=0x7f035c009260 comp rx=0 tx=0).stop 2023-10-08T12:39:26.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 -- 172.21.15.59:0/1898209241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036c101260 msgr2=0x7f036c199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:26.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036c101260 0x7f036c199310 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f03600059d0 tx=0x7f0360004730 comp rx=0 tx=0).stop 2023-10-08T12:39:26.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 -- 172.21.15.59:0/1898209241 shutdown_connections 2023-10-08T12:39:26.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03540a1560 0x7f03540a3a20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:26.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036c1008a0 0x7f036c198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:26.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f036c105680 0x7f036c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:26.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 --2- 172.21.15.59:0/1898209241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036c101260 0x7f036c199310 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:26.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 -- 172.21.15.59:0/1898209241 >> 172.21.15.59:0/1898209241 conn(0x7f036c077950 msgr2=0x7f036c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:26.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 -- 172.21.15.59:0/1898209241 shutdown_connections 2023-10-08T12:39:26.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:26.359+0000 7f0371331700 1 -- 172.21.15.59:0/1898209241 wait complete. 2023-10-08T12:39:26.936 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:39:26.936 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-08T12:39:26.937 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T12:39:27.000 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:26 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1898209241' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T12:39:27.000 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:26 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1898209241' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T12:39:27.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph config log 1 --format=json 2023-10-08T12:39:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:26 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1898209241' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T12:39:27.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:26 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1898209241' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T12:39:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:26 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1898209241' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T12:39:27.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:26 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1898209241' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T12:39:27.815 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:28.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:27 smithi059 ceph-mon[98489]: pgmap v260: 97 pgs: 97 active+clean; 618 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2023-10-08T12:39:28.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:27 smithi092 ceph-mon[134093]: pgmap v260: 97 pgs: 97 active+clean; 618 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2023-10-08T12:39:28.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:27 smithi173 ceph-mon[135182]: pgmap v260: 97 pgs: 97 active+clean; 618 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2023-10-08T12:39:29.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.431+0000 7f50299a2700 1 -- 172.21.15.59:0/3143521616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50241057c0 msgr2=0x7f5024105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:29.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.431+0000 7f50299a2700 1 --2- 172.21.15.59:0/3143521616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50241057c0 0x7f5024105ba0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5014009990 tx=0x7f5014009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:29.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.431+0000 7f50299a2700 1 -- 172.21.15.59:0/3143521616 shutdown_connections 2023-10-08T12:39:29.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.431+0000 7f50299a2700 1 --2- 172.21.15.59:0/3143521616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5024101260 0x7f502410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:29.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.431+0000 7f50299a2700 1 --2- 172.21.15.59:0/3143521616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50241057c0 0x7f5024105ba0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:29.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.431+0000 7f50299a2700 1 --2- 172.21.15.59:0/3143521616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50241008a0 0x7f5024100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:29.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.431+0000 7f50299a2700 1 -- 172.21.15.59:0/3143521616 >> 172.21.15.59:0/3143521616 conn(0x7f50240779e0 msgr2=0x7f5024077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:29.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.431+0000 7f50299a2700 1 -- 172.21.15.59:0/3143521616 shutdown_connections 2023-10-08T12:39:29.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.431+0000 7f50299a2700 1 -- 172.21.15.59:0/3143521616 wait complete. 2023-10-08T12:39:29.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.432+0000 7f50299a2700 1 Processor -- start 2023-10-08T12:39:29.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.432+0000 7f50299a2700 1 -- start start 2023-10-08T12:39:29.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f50299a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50241008a0 0x7f5024198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:29.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f50299a2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5024101260 0x7f5024199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:29.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f50299a2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50241057c0 0x7f502419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:29.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f50299a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502419de00 con 0x7f50241008a0 2023-10-08T12:39:29.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f50299a2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502419df70 con 0x7f50241057c0 2023-10-08T12:39:29.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f50299a2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502419e130 con 0x7f5024101260 2023-10-08T12:39:29.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f5022ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50241008a0 0x7f5024198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:29.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f5022ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50241008a0 0x7f5024198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47230/0 (socket says 172.21.15.59:47230) 2023-10-08T12:39:29.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f5022ffd700 1 -- 172.21.15.59:0/2384242191 learned_addr learned my addr 172.21.15.59:0/2384242191 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:29.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f50237fe700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50241057c0 0x7f502419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:29.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f50227fc700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5024101260 0x7f5024199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:29.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f5022ffd700 1 -- 172.21.15.59:0/2384242191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5024101260 msgr2=0x7f5024199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:29.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f5022ffd700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5024101260 0x7f5024199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:29.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f5022ffd700 1 -- 172.21.15.59:0/2384242191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50241057c0 msgr2=0x7f502419d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:29.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f5022ffd700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50241057c0 0x7f502419d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:29.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f5022ffd700 1 -- 172.21.15.59:0/2384242191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50140095f0 con 0x7f50241008a0 2023-10-08T12:39:29.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.433+0000 7f50237fe700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50241057c0 0x7f502419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:29.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.434+0000 7f5022ffd700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50241008a0 0x7f5024198f00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5014000c00 tx=0x7f5014005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:29.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.434+0000 7f50289a0700 1 -- 172.21.15.59:0/2384242191 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501401d070 con 0x7f50241008a0 2023-10-08T12:39:29.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.434+0000 7f50289a0700 1 -- 172.21.15.59:0/2384242191 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5014022470 con 0x7f50241008a0 2023-10-08T12:39:29.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.434+0000 7f50299a2700 1 -- 172.21.15.59:0/2384242191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502419e3b0 con 0x7f50241008a0 2023-10-08T12:39:29.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.434+0000 7f50289a0700 1 -- 172.21.15.59:0/2384242191 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014017650 con 0x7f50241008a0 2023-10-08T12:39:29.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.434+0000 7f50299a2700 1 -- 172.21.15.59:0/2384242191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50241a5c70 con 0x7f50241008a0 2023-10-08T12:39:29.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.435+0000 7f50299a2700 1 -- 172.21.15.59:0/2384242191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5024101f30 con 0x7f50241008a0 2023-10-08T12:39:29.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.437+0000 7f50289a0700 1 -- 172.21.15.59:0/2384242191 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f501400fad0 con 0x7f50241008a0 2023-10-08T12:39:29.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.438+0000 7f50289a0700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f500c0a1560 0x7f500c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:29.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.438+0000 7f50289a0700 1 -- 172.21.15.59:0/2384242191 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f50140ce270 con 0x7f50241008a0 2023-10-08T12:39:29.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.439+0000 7f50227fc700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f500c0a1560 0x7f500c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:29.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.439+0000 7f50227fc700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f500c0a1560 0x7f500c0a3a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f502419a460 tx=0x7f50180073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:29.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.443+0000 7f50289a0700 1 -- 172.21.15.59:0/2384242191 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f50140978e0 con 0x7f50241008a0 2023-10-08T12:39:29.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.656+0000 7f50299a2700 1 -- 172.21.15.59:0/2384242191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f502419a210 con 0x7f50241008a0 2023-10-08T12:39:29.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.656+0000 7f50289a0700 1 -- 172.21.15.59:0/2384242191 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v46) v1 ==== 86+0+133 (secure 0 0 0) 0x7f5014027020 con 0x7f50241008a0 2023-10-08T12:39:29.658 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 -- 172.21.15.59:0/2384242191 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f500c0a1560 msgr2=0x7f500c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f500c0a1560 0x7f500c0a3a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f502419a460 tx=0x7f50180073d0 comp rx=0 tx=0).stop 2023-10-08T12:39:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 -- 172.21.15.59:0/2384242191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50241008a0 msgr2=0x7f5024198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50241008a0 0x7f5024198f00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5014000c00 tx=0x7f5014005740 comp rx=0 tx=0).stop 2023-10-08T12:39:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 -- 172.21.15.59:0/2384242191 shutdown_connections 2023-10-08T12:39:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f500c0a1560 0x7f500c0a3a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:29.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50241057c0 0x7f502419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:29.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50241008a0 0x7f5024198f00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:29.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 --2- 172.21.15.59:0/2384242191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5024101260 0x7f5024199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:29.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 -- 172.21.15.59:0/2384242191 >> 172.21.15.59:0/2384242191 conn(0x7f50240779e0 msgr2=0x7f502410ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:29.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 -- 172.21.15.59:0/2384242191 shutdown_connections 2023-10-08T12:39:29.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:29.659+0000 7f50299a2700 1 -- 172.21.15.59:0/2384242191 wait complete. 2023-10-08T12:39:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:29 smithi173 ceph-mon[135182]: pgmap v261: 97 pgs: 97 active+clean; 618 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.6 KiB/s wr, 6 op/s 2023-10-08T12:39:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:29 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2384242191' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T12:39:30.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:29 smithi059 ceph-mon[98489]: pgmap v261: 97 pgs: 97 active+clean; 618 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.6 KiB/s wr, 6 op/s 2023-10-08T12:39:30.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:29 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2384242191' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T12:39:30.090 INFO:teuthology.orchestra.run.smithi059.stdout:[{"version":46,"timestamp":"2023-10-08T12:39:07.923269+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2023-10-08T12:39:30.091 INFO:tasks.ceph_manager:config epoch is 46 2023-10-08T12:39:30.091 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T12:39:30.091 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-08T12:39:30.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-08T12:39:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:29 smithi092 ceph-mon[134093]: pgmap v261: 97 pgs: 97 active+clean; 618 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.6 KiB/s wr, 6 op/s 2023-10-08T12:39:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:29 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2384242191' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T12:39:30.835 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:31 smithi059 ceph-mon[98489]: pgmap v262: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2023-10-08T12:39:32.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:31 smithi092 ceph-mon[134093]: pgmap v262: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2023-10-08T12:39:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:31 smithi173 ceph-mon[135182]: pgmap v262: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2023-10-08T12:39:32.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.361+0000 7f6c41706700 1 -- 172.21.15.59:0/2137188704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3c101260 msgr2=0x7f6c3c10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.361+0000 7f6c41706700 1 --2- 172.21.15.59:0/2137188704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3c101260 0x7f6c3c10d650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009f90 tx=0x7f6c3400b330 comp rx=0 tx=0).stop 2023-10-08T12:39:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.361+0000 7f6c41706700 1 -- 172.21.15.59:0/2137188704 shutdown_connections 2023-10-08T12:39:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.361+0000 7f6c41706700 1 --2- 172.21.15.59:0/2137188704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3c101260 0x7f6c3c10d650 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.361+0000 7f6c41706700 1 --2- 172.21.15.59:0/2137188704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c3c1057c0 0x7f6c3c105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.361+0000 7f6c41706700 1 --2- 172.21.15.59:0/2137188704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c1008a0 0x7f6c3c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.361+0000 7f6c41706700 1 -- 172.21.15.59:0/2137188704 >> 172.21.15.59:0/2137188704 conn(0x7f6c3c0779e0 msgr2=0x7f6c3c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.362+0000 7f6c41706700 1 -- 172.21.15.59:0/2137188704 shutdown_connections 2023-10-08T12:39:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.362+0000 7f6c41706700 1 -- 172.21.15.59:0/2137188704 wait complete. 2023-10-08T12:39:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.363+0000 7f6c41706700 1 Processor -- start 2023-10-08T12:39:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.363+0000 7f6c41706700 1 -- start start 2023-10-08T12:39:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.363+0000 7f6c41706700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c3c1008a0 0x7f6c3c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.363+0000 7f6c41706700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c101260 0x7f6c3c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.363+0000 7f6c41706700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3c1057c0 0x7f6c3c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.363+0000 7f6c41706700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c1a5090 con 0x7f6c3c1057c0 2023-10-08T12:39:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.363+0000 7f6c41706700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c1a5200 con 0x7f6c3c101260 2023-10-08T12:39:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.363+0000 7f6c41706700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c1a53c0 con 0x7f6c3c1008a0 2023-10-08T12:39:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.363+0000 7f6c3affd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c3c1008a0 0x7f6c3c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.363+0000 7f6c3b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3c1057c0 0x7f6c3c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c3affd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c3c1008a0 0x7f6c3c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:47870/0 (socket says 172.21.15.59:47870) 2023-10-08T12:39:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c3b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3c1057c0 0x7f6c3c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54628/0 (socket says 172.21.15.59:54628) 2023-10-08T12:39:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c3affd700 1 -- 172.21.15.59:0/4269773540 learned_addr learned my addr 172.21.15.59:0/4269773540 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c3a7fc700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c101260 0x7f6c3c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c3b7fe700 1 -- 172.21.15.59:0/4269773540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c3c1008a0 msgr2=0x7f6c3c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c3b7fe700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c3c1008a0 0x7f6c3c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c3b7fe700 1 -- 172.21.15.59:0/4269773540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c101260 msgr2=0x7f6c3c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c3b7fe700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c101260 0x7f6c3c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c3b7fe700 1 -- 172.21.15.59:0/4269773540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c300095f0 con 0x7f6c3c1057c0 2023-10-08T12:39:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c3affd700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c3c1008a0 0x7f6c3c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c3b7fe700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3c1057c0 0x7f6c3c073570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400b6c0 tx=0x7f6c34004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c23fff700 1 -- 172.21.15.59:0/4269773540 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400e040 con 0x7f6c3c1057c0 2023-10-08T12:39:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c41706700 1 -- 172.21.15.59:0/4269773540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c34009c40 con 0x7f6c3c1057c0 2023-10-08T12:39:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.364+0000 7f6c23fff700 1 -- 172.21.15.59:0/4269773540 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c3401b450 con 0x7f6c3c1057c0 2023-10-08T12:39:32.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.365+0000 7f6c23fff700 1 -- 172.21.15.59:0/4269773540 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c340052a0 con 0x7f6c3c1057c0 2023-10-08T12:39:32.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.365+0000 7f6c41706700 1 -- 172.21.15.59:0/4269773540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3c1a5970 con 0x7f6c3c1057c0 2023-10-08T12:39:32.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.366+0000 7f6c41706700 1 -- 172.21.15.59:0/4269773540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3c108da0 con 0x7f6c3c1057c0 2023-10-08T12:39:32.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.368+0000 7f6c23fff700 1 -- 172.21.15.59:0/4269773540 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f6c3400b9f0 con 0x7f6c3c1057c0 2023-10-08T12:39:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.369+0000 7f6c23fff700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c240a15e0 0x7f6c240a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.369+0000 7f6c23fff700 1 -- 172.21.15.59:0/4269773540 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f6c340cdff0 con 0x7f6c3c1057c0 2023-10-08T12:39:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.369+0000 7f6c3affd700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c240a15e0 0x7f6c240a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.370+0000 7f6c3affd700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c240a15e0 0x7f6c240a3aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c005950 tx=0x7f6c2c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:32.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.373+0000 7f6c23fff700 1 -- 172.21.15.59:0/4269773540 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6c34097540 con 0x7f6c3c1057c0 2023-10-08T12:39:32.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.640+0000 7f6c41706700 1 -- 172.21.15.59:0/4269773540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6c3c074090 con 0x7f6c3c1057c0 2023-10-08T12:39:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.646+0000 7f6c23fff700 1 -- 172.21.15.59:0/4269773540 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) v1 ==== 74+0+260416 (secure 0 0 0) 0x7f6c3409ab60 con 0x7f6c3c1057c0 2023-10-08T12:39:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:32.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 -- 172.21.15.59:0/4269773540 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c240a15e0 msgr2=0x7f6c240a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c240a15e0 0x7f6c240a3aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c005950 tx=0x7f6c2c009260 comp rx=0 tx=0).stop 2023-10-08T12:39:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 -- 172.21.15.59:0/4269773540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3c1057c0 msgr2=0x7f6c3c073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3c1057c0 0x7f6c3c073570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400b6c0 tx=0x7f6c34004f20 comp rx=0 tx=0).stop 2023-10-08T12:39:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 -- 172.21.15.59:0/4269773540 shutdown_connections 2023-10-08T12:39:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c240a15e0 0x7f6c240a3aa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3c1057c0 0x7f6c3c073570 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c3c1008a0 0x7f6c3c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 --2- 172.21.15.59:0/4269773540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c101260 0x7f6c3c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 -- 172.21.15.59:0/4269773540 >> 172.21.15.59:0/4269773540 conn(0x7f6c3c0779e0 msgr2=0x7f6c3c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 -- 172.21.15.59:0/4269773540 shutdown_connections 2023-10-08T12:39:32.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:32.651+0000 7f6c41706700 1 -- 172.21.15.59:0/4269773540 wait complete. 2023-10-08T12:39:33.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:32 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4269773540' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T12:39:33.118 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":21,"active_gid":14214,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":921332174},{"type":"v1","addr":"172.21.15.59:6801","nonce":921332174}]},"active_addr":"172.21.15.59:6801/921332174","active_change":"2023-10-08T12:33:10.699204+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24166,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24182,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.59:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":398794730}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":666710218}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":649821912}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":298610301}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":365379320}]}]} 2023-10-08T12:39:33.125 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-08T12:39:33.126 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-08T12:39:33.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T12:39:33.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:32 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4269773540' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T12:39:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:32 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4269773540' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T12:39:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:34.101 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:33 smithi059 ceph-mon[98489]: pgmap v263: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2023-10-08T12:39:34.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:33 smithi092 ceph-mon[134093]: pgmap v263: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2023-10-08T12:39:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:33 smithi173 ceph-mon[135182]: pgmap v263: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2023-10-08T12:39:35.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.236+0000 7f7097ffb700 1 -- 172.21.15.59:0/717021582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7090068b30 msgr2=0x7f709010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:35.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.236+0000 7f7097ffb700 1 --2- 172.21.15.59:0/717021582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7090068b30 0x7f709010d670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f708800b0a0 tx=0x7f708800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:35.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.236+0000 7f7097ffb700 1 -- 172.21.15.59:0/717021582 shutdown_connections 2023-10-08T12:39:35.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.236+0000 7f7097ffb700 1 --2- 172.21.15.59:0/717021582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7090068b30 0x7f709010d670 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:35.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.236+0000 7f7097ffb700 1 --2- 172.21.15.59:0/717021582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70901067a0 0x7f7090106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:35.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.236+0000 7f7097ffb700 1 --2- 172.21.15.59:0/717021582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7090068190 0x7f70900685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:35.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.236+0000 7f7097ffb700 1 -- 172.21.15.59:0/717021582 >> 172.21.15.59:0/717021582 conn(0x7f7090075790 msgr2=0x7f7090075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:35.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.236+0000 7f7097ffb700 1 -- 172.21.15.59:0/717021582 shutdown_connections 2023-10-08T12:39:35.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.236+0000 7f7097ffb700 1 -- 172.21.15.59:0/717021582 wait complete. 2023-10-08T12:39:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.237+0000 7f7097ffb700 1 Processor -- start 2023-10-08T12:39:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.237+0000 7f7097ffb700 1 -- start start 2023-10-08T12:39:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.237+0000 7f7097ffb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7090068190 0x7f7090198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.237+0000 7f7097ffb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7090068b30 0x7f70901994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.237+0000 7f7097ffb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70901067a0 0x7f709019d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.237+0000 7f7097ffb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709019de60 con 0x7f7090068b30 2023-10-08T12:39:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.237+0000 7f7097ffb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709019dfd0 con 0x7f7090068190 2023-10-08T12:39:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7097ffb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709019e190 con 0x7f70901067a0 2023-10-08T12:39:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7095d97700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7090068190 0x7f7090198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7095596700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7090068b30 0x7f70901994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7095d97700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7090068190 0x7f7090198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33942/0 (socket says 172.21.15.59:33942) 2023-10-08T12:39:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7095d97700 1 -- 172.21.15.59:0/3720079738 learned_addr learned my addr 172.21.15.59:0/3720079738 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7096598700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70901067a0 0x7f709019d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7095596700 1 -- 172.21.15.59:0/3720079738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70901067a0 msgr2=0x7f709019d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7095596700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70901067a0 0x7f709019d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7095596700 1 -- 172.21.15.59:0/3720079738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7090068190 msgr2=0x7f7090198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7095596700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7090068190 0x7f7090198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7095596700 1 -- 172.21.15.59:0/3720079738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7088009d00 con 0x7f7090068b30 2023-10-08T12:39:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.238+0000 7f7095d97700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7090068190 0x7f7090198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.239+0000 7f7095596700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7090068b30 0x7f70901994f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f708000d750 tx=0x7f708000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.239+0000 7f7086ffd700 1 -- 172.21.15.59:0/3720079738 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080004020 con 0x7f7090068b30 2023-10-08T12:39:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.239+0000 7f7097ffb700 1 -- 172.21.15.59:0/3720079738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709019e470 con 0x7f7090068b30 2023-10-08T12:39:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.239+0000 7f7086ffd700 1 -- 172.21.15.59:0/3720079738 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7080004830 con 0x7f7090068b30 2023-10-08T12:39:35.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.239+0000 7f7086ffd700 1 -- 172.21.15.59:0/3720079738 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800054c0 con 0x7f7090068b30 2023-10-08T12:39:35.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.239+0000 7f7097ffb700 1 -- 172.21.15.59:0/3720079738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70901a5cd0 con 0x7f7090068b30 2023-10-08T12:39:35.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.240+0000 7f7097ffb700 1 -- 172.21.15.59:0/3720079738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7090101ee0 con 0x7f7090068b30 2023-10-08T12:39:35.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.242+0000 7f7086ffd700 1 -- 172.21.15.59:0/3720079738 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f70800049a0 con 0x7f7090068b30 2023-10-08T12:39:35.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.243+0000 7f7086ffd700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f707c0a1560 0x7f707c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:35.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.244+0000 7f7086ffd700 1 -- 172.21.15.59:0/3720079738 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f70800cc810 con 0x7f7090068b30 2023-10-08T12:39:35.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.244+0000 7f7095d97700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f707c0a1560 0x7f707c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:35.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.244+0000 7f7095d97700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f707c0a1560 0x7f707c0a3a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f708c011550 tx=0x7f708c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:35.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.248+0000 7f7086ffd700 1 -- 172.21.15.59:0/3720079738 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7080095cd0 con 0x7f7090068b30 2023-10-08T12:39:35.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.458+0000 7f7097ffb700 1 -- 172.21.15.59:0/3720079738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7090110740 con 0x7f7090068b30 2023-10-08T12:39:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.459+0000 7f7086ffd700 1 -- 172.21.15.59:0/3720079738 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22396 (secure 0 0 0) 0x7f70800992f0 con 0x7f7090068b30 2023-10-08T12:39:35.461 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:35.461 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":84,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:39:15.190640+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:39:35.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 -- 172.21.15.59:0/3720079738 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f707c0a1560 msgr2=0x7f707c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:35.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f707c0a1560 0x7f707c0a3a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f708c011550 tx=0x7f708c009260 comp rx=0 tx=0).stop 2023-10-08T12:39:35.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 -- 172.21.15.59:0/3720079738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7090068b30 msgr2=0x7f70901994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:35.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7090068b30 0x7f70901994f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f708000d750 tx=0x7f708000da60 comp rx=0 tx=0).stop 2023-10-08T12:39:35.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 -- 172.21.15.59:0/3720079738 shutdown_connections 2023-10-08T12:39:35.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f707c0a1560 0x7f707c0a3a20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:35.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7090068190 0x7f7090198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:35.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70901067a0 0x7f709019d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:35.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 --2- 172.21.15.59:0/3720079738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7090068b30 0x7f70901994f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:35.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 -- 172.21.15.59:0/3720079738 >> 172.21.15.59:0/3720079738 conn(0x7f7090075790 msgr2=0x7f70900fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:35.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 -- 172.21.15.59:0/3720079738 shutdown_connections 2023-10-08T12:39:35.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:35.462+0000 7f7097ffb700 1 -- 172.21.15.59:0/3720079738 wait complete. 2023-10-08T12:39:36.047 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-08T12:39:36.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T12:39:36.110 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:35 smithi059 ceph-mon[98489]: pgmap v264: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2023-10-08T12:39:36.111 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:35 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3720079738' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:36.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:35 smithi092 ceph-mon[134093]: pgmap v264: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2023-10-08T12:39:36.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:35 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3720079738' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:35 smithi173 ceph-mon[135182]: pgmap v264: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2023-10-08T12:39:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:35 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3720079738' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:37 smithi092 ceph-mon[134093]: pgmap v265: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2023-10-08T12:39:38.132 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:37 smithi059 ceph-mon[98489]: pgmap v265: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2023-10-08T12:39:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:37 smithi173 ceph-mon[135182]: pgmap v265: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2023-10-08T12:39:38.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.371+0000 7fada7567700 1 -- 172.21.15.59:0/2662690751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fada01057c0 msgr2=0x7fada0105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.371+0000 7fada7567700 1 --2- 172.21.15.59:0/2662690751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fada01057c0 0x7fada0105ba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009990 tx=0x7fad9c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.371+0000 7fada7567700 1 -- 172.21.15.59:0/2662690751 shutdown_connections 2023-10-08T12:39:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.371+0000 7fada7567700 1 --2- 172.21.15.59:0/2662690751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fada0101260 0x7fada010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.371+0000 7fada7567700 1 --2- 172.21.15.59:0/2662690751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fada01057c0 0x7fada0105ba0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.371+0000 7fada7567700 1 --2- 172.21.15.59:0/2662690751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fada01008a0 0x7fada0100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.371+0000 7fada7567700 1 -- 172.21.15.59:0/2662690751 >> 172.21.15.59:0/2662690751 conn(0x7fada00779e0 msgr2=0x7fada0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.371+0000 7fada7567700 1 -- 172.21.15.59:0/2662690751 shutdown_connections 2023-10-08T12:39:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.371+0000 7fada7567700 1 -- 172.21.15.59:0/2662690751 wait complete. 2023-10-08T12:39:38.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.372+0000 7fada7567700 1 Processor -- start 2023-10-08T12:39:38.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.372+0000 7fada7567700 1 -- start start 2023-10-08T12:39:38.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada7567700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fada01008a0 0x7fada01076d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada7567700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fada0101260 0x7fada0107c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada7567700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fada01057c0 0x7fada0108150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada7567700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada01a94f0 con 0x7fada0101260 2023-10-08T12:39:38.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada7567700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada01a9630 con 0x7fada01008a0 2023-10-08T12:39:38.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada7567700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada01a9770 con 0x7fada01057c0 2023-10-08T12:39:38.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada4b02700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fada0101260 0x7fada0107c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada4b02700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fada0101260 0x7fada0107c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54676/0 (socket says 172.21.15.59:54676) 2023-10-08T12:39:38.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada4b02700 1 -- 172.21.15.59:0/652575935 learned_addr learned my addr 172.21.15.59:0/652575935 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:38.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada5303700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fada01008a0 0x7fada01076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada5b04700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fada01057c0 0x7fada0108150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada5303700 1 -- 172.21.15.59:0/652575935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fada01057c0 msgr2=0x7fada0108150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada5303700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fada01057c0 0x7fada0108150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada5303700 1 -- 172.21.15.59:0/652575935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fada0101260 msgr2=0x7fada0107c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada5303700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fada0101260 0x7fada0107c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada5303700 1 -- 172.21.15.59:0/652575935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90009520 con 0x7fada01008a0 2023-10-08T12:39:38.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada4b02700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fada0101260 0x7fada0107c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:38.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.373+0000 7fada5b04700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fada01057c0 0x7fada0108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:38.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.374+0000 7fada5303700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fada01008a0 0x7fada01076d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0098e0 tx=0x7fad9c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.374+0000 7fad967fc700 1 -- 172.21.15.59:0/652575935 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c01d070 con 0x7fada01008a0 2023-10-08T12:39:38.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.374+0000 7fada7567700 1 -- 172.21.15.59:0/652575935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c0095f0 con 0x7fada01008a0 2023-10-08T12:39:38.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.374+0000 7fad967fc700 1 -- 172.21.15.59:0/652575935 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad9c022470 con 0x7fada01008a0 2023-10-08T12:39:38.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.374+0000 7fad967fc700 1 -- 172.21.15.59:0/652575935 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c017650 con 0x7fada01008a0 2023-10-08T12:39:38.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.374+0000 7fada7567700 1 -- 172.21.15.59:0/652575935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada01a9cd0 con 0x7fada01008a0 2023-10-08T12:39:38.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.375+0000 7fada7567700 1 -- 172.21.15.59:0/652575935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada0101f30 con 0x7fada01008a0 2023-10-08T12:39:38.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.378+0000 7fad967fc700 1 -- 172.21.15.59:0/652575935 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fad9c0225e0 con 0x7fada01008a0 2023-10-08T12:39:38.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.379+0000 7fad967fc700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad8c0a1560 0x7fad8c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.379+0000 7fad967fc700 1 -- 172.21.15.59:0/652575935 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fad9c0ce880 con 0x7fada01008a0 2023-10-08T12:39:38.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.379+0000 7fada4b02700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad8c0a1560 0x7fad8c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.380+0000 7fada4b02700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad8c0a1560 0x7fad8c0a3a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad90009fd0 tx=0x7fad90009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.382+0000 7fad967fc700 1 -- 172.21.15.59:0/652575935 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fad9c097dd0 con 0x7fada01008a0 2023-10-08T12:39:38.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.592+0000 7fada7567700 1 -- 172.21.15.59:0/652575935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fada0108bb0 con 0x7fada01008a0 2023-10-08T12:39:38.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.594+0000 7fad967fc700 1 -- 172.21.15.59:0/652575935 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22396 (secure 0 0 0) 0x7fad9c09b3f0 con 0x7fada01008a0 2023-10-08T12:39:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:39:38.595 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":84,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:39:15.190640+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:39:38.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 -- 172.21.15.59:0/652575935 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad8c0a1560 msgr2=0x7fad8c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad8c0a1560 0x7fad8c0a3a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad90009fd0 tx=0x7fad90009260 comp rx=0 tx=0).stop 2023-10-08T12:39:38.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 -- 172.21.15.59:0/652575935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fada01008a0 msgr2=0x7fada01076d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fada01008a0 0x7fada01076d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0098e0 tx=0x7fad9c005740 comp rx=0 tx=0).stop 2023-10-08T12:39:38.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 -- 172.21.15.59:0/652575935 shutdown_connections 2023-10-08T12:39:38.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fad8c0a1560 0x7fad8c0a3a20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fada01008a0 0x7fada01076d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fada01057c0 0x7fada0108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 --2- 172.21.15.59:0/652575935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fada0101260 0x7fada0107c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 -- 172.21.15.59:0/652575935 >> 172.21.15.59:0/652575935 conn(0x7fada00779e0 msgr2=0x7fada010ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 -- 172.21.15.59:0/652575935 shutdown_connections 2023-10-08T12:39:38.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:38.596+0000 7fada7567700 1 -- 172.21.15.59:0/652575935 wait complete. 2023-10-08T12:39:39.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:38 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/652575935' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:39.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-08T12:39:39.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-08T12:39:39.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-08T12:39:39.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-08T12:39:39.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-08T12:39:39.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-08T12:39:39.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-08T12:39:39.064 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-08T12:39:39.064 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-08T12:39:39.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-08T12:39:39.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-08T12:39:39.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-08T12:39:39.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:38 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/652575935' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:38 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/652575935' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:39:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:39 smithi092 ceph-mon[134093]: pgmap v266: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2023-10-08T12:39:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:39 smithi173 ceph-mon[135182]: pgmap v266: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2023-10-08T12:39:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:39 smithi059 ceph-mon[98489]: pgmap v266: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2023-10-08T12:39:40.669 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:41.185 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:41.259 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:41.494 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:41.532 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:41.535 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:41.535 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:41.540 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:41.853 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:41.858 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:42.000 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:41 smithi059 ceph-mon[98489]: pgmap v267: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2023-10-08T12:39:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:41 smithi092 ceph-mon[134093]: pgmap v267: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2023-10-08T12:39:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:41 smithi173 ceph-mon[135182]: pgmap v267: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2023-10-08T12:39:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:43 smithi173 ceph-mon[135182]: pgmap v268: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2023-10-08T12:39:44.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:43 smithi059 ceph-mon[98489]: pgmap v268: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2023-10-08T12:39:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:43 smithi092 ceph-mon[134093]: pgmap v268: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2023-10-08T12:39:45.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.705+0000 7f52b0245700 1 -- 172.21.15.59:0/1272283108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52a81067a0 msgr2=0x7f52a8106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:45.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.705+0000 7f52b0245700 1 --2- 172.21.15.59:0/1272283108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52a81067a0 0x7f52a8106b80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009990 tx=0x7f52a4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:45.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.706+0000 7f52b0245700 1 -- 172.21.15.59:0/1272283108 shutdown_connections 2023-10-08T12:39:45.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.706+0000 7f52b0245700 1 --2- 172.21.15.59:0/1272283108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52a8068b30 0x7f52a810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:45.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.706+0000 7f52b0245700 1 --2- 172.21.15.59:0/1272283108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52a81067a0 0x7f52a8106b80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:45.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.706+0000 7f52b0245700 1 --2- 172.21.15.59:0/1272283108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a8068190 0x7f52a80685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:45.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.706+0000 7f52b0245700 1 -- 172.21.15.59:0/1272283108 >> 172.21.15.59:0/1272283108 conn(0x7f52a8075790 msgr2=0x7f52a8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:45.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.706+0000 7f52b0245700 1 -- 172.21.15.59:0/1272283108 shutdown_connections 2023-10-08T12:39:45.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.706+0000 7f52b0245700 1 -- 172.21.15.59:0/1272283108 wait complete. 2023-10-08T12:39:45.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.707+0000 7f52b0245700 1 Processor -- start 2023-10-08T12:39:45.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.707+0000 7f52b0245700 1 -- start start 2023-10-08T12:39:45.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.707+0000 7f52b0245700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52a8068190 0x7f52a8198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:45.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52b0245700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52a8068b30 0x7f52a81993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:45.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52b0245700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a81067a0 0x7f52a819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:45.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52b0245700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a819dd80 con 0x7f52a8068b30 2023-10-08T12:39:45.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52b0245700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a819def0 con 0x7f52a8068190 2023-10-08T12:39:45.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52b0245700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a819e0b0 con 0x7f52a81067a0 2023-10-08T12:39:45.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52adfe1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52a8068190 0x7f52a8198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:45.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52adfe1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52a8068190 0x7f52a8198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:55428/0 (socket says 172.21.15.59:55428) 2023-10-08T12:39:45.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52adfe1700 1 -- 172.21.15.59:0/2784879403 learned_addr learned my addr 172.21.15.59:0/2784879403 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:45.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52ad7e0700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52a8068b30 0x7f52a81993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:45.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52ae7e2700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a81067a0 0x7f52a819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:45.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52adfe1700 1 -- 172.21.15.59:0/2784879403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a81067a0 msgr2=0x7f52a819d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:45.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52adfe1700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a81067a0 0x7f52a819d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:45.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52adfe1700 1 -- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52a8068b30 msgr2=0x7f52a81993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:45.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52adfe1700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52a8068b30 0x7f52a81993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:45.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.708+0000 7f52adfe1700 1 -- 172.21.15.59:0/2784879403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40095f0 con 0x7f52a8068190 2023-10-08T12:39:45.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.709+0000 7f52adfe1700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52a8068190 0x7f52a8198e80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f52a40095c0 tx=0x7f52a400f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:45.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.709+0000 7f529effd700 1 -- 172.21.15.59:0/2784879403 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a401d070 con 0x7f52a8068190 2023-10-08T12:39:45.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.709+0000 7f52b0245700 1 -- 172.21.15.59:0/2784879403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a819e330 con 0x7f52a8068190 2023-10-08T12:39:45.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.709+0000 7f529effd700 1 -- 172.21.15.59:0/2784879403 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52a4005050 con 0x7f52a8068190 2023-10-08T12:39:45.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.709+0000 7f529effd700 1 -- 172.21.15.59:0/2784879403 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a4004b10 con 0x7f52a8068190 2023-10-08T12:39:45.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.709+0000 7f52b0245700 1 -- 172.21.15.59:0/2784879403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a81a5bf0 con 0x7f52a8068190 2023-10-08T12:39:45.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.710+0000 7f52b0245700 1 -- 172.21.15.59:0/2784879403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52a81109c0 con 0x7f52a8068190 2023-10-08T12:39:45.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.712+0000 7f529effd700 1 -- 172.21.15.59:0/2784879403 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f52a40051c0 con 0x7f52a8068190 2023-10-08T12:39:45.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.714+0000 7f529effd700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52940a1560 0x7f52940a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.714+0000 7f529effd700 1 -- 172.21.15.59:0/2784879403 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f52a40ce420 con 0x7f52a8068190 2023-10-08T12:39:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.714+0000 7f52ad7e0700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52940a1560 0x7f52940a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.714+0000 7f529effd700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555] conn(0x7f52940aaed0 0x7f52940ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.714+0000 7f529effd700 1 -- 172.21.15.59:0/2784879403 --> [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52940ad9a0 con 0x7f52940aaed0 2023-10-08T12:39:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.714+0000 7f529effd700 1 -- 172.21.15.59:0/2784879403 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52a40ce790 con 0x7f52a8068190 2023-10-08T12:39:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.715+0000 7f52ad7e0700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52940a1560 0x7f52940a3a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f52a819a3e0 tx=0x7f529800a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.715+0000 7f52ae7e2700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555] conn(0x7f52940aaed0 0x7f52940ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:45.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.716+0000 7f52ae7e2700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555] conn(0x7f52940aaed0 0x7f52940ad2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:45.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.717+0000 7f529effd700 1 -- 172.21.15.59:0/2784879403 <== osd.0 v2:172.21.15.59:6802/2710052555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f52940ad9a0 con 0x7f52940aaed0 2023-10-08T12:39:45.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.734+0000 7f52b0245700 1 -- 172.21.15.59:0/2784879403 --> [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f52a819e600 con 0x7f52940aaed0 2023-10-08T12:39:45.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.735+0000 7f529effd700 1 -- 172.21.15.59:0/2784879403 <== osd.0 v2:172.21.15.59:6802/2710052555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f52a0009cd0 con 0x7f52940aaed0 2023-10-08T12:39:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.735+0000 7f52b0245700 1 -- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555] conn(0x7f52940aaed0 msgr2=0x7f52940ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.735+0000 7f52b0245700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555] conn(0x7f52940aaed0 0x7f52940ad2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.735+0000 7f52b0245700 1 -- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52940a1560 msgr2=0x7f52940a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.735+0000 7f52b0245700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52940a1560 0x7f52940a3a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f52a819a3e0 tx=0x7f529800a380 comp rx=0 tx=0).stop 2023-10-08T12:39:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.735+0000 7f52b0245700 1 -- 172.21.15.59:0/2784879403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52a8068190 msgr2=0x7f52a8198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.735+0000 7f52b0245700 1 --2- 172.21.15.59:0/2784879403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52a8068190 0x7f52a8198e80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f52a40095c0 tx=0x7f52a400f690 comp rx=0 tx=0).stop 2023-10-08T12:39:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.736+0000 7f52ae7e2700 1 -- 172.21.15.59:0/2784879403 reap_dead start 2023-10-08T12:39:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.736+0000 7f52b0245700 1 -- 172.21.15.59:0/2784879403 shutdown_connections 2023-10-08T12:39:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.736+0000 7f52b0245700 1 -- 172.21.15.59:0/2784879403 >> 172.21.15.59:0/2784879403 conn(0x7f52a8075790 msgr2=0x7f52a810bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.736+0000 7f52b0245700 1 -- 172.21.15.59:0/2784879403 shutdown_connections 2023-10-08T12:39:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:45.736+0000 7f52b0245700 1 -- 172.21.15.59:0/2784879403 wait complete. 2023-10-08T12:39:45.958 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:45 smithi059 ceph-mon[98489]: pgmap v269: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2023-10-08T12:39:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:45 smithi173 ceph-mon[135182]: pgmap v269: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2023-10-08T12:39:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:45 smithi092 ceph-mon[134093]: pgmap v269: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2023-10-08T12:39:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.491+0000 7f0b1e972700 1 -- 172.21.15.59:0/3702235430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b181008a0 msgr2=0x7f0b18100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.491+0000 7f0b1e972700 1 --2- 172.21.15.59:0/3702235430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b181008a0 0x7f0b18100d20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009990 tx=0x7f0b0c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.491+0000 7f0b1e972700 1 -- 172.21.15.59:0/3702235430 shutdown_connections 2023-10-08T12:39:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.491+0000 7f0b1e972700 1 --2- 172.21.15.59:0/3702235430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b181057c0 0x7f0b18105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.491+0000 7f0b1e972700 1 --2- 172.21.15.59:0/3702235430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b18101260 0x7f0b1810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.491+0000 7f0b1e972700 1 --2- 172.21.15.59:0/3702235430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b181008a0 0x7f0b18100d20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.491+0000 7f0b1e972700 1 -- 172.21.15.59:0/3702235430 >> 172.21.15.59:0/3702235430 conn(0x7f0b180779e0 msgr2=0x7f0b18077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.491+0000 7f0b1e972700 1 -- 172.21.15.59:0/3702235430 shutdown_connections 2023-10-08T12:39:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.491+0000 7f0b1e972700 1 -- 172.21.15.59:0/3702235430 wait complete. 2023-10-08T12:39:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.492+0000 7f0b1e972700 1 Processor -- start 2023-10-08T12:39:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.492+0000 7f0b1e972700 1 -- start start 2023-10-08T12:39:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.492+0000 7f0b1e972700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b181008a0 0x7f0b18072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b1e972700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b18101260 0x7f0b18073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b1e972700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b181057c0 0x7f0b18073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b1e972700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181a4f90 con 0x7f0b181008a0 2023-10-08T12:39:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b1e972700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181a5100 con 0x7f0b181057c0 2023-10-08T12:39:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b1e972700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181a52c0 con 0x7f0b18101260 2023-10-08T12:39:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b17fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b181008a0 0x7f0b18072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b17fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b181008a0 0x7f0b18072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40776/0 (socket says 172.21.15.59:40776) 2023-10-08T12:39:46.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b17fff700 1 -- 172.21.15.59:0/3468956699 learned_addr learned my addr 172.21.15.59:0/3468956699 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:46.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b1cf0f700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b181057c0 0x7f0b18073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:46.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b177fe700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b18101260 0x7f0b18073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b17fff700 1 -- 172.21.15.59:0/3468956699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b18101260 msgr2=0x7f0b18073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b17fff700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b18101260 0x7f0b18073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b17fff700 1 -- 172.21.15.59:0/3468956699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b181057c0 msgr2=0x7f0b18073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b17fff700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b181057c0 0x7f0b18073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.493+0000 7f0b17fff700 1 -- 172.21.15.59:0/3468956699 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c0095f0 con 0x7f0b181008a0 2023-10-08T12:39:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.494+0000 7f0b17fff700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b181008a0 0x7f0b18072af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800e970 tx=0x7f0b0800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.494+0000 7f0b157fa700 1 -- 172.21.15.59:0/3468956699 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08009790 con 0x7f0b181008a0 2023-10-08T12:39:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.494+0000 7f0b157fa700 1 -- 172.21.15.59:0/3468956699 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b0800c7e0 con 0x7f0b181008a0 2023-10-08T12:39:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.494+0000 7f0b157fa700 1 -- 172.21.15.59:0/3468956699 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08003c70 con 0x7f0b181008a0 2023-10-08T12:39:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.494+0000 7f0b1e972700 1 -- 172.21.15.59:0/3468956699 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b181a55a0 con 0x7f0b181008a0 2023-10-08T12:39:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.494+0000 7f0b1e972700 1 -- 172.21.15.59:0/3468956699 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b181a5a50 con 0x7f0b181008a0 2023-10-08T12:39:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.495+0000 7f0b1e972700 1 -- 172.21.15.59:0/3468956699 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b18110a60 con 0x7f0b181008a0 2023-10-08T12:39:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.497+0000 7f0b157fa700 1 -- 172.21.15.59:0/3468956699 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f0b0800cc50 con 0x7f0b181008a0 2023-10-08T12:39:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.499+0000 7f0b157fa700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0b000a1560 0x7f0b000a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:46.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.499+0000 7f0b157fa700 1 -- 172.21.15.59:0/3468956699 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f0b08014070 con 0x7f0b181008a0 2023-10-08T12:39:46.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.499+0000 7f0b177fe700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0b000a1560 0x7f0b000a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:46.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.499+0000 7f0b157fa700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480] conn(0x7f0b000aaed0 0x7f0b000ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:46.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.499+0000 7f0b157fa700 1 -- 172.21.15.59:0/3468956699 --> [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b000ad9a0 con 0x7f0b000aaed0 2023-10-08T12:39:46.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.499+0000 7f0b157fa700 1 -- 172.21.15.59:0/3468956699 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b080cd4f0 con 0x7f0b181008a0 2023-10-08T12:39:46.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.500+0000 7f0b1cf0f700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480] conn(0x7f0b000aaed0 0x7f0b000ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:46.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.500+0000 7f0b177fe700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0b000a1560 0x7f0b000a3a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0b180741d0 tx=0x7f0b0c005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:46.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.500+0000 7f0b1cf0f700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480] conn(0x7f0b000aaed0 0x7f0b000ad2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.501+0000 7f0b157fa700 1 -- 172.21.15.59:0/3468956699 <== osd.4 v2:172.21.15.92:6808/1499509480 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0b000ad9a0 con 0x7f0b000aaed0 2023-10-08T12:39:46.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.518+0000 7f0b1e972700 1 -- 172.21.15.59:0/3468956699 --> [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0b18101f30 con 0x7f0b000aaed0 2023-10-08T12:39:46.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.519+0000 7f0b157fa700 1 -- 172.21.15.59:0/3468956699 <== osd.4 v2:172.21.15.92:6808/1499509480 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0b18101f30 con 0x7f0b000aaed0 2023-10-08T12:39:46.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.519+0000 7f0b1e972700 1 -- 172.21.15.59:0/3468956699 >> [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480] conn(0x7f0b000aaed0 msgr2=0x7f0b000ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:46.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.519+0000 7f0b1e972700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480] conn(0x7f0b000aaed0 0x7f0b000ad2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:46.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.520+0000 7f0b1e972700 1 -- 172.21.15.59:0/3468956699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0b000a1560 msgr2=0x7f0b000a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:46.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.520+0000 7f0b1e972700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0b000a1560 0x7f0b000a3a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0b180741d0 tx=0x7f0b0c005fd0 comp rx=0 tx=0).stop 2023-10-08T12:39:46.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.520+0000 7f0b1e972700 1 -- 172.21.15.59:0/3468956699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b181008a0 msgr2=0x7f0b18072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:46.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.520+0000 7f0b1e972700 1 --2- 172.21.15.59:0/3468956699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b181008a0 0x7f0b18072af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800e970 tx=0x7f0b0800ec80 comp rx=0 tx=0).stop 2023-10-08T12:39:46.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.520+0000 7f0b1cf0f700 1 -- 172.21.15.59:0/3468956699 reap_dead start 2023-10-08T12:39:46.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.520+0000 7f0b1e972700 1 -- 172.21.15.59:0/3468956699 shutdown_connections 2023-10-08T12:39:46.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.520+0000 7f0b1e972700 1 -- 172.21.15.59:0/3468956699 >> 172.21.15.59:0/3468956699 conn(0x7f0b180779e0 msgr2=0x7f0b180fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:46.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.520+0000 7f0b1e972700 1 -- 172.21.15.59:0/3468956699 shutdown_connections 2023-10-08T12:39:46.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:46.520+0000 7f0b1e972700 1 -- 172.21.15.59:0/3468956699 wait complete. 2023-10-08T12:39:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.210+0000 7efea86ad700 1 -- 172.21.15.59:0/738653249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea01008a0 msgr2=0x7efea0100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.210+0000 7efea86ad700 1 --2- 172.21.15.59:0/738653249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea01008a0 0x7efea0100d20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efe90009990 tx=0x7efe90009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.210+0000 7efea86ad700 1 -- 172.21.15.59:0/738653249 shutdown_connections 2023-10-08T12:39:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.210+0000 7efea86ad700 1 --2- 172.21.15.59:0/738653249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea01057c0 0x7efea0105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.210+0000 7efea86ad700 1 --2- 172.21.15.59:0/738653249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efea0101260 0x7efea010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.210+0000 7efea86ad700 1 --2- 172.21.15.59:0/738653249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea01008a0 0x7efea0100d20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.210+0000 7efea86ad700 1 -- 172.21.15.59:0/738653249 >> 172.21.15.59:0/738653249 conn(0x7efea00779e0 msgr2=0x7efea0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.210+0000 7efea86ad700 1 -- 172.21.15.59:0/738653249 shutdown_connections 2023-10-08T12:39:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.210+0000 7efea86ad700 1 -- 172.21.15.59:0/738653249 wait complete. 2023-10-08T12:39:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.211+0000 7efea86ad700 1 Processor -- start 2023-10-08T12:39:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.211+0000 7efea86ad700 1 -- start start 2023-10-08T12:39:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.212+0000 7efea86ad700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efea01008a0 0x7efea0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.212+0000 7efea86ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea0101260 0x7efea0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.212+0000 7efea86ad700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea01057c0 0x7efea0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.212+0000 7efea86ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea01a5020 con 0x7efea0101260 2023-10-08T12:39:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.212+0000 7efea86ad700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea01a5190 con 0x7efea01057c0 2023-10-08T12:39:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.212+0000 7efea86ad700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea01a5350 con 0x7efea01008a0 2023-10-08T12:39:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.212+0000 7efea5c48700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea0101260 0x7efea0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.212+0000 7efea5c48700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea0101260 0x7efea0073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40782/0 (socket says 172.21.15.59:40782) 2023-10-08T12:39:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.212+0000 7efea5c48700 1 -- 172.21.15.59:0/1336977360 learned_addr learned my addr 172.21.15.59:0/1336977360 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.212+0000 7efea6449700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efea01008a0 0x7efea0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.212+0000 7efea6c4a700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea01057c0 0x7efea0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.213+0000 7efea5c48700 1 -- 172.21.15.59:0/1336977360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efea01008a0 msgr2=0x7efea0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.213+0000 7efea5c48700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efea01008a0 0x7efea0072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.213+0000 7efea5c48700 1 -- 172.21.15.59:0/1336977360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea01057c0 msgr2=0x7efea0073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.213+0000 7efea5c48700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea01057c0 0x7efea0073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.213+0000 7efea5c48700 1 -- 172.21.15.59:0/1336977360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900095f0 con 0x7efea0101260 2023-10-08T12:39:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.213+0000 7efea5c48700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea0101260 0x7efea0073030 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efe90000c00 tx=0x7efe90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.213+0000 7efe977fe700 1 -- 172.21.15.59:0/1336977360 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9001d070 con 0x7efea0101260 2023-10-08T12:39:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.213+0000 7efe977fe700 1 -- 172.21.15.59:0/1336977360 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe90022470 con 0x7efea0101260 2023-10-08T12:39:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.213+0000 7efea86ad700 1 -- 172.21.15.59:0/1336977360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea01a55d0 con 0x7efea0101260 2023-10-08T12:39:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.213+0000 7efe977fe700 1 -- 172.21.15.59:0/1336977360 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90017650 con 0x7efea0101260 2023-10-08T12:39:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.213+0000 7efea86ad700 1 -- 172.21.15.59:0/1336977360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea01a5a40 con 0x7efea0101260 2023-10-08T12:39:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.214+0000 7efea86ad700 1 -- 172.21.15.59:0/1336977360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efea0110a30 con 0x7efea0101260 2023-10-08T12:39:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.216+0000 7efe977fe700 1 -- 172.21.15.59:0/1336977360 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7efe900225e0 con 0x7efea0101260 2023-10-08T12:39:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.218+0000 7efe977fe700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efe8c0a15e0 0x7efe8c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.218+0000 7efe977fe700 1 -- 172.21.15.59:0/1336977360 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7efe900ce8e0 con 0x7efea0101260 2023-10-08T12:39:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.218+0000 7efea6449700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efe8c0a15e0 0x7efe8c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.218+0000 7efe977fe700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527] conn(0x7efe8c0aaf50 0x7efe8c0ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.218+0000 7efe977fe700 1 -- 172.21.15.59:0/1336977360 --> [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe8c0ada20 con 0x7efe8c0aaf50 2023-10-08T12:39:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.218+0000 7efe977fe700 1 -- 172.21.15.59:0/1336977360 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe900cec50 con 0x7efea0101260 2023-10-08T12:39:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.218+0000 7efea6c4a700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527] conn(0x7efe8c0aaf50 0x7efe8c0ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.219+0000 7efea6449700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efe8c0a15e0 0x7efe8c0a3aa0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efea0101930 tx=0x7efe9c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.219+0000 7efea6c4a700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527] conn(0x7efe8c0aaf50 0x7efe8c0ad370 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.220+0000 7efe977fe700 1 -- 172.21.15.59:0/1336977360 <== osd.6 v2:172.21.15.59:6818/4121704527 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efe8c0ada20 con 0x7efe8c0aaf50 2023-10-08T12:39:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.237+0000 7efea86ad700 1 -- 172.21.15.59:0/1336977360 --> [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efea0060e70 con 0x7efe8c0aaf50 2023-10-08T12:39:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.237+0000 7efe977fe700 1 -- 172.21.15.59:0/1336977360 <== osd.6 v2:172.21.15.59:6818/4121704527 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efea0060e70 con 0x7efe8c0aaf50 2023-10-08T12:39:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.238+0000 7efea86ad700 1 -- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527] conn(0x7efe8c0aaf50 msgr2=0x7efe8c0ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.238+0000 7efea86ad700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527] conn(0x7efe8c0aaf50 0x7efe8c0ad370 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.238+0000 7efea86ad700 1 -- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efe8c0a15e0 msgr2=0x7efe8c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.238+0000 7efea86ad700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efe8c0a15e0 0x7efe8c0a3aa0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efea0101930 tx=0x7efe9c009260 comp rx=0 tx=0).stop 2023-10-08T12:39:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.238+0000 7efea86ad700 1 -- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea0101260 msgr2=0x7efea0073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.238+0000 7efea86ad700 1 --2- 172.21.15.59:0/1336977360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea0101260 0x7efea0073030 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efe90000c00 tx=0x7efe90004730 comp rx=0 tx=0).stop 2023-10-08T12:39:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.238+0000 7efea6c4a700 1 -- 172.21.15.59:0/1336977360 reap_dead start 2023-10-08T12:39:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.238+0000 7efea86ad700 1 -- 172.21.15.59:0/1336977360 shutdown_connections 2023-10-08T12:39:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.238+0000 7efea86ad700 1 -- 172.21.15.59:0/1336977360 >> 172.21.15.59:0/1336977360 conn(0x7efea00779e0 msgr2=0x7efea00fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.238+0000 7efea86ad700 1 -- 172.21.15.59:0/1336977360 shutdown_connections 2023-10-08T12:39:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:47.238+0000 7efea86ad700 1 -- 172.21.15.59:0/1336977360 wait complete. 2023-10-08T12:39:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:47 smithi173 ceph-mon[135182]: pgmap v270: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:39:48.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:47 smithi059 ceph-mon[98489]: pgmap v270: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:39:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:47 smithi092 ceph-mon[134093]: pgmap v270: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:39:48.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.490+0000 7fa242e9f700 1 -- 172.21.15.59:0/1633060111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23c101260 msgr2=0x7fa23c10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:48.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.490+0000 7fa242e9f700 1 --2- 172.21.15.59:0/1633060111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23c101260 0x7fa23c10d650 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa23400b0a0 tx=0x7fa23400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:48.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.491+0000 7fa242e9f700 1 -- 172.21.15.59:0/1633060111 shutdown_connections 2023-10-08T12:39:48.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.491+0000 7fa242e9f700 1 --2- 172.21.15.59:0/1633060111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23c101260 0x7fa23c10d650 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:48.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.491+0000 7fa242e9f700 1 --2- 172.21.15.59:0/1633060111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa23c1057c0 0x7fa23c105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:48.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.491+0000 7fa242e9f700 1 --2- 172.21.15.59:0/1633060111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa23c1008a0 0x7fa23c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:48.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.491+0000 7fa242e9f700 1 -- 172.21.15.59:0/1633060111 >> 172.21.15.59:0/1633060111 conn(0x7fa23c0779e0 msgr2=0x7fa23c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:48.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.491+0000 7fa242e9f700 1 -- 172.21.15.59:0/1633060111 shutdown_connections 2023-10-08T12:39:48.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.491+0000 7fa242e9f700 1 -- 172.21.15.59:0/1633060111 wait complete. 2023-10-08T12:39:48.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.492+0000 7fa242e9f700 1 Processor -- start 2023-10-08T12:39:48.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.492+0000 7fa242e9f700 1 -- start start 2023-10-08T12:39:48.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.492+0000 7fa242e9f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa23c1008a0 0x7fa23c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:48.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.492+0000 7fa242e9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23c101260 0x7fa23c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:48.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.492+0000 7fa242e9f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa23c1057c0 0x7fa23c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:48.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.492+0000 7fa242e9f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c1a5100 con 0x7fa23c101260 2023-10-08T12:39:48.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.492+0000 7fa242e9f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c1a5270 con 0x7fa23c1057c0 2023-10-08T12:39:48.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.492+0000 7fa242e9f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c1a5430 con 0x7fa23c1008a0 2023-10-08T12:39:48.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.493+0000 7fa23bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23c101260 0x7fa23c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:48.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.493+0000 7fa23bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23c101260 0x7fa23c073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40804/0 (socket says 172.21.15.59:40804) 2023-10-08T12:39:48.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.493+0000 7fa23bfff700 1 -- 172.21.15.59:0/2199781716 learned_addr learned my addr 172.21.15.59:0/2199781716 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:48.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.493+0000 7fa240c3b700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa23c1008a0 0x7fa23c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:48.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.493+0000 7fa24143c700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa23c1057c0 0x7fa23c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:48.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.493+0000 7fa23bfff700 1 -- 172.21.15.59:0/2199781716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa23c1008a0 msgr2=0x7fa23c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:48.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.493+0000 7fa23bfff700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa23c1008a0 0x7fa23c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:48.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.493+0000 7fa23bfff700 1 -- 172.21.15.59:0/2199781716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa23c1057c0 msgr2=0x7fa23c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:48.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.493+0000 7fa23bfff700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa23c1057c0 0x7fa23c073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:48.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.493+0000 7fa23bfff700 1 -- 172.21.15.59:0/2199781716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234009d00 con 0x7fa23c101260 2023-10-08T12:39:48.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.493+0000 7fa23bfff700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23c101260 0x7fa23c073030 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa22800e9a0 tx=0x7fa22800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:48.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.494+0000 7fa239ffb700 1 -- 172.21.15.59:0/2199781716 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228009790 con 0x7fa23c101260 2023-10-08T12:39:48.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.494+0000 7fa242e9f700 1 -- 172.21.15.59:0/2199781716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c1a5710 con 0x7fa23c101260 2023-10-08T12:39:48.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.494+0000 7fa239ffb700 1 -- 172.21.15.59:0/2199781716 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa228010430 con 0x7fa23c101260 2023-10-08T12:39:48.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.494+0000 7fa239ffb700 1 -- 172.21.15.59:0/2199781716 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228018680 con 0x7fa23c101260 2023-10-08T12:39:48.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.494+0000 7fa242e9f700 1 -- 172.21.15.59:0/2199781716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c1a5c10 con 0x7fa23c101260 2023-10-08T12:39:48.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.495+0000 7fa242e9f700 1 -- 172.21.15.59:0/2199781716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa23c1109f0 con 0x7fa23c101260 2023-10-08T12:39:48.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.497+0000 7fa239ffb700 1 -- 172.21.15.59:0/2199781716 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fa2280105a0 con 0x7fa23c101260 2023-10-08T12:39:48.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.498+0000 7fa239ffb700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa22c0a1560 0x7fa22c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:48.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.498+0000 7fa239ffb700 1 -- 172.21.15.59:0/2199781716 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fa228014070 con 0x7fa23c101260 2023-10-08T12:39:48.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.499+0000 7fa240c3b700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa22c0a1560 0x7fa22c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:48.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.499+0000 7fa239ffb700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233] conn(0x7fa22c0aaed0 0x7fa22c0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:48.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.499+0000 7fa239ffb700 1 -- 172.21.15.59:0/2199781716 --> [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa22c0ad9a0 con 0x7fa22c0aaed0 2023-10-08T12:39:48.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.499+0000 7fa239ffb700 1 -- 172.21.15.59:0/2199781716 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2280cd700 con 0x7fa23c101260 2023-10-08T12:39:48.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.499+0000 7fa240c3b700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa22c0a1560 0x7fa22c0a3a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa23c101930 tx=0x7fa23000b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:48.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.499+0000 7fa24143c700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233] conn(0x7fa22c0aaed0 0x7fa22c0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:48.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.500+0000 7fa24143c700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233] conn(0x7fa22c0aaed0 0x7fa22c0ad2f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.501+0000 7fa239ffb700 1 -- 172.21.15.59:0/2199781716 <== osd.11 v2:172.21.15.173:6824/1114623233 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa22c0ad9a0 con 0x7fa22c0aaed0 2023-10-08T12:39:48.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.518+0000 7fa242e9f700 1 -- 172.21.15.59:0/2199781716 --> [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa23c060e70 con 0x7fa22c0aaed0 2023-10-08T12:39:48.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.519+0000 7fa239ffb700 1 -- 172.21.15.59:0/2199781716 <== osd.11 v2:172.21.15.173:6824/1114623233 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa23c060e70 con 0x7fa22c0aaed0 2023-10-08T12:39:48.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.520+0000 7fa242e9f700 1 -- 172.21.15.59:0/2199781716 >> [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233] conn(0x7fa22c0aaed0 msgr2=0x7fa22c0ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:48.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.520+0000 7fa242e9f700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233] conn(0x7fa22c0aaed0 0x7fa22c0ad2f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:48.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.520+0000 7fa242e9f700 1 -- 172.21.15.59:0/2199781716 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa22c0a1560 msgr2=0x7fa22c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:48.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.520+0000 7fa242e9f700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa22c0a1560 0x7fa22c0a3a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa23c101930 tx=0x7fa23000b410 comp rx=0 tx=0).stop 2023-10-08T12:39:48.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.520+0000 7fa242e9f700 1 -- 172.21.15.59:0/2199781716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23c101260 msgr2=0x7fa23c073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:48.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.520+0000 7fa242e9f700 1 --2- 172.21.15.59:0/2199781716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23c101260 0x7fa23c073030 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa22800e9a0 tx=0x7fa22800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:39:48.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.520+0000 7fa24143c700 1 -- 172.21.15.59:0/2199781716 reap_dead start 2023-10-08T12:39:48.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.520+0000 7fa242e9f700 1 -- 172.21.15.59:0/2199781716 shutdown_connections 2023-10-08T12:39:48.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.520+0000 7fa242e9f700 1 -- 172.21.15.59:0/2199781716 >> 172.21.15.59:0/2199781716 conn(0x7fa23c0779e0 msgr2=0x7fa23c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:48.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.520+0000 7fa242e9f700 1 -- 172.21.15.59:0/2199781716 shutdown_connections 2023-10-08T12:39:48.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:48.520+0000 7fa242e9f700 1 -- 172.21.15.59:0/2199781716 wait complete. 2023-10-08T12:39:48.654 INFO:teuthology.orchestra.run.smithi059.stdout:38654705732 2023-10-08T12:39:48.654 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-08T12:39:48.859 INFO:teuthology.orchestra.run.smithi059.stdout:146028888115 2023-10-08T12:39:48.860 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-08T12:39:49.212 INFO:teuthology.orchestra.run.smithi059.stdout:339302416404 2023-10-08T12:39:49.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-08T12:39:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.379+0000 7f09acc1a700 1 -- 172.21.15.59:0/167673997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09a810d300 msgr2=0x7f09a810f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.379+0000 7f09acc1a700 1 --2- 172.21.15.59:0/167673997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09a810d300 0x7f09a810f6f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f09a000b0a0 tx=0x7f09a000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.379+0000 7f09acc1a700 1 -- 172.21.15.59:0/167673997 shutdown_connections 2023-10-08T12:39:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.379+0000 7f09acc1a700 1 --2- 172.21.15.59:0/167673997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09a810d300 0x7f09a810f6f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.379+0000 7f09acc1a700 1 --2- 172.21.15.59:0/167673997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a8068190 0x7f09a8068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.379+0000 7f09acc1a700 1 --2- 172.21.15.59:0/167673997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a8068ab0 0x7f09a810cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.379+0000 7f09acc1a700 1 -- 172.21.15.59:0/167673997 >> 172.21.15.59:0/167673997 conn(0x7f09a8075790 msgr2=0x7f09a8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.379+0000 7f09acc1a700 1 -- 172.21.15.59:0/167673997 shutdown_connections 2023-10-08T12:39:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.380+0000 7f09acc1a700 1 -- 172.21.15.59:0/167673997 wait complete. 2023-10-08T12:39:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.381+0000 7f09acc1a700 1 Processor -- start 2023-10-08T12:39:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.381+0000 7f09acc1a700 1 -- start start 2023-10-08T12:39:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.381+0000 7f09acc1a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09a8068190 0x7f09a8198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.381+0000 7f09acc1a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a8068ab0 0x7f09a8199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09acc1a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a810d300 0x7f09a819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09acc1a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a819de40 con 0x7f09a810d300 2023-10-08T12:39:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09acc1a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a819dfb0 con 0x7f09a8068190 2023-10-08T12:39:49.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09acc1a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a819e170 con 0x7f09a8068ab0 2023-10-08T12:39:49.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09a659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09a8068190 0x7f09a8198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:49.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09a659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09a8068190 0x7f09a8198f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:55514/0 (socket says 172.21.15.59:55514) 2023-10-08T12:39:49.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09a659c700 1 -- 172.21.15.59:0/3755707158 learned_addr learned my addr 172.21.15.59:0/3755707158 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:49.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09a5d9b700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a8068ab0 0x7f09a8199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:49.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09a6d9d700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a810d300 0x7f09a819d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:49.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09a659c700 1 -- 172.21.15.59:0/3755707158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a8068ab0 msgr2=0x7f09a8199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:49.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09a659c700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a8068ab0 0x7f09a8199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:49.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09a659c700 1 -- 172.21.15.59:0/3755707158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a810d300 msgr2=0x7f09a819d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:49.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09a659c700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a810d300 0x7f09a819d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:49.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.382+0000 7f09a659c700 1 -- 172.21.15.59:0/3755707158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0009d00 con 0x7f09a8068190 2023-10-08T12:39:49.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.383+0000 7f09a659c700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09a8068190 0x7f09a8198f40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f099800e9a0 tx=0x7f099800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:49.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.383+0000 7f09977fe700 1 -- 172.21.15.59:0/3755707158 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998009790 con 0x7f09a8068190 2023-10-08T12:39:49.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.383+0000 7f09acc1a700 1 -- 172.21.15.59:0/3755707158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a819e450 con 0x7f09a8068190 2023-10-08T12:39:49.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.383+0000 7f09977fe700 1 -- 172.21.15.59:0/3755707158 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f099800cbd0 con 0x7f09a8068190 2023-10-08T12:39:49.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.383+0000 7f09977fe700 1 -- 172.21.15.59:0/3755707158 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998018680 con 0x7f09a8068190 2023-10-08T12:39:49.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.383+0000 7f09acc1a700 1 -- 172.21.15.59:0/3755707158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a81a5cb0 con 0x7f09a8068190 2023-10-08T12:39:49.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.384+0000 7f09acc1a700 1 -- 172.21.15.59:0/3755707158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09a8112b90 con 0x7f09a8068190 2023-10-08T12:39:49.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.386+0000 7f09977fe700 1 -- 172.21.15.59:0/3755707158 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f099800cd40 con 0x7f09a8068190 2023-10-08T12:39:49.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.388+0000 7f09977fe700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f09900a15e0 0x7f09900a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:49.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.388+0000 7f09977fe700 1 -- 172.21.15.59:0/3755707158 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f0998014070 con 0x7f09a8068190 2023-10-08T12:39:49.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.388+0000 7f09a5d9b700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f09900a15e0 0x7f09900a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:49.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.388+0000 7f09977fe700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812] conn(0x7f09900aaf50 0x7f09900ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:49.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.388+0000 7f09977fe700 1 -- 172.21.15.59:0/3755707158 --> [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09900ada20 con 0x7f09900aaf50 2023-10-08T12:39:49.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.388+0000 7f09977fe700 1 -- 172.21.15.59:0/3755707158 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09980cd7e0 con 0x7f09a8068190 2023-10-08T12:39:49.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.388+0000 7f09a6d9d700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812] conn(0x7f09900aaf50 0x7f09900ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:49.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.389+0000 7f09a5d9b700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f09900a15e0 0x7f09900a3aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f09a819a4a0 tx=0x7f099c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:49.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.389+0000 7f09a6d9d700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812] conn(0x7f09900aaf50 0x7f09900ad370 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:49.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.390+0000 7f09977fe700 1 -- 172.21.15.59:0/3755707158 <== osd.10 v2:172.21.15.92:6824/1729220812 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f09900ada20 con 0x7f09900aaf50 2023-10-08T12:39:49.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.408+0000 7f09acc1a700 1 -- 172.21.15.59:0/3755707158 --> [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09a80ffd30 con 0x7f09900aaf50 2023-10-08T12:39:49.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.409+0000 7f09977fe700 1 -- 172.21.15.59:0/3755707158 <== osd.10 v2:172.21.15.92:6824/1729220812 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f09a80ffd30 con 0x7f09900aaf50 2023-10-08T12:39:49.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.410+0000 7f09acc1a700 1 -- 172.21.15.59:0/3755707158 >> [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812] conn(0x7f09900aaf50 msgr2=0x7f09900ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:49.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.410+0000 7f09acc1a700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812] conn(0x7f09900aaf50 0x7f09900ad370 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:49.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.410+0000 7f09acc1a700 1 -- 172.21.15.59:0/3755707158 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f09900a15e0 msgr2=0x7f09900a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:49.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.410+0000 7f09acc1a700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f09900a15e0 0x7f09900a3aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f09a819a4a0 tx=0x7f099c009260 comp rx=0 tx=0).stop 2023-10-08T12:39:49.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.410+0000 7f09acc1a700 1 -- 172.21.15.59:0/3755707158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09a8068190 msgr2=0x7f09a8198f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:49.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.410+0000 7f09acc1a700 1 --2- 172.21.15.59:0/3755707158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09a8068190 0x7f09a8198f40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f099800e9a0 tx=0x7f099800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:39:49.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.410+0000 7f09a6d9d700 1 -- 172.21.15.59:0/3755707158 reap_dead start 2023-10-08T12:39:49.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.410+0000 7f09acc1a700 1 -- 172.21.15.59:0/3755707158 shutdown_connections 2023-10-08T12:39:49.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.410+0000 7f09acc1a700 1 -- 172.21.15.59:0/3755707158 >> 172.21.15.59:0/3755707158 conn(0x7f09a8075790 msgr2=0x7f09a810e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:49.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.410+0000 7f09acc1a700 1 -- 172.21.15.59:0/3755707158 shutdown_connections 2023-10-08T12:39:49.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:49.410+0000 7f09acc1a700 1 -- 172.21.15.59:0/3755707158 wait complete. 2023-10-08T12:39:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:49 smithi173 ceph-mon[135182]: pgmap v271: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2023-10-08T12:39:50.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:49 smithi059 ceph-mon[98489]: pgmap v271: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2023-10-08T12:39:50.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.079+0000 7f409ba84700 1 -- 172.21.15.59:0/3337639060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4094101260 msgr2=0x7f409410d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:50.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.079+0000 7f409ba84700 1 --2- 172.21.15.59:0/3337639060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4094101260 0x7f409410d650 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f408c00b0a0 tx=0x7f408c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.079+0000 7f409ba84700 1 -- 172.21.15.59:0/3337639060 shutdown_connections 2023-10-08T12:39:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.079+0000 7f409ba84700 1 --2- 172.21.15.59:0/3337639060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40941057c0 0x7f4094105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.079+0000 7f409ba84700 1 --2- 172.21.15.59:0/3337639060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4094101260 0x7f409410d650 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.079+0000 7f409ba84700 1 --2- 172.21.15.59:0/3337639060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40941008a0 0x7f4094100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.079+0000 7f409ba84700 1 -- 172.21.15.59:0/3337639060 >> 172.21.15.59:0/3337639060 conn(0x7f40940779e0 msgr2=0x7f4094077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.079+0000 7f409ba84700 1 -- 172.21.15.59:0/3337639060 shutdown_connections 2023-10-08T12:39:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.079+0000 7f409ba84700 1 -- 172.21.15.59:0/3337639060 wait complete. 2023-10-08T12:39:50.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.080+0000 7f409ba84700 1 Processor -- start 2023-10-08T12:39:50.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.080+0000 7f409ba84700 1 -- start start 2023-10-08T12:39:50.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409ba84700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40941008a0 0x7f409419c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:50.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409ba84700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4094101260 0x7f409419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:50.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409ba84700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40941057c0 0x7f4094196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409ba84700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4094197130 con 0x7f40941057c0 2023-10-08T12:39:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409ba84700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40941972a0 con 0x7f40941008a0 2023-10-08T12:39:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409ba84700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4094197460 con 0x7f4094101260 2023-10-08T12:39:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f4099820700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40941008a0 0x7f409419c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409a021700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40941057c0 0x7f4094196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f4099820700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40941008a0 0x7f409419c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:55532/0 (socket says 172.21.15.59:55532) 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f4099820700 1 -- 172.21.15.59:0/2078652524 learned_addr learned my addr 172.21.15.59:0/2078652524 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409901f700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4094101260 0x7f409419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409a021700 1 -- 172.21.15.59:0/2078652524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4094101260 msgr2=0x7f409419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409a021700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4094101260 0x7f409419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409a021700 1 -- 172.21.15.59:0/2078652524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40941008a0 msgr2=0x7f409419c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409a021700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40941008a0 0x7f409419c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f409a021700 1 -- 172.21.15.59:0/2078652524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c009d00 con 0x7f40941057c0 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.081+0000 7f4099820700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40941008a0 0x7f409419c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.082+0000 7f409a021700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40941057c0 0x7f4094196ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f408c00b0a0 tx=0x7f408c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.082+0000 7f408affd700 1 -- 172.21.15.59:0/2078652524 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00e040 con 0x7f40941057c0 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.082+0000 7f408affd700 1 -- 172.21.15.59:0/2078652524 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f408c01d470 con 0x7f40941057c0 2023-10-08T12:39:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.082+0000 7f409ba84700 1 -- 172.21.15.59:0/2078652524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40941976e0 con 0x7f40941057c0 2023-10-08T12:39:50.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.082+0000 7f408affd700 1 -- 172.21.15.59:0/2078652524 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c005260 con 0x7f40941057c0 2023-10-08T12:39:50.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.082+0000 7f409ba84700 1 -- 172.21.15.59:0/2078652524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40941a3980 con 0x7f40941057c0 2023-10-08T12:39:50.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.083+0000 7f409ba84700 1 -- 172.21.15.59:0/2078652524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40941109f0 con 0x7f40941057c0 2023-10-08T12:39:50.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.085+0000 7f408affd700 1 -- 172.21.15.59:0/2078652524 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f408c01d5e0 con 0x7f40941057c0 2023-10-08T12:39:50.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.087+0000 7f408affd700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40800a1560 0x7f40800a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:50.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.087+0000 7f408affd700 1 -- 172.21.15.59:0/2078652524 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f408c0ce770 con 0x7f40941057c0 2023-10-08T12:39:50.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.087+0000 7f4099820700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40800a1560 0x7f40800a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:50.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.087+0000 7f408affd700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685] conn(0x7f40800aaed0 0x7f40800ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:50.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.087+0000 7f408affd700 1 -- 172.21.15.59:0/2078652524 --> [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40800ad9a0 con 0x7f40800aaed0 2023-10-08T12:39:50.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.087+0000 7f408affd700 1 -- 172.21.15.59:0/2078652524 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f408c0ceae0 con 0x7f40941057c0 2023-10-08T12:39:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.087+0000 7f4099820700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40800a1560 0x7f40800a3a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4090005950 tx=0x7f4090009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.087+0000 7f409901f700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685] conn(0x7f40800aaed0 0x7f40800ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.088+0000 7f409901f700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685] conn(0x7f40800aaed0 0x7f40800ad2f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.089+0000 7f408affd700 1 -- 172.21.15.59:0/2078652524 <== osd.7 v2:172.21.15.92:6816/2022263685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f40800ad9a0 con 0x7f40800aaed0 2023-10-08T12:39:50.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.109+0000 7f409ba84700 1 -- 172.21.15.59:0/2078652524 --> [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4094060ef0 con 0x7f40800aaed0 2023-10-08T12:39:50.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.109+0000 7f408affd700 1 -- 172.21.15.59:0/2078652524 <== osd.7 v2:172.21.15.92:6816/2022263685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4094060ef0 con 0x7f40800aaed0 2023-10-08T12:39:50.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.110+0000 7f409ba84700 1 -- 172.21.15.59:0/2078652524 >> [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685] conn(0x7f40800aaed0 msgr2=0x7f40800ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.110+0000 7f409ba84700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685] conn(0x7f40800aaed0 0x7f40800ad2f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.110+0000 7f409ba84700 1 -- 172.21.15.59:0/2078652524 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40800a1560 msgr2=0x7f40800a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.110+0000 7f409ba84700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40800a1560 0x7f40800a3a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4090005950 tx=0x7f4090009260 comp rx=0 tx=0).stop 2023-10-08T12:39:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.110+0000 7f409ba84700 1 -- 172.21.15.59:0/2078652524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40941057c0 msgr2=0x7f4094196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.110+0000 7f409ba84700 1 --2- 172.21.15.59:0/2078652524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40941057c0 0x7f4094196ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f408c00b0a0 tx=0x7f408c007870 comp rx=0 tx=0).stop 2023-10-08T12:39:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.110+0000 7f409a021700 1 -- 172.21.15.59:0/2078652524 reap_dead start 2023-10-08T12:39:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.110+0000 7f409ba84700 1 -- 172.21.15.59:0/2078652524 shutdown_connections 2023-10-08T12:39:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.110+0000 7f409ba84700 1 -- 172.21.15.59:0/2078652524 >> 172.21.15.59:0/2078652524 conn(0x7f40940779e0 msgr2=0x7f40940fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.110+0000 7f409ba84700 1 -- 172.21.15.59:0/2078652524 shutdown_connections 2023-10-08T12:39:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:50.110+0000 7f409ba84700 1 -- 172.21.15.59:0/2078652524 wait complete. 2023-10-08T12:39:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:49 smithi092 ceph-mon[134093]: pgmap v271: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2023-10-08T12:39:50.562 INFO:teuthology.orchestra.run.smithi059.stdout:201863462953 2023-10-08T12:39:50.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-08T12:39:51.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.016+0000 7ff844fea700 1 -- 172.21.15.59:0/2673898762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8401067a0 msgr2=0x7ff840106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.016+0000 7ff844fea700 1 --2- 172.21.15.59:0/2673898762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8401067a0 0x7ff840106b80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff830009990 tx=0x7ff830009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.016+0000 7ff844fea700 1 -- 172.21.15.59:0/2673898762 shutdown_connections 2023-10-08T12:39:51.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.016+0000 7ff844fea700 1 --2- 172.21.15.59:0/2673898762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff840068b30 0x7ff84010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.016+0000 7ff844fea700 1 --2- 172.21.15.59:0/2673898762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8401067a0 0x7ff840106b80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.016+0000 7ff844fea700 1 --2- 172.21.15.59:0/2673898762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840068190 0x7ff8400685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.016+0000 7ff844fea700 1 -- 172.21.15.59:0/2673898762 >> 172.21.15.59:0/2673898762 conn(0x7ff840075790 msgr2=0x7ff840075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:51.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.016+0000 7ff844fea700 1 -- 172.21.15.59:0/2673898762 shutdown_connections 2023-10-08T12:39:51.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.016+0000 7ff844fea700 1 -- 172.21.15.59:0/2673898762 wait complete. 2023-10-08T12:39:51.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.017+0000 7ff844fea700 1 Processor -- start 2023-10-08T12:39:51.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff844fea700 1 -- start start 2023-10-08T12:39:51.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff844fea700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff840068190 0x7ff8400ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:51.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff844fea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840068b30 0x7ff8400ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:51.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff844fea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8401014d0 0x7ff8401002c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:51.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff844fea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401a9ad0 con 0x7ff8401014d0 2023-10-08T12:39:51.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff844fea700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401a9c40 con 0x7ff840068b30 2023-10-08T12:39:51.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff844fea700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401a9e00 con 0x7ff840068190 2023-10-08T12:39:51.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff83ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8401014d0 0x7ff8401002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:51.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff83e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff840068190 0x7ff8400ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:51.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff83ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8401014d0 0x7ff8401002c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59542/0 (socket says 172.21.15.59:59542) 2023-10-08T12:39:51.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff83ed9d700 1 -- 172.21.15.59:0/46938093 learned_addr learned my addr 172.21.15.59:0/46938093 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:51.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.018+0000 7ff83dd9b700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840068b30 0x7ff8400ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:51.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.019+0000 7ff83e59c700 1 -- 172.21.15.59:0/46938093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840068b30 msgr2=0x7ff8400ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.019+0000 7ff83e59c700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840068b30 0x7ff8400ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.019+0000 7ff83e59c700 1 -- 172.21.15.59:0/46938093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8401014d0 msgr2=0x7ff8401002c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.019+0000 7ff83e59c700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8401014d0 0x7ff8401002c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.019+0000 7ff83e59c700 1 -- 172.21.15.59:0/46938093 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834009520 con 0x7ff840068190 2023-10-08T12:39:51.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.019+0000 7ff83e59c700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff840068190 0x7ff8400ff820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff830008000 tx=0x7ff83000bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:51.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.019+0000 7ff82f7fe700 1 -- 172.21.15.59:0/46938093 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000fa80 con 0x7ff840068190 2023-10-08T12:39:51.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.019+0000 7ff82f7fe700 1 -- 172.21.15.59:0/46938093 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff83002e070 con 0x7ff840068190 2023-10-08T12:39:51.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.019+0000 7ff844fea700 1 -- 172.21.15.59:0/46938093 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff838009c40 con 0x7ff840068190 2023-10-08T12:39:51.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.019+0000 7ff82f7fe700 1 -- 172.21.15.59:0/46938093 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830032c70 con 0x7ff840068190 2023-10-08T12:39:51.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.020+0000 7ff844fea700 1 -- 172.21.15.59:0/46938093 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8300095f0 con 0x7ff840068190 2023-10-08T12:39:51.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.020+0000 7ff82d7fa700 1 -- 172.21.15.59:0/46938093 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff840110970 con 0x7ff840068190 2023-10-08T12:39:51.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.023+0000 7ff82f7fe700 1 -- 172.21.15.59:0/46938093 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7ff830030070 con 0x7ff840068190 2023-10-08T12:39:51.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.024+0000 7ff82f7fe700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8280a1560 0x7ff8280a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:51.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.025+0000 7ff82f7fe700 1 -- 172.21.15.59:0/46938093 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7ff8300df120 con 0x7ff840068190 2023-10-08T12:39:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.025+0000 7ff83dd9b700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8280a1560 0x7ff8280a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:51.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.025+0000 7ff82f7fe700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573] conn(0x7ff8280aaed0 0x7ff8280ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:51.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.025+0000 7ff82f7fe700 1 -- 172.21.15.59:0/46938093 --> [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8280ad9a0 con 0x7ff8280aaed0 2023-10-08T12:39:51.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.025+0000 7ff82f7fe700 1 -- 172.21.15.59:0/46938093 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8300df490 con 0x7ff840068190 2023-10-08T12:39:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.025+0000 7ff83ed9d700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573] conn(0x7ff8280aaed0 0x7ff8280ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.025+0000 7ff83dd9b700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8280a1560 0x7ff8280a3a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff840101000 tx=0x7ff834009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.026+0000 7ff83ed9d700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573] conn(0x7ff8280aaed0 0x7ff8280ad2f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.027+0000 7ff82f7fe700 1 -- 172.21.15.59:0/46938093 <== osd.5 v2:172.21.15.173:6808/2710761573 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff8280ad9a0 con 0x7ff8280aaed0 2023-10-08T12:39:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.046+0000 7ff82d7fa700 1 -- 172.21.15.59:0/46938093 --> [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff840060e70 con 0x7ff8280aaed0 2023-10-08T12:39:51.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.047+0000 7ff82f7fe700 1 -- 172.21.15.59:0/46938093 <== osd.5 v2:172.21.15.173:6808/2710761573 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff840060e70 con 0x7ff8280aaed0 2023-10-08T12:39:51.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.047+0000 7ff82d7fa700 1 -- 172.21.15.59:0/46938093 >> [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573] conn(0x7ff8280aaed0 msgr2=0x7ff8280ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.047+0000 7ff82d7fa700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573] conn(0x7ff8280aaed0 0x7ff8280ad2f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.047+0000 7ff82d7fa700 1 -- 172.21.15.59:0/46938093 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8280a1560 msgr2=0x7ff8280a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.047+0000 7ff82d7fa700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8280a1560 0x7ff8280a3a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff840101000 tx=0x7ff834009260 comp rx=0 tx=0).stop 2023-10-08T12:39:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.047+0000 7ff82d7fa700 1 -- 172.21.15.59:0/46938093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff840068190 msgr2=0x7ff8400ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.047+0000 7ff82d7fa700 1 --2- 172.21.15.59:0/46938093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff840068190 0x7ff8400ff820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff830008000 tx=0x7ff83000bfd0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.047+0000 7ff83ed9d700 1 -- 172.21.15.59:0/46938093 reap_dead start 2023-10-08T12:39:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.048+0000 7ff82d7fa700 1 -- 172.21.15.59:0/46938093 shutdown_connections 2023-10-08T12:39:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.048+0000 7ff82d7fa700 1 -- 172.21.15.59:0/46938093 >> 172.21.15.59:0/46938093 conn(0x7ff840075790 msgr2=0x7ff8400fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.048+0000 7ff82d7fa700 1 -- 172.21.15.59:0/46938093 shutdown_connections 2023-10-08T12:39:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.048+0000 7ff82d7fa700 1 -- 172.21.15.59:0/46938093 wait complete. 2023-10-08T12:39:51.361 INFO:teuthology.orchestra.run.smithi059.stdout:309237645335 2023-10-08T12:39:51.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-08T12:39:51.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.429+0000 7f194bbd2700 1 -- 172.21.15.59:0/3684200334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19441008a0 msgr2=0x7f1944100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.429+0000 7f194bbd2700 1 --2- 172.21.15.59:0/3684200334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19441008a0 0x7f1944100d20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1934009990 tx=0x7f1934009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.430+0000 7f194bbd2700 1 -- 172.21.15.59:0/3684200334 shutdown_connections 2023-10-08T12:39:51.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.430+0000 7f194bbd2700 1 --2- 172.21.15.59:0/3684200334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19441057c0 0x7f1944105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.430+0000 7f194bbd2700 1 --2- 172.21.15.59:0/3684200334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944101260 0x7f194410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.430+0000 7f194bbd2700 1 --2- 172.21.15.59:0/3684200334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19441008a0 0x7f1944100d20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.430+0000 7f194bbd2700 1 -- 172.21.15.59:0/3684200334 >> 172.21.15.59:0/3684200334 conn(0x7f19440779e0 msgr2=0x7f1944077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:51.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.430+0000 7f194bbd2700 1 -- 172.21.15.59:0/3684200334 shutdown_connections 2023-10-08T12:39:51.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.430+0000 7f194bbd2700 1 -- 172.21.15.59:0/3684200334 wait complete. 2023-10-08T12:39:51.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.431+0000 7f194bbd2700 1 Processor -- start 2023-10-08T12:39:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.431+0000 7f194bbd2700 1 -- start start 2023-10-08T12:39:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.431+0000 7f194bbd2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441008a0 0x7f1944072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.431+0000 7f194bbd2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1944101260 0x7f1944073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.431+0000 7f194bbd2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19441057c0 0x7f1944073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.431+0000 7f194bbd2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19441a4fb0 con 0x7f19441008a0 2023-10-08T12:39:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.431+0000 7f194bbd2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19441a5120 con 0x7f19441057c0 2023-10-08T12:39:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.431+0000 7f194bbd2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19441a52e0 con 0x7f1944101260 2023-10-08T12:39:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194996e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441008a0 0x7f1944072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194996e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441008a0 0x7f1944072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59560/0 (socket says 172.21.15.59:59560) 2023-10-08T12:39:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194996e700 1 -- 172.21.15.59:0/2295744206 learned_addr learned my addr 172.21.15.59:0/2295744206 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194a16f700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19441057c0 0x7f1944073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194916d700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1944101260 0x7f1944073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194996e700 1 -- 172.21.15.59:0/2295744206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1944101260 msgr2=0x7f1944073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194996e700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1944101260 0x7f1944073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194996e700 1 -- 172.21.15.59:0/2295744206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19441057c0 msgr2=0x7f1944073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194996e700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19441057c0 0x7f1944073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194996e700 1 -- 172.21.15.59:0/2295744206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340095f0 con 0x7f19441008a0 2023-10-08T12:39:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194a16f700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19441057c0 0x7f1944073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.432+0000 7f194996e700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441008a0 0x7f1944072af0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f194000e970 tx=0x7f194000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.433+0000 7f193affd700 1 -- 172.21.15.59:0/2295744206 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940009790 con 0x7f19441008a0 2023-10-08T12:39:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.433+0000 7f194bbd2700 1 -- 172.21.15.59:0/2295744206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19441a55c0 con 0x7f19441008a0 2023-10-08T12:39:51.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.433+0000 7f193affd700 1 -- 172.21.15.59:0/2295744206 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f194000c7e0 con 0x7f19441008a0 2023-10-08T12:39:51.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.433+0000 7f193affd700 1 -- 172.21.15.59:0/2295744206 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940003c70 con 0x7f19441008a0 2023-10-08T12:39:51.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.433+0000 7f194bbd2700 1 -- 172.21.15.59:0/2295744206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19441a5ac0 con 0x7f19441008a0 2023-10-08T12:39:51.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.434+0000 7f194bbd2700 1 -- 172.21.15.59:0/2295744206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1944110a60 con 0x7f19441008a0 2023-10-08T12:39:51.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.436+0000 7f193affd700 1 -- 172.21.15.59:0/2295744206 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f194000cc50 con 0x7f19441008a0 2023-10-08T12:39:51.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.437+0000 7f193affd700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19300a1560 0x7f19300a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:51.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.438+0000 7f193affd700 1 -- 172.21.15.59:0/2295744206 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f1940014070 con 0x7f19441008a0 2023-10-08T12:39:51.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.438+0000 7f194916d700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19300a1560 0x7f19300a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:51.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.438+0000 7f193affd700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029] conn(0x7f19300aaed0 0x7f19300ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:51.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.438+0000 7f193affd700 1 -- 172.21.15.59:0/2295744206 --> [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19300ad9a0 con 0x7f19300aaed0 2023-10-08T12:39:51.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.438+0000 7f193affd700 1 -- 172.21.15.59:0/2295744206 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19400cf490 con 0x7f19441008a0 2023-10-08T12:39:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.438+0000 7f194a16f700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029] conn(0x7f19300aaed0 0x7f19300ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.438+0000 7f194916d700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19300a1560 0x7f19300a3a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1944074220 tx=0x7f1934005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.439+0000 7f194a16f700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029] conn(0x7f19300aaed0 0x7f19300ad2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.440+0000 7f193affd700 1 -- 172.21.15.59:0/2295744206 <== osd.2 v2:172.21.15.173:6800/425637029 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f19300ad9a0 con 0x7f19300aaed0 2023-10-08T12:39:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.458+0000 7f194bbd2700 1 -- 172.21.15.59:0/2295744206 --> [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1944101f30 con 0x7f19300aaed0 2023-10-08T12:39:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.459+0000 7f193affd700 1 -- 172.21.15.59:0/2295744206 <== osd.2 v2:172.21.15.173:6800/425637029 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1944101f30 con 0x7f19300aaed0 2023-10-08T12:39:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.459+0000 7f194bbd2700 1 -- 172.21.15.59:0/2295744206 >> [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029] conn(0x7f19300aaed0 msgr2=0x7f19300ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.459+0000 7f194bbd2700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029] conn(0x7f19300aaed0 0x7f19300ad2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.459+0000 7f194bbd2700 1 -- 172.21.15.59:0/2295744206 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19300a1560 msgr2=0x7f19300a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.459+0000 7f194bbd2700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19300a1560 0x7f19300a3a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1944074220 tx=0x7f1934005fd0 comp rx=0 tx=0).stop 2023-10-08T12:39:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.459+0000 7f194bbd2700 1 -- 172.21.15.59:0/2295744206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441008a0 msgr2=0x7f1944072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.459+0000 7f194bbd2700 1 --2- 172.21.15.59:0/2295744206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441008a0 0x7f1944072af0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f194000e970 tx=0x7f194000ec80 comp rx=0 tx=0).stop 2023-10-08T12:39:51.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.460+0000 7f194a16f700 1 -- 172.21.15.59:0/2295744206 reap_dead start 2023-10-08T12:39:51.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.460+0000 7f194bbd2700 1 -- 172.21.15.59:0/2295744206 shutdown_connections 2023-10-08T12:39:51.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.460+0000 7f194bbd2700 1 -- 172.21.15.59:0/2295744206 >> 172.21.15.59:0/2295744206 conn(0x7f19440779e0 msgr2=0x7f19440fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:51.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.460+0000 7f194bbd2700 1 -- 172.21.15.59:0/2295744206 shutdown_connections 2023-10-08T12:39:51.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:51.460+0000 7f194bbd2700 1 -- 172.21.15.59:0/2295744206 wait complete. 2023-10-08T12:39:51.881 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:51 smithi059 ceph-mon[98489]: pgmap v272: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:39:52.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:51 smithi092 ceph-mon[134093]: pgmap v272: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:39:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:51 smithi173 ceph-mon[135182]: pgmap v272: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:39:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.169+0000 7f04a7c74700 1 -- 172.21.15.59:0/2962028453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a01057c0 msgr2=0x7f04a0105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.169+0000 7f04a7c74700 1 --2- 172.21.15.59:0/2962028453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a01057c0 0x7f04a0105ba0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f049c009990 tx=0x7f049c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.169+0000 7f04a7c74700 1 -- 172.21.15.59:0/2962028453 shutdown_connections 2023-10-08T12:39:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.169+0000 7f04a7c74700 1 --2- 172.21.15.59:0/2962028453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04a0101260 0x7f04a010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.169+0000 7f04a7c74700 1 --2- 172.21.15.59:0/2962028453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a01057c0 0x7f04a0105ba0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.169+0000 7f04a7c74700 1 --2- 172.21.15.59:0/2962028453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04a01008a0 0x7f04a0100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.169+0000 7f04a7c74700 1 -- 172.21.15.59:0/2962028453 >> 172.21.15.59:0/2962028453 conn(0x7f04a00779e0 msgr2=0x7f04a0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.169+0000 7f04a7c74700 1 -- 172.21.15.59:0/2962028453 shutdown_connections 2023-10-08T12:39:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.169+0000 7f04a7c74700 1 -- 172.21.15.59:0/2962028453 wait complete. 2023-10-08T12:39:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.170+0000 7f04a7c74700 1 Processor -- start 2023-10-08T12:39:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.171+0000 7f04a7c74700 1 -- start start 2023-10-08T12:39:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.171+0000 7f04a7c74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a01008a0 0x7f04a0198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.171+0000 7f04a7c74700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04a0101260 0x7f04a01993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.171+0000 7f04a7c74700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04a01057c0 0x7f04a019d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.171+0000 7f04a7c74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a019dda0 con 0x7f04a01008a0 2023-10-08T12:39:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.171+0000 7f04a7c74700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a019df10 con 0x7f04a0101260 2023-10-08T12:39:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.171+0000 7f04a7c74700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a019e0d0 con 0x7f04a01057c0 2023-10-08T12:39:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.171+0000 7f04a5a10700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a01008a0 0x7f04a0198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.171+0000 7f04a5a10700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a01008a0 0x7f04a0198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59584/0 (socket says 172.21.15.59:59584) 2023-10-08T12:39:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.171+0000 7f04a5a10700 1 -- 172.21.15.59:0/1100922457 learned_addr learned my addr 172.21.15.59:0/1100922457 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.171+0000 7f04a6211700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04a01057c0 0x7f04a019d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.172+0000 7f04a520f700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04a0101260 0x7f04a01993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.172+0000 7f04a5a10700 1 -- 172.21.15.59:0/1100922457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04a01057c0 msgr2=0x7f04a019d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.172+0000 7f04a5a10700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04a01057c0 0x7f04a019d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.172+0000 7f04a5a10700 1 -- 172.21.15.59:0/1100922457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04a0101260 msgr2=0x7f04a01993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.172+0000 7f04a5a10700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04a0101260 0x7f04a01993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.172+0000 7f04a5a10700 1 -- 172.21.15.59:0/1100922457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0095f0 con 0x7f04a01008a0 2023-10-08T12:39:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.172+0000 7f04a5a10700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a01008a0 0x7f04a0198ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f049c000c00 tx=0x7f049c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.172+0000 7f0496ffd700 1 -- 172.21.15.59:0/1100922457 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c01d070 con 0x7f04a01008a0 2023-10-08T12:39:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.172+0000 7f0496ffd700 1 -- 172.21.15.59:0/1100922457 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f049c022470 con 0x7f04a01008a0 2023-10-08T12:39:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.172+0000 7f04a7c74700 1 -- 172.21.15.59:0/1100922457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a019e350 con 0x7f04a01008a0 2023-10-08T12:39:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.172+0000 7f0496ffd700 1 -- 172.21.15.59:0/1100922457 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c017650 con 0x7f04a01008a0 2023-10-08T12:39:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.173+0000 7f04a7c74700 1 -- 172.21.15.59:0/1100922457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a01a5c10 con 0x7f04a01008a0 2023-10-08T12:39:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.173+0000 7f04a7c74700 1 -- 172.21.15.59:0/1100922457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04a0110a20 con 0x7f04a01008a0 2023-10-08T12:39:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.176+0000 7f0496ffd700 1 -- 172.21.15.59:0/1100922457 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f049c00fad0 con 0x7f04a01008a0 2023-10-08T12:39:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.177+0000 7f0496ffd700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f048c0a1560 0x7f048c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.177+0000 7f0496ffd700 1 -- 172.21.15.59:0/1100922457 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f049c0ceb90 con 0x7f04a01008a0 2023-10-08T12:39:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.177+0000 7f04a520f700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f048c0a1560 0x7f048c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.177+0000 7f0496ffd700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392] conn(0x7f048c0aaed0 0x7f048c0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.177+0000 7f0496ffd700 1 -- 172.21.15.59:0/1100922457 --> [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f048c0ad9a0 con 0x7f048c0aaed0 2023-10-08T12:39:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.177+0000 7f0496ffd700 1 -- 172.21.15.59:0/1100922457 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f049c0cef00 con 0x7f04a01008a0 2023-10-08T12:39:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.178+0000 7f04a520f700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f048c0a1560 0x7f048c0a3a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f04a019a400 tx=0x7f0490009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.178+0000 7f04a6211700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392] conn(0x7f048c0aaed0 0x7f048c0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.178+0000 7f04a6211700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392] conn(0x7f048c0aaed0 0x7f048c0ad2f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.179+0000 7f0496ffd700 1 -- 172.21.15.59:0/1100922457 <== osd.8 v2:172.21.15.173:6816/993161392 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f048c0ad9a0 con 0x7f048c0aaed0 2023-10-08T12:39:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.197+0000 7f04a7c74700 1 -- 172.21.15.59:0/1100922457 --> [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f04a019e620 con 0x7f048c0aaed0 2023-10-08T12:39:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.198+0000 7f0496ffd700 1 -- 172.21.15.59:0/1100922457 <== osd.8 v2:172.21.15.173:6816/993161392 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f049800f040 con 0x7f048c0aaed0 2023-10-08T12:39:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.198+0000 7f04a7c74700 1 -- 172.21.15.59:0/1100922457 >> [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392] conn(0x7f048c0aaed0 msgr2=0x7f048c0ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.198+0000 7f04a7c74700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392] conn(0x7f048c0aaed0 0x7f048c0ad2f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.198+0000 7f04a7c74700 1 -- 172.21.15.59:0/1100922457 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f048c0a1560 msgr2=0x7f048c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.198+0000 7f04a7c74700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f048c0a1560 0x7f048c0a3a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f04a019a400 tx=0x7f0490009260 comp rx=0 tx=0).stop 2023-10-08T12:39:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.198+0000 7f04a7c74700 1 -- 172.21.15.59:0/1100922457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a01008a0 msgr2=0x7f04a0198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.198+0000 7f04a7c74700 1 --2- 172.21.15.59:0/1100922457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a01008a0 0x7f04a0198ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f049c000c00 tx=0x7f049c005740 comp rx=0 tx=0).stop 2023-10-08T12:39:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.198+0000 7f04a6211700 1 -- 172.21.15.59:0/1100922457 reap_dead start 2023-10-08T12:39:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.199+0000 7f04a7c74700 1 -- 172.21.15.59:0/1100922457 shutdown_connections 2023-10-08T12:39:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.199+0000 7f04a7c74700 1 -- 172.21.15.59:0/1100922457 >> 172.21.15.59:0/1100922457 conn(0x7f04a00779e0 msgr2=0x7f04a010ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.199+0000 7f04a7c74700 1 -- 172.21.15.59:0/1100922457 shutdown_connections 2023-10-08T12:39:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:52.199+0000 7f04a7c74700 1 -- 172.21.15.59:0/1100922457 wait complete. 2023-10-08T12:39:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:52.409 INFO:teuthology.orchestra.run.smithi059.stdout:81604378685 2023-10-08T12:39:52.409 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-08T12:39:52.774 INFO:teuthology.orchestra.run.smithi059.stdout:223338299430 2023-10-08T12:39:52.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-08T12:39:53.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.217+0000 7f54769bb700 1 -- 172.21.15.59:0/1974637328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54701008a0 msgr2=0x7f5470100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.217+0000 7f54769bb700 1 --2- 172.21.15.59:0/1974637328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54701008a0 0x7f5470100d20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5464009990 tx=0x7f5464009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.218+0000 7f54769bb700 1 -- 172.21.15.59:0/1974637328 shutdown_connections 2023-10-08T12:39:53.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.218+0000 7f54769bb700 1 --2- 172.21.15.59:0/1974637328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5470101260 0x7f547010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.218+0000 7f54769bb700 1 --2- 172.21.15.59:0/1974637328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54701057c0 0x7f5470105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.218+0000 7f54769bb700 1 --2- 172.21.15.59:0/1974637328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54701008a0 0x7f5470100d20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.218+0000 7f54769bb700 1 -- 172.21.15.59:0/1974637328 >> 172.21.15.59:0/1974637328 conn(0x7f54700779e0 msgr2=0x7f5470077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:53.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.218+0000 7f54769bb700 1 -- 172.21.15.59:0/1974637328 shutdown_connections 2023-10-08T12:39:53.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.218+0000 7f54769bb700 1 -- 172.21.15.59:0/1974637328 wait complete. 2023-10-08T12:39:53.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f54769bb700 1 Processor -- start 2023-10-08T12:39:53.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f54769bb700 1 -- start start 2023-10-08T12:39:53.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f54769bb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54701008a0 0x7f547019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:53.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f54769bb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5470101260 0x7f547019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:53.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f54769bb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54701057c0 0x7f5470196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f54769bb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54701970e0 con 0x7f5470101260 2023-10-08T12:39:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f54769bb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5470197250 con 0x7f54701008a0 2023-10-08T12:39:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f54769bb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5470197410 con 0x7f54701057c0 2023-10-08T12:39:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f546ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54701008a0 0x7f547019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f546f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5470101260 0x7f547019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f546ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54701008a0 0x7f547019c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53908/0 (socket says 172.21.15.59:53908) 2023-10-08T12:39:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.220+0000 7f546ffff700 1 -- 172.21.15.59:0/279432645 learned_addr learned my addr 172.21.15.59:0/279432645 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.221+0000 7f5474f58700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54701057c0 0x7f5470196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.221+0000 7f546ffff700 1 -- 172.21.15.59:0/279432645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54701057c0 msgr2=0x7f5470196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.221+0000 7f546ffff700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54701057c0 0x7f5470196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.221+0000 7f546ffff700 1 -- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5470101260 msgr2=0x7f547019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.221+0000 7f546ffff700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5470101260 0x7f547019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.221+0000 7f546ffff700 1 -- 172.21.15.59:0/279432645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54640095f0 con 0x7f54701008a0 2023-10-08T12:39:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.221+0000 7f546ffff700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54701008a0 0x7f547019c940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f546000e970 tx=0x7f546000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:53.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.221+0000 7f546d7fa700 1 -- 172.21.15.59:0/279432645 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460009790 con 0x7f54701008a0 2023-10-08T12:39:53.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.222+0000 7f546d7fa700 1 -- 172.21.15.59:0/279432645 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f546000c7e0 con 0x7f54701008a0 2023-10-08T12:39:53.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.222+0000 7f546d7fa700 1 -- 172.21.15.59:0/279432645 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460003c70 con 0x7f54701008a0 2023-10-08T12:39:53.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.222+0000 7f54769bb700 1 -- 172.21.15.59:0/279432645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54701976f0 con 0x7f54701008a0 2023-10-08T12:39:53.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.222+0000 7f54769bb700 1 -- 172.21.15.59:0/279432645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5470072bf0 con 0x7f54701008a0 2023-10-08T12:39:53.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.223+0000 7f54769bb700 1 -- 172.21.15.59:0/279432645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5470110a60 con 0x7f54701008a0 2023-10-08T12:39:53.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.225+0000 7f546d7fa700 1 -- 172.21.15.59:0/279432645 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f546000cc50 con 0x7f54701008a0 2023-10-08T12:39:53.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.227+0000 7f546d7fa700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f54580a15e0 0x7f54580a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:53.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.227+0000 7f546d7fa700 1 -- 172.21.15.59:0/279432645 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f5460014070 con 0x7f54701008a0 2023-10-08T12:39:53.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.227+0000 7f546f7fe700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f54580a15e0 0x7f54580a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:53.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.227+0000 7f546d7fa700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237] conn(0x7f54580aaf50 0x7f54580ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:53.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.227+0000 7f546d7fa700 1 -- 172.21.15.59:0/279432645 --> [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54580ada20 con 0x7f54580aaf50 2023-10-08T12:39:53.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.227+0000 7f546d7fa700 1 -- 172.21.15.59:0/279432645 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54600cd460 con 0x7f54701008a0 2023-10-08T12:39:53.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.228+0000 7f5474f58700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237] conn(0x7f54580aaf50 0x7f54580ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:53.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.228+0000 7f546f7fe700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f54580a15e0 0x7f54580a3aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5470197c40 tx=0x7f5464005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:53.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.228+0000 7f5474f58700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237] conn(0x7f54580aaf50 0x7f54580ad370 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:53.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.229+0000 7f546d7fa700 1 -- 172.21.15.59:0/279432645 <== osd.9 v2:172.21.15.59:6826/3574607237 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f54580ada20 con 0x7f54580aaf50 2023-10-08T12:39:53.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.246+0000 7f54769bb700 1 -- 172.21.15.59:0/279432645 --> [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5470060ef0 con 0x7f54580aaf50 2023-10-08T12:39:53.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.247+0000 7f546d7fa700 1 -- 172.21.15.59:0/279432645 <== osd.9 v2:172.21.15.59:6826/3574607237 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5470060ef0 con 0x7f54580aaf50 2023-10-08T12:39:53.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.247+0000 7f54769bb700 1 -- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237] conn(0x7f54580aaf50 msgr2=0x7f54580ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.247+0000 7f54769bb700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237] conn(0x7f54580aaf50 0x7f54580ad370 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.247+0000 7f54769bb700 1 -- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f54580a15e0 msgr2=0x7f54580a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.247+0000 7f54769bb700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f54580a15e0 0x7f54580a3aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5470197c40 tx=0x7f5464005fd0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.247+0000 7f54769bb700 1 -- 172.21.15.59:0/279432645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54701008a0 msgr2=0x7f547019c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.247+0000 7f54769bb700 1 --2- 172.21.15.59:0/279432645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54701008a0 0x7f547019c940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f546000e970 tx=0x7f546000ec80 comp rx=0 tx=0).stop 2023-10-08T12:39:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.247+0000 7f5474f58700 1 -- 172.21.15.59:0/279432645 reap_dead start 2023-10-08T12:39:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.247+0000 7f54769bb700 1 -- 172.21.15.59:0/279432645 shutdown_connections 2023-10-08T12:39:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.247+0000 7f54769bb700 1 -- 172.21.15.59:0/279432645 >> 172.21.15.59:0/279432645 conn(0x7f54700779e0 msgr2=0x7f54700fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.247+0000 7f54769bb700 1 -- 172.21.15.59:0/279432645 shutdown_connections 2023-10-08T12:39:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.248+0000 7f54769bb700 1 -- 172.21.15.59:0/279432645 wait complete. 2023-10-08T12:39:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.325+0000 7f740144d700 1 -- 172.21.15.59:0/731296298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73fc1057c0 msgr2=0x7f73fc105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.325+0000 7f740144d700 1 --2- 172.21.15.59:0/731296298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73fc1057c0 0x7f73fc105ba0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009990 tx=0x7f73ec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.326+0000 7f740144d700 1 -- 172.21.15.59:0/731296298 shutdown_connections 2023-10-08T12:39:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.326+0000 7f740144d700 1 --2- 172.21.15.59:0/731296298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc101260 0x7f73fc10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.326+0000 7f740144d700 1 --2- 172.21.15.59:0/731296298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73fc1057c0 0x7f73fc105ba0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.326+0000 7f740144d700 1 --2- 172.21.15.59:0/731296298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73fc1008a0 0x7f73fc100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.326+0000 7f740144d700 1 -- 172.21.15.59:0/731296298 >> 172.21.15.59:0/731296298 conn(0x7f73fc0779e0 msgr2=0x7f73fc077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.326+0000 7f740144d700 1 -- 172.21.15.59:0/731296298 shutdown_connections 2023-10-08T12:39:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.326+0000 7f740144d700 1 -- 172.21.15.59:0/731296298 wait complete. 2023-10-08T12:39:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.327+0000 7f740144d700 1 Processor -- start 2023-10-08T12:39:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.327+0000 7f740144d700 1 -- start start 2023-10-08T12:39:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.328+0000 7f740144d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73fc1008a0 0x7f73fc19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.328+0000 7f740144d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc101260 0x7f73fc19cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.328+0000 7f740144d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73fc1057c0 0x7f73fc196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.328+0000 7f740144d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc1971a0 con 0x7f73fc101260 2023-10-08T12:39:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.328+0000 7f740144d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc1972e0 con 0x7f73fc1008a0 2023-10-08T12:39:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.328+0000 7f740144d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc1974a0 con 0x7f73fc1057c0 2023-10-08T12:39:53.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.328+0000 7f73fa7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc101260 0x7f73fc19cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:53.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.328+0000 7f73fa7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc101260 0x7f73fc19cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59626/0 (socket says 172.21.15.59:59626) 2023-10-08T12:39:53.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.328+0000 7f73fa7fc700 1 -- 172.21.15.59:0/246358708 learned_addr learned my addr 172.21.15.59:0/246358708 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:53.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.328+0000 7f73faffd700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73fc1008a0 0x7f73fc19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:53.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.328+0000 7f73fb7fe700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73fc1057c0 0x7f73fc196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:53.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.329+0000 7f73fa7fc700 1 -- 172.21.15.59:0/246358708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73fc1057c0 msgr2=0x7f73fc196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.329+0000 7f73fa7fc700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73fc1057c0 0x7f73fc196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.329+0000 7f73fa7fc700 1 -- 172.21.15.59:0/246358708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73fc1008a0 msgr2=0x7f73fc19c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.329+0000 7f73fa7fc700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73fc1008a0 0x7f73fc19c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.329+0000 7f73fa7fc700 1 -- 172.21.15.59:0/246358708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec0095f0 con 0x7f73fc101260 2023-10-08T12:39:53.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.329+0000 7f73faffd700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73fc1008a0 0x7f73fc19c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.329+0000 7f73fa7fc700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc101260 0x7f73fc19cee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f73f000e9a0 tx=0x7f73f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.329+0000 7f73e3fff700 1 -- 172.21.15.59:0/246358708 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0009790 con 0x7f73fc101260 2023-10-08T12:39:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.329+0000 7f73e3fff700 1 -- 172.21.15.59:0/246358708 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73f0010430 con 0x7f73fc101260 2023-10-08T12:39:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.329+0000 7f740144d700 1 -- 172.21.15.59:0/246358708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73fc197780 con 0x7f73fc101260 2023-10-08T12:39:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.329+0000 7f73e3fff700 1 -- 172.21.15.59:0/246358708 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0018680 con 0x7f73fc101260 2023-10-08T12:39:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.330+0000 7f740144d700 1 -- 172.21.15.59:0/246358708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73fc1a3a40 con 0x7f73fc101260 2023-10-08T12:39:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.330+0000 7f740144d700 1 -- 172.21.15.59:0/246358708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73fc110a20 con 0x7f73fc101260 2023-10-08T12:39:53.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.334+0000 7f73e3fff700 1 -- 172.21.15.59:0/246358708 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f73f00105a0 con 0x7f73fc101260 2023-10-08T12:39:53.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.336+0000 7f73e3fff700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73e40a1560 0x7f73e40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:53.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.336+0000 7f73e3fff700 1 -- 172.21.15.59:0/246358708 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f73f0014070 con 0x7f73fc101260 2023-10-08T12:39:53.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.336+0000 7f73faffd700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73e40a1560 0x7f73e40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:53.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.336+0000 7f73e3fff700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167] conn(0x7f73e40aaed0 0x7f73e40ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:53.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.336+0000 7f73e3fff700 1 -- 172.21.15.59:0/246358708 --> [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73e40ad9a0 con 0x7f73e40aaed0 2023-10-08T12:39:53.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.336+0000 7f73e3fff700 1 -- 172.21.15.59:0/246358708 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73f00cd750 con 0x7f73fc101260 2023-10-08T12:39:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.337+0000 7f73fb7fe700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167] conn(0x7f73e40aaed0 0x7f73e40ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.337+0000 7f73faffd700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73e40a1560 0x7f73e40a3a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00b2e0 tx=0x7f73ec005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.337+0000 7f73fb7fe700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167] conn(0x7f73e40aaed0 0x7f73e40ad2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:53.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.338+0000 7f73e3fff700 1 -- 172.21.15.59:0/246358708 <== osd.1 v2:172.21.15.92:6800/2233119167 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f73e40ad9a0 con 0x7f73e40aaed0 2023-10-08T12:39:53.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.357+0000 7f740144d700 1 -- 172.21.15.59:0/246358708 --> [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f73fc060e70 con 0x7f73e40aaed0 2023-10-08T12:39:53.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.357+0000 7f73e3fff700 1 -- 172.21.15.59:0/246358708 <== osd.1 v2:172.21.15.92:6800/2233119167 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f73fc060e70 con 0x7f73e40aaed0 2023-10-08T12:39:53.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.358+0000 7f740144d700 1 -- 172.21.15.59:0/246358708 >> [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167] conn(0x7f73e40aaed0 msgr2=0x7f73e40ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.358+0000 7f740144d700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167] conn(0x7f73e40aaed0 0x7f73e40ad2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.358+0000 7f740144d700 1 -- 172.21.15.59:0/246358708 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73e40a1560 msgr2=0x7f73e40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.358+0000 7f740144d700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73e40a1560 0x7f73e40a3a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00b2e0 tx=0x7f73ec005fd0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.358+0000 7f740144d700 1 -- 172.21.15.59:0/246358708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc101260 msgr2=0x7f73fc19cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.358+0000 7f740144d700 1 --2- 172.21.15.59:0/246358708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc101260 0x7f73fc19cee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f73f000e9a0 tx=0x7f73f000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:39:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.358+0000 7f73fb7fe700 1 -- 172.21.15.59:0/246358708 reap_dead start 2023-10-08T12:39:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.358+0000 7f740144d700 1 -- 172.21.15.59:0/246358708 shutdown_connections 2023-10-08T12:39:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.358+0000 7f740144d700 1 -- 172.21.15.59:0/246358708 >> 172.21.15.59:0/246358708 conn(0x7f73fc0779e0 msgr2=0x7f73fc0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.358+0000 7f740144d700 1 -- 172.21.15.59:0/246358708 shutdown_connections 2023-10-08T12:39:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:53.358+0000 7f740144d700 1 -- 172.21.15.59:0/246358708 wait complete. 2023-10-08T12:39:53.586 INFO:teuthology.orchestra.run.smithi059.stdout:253403070496 2023-10-08T12:39:53.587 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-08T12:39:53.793 INFO:teuthology.orchestra.run.smithi059.stdout:167503724590 2023-10-08T12:39:53.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-08T12:39:54.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:53 smithi059 ceph-mon[98489]: pgmap v273: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:39:54.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:53 smithi092 ceph-mon[134093]: pgmap v273: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:39:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:53 smithi173 ceph-mon[135182]: pgmap v273: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:39:54.371 INFO:teuthology.orchestra.run.smithi059.stdout:60129542211 2023-10-08T12:39:54.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-08T12:39:54.423 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:54.483 INFO:teuthology.orchestra.run.smithi059.stdout:287762808859 2023-10-08T12:39:54.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-08T12:39:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.564+0000 7f2e36f32700 1 -- 172.21.15.59:0/870078545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e301008a0 msgr2=0x7f2e30100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.564+0000 7f2e36f32700 1 --2- 172.21.15.59:0/870078545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e301008a0 0x7f2e30100d20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009f90 tx=0x7f2e2800b330 comp rx=0 tx=0).stop 2023-10-08T12:39:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.564+0000 7f2e36f32700 1 -- 172.21.15.59:0/870078545 shutdown_connections 2023-10-08T12:39:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.564+0000 7f2e36f32700 1 --2- 172.21.15.59:0/870078545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e30101260 0x7f2e3010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.564+0000 7f2e36f32700 1 --2- 172.21.15.59:0/870078545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e301057c0 0x7f2e30105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.564+0000 7f2e36f32700 1 --2- 172.21.15.59:0/870078545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e301008a0 0x7f2e30100d20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.564+0000 7f2e36f32700 1 -- 172.21.15.59:0/870078545 >> 172.21.15.59:0/870078545 conn(0x7f2e300779e0 msgr2=0x7f2e30077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.565+0000 7f2e36f32700 1 -- 172.21.15.59:0/870078545 shutdown_connections 2023-10-08T12:39:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.565+0000 7f2e36f32700 1 -- 172.21.15.59:0/870078545 wait complete. 2023-10-08T12:39:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.566+0000 7f2e36f32700 1 Processor -- start 2023-10-08T12:39:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.566+0000 7f2e36f32700 1 -- start start 2023-10-08T12:39:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.567+0000 7f2e36f32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e301008a0 0x7f2e3019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.567+0000 7f2e36f32700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e30101260 0x7f2e3019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.567+0000 7f2e36f32700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e301057c0 0x7f2e30196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.567+0000 7f2e36f32700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30197140 con 0x7f2e301008a0 2023-10-08T12:39:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.567+0000 7f2e36f32700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301972b0 con 0x7f2e301057c0 2023-10-08T12:39:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.567+0000 7f2e36f32700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30197470 con 0x7f2e30101260 2023-10-08T12:39:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.568+0000 7f2e34cce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e301008a0 0x7f2e3019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.568+0000 7f2e34cce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e301008a0 0x7f2e3019c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59644/0 (socket says 172.21.15.59:59644) 2023-10-08T12:39:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.568+0000 7f2e34cce700 1 -- 172.21.15.59:0/3332216256 learned_addr learned my addr 172.21.15.59:0/3332216256 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.568+0000 7f2e2ffff700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e30101260 0x7f2e3019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.568+0000 7f2e2ffff700 1 -- 172.21.15.59:0/3332216256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e301057c0 msgr2=0x7f2e30196ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:39:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.568+0000 7f2e2ffff700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e301057c0 0x7f2e30196ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.568+0000 7f2e2ffff700 1 -- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e301008a0 msgr2=0x7f2e3019c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.568+0000 7f2e2ffff700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e301008a0 0x7f2e3019c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.568+0000 7f2e2ffff700 1 -- 172.21.15.59:0/3332216256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e28009c40 con 0x7f2e30101260 2023-10-08T12:39:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.569+0000 7f2e2ffff700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e30101260 0x7f2e3019ce90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009f90 tx=0x7f2e28004d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.569+0000 7f2e2dffb700 1 -- 172.21.15.59:0/3332216256 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800e040 con 0x7f2e30101260 2023-10-08T12:39:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.569+0000 7f2e36f32700 1 -- 172.21.15.59:0/3332216256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e301976f0 con 0x7f2e30101260 2023-10-08T12:39:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.569+0000 7f2e2dffb700 1 -- 172.21.15.59:0/3332216256 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e2800be10 con 0x7f2e30101260 2023-10-08T12:39:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.569+0000 7f2e2dffb700 1 -- 172.21.15.59:0/3332216256 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e280052a0 con 0x7f2e30101260 2023-10-08T12:39:54.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.569+0000 7f2e36f32700 1 -- 172.21.15.59:0/3332216256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e301a3940 con 0x7f2e30101260 2023-10-08T12:39:54.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.570+0000 7f2e36f32700 1 -- 172.21.15.59:0/3332216256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e30110a60 con 0x7f2e30101260 2023-10-08T12:39:54.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.573+0000 7f2e2dffb700 1 -- 172.21.15.59:0/3332216256 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f2e2801d470 con 0x7f2e30101260 2023-10-08T12:39:54.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.576+0000 7f2e2dffb700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2e180a1660 0x7f2e180a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:54.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.576+0000 7f2e2dffb700 1 -- 172.21.15.59:0/3332216256 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f2e280ced70 con 0x7f2e30101260 2023-10-08T12:39:54.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.577+0000 7f2e2dffb700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592] conn(0x7f2e180aafd0 0x7f2e180ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:54.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.577+0000 7f2e2dffb700 1 -- 172.21.15.59:0/3332216256 --> [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e180adaa0 con 0x7f2e180aafd0 2023-10-08T12:39:54.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.577+0000 7f2e2dffb700 1 -- 172.21.15.59:0/3332216256 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e280cf120 con 0x7f2e30101260 2023-10-08T12:39:54.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.577+0000 7f2e34cce700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2e180a1660 0x7f2e180a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:54.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.579+0000 7f2e34cce700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2e180a1660 0x7f2e180a3b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009c10 tx=0x7f2e240094a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:54.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.579+0000 7f2e354cf700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592] conn(0x7f2e180aafd0 0x7f2e180ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:54.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.580+0000 7f2e354cf700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592] conn(0x7f2e180aafd0 0x7f2e180ad3f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:54.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.581+0000 7f2e2dffb700 1 -- 172.21.15.59:0/3332216256 <== osd.3 v2:172.21.15.59:6810/2771486592 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2e180adaa0 con 0x7f2e180aafd0 2023-10-08T12:39:54.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.621+0000 7f2e36f32700 1 -- 172.21.15.59:0/3332216256 --> [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2e30060e70 con 0x7f2e180aafd0 2023-10-08T12:39:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.624+0000 7f2e2dffb700 1 -- 172.21.15.59:0/3332216256 <== osd.3 v2:172.21.15.59:6810/2771486592 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2e30060e70 con 0x7f2e180aafd0 2023-10-08T12:39:54.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.634+0000 7f2e36f32700 1 -- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592] conn(0x7f2e180aafd0 msgr2=0x7f2e180ad3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:54.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.634+0000 7f2e36f32700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592] conn(0x7f2e180aafd0 0x7f2e180ad3f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:54.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.636+0000 7f2e36f32700 1 -- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2e180a1660 msgr2=0x7f2e180a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:54.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.636+0000 7f2e36f32700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2e180a1660 0x7f2e180a3b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009c10 tx=0x7f2e240094a0 comp rx=0 tx=0).stop 2023-10-08T12:39:54.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.636+0000 7f2e36f32700 1 -- 172.21.15.59:0/3332216256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e30101260 msgr2=0x7f2e3019ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:54.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.636+0000 7f2e36f32700 1 --2- 172.21.15.59:0/3332216256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e30101260 0x7f2e3019ce90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009f90 tx=0x7f2e28004d20 comp rx=0 tx=0).stop 2023-10-08T12:39:54.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.638+0000 7f2e354cf700 1 -- 172.21.15.59:0/3332216256 reap_dead start 2023-10-08T12:39:54.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.638+0000 7f2e36f32700 1 -- 172.21.15.59:0/3332216256 shutdown_connections 2023-10-08T12:39:54.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.638+0000 7f2e36f32700 1 -- 172.21.15.59:0/3332216256 >> 172.21.15.59:0/3332216256 conn(0x7f2e300779e0 msgr2=0x7f2e300fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:54.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.638+0000 7f2e36f32700 1 -- 172.21.15.59:0/3332216256 shutdown_connections 2023-10-08T12:39:54.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:54.638+0000 7f2e36f32700 1 -- 172.21.15.59:0/3332216256 wait complete. 2023-10-08T12:39:55.241 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:56.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:55 smithi092 ceph-mon[134093]: pgmap v274: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:39:56.134 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:55 smithi059 ceph-mon[98489]: pgmap v274: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:39:56.181 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:55 smithi173 ceph-mon[135182]: pgmap v274: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:39:56.223 INFO:teuthology.orchestra.run.smithi059.stdout:111669149753 2023-10-08T12:39:56.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-08T12:39:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:57.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.381+0000 7f7562d73700 1 -- 172.21.15.59:0/2163907175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c103360 msgr2=0x7f755c10f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:57.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.381+0000 7f7562d73700 1 --2- 172.21.15.59:0/2163907175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c103360 0x7f755c10f870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f755400b0a0 tx=0x7f755400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.381+0000 7f7562d73700 1 -- 172.21.15.59:0/2163907175 shutdown_connections 2023-10-08T12:39:57.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.381+0000 7f7562d73700 1 --2- 172.21.15.59:0/2163907175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c103360 0x7f755c10f870 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.381+0000 7f7562d73700 1 --2- 172.21.15.59:0/2163907175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f755c1089a0 0x7f755c108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.381+0000 7f7562d73700 1 --2- 172.21.15.59:0/2163907175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755c1029a0 0x7f755c102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.381+0000 7f7562d73700 1 -- 172.21.15.59:0/2163907175 >> 172.21.15.59:0/2163907175 conn(0x7f755c0fe4b0 msgr2=0x7f755c1008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:57.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.381+0000 7f7562d73700 1 -- 172.21.15.59:0/2163907175 shutdown_connections 2023-10-08T12:39:57.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.382+0000 7f7562d73700 1 -- 172.21.15.59:0/2163907175 wait complete. 2023-10-08T12:39:57.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.383+0000 7f7562d73700 1 Processor -- start 2023-10-08T12:39:57.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.383+0000 7f7562d73700 1 -- start start 2023-10-08T12:39:57.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.383+0000 7f7562d73700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755c1029a0 0x7f755c199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:57.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.383+0000 7f7562d73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c103360 0x7f755c199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:57.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.383+0000 7f7562d73700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f755c1089a0 0x7f755c19d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:57.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.383+0000 7f7562d73700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c19df00 con 0x7f755c103360 2023-10-08T12:39:57.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.383+0000 7f7562d73700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c19e070 con 0x7f755c1029a0 2023-10-08T12:39:57.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.383+0000 7f7562d73700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c19e230 con 0x7f755c1089a0 2023-10-08T12:39:57.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.383+0000 7f7560b0f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755c1029a0 0x7f755c199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:57.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.383+0000 7f755bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c103360 0x7f755c199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:57.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f7560b0f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755c1029a0 0x7f755c199000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53970/0 (socket says 172.21.15.59:53970) 2023-10-08T12:39:57.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f7560b0f700 1 -- 172.21.15.59:0/3982209091 learned_addr learned my addr 172.21.15.59:0/3982209091 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:57.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f7561310700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f755c1089a0 0x7f755c19d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:57.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f7560b0f700 1 -- 172.21.15.59:0/3982209091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f755c1089a0 msgr2=0x7f755c19d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:57.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f7560b0f700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f755c1089a0 0x7f755c19d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f7560b0f700 1 -- 172.21.15.59:0/3982209091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c103360 msgr2=0x7f755c199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:57.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f7560b0f700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c103360 0x7f755c199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f7560b0f700 1 -- 172.21.15.59:0/3982209091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7554009d00 con 0x7f755c1029a0 2023-10-08T12:39:57.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f7561310700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f755c1089a0 0x7f755c19d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:57.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f755bfff700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c103360 0x7f755c199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:57.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f7560b0f700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755c1029a0 0x7f755c199000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f755000e9a0 tx=0x7f755000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:57.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.384+0000 7f7559ffb700 1 -- 172.21.15.59:0/3982209091 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7550009790 con 0x7f755c1029a0 2023-10-08T12:39:57.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.385+0000 7f7559ffb700 1 -- 172.21.15.59:0/3982209091 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f755000cbd0 con 0x7f755c1029a0 2023-10-08T12:39:57.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.385+0000 7f7562d73700 1 -- 172.21.15.59:0/3982209091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c19e510 con 0x7f755c1029a0 2023-10-08T12:39:57.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.385+0000 7f7559ffb700 1 -- 172.21.15.59:0/3982209091 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7550018680 con 0x7f755c1029a0 2023-10-08T12:39:57.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.385+0000 7f7562d73700 1 -- 172.21.15.59:0/3982209091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c1a5d70 con 0x7f755c1029a0 2023-10-08T12:39:57.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.386+0000 7f7562d73700 1 -- 172.21.15.59:0/3982209091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c10afa0 con 0x7f755c1029a0 2023-10-08T12:39:57.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.389+0000 7f7559ffb700 1 -- 172.21.15.59:0/3982209091 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f755000cd40 con 0x7f755c1029a0 2023-10-08T12:39:57.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.391+0000 7f7559ffb700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1560 0x7f754c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:57.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.391+0000 7f7559ffb700 1 -- 172.21.15.59:0/3982209091 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f7550014070 con 0x7f755c1029a0 2023-10-08T12:39:57.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.391+0000 7f755bfff700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1560 0x7f754c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:57.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.392+0000 7f755bfff700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1560 0x7f754c0a3a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f755c19a560 tx=0x7f7548009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:57.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.392+0000 7f7559ffb700 1 -- 172.21.15.59:0/3982209091 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f75500966f0 con 0x7f755c1029a0 2023-10-08T12:39:57.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.619+0000 7f7562d73700 1 -- 172.21.15.59:0/3982209091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f755c1040e0 con 0x7f755c1029a0 2023-10-08T12:39:57.632 INFO:teuthology.orchestra.run.smithi059.stdout:339302416406 2023-10-08T12:39:57.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.620+0000 7f7559ffb700 1 -- 172.21.15.59:0/3982209091 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f7550099d10 con 0x7f755c1029a0 2023-10-08T12:39:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.622+0000 7f7562d73700 1 -- 172.21.15.59:0/3982209091 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1560 msgr2=0x7f754c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.622+0000 7f7562d73700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1560 0x7f754c0a3a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f755c19a560 tx=0x7f7548009260 comp rx=0 tx=0).stop 2023-10-08T12:39:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.622+0000 7f7562d73700 1 -- 172.21.15.59:0/3982209091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755c1029a0 msgr2=0x7f755c199000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.622+0000 7f7562d73700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755c1029a0 0x7f755c199000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f755000e9a0 tx=0x7f755000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.622+0000 7f7562d73700 1 -- 172.21.15.59:0/3982209091 shutdown_connections 2023-10-08T12:39:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.622+0000 7f7562d73700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1560 0x7f754c0a3a20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.622+0000 7f7562d73700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755c1029a0 0x7f755c199000 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.622+0000 7f7562d73700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f755c1089a0 0x7f755c19d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.622+0000 7f7562d73700 1 --2- 172.21.15.59:0/3982209091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c103360 0x7f755c199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.622+0000 7f7562d73700 1 -- 172.21.15.59:0/3982209091 >> 172.21.15.59:0/3982209091 conn(0x7f755c0fe4b0 msgr2=0x7f755c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.623+0000 7f7562d73700 1 -- 172.21.15.59:0/3982209091 shutdown_connections 2023-10-08T12:39:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.623+0000 7f7562d73700 1 -- 172.21.15.59:0/3982209091 wait complete. 2023-10-08T12:39:57.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.607+0000 7f860d8dc700 1 -- 172.21.15.59:0/1848862686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8608072f60 msgr2=0x7f86080733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:57.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.607+0000 7f860d8dc700 1 --2- 172.21.15.59:0/1848862686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8608072f60 0x7f86080733e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0098f0 tx=0x7f85fc009c00 comp rx=0 tx=0).stop 2023-10-08T12:39:57.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.607+0000 7f860d8dc700 1 -- 172.21.15.59:0/1848862686 shutdown_connections 2023-10-08T12:39:57.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.607+0000 7f860d8dc700 1 --2- 172.21.15.59:0/1848862686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608111570 0x7f86081139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.607+0000 7f860d8dc700 1 --2- 172.21.15.59:0/1848862686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8608074770 0x7f8608072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.607+0000 7f860d8dc700 1 --2- 172.21.15.59:0/1848862686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8608072f60 0x7f86080733e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.607+0000 7f860d8dc700 1 -- 172.21.15.59:0/1848862686 >> 172.21.15.59:0/1848862686 conn(0x7f86080779e0 msgr2=0x7f8608077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:57.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.607+0000 7f860d8dc700 1 -- 172.21.15.59:0/1848862686 shutdown_connections 2023-10-08T12:39:57.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.608+0000 7f860d8dc700 1 -- 172.21.15.59:0/1848862686 wait complete. 2023-10-08T12:39:57.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.608+0000 7f860d8dc700 1 Processor -- start 2023-10-08T12:39:57.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.609+0000 7f860d8dc700 1 -- start start 2023-10-08T12:39:57.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.609+0000 7f860d8dc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608072f60 0x7f860819d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:57.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.609+0000 7f860d8dc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8608074770 0x7f860819d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:57.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.609+0000 7f860d8dc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8608111570 0x7f86081a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:57.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.609+0000 7f860d8dc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86081a2290 con 0x7f8608111570 2023-10-08T12:39:57.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.609+0000 7f860d8dc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86081a2400 con 0x7f8608074770 2023-10-08T12:39:57.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.609+0000 7f860d8dc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86081a25c0 con 0x7f8608072f60 2023-10-08T12:39:57.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.609+0000 7f86077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8608111570 0x7f86081a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:57.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.609+0000 7f8606ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608072f60 0x7f860819d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:57.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.609+0000 7f8606ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608072f60 0x7f860819d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:43614/0 (socket says 172.21.15.59:43614) 2023-10-08T12:39:57.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.609+0000 7f8606ffd700 1 -- 172.21.15.59:0/82020794 learned_addr learned my addr 172.21.15.59:0/82020794 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:39:57.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.610+0000 7f86067fc700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8608074770 0x7f860819d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:57.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.610+0000 7f8606ffd700 1 -- 172.21.15.59:0/82020794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8608074770 msgr2=0x7f860819d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:57.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.610+0000 7f8606ffd700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8608074770 0x7f860819d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.610+0000 7f8606ffd700 1 -- 172.21.15.59:0/82020794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8608111570 msgr2=0x7f86081a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:57.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.610+0000 7f8606ffd700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8608111570 0x7f86081a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.610+0000 7f8606ffd700 1 -- 172.21.15.59:0/82020794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc009520 con 0x7f8608072f60 2023-10-08T12:39:57.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.610+0000 7f86077fe700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8608111570 0x7f86081a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:57.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.610+0000 7f8606ffd700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608072f60 0x7f860819d390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f85f800e9c0 tx=0x7f85f800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:57.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.611+0000 7f860c8da700 1 -- 172.21.15.59:0/82020794 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8004a30 con 0x7f8608072f60 2023-10-08T12:39:57.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.611+0000 7f860c8da700 1 -- 172.21.15.59:0/82020794 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85f800cc80 con 0x7f8608072f60 2023-10-08T12:39:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.611+0000 7f860d8dc700 1 -- 172.21.15.59:0/82020794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86081a28a0 con 0x7f8608072f60 2023-10-08T12:39:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.611+0000 7f860c8da700 1 -- 172.21.15.59:0/82020794 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80054e0 con 0x7f8608072f60 2023-10-08T12:39:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.611+0000 7f860d8dc700 1 -- 172.21.15.59:0/82020794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86081aa100 con 0x7f8608072f60 2023-10-08T12:39:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.612+0000 7f860d8dc700 1 -- 172.21.15.59:0/82020794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86080740b0 con 0x7f8608072f60 2023-10-08T12:39:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.614+0000 7f860c8da700 1 -- 172.21.15.59:0/82020794 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f85f8004b90 con 0x7f8608072f60 2023-10-08T12:39:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.615+0000 7f860c8da700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f85f00a1560 0x7f85f00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.616+0000 7f860c8da700 1 -- 172.21.15.59:0/82020794 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f85f8014070 con 0x7f8608072f60 2023-10-08T12:39:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.616+0000 7f86067fc700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f85f00a1560 0x7f85f00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.616+0000 7f86067fc700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f85f00a1560 0x7f85f00a3a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009fd0 tx=0x7f85fc019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.618+0000 7f860c8da700 1 -- 172.21.15.59:0/82020794 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f85f8096480 con 0x7f8608072f60 2023-10-08T12:39:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.851+0000 7f860d8dc700 1 -- 172.21.15.59:0/82020794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f860804e4c0 con 0x7f8608072f60 2023-10-08T12:39:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.854+0000 7f860c8da700 1 -- 172.21.15.59:0/82020794 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85f8099aa0 con 0x7f8608072f60 2023-10-08T12:39:57.855 INFO:teuthology.orchestra.run.smithi059.stdout:201863462955 2023-10-08T12:39:57.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 -- 172.21.15.59:0/82020794 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f85f00a1560 msgr2=0x7f85f00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:57.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f85f00a1560 0x7f85f00a3a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009fd0 tx=0x7f85fc019040 comp rx=0 tx=0).stop 2023-10-08T12:39:57.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 -- 172.21.15.59:0/82020794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608072f60 msgr2=0x7f860819d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:57.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608072f60 0x7f860819d390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f85f800e9c0 tx=0x7f85f800ecd0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 -- 172.21.15.59:0/82020794 shutdown_connections 2023-10-08T12:39:57.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f85f00a1560 0x7f85f00a3a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8608111570 0x7f86081a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608072f60 0x7f860819d390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 --2- 172.21.15.59:0/82020794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8608074770 0x7f860819d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:57.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 -- 172.21.15.59:0/82020794 >> 172.21.15.59:0/82020794 conn(0x7f86080779e0 msgr2=0x7f86081101e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:57.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 -- 172.21.15.59:0/82020794 shutdown_connections 2023-10-08T12:39:57.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:39:57.856+0000 7f860d8dc700 1 -- 172.21.15.59:0/82020794 wait complete. 2023-10-08T12:39:58.018 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:39:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:57 smithi092 ceph-mon[134093]: pgmap v275: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:39:58.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:57 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3982209091' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T12:39:58.127 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:57 smithi059 ceph-mon[98489]: pgmap v275: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:39:58.127 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:57 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3982209091' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T12:39:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:57 smithi173 ceph-mon[135182]: pgmap v275: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:39:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:57 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3982209091' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T12:39:59.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:58 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/82020794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T12:39:59.201 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:58 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/82020794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T12:39:59.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:58 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/82020794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T12:39:59.574 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462953 got 201863462955 for osd.6 2023-10-08T12:39:59.574 DEBUG:teuthology.parallel:result is None 2023-10-08T12:39:59.875 INFO:tasks.cephadm.ceph_manager.ceph:need seq 339302416404 got 339302416406 for osd.11 2023-10-08T12:39:59.875 DEBUG:teuthology.parallel:result is None 2023-10-08T12:40:00.125 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:39:59 smithi059 ceph-mon[98489]: pgmap v276: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:00.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:39:59 smithi092 ceph-mon[134093]: pgmap v276: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:39:59 smithi173 ceph-mon[135182]: pgmap v276: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.601+0000 7fa6d7055700 1 -- 172.21.15.59:0/1916505441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d0068b30 msgr2=0x7fa6d010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.601+0000 7fa6d7055700 1 --2- 172.21.15.59:0/1916505441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d0068b30 0x7fa6d010d670 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009990 tx=0x7fa6c8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.601+0000 7fa6d7055700 1 -- 172.21.15.59:0/1916505441 shutdown_connections 2023-10-08T12:40:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.601+0000 7fa6d7055700 1 --2- 172.21.15.59:0/1916505441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d01067a0 0x7fa6d0106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.601+0000 7fa6d7055700 1 --2- 172.21.15.59:0/1916505441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d0068b30 0x7fa6d010d670 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.601+0000 7fa6d7055700 1 --2- 172.21.15.59:0/1916505441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d0068190 0x7fa6d00685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.601+0000 7fa6d7055700 1 -- 172.21.15.59:0/1916505441 >> 172.21.15.59:0/1916505441 conn(0x7fa6d0075790 msgr2=0x7fa6d0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.601+0000 7fa6d7055700 1 -- 172.21.15.59:0/1916505441 shutdown_connections 2023-10-08T12:40:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.601+0000 7fa6d7055700 1 -- 172.21.15.59:0/1916505441 wait complete. 2023-10-08T12:40:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.603+0000 7fa6d7055700 1 Processor -- start 2023-10-08T12:40:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.603+0000 7fa6d7055700 1 -- start start 2023-10-08T12:40:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.604+0000 7fa6d7055700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d0068190 0x7fa6d0107680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.604+0000 7fa6d7055700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d0068b30 0x7fa6d0107bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.604+0000 7fa6d7055700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d01067a0 0x7fa6d0108100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.604+0000 7fa6d7055700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d01a93f0 con 0x7fa6d0068190 2023-10-08T12:40:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.604+0000 7fa6d7055700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d01a9530 con 0x7fa6d01067a0 2023-10-08T12:40:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.604+0000 7fa6d7055700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d01a96f0 con 0x7fa6d0068b30 2023-10-08T12:40:00.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.604+0000 7fa6cffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d0068b30 0x7fa6d0107bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:00.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.604+0000 7fa6cffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d0068b30 0x7fa6d0107bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:43624/0 (socket says 172.21.15.59:43624) 2023-10-08T12:40:00.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.604+0000 7fa6cffff700 1 -- 172.21.15.59:0/1410606277 learned_addr learned my addr 172.21.15.59:0/1410606277 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:00.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.604+0000 7fa6d4df1700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d0068190 0x7fa6d0107680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:00.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.604+0000 7fa6d55f2700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d01067a0 0x7fa6d0108100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:00.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.605+0000 7fa6cffff700 1 -- 172.21.15.59:0/1410606277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d01067a0 msgr2=0x7fa6d0108100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.605+0000 7fa6cffff700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d01067a0 0x7fa6d0108100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.605+0000 7fa6cffff700 1 -- 172.21.15.59:0/1410606277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d0068190 msgr2=0x7fa6d0107680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.605+0000 7fa6cffff700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d0068190 0x7fa6d0107680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.605+0000 7fa6cffff700 1 -- 172.21.15.59:0/1410606277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80095f0 con 0x7fa6d0068b30 2023-10-08T12:40:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.605+0000 7fa6d4df1700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d0068190 0x7fa6d0107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.605+0000 7fa6cffff700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d0068b30 0x7fa6d0107bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00e9a0 tx=0x7fa6bc00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.605+0000 7fa6cdffb700 1 -- 172.21.15.59:0/1410606277 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc009790 con 0x7fa6d0068b30 2023-10-08T12:40:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.605+0000 7fa6d7055700 1 -- 172.21.15.59:0/1410606277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d01a99d0 con 0x7fa6d0068b30 2023-10-08T12:40:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.605+0000 7fa6cdffb700 1 -- 172.21.15.59:0/1410606277 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6bc00cbd0 con 0x7fa6d0068b30 2023-10-08T12:40:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.605+0000 7fa6cdffb700 1 -- 172.21.15.59:0/1410606277 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc018680 con 0x7fa6d0068b30 2023-10-08T12:40:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.606+0000 7fa6d7055700 1 -- 172.21.15.59:0/1410606277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d01a9f20 con 0x7fa6d0068b30 2023-10-08T12:40:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.607+0000 7fa6d7055700 1 -- 172.21.15.59:0/1410606277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d0101ee0 con 0x7fa6d0068b30 2023-10-08T12:40:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.610+0000 7fa6cdffb700 1 -- 172.21.15.59:0/1410606277 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fa6bc010430 con 0x7fa6d0068b30 2023-10-08T12:40:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.612+0000 7fa6cdffb700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6c00a15e0 0x7fa6c00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.612+0000 7fa6cdffb700 1 -- 172.21.15.59:0/1410606277 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fa6bc014070 con 0x7fa6d0068b30 2023-10-08T12:40:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.612+0000 7fa6d4df1700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6c00a15e0 0x7fa6c00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:00.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.613+0000 7fa6d4df1700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6c00a15e0 0x7fa6c00a3aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40093a0 tx=0x7fa6c400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:00.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.613+0000 7fa6cdffb700 1 -- 172.21.15.59:0/1410606277 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa6bc096f10 con 0x7fa6d0068b30 2023-10-08T12:40:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.832+0000 7fa6d7055700 1 -- 172.21.15.59:0/1410606277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa6d0108b10 con 0x7fa6d0068b30 2023-10-08T12:40:00.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.833+0000 7fa6cdffb700 1 -- 172.21.15.59:0/1410606277 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6bc09a530 con 0x7fa6d0068b30 2023-10-08T12:40:00.834 INFO:teuthology.orchestra.run.smithi059.stdout:223338299431 2023-10-08T12:40:00.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 -- 172.21.15.59:0/1410606277 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6c00a15e0 msgr2=0x7fa6c00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:00.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6c00a15e0 0x7fa6c00a3aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40093a0 tx=0x7fa6c400b040 comp rx=0 tx=0).stop 2023-10-08T12:40:00.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 -- 172.21.15.59:0/1410606277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d0068b30 msgr2=0x7fa6d0107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:00.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d0068b30 0x7fa6d0107bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00e9a0 tx=0x7fa6bc00ed60 comp rx=0 tx=0).stop 2023-10-08T12:40:00.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 -- 172.21.15.59:0/1410606277 shutdown_connections 2023-10-08T12:40:00.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6c00a15e0 0x7fa6c00a3aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:00.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d01067a0 0x7fa6d0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:00.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d0068190 0x7fa6d0107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:00.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 --2- 172.21.15.59:0/1410606277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d0068b30 0x7fa6d0107bc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:00.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 -- 172.21.15.59:0/1410606277 >> 172.21.15.59:0/1410606277 conn(0x7fa6d0075790 msgr2=0x7fa6d00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:00.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 -- 172.21.15.59:0/1410606277 shutdown_connections 2023-10-08T12:40:00.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:00.835+0000 7fa6d7055700 1 -- 172.21.15.59:0/1410606277 wait complete. 2023-10-08T12:40:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:00 smithi092 ceph-mon[134093]: overall HEALTH_OK 2023-10-08T12:40:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:00 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1410606277' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T12:40:01.136 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:00 smithi059 ceph-mon[98489]: overall HEALTH_OK 2023-10-08T12:40:01.136 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:00 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1410606277' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T12:40:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:00 smithi173 ceph-mon[135182]: overall HEALTH_OK 2023-10-08T12:40:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:00 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1410606277' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T12:40:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.285+0000 7f62518b6700 1 -- 172.21.15.59:0/1291619918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624c1008a0 msgr2=0x7f624c100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.285+0000 7f62518b6700 1 --2- 172.21.15.59:0/1291619918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624c1008a0 0x7f624c100d20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6240009990 tx=0x7f6240009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.285+0000 7f62518b6700 1 -- 172.21.15.59:0/1291619918 shutdown_connections 2023-10-08T12:40:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.285+0000 7f62518b6700 1 --2- 172.21.15.59:0/1291619918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c101260 0x7f624c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.285+0000 7f62518b6700 1 --2- 172.21.15.59:0/1291619918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f624c1057c0 0x7f624c105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.285+0000 7f62518b6700 1 --2- 172.21.15.59:0/1291619918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624c1008a0 0x7f624c100d20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.285+0000 7f62518b6700 1 -- 172.21.15.59:0/1291619918 >> 172.21.15.59:0/1291619918 conn(0x7f624c0779e0 msgr2=0x7f624c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.285+0000 7f62518b6700 1 -- 172.21.15.59:0/1291619918 shutdown_connections 2023-10-08T12:40:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.285+0000 7f62518b6700 1 -- 172.21.15.59:0/1291619918 wait complete. 2023-10-08T12:40:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.287+0000 7f62518b6700 1 Processor -- start 2023-10-08T12:40:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.287+0000 7f62518b6700 1 -- start start 2023-10-08T12:40:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.288+0000 7f62518b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624c1008a0 0x7f624c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.288+0000 7f62518b6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f624c101260 0x7f624c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.288+0000 7f62518b6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c1057c0 0x7f624c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.288+0000 7f62518b6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1a4f90 con 0x7f624c1008a0 2023-10-08T12:40:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.288+0000 7f62518b6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1a5100 con 0x7f624c1057c0 2023-10-08T12:40:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.288+0000 7f62518b6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1a52c0 con 0x7f624c101260 2023-10-08T12:40:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.288+0000 7f624affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624c1008a0 0x7f624c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.288+0000 7f624affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624c1008a0 0x7f624c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50552/0 (socket says 172.21.15.59:50552) 2023-10-08T12:40:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.288+0000 7f624affd700 1 -- 172.21.15.59:0/2109374100 learned_addr learned my addr 172.21.15.59:0/2109374100 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.288+0000 7f624a7fc700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f624c101260 0x7f624c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.288+0000 7f624b7fe700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c1057c0 0x7f624c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f624affd700 1 -- 172.21.15.59:0/2109374100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f624c101260 msgr2=0x7f624c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f624affd700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f624c101260 0x7f624c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f624affd700 1 -- 172.21.15.59:0/2109374100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c1057c0 msgr2=0x7f624c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f624affd700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c1057c0 0x7f624c073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f624affd700 1 -- 172.21.15.59:0/2109374100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400095f0 con 0x7f624c1008a0 2023-10-08T12:40:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f624b7fe700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c1057c0 0x7f624c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:40:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f624affd700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624c1008a0 0x7f624c072af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f623c00e970 tx=0x7f623c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f62508b4700 1 -- 172.21.15.59:0/2109374100 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c009790 con 0x7f624c1008a0 2023-10-08T12:40:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f62508b4700 1 -- 172.21.15.59:0/2109374100 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f623c00eec0 con 0x7f624c1008a0 2023-10-08T12:40:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f62518b6700 1 -- 172.21.15.59:0/2109374100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c1a55a0 con 0x7f624c1008a0 2023-10-08T12:40:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f62518b6700 1 -- 172.21.15.59:0/2109374100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c1a5aa0 con 0x7f624c1008a0 2023-10-08T12:40:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.289+0000 7f62508b4700 1 -- 172.21.15.59:0/2109374100 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c003cf0 con 0x7f624c1008a0 2023-10-08T12:40:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.291+0000 7f62518b6700 1 -- 172.21.15.59:0/2109374100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6238005320 con 0x7f624c1008a0 2023-10-08T12:40:01.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.293+0000 7f62508b4700 1 -- 172.21.15.59:0/2109374100 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f623c00ccd0 con 0x7f624c1008a0 2023-10-08T12:40:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.295+0000 7f62508b4700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f62340a1560 0x7f62340a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.295+0000 7f62508b4700 1 -- 172.21.15.59:0/2109374100 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f623c014070 con 0x7f624c1008a0 2023-10-08T12:40:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.295+0000 7f624a7fc700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f62340a1560 0x7f62340a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.296+0000 7f624a7fc700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f62340a1560 0x7f62340a3a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f624c0741d0 tx=0x7f6240005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.301+0000 7f62508b4700 1 -- 172.21.15.59:0/2109374100 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f623c096560 con 0x7f624c1008a0 2023-10-08T12:40:01.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.210+0000 7f3959c01700 1 -- 172.21.15.59:0/953401821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3954103250 msgr2=0x7f3954103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.210+0000 7f3959c01700 1 --2- 172.21.15.59:0/953401821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3954103250 0x7f3954103700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f394c00b0a0 tx=0x7f394c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.210+0000 7f3959c01700 1 -- 172.21.15.59:0/953401821 shutdown_connections 2023-10-08T12:40:01.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.210+0000 7f3959c01700 1 --2- 172.21.15.59:0/953401821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3954103250 0x7f3954103700 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.210+0000 7f3959c01700 1 --2- 172.21.15.59:0/953401821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39541056f0 0x7f3954068190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.210+0000 7f3959c01700 1 --2- 172.21.15.59:0/953401821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39540686d0 0x7f3954068b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.210+0000 7f3959c01700 1 -- 172.21.15.59:0/953401821 >> 172.21.15.59:0/953401821 conn(0x7f3954075790 msgr2=0x7f3954075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:01.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.210+0000 7f3959c01700 1 -- 172.21.15.59:0/953401821 shutdown_connections 2023-10-08T12:40:01.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.210+0000 7f3959c01700 1 -- 172.21.15.59:0/953401821 wait complete. 2023-10-08T12:40:01.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.211+0000 7f3959c01700 1 Processor -- start 2023-10-08T12:40:01.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.211+0000 7f3959c01700 1 -- start start 2023-10-08T12:40:01.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f3959c01700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39540686d0 0x7f395419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f3959c01700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3954103250 0x7f395419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f3959c01700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39541056f0 0x7f39541a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f3959c01700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39541a20c0 con 0x7f39540686d0 2023-10-08T12:40:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f3959c01700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39541a2230 con 0x7f39541056f0 2023-10-08T12:40:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f3959c01700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39541a23f0 con 0x7f3954103250 2023-10-08T12:40:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f39537fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39540686d0 0x7f395419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f39537fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39540686d0 0x7f395419d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50532/0 (socket says 172.21.15.59:50532) 2023-10-08T12:40:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f39537fe700 1 -- 172.21.15.59:0/982391857 learned_addr learned my addr 172.21.15.59:0/982391857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f39537fe700 1 -- 172.21.15.59:0/982391857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3954103250 msgr2=0x7f395419d700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:40:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f39537fe700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3954103250 0x7f395419d700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f39537fe700 1 -- 172.21.15.59:0/982391857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39541056f0 msgr2=0x7f39541a1ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:40:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.212+0000 7f39537fe700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39541056f0 0x7f39541a1ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.213+0000 7f39537fe700 1 -- 172.21.15.59:0/982391857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c009d00 con 0x7f39540686d0 2023-10-08T12:40:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.213+0000 7f39537fe700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39540686d0 0x7f395419d1c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f394400e9a0 tx=0x7f394400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.213+0000 7f3950ff9700 1 -- 172.21.15.59:0/982391857 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944009790 con 0x7f39540686d0 2023-10-08T12:40:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.213+0000 7f3950ff9700 1 -- 172.21.15.59:0/982391857 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f394400cbd0 con 0x7f39540686d0 2023-10-08T12:40:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.213+0000 7f3950ff9700 1 -- 172.21.15.59:0/982391857 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944018680 con 0x7f39540686d0 2023-10-08T12:40:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.214+0000 7f3959c01700 1 -- 172.21.15.59:0/982391857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39541a26d0 con 0x7f39540686d0 2023-10-08T12:40:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.214+0000 7f3959c01700 1 -- 172.21.15.59:0/982391857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39541a9f30 con 0x7f39540686d0 2023-10-08T12:40:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.216+0000 7f3959c01700 1 -- 172.21.15.59:0/982391857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39540ffd30 con 0x7f39540686d0 2023-10-08T12:40:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.219+0000 7f3950ff9700 1 -- 172.21.15.59:0/982391857 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f394400cd40 con 0x7f39540686d0 2023-10-08T12:40:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.221+0000 7f3950ff9700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f393c0a16b0 0x7f393c0a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.221+0000 7f3950ff9700 1 -- 172.21.15.59:0/982391857 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f3944014070 con 0x7f39540686d0 2023-10-08T12:40:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.221+0000 7f3952ffd700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f393c0a16b0 0x7f393c0a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.223+0000 7f3952ffd700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f393c0a16b0 0x7f393c0a3b70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f395419e720 tx=0x7f3948006c60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.227+0000 7f3950ff9700 1 -- 172.21.15.59:0/982391857 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3944097060 con 0x7f39540686d0 2023-10-08T12:40:01.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.470+0000 7f3959c01700 1 -- 172.21.15.59:0/982391857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f395404e4c0 con 0x7f39540686d0 2023-10-08T12:40:01.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.471+0000 7f3950ff9700 1 -- 172.21.15.59:0/982391857 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f394409a680 con 0x7f39540686d0 2023-10-08T12:40:01.473 INFO:teuthology.orchestra.run.smithi059.stdout:38654705735 2023-10-08T12:40:01.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.473+0000 7f3959c01700 1 -- 172.21.15.59:0/982391857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f393c0a16b0 msgr2=0x7f393c0a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.473+0000 7f3959c01700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f393c0a16b0 0x7f393c0a3b70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f395419e720 tx=0x7f3948006c60 comp rx=0 tx=0).stop 2023-10-08T12:40:01.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.473+0000 7f3959c01700 1 -- 172.21.15.59:0/982391857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39540686d0 msgr2=0x7f395419d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.473+0000 7f3959c01700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39540686d0 0x7f395419d1c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f394400e9a0 tx=0x7f394400ed60 comp rx=0 tx=0).stop 2023-10-08T12:40:01.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.473+0000 7f3959c01700 1 -- 172.21.15.59:0/982391857 shutdown_connections 2023-10-08T12:40:01.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.473+0000 7f3959c01700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f393c0a16b0 0x7f393c0a3b70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.473+0000 7f3959c01700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39541056f0 0x7f39541a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.473+0000 7f3959c01700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39540686d0 0x7f395419d1c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.473+0000 7f3959c01700 1 --2- 172.21.15.59:0/982391857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3954103250 0x7f395419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.473+0000 7f3959c01700 1 -- 172.21.15.59:0/982391857 >> 172.21.15.59:0/982391857 conn(0x7f3954075790 msgr2=0x7f3954102230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:01.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.474+0000 7f3959c01700 1 -- 172.21.15.59:0/982391857 shutdown_connections 2023-10-08T12:40:01.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.474+0000 7f3959c01700 1 -- 172.21.15.59:0/982391857 wait complete. 2023-10-08T12:40:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.496+0000 7fe25e2f9700 1 -- 172.21.15.59:0/1372411263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe25810ef90 msgr2=0x7fe2581077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.496+0000 7fe25e2f9700 1 --2- 172.21.15.59:0/1372411263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe25810ef90 0x7fe2581077f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe2480099c0 tx=0x7fe248009cd0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.496+0000 7fe25e2f9700 1 -- 172.21.15.59:0/1372411263 shutdown_connections 2023-10-08T12:40:01.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.496+0000 7fe25e2f9700 1 --2- 172.21.15.59:0/1372411263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe258119fd0 0x7fe25811c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.496+0000 7fe25e2f9700 1 --2- 172.21.15.59:0/1372411263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe25810ef90 0x7fe2581077f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.496+0000 7fe25e2f9700 1 --2- 172.21.15.59:0/1372411263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe258107d30 0x7fe2581081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.496+0000 7fe25e2f9700 1 -- 172.21.15.59:0/1372411263 >> 172.21.15.59:0/1372411263 conn(0x7fe25806b8c0 msgr2=0x7fe25806bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.496+0000 7fe25e2f9700 1 -- 172.21.15.59:0/1372411263 shutdown_connections 2023-10-08T12:40:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.496+0000 7fe25e2f9700 1 -- 172.21.15.59:0/1372411263 wait complete. 2023-10-08T12:40:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.498+0000 7fe25e2f9700 1 Processor -- start 2023-10-08T12:40:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.499+0000 7fe25e2f9700 1 -- start start 2023-10-08T12:40:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.499+0000 7fe25e2f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe258107d30 0x7fe2581ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.499+0000 7fe25e2f9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25810ef90 0x7fe2581abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.499+0000 7fe25e2f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe258119fd0 0x7fe2581a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.499+0000 7fe25e2f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2581a5f20 con 0x7fe258107d30 2023-10-08T12:40:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.499+0000 7fe25e2f9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2581a6090 con 0x7fe258119fd0 2023-10-08T12:40:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.499+0000 7fe25e2f9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2581a6250 con 0x7fe25810ef90 2023-10-08T12:40:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.500+0000 7fe2577fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25810ef90 0x7fe2581abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.500+0000 7fe25c896700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe258119fd0 0x7fe2581a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.500+0000 7fe25c896700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe258119fd0 0x7fe2581a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45942/0 (socket says 172.21.15.59:45942) 2023-10-08T12:40:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.500+0000 7fe25c896700 1 -- 172.21.15.59:0/2114697963 learned_addr learned my addr 172.21.15.59:0/2114697963 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.500+0000 7fe25c896700 1 -- 172.21.15.59:0/2114697963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25810ef90 msgr2=0x7fe2581abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.500+0000 7fe25c896700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25810ef90 0x7fe2581abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.500+0000 7fe25c896700 1 -- 172.21.15.59:0/2114697963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe258107d30 msgr2=0x7fe2581ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.500+0000 7fe25c896700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe258107d30 0x7fe2581ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.500+0000 7fe25c896700 1 -- 172.21.15.59:0/2114697963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2480095f0 con 0x7fe258119fd0 2023-10-08T12:40:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.501+0000 7fe25c896700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe258119fd0 0x7fe2581a58c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe25000ef90 tx=0x7fe25000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.501+0000 7fe2557fa700 1 -- 172.21.15.59:0/2114697963 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250018070 con 0x7fe258119fd0 2023-10-08T12:40:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.501+0000 7fe2557fa700 1 -- 172.21.15.59:0/2114697963 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe25000f040 con 0x7fe258119fd0 2023-10-08T12:40:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.501+0000 7fe25e2f9700 1 -- 172.21.15.59:0/2114697963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2581a64d0 con 0x7fe258119fd0 2023-10-08T12:40:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.501+0000 7fe2557fa700 1 -- 172.21.15.59:0/2114697963 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250003e00 con 0x7fe258119fd0 2023-10-08T12:40:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.501+0000 7fe25e2f9700 1 -- 172.21.15.59:0/2114697963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2581b2770 con 0x7fe258119fd0 2023-10-08T12:40:01.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.502+0000 7fe25e2f9700 1 -- 172.21.15.59:0/2114697963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25806ce90 con 0x7fe258119fd0 2023-10-08T12:40:01.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.505+0000 7fe2557fa700 1 -- 172.21.15.59:0/2114697963 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fe25000ca50 con 0x7fe258119fd0 2023-10-08T12:40:01.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.506+0000 7fe2557fa700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2400a15e0 0x7fe2400a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:01.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.506+0000 7fe2557fa700 1 -- 172.21.15.59:0/2114697963 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fe2500ccbc0 con 0x7fe258119fd0 2023-10-08T12:40:01.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.506+0000 7fe257fff700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2400a15e0 0x7fe2400a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:01.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.507+0000 7fe257fff700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2400a15e0 0x7fe2400a3aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe2480058e0 tx=0x7fe248000bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:01.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.508+0000 7fe2557fa700 1 -- 172.21.15.59:0/2114697963 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe250096170 con 0x7fe258119fd0 2023-10-08T12:40:01.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.547+0000 7f62518b6700 1 -- 172.21.15.59:0/2109374100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f6238005190 con 0x7f624c1008a0 2023-10-08T12:40:01.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.547+0000 7f62508b4700 1 -- 172.21.15.59:0/2109374100 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f623c099b80 con 0x7f624c1008a0 2023-10-08T12:40:01.552 INFO:teuthology.orchestra.run.smithi059.stdout:309237645338 2023-10-08T12:40:01.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 -- 172.21.15.59:0/2109374100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f62340a1560 msgr2=0x7f62340a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f62340a1560 0x7f62340a3a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f624c0741d0 tx=0x7f6240005fd0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 -- 172.21.15.59:0/2109374100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624c1008a0 msgr2=0x7f624c072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624c1008a0 0x7f624c072af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f623c00e970 tx=0x7f623c00ec80 comp rx=0 tx=0).stop 2023-10-08T12:40:01.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 -- 172.21.15.59:0/2109374100 shutdown_connections 2023-10-08T12:40:01.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f62340a1560 0x7f62340a3a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c1057c0 0x7f624c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624c1008a0 0x7f624c072af0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 --2- 172.21.15.59:0/2109374100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f624c101260 0x7f624c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 -- 172.21.15.59:0/2109374100 >> 172.21.15.59:0/2109374100 conn(0x7f624c0779e0 msgr2=0x7f624c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 -- 172.21.15.59:0/2109374100 shutdown_connections 2023-10-08T12:40:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.550+0000 7f62518b6700 1 -- 172.21.15.59:0/2109374100 wait complete. 2023-10-08T12:40:01.770 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299430 got 223338299431 for osd.7 2023-10-08T12:40:01.770 DEBUG:teuthology.parallel:result is None 2023-10-08T12:40:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.769+0000 7fe25e2f9700 1 -- 172.21.15.59:0/2114697963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe25804e4c0 con 0x7fe258119fd0 2023-10-08T12:40:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.770+0000 7fe2557fa700 1 -- 172.21.15.59:0/2114697963 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe250099790 con 0x7fe258119fd0 2023-10-08T12:40:01.773 INFO:teuthology.orchestra.run.smithi059.stdout:146028888118 2023-10-08T12:40:01.773 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.773+0000 7fe25e2f9700 1 -- 172.21.15.59:0/2114697963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2400a15e0 msgr2=0x7fe2400a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.773+0000 7fe25e2f9700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2400a15e0 0x7fe2400a3aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe2480058e0 tx=0x7fe248000bc0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.773+0000 7fe25e2f9700 1 -- 172.21.15.59:0/2114697963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe258119fd0 msgr2=0x7fe2581a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.773+0000 7fe25e2f9700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe258119fd0 0x7fe2581a58c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe25000ef90 tx=0x7fe25000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.773+0000 7fe25e2f9700 1 -- 172.21.15.59:0/2114697963 shutdown_connections 2023-10-08T12:40:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.773+0000 7fe25e2f9700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2400a15e0 0x7fe2400a3aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.773+0000 7fe25e2f9700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe258119fd0 0x7fe2581a58c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.773+0000 7fe25e2f9700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe258107d30 0x7fe2581ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.773+0000 7fe25e2f9700 1 --2- 172.21.15.59:0/2114697963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25810ef90 0x7fe2581abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.773+0000 7fe25e2f9700 1 -- 172.21.15.59:0/2114697963 >> 172.21.15.59:0/2114697963 conn(0x7fe25806b8c0 msgr2=0x7fe258117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.774+0000 7fe25e2f9700 1 -- 172.21.15.59:0/2114697963 shutdown_connections 2023-10-08T12:40:01.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:01.774+0000 7fe25e2f9700 1 -- 172.21.15.59:0/2114697963 wait complete. 2023-10-08T12:40:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:01 smithi092 ceph-mon[134093]: pgmap v277: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:01 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/982391857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T12:40:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:01 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2109374100' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T12:40:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:01 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2114697963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T12:40:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:02.192 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:01 smithi059 ceph-mon[98489]: pgmap v277: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:02.192 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:01 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/982391857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T12:40:02.192 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:01 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2109374100' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T12:40:02.192 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:01 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2114697963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T12:40:02.195 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705732 got 38654705735 for osd.0 2023-10-08T12:40:02.195 DEBUG:teuthology.parallel:result is None 2023-10-08T12:40:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:01 smithi173 ceph-mon[135182]: pgmap v277: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:01 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/982391857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T12:40:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:01 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2109374100' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T12:40:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:01 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2114697963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T12:40:02.834 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:02.869 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645335 got 309237645338 for osd.10 2023-10-08T12:40:02.870 DEBUG:teuthology.parallel:result is None 2023-10-08T12:40:02.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.958+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/3944241859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e241008a0 msgr2=0x7f7e24100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:02.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.958+0000 7f7e2ae4a700 1 --2- 172.21.15.59:0/3944241859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e241008a0 0x7f7e24100d20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009990 tx=0x7f7e10009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:02.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.959+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/3944241859 shutdown_connections 2023-10-08T12:40:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.959+0000 7f7e2ae4a700 1 --2- 172.21.15.59:0/3944241859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e24101260 0x7f7e2410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.959+0000 7f7e2ae4a700 1 --2- 172.21.15.59:0/3944241859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e241057c0 0x7f7e24105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.959+0000 7f7e2ae4a700 1 --2- 172.21.15.59:0/3944241859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e241008a0 0x7f7e24100d20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.959+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/3944241859 >> 172.21.15.59:0/3944241859 conn(0x7f7e240779e0 msgr2=0x7f7e24077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.959+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/3944241859 shutdown_connections 2023-10-08T12:40:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.959+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/3944241859 wait complete. 2023-10-08T12:40:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.961+0000 7f7e2ae4a700 1 Processor -- start 2023-10-08T12:40:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.961+0000 7f7e2ae4a700 1 -- start start 2023-10-08T12:40:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.961+0000 7f7e2ae4a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e241008a0 0x7f7e24198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.961+0000 7f7e2ae4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24101260 0x7f7e24199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.961+0000 7f7e2ae4a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e2419d880 0x7f7e2419dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.961+0000 7f7e2ae4a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2419e270 con 0x7f7e24101260 2023-10-08T12:40:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.961+0000 7f7e2ae4a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2419e3e0 con 0x7f7e2419d880 2023-10-08T12:40:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.961+0000 7f7e2ae4a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2419e5a0 con 0x7f7e241008a0 2023-10-08T12:40:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.962+0000 7f7e23fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24101260 0x7f7e24199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.962+0000 7f7e23fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24101260 0x7f7e24199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50592/0 (socket says 172.21.15.59:50592) 2023-10-08T12:40:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.962+0000 7f7e23fff700 1 -- 172.21.15.59:0/2900717798 learned_addr learned my addr 172.21.15.59:0/2900717798 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.962+0000 7f7e23fff700 1 -- 172.21.15.59:0/2900717798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e241008a0 msgr2=0x7f7e24198fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:40:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.962+0000 7f7e23fff700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e241008a0 0x7f7e24198fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.962+0000 7f7e23fff700 1 -- 172.21.15.59:0/2900717798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e2419d880 msgr2=0x7f7e2419dd00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:40:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.962+0000 7f7e23fff700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e2419d880 0x7f7e2419dd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.962+0000 7f7e23fff700 1 -- 172.21.15.59:0/2900717798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100095f0 con 0x7f7e24101260 2023-10-08T12:40:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.962+0000 7f7e23fff700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24101260 0x7f7e24199520 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7e10005740 tx=0x7f7e10005ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.963+0000 7f7e21ffb700 1 -- 172.21.15.59:0/2900717798 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1001d070 con 0x7f7e24101260 2023-10-08T12:40:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.963+0000 7f7e21ffb700 1 -- 172.21.15.59:0/2900717798 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e10022470 con 0x7f7e24101260 2023-10-08T12:40:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.963+0000 7f7e21ffb700 1 -- 172.21.15.59:0/2900717798 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10017650 con 0x7f7e24101260 2023-10-08T12:40:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.963+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/2900717798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e241a5b30 con 0x7f7e24101260 2023-10-08T12:40:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.963+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/2900717798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e241a5ef0 con 0x7f7e24101260 2023-10-08T12:40:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.965+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/2900717798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e24101f30 con 0x7f7e24101260 2023-10-08T12:40:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.967+0000 7f7e21ffb700 1 -- 172.21.15.59:0/2900717798 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f7e1000fb00 con 0x7f7e24101260 2023-10-08T12:40:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.969+0000 7f7e21ffb700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e140a15e0 0x7f7e140a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.969+0000 7f7e21ffb700 1 -- 172.21.15.59:0/2900717798 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f7e100ce310 con 0x7f7e24101260 2023-10-08T12:40:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.970+0000 7f7e28be6700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e140a15e0 0x7f7e140a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.971+0000 7f7e28be6700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e140a15e0 0x7f7e140a3aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e18005950 tx=0x7f7e180058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:02.972+0000 7f7e21ffb700 1 -- 172.21.15.59:0/2900717798 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7e10097860 con 0x7f7e24101260 2023-10-08T12:40:03.112 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888115 got 146028888118 for osd.4 2023-10-08T12:40:03.113 DEBUG:teuthology.parallel:result is None 2023-10-08T12:40:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:03.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.253+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/2900717798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7e24110870 con 0x7f7e24101260 2023-10-08T12:40:03.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.253+0000 7f7e21ffb700 1 -- 172.21.15.59:0/2900717798 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e1009ae80 con 0x7f7e24101260 2023-10-08T12:40:03.254 INFO:teuthology.orchestra.run.smithi059.stdout:167503724593 2023-10-08T12:40:03.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/2900717798 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e140a15e0 msgr2=0x7f7e140a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:03.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e140a15e0 0x7f7e140a3aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e18005950 tx=0x7f7e180058e0 comp rx=0 tx=0).stop 2023-10-08T12:40:03.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/2900717798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24101260 msgr2=0x7f7e24199520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:03.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24101260 0x7f7e24199520 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7e10005740 tx=0x7f7e10005ea0 comp rx=0 tx=0).stop 2023-10-08T12:40:03.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/2900717798 shutdown_connections 2023-10-08T12:40:03.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e140a15e0 0x7f7e140a3aa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:03.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e2419d880 0x7f7e2419dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:03.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e241008a0 0x7f7e24198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:03.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 --2- 172.21.15.59:0/2900717798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24101260 0x7f7e24199520 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:03.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/2900717798 >> 172.21.15.59:0/2900717798 conn(0x7f7e240779e0 msgr2=0x7f7e240fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:03.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/2900717798 shutdown_connections 2023-10-08T12:40:03.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.256+0000 7f7e2ae4a700 1 -- 172.21.15.59:0/2900717798 wait complete. 2023-10-08T12:40:03.919 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:03 smithi059 ceph-mon[98489]: pgmap v278: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:03.919 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:03 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2900717798' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T12:40:03.919 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:03 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3190715463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T12:40:04.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.576+0000 7f98a0576700 1 -- 172.21.15.59:0/3155860571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98981057c0 msgr2=0x7f9898105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:04.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.576+0000 7f98a0576700 1 --2- 172.21.15.59:0/3155860571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98981057c0 0x7f9898105ba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9894009990 tx=0x7f9894009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:04.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.576+0000 7f98a0576700 1 -- 172.21.15.59:0/3155860571 shutdown_connections 2023-10-08T12:40:04.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.576+0000 7f98a0576700 1 --2- 172.21.15.59:0/3155860571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9898101260 0x7f989810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:04.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.576+0000 7f98a0576700 1 --2- 172.21.15.59:0/3155860571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98981057c0 0x7f9898105ba0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:04.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.576+0000 7f98a0576700 1 --2- 172.21.15.59:0/3155860571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981008a0 0x7f9898100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:04.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.576+0000 7f98a0576700 1 -- 172.21.15.59:0/3155860571 >> 172.21.15.59:0/3155860571 conn(0x7f98980779e0 msgr2=0x7f9898077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:04.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.576+0000 7f98a0576700 1 -- 172.21.15.59:0/3155860571 shutdown_connections 2023-10-08T12:40:04.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.576+0000 7f98a0576700 1 -- 172.21.15.59:0/3155860571 wait complete. 2023-10-08T12:40:04.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.577+0000 7f98a0576700 1 Processor -- start 2023-10-08T12:40:04.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.578+0000 7f98a0576700 1 -- start start 2023-10-08T12:40:04.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.578+0000 7f98a0576700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98981008a0 0x7f9898198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:04.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.578+0000 7f98a0576700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9898101260 0x7f9898199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:04.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.578+0000 7f98a0576700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981057c0 0x7f989819d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:04.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.578+0000 7f98a0576700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989819de00 con 0x7f98981008a0 2023-10-08T12:40:04.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.578+0000 7f98a0576700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989819df70 con 0x7f9898101260 2023-10-08T12:40:04.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.578+0000 7f98a0576700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989819e130 con 0x7f98981057c0 2023-10-08T12:40:04.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f989e312700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98981008a0 0x7f9898198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:04.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f989e312700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98981008a0 0x7f9898198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50618/0 (socket says 172.21.15.59:50618) 2023-10-08T12:40:04.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f989e312700 1 -- 172.21.15.59:0/3190715463 learned_addr learned my addr 172.21.15.59:0/3190715463 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:04.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f989db11700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9898101260 0x7f9898199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:04.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f989eb13700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981057c0 0x7f989819d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:04.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f989e312700 1 -- 172.21.15.59:0/3190715463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981057c0 msgr2=0x7f989819d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:04.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f989e312700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981057c0 0x7f989819d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f989e312700 1 -- 172.21.15.59:0/3190715463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9898101260 msgr2=0x7f9898199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f989e312700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9898101260 0x7f9898199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f989e312700 1 -- 172.21.15.59:0/3190715463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98940095f0 con 0x7f98981008a0 2023-10-08T12:40:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f989e312700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98981008a0 0x7f9898198f00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9894000c00 tx=0x7f9894004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f988f7fe700 1 -- 172.21.15.59:0/3190715463 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989401d070 con 0x7f98981008a0 2023-10-08T12:40:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f988f7fe700 1 -- 172.21.15.59:0/3190715463 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9894021410 con 0x7f98981008a0 2023-10-08T12:40:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.579+0000 7f98a0576700 1 -- 172.21.15.59:0/3190715463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989819e3b0 con 0x7f98981008a0 2023-10-08T12:40:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.580+0000 7f988f7fe700 1 -- 172.21.15.59:0/3190715463 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894017650 con 0x7f98981008a0 2023-10-08T12:40:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.580+0000 7f98a0576700 1 -- 172.21.15.59:0/3190715463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98981a5c70 con 0x7f98981008a0 2023-10-08T12:40:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.581+0000 7f98a0576700 1 -- 172.21.15.59:0/3190715463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9898101f30 con 0x7f98981008a0 2023-10-08T12:40:04.033 INFO:teuthology.orchestra.run.smithi059.stdout:81604378688 2023-10-08T12:40:04.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.583+0000 7f988f7fe700 1 -- 172.21.15.59:0/3190715463 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f9894021580 con 0x7f98981008a0 2023-10-08T12:40:04.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.584+0000 7f988f7fe700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98840a1560 0x7f98840a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:04.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.584+0000 7f988f7fe700 1 -- 172.21.15.59:0/3190715463 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f98940ce1b0 con 0x7f98981008a0 2023-10-08T12:40:04.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.584+0000 7f989db11700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98840a1560 0x7f98840a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:04.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.585+0000 7f989db11700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98840a1560 0x7f98840a3a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f989819a460 tx=0x7f9888009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:04.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.588+0000 7f988f7fe700 1 -- 172.21.15.59:0/3190715463 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9894097700 con 0x7f98981008a0 2023-10-08T12:40:04.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.823+0000 7f98a0576700 1 -- 172.21.15.59:0/3190715463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f989819a210 con 0x7f98981008a0 2023-10-08T12:40:04.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.823+0000 7f988f7fe700 1 -- 172.21.15.59:0/3190715463 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f989409ad20 con 0x7f98981008a0 2023-10-08T12:40:04.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 -- 172.21.15.59:0/3190715463 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98840a1560 msgr2=0x7f98840a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:04.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98840a1560 0x7f98840a3a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f989819a460 tx=0x7f9888009260 comp rx=0 tx=0).stop 2023-10-08T12:40:04.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 -- 172.21.15.59:0/3190715463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98981008a0 msgr2=0x7f9898198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:04.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98981008a0 0x7f9898198f00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9894000c00 tx=0x7f9894004730 comp rx=0 tx=0).stop 2023-10-08T12:40:04.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 -- 172.21.15.59:0/3190715463 shutdown_connections 2023-10-08T12:40:04.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98840a1560 0x7f98840a3a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:04.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981057c0 0x7f989819d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:04.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98981008a0 0x7f9898198f00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:04.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 --2- 172.21.15.59:0/3190715463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9898101260 0x7f9898199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:04.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 -- 172.21.15.59:0/3190715463 >> 172.21.15.59:0/3190715463 conn(0x7f98980779e0 msgr2=0x7f989810ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:04.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 -- 172.21.15.59:0/3190715463 shutdown_connections 2023-10-08T12:40:04.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:03.826+0000 7f98a0576700 1 -- 172.21.15.59:0/3190715463 wait complete. 2023-10-08T12:40:04.119 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724590 got 167503724593 for osd.5 2023-10-08T12:40:04.120 DEBUG:teuthology.parallel:result is None 2023-10-08T12:40:04.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:03 smithi092 ceph-mon[134093]: pgmap v278: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:03 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2900717798' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T12:40:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:03 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3190715463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T12:40:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:03 smithi173 ceph-mon[135182]: pgmap v278: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:03 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2900717798' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T12:40:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:03 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3190715463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T12:40:04.895 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378685 got 81604378688 for osd.2 2023-10-08T12:40:04.895 DEBUG:teuthology.parallel:result is None 2023-10-08T12:40:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:05 smithi092 ceph-mon[134093]: pgmap v279: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:06.132 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:05 smithi059 ceph-mon[98489]: pgmap v279: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:06.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.185+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2299089472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd4072f60 msgr2=0x7f4dd40733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.185+0000 7f4dd98f3700 1 --2- 172.21.15.59:0/2299089472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd4072f60 0x7f4dd40733e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009990 tx=0x7f4dc8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.185+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2299089472 shutdown_connections 2023-10-08T12:40:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.185+0000 7f4dd98f3700 1 --2- 172.21.15.59:0/2299089472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd4111570 0x7f4dd41139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.185+0000 7f4dd98f3700 1 --2- 172.21.15.59:0/2299089472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dd4074770 0x7f4dd4072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.185+0000 7f4dd98f3700 1 --2- 172.21.15.59:0/2299089472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd4072f60 0x7f4dd40733e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.185+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2299089472 >> 172.21.15.59:0/2299089472 conn(0x7f4dd40779e0 msgr2=0x7f4dd4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.185+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2299089472 shutdown_connections 2023-10-08T12:40:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.185+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2299089472 wait complete. 2023-10-08T12:40:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.186+0000 7f4dd98f3700 1 Processor -- start 2023-10-08T12:40:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.187+0000 7f4dd98f3700 1 -- start start 2023-10-08T12:40:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.187+0000 7f4dd98f3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd4072f60 0x7f4dd419d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.187+0000 7f4dd98f3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dd4074770 0x7f4dd419d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.187+0000 7f4dd98f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd4111570 0x7f4dd41a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.187+0000 7f4dd98f3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a21e0 con 0x7f4dd4111570 2023-10-08T12:40:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.187+0000 7f4dd98f3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a2350 con 0x7f4dd4072f60 2023-10-08T12:40:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.187+0000 7f4dd98f3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a2510 con 0x7f4dd4074770 2023-10-08T12:40:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.188+0000 7f4dd37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd4111570 0x7f4dd41a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.188+0000 7f4dd37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd4111570 0x7f4dd41a1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50634/0 (socket says 172.21.15.59:50634) 2023-10-08T12:40:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.188+0000 7f4dd37fe700 1 -- 172.21.15.59:0/2005986555 learned_addr learned my addr 172.21.15.59:0/2005986555 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.188+0000 7f4dd2ffd700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd4072f60 0x7f4dd419d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.188+0000 7f4dd27fc700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dd4074770 0x7f4dd419d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.188+0000 7f4dd37fe700 1 -- 172.21.15.59:0/2005986555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dd4074770 msgr2=0x7f4dd419d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.188+0000 7f4dd37fe700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dd4074770 0x7f4dd419d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.188+0000 7f4dd37fe700 1 -- 172.21.15.59:0/2005986555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd4072f60 msgr2=0x7f4dd419d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.188+0000 7f4dd37fe700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd4072f60 0x7f4dd419d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.188+0000 7f4dd37fe700 1 -- 172.21.15.59:0/2005986555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc009c40 con 0x7f4dd4111570 2023-10-08T12:40:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.188+0000 7f4dd37fe700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd4111570 0x7f4dd41a1bd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0060b0 tx=0x7f4dcc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:06.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.189+0000 7f4dd88f1700 1 -- 172.21.15.59:0/2005986555 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc018070 con 0x7f4dd4111570 2023-10-08T12:40:06.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.189+0000 7f4dd88f1700 1 -- 172.21.15.59:0/2005986555 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4dcc00f040 con 0x7f4dd4111570 2023-10-08T12:40:06.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.189+0000 7f4dd88f1700 1 -- 172.21.15.59:0/2005986555 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc004280 con 0x7f4dd4111570 2023-10-08T12:40:06.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.189+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2005986555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc80095f0 con 0x7f4dd4111570 2023-10-08T12:40:06.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.189+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2005986555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd41a9e80 con 0x7f4dd4111570 2023-10-08T12:40:06.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.190+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2005986555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd40740b0 con 0x7f4dd4111570 2023-10-08T12:40:06.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.194+0000 7f4dd88f1700 1 -- 172.21.15.59:0/2005986555 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f4dcc00ca20 con 0x7f4dd4111570 2023-10-08T12:40:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.195+0000 7f4dd88f1700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4dbc0a15e0 0x7f4dbc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.195+0000 7f4dd88f1700 1 -- 172.21.15.59:0/2005986555 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f4dcc0ccc20 con 0x7f4dd4111570 2023-10-08T12:40:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.195+0000 7f4dd2ffd700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4dbc0a15e0 0x7f4dbc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.196+0000 7f4dd2ffd700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4dbc0a15e0 0x7f4dbc0a3aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400ac50 tx=0x7f4dc400a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:06.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.201+0000 7f4dd88f1700 1 -- 172.21.15.59:0/2005986555 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4dcc0cce60 con 0x7f4dd4111570 2023-10-08T12:40:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:05 smithi173 ceph-mon[135182]: pgmap v279: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:06.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.319+0000 7fca3a338700 1 -- 172.21.15.59:0/2651835981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca341057c0 msgr2=0x7fca34105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.319+0000 7fca3a338700 1 --2- 172.21.15.59:0/2651835981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca341057c0 0x7fca34105ba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca24009990 tx=0x7fca24009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.320+0000 7fca3a338700 1 -- 172.21.15.59:0/2651835981 shutdown_connections 2023-10-08T12:40:06.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.320+0000 7fca3a338700 1 --2- 172.21.15.59:0/2651835981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca34101260 0x7fca3410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.320+0000 7fca3a338700 1 --2- 172.21.15.59:0/2651835981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca341057c0 0x7fca34105ba0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.320+0000 7fca3a338700 1 --2- 172.21.15.59:0/2651835981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca341008a0 0x7fca34100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.320+0000 7fca3a338700 1 -- 172.21.15.59:0/2651835981 >> 172.21.15.59:0/2651835981 conn(0x7fca340779e0 msgr2=0x7fca34077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:06.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.320+0000 7fca3a338700 1 -- 172.21.15.59:0/2651835981 shutdown_connections 2023-10-08T12:40:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.320+0000 7fca3a338700 1 -- 172.21.15.59:0/2651835981 wait complete. 2023-10-08T12:40:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.321+0000 7fca3a338700 1 Processor -- start 2023-10-08T12:40:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.321+0000 7fca3a338700 1 -- start start 2023-10-08T12:40:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.321+0000 7fca3a338700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca341008a0 0x7fca34198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.321+0000 7fca3a338700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca34101260 0x7fca341994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.321+0000 7fca3a338700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca341057c0 0x7fca3419d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.321+0000 7fca3a338700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3419de60 con 0x7fca341008a0 2023-10-08T12:40:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.321+0000 7fca3a338700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3419dfd0 con 0x7fca34101260 2023-10-08T12:40:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.321+0000 7fca3a338700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3419e190 con 0x7fca341057c0 2023-10-08T12:40:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.322+0000 7fca33fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca341008a0 0x7fca34198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.322+0000 7fca33fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca341008a0 0x7fca34198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50644/0 (socket says 172.21.15.59:50644) 2023-10-08T12:40:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.322+0000 7fca33fff700 1 -- 172.21.15.59:0/544199216 learned_addr learned my addr 172.21.15.59:0/544199216 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.322+0000 7fca337fe700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca34101260 0x7fca341994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.322+0000 7fca388d5700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca341057c0 0x7fca3419d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.322+0000 7fca33fff700 1 -- 172.21.15.59:0/544199216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca341057c0 msgr2=0x7fca3419d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.322+0000 7fca33fff700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca341057c0 0x7fca3419d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.322+0000 7fca33fff700 1 -- 172.21.15.59:0/544199216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca34101260 msgr2=0x7fca341994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.322+0000 7fca33fff700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca34101260 0x7fca341994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.322+0000 7fca33fff700 1 -- 172.21.15.59:0/544199216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240095f0 con 0x7fca341008a0 2023-10-08T12:40:06.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.323+0000 7fca33fff700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca341008a0 0x7fca34198fb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca24000c00 tx=0x7fca24005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.323+0000 7fca317fa700 1 -- 172.21.15.59:0/544199216 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2401d070 con 0x7fca341008a0 2023-10-08T12:40:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.323+0000 7fca3a338700 1 -- 172.21.15.59:0/544199216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3419e410 con 0x7fca341008a0 2023-10-08T12:40:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.323+0000 7fca317fa700 1 -- 172.21.15.59:0/544199216 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca24022470 con 0x7fca341008a0 2023-10-08T12:40:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.323+0000 7fca317fa700 1 -- 172.21.15.59:0/544199216 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24017650 con 0x7fca341008a0 2023-10-08T12:40:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.323+0000 7fca3a338700 1 -- 172.21.15.59:0/544199216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca341a5cd0 con 0x7fca341008a0 2023-10-08T12:40:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.324+0000 7fca3a338700 1 -- 172.21.15.59:0/544199216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca34101f30 con 0x7fca341008a0 2023-10-08T12:40:06.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.326+0000 7fca317fa700 1 -- 172.21.15.59:0/544199216 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fca2400fad0 con 0x7fca341008a0 2023-10-08T12:40:06.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.328+0000 7fca317fa700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca1c0a15e0 0x7fca1c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.328+0000 7fca317fa700 1 -- 172.21.15.59:0/544199216 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fca240ce240 con 0x7fca341008a0 2023-10-08T12:40:06.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.328+0000 7fca337fe700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca1c0a15e0 0x7fca1c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.329+0000 7fca337fe700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca1c0a15e0 0x7fca1c0a3aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca3419a4c0 tx=0x7fca28009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:06.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.332+0000 7fca317fa700 1 -- 172.21.15.59:0/544199216 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fca24097790 con 0x7fca341008a0 2023-10-08T12:40:06.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.423+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2005986555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4dd419e5f0 con 0x7f4dd4111570 2023-10-08T12:40:06.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.423+0000 7f4dd88f1700 1 -- 172.21.15.59:0/2005986555 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4dcc0960e0 con 0x7f4dd4111570 2023-10-08T12:40:06.425 INFO:teuthology.orchestra.run.smithi059.stdout:60129542213 2023-10-08T12:40:06.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2005986555 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4dbc0a15e0 msgr2=0x7f4dbc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4dbc0a15e0 0x7f4dbc0a3aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400ac50 tx=0x7f4dc400a380 comp rx=0 tx=0).stop 2023-10-08T12:40:06.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2005986555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd4111570 msgr2=0x7f4dd41a1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd4111570 0x7f4dd41a1bd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0060b0 tx=0x7f4dcc00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2005986555 shutdown_connections 2023-10-08T12:40:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4dbc0a15e0 0x7f4dbc0a3aa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd4072f60 0x7f4dd419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd4111570 0x7f4dd41a1bd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 --2- 172.21.15.59:0/2005986555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dd4074770 0x7f4dd419d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2005986555 >> 172.21.15.59:0/2005986555 conn(0x7f4dd40779e0 msgr2=0x7f4dd41101a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2005986555 shutdown_connections 2023-10-08T12:40:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.426+0000 7f4dd98f3700 1 -- 172.21.15.59:0/2005986555 wait complete. 2023-10-08T12:40:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.444+0000 7f4b7d56c700 1 -- 172.21.15.59:0/753508184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b78068190 msgr2=0x7f4b780685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.444+0000 7f4b7d56c700 1 --2- 172.21.15.59:0/753508184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b78068190 0x7f4b780685f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0098f0 tx=0x7f4b6c009c00 comp rx=0 tx=0).stop 2023-10-08T12:40:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.444+0000 7f4b7d56c700 1 -- 172.21.15.59:0/753508184 shutdown_connections 2023-10-08T12:40:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.444+0000 7f4b7d56c700 1 --2- 172.21.15.59:0/753508184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78068b30 0x7f4b7810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.444+0000 7f4b7d56c700 1 --2- 172.21.15.59:0/753508184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b781067a0 0x7f4b78106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.444+0000 7f4b7d56c700 1 --2- 172.21.15.59:0/753508184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b78068190 0x7f4b780685f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.444+0000 7f4b7d56c700 1 -- 172.21.15.59:0/753508184 >> 172.21.15.59:0/753508184 conn(0x7f4b78075790 msgr2=0x7f4b78075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:06.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.444+0000 7f4b7d56c700 1 -- 172.21.15.59:0/753508184 shutdown_connections 2023-10-08T12:40:06.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.444+0000 7f4b7d56c700 1 -- 172.21.15.59:0/753508184 wait complete. 2023-10-08T12:40:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.445+0000 7f4b7d56c700 1 Processor -- start 2023-10-08T12:40:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.445+0000 7f4b7d56c700 1 -- start start 2023-10-08T12:40:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.446+0000 7f4b7d56c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b78068190 0x7f4b780ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.446+0000 7f4b7d56c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78068b30 0x7f4b780ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.446+0000 7f4b7d56c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b781067a0 0x7f4b781002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.446+0000 7f4b7d56c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b781a5010 con 0x7f4b78068b30 2023-10-08T12:40:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.446+0000 7f4b7d56c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b781a5180 con 0x7f4b78068190 2023-10-08T12:40:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.446+0000 7f4b7d56c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b781a5340 con 0x7f4b781067a0 2023-10-08T12:40:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.446+0000 7f4b767fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78068b30 0x7f4b780ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b76ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b78068190 0x7f4b780ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b76ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b78068190 0x7f4b780ff820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:46028/0 (socket says 172.21.15.59:46028) 2023-10-08T12:40:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b767fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78068b30 0x7f4b780ffd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50658/0 (socket says 172.21.15.59:50658) 2023-10-08T12:40:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b76ffd700 1 -- 172.21.15.59:0/1319161525 learned_addr learned my addr 172.21.15.59:0/1319161525 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b777fe700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b781067a0 0x7f4b781002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b76ffd700 1 -- 172.21.15.59:0/1319161525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b781067a0 msgr2=0x7f4b781002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b76ffd700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b781067a0 0x7f4b781002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b76ffd700 1 -- 172.21.15.59:0/1319161525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78068b30 msgr2=0x7f4b780ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b76ffd700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78068b30 0x7f4b780ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b76ffd700 1 -- 172.21.15.59:0/1319161525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c009520 con 0x7f4b78068190 2023-10-08T12:40:06.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b767fc700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78068b30 0x7f4b780ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.447+0000 7f4b76ffd700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b78068190 0x7f4b780ff820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800e9c0 tx=0x7f4b6800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.448+0000 7f4b5ffff700 1 -- 172.21.15.59:0/1319161525 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68004a30 con 0x7f4b78068190 2023-10-08T12:40:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.448+0000 7f4b5ffff700 1 -- 172.21.15.59:0/1319161525 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b6800cc80 con 0x7f4b78068190 2023-10-08T12:40:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.448+0000 7f4b5ffff700 1 -- 172.21.15.59:0/1319161525 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680054e0 con 0x7f4b78068190 2023-10-08T12:40:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.448+0000 7f4b7d56c700 1 -- 172.21.15.59:0/1319161525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b781a5620 con 0x7f4b78068190 2023-10-08T12:40:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.448+0000 7f4b7d56c700 1 -- 172.21.15.59:0/1319161525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b781a5aa0 con 0x7f4b78068190 2023-10-08T12:40:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.449+0000 7f4b7d56c700 1 -- 172.21.15.59:0/1319161525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b78108d50 con 0x7f4b78068190 2023-10-08T12:40:06.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.453+0000 7f4b5ffff700 1 -- 172.21.15.59:0/1319161525 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f4b68004b90 con 0x7f4b78068190 2023-10-08T12:40:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.456+0000 7f4b5ffff700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4b600a1660 0x7f4b600a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.456+0000 7f4b5ffff700 1 -- 172.21.15.59:0/1319161525 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f4b68014070 con 0x7f4b78068190 2023-10-08T12:40:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.457+0000 7f4b767fc700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4b600a1660 0x7f4b600a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.457+0000 7f4b767fc700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4b600a1660 0x7f4b600a3b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0098c0 tx=0x7f4b6c019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:06.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.459+0000 7f4b5ffff700 1 -- 172.21.15.59:0/1319161525 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4b680963c0 con 0x7f4b78068190 2023-10-08T12:40:06.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.628+0000 7fca3a338700 1 -- 172.21.15.59:0/544199216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fca3404e4c0 con 0x7fca341008a0 2023-10-08T12:40:06.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.628+0000 7fca317fa700 1 -- 172.21.15.59:0/544199216 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca2409adb0 con 0x7fca341008a0 2023-10-08T12:40:06.629 INFO:teuthology.orchestra.run.smithi059.stdout:287762808862 2023-10-08T12:40:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.630+0000 7fca3a338700 1 -- 172.21.15.59:0/544199216 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca1c0a15e0 msgr2=0x7fca1c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.631+0000 7fca3a338700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca1c0a15e0 0x7fca1c0a3aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca3419a4c0 tx=0x7fca28009260 comp rx=0 tx=0).stop 2023-10-08T12:40:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.631+0000 7fca3a338700 1 -- 172.21.15.59:0/544199216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca341008a0 msgr2=0x7fca34198fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.631+0000 7fca3a338700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca341008a0 0x7fca34198fb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca24000c00 tx=0x7fca24005740 comp rx=0 tx=0).stop 2023-10-08T12:40:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.631+0000 7fca3a338700 1 -- 172.21.15.59:0/544199216 shutdown_connections 2023-10-08T12:40:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.631+0000 7fca3a338700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca1c0a15e0 0x7fca1c0a3aa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.631+0000 7fca3a338700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca341057c0 0x7fca3419d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.631+0000 7fca3a338700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca341008a0 0x7fca34198fb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.631+0000 7fca3a338700 1 --2- 172.21.15.59:0/544199216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca34101260 0x7fca341994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.631+0000 7fca3a338700 1 -- 172.21.15.59:0/544199216 >> 172.21.15.59:0/544199216 conn(0x7fca340779e0 msgr2=0x7fca3410baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.631+0000 7fca3a338700 1 -- 172.21.15.59:0/544199216 shutdown_connections 2023-10-08T12:40:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.631+0000 7fca3a338700 1 -- 172.21.15.59:0/544199216 wait complete. 2023-10-08T12:40:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.708+0000 7f0c4f9da700 1 -- 172.21.15.59:0/3792483378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c48073340 msgr2=0x7f0c4810cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.708+0000 7f0c4f9da700 1 --2- 172.21.15.59:0/3792483378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c48073340 0x7f0c4810cd10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009990 tx=0x7f0c38009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.708+0000 7f0c4f9da700 1 -- 172.21.15.59:0/3792483378 shutdown_connections 2023-10-08T12:40:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.708+0000 7f0c4f9da700 1 --2- 172.21.15.59:0/3792483378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c4810d250 0x7f0c4810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.708+0000 7f0c4f9da700 1 --2- 172.21.15.59:0/3792483378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c48072a20 0x7f0c48072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.708+0000 7f0c4f9da700 1 --2- 172.21.15.59:0/3792483378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c48073340 0x7f0c4810cd10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.708+0000 7f0c4f9da700 1 -- 172.21.15.59:0/3792483378 >> 172.21.15.59:0/3792483378 conn(0x7f0c480779e0 msgr2=0x7f0c48077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.708+0000 7f0c4f9da700 1 -- 172.21.15.59:0/3792483378 shutdown_connections 2023-10-08T12:40:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.708+0000 7f0c4f9da700 1 -- 172.21.15.59:0/3792483378 wait complete. 2023-10-08T12:40:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.709+0000 7f0c4f9da700 1 Processor -- start 2023-10-08T12:40:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.710+0000 7f0c4f9da700 1 -- start start 2023-10-08T12:40:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.710+0000 7f0c4f9da700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c48072a20 0x7f0c48198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.710+0000 7f0c4f9da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c48073340 0x7f0c48199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.710+0000 7f0c4f9da700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c4810d250 0x7f0c4819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.710+0000 7f0c4f9da700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4819dd80 con 0x7f0c48073340 2023-10-08T12:40:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.710+0000 7f0c4f9da700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4819def0 con 0x7f0c4810d250 2023-10-08T12:40:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.710+0000 7f0c4f9da700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4819e0b0 con 0x7f0c48072a20 2023-10-08T12:40:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.710+0000 7f0c4d776700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c48072a20 0x7f0c48198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.710+0000 7f0c4cf75700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c48073340 0x7f0c48199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.710+0000 7f0c4d776700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c48072a20 0x7f0c48198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40264/0 (socket says 172.21.15.59:40264) 2023-10-08T12:40:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.710+0000 7f0c4d776700 1 -- 172.21.15.59:0/4131197371 learned_addr learned my addr 172.21.15.59:0/4131197371 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.711+0000 7f0c4d776700 1 -- 172.21.15.59:0/4131197371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c4810d250 msgr2=0x7f0c4819d770 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:40:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.711+0000 7f0c4d776700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c4810d250 0x7f0c4819d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.711+0000 7f0c4d776700 1 -- 172.21.15.59:0/4131197371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c48073340 msgr2=0x7f0c48199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.711+0000 7f0c4d776700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c48073340 0x7f0c48199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.711+0000 7f0c4d776700 1 -- 172.21.15.59:0/4131197371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380095f0 con 0x7f0c48072a20 2023-10-08T12:40:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.711+0000 7f0c4d776700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c48072a20 0x7f0c48198ed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400e9a0 tx=0x7f0c4400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.711+0000 7f0c3e7fc700 1 -- 172.21.15.59:0/4131197371 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44009790 con 0x7f0c48072a20 2023-10-08T12:40:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.711+0000 7f0c3e7fc700 1 -- 172.21.15.59:0/4131197371 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c4400cbd0 con 0x7f0c48072a20 2023-10-08T12:40:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.712+0000 7f0c4f9da700 1 -- 172.21.15.59:0/4131197371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4819e390 con 0x7f0c48072a20 2023-10-08T12:40:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.712+0000 7f0c3e7fc700 1 -- 172.21.15.59:0/4131197371 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44018680 con 0x7f0c48072a20 2023-10-08T12:40:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.712+0000 7f0c4f9da700 1 -- 172.21.15.59:0/4131197371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c481a5bf0 con 0x7f0c48072a20 2023-10-08T12:40:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.713+0000 7f0c4f9da700 1 -- 172.21.15.59:0/4131197371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c48108460 con 0x7f0c48072a20 2023-10-08T12:40:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.715+0000 7f0c3e7fc700 1 -- 172.21.15.59:0/4131197371 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f0c44010430 con 0x7f0c48072a20 2023-10-08T12:40:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.716+0000 7f0c3e7fc700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0c340a15e0 0x7f0c340a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.716+0000 7f0c3e7fc700 1 -- 172.21.15.59:0/4131197371 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f0c44014070 con 0x7f0c48072a20 2023-10-08T12:40:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.717+0000 7f0c4cf75700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0c340a15e0 0x7f0c340a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.717+0000 7f0c4cf75700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0c340a15e0 0x7f0c340a3aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800b2e0 tx=0x7f0c38005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.718+0000 7f0c3e7fc700 1 -- 172.21.15.59:0/4131197371 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0c44096560 con 0x7f0c48072a20 2023-10-08T12:40:06.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.751+0000 7f4b7d56c700 1 -- 172.21.15.59:0/1319161525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b78100d00 con 0x7f4b78068190 2023-10-08T12:40:06.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.751+0000 7f4b5ffff700 1 -- 172.21.15.59:0/1319161525 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b680999e0 con 0x7f4b78068190 2023-10-08T12:40:06.752 INFO:teuthology.orchestra.run.smithi059.stdout:111669149755 2023-10-08T12:40:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 -- 172.21.15.59:0/1319161525 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4b600a1660 msgr2=0x7f4b600a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4b600a1660 0x7f4b600a3b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0098c0 tx=0x7f4b6c019040 comp rx=0 tx=0).stop 2023-10-08T12:40:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 -- 172.21.15.59:0/1319161525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b78068190 msgr2=0x7f4b780ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b78068190 0x7f4b780ff820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800e9c0 tx=0x7f4b6800ecd0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 -- 172.21.15.59:0/1319161525 shutdown_connections 2023-10-08T12:40:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4b600a1660 0x7f4b600a3b20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b78068190 0x7f4b780ff820 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b781067a0 0x7f4b781002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 --2- 172.21.15.59:0/1319161525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78068b30 0x7f4b780ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 -- 172.21.15.59:0/1319161525 >> 172.21.15.59:0/1319161525 conn(0x7f4b78075790 msgr2=0x7f4b780fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 -- 172.21.15.59:0/1319161525 shutdown_connections 2023-10-08T12:40:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.754+0000 7f4b7d56c700 1 -- 172.21.15.59:0/1319161525 wait complete. 2023-10-08T12:40:06.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.973+0000 7f0c4f9da700 1 -- 172.21.15.59:0/4131197371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f0c4819a190 con 0x7f0c48072a20 2023-10-08T12:40:06.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.974+0000 7f0c3e7fc700 1 -- 172.21.15.59:0/4131197371 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c44099b80 con 0x7f0c48072a20 2023-10-08T12:40:06.975 INFO:teuthology.orchestra.run.smithi059.stdout:253403070499 2023-10-08T12:40:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.976+0000 7f0c4f9da700 1 -- 172.21.15.59:0/4131197371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0c340a15e0 msgr2=0x7f0c340a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.976+0000 7f0c4f9da700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0c340a15e0 0x7f0c340a3aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800b2e0 tx=0x7f0c38005960 comp rx=0 tx=0).stop 2023-10-08T12:40:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.976+0000 7f0c4f9da700 1 -- 172.21.15.59:0/4131197371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c48072a20 msgr2=0x7f0c48198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.976+0000 7f0c4f9da700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c48072a20 0x7f0c48198ed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400e9a0 tx=0x7f0c4400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.976+0000 7f0c4f9da700 1 -- 172.21.15.59:0/4131197371 shutdown_connections 2023-10-08T12:40:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.976+0000 7f0c4f9da700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0c340a15e0 0x7f0c340a3aa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.976+0000 7f0c4f9da700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c4810d250 0x7f0c4819d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.976+0000 7f0c4f9da700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c48072a20 0x7f0c48198ed0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.976+0000 7f0c4f9da700 1 --2- 172.21.15.59:0/4131197371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c48073340 0x7f0c48199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.976+0000 7f0c4f9da700 1 -- 172.21.15.59:0/4131197371 >> 172.21.15.59:0/4131197371 conn(0x7f0c480779e0 msgr2=0x7f0c480fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.977+0000 7f0c4f9da700 1 -- 172.21.15.59:0/4131197371 shutdown_connections 2023-10-08T12:40:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:06.977+0000 7f0c4f9da700 1 -- 172.21.15.59:0/4131197371 wait complete. 2023-10-08T12:40:07.070 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:06 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2005986555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T12:40:07.070 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:06 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/544199216' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T12:40:07.071 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:06 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1319161525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T12:40:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:06 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2005986555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T12:40:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:06 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/544199216' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T12:40:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:06 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1319161525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T12:40:07.248 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542211 got 60129542213 for osd.1 2023-10-08T12:40:07.248 DEBUG:teuthology.parallel:result is None 2023-10-08T12:40:07.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:06 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2005986555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T12:40:07.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:06 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/544199216' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T12:40:07.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:06 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1319161525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T12:40:07.710 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808859 got 287762808862 for osd.9 2023-10-08T12:40:07.710 DEBUG:teuthology.parallel:result is None 2023-10-08T12:40:07.730 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149753 got 111669149755 for osd.3 2023-10-08T12:40:07.730 DEBUG:teuthology.parallel:result is None 2023-10-08T12:40:07.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:07 smithi059 ceph-mon[98489]: pgmap v280: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:07.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:07 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4131197371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T12:40:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:07 smithi092 ceph-mon[134093]: pgmap v280: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:07 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4131197371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T12:40:08.177 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070496 got 253403070499 for osd.8 2023-10-08T12:40:08.178 DEBUG:teuthology.parallel:result is None 2023-10-08T12:40:08.178 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-08T12:40:08.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T12:40:08.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:07 smithi173 ceph-mon[135182]: pgmap v280: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:08.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:07 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4131197371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T12:40:08.915 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:09.760 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:09 smithi059 ceph-mon[98489]: pgmap v281: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:09.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:09 smithi173 ceph-mon[135182]: pgmap v281: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:09 smithi092 ceph-mon[134093]: pgmap v281: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:10.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.432+0000 7f6bdeed9700 1 -- 172.21.15.59:0/3929813749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bd8101260 msgr2=0x7f6bd810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.432+0000 7f6bdeed9700 1 --2- 172.21.15.59:0/3929813749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bd8101260 0x7f6bd810d650 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000b0a0 tx=0x7f6bd000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.433+0000 7f6bdeed9700 1 -- 172.21.15.59:0/3929813749 shutdown_connections 2023-10-08T12:40:10.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.433+0000 7f6bdeed9700 1 --2- 172.21.15.59:0/3929813749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bd8101260 0x7f6bd810d650 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.433+0000 7f6bdeed9700 1 --2- 172.21.15.59:0/3929813749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bd81057c0 0x7f6bd8105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.433+0000 7f6bdeed9700 1 --2- 172.21.15.59:0/3929813749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bd81008a0 0x7f6bd8100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.433+0000 7f6bdeed9700 1 -- 172.21.15.59:0/3929813749 >> 172.21.15.59:0/3929813749 conn(0x7f6bd80779e0 msgr2=0x7f6bd8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:10.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.433+0000 7f6bdeed9700 1 -- 172.21.15.59:0/3929813749 shutdown_connections 2023-10-08T12:40:10.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.433+0000 7f6bdeed9700 1 -- 172.21.15.59:0/3929813749 wait complete. 2023-10-08T12:40:10.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.434+0000 7f6bdeed9700 1 Processor -- start 2023-10-08T12:40:10.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.434+0000 7f6bdeed9700 1 -- start start 2023-10-08T12:40:10.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.434+0000 7f6bdeed9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bd81008a0 0x7f6bd8198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.434+0000 7f6bdeed9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bd8101260 0x7f6bd8199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.434+0000 7f6bdeed9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bd81057c0 0x7f6bd819d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.434+0000 7f6bdeed9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd819de30 con 0x7f6bd81008a0 2023-10-08T12:40:10.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.434+0000 7f6bdeed9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd819dfa0 con 0x7f6bd8101260 2023-10-08T12:40:10.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.434+0000 7f6bdeed9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd819e160 con 0x7f6bd81057c0 2023-10-08T12:40:10.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bdcc75700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bd81008a0 0x7f6bd8198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bdcc75700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bd81008a0 0x7f6bd8198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50700/0 (socket says 172.21.15.59:50700) 2023-10-08T12:40:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bdcc75700 1 -- 172.21.15.59:0/2149176026 learned_addr learned my addr 172.21.15.59:0/2149176026 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bd7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bd8101260 0x7f6bd8199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bdd476700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bd81057c0 0x7f6bd819d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bdcc75700 1 -- 172.21.15.59:0/2149176026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bd81057c0 msgr2=0x7f6bd819d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bdcc75700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bd81057c0 0x7f6bd819d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bdcc75700 1 -- 172.21.15.59:0/2149176026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bd8101260 msgr2=0x7f6bd8199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bdcc75700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bd8101260 0x7f6bd8199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bdcc75700 1 -- 172.21.15.59:0/2149176026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc4009520 con 0x7f6bd81008a0 2023-10-08T12:40:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bd7fff700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bd8101260 0x7f6bd8199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.435+0000 7f6bdcc75700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bd81008a0 0x7f6bd8198f30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00e970 tx=0x7f6bcc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:10.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.436+0000 7f6bd5ffb700 1 -- 172.21.15.59:0/2149176026 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc009790 con 0x7f6bd81008a0 2023-10-08T12:40:10.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.436+0000 7f6bdeed9700 1 -- 172.21.15.59:0/2149176026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd0009d00 con 0x7f6bd81008a0 2023-10-08T12:40:10.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.436+0000 7f6bd5ffb700 1 -- 172.21.15.59:0/2149176026 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bcc00c7e0 con 0x7f6bd81008a0 2023-10-08T12:40:10.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.436+0000 7f6bd5ffb700 1 -- 172.21.15.59:0/2149176026 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc003c70 con 0x7f6bd81008a0 2023-10-08T12:40:10.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.436+0000 7f6bdeed9700 1 -- 172.21.15.59:0/2149176026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd81a5ad0 con 0x7f6bd81008a0 2023-10-08T12:40:10.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.437+0000 7f6bdeed9700 1 -- 172.21.15.59:0/2149176026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc0052f0 con 0x7f6bd81008a0 2023-10-08T12:40:10.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.439+0000 7f6bd5ffb700 1 -- 172.21.15.59:0/2149176026 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f6bcc018430 con 0x7f6bd81008a0 2023-10-08T12:40:10.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.440+0000 7f6bd5ffb700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6bc80a1560 0x7f6bc80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.440+0000 7f6bd5ffb700 1 -- 172.21.15.59:0/2149176026 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f6bcc014070 con 0x7f6bd81008a0 2023-10-08T12:40:10.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.440+0000 7f6bd7fff700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6bc80a1560 0x7f6bc80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.441+0000 7f6bd7fff700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6bc80a1560 0x7f6bc80a3a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009fd0 tx=0x7f6bc4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:10.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.444+0000 7f6bd5ffb700 1 -- 172.21.15.59:0/2149176026 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6bcc0964f0 con 0x7f6bd81008a0 2023-10-08T12:40:10.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.649+0000 7f6bdeed9700 1 -- 172.21.15.59:0/2149176026 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bbc000bc0 con 0x7f6bc80a1560 2023-10-08T12:40:10.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.661+0000 7f6bd5ffb700 1 -- 172.21.15.59:0/2149176026 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340437 (secure 0 0 0) 0x7f6bbc000bc0 con 0x7f6bc80a1560 2023-10-08T12:40:10.670 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 -- 172.21.15.59:0/2149176026 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6bc80a1560 msgr2=0x7f6bc80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6bc80a1560 0x7f6bc80a3a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009fd0 tx=0x7f6bc4009260 comp rx=0 tx=0).stop 2023-10-08T12:40:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 -- 172.21.15.59:0/2149176026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bd81008a0 msgr2=0x7f6bd8198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bd81008a0 0x7f6bd8198f30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00e970 tx=0x7f6bcc00ec80 comp rx=0 tx=0).stop 2023-10-08T12:40:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 -- 172.21.15.59:0/2149176026 shutdown_connections 2023-10-08T12:40:10.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6bc80a1560 0x7f6bc80a3a20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bd81057c0 0x7f6bd819d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bd81008a0 0x7f6bd8198f30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 --2- 172.21.15.59:0/2149176026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bd8101260 0x7f6bd8199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 -- 172.21.15.59:0/2149176026 >> 172.21.15.59:0/2149176026 conn(0x7f6bd80779e0 msgr2=0x7f6bd810ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:10.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 -- 172.21.15.59:0/2149176026 shutdown_connections 2023-10-08T12:40:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:10.666+0000 7f6bdeed9700 1 -- 172.21.15.59:0/2149176026 wait complete. 2023-10-08T12:40:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-08T12:40:11.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-08T12:40:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-08T12:40:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2023-10-08T12:40:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-10-08T12:40:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-08T12:40:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2023-10-08T12:40:11.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:10 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2023-10-08T12:40:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-08T12:40:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-08T12:40:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2023-10-08T12:40:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-10-08T12:40:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-08T12:40:11.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2023-10-08T12:40:11.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:10 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2023-10-08T12:40:11.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-08T12:40:11.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-08T12:40:11.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2023-10-08T12:40:11.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-10-08T12:40:11.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-08T12:40:11.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2023-10-08T12:40:11.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:10 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2023-10-08T12:40:11.294 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2023-10-08T12:40:08.789857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650572,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":246,"num_read_kb":233,"num_write":251,"num_write_kb":3018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335228,"kb_used_data":11008,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606596,"statfs":{"total":1151940427776,"available":1151597154304,"internally_reserved":0,"allocated":11272192,"data_stored":7284481,"data_compressed":112209,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003667"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670437+0000","last_change":"2023-10-08T12:39:14.206423+0000","last_active":"2023-10-08T12:39:15.670437+0000","last_peered":"2023-10-08T12:39:15.670437+0000","last_clean":"2023-10-08T12:39:15.670437+0000","last_became_active":"2023-10-08T12:39:14.205454+0000","last_became_peered":"2023-10-08T12:39:14.205454+0000","last_unstale":"2023-10-08T12:39:15.670437+0000","last_undegraded":"2023-10-08T12:39:15.670437+0000","last_fullsized":"2023-10-08T12:39:15.670437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:37.669007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548773+0000","last_change":"2023-10-08T12:39:14.215711+0000","last_active":"2023-10-08T12:39:15.548773+0000","last_peered":"2023-10-08T12:39:15.548773+0000","last_clean":"2023-10-08T12:39:15.548773+0000","last_became_active":"2023-10-08T12:39:14.215283+0000","last_became_peered":"2023-10-08T12:39:14.215283+0000","last_unstale":"2023-10-08T12:39:15.548773+0000","last_undegraded":"2023-10-08T12:39:15.548773+0000","last_fullsized":"2023-10-08T12:39:15.548773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:29.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549611+0000","last_change":"2023-10-08T12:39:14.209843+0000","last_active":"2023-10-08T12:39:15.549611+0000","last_peered":"2023-10-08T12:39:15.549611+0000","last_clean":"2023-10-08T12:39:15.549611+0000","last_became_active":"2023-10-08T12:39:14.209528+0000","last_became_peered":"2023-10-08T12:39:14.209528+0000","last_unstale":"2023-10-08T12:39:15.549611+0000","last_undegraded":"2023-10-08T12:39:15.549611+0000","last_fullsized":"2023-10-08T12:39:15.549611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:54.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405655+0000","last_change":"2023-10-08T12:39:14.204891+0000","last_active":"2023-10-08T12:39:15.405655+0000","last_peered":"2023-10-08T12:39:15.405655+0000","last_clean":"2023-10-08T12:39:15.405655+0000","last_became_active":"2023-10-08T12:39:14.204075+0000","last_became_peered":"2023-10-08T12:39:14.204075+0000","last_unstale":"2023-10-08T12:39:15.405655+0000","last_undegraded":"2023-10-08T12:39:15.405655+0000","last_fullsized":"2023-10-08T12:39:15.405655+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:18.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493441+0000","last_change":"2023-10-08T12:39:14.212527+0000","last_active":"2023-10-08T12:39:15.493441+0000","last_peered":"2023-10-08T12:39:15.493441+0000","last_clean":"2023-10-08T12:39:15.493441+0000","last_became_active":"2023-10-08T12:39:14.212188+0000","last_became_peered":"2023-10-08T12:39:14.212188+0000","last_unstale":"2023-10-08T12:39:15.493441+0000","last_undegraded":"2023-10-08T12:39:15.493441+0000","last_fullsized":"2023-10-08T12:39:15.493441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:28.952210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549185+0000","last_change":"2023-10-08T12:39:14.216842+0000","last_active":"2023-10-08T12:39:15.549185+0000","last_peered":"2023-10-08T12:39:15.549185+0000","last_clean":"2023-10-08T12:39:15.549185+0000","last_became_active":"2023-10-08T12:39:14.216446+0000","last_became_peered":"2023-10-08T12:39:14.216446+0000","last_unstale":"2023-10-08T12:39:15.549185+0000","last_undegraded":"2023-10-08T12:39:15.549185+0000","last_fullsized":"2023-10-08T12:39:15.549185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:40.718246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548684+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:39:15.548684+0000","last_peered":"2023-10-08T12:39:15.548684+0000","last_clean":"2023-10-08T12:39:15.548684+0000","last_became_active":"2023-10-08T12:39:14.222410+0000","last_became_peered":"2023-10-08T12:39:14.222410+0000","last_unstale":"2023-10-08T12:39:15.548684+0000","last_undegraded":"2023-10-08T12:39:15.548684+0000","last_fullsized":"2023-10-08T12:39:15.548684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:03.599610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550066+0000","last_change":"2023-10-08T12:39:14.209422+0000","last_active":"2023-10-08T12:39:15.550066+0000","last_peered":"2023-10-08T12:39:15.550066+0000","last_clean":"2023-10-08T12:39:15.550066+0000","last_became_active":"2023-10-08T12:39:14.209073+0000","last_became_peered":"2023-10-08T12:39:14.209073+0000","last_unstale":"2023-10-08T12:39:15.550066+0000","last_undegraded":"2023-10-08T12:39:15.550066+0000","last_fullsized":"2023-10-08T12:39:15.550066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:09.587414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203646+0000","last_change":"2023-10-08T12:39:14.211228+0000","last_active":"2023-10-08T12:39:15.203646+0000","last_peered":"2023-10-08T12:39:15.203646+0000","last_clean":"2023-10-08T12:39:15.203646+0000","last_became_active":"2023-10-08T12:39:14.210940+0000","last_became_peered":"2023-10-08T12:39:14.210940+0000","last_unstale":"2023-10-08T12:39:15.203646+0000","last_undegraded":"2023-10-08T12:39:15.203646+0000","last_fullsized":"2023-10-08T12:39:15.203646+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:52.683409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549070+0000","last_change":"2023-10-08T12:39:14.207071+0000","last_active":"2023-10-08T12:39:15.549070+0000","last_peered":"2023-10-08T12:39:15.549070+0000","last_clean":"2023-10-08T12:39:15.549070+0000","last_became_active":"2023-10-08T12:39:14.206770+0000","last_became_peered":"2023-10-08T12:39:14.206770+0000","last_unstale":"2023-10-08T12:39:15.549070+0000","last_undegraded":"2023-10-08T12:39:15.549070+0000","last_fullsized":"2023-10-08T12:39:15.549070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:19.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549102+0000","last_change":"2023-10-08T12:39:14.212780+0000","last_active":"2023-10-08T12:39:15.549102+0000","last_peered":"2023-10-08T12:39:15.549102+0000","last_clean":"2023-10-08T12:39:15.549102+0000","last_became_active":"2023-10-08T12:39:14.212167+0000","last_became_peered":"2023-10-08T12:39:14.212167+0000","last_unstale":"2023-10-08T12:39:15.549102+0000","last_undegraded":"2023-10-08T12:39:15.549102+0000","last_fullsized":"2023-10-08T12:39:15.549102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:17.332257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405632+0000","last_change":"2023-10-08T12:39:14.204506+0000","last_active":"2023-10-08T12:39:15.405632+0000","last_peered":"2023-10-08T12:39:15.405632+0000","last_clean":"2023-10-08T12:39:15.405632+0000","last_became_active":"2023-10-08T12:39:14.204184+0000","last_became_peered":"2023-10-08T12:39:14.204184+0000","last_unstale":"2023-10-08T12:39:15.405632+0000","last_undegraded":"2023-10-08T12:39:15.405632+0000","last_fullsized":"2023-10-08T12:39:15.405632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:05.696554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549661+0000","last_change":"2023-10-08T12:39:14.211957+0000","last_active":"2023-10-08T12:39:15.549661+0000","last_peered":"2023-10-08T12:39:15.549661+0000","last_clean":"2023-10-08T12:39:15.549661+0000","last_became_active":"2023-10-08T12:39:14.211629+0000","last_became_peered":"2023-10-08T12:39:14.211629+0000","last_unstale":"2023-10-08T12:39:15.549661+0000","last_undegraded":"2023-10-08T12:39:15.549661+0000","last_fullsized":"2023-10-08T12:39:15.549661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:10.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549044+0000","last_change":"2023-10-08T12:39:14.207006+0000","last_active":"2023-10-08T12:39:15.549044+0000","last_peered":"2023-10-08T12:39:15.549044+0000","last_clean":"2023-10-08T12:39:15.549044+0000","last_became_active":"2023-10-08T12:39:14.206624+0000","last_became_peered":"2023-10-08T12:39:14.206624+0000","last_unstale":"2023-10-08T12:39:15.549044+0000","last_undegraded":"2023-10-08T12:39:15.549044+0000","last_fullsized":"2023-10-08T12:39:15.549044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:11.232875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548718+0000","last_change":"2023-10-08T12:39:14.213865+0000","last_active":"2023-10-08T12:39:15.548718+0000","last_peered":"2023-10-08T12:39:15.548718+0000","last_clean":"2023-10-08T12:39:15.548718+0000","last_became_active":"2023-10-08T12:39:14.207972+0000","last_became_peered":"2023-10-08T12:39:14.207972+0000","last_unstale":"2023-10-08T12:39:15.548718+0000","last_undegraded":"2023-10-08T12:39:15.548718+0000","last_fullsized":"2023-10-08T12:39:15.548718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:01.434731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203301+0000","last_change":"2023-10-08T12:39:14.206313+0000","last_active":"2023-10-08T12:39:15.203301+0000","last_peered":"2023-10-08T12:39:15.203301+0000","last_clean":"2023-10-08T12:39:15.203301+0000","last_became_active":"2023-10-08T12:39:14.206001+0000","last_became_peered":"2023-10-08T12:39:14.206001+0000","last_unstale":"2023-10-08T12:39:15.203301+0000","last_undegraded":"2023-10-08T12:39:15.203301+0000","last_fullsized":"2023-10-08T12:39:15.203301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:43.912356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670533+0000","last_change":"2023-10-08T12:39:14.205752+0000","last_active":"2023-10-08T12:39:15.670533+0000","last_peered":"2023-10-08T12:39:15.670533+0000","last_clean":"2023-10-08T12:39:15.670533+0000","last_became_active":"2023-10-08T12:39:14.204696+0000","last_became_peered":"2023-10-08T12:39:14.204696+0000","last_unstale":"2023-10-08T12:39:15.670533+0000","last_undegraded":"2023-10-08T12:39:15.670533+0000","last_fullsized":"2023-10-08T12:39:15.670533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:42.409107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201311+0000","last_change":"2023-10-08T12:39:14.203373+0000","last_active":"2023-10-08T12:39:15.201311+0000","last_peered":"2023-10-08T12:39:15.201311+0000","last_clean":"2023-10-08T12:39:15.201311+0000","last_became_active":"2023-10-08T12:39:14.202966+0000","last_became_peered":"2023-10-08T12:39:14.202966+0000","last_unstale":"2023-10-08T12:39:15.201311+0000","last_undegraded":"2023-10-08T12:39:15.201311+0000","last_fullsized":"2023-10-08T12:39:15.201311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:00.114475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.202041+0000","last_change":"2023-10-08T12:39:14.216154+0000","last_active":"2023-10-08T12:39:15.202041+0000","last_peered":"2023-10-08T12:39:15.202041+0000","last_clean":"2023-10-08T12:39:15.202041+0000","last_became_active":"2023-10-08T12:39:14.215868+0000","last_became_peered":"2023-10-08T12:39:14.215868+0000","last_unstale":"2023-10-08T12:39:15.202041+0000","last_undegraded":"2023-10-08T12:39:15.202041+0000","last_fullsized":"2023-10-08T12:39:15.202041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:53.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201161+0000","last_change":"2023-10-08T12:39:13.214538+0000","last_active":"2023-10-08T12:39:15.201161+0000","last_peered":"2023-10-08T12:39:15.201161+0000","last_clean":"2023-10-08T12:39:15.201161+0000","last_became_active":"2023-10-08T12:39:13.214162+0000","last_became_peered":"2023-10-08T12:39:13.214162+0000","last_unstale":"2023-10-08T12:39:15.201161+0000","last_undegraded":"2023-10-08T12:39:15.201161+0000","last_fullsized":"2023-10-08T12:39:15.201161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:11.500815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550308+0000","last_change":"2023-10-08T12:39:14.211308+0000","last_active":"2023-10-08T12:39:15.550308+0000","last_peered":"2023-10-08T12:39:15.550308+0000","last_clean":"2023-10-08T12:39:15.550308+0000","last_became_active":"2023-10-08T12:39:14.210961+0000","last_became_peered":"2023-10-08T12:39:14.210961+0000","last_unstale":"2023-10-08T12:39:15.550308+0000","last_undegraded":"2023-10-08T12:39:15.550308+0000","last_fullsized":"2023-10-08T12:39:15.550308+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.221981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.706784+0000","last_change":"2023-10-08T12:39:13.219982+0000","last_active":"2023-10-08T12:39:14.706784+0000","last_peered":"2023-10-08T12:39:14.706784+0000","last_clean":"2023-10-08T12:39:14.706784+0000","last_became_active":"2023-10-08T12:39:13.219668+0000","last_became_peered":"2023-10-08T12:39:13.219668+0000","last_unstale":"2023-10-08T12:39:14.706784+0000","last_undegraded":"2023-10-08T12:39:14.706784+0000","last_fullsized":"2023-10-08T12:39:14.706784+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.664553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549090+0000","last_change":"2023-10-08T12:39:14.216922+0000","last_active":"2023-10-08T12:39:15.549090+0000","last_peered":"2023-10-08T12:39:15.549090+0000","last_clean":"2023-10-08T12:39:15.549090+0000","last_became_active":"2023-10-08T12:39:14.216634+0000","last_became_peered":"2023-10-08T12:39:14.216634+0000","last_unstale":"2023-10-08T12:39:15.549090+0000","last_undegraded":"2023-10-08T12:39:15.549090+0000","last_fullsized":"2023-10-08T12:39:15.549090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:21.254178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.708415+0000","last_change":"2023-10-08T12:39:13.220262+0000","last_active":"2023-10-08T12:39:14.708415+0000","last_peered":"2023-10-08T12:39:14.708415+0000","last_clean":"2023-10-08T12:39:14.708415+0000","last_became_active":"2023-10-08T12:39:13.219917+0000","last_became_peered":"2023-10-08T12:39:13.219917+0000","last_unstale":"2023-10-08T12:39:14.708415+0000","last_undegraded":"2023-10-08T12:39:14.708415+0000","last_fullsized":"2023-10-08T12:39:14.708415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:34.368119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203329+0000","last_change":"2023-10-08T12:39:14.212620+0000","last_active":"2023-10-08T12:39:15.203329+0000","last_peered":"2023-10-08T12:39:15.203329+0000","last_clean":"2023-10-08T12:39:15.203329+0000","last_became_active":"2023-10-08T12:39:14.212128+0000","last_became_peered":"2023-10-08T12:39:14.212128+0000","last_unstale":"2023-10-08T12:39:15.203329+0000","last_undegraded":"2023-10-08T12:39:15.203329+0000","last_fullsized":"2023-10-08T12:39:15.203329+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:40.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.706405+0000","last_change":"2023-10-08T12:39:13.218291+0000","last_active":"2023-10-08T12:39:14.706405+0000","last_peered":"2023-10-08T12:39:14.706405+0000","last_clean":"2023-10-08T12:39:14.706405+0000","last_became_active":"2023-10-08T12:39:13.217907+0000","last_became_peered":"2023-10-08T12:39:13.217907+0000","last_unstale":"2023-10-08T12:39:14.706405+0000","last_undegraded":"2023-10-08T12:39:14.706405+0000","last_fullsized":"2023-10-08T12:39:14.706405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:54:46.891553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549340+0000","last_change":"2023-10-08T12:39:14.207991+0000","last_active":"2023-10-08T12:39:15.549340+0000","last_peered":"2023-10-08T12:39:15.549340+0000","last_clean":"2023-10-08T12:39:15.549340+0000","last_became_active":"2023-10-08T12:39:14.207683+0000","last_became_peered":"2023-10-08T12:39:14.207683+0000","last_unstale":"2023-10-08T12:39:15.549340+0000","last_undegraded":"2023-10-08T12:39:15.549340+0000","last_fullsized":"2023-10-08T12:39:15.549340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:47.809553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.708660+0000","last_change":"2023-10-08T12:39:13.214704+0000","last_active":"2023-10-08T12:39:14.708660+0000","last_peered":"2023-10-08T12:39:14.708660+0000","last_clean":"2023-10-08T12:39:14.708660+0000","last_became_active":"2023-10-08T12:39:13.214205+0000","last_became_peered":"2023-10-08T12:39:13.214205+0000","last_unstale":"2023-10-08T12:39:14.708660+0000","last_undegraded":"2023-10-08T12:39:14.708660+0000","last_fullsized":"2023-10-08T12:39:14.708660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:58.572620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493406+0000","last_change":"2023-10-08T12:39:14.219813+0000","last_active":"2023-10-08T12:39:15.493406+0000","last_peered":"2023-10-08T12:39:15.493406+0000","last_clean":"2023-10-08T12:39:15.493406+0000","last_became_active":"2023-10-08T12:39:14.219511+0000","last_became_peered":"2023-10-08T12:39:14.219511+0000","last_unstale":"2023-10-08T12:39:15.493406+0000","last_undegraded":"2023-10-08T12:39:15.493406+0000","last_fullsized":"2023-10-08T12:39:15.493406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:43.716871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549057+0000","last_change":"2023-10-08T12:39:13.212567+0000","last_active":"2023-10-08T12:39:15.549057+0000","last_peered":"2023-10-08T12:39:15.549057+0000","last_clean":"2023-10-08T12:39:15.549057+0000","last_became_active":"2023-10-08T12:39:13.212079+0000","last_became_peered":"2023-10-08T12:39:13.212079+0000","last_unstale":"2023-10-08T12:39:15.549057+0000","last_undegraded":"2023-10-08T12:39:15.549057+0000","last_fullsized":"2023-10-08T12:39:15.549057+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:35.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549149+0000","last_change":"2023-10-08T12:39:14.208760+0000","last_active":"2023-10-08T12:39:15.549149+0000","last_peered":"2023-10-08T12:39:15.549149+0000","last_clean":"2023-10-08T12:39:15.549149+0000","last_became_active":"2023-10-08T12:39:14.208490+0000","last_became_peered":"2023-10-08T12:39:14.208490+0000","last_unstale":"2023-10-08T12:39:15.549149+0000","last_undegraded":"2023-10-08T12:39:15.549149+0000","last_fullsized":"2023-10-08T12:39:15.549149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:19:56.423514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056781+0000","last_change":"2023-10-08T12:39:13.214197+0000","last_active":"2023-10-08T12:39:15.056781+0000","last_peered":"2023-10-08T12:39:15.056781+0000","last_clean":"2023-10-08T12:39:15.056781+0000","last_became_active":"2023-10-08T12:39:13.213829+0000","last_became_peered":"2023-10-08T12:39:13.213829+0000","last_unstale":"2023-10-08T12:39:15.056781+0000","last_undegraded":"2023-10-08T12:39:15.056781+0000","last_fullsized":"2023-10-08T12:39:15.056781+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:29:05.080370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550089+0000","last_change":"2023-10-08T12:39:14.212369+0000","last_active":"2023-10-08T12:39:15.550089+0000","last_peered":"2023-10-08T12:39:15.550089+0000","last_clean":"2023-10-08T12:39:15.550089+0000","last_became_active":"2023-10-08T12:39:14.211917+0000","last_became_peered":"2023-10-08T12:39:14.211917+0000","last_unstale":"2023-10-08T12:39:15.550089+0000","last_undegraded":"2023-10-08T12:39:15.550089+0000","last_fullsized":"2023-10-08T12:39:15.550089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:27.265251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.199098+0000","last_change":"2023-10-08T12:39:13.217339+0000","last_active":"2023-10-08T12:39:14.199098+0000","last_peered":"2023-10-08T12:39:14.199098+0000","last_clean":"2023-10-08T12:39:14.199098+0000","last_became_active":"2023-10-08T12:39:13.216973+0000","last_became_peered":"2023-10-08T12:39:13.216973+0000","last_unstale":"2023-10-08T12:39:14.199098+0000","last_undegraded":"2023-10-08T12:39:14.199098+0000","last_fullsized":"2023-10-08T12:39:14.199098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:35.899844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.200919+0000","last_change":"2023-10-08T12:39:14.218870+0000","last_active":"2023-10-08T12:39:15.200919+0000","last_peered":"2023-10-08T12:39:15.200919+0000","last_clean":"2023-10-08T12:39:15.200919+0000","last_became_active":"2023-10-08T12:39:14.217879+0000","last_became_peered":"2023-10-08T12:39:14.217879+0000","last_unstale":"2023-10-08T12:39:15.200919+0000","last_undegraded":"2023-10-08T12:39:15.200919+0000","last_fullsized":"2023-10-08T12:39:15.200919+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:06.769081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549190+0000","last_change":"2023-10-08T12:39:13.209120+0000","last_active":"2023-10-08T12:39:15.549190+0000","last_peered":"2023-10-08T12:39:15.549190+0000","last_clean":"2023-10-08T12:39:15.549190+0000","last_became_active":"2023-10-08T12:39:13.208755+0000","last_became_peered":"2023-10-08T12:39:13.208755+0000","last_unstale":"2023-10-08T12:39:15.549190+0000","last_undegraded":"2023-10-08T12:39:15.549190+0000","last_fullsized":"2023-10-08T12:39:15.549190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:48.977375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203583+0000","last_change":"2023-10-08T12:39:14.208187+0000","last_active":"2023-10-08T12:39:15.203583+0000","last_peered":"2023-10-08T12:39:15.203583+0000","last_clean":"2023-10-08T12:39:15.203583+0000","last_became_active":"2023-10-08T12:39:14.207868+0000","last_became_peered":"2023-10-08T12:39:14.207868+0000","last_unstale":"2023-10-08T12:39:15.203583+0000","last_undegraded":"2023-10-08T12:39:15.203583+0000","last_fullsized":"2023-10-08T12:39:15.203583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:50.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853939+0000","last_change":"2023-10-08T12:39:13.220447+0000","last_active":"2023-10-08T12:39:14.853939+0000","last_peered":"2023-10-08T12:39:14.853939+0000","last_clean":"2023-10-08T12:39:14.853939+0000","last_became_active":"2023-10-08T12:39:13.220032+0000","last_became_peered":"2023-10-08T12:39:13.220032+0000","last_unstale":"2023-10-08T12:39:14.853939+0000","last_undegraded":"2023-10-08T12:39:14.853939+0000","last_fullsized":"2023-10-08T12:39:14.853939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:22.223707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549247+0000","last_change":"2023-10-08T12:39:14.214899+0000","last_active":"2023-10-08T12:39:15.549247+0000","last_peered":"2023-10-08T12:39:15.549247+0000","last_clean":"2023-10-08T12:39:15.549247+0000","last_became_active":"2023-10-08T12:39:14.214536+0000","last_became_peered":"2023-10-08T12:39:14.214536+0000","last_unstale":"2023-10-08T12:39:15.549247+0000","last_undegraded":"2023-10-08T12:39:15.549247+0000","last_fullsized":"2023-10-08T12:39:15.549247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:34.166298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.706531+0000","last_change":"2023-10-08T12:39:13.219131+0000","last_active":"2023-10-08T12:39:14.706531+0000","last_peered":"2023-10-08T12:39:14.706531+0000","last_clean":"2023-10-08T12:39:14.706531+0000","last_became_active":"2023-10-08T12:39:13.218639+0000","last_became_peered":"2023-10-08T12:39:13.218639+0000","last_unstale":"2023-10-08T12:39:14.706531+0000","last_undegraded":"2023-10-08T12:39:14.706531+0000","last_fullsized":"2023-10-08T12:39:14.706531+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.316153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203386+0000","last_change":"2023-10-08T12:39:14.212352+0000","last_active":"2023-10-08T12:39:15.203386+0000","last_peered":"2023-10-08T12:39:15.203386+0000","last_clean":"2023-10-08T12:39:15.203386+0000","last_became_active":"2023-10-08T12:39:14.211342+0000","last_became_peered":"2023-10-08T12:39:14.211342+0000","last_unstale":"2023-10-08T12:39:15.203386+0000","last_undegraded":"2023-10-08T12:39:15.203386+0000","last_fullsized":"2023-10-08T12:39:15.203386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:39:00.731860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'25","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:40:05.311533+0000","last_change":"2023-10-08T12:39:13.209967+0000","last_active":"2023-10-08T12:40:05.311533+0000","last_peered":"2023-10-08T12:40:05.311533+0000","last_clean":"2023-10-08T12:40:05.311533+0000","last_became_active":"2023-10-08T12:39:13.209650+0000","last_became_peered":"2023-10-08T12:39:13.209650+0000","last_unstale":"2023-10-08T12:40:05.311533+0000","last_undegraded":"2023-10-08T12:40:05.311533+0000","last_fullsized":"2023-10-08T12:40:05.311533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:08.206168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59160,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":108,"num_write":25,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493730+0000","last_change":"2023-10-08T12:39:14.211335+0000","last_active":"2023-10-08T12:39:15.493730+0000","last_peered":"2023-10-08T12:39:15.493730+0000","last_clean":"2023-10-08T12:39:15.493730+0000","last_became_active":"2023-10-08T12:39:14.211003+0000","last_became_peered":"2023-10-08T12:39:14.211003+0000","last_unstale":"2023-10-08T12:39:15.493730+0000","last_undegraded":"2023-10-08T12:39:15.493730+0000","last_fullsized":"2023-10-08T12:39:15.493730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:00.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201926+0000","last_change":"2023-10-08T12:39:13.215379+0000","last_active":"2023-10-08T12:39:15.201926+0000","last_peered":"2023-10-08T12:39:15.201926+0000","last_clean":"2023-10-08T12:39:15.201926+0000","last_became_active":"2023-10-08T12:39:13.215036+0000","last_became_peered":"2023-10-08T12:39:13.215036+0000","last_unstale":"2023-10-08T12:39:15.201926+0000","last_undegraded":"2023-10-08T12:39:15.201926+0000","last_fullsized":"2023-10-08T12:39:15.201926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:24.690473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549022+0000","last_change":"2023-10-08T12:39:14.207907+0000","last_active":"2023-10-08T12:39:15.549022+0000","last_peered":"2023-10-08T12:39:15.549022+0000","last_clean":"2023-10-08T12:39:15.549022+0000","last_became_active":"2023-10-08T12:39:14.207620+0000","last_became_peered":"2023-10-08T12:39:14.207620+0000","last_unstale":"2023-10-08T12:39:15.549022+0000","last_undegraded":"2023-10-08T12:39:15.549022+0000","last_fullsized":"2023-10-08T12:39:15.549022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:49:11.866245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.196556+0000","last_change":"2023-10-08T12:39:13.214521+0000","last_active":"2023-10-08T12:39:14.196556+0000","last_peered":"2023-10-08T12:39:14.196556+0000","last_clean":"2023-10-08T12:39:14.196556+0000","last_became_active":"2023-10-08T12:39:13.214127+0000","last_became_peered":"2023-10-08T12:39:13.214127+0000","last_unstale":"2023-10-08T12:39:14.196556+0000","last_undegraded":"2023-10-08T12:39:14.196556+0000","last_fullsized":"2023-10-08T12:39:14.196556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:46.735663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548940+0000","last_change":"2023-10-08T12:39:14.213542+0000","last_active":"2023-10-08T12:39:15.548940+0000","last_peered":"2023-10-08T12:39:15.548940+0000","last_clean":"2023-10-08T12:39:15.548940+0000","last_became_active":"2023-10-08T12:39:14.213295+0000","last_became_peered":"2023-10-08T12:39:14.213295+0000","last_unstale":"2023-10-08T12:39:15.548940+0000","last_undegraded":"2023-10-08T12:39:15.548940+0000","last_fullsized":"2023-10-08T12:39:15.548940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:46.883656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405433+0000","last_change":"2023-10-08T12:39:13.214758+0000","last_active":"2023-10-08T12:39:15.405433+0000","last_peered":"2023-10-08T12:39:15.405433+0000","last_clean":"2023-10-08T12:39:15.405433+0000","last_became_active":"2023-10-08T12:39:13.214304+0000","last_became_peered":"2023-10-08T12:39:13.214304+0000","last_unstale":"2023-10-08T12:39:15.405433+0000","last_undegraded":"2023-10-08T12:39:15.405433+0000","last_fullsized":"2023-10-08T12:39:15.405433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:34.074248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548713+0000","last_change":"2023-10-08T12:39:14.208071+0000","last_active":"2023-10-08T12:39:15.548713+0000","last_peered":"2023-10-08T12:39:15.548713+0000","last_clean":"2023-10-08T12:39:15.548713+0000","last_became_active":"2023-10-08T12:39:14.207787+0000","last_became_peered":"2023-10-08T12:39:14.207787+0000","last_unstale":"2023-10-08T12:39:15.548713+0000","last_undegraded":"2023-10-08T12:39:15.548713+0000","last_fullsized":"2023-10-08T12:39:15.548713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:40.869575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.708642+0000","last_change":"2023-10-08T12:39:13.219105+0000","last_active":"2023-10-08T12:39:14.708642+0000","last_peered":"2023-10-08T12:39:14.708642+0000","last_clean":"2023-10-08T12:39:14.708642+0000","last_became_active":"2023-10-08T12:39:13.218767+0000","last_became_peered":"2023-10-08T12:39:13.218767+0000","last_unstale":"2023-10-08T12:39:14.708642+0000","last_undegraded":"2023-10-08T12:39:14.708642+0000","last_fullsized":"2023-10-08T12:39:14.708642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:22.763921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548972+0000","last_change":"2023-10-08T12:39:14.210037+0000","last_active":"2023-10-08T12:39:15.548972+0000","last_peered":"2023-10-08T12:39:15.548972+0000","last_clean":"2023-10-08T12:39:15.548972+0000","last_became_active":"2023-10-08T12:39:14.208140+0000","last_became_peered":"2023-10-08T12:39:14.208140+0000","last_unstale":"2023-10-08T12:39:15.548972+0000","last_undegraded":"2023-10-08T12:39:15.548972+0000","last_fullsized":"2023-10-08T12:39:15.548972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:38.475668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493819+0000","last_change":"2023-10-08T12:39:13.219229+0000","last_active":"2023-10-08T12:39:15.493819+0000","last_peered":"2023-10-08T12:39:15.493819+0000","last_clean":"2023-10-08T12:39:15.493819+0000","last_became_active":"2023-10-08T12:39:13.217964+0000","last_became_peered":"2023-10-08T12:39:13.217964+0000","last_unstale":"2023-10-08T12:39:15.493819+0000","last_undegraded":"2023-10-08T12:39:15.493819+0000","last_fullsized":"2023-10-08T12:39:15.493819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:47.480351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670304+0000","last_change":"2023-10-08T12:39:14.199562+0000","last_active":"2023-10-08T12:39:15.670304+0000","last_peered":"2023-10-08T12:39:15.670304+0000","last_clean":"2023-10-08T12:39:15.670304+0000","last_became_active":"2023-10-08T12:39:14.199235+0000","last_became_peered":"2023-10-08T12:39:14.199235+0000","last_unstale":"2023-10-08T12:39:15.670304+0000","last_undegraded":"2023-10-08T12:39:15.670304+0000","last_fullsized":"2023-10-08T12:39:15.670304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:17.181406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.192321+0000","last_change":"2023-10-08T12:39:13.212791+0000","last_active":"2023-10-08T12:39:14.192321+0000","last_peered":"2023-10-08T12:39:14.192321+0000","last_clean":"2023-10-08T12:39:14.192321+0000","last_became_active":"2023-10-08T12:39:13.212146+0000","last_became_peered":"2023-10-08T12:39:13.212146+0000","last_unstale":"2023-10-08T12:39:14.192321+0000","last_undegraded":"2023-10-08T12:39:14.192321+0000","last_fullsized":"2023-10-08T12:39:14.192321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:37.452859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.615669+0000","last_change":"2023-10-08T12:39:14.215081+0000","last_active":"2023-10-08T12:39:15.615669+0000","last_peered":"2023-10-08T12:39:15.615669+0000","last_clean":"2023-10-08T12:39:15.615669+0000","last_became_active":"2023-10-08T12:39:14.214825+0000","last_became_peered":"2023-10-08T12:39:14.214825+0000","last_unstale":"2023-10-08T12:39:15.615669+0000","last_undegraded":"2023-10-08T12:39:15.615669+0000","last_fullsized":"2023-10-08T12:39:15.615669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:05.706569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853878+0000","last_change":"2023-10-08T12:39:13.217672+0000","last_active":"2023-10-08T12:39:14.853878+0000","last_peered":"2023-10-08T12:39:14.853878+0000","last_clean":"2023-10-08T12:39:14.853878+0000","last_became_active":"2023-10-08T12:39:13.217277+0000","last_became_peered":"2023-10-08T12:39:13.217277+0000","last_unstale":"2023-10-08T12:39:14.853878+0000","last_undegraded":"2023-10-08T12:39:14.853878+0000","last_fullsized":"2023-10-08T12:39:14.853878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:41.097439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549447+0000","last_change":"2023-10-08T12:39:14.219261+0000","last_active":"2023-10-08T12:39:15.549447+0000","last_peered":"2023-10-08T12:39:15.549447+0000","last_clean":"2023-10-08T12:39:15.549447+0000","last_became_active":"2023-10-08T12:39:14.218963+0000","last_became_peered":"2023-10-08T12:39:14.218963+0000","last_unstale":"2023-10-08T12:39:15.549447+0000","last_undegraded":"2023-10-08T12:39:15.549447+0000","last_fullsized":"2023-10-08T12:39:15.549447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:19.573306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549170+0000","last_change":"2023-10-08T12:39:14.207923+0000","last_active":"2023-10-08T12:39:15.549170+0000","last_peered":"2023-10-08T12:39:15.549170+0000","last_clean":"2023-10-08T12:39:15.549170+0000","last_became_active":"2023-10-08T12:39:14.207634+0000","last_became_peered":"2023-10-08T12:39:14.207634+0000","last_unstale":"2023-10-08T12:39:15.549170+0000","last_undegraded":"2023-10-08T12:39:15.549170+0000","last_fullsized":"2023-10-08T12:39:15.549170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:39.634945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056769+0000","last_change":"2023-10-08T12:39:13.223021+0000","last_active":"2023-10-08T12:39:15.056769+0000","last_peered":"2023-10-08T12:39:15.056769+0000","last_clean":"2023-10-08T12:39:15.056769+0000","last_became_active":"2023-10-08T12:39:13.222680+0000","last_became_peered":"2023-10-08T12:39:13.222680+0000","last_unstale":"2023-10-08T12:39:15.056769+0000","last_undegraded":"2023-10-08T12:39:15.056769+0000","last_fullsized":"2023-10-08T12:39:15.056769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:40.454436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549663+0000","last_change":"2023-10-08T12:39:14.217364+0000","last_active":"2023-10-08T12:39:15.549663+0000","last_peered":"2023-10-08T12:39:15.549663+0000","last_clean":"2023-10-08T12:39:15.549663+0000","last_became_active":"2023-10-08T12:39:14.216984+0000","last_became_peered":"2023-10-08T12:39:14.216984+0000","last_unstale":"2023-10-08T12:39:15.549663+0000","last_undegraded":"2023-10-08T12:39:15.549663+0000","last_fullsized":"2023-10-08T12:39:15.549663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:11:51.818034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405564+0000","last_change":"2023-10-08T12:39:13.207687+0000","last_active":"2023-10-08T12:39:15.405564+0000","last_peered":"2023-10-08T12:39:15.405564+0000","last_clean":"2023-10-08T12:39:15.405564+0000","last_became_active":"2023-10-08T12:39:13.207270+0000","last_became_peered":"2023-10-08T12:39:13.207270+0000","last_unstale":"2023-10-08T12:39:15.405564+0000","last_undegraded":"2023-10-08T12:39:15.405564+0000","last_fullsized":"2023-10-08T12:39:15.405564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:44.673383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.200716+0000","last_change":"2023-10-08T12:38:07.696721+0000","last_active":"2023-10-08T12:39:14.200716+0000","last_peered":"2023-10-08T12:39:14.200716+0000","last_clean":"2023-10-08T12:39:14.200716+0000","last_became_active":"2023-10-08T12:38:07.696336+0000","last_became_peered":"2023-10-08T12:38:07.696336+0000","last_unstale":"2023-10-08T12:39:14.200716+0000","last_undegraded":"2023-10-08T12:39:14.200716+0000","last_fullsized":"2023-10-08T12:39:14.200716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_clean_scrub_stamp":"2023-10-08T12:34:57.643348+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:01.821924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548781+0000","last_change":"2023-10-08T12:39:14.208845+0000","last_active":"2023-10-08T12:39:15.548781+0000","last_peered":"2023-10-08T12:39:15.548781+0000","last_clean":"2023-10-08T12:39:15.548781+0000","last_became_active":"2023-10-08T12:39:14.208487+0000","last_became_peered":"2023-10-08T12:39:14.208487+0000","last_unstale":"2023-10-08T12:39:15.548781+0000","last_undegraded":"2023-10-08T12:39:15.548781+0000","last_fullsized":"2023-10-08T12:39:15.548781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:26.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853797+0000","last_change":"2023-10-08T12:39:13.216627+0000","last_active":"2023-10-08T12:39:14.853797+0000","last_peered":"2023-10-08T12:39:14.853797+0000","last_clean":"2023-10-08T12:39:14.853797+0000","last_became_active":"2023-10-08T12:39:13.216201+0000","last_became_peered":"2023-10-08T12:39:13.216201+0000","last_unstale":"2023-10-08T12:39:14.853797+0000","last_undegraded":"2023-10-08T12:39:14.853797+0000","last_fullsized":"2023-10-08T12:39:14.853797+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:19.873615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.199877+0000","last_change":"2023-10-08T12:39:13.219222+0000","last_active":"2023-10-08T12:39:14.199877+0000","last_peered":"2023-10-08T12:39:14.199877+0000","last_clean":"2023-10-08T12:39:14.199877+0000","last_became_active":"2023-10-08T12:39:13.218757+0000","last_became_peered":"2023-10-08T12:39:13.218757+0000","last_unstale":"2023-10-08T12:39:14.199877+0000","last_undegraded":"2023-10-08T12:39:14.199877+0000","last_fullsized":"2023-10-08T12:39:14.199877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:15.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549929+0000","last_change":"2023-10-08T12:39:14.221945+0000","last_active":"2023-10-08T12:39:15.549929+0000","last_peered":"2023-10-08T12:39:15.549929+0000","last_clean":"2023-10-08T12:39:15.549929+0000","last_became_active":"2023-10-08T12:39:14.221625+0000","last_became_peered":"2023-10-08T12:39:14.221625+0000","last_unstale":"2023-10-08T12:39:15.549929+0000","last_undegraded":"2023-10-08T12:39:15.549929+0000","last_fullsized":"2023-10-08T12:39:15.549929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:50.424023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:22.808035+0000","last_change":"2023-10-08T12:39:13.213666+0000","last_active":"2023-10-08T12:39:22.808035+0000","last_peered":"2023-10-08T12:39:22.808035+0000","last_clean":"2023-10-08T12:39:22.808035+0000","last_became_active":"2023-10-08T12:39:13.213323+0000","last_became_peered":"2023-10-08T12:39:13.213323+0000","last_unstale":"2023-10-08T12:39:22.808035+0000","last_undegraded":"2023-10-08T12:39:22.808035+0000","last_fullsized":"2023-10-08T12:39:22.808035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:50:30.471672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550265+0000","last_change":"2023-10-08T12:39:14.214849+0000","last_active":"2023-10-08T12:39:15.550265+0000","last_peered":"2023-10-08T12:39:15.550265+0000","last_clean":"2023-10-08T12:39:15.550265+0000","last_became_active":"2023-10-08T12:39:14.214573+0000","last_became_peered":"2023-10-08T12:39:14.214573+0000","last_unstale":"2023-10-08T12:39:15.550265+0000","last_undegraded":"2023-10-08T12:39:15.550265+0000","last_fullsized":"2023-10-08T12:39:15.550265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:50.922519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.405780+0000","last_change":"2023-10-08T12:39:13.206518+0000","last_active":"2023-10-08T12:39:15.405780+0000","last_peered":"2023-10-08T12:39:15.405780+0000","last_clean":"2023-10-08T12:39:15.405780+0000","last_became_active":"2023-10-08T12:39:13.206082+0000","last_became_peered":"2023-10-08T12:39:13.206082+0000","last_unstale":"2023-10-08T12:39:15.405780+0000","last_undegraded":"2023-10-08T12:39:15.405780+0000","last_fullsized":"2023-10-08T12:39:15.405780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:47.980651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548913+0000","last_change":"2023-10-08T12:39:14.220897+0000","last_active":"2023-10-08T12:39:15.548913+0000","last_peered":"2023-10-08T12:39:15.548913+0000","last_clean":"2023-10-08T12:39:15.548913+0000","last_became_active":"2023-10-08T12:39:14.220173+0000","last_became_peered":"2023-10-08T12:39:14.220173+0000","last_unstale":"2023-10-08T12:39:15.548913+0000","last_undegraded":"2023-10-08T12:39:15.548913+0000","last_fullsized":"2023-10-08T12:39:15.548913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:09:02.588054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.197390+0000","last_change":"2023-10-08T12:39:13.213505+0000","last_active":"2023-10-08T12:39:14.197390+0000","last_peered":"2023-10-08T12:39:14.197390+0000","last_clean":"2023-10-08T12:39:14.197390+0000","last_became_active":"2023-10-08T12:39:13.213199+0000","last_became_peered":"2023-10-08T12:39:13.213199+0000","last_unstale":"2023-10-08T12:39:14.197390+0000","last_undegraded":"2023-10-08T12:39:14.197390+0000","last_fullsized":"2023-10-08T12:39:14.197390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:49.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493387+0000","last_change":"2023-10-08T12:39:14.208080+0000","last_active":"2023-10-08T12:39:15.493387+0000","last_peered":"2023-10-08T12:39:15.493387+0000","last_clean":"2023-10-08T12:39:15.493387+0000","last_became_active":"2023-10-08T12:39:14.207788+0000","last_became_peered":"2023-10-08T12:39:14.207788+0000","last_unstale":"2023-10-08T12:39:15.493387+0000","last_undegraded":"2023-10-08T12:39:15.493387+0000","last_fullsized":"2023-10-08T12:39:15.493387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:44.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.534523+0000","last_change":"2023-10-08T12:39:13.216003+0000","last_active":"2023-10-08T12:39:14.534523+0000","last_peered":"2023-10-08T12:39:14.534523+0000","last_clean":"2023-10-08T12:39:14.534523+0000","last_became_active":"2023-10-08T12:39:13.215662+0000","last_became_peered":"2023-10-08T12:39:13.215662+0000","last_unstale":"2023-10-08T12:39:14.534523+0000","last_undegraded":"2023-10-08T12:39:14.534523+0000","last_fullsized":"2023-10-08T12:39:14.534523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:28.310430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670191+0000","last_change":"2023-10-08T12:39:14.204336+0000","last_active":"2023-10-08T12:39:15.670191+0000","last_peered":"2023-10-08T12:39:15.670191+0000","last_clean":"2023-10-08T12:39:15.670191+0000","last_became_active":"2023-10-08T12:39:14.203993+0000","last_became_peered":"2023-10-08T12:39:14.203993+0000","last_unstale":"2023-10-08T12:39:15.670191+0000","last_undegraded":"2023-10-08T12:39:15.670191+0000","last_fullsized":"2023-10-08T12:39:15.670191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:54.545166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.193182+0000","last_change":"2023-10-08T12:39:13.214767+0000","last_active":"2023-10-08T12:39:14.193182+0000","last_peered":"2023-10-08T12:39:14.193182+0000","last_clean":"2023-10-08T12:39:14.193182+0000","last_became_active":"2023-10-08T12:39:13.214431+0000","last_became_peered":"2023-10-08T12:39:13.214431+0000","last_unstale":"2023-10-08T12:39:14.193182+0000","last_undegraded":"2023-10-08T12:39:14.193182+0000","last_fullsized":"2023-10-08T12:39:14.193182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:51.062301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549952+0000","last_change":"2023-10-08T12:39:14.221040+0000","last_active":"2023-10-08T12:39:15.549952+0000","last_peered":"2023-10-08T12:39:15.549952+0000","last_clean":"2023-10-08T12:39:15.549952+0000","last_became_active":"2023-10-08T12:39:14.220724+0000","last_became_peered":"2023-10-08T12:39:14.220724+0000","last_unstale":"2023-10-08T12:39:15.549952+0000","last_undegraded":"2023-10-08T12:39:15.549952+0000","last_fullsized":"2023-10-08T12:39:15.549952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:52.824228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.493423+0000","last_change":"2023-10-08T12:39:13.212244+0000","last_active":"2023-10-08T12:39:15.493423+0000","last_peered":"2023-10-08T12:39:15.493423+0000","last_clean":"2023-10-08T12:39:15.493423+0000","last_became_active":"2023-10-08T12:39:13.212028+0000","last_became_peered":"2023-10-08T12:39:13.212028+0000","last_unstale":"2023-10-08T12:39:15.493423+0000","last_undegraded":"2023-10-08T12:39:15.493423+0000","last_fullsized":"2023-10-08T12:39:15.493423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:06.111807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548953+0000","last_change":"2023-10-08T12:39:14.216665+0000","last_active":"2023-10-08T12:39:15.548953+0000","last_peered":"2023-10-08T12:39:15.548953+0000","last_clean":"2023-10-08T12:39:15.548953+0000","last_became_active":"2023-10-08T12:39:14.216330+0000","last_became_peered":"2023-10-08T12:39:14.216330+0000","last_unstale":"2023-10-08T12:39:15.548953+0000","last_undegraded":"2023-10-08T12:39:15.548953+0000","last_fullsized":"2023-10-08T12:39:15.548953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.658600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.193201+0000","last_change":"2023-10-08T12:39:13.214495+0000","last_active":"2023-10-08T12:39:14.193201+0000","last_peered":"2023-10-08T12:39:14.193201+0000","last_clean":"2023-10-08T12:39:14.193201+0000","last_became_active":"2023-10-08T12:39:13.213930+0000","last_became_peered":"2023-10-08T12:39:13.213930+0000","last_unstale":"2023-10-08T12:39:14.193201+0000","last_undegraded":"2023-10-08T12:39:14.193201+0000","last_fullsized":"2023-10-08T12:39:14.193201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:20:38.096164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549209+0000","last_change":"2023-10-08T12:39:14.212566+0000","last_active":"2023-10-08T12:39:15.549209+0000","last_peered":"2023-10-08T12:39:15.549209+0000","last_clean":"2023-10-08T12:39:15.549209+0000","last_became_active":"2023-10-08T12:39:14.211756+0000","last_became_peered":"2023-10-08T12:39:14.211756+0000","last_unstale":"2023-10-08T12:39:15.549209+0000","last_undegraded":"2023-10-08T12:39:15.549209+0000","last_fullsized":"2023-10-08T12:39:15.549209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:12.741640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549200+0000","last_change":"2023-10-08T12:39:13.217914+0000","last_active":"2023-10-08T12:39:15.549200+0000","last_peered":"2023-10-08T12:39:15.549200+0000","last_clean":"2023-10-08T12:39:15.549200+0000","last_became_active":"2023-10-08T12:39:13.217571+0000","last_became_peered":"2023-10-08T12:39:13.217571+0000","last_unstale":"2023-10-08T12:39:15.549200+0000","last_undegraded":"2023-10-08T12:39:15.549200+0000","last_fullsized":"2023-10-08T12:39:15.549200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:10.826007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548869+0000","last_change":"2023-10-08T12:39:14.214280+0000","last_active":"2023-10-08T12:39:15.548869+0000","last_peered":"2023-10-08T12:39:15.548869+0000","last_clean":"2023-10-08T12:39:15.548869+0000","last_became_active":"2023-10-08T12:39:14.213942+0000","last_became_peered":"2023-10-08T12:39:14.213942+0000","last_unstale":"2023-10-08T12:39:15.548869+0000","last_undegraded":"2023-10-08T12:39:15.548869+0000","last_fullsized":"2023-10-08T12:39:15.548869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:17:21.450265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056839+0000","last_change":"2023-10-08T12:39:13.222484+0000","last_active":"2023-10-08T12:39:15.056839+0000","last_peered":"2023-10-08T12:39:15.056839+0000","last_clean":"2023-10-08T12:39:15.056839+0000","last_became_active":"2023-10-08T12:39:13.222091+0000","last_became_peered":"2023-10-08T12:39:13.222091+0000","last_unstale":"2023-10-08T12:39:15.056839+0000","last_undegraded":"2023-10-08T12:39:15.056839+0000","last_fullsized":"2023-10-08T12:39:15.056839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:00.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549425+0000","last_change":"2023-10-08T12:39:14.207715+0000","last_active":"2023-10-08T12:39:15.549425+0000","last_peered":"2023-10-08T12:39:15.549425+0000","last_clean":"2023-10-08T12:39:15.549425+0000","last_became_active":"2023-10-08T12:39:14.207429+0000","last_became_peered":"2023-10-08T12:39:14.207429+0000","last_unstale":"2023-10-08T12:39:15.549425+0000","last_undegraded":"2023-10-08T12:39:15.549425+0000","last_fullsized":"2023-10-08T12:39:15.549425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:16.991831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670238+0000","last_change":"2023-10-08T12:39:14.200398+0000","last_active":"2023-10-08T12:39:15.670238+0000","last_peered":"2023-10-08T12:39:15.670238+0000","last_clean":"2023-10-08T12:39:15.670238+0000","last_became_active":"2023-10-08T12:39:14.200035+0000","last_became_peered":"2023-10-08T12:39:14.200035+0000","last_unstale":"2023-10-08T12:39:15.670238+0000","last_undegraded":"2023-10-08T12:39:15.670238+0000","last_fullsized":"2023-10-08T12:39:15.670238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:13.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201966+0000","last_change":"2023-10-08T12:39:14.202185+0000","last_active":"2023-10-08T12:39:15.201966+0000","last_peered":"2023-10-08T12:39:15.201966+0000","last_clean":"2023-10-08T12:39:15.201966+0000","last_became_active":"2023-10-08T12:39:14.201232+0000","last_became_peered":"2023-10-08T12:39:14.201232+0000","last_unstale":"2023-10-08T12:39:15.201966+0000","last_undegraded":"2023-10-08T12:39:15.201966+0000","last_fullsized":"2023-10-08T12:39:15.201966+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:50.949047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201847+0000","last_change":"2023-10-08T12:39:14.208014+0000","last_active":"2023-10-08T12:39:15.201847+0000","last_peered":"2023-10-08T12:39:15.201847+0000","last_clean":"2023-10-08T12:39:15.201847+0000","last_became_active":"2023-10-08T12:39:14.207579+0000","last_became_peered":"2023-10-08T12:39:14.207579+0000","last_unstale":"2023-10-08T12:39:15.201847+0000","last_undegraded":"2023-10-08T12:39:15.201847+0000","last_fullsized":"2023-10-08T12:39:15.201847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:37.352827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549736+0000","last_change":"2023-10-08T12:39:14.210834+0000","last_active":"2023-10-08T12:39:15.549736+0000","last_peered":"2023-10-08T12:39:15.549736+0000","last_clean":"2023-10-08T12:39:15.549736+0000","last_became_active":"2023-10-08T12:39:14.210486+0000","last_became_peered":"2023-10-08T12:39:14.210486+0000","last_unstale":"2023-10-08T12:39:15.549736+0000","last_undegraded":"2023-10-08T12:39:15.549736+0000","last_fullsized":"2023-10-08T12:39:15.549736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:36.252533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549923+0000","last_change":"2023-10-08T12:39:14.222630+0000","last_active":"2023-10-08T12:39:15.549923+0000","last_peered":"2023-10-08T12:39:15.549923+0000","last_clean":"2023-10-08T12:39:15.549923+0000","last_became_active":"2023-10-08T12:39:14.222300+0000","last_became_peered":"2023-10-08T12:39:14.222300+0000","last_unstale":"2023-10-08T12:39:15.549923+0000","last_undegraded":"2023-10-08T12:39:15.549923+0000","last_fullsized":"2023-10-08T12:39:15.549923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.040227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670356+0000","last_change":"2023-10-08T12:39:14.207144+0000","last_active":"2023-10-08T12:39:15.670356+0000","last_peered":"2023-10-08T12:39:15.670356+0000","last_clean":"2023-10-08T12:39:15.670356+0000","last_became_active":"2023-10-08T12:39:14.206775+0000","last_became_peered":"2023-10-08T12:39:14.206775+0000","last_unstale":"2023-10-08T12:39:15.670356+0000","last_undegraded":"2023-10-08T12:39:15.670356+0000","last_fullsized":"2023-10-08T12:39:15.670356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:55.224270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.202113+0000","last_change":"2023-10-08T12:39:14.204123+0000","last_active":"2023-10-08T12:39:15.202113+0000","last_peered":"2023-10-08T12:39:15.202113+0000","last_clean":"2023-10-08T12:39:15.202113+0000","last_became_active":"2023-10-08T12:39:14.203123+0000","last_became_peered":"2023-10-08T12:39:14.203123+0000","last_unstale":"2023-10-08T12:39:15.202113+0000","last_undegraded":"2023-10-08T12:39:15.202113+0000","last_fullsized":"2023-10-08T12:39:15.202113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:45.423095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550121+0000","last_change":"2023-10-08T12:39:14.211049+0000","last_active":"2023-10-08T12:39:15.550121+0000","last_peered":"2023-10-08T12:39:15.550121+0000","last_clean":"2023-10-08T12:39:15.550121+0000","last_became_active":"2023-10-08T12:39:14.210738+0000","last_became_peered":"2023-10-08T12:39:14.210738+0000","last_unstale":"2023-10-08T12:39:15.550121+0000","last_undegraded":"2023-10-08T12:39:15.550121+0000","last_fullsized":"2023-10-08T12:39:15.550121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:12.535857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549047+0000","last_change":"2023-10-08T12:39:14.220013+0000","last_active":"2023-10-08T12:39:15.549047+0000","last_peered":"2023-10-08T12:39:15.549047+0000","last_clean":"2023-10-08T12:39:15.549047+0000","last_became_active":"2023-10-08T12:39:14.219711+0000","last_became_peered":"2023-10-08T12:39:14.219711+0000","last_unstale":"2023-10-08T12:39:15.549047+0000","last_undegraded":"2023-10-08T12:39:15.549047+0000","last_fullsized":"2023-10-08T12:39:15.549047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:23.205074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549313+0000","last_change":"2023-10-08T12:39:14.214237+0000","last_active":"2023-10-08T12:39:15.549313+0000","last_peered":"2023-10-08T12:39:15.549313+0000","last_clean":"2023-10-08T12:39:15.549313+0000","last_became_active":"2023-10-08T12:39:14.213891+0000","last_became_peered":"2023-10-08T12:39:14.213891+0000","last_unstale":"2023-10-08T12:39:15.549313+0000","last_undegraded":"2023-10-08T12:39:15.549313+0000","last_fullsized":"2023-10-08T12:39:15.549313+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:11.348411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.203309+0000","last_change":"2023-10-08T12:39:14.209037+0000","last_active":"2023-10-08T12:39:15.203309+0000","last_peered":"2023-10-08T12:39:15.203309+0000","last_clean":"2023-10-08T12:39:15.203309+0000","last_became_active":"2023-10-08T12:39:14.208728+0000","last_became_peered":"2023-10-08T12:39:14.208728+0000","last_unstale":"2023-10-08T12:39:15.203309+0000","last_undegraded":"2023-10-08T12:39:15.203309+0000","last_fullsized":"2023-10-08T12:39:15.203309+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:23.440413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549527+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:39:15.549527+0000","last_peered":"2023-10-08T12:39:15.549527+0000","last_clean":"2023-10-08T12:39:15.549527+0000","last_became_active":"2023-10-08T12:39:14.222393+0000","last_became_peered":"2023-10-08T12:39:14.222393+0000","last_unstale":"2023-10-08T12:39:15.549527+0000","last_undegraded":"2023-10-08T12:39:15.549527+0000","last_fullsized":"2023-10-08T12:39:15.549527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:19.704140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.670257+0000","last_change":"2023-10-08T12:39:14.200858+0000","last_active":"2023-10-08T12:39:15.670257+0000","last_peered":"2023-10-08T12:39:15.670257+0000","last_clean":"2023-10-08T12:39:15.670257+0000","last_became_active":"2023-10-08T12:39:14.199948+0000","last_became_peered":"2023-10-08T12:39:14.199948+0000","last_unstale":"2023-10-08T12:39:15.670257+0000","last_undegraded":"2023-10-08T12:39:15.670257+0000","last_fullsized":"2023-10-08T12:39:15.670257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:10.366380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281436,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59958,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":110,"num_read_kb":114,"num_write":68,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":179874,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416408,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":444535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.44},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.68999999999999995}]},{"osd":1,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54800000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.48799999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.745}]},{"osd":7,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58599999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.71699999999999997}]},{"osd":10,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.78500000000000003}]}]},{"osd":10,"up_from":72,"seq":309237645339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":1094049,"data_compressed":37403,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.42099999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69099999999999995}]},{"osd":4,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.59099999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65400000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.753}]},{"osd":7,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65900000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.63200000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67900000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.80100000000000005}]}]},{"osd":9,"up_from":67,"seq":287762808863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":445117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.41299999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.497,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.747}]},{"osd":2,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":3.1269999999999998,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.621},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58299999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.212,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.82699999999999996,"15min":0.83499999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.88600000000000001,"15min":0.90000000000000002},"min":{"1min":0.60899999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":1.325,"15min":1.325},"last":0.64800000000000002}]},{"osd":6,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.93799999999999994,"15min":0.94699999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.0720000000000001,"5min":3.0720000000000001,"15min":3.0720000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.86599999999999999,"15min":0.874},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.93100000000000005,"15min":0.94699999999999995},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2729999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.999,"15min":1.0029999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.98,"5min":2.98,"15min":2.98},"last":0.79000000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.016,"15min":1.0249999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.96199999999999997,"15min":0.97199999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.77300000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.95899999999999996,"15min":0.95299999999999996},"min":{"1min":0.63500000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.90300000000000002,"15min":0.90400000000000003},"min":{"1min":0.60799999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.80600000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070500,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":444808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.496}]},{"osd":1,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71699999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.28399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.44500000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.40000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83699999999999997,"5min":0.879,"15min":0.879},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66000000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.43099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.34499999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.83299999999999996}]},{"osd":7,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98899999999999999,"5min":1.181,"15min":1.181},"last":0.77700000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.75900000000000001,"15min":0.753},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.75800000000000001,"15min":0.746},"min":{"1min":0.57399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.76800000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.77400000000000002,"15min":0.76500000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.752},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.54300000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70399999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":7,"up_from":52,"seq":223338299433,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":1035608,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.877,"15min":0.877},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.434},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.372}]},{"osd":2,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.745,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.69399999999999995}]},{"osd":4,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40799999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82899999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.70799999999999996}]},{"osd":6,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.67000000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56000000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.88400000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.80700000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.75700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462957,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":444658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.51700000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79400000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66200000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.56399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76100000000000001,"15min":0.77000000000000002},"min":{"1min":0.497,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.83599999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.032,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.747},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.76500000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.73499999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82099999999999995,"5min":6.875,"15min":6.875},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0229999999999999,"5min":1.095,"15min":1.095},"last":0.70799999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.125,"15min":1.125},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83299999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.79900000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:39:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81000000000000005,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.86099999999999999,"15min":0.83299999999999996},"min":{"1min":0.66900000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.78200000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.95999999999999996,"15min":0.97499999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1200000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.876},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84599999999999997,"15min":0.85199999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.82299999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.91400000000000003}]},{"osd":10,"last update":"Sun Oct 8 12:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.93400000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542214,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":503364,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.67000000000000004,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73099999999999998,"5min":1.452,"15min":1.452},"last":0.61799999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.35899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59199999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:39:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74299999999999999,"5min":1.413,"15min":1.413},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.57199999999999995},"min":{"1min":0.41799999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":1.427,"15min":1.427},"last":0.68700000000000006}]},{"osd":4,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.42999999999999999,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.502},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.42999999999999999,"15min":0.39800000000000002},"min":{"1min":0.316,"5min":0.245,"15min":0.245},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.72299999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.46999999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.123,"5min":1.355,"15min":1.355},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.99199999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Sun Oct 8 12:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.748}]},{"osd":8,"last update":"Sun Oct 8 12:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.625},"min":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.64700000000000002,"15min":0.63200000000000001},"min":{"1min":0.505,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.95099999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73199999999999998,"15min":0.72199999999999998},"min":{"1min":0.50800000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.96399999999999997}]},{"osd":10,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.86399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":444625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:39:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.56000000000000005},"min":{"1min":0.35199999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63500000000000001,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.046},"last":0.61699999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.628,"15min":0.57999999999999996},"min":{"1min":0.48799999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.622,"15min":0.58299999999999996},"min":{"1min":0.48899999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.998,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.66100000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:39:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66100000000000003,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.52300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0109999999999999,"5min":1.911,"15min":1.911},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.69099999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92100000000000004,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.745,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.89100000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.50600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.873,"15min":0.879},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.048,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.79900000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.88200000000000001,"15min":0.89900000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.24,"15min":1.24},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.92900000000000005,"15min":0.94299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1259999999999999,"5min":1.298,"15min":1.298},"last":0.96299999999999997}]},{"osd":10,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.65100000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.873}]}]},{"osd":2,"up_from":19,"seq":81604378689,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":503729,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.88500000000000001,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.88700000000000001,"5min":1.194,"15min":1.194},"last":0.48499999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.54100000000000004,"15min":0.51400000000000001},"min":{"1min":0.41999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55100000000000005,"15min":0.51500000000000001},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63100000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83299999999999996,"5min":1.073,"15min":1.073},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91500000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.45100000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.435,"5min":0.378,"15min":0.378},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.71499999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.40999999999999998},"min":{"1min":0.28799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.501},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.44,"15min":0.42599999999999999},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.64400000000000002}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.621,"15min":0.59899999999999998},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":1.04,"15min":1.04},"last":0.45000000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.73599999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:39:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95099999999999996,"5min":1.024,"15min":1.024},"last":0.753},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77900000000000003,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.85299999999999998,"5min":1.087,"15min":1.087},"last":0.60099999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.85299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149755,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":444554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46800000000000003,"15min":0.42999999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.72899999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.504,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81899999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.57499999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.60899999999999999},"min":{"1min":0.53800000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":1.081,"15min":1.081},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.63200000000000001,"15min":0.59899999999999998},"min":{"1min":0.495,"5min":0.371,"15min":0.371},"max":{"1min":0.92600000000000005,"5min":1.05,"15min":1.05},"last":0.81100000000000005}]},{"osd":2,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.42899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88700000000000001,"5min":1.077,"15min":1.077},"last":0.623},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70599999999999996,"15min":0.68700000000000006},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.98099999999999998,"5min":1.23,"15min":1.23},"last":0.65900000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67900000000000005,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71899999999999997,"15min":0.66700000000000004},"min":{"1min":0.57299999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.042,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73499999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98499999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.70899999999999996,"15min":0.69199999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0669999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":1.0069999999999999,"5min":1.109,"15min":1.109},"last":0.64100000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61799999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.069,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.53100000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0840000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.77700000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.89400000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.96499999999999997,"15min":0.998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1739999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.91900000000000004,"15min":0.93500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.121,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.82499999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.90100000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":4,"up_from":34,"seq":146028888120,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":444557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67100000000000004,"15min":0.71999999999999997},"min":{"1min":0.439,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":6.0549999999999997,"15min":6.0549999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39500000000000002,"15min":0.36099999999999999},"min":{"1min":0.33000000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.629,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.38400000000000001},"min":{"1min":0.32400000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.74099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52000000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.58699999999999997,"15min":0.56000000000000005},"min":{"1min":0.52300000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.54400000000000004,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61399999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57999999999999996,"15min":0.53200000000000003},"min":{"1min":0.45700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58299999999999996,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83099999999999996,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.65900000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.59499999999999997,"15min":0.54900000000000004},"min":{"1min":0.52500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.91300000000000003,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.58999999999999997,"15min":0.56399999999999995},"min":{"1min":0.442,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94299999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67900000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63100000000000001,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.876,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.46899999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.56499999999999995},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.746}]},{"osd":8,"last update":"Sun Oct 8 12:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.55600000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.119,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.71399999999999997,"15min":0.70099999999999996},"min":{"1min":0.55300000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96299999999999997,"5min":1.242,"15min":1.242},"last":0.81999999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.91500000000000004,"5min":1.349,"15min":1.349},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.016,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.76300000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.71499999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":5,"up_from":39,"seq":167503724594,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1034877,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88600000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78200000000000003,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.43099999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.45800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68400000000000005}]},{"osd":2,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.39900000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.625}]},{"osd":3,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.57099999999999995,"15min":0.55300000000000005},"min":{"1min":0.44600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.64400000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.93300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71299999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:39:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.753},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64900000000000002,"15min":0.63100000000000001},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.76800000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.69999999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.81699999999999995,"15min":0.79300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.85899999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.59599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.97599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.81599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59160,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59194,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59354,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:40:11.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T12:40:12.044 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:11 smithi092 ceph-mon[134093]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-08T12:40:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-08T12:40:12.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2023-10-08T12:40:12.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-10-08T12:40:12.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-08T12:40:12.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2023-10-08T12:40:12.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:11 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2023-10-08T12:40:12.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:11 smithi092 ceph-mon[134093]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T12:40:12.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:11 smithi092 ceph-mon[134093]: pgmap v283: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2023-10-08T12:40:12.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:11 smithi092 ceph-mon[134093]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T12:40:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:11 smithi173 ceph-mon[135182]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-08T12:40:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-08T12:40:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2023-10-08T12:40:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-10-08T12:40:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-08T12:40:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2023-10-08T12:40:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:11 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2023-10-08T12:40:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:11 smithi173 ceph-mon[135182]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T12:40:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:11 smithi173 ceph-mon[135182]: pgmap v283: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2023-10-08T12:40:12.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:11 smithi173 ceph-mon[135182]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T12:40:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:11 smithi059 ceph-mon[98489]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-08T12:40:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-08T12:40:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2023-10-08T12:40:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-10-08T12:40:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-08T12:40:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2023-10-08T12:40:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:11 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2023-10-08T12:40:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:11 smithi059 ceph-mon[98489]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T12:40:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:11 smithi059 ceph-mon[98489]: pgmap v283: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2023-10-08T12:40:12.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:11 smithi059 ceph-mon[98489]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.607+0000 7fdcee656700 1 -- 172.21.15.59:0/983482567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce8073340 msgr2=0x7fdce810cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.607+0000 7fdcee656700 1 --2- 172.21.15.59:0/983482567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce8073340 0x7fdce810cd10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009990 tx=0x7fdcdc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.607+0000 7fdcee656700 1 -- 172.21.15.59:0/983482567 shutdown_connections 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.607+0000 7fdcee656700 1 --2- 172.21.15.59:0/983482567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdce810d250 0x7fdce810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.607+0000 7fdcee656700 1 --2- 172.21.15.59:0/983482567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdce8072a20 0x7fdce8072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.607+0000 7fdcee656700 1 --2- 172.21.15.59:0/983482567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce8073340 0x7fdce810cd10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.607+0000 7fdcee656700 1 -- 172.21.15.59:0/983482567 >> 172.21.15.59:0/983482567 conn(0x7fdce80779e0 msgr2=0x7fdce8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.607+0000 7fdcee656700 1 -- 172.21.15.59:0/983482567 shutdown_connections 2023-10-08T12:40:13.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.607+0000 7fdcee656700 1 -- 172.21.15.59:0/983482567 wait complete. 2023-10-08T12:40:13.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.608+0000 7fdcee656700 1 Processor -- start 2023-10-08T12:40:13.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.608+0000 7fdcee656700 1 -- start start 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcee656700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdce8072a20 0x7fdce8198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcee656700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdce8073340 0x7fdce8199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcee656700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce810d250 0x7fdce819d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcee656700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce819ddb0 con 0x7fdce810d250 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcee656700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce819df20 con 0x7fdce8072a20 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcee656700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce819e0e0 con 0x7fdce8073340 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcecbf3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce810d250 0x7fdce819d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcecbf3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce810d250 0x7fdce819d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42400/0 (socket says 172.21.15.59:42400) 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcecbf3700 1 -- 172.21.15.59:0/3006525887 learned_addr learned my addr 172.21.15.59:0/3006525887 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdce7fff700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdce8072a20 0x7fdce8198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdce77fe700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdce8073340 0x7fdce8199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcecbf3700 1 -- 172.21.15.59:0/3006525887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdce8073340 msgr2=0x7fdce8199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcecbf3700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdce8073340 0x7fdce8199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcecbf3700 1 -- 172.21.15.59:0/3006525887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdce8072a20 msgr2=0x7fdce8198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcecbf3700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdce8072a20 0x7fdce8198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.609+0000 7fdcecbf3700 1 -- 172.21.15.59:0/3006525887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0095f0 con 0x7fdce810d250 2023-10-08T12:40:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.610+0000 7fdcecbf3700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce810d250 0x7fdce819d7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdce000efc0 tx=0x7fdce000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.610+0000 7fdce57fa700 1 -- 172.21.15.59:0/3006525887 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0018070 con 0x7fdce810d250 2023-10-08T12:40:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.610+0000 7fdcee656700 1 -- 172.21.15.59:0/3006525887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce819e360 con 0x7fdce810d250 2023-10-08T12:40:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.610+0000 7fdce57fa700 1 -- 172.21.15.59:0/3006525887 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdce000f040 con 0x7fdce810d250 2023-10-08T12:40:13.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.610+0000 7fdce57fa700 1 -- 172.21.15.59:0/3006525887 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000cd00 con 0x7fdce810d250 2023-10-08T12:40:13.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.610+0000 7fdcee656700 1 -- 172.21.15.59:0/3006525887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce81a5c20 con 0x7fdce810d250 2023-10-08T12:40:13.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.611+0000 7fdcee656700 1 -- 172.21.15.59:0/3006525887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce8108460 con 0x7fdce810d250 2023-10-08T12:40:13.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.613+0000 7fdce57fa700 1 -- 172.21.15.59:0/3006525887 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fdce0003a00 con 0x7fdce810d250 2023-10-08T12:40:13.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.614+0000 7fdce57fa700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcd00a1560 0x7fdcd00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.615+0000 7fdce57fa700 1 -- 172.21.15.59:0/3006525887 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fdce00cc9f0 con 0x7fdce810d250 2023-10-08T12:40:13.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.615+0000 7fdce7fff700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcd00a1560 0x7fdcd00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.616+0000 7fdce7fff700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcd00a1560 0x7fdcd00a3a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8007c60 tx=0x7fdcd80073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.619+0000 7fdce57fa700 1 -- 172.21.15.59:0/3006525887 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdce0095e80 con 0x7fdce810d250 2023-10-08T12:40:13.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.824+0000 7fdcee656700 1 -- 172.21.15.59:0/3006525887 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdce819a1c0 con 0x7fdcd00a1560 2023-10-08T12:40:13.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.835+0000 7fdce57fa700 1 -- 172.21.15.59:0/3006525887 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340321 (secure 0 0 0) 0x7fdce819a1c0 con 0x7fdcd00a1560 2023-10-08T12:40:13.841 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.840+0000 7fdcee656700 1 -- 172.21.15.59:0/3006525887 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcd00a1560 msgr2=0x7fdcd00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.840+0000 7fdcee656700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcd00a1560 0x7fdcd00a3a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8007c60 tx=0x7fdcd80073d0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.840+0000 7fdcee656700 1 -- 172.21.15.59:0/3006525887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce810d250 msgr2=0x7fdce819d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.840+0000 7fdcee656700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce810d250 0x7fdce819d7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdce000efc0 tx=0x7fdce000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.840+0000 7fdcee656700 1 -- 172.21.15.59:0/3006525887 shutdown_connections 2023-10-08T12:40:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.840+0000 7fdcee656700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcd00a1560 0x7fdcd00a3a20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.840+0000 7fdcee656700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdce8072a20 0x7fdce8198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.840+0000 7fdcee656700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce810d250 0x7fdce819d7a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.840+0000 7fdcee656700 1 --2- 172.21.15.59:0/3006525887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdce8073340 0x7fdce8199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.840+0000 7fdcee656700 1 -- 172.21.15.59:0/3006525887 >> 172.21.15.59:0/3006525887 conn(0x7fdce80779e0 msgr2=0x7fdce80fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.841+0000 7fdcee656700 1 -- 172.21.15.59:0/3006525887 shutdown_connections 2023-10-08T12:40:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:13.841+0000 7fdcee656700 1 -- 172.21.15.59:0/3006525887 wait complete. 2023-10-08T12:40:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-08T12:40:14.058 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:13 smithi059 ceph-mon[98489]: pgmap v285: 97 pgs: 4 peering, 93 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:14.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:13 smithi092 ceph-mon[134093]: pgmap v285: 97 pgs: 4 peering, 93 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:14.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:13 smithi173 ceph-mon[135182]: pgmap v285: 97 pgs: 4 peering, 93 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:14.424 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2023-10-08T12:40:12.793852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650572,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":256,"num_read_kb":238,"num_write":251,"num_write_kb":3018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335360,"kb_used_data":11116,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606464,"statfs":{"total":1151940427776,"available":1151597019136,"internally_reserved":0,"allocated":11382784,"data_stored":7363841,"data_compressed":138346,"data_compressed_allocated":184320,"data_compressed_original":1867776,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.005446"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.065823+0000","last_change":"2023-10-08T12:39:14.206423+0000","last_active":"2023-10-08T12:39:16.065823+0000","last_peered":"2023-10-08T12:39:16.065823+0000","last_clean":"2023-10-08T12:39:16.065823+0000","last_became_active":"2023-10-08T12:39:14.205454+0000","last_became_peered":"2023-10-08T12:39:14.205454+0000","last_unstale":"2023-10-08T12:39:16.065823+0000","last_undegraded":"2023-10-08T12:39:16.065823+0000","last_fullsized":"2023-10-08T12:39:16.065823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:37.669007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.094066+0000","last_change":"2023-10-08T12:39:14.215711+0000","last_active":"2023-10-08T12:39:16.094066+0000","last_peered":"2023-10-08T12:39:16.094066+0000","last_clean":"2023-10-08T12:39:16.094066+0000","last_became_active":"2023-10-08T12:39:14.215283+0000","last_became_peered":"2023-10-08T12:39:14.215283+0000","last_unstale":"2023-10-08T12:39:16.094066+0000","last_undegraded":"2023-10-08T12:39:16.094066+0000","last_fullsized":"2023-10-08T12:39:16.094066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:29.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.094043+0000","last_change":"2023-10-08T12:39:14.209843+0000","last_active":"2023-10-08T12:39:16.094043+0000","last_peered":"2023-10-08T12:39:16.094043+0000","last_clean":"2023-10-08T12:39:16.094043+0000","last_became_active":"2023-10-08T12:39:14.209528+0000","last_became_peered":"2023-10-08T12:39:14.209528+0000","last_unstale":"2023-10-08T12:39:16.094043+0000","last_undegraded":"2023-10-08T12:39:16.094043+0000","last_fullsized":"2023-10-08T12:39:16.094043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:54.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791708+0000","last_change":"2023-10-08T12:39:14.204891+0000","last_active":"2023-10-08T12:40:10.791708+0000","last_peered":"2023-10-08T12:40:10.791708+0000","last_clean":"2023-10-08T12:40:10.791708+0000","last_became_active":"2023-10-08T12:39:14.204075+0000","last_became_peered":"2023-10-08T12:39:14.204075+0000","last_unstale":"2023-10-08T12:40:10.791708+0000","last_undegraded":"2023-10-08T12:40:10.791708+0000","last_fullsized":"2023-10-08T12:40:10.791708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:18.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789932+0000","last_change":"2023-10-08T12:39:14.212527+0000","last_active":"2023-10-08T12:40:10.789932+0000","last_peered":"2023-10-08T12:40:10.789932+0000","last_clean":"2023-10-08T12:40:10.789932+0000","last_became_active":"2023-10-08T12:39:14.212188+0000","last_became_peered":"2023-10-08T12:39:14.212188+0000","last_unstale":"2023-10-08T12:40:10.789932+0000","last_undegraded":"2023-10-08T12:40:10.789932+0000","last_fullsized":"2023-10-08T12:40:10.789932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:28.952210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549185+0000","last_change":"2023-10-08T12:39:14.216842+0000","last_active":"2023-10-08T12:39:15.549185+0000","last_peered":"2023-10-08T12:39:15.549185+0000","last_clean":"2023-10-08T12:39:15.549185+0000","last_became_active":"2023-10-08T12:39:14.216446+0000","last_became_peered":"2023-10-08T12:39:14.216446+0000","last_unstale":"2023-10-08T12:39:15.549185+0000","last_undegraded":"2023-10-08T12:39:15.549185+0000","last_fullsized":"2023-10-08T12:39:15.549185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:40.718246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548684+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:39:15.548684+0000","last_peered":"2023-10-08T12:39:15.548684+0000","last_clean":"2023-10-08T12:39:15.548684+0000","last_became_active":"2023-10-08T12:39:14.222410+0000","last_became_peered":"2023-10-08T12:39:14.222410+0000","last_unstale":"2023-10-08T12:39:15.548684+0000","last_undegraded":"2023-10-08T12:39:15.548684+0000","last_fullsized":"2023-10-08T12:39:15.548684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:03.599610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550066+0000","last_change":"2023-10-08T12:39:14.209422+0000","last_active":"2023-10-08T12:39:15.550066+0000","last_peered":"2023-10-08T12:39:15.550066+0000","last_clean":"2023-10-08T12:39:15.550066+0000","last_became_active":"2023-10-08T12:39:14.209073+0000","last_became_peered":"2023-10-08T12:39:14.209073+0000","last_unstale":"2023-10-08T12:39:15.550066+0000","last_undegraded":"2023-10-08T12:39:15.550066+0000","last_fullsized":"2023-10-08T12:39:15.550066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:09.587414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282376+0000","last_change":"2023-10-08T12:39:14.211228+0000","last_active":"2023-10-08T12:40:11.282376+0000","last_peered":"2023-10-08T12:40:11.282376+0000","last_clean":"2023-10-08T12:40:11.282376+0000","last_became_active":"2023-10-08T12:39:14.210940+0000","last_became_peered":"2023-10-08T12:39:14.210940+0000","last_unstale":"2023-10-08T12:40:11.282376+0000","last_undegraded":"2023-10-08T12:40:11.282376+0000","last_fullsized":"2023-10-08T12:40:11.282376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:52.683409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549070+0000","last_change":"2023-10-08T12:39:14.207071+0000","last_active":"2023-10-08T12:39:15.549070+0000","last_peered":"2023-10-08T12:39:15.549070+0000","last_clean":"2023-10-08T12:39:15.549070+0000","last_became_active":"2023-10-08T12:39:14.206770+0000","last_became_peered":"2023-10-08T12:39:14.206770+0000","last_unstale":"2023-10-08T12:39:15.549070+0000","last_undegraded":"2023-10-08T12:39:15.549070+0000","last_fullsized":"2023-10-08T12:39:15.549070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:19.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549102+0000","last_change":"2023-10-08T12:39:14.212780+0000","last_active":"2023-10-08T12:39:15.549102+0000","last_peered":"2023-10-08T12:39:15.549102+0000","last_clean":"2023-10-08T12:39:15.549102+0000","last_became_active":"2023-10-08T12:39:14.212167+0000","last_became_peered":"2023-10-08T12:39:14.212167+0000","last_unstale":"2023-10-08T12:39:15.549102+0000","last_undegraded":"2023-10-08T12:39:15.549102+0000","last_fullsized":"2023-10-08T12:39:15.549102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:17.332257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791627+0000","last_change":"2023-10-08T12:39:14.204506+0000","last_active":"2023-10-08T12:40:10.791627+0000","last_peered":"2023-10-08T12:40:10.791627+0000","last_clean":"2023-10-08T12:40:10.791627+0000","last_became_active":"2023-10-08T12:39:14.204184+0000","last_became_peered":"2023-10-08T12:39:14.204184+0000","last_unstale":"2023-10-08T12:40:10.791627+0000","last_undegraded":"2023-10-08T12:40:10.791627+0000","last_fullsized":"2023-10-08T12:40:10.791627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:05.696554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549661+0000","last_change":"2023-10-08T12:39:14.211957+0000","last_active":"2023-10-08T12:39:15.549661+0000","last_peered":"2023-10-08T12:39:15.549661+0000","last_clean":"2023-10-08T12:39:15.549661+0000","last_became_active":"2023-10-08T12:39:14.211629+0000","last_became_peered":"2023-10-08T12:39:14.211629+0000","last_unstale":"2023-10-08T12:39:15.549661+0000","last_undegraded":"2023-10-08T12:39:15.549661+0000","last_fullsized":"2023-10-08T12:39:15.549661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:10.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.094003+0000","last_change":"2023-10-08T12:39:14.207006+0000","last_active":"2023-10-08T12:39:16.094003+0000","last_peered":"2023-10-08T12:39:16.094003+0000","last_clean":"2023-10-08T12:39:16.094003+0000","last_became_active":"2023-10-08T12:39:14.206624+0000","last_became_peered":"2023-10-08T12:39:14.206624+0000","last_unstale":"2023-10-08T12:39:16.094003+0000","last_undegraded":"2023-10-08T12:39:16.094003+0000","last_fullsized":"2023-10-08T12:39:16.094003+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:11.232875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.093974+0000","last_change":"2023-10-08T12:39:14.213865+0000","last_active":"2023-10-08T12:39:16.093974+0000","last_peered":"2023-10-08T12:39:16.093974+0000","last_clean":"2023-10-08T12:39:16.093974+0000","last_became_active":"2023-10-08T12:39:14.207972+0000","last_became_peered":"2023-10-08T12:39:14.207972+0000","last_unstale":"2023-10-08T12:39:16.093974+0000","last_undegraded":"2023-10-08T12:39:16.093974+0000","last_fullsized":"2023-10-08T12:39:16.093974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:01.434731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.281917+0000","last_change":"2023-10-08T12:39:14.206313+0000","last_active":"2023-10-08T12:40:11.281917+0000","last_peered":"2023-10-08T12:40:11.281917+0000","last_clean":"2023-10-08T12:40:11.281917+0000","last_became_active":"2023-10-08T12:39:14.206001+0000","last_became_peered":"2023-10-08T12:39:14.206001+0000","last_unstale":"2023-10-08T12:40:11.281917+0000","last_undegraded":"2023-10-08T12:40:11.281917+0000","last_fullsized":"2023-10-08T12:40:11.281917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:43.912356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.065831+0000","last_change":"2023-10-08T12:39:14.205752+0000","last_active":"2023-10-08T12:39:16.065831+0000","last_peered":"2023-10-08T12:39:16.065831+0000","last_clean":"2023-10-08T12:39:16.065831+0000","last_became_active":"2023-10-08T12:39:14.204696+0000","last_became_peered":"2023-10-08T12:39:14.204696+0000","last_unstale":"2023-10-08T12:39:16.065831+0000","last_undegraded":"2023-10-08T12:39:16.065831+0000","last_fullsized":"2023-10-08T12:39:16.065831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:42.409107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201311+0000","last_change":"2023-10-08T12:39:14.203373+0000","last_active":"2023-10-08T12:39:15.201311+0000","last_peered":"2023-10-08T12:39:15.201311+0000","last_clean":"2023-10-08T12:39:15.201311+0000","last_became_active":"2023-10-08T12:39:14.202966+0000","last_became_peered":"2023-10-08T12:39:14.202966+0000","last_unstale":"2023-10-08T12:39:15.201311+0000","last_undegraded":"2023-10-08T12:39:15.201311+0000","last_fullsized":"2023-10-08T12:39:15.201311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:00.114475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793600+0000","last_change":"2023-10-08T12:39:14.216154+0000","last_active":"2023-10-08T12:40:10.793600+0000","last_peered":"2023-10-08T12:40:10.793600+0000","last_clean":"2023-10-08T12:40:10.793600+0000","last_became_active":"2023-10-08T12:39:14.215868+0000","last_became_peered":"2023-10-08T12:39:14.215868+0000","last_unstale":"2023-10-08T12:40:10.793600+0000","last_undegraded":"2023-10-08T12:40:10.793600+0000","last_fullsized":"2023-10-08T12:40:10.793600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:53.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.201161+0000","last_change":"2023-10-08T12:39:13.214538+0000","last_active":"2023-10-08T12:39:15.201161+0000","last_peered":"2023-10-08T12:39:15.201161+0000","last_clean":"2023-10-08T12:39:15.201161+0000","last_became_active":"2023-10-08T12:39:13.214162+0000","last_became_peered":"2023-10-08T12:39:13.214162+0000","last_unstale":"2023-10-08T12:39:15.201161+0000","last_undegraded":"2023-10-08T12:39:15.201161+0000","last_fullsized":"2023-10-08T12:39:15.201161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:11.500815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550308+0000","last_change":"2023-10-08T12:39:14.211308+0000","last_active":"2023-10-08T12:39:15.550308+0000","last_peered":"2023-10-08T12:39:15.550308+0000","last_clean":"2023-10-08T12:39:15.550308+0000","last_became_active":"2023-10-08T12:39:14.210961+0000","last_became_peered":"2023-10-08T12:39:14.210961+0000","last_unstale":"2023-10-08T12:39:15.550308+0000","last_undegraded":"2023-10-08T12:39:15.550308+0000","last_fullsized":"2023-10-08T12:39:15.550308+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.221981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.706784+0000","last_change":"2023-10-08T12:39:13.219982+0000","last_active":"2023-10-08T12:39:14.706784+0000","last_peered":"2023-10-08T12:39:14.706784+0000","last_clean":"2023-10-08T12:39:14.706784+0000","last_became_active":"2023-10-08T12:39:13.219668+0000","last_became_peered":"2023-10-08T12:39:13.219668+0000","last_unstale":"2023-10-08T12:39:14.706784+0000","last_undegraded":"2023-10-08T12:39:14.706784+0000","last_fullsized":"2023-10-08T12:39:14.706784+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.664553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.094102+0000","last_change":"2023-10-08T12:39:14.216922+0000","last_active":"2023-10-08T12:39:16.094102+0000","last_peered":"2023-10-08T12:39:16.094102+0000","last_clean":"2023-10-08T12:39:16.094102+0000","last_became_active":"2023-10-08T12:39:14.216634+0000","last_became_peered":"2023-10-08T12:39:14.216634+0000","last_unstale":"2023-10-08T12:39:16.094102+0000","last_undegraded":"2023-10-08T12:39:16.094102+0000","last_fullsized":"2023-10-08T12:39:16.094102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:21.254178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790823+0000","last_change":"2023-10-08T12:39:13.220262+0000","last_active":"2023-10-08T12:40:10.790823+0000","last_peered":"2023-10-08T12:40:10.790823+0000","last_clean":"2023-10-08T12:40:10.790823+0000","last_became_active":"2023-10-08T12:39:13.219917+0000","last_became_peered":"2023-10-08T12:39:13.219917+0000","last_unstale":"2023-10-08T12:40:10.790823+0000","last_undegraded":"2023-10-08T12:40:10.790823+0000","last_fullsized":"2023-10-08T12:40:10.790823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:34.368119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282033+0000","last_change":"2023-10-08T12:39:14.212620+0000","last_active":"2023-10-08T12:40:11.282033+0000","last_peered":"2023-10-08T12:40:11.282033+0000","last_clean":"2023-10-08T12:40:11.282033+0000","last_became_active":"2023-10-08T12:39:14.212128+0000","last_became_peered":"2023-10-08T12:39:14.212128+0000","last_unstale":"2023-10-08T12:40:11.282033+0000","last_undegraded":"2023-10-08T12:40:11.282033+0000","last_fullsized":"2023-10-08T12:40:11.282033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:40.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790321+0000","last_change":"2023-10-08T12:39:13.218291+0000","last_active":"2023-10-08T12:40:10.790321+0000","last_peered":"2023-10-08T12:40:10.790321+0000","last_clean":"2023-10-08T12:40:10.790321+0000","last_became_active":"2023-10-08T12:39:13.217907+0000","last_became_peered":"2023-10-08T12:39:13.217907+0000","last_unstale":"2023-10-08T12:40:10.790321+0000","last_undegraded":"2023-10-08T12:40:10.790321+0000","last_fullsized":"2023-10-08T12:40:10.790321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:54:46.891553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786701+0000","last_change":"2023-10-08T12:39:14.207991+0000","last_active":"2023-10-08T12:40:10.786701+0000","last_peered":"2023-10-08T12:40:10.786701+0000","last_clean":"2023-10-08T12:40:10.786701+0000","last_became_active":"2023-10-08T12:39:14.207683+0000","last_became_peered":"2023-10-08T12:39:14.207683+0000","last_unstale":"2023-10-08T12:40:10.786701+0000","last_undegraded":"2023-10-08T12:40:10.786701+0000","last_fullsized":"2023-10-08T12:40:10.786701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:47.809553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786504+0000","last_change":"2023-10-08T12:39:13.214704+0000","last_active":"2023-10-08T12:40:10.786504+0000","last_peered":"2023-10-08T12:40:10.786504+0000","last_clean":"2023-10-08T12:40:10.786504+0000","last_became_active":"2023-10-08T12:39:13.214205+0000","last_became_peered":"2023-10-08T12:39:13.214205+0000","last_unstale":"2023-10-08T12:40:10.786504+0000","last_undegraded":"2023-10-08T12:40:10.786504+0000","last_fullsized":"2023-10-08T12:40:10.786504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:58.572620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790431+0000","last_change":"2023-10-08T12:39:14.219813+0000","last_active":"2023-10-08T12:40:10.790431+0000","last_peered":"2023-10-08T12:40:10.790431+0000","last_clean":"2023-10-08T12:40:10.790431+0000","last_became_active":"2023-10-08T12:39:14.219511+0000","last_became_peered":"2023-10-08T12:39:14.219511+0000","last_unstale":"2023-10-08T12:40:10.790431+0000","last_undegraded":"2023-10-08T12:40:10.790431+0000","last_fullsized":"2023-10-08T12:40:10.790431+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:43.716871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549057+0000","last_change":"2023-10-08T12:39:13.212567+0000","last_active":"2023-10-08T12:39:15.549057+0000","last_peered":"2023-10-08T12:39:15.549057+0000","last_clean":"2023-10-08T12:39:15.549057+0000","last_became_active":"2023-10-08T12:39:13.212079+0000","last_became_peered":"2023-10-08T12:39:13.212079+0000","last_unstale":"2023-10-08T12:39:15.549057+0000","last_undegraded":"2023-10-08T12:39:15.549057+0000","last_fullsized":"2023-10-08T12:39:15.549057+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:35.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786558+0000","last_change":"2023-10-08T12:39:14.208760+0000","last_active":"2023-10-08T12:40:10.786558+0000","last_peered":"2023-10-08T12:40:10.786558+0000","last_clean":"2023-10-08T12:40:10.786558+0000","last_became_active":"2023-10-08T12:39:14.208490+0000","last_became_peered":"2023-10-08T12:39:14.208490+0000","last_unstale":"2023-10-08T12:40:10.786558+0000","last_undegraded":"2023-10-08T12:40:10.786558+0000","last_fullsized":"2023-10-08T12:40:10.786558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:19:56.423514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056781+0000","last_change":"2023-10-08T12:39:13.214197+0000","last_active":"2023-10-08T12:39:15.056781+0000","last_peered":"2023-10-08T12:39:15.056781+0000","last_clean":"2023-10-08T12:39:15.056781+0000","last_became_active":"2023-10-08T12:39:13.213829+0000","last_became_peered":"2023-10-08T12:39:13.213829+0000","last_unstale":"2023-10-08T12:39:15.056781+0000","last_undegraded":"2023-10-08T12:39:15.056781+0000","last_fullsized":"2023-10-08T12:39:15.056781+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:29:05.080370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550089+0000","last_change":"2023-10-08T12:39:14.212369+0000","last_active":"2023-10-08T12:39:15.550089+0000","last_peered":"2023-10-08T12:39:15.550089+0000","last_clean":"2023-10-08T12:39:15.550089+0000","last_became_active":"2023-10-08T12:39:14.211917+0000","last_became_peered":"2023-10-08T12:39:14.211917+0000","last_unstale":"2023-10-08T12:39:15.550089+0000","last_undegraded":"2023-10-08T12:39:15.550089+0000","last_fullsized":"2023-10-08T12:39:15.550089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:27.265251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786322+0000","last_change":"2023-10-08T12:39:13.217339+0000","last_active":"2023-10-08T12:40:10.786322+0000","last_peered":"2023-10-08T12:40:10.786322+0000","last_clean":"2023-10-08T12:40:10.786322+0000","last_became_active":"2023-10-08T12:39:13.216973+0000","last_became_peered":"2023-10-08T12:39:13.216973+0000","last_unstale":"2023-10-08T12:40:10.786322+0000","last_undegraded":"2023-10-08T12:40:10.786322+0000","last_fullsized":"2023-10-08T12:40:10.786322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:35.899844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.200919+0000","last_change":"2023-10-08T12:39:14.218870+0000","last_active":"2023-10-08T12:39:15.200919+0000","last_peered":"2023-10-08T12:39:15.200919+0000","last_clean":"2023-10-08T12:39:15.200919+0000","last_became_active":"2023-10-08T12:39:14.217879+0000","last_became_peered":"2023-10-08T12:39:14.217879+0000","last_unstale":"2023-10-08T12:39:15.200919+0000","last_undegraded":"2023-10-08T12:39:15.200919+0000","last_fullsized":"2023-10-08T12:39:15.200919+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:06.769081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549190+0000","last_change":"2023-10-08T12:39:13.209120+0000","last_active":"2023-10-08T12:39:15.549190+0000","last_peered":"2023-10-08T12:39:15.549190+0000","last_clean":"2023-10-08T12:39:15.549190+0000","last_became_active":"2023-10-08T12:39:13.208755+0000","last_became_peered":"2023-10-08T12:39:13.208755+0000","last_unstale":"2023-10-08T12:39:15.549190+0000","last_undegraded":"2023-10-08T12:39:15.549190+0000","last_fullsized":"2023-10-08T12:39:15.549190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:48.977375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282268+0000","last_change":"2023-10-08T12:39:14.208187+0000","last_active":"2023-10-08T12:40:11.282268+0000","last_peered":"2023-10-08T12:40:11.282268+0000","last_clean":"2023-10-08T12:40:11.282268+0000","last_became_active":"2023-10-08T12:39:14.207868+0000","last_became_peered":"2023-10-08T12:39:14.207868+0000","last_unstale":"2023-10-08T12:40:11.282268+0000","last_undegraded":"2023-10-08T12:40:11.282268+0000","last_fullsized":"2023-10-08T12:40:11.282268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:50.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853939+0000","last_change":"2023-10-08T12:39:13.220447+0000","last_active":"2023-10-08T12:39:14.853939+0000","last_peered":"2023-10-08T12:39:14.853939+0000","last_clean":"2023-10-08T12:39:14.853939+0000","last_became_active":"2023-10-08T12:39:13.220032+0000","last_became_peered":"2023-10-08T12:39:13.220032+0000","last_unstale":"2023-10-08T12:39:14.853939+0000","last_undegraded":"2023-10-08T12:39:14.853939+0000","last_fullsized":"2023-10-08T12:39:14.853939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:22.223707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"peering","last_fresh":"2023-10-08T12:39:16.094123+0000","last_change":"2023-10-08T12:40:10.790120+0000","last_active":"2023-10-08T12:40:10.790120+0000","last_peered":"2023-10-08T12:39:16.094123+0000","last_clean":"2023-10-08T12:39:16.094123+0000","last_became_active":"2023-10-08T12:39:14.214536+0000","last_became_peered":"2023-10-08T12:39:14.214536+0000","last_unstale":"2023-10-08T12:39:16.094123+0000","last_undegraded":"2023-10-08T12:39:16.094123+0000","last_fullsized":"2023-10-08T12:39:16.094123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786798+0000","last_change":"2023-10-08T12:39:13.219131+0000","last_active":"2023-10-08T12:40:10.786798+0000","last_peered":"2023-10-08T12:40:10.786798+0000","last_clean":"2023-10-08T12:40:10.786798+0000","last_became_active":"2023-10-08T12:39:13.218639+0000","last_became_peered":"2023-10-08T12:39:13.218639+0000","last_unstale":"2023-10-08T12:40:10.786798+0000","last_undegraded":"2023-10-08T12:40:10.786798+0000","last_fullsized":"2023-10-08T12:40:10.786798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.316153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282166+0000","last_change":"2023-10-08T12:39:14.212352+0000","last_active":"2023-10-08T12:40:11.282166+0000","last_peered":"2023-10-08T12:40:11.282166+0000","last_clean":"2023-10-08T12:40:11.282166+0000","last_became_active":"2023-10-08T12:39:14.211342+0000","last_became_peered":"2023-10-08T12:39:14.211342+0000","last_unstale":"2023-10-08T12:40:11.282166+0000","last_undegraded":"2023-10-08T12:40:11.282166+0000","last_fullsized":"2023-10-08T12:40:11.282166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:39:00.731860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'25","reported_seq":152,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.319839+0000","last_change":"2023-10-08T12:39:13.209967+0000","last_active":"2023-10-08T12:40:10.319839+0000","last_peered":"2023-10-08T12:40:10.319839+0000","last_clean":"2023-10-08T12:40:10.319839+0000","last_became_active":"2023-10-08T12:39:13.209650+0000","last_became_peered":"2023-10-08T12:39:13.209650+0000","last_unstale":"2023-10-08T12:40:10.319839+0000","last_undegraded":"2023-10-08T12:40:10.319839+0000","last_fullsized":"2023-10-08T12:40:10.319839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:08.206168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59160,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":25,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790692+0000","last_change":"2023-10-08T12:39:14.211335+0000","last_active":"2023-10-08T12:40:10.790692+0000","last_peered":"2023-10-08T12:40:10.790692+0000","last_clean":"2023-10-08T12:40:10.790692+0000","last_became_active":"2023-10-08T12:39:14.211003+0000","last_became_peered":"2023-10-08T12:39:14.211003+0000","last_unstale":"2023-10-08T12:40:10.790692+0000","last_undegraded":"2023-10-08T12:40:10.790692+0000","last_fullsized":"2023-10-08T12:40:10.790692+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:00.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793676+0000","last_change":"2023-10-08T12:39:13.215379+0000","last_active":"2023-10-08T12:40:10.793676+0000","last_peered":"2023-10-08T12:40:10.793676+0000","last_clean":"2023-10-08T12:40:10.793676+0000","last_became_active":"2023-10-08T12:39:13.215036+0000","last_became_peered":"2023-10-08T12:39:13.215036+0000","last_unstale":"2023-10-08T12:40:10.793676+0000","last_undegraded":"2023-10-08T12:40:10.793676+0000","last_fullsized":"2023-10-08T12:40:10.793676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:24.690473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549022+0000","last_change":"2023-10-08T12:39:14.207907+0000","last_active":"2023-10-08T12:39:15.549022+0000","last_peered":"2023-10-08T12:39:15.549022+0000","last_clean":"2023-10-08T12:39:15.549022+0000","last_became_active":"2023-10-08T12:39:14.207620+0000","last_became_peered":"2023-10-08T12:39:14.207620+0000","last_unstale":"2023-10-08T12:39:15.549022+0000","last_undegraded":"2023-10-08T12:39:15.549022+0000","last_fullsized":"2023-10-08T12:39:15.549022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:49:11.866245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786468+0000","last_change":"2023-10-08T12:39:13.214521+0000","last_active":"2023-10-08T12:40:10.786468+0000","last_peered":"2023-10-08T12:40:10.786468+0000","last_clean":"2023-10-08T12:40:10.786468+0000","last_became_active":"2023-10-08T12:39:13.214127+0000","last_became_peered":"2023-10-08T12:39:13.214127+0000","last_unstale":"2023-10-08T12:40:10.786468+0000","last_undegraded":"2023-10-08T12:40:10.786468+0000","last_fullsized":"2023-10-08T12:40:10.786468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:46.735663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548940+0000","last_change":"2023-10-08T12:39:14.213542+0000","last_active":"2023-10-08T12:39:15.548940+0000","last_peered":"2023-10-08T12:39:15.548940+0000","last_clean":"2023-10-08T12:39:15.548940+0000","last_became_active":"2023-10-08T12:39:14.213295+0000","last_became_peered":"2023-10-08T12:39:14.213295+0000","last_unstale":"2023-10-08T12:39:15.548940+0000","last_undegraded":"2023-10-08T12:39:15.548940+0000","last_fullsized":"2023-10-08T12:39:15.548940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:46.883656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791530+0000","last_change":"2023-10-08T12:39:13.214758+0000","last_active":"2023-10-08T12:40:10.791530+0000","last_peered":"2023-10-08T12:40:10.791530+0000","last_clean":"2023-10-08T12:40:10.791530+0000","last_became_active":"2023-10-08T12:39:13.214304+0000","last_became_peered":"2023-10-08T12:39:13.214304+0000","last_unstale":"2023-10-08T12:40:10.791530+0000","last_undegraded":"2023-10-08T12:40:10.791530+0000","last_fullsized":"2023-10-08T12:40:10.791530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:34.074248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548713+0000","last_change":"2023-10-08T12:39:14.208071+0000","last_active":"2023-10-08T12:39:15.548713+0000","last_peered":"2023-10-08T12:39:15.548713+0000","last_clean":"2023-10-08T12:39:15.548713+0000","last_became_active":"2023-10-08T12:39:14.207787+0000","last_became_peered":"2023-10-08T12:39:14.207787+0000","last_unstale":"2023-10-08T12:39:15.548713+0000","last_undegraded":"2023-10-08T12:39:15.548713+0000","last_fullsized":"2023-10-08T12:39:15.548713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:40.869575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789406+0000","last_change":"2023-10-08T12:39:13.219105+0000","last_active":"2023-10-08T12:40:10.789406+0000","last_peered":"2023-10-08T12:40:10.789406+0000","last_clean":"2023-10-08T12:40:10.789406+0000","last_became_active":"2023-10-08T12:39:13.218767+0000","last_became_peered":"2023-10-08T12:39:13.218767+0000","last_unstale":"2023-10-08T12:40:10.789406+0000","last_undegraded":"2023-10-08T12:40:10.789406+0000","last_fullsized":"2023-10-08T12:40:10.789406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:22.763921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786312+0000","last_change":"2023-10-08T12:39:14.210037+0000","last_active":"2023-10-08T12:40:10.786312+0000","last_peered":"2023-10-08T12:40:10.786312+0000","last_clean":"2023-10-08T12:40:10.786312+0000","last_became_active":"2023-10-08T12:39:14.208140+0000","last_became_peered":"2023-10-08T12:39:14.208140+0000","last_unstale":"2023-10-08T12:40:10.786312+0000","last_undegraded":"2023-10-08T12:40:10.786312+0000","last_fullsized":"2023-10-08T12:40:10.786312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:38.475668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790878+0000","last_change":"2023-10-08T12:39:13.219229+0000","last_active":"2023-10-08T12:40:10.790878+0000","last_peered":"2023-10-08T12:40:10.790878+0000","last_clean":"2023-10-08T12:40:10.790878+0000","last_became_active":"2023-10-08T12:39:13.217964+0000","last_became_peered":"2023-10-08T12:39:13.217964+0000","last_unstale":"2023-10-08T12:40:10.790878+0000","last_undegraded":"2023-10-08T12:40:10.790878+0000","last_fullsized":"2023-10-08T12:40:10.790878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:47.480351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"peering","last_fresh":"2023-10-08T12:39:16.065811+0000","last_change":"2023-10-08T12:40:10.789393+0000","last_active":"2023-10-08T12:40:10.789393+0000","last_peered":"2023-10-08T12:39:16.065811+0000","last_clean":"2023-10-08T12:39:16.065811+0000","last_became_active":"2023-10-08T12:39:14.199235+0000","last_became_peered":"2023-10-08T12:39:14.199235+0000","last_unstale":"2023-10-08T12:39:16.065811+0000","last_undegraded":"2023-10-08T12:39:16.065811+0000","last_fullsized":"2023-10-08T12:39:16.065811+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.192321+0000","last_change":"2023-10-08T12:39:13.212791+0000","last_active":"2023-10-08T12:39:14.192321+0000","last_peered":"2023-10-08T12:39:14.192321+0000","last_clean":"2023-10-08T12:39:14.192321+0000","last_became_active":"2023-10-08T12:39:13.212146+0000","last_became_peered":"2023-10-08T12:39:13.212146+0000","last_unstale":"2023-10-08T12:39:14.192321+0000","last_undegraded":"2023-10-08T12:39:14.192321+0000","last_fullsized":"2023-10-08T12:39:14.192321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:37.452859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.615669+0000","last_change":"2023-10-08T12:39:14.215081+0000","last_active":"2023-10-08T12:39:15.615669+0000","last_peered":"2023-10-08T12:39:15.615669+0000","last_clean":"2023-10-08T12:39:15.615669+0000","last_became_active":"2023-10-08T12:39:14.214825+0000","last_became_peered":"2023-10-08T12:39:14.214825+0000","last_unstale":"2023-10-08T12:39:15.615669+0000","last_undegraded":"2023-10-08T12:39:15.615669+0000","last_fullsized":"2023-10-08T12:39:15.615669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:05.706569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853878+0000","last_change":"2023-10-08T12:39:13.217672+0000","last_active":"2023-10-08T12:39:14.853878+0000","last_peered":"2023-10-08T12:39:14.853878+0000","last_clean":"2023-10-08T12:39:14.853878+0000","last_became_active":"2023-10-08T12:39:13.217277+0000","last_became_peered":"2023-10-08T12:39:13.217277+0000","last_unstale":"2023-10-08T12:39:14.853878+0000","last_undegraded":"2023-10-08T12:39:14.853878+0000","last_fullsized":"2023-10-08T12:39:14.853878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:41.097439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549447+0000","last_change":"2023-10-08T12:39:14.219261+0000","last_active":"2023-10-08T12:39:15.549447+0000","last_peered":"2023-10-08T12:39:15.549447+0000","last_clean":"2023-10-08T12:39:15.549447+0000","last_became_active":"2023-10-08T12:39:14.218963+0000","last_became_peered":"2023-10-08T12:39:14.218963+0000","last_unstale":"2023-10-08T12:39:15.549447+0000","last_undegraded":"2023-10-08T12:39:15.549447+0000","last_fullsized":"2023-10-08T12:39:15.549447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:19.573306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786505+0000","last_change":"2023-10-08T12:39:14.207923+0000","last_active":"2023-10-08T12:40:10.786505+0000","last_peered":"2023-10-08T12:40:10.786505+0000","last_clean":"2023-10-08T12:40:10.786505+0000","last_became_active":"2023-10-08T12:39:14.207634+0000","last_became_peered":"2023-10-08T12:39:14.207634+0000","last_unstale":"2023-10-08T12:40:10.786505+0000","last_undegraded":"2023-10-08T12:40:10.786505+0000","last_fullsized":"2023-10-08T12:40:10.786505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:39.634945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056769+0000","last_change":"2023-10-08T12:39:13.223021+0000","last_active":"2023-10-08T12:39:15.056769+0000","last_peered":"2023-10-08T12:39:15.056769+0000","last_clean":"2023-10-08T12:39:15.056769+0000","last_became_active":"2023-10-08T12:39:13.222680+0000","last_became_peered":"2023-10-08T12:39:13.222680+0000","last_unstale":"2023-10-08T12:39:15.056769+0000","last_undegraded":"2023-10-08T12:39:15.056769+0000","last_fullsized":"2023-10-08T12:39:15.056769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:40.454436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549663+0000","last_change":"2023-10-08T12:39:14.217364+0000","last_active":"2023-10-08T12:39:15.549663+0000","last_peered":"2023-10-08T12:39:15.549663+0000","last_clean":"2023-10-08T12:39:15.549663+0000","last_became_active":"2023-10-08T12:39:14.216984+0000","last_became_peered":"2023-10-08T12:39:14.216984+0000","last_unstale":"2023-10-08T12:39:15.549663+0000","last_undegraded":"2023-10-08T12:39:15.549663+0000","last_fullsized":"2023-10-08T12:39:15.549663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:11:51.818034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792124+0000","last_change":"2023-10-08T12:39:13.207687+0000","last_active":"2023-10-08T12:40:10.792124+0000","last_peered":"2023-10-08T12:40:10.792124+0000","last_clean":"2023-10-08T12:40:10.792124+0000","last_became_active":"2023-10-08T12:39:13.207270+0000","last_became_peered":"2023-10-08T12:39:13.207270+0000","last_unstale":"2023-10-08T12:40:10.792124+0000","last_undegraded":"2023-10-08T12:40:10.792124+0000","last_fullsized":"2023-10-08T12:40:10.792124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:44.673383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.200716+0000","last_change":"2023-10-08T12:38:07.696721+0000","last_active":"2023-10-08T12:39:14.200716+0000","last_peered":"2023-10-08T12:39:14.200716+0000","last_clean":"2023-10-08T12:39:14.200716+0000","last_became_active":"2023-10-08T12:38:07.696336+0000","last_became_peered":"2023-10-08T12:38:07.696336+0000","last_unstale":"2023-10-08T12:39:14.200716+0000","last_undegraded":"2023-10-08T12:39:14.200716+0000","last_fullsized":"2023-10-08T12:39:14.200716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_clean_scrub_stamp":"2023-10-08T12:34:57.643348+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:01.821924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548781+0000","last_change":"2023-10-08T12:39:14.208845+0000","last_active":"2023-10-08T12:39:15.548781+0000","last_peered":"2023-10-08T12:39:15.548781+0000","last_clean":"2023-10-08T12:39:15.548781+0000","last_became_active":"2023-10-08T12:39:14.208487+0000","last_became_peered":"2023-10-08T12:39:14.208487+0000","last_unstale":"2023-10-08T12:39:15.548781+0000","last_undegraded":"2023-10-08T12:39:15.548781+0000","last_fullsized":"2023-10-08T12:39:15.548781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:26.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.853797+0000","last_change":"2023-10-08T12:39:13.216627+0000","last_active":"2023-10-08T12:39:14.853797+0000","last_peered":"2023-10-08T12:39:14.853797+0000","last_clean":"2023-10-08T12:39:14.853797+0000","last_became_active":"2023-10-08T12:39:13.216201+0000","last_became_peered":"2023-10-08T12:39:13.216201+0000","last_unstale":"2023-10-08T12:39:14.853797+0000","last_undegraded":"2023-10-08T12:39:14.853797+0000","last_fullsized":"2023-10-08T12:39:14.853797+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:19.873615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790683+0000","last_change":"2023-10-08T12:39:13.219222+0000","last_active":"2023-10-08T12:40:10.790683+0000","last_peered":"2023-10-08T12:40:10.790683+0000","last_clean":"2023-10-08T12:40:10.790683+0000","last_became_active":"2023-10-08T12:39:13.218757+0000","last_became_peered":"2023-10-08T12:39:13.218757+0000","last_unstale":"2023-10-08T12:40:10.790683+0000","last_undegraded":"2023-10-08T12:40:10.790683+0000","last_fullsized":"2023-10-08T12:40:10.790683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:15.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549929+0000","last_change":"2023-10-08T12:39:14.221945+0000","last_active":"2023-10-08T12:39:15.549929+0000","last_peered":"2023-10-08T12:39:15.549929+0000","last_clean":"2023-10-08T12:39:15.549929+0000","last_became_active":"2023-10-08T12:39:14.221625+0000","last_became_peered":"2023-10-08T12:39:14.221625+0000","last_unstale":"2023-10-08T12:39:15.549929+0000","last_undegraded":"2023-10-08T12:39:15.549929+0000","last_fullsized":"2023-10-08T12:39:15.549929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:50.424023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:22.808035+0000","last_change":"2023-10-08T12:39:13.213666+0000","last_active":"2023-10-08T12:39:22.808035+0000","last_peered":"2023-10-08T12:39:22.808035+0000","last_clean":"2023-10-08T12:39:22.808035+0000","last_became_active":"2023-10-08T12:39:13.213323+0000","last_became_peered":"2023-10-08T12:39:13.213323+0000","last_unstale":"2023-10-08T12:39:22.808035+0000","last_undegraded":"2023-10-08T12:39:22.808035+0000","last_fullsized":"2023-10-08T12:39:22.808035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:50:30.471672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550265+0000","last_change":"2023-10-08T12:39:14.214849+0000","last_active":"2023-10-08T12:39:15.550265+0000","last_peered":"2023-10-08T12:39:15.550265+0000","last_clean":"2023-10-08T12:39:15.550265+0000","last_became_active":"2023-10-08T12:39:14.214573+0000","last_became_peered":"2023-10-08T12:39:14.214573+0000","last_unstale":"2023-10-08T12:39:15.550265+0000","last_undegraded":"2023-10-08T12:39:15.550265+0000","last_fullsized":"2023-10-08T12:39:15.550265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:50.922519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791629+0000","last_change":"2023-10-08T12:39:13.206518+0000","last_active":"2023-10-08T12:40:10.791629+0000","last_peered":"2023-10-08T12:40:10.791629+0000","last_clean":"2023-10-08T12:40:10.791629+0000","last_became_active":"2023-10-08T12:39:13.206082+0000","last_became_peered":"2023-10-08T12:39:13.206082+0000","last_unstale":"2023-10-08T12:40:10.791629+0000","last_undegraded":"2023-10-08T12:40:10.791629+0000","last_fullsized":"2023-10-08T12:40:10.791629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:47.980651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.094085+0000","last_change":"2023-10-08T12:39:14.220897+0000","last_active":"2023-10-08T12:39:16.094085+0000","last_peered":"2023-10-08T12:39:16.094085+0000","last_clean":"2023-10-08T12:39:16.094085+0000","last_became_active":"2023-10-08T12:39:14.220173+0000","last_became_peered":"2023-10-08T12:39:14.220173+0000","last_unstale":"2023-10-08T12:39:16.094085+0000","last_undegraded":"2023-10-08T12:39:16.094085+0000","last_fullsized":"2023-10-08T12:39:16.094085+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:09:02.588054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.281984+0000","last_change":"2023-10-08T12:39:13.213505+0000","last_active":"2023-10-08T12:40:11.281984+0000","last_peered":"2023-10-08T12:40:11.281984+0000","last_clean":"2023-10-08T12:40:11.281984+0000","last_became_active":"2023-10-08T12:39:13.213199+0000","last_became_peered":"2023-10-08T12:39:13.213199+0000","last_unstale":"2023-10-08T12:40:11.281984+0000","last_undegraded":"2023-10-08T12:40:11.281984+0000","last_fullsized":"2023-10-08T12:40:11.281984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:49.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789447+0000","last_change":"2023-10-08T12:39:14.208080+0000","last_active":"2023-10-08T12:40:10.789447+0000","last_peered":"2023-10-08T12:40:10.789447+0000","last_clean":"2023-10-08T12:40:10.789447+0000","last_became_active":"2023-10-08T12:39:14.207788+0000","last_became_peered":"2023-10-08T12:39:14.207788+0000","last_unstale":"2023-10-08T12:40:10.789447+0000","last_undegraded":"2023-10-08T12:40:10.789447+0000","last_fullsized":"2023-10-08T12:40:10.789447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:44.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:14.534523+0000","last_change":"2023-10-08T12:39:13.216003+0000","last_active":"2023-10-08T12:39:14.534523+0000","last_peered":"2023-10-08T12:39:14.534523+0000","last_clean":"2023-10-08T12:39:14.534523+0000","last_became_active":"2023-10-08T12:39:13.215662+0000","last_became_peered":"2023-10-08T12:39:13.215662+0000","last_unstale":"2023-10-08T12:39:14.534523+0000","last_undegraded":"2023-10-08T12:39:14.534523+0000","last_fullsized":"2023-10-08T12:39:14.534523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:28.310430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.065759+0000","last_change":"2023-10-08T12:39:14.204336+0000","last_active":"2023-10-08T12:39:16.065759+0000","last_peered":"2023-10-08T12:39:16.065759+0000","last_clean":"2023-10-08T12:39:16.065759+0000","last_became_active":"2023-10-08T12:39:14.203993+0000","last_became_peered":"2023-10-08T12:39:14.203993+0000","last_unstale":"2023-10-08T12:39:16.065759+0000","last_undegraded":"2023-10-08T12:39:16.065759+0000","last_fullsized":"2023-10-08T12:39:16.065759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:54.545166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":2,"reported_epoch":85,"state":"peering","last_fresh":"2023-10-08T12:39:15.202001+0000","last_change":"2023-10-08T12:40:11.072000+0000","last_active":"2023-10-08T12:40:11.072000+0000","last_peered":"2023-10-08T12:39:15.202001+0000","last_clean":"2023-10-08T12:39:15.202001+0000","last_became_active":"2023-10-08T12:39:13.214431+0000","last_became_peered":"2023-10-08T12:39:13.214431+0000","last_unstale":"2023-10-08T12:39:15.202001+0000","last_undegraded":"2023-10-08T12:39:15.202001+0000","last_fullsized":"2023-10-08T12:39:15.202001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549952+0000","last_change":"2023-10-08T12:39:14.221040+0000","last_active":"2023-10-08T12:39:15.549952+0000","last_peered":"2023-10-08T12:39:15.549952+0000","last_clean":"2023-10-08T12:39:15.549952+0000","last_became_active":"2023-10-08T12:39:14.220724+0000","last_became_peered":"2023-10-08T12:39:14.220724+0000","last_unstale":"2023-10-08T12:39:15.549952+0000","last_undegraded":"2023-10-08T12:39:15.549952+0000","last_fullsized":"2023-10-08T12:39:15.549952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:52.824228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790002+0000","last_change":"2023-10-08T12:39:13.212244+0000","last_active":"2023-10-08T12:40:10.790002+0000","last_peered":"2023-10-08T12:40:10.790002+0000","last_clean":"2023-10-08T12:40:10.790002+0000","last_became_active":"2023-10-08T12:39:13.212028+0000","last_became_peered":"2023-10-08T12:39:13.212028+0000","last_unstale":"2023-10-08T12:40:10.790002+0000","last_undegraded":"2023-10-08T12:40:10.790002+0000","last_fullsized":"2023-10-08T12:40:10.790002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:06.111807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548953+0000","last_change":"2023-10-08T12:39:14.216665+0000","last_active":"2023-10-08T12:39:15.548953+0000","last_peered":"2023-10-08T12:39:15.548953+0000","last_clean":"2023-10-08T12:39:15.548953+0000","last_became_active":"2023-10-08T12:39:14.216330+0000","last_became_peered":"2023-10-08T12:39:14.216330+0000","last_unstale":"2023-10-08T12:39:15.548953+0000","last_undegraded":"2023-10-08T12:39:15.548953+0000","last_fullsized":"2023-10-08T12:39:15.548953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.658600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793792+0000","last_change":"2023-10-08T12:39:13.214495+0000","last_active":"2023-10-08T12:40:10.793792+0000","last_peered":"2023-10-08T12:40:10.793792+0000","last_clean":"2023-10-08T12:40:10.793792+0000","last_became_active":"2023-10-08T12:39:13.213930+0000","last_became_peered":"2023-10-08T12:39:13.213930+0000","last_unstale":"2023-10-08T12:40:10.793792+0000","last_undegraded":"2023-10-08T12:40:10.793792+0000","last_fullsized":"2023-10-08T12:40:10.793792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:20:38.096164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549209+0000","last_change":"2023-10-08T12:39:14.212566+0000","last_active":"2023-10-08T12:39:15.549209+0000","last_peered":"2023-10-08T12:39:15.549209+0000","last_clean":"2023-10-08T12:39:15.549209+0000","last_became_active":"2023-10-08T12:39:14.211756+0000","last_became_peered":"2023-10-08T12:39:14.211756+0000","last_unstale":"2023-10-08T12:39:15.549209+0000","last_undegraded":"2023-10-08T12:39:15.549209+0000","last_fullsized":"2023-10-08T12:39:15.549209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:12.741640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786680+0000","last_change":"2023-10-08T12:39:13.217914+0000","last_active":"2023-10-08T12:40:10.786680+0000","last_peered":"2023-10-08T12:40:10.786680+0000","last_clean":"2023-10-08T12:40:10.786680+0000","last_became_active":"2023-10-08T12:39:13.217571+0000","last_became_peered":"2023-10-08T12:39:13.217571+0000","last_unstale":"2023-10-08T12:40:10.786680+0000","last_undegraded":"2023-10-08T12:40:10.786680+0000","last_fullsized":"2023-10-08T12:40:10.786680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:10.826007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.548869+0000","last_change":"2023-10-08T12:39:14.214280+0000","last_active":"2023-10-08T12:39:15.548869+0000","last_peered":"2023-10-08T12:39:15.548869+0000","last_clean":"2023-10-08T12:39:15.548869+0000","last_became_active":"2023-10-08T12:39:14.213942+0000","last_became_peered":"2023-10-08T12:39:14.213942+0000","last_unstale":"2023-10-08T12:39:15.548869+0000","last_undegraded":"2023-10-08T12:39:15.548869+0000","last_fullsized":"2023-10-08T12:39:15.548869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:17:21.450265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.056839+0000","last_change":"2023-10-08T12:39:13.222484+0000","last_active":"2023-10-08T12:39:15.056839+0000","last_peered":"2023-10-08T12:39:15.056839+0000","last_clean":"2023-10-08T12:39:15.056839+0000","last_became_active":"2023-10-08T12:39:13.222091+0000","last_became_peered":"2023-10-08T12:39:13.222091+0000","last_unstale":"2023-10-08T12:39:15.056839+0000","last_undegraded":"2023-10-08T12:39:15.056839+0000","last_fullsized":"2023-10-08T12:39:15.056839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:00.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549425+0000","last_change":"2023-10-08T12:39:14.207715+0000","last_active":"2023-10-08T12:39:15.549425+0000","last_peered":"2023-10-08T12:39:15.549425+0000","last_clean":"2023-10-08T12:39:15.549425+0000","last_became_active":"2023-10-08T12:39:14.207429+0000","last_became_peered":"2023-10-08T12:39:14.207429+0000","last_unstale":"2023-10-08T12:39:15.549425+0000","last_undegraded":"2023-10-08T12:39:15.549425+0000","last_fullsized":"2023-10-08T12:39:15.549425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:16.991831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.065780+0000","last_change":"2023-10-08T12:39:14.200398+0000","last_active":"2023-10-08T12:39:16.065780+0000","last_peered":"2023-10-08T12:39:16.065780+0000","last_clean":"2023-10-08T12:39:16.065780+0000","last_became_active":"2023-10-08T12:39:14.200035+0000","last_became_peered":"2023-10-08T12:39:14.200035+0000","last_unstale":"2023-10-08T12:39:16.065780+0000","last_undegraded":"2023-10-08T12:39:16.065780+0000","last_fullsized":"2023-10-08T12:39:16.065780+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:13.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793521+0000","last_change":"2023-10-08T12:39:14.202185+0000","last_active":"2023-10-08T12:40:10.793521+0000","last_peered":"2023-10-08T12:40:10.793521+0000","last_clean":"2023-10-08T12:40:10.793521+0000","last_became_active":"2023-10-08T12:39:14.201232+0000","last_became_peered":"2023-10-08T12:39:14.201232+0000","last_unstale":"2023-10-08T12:40:10.793521+0000","last_undegraded":"2023-10-08T12:40:10.793521+0000","last_fullsized":"2023-10-08T12:40:10.793521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:50.949047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793459+0000","last_change":"2023-10-08T12:39:14.208014+0000","last_active":"2023-10-08T12:40:10.793459+0000","last_peered":"2023-10-08T12:40:10.793459+0000","last_clean":"2023-10-08T12:40:10.793459+0000","last_became_active":"2023-10-08T12:39:14.207579+0000","last_became_peered":"2023-10-08T12:39:14.207579+0000","last_unstale":"2023-10-08T12:40:10.793459+0000","last_undegraded":"2023-10-08T12:40:10.793459+0000","last_fullsized":"2023-10-08T12:40:10.793459+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:37.352827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"peering","last_fresh":"2023-10-08T12:39:16.094023+0000","last_change":"2023-10-08T12:40:10.790829+0000","last_active":"2023-10-08T12:40:10.790829+0000","last_peered":"2023-10-08T12:39:16.094023+0000","last_clean":"2023-10-08T12:39:16.094023+0000","last_became_active":"2023-10-08T12:39:14.210486+0000","last_became_peered":"2023-10-08T12:39:14.210486+0000","last_unstale":"2023-10-08T12:39:16.094023+0000","last_undegraded":"2023-10-08T12:39:16.094023+0000","last_fullsized":"2023-10-08T12:39:16.094023+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,6,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549923+0000","last_change":"2023-10-08T12:39:14.222630+0000","last_active":"2023-10-08T12:39:15.549923+0000","last_peered":"2023-10-08T12:39:15.549923+0000","last_clean":"2023-10-08T12:39:15.549923+0000","last_became_active":"2023-10-08T12:39:14.222300+0000","last_became_peered":"2023-10-08T12:39:14.222300+0000","last_unstale":"2023-10-08T12:39:15.549923+0000","last_undegraded":"2023-10-08T12:39:15.549923+0000","last_fullsized":"2023-10-08T12:39:15.549923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.040227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.065801+0000","last_change":"2023-10-08T12:39:14.207144+0000","last_active":"2023-10-08T12:39:16.065801+0000","last_peered":"2023-10-08T12:39:16.065801+0000","last_clean":"2023-10-08T12:39:16.065801+0000","last_became_active":"2023-10-08T12:39:14.206775+0000","last_became_peered":"2023-10-08T12:39:14.206775+0000","last_unstale":"2023-10-08T12:39:16.065801+0000","last_undegraded":"2023-10-08T12:39:16.065801+0000","last_fullsized":"2023-10-08T12:39:16.065801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:55.224270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794188+0000","last_change":"2023-10-08T12:39:14.204123+0000","last_active":"2023-10-08T12:40:10.794188+0000","last_peered":"2023-10-08T12:40:10.794188+0000","last_clean":"2023-10-08T12:40:10.794188+0000","last_became_active":"2023-10-08T12:39:14.203123+0000","last_became_peered":"2023-10-08T12:39:14.203123+0000","last_unstale":"2023-10-08T12:40:10.794188+0000","last_undegraded":"2023-10-08T12:40:10.794188+0000","last_fullsized":"2023-10-08T12:40:10.794188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:45.423095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.550121+0000","last_change":"2023-10-08T12:39:14.211049+0000","last_active":"2023-10-08T12:39:15.550121+0000","last_peered":"2023-10-08T12:39:15.550121+0000","last_clean":"2023-10-08T12:39:15.550121+0000","last_became_active":"2023-10-08T12:39:14.210738+0000","last_became_peered":"2023-10-08T12:39:14.210738+0000","last_unstale":"2023-10-08T12:39:15.550121+0000","last_undegraded":"2023-10-08T12:39:15.550121+0000","last_fullsized":"2023-10-08T12:39:15.550121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:12.535857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786331+0000","last_change":"2023-10-08T12:39:14.220013+0000","last_active":"2023-10-08T12:40:10.786331+0000","last_peered":"2023-10-08T12:40:10.786331+0000","last_clean":"2023-10-08T12:40:10.786331+0000","last_became_active":"2023-10-08T12:39:14.219711+0000","last_became_peered":"2023-10-08T12:39:14.219711+0000","last_unstale":"2023-10-08T12:40:10.786331+0000","last_undegraded":"2023-10-08T12:40:10.786331+0000","last_fullsized":"2023-10-08T12:40:10.786331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:23.205074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549313+0000","last_change":"2023-10-08T12:39:14.214237+0000","last_active":"2023-10-08T12:39:15.549313+0000","last_peered":"2023-10-08T12:39:15.549313+0000","last_clean":"2023-10-08T12:39:15.549313+0000","last_became_active":"2023-10-08T12:39:14.213891+0000","last_became_peered":"2023-10-08T12:39:14.213891+0000","last_unstale":"2023-10-08T12:39:15.549313+0000","last_undegraded":"2023-10-08T12:39:15.549313+0000","last_fullsized":"2023-10-08T12:39:15.549313+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:11.348411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282101+0000","last_change":"2023-10-08T12:39:14.209037+0000","last_active":"2023-10-08T12:40:11.282101+0000","last_peered":"2023-10-08T12:40:11.282101+0000","last_clean":"2023-10-08T12:40:11.282101+0000","last_became_active":"2023-10-08T12:39:14.208728+0000","last_became_peered":"2023-10-08T12:39:14.208728+0000","last_unstale":"2023-10-08T12:40:11.282101+0000","last_undegraded":"2023-10-08T12:40:11.282101+0000","last_fullsized":"2023-10-08T12:40:11.282101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:23.440413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:15.549527+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:39:15.549527+0000","last_peered":"2023-10-08T12:39:15.549527+0000","last_clean":"2023-10-08T12:39:15.549527+0000","last_became_active":"2023-10-08T12:39:14.222393+0000","last_became_peered":"2023-10-08T12:39:14.222393+0000","last_unstale":"2023-10-08T12:39:15.549527+0000","last_undegraded":"2023-10-08T12:39:15.549527+0000","last_fullsized":"2023-10-08T12:39:15.549527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:19.704140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:39:16.065791+0000","last_change":"2023-10-08T12:39:14.200858+0000","last_active":"2023-10-08T12:39:16.065791+0000","last_peered":"2023-10-08T12:39:16.065791+0000","last_clean":"2023-10-08T12:39:16.065791+0000","last_became_active":"2023-10-08T12:39:14.199948+0000","last_became_peered":"2023-10-08T12:39:14.199948+0000","last_unstale":"2023-10-08T12:39:16.065791+0000","last_undegraded":"2023-10-08T12:39:16.065791+0000","last_fullsized":"2023-10-08T12:39:16.065791+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:10.366380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281436,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59958,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":68,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":179874,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416409,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":444535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47399999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53600000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58699999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65800000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":9,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.79200000000000004}]},{"osd":10,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.747}]}]},{"osd":10,"up_from":72,"seq":309237645340,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":1094049,"data_compressed":37403,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.46300000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.376,"15min":0.376},"max":{"1min":0.76400000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81399999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58099999999999996}]},{"osd":3,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.64300000000000002,"15min":0.65300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.48899999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72999999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47699999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.65600000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83599999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.59299999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65900000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.86499999999999999,"15min":0.88700000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.583,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.627},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.74299999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.64200000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.72499999999999998}]}]},{"osd":9,"up_from":67,"seq":287762808863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":445117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.41299999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.497,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.747}]},{"osd":2,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":3.1269999999999998,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.621},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58299999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.212,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.82699999999999996,"15min":0.83499999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.88600000000000001,"15min":0.90000000000000002},"min":{"1min":0.60899999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":1.325,"15min":1.325},"last":0.64800000000000002}]},{"osd":6,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.93799999999999994,"15min":0.94699999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.0720000000000001,"5min":3.0720000000000001,"15min":3.0720000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.86599999999999999,"15min":0.874},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.93100000000000005,"15min":0.94699999999999995},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2729999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.999,"15min":1.0029999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.98,"5min":2.98,"15min":2.98},"last":0.79000000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.016,"15min":1.0249999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.96199999999999997,"15min":0.97199999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.77300000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.95899999999999996,"15min":0.95299999999999996},"min":{"1min":0.63500000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.90300000000000002,"15min":0.90400000000000003},"min":{"1min":0.60799999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.80600000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070501,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":462448,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.35199999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58899999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.28399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.55900000000000005}]},{"osd":3,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.40000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83699999999999997,"5min":0.879,"15min":0.879},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.43099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.41299999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.34499999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98899999999999999,"5min":1.181,"15min":1.181},"last":0.78500000000000003}]},{"osd":9,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.75900000000000001,"15min":0.753},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.75800000000000001,"15min":0.746},"min":{"1min":0.57399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.753}]},{"osd":10,"last update":"Sun Oct 8 12:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.77400000000000002,"15min":0.76500000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.54300000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.877}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299434,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":1035608,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.877,"15min":0.877},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.434},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.627},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.745,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.73799999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.86099999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.80600000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82899999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.94099999999999995}]},{"osd":8,"last update":"Sun Oct 8 12:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":1.008},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":1.022}]},{"osd":9,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.88400000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":1.0369999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91700000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.90700000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462958,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":444658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.377}]},{"osd":1,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79400000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.56399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76100000000000001,"15min":0.77000000000000002},"min":{"1min":0.497,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.65500000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.032,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.73499999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82099999999999995,"5min":6.875,"15min":6.875},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0229999999999999,"5min":1.095,"15min":1.095},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.125,"15min":1.125},"last":0.628},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83299999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.63700000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:39:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81000000000000005,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.86099999999999999,"15min":0.83299999999999996},"min":{"1min":0.66900000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.72099999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.95999999999999996,"15min":0.97499999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1200000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84599999999999997,"15min":0.85199999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59099999999999997}]},{"osd":9,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.496}]},{"osd":10,"last update":"Sun Oct 8 12:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.752}]}]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":521004,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.67000000000000004,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73099999999999998,"5min":1.452,"15min":1.452},"last":0.41199999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.55300000000000005,"15min":0.52500000000000002},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72799999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:39:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74299999999999999,"5min":1.413,"15min":1.413},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.57199999999999995},"min":{"1min":0.41799999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":1.427,"15min":1.427},"last":0.58699999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.42999999999999999,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.42999999999999999,"15min":0.39800000000000002},"min":{"1min":0.316,"5min":0.245,"15min":0.245},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.44900000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.63500000000000001,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.621,"15min":0.58799999999999997},"min":{"1min":0.51900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.123,"5min":1.355,"15min":1.355},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.99199999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.56599999999999995}]},{"osd":8,"last update":"Sun Oct 8 12:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.625},"min":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.64700000000000002,"15min":0.63200000000000001},"min":{"1min":0.505,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79800000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73199999999999998,"15min":0.72199999999999998},"min":{"1min":0.50800000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.65100000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.76900000000000002,"15min":0.755},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.73499999999999999,"15min":0.72199999999999998},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.84599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":444625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:39:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.56000000000000005},"min":{"1min":0.35199999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63500000000000001,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.046},"last":0.61699999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.628,"15min":0.57999999999999996},"min":{"1min":0.48799999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.622,"15min":0.58299999999999996},"min":{"1min":0.48899999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.998,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.66100000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:39:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66100000000000003,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.52300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0109999999999999,"5min":1.911,"15min":1.911},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.69099999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92100000000000004,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.745,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.89100000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.50600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.873,"15min":0.879},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.048,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.79900000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.88200000000000001,"15min":0.89900000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.24,"15min":1.24},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.92900000000000005,"15min":0.94299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1259999999999999,"5min":1.298,"15min":1.298},"last":0.96299999999999997}]},{"osd":10,"last update":"Sun Oct 8 12:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.65100000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.873}]}]},{"osd":2,"up_from":19,"seq":81604378690,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":521369,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.41999999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.82899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":1.194,"15min":1.194},"last":0.63900000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:40:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56699999999999995,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81200000000000006,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.623},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.58599999999999997,"15min":0.52600000000000002},"min":{"1min":0.45200000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79400000000000004}]},{"osd":3,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83299999999999996,"5min":1.073,"15min":1.073},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91500000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66400000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.45100000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.435,"5min":0.378,"15min":0.378},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.71499999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.40999999999999998},"min":{"1min":0.28799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.44,"15min":0.42599999999999999},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.69099999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.621,"15min":0.59899999999999998},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":1.04,"15min":1.04},"last":0.75700000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77800000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:39:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95099999999999996,"5min":1.024,"15min":1.024},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77900000000000003,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.85299999999999998,"5min":1.087,"15min":1.087},"last":0.80800000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.875}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149756,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":444554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46800000000000003,"15min":0.42999999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.72899999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.495},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.504,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81899999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.60899999999999999},"min":{"1min":0.53800000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":1.081,"15min":1.081},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.63200000000000001,"15min":0.59899999999999998},"min":{"1min":0.495,"5min":0.371,"15min":0.371},"max":{"1min":0.92600000000000005,"5min":1.05,"15min":1.05},"last":0.73499999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.42899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88700000000000001,"5min":1.077,"15min":1.077},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70599999999999996,"15min":0.68700000000000006},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.98099999999999998,"5min":1.23,"15min":1.23},"last":0.66500000000000004}]},{"osd":4,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67900000000000005,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71899999999999997,"15min":0.66700000000000004},"min":{"1min":0.57299999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.042,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98499999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.70899999999999996,"15min":0.69199999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0669999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":1.0069999999999999,"5min":1.109,"15min":1.109},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Oct 8 12:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61799999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.069,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.53100000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0840000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.85799999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.89400000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.96499999999999997,"15min":0.998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1739999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.91900000000000004,"15min":0.93500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.121,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.80500000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.876},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.91900000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":4,"up_from":34,"seq":146028888121,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":453357,"data_compressed":2901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67100000000000004,"15min":0.71999999999999997},"min":{"1min":0.439,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":6.0549999999999997,"15min":6.0549999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39500000000000002,"15min":0.36099999999999999},"min":{"1min":0.33000000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.629,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.38400000000000001},"min":{"1min":0.32400000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.74099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48599999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.58699999999999997,"15min":0.56000000000000005},"min":{"1min":0.52300000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.873},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.54400000000000004,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.77900000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57999999999999996,"15min":0.53200000000000003},"min":{"1min":0.45700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.623},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58299999999999996,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83099999999999996,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.746}]},{"osd":5,"last update":"Sun Oct 8 12:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.626,"15min":0.55900000000000005},"min":{"1min":0.51700000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81899999999999995,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.62,"15min":0.57399999999999995},"min":{"1min":0.45100000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63100000000000001,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.876,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.52800000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.56499999999999995},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.88700000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.55600000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.119,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.71399999999999997,"15min":0.70099999999999996},"min":{"1min":0.55300000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96299999999999997,"5min":1.242,"15min":1.242},"last":0.81499999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.91500000000000004,"5min":1.349,"15min":1.349},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.016,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.90500000000000003}]},{"osd":10,"last update":"Sun Oct 8 12:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98199999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.004,"5min":1.171,"15min":1.171},"last":0.83699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":5,"up_from":39,"seq":167503724595,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1052517,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88600000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78200000000000003,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.45800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.39900000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.67800000000000005}]},{"osd":3,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.57099999999999995,"15min":0.55300000000000005},"min":{"1min":0.44600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.93300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69899999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.86899999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:39:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64900000000000002,"15min":0.63100000000000001},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.94999999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.82999999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.81699999999999995,"15min":0.79300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.91200000000000003}]},{"osd":10,"last update":"Sun Oct 8 12:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.59599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.97599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.98199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59160,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59194,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59354,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:40:14.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T12:40:15.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:14 smithi092 ceph-mon[134093]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:15.171 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:15.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:14 smithi173 ceph-mon[135182]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:14 smithi059 ceph-mon[98489]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:16.125 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:15 smithi059 ceph-mon[98489]: pgmap v286: 97 pgs: 4 peering, 93 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:16.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:15 smithi092 ceph-mon[134093]: pgmap v286: 97 pgs: 4 peering, 93 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:15 smithi173 ceph-mon[135182]: pgmap v286: 97 pgs: 4 peering, 93 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.789+0000 7f65fd135700 1 -- 172.21.15.59:0/1021141958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f81008a0 msgr2=0x7f65f8100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.789+0000 7f65fd135700 1 --2- 172.21.15.59:0/1021141958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f81008a0 0x7f65f8100d20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009990 tx=0x7f65ec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.789+0000 7f65fd135700 1 -- 172.21.15.59:0/1021141958 shutdown_connections 2023-10-08T12:40:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.789+0000 7f65fd135700 1 --2- 172.21.15.59:0/1021141958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f81057c0 0x7f65f8105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.789+0000 7f65fd135700 1 --2- 172.21.15.59:0/1021141958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8101260 0x7f65f810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.789+0000 7f65fd135700 1 --2- 172.21.15.59:0/1021141958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f81008a0 0x7f65f8100d20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.789+0000 7f65fd135700 1 -- 172.21.15.59:0/1021141958 >> 172.21.15.59:0/1021141958 conn(0x7f65f80779e0 msgr2=0x7f65f8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.789+0000 7f65fd135700 1 -- 172.21.15.59:0/1021141958 shutdown_connections 2023-10-08T12:40:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.789+0000 7f65fd135700 1 -- 172.21.15.59:0/1021141958 wait complete. 2023-10-08T12:40:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.790+0000 7f65fd135700 1 Processor -- start 2023-10-08T12:40:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.791+0000 7f65fd135700 1 -- start start 2023-10-08T12:40:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.791+0000 7f65fd135700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f81008a0 0x7f65f819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.791+0000 7f65fd135700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8101260 0x7f65f819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.791+0000 7f65fd135700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f81057c0 0x7f65f8196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.791+0000 7f65fd135700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f8197140 con 0x7f65f81008a0 2023-10-08T12:40:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.791+0000 7f65fd135700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f81972b0 con 0x7f65f81057c0 2023-10-08T12:40:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.791+0000 7f65fd135700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f8197470 con 0x7f65f8101260 2023-10-08T12:40:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.791+0000 7f65f6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f81008a0 0x7f65f819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.791+0000 7f65f6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f81008a0 0x7f65f819c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42414/0 (socket says 172.21.15.59:42414) 2023-10-08T12:40:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.791+0000 7f65f6d9d700 1 -- 172.21.15.59:0/3538677587 learned_addr learned my addr 172.21.15.59:0/3538677587 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65f659c700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8101260 0x7f65f819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65f759e700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f81057c0 0x7f65f8196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65f6d9d700 1 -- 172.21.15.59:0/3538677587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8101260 msgr2=0x7f65f819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65f6d9d700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8101260 0x7f65f819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65f6d9d700 1 -- 172.21.15.59:0/3538677587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f81057c0 msgr2=0x7f65f8196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65f6d9d700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f81057c0 0x7f65f8196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65f6d9d700 1 -- 172.21.15.59:0/3538677587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec0095f0 con 0x7f65f81008a0 2023-10-08T12:40:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65f759e700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f81057c0 0x7f65f8196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65f6d9d700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f81008a0 0x7f65f819c990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f65e800e970 tx=0x7f65e800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65dffff700 1 -- 172.21.15.59:0/3538677587 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8009790 con 0x7f65f81008a0 2023-10-08T12:40:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65dffff700 1 -- 172.21.15.59:0/3538677587 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65e800eec0 con 0x7f65f81008a0 2023-10-08T12:40:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65fd135700 1 -- 172.21.15.59:0/3538677587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f8197750 con 0x7f65f81008a0 2023-10-08T12:40:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.792+0000 7f65dffff700 1 -- 172.21.15.59:0/3538677587 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8003cf0 con 0x7f65f81008a0 2023-10-08T12:40:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.793+0000 7f65fd135700 1 -- 172.21.15.59:0/3538677587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f81a3980 con 0x7f65f81008a0 2023-10-08T12:40:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.794+0000 7f65fd135700 1 -- 172.21.15.59:0/3538677587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f8108da0 con 0x7f65f81008a0 2023-10-08T12:40:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.796+0000 7f65dffff700 1 -- 172.21.15.59:0/3538677587 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f65e800ccd0 con 0x7f65f81008a0 2023-10-08T12:40:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.798+0000 7f65dffff700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65e00a15e0 0x7f65e00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.798+0000 7f65dffff700 1 -- 172.21.15.59:0/3538677587 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f65e8014070 con 0x7f65f81008a0 2023-10-08T12:40:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.798+0000 7f65f659c700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65e00a15e0 0x7f65e00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.799+0000 7f65f659c700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65e00a15e0 0x7f65e00a3aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0098e0 tx=0x7f65ec005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:16.802+0000 7f65dffff700 1 -- 172.21.15.59:0/3538677587 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f65e8096580 con 0x7f65f81008a0 2023-10-08T12:40:17.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.012+0000 7f65fd135700 1 -- 172.21.15.59:0/3538677587 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65f8197f90 con 0x7f65e00a15e0 2023-10-08T12:40:17.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.023+0000 7f65dffff700 1 -- 172.21.15.59:0/3538677587 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341941 (secure 0 0 0) 0x7f65f8197f90 con 0x7f65e00a15e0 2023-10-08T12:40:17.030 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:17.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 -- 172.21.15.59:0/3538677587 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65e00a15e0 msgr2=0x7f65e00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:17.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65e00a15e0 0x7f65e00a3aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0098e0 tx=0x7f65ec005960 comp rx=0 tx=0).stop 2023-10-08T12:40:17.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 -- 172.21.15.59:0/3538677587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f81008a0 msgr2=0x7f65f819c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:17.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f81008a0 0x7f65f819c990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f65e800e970 tx=0x7f65e800ec80 comp rx=0 tx=0).stop 2023-10-08T12:40:17.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 -- 172.21.15.59:0/3538677587 shutdown_connections 2023-10-08T12:40:17.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65e00a15e0 0x7f65e00a3aa0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f81057c0 0x7f65f8196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f81008a0 0x7f65f819c990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 --2- 172.21.15.59:0/3538677587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8101260 0x7f65f819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 -- 172.21.15.59:0/3538677587 >> 172.21.15.59:0/3538677587 conn(0x7f65f80779e0 msgr2=0x7f65f80fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 -- 172.21.15.59:0/3538677587 shutdown_connections 2023-10-08T12:40:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:17.029+0000 7f65fd135700 1 -- 172.21.15.59:0/3538677587 wait complete. 2023-10-08T12:40:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-08T12:40:17.453 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2023-10-08T12:40:16.794758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650572,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":266,"num_read_kb":243,"num_write":251,"num_write_kb":3018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180859,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":297,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335544,"kb_used_data":11284,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606280,"statfs":{"total":1151940427776,"available":1151596830720,"internally_reserved":0,"allocated":11554816,"data_stored":7487321,"data_compressed":179009,"data_compressed_allocated":241664,"data_compressed_original":1982464,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":123,"num_keys_recovered":7,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004900"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789351+0000","last_change":"2023-10-08T12:39:14.206423+0000","last_active":"2023-10-08T12:40:10.789351+0000","last_peered":"2023-10-08T12:40:10.789351+0000","last_clean":"2023-10-08T12:40:10.789351+0000","last_became_active":"2023-10-08T12:39:14.205454+0000","last_became_peered":"2023-10-08T12:39:14.205454+0000","last_unstale":"2023-10-08T12:40:10.789351+0000","last_undegraded":"2023-10-08T12:40:10.789351+0000","last_fullsized":"2023-10-08T12:40:10.789351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:37.669007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790629+0000","last_change":"2023-10-08T12:39:14.215711+0000","last_active":"2023-10-08T12:40:10.790629+0000","last_peered":"2023-10-08T12:40:10.790629+0000","last_clean":"2023-10-08T12:40:10.790629+0000","last_became_active":"2023-10-08T12:39:14.215283+0000","last_became_peered":"2023-10-08T12:39:14.215283+0000","last_unstale":"2023-10-08T12:40:10.790629+0000","last_undegraded":"2023-10-08T12:40:10.790629+0000","last_fullsized":"2023-10-08T12:40:10.790629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:29.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789909+0000","last_change":"2023-10-08T12:39:14.209843+0000","last_active":"2023-10-08T12:40:10.789909+0000","last_peered":"2023-10-08T12:40:10.789909+0000","last_clean":"2023-10-08T12:40:10.789909+0000","last_became_active":"2023-10-08T12:39:14.209528+0000","last_became_peered":"2023-10-08T12:39:14.209528+0000","last_unstale":"2023-10-08T12:40:10.789909+0000","last_undegraded":"2023-10-08T12:40:10.789909+0000","last_fullsized":"2023-10-08T12:40:10.789909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:54.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791708+0000","last_change":"2023-10-08T12:39:14.204891+0000","last_active":"2023-10-08T12:40:10.791708+0000","last_peered":"2023-10-08T12:40:10.791708+0000","last_clean":"2023-10-08T12:40:10.791708+0000","last_became_active":"2023-10-08T12:39:14.204075+0000","last_became_peered":"2023-10-08T12:39:14.204075+0000","last_unstale":"2023-10-08T12:40:10.791708+0000","last_undegraded":"2023-10-08T12:40:10.791708+0000","last_fullsized":"2023-10-08T12:40:10.791708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:18.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789932+0000","last_change":"2023-10-08T12:39:14.212527+0000","last_active":"2023-10-08T12:40:10.789932+0000","last_peered":"2023-10-08T12:40:10.789932+0000","last_clean":"2023-10-08T12:40:10.789932+0000","last_became_active":"2023-10-08T12:39:14.212188+0000","last_became_peered":"2023-10-08T12:39:14.212188+0000","last_unstale":"2023-10-08T12:40:10.789932+0000","last_undegraded":"2023-10-08T12:40:10.789932+0000","last_fullsized":"2023-10-08T12:40:10.789932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:28.952210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786911+0000","last_change":"2023-10-08T12:39:14.216842+0000","last_active":"2023-10-08T12:40:10.786911+0000","last_peered":"2023-10-08T12:40:10.786911+0000","last_clean":"2023-10-08T12:40:10.786911+0000","last_became_active":"2023-10-08T12:39:14.216446+0000","last_became_peered":"2023-10-08T12:39:14.216446+0000","last_unstale":"2023-10-08T12:40:10.786911+0000","last_undegraded":"2023-10-08T12:40:10.786911+0000","last_fullsized":"2023-10-08T12:40:10.786911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:40.718246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793700+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:10.793700+0000","last_peered":"2023-10-08T12:40:10.793700+0000","last_clean":"2023-10-08T12:40:10.793700+0000","last_became_active":"2023-10-08T12:39:14.222410+0000","last_became_peered":"2023-10-08T12:39:14.222410+0000","last_unstale":"2023-10-08T12:40:10.793700+0000","last_undegraded":"2023-10-08T12:40:10.793700+0000","last_fullsized":"2023-10-08T12:40:10.793700+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:03.599610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790917+0000","last_change":"2023-10-08T12:39:14.209422+0000","last_active":"2023-10-08T12:40:10.790917+0000","last_peered":"2023-10-08T12:40:10.790917+0000","last_clean":"2023-10-08T12:40:10.790917+0000","last_became_active":"2023-10-08T12:39:14.209073+0000","last_became_peered":"2023-10-08T12:39:14.209073+0000","last_unstale":"2023-10-08T12:40:10.790917+0000","last_undegraded":"2023-10-08T12:40:10.790917+0000","last_fullsized":"2023-10-08T12:40:10.790917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:09.587414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282376+0000","last_change":"2023-10-08T12:39:14.211228+0000","last_active":"2023-10-08T12:40:11.282376+0000","last_peered":"2023-10-08T12:40:11.282376+0000","last_clean":"2023-10-08T12:40:11.282376+0000","last_became_active":"2023-10-08T12:39:14.210940+0000","last_became_peered":"2023-10-08T12:39:14.210940+0000","last_unstale":"2023-10-08T12:40:11.282376+0000","last_undegraded":"2023-10-08T12:40:11.282376+0000","last_fullsized":"2023-10-08T12:40:11.282376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:52.683409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787260+0000","last_change":"2023-10-08T12:39:14.207071+0000","last_active":"2023-10-08T12:40:10.787260+0000","last_peered":"2023-10-08T12:40:10.787260+0000","last_clean":"2023-10-08T12:40:10.787260+0000","last_became_active":"2023-10-08T12:39:14.206770+0000","last_became_peered":"2023-10-08T12:39:14.206770+0000","last_unstale":"2023-10-08T12:40:10.787260+0000","last_undegraded":"2023-10-08T12:40:10.787260+0000","last_fullsized":"2023-10-08T12:40:10.787260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:19.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794200+0000","last_change":"2023-10-08T12:39:14.212780+0000","last_active":"2023-10-08T12:40:10.794200+0000","last_peered":"2023-10-08T12:40:10.794200+0000","last_clean":"2023-10-08T12:40:10.794200+0000","last_became_active":"2023-10-08T12:39:14.212167+0000","last_became_peered":"2023-10-08T12:39:14.212167+0000","last_unstale":"2023-10-08T12:40:10.794200+0000","last_undegraded":"2023-10-08T12:40:10.794200+0000","last_fullsized":"2023-10-08T12:40:10.794200+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:17.332257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791627+0000","last_change":"2023-10-08T12:39:14.204506+0000","last_active":"2023-10-08T12:40:10.791627+0000","last_peered":"2023-10-08T12:40:10.791627+0000","last_clean":"2023-10-08T12:40:10.791627+0000","last_became_active":"2023-10-08T12:39:14.204184+0000","last_became_peered":"2023-10-08T12:39:14.204184+0000","last_unstale":"2023-10-08T12:40:10.791627+0000","last_undegraded":"2023-10-08T12:40:10.791627+0000","last_fullsized":"2023-10-08T12:40:10.791627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:05.696554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793271+0000","last_change":"2023-10-08T12:39:14.211957+0000","last_active":"2023-10-08T12:40:10.793271+0000","last_peered":"2023-10-08T12:40:10.793271+0000","last_clean":"2023-10-08T12:40:10.793271+0000","last_became_active":"2023-10-08T12:39:14.211629+0000","last_became_peered":"2023-10-08T12:39:14.211629+0000","last_unstale":"2023-10-08T12:40:10.793271+0000","last_undegraded":"2023-10-08T12:40:10.793271+0000","last_fullsized":"2023-10-08T12:40:10.793271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:10.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789681+0000","last_change":"2023-10-08T12:39:14.207006+0000","last_active":"2023-10-08T12:40:10.789681+0000","last_peered":"2023-10-08T12:40:10.789681+0000","last_clean":"2023-10-08T12:40:10.789681+0000","last_became_active":"2023-10-08T12:39:14.206624+0000","last_became_peered":"2023-10-08T12:39:14.206624+0000","last_unstale":"2023-10-08T12:40:10.789681+0000","last_undegraded":"2023-10-08T12:40:10.789681+0000","last_fullsized":"2023-10-08T12:40:10.789681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:11.232875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789907+0000","last_change":"2023-10-08T12:39:14.213865+0000","last_active":"2023-10-08T12:40:10.789907+0000","last_peered":"2023-10-08T12:40:10.789907+0000","last_clean":"2023-10-08T12:40:10.789907+0000","last_became_active":"2023-10-08T12:39:14.207972+0000","last_became_peered":"2023-10-08T12:39:14.207972+0000","last_unstale":"2023-10-08T12:40:10.789907+0000","last_undegraded":"2023-10-08T12:40:10.789907+0000","last_fullsized":"2023-10-08T12:40:10.789907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:01.434731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.281917+0000","last_change":"2023-10-08T12:39:14.206313+0000","last_active":"2023-10-08T12:40:11.281917+0000","last_peered":"2023-10-08T12:40:11.281917+0000","last_clean":"2023-10-08T12:40:11.281917+0000","last_became_active":"2023-10-08T12:39:14.206001+0000","last_became_peered":"2023-10-08T12:39:14.206001+0000","last_unstale":"2023-10-08T12:40:11.281917+0000","last_undegraded":"2023-10-08T12:40:11.281917+0000","last_fullsized":"2023-10-08T12:40:11.281917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:43.912356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789442+0000","last_change":"2023-10-08T12:39:14.205752+0000","last_active":"2023-10-08T12:40:10.789442+0000","last_peered":"2023-10-08T12:40:10.789442+0000","last_clean":"2023-10-08T12:40:10.789442+0000","last_became_active":"2023-10-08T12:39:14.204696+0000","last_became_peered":"2023-10-08T12:39:14.204696+0000","last_unstale":"2023-10-08T12:40:10.789442+0000","last_undegraded":"2023-10-08T12:40:10.789442+0000","last_fullsized":"2023-10-08T12:40:10.789442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:42.409107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787698+0000","last_change":"2023-10-08T12:39:14.203373+0000","last_active":"2023-10-08T12:40:10.787698+0000","last_peered":"2023-10-08T12:40:10.787698+0000","last_clean":"2023-10-08T12:40:10.787698+0000","last_became_active":"2023-10-08T12:39:14.202966+0000","last_became_peered":"2023-10-08T12:39:14.202966+0000","last_unstale":"2023-10-08T12:40:10.787698+0000","last_undegraded":"2023-10-08T12:40:10.787698+0000","last_fullsized":"2023-10-08T12:40:10.787698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:00.114475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793600+0000","last_change":"2023-10-08T12:39:14.216154+0000","last_active":"2023-10-08T12:40:10.793600+0000","last_peered":"2023-10-08T12:40:10.793600+0000","last_clean":"2023-10-08T12:40:10.793600+0000","last_became_active":"2023-10-08T12:39:14.215868+0000","last_became_peered":"2023-10-08T12:39:14.215868+0000","last_unstale":"2023-10-08T12:40:10.793600+0000","last_undegraded":"2023-10-08T12:40:10.793600+0000","last_fullsized":"2023-10-08T12:40:10.793600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:53.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786840+0000","last_change":"2023-10-08T12:39:13.214538+0000","last_active":"2023-10-08T12:40:10.786840+0000","last_peered":"2023-10-08T12:40:10.786840+0000","last_clean":"2023-10-08T12:40:10.786840+0000","last_became_active":"2023-10-08T12:39:13.214162+0000","last_became_peered":"2023-10-08T12:39:13.214162+0000","last_unstale":"2023-10-08T12:40:10.786840+0000","last_undegraded":"2023-10-08T12:40:10.786840+0000","last_fullsized":"2023-10-08T12:40:10.786840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:11.500815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793193+0000","last_change":"2023-10-08T12:39:14.211308+0000","last_active":"2023-10-08T12:40:10.793193+0000","last_peered":"2023-10-08T12:40:10.793193+0000","last_clean":"2023-10-08T12:40:10.793193+0000","last_became_active":"2023-10-08T12:39:14.210961+0000","last_became_peered":"2023-10-08T12:39:14.210961+0000","last_unstale":"2023-10-08T12:40:10.793193+0000","last_undegraded":"2023-10-08T12:40:10.793193+0000","last_fullsized":"2023-10-08T12:40:10.793193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.221981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793311+0000","last_change":"2023-10-08T12:39:13.219982+0000","last_active":"2023-10-08T12:40:10.793311+0000","last_peered":"2023-10-08T12:40:10.793311+0000","last_clean":"2023-10-08T12:40:10.793311+0000","last_became_active":"2023-10-08T12:39:13.219668+0000","last_became_peered":"2023-10-08T12:39:13.219668+0000","last_unstale":"2023-10-08T12:40:10.793311+0000","last_undegraded":"2023-10-08T12:40:10.793311+0000","last_fullsized":"2023-10-08T12:40:10.793311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.664553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790263+0000","last_change":"2023-10-08T12:39:14.216922+0000","last_active":"2023-10-08T12:40:10.790263+0000","last_peered":"2023-10-08T12:40:10.790263+0000","last_clean":"2023-10-08T12:40:10.790263+0000","last_became_active":"2023-10-08T12:39:14.216634+0000","last_became_peered":"2023-10-08T12:39:14.216634+0000","last_unstale":"2023-10-08T12:40:10.790263+0000","last_undegraded":"2023-10-08T12:40:10.790263+0000","last_fullsized":"2023-10-08T12:40:10.790263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:21.254178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790823+0000","last_change":"2023-10-08T12:39:13.220262+0000","last_active":"2023-10-08T12:40:10.790823+0000","last_peered":"2023-10-08T12:40:10.790823+0000","last_clean":"2023-10-08T12:40:10.790823+0000","last_became_active":"2023-10-08T12:39:13.219917+0000","last_became_peered":"2023-10-08T12:39:13.219917+0000","last_unstale":"2023-10-08T12:40:10.790823+0000","last_undegraded":"2023-10-08T12:40:10.790823+0000","last_fullsized":"2023-10-08T12:40:10.790823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:34.368119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282033+0000","last_change":"2023-10-08T12:39:14.212620+0000","last_active":"2023-10-08T12:40:11.282033+0000","last_peered":"2023-10-08T12:40:11.282033+0000","last_clean":"2023-10-08T12:40:11.282033+0000","last_became_active":"2023-10-08T12:39:14.212128+0000","last_became_peered":"2023-10-08T12:39:14.212128+0000","last_unstale":"2023-10-08T12:40:11.282033+0000","last_undegraded":"2023-10-08T12:40:11.282033+0000","last_fullsized":"2023-10-08T12:40:11.282033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:40.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790321+0000","last_change":"2023-10-08T12:39:13.218291+0000","last_active":"2023-10-08T12:40:10.790321+0000","last_peered":"2023-10-08T12:40:10.790321+0000","last_clean":"2023-10-08T12:40:10.790321+0000","last_became_active":"2023-10-08T12:39:13.217907+0000","last_became_peered":"2023-10-08T12:39:13.217907+0000","last_unstale":"2023-10-08T12:40:10.790321+0000","last_undegraded":"2023-10-08T12:40:10.790321+0000","last_fullsized":"2023-10-08T12:40:10.790321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:54:46.891553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786701+0000","last_change":"2023-10-08T12:39:14.207991+0000","last_active":"2023-10-08T12:40:10.786701+0000","last_peered":"2023-10-08T12:40:10.786701+0000","last_clean":"2023-10-08T12:40:10.786701+0000","last_became_active":"2023-10-08T12:39:14.207683+0000","last_became_peered":"2023-10-08T12:39:14.207683+0000","last_unstale":"2023-10-08T12:40:10.786701+0000","last_undegraded":"2023-10-08T12:40:10.786701+0000","last_fullsized":"2023-10-08T12:40:10.786701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:47.809553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786504+0000","last_change":"2023-10-08T12:39:13.214704+0000","last_active":"2023-10-08T12:40:10.786504+0000","last_peered":"2023-10-08T12:40:10.786504+0000","last_clean":"2023-10-08T12:40:10.786504+0000","last_became_active":"2023-10-08T12:39:13.214205+0000","last_became_peered":"2023-10-08T12:39:13.214205+0000","last_unstale":"2023-10-08T12:40:10.786504+0000","last_undegraded":"2023-10-08T12:40:10.786504+0000","last_fullsized":"2023-10-08T12:40:10.786504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:58.572620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790431+0000","last_change":"2023-10-08T12:39:14.219813+0000","last_active":"2023-10-08T12:40:10.790431+0000","last_peered":"2023-10-08T12:40:10.790431+0000","last_clean":"2023-10-08T12:40:10.790431+0000","last_became_active":"2023-10-08T12:39:14.219511+0000","last_became_peered":"2023-10-08T12:39:14.219511+0000","last_unstale":"2023-10-08T12:40:10.790431+0000","last_undegraded":"2023-10-08T12:40:10.790431+0000","last_fullsized":"2023-10-08T12:40:10.790431+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:43.716871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786848+0000","last_change":"2023-10-08T12:39:13.212567+0000","last_active":"2023-10-08T12:40:10.786848+0000","last_peered":"2023-10-08T12:40:10.786848+0000","last_clean":"2023-10-08T12:40:10.786848+0000","last_became_active":"2023-10-08T12:39:13.212079+0000","last_became_peered":"2023-10-08T12:39:13.212079+0000","last_unstale":"2023-10-08T12:40:10.786848+0000","last_undegraded":"2023-10-08T12:40:10.786848+0000","last_fullsized":"2023-10-08T12:40:10.786848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:35.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786558+0000","last_change":"2023-10-08T12:39:14.208760+0000","last_active":"2023-10-08T12:40:10.786558+0000","last_peered":"2023-10-08T12:40:10.786558+0000","last_clean":"2023-10-08T12:40:10.786558+0000","last_became_active":"2023-10-08T12:39:14.208490+0000","last_became_peered":"2023-10-08T12:39:14.208490+0000","last_unstale":"2023-10-08T12:40:10.786558+0000","last_undegraded":"2023-10-08T12:40:10.786558+0000","last_fullsized":"2023-10-08T12:40:10.786558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:19:56.423514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791638+0000","last_change":"2023-10-08T12:39:13.214197+0000","last_active":"2023-10-08T12:40:10.791638+0000","last_peered":"2023-10-08T12:40:10.791638+0000","last_clean":"2023-10-08T12:40:10.791638+0000","last_became_active":"2023-10-08T12:39:13.213829+0000","last_became_peered":"2023-10-08T12:39:13.213829+0000","last_unstale":"2023-10-08T12:40:10.791638+0000","last_undegraded":"2023-10-08T12:40:10.791638+0000","last_fullsized":"2023-10-08T12:40:10.791638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:29:05.080370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792154+0000","last_change":"2023-10-08T12:39:14.212369+0000","last_active":"2023-10-08T12:40:10.792154+0000","last_peered":"2023-10-08T12:40:10.792154+0000","last_clean":"2023-10-08T12:40:10.792154+0000","last_became_active":"2023-10-08T12:39:14.211917+0000","last_became_peered":"2023-10-08T12:39:14.211917+0000","last_unstale":"2023-10-08T12:40:10.792154+0000","last_undegraded":"2023-10-08T12:40:10.792154+0000","last_fullsized":"2023-10-08T12:40:10.792154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:27.265251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786322+0000","last_change":"2023-10-08T12:39:13.217339+0000","last_active":"2023-10-08T12:40:10.786322+0000","last_peered":"2023-10-08T12:40:10.786322+0000","last_clean":"2023-10-08T12:40:10.786322+0000","last_became_active":"2023-10-08T12:39:13.216973+0000","last_became_peered":"2023-10-08T12:39:13.216973+0000","last_unstale":"2023-10-08T12:40:10.786322+0000","last_undegraded":"2023-10-08T12:40:10.786322+0000","last_fullsized":"2023-10-08T12:40:10.786322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:35.899844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786605+0000","last_change":"2023-10-08T12:39:14.218870+0000","last_active":"2023-10-08T12:40:10.786605+0000","last_peered":"2023-10-08T12:40:10.786605+0000","last_clean":"2023-10-08T12:40:10.786605+0000","last_became_active":"2023-10-08T12:39:14.217879+0000","last_became_peered":"2023-10-08T12:39:14.217879+0000","last_unstale":"2023-10-08T12:40:10.786605+0000","last_undegraded":"2023-10-08T12:40:10.786605+0000","last_fullsized":"2023-10-08T12:40:10.786605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:06.769081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787188+0000","last_change":"2023-10-08T12:39:13.209120+0000","last_active":"2023-10-08T12:40:10.787188+0000","last_peered":"2023-10-08T12:40:10.787188+0000","last_clean":"2023-10-08T12:40:10.787188+0000","last_became_active":"2023-10-08T12:39:13.208755+0000","last_became_peered":"2023-10-08T12:39:13.208755+0000","last_unstale":"2023-10-08T12:40:10.787188+0000","last_undegraded":"2023-10-08T12:40:10.787188+0000","last_fullsized":"2023-10-08T12:40:10.787188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:48.977375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282268+0000","last_change":"2023-10-08T12:39:14.208187+0000","last_active":"2023-10-08T12:40:11.282268+0000","last_peered":"2023-10-08T12:40:11.282268+0000","last_clean":"2023-10-08T12:40:11.282268+0000","last_became_active":"2023-10-08T12:39:14.207868+0000","last_became_peered":"2023-10-08T12:39:14.207868+0000","last_unstale":"2023-10-08T12:40:11.282268+0000","last_undegraded":"2023-10-08T12:40:11.282268+0000","last_fullsized":"2023-10-08T12:40:11.282268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:50.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794276+0000","last_change":"2023-10-08T12:39:13.220447+0000","last_active":"2023-10-08T12:40:10.794276+0000","last_peered":"2023-10-08T12:40:10.794276+0000","last_clean":"2023-10-08T12:40:10.794276+0000","last_became_active":"2023-10-08T12:39:13.220032+0000","last_became_peered":"2023-10-08T12:39:13.220032+0000","last_unstale":"2023-10-08T12:40:10.794276+0000","last_undegraded":"2023-10-08T12:40:10.794276+0000","last_fullsized":"2023-10-08T12:40:10.794276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:22.223707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.807692+0000","last_change":"2023-10-08T12:40:11.807692+0000","last_active":"2023-10-08T12:40:11.807692+0000","last_peered":"2023-10-08T12:40:11.807692+0000","last_clean":"2023-10-08T12:40:11.807692+0000","last_became_active":"2023-10-08T12:40:11.807311+0000","last_became_peered":"2023-10-08T12:40:11.807311+0000","last_unstale":"2023-10-08T12:40:11.807692+0000","last_undegraded":"2023-10-08T12:40:11.807692+0000","last_fullsized":"2023-10-08T12:40:11.807692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:42.114689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786798+0000","last_change":"2023-10-08T12:39:13.219131+0000","last_active":"2023-10-08T12:40:10.786798+0000","last_peered":"2023-10-08T12:40:10.786798+0000","last_clean":"2023-10-08T12:40:10.786798+0000","last_became_active":"2023-10-08T12:39:13.218639+0000","last_became_peered":"2023-10-08T12:39:13.218639+0000","last_unstale":"2023-10-08T12:40:10.786798+0000","last_undegraded":"2023-10-08T12:40:10.786798+0000","last_fullsized":"2023-10-08T12:40:10.786798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.316153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282166+0000","last_change":"2023-10-08T12:39:14.212352+0000","last_active":"2023-10-08T12:40:11.282166+0000","last_peered":"2023-10-08T12:40:11.282166+0000","last_clean":"2023-10-08T12:40:11.282166+0000","last_became_active":"2023-10-08T12:39:14.211342+0000","last_became_peered":"2023-10-08T12:39:14.211342+0000","last_unstale":"2023-10-08T12:40:11.282166+0000","last_undegraded":"2023-10-08T12:40:11.282166+0000","last_fullsized":"2023-10-08T12:40:11.282166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:39:00.731860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'25","reported_seq":164,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:15.328425+0000","last_change":"2023-10-08T12:39:13.209967+0000","last_active":"2023-10-08T12:40:15.328425+0000","last_peered":"2023-10-08T12:40:15.328425+0000","last_clean":"2023-10-08T12:40:15.328425+0000","last_became_active":"2023-10-08T12:39:13.209650+0000","last_became_peered":"2023-10-08T12:39:13.209650+0000","last_unstale":"2023-10-08T12:40:15.328425+0000","last_undegraded":"2023-10-08T12:40:15.328425+0000","last_fullsized":"2023-10-08T12:40:15.328425+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:08.206168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59160,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":25,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790692+0000","last_change":"2023-10-08T12:39:14.211335+0000","last_active":"2023-10-08T12:40:10.790692+0000","last_peered":"2023-10-08T12:40:10.790692+0000","last_clean":"2023-10-08T12:40:10.790692+0000","last_became_active":"2023-10-08T12:39:14.211003+0000","last_became_peered":"2023-10-08T12:39:14.211003+0000","last_unstale":"2023-10-08T12:40:10.790692+0000","last_undegraded":"2023-10-08T12:40:10.790692+0000","last_fullsized":"2023-10-08T12:40:10.790692+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:00.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793676+0000","last_change":"2023-10-08T12:39:13.215379+0000","last_active":"2023-10-08T12:40:10.793676+0000","last_peered":"2023-10-08T12:40:10.793676+0000","last_clean":"2023-10-08T12:40:10.793676+0000","last_became_active":"2023-10-08T12:39:13.215036+0000","last_became_peered":"2023-10-08T12:39:13.215036+0000","last_unstale":"2023-10-08T12:40:10.793676+0000","last_undegraded":"2023-10-08T12:40:10.793676+0000","last_fullsized":"2023-10-08T12:40:10.793676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:24.690473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791858+0000","last_change":"2023-10-08T12:39:14.207907+0000","last_active":"2023-10-08T12:40:10.791858+0000","last_peered":"2023-10-08T12:40:10.791858+0000","last_clean":"2023-10-08T12:40:10.791858+0000","last_became_active":"2023-10-08T12:39:14.207620+0000","last_became_peered":"2023-10-08T12:39:14.207620+0000","last_unstale":"2023-10-08T12:40:10.791858+0000","last_undegraded":"2023-10-08T12:40:10.791858+0000","last_fullsized":"2023-10-08T12:40:10.791858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:49:11.866245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786468+0000","last_change":"2023-10-08T12:39:13.214521+0000","last_active":"2023-10-08T12:40:10.786468+0000","last_peered":"2023-10-08T12:40:10.786468+0000","last_clean":"2023-10-08T12:40:10.786468+0000","last_became_active":"2023-10-08T12:39:13.214127+0000","last_became_peered":"2023-10-08T12:39:13.214127+0000","last_unstale":"2023-10-08T12:40:10.786468+0000","last_undegraded":"2023-10-08T12:40:10.786468+0000","last_fullsized":"2023-10-08T12:40:10.786468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:46.735663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.796744+0000","last_change":"2023-10-08T12:40:11.796744+0000","last_active":"2023-10-08T12:40:11.796744+0000","last_peered":"2023-10-08T12:40:11.796744+0000","last_clean":"2023-10-08T12:40:11.796744+0000","last_became_active":"2023-10-08T12:40:11.796418+0000","last_became_peered":"2023-10-08T12:40:11.796418+0000","last_unstale":"2023-10-08T12:40:11.796744+0000","last_undegraded":"2023-10-08T12:40:11.796744+0000","last_fullsized":"2023-10-08T12:40:11.796744+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:22.693079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791530+0000","last_change":"2023-10-08T12:39:13.214758+0000","last_active":"2023-10-08T12:40:10.791530+0000","last_peered":"2023-10-08T12:40:10.791530+0000","last_clean":"2023-10-08T12:40:10.791530+0000","last_became_active":"2023-10-08T12:39:13.214304+0000","last_became_peered":"2023-10-08T12:39:13.214304+0000","last_unstale":"2023-10-08T12:40:10.791530+0000","last_undegraded":"2023-10-08T12:40:10.791530+0000","last_fullsized":"2023-10-08T12:40:10.791530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:34.074248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793742+0000","last_change":"2023-10-08T12:39:14.208071+0000","last_active":"2023-10-08T12:40:10.793742+0000","last_peered":"2023-10-08T12:40:10.793742+0000","last_clean":"2023-10-08T12:40:10.793742+0000","last_became_active":"2023-10-08T12:39:14.207787+0000","last_became_peered":"2023-10-08T12:39:14.207787+0000","last_unstale":"2023-10-08T12:40:10.793742+0000","last_undegraded":"2023-10-08T12:40:10.793742+0000","last_fullsized":"2023-10-08T12:40:10.793742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:40.869575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789406+0000","last_change":"2023-10-08T12:39:13.219105+0000","last_active":"2023-10-08T12:40:10.789406+0000","last_peered":"2023-10-08T12:40:10.789406+0000","last_clean":"2023-10-08T12:40:10.789406+0000","last_became_active":"2023-10-08T12:39:13.218767+0000","last_became_peered":"2023-10-08T12:39:13.218767+0000","last_unstale":"2023-10-08T12:40:10.789406+0000","last_undegraded":"2023-10-08T12:40:10.789406+0000","last_fullsized":"2023-10-08T12:40:10.789406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:22.763921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786312+0000","last_change":"2023-10-08T12:39:14.210037+0000","last_active":"2023-10-08T12:40:10.786312+0000","last_peered":"2023-10-08T12:40:10.786312+0000","last_clean":"2023-10-08T12:40:10.786312+0000","last_became_active":"2023-10-08T12:39:14.208140+0000","last_became_peered":"2023-10-08T12:39:14.208140+0000","last_unstale":"2023-10-08T12:40:10.786312+0000","last_undegraded":"2023-10-08T12:40:10.786312+0000","last_fullsized":"2023-10-08T12:40:10.786312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:38.475668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790878+0000","last_change":"2023-10-08T12:39:13.219229+0000","last_active":"2023-10-08T12:40:10.790878+0000","last_peered":"2023-10-08T12:40:10.790878+0000","last_clean":"2023-10-08T12:40:10.790878+0000","last_became_active":"2023-10-08T12:39:13.217964+0000","last_became_peered":"2023-10-08T12:39:13.217964+0000","last_unstale":"2023-10-08T12:40:10.790878+0000","last_undegraded":"2023-10-08T12:40:10.790878+0000","last_fullsized":"2023-10-08T12:40:10.790878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:47.480351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.808035+0000","last_change":"2023-10-08T12:40:11.808035+0000","last_active":"2023-10-08T12:40:11.808035+0000","last_peered":"2023-10-08T12:40:11.808035+0000","last_clean":"2023-10-08T12:40:11.808035+0000","last_became_active":"2023-10-08T12:40:11.807611+0000","last_became_peered":"2023-10-08T12:40:11.807611+0000","last_unstale":"2023-10-08T12:40:11.808035+0000","last_undegraded":"2023-10-08T12:40:11.808035+0000","last_fullsized":"2023-10-08T12:40:11.808035+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:51.833325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786745+0000","last_change":"2023-10-08T12:39:13.212791+0000","last_active":"2023-10-08T12:40:10.786745+0000","last_peered":"2023-10-08T12:40:10.786745+0000","last_clean":"2023-10-08T12:40:10.786745+0000","last_became_active":"2023-10-08T12:39:13.212146+0000","last_became_peered":"2023-10-08T12:39:13.212146+0000","last_unstale":"2023-10-08T12:40:10.786745+0000","last_undegraded":"2023-10-08T12:40:10.786745+0000","last_fullsized":"2023-10-08T12:40:10.786745+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:37.452859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.800095+0000","last_change":"2023-10-08T12:40:11.800095+0000","last_active":"2023-10-08T12:40:11.800095+0000","last_peered":"2023-10-08T12:40:11.800095+0000","last_clean":"2023-10-08T12:40:11.800095+0000","last_became_active":"2023-10-08T12:40:11.795780+0000","last_became_peered":"2023-10-08T12:40:11.795780+0000","last_unstale":"2023-10-08T12:40:11.800095+0000","last_undegraded":"2023-10-08T12:40:11.800095+0000","last_fullsized":"2023-10-08T12:40:11.800095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:15.163613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794197+0000","last_change":"2023-10-08T12:39:13.217672+0000","last_active":"2023-10-08T12:40:10.794197+0000","last_peered":"2023-10-08T12:40:10.794197+0000","last_clean":"2023-10-08T12:40:10.794197+0000","last_became_active":"2023-10-08T12:39:13.217277+0000","last_became_peered":"2023-10-08T12:39:13.217277+0000","last_unstale":"2023-10-08T12:40:10.794197+0000","last_undegraded":"2023-10-08T12:40:10.794197+0000","last_fullsized":"2023-10-08T12:40:10.794197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:41.097439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787045+0000","last_change":"2023-10-08T12:39:14.219261+0000","last_active":"2023-10-08T12:40:10.787045+0000","last_peered":"2023-10-08T12:40:10.787045+0000","last_clean":"2023-10-08T12:40:10.787045+0000","last_became_active":"2023-10-08T12:39:14.218963+0000","last_became_peered":"2023-10-08T12:39:14.218963+0000","last_unstale":"2023-10-08T12:40:10.787045+0000","last_undegraded":"2023-10-08T12:40:10.787045+0000","last_fullsized":"2023-10-08T12:40:10.787045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:19.573306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786505+0000","last_change":"2023-10-08T12:39:14.207923+0000","last_active":"2023-10-08T12:40:10.786505+0000","last_peered":"2023-10-08T12:40:10.786505+0000","last_clean":"2023-10-08T12:40:10.786505+0000","last_became_active":"2023-10-08T12:39:14.207634+0000","last_became_peered":"2023-10-08T12:39:14.207634+0000","last_unstale":"2023-10-08T12:40:10.786505+0000","last_undegraded":"2023-10-08T12:40:10.786505+0000","last_fullsized":"2023-10-08T12:40:10.786505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:39.634945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791515+0000","last_change":"2023-10-08T12:39:13.223021+0000","last_active":"2023-10-08T12:40:10.791515+0000","last_peered":"2023-10-08T12:40:10.791515+0000","last_clean":"2023-10-08T12:40:10.791515+0000","last_became_active":"2023-10-08T12:39:13.222680+0000","last_became_peered":"2023-10-08T12:39:13.222680+0000","last_unstale":"2023-10-08T12:40:10.791515+0000","last_undegraded":"2023-10-08T12:40:10.791515+0000","last_fullsized":"2023-10-08T12:40:10.791515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:40.454436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792771+0000","last_change":"2023-10-08T12:39:14.217364+0000","last_active":"2023-10-08T12:40:10.792771+0000","last_peered":"2023-10-08T12:40:10.792771+0000","last_clean":"2023-10-08T12:40:10.792771+0000","last_became_active":"2023-10-08T12:39:14.216984+0000","last_became_peered":"2023-10-08T12:39:14.216984+0000","last_unstale":"2023-10-08T12:40:10.792771+0000","last_undegraded":"2023-10-08T12:40:10.792771+0000","last_fullsized":"2023-10-08T12:40:10.792771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:11:51.818034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792124+0000","last_change":"2023-10-08T12:39:13.207687+0000","last_active":"2023-10-08T12:40:10.792124+0000","last_peered":"2023-10-08T12:40:10.792124+0000","last_clean":"2023-10-08T12:40:10.792124+0000","last_became_active":"2023-10-08T12:39:13.207270+0000","last_became_peered":"2023-10-08T12:39:13.207270+0000","last_unstale":"2023-10-08T12:40:10.792124+0000","last_undegraded":"2023-10-08T12:40:10.792124+0000","last_fullsized":"2023-10-08T12:40:10.792124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:44.673383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":318,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793703+0000","last_change":"2023-10-08T12:38:07.696721+0000","last_active":"2023-10-08T12:40:10.793703+0000","last_peered":"2023-10-08T12:40:10.793703+0000","last_clean":"2023-10-08T12:40:10.793703+0000","last_became_active":"2023-10-08T12:38:07.696336+0000","last_became_peered":"2023-10-08T12:38:07.696336+0000","last_unstale":"2023-10-08T12:40:10.793703+0000","last_undegraded":"2023-10-08T12:40:10.793703+0000","last_fullsized":"2023-10-08T12:40:10.793703+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_clean_scrub_stamp":"2023-10-08T12:34:57.643348+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:01.821924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791426+0000","last_change":"2023-10-08T12:39:14.208845+0000","last_active":"2023-10-08T12:40:10.791426+0000","last_peered":"2023-10-08T12:40:10.791426+0000","last_clean":"2023-10-08T12:40:10.791426+0000","last_became_active":"2023-10-08T12:39:14.208487+0000","last_became_peered":"2023-10-08T12:39:14.208487+0000","last_unstale":"2023-10-08T12:40:10.791426+0000","last_undegraded":"2023-10-08T12:40:10.791426+0000","last_fullsized":"2023-10-08T12:40:10.791426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:26.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793636+0000","last_change":"2023-10-08T12:39:13.216627+0000","last_active":"2023-10-08T12:40:10.793636+0000","last_peered":"2023-10-08T12:40:10.793636+0000","last_clean":"2023-10-08T12:40:10.793636+0000","last_became_active":"2023-10-08T12:39:13.216201+0000","last_became_peered":"2023-10-08T12:39:13.216201+0000","last_unstale":"2023-10-08T12:40:10.793636+0000","last_undegraded":"2023-10-08T12:40:10.793636+0000","last_fullsized":"2023-10-08T12:40:10.793636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:19.873615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790683+0000","last_change":"2023-10-08T12:39:13.219222+0000","last_active":"2023-10-08T12:40:10.790683+0000","last_peered":"2023-10-08T12:40:10.790683+0000","last_clean":"2023-10-08T12:40:10.790683+0000","last_became_active":"2023-10-08T12:39:13.218757+0000","last_became_peered":"2023-10-08T12:39:13.218757+0000","last_unstale":"2023-10-08T12:40:10.790683+0000","last_undegraded":"2023-10-08T12:40:10.790683+0000","last_fullsized":"2023-10-08T12:40:10.790683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:15.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792165+0000","last_change":"2023-10-08T12:39:14.221945+0000","last_active":"2023-10-08T12:40:10.792165+0000","last_peered":"2023-10-08T12:40:10.792165+0000","last_clean":"2023-10-08T12:40:10.792165+0000","last_became_active":"2023-10-08T12:39:14.221625+0000","last_became_peered":"2023-10-08T12:39:14.221625+0000","last_unstale":"2023-10-08T12:40:10.792165+0000","last_undegraded":"2023-10-08T12:40:10.792165+0000","last_fullsized":"2023-10-08T12:40:10.792165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:50.424023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.799358+0000","last_change":"2023-10-08T12:40:11.799358+0000","last_active":"2023-10-08T12:40:11.799358+0000","last_peered":"2023-10-08T12:40:11.799358+0000","last_clean":"2023-10-08T12:40:11.799358+0000","last_became_active":"2023-10-08T12:40:11.792992+0000","last_became_peered":"2023-10-08T12:40:11.792992+0000","last_unstale":"2023-10-08T12:40:11.799358+0000","last_undegraded":"2023-10-08T12:40:11.799358+0000","last_fullsized":"2023-10-08T12:40:11.799358+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:26.689160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792960+0000","last_change":"2023-10-08T12:39:14.214849+0000","last_active":"2023-10-08T12:40:10.792960+0000","last_peered":"2023-10-08T12:40:10.792960+0000","last_clean":"2023-10-08T12:40:10.792960+0000","last_became_active":"2023-10-08T12:39:14.214573+0000","last_became_peered":"2023-10-08T12:39:14.214573+0000","last_unstale":"2023-10-08T12:40:10.792960+0000","last_undegraded":"2023-10-08T12:40:10.792960+0000","last_fullsized":"2023-10-08T12:40:10.792960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:50.922519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791629+0000","last_change":"2023-10-08T12:39:13.206518+0000","last_active":"2023-10-08T12:40:10.791629+0000","last_peered":"2023-10-08T12:40:10.791629+0000","last_clean":"2023-10-08T12:40:10.791629+0000","last_became_active":"2023-10-08T12:39:13.206082+0000","last_became_peered":"2023-10-08T12:39:13.206082+0000","last_unstale":"2023-10-08T12:40:10.791629+0000","last_undegraded":"2023-10-08T12:40:10.791629+0000","last_fullsized":"2023-10-08T12:40:10.791629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:47.980651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790717+0000","last_change":"2023-10-08T12:39:14.220897+0000","last_active":"2023-10-08T12:40:10.790717+0000","last_peered":"2023-10-08T12:40:10.790717+0000","last_clean":"2023-10-08T12:40:10.790717+0000","last_became_active":"2023-10-08T12:39:14.220173+0000","last_became_peered":"2023-10-08T12:39:14.220173+0000","last_unstale":"2023-10-08T12:40:10.790717+0000","last_undegraded":"2023-10-08T12:40:10.790717+0000","last_fullsized":"2023-10-08T12:40:10.790717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:09:02.588054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.281984+0000","last_change":"2023-10-08T12:39:13.213505+0000","last_active":"2023-10-08T12:40:11.281984+0000","last_peered":"2023-10-08T12:40:11.281984+0000","last_clean":"2023-10-08T12:40:11.281984+0000","last_became_active":"2023-10-08T12:39:13.213199+0000","last_became_peered":"2023-10-08T12:39:13.213199+0000","last_unstale":"2023-10-08T12:40:11.281984+0000","last_undegraded":"2023-10-08T12:40:11.281984+0000","last_fullsized":"2023-10-08T12:40:11.281984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:49.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789447+0000","last_change":"2023-10-08T12:39:14.208080+0000","last_active":"2023-10-08T12:40:10.789447+0000","last_peered":"2023-10-08T12:40:10.789447+0000","last_clean":"2023-10-08T12:40:10.789447+0000","last_became_active":"2023-10-08T12:39:14.207788+0000","last_became_peered":"2023-10-08T12:39:14.207788+0000","last_unstale":"2023-10-08T12:40:10.789447+0000","last_undegraded":"2023-10-08T12:40:10.789447+0000","last_fullsized":"2023-10-08T12:40:10.789447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:44.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791994+0000","last_change":"2023-10-08T12:39:13.216003+0000","last_active":"2023-10-08T12:40:10.791994+0000","last_peered":"2023-10-08T12:40:10.791994+0000","last_clean":"2023-10-08T12:40:10.791994+0000","last_became_active":"2023-10-08T12:39:13.215662+0000","last_became_peered":"2023-10-08T12:39:13.215662+0000","last_unstale":"2023-10-08T12:40:10.791994+0000","last_undegraded":"2023-10-08T12:40:10.791994+0000","last_fullsized":"2023-10-08T12:40:10.791994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:28.310430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.788835+0000","last_change":"2023-10-08T12:39:14.204336+0000","last_active":"2023-10-08T12:40:10.788835+0000","last_peered":"2023-10-08T12:40:10.788835+0000","last_clean":"2023-10-08T12:40:10.788835+0000","last_became_active":"2023-10-08T12:39:14.203993+0000","last_became_peered":"2023-10-08T12:39:14.203993+0000","last_unstale":"2023-10-08T12:40:10.788835+0000","last_undegraded":"2023-10-08T12:40:10.788835+0000","last_fullsized":"2023-10-08T12:40:10.788835+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:54.545166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.793371+0000","last_change":"2023-10-08T12:40:11.793371+0000","last_active":"2023-10-08T12:40:11.793371+0000","last_peered":"2023-10-08T12:40:11.793371+0000","last_clean":"2023-10-08T12:40:11.793371+0000","last_became_active":"2023-10-08T12:40:11.792968+0000","last_became_peered":"2023-10-08T12:40:11.792968+0000","last_unstale":"2023-10-08T12:40:11.793371+0000","last_undegraded":"2023-10-08T12:40:11.793371+0000","last_fullsized":"2023-10-08T12:40:11.793371+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:20.744535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792529+0000","last_change":"2023-10-08T12:39:14.221040+0000","last_active":"2023-10-08T12:40:10.792529+0000","last_peered":"2023-10-08T12:40:10.792529+0000","last_clean":"2023-10-08T12:40:10.792529+0000","last_became_active":"2023-10-08T12:39:14.220724+0000","last_became_peered":"2023-10-08T12:39:14.220724+0000","last_unstale":"2023-10-08T12:40:10.792529+0000","last_undegraded":"2023-10-08T12:40:10.792529+0000","last_fullsized":"2023-10-08T12:40:10.792529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:52.824228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790002+0000","last_change":"2023-10-08T12:39:13.212244+0000","last_active":"2023-10-08T12:40:10.790002+0000","last_peered":"2023-10-08T12:40:10.790002+0000","last_clean":"2023-10-08T12:40:10.790002+0000","last_became_active":"2023-10-08T12:39:13.212028+0000","last_became_peered":"2023-10-08T12:39:13.212028+0000","last_unstale":"2023-10-08T12:40:10.790002+0000","last_undegraded":"2023-10-08T12:40:10.790002+0000","last_fullsized":"2023-10-08T12:40:10.790002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:06.111807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793868+0000","last_change":"2023-10-08T12:39:14.216665+0000","last_active":"2023-10-08T12:40:10.793868+0000","last_peered":"2023-10-08T12:40:10.793868+0000","last_clean":"2023-10-08T12:40:10.793868+0000","last_became_active":"2023-10-08T12:39:14.216330+0000","last_became_peered":"2023-10-08T12:39:14.216330+0000","last_unstale":"2023-10-08T12:40:10.793868+0000","last_undegraded":"2023-10-08T12:40:10.793868+0000","last_fullsized":"2023-10-08T12:40:10.793868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.658600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793792+0000","last_change":"2023-10-08T12:39:13.214495+0000","last_active":"2023-10-08T12:40:10.793792+0000","last_peered":"2023-10-08T12:40:10.793792+0000","last_clean":"2023-10-08T12:40:10.793792+0000","last_became_active":"2023-10-08T12:39:13.213930+0000","last_became_peered":"2023-10-08T12:39:13.213930+0000","last_unstale":"2023-10-08T12:40:10.793792+0000","last_undegraded":"2023-10-08T12:40:10.793792+0000","last_fullsized":"2023-10-08T12:40:10.793792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:20:38.096164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794264+0000","last_change":"2023-10-08T12:39:14.212566+0000","last_active":"2023-10-08T12:40:10.794264+0000","last_peered":"2023-10-08T12:40:10.794264+0000","last_clean":"2023-10-08T12:40:10.794264+0000","last_became_active":"2023-10-08T12:39:14.211756+0000","last_became_peered":"2023-10-08T12:39:14.211756+0000","last_unstale":"2023-10-08T12:40:10.794264+0000","last_undegraded":"2023-10-08T12:40:10.794264+0000","last_fullsized":"2023-10-08T12:40:10.794264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:12.741640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786680+0000","last_change":"2023-10-08T12:39:13.217914+0000","last_active":"2023-10-08T12:40:10.786680+0000","last_peered":"2023-10-08T12:40:10.786680+0000","last_clean":"2023-10-08T12:40:10.786680+0000","last_became_active":"2023-10-08T12:39:13.217571+0000","last_became_peered":"2023-10-08T12:39:13.217571+0000","last_unstale":"2023-10-08T12:40:10.786680+0000","last_undegraded":"2023-10-08T12:40:10.786680+0000","last_fullsized":"2023-10-08T12:40:10.786680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:10.826007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794134+0000","last_change":"2023-10-08T12:39:14.214280+0000","last_active":"2023-10-08T12:40:10.794134+0000","last_peered":"2023-10-08T12:40:10.794134+0000","last_clean":"2023-10-08T12:40:10.794134+0000","last_became_active":"2023-10-08T12:39:14.213942+0000","last_became_peered":"2023-10-08T12:39:14.213942+0000","last_unstale":"2023-10-08T12:40:10.794134+0000","last_undegraded":"2023-10-08T12:40:10.794134+0000","last_fullsized":"2023-10-08T12:40:10.794134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:17:21.450265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791974+0000","last_change":"2023-10-08T12:39:13.222484+0000","last_active":"2023-10-08T12:40:10.791974+0000","last_peered":"2023-10-08T12:40:10.791974+0000","last_clean":"2023-10-08T12:40:10.791974+0000","last_became_active":"2023-10-08T12:39:13.222091+0000","last_became_peered":"2023-10-08T12:39:13.222091+0000","last_unstale":"2023-10-08T12:40:10.791974+0000","last_undegraded":"2023-10-08T12:40:10.791974+0000","last_fullsized":"2023-10-08T12:40:10.791974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:00.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794574+0000","last_change":"2023-10-08T12:39:14.207715+0000","last_active":"2023-10-08T12:40:10.794574+0000","last_peered":"2023-10-08T12:40:10.794574+0000","last_clean":"2023-10-08T12:40:10.794574+0000","last_became_active":"2023-10-08T12:39:14.207429+0000","last_became_peered":"2023-10-08T12:39:14.207429+0000","last_unstale":"2023-10-08T12:40:10.794574+0000","last_undegraded":"2023-10-08T12:40:10.794574+0000","last_fullsized":"2023-10-08T12:40:10.794574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:16.991831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.788904+0000","last_change":"2023-10-08T12:39:14.200398+0000","last_active":"2023-10-08T12:40:10.788904+0000","last_peered":"2023-10-08T12:40:10.788904+0000","last_clean":"2023-10-08T12:40:10.788904+0000","last_became_active":"2023-10-08T12:39:14.200035+0000","last_became_peered":"2023-10-08T12:39:14.200035+0000","last_unstale":"2023-10-08T12:40:10.788904+0000","last_undegraded":"2023-10-08T12:40:10.788904+0000","last_fullsized":"2023-10-08T12:40:10.788904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:13.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793521+0000","last_change":"2023-10-08T12:39:14.202185+0000","last_active":"2023-10-08T12:40:10.793521+0000","last_peered":"2023-10-08T12:40:10.793521+0000","last_clean":"2023-10-08T12:40:10.793521+0000","last_became_active":"2023-10-08T12:39:14.201232+0000","last_became_peered":"2023-10-08T12:39:14.201232+0000","last_unstale":"2023-10-08T12:40:10.793521+0000","last_undegraded":"2023-10-08T12:40:10.793521+0000","last_fullsized":"2023-10-08T12:40:10.793521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:50.949047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793459+0000","last_change":"2023-10-08T12:39:14.208014+0000","last_active":"2023-10-08T12:40:10.793459+0000","last_peered":"2023-10-08T12:40:10.793459+0000","last_clean":"2023-10-08T12:40:10.793459+0000","last_became_active":"2023-10-08T12:39:14.207579+0000","last_became_peered":"2023-10-08T12:39:14.207579+0000","last_unstale":"2023-10-08T12:40:10.793459+0000","last_undegraded":"2023-10-08T12:40:10.793459+0000","last_fullsized":"2023-10-08T12:40:10.793459+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:37.352827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.796652+0000","last_change":"2023-10-08T12:40:11.796652+0000","last_active":"2023-10-08T12:40:11.796652+0000","last_peered":"2023-10-08T12:40:11.796652+0000","last_clean":"2023-10-08T12:40:11.796652+0000","last_became_active":"2023-10-08T12:40:11.796346+0000","last_became_peered":"2023-10-08T12:40:11.796346+0000","last_unstale":"2023-10-08T12:40:11.796652+0000","last_undegraded":"2023-10-08T12:40:11.796652+0000","last_fullsized":"2023-10-08T12:40:11.796652+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:25:31.781651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792262+0000","last_change":"2023-10-08T12:39:14.222630+0000","last_active":"2023-10-08T12:40:10.792262+0000","last_peered":"2023-10-08T12:40:10.792262+0000","last_clean":"2023-10-08T12:40:10.792262+0000","last_became_active":"2023-10-08T12:39:14.222300+0000","last_became_peered":"2023-10-08T12:39:14.222300+0000","last_unstale":"2023-10-08T12:40:10.792262+0000","last_undegraded":"2023-10-08T12:40:10.792262+0000","last_fullsized":"2023-10-08T12:40:10.792262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.040227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789101+0000","last_change":"2023-10-08T12:39:14.207144+0000","last_active":"2023-10-08T12:40:10.789101+0000","last_peered":"2023-10-08T12:40:10.789101+0000","last_clean":"2023-10-08T12:40:10.789101+0000","last_became_active":"2023-10-08T12:39:14.206775+0000","last_became_peered":"2023-10-08T12:39:14.206775+0000","last_unstale":"2023-10-08T12:40:10.789101+0000","last_undegraded":"2023-10-08T12:40:10.789101+0000","last_fullsized":"2023-10-08T12:40:10.789101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:55.224270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794188+0000","last_change":"2023-10-08T12:39:14.204123+0000","last_active":"2023-10-08T12:40:10.794188+0000","last_peered":"2023-10-08T12:40:10.794188+0000","last_clean":"2023-10-08T12:40:10.794188+0000","last_became_active":"2023-10-08T12:39:14.203123+0000","last_became_peered":"2023-10-08T12:39:14.203123+0000","last_unstale":"2023-10-08T12:40:10.794188+0000","last_undegraded":"2023-10-08T12:40:10.794188+0000","last_fullsized":"2023-10-08T12:40:10.794188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:45.423095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792878+0000","last_change":"2023-10-08T12:39:14.211049+0000","last_active":"2023-10-08T12:40:10.792878+0000","last_peered":"2023-10-08T12:40:10.792878+0000","last_clean":"2023-10-08T12:40:10.792878+0000","last_became_active":"2023-10-08T12:39:14.210738+0000","last_became_peered":"2023-10-08T12:39:14.210738+0000","last_unstale":"2023-10-08T12:40:10.792878+0000","last_undegraded":"2023-10-08T12:40:10.792878+0000","last_fullsized":"2023-10-08T12:40:10.792878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:12.535857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786331+0000","last_change":"2023-10-08T12:39:14.220013+0000","last_active":"2023-10-08T12:40:10.786331+0000","last_peered":"2023-10-08T12:40:10.786331+0000","last_clean":"2023-10-08T12:40:10.786331+0000","last_became_active":"2023-10-08T12:39:14.219711+0000","last_became_peered":"2023-10-08T12:39:14.219711+0000","last_unstale":"2023-10-08T12:40:10.786331+0000","last_undegraded":"2023-10-08T12:40:10.786331+0000","last_fullsized":"2023-10-08T12:40:10.786331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:23.205074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791907+0000","last_change":"2023-10-08T12:39:14.214237+0000","last_active":"2023-10-08T12:40:10.791907+0000","last_peered":"2023-10-08T12:40:10.791907+0000","last_clean":"2023-10-08T12:40:10.791907+0000","last_became_active":"2023-10-08T12:39:14.213891+0000","last_became_peered":"2023-10-08T12:39:14.213891+0000","last_unstale":"2023-10-08T12:40:10.791907+0000","last_undegraded":"2023-10-08T12:40:10.791907+0000","last_fullsized":"2023-10-08T12:40:10.791907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:11.348411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282101+0000","last_change":"2023-10-08T12:39:14.209037+0000","last_active":"2023-10-08T12:40:11.282101+0000","last_peered":"2023-10-08T12:40:11.282101+0000","last_clean":"2023-10-08T12:40:11.282101+0000","last_became_active":"2023-10-08T12:39:14.208728+0000","last_became_peered":"2023-10-08T12:39:14.208728+0000","last_unstale":"2023-10-08T12:40:11.282101+0000","last_undegraded":"2023-10-08T12:40:11.282101+0000","last_fullsized":"2023-10-08T12:40:11.282101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:23.440413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793173+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:10.793173+0000","last_peered":"2023-10-08T12:40:10.793173+0000","last_clean":"2023-10-08T12:40:10.793173+0000","last_became_active":"2023-10-08T12:39:14.222393+0000","last_became_peered":"2023-10-08T12:39:14.222393+0000","last_unstale":"2023-10-08T12:40:10.793173+0000","last_undegraded":"2023-10-08T12:40:10.793173+0000","last_fullsized":"2023-10-08T12:40:10.793173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:19.704140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789020+0000","last_change":"2023-10-08T12:39:14.200858+0000","last_active":"2023-10-08T12:40:10.789020+0000","last_peered":"2023-10-08T12:40:10.789020+0000","last_clean":"2023-10-08T12:40:10.789020+0000","last_became_active":"2023-10-08T12:39:14.199948+0000","last_became_peered":"2023-10-08T12:39:14.199948+0000","last_unstale":"2023-10-08T12:40:10.789020+0000","last_undegraded":"2023-10-08T12:40:10.789020+0000","last_fullsized":"2023-10-08T12:40:10.789020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:10.366380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281436,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59958,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":130,"num_read_kb":124,"num_write":68,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":179874,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416410,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":462175,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60499999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.753},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73499999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.77100000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.82599999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.71099999999999997}]},{"osd":9,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.84799999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.878},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.86199999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645341,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":1111689,"data_compressed":43212,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.46300000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.376,"15min":0.376},"max":{"1min":0.76400000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81399999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.76300000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.64300000000000002,"15min":0.65300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.61199999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72999999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.5},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.68899999999999995}]},{"osd":5,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.84499999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83599999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65900000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.86499999999999999,"15min":0.88700000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.583,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.98099999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":1.022}]},{"osd":11,"last update":"Sun Oct 8 12:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.88600000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808864,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":462880,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.37}]},{"osd":1,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.497,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.68100000000000005}]},{"osd":2,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":3.1269999999999998,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.55600000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58299999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.212,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.82699999999999996,"15min":0.83499999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.88600000000000001,"15min":0.90000000000000002},"min":{"1min":0.60899999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":1.325,"15min":1.325},"last":0.72799999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.93799999999999994,"15min":0.94699999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.0720000000000001,"5min":3.0720000000000001,"15min":3.0720000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.86599999999999999,"15min":0.874},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.93100000000000005,"15min":0.94699999999999995},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2729999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.999,"15min":1.0029999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.98,"5min":2.98,"15min":2.98},"last":0.74399999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.016,"15min":1.0249999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.96199999999999997,"15min":0.97199999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.84799999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.95899999999999996,"15min":0.95299999999999996},"min":{"1min":0.63500000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.90300000000000002,"15min":0.90400000000000003},"min":{"1min":0.60799999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.76000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070501,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":462448,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.35199999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58899999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.28399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.55900000000000005}]},{"osd":3,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.40000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83699999999999997,"5min":0.879,"15min":0.879},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.43099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.41299999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.34499999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98899999999999999,"5min":1.181,"15min":1.181},"last":0.78500000000000003}]},{"osd":9,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.75900000000000001,"15min":0.753},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.75800000000000001,"15min":0.746},"min":{"1min":0.57399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.753}]},{"osd":10,"last update":"Sun Oct 8 12:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.77400000000000002,"15min":0.76500000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.54300000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.877}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299435,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":1053248,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.877,"15min":0.877},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.434},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51900000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.745,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.78900000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.80400000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.39000000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82899999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.751}]},{"osd":6,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.628},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.58899999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69899999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.441},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.88400000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.60899999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91700000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65300000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.871}]}]},{"osd":6,"up_from":47,"seq":201863462959,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":462298,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.442}]},{"osd":1,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79400000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.749}]},{"osd":2,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.56399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.629},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76100000000000001,"15min":0.77000000000000002},"min":{"1min":0.497,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.032,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.49299999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.73499999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82099999999999995,"5min":6.875,"15min":6.875},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0229999999999999,"5min":1.095,"15min":1.095},"last":0.76700000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.125,"15min":1.125},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83299999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.79000000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:39:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81000000000000005,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.86099999999999999,"15min":0.83299999999999996},"min":{"1min":0.66900000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.92400000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.95999999999999996,"15min":0.97499999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1200000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84599999999999997,"15min":0.85199999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81499999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.88900000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.873},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.98399999999999999,"15min":0.998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.452,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.94699999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":521004,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.67000000000000004,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73099999999999998,"5min":1.452,"15min":1.452},"last":0.41199999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.55300000000000005,"15min":0.52500000000000002},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72799999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:39:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74299999999999999,"5min":1.413,"15min":1.413},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.57199999999999995},"min":{"1min":0.41799999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":1.427,"15min":1.427},"last":0.58699999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.42999999999999999,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.42999999999999999,"15min":0.39800000000000002},"min":{"1min":0.316,"5min":0.245,"15min":0.245},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.44900000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.63500000000000001,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.621,"15min":0.58799999999999997},"min":{"1min":0.51900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.123,"5min":1.355,"15min":1.355},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.99199999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.56599999999999995}]},{"osd":8,"last update":"Sun Oct 8 12:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.625},"min":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.64700000000000002,"15min":0.63200000000000001},"min":{"1min":0.505,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79800000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73199999999999998,"15min":0.72199999999999998},"min":{"1min":0.50800000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.65100000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.76900000000000002,"15min":0.755},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.73499999999999999,"15min":0.72199999999999998},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.84599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":462265,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:39:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.56000000000000005},"min":{"1min":0.35199999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63500000000000001,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.046},"last":0.58199999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65600000000000003,"15min":0.58899999999999997},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0089999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64100000000000001,"15min":0.58899999999999997},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.079,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.443},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.59799999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:39:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66100000000000003,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.619,"5min":1.911,"15min":1.911},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.61299999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92100000000000004,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.626},{"interface":"front","average":{"1min":0.755,"5min":0.745,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.50600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.873,"15min":0.879},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.048,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.68600000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.88200000000000001,"15min":0.89900000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.24,"15min":1.24},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.92900000000000005,"15min":0.94299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1259999999999999,"5min":1.298,"15min":1.298},"last":0.77000000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.94299999999999995,"15min":0.96599999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.78600000000000003}]},{"osd":11,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.752}]}]},{"osd":2,"up_from":19,"seq":81604378690,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":521369,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.41999999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.82899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":1.194,"15min":1.194},"last":0.63900000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:40:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56699999999999995,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81200000000000006,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.623},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.58599999999999997,"15min":0.52600000000000002},"min":{"1min":0.45200000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79400000000000004}]},{"osd":3,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83299999999999996,"5min":1.073,"15min":1.073},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91500000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66400000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.45100000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.435,"5min":0.378,"15min":0.378},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.71499999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.40999999999999998},"min":{"1min":0.28799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.44,"15min":0.42599999999999999},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.69099999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.621,"15min":0.59899999999999998},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":1.04,"15min":1.04},"last":0.75700000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77800000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:39:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95099999999999996,"5min":1.024,"15min":1.024},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77900000000000003,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.85299999999999998,"5min":1.087,"15min":1.087},"last":0.80800000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.875}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149757,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":462071,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46800000000000003,"15min":0.42999999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.72899999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.504,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81899999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.60899999999999999},"min":{"1min":0.53800000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":1.081,"15min":1.081},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.63200000000000001,"15min":0.59899999999999998},"min":{"1min":0.495,"5min":0.371,"15min":0.371},"max":{"1min":0.92600000000000005,"5min":1.05,"15min":1.05},"last":0.67500000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.42899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88700000000000001,"5min":1.077,"15min":1.077},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70599999999999996,"15min":0.68700000000000006},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.98099999999999998,"5min":1.23,"15min":1.23},"last":0.84799999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67900000000000005,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71899999999999997,"15min":0.66700000000000004},"min":{"1min":0.57299999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.042,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89200000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.70699999999999996,"15min":0.69099999999999995},"min":{"1min":0.52700000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89400000000000002,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0669999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":1.0069999999999999,"5min":1.109,"15min":1.109},"last":0.77600000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61799999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.069,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.53100000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0840000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.88800000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.89400000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.96499999999999997,"15min":0.998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1739999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.91900000000000004,"15min":0.93500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.121,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.92900000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.93500000000000005,"15min":0.94999999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0549999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.878},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.95399999999999996,"15min":0.97599999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.238,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.86399999999999999}]},{"osd":11,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.90400000000000003}]}]},{"osd":4,"up_from":34,"seq":146028888121,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":453357,"data_compressed":2901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67100000000000004,"15min":0.71999999999999997},"min":{"1min":0.439,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":6.0549999999999997,"15min":6.0549999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39500000000000002,"15min":0.36099999999999999},"min":{"1min":0.33000000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.629,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.38400000000000001},"min":{"1min":0.32400000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.74099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48599999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.58699999999999997,"15min":0.56000000000000005},"min":{"1min":0.52300000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.873},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.54400000000000004,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.77900000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57999999999999996,"15min":0.53200000000000003},"min":{"1min":0.45700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.623},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58299999999999996,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83099999999999996,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.746}]},{"osd":5,"last update":"Sun Oct 8 12:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.626,"15min":0.55900000000000005},"min":{"1min":0.51700000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81899999999999995,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.62,"15min":0.57399999999999995},"min":{"1min":0.45100000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63100000000000001,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.876,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.52800000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.56499999999999995},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.88700000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.55600000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.119,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.71399999999999997,"15min":0.70099999999999996},"min":{"1min":0.55300000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96299999999999997,"5min":1.242,"15min":1.242},"last":0.81499999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.91500000000000004,"5min":1.349,"15min":1.349},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.016,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.90500000000000003}]},{"osd":10,"last update":"Sun Oct 8 12:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98199999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.004,"5min":1.171,"15min":1.171},"last":0.83699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":5,"up_from":39,"seq":167503724595,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1052517,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88600000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78200000000000003,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.45800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.39900000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.67800000000000005}]},{"osd":3,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.57099999999999995,"15min":0.55300000000000005},"min":{"1min":0.44600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.93300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69899999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.86899999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:39:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64900000000000002,"15min":0.63100000000000001},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.94999999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.82999999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.81699999999999995,"15min":0.79300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.91200000000000003}]},{"osd":10,"last update":"Sun Oct 8 12:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.59599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.97599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.98199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59160,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59194,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59354,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:40:17.461 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph status --format=json 2023-10-08T12:40:18.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:17 smithi092 ceph-mon[134093]: pgmap v287: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 15 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:18.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:17 smithi092 ceph-mon[134093]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:18.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:17 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:40:18.210 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:17 smithi173 ceph-mon[135182]: pgmap v287: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 15 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:17 smithi173 ceph-mon[135182]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:18.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:17 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:40:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:17 smithi059 ceph-mon[98489]: pgmap v287: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 15 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:17 smithi059 ceph-mon[98489]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:17 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:40:19.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.840+0000 7f735bcd0700 1 -- 172.21.15.59:0/310665787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7354072a20 msgr2=0x7f7354072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:19.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.840+0000 7f735bcd0700 1 --2- 172.21.15.59:0/310665787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7354072a20 0x7f7354072e00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7350009990 tx=0x7f7350009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:19.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.840+0000 7f735bcd0700 1 -- 172.21.15.59:0/310665787 shutdown_connections 2023-10-08T12:40:19.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.840+0000 7f735bcd0700 1 --2- 172.21.15.59:0/310665787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f735410d250 0x7f735410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:19.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.840+0000 7f735bcd0700 1 --2- 172.21.15.59:0/310665787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7354072a20 0x7f7354072e00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:19.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.840+0000 7f735bcd0700 1 --2- 172.21.15.59:0/310665787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7354073340 0x7f735410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:19.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.840+0000 7f735bcd0700 1 -- 172.21.15.59:0/310665787 >> 172.21.15.59:0/310665787 conn(0x7f73540779e0 msgr2=0x7f7354077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:19.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.840+0000 7f735bcd0700 1 -- 172.21.15.59:0/310665787 shutdown_connections 2023-10-08T12:40:19.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.840+0000 7f735bcd0700 1 -- 172.21.15.59:0/310665787 wait complete. 2023-10-08T12:40:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.841+0000 7f735bcd0700 1 Processor -- start 2023-10-08T12:40:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.842+0000 7f735bcd0700 1 -- start start 2023-10-08T12:40:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.842+0000 7f735bcd0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7354072a20 0x7f7354198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.842+0000 7f735bcd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7354073340 0x7f7354199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:19.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.842+0000 7f735bcd0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f735410d250 0x7f735419d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:19.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.842+0000 7f735bcd0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735419dd90 con 0x7f7354073340 2023-10-08T12:40:19.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.842+0000 7f735bcd0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735419df00 con 0x7f7354072a20 2023-10-08T12:40:19.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.842+0000 7f735bcd0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735419e0c0 con 0x7f735410d250 2023-10-08T12:40:19.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f735926b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7354073340 0x7f7354199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:19.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f7359a6c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7354072a20 0x7f7354198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:19.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f735926b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7354073340 0x7f7354199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42432/0 (socket says 172.21.15.59:42432) 2023-10-08T12:40:19.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f735926b700 1 -- 172.21.15.59:0/2750197839 learned_addr learned my addr 172.21.15.59:0/2750197839 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:19.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f7359a6c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7354072a20 0x7f7354198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54474/0 (socket says 172.21.15.59:54474) 2023-10-08T12:40:19.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f735a26d700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f735410d250 0x7f735419d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:19.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f735926b700 1 -- 172.21.15.59:0/2750197839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f735410d250 msgr2=0x7f735419d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:19.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f735926b700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f735410d250 0x7f735419d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:19.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f735926b700 1 -- 172.21.15.59:0/2750197839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7354072a20 msgr2=0x7f7354198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:19.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f735926b700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7354072a20 0x7f7354198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:19.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f735926b700 1 -- 172.21.15.59:0/2750197839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73500095f0 con 0x7f7354073340 2023-10-08T12:40:19.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f7359a6c700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7354072a20 0x7f7354198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:19.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f735926b700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7354073340 0x7f7354199420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f734400e9a0 tx=0x7f734400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:19.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.843+0000 7f734affd700 1 -- 172.21.15.59:0/2750197839 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344009790 con 0x7f7354073340 2023-10-08T12:40:19.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.844+0000 7f735bcd0700 1 -- 172.21.15.59:0/2750197839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735419e3a0 con 0x7f7354073340 2023-10-08T12:40:19.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.844+0000 7f734affd700 1 -- 172.21.15.59:0/2750197839 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7344010430 con 0x7f7354073340 2023-10-08T12:40:19.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.844+0000 7f734affd700 1 -- 172.21.15.59:0/2750197839 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344018680 con 0x7f7354073340 2023-10-08T12:40:19.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.844+0000 7f735bcd0700 1 -- 172.21.15.59:0/2750197839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73541a5c00 con 0x7f7354073340 2023-10-08T12:40:19.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.845+0000 7f735bcd0700 1 -- 172.21.15.59:0/2750197839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7354108460 con 0x7f7354073340 2023-10-08T12:40:19.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.847+0000 7f734affd700 1 -- 172.21.15.59:0/2750197839 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f73440105a0 con 0x7f7354073340 2023-10-08T12:40:19.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.848+0000 7f734affd700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73400a1560 0x7f73400a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:19.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.848+0000 7f734affd700 1 -- 172.21.15.59:0/2750197839 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7344014070 con 0x7f7354073340 2023-10-08T12:40:19.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.848+0000 7f7359a6c700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73400a1560 0x7f73400a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:19.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.849+0000 7f7359a6c700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73400a1560 0x7f73400a3a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7350006010 tx=0x7f735000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:19.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:19.852+0000 7f734affd700 1 -- 172.21.15.59:0/2750197839 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7344052100 con 0x7f7354073340 2023-10-08T12:40:19.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:19 smithi173 ceph-mon[135182]: pgmap v288: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 15 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:20.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:19 smithi059 ceph-mon[98489]: pgmap v288: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 15 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:20.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:19 smithi092 ceph-mon[134093]: pgmap v288: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 15 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:20.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.178+0000 7f735bcd0700 1 -- 172.21.15.59:0/2750197839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f735419a1a0 con 0x7f7354073340 2023-10-08T12:40:20.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.179+0000 7f734affd700 1 -- 172.21.15.59:0/2750197839 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1503 (secure 0 0 0) 0x7f73440965a0 con 0x7f7354073340 2023-10-08T12:40:20.180 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:20.180 INFO:teuthology.orchestra.run.smithi059.stdout:{"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":443,"monmap":{"epoch":3,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":86,"num_osds":12,"num_up_osds":12,"osd_up_since":1696768705,"num_in_osds":12,"osd_in_since":1696768687,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":26,"data_bytes":650572,"bytes_used":343609344,"bytes_avail":1151596818432,"bytes_total":1151940427776,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":15,"recovering_keys_per_sec":0,"num_objects_recovered":2,"num_bytes_recovered":123,"num_keys_recovered":7,"read_bytes_sec":639,"read_op_per_sec":1,"write_op_per_sec":0},"fsmap":{"epoch":20,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"i","status":"up:standby-replay","gid":24673},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24710}],"up:standby":10},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"services":{"dashboard":"https://172.21.15.59:8443/"}},"servicemap":{"epoch":28,"modified":"2023-10-08T12:40:18.795441+0000","services":{"mds":{"daemons":{"summary":"","i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-08T12:40:20.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 -- 172.21.15.59:0/2750197839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73400a1560 msgr2=0x7f73400a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:20.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73400a1560 0x7f73400a3a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7350006010 tx=0x7f735000b260 comp rx=0 tx=0).stop 2023-10-08T12:40:20.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 -- 172.21.15.59:0/2750197839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7354073340 msgr2=0x7f7354199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7354073340 0x7f7354199420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f734400e9a0 tx=0x7f734400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 -- 172.21.15.59:0/2750197839 shutdown_connections 2023-10-08T12:40:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73400a1560 0x7f73400a3a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7354072a20 0x7f7354198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f735410d250 0x7f735419d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 --2- 172.21.15.59:0/2750197839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7354073340 0x7f7354199420 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 -- 172.21.15.59:0/2750197839 >> 172.21.15.59:0/2750197839 conn(0x7f73540779e0 msgr2=0x7f73540fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 -- 172.21.15.59:0/2750197839 shutdown_connections 2023-10-08T12:40:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:20.181+0000 7f735bcd0700 1 -- 172.21.15.59:0/2750197839 wait complete. 2023-10-08T12:40:20.719 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2023-10-08T12:40:20.719 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T12:40:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:21 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:21 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2750197839' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2023-10-08T12:40:21.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:21 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:21 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2750197839' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2023-10-08T12:40:21.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:21 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:21.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:21 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2750197839' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2023-10-08T12:40:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:22.078 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:22 smithi059 ceph-mon[98489]: pgmap v289: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s; 12 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:22.078 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:22.078 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:22 smithi092 ceph-mon[134093]: pgmap v289: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s; 12 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:22.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:22 smithi173 ceph-mon[135182]: pgmap v289: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s; 12 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:22.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:22.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:22.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.940+0000 7fd0a985b700 1 -- 172.21.15.59:0/2865516691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a4072a20 msgr2=0x7fd0a4072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:22.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.940+0000 7fd0a985b700 1 --2- 172.21.15.59:0/2865516691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a4072a20 0x7fd0a4072e00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd094009990 tx=0x7fd094009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:22.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.940+0000 7fd0a985b700 1 -- 172.21.15.59:0/2865516691 shutdown_connections 2023-10-08T12:40:22.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.940+0000 7fd0a985b700 1 --2- 172.21.15.59:0/2865516691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0a410d250 0x7fd0a410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:22.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.940+0000 7fd0a985b700 1 --2- 172.21.15.59:0/2865516691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a4072a20 0x7fd0a4072e00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:22.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.940+0000 7fd0a985b700 1 --2- 172.21.15.59:0/2865516691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a4073340 0x7fd0a410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:22.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.940+0000 7fd0a985b700 1 -- 172.21.15.59:0/2865516691 >> 172.21.15.59:0/2865516691 conn(0x7fd0a40779e0 msgr2=0x7fd0a4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:22.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.940+0000 7fd0a985b700 1 -- 172.21.15.59:0/2865516691 shutdown_connections 2023-10-08T12:40:22.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.940+0000 7fd0a985b700 1 -- 172.21.15.59:0/2865516691 wait complete. 2023-10-08T12:40:22.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.941+0000 7fd0a985b700 1 Processor -- start 2023-10-08T12:40:22.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.941+0000 7fd0a985b700 1 -- start start 2023-10-08T12:40:22.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.942+0000 7fd0a985b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a4072a20 0x7fd0a4198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:22.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.942+0000 7fd0a985b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a4073340 0x7fd0a4199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:22.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.942+0000 7fd0a985b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0a410d250 0x7fd0a419d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:22.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.942+0000 7fd0a985b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a419ddb0 con 0x7fd0a4073340 2023-10-08T12:40:22.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.942+0000 7fd0a985b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a419df20 con 0x7fd0a4072a20 2023-10-08T12:40:22.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.942+0000 7fd0a985b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a419e0e0 con 0x7fd0a410d250 2023-10-08T12:40:22.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.942+0000 7fd0a27fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a4073340 0x7fd0a4199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:22.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.942+0000 7fd0a27fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a4073340 0x7fd0a4199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51388/0 (socket says 172.21.15.59:51388) 2023-10-08T12:40:22.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.942+0000 7fd0a27fc700 1 -- 172.21.15.59:0/2200458932 learned_addr learned my addr 172.21.15.59:0/2200458932 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:22.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.942+0000 7fd0a37fe700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0a410d250 0x7fd0a419d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:22.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.942+0000 7fd0a2ffd700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a4072a20 0x7fd0a4198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:22.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.943+0000 7fd0a27fc700 1 -- 172.21.15.59:0/2200458932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0a410d250 msgr2=0x7fd0a419d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:22.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.943+0000 7fd0a27fc700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0a410d250 0x7fd0a419d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:22.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.943+0000 7fd0a27fc700 1 -- 172.21.15.59:0/2200458932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a4072a20 msgr2=0x7fd0a4198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:22.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.943+0000 7fd0a27fc700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a4072a20 0x7fd0a4198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:22.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.943+0000 7fd0a27fc700 1 -- 172.21.15.59:0/2200458932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0940095f0 con 0x7fd0a4073340 2023-10-08T12:40:22.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.943+0000 7fd0a27fc700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a4073340 0x7fd0a4199440 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd09800d980 tx=0x7fd09800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:22.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.943+0000 7fd0a8859700 1 -- 172.21.15.59:0/2200458932 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098004220 con 0x7fd0a4073340 2023-10-08T12:40:22.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.943+0000 7fd0a985b700 1 -- 172.21.15.59:0/2200458932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a419e3c0 con 0x7fd0a4073340 2023-10-08T12:40:22.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.943+0000 7fd0a8859700 1 -- 172.21.15.59:0/2200458932 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd098007640 con 0x7fd0a4073340 2023-10-08T12:40:22.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.943+0000 7fd0a8859700 1 -- 172.21.15.59:0/2200458932 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098005690 con 0x7fd0a4073340 2023-10-08T12:40:22.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.943+0000 7fd0a985b700 1 -- 172.21.15.59:0/2200458932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a41a5c20 con 0x7fd0a4073340 2023-10-08T12:40:22.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.944+0000 7fd0a985b700 1 -- 172.21.15.59:0/2200458932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a4108460 con 0x7fd0a4073340 2023-10-08T12:40:22.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.946+0000 7fd0a8859700 1 -- 172.21.15.59:0/2200458932 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fd098004750 con 0x7fd0a4073340 2023-10-08T12:40:22.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.948+0000 7fd0a8859700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd08c0a15e0 0x7fd08c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:22.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.948+0000 7fd0a8859700 1 -- 172.21.15.59:0/2200458932 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd0980ccd80 con 0x7fd0a4073340 2023-10-08T12:40:22.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.948+0000 7fd0a2ffd700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd08c0a15e0 0x7fd08c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:22.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.949+0000 7fd0a2ffd700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd08c0a15e0 0x7fd08c0a3aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd094006010 tx=0x7fd09400b540 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:22.952+0000 7fd0a8859700 1 -- 172.21.15.59:0/2200458932 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd098096180 con 0x7fd0a4073340 2023-10-08T12:40:23.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.160+0000 7fd0a985b700 1 -- 172.21.15.59:0/2200458932 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0a404e560 con 0x7fd08c0a15e0 2023-10-08T12:40:23.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.172+0000 7fd0a8859700 1 -- 172.21.15.59:0/2200458932 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344187 (secure 0 0 0) 0x7fd0a404e560 con 0x7fd08c0a15e0 2023-10-08T12:40:23.177 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:23.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.176+0000 7fd0a985b700 1 -- 172.21.15.59:0/2200458932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd08c0a15e0 msgr2=0x7fd08c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.176+0000 7fd0a985b700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd08c0a15e0 0x7fd08c0a3aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd094006010 tx=0x7fd09400b540 comp rx=0 tx=0).stop 2023-10-08T12:40:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.176+0000 7fd0a985b700 1 -- 172.21.15.59:0/2200458932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a4073340 msgr2=0x7fd0a4199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.176+0000 7fd0a985b700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a4073340 0x7fd0a4199440 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd09800d980 tx=0x7fd09800dc90 comp rx=0 tx=0).stop 2023-10-08T12:40:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.177+0000 7fd0a985b700 1 -- 172.21.15.59:0/2200458932 shutdown_connections 2023-10-08T12:40:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.177+0000 7fd0a985b700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd08c0a15e0 0x7fd08c0a3aa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.177+0000 7fd0a985b700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a4072a20 0x7fd0a4198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.177+0000 7fd0a985b700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0a410d250 0x7fd0a419d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.177+0000 7fd0a985b700 1 --2- 172.21.15.59:0/2200458932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a4073340 0x7fd0a4199440 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.177+0000 7fd0a985b700 1 -- 172.21.15.59:0/2200458932 >> 172.21.15.59:0/2200458932 conn(0x7fd0a40779e0 msgr2=0x7fd0a40fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.177+0000 7fd0a985b700 1 -- 172.21.15.59:0/2200458932 shutdown_connections 2023-10-08T12:40:23.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:23.177+0000 7fd0a985b700 1 -- 172.21.15.59:0/2200458932 wait complete. 2023-10-08T12:40:23.182 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-08T12:40:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:23 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:40:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:23 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:40:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:23 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:23.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:23 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:40:23.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:23 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:40:23.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:23 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:23.484 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:23 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:40:23.484 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:23 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:40:23.484 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:23 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:40:23.819 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2023-10-08T12:40:22.797394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650572,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":276,"num_read_kb":248,"num_write":251,"num_write_kb":3018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180859,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335556,"kb_used_data":11296,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606268,"statfs":{"total":1151940427776,"available":1151596818432,"internally_reserved":0,"allocated":11567104,"data_stored":7496161,"data_compressed":181917,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":123,"num_keys_recovered":7,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.011480"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789351+0000","last_change":"2023-10-08T12:39:14.206423+0000","last_active":"2023-10-08T12:40:10.789351+0000","last_peered":"2023-10-08T12:40:10.789351+0000","last_clean":"2023-10-08T12:40:10.789351+0000","last_became_active":"2023-10-08T12:39:14.205454+0000","last_became_peered":"2023-10-08T12:39:14.205454+0000","last_unstale":"2023-10-08T12:40:10.789351+0000","last_undegraded":"2023-10-08T12:40:10.789351+0000","last_fullsized":"2023-10-08T12:40:10.789351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:37.669007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790629+0000","last_change":"2023-10-08T12:39:14.215711+0000","last_active":"2023-10-08T12:40:10.790629+0000","last_peered":"2023-10-08T12:40:10.790629+0000","last_clean":"2023-10-08T12:40:10.790629+0000","last_became_active":"2023-10-08T12:39:14.215283+0000","last_became_peered":"2023-10-08T12:39:14.215283+0000","last_unstale":"2023-10-08T12:40:10.790629+0000","last_undegraded":"2023-10-08T12:40:10.790629+0000","last_fullsized":"2023-10-08T12:40:10.790629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:29.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789909+0000","last_change":"2023-10-08T12:39:14.209843+0000","last_active":"2023-10-08T12:40:10.789909+0000","last_peered":"2023-10-08T12:40:10.789909+0000","last_clean":"2023-10-08T12:40:10.789909+0000","last_became_active":"2023-10-08T12:39:14.209528+0000","last_became_peered":"2023-10-08T12:39:14.209528+0000","last_unstale":"2023-10-08T12:40:10.789909+0000","last_undegraded":"2023-10-08T12:40:10.789909+0000","last_fullsized":"2023-10-08T12:40:10.789909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:54.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791708+0000","last_change":"2023-10-08T12:39:14.204891+0000","last_active":"2023-10-08T12:40:10.791708+0000","last_peered":"2023-10-08T12:40:10.791708+0000","last_clean":"2023-10-08T12:40:10.791708+0000","last_became_active":"2023-10-08T12:39:14.204075+0000","last_became_peered":"2023-10-08T12:39:14.204075+0000","last_unstale":"2023-10-08T12:40:10.791708+0000","last_undegraded":"2023-10-08T12:40:10.791708+0000","last_fullsized":"2023-10-08T12:40:10.791708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:18.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789932+0000","last_change":"2023-10-08T12:39:14.212527+0000","last_active":"2023-10-08T12:40:10.789932+0000","last_peered":"2023-10-08T12:40:10.789932+0000","last_clean":"2023-10-08T12:40:10.789932+0000","last_became_active":"2023-10-08T12:39:14.212188+0000","last_became_peered":"2023-10-08T12:39:14.212188+0000","last_unstale":"2023-10-08T12:40:10.789932+0000","last_undegraded":"2023-10-08T12:40:10.789932+0000","last_fullsized":"2023-10-08T12:40:10.789932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:28.952210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786911+0000","last_change":"2023-10-08T12:39:14.216842+0000","last_active":"2023-10-08T12:40:10.786911+0000","last_peered":"2023-10-08T12:40:10.786911+0000","last_clean":"2023-10-08T12:40:10.786911+0000","last_became_active":"2023-10-08T12:39:14.216446+0000","last_became_peered":"2023-10-08T12:39:14.216446+0000","last_unstale":"2023-10-08T12:40:10.786911+0000","last_undegraded":"2023-10-08T12:40:10.786911+0000","last_fullsized":"2023-10-08T12:40:10.786911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:40.718246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793700+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:10.793700+0000","last_peered":"2023-10-08T12:40:10.793700+0000","last_clean":"2023-10-08T12:40:10.793700+0000","last_became_active":"2023-10-08T12:39:14.222410+0000","last_became_peered":"2023-10-08T12:39:14.222410+0000","last_unstale":"2023-10-08T12:40:10.793700+0000","last_undegraded":"2023-10-08T12:40:10.793700+0000","last_fullsized":"2023-10-08T12:40:10.793700+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:03.599610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790917+0000","last_change":"2023-10-08T12:39:14.209422+0000","last_active":"2023-10-08T12:40:10.790917+0000","last_peered":"2023-10-08T12:40:10.790917+0000","last_clean":"2023-10-08T12:40:10.790917+0000","last_became_active":"2023-10-08T12:39:14.209073+0000","last_became_peered":"2023-10-08T12:39:14.209073+0000","last_unstale":"2023-10-08T12:40:10.790917+0000","last_undegraded":"2023-10-08T12:40:10.790917+0000","last_fullsized":"2023-10-08T12:40:10.790917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:09.587414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282376+0000","last_change":"2023-10-08T12:39:14.211228+0000","last_active":"2023-10-08T12:40:11.282376+0000","last_peered":"2023-10-08T12:40:11.282376+0000","last_clean":"2023-10-08T12:40:11.282376+0000","last_became_active":"2023-10-08T12:39:14.210940+0000","last_became_peered":"2023-10-08T12:39:14.210940+0000","last_unstale":"2023-10-08T12:40:11.282376+0000","last_undegraded":"2023-10-08T12:40:11.282376+0000","last_fullsized":"2023-10-08T12:40:11.282376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:52.683409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787260+0000","last_change":"2023-10-08T12:39:14.207071+0000","last_active":"2023-10-08T12:40:10.787260+0000","last_peered":"2023-10-08T12:40:10.787260+0000","last_clean":"2023-10-08T12:40:10.787260+0000","last_became_active":"2023-10-08T12:39:14.206770+0000","last_became_peered":"2023-10-08T12:39:14.206770+0000","last_unstale":"2023-10-08T12:40:10.787260+0000","last_undegraded":"2023-10-08T12:40:10.787260+0000","last_fullsized":"2023-10-08T12:40:10.787260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:19.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794200+0000","last_change":"2023-10-08T12:39:14.212780+0000","last_active":"2023-10-08T12:40:10.794200+0000","last_peered":"2023-10-08T12:40:10.794200+0000","last_clean":"2023-10-08T12:40:10.794200+0000","last_became_active":"2023-10-08T12:39:14.212167+0000","last_became_peered":"2023-10-08T12:39:14.212167+0000","last_unstale":"2023-10-08T12:40:10.794200+0000","last_undegraded":"2023-10-08T12:40:10.794200+0000","last_fullsized":"2023-10-08T12:40:10.794200+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:17.332257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791627+0000","last_change":"2023-10-08T12:39:14.204506+0000","last_active":"2023-10-08T12:40:10.791627+0000","last_peered":"2023-10-08T12:40:10.791627+0000","last_clean":"2023-10-08T12:40:10.791627+0000","last_became_active":"2023-10-08T12:39:14.204184+0000","last_became_peered":"2023-10-08T12:39:14.204184+0000","last_unstale":"2023-10-08T12:40:10.791627+0000","last_undegraded":"2023-10-08T12:40:10.791627+0000","last_fullsized":"2023-10-08T12:40:10.791627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:05.696554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793271+0000","last_change":"2023-10-08T12:39:14.211957+0000","last_active":"2023-10-08T12:40:10.793271+0000","last_peered":"2023-10-08T12:40:10.793271+0000","last_clean":"2023-10-08T12:40:10.793271+0000","last_became_active":"2023-10-08T12:39:14.211629+0000","last_became_peered":"2023-10-08T12:39:14.211629+0000","last_unstale":"2023-10-08T12:40:10.793271+0000","last_undegraded":"2023-10-08T12:40:10.793271+0000","last_fullsized":"2023-10-08T12:40:10.793271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:10.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789681+0000","last_change":"2023-10-08T12:39:14.207006+0000","last_active":"2023-10-08T12:40:10.789681+0000","last_peered":"2023-10-08T12:40:10.789681+0000","last_clean":"2023-10-08T12:40:10.789681+0000","last_became_active":"2023-10-08T12:39:14.206624+0000","last_became_peered":"2023-10-08T12:39:14.206624+0000","last_unstale":"2023-10-08T12:40:10.789681+0000","last_undegraded":"2023-10-08T12:40:10.789681+0000","last_fullsized":"2023-10-08T12:40:10.789681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:11.232875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789907+0000","last_change":"2023-10-08T12:39:14.213865+0000","last_active":"2023-10-08T12:40:10.789907+0000","last_peered":"2023-10-08T12:40:10.789907+0000","last_clean":"2023-10-08T12:40:10.789907+0000","last_became_active":"2023-10-08T12:39:14.207972+0000","last_became_peered":"2023-10-08T12:39:14.207972+0000","last_unstale":"2023-10-08T12:40:10.789907+0000","last_undegraded":"2023-10-08T12:40:10.789907+0000","last_fullsized":"2023-10-08T12:40:10.789907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:01.434731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.281917+0000","last_change":"2023-10-08T12:39:14.206313+0000","last_active":"2023-10-08T12:40:11.281917+0000","last_peered":"2023-10-08T12:40:11.281917+0000","last_clean":"2023-10-08T12:40:11.281917+0000","last_became_active":"2023-10-08T12:39:14.206001+0000","last_became_peered":"2023-10-08T12:39:14.206001+0000","last_unstale":"2023-10-08T12:40:11.281917+0000","last_undegraded":"2023-10-08T12:40:11.281917+0000","last_fullsized":"2023-10-08T12:40:11.281917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:43.912356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789442+0000","last_change":"2023-10-08T12:39:14.205752+0000","last_active":"2023-10-08T12:40:10.789442+0000","last_peered":"2023-10-08T12:40:10.789442+0000","last_clean":"2023-10-08T12:40:10.789442+0000","last_became_active":"2023-10-08T12:39:14.204696+0000","last_became_peered":"2023-10-08T12:39:14.204696+0000","last_unstale":"2023-10-08T12:40:10.789442+0000","last_undegraded":"2023-10-08T12:40:10.789442+0000","last_fullsized":"2023-10-08T12:40:10.789442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:42.409107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787698+0000","last_change":"2023-10-08T12:39:14.203373+0000","last_active":"2023-10-08T12:40:10.787698+0000","last_peered":"2023-10-08T12:40:10.787698+0000","last_clean":"2023-10-08T12:40:10.787698+0000","last_became_active":"2023-10-08T12:39:14.202966+0000","last_became_peered":"2023-10-08T12:39:14.202966+0000","last_unstale":"2023-10-08T12:40:10.787698+0000","last_undegraded":"2023-10-08T12:40:10.787698+0000","last_fullsized":"2023-10-08T12:40:10.787698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:00.114475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793600+0000","last_change":"2023-10-08T12:39:14.216154+0000","last_active":"2023-10-08T12:40:10.793600+0000","last_peered":"2023-10-08T12:40:10.793600+0000","last_clean":"2023-10-08T12:40:10.793600+0000","last_became_active":"2023-10-08T12:39:14.215868+0000","last_became_peered":"2023-10-08T12:39:14.215868+0000","last_unstale":"2023-10-08T12:40:10.793600+0000","last_undegraded":"2023-10-08T12:40:10.793600+0000","last_fullsized":"2023-10-08T12:40:10.793600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:53.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786840+0000","last_change":"2023-10-08T12:39:13.214538+0000","last_active":"2023-10-08T12:40:10.786840+0000","last_peered":"2023-10-08T12:40:10.786840+0000","last_clean":"2023-10-08T12:40:10.786840+0000","last_became_active":"2023-10-08T12:39:13.214162+0000","last_became_peered":"2023-10-08T12:39:13.214162+0000","last_unstale":"2023-10-08T12:40:10.786840+0000","last_undegraded":"2023-10-08T12:40:10.786840+0000","last_fullsized":"2023-10-08T12:40:10.786840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:11.500815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793193+0000","last_change":"2023-10-08T12:39:14.211308+0000","last_active":"2023-10-08T12:40:10.793193+0000","last_peered":"2023-10-08T12:40:10.793193+0000","last_clean":"2023-10-08T12:40:10.793193+0000","last_became_active":"2023-10-08T12:39:14.210961+0000","last_became_peered":"2023-10-08T12:39:14.210961+0000","last_unstale":"2023-10-08T12:40:10.793193+0000","last_undegraded":"2023-10-08T12:40:10.793193+0000","last_fullsized":"2023-10-08T12:40:10.793193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.221981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793311+0000","last_change":"2023-10-08T12:39:13.219982+0000","last_active":"2023-10-08T12:40:10.793311+0000","last_peered":"2023-10-08T12:40:10.793311+0000","last_clean":"2023-10-08T12:40:10.793311+0000","last_became_active":"2023-10-08T12:39:13.219668+0000","last_became_peered":"2023-10-08T12:39:13.219668+0000","last_unstale":"2023-10-08T12:40:10.793311+0000","last_undegraded":"2023-10-08T12:40:10.793311+0000","last_fullsized":"2023-10-08T12:40:10.793311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.664553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790263+0000","last_change":"2023-10-08T12:39:14.216922+0000","last_active":"2023-10-08T12:40:10.790263+0000","last_peered":"2023-10-08T12:40:10.790263+0000","last_clean":"2023-10-08T12:40:10.790263+0000","last_became_active":"2023-10-08T12:39:14.216634+0000","last_became_peered":"2023-10-08T12:39:14.216634+0000","last_unstale":"2023-10-08T12:40:10.790263+0000","last_undegraded":"2023-10-08T12:40:10.790263+0000","last_fullsized":"2023-10-08T12:40:10.790263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:21.254178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790823+0000","last_change":"2023-10-08T12:39:13.220262+0000","last_active":"2023-10-08T12:40:10.790823+0000","last_peered":"2023-10-08T12:40:10.790823+0000","last_clean":"2023-10-08T12:40:10.790823+0000","last_became_active":"2023-10-08T12:39:13.219917+0000","last_became_peered":"2023-10-08T12:39:13.219917+0000","last_unstale":"2023-10-08T12:40:10.790823+0000","last_undegraded":"2023-10-08T12:40:10.790823+0000","last_fullsized":"2023-10-08T12:40:10.790823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:34.368119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282033+0000","last_change":"2023-10-08T12:39:14.212620+0000","last_active":"2023-10-08T12:40:11.282033+0000","last_peered":"2023-10-08T12:40:11.282033+0000","last_clean":"2023-10-08T12:40:11.282033+0000","last_became_active":"2023-10-08T12:39:14.212128+0000","last_became_peered":"2023-10-08T12:39:14.212128+0000","last_unstale":"2023-10-08T12:40:11.282033+0000","last_undegraded":"2023-10-08T12:40:11.282033+0000","last_fullsized":"2023-10-08T12:40:11.282033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:40.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790321+0000","last_change":"2023-10-08T12:39:13.218291+0000","last_active":"2023-10-08T12:40:10.790321+0000","last_peered":"2023-10-08T12:40:10.790321+0000","last_clean":"2023-10-08T12:40:10.790321+0000","last_became_active":"2023-10-08T12:39:13.217907+0000","last_became_peered":"2023-10-08T12:39:13.217907+0000","last_unstale":"2023-10-08T12:40:10.790321+0000","last_undegraded":"2023-10-08T12:40:10.790321+0000","last_fullsized":"2023-10-08T12:40:10.790321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:54:46.891553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786701+0000","last_change":"2023-10-08T12:39:14.207991+0000","last_active":"2023-10-08T12:40:10.786701+0000","last_peered":"2023-10-08T12:40:10.786701+0000","last_clean":"2023-10-08T12:40:10.786701+0000","last_became_active":"2023-10-08T12:39:14.207683+0000","last_became_peered":"2023-10-08T12:39:14.207683+0000","last_unstale":"2023-10-08T12:40:10.786701+0000","last_undegraded":"2023-10-08T12:40:10.786701+0000","last_fullsized":"2023-10-08T12:40:10.786701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:47.809553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786504+0000","last_change":"2023-10-08T12:39:13.214704+0000","last_active":"2023-10-08T12:40:10.786504+0000","last_peered":"2023-10-08T12:40:10.786504+0000","last_clean":"2023-10-08T12:40:10.786504+0000","last_became_active":"2023-10-08T12:39:13.214205+0000","last_became_peered":"2023-10-08T12:39:13.214205+0000","last_unstale":"2023-10-08T12:40:10.786504+0000","last_undegraded":"2023-10-08T12:40:10.786504+0000","last_fullsized":"2023-10-08T12:40:10.786504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:58.572620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790431+0000","last_change":"2023-10-08T12:39:14.219813+0000","last_active":"2023-10-08T12:40:10.790431+0000","last_peered":"2023-10-08T12:40:10.790431+0000","last_clean":"2023-10-08T12:40:10.790431+0000","last_became_active":"2023-10-08T12:39:14.219511+0000","last_became_peered":"2023-10-08T12:39:14.219511+0000","last_unstale":"2023-10-08T12:40:10.790431+0000","last_undegraded":"2023-10-08T12:40:10.790431+0000","last_fullsized":"2023-10-08T12:40:10.790431+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:43.716871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786848+0000","last_change":"2023-10-08T12:39:13.212567+0000","last_active":"2023-10-08T12:40:10.786848+0000","last_peered":"2023-10-08T12:40:10.786848+0000","last_clean":"2023-10-08T12:40:10.786848+0000","last_became_active":"2023-10-08T12:39:13.212079+0000","last_became_peered":"2023-10-08T12:39:13.212079+0000","last_unstale":"2023-10-08T12:40:10.786848+0000","last_undegraded":"2023-10-08T12:40:10.786848+0000","last_fullsized":"2023-10-08T12:40:10.786848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:35.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786558+0000","last_change":"2023-10-08T12:39:14.208760+0000","last_active":"2023-10-08T12:40:10.786558+0000","last_peered":"2023-10-08T12:40:10.786558+0000","last_clean":"2023-10-08T12:40:10.786558+0000","last_became_active":"2023-10-08T12:39:14.208490+0000","last_became_peered":"2023-10-08T12:39:14.208490+0000","last_unstale":"2023-10-08T12:40:10.786558+0000","last_undegraded":"2023-10-08T12:40:10.786558+0000","last_fullsized":"2023-10-08T12:40:10.786558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:19:56.423514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791638+0000","last_change":"2023-10-08T12:39:13.214197+0000","last_active":"2023-10-08T12:40:10.791638+0000","last_peered":"2023-10-08T12:40:10.791638+0000","last_clean":"2023-10-08T12:40:10.791638+0000","last_became_active":"2023-10-08T12:39:13.213829+0000","last_became_peered":"2023-10-08T12:39:13.213829+0000","last_unstale":"2023-10-08T12:40:10.791638+0000","last_undegraded":"2023-10-08T12:40:10.791638+0000","last_fullsized":"2023-10-08T12:40:10.791638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:29:05.080370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792154+0000","last_change":"2023-10-08T12:39:14.212369+0000","last_active":"2023-10-08T12:40:10.792154+0000","last_peered":"2023-10-08T12:40:10.792154+0000","last_clean":"2023-10-08T12:40:10.792154+0000","last_became_active":"2023-10-08T12:39:14.211917+0000","last_became_peered":"2023-10-08T12:39:14.211917+0000","last_unstale":"2023-10-08T12:40:10.792154+0000","last_undegraded":"2023-10-08T12:40:10.792154+0000","last_fullsized":"2023-10-08T12:40:10.792154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:27.265251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786322+0000","last_change":"2023-10-08T12:39:13.217339+0000","last_active":"2023-10-08T12:40:10.786322+0000","last_peered":"2023-10-08T12:40:10.786322+0000","last_clean":"2023-10-08T12:40:10.786322+0000","last_became_active":"2023-10-08T12:39:13.216973+0000","last_became_peered":"2023-10-08T12:39:13.216973+0000","last_unstale":"2023-10-08T12:40:10.786322+0000","last_undegraded":"2023-10-08T12:40:10.786322+0000","last_fullsized":"2023-10-08T12:40:10.786322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:35.899844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786605+0000","last_change":"2023-10-08T12:39:14.218870+0000","last_active":"2023-10-08T12:40:10.786605+0000","last_peered":"2023-10-08T12:40:10.786605+0000","last_clean":"2023-10-08T12:40:10.786605+0000","last_became_active":"2023-10-08T12:39:14.217879+0000","last_became_peered":"2023-10-08T12:39:14.217879+0000","last_unstale":"2023-10-08T12:40:10.786605+0000","last_undegraded":"2023-10-08T12:40:10.786605+0000","last_fullsized":"2023-10-08T12:40:10.786605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:06.769081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787188+0000","last_change":"2023-10-08T12:39:13.209120+0000","last_active":"2023-10-08T12:40:10.787188+0000","last_peered":"2023-10-08T12:40:10.787188+0000","last_clean":"2023-10-08T12:40:10.787188+0000","last_became_active":"2023-10-08T12:39:13.208755+0000","last_became_peered":"2023-10-08T12:39:13.208755+0000","last_unstale":"2023-10-08T12:40:10.787188+0000","last_undegraded":"2023-10-08T12:40:10.787188+0000","last_fullsized":"2023-10-08T12:40:10.787188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:48.977375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282268+0000","last_change":"2023-10-08T12:39:14.208187+0000","last_active":"2023-10-08T12:40:11.282268+0000","last_peered":"2023-10-08T12:40:11.282268+0000","last_clean":"2023-10-08T12:40:11.282268+0000","last_became_active":"2023-10-08T12:39:14.207868+0000","last_became_peered":"2023-10-08T12:39:14.207868+0000","last_unstale":"2023-10-08T12:40:11.282268+0000","last_undegraded":"2023-10-08T12:40:11.282268+0000","last_fullsized":"2023-10-08T12:40:11.282268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:50.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794276+0000","last_change":"2023-10-08T12:39:13.220447+0000","last_active":"2023-10-08T12:40:10.794276+0000","last_peered":"2023-10-08T12:40:10.794276+0000","last_clean":"2023-10-08T12:40:10.794276+0000","last_became_active":"2023-10-08T12:39:13.220032+0000","last_became_peered":"2023-10-08T12:39:13.220032+0000","last_unstale":"2023-10-08T12:40:10.794276+0000","last_undegraded":"2023-10-08T12:40:10.794276+0000","last_fullsized":"2023-10-08T12:40:10.794276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:22.223707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.807692+0000","last_change":"2023-10-08T12:40:11.807692+0000","last_active":"2023-10-08T12:40:11.807692+0000","last_peered":"2023-10-08T12:40:11.807692+0000","last_clean":"2023-10-08T12:40:11.807692+0000","last_became_active":"2023-10-08T12:40:11.807311+0000","last_became_peered":"2023-10-08T12:40:11.807311+0000","last_unstale":"2023-10-08T12:40:11.807692+0000","last_undegraded":"2023-10-08T12:40:11.807692+0000","last_fullsized":"2023-10-08T12:40:11.807692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:42.114689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786798+0000","last_change":"2023-10-08T12:39:13.219131+0000","last_active":"2023-10-08T12:40:10.786798+0000","last_peered":"2023-10-08T12:40:10.786798+0000","last_clean":"2023-10-08T12:40:10.786798+0000","last_became_active":"2023-10-08T12:39:13.218639+0000","last_became_peered":"2023-10-08T12:39:13.218639+0000","last_unstale":"2023-10-08T12:40:10.786798+0000","last_undegraded":"2023-10-08T12:40:10.786798+0000","last_fullsized":"2023-10-08T12:40:10.786798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.316153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282166+0000","last_change":"2023-10-08T12:39:14.212352+0000","last_active":"2023-10-08T12:40:11.282166+0000","last_peered":"2023-10-08T12:40:11.282166+0000","last_clean":"2023-10-08T12:40:11.282166+0000","last_became_active":"2023-10-08T12:39:14.211342+0000","last_became_peered":"2023-10-08T12:39:14.211342+0000","last_unstale":"2023-10-08T12:40:11.282166+0000","last_undegraded":"2023-10-08T12:40:11.282166+0000","last_fullsized":"2023-10-08T12:40:11.282166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:39:00.731860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'25","reported_seq":174,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:20.335452+0000","last_change":"2023-10-08T12:39:13.209967+0000","last_active":"2023-10-08T12:40:20.335452+0000","last_peered":"2023-10-08T12:40:20.335452+0000","last_clean":"2023-10-08T12:40:20.335452+0000","last_became_active":"2023-10-08T12:39:13.209650+0000","last_became_peered":"2023-10-08T12:39:13.209650+0000","last_unstale":"2023-10-08T12:40:20.335452+0000","last_undegraded":"2023-10-08T12:40:20.335452+0000","last_fullsized":"2023-10-08T12:40:20.335452+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:08.206168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59160,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":123,"num_write":25,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790692+0000","last_change":"2023-10-08T12:39:14.211335+0000","last_active":"2023-10-08T12:40:10.790692+0000","last_peered":"2023-10-08T12:40:10.790692+0000","last_clean":"2023-10-08T12:40:10.790692+0000","last_became_active":"2023-10-08T12:39:14.211003+0000","last_became_peered":"2023-10-08T12:39:14.211003+0000","last_unstale":"2023-10-08T12:40:10.790692+0000","last_undegraded":"2023-10-08T12:40:10.790692+0000","last_fullsized":"2023-10-08T12:40:10.790692+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:00.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793676+0000","last_change":"2023-10-08T12:39:13.215379+0000","last_active":"2023-10-08T12:40:10.793676+0000","last_peered":"2023-10-08T12:40:10.793676+0000","last_clean":"2023-10-08T12:40:10.793676+0000","last_became_active":"2023-10-08T12:39:13.215036+0000","last_became_peered":"2023-10-08T12:39:13.215036+0000","last_unstale":"2023-10-08T12:40:10.793676+0000","last_undegraded":"2023-10-08T12:40:10.793676+0000","last_fullsized":"2023-10-08T12:40:10.793676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:24.690473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791858+0000","last_change":"2023-10-08T12:39:14.207907+0000","last_active":"2023-10-08T12:40:10.791858+0000","last_peered":"2023-10-08T12:40:10.791858+0000","last_clean":"2023-10-08T12:40:10.791858+0000","last_became_active":"2023-10-08T12:39:14.207620+0000","last_became_peered":"2023-10-08T12:39:14.207620+0000","last_unstale":"2023-10-08T12:40:10.791858+0000","last_undegraded":"2023-10-08T12:40:10.791858+0000","last_fullsized":"2023-10-08T12:40:10.791858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:49:11.866245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786468+0000","last_change":"2023-10-08T12:39:13.214521+0000","last_active":"2023-10-08T12:40:10.786468+0000","last_peered":"2023-10-08T12:40:10.786468+0000","last_clean":"2023-10-08T12:40:10.786468+0000","last_became_active":"2023-10-08T12:39:13.214127+0000","last_became_peered":"2023-10-08T12:39:13.214127+0000","last_unstale":"2023-10-08T12:40:10.786468+0000","last_undegraded":"2023-10-08T12:40:10.786468+0000","last_fullsized":"2023-10-08T12:40:10.786468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:46.735663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.796744+0000","last_change":"2023-10-08T12:40:11.796744+0000","last_active":"2023-10-08T12:40:11.796744+0000","last_peered":"2023-10-08T12:40:11.796744+0000","last_clean":"2023-10-08T12:40:11.796744+0000","last_became_active":"2023-10-08T12:40:11.796418+0000","last_became_peered":"2023-10-08T12:40:11.796418+0000","last_unstale":"2023-10-08T12:40:11.796744+0000","last_undegraded":"2023-10-08T12:40:11.796744+0000","last_fullsized":"2023-10-08T12:40:11.796744+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:22.693079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791530+0000","last_change":"2023-10-08T12:39:13.214758+0000","last_active":"2023-10-08T12:40:10.791530+0000","last_peered":"2023-10-08T12:40:10.791530+0000","last_clean":"2023-10-08T12:40:10.791530+0000","last_became_active":"2023-10-08T12:39:13.214304+0000","last_became_peered":"2023-10-08T12:39:13.214304+0000","last_unstale":"2023-10-08T12:40:10.791530+0000","last_undegraded":"2023-10-08T12:40:10.791530+0000","last_fullsized":"2023-10-08T12:40:10.791530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:34.074248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793742+0000","last_change":"2023-10-08T12:39:14.208071+0000","last_active":"2023-10-08T12:40:10.793742+0000","last_peered":"2023-10-08T12:40:10.793742+0000","last_clean":"2023-10-08T12:40:10.793742+0000","last_became_active":"2023-10-08T12:39:14.207787+0000","last_became_peered":"2023-10-08T12:39:14.207787+0000","last_unstale":"2023-10-08T12:40:10.793742+0000","last_undegraded":"2023-10-08T12:40:10.793742+0000","last_fullsized":"2023-10-08T12:40:10.793742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:40.869575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789406+0000","last_change":"2023-10-08T12:39:13.219105+0000","last_active":"2023-10-08T12:40:10.789406+0000","last_peered":"2023-10-08T12:40:10.789406+0000","last_clean":"2023-10-08T12:40:10.789406+0000","last_became_active":"2023-10-08T12:39:13.218767+0000","last_became_peered":"2023-10-08T12:39:13.218767+0000","last_unstale":"2023-10-08T12:40:10.789406+0000","last_undegraded":"2023-10-08T12:40:10.789406+0000","last_fullsized":"2023-10-08T12:40:10.789406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:22.763921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786312+0000","last_change":"2023-10-08T12:39:14.210037+0000","last_active":"2023-10-08T12:40:10.786312+0000","last_peered":"2023-10-08T12:40:10.786312+0000","last_clean":"2023-10-08T12:40:10.786312+0000","last_became_active":"2023-10-08T12:39:14.208140+0000","last_became_peered":"2023-10-08T12:39:14.208140+0000","last_unstale":"2023-10-08T12:40:10.786312+0000","last_undegraded":"2023-10-08T12:40:10.786312+0000","last_fullsized":"2023-10-08T12:40:10.786312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:38.475668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790878+0000","last_change":"2023-10-08T12:39:13.219229+0000","last_active":"2023-10-08T12:40:10.790878+0000","last_peered":"2023-10-08T12:40:10.790878+0000","last_clean":"2023-10-08T12:40:10.790878+0000","last_became_active":"2023-10-08T12:39:13.217964+0000","last_became_peered":"2023-10-08T12:39:13.217964+0000","last_unstale":"2023-10-08T12:40:10.790878+0000","last_undegraded":"2023-10-08T12:40:10.790878+0000","last_fullsized":"2023-10-08T12:40:10.790878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:47.480351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.808035+0000","last_change":"2023-10-08T12:40:11.808035+0000","last_active":"2023-10-08T12:40:11.808035+0000","last_peered":"2023-10-08T12:40:11.808035+0000","last_clean":"2023-10-08T12:40:11.808035+0000","last_became_active":"2023-10-08T12:40:11.807611+0000","last_became_peered":"2023-10-08T12:40:11.807611+0000","last_unstale":"2023-10-08T12:40:11.808035+0000","last_undegraded":"2023-10-08T12:40:11.808035+0000","last_fullsized":"2023-10-08T12:40:11.808035+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:51.833325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786745+0000","last_change":"2023-10-08T12:39:13.212791+0000","last_active":"2023-10-08T12:40:10.786745+0000","last_peered":"2023-10-08T12:40:10.786745+0000","last_clean":"2023-10-08T12:40:10.786745+0000","last_became_active":"2023-10-08T12:39:13.212146+0000","last_became_peered":"2023-10-08T12:39:13.212146+0000","last_unstale":"2023-10-08T12:40:10.786745+0000","last_undegraded":"2023-10-08T12:40:10.786745+0000","last_fullsized":"2023-10-08T12:40:10.786745+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:37.452859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.800095+0000","last_change":"2023-10-08T12:40:11.800095+0000","last_active":"2023-10-08T12:40:11.800095+0000","last_peered":"2023-10-08T12:40:11.800095+0000","last_clean":"2023-10-08T12:40:11.800095+0000","last_became_active":"2023-10-08T12:40:11.795780+0000","last_became_peered":"2023-10-08T12:40:11.795780+0000","last_unstale":"2023-10-08T12:40:11.800095+0000","last_undegraded":"2023-10-08T12:40:11.800095+0000","last_fullsized":"2023-10-08T12:40:11.800095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:15.163613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794197+0000","last_change":"2023-10-08T12:39:13.217672+0000","last_active":"2023-10-08T12:40:10.794197+0000","last_peered":"2023-10-08T12:40:10.794197+0000","last_clean":"2023-10-08T12:40:10.794197+0000","last_became_active":"2023-10-08T12:39:13.217277+0000","last_became_peered":"2023-10-08T12:39:13.217277+0000","last_unstale":"2023-10-08T12:40:10.794197+0000","last_undegraded":"2023-10-08T12:40:10.794197+0000","last_fullsized":"2023-10-08T12:40:10.794197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:41.097439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787045+0000","last_change":"2023-10-08T12:39:14.219261+0000","last_active":"2023-10-08T12:40:10.787045+0000","last_peered":"2023-10-08T12:40:10.787045+0000","last_clean":"2023-10-08T12:40:10.787045+0000","last_became_active":"2023-10-08T12:39:14.218963+0000","last_became_peered":"2023-10-08T12:39:14.218963+0000","last_unstale":"2023-10-08T12:40:10.787045+0000","last_undegraded":"2023-10-08T12:40:10.787045+0000","last_fullsized":"2023-10-08T12:40:10.787045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:19.573306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786505+0000","last_change":"2023-10-08T12:39:14.207923+0000","last_active":"2023-10-08T12:40:10.786505+0000","last_peered":"2023-10-08T12:40:10.786505+0000","last_clean":"2023-10-08T12:40:10.786505+0000","last_became_active":"2023-10-08T12:39:14.207634+0000","last_became_peered":"2023-10-08T12:39:14.207634+0000","last_unstale":"2023-10-08T12:40:10.786505+0000","last_undegraded":"2023-10-08T12:40:10.786505+0000","last_fullsized":"2023-10-08T12:40:10.786505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:39.634945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791515+0000","last_change":"2023-10-08T12:39:13.223021+0000","last_active":"2023-10-08T12:40:10.791515+0000","last_peered":"2023-10-08T12:40:10.791515+0000","last_clean":"2023-10-08T12:40:10.791515+0000","last_became_active":"2023-10-08T12:39:13.222680+0000","last_became_peered":"2023-10-08T12:39:13.222680+0000","last_unstale":"2023-10-08T12:40:10.791515+0000","last_undegraded":"2023-10-08T12:40:10.791515+0000","last_fullsized":"2023-10-08T12:40:10.791515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:40.454436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792771+0000","last_change":"2023-10-08T12:39:14.217364+0000","last_active":"2023-10-08T12:40:10.792771+0000","last_peered":"2023-10-08T12:40:10.792771+0000","last_clean":"2023-10-08T12:40:10.792771+0000","last_became_active":"2023-10-08T12:39:14.216984+0000","last_became_peered":"2023-10-08T12:39:14.216984+0000","last_unstale":"2023-10-08T12:40:10.792771+0000","last_undegraded":"2023-10-08T12:40:10.792771+0000","last_fullsized":"2023-10-08T12:40:10.792771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:11:51.818034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792124+0000","last_change":"2023-10-08T12:39:13.207687+0000","last_active":"2023-10-08T12:40:10.792124+0000","last_peered":"2023-10-08T12:40:10.792124+0000","last_clean":"2023-10-08T12:40:10.792124+0000","last_became_active":"2023-10-08T12:39:13.207270+0000","last_became_peered":"2023-10-08T12:39:13.207270+0000","last_unstale":"2023-10-08T12:40:10.792124+0000","last_undegraded":"2023-10-08T12:40:10.792124+0000","last_fullsized":"2023-10-08T12:40:10.792124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:44.673383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":318,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793703+0000","last_change":"2023-10-08T12:38:07.696721+0000","last_active":"2023-10-08T12:40:10.793703+0000","last_peered":"2023-10-08T12:40:10.793703+0000","last_clean":"2023-10-08T12:40:10.793703+0000","last_became_active":"2023-10-08T12:38:07.696336+0000","last_became_peered":"2023-10-08T12:38:07.696336+0000","last_unstale":"2023-10-08T12:40:10.793703+0000","last_undegraded":"2023-10-08T12:40:10.793703+0000","last_fullsized":"2023-10-08T12:40:10.793703+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_clean_scrub_stamp":"2023-10-08T12:34:57.643348+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:01.821924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791426+0000","last_change":"2023-10-08T12:39:14.208845+0000","last_active":"2023-10-08T12:40:10.791426+0000","last_peered":"2023-10-08T12:40:10.791426+0000","last_clean":"2023-10-08T12:40:10.791426+0000","last_became_active":"2023-10-08T12:39:14.208487+0000","last_became_peered":"2023-10-08T12:39:14.208487+0000","last_unstale":"2023-10-08T12:40:10.791426+0000","last_undegraded":"2023-10-08T12:40:10.791426+0000","last_fullsized":"2023-10-08T12:40:10.791426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:26.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793636+0000","last_change":"2023-10-08T12:39:13.216627+0000","last_active":"2023-10-08T12:40:10.793636+0000","last_peered":"2023-10-08T12:40:10.793636+0000","last_clean":"2023-10-08T12:40:10.793636+0000","last_became_active":"2023-10-08T12:39:13.216201+0000","last_became_peered":"2023-10-08T12:39:13.216201+0000","last_unstale":"2023-10-08T12:40:10.793636+0000","last_undegraded":"2023-10-08T12:40:10.793636+0000","last_fullsized":"2023-10-08T12:40:10.793636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:19.873615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790683+0000","last_change":"2023-10-08T12:39:13.219222+0000","last_active":"2023-10-08T12:40:10.790683+0000","last_peered":"2023-10-08T12:40:10.790683+0000","last_clean":"2023-10-08T12:40:10.790683+0000","last_became_active":"2023-10-08T12:39:13.218757+0000","last_became_peered":"2023-10-08T12:39:13.218757+0000","last_unstale":"2023-10-08T12:40:10.790683+0000","last_undegraded":"2023-10-08T12:40:10.790683+0000","last_fullsized":"2023-10-08T12:40:10.790683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:15.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792165+0000","last_change":"2023-10-08T12:39:14.221945+0000","last_active":"2023-10-08T12:40:10.792165+0000","last_peered":"2023-10-08T12:40:10.792165+0000","last_clean":"2023-10-08T12:40:10.792165+0000","last_became_active":"2023-10-08T12:39:14.221625+0000","last_became_peered":"2023-10-08T12:39:14.221625+0000","last_unstale":"2023-10-08T12:40:10.792165+0000","last_undegraded":"2023-10-08T12:40:10.792165+0000","last_fullsized":"2023-10-08T12:40:10.792165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:50.424023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.799358+0000","last_change":"2023-10-08T12:40:11.799358+0000","last_active":"2023-10-08T12:40:11.799358+0000","last_peered":"2023-10-08T12:40:11.799358+0000","last_clean":"2023-10-08T12:40:11.799358+0000","last_became_active":"2023-10-08T12:40:11.792992+0000","last_became_peered":"2023-10-08T12:40:11.792992+0000","last_unstale":"2023-10-08T12:40:11.799358+0000","last_undegraded":"2023-10-08T12:40:11.799358+0000","last_fullsized":"2023-10-08T12:40:11.799358+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:26.689160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792960+0000","last_change":"2023-10-08T12:39:14.214849+0000","last_active":"2023-10-08T12:40:10.792960+0000","last_peered":"2023-10-08T12:40:10.792960+0000","last_clean":"2023-10-08T12:40:10.792960+0000","last_became_active":"2023-10-08T12:39:14.214573+0000","last_became_peered":"2023-10-08T12:39:14.214573+0000","last_unstale":"2023-10-08T12:40:10.792960+0000","last_undegraded":"2023-10-08T12:40:10.792960+0000","last_fullsized":"2023-10-08T12:40:10.792960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:50.922519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791629+0000","last_change":"2023-10-08T12:39:13.206518+0000","last_active":"2023-10-08T12:40:10.791629+0000","last_peered":"2023-10-08T12:40:10.791629+0000","last_clean":"2023-10-08T12:40:10.791629+0000","last_became_active":"2023-10-08T12:39:13.206082+0000","last_became_peered":"2023-10-08T12:39:13.206082+0000","last_unstale":"2023-10-08T12:40:10.791629+0000","last_undegraded":"2023-10-08T12:40:10.791629+0000","last_fullsized":"2023-10-08T12:40:10.791629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:47.980651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790717+0000","last_change":"2023-10-08T12:39:14.220897+0000","last_active":"2023-10-08T12:40:10.790717+0000","last_peered":"2023-10-08T12:40:10.790717+0000","last_clean":"2023-10-08T12:40:10.790717+0000","last_became_active":"2023-10-08T12:39:14.220173+0000","last_became_peered":"2023-10-08T12:39:14.220173+0000","last_unstale":"2023-10-08T12:40:10.790717+0000","last_undegraded":"2023-10-08T12:40:10.790717+0000","last_fullsized":"2023-10-08T12:40:10.790717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:09:02.588054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.281984+0000","last_change":"2023-10-08T12:39:13.213505+0000","last_active":"2023-10-08T12:40:11.281984+0000","last_peered":"2023-10-08T12:40:11.281984+0000","last_clean":"2023-10-08T12:40:11.281984+0000","last_became_active":"2023-10-08T12:39:13.213199+0000","last_became_peered":"2023-10-08T12:39:13.213199+0000","last_unstale":"2023-10-08T12:40:11.281984+0000","last_undegraded":"2023-10-08T12:40:11.281984+0000","last_fullsized":"2023-10-08T12:40:11.281984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:49.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789447+0000","last_change":"2023-10-08T12:39:14.208080+0000","last_active":"2023-10-08T12:40:10.789447+0000","last_peered":"2023-10-08T12:40:10.789447+0000","last_clean":"2023-10-08T12:40:10.789447+0000","last_became_active":"2023-10-08T12:39:14.207788+0000","last_became_peered":"2023-10-08T12:39:14.207788+0000","last_unstale":"2023-10-08T12:40:10.789447+0000","last_undegraded":"2023-10-08T12:40:10.789447+0000","last_fullsized":"2023-10-08T12:40:10.789447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:44.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791994+0000","last_change":"2023-10-08T12:39:13.216003+0000","last_active":"2023-10-08T12:40:10.791994+0000","last_peered":"2023-10-08T12:40:10.791994+0000","last_clean":"2023-10-08T12:40:10.791994+0000","last_became_active":"2023-10-08T12:39:13.215662+0000","last_became_peered":"2023-10-08T12:39:13.215662+0000","last_unstale":"2023-10-08T12:40:10.791994+0000","last_undegraded":"2023-10-08T12:40:10.791994+0000","last_fullsized":"2023-10-08T12:40:10.791994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:28.310430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.788835+0000","last_change":"2023-10-08T12:39:14.204336+0000","last_active":"2023-10-08T12:40:10.788835+0000","last_peered":"2023-10-08T12:40:10.788835+0000","last_clean":"2023-10-08T12:40:10.788835+0000","last_became_active":"2023-10-08T12:39:14.203993+0000","last_became_peered":"2023-10-08T12:39:14.203993+0000","last_unstale":"2023-10-08T12:40:10.788835+0000","last_undegraded":"2023-10-08T12:40:10.788835+0000","last_fullsized":"2023-10-08T12:40:10.788835+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:54.545166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.793371+0000","last_change":"2023-10-08T12:40:11.793371+0000","last_active":"2023-10-08T12:40:11.793371+0000","last_peered":"2023-10-08T12:40:11.793371+0000","last_clean":"2023-10-08T12:40:11.793371+0000","last_became_active":"2023-10-08T12:40:11.792968+0000","last_became_peered":"2023-10-08T12:40:11.792968+0000","last_unstale":"2023-10-08T12:40:11.793371+0000","last_undegraded":"2023-10-08T12:40:11.793371+0000","last_fullsized":"2023-10-08T12:40:11.793371+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:20.744535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792529+0000","last_change":"2023-10-08T12:39:14.221040+0000","last_active":"2023-10-08T12:40:10.792529+0000","last_peered":"2023-10-08T12:40:10.792529+0000","last_clean":"2023-10-08T12:40:10.792529+0000","last_became_active":"2023-10-08T12:39:14.220724+0000","last_became_peered":"2023-10-08T12:39:14.220724+0000","last_unstale":"2023-10-08T12:40:10.792529+0000","last_undegraded":"2023-10-08T12:40:10.792529+0000","last_fullsized":"2023-10-08T12:40:10.792529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:52.824228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790002+0000","last_change":"2023-10-08T12:39:13.212244+0000","last_active":"2023-10-08T12:40:10.790002+0000","last_peered":"2023-10-08T12:40:10.790002+0000","last_clean":"2023-10-08T12:40:10.790002+0000","last_became_active":"2023-10-08T12:39:13.212028+0000","last_became_peered":"2023-10-08T12:39:13.212028+0000","last_unstale":"2023-10-08T12:40:10.790002+0000","last_undegraded":"2023-10-08T12:40:10.790002+0000","last_fullsized":"2023-10-08T12:40:10.790002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:06.111807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793868+0000","last_change":"2023-10-08T12:39:14.216665+0000","last_active":"2023-10-08T12:40:10.793868+0000","last_peered":"2023-10-08T12:40:10.793868+0000","last_clean":"2023-10-08T12:40:10.793868+0000","last_became_active":"2023-10-08T12:39:14.216330+0000","last_became_peered":"2023-10-08T12:39:14.216330+0000","last_unstale":"2023-10-08T12:40:10.793868+0000","last_undegraded":"2023-10-08T12:40:10.793868+0000","last_fullsized":"2023-10-08T12:40:10.793868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.658600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793792+0000","last_change":"2023-10-08T12:39:13.214495+0000","last_active":"2023-10-08T12:40:10.793792+0000","last_peered":"2023-10-08T12:40:10.793792+0000","last_clean":"2023-10-08T12:40:10.793792+0000","last_became_active":"2023-10-08T12:39:13.213930+0000","last_became_peered":"2023-10-08T12:39:13.213930+0000","last_unstale":"2023-10-08T12:40:10.793792+0000","last_undegraded":"2023-10-08T12:40:10.793792+0000","last_fullsized":"2023-10-08T12:40:10.793792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:20:38.096164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794264+0000","last_change":"2023-10-08T12:39:14.212566+0000","last_active":"2023-10-08T12:40:10.794264+0000","last_peered":"2023-10-08T12:40:10.794264+0000","last_clean":"2023-10-08T12:40:10.794264+0000","last_became_active":"2023-10-08T12:39:14.211756+0000","last_became_peered":"2023-10-08T12:39:14.211756+0000","last_unstale":"2023-10-08T12:40:10.794264+0000","last_undegraded":"2023-10-08T12:40:10.794264+0000","last_fullsized":"2023-10-08T12:40:10.794264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:12.741640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786680+0000","last_change":"2023-10-08T12:39:13.217914+0000","last_active":"2023-10-08T12:40:10.786680+0000","last_peered":"2023-10-08T12:40:10.786680+0000","last_clean":"2023-10-08T12:40:10.786680+0000","last_became_active":"2023-10-08T12:39:13.217571+0000","last_became_peered":"2023-10-08T12:39:13.217571+0000","last_unstale":"2023-10-08T12:40:10.786680+0000","last_undegraded":"2023-10-08T12:40:10.786680+0000","last_fullsized":"2023-10-08T12:40:10.786680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:10.826007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794134+0000","last_change":"2023-10-08T12:39:14.214280+0000","last_active":"2023-10-08T12:40:10.794134+0000","last_peered":"2023-10-08T12:40:10.794134+0000","last_clean":"2023-10-08T12:40:10.794134+0000","last_became_active":"2023-10-08T12:39:14.213942+0000","last_became_peered":"2023-10-08T12:39:14.213942+0000","last_unstale":"2023-10-08T12:40:10.794134+0000","last_undegraded":"2023-10-08T12:40:10.794134+0000","last_fullsized":"2023-10-08T12:40:10.794134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:17:21.450265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791974+0000","last_change":"2023-10-08T12:39:13.222484+0000","last_active":"2023-10-08T12:40:10.791974+0000","last_peered":"2023-10-08T12:40:10.791974+0000","last_clean":"2023-10-08T12:40:10.791974+0000","last_became_active":"2023-10-08T12:39:13.222091+0000","last_became_peered":"2023-10-08T12:39:13.222091+0000","last_unstale":"2023-10-08T12:40:10.791974+0000","last_undegraded":"2023-10-08T12:40:10.791974+0000","last_fullsized":"2023-10-08T12:40:10.791974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:00.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794574+0000","last_change":"2023-10-08T12:39:14.207715+0000","last_active":"2023-10-08T12:40:10.794574+0000","last_peered":"2023-10-08T12:40:10.794574+0000","last_clean":"2023-10-08T12:40:10.794574+0000","last_became_active":"2023-10-08T12:39:14.207429+0000","last_became_peered":"2023-10-08T12:39:14.207429+0000","last_unstale":"2023-10-08T12:40:10.794574+0000","last_undegraded":"2023-10-08T12:40:10.794574+0000","last_fullsized":"2023-10-08T12:40:10.794574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:16.991831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.788904+0000","last_change":"2023-10-08T12:39:14.200398+0000","last_active":"2023-10-08T12:40:10.788904+0000","last_peered":"2023-10-08T12:40:10.788904+0000","last_clean":"2023-10-08T12:40:10.788904+0000","last_became_active":"2023-10-08T12:39:14.200035+0000","last_became_peered":"2023-10-08T12:39:14.200035+0000","last_unstale":"2023-10-08T12:40:10.788904+0000","last_undegraded":"2023-10-08T12:40:10.788904+0000","last_fullsized":"2023-10-08T12:40:10.788904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:13.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793521+0000","last_change":"2023-10-08T12:39:14.202185+0000","last_active":"2023-10-08T12:40:10.793521+0000","last_peered":"2023-10-08T12:40:10.793521+0000","last_clean":"2023-10-08T12:40:10.793521+0000","last_became_active":"2023-10-08T12:39:14.201232+0000","last_became_peered":"2023-10-08T12:39:14.201232+0000","last_unstale":"2023-10-08T12:40:10.793521+0000","last_undegraded":"2023-10-08T12:40:10.793521+0000","last_fullsized":"2023-10-08T12:40:10.793521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:50.949047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793459+0000","last_change":"2023-10-08T12:39:14.208014+0000","last_active":"2023-10-08T12:40:10.793459+0000","last_peered":"2023-10-08T12:40:10.793459+0000","last_clean":"2023-10-08T12:40:10.793459+0000","last_became_active":"2023-10-08T12:39:14.207579+0000","last_became_peered":"2023-10-08T12:39:14.207579+0000","last_unstale":"2023-10-08T12:40:10.793459+0000","last_undegraded":"2023-10-08T12:40:10.793459+0000","last_fullsized":"2023-10-08T12:40:10.793459+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:37.352827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.796652+0000","last_change":"2023-10-08T12:40:11.796652+0000","last_active":"2023-10-08T12:40:11.796652+0000","last_peered":"2023-10-08T12:40:11.796652+0000","last_clean":"2023-10-08T12:40:11.796652+0000","last_became_active":"2023-10-08T12:40:11.796346+0000","last_became_peered":"2023-10-08T12:40:11.796346+0000","last_unstale":"2023-10-08T12:40:11.796652+0000","last_undegraded":"2023-10-08T12:40:11.796652+0000","last_fullsized":"2023-10-08T12:40:11.796652+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:25:31.781651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792262+0000","last_change":"2023-10-08T12:39:14.222630+0000","last_active":"2023-10-08T12:40:10.792262+0000","last_peered":"2023-10-08T12:40:10.792262+0000","last_clean":"2023-10-08T12:40:10.792262+0000","last_became_active":"2023-10-08T12:39:14.222300+0000","last_became_peered":"2023-10-08T12:39:14.222300+0000","last_unstale":"2023-10-08T12:40:10.792262+0000","last_undegraded":"2023-10-08T12:40:10.792262+0000","last_fullsized":"2023-10-08T12:40:10.792262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.040227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789101+0000","last_change":"2023-10-08T12:39:14.207144+0000","last_active":"2023-10-08T12:40:10.789101+0000","last_peered":"2023-10-08T12:40:10.789101+0000","last_clean":"2023-10-08T12:40:10.789101+0000","last_became_active":"2023-10-08T12:39:14.206775+0000","last_became_peered":"2023-10-08T12:39:14.206775+0000","last_unstale":"2023-10-08T12:40:10.789101+0000","last_undegraded":"2023-10-08T12:40:10.789101+0000","last_fullsized":"2023-10-08T12:40:10.789101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:55.224270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794188+0000","last_change":"2023-10-08T12:39:14.204123+0000","last_active":"2023-10-08T12:40:10.794188+0000","last_peered":"2023-10-08T12:40:10.794188+0000","last_clean":"2023-10-08T12:40:10.794188+0000","last_became_active":"2023-10-08T12:39:14.203123+0000","last_became_peered":"2023-10-08T12:39:14.203123+0000","last_unstale":"2023-10-08T12:40:10.794188+0000","last_undegraded":"2023-10-08T12:40:10.794188+0000","last_fullsized":"2023-10-08T12:40:10.794188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:45.423095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792878+0000","last_change":"2023-10-08T12:39:14.211049+0000","last_active":"2023-10-08T12:40:10.792878+0000","last_peered":"2023-10-08T12:40:10.792878+0000","last_clean":"2023-10-08T12:40:10.792878+0000","last_became_active":"2023-10-08T12:39:14.210738+0000","last_became_peered":"2023-10-08T12:39:14.210738+0000","last_unstale":"2023-10-08T12:40:10.792878+0000","last_undegraded":"2023-10-08T12:40:10.792878+0000","last_fullsized":"2023-10-08T12:40:10.792878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:12.535857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786331+0000","last_change":"2023-10-08T12:39:14.220013+0000","last_active":"2023-10-08T12:40:10.786331+0000","last_peered":"2023-10-08T12:40:10.786331+0000","last_clean":"2023-10-08T12:40:10.786331+0000","last_became_active":"2023-10-08T12:39:14.219711+0000","last_became_peered":"2023-10-08T12:39:14.219711+0000","last_unstale":"2023-10-08T12:40:10.786331+0000","last_undegraded":"2023-10-08T12:40:10.786331+0000","last_fullsized":"2023-10-08T12:40:10.786331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:23.205074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791907+0000","last_change":"2023-10-08T12:39:14.214237+0000","last_active":"2023-10-08T12:40:10.791907+0000","last_peered":"2023-10-08T12:40:10.791907+0000","last_clean":"2023-10-08T12:40:10.791907+0000","last_became_active":"2023-10-08T12:39:14.213891+0000","last_became_peered":"2023-10-08T12:39:14.213891+0000","last_unstale":"2023-10-08T12:40:10.791907+0000","last_undegraded":"2023-10-08T12:40:10.791907+0000","last_fullsized":"2023-10-08T12:40:10.791907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:11.348411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282101+0000","last_change":"2023-10-08T12:39:14.209037+0000","last_active":"2023-10-08T12:40:11.282101+0000","last_peered":"2023-10-08T12:40:11.282101+0000","last_clean":"2023-10-08T12:40:11.282101+0000","last_became_active":"2023-10-08T12:39:14.208728+0000","last_became_peered":"2023-10-08T12:39:14.208728+0000","last_unstale":"2023-10-08T12:40:11.282101+0000","last_undegraded":"2023-10-08T12:40:11.282101+0000","last_fullsized":"2023-10-08T12:40:11.282101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:23.440413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793173+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:10.793173+0000","last_peered":"2023-10-08T12:40:10.793173+0000","last_clean":"2023-10-08T12:40:10.793173+0000","last_became_active":"2023-10-08T12:39:14.222393+0000","last_became_peered":"2023-10-08T12:39:14.222393+0000","last_unstale":"2023-10-08T12:40:10.793173+0000","last_undegraded":"2023-10-08T12:40:10.793173+0000","last_fullsized":"2023-10-08T12:40:10.793173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:19.704140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789020+0000","last_change":"2023-10-08T12:39:14.200858+0000","last_active":"2023-10-08T12:40:10.789020+0000","last_peered":"2023-10-08T12:40:10.789020+0000","last_clean":"2023-10-08T12:40:10.789020+0000","last_became_active":"2023-10-08T12:39:14.199948+0000","last_became_peered":"2023-10-08T12:39:14.199948+0000","last_unstale":"2023-10-08T12:40:10.789020+0000","last_undegraded":"2023-10-08T12:40:10.789020+0000","last_fullsized":"2023-10-08T12:40:10.789020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:10.366380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281436,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59958,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":140,"num_read_kb":129,"num_write":68,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":179874,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416411,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":462175,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.67100000000000004}]},{"osd":1,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73799999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":1.004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.76000000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.90300000000000002}]},{"osd":6,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.78100000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.63800000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.61599999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.69599999999999995}]}]},{"osd":10,"up_from":72,"seq":309237645342,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":1111689,"data_compressed":43212,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.377},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58499999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.46300000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.33500000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.376,"15min":0.376},"max":{"1min":0.76400000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81399999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.627}]},{"osd":3,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.437},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.64300000000000002,"15min":0.65300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.52300000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72999999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45400000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.57099999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83599999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64200000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65900000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.86499999999999999,"15min":0.88700000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.583,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.746}]},{"osd":9,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68899999999999995}]},{"osd":11,"last update":"Sun Oct 8 12:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.76700000000000002}]}]},{"osd":9,"up_from":67,"seq":287762808865,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":462880,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.43099999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.497,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.61299999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.57599999999999996}]},{"osd":3,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":3.1269999999999998,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.503}]},{"osd":4,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58299999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.212,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.82699999999999996,"15min":0.83499999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.88600000000000001,"15min":0.90000000000000002},"min":{"1min":0.60899999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":1.325,"15min":1.325},"last":0.80800000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.93799999999999994,"15min":0.94699999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.0720000000000001,"5min":3.0720000000000001,"15min":3.0720000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.86599999999999999,"15min":0.874},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.48199999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.93100000000000005,"15min":0.94699999999999995},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2729999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.999,"15min":1.0029999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.98,"5min":2.98,"15min":2.98},"last":0.76500000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.016,"15min":1.0249999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.96199999999999997,"15min":0.97199999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.83099999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.95899999999999996,"15min":0.95299999999999996},"min":{"1min":0.63500000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.90300000000000002,"15min":0.90400000000000003},"min":{"1min":0.60799999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.79000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070503,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":462448,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85599999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51600000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84699999999999998,"5min":1.026,"15min":1.026},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90700000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.90700000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.47599999999999998,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80300000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86199999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.625}]},{"osd":4,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.995,"5min":1.044,"15min":1.044},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94199999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77200000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.59999999999999998,"15min":0.58799999999999997},"min":{"1min":0.45000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.89000000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.64000000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72599999999999998,"15min":0.71899999999999997},"min":{"1min":0.54800000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77200000000000002,"15min":0.76500000000000001},"min":{"1min":0.64600000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.72999999999999998,"15min":0.70999999999999996},"min":{"1min":0.63100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59399999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.085,"5min":1.181,"15min":1.181},"last":0.86599999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.75900000000000001,"15min":0.753},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.75800000000000001,"15min":0.746},"min":{"1min":0.57399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.72499999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.77400000000000002,"15min":0.76500000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.879},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.54300000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.85299999999999998}]},{"osd":11,"last update":"Sun Oct 8 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.75600000000000001}]}]},{"osd":7,"up_from":52,"seq":223338299436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":1053248,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.877,"15min":0.877},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.434},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.745,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52100000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82899999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.629},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77800000000000002}]},{"osd":6,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.58799999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.79800000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.88400000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.71099999999999997}]},{"osd":10,"last update":"Sun Oct 8 12:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.748},{"interface":"front","average":{"1min":0.748,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91700000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.82799999999999996}]},{"osd":11,"last update":"Sun Oct 8 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.86599999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462960,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":462298,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79400000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56699999999999995}]},{"osd":2,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.56399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76100000000000001,"15min":0.77000000000000002},"min":{"1min":0.497,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.44800000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.032,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.52200000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.73499999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82099999999999995,"5min":6.875,"15min":6.875},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0229999999999999,"5min":1.095,"15min":1.095},"last":0.71899999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.125,"15min":1.125},"last":0.627},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83299999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:39:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81000000000000005,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.86099999999999999,"15min":0.83299999999999996},"min":{"1min":0.66900000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.77300000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.95999999999999996,"15min":0.97499999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1200000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84599999999999997,"15min":0.85199999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.69899999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.79700000000000004}]},{"osd":10,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.98399999999999999,"15min":0.998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.452,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.016}]}]},{"osd":1,"up_from":14,"seq":60129542217,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":521004,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.67000000000000004,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73099999999999998,"5min":1.452,"15min":1.452},"last":0.60499999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.55300000000000005,"15min":0.52500000000000002},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:39:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74299999999999999,"5min":1.413,"15min":1.413},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.57199999999999995},"min":{"1min":0.41799999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":1.427,"15min":1.427},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.42999999999999999,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.42999999999999999,"15min":0.39800000000000002},"min":{"1min":0.316,"5min":0.245,"15min":0.245},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.318}]},{"osd":5,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.63500000000000001,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.621,"15min":0.58799999999999997},"min":{"1min":0.51900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.123,"5min":1.355,"15min":1.355},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.99199999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.40699999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.625},"min":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.64700000000000002,"15min":0.63200000000000001},"min":{"1min":0.505,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.59099999999999997}]},{"osd":9,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73199999999999998,"15min":0.72199999999999998},"min":{"1min":0.50800000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.66700000000000004}]},{"osd":10,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.76900000000000002,"15min":0.755},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.73499999999999999,"15min":0.72199999999999998},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.65500000000000003}]},{"osd":11,"last update":"Sun Oct 8 12:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69799999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705740,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":462265,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:39:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.56000000000000005},"min":{"1min":0.35199999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63500000000000001,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.046},"last":0.47199999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65600000000000003,"15min":0.58899999999999997},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0089999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64100000000000001,"15min":0.58899999999999997},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.079,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:39:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66100000000000003,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.619,"5min":1.911,"15min":1.911},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.53000000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92100000000000004,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.745,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.50600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.873,"15min":0.879},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.048,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.56599999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.88200000000000001,"15min":0.89900000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.24,"15min":1.24},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.92900000000000005,"15min":0.94299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1259999999999999,"5min":1.298,"15min":1.298},"last":0.82199999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.94299999999999995,"15min":0.96599999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.65500000000000003}]},{"osd":11,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.74199999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378692,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":521369,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.41999999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.82899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":1.194,"15min":1.194},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Oct 8 12:40:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56699999999999995,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81200000000000006,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.58599999999999997,"15min":0.52600000000000002},"min":{"1min":0.45200000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.43099999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83299999999999996,"5min":1.073,"15min":1.073},"last":0.38},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91500000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48499999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.56299999999999994}]},{"osd":5,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.44400000000000001,"15min":0.41599999999999998},"min":{"1min":0.36699999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66700000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.434},"min":{"1min":0.371,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.44800000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.621,"15min":0.59899999999999998},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":1.04,"15min":1.04},"last":0.748}]},{"osd":7,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77200000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:39:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95099999999999996,"5min":1.024,"15min":1.024},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77900000000000003,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.85299999999999998,"5min":1.087,"15min":1.087},"last":0.84899999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.58899999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88100000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.60699999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.72499999999999998}]},{"osd":11,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.86599999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149758,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":462071,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46800000000000003,"15min":0.42999999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.72899999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.504,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81899999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.77500000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.60899999999999999},"min":{"1min":0.53800000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":1.081,"15min":1.081},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.63200000000000001,"15min":0.59899999999999998},"min":{"1min":0.495,"5min":0.371,"15min":0.371},"max":{"1min":0.92600000000000005,"5min":1.05,"15min":1.05},"last":0.70399999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.42899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88700000000000001,"5min":1.077,"15min":1.077},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70599999999999996,"15min":0.68700000000000006},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.98099999999999998,"5min":1.23,"15min":1.23},"last":0.56200000000000006}]},{"osd":4,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67900000000000005,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71899999999999997,"15min":0.66700000000000004},"min":{"1min":0.57299999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.042,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.754}]},{"osd":5,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89200000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.70699999999999996,"15min":0.69099999999999995},"min":{"1min":0.52700000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89400000000000002,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.47799999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0669999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":1.0069999999999999,"5min":1.109,"15min":1.109},"last":0.624}]},{"osd":7,"last update":"Sun Oct 8 12:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61799999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.069,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.53100000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0840000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.65300000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.89400000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.96499999999999997,"15min":0.998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1739999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.91900000000000004,"15min":0.93500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.121,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.69099999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.93500000000000005,"15min":0.94999999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0549999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.95399999999999996,"15min":0.97599999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.238,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.71899999999999997}]},{"osd":11,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.80100000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888123,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":462197,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67100000000000004,"15min":0.71999999999999997},"min":{"1min":0.439,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":6.0549999999999997,"15min":6.0549999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39500000000000002,"15min":0.36099999999999999},"min":{"1min":0.33000000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.629,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.38400000000000001},"min":{"1min":0.32400000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.74099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.58699999999999997,"15min":0.56000000000000005},"min":{"1min":0.52300000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.54400000000000004,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61399999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57999999999999996,"15min":0.53200000000000003},"min":{"1min":0.45700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58299999999999996,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83099999999999996,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.48399999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.626,"15min":0.55900000000000005},"min":{"1min":0.51700000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81899999999999995,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.62,"15min":0.57399999999999995},"min":{"1min":0.45100000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72199999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63100000000000001,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.876,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.56499999999999995},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.70299999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.55600000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.119,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.71399999999999997,"15min":0.70099999999999996},"min":{"1min":0.55300000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96299999999999997,"5min":1.242,"15min":1.242},"last":0.79100000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.91500000000000004,"5min":1.349,"15min":1.349},"last":0.747},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.016,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.67600000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98199999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.004,"5min":1.171,"15min":1.171},"last":0.60299999999999998}]},{"osd":11,"last update":"Sun Oct 8 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73599999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724597,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1052517,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.39600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.58499999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.498,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81999999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.47999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.40500000000000003},"min":{"1min":0.318,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.40699999999999997},"min":{"1min":0.29499999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.49299999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.59499999999999997,"15min":0.56100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67900000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.81000000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.60499999999999998,"15min":0.57499999999999996},"min":{"1min":0.54400000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83599999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.54700000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78400000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:39:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64900000000000002,"15min":0.63100000000000001},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.61699999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.441},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.46800000000000003}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.81699999999999995,"15min":0.79300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.75700000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.59599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.97599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59160,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59194,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59354,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:40:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:24 smithi092 ceph-mon[134093]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 929 B/s rd, 1 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:24.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:24 smithi173 ceph-mon[135182]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 929 B/s rd, 1 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:24.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:24 smithi059 ceph-mon[98489]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 929 B/s rd, 1 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:25.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:25 smithi092 ceph-mon[134093]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:25.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:25 smithi173 ceph-mon[135182]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:25.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:25 smithi059 ceph-mon[98489]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:26 smithi092 ceph-mon[134093]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:26 smithi173 ceph-mon[135182]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:26.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:26 smithi059 ceph-mon[98489]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T12:40:26.829 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T12:40:27.597 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:28.167 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:28 smithi059 ceph-mon[98489]: pgmap v292: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 10 B/s, 0 objects/s recovering 2023-10-08T12:40:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:28 smithi092 ceph-mon[134093]: pgmap v292: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 10 B/s, 0 objects/s recovering 2023-10-08T12:40:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:28 smithi173 ceph-mon[135182]: pgmap v292: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 10 B/s, 0 objects/s recovering 2023-10-08T12:40:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.207+0000 7fb36649b700 1 -- 172.21.15.59:0/1600257628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb360101260 msgr2=0x7fb36010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.207+0000 7fb36649b700 1 --2- 172.21.15.59:0/1600257628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb360101260 0x7fb36010d650 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb35800b0a0 tx=0x7fb35800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.207+0000 7fb36649b700 1 -- 172.21.15.59:0/1600257628 shutdown_connections 2023-10-08T12:40:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.207+0000 7fb36649b700 1 --2- 172.21.15.59:0/1600257628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3601057c0 0x7fb360105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.207+0000 7fb36649b700 1 --2- 172.21.15.59:0/1600257628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb360101260 0x7fb36010d650 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.207+0000 7fb36649b700 1 --2- 172.21.15.59:0/1600257628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3601008a0 0x7fb360100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.207+0000 7fb36649b700 1 -- 172.21.15.59:0/1600257628 >> 172.21.15.59:0/1600257628 conn(0x7fb3600779e0 msgr2=0x7fb360077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:29.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.207+0000 7fb36649b700 1 -- 172.21.15.59:0/1600257628 shutdown_connections 2023-10-08T12:40:29.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.207+0000 7fb36649b700 1 -- 172.21.15.59:0/1600257628 wait complete. 2023-10-08T12:40:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.208+0000 7fb36649b700 1 Processor -- start 2023-10-08T12:40:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb36649b700 1 -- start start 2023-10-08T12:40:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb36649b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3601008a0 0x7fb360072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb36649b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb360101260 0x7fb360073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb36649b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3601057c0 0x7fb360073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb36649b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3601a5060 con 0x7fb360101260 2023-10-08T12:40:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb36649b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3601a51d0 con 0x7fb3601008a0 2023-10-08T12:40:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb36649b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3601a5390 con 0x7fb3601057c0 2023-10-08T12:40:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb35f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb360101260 0x7fb360073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb35f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb360101260 0x7fb360073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51406/0 (socket says 172.21.15.59:51406) 2023-10-08T12:40:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb35f7fe700 1 -- 172.21.15.59:0/46224846 learned_addr learned my addr 172.21.15.59:0/46224846 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb35ffff700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3601008a0 0x7fb360072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.209+0000 7fb364a38700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3601057c0 0x7fb360073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb35f7fe700 1 -- 172.21.15.59:0/46224846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3601057c0 msgr2=0x7fb360073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb35f7fe700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3601057c0 0x7fb360073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb35f7fe700 1 -- 172.21.15.59:0/46224846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3601008a0 msgr2=0x7fb360072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb35f7fe700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3601008a0 0x7fb360072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb35f7fe700 1 -- 172.21.15.59:0/46224846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358009d00 con 0x7fb360101260 2023-10-08T12:40:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb364a38700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3601057c0 0x7fb360073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb35f7fe700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb360101260 0x7fb360073030 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb35400d950 tx=0x7fb35400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb35d7fa700 1 -- 172.21.15.59:0/46224846 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354009940 con 0x7fb360101260 2023-10-08T12:40:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb35d7fa700 1 -- 172.21.15.59:0/46224846 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb354010460 con 0x7fb360101260 2023-10-08T12:40:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb36649b700 1 -- 172.21.15.59:0/46224846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3601a5670 con 0x7fb360101260 2023-10-08T12:40:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb35d7fa700 1 -- 172.21.15.59:0/46224846 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35400f620 con 0x7fb360101260 2023-10-08T12:40:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.210+0000 7fb36649b700 1 -- 172.21.15.59:0/46224846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3601a5bc0 con 0x7fb360101260 2023-10-08T12:40:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.212+0000 7fb36649b700 1 -- 172.21.15.59:0/46224846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb360108da0 con 0x7fb360101260 2023-10-08T12:40:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.214+0000 7fb35d7fa700 1 -- 172.21.15.59:0/46224846 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fb3540108d0 con 0x7fb360101260 2023-10-08T12:40:29.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.215+0000 7fb35d7fa700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb3480a15e0 0x7fb3480a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:29.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.215+0000 7fb35d7fa700 1 -- 172.21.15.59:0/46224846 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb3540cd110 con 0x7fb360101260 2023-10-08T12:40:29.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.215+0000 7fb35ffff700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb3480a15e0 0x7fb3480a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:29.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.216+0000 7fb35ffff700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb3480a15e0 0x7fb3480a3aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb360101930 tx=0x7fb35000b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.219+0000 7fb35d7fa700 1 -- 172.21.15.59:0/46224846 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb354096570 con 0x7fb360101260 2023-10-08T12:40:29.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.428+0000 7fb36649b700 1 -- 172.21.15.59:0/46224846 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb360073fd0 con 0x7fb3480a15e0 2023-10-08T12:40:29.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.439+0000 7fb35d7fa700 1 -- 172.21.15.59:0/46224846 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344139 (secure 0 0 0) 0x7fb360073fd0 con 0x7fb3480a15e0 2023-10-08T12:40:29.451 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 -- 172.21.15.59:0/46224846 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb3480a15e0 msgr2=0x7fb3480a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb3480a15e0 0x7fb3480a3aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb360101930 tx=0x7fb35000b410 comp rx=0 tx=0).stop 2023-10-08T12:40:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 -- 172.21.15.59:0/46224846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb360101260 msgr2=0x7fb360073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb360101260 0x7fb360073030 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb35400d950 tx=0x7fb35400dc60 comp rx=0 tx=0).stop 2023-10-08T12:40:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 -- 172.21.15.59:0/46224846 shutdown_connections 2023-10-08T12:40:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb3480a15e0 0x7fb3480a3aa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3601008a0 0x7fb360072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3601057c0 0x7fb360073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 --2- 172.21.15.59:0/46224846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb360101260 0x7fb360073030 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 -- 172.21.15.59:0/46224846 >> 172.21.15.59:0/46224846 conn(0x7fb3600779e0 msgr2=0x7fb3600fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 -- 172.21.15.59:0/46224846 shutdown_connections 2023-10-08T12:40:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:29.444+0000 7fb36649b700 1 -- 172.21.15.59:0/46224846 wait complete. 2023-10-08T12:40:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-08T12:40:29.975 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:29 smithi059 ceph-mon[98489]: pgmap v293: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:29.977 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2023-10-08T12:40:28.799071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650572,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":286,"num_read_kb":253,"num_write":251,"num_write_kb":3018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180859,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335556,"kb_used_data":11296,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606268,"statfs":{"total":1151940427776,"available":1151596818432,"internally_reserved":0,"allocated":11567104,"data_stored":7496161,"data_compressed":181917,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004313"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789351+0000","last_change":"2023-10-08T12:39:14.206423+0000","last_active":"2023-10-08T12:40:10.789351+0000","last_peered":"2023-10-08T12:40:10.789351+0000","last_clean":"2023-10-08T12:40:10.789351+0000","last_became_active":"2023-10-08T12:39:14.205454+0000","last_became_peered":"2023-10-08T12:39:14.205454+0000","last_unstale":"2023-10-08T12:40:10.789351+0000","last_undegraded":"2023-10-08T12:40:10.789351+0000","last_fullsized":"2023-10-08T12:40:10.789351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:37.669007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790629+0000","last_change":"2023-10-08T12:39:14.215711+0000","last_active":"2023-10-08T12:40:10.790629+0000","last_peered":"2023-10-08T12:40:10.790629+0000","last_clean":"2023-10-08T12:40:10.790629+0000","last_became_active":"2023-10-08T12:39:14.215283+0000","last_became_peered":"2023-10-08T12:39:14.215283+0000","last_unstale":"2023-10-08T12:40:10.790629+0000","last_undegraded":"2023-10-08T12:40:10.790629+0000","last_fullsized":"2023-10-08T12:40:10.790629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:29.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789909+0000","last_change":"2023-10-08T12:39:14.209843+0000","last_active":"2023-10-08T12:40:10.789909+0000","last_peered":"2023-10-08T12:40:10.789909+0000","last_clean":"2023-10-08T12:40:10.789909+0000","last_became_active":"2023-10-08T12:39:14.209528+0000","last_became_peered":"2023-10-08T12:39:14.209528+0000","last_unstale":"2023-10-08T12:40:10.789909+0000","last_undegraded":"2023-10-08T12:40:10.789909+0000","last_fullsized":"2023-10-08T12:40:10.789909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:54.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791708+0000","last_change":"2023-10-08T12:39:14.204891+0000","last_active":"2023-10-08T12:40:10.791708+0000","last_peered":"2023-10-08T12:40:10.791708+0000","last_clean":"2023-10-08T12:40:10.791708+0000","last_became_active":"2023-10-08T12:39:14.204075+0000","last_became_peered":"2023-10-08T12:39:14.204075+0000","last_unstale":"2023-10-08T12:40:10.791708+0000","last_undegraded":"2023-10-08T12:40:10.791708+0000","last_fullsized":"2023-10-08T12:40:10.791708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:18.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789932+0000","last_change":"2023-10-08T12:39:14.212527+0000","last_active":"2023-10-08T12:40:10.789932+0000","last_peered":"2023-10-08T12:40:10.789932+0000","last_clean":"2023-10-08T12:40:10.789932+0000","last_became_active":"2023-10-08T12:39:14.212188+0000","last_became_peered":"2023-10-08T12:39:14.212188+0000","last_unstale":"2023-10-08T12:40:10.789932+0000","last_undegraded":"2023-10-08T12:40:10.789932+0000","last_fullsized":"2023-10-08T12:40:10.789932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:28.952210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786911+0000","last_change":"2023-10-08T12:39:14.216842+0000","last_active":"2023-10-08T12:40:10.786911+0000","last_peered":"2023-10-08T12:40:10.786911+0000","last_clean":"2023-10-08T12:40:10.786911+0000","last_became_active":"2023-10-08T12:39:14.216446+0000","last_became_peered":"2023-10-08T12:39:14.216446+0000","last_unstale":"2023-10-08T12:40:10.786911+0000","last_undegraded":"2023-10-08T12:40:10.786911+0000","last_fullsized":"2023-10-08T12:40:10.786911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:40.718246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793700+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:10.793700+0000","last_peered":"2023-10-08T12:40:10.793700+0000","last_clean":"2023-10-08T12:40:10.793700+0000","last_became_active":"2023-10-08T12:39:14.222410+0000","last_became_peered":"2023-10-08T12:39:14.222410+0000","last_unstale":"2023-10-08T12:40:10.793700+0000","last_undegraded":"2023-10-08T12:40:10.793700+0000","last_fullsized":"2023-10-08T12:40:10.793700+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:03.599610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790917+0000","last_change":"2023-10-08T12:39:14.209422+0000","last_active":"2023-10-08T12:40:10.790917+0000","last_peered":"2023-10-08T12:40:10.790917+0000","last_clean":"2023-10-08T12:40:10.790917+0000","last_became_active":"2023-10-08T12:39:14.209073+0000","last_became_peered":"2023-10-08T12:39:14.209073+0000","last_unstale":"2023-10-08T12:40:10.790917+0000","last_undegraded":"2023-10-08T12:40:10.790917+0000","last_fullsized":"2023-10-08T12:40:10.790917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:09.587414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282376+0000","last_change":"2023-10-08T12:39:14.211228+0000","last_active":"2023-10-08T12:40:11.282376+0000","last_peered":"2023-10-08T12:40:11.282376+0000","last_clean":"2023-10-08T12:40:11.282376+0000","last_became_active":"2023-10-08T12:39:14.210940+0000","last_became_peered":"2023-10-08T12:39:14.210940+0000","last_unstale":"2023-10-08T12:40:11.282376+0000","last_undegraded":"2023-10-08T12:40:11.282376+0000","last_fullsized":"2023-10-08T12:40:11.282376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:52.683409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787260+0000","last_change":"2023-10-08T12:39:14.207071+0000","last_active":"2023-10-08T12:40:10.787260+0000","last_peered":"2023-10-08T12:40:10.787260+0000","last_clean":"2023-10-08T12:40:10.787260+0000","last_became_active":"2023-10-08T12:39:14.206770+0000","last_became_peered":"2023-10-08T12:39:14.206770+0000","last_unstale":"2023-10-08T12:40:10.787260+0000","last_undegraded":"2023-10-08T12:40:10.787260+0000","last_fullsized":"2023-10-08T12:40:10.787260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:19.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794200+0000","last_change":"2023-10-08T12:39:14.212780+0000","last_active":"2023-10-08T12:40:10.794200+0000","last_peered":"2023-10-08T12:40:10.794200+0000","last_clean":"2023-10-08T12:40:10.794200+0000","last_became_active":"2023-10-08T12:39:14.212167+0000","last_became_peered":"2023-10-08T12:39:14.212167+0000","last_unstale":"2023-10-08T12:40:10.794200+0000","last_undegraded":"2023-10-08T12:40:10.794200+0000","last_fullsized":"2023-10-08T12:40:10.794200+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:17.332257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791627+0000","last_change":"2023-10-08T12:39:14.204506+0000","last_active":"2023-10-08T12:40:10.791627+0000","last_peered":"2023-10-08T12:40:10.791627+0000","last_clean":"2023-10-08T12:40:10.791627+0000","last_became_active":"2023-10-08T12:39:14.204184+0000","last_became_peered":"2023-10-08T12:39:14.204184+0000","last_unstale":"2023-10-08T12:40:10.791627+0000","last_undegraded":"2023-10-08T12:40:10.791627+0000","last_fullsized":"2023-10-08T12:40:10.791627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:05.696554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793271+0000","last_change":"2023-10-08T12:39:14.211957+0000","last_active":"2023-10-08T12:40:10.793271+0000","last_peered":"2023-10-08T12:40:10.793271+0000","last_clean":"2023-10-08T12:40:10.793271+0000","last_became_active":"2023-10-08T12:39:14.211629+0000","last_became_peered":"2023-10-08T12:39:14.211629+0000","last_unstale":"2023-10-08T12:40:10.793271+0000","last_undegraded":"2023-10-08T12:40:10.793271+0000","last_fullsized":"2023-10-08T12:40:10.793271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:10.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789681+0000","last_change":"2023-10-08T12:39:14.207006+0000","last_active":"2023-10-08T12:40:10.789681+0000","last_peered":"2023-10-08T12:40:10.789681+0000","last_clean":"2023-10-08T12:40:10.789681+0000","last_became_active":"2023-10-08T12:39:14.206624+0000","last_became_peered":"2023-10-08T12:39:14.206624+0000","last_unstale":"2023-10-08T12:40:10.789681+0000","last_undegraded":"2023-10-08T12:40:10.789681+0000","last_fullsized":"2023-10-08T12:40:10.789681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:11.232875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789907+0000","last_change":"2023-10-08T12:39:14.213865+0000","last_active":"2023-10-08T12:40:10.789907+0000","last_peered":"2023-10-08T12:40:10.789907+0000","last_clean":"2023-10-08T12:40:10.789907+0000","last_became_active":"2023-10-08T12:39:14.207972+0000","last_became_peered":"2023-10-08T12:39:14.207972+0000","last_unstale":"2023-10-08T12:40:10.789907+0000","last_undegraded":"2023-10-08T12:40:10.789907+0000","last_fullsized":"2023-10-08T12:40:10.789907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:01.434731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.281917+0000","last_change":"2023-10-08T12:39:14.206313+0000","last_active":"2023-10-08T12:40:11.281917+0000","last_peered":"2023-10-08T12:40:11.281917+0000","last_clean":"2023-10-08T12:40:11.281917+0000","last_became_active":"2023-10-08T12:39:14.206001+0000","last_became_peered":"2023-10-08T12:39:14.206001+0000","last_unstale":"2023-10-08T12:40:11.281917+0000","last_undegraded":"2023-10-08T12:40:11.281917+0000","last_fullsized":"2023-10-08T12:40:11.281917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:43.912356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789442+0000","last_change":"2023-10-08T12:39:14.205752+0000","last_active":"2023-10-08T12:40:10.789442+0000","last_peered":"2023-10-08T12:40:10.789442+0000","last_clean":"2023-10-08T12:40:10.789442+0000","last_became_active":"2023-10-08T12:39:14.204696+0000","last_became_peered":"2023-10-08T12:39:14.204696+0000","last_unstale":"2023-10-08T12:40:10.789442+0000","last_undegraded":"2023-10-08T12:40:10.789442+0000","last_fullsized":"2023-10-08T12:40:10.789442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:42.409107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787698+0000","last_change":"2023-10-08T12:39:14.203373+0000","last_active":"2023-10-08T12:40:10.787698+0000","last_peered":"2023-10-08T12:40:10.787698+0000","last_clean":"2023-10-08T12:40:10.787698+0000","last_became_active":"2023-10-08T12:39:14.202966+0000","last_became_peered":"2023-10-08T12:39:14.202966+0000","last_unstale":"2023-10-08T12:40:10.787698+0000","last_undegraded":"2023-10-08T12:40:10.787698+0000","last_fullsized":"2023-10-08T12:40:10.787698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:00.114475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793600+0000","last_change":"2023-10-08T12:39:14.216154+0000","last_active":"2023-10-08T12:40:10.793600+0000","last_peered":"2023-10-08T12:40:10.793600+0000","last_clean":"2023-10-08T12:40:10.793600+0000","last_became_active":"2023-10-08T12:39:14.215868+0000","last_became_peered":"2023-10-08T12:39:14.215868+0000","last_unstale":"2023-10-08T12:40:10.793600+0000","last_undegraded":"2023-10-08T12:40:10.793600+0000","last_fullsized":"2023-10-08T12:40:10.793600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:53.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786840+0000","last_change":"2023-10-08T12:39:13.214538+0000","last_active":"2023-10-08T12:40:10.786840+0000","last_peered":"2023-10-08T12:40:10.786840+0000","last_clean":"2023-10-08T12:40:10.786840+0000","last_became_active":"2023-10-08T12:39:13.214162+0000","last_became_peered":"2023-10-08T12:39:13.214162+0000","last_unstale":"2023-10-08T12:40:10.786840+0000","last_undegraded":"2023-10-08T12:40:10.786840+0000","last_fullsized":"2023-10-08T12:40:10.786840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:11.500815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793193+0000","last_change":"2023-10-08T12:39:14.211308+0000","last_active":"2023-10-08T12:40:10.793193+0000","last_peered":"2023-10-08T12:40:10.793193+0000","last_clean":"2023-10-08T12:40:10.793193+0000","last_became_active":"2023-10-08T12:39:14.210961+0000","last_became_peered":"2023-10-08T12:39:14.210961+0000","last_unstale":"2023-10-08T12:40:10.793193+0000","last_undegraded":"2023-10-08T12:40:10.793193+0000","last_fullsized":"2023-10-08T12:40:10.793193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.221981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793311+0000","last_change":"2023-10-08T12:39:13.219982+0000","last_active":"2023-10-08T12:40:10.793311+0000","last_peered":"2023-10-08T12:40:10.793311+0000","last_clean":"2023-10-08T12:40:10.793311+0000","last_became_active":"2023-10-08T12:39:13.219668+0000","last_became_peered":"2023-10-08T12:39:13.219668+0000","last_unstale":"2023-10-08T12:40:10.793311+0000","last_undegraded":"2023-10-08T12:40:10.793311+0000","last_fullsized":"2023-10-08T12:40:10.793311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.664553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790263+0000","last_change":"2023-10-08T12:39:14.216922+0000","last_active":"2023-10-08T12:40:10.790263+0000","last_peered":"2023-10-08T12:40:10.790263+0000","last_clean":"2023-10-08T12:40:10.790263+0000","last_became_active":"2023-10-08T12:39:14.216634+0000","last_became_peered":"2023-10-08T12:39:14.216634+0000","last_unstale":"2023-10-08T12:40:10.790263+0000","last_undegraded":"2023-10-08T12:40:10.790263+0000","last_fullsized":"2023-10-08T12:40:10.790263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:21.254178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790823+0000","last_change":"2023-10-08T12:39:13.220262+0000","last_active":"2023-10-08T12:40:10.790823+0000","last_peered":"2023-10-08T12:40:10.790823+0000","last_clean":"2023-10-08T12:40:10.790823+0000","last_became_active":"2023-10-08T12:39:13.219917+0000","last_became_peered":"2023-10-08T12:39:13.219917+0000","last_unstale":"2023-10-08T12:40:10.790823+0000","last_undegraded":"2023-10-08T12:40:10.790823+0000","last_fullsized":"2023-10-08T12:40:10.790823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:34.368119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282033+0000","last_change":"2023-10-08T12:39:14.212620+0000","last_active":"2023-10-08T12:40:11.282033+0000","last_peered":"2023-10-08T12:40:11.282033+0000","last_clean":"2023-10-08T12:40:11.282033+0000","last_became_active":"2023-10-08T12:39:14.212128+0000","last_became_peered":"2023-10-08T12:39:14.212128+0000","last_unstale":"2023-10-08T12:40:11.282033+0000","last_undegraded":"2023-10-08T12:40:11.282033+0000","last_fullsized":"2023-10-08T12:40:11.282033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:40.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790321+0000","last_change":"2023-10-08T12:39:13.218291+0000","last_active":"2023-10-08T12:40:10.790321+0000","last_peered":"2023-10-08T12:40:10.790321+0000","last_clean":"2023-10-08T12:40:10.790321+0000","last_became_active":"2023-10-08T12:39:13.217907+0000","last_became_peered":"2023-10-08T12:39:13.217907+0000","last_unstale":"2023-10-08T12:40:10.790321+0000","last_undegraded":"2023-10-08T12:40:10.790321+0000","last_fullsized":"2023-10-08T12:40:10.790321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:54:46.891553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786701+0000","last_change":"2023-10-08T12:39:14.207991+0000","last_active":"2023-10-08T12:40:10.786701+0000","last_peered":"2023-10-08T12:40:10.786701+0000","last_clean":"2023-10-08T12:40:10.786701+0000","last_became_active":"2023-10-08T12:39:14.207683+0000","last_became_peered":"2023-10-08T12:39:14.207683+0000","last_unstale":"2023-10-08T12:40:10.786701+0000","last_undegraded":"2023-10-08T12:40:10.786701+0000","last_fullsized":"2023-10-08T12:40:10.786701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:47.809553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786504+0000","last_change":"2023-10-08T12:39:13.214704+0000","last_active":"2023-10-08T12:40:10.786504+0000","last_peered":"2023-10-08T12:40:10.786504+0000","last_clean":"2023-10-08T12:40:10.786504+0000","last_became_active":"2023-10-08T12:39:13.214205+0000","last_became_peered":"2023-10-08T12:39:13.214205+0000","last_unstale":"2023-10-08T12:40:10.786504+0000","last_undegraded":"2023-10-08T12:40:10.786504+0000","last_fullsized":"2023-10-08T12:40:10.786504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:58.572620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790431+0000","last_change":"2023-10-08T12:39:14.219813+0000","last_active":"2023-10-08T12:40:10.790431+0000","last_peered":"2023-10-08T12:40:10.790431+0000","last_clean":"2023-10-08T12:40:10.790431+0000","last_became_active":"2023-10-08T12:39:14.219511+0000","last_became_peered":"2023-10-08T12:39:14.219511+0000","last_unstale":"2023-10-08T12:40:10.790431+0000","last_undegraded":"2023-10-08T12:40:10.790431+0000","last_fullsized":"2023-10-08T12:40:10.790431+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:43.716871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786848+0000","last_change":"2023-10-08T12:39:13.212567+0000","last_active":"2023-10-08T12:40:10.786848+0000","last_peered":"2023-10-08T12:40:10.786848+0000","last_clean":"2023-10-08T12:40:10.786848+0000","last_became_active":"2023-10-08T12:39:13.212079+0000","last_became_peered":"2023-10-08T12:39:13.212079+0000","last_unstale":"2023-10-08T12:40:10.786848+0000","last_undegraded":"2023-10-08T12:40:10.786848+0000","last_fullsized":"2023-10-08T12:40:10.786848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:35.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786558+0000","last_change":"2023-10-08T12:39:14.208760+0000","last_active":"2023-10-08T12:40:10.786558+0000","last_peered":"2023-10-08T12:40:10.786558+0000","last_clean":"2023-10-08T12:40:10.786558+0000","last_became_active":"2023-10-08T12:39:14.208490+0000","last_became_peered":"2023-10-08T12:39:14.208490+0000","last_unstale":"2023-10-08T12:40:10.786558+0000","last_undegraded":"2023-10-08T12:40:10.786558+0000","last_fullsized":"2023-10-08T12:40:10.786558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:19:56.423514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791638+0000","last_change":"2023-10-08T12:39:13.214197+0000","last_active":"2023-10-08T12:40:10.791638+0000","last_peered":"2023-10-08T12:40:10.791638+0000","last_clean":"2023-10-08T12:40:10.791638+0000","last_became_active":"2023-10-08T12:39:13.213829+0000","last_became_peered":"2023-10-08T12:39:13.213829+0000","last_unstale":"2023-10-08T12:40:10.791638+0000","last_undegraded":"2023-10-08T12:40:10.791638+0000","last_fullsized":"2023-10-08T12:40:10.791638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:29:05.080370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792154+0000","last_change":"2023-10-08T12:39:14.212369+0000","last_active":"2023-10-08T12:40:10.792154+0000","last_peered":"2023-10-08T12:40:10.792154+0000","last_clean":"2023-10-08T12:40:10.792154+0000","last_became_active":"2023-10-08T12:39:14.211917+0000","last_became_peered":"2023-10-08T12:39:14.211917+0000","last_unstale":"2023-10-08T12:40:10.792154+0000","last_undegraded":"2023-10-08T12:40:10.792154+0000","last_fullsized":"2023-10-08T12:40:10.792154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:27.265251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786322+0000","last_change":"2023-10-08T12:39:13.217339+0000","last_active":"2023-10-08T12:40:10.786322+0000","last_peered":"2023-10-08T12:40:10.786322+0000","last_clean":"2023-10-08T12:40:10.786322+0000","last_became_active":"2023-10-08T12:39:13.216973+0000","last_became_peered":"2023-10-08T12:39:13.216973+0000","last_unstale":"2023-10-08T12:40:10.786322+0000","last_undegraded":"2023-10-08T12:40:10.786322+0000","last_fullsized":"2023-10-08T12:40:10.786322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:35.899844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786605+0000","last_change":"2023-10-08T12:39:14.218870+0000","last_active":"2023-10-08T12:40:10.786605+0000","last_peered":"2023-10-08T12:40:10.786605+0000","last_clean":"2023-10-08T12:40:10.786605+0000","last_became_active":"2023-10-08T12:39:14.217879+0000","last_became_peered":"2023-10-08T12:39:14.217879+0000","last_unstale":"2023-10-08T12:40:10.786605+0000","last_undegraded":"2023-10-08T12:40:10.786605+0000","last_fullsized":"2023-10-08T12:40:10.786605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:06.769081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787188+0000","last_change":"2023-10-08T12:39:13.209120+0000","last_active":"2023-10-08T12:40:10.787188+0000","last_peered":"2023-10-08T12:40:10.787188+0000","last_clean":"2023-10-08T12:40:10.787188+0000","last_became_active":"2023-10-08T12:39:13.208755+0000","last_became_peered":"2023-10-08T12:39:13.208755+0000","last_unstale":"2023-10-08T12:40:10.787188+0000","last_undegraded":"2023-10-08T12:40:10.787188+0000","last_fullsized":"2023-10-08T12:40:10.787188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:48.977375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282268+0000","last_change":"2023-10-08T12:39:14.208187+0000","last_active":"2023-10-08T12:40:11.282268+0000","last_peered":"2023-10-08T12:40:11.282268+0000","last_clean":"2023-10-08T12:40:11.282268+0000","last_became_active":"2023-10-08T12:39:14.207868+0000","last_became_peered":"2023-10-08T12:39:14.207868+0000","last_unstale":"2023-10-08T12:40:11.282268+0000","last_undegraded":"2023-10-08T12:40:11.282268+0000","last_fullsized":"2023-10-08T12:40:11.282268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:50.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794276+0000","last_change":"2023-10-08T12:39:13.220447+0000","last_active":"2023-10-08T12:40:10.794276+0000","last_peered":"2023-10-08T12:40:10.794276+0000","last_clean":"2023-10-08T12:40:10.794276+0000","last_became_active":"2023-10-08T12:39:13.220032+0000","last_became_peered":"2023-10-08T12:39:13.220032+0000","last_unstale":"2023-10-08T12:40:10.794276+0000","last_undegraded":"2023-10-08T12:40:10.794276+0000","last_fullsized":"2023-10-08T12:40:10.794276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:22.223707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.807692+0000","last_change":"2023-10-08T12:40:11.807692+0000","last_active":"2023-10-08T12:40:11.807692+0000","last_peered":"2023-10-08T12:40:11.807692+0000","last_clean":"2023-10-08T12:40:11.807692+0000","last_became_active":"2023-10-08T12:40:11.807311+0000","last_became_peered":"2023-10-08T12:40:11.807311+0000","last_unstale":"2023-10-08T12:40:11.807692+0000","last_undegraded":"2023-10-08T12:40:11.807692+0000","last_fullsized":"2023-10-08T12:40:11.807692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:42.114689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786798+0000","last_change":"2023-10-08T12:39:13.219131+0000","last_active":"2023-10-08T12:40:10.786798+0000","last_peered":"2023-10-08T12:40:10.786798+0000","last_clean":"2023-10-08T12:40:10.786798+0000","last_became_active":"2023-10-08T12:39:13.218639+0000","last_became_peered":"2023-10-08T12:39:13.218639+0000","last_unstale":"2023-10-08T12:40:10.786798+0000","last_undegraded":"2023-10-08T12:40:10.786798+0000","last_fullsized":"2023-10-08T12:40:10.786798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.316153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282166+0000","last_change":"2023-10-08T12:39:14.212352+0000","last_active":"2023-10-08T12:40:11.282166+0000","last_peered":"2023-10-08T12:40:11.282166+0000","last_clean":"2023-10-08T12:40:11.282166+0000","last_became_active":"2023-10-08T12:39:14.211342+0000","last_became_peered":"2023-10-08T12:39:14.211342+0000","last_unstale":"2023-10-08T12:40:11.282166+0000","last_undegraded":"2023-10-08T12:40:11.282166+0000","last_fullsized":"2023-10-08T12:40:11.282166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:39:00.731860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'25","reported_seq":184,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:25.343735+0000","last_change":"2023-10-08T12:39:13.209967+0000","last_active":"2023-10-08T12:40:25.343735+0000","last_peered":"2023-10-08T12:40:25.343735+0000","last_clean":"2023-10-08T12:40:25.343735+0000","last_became_active":"2023-10-08T12:39:13.209650+0000","last_became_peered":"2023-10-08T12:39:13.209650+0000","last_unstale":"2023-10-08T12:40:25.343735+0000","last_undegraded":"2023-10-08T12:40:25.343735+0000","last_fullsized":"2023-10-08T12:40:25.343735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:08.206168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59160,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":128,"num_write":25,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790692+0000","last_change":"2023-10-08T12:39:14.211335+0000","last_active":"2023-10-08T12:40:10.790692+0000","last_peered":"2023-10-08T12:40:10.790692+0000","last_clean":"2023-10-08T12:40:10.790692+0000","last_became_active":"2023-10-08T12:39:14.211003+0000","last_became_peered":"2023-10-08T12:39:14.211003+0000","last_unstale":"2023-10-08T12:40:10.790692+0000","last_undegraded":"2023-10-08T12:40:10.790692+0000","last_fullsized":"2023-10-08T12:40:10.790692+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:00.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793676+0000","last_change":"2023-10-08T12:39:13.215379+0000","last_active":"2023-10-08T12:40:10.793676+0000","last_peered":"2023-10-08T12:40:10.793676+0000","last_clean":"2023-10-08T12:40:10.793676+0000","last_became_active":"2023-10-08T12:39:13.215036+0000","last_became_peered":"2023-10-08T12:39:13.215036+0000","last_unstale":"2023-10-08T12:40:10.793676+0000","last_undegraded":"2023-10-08T12:40:10.793676+0000","last_fullsized":"2023-10-08T12:40:10.793676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:24.690473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791858+0000","last_change":"2023-10-08T12:39:14.207907+0000","last_active":"2023-10-08T12:40:10.791858+0000","last_peered":"2023-10-08T12:40:10.791858+0000","last_clean":"2023-10-08T12:40:10.791858+0000","last_became_active":"2023-10-08T12:39:14.207620+0000","last_became_peered":"2023-10-08T12:39:14.207620+0000","last_unstale":"2023-10-08T12:40:10.791858+0000","last_undegraded":"2023-10-08T12:40:10.791858+0000","last_fullsized":"2023-10-08T12:40:10.791858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:49:11.866245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786468+0000","last_change":"2023-10-08T12:39:13.214521+0000","last_active":"2023-10-08T12:40:10.786468+0000","last_peered":"2023-10-08T12:40:10.786468+0000","last_clean":"2023-10-08T12:40:10.786468+0000","last_became_active":"2023-10-08T12:39:13.214127+0000","last_became_peered":"2023-10-08T12:39:13.214127+0000","last_unstale":"2023-10-08T12:40:10.786468+0000","last_undegraded":"2023-10-08T12:40:10.786468+0000","last_fullsized":"2023-10-08T12:40:10.786468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:46.735663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.796744+0000","last_change":"2023-10-08T12:40:11.796744+0000","last_active":"2023-10-08T12:40:11.796744+0000","last_peered":"2023-10-08T12:40:11.796744+0000","last_clean":"2023-10-08T12:40:11.796744+0000","last_became_active":"2023-10-08T12:40:11.796418+0000","last_became_peered":"2023-10-08T12:40:11.796418+0000","last_unstale":"2023-10-08T12:40:11.796744+0000","last_undegraded":"2023-10-08T12:40:11.796744+0000","last_fullsized":"2023-10-08T12:40:11.796744+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:22.693079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791530+0000","last_change":"2023-10-08T12:39:13.214758+0000","last_active":"2023-10-08T12:40:10.791530+0000","last_peered":"2023-10-08T12:40:10.791530+0000","last_clean":"2023-10-08T12:40:10.791530+0000","last_became_active":"2023-10-08T12:39:13.214304+0000","last_became_peered":"2023-10-08T12:39:13.214304+0000","last_unstale":"2023-10-08T12:40:10.791530+0000","last_undegraded":"2023-10-08T12:40:10.791530+0000","last_fullsized":"2023-10-08T12:40:10.791530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:34.074248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793742+0000","last_change":"2023-10-08T12:39:14.208071+0000","last_active":"2023-10-08T12:40:10.793742+0000","last_peered":"2023-10-08T12:40:10.793742+0000","last_clean":"2023-10-08T12:40:10.793742+0000","last_became_active":"2023-10-08T12:39:14.207787+0000","last_became_peered":"2023-10-08T12:39:14.207787+0000","last_unstale":"2023-10-08T12:40:10.793742+0000","last_undegraded":"2023-10-08T12:40:10.793742+0000","last_fullsized":"2023-10-08T12:40:10.793742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:40.869575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789406+0000","last_change":"2023-10-08T12:39:13.219105+0000","last_active":"2023-10-08T12:40:10.789406+0000","last_peered":"2023-10-08T12:40:10.789406+0000","last_clean":"2023-10-08T12:40:10.789406+0000","last_became_active":"2023-10-08T12:39:13.218767+0000","last_became_peered":"2023-10-08T12:39:13.218767+0000","last_unstale":"2023-10-08T12:40:10.789406+0000","last_undegraded":"2023-10-08T12:40:10.789406+0000","last_fullsized":"2023-10-08T12:40:10.789406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:22.763921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786312+0000","last_change":"2023-10-08T12:39:14.210037+0000","last_active":"2023-10-08T12:40:10.786312+0000","last_peered":"2023-10-08T12:40:10.786312+0000","last_clean":"2023-10-08T12:40:10.786312+0000","last_became_active":"2023-10-08T12:39:14.208140+0000","last_became_peered":"2023-10-08T12:39:14.208140+0000","last_unstale":"2023-10-08T12:40:10.786312+0000","last_undegraded":"2023-10-08T12:40:10.786312+0000","last_fullsized":"2023-10-08T12:40:10.786312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:38.475668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790878+0000","last_change":"2023-10-08T12:39:13.219229+0000","last_active":"2023-10-08T12:40:10.790878+0000","last_peered":"2023-10-08T12:40:10.790878+0000","last_clean":"2023-10-08T12:40:10.790878+0000","last_became_active":"2023-10-08T12:39:13.217964+0000","last_became_peered":"2023-10-08T12:39:13.217964+0000","last_unstale":"2023-10-08T12:40:10.790878+0000","last_undegraded":"2023-10-08T12:40:10.790878+0000","last_fullsized":"2023-10-08T12:40:10.790878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:47.480351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.808035+0000","last_change":"2023-10-08T12:40:11.808035+0000","last_active":"2023-10-08T12:40:11.808035+0000","last_peered":"2023-10-08T12:40:11.808035+0000","last_clean":"2023-10-08T12:40:11.808035+0000","last_became_active":"2023-10-08T12:40:11.807611+0000","last_became_peered":"2023-10-08T12:40:11.807611+0000","last_unstale":"2023-10-08T12:40:11.808035+0000","last_undegraded":"2023-10-08T12:40:11.808035+0000","last_fullsized":"2023-10-08T12:40:11.808035+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:51.833325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786745+0000","last_change":"2023-10-08T12:39:13.212791+0000","last_active":"2023-10-08T12:40:10.786745+0000","last_peered":"2023-10-08T12:40:10.786745+0000","last_clean":"2023-10-08T12:40:10.786745+0000","last_became_active":"2023-10-08T12:39:13.212146+0000","last_became_peered":"2023-10-08T12:39:13.212146+0000","last_unstale":"2023-10-08T12:40:10.786745+0000","last_undegraded":"2023-10-08T12:40:10.786745+0000","last_fullsized":"2023-10-08T12:40:10.786745+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:37.452859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.800095+0000","last_change":"2023-10-08T12:40:11.800095+0000","last_active":"2023-10-08T12:40:11.800095+0000","last_peered":"2023-10-08T12:40:11.800095+0000","last_clean":"2023-10-08T12:40:11.800095+0000","last_became_active":"2023-10-08T12:40:11.795780+0000","last_became_peered":"2023-10-08T12:40:11.795780+0000","last_unstale":"2023-10-08T12:40:11.800095+0000","last_undegraded":"2023-10-08T12:40:11.800095+0000","last_fullsized":"2023-10-08T12:40:11.800095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:15.163613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794197+0000","last_change":"2023-10-08T12:39:13.217672+0000","last_active":"2023-10-08T12:40:10.794197+0000","last_peered":"2023-10-08T12:40:10.794197+0000","last_clean":"2023-10-08T12:40:10.794197+0000","last_became_active":"2023-10-08T12:39:13.217277+0000","last_became_peered":"2023-10-08T12:39:13.217277+0000","last_unstale":"2023-10-08T12:40:10.794197+0000","last_undegraded":"2023-10-08T12:40:10.794197+0000","last_fullsized":"2023-10-08T12:40:10.794197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:41.097439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787045+0000","last_change":"2023-10-08T12:39:14.219261+0000","last_active":"2023-10-08T12:40:10.787045+0000","last_peered":"2023-10-08T12:40:10.787045+0000","last_clean":"2023-10-08T12:40:10.787045+0000","last_became_active":"2023-10-08T12:39:14.218963+0000","last_became_peered":"2023-10-08T12:39:14.218963+0000","last_unstale":"2023-10-08T12:40:10.787045+0000","last_undegraded":"2023-10-08T12:40:10.787045+0000","last_fullsized":"2023-10-08T12:40:10.787045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:19.573306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786505+0000","last_change":"2023-10-08T12:39:14.207923+0000","last_active":"2023-10-08T12:40:10.786505+0000","last_peered":"2023-10-08T12:40:10.786505+0000","last_clean":"2023-10-08T12:40:10.786505+0000","last_became_active":"2023-10-08T12:39:14.207634+0000","last_became_peered":"2023-10-08T12:39:14.207634+0000","last_unstale":"2023-10-08T12:40:10.786505+0000","last_undegraded":"2023-10-08T12:40:10.786505+0000","last_fullsized":"2023-10-08T12:40:10.786505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:39.634945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791515+0000","last_change":"2023-10-08T12:39:13.223021+0000","last_active":"2023-10-08T12:40:10.791515+0000","last_peered":"2023-10-08T12:40:10.791515+0000","last_clean":"2023-10-08T12:40:10.791515+0000","last_became_active":"2023-10-08T12:39:13.222680+0000","last_became_peered":"2023-10-08T12:39:13.222680+0000","last_unstale":"2023-10-08T12:40:10.791515+0000","last_undegraded":"2023-10-08T12:40:10.791515+0000","last_fullsized":"2023-10-08T12:40:10.791515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:40.454436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792771+0000","last_change":"2023-10-08T12:39:14.217364+0000","last_active":"2023-10-08T12:40:10.792771+0000","last_peered":"2023-10-08T12:40:10.792771+0000","last_clean":"2023-10-08T12:40:10.792771+0000","last_became_active":"2023-10-08T12:39:14.216984+0000","last_became_peered":"2023-10-08T12:39:14.216984+0000","last_unstale":"2023-10-08T12:40:10.792771+0000","last_undegraded":"2023-10-08T12:40:10.792771+0000","last_fullsized":"2023-10-08T12:40:10.792771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:11:51.818034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792124+0000","last_change":"2023-10-08T12:39:13.207687+0000","last_active":"2023-10-08T12:40:10.792124+0000","last_peered":"2023-10-08T12:40:10.792124+0000","last_clean":"2023-10-08T12:40:10.792124+0000","last_became_active":"2023-10-08T12:39:13.207270+0000","last_became_peered":"2023-10-08T12:39:13.207270+0000","last_unstale":"2023-10-08T12:40:10.792124+0000","last_undegraded":"2023-10-08T12:40:10.792124+0000","last_fullsized":"2023-10-08T12:40:10.792124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:44.673383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":318,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793703+0000","last_change":"2023-10-08T12:38:07.696721+0000","last_active":"2023-10-08T12:40:10.793703+0000","last_peered":"2023-10-08T12:40:10.793703+0000","last_clean":"2023-10-08T12:40:10.793703+0000","last_became_active":"2023-10-08T12:38:07.696336+0000","last_became_peered":"2023-10-08T12:38:07.696336+0000","last_unstale":"2023-10-08T12:40:10.793703+0000","last_undegraded":"2023-10-08T12:40:10.793703+0000","last_fullsized":"2023-10-08T12:40:10.793703+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_clean_scrub_stamp":"2023-10-08T12:34:57.643348+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:01.821924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791426+0000","last_change":"2023-10-08T12:39:14.208845+0000","last_active":"2023-10-08T12:40:10.791426+0000","last_peered":"2023-10-08T12:40:10.791426+0000","last_clean":"2023-10-08T12:40:10.791426+0000","last_became_active":"2023-10-08T12:39:14.208487+0000","last_became_peered":"2023-10-08T12:39:14.208487+0000","last_unstale":"2023-10-08T12:40:10.791426+0000","last_undegraded":"2023-10-08T12:40:10.791426+0000","last_fullsized":"2023-10-08T12:40:10.791426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:26.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793636+0000","last_change":"2023-10-08T12:39:13.216627+0000","last_active":"2023-10-08T12:40:10.793636+0000","last_peered":"2023-10-08T12:40:10.793636+0000","last_clean":"2023-10-08T12:40:10.793636+0000","last_became_active":"2023-10-08T12:39:13.216201+0000","last_became_peered":"2023-10-08T12:39:13.216201+0000","last_unstale":"2023-10-08T12:40:10.793636+0000","last_undegraded":"2023-10-08T12:40:10.793636+0000","last_fullsized":"2023-10-08T12:40:10.793636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:19.873615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790683+0000","last_change":"2023-10-08T12:39:13.219222+0000","last_active":"2023-10-08T12:40:10.790683+0000","last_peered":"2023-10-08T12:40:10.790683+0000","last_clean":"2023-10-08T12:40:10.790683+0000","last_became_active":"2023-10-08T12:39:13.218757+0000","last_became_peered":"2023-10-08T12:39:13.218757+0000","last_unstale":"2023-10-08T12:40:10.790683+0000","last_undegraded":"2023-10-08T12:40:10.790683+0000","last_fullsized":"2023-10-08T12:40:10.790683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:15.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792165+0000","last_change":"2023-10-08T12:39:14.221945+0000","last_active":"2023-10-08T12:40:10.792165+0000","last_peered":"2023-10-08T12:40:10.792165+0000","last_clean":"2023-10-08T12:40:10.792165+0000","last_became_active":"2023-10-08T12:39:14.221625+0000","last_became_peered":"2023-10-08T12:39:14.221625+0000","last_unstale":"2023-10-08T12:40:10.792165+0000","last_undegraded":"2023-10-08T12:40:10.792165+0000","last_fullsized":"2023-10-08T12:40:10.792165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:50.424023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.799358+0000","last_change":"2023-10-08T12:40:11.799358+0000","last_active":"2023-10-08T12:40:11.799358+0000","last_peered":"2023-10-08T12:40:11.799358+0000","last_clean":"2023-10-08T12:40:11.799358+0000","last_became_active":"2023-10-08T12:40:11.792992+0000","last_became_peered":"2023-10-08T12:40:11.792992+0000","last_unstale":"2023-10-08T12:40:11.799358+0000","last_undegraded":"2023-10-08T12:40:11.799358+0000","last_fullsized":"2023-10-08T12:40:11.799358+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:26.689160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792960+0000","last_change":"2023-10-08T12:39:14.214849+0000","last_active":"2023-10-08T12:40:10.792960+0000","last_peered":"2023-10-08T12:40:10.792960+0000","last_clean":"2023-10-08T12:40:10.792960+0000","last_became_active":"2023-10-08T12:39:14.214573+0000","last_became_peered":"2023-10-08T12:39:14.214573+0000","last_unstale":"2023-10-08T12:40:10.792960+0000","last_undegraded":"2023-10-08T12:40:10.792960+0000","last_fullsized":"2023-10-08T12:40:10.792960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:50.922519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791629+0000","last_change":"2023-10-08T12:39:13.206518+0000","last_active":"2023-10-08T12:40:10.791629+0000","last_peered":"2023-10-08T12:40:10.791629+0000","last_clean":"2023-10-08T12:40:10.791629+0000","last_became_active":"2023-10-08T12:39:13.206082+0000","last_became_peered":"2023-10-08T12:39:13.206082+0000","last_unstale":"2023-10-08T12:40:10.791629+0000","last_undegraded":"2023-10-08T12:40:10.791629+0000","last_fullsized":"2023-10-08T12:40:10.791629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:47.980651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790717+0000","last_change":"2023-10-08T12:39:14.220897+0000","last_active":"2023-10-08T12:40:10.790717+0000","last_peered":"2023-10-08T12:40:10.790717+0000","last_clean":"2023-10-08T12:40:10.790717+0000","last_became_active":"2023-10-08T12:39:14.220173+0000","last_became_peered":"2023-10-08T12:39:14.220173+0000","last_unstale":"2023-10-08T12:40:10.790717+0000","last_undegraded":"2023-10-08T12:40:10.790717+0000","last_fullsized":"2023-10-08T12:40:10.790717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:09:02.588054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.281984+0000","last_change":"2023-10-08T12:39:13.213505+0000","last_active":"2023-10-08T12:40:11.281984+0000","last_peered":"2023-10-08T12:40:11.281984+0000","last_clean":"2023-10-08T12:40:11.281984+0000","last_became_active":"2023-10-08T12:39:13.213199+0000","last_became_peered":"2023-10-08T12:39:13.213199+0000","last_unstale":"2023-10-08T12:40:11.281984+0000","last_undegraded":"2023-10-08T12:40:11.281984+0000","last_fullsized":"2023-10-08T12:40:11.281984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:49.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789447+0000","last_change":"2023-10-08T12:39:14.208080+0000","last_active":"2023-10-08T12:40:10.789447+0000","last_peered":"2023-10-08T12:40:10.789447+0000","last_clean":"2023-10-08T12:40:10.789447+0000","last_became_active":"2023-10-08T12:39:14.207788+0000","last_became_peered":"2023-10-08T12:39:14.207788+0000","last_unstale":"2023-10-08T12:40:10.789447+0000","last_undegraded":"2023-10-08T12:40:10.789447+0000","last_fullsized":"2023-10-08T12:40:10.789447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:44.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791994+0000","last_change":"2023-10-08T12:39:13.216003+0000","last_active":"2023-10-08T12:40:10.791994+0000","last_peered":"2023-10-08T12:40:10.791994+0000","last_clean":"2023-10-08T12:40:10.791994+0000","last_became_active":"2023-10-08T12:39:13.215662+0000","last_became_peered":"2023-10-08T12:39:13.215662+0000","last_unstale":"2023-10-08T12:40:10.791994+0000","last_undegraded":"2023-10-08T12:40:10.791994+0000","last_fullsized":"2023-10-08T12:40:10.791994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:28.310430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.788835+0000","last_change":"2023-10-08T12:39:14.204336+0000","last_active":"2023-10-08T12:40:10.788835+0000","last_peered":"2023-10-08T12:40:10.788835+0000","last_clean":"2023-10-08T12:40:10.788835+0000","last_became_active":"2023-10-08T12:39:14.203993+0000","last_became_peered":"2023-10-08T12:39:14.203993+0000","last_unstale":"2023-10-08T12:40:10.788835+0000","last_undegraded":"2023-10-08T12:40:10.788835+0000","last_fullsized":"2023-10-08T12:40:10.788835+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:54.545166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.793371+0000","last_change":"2023-10-08T12:40:11.793371+0000","last_active":"2023-10-08T12:40:11.793371+0000","last_peered":"2023-10-08T12:40:11.793371+0000","last_clean":"2023-10-08T12:40:11.793371+0000","last_became_active":"2023-10-08T12:40:11.792968+0000","last_became_peered":"2023-10-08T12:40:11.792968+0000","last_unstale":"2023-10-08T12:40:11.793371+0000","last_undegraded":"2023-10-08T12:40:11.793371+0000","last_fullsized":"2023-10-08T12:40:11.793371+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:20.744535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792529+0000","last_change":"2023-10-08T12:39:14.221040+0000","last_active":"2023-10-08T12:40:10.792529+0000","last_peered":"2023-10-08T12:40:10.792529+0000","last_clean":"2023-10-08T12:40:10.792529+0000","last_became_active":"2023-10-08T12:39:14.220724+0000","last_became_peered":"2023-10-08T12:39:14.220724+0000","last_unstale":"2023-10-08T12:40:10.792529+0000","last_undegraded":"2023-10-08T12:40:10.792529+0000","last_fullsized":"2023-10-08T12:40:10.792529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:52.824228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790002+0000","last_change":"2023-10-08T12:39:13.212244+0000","last_active":"2023-10-08T12:40:10.790002+0000","last_peered":"2023-10-08T12:40:10.790002+0000","last_clean":"2023-10-08T12:40:10.790002+0000","last_became_active":"2023-10-08T12:39:13.212028+0000","last_became_peered":"2023-10-08T12:39:13.212028+0000","last_unstale":"2023-10-08T12:40:10.790002+0000","last_undegraded":"2023-10-08T12:40:10.790002+0000","last_fullsized":"2023-10-08T12:40:10.790002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:06.111807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793868+0000","last_change":"2023-10-08T12:39:14.216665+0000","last_active":"2023-10-08T12:40:10.793868+0000","last_peered":"2023-10-08T12:40:10.793868+0000","last_clean":"2023-10-08T12:40:10.793868+0000","last_became_active":"2023-10-08T12:39:14.216330+0000","last_became_peered":"2023-10-08T12:39:14.216330+0000","last_unstale":"2023-10-08T12:40:10.793868+0000","last_undegraded":"2023-10-08T12:40:10.793868+0000","last_fullsized":"2023-10-08T12:40:10.793868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.658600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793792+0000","last_change":"2023-10-08T12:39:13.214495+0000","last_active":"2023-10-08T12:40:10.793792+0000","last_peered":"2023-10-08T12:40:10.793792+0000","last_clean":"2023-10-08T12:40:10.793792+0000","last_became_active":"2023-10-08T12:39:13.213930+0000","last_became_peered":"2023-10-08T12:39:13.213930+0000","last_unstale":"2023-10-08T12:40:10.793792+0000","last_undegraded":"2023-10-08T12:40:10.793792+0000","last_fullsized":"2023-10-08T12:40:10.793792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:20:38.096164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794264+0000","last_change":"2023-10-08T12:39:14.212566+0000","last_active":"2023-10-08T12:40:10.794264+0000","last_peered":"2023-10-08T12:40:10.794264+0000","last_clean":"2023-10-08T12:40:10.794264+0000","last_became_active":"2023-10-08T12:39:14.211756+0000","last_became_peered":"2023-10-08T12:39:14.211756+0000","last_unstale":"2023-10-08T12:40:10.794264+0000","last_undegraded":"2023-10-08T12:40:10.794264+0000","last_fullsized":"2023-10-08T12:40:10.794264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:12.741640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786680+0000","last_change":"2023-10-08T12:39:13.217914+0000","last_active":"2023-10-08T12:40:10.786680+0000","last_peered":"2023-10-08T12:40:10.786680+0000","last_clean":"2023-10-08T12:40:10.786680+0000","last_became_active":"2023-10-08T12:39:13.217571+0000","last_became_peered":"2023-10-08T12:39:13.217571+0000","last_unstale":"2023-10-08T12:40:10.786680+0000","last_undegraded":"2023-10-08T12:40:10.786680+0000","last_fullsized":"2023-10-08T12:40:10.786680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:10.826007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794134+0000","last_change":"2023-10-08T12:39:14.214280+0000","last_active":"2023-10-08T12:40:10.794134+0000","last_peered":"2023-10-08T12:40:10.794134+0000","last_clean":"2023-10-08T12:40:10.794134+0000","last_became_active":"2023-10-08T12:39:14.213942+0000","last_became_peered":"2023-10-08T12:39:14.213942+0000","last_unstale":"2023-10-08T12:40:10.794134+0000","last_undegraded":"2023-10-08T12:40:10.794134+0000","last_fullsized":"2023-10-08T12:40:10.794134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:17:21.450265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791974+0000","last_change":"2023-10-08T12:39:13.222484+0000","last_active":"2023-10-08T12:40:10.791974+0000","last_peered":"2023-10-08T12:40:10.791974+0000","last_clean":"2023-10-08T12:40:10.791974+0000","last_became_active":"2023-10-08T12:39:13.222091+0000","last_became_peered":"2023-10-08T12:39:13.222091+0000","last_unstale":"2023-10-08T12:40:10.791974+0000","last_undegraded":"2023-10-08T12:40:10.791974+0000","last_fullsized":"2023-10-08T12:40:10.791974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:00.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794574+0000","last_change":"2023-10-08T12:39:14.207715+0000","last_active":"2023-10-08T12:40:10.794574+0000","last_peered":"2023-10-08T12:40:10.794574+0000","last_clean":"2023-10-08T12:40:10.794574+0000","last_became_active":"2023-10-08T12:39:14.207429+0000","last_became_peered":"2023-10-08T12:39:14.207429+0000","last_unstale":"2023-10-08T12:40:10.794574+0000","last_undegraded":"2023-10-08T12:40:10.794574+0000","last_fullsized":"2023-10-08T12:40:10.794574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:16.991831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.788904+0000","last_change":"2023-10-08T12:39:14.200398+0000","last_active":"2023-10-08T12:40:10.788904+0000","last_peered":"2023-10-08T12:40:10.788904+0000","last_clean":"2023-10-08T12:40:10.788904+0000","last_became_active":"2023-10-08T12:39:14.200035+0000","last_became_peered":"2023-10-08T12:39:14.200035+0000","last_unstale":"2023-10-08T12:40:10.788904+0000","last_undegraded":"2023-10-08T12:40:10.788904+0000","last_fullsized":"2023-10-08T12:40:10.788904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:13.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793521+0000","last_change":"2023-10-08T12:39:14.202185+0000","last_active":"2023-10-08T12:40:10.793521+0000","last_peered":"2023-10-08T12:40:10.793521+0000","last_clean":"2023-10-08T12:40:10.793521+0000","last_became_active":"2023-10-08T12:39:14.201232+0000","last_became_peered":"2023-10-08T12:39:14.201232+0000","last_unstale":"2023-10-08T12:40:10.793521+0000","last_undegraded":"2023-10-08T12:40:10.793521+0000","last_fullsized":"2023-10-08T12:40:10.793521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:50.949047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793459+0000","last_change":"2023-10-08T12:39:14.208014+0000","last_active":"2023-10-08T12:40:10.793459+0000","last_peered":"2023-10-08T12:40:10.793459+0000","last_clean":"2023-10-08T12:40:10.793459+0000","last_became_active":"2023-10-08T12:39:14.207579+0000","last_became_peered":"2023-10-08T12:39:14.207579+0000","last_unstale":"2023-10-08T12:40:10.793459+0000","last_undegraded":"2023-10-08T12:40:10.793459+0000","last_fullsized":"2023-10-08T12:40:10.793459+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:37.352827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.796652+0000","last_change":"2023-10-08T12:40:11.796652+0000","last_active":"2023-10-08T12:40:11.796652+0000","last_peered":"2023-10-08T12:40:11.796652+0000","last_clean":"2023-10-08T12:40:11.796652+0000","last_became_active":"2023-10-08T12:40:11.796346+0000","last_became_peered":"2023-10-08T12:40:11.796346+0000","last_unstale":"2023-10-08T12:40:11.796652+0000","last_undegraded":"2023-10-08T12:40:11.796652+0000","last_fullsized":"2023-10-08T12:40:11.796652+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:25:31.781651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792262+0000","last_change":"2023-10-08T12:39:14.222630+0000","last_active":"2023-10-08T12:40:10.792262+0000","last_peered":"2023-10-08T12:40:10.792262+0000","last_clean":"2023-10-08T12:40:10.792262+0000","last_became_active":"2023-10-08T12:39:14.222300+0000","last_became_peered":"2023-10-08T12:39:14.222300+0000","last_unstale":"2023-10-08T12:40:10.792262+0000","last_undegraded":"2023-10-08T12:40:10.792262+0000","last_fullsized":"2023-10-08T12:40:10.792262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.040227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789101+0000","last_change":"2023-10-08T12:39:14.207144+0000","last_active":"2023-10-08T12:40:10.789101+0000","last_peered":"2023-10-08T12:40:10.789101+0000","last_clean":"2023-10-08T12:40:10.789101+0000","last_became_active":"2023-10-08T12:39:14.206775+0000","last_became_peered":"2023-10-08T12:39:14.206775+0000","last_unstale":"2023-10-08T12:40:10.789101+0000","last_undegraded":"2023-10-08T12:40:10.789101+0000","last_fullsized":"2023-10-08T12:40:10.789101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:55.224270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794188+0000","last_change":"2023-10-08T12:39:14.204123+0000","last_active":"2023-10-08T12:40:10.794188+0000","last_peered":"2023-10-08T12:40:10.794188+0000","last_clean":"2023-10-08T12:40:10.794188+0000","last_became_active":"2023-10-08T12:39:14.203123+0000","last_became_peered":"2023-10-08T12:39:14.203123+0000","last_unstale":"2023-10-08T12:40:10.794188+0000","last_undegraded":"2023-10-08T12:40:10.794188+0000","last_fullsized":"2023-10-08T12:40:10.794188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:45.423095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792878+0000","last_change":"2023-10-08T12:39:14.211049+0000","last_active":"2023-10-08T12:40:10.792878+0000","last_peered":"2023-10-08T12:40:10.792878+0000","last_clean":"2023-10-08T12:40:10.792878+0000","last_became_active":"2023-10-08T12:39:14.210738+0000","last_became_peered":"2023-10-08T12:39:14.210738+0000","last_unstale":"2023-10-08T12:40:10.792878+0000","last_undegraded":"2023-10-08T12:40:10.792878+0000","last_fullsized":"2023-10-08T12:40:10.792878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:12.535857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786331+0000","last_change":"2023-10-08T12:39:14.220013+0000","last_active":"2023-10-08T12:40:10.786331+0000","last_peered":"2023-10-08T12:40:10.786331+0000","last_clean":"2023-10-08T12:40:10.786331+0000","last_became_active":"2023-10-08T12:39:14.219711+0000","last_became_peered":"2023-10-08T12:39:14.219711+0000","last_unstale":"2023-10-08T12:40:10.786331+0000","last_undegraded":"2023-10-08T12:40:10.786331+0000","last_fullsized":"2023-10-08T12:40:10.786331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:23.205074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791907+0000","last_change":"2023-10-08T12:39:14.214237+0000","last_active":"2023-10-08T12:40:10.791907+0000","last_peered":"2023-10-08T12:40:10.791907+0000","last_clean":"2023-10-08T12:40:10.791907+0000","last_became_active":"2023-10-08T12:39:14.213891+0000","last_became_peered":"2023-10-08T12:39:14.213891+0000","last_unstale":"2023-10-08T12:40:10.791907+0000","last_undegraded":"2023-10-08T12:40:10.791907+0000","last_fullsized":"2023-10-08T12:40:10.791907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:11.348411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.282101+0000","last_change":"2023-10-08T12:39:14.209037+0000","last_active":"2023-10-08T12:40:11.282101+0000","last_peered":"2023-10-08T12:40:11.282101+0000","last_clean":"2023-10-08T12:40:11.282101+0000","last_became_active":"2023-10-08T12:39:14.208728+0000","last_became_peered":"2023-10-08T12:39:14.208728+0000","last_unstale":"2023-10-08T12:40:11.282101+0000","last_undegraded":"2023-10-08T12:40:11.282101+0000","last_fullsized":"2023-10-08T12:40:11.282101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:23.440413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793173+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:10.793173+0000","last_peered":"2023-10-08T12:40:10.793173+0000","last_clean":"2023-10-08T12:40:10.793173+0000","last_became_active":"2023-10-08T12:39:14.222393+0000","last_became_peered":"2023-10-08T12:39:14.222393+0000","last_unstale":"2023-10-08T12:40:10.793173+0000","last_undegraded":"2023-10-08T12:40:10.793173+0000","last_fullsized":"2023-10-08T12:40:10.793173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:19.704140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789020+0000","last_change":"2023-10-08T12:39:14.200858+0000","last_active":"2023-10-08T12:40:10.789020+0000","last_peered":"2023-10-08T12:40:10.789020+0000","last_clean":"2023-10-08T12:40:10.789020+0000","last_became_active":"2023-10-08T12:39:14.199948+0000","last_became_peered":"2023-10-08T12:39:14.199948+0000","last_unstale":"2023-10-08T12:40:10.789020+0000","last_undegraded":"2023-10-08T12:40:10.789020+0000","last_fullsized":"2023-10-08T12:40:10.789020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:10.366380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281436,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59958,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":150,"num_read_kb":134,"num_write":68,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":179874,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416412,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":462175,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.76700000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.48899999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.66500000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.72499999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.73999999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.82999999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.622},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.69099999999999995}]}]},{"osd":10,"up_from":72,"seq":309237645343,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":1111689,"data_compressed":43212,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48499999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.46300000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.39600000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.376,"15min":0.376},"max":{"1min":0.76400000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81399999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.64300000000000002,"15min":0.65300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.60199999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72999999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.438}]},{"osd":5,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83599999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65900000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.86499999999999999,"15min":0.88700000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.583,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.75700000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:40:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.81000000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.78800000000000003}]}]},{"osd":9,"up_from":67,"seq":287762808867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":462880,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.497,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.71799999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.80700000000000005}]},{"osd":3,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":3.1269999999999998,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":1.0029999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58299999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.212,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.82699999999999996,"15min":0.83499999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.88600000000000001,"15min":0.90000000000000002},"min":{"1min":0.60899999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":1.325,"15min":1.325},"last":0.79900000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.93799999999999994,"15min":0.94699999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.0720000000000001,"5min":3.0720000000000001,"15min":3.0720000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.86599999999999999,"15min":0.874},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.78300000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.93100000000000005,"15min":0.94699999999999995},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2729999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.755},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.999,"15min":1.0029999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.98,"5min":2.98,"15min":2.98},"last":0.84599999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.016,"15min":1.0249999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.96199999999999997,"15min":0.97199999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.92400000000000004}]},{"osd":10,"last update":"Sun Oct 8 12:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.95899999999999996,"15min":0.95299999999999996},"min":{"1min":0.63500000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.90300000000000002,"15min":0.90400000000000003},"min":{"1min":0.60799999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.95299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":8,"up_from":59,"seq":253403070504,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":462448,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85599999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.72199999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84699999999999998,"5min":1.026,"15min":1.026},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90700000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70599999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.47599999999999998,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80300000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57899999999999996}]},{"osd":3,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86199999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.73999999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.995,"5min":1.044,"15min":1.044},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94199999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.879}]},{"osd":5,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.59999999999999998,"15min":0.58799999999999997},"min":{"1min":0.45000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.89000000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61299999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72599999999999998,"15min":0.71899999999999997},"min":{"1min":0.54800000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77200000000000002,"15min":0.76500000000000001},"min":{"1min":0.64600000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.89800000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.72999999999999998,"15min":0.70999999999999996},"min":{"1min":0.63100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59399999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.085,"5min":1.181,"15min":1.181},"last":0.92600000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.75900000000000001,"15min":0.753},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.75800000000000001,"15min":0.746},"min":{"1min":0.57399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.91200000000000003}]},{"osd":10,"last update":"Sun Oct 8 12:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.77400000000000002,"15min":0.76500000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.01},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.54300000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.95699999999999996}]},{"osd":11,"last update":"Sun Oct 8 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.83299999999999996}]}]},{"osd":7,"up_from":52,"seq":223338299437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":1053248,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.877,"15min":0.877},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.434},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.432}]},{"osd":2,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.745,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.626},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66700000000000004}]},{"osd":3,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.64800000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.50800000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82899999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77600000000000002}]},{"osd":6,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.68700000000000006}]},{"osd":8,"last update":"Sun Oct 8 12:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.70999999999999996,"15min":0.69199999999999995},"min":{"1min":0.56299999999999994,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.746},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.56000000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.73299999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.88400000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81399999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91700000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71599999999999997}]},{"osd":11,"last update":"Sun Oct 8 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.86499999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462961,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":462298,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64500000000000002,"15min":0.625},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79400000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.57999999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.56399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76100000000000001,"15min":0.77000000000000002},"min":{"1min":0.497,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81399999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.032,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.46300000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.73499999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82099999999999995,"5min":6.875,"15min":6.875},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0229999999999999,"5min":1.095,"15min":1.095},"last":0.69999999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.125,"15min":1.125},"last":0.628},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83299999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.753}]},{"osd":7,"last update":"Sun Oct 8 12:39:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81000000000000005,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.86099999999999999,"15min":0.83299999999999996},"min":{"1min":0.66900000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.66000000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.94799999999999995,"15min":0.97099999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84099999999999997,"15min":0.85099999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.67300000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.73799999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.98399999999999999,"15min":0.998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.452,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.71599999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542218,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":521004,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.67000000000000004,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73099999999999998,"5min":1.452,"15min":1.452},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.55300000000000005,"15min":0.52500000000000002},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.70099999999999996}]},{"osd":3,"last update":"Sun Oct 8 12:39:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74299999999999999,"5min":1.413,"15min":1.413},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.57199999999999995},"min":{"1min":0.41799999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":1.427,"15min":1.427},"last":0.61499999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.42999999999999999,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.42999999999999999,"15min":0.39800000000000002},"min":{"1min":0.316,"5min":0.245,"15min":0.245},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.44400000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.63500000000000001,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.621,"15min":0.58799999999999997},"min":{"1min":0.51900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.75800000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.123,"5min":1.355,"15min":1.355},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.99199999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.63600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.66700000000000004,"15min":0.63700000000000001},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.69899999999999995,"15min":0.64900000000000002},"min":{"1min":0.59099999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.85999999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:39:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73199999999999998,"15min":0.72199999999999998},"min":{"1min":0.50800000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.77500000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.76900000000000002,"15min":0.755},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.73499999999999999,"15min":0.72199999999999998},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.65100000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.84199999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705741,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":462265,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:39:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.56000000000000005},"min":{"1min":0.35199999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63500000000000001,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.046},"last":0.78500000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65600000000000003,"15min":0.58899999999999997},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0089999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64100000000000001,"15min":0.58899999999999997},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.079,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.71599999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.016}]},{"osd":4,"last update":"Sun Oct 8 12:39:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66100000000000003,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.619,"5min":1.911,"15min":1.911},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92100000000000004,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.745,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.89300000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.50600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.59299999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.81100000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.88200000000000001,"15min":0.89900000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.24,"15min":1.24},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.92900000000000005,"15min":0.94299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1259999999999999,"5min":1.298,"15min":1.298},"last":1.0820000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.038},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.94299999999999995,"15min":0.96599999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.119}]},{"osd":11,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.139},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.97999999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378693,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":521369,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.41999999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.82899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":1.194,"15min":1.194},"last":0.55200000000000005}]},{"osd":1,"last update":"Sun Oct 8 12:40:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56699999999999995,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81200000000000006,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.58599999999999997,"15min":0.52600000000000002},"min":{"1min":0.45200000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.64100000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:40:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61699999999999999,"15min":0.59599999999999997},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0129999999999999,"5min":1.073,"15min":1.073},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79300000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.499}]},{"osd":5,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.44400000000000001,"15min":0.41599999999999998},"min":{"1min":0.36699999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66700000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.434},"min":{"1min":0.371,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.74399999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.621,"15min":0.59899999999999998},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":1.04,"15min":1.04},"last":0.65900000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:40:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98799999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61399999999999999},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83799999999999997,"5min":1.006,"15min":1.006},"last":0.57999999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:39:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95099999999999996,"5min":1.024,"15min":1.024},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77900000000000003,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.85299999999999998,"5min":1.087,"15min":1.087},"last":0.70099999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.58899999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88100000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.60699999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.628}]},{"osd":11,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68799999999999994}]}]},{"osd":3,"up_from":26,"seq":111669149759,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":462071,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46800000000000003,"15min":0.42999999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.72899999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.504,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81899999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.45300000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.60899999999999999},"min":{"1min":0.53800000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":1.081,"15min":1.081},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.63200000000000001,"15min":0.59899999999999998},"min":{"1min":0.495,"5min":0.371,"15min":0.371},"max":{"1min":0.92600000000000005,"5min":1.05,"15min":1.05},"last":0.64500000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.42899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88700000000000001,"5min":1.077,"15min":1.077},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70599999999999996,"15min":0.68700000000000006},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.98099999999999998,"5min":1.23,"15min":1.23},"last":0.71699999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67900000000000005,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71899999999999997,"15min":0.66700000000000004},"min":{"1min":0.57299999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.042,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.75}]},{"osd":5,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89200000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.70699999999999996,"15min":0.69099999999999995},"min":{"1min":0.52700000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89400000000000002,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0669999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":1.0069999999999999,"5min":1.109,"15min":1.109},"last":0.57199999999999995}]},{"osd":7,"last update":"Sun Oct 8 12:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61799999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.069,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.53100000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0840000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.88100000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.89400000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.96499999999999997,"15min":0.998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1739999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.91900000000000004,"15min":0.93500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.121,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.77800000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.93500000000000005,"15min":0.94999999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0549999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.95399999999999996,"15min":0.97599999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.238,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84899999999999998}]},{"osd":11,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.80600000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888124,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":462197,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67100000000000004,"15min":0.71999999999999997},"min":{"1min":0.439,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":6.0549999999999997,"15min":6.0549999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39500000000000002,"15min":0.36099999999999999},"min":{"1min":0.33000000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.629,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.38400000000000001},"min":{"1min":0.32400000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.74099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.58699999999999997,"15min":0.56000000000000005},"min":{"1min":0.52300000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.752},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.54400000000000004,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59199999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57999999999999996,"15min":0.53200000000000003},"min":{"1min":0.45700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58299999999999996,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83099999999999996,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.69599999999999995}]},{"osd":5,"last update":"Sun Oct 8 12:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.626,"15min":0.55900000000000005},"min":{"1min":0.51700000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81899999999999995,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.62,"15min":0.57399999999999995},"min":{"1min":0.45100000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63100000000000001,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.876,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.56499999999999995},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.79700000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.55600000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.119,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.71399999999999997,"15min":0.70099999999999996},"min":{"1min":0.55300000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96299999999999997,"5min":1.242,"15min":1.242},"last":0.84499999999999997}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.91500000000000004,"5min":1.349,"15min":1.349},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.016,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.81399999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98199999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.004,"5min":1.171,"15min":1.171},"last":0.78400000000000003}]},{"osd":11,"last update":"Sun Oct 8 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.872},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.86199999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724598,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1052517,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.39600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.629}]},{"osd":1,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.498,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81999999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.47999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72599999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.40500000000000003},"min":{"1min":0.318,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.439},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.40699999999999997},"min":{"1min":0.29499999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.38300000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.59499999999999997,"15min":0.56100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70899999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.81000000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.60499999999999998,"15min":0.57499999999999996},"min":{"1min":0.54400000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83599999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.48999999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.84599999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:39:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64900000000000002,"15min":0.63100000000000001},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.76200000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.59999999999999998,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.59499999999999997,"15min":0.57299999999999995},"min":{"1min":0.46800000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.52200000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.81699999999999995,"15min":0.79300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.746},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.82299999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.59599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.97599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.79300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59160,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59194,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59354,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:40:29.987 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-08T12:40:29.987 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T12:40:29.987 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-08T12:40:29.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph health --format=json 2023-10-08T12:40:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:29 smithi092 ceph-mon[134093]: pgmap v293: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:29 smithi173 ceph-mon[135182]: pgmap v293: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:30.725 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:31.008 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:30 smithi059 ceph-mon[98489]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:31.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:30 smithi092 ceph-mon[134093]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:31.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:30 smithi173 ceph-mon[135182]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:40:31.930 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:31 smithi059 ceph-mon[98489]: pgmap v294: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:32.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:31 smithi092 ceph-mon[134093]: pgmap v294: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:32.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.181+0000 7f04b8569700 1 -- 172.21.15.59:0/4263762478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b010d1f0 msgr2=0x7f04b010f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:32.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.181+0000 7f04b8569700 1 --2- 172.21.15.59:0/4263762478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b010d1f0 0x7f04b010f5e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f04a800b0a0 tx=0x7f04a800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:32.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.181+0000 7f04b8569700 1 -- 172.21.15.59:0/4263762478 shutdown_connections 2023-10-08T12:40:32.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.181+0000 7f04b8569700 1 --2- 172.21.15.59:0/4263762478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b010d1f0 0x7f04b010f5e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:32.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.181+0000 7f04b8569700 1 --2- 172.21.15.59:0/4263762478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b0072a20 0x7f04b0072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:32.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.181+0000 7f04b8569700 1 --2- 172.21.15.59:0/4263762478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04b0073340 0x7f04b010ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:32.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.181+0000 7f04b8569700 1 -- 172.21.15.59:0/4263762478 >> 172.21.15.59:0/4263762478 conn(0x7f04b0077950 msgr2=0x7f04b0077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:32.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.181+0000 7f04b8569700 1 -- 172.21.15.59:0/4263762478 shutdown_connections 2023-10-08T12:40:32.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.181+0000 7f04b8569700 1 -- 172.21.15.59:0/4263762478 wait complete. 2023-10-08T12:40:32.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.182+0000 7f04b8569700 1 Processor -- start 2023-10-08T12:40:32.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.182+0000 7f04b8569700 1 -- start start 2023-10-08T12:40:32.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.183+0000 7f04b8569700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04b0072a20 0x7f04b0198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:32.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.183+0000 7f04b8569700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b0073340 0x7f04b01994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:32.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.183+0000 7f04b8569700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b010d1f0 0x7f04b019d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:32.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.183+0000 7f04b8569700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b019de20 con 0x7f04b0073340 2023-10-08T12:40:32.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.183+0000 7f04b8569700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b019df90 con 0x7f04b0072a20 2023-10-08T12:40:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.183+0000 7f04b8569700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b019e150 con 0x7f04b010d1f0 2023-10-08T12:40:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.183+0000 7f04b5b04700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b0073340 0x7f04b01994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.183+0000 7f04b5b04700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b0073340 0x7f04b01994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39568/0 (socket says 172.21.15.59:39568) 2023-10-08T12:40:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.183+0000 7f04b5b04700 1 -- 172.21.15.59:0/1375731141 learned_addr learned my addr 172.21.15.59:0/1375731141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.183+0000 7f04b6305700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04b0072a20 0x7f04b0198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:32.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.183+0000 7f04b6b06700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b010d1f0 0x7f04b019d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.184+0000 7f04b5b04700 1 -- 172.21.15.59:0/1375731141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b010d1f0 msgr2=0x7f04b019d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.184+0000 7f04b5b04700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b010d1f0 0x7f04b019d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.184+0000 7f04b5b04700 1 -- 172.21.15.59:0/1375731141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04b0072a20 msgr2=0x7f04b0198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.184+0000 7f04b5b04700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04b0072a20 0x7f04b0198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.184+0000 7f04b5b04700 1 -- 172.21.15.59:0/1375731141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a8009d00 con 0x7f04b0073340 2023-10-08T12:40:32.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.184+0000 7f04b5b04700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b0073340 0x7f04b01994b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f04a000e9a0 tx=0x7f04a000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:32.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.184+0000 7f04a77fe700 1 -- 172.21.15.59:0/1375731141 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0009790 con 0x7f04b0073340 2023-10-08T12:40:32.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.184+0000 7f04a77fe700 1 -- 172.21.15.59:0/1375731141 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04a0010430 con 0x7f04b0073340 2023-10-08T12:40:32.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.184+0000 7f04b8569700 1 -- 172.21.15.59:0/1375731141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b019e430 con 0x7f04b0073340 2023-10-08T12:40:32.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.184+0000 7f04a77fe700 1 -- 172.21.15.59:0/1375731141 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0018680 con 0x7f04b0073340 2023-10-08T12:40:32.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.184+0000 7f04b8569700 1 -- 172.21.15.59:0/1375731141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b01a5c90 con 0x7f04b0073340 2023-10-08T12:40:32.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.185+0000 7f04b8569700 1 -- 172.21.15.59:0/1375731141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b0108400 con 0x7f04b0073340 2023-10-08T12:40:32.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.187+0000 7f04a77fe700 1 -- 172.21.15.59:0/1375731141 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f04a00105a0 con 0x7f04b0073340 2023-10-08T12:40:32.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.188+0000 7f04a77fe700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f049c0a15e0 0x7f049c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:32.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.189+0000 7f04a77fe700 1 -- 172.21.15.59:0/1375731141 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f04a0014070 con 0x7f04b0073340 2023-10-08T12:40:32.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.189+0000 7f04b6305700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f049c0a15e0 0x7f049c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:32.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.189+0000 7f04b6305700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f049c0a15e0 0x7f049c0a3aa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009c60 tx=0x7f04ac009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:32.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.192+0000 7f04a77fe700 1 -- 172.21.15.59:0/1375731141 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f04a00964b0 con 0x7f04b0073340 2023-10-08T12:40:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:31 smithi173 ceph-mon[135182]: pgmap v294: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.448+0000 7f04b8569700 1 -- 172.21.15.59:0/1375731141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f04b019a230 con 0x7f04b0073340 2023-10-08T12:40:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.449+0000 7f04a77fe700 1 -- 172.21.15.59:0/1375731141 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f04a0099ad0 con 0x7f04b0073340 2023-10-08T12:40:32.450 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:32.450 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T12:40:32.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.451+0000 7f04b8569700 1 -- 172.21.15.59:0/1375731141 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f049c0a15e0 msgr2=0x7f049c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:32.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.451+0000 7f04b8569700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f049c0a15e0 0x7f049c0a3aa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009c60 tx=0x7f04ac009260 comp rx=0 tx=0).stop 2023-10-08T12:40:32.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.451+0000 7f04b8569700 1 -- 172.21.15.59:0/1375731141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b0073340 msgr2=0x7f04b01994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:32.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.451+0000 7f04b8569700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b0073340 0x7f04b01994b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f04a000e9a0 tx=0x7f04a000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:32.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.452+0000 7f04b8569700 1 -- 172.21.15.59:0/1375731141 shutdown_connections 2023-10-08T12:40:32.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.452+0000 7f04b8569700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f049c0a15e0 0x7f049c0a3aa0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:32.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.452+0000 7f04b8569700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04b0072a20 0x7f04b0198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:32.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.452+0000 7f04b8569700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b010d1f0 0x7f04b019d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:32.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.452+0000 7f04b8569700 1 --2- 172.21.15.59:0/1375731141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b0073340 0x7f04b01994b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:32.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.452+0000 7f04b8569700 1 -- 172.21.15.59:0/1375731141 >> 172.21.15.59:0/1375731141 conn(0x7f04b0077950 msgr2=0x7f04b00fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:32.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.452+0000 7f04b8569700 1 -- 172.21.15.59:0/1375731141 shutdown_connections 2023-10-08T12:40:32.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:32.452+0000 7f04b8569700 1 -- 172.21.15.59:0/1375731141 wait complete. 2023-10-08T12:40:32.907 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-08T12:40:32.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:40:33.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:32 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1375731141' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T12:40:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.117+0000 7fe308bff700 1 -- 172.21.15.59:0/645688641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe304100630 msgr2=0x7fe304100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.117+0000 7fe308bff700 1 --2- 172.21.15.59:0/645688641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe304100630 0x7fe304100ab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009990 tx=0x7fe2ec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.117+0000 7fe308bff700 1 -- 172.21.15.59:0/645688641 shutdown_connections 2023-10-08T12:40:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.117+0000 7fe308bff700 1 --2- 172.21.15.59:0/645688641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304100ff0 0x7fe30410d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.117+0000 7fe308bff700 1 --2- 172.21.15.59:0/645688641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe304106640 0x7fe304106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.117+0000 7fe308bff700 1 --2- 172.21.15.59:0/645688641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe304100630 0x7fe304100ab0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.117+0000 7fe308bff700 1 -- 172.21.15.59:0/645688641 >> 172.21.15.59:0/645688641 conn(0x7fe3040fc140 msgr2=0x7fe3040fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.117+0000 7fe308bff700 1 -- 172.21.15.59:0/645688641 shutdown_connections 2023-10-08T12:40:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.117+0000 7fe308bff700 1 -- 172.21.15.59:0/645688641 wait complete. 2023-10-08T12:40:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.119+0000 7fe308bff700 1 Processor -- start 2023-10-08T12:40:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.119+0000 7fe308bff700 1 -- start start 2023-10-08T12:40:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.119+0000 7fe308bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304100630 0x7fe30419ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.119+0000 7fe308bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe304100ff0 0x7fe30419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.119+0000 7fe308bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe304106640 0x7fe304198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.119+0000 7fe308bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3041992c0 con 0x7fe304100ff0 2023-10-08T12:40:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.119+0000 7fe308bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe304199430 con 0x7fe304100630 2023-10-08T12:40:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe308bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3041995f0 con 0x7fe304106640 2023-10-08T12:40:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe30259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304100630 0x7fe30419ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe30259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304100630 0x7fe30419ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33006/0 (socket says 172.21.15.59:33006) 2023-10-08T12:40:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe30259c700 1 -- 172.21.15.59:0/138351475 learned_addr learned my addr 172.21.15.59:0/138351475 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe302d9d700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe304106640 0x7fe304198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe2fbfff700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe304100ff0 0x7fe30419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe30259c700 1 -- 172.21.15.59:0/138351475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe304106640 msgr2=0x7fe304198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe30259c700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe304106640 0x7fe304198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe30259c700 1 -- 172.21.15.59:0/138351475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe304100ff0 msgr2=0x7fe30419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe30259c700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe304100ff0 0x7fe30419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe30259c700 1 -- 172.21.15.59:0/138351475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec0095f0 con 0x7fe304100630 2023-10-08T12:40:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.120+0000 7fe30259c700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304100630 0x7fe30419ea50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400e9a0 tx=0x7fe2f400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.121+0000 7fe2fb7fe700 1 -- 172.21.15.59:0/138351475 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4009790 con 0x7fe304100630 2023-10-08T12:40:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.121+0000 7fe2fb7fe700 1 -- 172.21.15.59:0/138351475 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2f4010430 con 0x7fe304100630 2023-10-08T12:40:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.121+0000 7fe308bff700 1 -- 172.21.15.59:0/138351475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3041998d0 con 0x7fe304100630 2023-10-08T12:40:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.121+0000 7fe2fb7fe700 1 -- 172.21.15.59:0/138351475 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4018680 con 0x7fe304100630 2023-10-08T12:40:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.121+0000 7fe308bff700 1 -- 172.21.15.59:0/138351475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3041a59d0 con 0x7fe304100630 2023-10-08T12:40:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.122+0000 7fe308bff700 1 -- 172.21.15.59:0/138351475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe304101d70 con 0x7fe304100630 2023-10-08T12:40:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.124+0000 7fe2fb7fe700 1 -- 172.21.15.59:0/138351475 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fe2f40105a0 con 0x7fe304100630 2023-10-08T12:40:33.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.125+0000 7fe2fb7fe700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2f00a1560 0x7fe2f00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:33.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.125+0000 7fe2fb7fe700 1 -- 172.21.15.59:0/138351475 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe2f4014070 con 0x7fe304100630 2023-10-08T12:40:33.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.125+0000 7fe2fbfff700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2f00a1560 0x7fe2f00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:33.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.126+0000 7fe2fbfff700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2f00a1560 0x7fe2f00a3a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe30419a260 tx=0x7fe2ec005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:33.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:32 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1375731141' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T12:40:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.127+0000 7fe2fb7fe700 1 -- 172.21.15.59:0/138351475 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe2f4096530 con 0x7fe304100630 2023-10-08T12:40:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:32 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1375731141' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T12:40:33.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.343+0000 7fe308bff700 1 -- 172.21.15.59:0/138351475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe304110570 con 0x7fe304100630 2023-10-08T12:40:33.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.345+0000 7fe2fb7fe700 1 -- 172.21.15.59:0/138351475 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22725 (secure 0 0 0) 0x7fe2f4099b50 con 0x7fe304100630 2023-10-08T12:40:33.345 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:33.345 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":86,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:40:11.783762+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:40:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 -- 172.21.15.59:0/138351475 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2f00a1560 msgr2=0x7fe2f00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2f00a1560 0x7fe2f00a3a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe30419a260 tx=0x7fe2ec005fd0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 -- 172.21.15.59:0/138351475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304100630 msgr2=0x7fe30419ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304100630 0x7fe30419ea50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400e9a0 tx=0x7fe2f400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 -- 172.21.15.59:0/138351475 shutdown_connections 2023-10-08T12:40:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2f00a1560 0x7fe2f00a3a20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304100630 0x7fe30419ea50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe304106640 0x7fe304198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 --2- 172.21.15.59:0/138351475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe304100ff0 0x7fe30419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 -- 172.21.15.59:0/138351475 >> 172.21.15.59:0/138351475 conn(0x7fe3040fc140 msgr2=0x7fe30410be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 -- 172.21.15.59:0/138351475 shutdown_connections 2023-10-08T12:40:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.347+0000 7fe308bff700 1 -- 172.21.15.59:0/138351475 wait complete. 2023-10-08T12:40:33.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:39:12.134451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:39:13.186137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:40:33.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:40:33.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.573+0000 7f48bdbff700 1 -- 172.21.15.59:0/3329739715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b80734e0 msgr2=0x7f48b810ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:33.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.573+0000 7f48bdbff700 1 --2- 172.21.15.59:0/3329739715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b80734e0 0x7f48b810ca90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009990 tx=0x7f48ac009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.573+0000 7f48bdbff700 1 -- 172.21.15.59:0/3329739715 shutdown_connections 2023-10-08T12:40:33.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.573+0000 7f48bdbff700 1 --2- 172.21.15.59:0/3329739715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b810cfd0 0x7f48b810f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.573+0000 7f48bdbff700 1 --2- 172.21.15.59:0/3329739715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48b8072bc0 0x7f48b8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.573+0000 7f48bdbff700 1 --2- 172.21.15.59:0/3329739715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b80734e0 0x7f48b810ca90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.573+0000 7f48bdbff700 1 -- 172.21.15.59:0/3329739715 >> 172.21.15.59:0/3329739715 conn(0x7f48b80fc200 msgr2=0x7f48b80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:33.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.573+0000 7f48bdbff700 1 -- 172.21.15.59:0/3329739715 shutdown_connections 2023-10-08T12:40:33.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.573+0000 7f48bdbff700 1 -- 172.21.15.59:0/3329739715 wait complete. 2023-10-08T12:40:33.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.574+0000 7f48bdbff700 1 Processor -- start 2023-10-08T12:40:33.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48bdbff700 1 -- start start 2023-10-08T12:40:33.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48bdbff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b8072bc0 0x7f48b8198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:33.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48bdbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48b80734e0 0x7f48b81993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:33.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48bdbff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b810cfd0 0x7f48b819d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48bdbff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b819ddd0 con 0x7f48b8072bc0 2023-10-08T12:40:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48bdbff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b819df40 con 0x7f48b810cfd0 2023-10-08T12:40:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48bdbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b819e100 con 0x7f48b80734e0 2023-10-08T12:40:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48b77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b8072bc0 0x7f48b8198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48b77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b8072bc0 0x7f48b8198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39596/0 (socket says 172.21.15.59:39596) 2023-10-08T12:40:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48b6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48b80734e0 0x7f48b81993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48b77fe700 1 -- 172.21.15.59:0/4056458871 learned_addr learned my addr 172.21.15.59:0/4056458871 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.575+0000 7f48b7fff700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b810cfd0 0x7f48b819d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:33.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48b6ffd700 1 -- 172.21.15.59:0/4056458871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b810cfd0 msgr2=0x7f48b819d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:33.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48b6ffd700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b810cfd0 0x7f48b819d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48b6ffd700 1 -- 172.21.15.59:0/4056458871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b8072bc0 msgr2=0x7f48b8198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:33.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48b6ffd700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b8072bc0 0x7f48b8198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48b6ffd700 1 -- 172.21.15.59:0/4056458871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac0095f0 con 0x7f48b80734e0 2023-10-08T12:40:33.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48b77fe700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b8072bc0 0x7f48b8198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:33.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48b7fff700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b810cfd0 0x7f48b819d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:33.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48b6ffd700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48b80734e0 0x7f48b81993f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48ac000c00 tx=0x7f48ac004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:33.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48b4ff9700 1 -- 172.21.15.59:0/4056458871 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac01d070 con 0x7f48b80734e0 2023-10-08T12:40:33.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48b4ff9700 1 -- 172.21.15.59:0/4056458871 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f48ac021410 con 0x7f48b80734e0 2023-10-08T12:40:33.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48bdbff700 1 -- 172.21.15.59:0/4056458871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b819e380 con 0x7f48b80734e0 2023-10-08T12:40:33.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48b4ff9700 1 -- 172.21.15.59:0/4056458871 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac017650 con 0x7f48b80734e0 2023-10-08T12:40:33.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.576+0000 7f48bdbff700 1 -- 172.21.15.59:0/4056458871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b81a5c20 con 0x7f48b80734e0 2023-10-08T12:40:33.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.577+0000 7f48bdbff700 1 -- 172.21.15.59:0/4056458871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b81081e0 con 0x7f48b80734e0 2023-10-08T12:40:33.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.580+0000 7f48b4ff9700 1 -- 172.21.15.59:0/4056458871 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f48ac021580 con 0x7f48b80734e0 2023-10-08T12:40:33.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.581+0000 7f48b4ff9700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48a00a1560 0x7f48a00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:33.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.581+0000 7f48b4ff9700 1 -- 172.21.15.59:0/4056458871 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f48ac0ce8d0 con 0x7f48b80734e0 2023-10-08T12:40:33.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.581+0000 7f48b77fe700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48a00a1560 0x7f48a00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:33.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.582+0000 7f48b77fe700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48a00a1560 0x7f48a00a3a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48a8011550 tx=0x7f48a8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:33.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.583+0000 7f48b4ff9700 1 -- 172.21.15.59:0/4056458871 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f48ac097d60 con 0x7f48b80734e0 2023-10-08T12:40:33.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.797+0000 7f48bdbff700 1 -- 172.21.15.59:0/4056458871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48b819a1b0 con 0x7f48b80734e0 2023-10-08T12:40:33.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.798+0000 7f48b4ff9700 1 -- 172.21.15.59:0/4056458871 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48ac09b380 con 0x7f48b80734e0 2023-10-08T12:40:33.798 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T12:40:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 -- 172.21.15.59:0/4056458871 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48a00a1560 msgr2=0x7f48a00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48a00a1560 0x7f48a00a3a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48a8011550 tx=0x7f48a8009260 comp rx=0 tx=0).stop 2023-10-08T12:40:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 -- 172.21.15.59:0/4056458871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48b80734e0 msgr2=0x7f48b81993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48b80734e0 0x7f48b81993f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48ac000c00 tx=0x7f48ac004730 comp rx=0 tx=0).stop 2023-10-08T12:40:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 -- 172.21.15.59:0/4056458871 shutdown_connections 2023-10-08T12:40:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f48a00a1560 0x7f48a00a3a20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b810cfd0 0x7f48b819d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b8072bc0 0x7f48b8198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 --2- 172.21.15.59:0/4056458871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48b80734e0 0x7f48b81993f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 -- 172.21.15.59:0/4056458871 >> 172.21.15.59:0/4056458871 conn(0x7f48b80fc200 msgr2=0x7f48b80fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 -- 172.21.15.59:0/4056458871 shutdown_connections 2023-10-08T12:40:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:33.801+0000 7f48bdbff700 1 -- 172.21.15.59:0/4056458871 wait complete. 2023-10-08T12:40:33.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:40:34.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:33 smithi059 ceph-mon[98489]: pgmap v295: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:34.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:33 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/138351475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:40:34.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.025+0000 7f16af7ff700 1 -- 172.21.15.59:0/71114168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a8106660 msgr2=0x7f16a8106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.025+0000 7f16af7ff700 1 --2- 172.21.15.59:0/71114168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a8106660 0x7f16a8106a40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009990 tx=0x7f16a4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.025+0000 7f16af7ff700 1 -- 172.21.15.59:0/71114168 shutdown_connections 2023-10-08T12:40:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.025+0000 7f16af7ff700 1 --2- 172.21.15.59:0/71114168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16a8101010 0x7f16a810d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.025+0000 7f16af7ff700 1 --2- 172.21.15.59:0/71114168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a8106660 0x7f16a8106a40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.025+0000 7f16af7ff700 1 --2- 172.21.15.59:0/71114168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a8100650 0x7f16a8100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.025+0000 7f16af7ff700 1 -- 172.21.15.59:0/71114168 >> 172.21.15.59:0/71114168 conn(0x7f16a80fc160 msgr2=0x7f16a80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.026+0000 7f16af7ff700 1 -- 172.21.15.59:0/71114168 shutdown_connections 2023-10-08T12:40:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.026+0000 7f16af7ff700 1 -- 172.21.15.59:0/71114168 wait complete. 2023-10-08T12:40:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.026+0000 7f16af7ff700 1 Processor -- start 2023-10-08T12:40:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16af7ff700 1 -- start start 2023-10-08T12:40:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16af7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a8100650 0x7f16a8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16af7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16a8101010 0x7f16a8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16af7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a8106660 0x7f16a8073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16af7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81a4e10 con 0x7f16a8100650 2023-10-08T12:40:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16af7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81a4f80 con 0x7f16a8101010 2023-10-08T12:40:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16af7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81a5140 con 0x7f16a8106660 2023-10-08T12:40:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16ad59b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a8100650 0x7f16a8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16ad59b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a8100650 0x7f16a8072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39612/0 (socket says 172.21.15.59:39612) 2023-10-08T12:40:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16ad59b700 1 -- 172.21.15.59:0/51161281 learned_addr learned my addr 172.21.15.59:0/51161281 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16add9c700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a8106660 0x7f16a8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.027+0000 7f16acd9a700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16a8101010 0x7f16a8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.028+0000 7f16ad59b700 1 -- 172.21.15.59:0/51161281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a8106660 msgr2=0x7f16a8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.028+0000 7f16ad59b700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a8106660 0x7f16a8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.028+0000 7f16ad59b700 1 -- 172.21.15.59:0/51161281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16a8101010 msgr2=0x7f16a8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.028+0000 7f16ad59b700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16a8101010 0x7f16a8073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.028+0000 7f16ad59b700 1 -- 172.21.15.59:0/51161281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a40095f0 con 0x7f16a8100650 2023-10-08T12:40:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.028+0000 7f16ad59b700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a8100650 0x7f16a8072af0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f16a4000c00 tx=0x7f16a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.028+0000 7f169e7fc700 1 -- 172.21.15.59:0/51161281 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a401d070 con 0x7f16a8100650 2023-10-08T12:40:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.028+0000 7f169e7fc700 1 -- 172.21.15.59:0/51161281 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16a4022470 con 0x7f16a8100650 2023-10-08T12:40:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.028+0000 7f16af7ff700 1 -- 172.21.15.59:0/51161281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a81a53c0 con 0x7f16a8100650 2023-10-08T12:40:34.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.028+0000 7f169e7fc700 1 -- 172.21.15.59:0/51161281 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4017650 con 0x7f16a8100650 2023-10-08T12:40:34.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.028+0000 7f16af7ff700 1 -- 172.21.15.59:0/51161281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a81a58f0 con 0x7f16a8100650 2023-10-08T12:40:34.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.029+0000 7f16af7ff700 1 -- 172.21.15.59:0/51161281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a8108c50 con 0x7f16a8100650 2023-10-08T12:40:34.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.032+0000 7f169e7fc700 1 -- 172.21.15.59:0/51161281 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f16a40225e0 con 0x7f16a8100650 2023-10-08T12:40:34.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.033+0000 7f169e7fc700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f16940a15d0 0x7f16940a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.033+0000 7f169e7fc700 1 -- 172.21.15.59:0/51161281 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f16a40ce620 con 0x7f16a8100650 2023-10-08T12:40:34.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.033+0000 7f16acd9a700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f16940a15d0 0x7f16940a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.034+0000 7f16acd9a700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f16940a15d0 0x7f16940a3a90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f16a8074220 tx=0x7f1698009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:34.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.035+0000 7f169e7fc700 1 -- 172.21.15.59:0/51161281 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f16a4097b30 con 0x7f16a8100650 2023-10-08T12:40:34.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:33 smithi092 ceph-mon[134093]: pgmap v295: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:34.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:33 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/138351475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:40:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:33 smithi173 ceph-mon[135182]: pgmap v295: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:33 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/138351475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:40:34.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.250+0000 7f16af7ff700 1 -- 172.21.15.59:0/51161281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16a8073fd0 con 0x7f16a8100650 2023-10-08T12:40:34.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.251+0000 7f169e7fc700 1 -- 172.21.15.59:0/51161281 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16a409b150 con 0x7f16a8100650 2023-10-08T12:40:34.251 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-08T12:40:34.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 -- 172.21.15.59:0/51161281 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f16940a15d0 msgr2=0x7f16940a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f16940a15d0 0x7f16940a3a90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f16a8074220 tx=0x7f1698009260 comp rx=0 tx=0).stop 2023-10-08T12:40:34.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 -- 172.21.15.59:0/51161281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a8100650 msgr2=0x7f16a8072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a8100650 0x7f16a8072af0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f16a4000c00 tx=0x7f16a4004730 comp rx=0 tx=0).stop 2023-10-08T12:40:34.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 -- 172.21.15.59:0/51161281 shutdown_connections 2023-10-08T12:40:34.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f16940a15d0 0x7f16940a3a90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a8106660 0x7f16a8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a8100650 0x7f16a8072af0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 --2- 172.21.15.59:0/51161281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16a8101010 0x7f16a8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 -- 172.21.15.59:0/51161281 >> 172.21.15.59:0/51161281 conn(0x7f16a80fc160 msgr2=0x7f16a80fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:34.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 -- 172.21.15.59:0/51161281 shutdown_connections 2023-10-08T12:40:34.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.253+0000 7f16af7ff700 1 -- 172.21.15.59:0/51161281 wait complete. 2023-10-08T12:40:34.272 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:40:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.478+0000 7f270fdff700 1 -- 172.21.15.59:0/326485636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708072c20 msgr2=0x7f2708073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.478+0000 7f270fdff700 1 --2- 172.21.15.59:0/326485636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708072c20 0x7f2708073000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2704009990 tx=0x7f2704009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.478+0000 7f270fdff700 1 -- 172.21.15.59:0/326485636 shutdown_connections 2023-10-08T12:40:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.478+0000 7f270fdff700 1 --2- 172.21.15.59:0/326485636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f270810cf70 0x7f270810f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.478+0000 7f270fdff700 1 --2- 172.21.15.59:0/326485636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708072c20 0x7f2708073000 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.478+0000 7f270fdff700 1 --2- 172.21.15.59:0/326485636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2708073540 0x7f270810ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.478+0000 7f270fdff700 1 -- 172.21.15.59:0/326485636 >> 172.21.15.59:0/326485636 conn(0x7f27080fc200 msgr2=0x7f27080fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.478+0000 7f270fdff700 1 -- 172.21.15.59:0/326485636 shutdown_connections 2023-10-08T12:40:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.478+0000 7f270fdff700 1 -- 172.21.15.59:0/326485636 wait complete. 2023-10-08T12:40:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.479+0000 7f270fdff700 1 Processor -- start 2023-10-08T12:40:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.479+0000 7f270fdff700 1 -- start start 2023-10-08T12:40:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270fdff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2708072c20 0x7f2708198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270fdff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708073540 0x7f2708199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270fdff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f270810cf70 0x7f270819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270fdff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270819dd50 con 0x7f2708073540 2023-10-08T12:40:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270fdff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270819dec0 con 0x7f2708072c20 2023-10-08T12:40:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270fdff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270819e080 con 0x7f270810cf70 2023-10-08T12:40:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270d39a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708073540 0x7f2708199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270d39a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708073540 0x7f2708199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39634/0 (socket says 172.21.15.59:39634) 2023-10-08T12:40:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270d39a700 1 -- 172.21.15.59:0/450841296 learned_addr learned my addr 172.21.15.59:0/450841296 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270db9b700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2708072c20 0x7f2708198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270e39c700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f270810cf70 0x7f270819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270d39a700 1 -- 172.21.15.59:0/450841296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f270810cf70 msgr2=0x7f270819d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270d39a700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f270810cf70 0x7f270819d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270d39a700 1 -- 172.21.15.59:0/450841296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2708072c20 msgr2=0x7f2708198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270d39a700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2708072c20 0x7f2708198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270d39a700 1 -- 172.21.15.59:0/450841296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27040095f0 con 0x7f2708073540 2023-10-08T12:40:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.480+0000 7f270e39c700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f270810cf70 0x7f270819d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.481+0000 7f270d39a700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708073540 0x7f2708199370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f26f800e9a0 tx=0x7f26f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.481+0000 7f26feffd700 1 -- 172.21.15.59:0/450841296 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8009790 con 0x7f2708073540 2023-10-08T12:40:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.481+0000 7f270fdff700 1 -- 172.21.15.59:0/450841296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270819e360 con 0x7f2708073540 2023-10-08T12:40:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.481+0000 7f26feffd700 1 -- 172.21.15.59:0/450841296 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26f800cbd0 con 0x7f2708073540 2023-10-08T12:40:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.481+0000 7f26feffd700 1 -- 172.21.15.59:0/450841296 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8018680 con 0x7f2708073540 2023-10-08T12:40:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.481+0000 7f270fdff700 1 -- 172.21.15.59:0/450841296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27081a5ba0 con 0x7f2708073540 2023-10-08T12:40:34.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.482+0000 7f270fdff700 1 -- 172.21.15.59:0/450841296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2708108180 con 0x7f2708073540 2023-10-08T12:40:34.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.486+0000 7f26feffd700 1 -- 172.21.15.59:0/450841296 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f26f800cd40 con 0x7f2708073540 2023-10-08T12:40:34.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.487+0000 7f26feffd700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26f40a1560 0x7f26f40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.487+0000 7f26feffd700 1 -- 172.21.15.59:0/450841296 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f26f8014070 con 0x7f2708073540 2023-10-08T12:40:34.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.487+0000 7f270db9b700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26f40a1560 0x7f26f40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.488+0000 7f270db9b700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26f40a1560 0x7f26f40a3a20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f270400b2e0 tx=0x7f2704005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:34.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.489+0000 7f26feffd700 1 -- 172.21.15.59:0/450841296 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f26f8096b00 con 0x7f2708073540 2023-10-08T12:40:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.702+0000 7f270fdff700 1 -- 172.21.15.59:0/450841296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f270819a130 con 0x7f2708073540 2023-10-08T12:40:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.702+0000 7f26feffd700 1 -- 172.21.15.59:0/450841296 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26f809a120 con 0x7f2708073540 2023-10-08T12:40:34.703 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-08T12:40:34.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 -- 172.21.15.59:0/450841296 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26f40a1560 msgr2=0x7f26f40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26f40a1560 0x7f26f40a3a20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f270400b2e0 tx=0x7f2704005fd0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 -- 172.21.15.59:0/450841296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708073540 msgr2=0x7f2708199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708073540 0x7f2708199370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f26f800e9a0 tx=0x7f26f800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 -- 172.21.15.59:0/450841296 shutdown_connections 2023-10-08T12:40:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26f40a1560 0x7f26f40a3a20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2708072c20 0x7f2708198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f270810cf70 0x7f270819d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 --2- 172.21.15.59:0/450841296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708073540 0x7f2708199370 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 -- 172.21.15.59:0/450841296 >> 172.21.15.59:0/450841296 conn(0x7f27080fc200 msgr2=0x7f27080fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 -- 172.21.15.59:0/450841296 shutdown_connections 2023-10-08T12:40:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.705+0000 7f270fdff700 1 -- 172.21.15.59:0/450841296 wait complete. 2023-10-08T12:40:34.724 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:40:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.928+0000 7fbe33fff700 1 -- 172.21.15.59:0/3514111761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe2c102110 msgr2=0x7fbe2c10a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.928+0000 7fbe33fff700 1 --2- 172.21.15.59:0/3514111761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe2c102110 0x7fbe2c10a5f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009990 tx=0x7fbe1c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.928+0000 7fbe33fff700 1 -- 172.21.15.59:0/3514111761 shutdown_connections 2023-10-08T12:40:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.928+0000 7fbe33fff700 1 --2- 172.21.15.59:0/3514111761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe2c1017f0 0x7fbe2c101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.928+0000 7fbe33fff700 1 --2- 172.21.15.59:0/3514111761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c10ac10 0x7fbe2c10d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.928+0000 7fbe33fff700 1 --2- 172.21.15.59:0/3514111761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe2c102110 0x7fbe2c10a5f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.928+0000 7fbe33fff700 1 -- 172.21.15.59:0/3514111761 >> 172.21.15.59:0/3514111761 conn(0x7fbe2c0fb030 msgr2=0x7fbe2c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.928+0000 7fbe33fff700 1 -- 172.21.15.59:0/3514111761 shutdown_connections 2023-10-08T12:40:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.928+0000 7fbe33fff700 1 -- 172.21.15.59:0/3514111761 wait complete. 2023-10-08T12:40:34.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.929+0000 7fbe33fff700 1 Processor -- start 2023-10-08T12:40:34.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.929+0000 7fbe33fff700 1 -- start start 2023-10-08T12:40:34.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe33fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe2c1017f0 0x7fbe2c19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe33fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe2c102110 0x7fbe2c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe33fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c10ac10 0x7fbe2c198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe33fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c199240 con 0x7fbe2c10ac10 2023-10-08T12:40:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe33fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c1993b0 con 0x7fbe2c102110 2023-10-08T12:40:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe33fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c199570 con 0x7fbe2c1017f0 2023-10-08T12:40:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe3259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c10ac10 0x7fbe2c198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe3259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c10ac10 0x7fbe2c198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39638/0 (socket says 172.21.15.59:39638) 2023-10-08T12:40:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe3259c700 1 -- 172.21.15.59:0/141048378 learned_addr learned my addr 172.21.15.59:0/141048378 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe31d9b700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe2c1017f0 0x7fbe2c19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe3159a700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe2c102110 0x7fbe2c19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe3259c700 1 -- 172.21.15.59:0/141048378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe2c1017f0 msgr2=0x7fbe2c19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe3259c700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe2c1017f0 0x7fbe2c19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe3259c700 1 -- 172.21.15.59:0/141048378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe2c102110 msgr2=0x7fbe2c19ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe3259c700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe2c102110 0x7fbe2c19ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.930+0000 7fbe3259c700 1 -- 172.21.15.59:0/141048378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c0095f0 con 0x7fbe2c10ac10 2023-10-08T12:40:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.931+0000 7fbe3259c700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c10ac10 0x7fbe2c198bd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400ef30 tx=0x7fbe2400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.931+0000 7fbe22ffd700 1 -- 172.21.15.59:0/141048378 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24018070 con 0x7fbe2c10ac10 2023-10-08T12:40:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.931+0000 7fbe33fff700 1 -- 172.21.15.59:0/141048378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c1997f0 con 0x7fbe2c10ac10 2023-10-08T12:40:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.931+0000 7fbe22ffd700 1 -- 172.21.15.59:0/141048378 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe2400f040 con 0x7fbe2c10ac10 2023-10-08T12:40:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.931+0000 7fbe22ffd700 1 -- 172.21.15.59:0/141048378 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400cd00 con 0x7fbe2c10ac10 2023-10-08T12:40:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.931+0000 7fbe33fff700 1 -- 172.21.15.59:0/141048378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c1a5a40 con 0x7fbe2c10ac10 2023-10-08T12:40:34.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.932+0000 7fbe33fff700 1 -- 172.21.15.59:0/141048378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c068110 con 0x7fbe2c10ac10 2023-10-08T12:40:34.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.934+0000 7fbe22ffd700 1 -- 172.21.15.59:0/141048378 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fbe24003a00 con 0x7fbe2c10ac10 2023-10-08T12:40:34.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.935+0000 7fbe22ffd700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe180a15e0 0x7fbe180a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:34.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.935+0000 7fbe22ffd700 1 -- 172.21.15.59:0/141048378 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbe240cd430 con 0x7fbe2c10ac10 2023-10-08T12:40:34.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.936+0000 7fbe31d9b700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe180a15e0 0x7fbe180a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:34.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.936+0000 7fbe31d9b700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe180a15e0 0x7fbe180a3aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009c60 tx=0x7fbe28009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:34.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:34.937+0000 7fbe22ffd700 1 -- 172.21.15.59:0/141048378 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbe240968c0 con 0x7fbe2c10ac10 2023-10-08T12:40:35.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:34 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4056458871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:40:35.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:34 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/51161281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:40:35.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:34 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/450841296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:40:35.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:34 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4056458871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:40:35.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:34 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/51161281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:40:35.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:34 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/450841296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:40:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.199+0000 7fbe33fff700 1 -- 172.21.15.59:0/141048378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe2c067450 con 0x7fbe2c10ac10 2023-10-08T12:40:35.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.200+0000 7fbe22ffd700 1 -- 172.21.15.59:0/141048378 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fbe24099ee0 con 0x7fbe2c10ac10 2023-10-08T12:40:35.201 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:35.201 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:40:35.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 -- 172.21.15.59:0/141048378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe180a15e0 msgr2=0x7fbe180a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:35.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe180a15e0 0x7fbe180a3aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009c60 tx=0x7fbe28009260 comp rx=0 tx=0).stop 2023-10-08T12:40:35.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 -- 172.21.15.59:0/141048378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c10ac10 msgr2=0x7fbe2c198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:35.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c10ac10 0x7fbe2c198bd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400ef30 tx=0x7fbe2400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 -- 172.21.15.59:0/141048378 shutdown_connections 2023-10-08T12:40:35.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe180a15e0 0x7fbe180a3aa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c10ac10 0x7fbe2c198bd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe2c1017f0 0x7fbe2c19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 --2- 172.21.15.59:0/141048378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe2c102110 0x7fbe2c19ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 -- 172.21.15.59:0/141048378 >> 172.21.15.59:0/141048378 conn(0x7fbe2c0fb030 msgr2=0x7fbe2c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:35.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 -- 172.21.15.59:0/141048378 shutdown_connections 2023-10-08T12:40:35.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.203+0000 7fbe33fff700 1 -- 172.21.15.59:0/141048378 wait complete. 2023-10-08T12:40:35.206 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:40:35.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:34 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4056458871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:40:35.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:34 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/51161281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:40:35.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:34 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/450841296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:40:35.222 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:40:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.425+0000 7f9c7dfff700 1 -- 172.21.15.59:0/89353671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c78106640 msgr2=0x7f9c78106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.425+0000 7f9c7dfff700 1 --2- 172.21.15.59:0/89353671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c78106640 0x7f9c78106a20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009990 tx=0x7f9c68009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.425+0000 7f9c7dfff700 1 -- 172.21.15.59:0/89353671 shutdown_connections 2023-10-08T12:40:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.425+0000 7f9c7dfff700 1 --2- 172.21.15.59:0/89353671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c78100ff0 0x7f9c7810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.425+0000 7f9c7dfff700 1 --2- 172.21.15.59:0/89353671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c78106640 0x7f9c78106a20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.425+0000 7f9c7dfff700 1 --2- 172.21.15.59:0/89353671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c78100630 0x7f9c78100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.425+0000 7f9c7dfff700 1 -- 172.21.15.59:0/89353671 >> 172.21.15.59:0/89353671 conn(0x7f9c780fc1a0 msgr2=0x7f9c780fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:35.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.426+0000 7f9c7dfff700 1 -- 172.21.15.59:0/89353671 shutdown_connections 2023-10-08T12:40:35.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.426+0000 7f9c7dfff700 1 -- 172.21.15.59:0/89353671 wait complete. 2023-10-08T12:40:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.426+0000 7f9c7dfff700 1 Processor -- start 2023-10-08T12:40:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c7dfff700 1 -- start start 2023-10-08T12:40:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c7dfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c78100630 0x7f9c7819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c7dfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c78100ff0 0x7f9c7819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c7dfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c78106640 0x7f9c781968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c7dfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78196f30 con 0x7f9c78100ff0 2023-10-08T12:40:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c7dfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c781970a0 con 0x7f9c78106640 2023-10-08T12:40:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c7dfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78197260 con 0x7f9c78100630 2023-10-08T12:40:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c76ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c78100ff0 0x7f9c7819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c76ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c78100ff0 0x7f9c7819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39656/0 (socket says 172.21.15.59:39656) 2023-10-08T12:40:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c76ffd700 1 -- 172.21.15.59:0/1164783992 learned_addr learned my addr 172.21.15.59:0/1164783992 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c77fff700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c78106640 0x7f9c781968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.427+0000 7f9c777fe700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c78100630 0x7f9c7819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c77fff700 1 -- 172.21.15.59:0/1164783992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c78100630 msgr2=0x7f9c7819c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c77fff700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c78100630 0x7f9c7819c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c77fff700 1 -- 172.21.15.59:0/1164783992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c78100ff0 msgr2=0x7f9c7819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c77fff700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c78100ff0 0x7f9c7819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c77fff700 1 -- 172.21.15.59:0/1164783992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c009520 con 0x7f9c78106640 2023-10-08T12:40:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c76ffd700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c78100ff0 0x7f9c7819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c77fff700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c78106640 0x7f9c781968d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000efc0 tx=0x7f9c7000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c74ff9700 1 -- 172.21.15.59:0/1164783992 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70018070 con 0x7f9c78106640 2023-10-08T12:40:35.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c74ff9700 1 -- 172.21.15.59:0/1164783992 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c7000f040 con 0x7f9c78106640 2023-10-08T12:40:35.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c7dfff700 1 -- 172.21.15.59:0/1164783992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c680095f0 con 0x7f9c78106640 2023-10-08T12:40:35.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c74ff9700 1 -- 172.21.15.59:0/1164783992 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000cd40 con 0x7f9c78106640 2023-10-08T12:40:35.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.428+0000 7f9c7dfff700 1 -- 172.21.15.59:0/1164783992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c781a35b0 con 0x7f9c78106640 2023-10-08T12:40:35.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.429+0000 7f9c7dfff700 1 -- 172.21.15.59:0/1164783992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c78108bc0 con 0x7f9c78106640 2023-10-08T12:40:35.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.432+0000 7f9c74ff9700 1 -- 172.21.15.59:0/1164783992 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f9c70003a00 con 0x7f9c78106640 2023-10-08T12:40:35.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.433+0000 7f9c74ff9700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9c600a15e0 0x7f9c600a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:35.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.433+0000 7f9c74ff9700 1 -- 172.21.15.59:0/1164783992 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9c700cd4a0 con 0x7f9c78106640 2023-10-08T12:40:35.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.433+0000 7f9c777fe700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9c600a15e0 0x7f9c600a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:35.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.434+0000 7f9c777fe700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9c600a15e0 0x7f9c600a3aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800b2e0 tx=0x7f9c68005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:35.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.435+0000 7f9c74ff9700 1 -- 172.21.15.59:0/1164783992 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9c70096930 con 0x7f9c78106640 2023-10-08T12:40:35.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.648+0000 7f9c7dfff700 1 -- 172.21.15.59:0/1164783992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c78101d70 con 0x7f9c78106640 2023-10-08T12:40:35.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.650+0000 7f9c74ff9700 1 -- 172.21.15.59:0/1164783992 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22725 (secure 0 0 0) 0x7f9c70099f50 con 0x7f9c78106640 2023-10-08T12:40:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:35.650 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":86,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:40:11.783762+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:40:35.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 -- 172.21.15.59:0/1164783992 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9c600a15e0 msgr2=0x7f9c600a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:35.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9c600a15e0 0x7f9c600a3aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800b2e0 tx=0x7f9c68005fd0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 -- 172.21.15.59:0/1164783992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c78106640 msgr2=0x7f9c781968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:35.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c78106640 0x7f9c781968d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000efc0 tx=0x7f9c7000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 -- 172.21.15.59:0/1164783992 shutdown_connections 2023-10-08T12:40:35.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9c600a15e0 0x7f9c600a3aa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c78106640 0x7f9c781968d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c78100630 0x7f9c7819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 --2- 172.21.15.59:0/1164783992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c78100ff0 0x7f9c7819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 -- 172.21.15.59:0/1164783992 >> 172.21.15.59:0/1164783992 conn(0x7f9c780fc1a0 msgr2=0x7f9c780fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:35.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 -- 172.21.15.59:0/1164783992 shutdown_connections 2023-10-08T12:40:35.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.652+0000 7f9c7dfff700 1 -- 172.21.15.59:0/1164783992 wait complete. 2023-10-08T12:40:35.672 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:39:12.134451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:39:13.186137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:40:35.673 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:40:35.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.879+0000 7f088e9ff700 1 -- 172.21.15.59:0/1879493250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08881010f0 msgr2=0x7f088810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.879+0000 7f088e9ff700 1 --2- 172.21.15.59:0/1879493250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08881010f0 0x7f088810d600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f088000b0a0 tx=0x7f088000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.879+0000 7f088e9ff700 1 -- 172.21.15.59:0/1879493250 shutdown_connections 2023-10-08T12:40:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.879+0000 7f088e9ff700 1 --2- 172.21.15.59:0/1879493250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08881010f0 0x7f088810d600 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.879+0000 7f088e9ff700 1 --2- 172.21.15.59:0/1879493250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0888106740 0x7f0888106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.879+0000 7f088e9ff700 1 --2- 172.21.15.59:0/1879493250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0888100730 0x7f0888100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.879+0000 7f088e9ff700 1 -- 172.21.15.59:0/1879493250 >> 172.21.15.59:0/1879493250 conn(0x7f08880fc200 msgr2=0x7f08880fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.879+0000 7f088e9ff700 1 -- 172.21.15.59:0/1879493250 shutdown_connections 2023-10-08T12:40:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.879+0000 7f088e9ff700 1 -- 172.21.15.59:0/1879493250 wait complete. 2023-10-08T12:40:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.880+0000 7f088e9ff700 1 Processor -- start 2023-10-08T12:40:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.880+0000 7f088e9ff700 1 -- start start 2023-10-08T12:40:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.881+0000 7f088e9ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0888100730 0x7f088819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.881+0000 7f088e9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08881010f0 0x7f088819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.881+0000 7f088e9ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0888106740 0x7f0888198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.881+0000 7f088e9ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0888199350 con 0x7f0888106740 2023-10-08T12:40:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.881+0000 7f088e9ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08881994c0 con 0x7f0888100730 2023-10-08T12:40:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.881+0000 7f088e9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0888199680 con 0x7f08881010f0 2023-10-08T12:40:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.881+0000 7f088cf9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0888106740 0x7f0888198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.881+0000 7f088cf9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0888106740 0x7f0888198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39670/0 (socket says 172.21.15.59:39670) 2023-10-08T12:40:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.881+0000 7f088cf9c700 1 -- 172.21.15.59:0/3141390994 learned_addr learned my addr 172.21.15.59:0/3141390994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.881+0000 7f0887fff700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0888100730 0x7f088819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.881+0000 7f08877fe700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08881010f0 0x7f088819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.882+0000 7f088cf9c700 1 -- 172.21.15.59:0/3141390994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08881010f0 msgr2=0x7f088819f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.882+0000 7f088cf9c700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08881010f0 0x7f088819f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.882+0000 7f088cf9c700 1 -- 172.21.15.59:0/3141390994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0888100730 msgr2=0x7f088819eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.882+0000 7f088cf9c700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0888100730 0x7f088819eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.882+0000 7f088cf9c700 1 -- 172.21.15.59:0/3141390994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0880009d00 con 0x7f0888106740 2023-10-08T12:40:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.882+0000 7f088cf9c700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0888106740 0x7f0888198b80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f088000b070 tx=0x7f08800077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.882+0000 7f08857fa700 1 -- 172.21.15.59:0/3141390994 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088000e040 con 0x7f0888106740 2023-10-08T12:40:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.882+0000 7f08857fa700 1 -- 172.21.15.59:0/3141390994 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08800094c0 con 0x7f0888106740 2023-10-08T12:40:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.882+0000 7f088e9ff700 1 -- 172.21.15.59:0/3141390994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0888199900 con 0x7f0888106740 2023-10-08T12:40:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.882+0000 7f08857fa700 1 -- 172.21.15.59:0/3141390994 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08800043a0 con 0x7f0888106740 2023-10-08T12:40:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.882+0000 7f088e9ff700 1 -- 172.21.15.59:0/3141390994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08881a5a60 con 0x7f0888106740 2023-10-08T12:40:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.883+0000 7f088e9ff700 1 -- 172.21.15.59:0/3141390994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0888101e70 con 0x7f0888106740 2023-10-08T12:40:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.885+0000 7f08857fa700 1 -- 172.21.15.59:0/3141390994 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f0880004500 con 0x7f0888106740 2023-10-08T12:40:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.887+0000 7f08857fa700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f08700a15e0 0x7f08700a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.887+0000 7f08857fa700 1 -- 172.21.15.59:0/3141390994 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f08800cdd60 con 0x7f0888106740 2023-10-08T12:40:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.887+0000 7f0887fff700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f08700a15e0 0x7f08700a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.888+0000 7f0887fff700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f08700a15e0 0x7f08700a3aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0878009be0 tx=0x7f0878009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:35.891+0000 7f08857fa700 1 -- 172.21.15.59:0/3141390994 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0880097250 con 0x7f0888106740 2023-10-08T12:40:36.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:35 smithi059 ceph-mon[98489]: pgmap v296: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:36.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:35 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/141048378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:36.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:35 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1164783992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:40:36.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.100+0000 7f088e9ff700 1 -- 172.21.15.59:0/3141390994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0888067530 con 0x7f0888106740 2023-10-08T12:40:36.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.100+0000 7f08857fa700 1 -- 172.21.15.59:0/3141390994 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f088009a870 con 0x7f0888106740 2023-10-08T12:40:36.100 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T12:40:36.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 -- 172.21.15.59:0/3141390994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f08700a15e0 msgr2=0x7f08700a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:36.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f08700a15e0 0x7f08700a3aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0878009be0 tx=0x7f0878009260 comp rx=0 tx=0).stop 2023-10-08T12:40:36.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 -- 172.21.15.59:0/3141390994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0888106740 msgr2=0x7f0888198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:36.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0888106740 0x7f0888198b80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f088000b070 tx=0x7f08800077f0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 -- 172.21.15.59:0/3141390994 shutdown_connections 2023-10-08T12:40:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f08700a15e0 0x7f08700a3aa0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0888100730 0x7f088819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0888106740 0x7f0888198b80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 --2- 172.21.15.59:0/3141390994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08881010f0 0x7f088819f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 -- 172.21.15.59:0/3141390994 >> 172.21.15.59:0/3141390994 conn(0x7f08880fc200 msgr2=0x7f08880fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 -- 172.21.15.59:0/3141390994 shutdown_connections 2023-10-08T12:40:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.103+0000 7f088e9ff700 1 -- 172.21.15.59:0/3141390994 wait complete. 2023-10-08T12:40:36.122 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:40:36.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:35 smithi092 ceph-mon[134093]: pgmap v296: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:36.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:35 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/141048378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:36.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:35 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1164783992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:40:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:35 smithi173 ceph-mon[135182]: pgmap v296: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:35 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/141048378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:35 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1164783992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:40:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.330+0000 7f75c19ff700 1 -- 172.21.15.59:0/1047026217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75bc106740 msgr2=0x7f75bc106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.330+0000 7f75c19ff700 1 --2- 172.21.15.59:0/1047026217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75bc106740 0x7f75bc106b20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0098f0 tx=0x7f75ac009c00 comp rx=0 tx=0).stop 2023-10-08T12:40:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.330+0000 7f75c19ff700 1 -- 172.21.15.59:0/1047026217 shutdown_connections 2023-10-08T12:40:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.330+0000 7f75c19ff700 1 --2- 172.21.15.59:0/1047026217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75bc1010f0 0x7f75bc10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.330+0000 7f75c19ff700 1 --2- 172.21.15.59:0/1047026217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75bc106740 0x7f75bc106b20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.330+0000 7f75c19ff700 1 --2- 172.21.15.59:0/1047026217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75bc100730 0x7f75bc100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.330+0000 7f75c19ff700 1 -- 172.21.15.59:0/1047026217 >> 172.21.15.59:0/1047026217 conn(0x7f75bc0fc200 msgr2=0x7f75bc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.330+0000 7f75c19ff700 1 -- 172.21.15.59:0/1047026217 shutdown_connections 2023-10-08T12:40:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.330+0000 7f75c19ff700 1 -- 172.21.15.59:0/1047026217 wait complete. 2023-10-08T12:40:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.331+0000 7f75c19ff700 1 Processor -- start 2023-10-08T12:40:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.331+0000 7f75c19ff700 1 -- start start 2023-10-08T12:40:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75c19ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75bc100730 0x7f75bc19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75c19ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75bc1010f0 0x7f75bc19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75c19ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75bc106740 0x7f75bc196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75c19ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc197080 con 0x7f75bc106740 2023-10-08T12:40:36.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75c19ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1971f0 con 0x7f75bc100730 2023-10-08T12:40:36.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75c19ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1973b0 con 0x7f75bc1010f0 2023-10-08T12:40:36.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75bb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75bc106740 0x7f75bc196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:36.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75baffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75bc100730 0x7f75bc19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:36.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75bb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75bc106740 0x7f75bc196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39674/0 (socket says 172.21.15.59:39674) 2023-10-08T12:40:36.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75baffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75bc100730 0x7f75bc19c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33132/0 (socket says 172.21.15.59:33132) 2023-10-08T12:40:36.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75bb7fe700 1 -- 172.21.15.59:0/3287588522 learned_addr learned my addr 172.21.15.59:0/3287588522 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:36.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75ba7fc700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75bc1010f0 0x7f75bc19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:36.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75baffd700 1 -- 172.21.15.59:0/3287588522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75bc1010f0 msgr2=0x7f75bc19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:36.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75baffd700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75bc1010f0 0x7f75bc19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75baffd700 1 -- 172.21.15.59:0/3287588522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75bc106740 msgr2=0x7f75bc196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:36.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75baffd700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75bc106740 0x7f75bc196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75baffd700 1 -- 172.21.15.59:0/3287588522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b00095f0 con 0x7f75bc100730 2023-10-08T12:40:36.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.332+0000 7f75bb7fe700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75bc106740 0x7f75bc196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:36.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.333+0000 7f75baffd700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75bc100730 0x7f75bc19c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009fd0 tx=0x7f75ac00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:36.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.333+0000 7f75c09fd700 1 -- 172.21.15.59:0/3287588522 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac01c070 con 0x7f75bc100730 2023-10-08T12:40:36.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.333+0000 7f75c19ff700 1 -- 172.21.15.59:0/3287588522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac009520 con 0x7f75bc100730 2023-10-08T12:40:36.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.333+0000 7f75c09fd700 1 -- 172.21.15.59:0/3287588522 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75ac00bb20 con 0x7f75bc100730 2023-10-08T12:40:36.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.333+0000 7f75c09fd700 1 -- 172.21.15.59:0/3287588522 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0038e0 con 0x7f75bc100730 2023-10-08T12:40:36.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.333+0000 7f75c19ff700 1 -- 172.21.15.59:0/3287588522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc1a3700 con 0x7f75bc100730 2023-10-08T12:40:36.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.334+0000 7f75c19ff700 1 -- 172.21.15.59:0/3287588522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc108cc0 con 0x7f75bc100730 2023-10-08T12:40:36.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.336+0000 7f75c09fd700 1 -- 172.21.15.59:0/3287588522 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f75ac020030 con 0x7f75bc100730 2023-10-08T12:40:36.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.337+0000 7f75c09fd700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75a40a1560 0x7f75a40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:36.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.338+0000 7f75c09fd700 1 -- 172.21.15.59:0/3287588522 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f75ac0cdfe0 con 0x7f75bc100730 2023-10-08T12:40:36.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.338+0000 7f75ba7fc700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75a40a1560 0x7f75a40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:36.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.338+0000 7f75ba7fc700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75a40a1560 0x7f75a40a3a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f75bc197be0 tx=0x7f75b0009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:36.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.340+0000 7f75c09fd700 1 -- 172.21.15.59:0/3287588522 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f75ac097470 con 0x7f75bc100730 2023-10-08T12:40:36.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.548+0000 7f75c19ff700 1 -- 172.21.15.59:0/3287588522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75bc197ee0 con 0x7f75bc100730 2023-10-08T12:40:36.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.549+0000 7f75c09fd700 1 -- 172.21.15.59:0/3287588522 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f75ac0223d0 con 0x7f75bc100730 2023-10-08T12:40:36.549 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-08T12:40:36.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.551+0000 7f75c19ff700 1 -- 172.21.15.59:0/3287588522 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75a40a1560 msgr2=0x7f75a40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:36.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.551+0000 7f75c19ff700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75a40a1560 0x7f75a40a3a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f75bc197be0 tx=0x7f75b0009310 comp rx=0 tx=0).stop 2023-10-08T12:40:36.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.551+0000 7f75c19ff700 1 -- 172.21.15.59:0/3287588522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75bc100730 msgr2=0x7f75bc19c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:36.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.551+0000 7f75c19ff700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75bc100730 0x7f75bc19c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009fd0 tx=0x7f75ac00fa00 comp rx=0 tx=0).stop 2023-10-08T12:40:36.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.552+0000 7f75c19ff700 1 -- 172.21.15.59:0/3287588522 shutdown_connections 2023-10-08T12:40:36.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.552+0000 7f75c19ff700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75a40a1560 0x7f75a40a3a20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.552+0000 7f75c19ff700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75bc100730 0x7f75bc19c8f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.552+0000 7f75c19ff700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75bc106740 0x7f75bc196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.552+0000 7f75c19ff700 1 --2- 172.21.15.59:0/3287588522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75bc1010f0 0x7f75bc19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.552+0000 7f75c19ff700 1 -- 172.21.15.59:0/3287588522 >> 172.21.15.59:0/3287588522 conn(0x7f75bc0fc200 msgr2=0x7f75bc0fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:36.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.552+0000 7f75c19ff700 1 -- 172.21.15.59:0/3287588522 shutdown_connections 2023-10-08T12:40:36.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.552+0000 7f75c19ff700 1 -- 172.21.15.59:0/3287588522 wait complete. 2023-10-08T12:40:36.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:40:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.778+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/3890066385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb4410cf70 msgr2=0x7ffb4410f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.778+0000 7ffb4a5ff700 1 --2- 172.21.15.59:0/3890066385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb4410cf70 0x7ffb4410f3e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00b0a0 tx=0x7ffb3c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.778+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/3890066385 shutdown_connections 2023-10-08T12:40:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.778+0000 7ffb4a5ff700 1 --2- 172.21.15.59:0/3890066385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb4410cf70 0x7ffb4410f3e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.778+0000 7ffb4a5ff700 1 --2- 172.21.15.59:0/3890066385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb44072c20 0x7ffb44073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.778+0000 7ffb4a5ff700 1 --2- 172.21.15.59:0/3890066385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb44073540 0x7ffb4410ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.778+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/3890066385 >> 172.21.15.59:0/3890066385 conn(0x7ffb440fc200 msgr2=0x7ffb440fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.779+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/3890066385 shutdown_connections 2023-10-08T12:40:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.779+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/3890066385 wait complete. 2023-10-08T12:40:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb4a5ff700 1 Processor -- start 2023-10-08T12:40:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb4a5ff700 1 -- start start 2023-10-08T12:40:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb4a5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb44072c20 0x7ffb44198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb4a5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb44073540 0x7ffb441994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb4a5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb4410cf70 0x7ffb4419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb4a5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4419de30 con 0x7ffb44073540 2023-10-08T12:40:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb4a5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4419dfa0 con 0x7ffb44072c20 2023-10-08T12:40:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb4a5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4419e160 con 0x7ffb4410cf70 2023-10-08T12:40:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb437fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb44073540 0x7ffb441994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb437fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb44073540 0x7ffb441994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39690/0 (socket says 172.21.15.59:39690) 2023-10-08T12:40:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb437fe700 1 -- 172.21.15.59:0/1477666677 learned_addr learned my addr 172.21.15.59:0/1477666677 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.780+0000 7ffb48b9c700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb4410cf70 0x7ffb4419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb43fff700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb44072c20 0x7ffb44198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb437fe700 1 -- 172.21.15.59:0/1477666677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb4410cf70 msgr2=0x7ffb4419d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb437fe700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb4410cf70 0x7ffb4419d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb437fe700 1 -- 172.21.15.59:0/1477666677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb44072c20 msgr2=0x7ffb44198f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb437fe700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb44072c20 0x7ffb44198f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb437fe700 1 -- 172.21.15.59:0/1477666677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c009d00 con 0x7ffb44073540 2023-10-08T12:40:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb437fe700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb44073540 0x7ffb441994a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800e9a0 tx=0x7ffb3800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb417fa700 1 -- 172.21.15.59:0/1477666677 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38009790 con 0x7ffb44073540 2023-10-08T12:40:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb417fa700 1 -- 172.21.15.59:0/1477666677 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb38010430 con 0x7ffb44073540 2023-10-08T12:40:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb417fa700 1 -- 172.21.15.59:0/1477666677 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38018680 con 0x7ffb44073540 2023-10-08T12:40:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/1477666677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4419e440 con 0x7ffb44073540 2023-10-08T12:40:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.781+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/1477666677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb441a5c80 con 0x7ffb44073540 2023-10-08T12:40:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.782+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/1477666677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb44108180 con 0x7ffb44073540 2023-10-08T12:40:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.784+0000 7ffb417fa700 1 -- 172.21.15.59:0/1477666677 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7ffb380105a0 con 0x7ffb44073540 2023-10-08T12:40:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.786+0000 7ffb417fa700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffb2c0a1560 0x7ffb2c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.786+0000 7ffb417fa700 1 -- 172.21.15.59:0/1477666677 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ffb38014070 con 0x7ffb44073540 2023-10-08T12:40:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.786+0000 7ffb43fff700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffb2c0a1560 0x7ffb2c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.786+0000 7ffb43fff700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffb2c0a1560 0x7ffb2c0a3a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009c60 tx=0x7ffb34009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:36.789+0000 7ffb417fa700 1 -- 172.21.15.59:0/1477666677 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffb38052100 con 0x7ffb44073540 2023-10-08T12:40:37.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.002+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/1477666677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb4419a210 con 0x7ffb44073540 2023-10-08T12:40:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.002+0000 7ffb417fa700 1 -- 172.21.15.59:0/1477666677 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb38096540 con 0x7ffb44073540 2023-10-08T12:40:37.002 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-08T12:40:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/1477666677 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffb2c0a1560 msgr2=0x7ffb2c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffb2c0a1560 0x7ffb2c0a3a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009c60 tx=0x7ffb34009260 comp rx=0 tx=0).stop 2023-10-08T12:40:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/1477666677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb44073540 msgr2=0x7ffb441994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb44073540 0x7ffb441994a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800e9a0 tx=0x7ffb3800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/1477666677 shutdown_connections 2023-10-08T12:40:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffb2c0a1560 0x7ffb2c0a3a20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb44072c20 0x7ffb44198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb4410cf70 0x7ffb4419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 --2- 172.21.15.59:0/1477666677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb44073540 0x7ffb441994a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/1477666677 >> 172.21.15.59:0/1477666677 conn(0x7ffb440fc200 msgr2=0x7ffb440fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/1477666677 shutdown_connections 2023-10-08T12:40:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.005+0000 7ffb4a5ff700 1 -- 172.21.15.59:0/1477666677 wait complete. 2023-10-08T12:40:37.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:36 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3141390994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:40:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:36 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3287588522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:40:37.024 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:40:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:36 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3141390994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:40:37.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:36 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3287588522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:40:37.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:36 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3141390994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:40:37.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:36 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3287588522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:40:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.228+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/4162445469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d58106640 msgr2=0x7f7d58106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.228+0000 7f7d5c9ff700 1 --2- 172.21.15.59:0/4162445469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d58106640 0x7f7d58106a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009990 tx=0x7f7d48009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.228+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/4162445469 shutdown_connections 2023-10-08T12:40:37.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.228+0000 7f7d5c9ff700 1 --2- 172.21.15.59:0/4162445469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d58100ff0 0x7f7d5810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.228+0000 7f7d5c9ff700 1 --2- 172.21.15.59:0/4162445469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d58106640 0x7f7d58106a20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.228+0000 7f7d5c9ff700 1 --2- 172.21.15.59:0/4162445469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d58100630 0x7f7d58100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.228+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/4162445469 >> 172.21.15.59:0/4162445469 conn(0x7f7d580fc140 msgr2=0x7f7d580fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:37.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.228+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/4162445469 shutdown_connections 2023-10-08T12:40:37.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.228+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/4162445469 wait complete. 2023-10-08T12:40:37.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.229+0000 7f7d5c9ff700 1 Processor -- start 2023-10-08T12:40:37.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.229+0000 7f7d5c9ff700 1 -- start start 2023-10-08T12:40:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.229+0000 7f7d5c9ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d58100630 0x7f7d58072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5c9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d58100ff0 0x7f7d58073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5c9ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d58106640 0x7f7d58073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5c9ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d581a4e80 con 0x7f7d58100630 2023-10-08T12:40:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5c9ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d581a4ff0 con 0x7f7d58106640 2023-10-08T12:40:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5c9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d581a51b0 con 0x7f7d58100ff0 2023-10-08T12:40:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d58100630 0x7f7d58072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d58100630 0x7f7d58072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39714/0 (socket says 172.21.15.59:39714) 2023-10-08T12:40:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5659c700 1 -- 172.21.15.59:0/931500968 learned_addr learned my addr 172.21.15.59:0/931500968 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d56d9d700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d58106640 0x7f7d58073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d4ffff700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d58100ff0 0x7f7d58073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5659c700 1 -- 172.21.15.59:0/931500968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d58100ff0 msgr2=0x7f7d58073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5659c700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d58100ff0 0x7f7d58073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5659c700 1 -- 172.21.15.59:0/931500968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d58106640 msgr2=0x7f7d58073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5659c700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d58106640 0x7f7d58073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5659c700 1 -- 172.21.15.59:0/931500968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d480095f0 con 0x7f7d58100630 2023-10-08T12:40:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d4ffff700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d58100ff0 0x7f7d58073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d56d9d700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d58106640 0x7f7d58073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.230+0000 7f7d5659c700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d58100630 0x7f7d58072af0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7d48005770 tx=0x7f7d480057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.231+0000 7f7d4f7fe700 1 -- 172.21.15.59:0/931500968 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4801d070 con 0x7f7d58100630 2023-10-08T12:40:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.231+0000 7f7d4f7fe700 1 -- 172.21.15.59:0/931500968 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d48021410 con 0x7f7d58100630 2023-10-08T12:40:37.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.231+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/931500968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d581a5490 con 0x7f7d58100630 2023-10-08T12:40:37.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.231+0000 7f7d4f7fe700 1 -- 172.21.15.59:0/931500968 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48017650 con 0x7f7d58100630 2023-10-08T12:40:37.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.231+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/931500968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d581a59f0 con 0x7f7d58100630 2023-10-08T12:40:37.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.232+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/931500968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d58108c30 con 0x7f7d58100630 2023-10-08T12:40:37.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.234+0000 7f7d4f7fe700 1 -- 172.21.15.59:0/931500968 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f7d480217f0 con 0x7f7d58100630 2023-10-08T12:40:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.236+0000 7f7d4f7fe700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d440a15e0 0x7f7d440a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.236+0000 7f7d4f7fe700 1 -- 172.21.15.59:0/931500968 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7d480ce230 con 0x7f7d58100630 2023-10-08T12:40:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.236+0000 7f7d4ffff700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d440a15e0 0x7f7d440a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:37.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.237+0000 7f7d4ffff700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d440a15e0 0x7f7d440a3aa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7d58074220 tx=0x7f7d4000b5f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:37.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.240+0000 7f7d4f7fe700 1 -- 172.21.15.59:0/931500968 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7d48097720 con 0x7f7d58100630 2023-10-08T12:40:37.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.501+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/931500968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d58073fd0 con 0x7f7d58100630 2023-10-08T12:40:37.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.501+0000 7f7d4f7fe700 1 -- 172.21.15.59:0/931500968 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f7d4809ad40 con 0x7f7d58100630 2023-10-08T12:40:37.501 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:37.502 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:40:37.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/931500968 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d440a15e0 msgr2=0x7f7d440a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d440a15e0 0x7f7d440a3aa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7d58074220 tx=0x7f7d4000b5f0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/931500968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d58100630 msgr2=0x7f7d58072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d58100630 0x7f7d58072af0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7d48005770 tx=0x7f7d480057a0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/931500968 shutdown_connections 2023-10-08T12:40:37.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d440a15e0 0x7f7d440a3aa0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d58106640 0x7f7d58073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d58100630 0x7f7d58072af0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 --2- 172.21.15.59:0/931500968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d58100ff0 0x7f7d58073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/931500968 >> 172.21.15.59:0/931500968 conn(0x7f7d580fc140 msgr2=0x7f7d580fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:37.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/931500968 shutdown_connections 2023-10-08T12:40:37.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.504+0000 7f7d5c9ff700 1 -- 172.21.15.59:0/931500968 wait complete. 2023-10-08T12:40:37.506 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:40:37.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:40:37.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.730+0000 7f4c63bff700 1 -- 172.21.15.59:0/1456611020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c5c100630 msgr2=0x7f4c5c100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.730+0000 7f4c63bff700 1 --2- 172.21.15.59:0/1456611020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c5c100630 0x7f4c5c100ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009990 tx=0x7f4c4c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.730+0000 7f4c63bff700 1 -- 172.21.15.59:0/1456611020 shutdown_connections 2023-10-08T12:40:37.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.730+0000 7f4c63bff700 1 --2- 172.21.15.59:0/1456611020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c100ff0 0x7f4c5c10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.730+0000 7f4c63bff700 1 --2- 172.21.15.59:0/1456611020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c106640 0x7f4c5c106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.730+0000 7f4c63bff700 1 --2- 172.21.15.59:0/1456611020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c5c100630 0x7f4c5c100ab0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.730+0000 7f4c63bff700 1 -- 172.21.15.59:0/1456611020 >> 172.21.15.59:0/1456611020 conn(0x7f4c5c0fc140 msgr2=0x7f4c5c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:37.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.730+0000 7f4c63bff700 1 -- 172.21.15.59:0/1456611020 shutdown_connections 2023-10-08T12:40:37.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.730+0000 7f4c63bff700 1 -- 172.21.15.59:0/1456611020 wait complete. 2023-10-08T12:40:37.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.731+0000 7f4c63bff700 1 Processor -- start 2023-10-08T12:40:37.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.731+0000 7f4c63bff700 1 -- start start 2023-10-08T12:40:37.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c63bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c100630 0x7f4c5c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:37.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c63bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c5c100ff0 0x7f4c5c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:37.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c63bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c106640 0x7f4c5c19c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:37.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c63bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c19cb50 con 0x7f4c5c106640 2023-10-08T12:40:37.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c63bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c19ccc0 con 0x7f4c5c100ff0 2023-10-08T12:40:37.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c63bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c19ce80 con 0x7f4c5c100630 2023-10-08T12:40:37.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c6119a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c5c100ff0 0x7f4c5c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:37.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c6219c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c106640 0x7f4c5c19c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:37.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c6199b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c100630 0x7f4c5c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:37.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c6119a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c5c100ff0 0x7f4c5c199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33188/0 (socket says 172.21.15.59:33188) 2023-10-08T12:40:37.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c6199b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c100630 0x7f4c5c198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:53588/0 (socket says 172.21.15.59:53588) 2023-10-08T12:40:37.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c6119a700 1 -- 172.21.15.59:0/3760386780 learned_addr learned my addr 172.21.15.59:0/3760386780 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:37.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c6119a700 1 -- 172.21.15.59:0/3760386780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c100630 msgr2=0x7f4c5c198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c6119a700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c100630 0x7f4c5c198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c6119a700 1 -- 172.21.15.59:0/3760386780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c106640 msgr2=0x7f4c5c19c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c6119a700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c106640 0x7f4c5c19c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.732+0000 7f4c6119a700 1 -- 172.21.15.59:0/3760386780 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c0095f0 con 0x7f4c5c100ff0 2023-10-08T12:40:37.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.733+0000 7f4c6219c700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c106640 0x7f4c5c19c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:37.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.733+0000 7f4c6119a700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c5c100ff0 0x7f4c5c199260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c000c00 tx=0x7f4c4c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:37.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.733+0000 7f4c52ffd700 1 -- 172.21.15.59:0/3760386780 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c01d070 con 0x7f4c5c100ff0 2023-10-08T12:40:37.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.733+0000 7f4c52ffd700 1 -- 172.21.15.59:0/3760386780 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c4c022470 con 0x7f4c5c100ff0 2023-10-08T12:40:37.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.733+0000 7f4c63bff700 1 -- 172.21.15.59:0/3760386780 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c19d100 con 0x7f4c5c100ff0 2023-10-08T12:40:37.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.733+0000 7f4c52ffd700 1 -- 172.21.15.59:0/3760386780 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c017650 con 0x7f4c5c100ff0 2023-10-08T12:40:37.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.733+0000 7f4c63bff700 1 -- 172.21.15.59:0/3760386780 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5c1a5ac0 con 0x7f4c5c100ff0 2023-10-08T12:40:37.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.734+0000 7f4c63bff700 1 -- 172.21.15.59:0/3760386780 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5c101d70 con 0x7f4c5c100ff0 2023-10-08T12:40:37.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.736+0000 7f4c52ffd700 1 -- 172.21.15.59:0/3760386780 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f4c4c0225e0 con 0x7f4c5c100ff0 2023-10-08T12:40:37.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.738+0000 7f4c52ffd700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c480a1560 0x7f4c480a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:37.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.738+0000 7f4c52ffd700 1 -- 172.21.15.59:0/3760386780 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f4c4c0ce340 con 0x7f4c5c100ff0 2023-10-08T12:40:37.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.738+0000 7f4c6199b700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c480a1560 0x7f4c480a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:37.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.738+0000 7f4c6199b700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c480a1560 0x7f4c480a3a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009be0 tx=0x7f4c58009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:37.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.740+0000 7f4c52ffd700 1 -- 172.21.15.59:0/3760386780 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4c4c097830 con 0x7f4c5c100ff0 2023-10-08T12:40:37.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.957+0000 7f4c63bff700 1 -- 172.21.15.59:0/3760386780 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c5c199fe0 con 0x7f4c5c100ff0 2023-10-08T12:40:37.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.959+0000 7f4c52ffd700 1 -- 172.21.15.59:0/3760386780 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22725 (secure 0 0 0) 0x7f4c4c09ae50 con 0x7f4c5c100ff0 2023-10-08T12:40:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:37.960 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":86,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:40:11.783762+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:40:37.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.962+0000 7f4c63bff700 1 -- 172.21.15.59:0/3760386780 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c480a1560 msgr2=0x7f4c480a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.962+0000 7f4c63bff700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c480a1560 0x7f4c480a3a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009be0 tx=0x7f4c58009260 comp rx=0 tx=0).stop 2023-10-08T12:40:37.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.962+0000 7f4c63bff700 1 -- 172.21.15.59:0/3760386780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c5c100ff0 msgr2=0x7f4c5c199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:37.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.962+0000 7f4c63bff700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c5c100ff0 0x7f4c5c199260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c000c00 tx=0x7f4c4c005740 comp rx=0 tx=0).stop 2023-10-08T12:40:37.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.962+0000 7f4c63bff700 1 -- 172.21.15.59:0/3760386780 shutdown_connections 2023-10-08T12:40:37.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.962+0000 7f4c63bff700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c480a1560 0x7f4c480a3a20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.962+0000 7f4c63bff700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c106640 0x7f4c5c19c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.962+0000 7f4c63bff700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c100630 0x7f4c5c198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.962+0000 7f4c63bff700 1 --2- 172.21.15.59:0/3760386780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c5c100ff0 0x7f4c5c199260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:37.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.962+0000 7f4c63bff700 1 -- 172.21.15.59:0/3760386780 >> 172.21.15.59:0/3760386780 conn(0x7f4c5c0fc140 msgr2=0x7f4c5c10be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:37.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.962+0000 7f4c63bff700 1 -- 172.21.15.59:0/3760386780 shutdown_connections 2023-10-08T12:40:37.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:37.963+0000 7f4c63bff700 1 -- 172.21.15.59:0/3760386780 wait complete. 2023-10-08T12:40:37.980 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:37 smithi059 ceph-mon[98489]: pgmap v297: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:37.980 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:37 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1477666677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:40:37.980 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:37 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/931500968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:37.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:40:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:37 smithi092 ceph-mon[134093]: pgmap v297: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:37 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1477666677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:40:38.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:37 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/931500968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:38.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.184+0000 7f95451ff700 1 -- 172.21.15.59:0/62295011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9540106640 msgr2=0x7f9540106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.184+0000 7f95451ff700 1 --2- 172.21.15.59:0/62295011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9540106640 0x7f9540106a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9530009990 tx=0x7f9530009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.184+0000 7f95451ff700 1 -- 172.21.15.59:0/62295011 shutdown_connections 2023-10-08T12:40:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.184+0000 7f95451ff700 1 --2- 172.21.15.59:0/62295011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9540100ff0 0x7f954010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.184+0000 7f95451ff700 1 --2- 172.21.15.59:0/62295011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9540106640 0x7f9540106a20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.184+0000 7f95451ff700 1 --2- 172.21.15.59:0/62295011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9540100630 0x7f9540100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.184+0000 7f95451ff700 1 -- 172.21.15.59:0/62295011 >> 172.21.15.59:0/62295011 conn(0x7f95400fc140 msgr2=0x7f95400fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.184+0000 7f95451ff700 1 -- 172.21.15.59:0/62295011 shutdown_connections 2023-10-08T12:40:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.184+0000 7f95451ff700 1 -- 172.21.15.59:0/62295011 wait complete. 2023-10-08T12:40:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.185+0000 7f95451ff700 1 Processor -- start 2023-10-08T12:40:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.185+0000 7f95451ff700 1 -- start start 2023-10-08T12:40:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f95451ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9540100630 0x7f954019ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f95451ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9540100ff0 0x7f954019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f95451ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9540106640 0x7f9540198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f95451ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9540199190 con 0x7f9540100ff0 2023-10-08T12:40:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f95451ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9540199300 con 0x7f9540106640 2023-10-08T12:40:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f95451ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95401994c0 con 0x7f9540100630 2023-10-08T12:40:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f9537fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9540100ff0 0x7f954019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f9537fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9540100ff0 0x7f954019ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39746/0 (socket says 172.21.15.59:39746) 2023-10-08T12:40:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f9537fff700 1 -- 172.21.15.59:0/123158706 learned_addr learned my addr 172.21.15.59:0/123158706 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f953f59e700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9540106640 0x7f9540198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f953ed9d700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9540100630 0x7f954019ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f9537fff700 1 -- 172.21.15.59:0/123158706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9540100630 msgr2=0x7f954019ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f9537fff700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9540100630 0x7f954019ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f9537fff700 1 -- 172.21.15.59:0/123158706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9540106640 msgr2=0x7f9540198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f9537fff700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9540106640 0x7f9540198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.186+0000 7f9537fff700 1 -- 172.21.15.59:0/123158706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95300095f0 con 0x7f9540100ff0 2023-10-08T12:40:38.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.187+0000 7f9537fff700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9540100ff0 0x7f954019ef40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f952800e9a0 tx=0x7f952800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:38.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.187+0000 7f953cd99700 1 -- 172.21.15.59:0/123158706 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528009790 con 0x7f9540100ff0 2023-10-08T12:40:38.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.187+0000 7f95451ff700 1 -- 172.21.15.59:0/123158706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95401997a0 con 0x7f9540100ff0 2023-10-08T12:40:38.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.187+0000 7f953cd99700 1 -- 172.21.15.59:0/123158706 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9528010430 con 0x7f9540100ff0 2023-10-08T12:40:38.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.187+0000 7f953cd99700 1 -- 172.21.15.59:0/123158706 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528018680 con 0x7f9540100ff0 2023-10-08T12:40:38.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.187+0000 7f95451ff700 1 -- 172.21.15.59:0/123158706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95401a59f0 con 0x7f9540100ff0 2023-10-08T12:40:38.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.188+0000 7f95451ff700 1 -- 172.21.15.59:0/123158706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9540101d70 con 0x7f9540100ff0 2023-10-08T12:40:38.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.190+0000 7f953cd99700 1 -- 172.21.15.59:0/123158706 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f95280105a0 con 0x7f9540100ff0 2023-10-08T12:40:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.191+0000 7f953cd99700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f952c0a1560 0x7f952c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.192+0000 7f953cd99700 1 -- 172.21.15.59:0/123158706 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9528014070 con 0x7f9540100ff0 2023-10-08T12:40:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.192+0000 7f953ed9d700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f952c0a1560 0x7f952c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.192+0000 7f953ed9d700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f952c0a1560 0x7f952c0a3a20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9530006010 tx=0x7f953000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:38.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.196+0000 7f953cd99700 1 -- 172.21.15.59:0/123158706 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9528052100 con 0x7f9540100ff0 2023-10-08T12:40:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:37 smithi173 ceph-mon[135182]: pgmap v297: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:37 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1477666677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:40:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:37 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/931500968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:38.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.455+0000 7f95451ff700 1 -- 172.21.15.59:0/123158706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9540199990 con 0x7f9540100ff0 2023-10-08T12:40:38.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.456+0000 7f953cd99700 1 -- 172.21.15.59:0/123158706 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f95280965a0 con 0x7f9540100ff0 2023-10-08T12:40:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:38.456 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:40:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.458+0000 7f95451ff700 1 -- 172.21.15.59:0/123158706 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f952c0a1560 msgr2=0x7f952c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.458+0000 7f95451ff700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f952c0a1560 0x7f952c0a3a20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9530006010 tx=0x7f953000b260 comp rx=0 tx=0).stop 2023-10-08T12:40:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.459+0000 7f95451ff700 1 -- 172.21.15.59:0/123158706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9540100ff0 msgr2=0x7f954019ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.459+0000 7f95451ff700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9540100ff0 0x7f954019ef40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f952800e9a0 tx=0x7f952800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.459+0000 7f95451ff700 1 -- 172.21.15.59:0/123158706 shutdown_connections 2023-10-08T12:40:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.459+0000 7f95451ff700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f952c0a1560 0x7f952c0a3a20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.459+0000 7f95451ff700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9540106640 0x7f9540198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.459+0000 7f95451ff700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9540100630 0x7f954019ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.459+0000 7f95451ff700 1 --2- 172.21.15.59:0/123158706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9540100ff0 0x7f954019ef40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.459+0000 7f95451ff700 1 -- 172.21.15.59:0/123158706 >> 172.21.15.59:0/123158706 conn(0x7f95400fc140 msgr2=0x7f954010bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:38.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.459+0000 7f95451ff700 1 -- 172.21.15.59:0/123158706 shutdown_connections 2023-10-08T12:40:38.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.459+0000 7f95451ff700 1 -- 172.21.15.59:0/123158706 wait complete. 2023-10-08T12:40:38.460 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:40:38.478 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-08T12:39:13.722264+0000', 'modified': '2023-10-08T12:39:18.723320+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24710}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24673': {'gid': 24673, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6839/2951536251', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 2951536251}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 2951536251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24710': {'gid': 24710, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6839/2979385377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 2979385377}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 2979385377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T12:40:38.478 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T12:40:38.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T12:40:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.682+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/125310972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e8105b80 msgr2=0x7fc9e810d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.682+0000 7fc9ee5ff700 1 --2- 172.21.15.59:0/125310972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e8105b80 0x7fc9e810d590 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000b0d0 tx=0x7fc9e000b3e0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.682+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/125310972 shutdown_connections 2023-10-08T12:40:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.682+0000 7fc9ee5ff700 1 --2- 172.21.15.59:0/125310972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e8105b80 0x7fc9e810d590 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.682+0000 7fc9ee5ff700 1 --2- 172.21.15.59:0/125310972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9e8067ce0 0x7fc9e80680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.682+0000 7fc9ee5ff700 1 --2- 172.21.15.59:0/125310972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e81051c0 0x7fc9e8105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.682+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/125310972 >> 172.21.15.59:0/125310972 conn(0x7fc9e8076780 msgr2=0x7fc9e8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.682+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/125310972 shutdown_connections 2023-10-08T12:40:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.682+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/125310972 wait complete. 2023-10-08T12:40:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.683+0000 7fc9ee5ff700 1 Processor -- start 2023-10-08T12:40:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.683+0000 7fc9ee5ff700 1 -- start start 2023-10-08T12:40:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9ee5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9e8067ce0 0x7fc9e8198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9ee5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e81051c0 0x7fc9e81994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9ee5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105b80 0x7fc9e819d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9ee5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e819ded0 con 0x7fc9e81051c0 2023-10-08T12:40:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9ee5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e819e040 con 0x7fc9e8105b80 2023-10-08T12:40:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9ee5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e819e200 con 0x7fc9e8067ce0 2023-10-08T12:40:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e81051c0 0x7fc9e81994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9e7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9e8067ce0 0x7fc9e8198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e81051c0 0x7fc9e81994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39766/0 (socket says 172.21.15.59:39766) 2023-10-08T12:40:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9e77fe700 1 -- 172.21.15.59:0/1325056398 learned_addr learned my addr 172.21.15.59:0/1325056398 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9ecb9c700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105b80 0x7fc9e819d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9e77fe700 1 -- 172.21.15.59:0/1325056398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9e8067ce0 msgr2=0x7fc9e8198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9e77fe700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9e8067ce0 0x7fc9e8198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9e77fe700 1 -- 172.21.15.59:0/1325056398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105b80 msgr2=0x7fc9e819d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9e77fe700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105b80 0x7fc9e819d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.684+0000 7fc9e77fe700 1 -- 172.21.15.59:0/1325056398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e0009d00 con 0x7fc9e81051c0 2023-10-08T12:40:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.685+0000 7fc9e77fe700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e81051c0 0x7fc9e81994f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00e9a0 tx=0x7fc9dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.685+0000 7fc9e57fa700 1 -- 172.21.15.59:0/1325056398 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc009790 con 0x7fc9e81051c0 2023-10-08T12:40:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.685+0000 7fc9e57fa700 1 -- 172.21.15.59:0/1325056398 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9dc010430 con 0x7fc9e81051c0 2023-10-08T12:40:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.685+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/1325056398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e819e4e0 con 0x7fc9e81051c0 2023-10-08T12:40:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.685+0000 7fc9e57fa700 1 -- 172.21.15.59:0/1325056398 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc018680 con 0x7fc9e81051c0 2023-10-08T12:40:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.685+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/1325056398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e81a5d20 con 0x7fc9e81051c0 2023-10-08T12:40:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.688+0000 7fc9e57fa700 1 -- 172.21.15.59:0/1325056398 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fc9dc0105a0 con 0x7fc9e81051c0 2023-10-08T12:40:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.689+0000 7fca01ee3b80 1 Processor -- start 2023-10-08T12:40:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fca01ee3b80 1 -- start start 2023-10-08T12:40:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fc9e57fa700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc9d00a1560 0x7fc9d00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38d5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fc9e57fa700 1 -- 172.21.15.59:0/1325056398 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc9dc014070 con 0x7fc9e81051c0 2023-10-08T12:40:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b383e410 con 0x55b2b38e0600 2023-10-08T12:40:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b382fbd0 con 0x55b2b38d5750 2023-10-08T12:40:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b382d4f0 con 0x55b2b38d4e30 2023-10-08T12:40:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fc9e7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38d5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fc9ecb9c700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc9d00a1560 0x7fc9d00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fc9e7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38d5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:53642/0 (socket says 172.21.15.59:53642) 2023-10-08T12:40:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1327177079 learned_addr learned my addr 172.21.15.59:0/1327177079 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fc9e77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.690+0000 7fc9ecb9c700 1 --2- 172.21.15.59:0/1327177079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.691+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1327177079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 msgr2=0x55b2b38e00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.691+0000 7fc9e7fff700 1 --2- 172.21.15.59:0/1327177079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38e00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.691+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1327177079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 msgr2=0x55b2b38e29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.691+0000 7fc9e7fff700 1 --2- 172.21.15.59:0/1327177079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38e29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.691+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1327177079 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2b3653d90 con 0x55b2b38d4e30 2023-10-08T12:40:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.691+0000 7fc9ecb9c700 1 --2- 172.21.15.59:0/1327177079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38e29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.691+0000 7fc9ecb9c700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc9d00a1560 0x7fc9d00a3a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009610 tx=0x7fc9e0006000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.691+0000 7fc9e7fff700 1 --2- 172.21.15.59:0/1327177079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38d5210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009db0 tx=0x7fc9d8011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1ad8c45aaf4e008 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.691+0000 7fc9ce7fc700 1 -- 172.21.15.59:0/1327177079 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8004230 con 0x55b2b38d4e30 2023-10-08T12:40:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.691+0000 7fc9ce7fc700 1 -- 172.21.15.59:0/1327177079 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9d8004390 con 0x55b2b38d4e30 2023-10-08T12:40:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.691+0000 7fc9ce7fc700 1 -- 172.21.15.59:0/1327177079 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8019840 con 0x55b2b38d4e30 2023-10-08T12:40:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.692+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1327177079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 msgr2=0x55b2b38d5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.692+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1327177079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38d5210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009db0 tx=0x7fc9d8011720 comp rx=0 tx=0).stop 2023-10-08T12:40:38.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.692+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1327177079 shutdown_connections 2023-10-08T12:40:38.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.692+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1327177079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38e29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.692+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1327177079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38d5210 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.692+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1327177079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.692+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1327177079 >> 172.21.15.59:0/1327177079 conn(0x55b2b384a210 msgr2=0x55b2b38d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:38.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.692+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1327177079 shutdown_connections 2023-10-08T12:40:38.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.692+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1327177079 wait complete. 2023-10-08T12:40:38.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.693+0000 7fca01ee3b80 1 -- start start 2023-10-08T12:40:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.693+0000 7fca01ee3b80 1 Processor -- start 2023-10-08T12:40:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.693+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38dffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.693+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38dd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.693+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38dd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.693+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b3828de0 con 0x55b2b38e0600 2023-10-08T12:40:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.693+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b37c56c0 con 0x55b2b38d5750 2023-10-08T12:40:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.693+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b37c5360 con 0x55b2b38d4e30 2023-10-08T12:40:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.693+0000 7fca01ee3b80 10 client.0 _ll_register_callbacks cb 0x55b2b36227b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9e7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38dffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9e7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38dffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:53652/0 (socket says 172.21.15.59:53652) 2023-10-08T12:40:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1882156509 learned_addr learned my addr 172.21.15.59:0/1882156509 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9e77fe700 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38dd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9ecb9c700 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1882156509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 msgr2=0x55b2b38dd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9e7fff700 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38dd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1882156509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 msgr2=0x55b2b38dd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9e7fff700 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38dd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1882156509 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d80099e0 con 0x55b2b38d4e30 2023-10-08T12:40:38.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9e7fff700 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38dffd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000c00 tx=0x7fc9d80038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13acaaef8b624d90 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:38.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.694+0000 7fc9c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:40:38.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.695+0000 7fc9c77fe700 1 -- 172.21.15.59:0/1882156509 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8005240 con 0x55b2b38d4e30 2023-10-08T12:40:38.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.695+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1882156509 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2b37f0e60 con 0x55b2b38d4e30 2023-10-08T12:40:38.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.695+0000 7fc9c77fe700 1 -- 172.21.15.59:0/1882156509 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc9d8004500 con 0x55b2b38d4e30 2023-10-08T12:40:38.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.695+0000 7fc9c77fe700 1 -- 172.21.15.59:0/1882156509 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9d8005ce0 con 0x55b2b38d4e30 2023-10-08T12:40:38.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.695+0000 7fca01ee3b80 10 client.25120 fetch_fsmap learned FSMap version 20 2023-10-08T12:40:38.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.695+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1882156509 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b2b363cc10 con 0x55b2b38d4e30 2023-10-08T12:40:38.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.696+0000 7fc9c77fe700 1 -- 172.21.15.59:0/1882156509 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b2b37f0e60 con 0x55b2b38d4e30 2023-10-08T12:40:38.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.696+0000 7fc9c77fe700 1 -- 172.21.15.59:0/1882156509 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc9d8021040 con 0x55b2b38d4e30 2023-10-08T12:40:38.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.696+0000 7fca01ee3b80 10 client.25120 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:40:38.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.696+0000 7fca01ee3b80 10 client.25120 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T12:40:38.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.696+0000 7fca01ee3b80 20 client.25120 populate_metadata read hostname 'smithi059' 2023-10-08T12:40:38.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.696+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b2b38f00d0 0x55b2b38eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.696+0000 7fca01ee3b80 4 client.25120 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.696+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1882156509 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2b3821dc0 con 0x55b2b38f00d0 2023-10-08T12:40:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.696+0000 7fc9e77fe700 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b2b38f00d0 0x55b2b38eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.697+0000 7fc9e77fe700 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b2b38f00d0 0x55b2b38eeb90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c72057af1c5e229 server_cookie=8d27daabb26d5468 in_seq=0 out_seq=0 2023-10-08T12:40:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.697+0000 7fc9c77fe700 10 client.25120 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:40:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fc9c77fe700 1 -- 172.21.15.59:0/1882156509 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b2b3821dc0 con 0x55b2b38f00d0 2023-10-08T12:40:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fc9c77fe700 10 client.25120 handle_command_reply: tid=0 2023-10-08T12:40:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 1 client.25120 shutdown 2023-10-08T12:40:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1882156509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 msgr2=0x55b2b38dffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38dffd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000c00 tx=0x7fc9d80038b0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1882156509 shutdown_connections 2023-10-08T12:40:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b2b38f00d0 0x55b2b38eeb90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38dd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38dffd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fc9c77fe700 0 client.25120 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:40:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1882156509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38dd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1882156509 >> 172.21.15.59:0/1882156509 conn(0x55b2b384a210 msgr2=0x55b2b38d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1882156509 shutdown_connections 2023-10-08T12:40:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1882156509 wait complete. 2023-10-08T12:40:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.698+0000 7fca01ee3b80 20 client.25120 trim_cache size 0 max 16384 2023-10-08T12:40:38.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.717+0000 7fca01ee3b80 1 Processor -- start 2023-10-08T12:40:38.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.717+0000 7fca01ee3b80 1 -- start start 2023-10-08T12:40:38.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38ec170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b36a98d0 con 0x55b2b38e0600 2023-10-08T12:40:38.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b36b5de0 con 0x55b2b38d5750 2023-10-08T12:40:38.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b38ecbc0 con 0x55b2b38d4e30 2023-10-08T12:40:38.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fc9e7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38ec170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fc9e7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38ec170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:53664/0 (socket says 172.21.15.59:53664) 2023-10-08T12:40:38.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fc9ecb9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fc9e77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1918160991 learned_addr learned my addr 172.21.15.59:0/1918160991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:38.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1918160991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 msgr2=0x55b2b38f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:38.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fc9e7fff700 1 --2- 172.21.15.59:0/1918160991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1918160991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 msgr2=0x55b2b38eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:38.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fc9e7fff700 1 --2- 172.21.15.59:0/1918160991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38eeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fc9e7fff700 1 -- 172.21.15.59:0/1918160991 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2b367a200 con 0x55b2b38d4e30 2023-10-08T12:40:38.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.718+0000 7fc9e77fe700 1 --2- 172.21.15.59:0/1918160991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:38.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.719+0000 7fc9e7fff700 1 --2- 172.21.15.59:0/1918160991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38ec170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8019510 tx=0x7fc9d8003d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee64be95f6a9a007 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.720+0000 7fc9ceffd700 1 -- 172.21.15.59:0/1918160991 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8011a70 con 0x55b2b38d4e30 2023-10-08T12:40:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.721+0000 7fc9ceffd700 1 -- 172.21.15.59:0/1918160991 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9d8003920 con 0x55b2b38d4e30 2023-10-08T12:40:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.721+0000 7fc9ceffd700 1 -- 172.21.15.59:0/1918160991 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8004500 con 0x55b2b38d4e30 2023-10-08T12:40:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.721+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1918160991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 msgr2=0x55b2b38ec170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.721+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1918160991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38ec170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8019510 tx=0x7fc9d8003d30 comp rx=0 tx=0).stop 2023-10-08T12:40:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.721+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1918160991 shutdown_connections 2023-10-08T12:40:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.721+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1918160991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38e0600 0x55b2b38eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.721+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1918160991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38d4e30 0x55b2b38ec170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.721+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/1918160991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.721+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1918160991 >> 172.21.15.59:0/1918160991 conn(0x55b2b384a210 msgr2=0x55b2b38dbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.721+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1918160991 shutdown_connections 2023-10-08T12:40:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.721+0000 7fca01ee3b80 1 -- 172.21.15.59:0/1918160991 wait complete. 2023-10-08T12:40:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.722+0000 7fca01ee3b80 1 -- start start 2023-10-08T12:40:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.722+0000 7fca01ee3b80 1 Processor -- start 2023-10-08T12:40:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38d4e30 0x55b2b38f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fca01ee3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38e0600 0x55b2b38f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b38f9000 con 0x55b2b38d4e30 2023-10-08T12:40:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b38f3520 con 0x55b2b38d5750 2023-10-08T12:40:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fca01ee3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b38f3690 con 0x55b2b38e0600 2023-10-08T12:40:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fca01ee3b80 10 client.0 _ll_register_callbacks cb 0x7fc9dc096580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fc9e7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38d4e30 0x55b2b38f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fc9e77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fc9e7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38d4e30 0x55b2b38f86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39792/0 (socket says 172.21.15.59:39792) 2023-10-08T12:40:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fc9e77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38f2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33256/0 (socket says 172.21.15.59:33256) 2023-10-08T12:40:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fc9e7fff700 1 -- 172.21.15.59:0/304304025 learned_addr learned my addr 172.21.15.59:0/304304025 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fc9ecb9c700 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38e0600 0x55b2b38f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fc9e77fe700 1 -- 172.21.15.59:0/304304025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38e0600 msgr2=0x55b2b38f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fc9e77fe700 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38e0600 0x55b2b38f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fc9e77fe700 1 -- 172.21.15.59:0/304304025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38d4e30 msgr2=0x55b2b38f86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fc9e77fe700 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38d4e30 0x55b2b38f86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.723+0000 7fc9e77fe700 1 -- 172.21.15.59:0/304304025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e81a5d20 con 0x55b2b38d5750 2023-10-08T12:40:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fc9e77fe700 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38f2aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0ca9f0 tx=0x7fc9dc0cc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8654999a9f10cb7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fc9c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:40:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fc9c77fe700 1 -- 172.21.15.59:0/304304025 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc09e350 con 0x55b2b38d5750 2023-10-08T12:40:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fca01ee3b80 1 -- 172.21.15.59:0/304304025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9d8004390 con 0x55b2b38d5750 2023-10-08T12:40:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fc9c77fe700 1 -- 172.21.15.59:0/304304025 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc9dc0a2590 con 0x55b2b38d5750 2023-10-08T12:40:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fc9c77fe700 1 -- 172.21.15.59:0/304304025 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9dc0b8300 con 0x55b2b38d5750 2023-10-08T12:40:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fca01ee3b80 10 client.25124 fetch_fsmap learned FSMap version 20 2023-10-08T12:40:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fca01ee3b80 1 -- 172.21.15.59:0/304304025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b2b363cc10 con 0x55b2b38d5750 2023-10-08T12:40:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fc9c77fe700 1 -- 172.21.15.59:0/304304025 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9dc07e080 con 0x55b2b38d5750 2023-10-08T12:40:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fc9c77fe700 1 -- 172.21.15.59:0/304304025 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc9dc0b8020 con 0x55b2b38d5750 2023-10-08T12:40:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fca01ee3b80 10 client.25124 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:40:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fca01ee3b80 10 client.25124 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T12:40:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.724+0000 7fca01ee3b80 20 client.25124 populate_metadata read hostname 'smithi059' 2023-10-08T12:40:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.725+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b2b3948a90 0x55b2b3944ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.725+0000 7fca01ee3b80 4 client.25124 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:40:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.725+0000 7fca01ee3b80 1 -- 172.21.15.59:0/304304025 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b2b3821ae0 con 0x55b2b3948a90 2023-10-08T12:40:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.725+0000 7fc9e7fff700 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b2b3948a90 0x55b2b3944ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.725+0000 7fc9e7fff700 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b2b3948a90 0x55b2b3944ef0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6dd225a0482c4c7 server_cookie=e4325aafbafb4b6 in_seq=0 out_seq=0 2023-10-08T12:40:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.725+0000 7fc9c77fe700 10 client.25124 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:40:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.725+0000 7fc9c77fe700 1 -- 172.21.15.59:0/304304025 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55b2b3821ae0 con 0x55b2b3948a90 2023-10-08T12:40:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.725+0000 7fc9c77fe700 10 client.25124 handle_command_reply: tid=0 2023-10-08T12:40:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.725+0000 7fca01ee3b80 1 client.25124 shutdown 2023-10-08T12:40:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fca01ee3b80 1 -- 172.21.15.59:0/304304025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 msgr2=0x55b2b38f2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38f2aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0ca9f0 tx=0x7fc9dc0cc040 comp rx=0 tx=0).stop 2023-10-08T12:40:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fca01ee3b80 1 -- 172.21.15.59:0/304304025 shutdown_connections 2023-10-08T12:40:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b2b3948a90 0x55b2b3944ef0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2b38e0600 0x55b2b38f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2b38d4e30 0x55b2b38f86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fca01ee3b80 1 --2- 172.21.15.59:0/304304025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2b38d5750 0x55b2b38f2aa0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fc9c77fe700 0 client.25124 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:40:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fca01ee3b80 1 -- 172.21.15.59:0/304304025 >> 172.21.15.59:0/304304025 conn(0x55b2b384a210 msgr2=0x55b2b38db870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fca01ee3b80 1 -- 172.21.15.59:0/304304025 shutdown_connections 2023-10-08T12:40:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fca01ee3b80 1 -- 172.21.15.59:0/304304025 wait complete. 2023-10-08T12:40:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.726+0000 7fca01ee3b80 20 client.25124 trim_cache size 0 max 16384 2023-10-08T12:40:38.731 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:40:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "6a005028-65d6-11ee-8db5-212e2dc638e7", 2023-10-08T12:40:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-10-08T12:40:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24710, 2023-10-08T12:40:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-10-08T12:40:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-10-08T12:40:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-10-08T12:40:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 84.029522870999998, 2023-10-08T12:40:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 20, 2023-10-08T12:40:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 86, 2023-10-08T12:40:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:40:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 90.921834904999997 2023-10-08T12:40:38.732 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:40:38.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/1325056398 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc9d00a1560 msgr2=0x7fc9d00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc9d00a1560 0x7fc9d00a3a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009610 tx=0x7fc9e0006000 comp rx=0 tx=0).stop 2023-10-08T12:40:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/1325056398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e81051c0 msgr2=0x7fc9e81994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e81051c0 0x7fc9e81994f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00e9a0 tx=0x7fc9dc00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/1325056398 shutdown_connections 2023-10-08T12:40:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc9d00a1560 0x7fc9d00a3a20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e8105b80 0x7fc9e819d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9e8067ce0 0x7fc9e8198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 --2- 172.21.15.59:0/1325056398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e81051c0 0x7fc9e81994f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/1325056398 >> 172.21.15.59:0/1325056398 conn(0x7fc9e8076780 msgr2=0x7fc9e810be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/1325056398 shutdown_connections 2023-10-08T12:40:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:38.727+0000 7fc9ee5ff700 1 -- 172.21.15.59:0/1325056398 wait complete. 2023-10-08T12:40:38.745 INFO:tasks.cephadm:Setup complete, yielding 2023-10-08T12:40:38.745 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-08T12:40:38.757 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2023-10-08T12:40:38.759 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-08T12:40:39.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:38 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3760386780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:40:39.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:38 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/123158706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:39.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:38 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3760386780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:40:39.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:38 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/123158706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:38 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3760386780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:40:39.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:38 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/123158706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:39.493 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:40.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:39 smithi059 ceph-mon[98489]: pgmap v298: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:39 smithi092 ceph-mon[134093]: pgmap v298: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:39 smithi173 ceph-mon[135182]: pgmap v298: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:40:41.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.114+0000 7f19faec3700 1 -- 172.21.15.59:0/3554190150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f41008a0 msgr2=0x7f19f4100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:41.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.114+0000 7f19faec3700 1 --2- 172.21.15.59:0/3554190150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f41008a0 0x7f19f4100d20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009990 tx=0x7f19e0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:41.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.115+0000 7f19faec3700 1 -- 172.21.15.59:0/3554190150 shutdown_connections 2023-10-08T12:40:41.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.115+0000 7f19faec3700 1 --2- 172.21.15.59:0/3554190150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f41057c0 0x7f19f4105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:41.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.115+0000 7f19faec3700 1 --2- 172.21.15.59:0/3554190150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f4101260 0x7f19f410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:41.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.115+0000 7f19faec3700 1 --2- 172.21.15.59:0/3554190150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f41008a0 0x7f19f4100d20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:41.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.115+0000 7f19faec3700 1 -- 172.21.15.59:0/3554190150 >> 172.21.15.59:0/3554190150 conn(0x7f19f40779e0 msgr2=0x7f19f4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:41.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.115+0000 7f19faec3700 1 -- 172.21.15.59:0/3554190150 shutdown_connections 2023-10-08T12:40:41.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.115+0000 7f19faec3700 1 -- 172.21.15.59:0/3554190150 wait complete. 2023-10-08T12:40:41.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.116+0000 7f19faec3700 1 Processor -- start 2023-10-08T12:40:41.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.116+0000 7f19faec3700 1 -- start start 2023-10-08T12:40:41.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.116+0000 7f19faec3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f41008a0 0x7f19f4072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:41.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.116+0000 7f19faec3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f4101260 0x7f19f4073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:41.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.116+0000 7f19faec3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f41057c0 0x7f19f4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:41.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.116+0000 7f19faec3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f41a5010 con 0x7f19f41008a0 2023-10-08T12:40:41.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.116+0000 7f19faec3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f41a5180 con 0x7f19f41057c0 2023-10-08T12:40:41.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.116+0000 7f19faec3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f41a5340 con 0x7f19f4101260 2023-10-08T12:40:41.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.117+0000 7f19f8c5f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f41008a0 0x7f19f4072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:41.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.117+0000 7f19f8c5f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f41008a0 0x7f19f4072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47890/0 (socket says 172.21.15.59:47890) 2023-10-08T12:40:41.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.117+0000 7f19f8c5f700 1 -- 172.21.15.59:0/882062130 learned_addr learned my addr 172.21.15.59:0/882062130 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:41.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.117+0000 7f19f3fff700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f4101260 0x7f19f4073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:41.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.117+0000 7f19f9460700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f41057c0 0x7f19f4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:41.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.117+0000 7f19f8c5f700 1 -- 172.21.15.59:0/882062130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f4101260 msgr2=0x7f19f4073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:41.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.117+0000 7f19f8c5f700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f4101260 0x7f19f4073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:41.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.117+0000 7f19f8c5f700 1 -- 172.21.15.59:0/882062130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f41057c0 msgr2=0x7f19f4073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:41.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.117+0000 7f19f8c5f700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f41057c0 0x7f19f4073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:41.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.117+0000 7f19f8c5f700 1 -- 172.21.15.59:0/882062130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e00095f0 con 0x7f19f41008a0 2023-10-08T12:40:41.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.117+0000 7f19f8c5f700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f41008a0 0x7f19f4072af0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f19e800e970 tx=0x7f19e800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:41.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.118+0000 7f19f1ffb700 1 -- 172.21.15.59:0/882062130 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8009790 con 0x7f19f41008a0 2023-10-08T12:40:41.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.118+0000 7f19f1ffb700 1 -- 172.21.15.59:0/882062130 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19e800c7e0 con 0x7f19f41008a0 2023-10-08T12:40:41.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.118+0000 7f19f1ffb700 1 -- 172.21.15.59:0/882062130 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8003c70 con 0x7f19f41008a0 2023-10-08T12:40:41.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.118+0000 7f19faec3700 1 -- 172.21.15.59:0/882062130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f41a5620 con 0x7f19f41008a0 2023-10-08T12:40:41.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.118+0000 7f19faec3700 1 -- 172.21.15.59:0/882062130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f41a5ad0 con 0x7f19f41008a0 2023-10-08T12:40:41.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.119+0000 7f19faec3700 1 -- 172.21.15.59:0/882062130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f4108da0 con 0x7f19f41008a0 2023-10-08T12:40:41.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.121+0000 7f19f1ffb700 1 -- 172.21.15.59:0/882062130 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f19e800cc50 con 0x7f19f41008a0 2023-10-08T12:40:41.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.122+0000 7f19f1ffb700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e40a15e0 0x7f19e40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:41.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.122+0000 7f19f1ffb700 1 -- 172.21.15.59:0/882062130 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f19e8014070 con 0x7f19f41008a0 2023-10-08T12:40:41.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.122+0000 7f19f3fff700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e40a15e0 0x7f19e40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:41.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.123+0000 7f19f3fff700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e40a15e0 0x7f19e40a3aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f19f40741d0 tx=0x7f19e000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:41.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.126+0000 7f19f1ffb700 1 -- 172.21.15.59:0/882062130 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f19e80964c0 con 0x7f19f41008a0 2023-10-08T12:40:41.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.355+0000 7f19faec3700 1 -- 172.21.15.59:0/882062130 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19f4073ff0 con 0x7f19e40a15e0 2023-10-08T12:40:41.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.357+0000 7f19f1ffb700 1 -- 172.21.15.59:0/882062130 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f19f4073ff0 con 0x7f19e40a15e0 2023-10-08T12:40:41.357 INFO:teuthology.orchestra.run.smithi059.stdout:Backend: cephadm 2023-10-08T12:40:41.357 INFO:teuthology.orchestra.run.smithi059.stdout:Available: Yes 2023-10-08T12:40:41.357 INFO:teuthology.orchestra.run.smithi059.stdout:Paused: No 2023-10-08T12:40:41.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.359+0000 7f19faec3700 1 -- 172.21.15.59:0/882062130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e40a15e0 msgr2=0x7f19e40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:41.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.359+0000 7f19faec3700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e40a15e0 0x7f19e40a3aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f19f40741d0 tx=0x7f19e000b260 comp rx=0 tx=0).stop 2023-10-08T12:40:41.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.359+0000 7f19faec3700 1 -- 172.21.15.59:0/882062130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f41008a0 msgr2=0x7f19f4072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:41.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.359+0000 7f19faec3700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f41008a0 0x7f19f4072af0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f19e800e970 tx=0x7f19e800ec80 comp rx=0 tx=0).stop 2023-10-08T12:40:41.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.359+0000 7f19faec3700 1 -- 172.21.15.59:0/882062130 shutdown_connections 2023-10-08T12:40:41.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.359+0000 7f19faec3700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19e40a15e0 0x7f19e40a3aa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:41.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.359+0000 7f19faec3700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f41057c0 0x7f19f4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:41.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.359+0000 7f19faec3700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f41008a0 0x7f19f4072af0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:41.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.359+0000 7f19faec3700 1 --2- 172.21.15.59:0/882062130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f4101260 0x7f19f4073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:41.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.359+0000 7f19faec3700 1 -- 172.21.15.59:0/882062130 >> 172.21.15.59:0/882062130 conn(0x7f19f40779e0 msgr2=0x7f19f40fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:41.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.360+0000 7f19faec3700 1 -- 172.21.15.59:0/882062130 shutdown_connections 2023-10-08T12:40:41.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:41.360+0000 7f19faec3700 1 -- 172.21.15.59:0/882062130 wait complete. 2023-10-08T12:40:41.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-08T12:40:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:41 smithi092 ceph-mon[134093]: pgmap v299: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:41 smithi173 ceph-mon[135182]: pgmap v299: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:41 smithi059 ceph-mon[98489]: pgmap v299: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:40:42.618 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:43.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:42 smithi173 ceph-mon[135182]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:43.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:42 smithi173 ceph-mon[135182]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T12:40:43.223 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:42 smithi059 ceph-mon[98489]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:43.223 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:42 smithi059 ceph-mon[98489]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T12:40:43.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:42 smithi092 ceph-mon[134093]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:43.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:42 smithi092 ceph-mon[134093]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T12:40:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.131+0000 7fb2d3081700 1 -- 172.21.15.59:0/306183019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2cc072a20 msgr2=0x7fb2cc072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.131+0000 7fb2d3081700 1 --2- 172.21.15.59:0/306183019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2cc072a20 0x7fb2cc072e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009990 tx=0x7fb2c0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.131+0000 7fb2d3081700 1 -- 172.21.15.59:0/306183019 shutdown_connections 2023-10-08T12:40:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.131+0000 7fb2d3081700 1 --2- 172.21.15.59:0/306183019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2cc10d250 0x7fb2cc10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.131+0000 7fb2d3081700 1 --2- 172.21.15.59:0/306183019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2cc072a20 0x7fb2cc072e00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.131+0000 7fb2d3081700 1 --2- 172.21.15.59:0/306183019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2cc073340 0x7fb2cc10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.131+0000 7fb2d3081700 1 -- 172.21.15.59:0/306183019 >> 172.21.15.59:0/306183019 conn(0x7fb2cc0779e0 msgr2=0x7fb2cc077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.131+0000 7fb2d3081700 1 -- 172.21.15.59:0/306183019 shutdown_connections 2023-10-08T12:40:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.131+0000 7fb2d3081700 1 -- 172.21.15.59:0/306183019 wait complete. 2023-10-08T12:40:44.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.132+0000 7fb2d3081700 1 Processor -- start 2023-10-08T12:40:44.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.132+0000 7fb2d3081700 1 -- start start 2023-10-08T12:40:44.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.132+0000 7fb2d3081700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2cc072a20 0x7fb2cc198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d3081700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2cc073340 0x7fb2cc199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d3081700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2cc10d250 0x7fb2cc19d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d3081700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc19ddc0 con 0x7fb2cc072a20 2023-10-08T12:40:44.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d3081700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc19df30 con 0x7fb2cc10d250 2023-10-08T12:40:44.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d3081700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc19e0f0 con 0x7fb2cc073340 2023-10-08T12:40:44.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d0e1d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2cc072a20 0x7fb2cc198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d0e1d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2cc072a20 0x7fb2cc198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47894/0 (socket says 172.21.15.59:47894) 2023-10-08T12:40:44.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d0e1d700 1 -- 172.21.15.59:0/3685954682 learned_addr learned my addr 172.21.15.59:0/3685954682 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:44.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d161e700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2cc10d250 0x7fb2cc19d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2cbfff700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2cc073340 0x7fb2cc199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d0e1d700 1 -- 172.21.15.59:0/3685954682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2cc073340 msgr2=0x7fb2cc199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d0e1d700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2cc073340 0x7fb2cc199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d0e1d700 1 -- 172.21.15.59:0/3685954682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2cc10d250 msgr2=0x7fb2cc19d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d0e1d700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2cc10d250 0x7fb2cc19d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d0e1d700 1 -- 172.21.15.59:0/3685954682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c00095f0 con 0x7fb2cc072a20 2023-10-08T12:40:44.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.133+0000 7fb2d161e700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2cc10d250 0x7fb2cc19d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:44.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.134+0000 7fb2d0e1d700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2cc072a20 0x7fb2cc198ec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0005910 tx=0x7fb2c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:44.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.134+0000 7fb2c9ffb700 1 -- 172.21.15.59:0/3685954682 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c001d070 con 0x7fb2cc072a20 2023-10-08T12:40:44.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.134+0000 7fb2d3081700 1 -- 172.21.15.59:0/3685954682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2cc19e370 con 0x7fb2cc072a20 2023-10-08T12:40:44.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.134+0000 7fb2c9ffb700 1 -- 172.21.15.59:0/3685954682 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2c0022470 con 0x7fb2cc072a20 2023-10-08T12:40:44.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.134+0000 7fb2c9ffb700 1 -- 172.21.15.59:0/3685954682 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0017650 con 0x7fb2cc072a20 2023-10-08T12:40:44.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.134+0000 7fb2d3081700 1 -- 172.21.15.59:0/3685954682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2cc1a5c30 con 0x7fb2cc072a20 2023-10-08T12:40:44.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.135+0000 7fb2d3081700 1 -- 172.21.15.59:0/3685954682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2cc108460 con 0x7fb2cc072a20 2023-10-08T12:40:44.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.139+0000 7fb2c9ffb700 1 -- 172.21.15.59:0/3685954682 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb2c00225e0 con 0x7fb2cc072a20 2023-10-08T12:40:44.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.140+0000 7fb2c9ffb700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2bc0a14d0 0x7fb2bc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.140+0000 7fb2c9ffb700 1 -- 172.21.15.59:0/3685954682 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb2c00ce4d0 con 0x7fb2cc072a20 2023-10-08T12:40:44.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.140+0000 7fb2cbfff700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2bc0a14d0 0x7fb2bc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.141+0000 7fb2cbfff700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2bc0a14d0 0x7fb2bc0a3990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc19a420 tx=0x7fb2b8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:44.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.143+0000 7fb2c9ffb700 1 -- 172.21.15.59:0/3685954682 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb2c0097ac0 con 0x7fb2cc072a20 2023-10-08T12:40:44.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:43 smithi173 ceph-mon[135182]: pgmap v300: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2023-10-08T12:40:44.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:43 smithi059 ceph-mon[98489]: pgmap v300: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2023-10-08T12:40:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.361+0000 7fb2d3081700 1 -- 172.21.15.59:0/3685954682 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2cc19a1d0 con 0x7fb2bc0a14d0 2023-10-08T12:40:44.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.376+0000 7fb2c9ffb700 1 -- 172.21.15.59:0/3685954682 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7fb2cc19a1d0 con 0x7fb2bc0a14d0 2023-10-08T12:40:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-08T12:40:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:mds.a smithi059 running (99s) 22s ago 98s 13.6M - 18.0.0-6639-g7b3143ba 09a1f3752b5d b6b4cc04cef5 2023-10-08T12:40:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:mds.b smithi092 running (96s) 24s ago 96s 29.5M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 915ab5d93a93 2023-10-08T12:40:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:mds.c smithi173 running (109s) 24s ago 109s 15.1M - 18.0.0-6639-g7b3143ba 09a1f3752b5d e26c4b22b8ba 2023-10-08T12:40:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:mds.d smithi059 running (116s) 22s ago 116s 13.8M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 9d55d2530661 2023-10-08T12:40:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:mds.e smithi092 running (114s) 24s ago 114s 16.5M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 5675e54d9b90 2023-10-08T12:40:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:mds.f smithi173 running (112s) 24s ago 111s 15.1M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 66eaf123a46d 2023-10-08T12:40:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:mds.g smithi059 running (102s) 22s ago 101s 13.7M - 18.0.0-6639-g7b3143ba 09a1f3752b5d c85105f342ea 2023-10-08T12:40:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:mds.h smithi092 running (107s) 24s ago 107s 15.1M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 2b99b4dc099a 2023-10-08T12:40:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:mds.i smithi173 running (105s) 24s ago 105s 21.7M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 13ab3c41efa3 2023-10-08T12:40:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:mds.j smithi059 running (2m) 22s ago 119s 13.8M - 18.0.0-6639-g7b3143ba 09a1f3752b5d b87d9941426b 2023-10-08T12:40:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:mds.k smithi092 running (2m) 24s ago 2m 17.5M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 2c9f251746b0 2023-10-08T12:40:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:mds.l smithi173 running (2m) 24s ago 2m 15.0M - 18.0.0-6639-g7b3143ba 09a1f3752b5d e54231eebb46 2023-10-08T12:40:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:mgr.x smithi059 *:9283,8765 running (9m) 22s ago 9m 522M - 18.0.0-6639-g7b3143ba 09a1f3752b5d ef5151d45989 2023-10-08T12:40:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:mgr.y smithi092 *:8443,8765 running (7m) 24s ago 7m 450M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 44948e4c2dae 2023-10-08T12:40:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:mgr.z smithi173 *:8443,8765 running (7m) 24s ago 7m 453M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 967eb75d653a 2023-10-08T12:40:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:mon.a smithi059 running (9m) 22s ago 9m 97.7M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d 07228c733469 2023-10-08T12:40:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:mon.b smithi092 running (7m) 24s ago 7m 70.1M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d e6d5bdfbc5c7 2023-10-08T12:40:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:mon.c smithi173 running (8m) 24s ago 8m 70.6M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d 65a094cad362 2023-10-08T12:40:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0 smithi059 running (6m) 22s ago 6m 67.6M 4318M 18.0.0-6639-g7b3143ba 09a1f3752b5d 1b0ec85da7c4 2023-10-08T12:40:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1 smithi092 running (6m) 24s ago 6m 76.2M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 2e31733eb045 2023-10-08T12:40:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2 smithi173 running (5m) 24s ago 5m 71.4M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d d394d27d0303 2023-10-08T12:40:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3 smithi059 running (5m) 22s ago 5m 62.1M 4318M 18.0.0-6639-g7b3143ba 09a1f3752b5d d557a4900e01 2023-10-08T12:40:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4 smithi092 running (5m) 24s ago 5m 59.6M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 301527938afc 2023-10-08T12:40:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5 smithi173 running (4m) 24s ago 4m 66.4M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 195846b57eca 2023-10-08T12:40:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6 smithi059 running (4m) 22s ago 4m 57.6M 4318M 18.0.0-6639-g7b3143ba 09a1f3752b5d 77ac5d62d092 2023-10-08T12:40:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7 smithi092 running (3m) 24s ago 3m 64.9M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 977fe4de534c 2023-10-08T12:40:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8 smithi173 running (3m) 24s ago 3m 59.5M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 89bf43885644 2023-10-08T12:40:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9 smithi059 running (3m) 22s ago 3m 54.7M 4318M 18.0.0-6639-g7b3143ba 09a1f3752b5d d8df4b962dc2 2023-10-08T12:40:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10 smithi092 running (2m) 24s ago 2m 61.1M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 0170fba53ee3 2023-10-08T12:40:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11 smithi173 running (2m) 24s ago 2m 53.0M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 13436523f137 2023-10-08T12:40:44.380 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:43 smithi092 ceph-mon[134093]: pgmap v300: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2023-10-08T12:40:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.378+0000 7fb2d3081700 1 -- 172.21.15.59:0/3685954682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2bc0a14d0 msgr2=0x7fb2bc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.378+0000 7fb2d3081700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2bc0a14d0 0x7fb2bc0a3990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc19a420 tx=0x7fb2b8009260 comp rx=0 tx=0).stop 2023-10-08T12:40:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.378+0000 7fb2d3081700 1 -- 172.21.15.59:0/3685954682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2cc072a20 msgr2=0x7fb2cc198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.378+0000 7fb2d3081700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2cc072a20 0x7fb2cc198ec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0005910 tx=0x7fb2c0004730 comp rx=0 tx=0).stop 2023-10-08T12:40:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.378+0000 7fb2d3081700 1 -- 172.21.15.59:0/3685954682 shutdown_connections 2023-10-08T12:40:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.378+0000 7fb2d3081700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb2bc0a14d0 0x7fb2bc0a3990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.378+0000 7fb2d3081700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2cc10d250 0x7fb2cc19d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.378+0000 7fb2d3081700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2cc072a20 0x7fb2cc198ec0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.378+0000 7fb2d3081700 1 --2- 172.21.15.59:0/3685954682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2cc073340 0x7fb2cc199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.378+0000 7fb2d3081700 1 -- 172.21.15.59:0/3685954682 >> 172.21.15.59:0/3685954682 conn(0x7fb2cc0779e0 msgr2=0x7fb2cc0fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:44.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.379+0000 7fb2d3081700 1 -- 172.21.15.59:0/3685954682 shutdown_connections 2023-10-08T12:40:44.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:44.379+0000 7fb2d3081700 1 -- 172.21.15.59:0/3685954682 wait complete. 2023-10-08T12:40:44.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:46.085 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:45 smithi059 ceph-mon[98489]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:46.085 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:45 smithi059 ceph-mon[98489]: pgmap v301: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2023-10-08T12:40:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:45 smithi173 ceph-mon[135182]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:45 smithi173 ceph-mon[135182]: pgmap v301: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2023-10-08T12:40:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:45 smithi092 ceph-mon[134093]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:45 smithi092 ceph-mon[134093]: pgmap v301: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2023-10-08T12:40:47.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.040+0000 7fe4fb358700 1 -- 172.21.15.59:0/1591689569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f41008a0 msgr2=0x7fe4f4100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.040+0000 7fe4fb358700 1 --2- 172.21.15.59:0/1591689569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f41008a0 0x7fe4f4100d20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009990 tx=0x7fe4e4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.040+0000 7fe4fb358700 1 -- 172.21.15.59:0/1591689569 shutdown_connections 2023-10-08T12:40:47.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.040+0000 7fe4fb358700 1 --2- 172.21.15.59:0/1591689569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f41057c0 0x7fe4f4105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.040+0000 7fe4fb358700 1 --2- 172.21.15.59:0/1591689569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f4101260 0x7fe4f410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.040+0000 7fe4fb358700 1 --2- 172.21.15.59:0/1591689569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f41008a0 0x7fe4f4100d20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.040+0000 7fe4fb358700 1 -- 172.21.15.59:0/1591689569 >> 172.21.15.59:0/1591689569 conn(0x7fe4f40779e0 msgr2=0x7fe4f4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:47.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.040+0000 7fe4fb358700 1 -- 172.21.15.59:0/1591689569 shutdown_connections 2023-10-08T12:40:47.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.040+0000 7fe4fb358700 1 -- 172.21.15.59:0/1591689569 wait complete. 2023-10-08T12:40:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.041+0000 7fe4fb358700 1 Processor -- start 2023-10-08T12:40:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.041+0000 7fe4fb358700 1 -- start start 2023-10-08T12:40:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4fb358700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f41008a0 0x7fe4f419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4fb358700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f4101260 0x7fe4f419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4fb358700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f41057c0 0x7fe4f4196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4fb358700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f41970a0 con 0x7fe4f41008a0 2023-10-08T12:40:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4fb358700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f41971e0 con 0x7fe4f4101260 2023-10-08T12:40:47.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4fb358700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f41973a0 con 0x7fe4f41057c0 2023-10-08T12:40:47.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4f90f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f41008a0 0x7fe4f419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4f90f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f41008a0 0x7fe4f419c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47908/0 (socket says 172.21.15.59:47908) 2023-10-08T12:40:47.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4f90f4700 1 -- 172.21.15.59:0/2378355164 learned_addr learned my addr 172.21.15.59:0/2378355164 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:47.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4f98f5700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f41057c0 0x7fe4f4196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4f88f3700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f4101260 0x7fe4f419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4f90f4700 1 -- 172.21.15.59:0/2378355164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f41057c0 msgr2=0x7fe4f4196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4f90f4700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f41057c0 0x7fe4f4196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4f90f4700 1 -- 172.21.15.59:0/2378355164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f4101260 msgr2=0x7fe4f419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4f90f4700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f4101260 0x7fe4f419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.042+0000 7fe4f90f4700 1 -- 172.21.15.59:0/2378355164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e40095f0 con 0x7fe4f41008a0 2023-10-08T12:40:47.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.043+0000 7fe4f90f4700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f41008a0 0x7fe4f419c830 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000e970 tx=0x7fe4f000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:47.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.043+0000 7fe4ea7fc700 1 -- 172.21.15.59:0/2378355164 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0009790 con 0x7fe4f41008a0 2023-10-08T12:40:47.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.043+0000 7fe4ea7fc700 1 -- 172.21.15.59:0/2378355164 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4f000c7e0 con 0x7fe4f41008a0 2023-10-08T12:40:47.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.043+0000 7fe4ea7fc700 1 -- 172.21.15.59:0/2378355164 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0003c70 con 0x7fe4f41008a0 2023-10-08T12:40:47.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.043+0000 7fe4fb358700 1 -- 172.21.15.59:0/2378355164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f4197680 con 0x7fe4f41008a0 2023-10-08T12:40:47.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.043+0000 7fe4fb358700 1 -- 172.21.15.59:0/2378355164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f41a38d0 con 0x7fe4f41008a0 2023-10-08T12:40:47.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.044+0000 7fe4fb358700 1 -- 172.21.15.59:0/2378355164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f4108da0 con 0x7fe4f41008a0 2023-10-08T12:40:47.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.046+0000 7fe4ea7fc700 1 -- 172.21.15.59:0/2378355164 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe4f000cc50 con 0x7fe4f41008a0 2023-10-08T12:40:47.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.048+0000 7fe4ea7fc700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e00a1550 0x7fe4e00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.048+0000 7fe4ea7fc700 1 -- 172.21.15.59:0/2378355164 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe4f0014070 con 0x7fe4f41008a0 2023-10-08T12:40:47.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.048+0000 7fe4f88f3700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e00a1550 0x7fe4e00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.049+0000 7fe4f88f3700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e00a1550 0x7fe4e00a3a10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4100710 tx=0x7fe4e4005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:47.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.052+0000 7fe4ea7fc700 1 -- 172.21.15.59:0/2378355164 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe4f0096490 con 0x7fe4f41008a0 2023-10-08T12:40:47.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.269+0000 7fe4fb358700 1 -- 172.21.15.59:0/2378355164 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4f41107a0 con 0x7fe4e00a1550 2023-10-08T12:40:47.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.276+0000 7fe4ea7fc700 1 -- 172.21.15.59:0/2378355164 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fe4f41107a0 con 0x7fe4e00a1550 2023-10-08T12:40:47.276 INFO:teuthology.orchestra.run.smithi059.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-08T12:40:47.276 INFO:teuthology.orchestra.run.smithi059.stdout:mds.all 12/12 27s ago 2m smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2023-10-08T12:40:47.276 INFO:teuthology.orchestra.run.smithi059.stdout:mgr 3/3 27s ago 7m smithi059=x;smithi092=y;smithi173=z;count:3 2023-10-08T12:40:47.276 INFO:teuthology.orchestra.run.smithi059.stdout:mon 3/3 27s ago 8m smithi059:172.21.15.59=a;smithi092:172.21.15.92=b;smithi173:172.21.15.173=c;count:3 2023-10-08T12:40:47.276 INFO:teuthology.orchestra.run.smithi059.stdout:osd 12 27s ago - 2023-10-08T12:40:47.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.278+0000 7fe4fb358700 1 -- 172.21.15.59:0/2378355164 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e00a1550 msgr2=0x7fe4e00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.278+0000 7fe4fb358700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e00a1550 0x7fe4e00a3a10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4100710 tx=0x7fe4e4005fd0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.278+0000 7fe4fb358700 1 -- 172.21.15.59:0/2378355164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f41008a0 msgr2=0x7fe4f419c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.278+0000 7fe4fb358700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f41008a0 0x7fe4f419c830 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000e970 tx=0x7fe4f000ec80 comp rx=0 tx=0).stop 2023-10-08T12:40:47.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.278+0000 7fe4fb358700 1 -- 172.21.15.59:0/2378355164 shutdown_connections 2023-10-08T12:40:47.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.278+0000 7fe4fb358700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e00a1550 0x7fe4e00a3a10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.278+0000 7fe4fb358700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f41057c0 0x7fe4f4196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.278+0000 7fe4fb358700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f41008a0 0x7fe4f419c830 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.278+0000 7fe4fb358700 1 --2- 172.21.15.59:0/2378355164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f4101260 0x7fe4f419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.278+0000 7fe4fb358700 1 -- 172.21.15.59:0/2378355164 >> 172.21.15.59:0/2378355164 conn(0x7fe4f40779e0 msgr2=0x7fe4f40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:47.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.279+0000 7fe4fb358700 1 -- 172.21.15.59:0/2378355164 shutdown_connections 2023-10-08T12:40:47.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:47.279+0000 7fe4fb358700 1 -- 172.21.15.59:0/2378355164 wait complete. 2023-10-08T12:40:47.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-08T12:40:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:47 smithi173 ceph-mon[135182]: pgmap v302: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:48.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:47 smithi059 ceph-mon[98489]: pgmap v302: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:47 smithi092 ceph-mon[134093]: pgmap v302: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:48.551 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:49.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:48 smithi059 ceph-mon[98489]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:48 smithi173 ceph-mon[135182]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:48 smithi092 ceph-mon[134093]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.122+0000 7f64ca5d6700 1 -- 172.21.15.59:0/3484283277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c41057c0 msgr2=0x7f64c4105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.122+0000 7f64ca5d6700 1 --2- 172.21.15.59:0/3484283277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c41057c0 0x7f64c4105ba0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009990 tx=0x7f64b4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.122+0000 7f64ca5d6700 1 -- 172.21.15.59:0/3484283277 shutdown_connections 2023-10-08T12:40:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.122+0000 7f64ca5d6700 1 --2- 172.21.15.59:0/3484283277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c4101260 0x7f64c410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.122+0000 7f64ca5d6700 1 --2- 172.21.15.59:0/3484283277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c41057c0 0x7f64c4105ba0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.122+0000 7f64ca5d6700 1 --2- 172.21.15.59:0/3484283277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c41008a0 0x7f64c4100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:50.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.122+0000 7f64ca5d6700 1 -- 172.21.15.59:0/3484283277 >> 172.21.15.59:0/3484283277 conn(0x7f64c40779e0 msgr2=0x7f64c4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:50.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.122+0000 7f64ca5d6700 1 -- 172.21.15.59:0/3484283277 shutdown_connections 2023-10-08T12:40:50.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.122+0000 7f64ca5d6700 1 -- 172.21.15.59:0/3484283277 wait complete. 2023-10-08T12:40:50.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.123+0000 7f64ca5d6700 1 Processor -- start 2023-10-08T12:40:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64ca5d6700 1 -- start start 2023-10-08T12:40:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64ca5d6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c41008a0 0x7f64c4198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64ca5d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4101260 0x7f64c4199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64ca5d6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c41057c0 0x7f64c419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64ca5d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c419de00 con 0x7f64c4101260 2023-10-08T12:40:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64ca5d6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c419df70 con 0x7f64c41008a0 2023-10-08T12:40:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64ca5d6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c419e130 con 0x7f64c41057c0 2023-10-08T12:40:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64c3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c41008a0 0x7f64c4198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64c3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c41008a0 0x7f64c4198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50370/0 (socket says 172.21.15.59:50370) 2023-10-08T12:40:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64c3fff700 1 -- 172.21.15.59:0/1722864657 learned_addr learned my addr 172.21.15.59:0/1722864657 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64c37fe700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4101260 0x7f64c4199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.124+0000 7f64c8b73700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c41057c0 0x7f64c419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.125+0000 7f64c3fff700 1 -- 172.21.15.59:0/1722864657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c41057c0 msgr2=0x7f64c419d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.125+0000 7f64c3fff700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c41057c0 0x7f64c419d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.125+0000 7f64c3fff700 1 -- 172.21.15.59:0/1722864657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4101260 msgr2=0x7f64c4199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.125+0000 7f64c3fff700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4101260 0x7f64c4199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.125+0000 7f64c3fff700 1 -- 172.21.15.59:0/1722864657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40095f0 con 0x7f64c41008a0 2023-10-08T12:40:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.125+0000 7f64c3fff700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c41008a0 0x7f64c4198f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64b4000c00 tx=0x7f64b4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.125+0000 7f64c17fa700 1 -- 172.21.15.59:0/1722864657 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b401d070 con 0x7f64c41008a0 2023-10-08T12:40:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.125+0000 7f64ca5d6700 1 -- 172.21.15.59:0/1722864657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c419e3b0 con 0x7f64c41008a0 2023-10-08T12:40:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.125+0000 7f64c17fa700 1 -- 172.21.15.59:0/1722864657 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64b4022470 con 0x7f64c41008a0 2023-10-08T12:40:50.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.125+0000 7f64c17fa700 1 -- 172.21.15.59:0/1722864657 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4017650 con 0x7f64c41008a0 2023-10-08T12:40:50.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.125+0000 7f64ca5d6700 1 -- 172.21.15.59:0/1722864657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c41a5c70 con 0x7f64c41008a0 2023-10-08T12:40:50.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.126+0000 7f64ca5d6700 1 -- 172.21.15.59:0/1722864657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c4101f30 con 0x7f64c41008a0 2023-10-08T12:40:50.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.128+0000 7f64c17fa700 1 -- 172.21.15.59:0/1722864657 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f64b400fad0 con 0x7f64c41008a0 2023-10-08T12:40:50.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.130+0000 7f64c17fa700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f64ac0a14d0 0x7f64ac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:50.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.130+0000 7f64c17fa700 1 -- 172.21.15.59:0/1722864657 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f64b40ce810 con 0x7f64c41008a0 2023-10-08T12:40:50.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.130+0000 7f64c37fe700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f64ac0a14d0 0x7f64ac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:50.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.131+0000 7f64c37fe700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f64ac0a14d0 0x7f64ac0a3990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64c419a460 tx=0x7f64b8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.132+0000 7f64c17fa700 1 -- 172.21.15.59:0/1722864657 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f64b4097e00 con 0x7f64c41008a0 2023-10-08T12:40:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:49 smithi173 ceph-mon[135182]: pgmap v303: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:50.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:49 smithi059 ceph-mon[98489]: pgmap v303: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:50.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.353+0000 7f64ca5d6700 1 -- 172.21.15.59:0/1722864657 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f64c419a210 con 0x7f64ac0a14d0 2023-10-08T12:40:50.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.354+0000 7f64c17fa700 1 -- 172.21.15.59:0/1722864657 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f64c419a210 con 0x7f64ac0a14d0 2023-10-08T12:40:50.356 INFO:teuthology.orchestra.run.smithi059.stdout:HOST ADDR LABELS STATUS 2023-10-08T12:40:50.356 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059 172.21.15.59 2023-10-08T12:40:50.356 INFO:teuthology.orchestra.run.smithi059.stdout:smithi092 172.21.15.92 2023-10-08T12:40:50.356 INFO:teuthology.orchestra.run.smithi059.stdout:smithi173 172.21.15.173 2023-10-08T12:40:50.356 INFO:teuthology.orchestra.run.smithi059.stdout:3 hosts in cluster 2023-10-08T12:40:50.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 -- 172.21.15.59:0/1722864657 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f64ac0a14d0 msgr2=0x7f64ac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f64ac0a14d0 0x7f64ac0a3990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64c419a460 tx=0x7f64b8009260 comp rx=0 tx=0).stop 2023-10-08T12:40:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 -- 172.21.15.59:0/1722864657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c41008a0 msgr2=0x7f64c4198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c41008a0 0x7f64c4198f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64b4000c00 tx=0x7f64b4005740 comp rx=0 tx=0).stop 2023-10-08T12:40:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 -- 172.21.15.59:0/1722864657 shutdown_connections 2023-10-08T12:40:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f64ac0a14d0 0x7f64ac0a3990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c41008a0 0x7f64c4198f00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c41057c0 0x7f64c419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 --2- 172.21.15.59:0/1722864657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4101260 0x7f64c4199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 -- 172.21.15.59:0/1722864657 >> 172.21.15.59:0/1722864657 conn(0x7f64c40779e0 msgr2=0x7f64c410ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:50.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 -- 172.21.15.59:0/1722864657 shutdown_connections 2023-10-08T12:40:50.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:50.357+0000 7f64ca5d6700 1 -- 172.21.15.59:0/1722864657 wait complete. 2023-10-08T12:40:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:49 smithi092 ceph-mon[134093]: pgmap v303: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:50.827 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-08T12:40:51.564 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:52.213 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:51 smithi059 ceph-mon[98489]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:52.214 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:51 smithi059 ceph-mon[98489]: pgmap v304: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:51 smithi173 ceph-mon[135182]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:51 smithi173 ceph-mon[135182]: pgmap v304: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:51 smithi092 ceph-mon[134093]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:51 smithi092 ceph-mon[134093]: pgmap v304: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:53.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.172+0000 7f5093ae1700 1 -- 172.21.15.59:0/312136160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f508c1057c0 msgr2=0x7f508c105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:53.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.172+0000 7f5093ae1700 1 --2- 172.21.15.59:0/312136160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f508c1057c0 0x7f508c105ba0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5088009990 tx=0x7f5088009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:53.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.172+0000 7f5093ae1700 1 -- 172.21.15.59:0/312136160 shutdown_connections 2023-10-08T12:40:53.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.172+0000 7f5093ae1700 1 --2- 172.21.15.59:0/312136160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f508c101260 0x7f508c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:53.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.172+0000 7f5093ae1700 1 --2- 172.21.15.59:0/312136160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f508c1057c0 0x7f508c105ba0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:53.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.172+0000 7f5093ae1700 1 --2- 172.21.15.59:0/312136160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f508c1008a0 0x7f508c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:53.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.172+0000 7f5093ae1700 1 -- 172.21.15.59:0/312136160 >> 172.21.15.59:0/312136160 conn(0x7f508c0779e0 msgr2=0x7f508c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:53.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.173+0000 7f5093ae1700 1 -- 172.21.15.59:0/312136160 shutdown_connections 2023-10-08T12:40:53.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.173+0000 7f5093ae1700 1 -- 172.21.15.59:0/312136160 wait complete. 2023-10-08T12:40:53.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.174+0000 7f5093ae1700 1 Processor -- start 2023-10-08T12:40:53.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.174+0000 7f5093ae1700 1 -- start start 2023-10-08T12:40:53.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.174+0000 7f5093ae1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f508c1008a0 0x7f508c19c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:53.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.174+0000 7f5093ae1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f508c101260 0x7f508c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:53.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.174+0000 7f5093ae1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f508c1057c0 0x7f508c196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.174+0000 7f5093ae1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c1970e0 con 0x7f508c1057c0 2023-10-08T12:40:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.174+0000 7f5093ae1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c197250 con 0x7f508c1008a0 2023-10-08T12:40:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.174+0000 7f5093ae1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c197410 con 0x7f508c101260 2023-10-08T12:40:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.174+0000 7f509207e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f508c1057c0 0x7f508c196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.174+0000 7f509107c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f508c101260 0x7f508c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f509107c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f508c101260 0x7f508c19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:50992/0 (socket says 172.21.15.59:50992) 2023-10-08T12:40:53.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f509107c700 1 -- 172.21.15.59:0/2506212069 learned_addr learned my addr 172.21.15.59:0/2506212069 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f509207e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f508c1057c0 0x7f508c196a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45308/0 (socket says 172.21.15.59:45308) 2023-10-08T12:40:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f509187d700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f508c1008a0 0x7f508c19c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f509207e700 1 -- 172.21.15.59:0/2506212069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f508c101260 msgr2=0x7f508c19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f509207e700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f508c101260 0x7f508c19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f509207e700 1 -- 172.21.15.59:0/2506212069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f508c1008a0 msgr2=0x7f508c19c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f509207e700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f508c1008a0 0x7f508c19c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f509207e700 1 -- 172.21.15.59:0/2506212069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50880095f0 con 0x7f508c1057c0 2023-10-08T12:40:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f509107c700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f508c101260 0x7f508c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f509207e700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f508c1057c0 0x7f508c196a80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f508400efc0 tx=0x7f508400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f5082ffd700 1 -- 172.21.15.59:0/2506212069 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084018070 con 0x7f508c1057c0 2023-10-08T12:40:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f5093ae1700 1 -- 172.21.15.59:0/2506212069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c197690 con 0x7f508c1057c0 2023-10-08T12:40:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f5082ffd700 1 -- 172.21.15.59:0/2506212069 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f508400f040 con 0x7f508c1057c0 2023-10-08T12:40:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.175+0000 7f5082ffd700 1 -- 172.21.15.59:0/2506212069 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400cc80 con 0x7f508c1057c0 2023-10-08T12:40:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.176+0000 7f5093ae1700 1 -- 172.21.15.59:0/2506212069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c1a3930 con 0x7f508c1057c0 2023-10-08T12:40:53.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.177+0000 7f5093ae1700 1 -- 172.21.15.59:0/2506212069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c108d80 con 0x7f508c1057c0 2023-10-08T12:40:53.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.179+0000 7f5082ffd700 1 -- 172.21.15.59:0/2506212069 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5084003a00 con 0x7f508c1057c0 2023-10-08T12:40:53.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.180+0000 7f5082ffd700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50780a1550 0x7f50780a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:53.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.180+0000 7f5082ffd700 1 -- 172.21.15.59:0/2506212069 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f50840cc820 con 0x7f508c1057c0 2023-10-08T12:40:53.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.180+0000 7f509187d700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50780a1550 0x7f50780a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:53.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.181+0000 7f509187d700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50780a1550 0x7f50780a3a10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5088006010 tx=0x7f508800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:53.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.184+0000 7f5082ffd700 1 -- 172.21.15.59:0/2506212069 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5084095e10 con 0x7f508c1057c0 2023-10-08T12:40:53.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.402+0000 7f5093ae1700 1 -- 172.21.15.59:0/2506212069 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f508c197f40 con 0x7f50780a1550 2023-10-08T12:40:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.403+0000 7f5082ffd700 1 -- 172.21.15.59:0/2506212069 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f508c197f40 con 0x7f50780a1550 2023-10-08T12:40:53.404 INFO:teuthology.orchestra.run.smithi059.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-08T12:40:53.405 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009L400BGN 372G No 3m ago Has a FileSystem, LVM detected 2023-10-08T12:40:53.405 INFO:teuthology.orchestra.run.smithi059.stdout:smithi092 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QM400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-08T12:40:53.405 INFO:teuthology.orchestra.run.smithi059.stdout:smithi173 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204019S400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-08T12:40:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 -- 172.21.15.59:0/2506212069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50780a1550 msgr2=0x7f50780a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50780a1550 0x7f50780a3a10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5088006010 tx=0x7f508800b260 comp rx=0 tx=0).stop 2023-10-08T12:40:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 -- 172.21.15.59:0/2506212069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f508c1057c0 msgr2=0x7f508c196a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f508c1057c0 0x7f508c196a80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f508400efc0 tx=0x7f508400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:40:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 -- 172.21.15.59:0/2506212069 shutdown_connections 2023-10-08T12:40:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50780a1550 0x7f50780a3a10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f508c1008a0 0x7f508c19c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f508c1057c0 0x7f508c196a80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 --2- 172.21.15.59:0/2506212069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f508c101260 0x7f508c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 -- 172.21.15.59:0/2506212069 >> 172.21.15.59:0/2506212069 conn(0x7f508c0779e0 msgr2=0x7f508c0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 -- 172.21.15.59:0/2506212069 shutdown_connections 2023-10-08T12:40:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:53.406+0000 7f5093ae1700 1 -- 172.21.15.59:0/2506212069 wait complete. 2023-10-08T12:40:53.845 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-08T12:40:53.856 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2023-10-08T12:40:53.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-08T12:40:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:53 smithi173 ceph-mon[135182]: pgmap v305: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:54.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:53 smithi059 ceph-mon[98489]: pgmap v305: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:53 smithi092 ceph-mon[134093]: pgmap v305: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:54.598 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:55.122 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:54 smithi059 ceph-mon[98489]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:54 smithi173 ceph-mon[135182]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:55.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:54 smithi092 ceph-mon[134093]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:40:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.970+0000 7f56fb8ba700 1 -- 172.21.15.59:0/1259629056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f41057c0 msgr2=0x7f56f4105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.970+0000 7f56fb8ba700 1 --2- 172.21.15.59:0/1259629056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f41057c0 0x7f56f4105ba0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009990 tx=0x7f56f0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.971+0000 7f56fb8ba700 1 -- 172.21.15.59:0/1259629056 shutdown_connections 2023-10-08T12:40:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.971+0000 7f56fb8ba700 1 --2- 172.21.15.59:0/1259629056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56f4101260 0x7f56f410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.971+0000 7f56fb8ba700 1 --2- 172.21.15.59:0/1259629056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f41057c0 0x7f56f4105ba0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.971+0000 7f56fb8ba700 1 --2- 172.21.15.59:0/1259629056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f41008a0 0x7f56f4100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.971+0000 7f56fb8ba700 1 -- 172.21.15.59:0/1259629056 >> 172.21.15.59:0/1259629056 conn(0x7f56f40779e0 msgr2=0x7f56f4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.971+0000 7f56fb8ba700 1 -- 172.21.15.59:0/1259629056 shutdown_connections 2023-10-08T12:40:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.971+0000 7f56fb8ba700 1 -- 172.21.15.59:0/1259629056 wait complete. 2023-10-08T12:40:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.972+0000 7f56fb8ba700 1 Processor -- start 2023-10-08T12:40:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.972+0000 7f56fb8ba700 1 -- start start 2023-10-08T12:40:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56fb8ba700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56f41008a0 0x7f56f4072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56fb8ba700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f4101260 0x7f56f4073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56fb8ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f41057c0 0x7f56f4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56fb8ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f41a4fe0 con 0x7f56f41057c0 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56fb8ba700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f41a5150 con 0x7f56f4101260 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56fb8ba700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f41a5310 con 0x7f56f41008a0 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56f9e57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f41057c0 0x7f56f4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56f9e57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f41057c0 0x7f56f4073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45322/0 (socket says 172.21.15.59:45322) 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56f9e57700 1 -- 172.21.15.59:0/320087443 learned_addr learned my addr 172.21.15.59:0/320087443 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56f8e55700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f4101260 0x7f56f4073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56f9656700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56f41008a0 0x7f56f4072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56f9e57700 1 -- 172.21.15.59:0/320087443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56f41008a0 msgr2=0x7f56f4072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56f9e57700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56f41008a0 0x7f56f4072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56f9e57700 1 -- 172.21.15.59:0/320087443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f4101260 msgr2=0x7f56f4073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56f9e57700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f4101260 0x7f56f4073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.973+0000 7f56f9e57700 1 -- 172.21.15.59:0/320087443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f00095f0 con 0x7f56f41057c0 2023-10-08T12:40:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.974+0000 7f56f9e57700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f41057c0 0x7f56f4073570 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f56ec007f10 tx=0x7f56ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.974+0000 7f56ea7fc700 1 -- 172.21.15.59:0/320087443 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec017070 con 0x7f56f41057c0 2023-10-08T12:40:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.974+0000 7f56fb8ba700 1 -- 172.21.15.59:0/320087443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f41a55f0 con 0x7f56f41057c0 2023-10-08T12:40:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.974+0000 7f56ea7fc700 1 -- 172.21.15.59:0/320087443 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56ec00f040 con 0x7f56f41057c0 2023-10-08T12:40:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.974+0000 7f56ea7fc700 1 -- 172.21.15.59:0/320087443 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0054b0 con 0x7f56f41057c0 2023-10-08T12:40:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.974+0000 7f56fb8ba700 1 -- 172.21.15.59:0/320087443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f41a5af0 con 0x7f56f41057c0 2023-10-08T12:40:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.975+0000 7f56fb8ba700 1 -- 172.21.15.59:0/320087443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f4108d80 con 0x7f56f41057c0 2023-10-08T12:40:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.977+0000 7f56ea7fc700 1 -- 172.21.15.59:0/320087443 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f56ec004ad0 con 0x7f56f41057c0 2023-10-08T12:40:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.979+0000 7f56ea7fc700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56e00a14d0 0x7f56e00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.980+0000 7f56ea7fc700 1 -- 172.21.15.59:0/320087443 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f56ec0cc4a0 con 0x7f56f41057c0 2023-10-08T12:40:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.980+0000 7f56f9656700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56e00a14d0 0x7f56e00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.980+0000 7f56f9656700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56e00a14d0 0x7f56e00a3990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f56f0006010 tx=0x7f56f0005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:55.984+0000 7f56ea7fc700 1 -- 172.21.15.59:0/320087443 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f56ec095a00 con 0x7f56f41057c0 2023-10-08T12:40:56.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:55 smithi059 ceph-mon[98489]: pgmap v306: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:55 smithi173 ceph-mon[135182]: pgmap v306: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:56.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.240+0000 7f56fb8ba700 1 -- 172.21.15.59:0/320087443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f56f4073f80 con 0x7f56f41057c0 2023-10-08T12:40:56.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.240+0000 7f56ea7fc700 1 -- 172.21.15.59:0/320087443 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+2909 (secure 0 0 0) 0x7f56ec099020 con 0x7f56f41057c0 2023-10-08T12:40:56.241 INFO:teuthology.orchestra.run.smithi059.stdout:e20 2023-10-08T12:40:56.241 INFO:teuthology.orchestra.run.smithi059.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T12:40:56.242 INFO:teuthology.orchestra.run.smithi059.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:40:56.242 INFO:teuthology.orchestra.run.smithi059.stdout:legacy client fscid: 1 2023-10-08T12:40:56.242 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:56.242 INFO:teuthology.orchestra.run.smithi059.stdout:Filesystem 'cephfs' (1) 2023-10-08T12:40:56.242 INFO:teuthology.orchestra.run.smithi059.stdout:fs_name cephfs 2023-10-08T12:40:56.242 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 20 2023-10-08T12:40:56.242 INFO:teuthology.orchestra.run.smithi059.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-08T12:40:56.242 INFO:teuthology.orchestra.run.smithi059.stdout:created 2023-10-08T12:39:13.722264+0000 2023-10-08T12:40:56.242 INFO:teuthology.orchestra.run.smithi059.stdout:modified 2023-10-08T12:39:18.723320+0000 2023-10-08T12:40:56.242 INFO:teuthology.orchestra.run.smithi059.stdout:tableserver 0 2023-10-08T12:40:56.243 INFO:teuthology.orchestra.run.smithi059.stdout:root 0 2023-10-08T12:40:56.243 INFO:teuthology.orchestra.run.smithi059.stdout:session_timeout 300 2023-10-08T12:40:56.243 INFO:teuthology.orchestra.run.smithi059.stdout:session_autoclose 300 2023-10-08T12:40:56.243 INFO:teuthology.orchestra.run.smithi059.stdout:max_file_size 1099511627776 2023-10-08T12:40:56.243 INFO:teuthology.orchestra.run.smithi059.stdout:max_xattr_size 65536 2023-10-08T12:40:56.243 INFO:teuthology.orchestra.run.smithi059.stdout:required_client_features {} 2023-10-08T12:40:56.243 INFO:teuthology.orchestra.run.smithi059.stdout:last_failure 0 2023-10-08T12:40:56.243 INFO:teuthology.orchestra.run.smithi059.stdout:last_failure_osd_epoch 0 2023-10-08T12:40:56.243 INFO:teuthology.orchestra.run.smithi059.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:40:56.243 INFO:teuthology.orchestra.run.smithi059.stdout:max_mds 1 2023-10-08T12:40:56.244 INFO:teuthology.orchestra.run.smithi059.stdout:in 0 2023-10-08T12:40:56.244 INFO:teuthology.orchestra.run.smithi059.stdout:up {0=24710} 2023-10-08T12:40:56.244 INFO:teuthology.orchestra.run.smithi059.stdout:failed 2023-10-08T12:40:56.244 INFO:teuthology.orchestra.run.smithi059.stdout:damaged 2023-10-08T12:40:56.244 INFO:teuthology.orchestra.run.smithi059.stdout:stopped 2023-10-08T12:40:56.244 INFO:teuthology.orchestra.run.smithi059.stdout:data_pools [3] 2023-10-08T12:40:56.244 INFO:teuthology.orchestra.run.smithi059.stdout:metadata_pool 2 2023-10-08T12:40:56.244 INFO:teuthology.orchestra.run.smithi059.stdout:inline_data disabled 2023-10-08T12:40:56.244 INFO:teuthology.orchestra.run.smithi059.stdout:balancer 2023-10-08T12:40:56.244 INFO:teuthology.orchestra.run.smithi059.stdout:bal_rank_mask -1 2023-10-08T12:40:56.244 INFO:teuthology.orchestra.run.smithi059.stdout:standby_count_wanted 0 2023-10-08T12:40:56.245 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b{0:24710} state up:active seq 3 addr [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.245 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.i{0:24673} state up:standby-replay seq 1 addr [v2:172.21.15.173:6838/2951536251,v1:172.21.15.173:6839/2951536251] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.245 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:56.245 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:56.245 INFO:teuthology.orchestra.run.smithi059.stdout:Standby daemons: 2023-10-08T12:40:56.245 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:40:56.245 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d{-1:14619} state up:standby seq 1 addr [v2:172.21.15.59:6836/1582249232,v1:172.21.15.59:6837/1582249232] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.245 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.g{-1:14676} state up:standby seq 1 addr [v2:172.21.15.59:6838/3140194439,v1:172.21.15.59:6839/3140194439] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.245 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a{-1:14688} state up:standby seq 1 addr [v2:172.21.15.59:6840/3603700494,v1:172.21.15.59:6841/3603700494] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.245 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.k{-1:24593} state up:standby seq 1 addr [v2:172.21.15.92:6832/2525965671,v1:172.21.15.92:6833/2525965671] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.245 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.l{-1:24595} state up:standby seq 1 addr [v2:172.21.15.173:6832/3717916833,v1:172.21.15.173:6833/3717916833] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.246 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.j{-1:24611} state up:standby seq 1 addr [v2:172.21.15.59:6834/353168083,v1:172.21.15.59:6835/353168083] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.246 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.e{-1:24635} state up:standby seq 1 addr [v2:172.21.15.92:6834/798745329,v1:172.21.15.92:6835/798745329] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.246 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.f{-1:24646} state up:standby seq 1 addr [v2:172.21.15.173:6834/1081657553,v1:172.21.15.173:6835/1081657553] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.246 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c{-1:24658} state up:standby seq 1 addr [v2:172.21.15.173:6836/1001466762,v1:172.21.15.173:6837/1001466762] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.246 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.h{-1:24665} state up:standby seq 1 addr [v2:172.21.15.92:6836/3270985909,v1:172.21.15.92:6837/3270985909] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:40:56.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 -- 172.21.15.59:0/320087443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56e00a14d0 msgr2=0x7f56e00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:56.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56e00a14d0 0x7f56e00a3990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f56f0006010 tx=0x7f56f0005960 comp rx=0 tx=0).stop 2023-10-08T12:40:56.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 -- 172.21.15.59:0/320087443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f41057c0 msgr2=0x7f56f4073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:56.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f41057c0 0x7f56f4073570 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f56ec007f10 tx=0x7f56ec00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:56.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 -- 172.21.15.59:0/320087443 shutdown_connections 2023-10-08T12:40:56.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56e00a14d0 0x7f56e00a3990 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:56.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f41057c0 0x7f56f4073570 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:56.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56f41008a0 0x7f56f4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:56.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 --2- 172.21.15.59:0/320087443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f4101260 0x7f56f4073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:56.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 -- 172.21.15.59:0/320087443 >> 172.21.15.59:0/320087443 conn(0x7f56f40779e0 msgr2=0x7f56f40fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:56.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 -- 172.21.15.59:0/320087443 shutdown_connections 2023-10-08T12:40:56.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:56.243+0000 7f56fb8ba700 1 -- 172.21.15.59:0/320087443 wait complete. 2023-10-08T12:40:56.248 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:40:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:55 smithi092 ceph-mon[134093]: pgmap v306: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:56.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-08T12:40:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:56 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/320087443' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T12:40:57.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:56 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/320087443' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T12:40:57.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:56 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/320087443' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T12:40:57.519 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:40:58.063 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:57 smithi059 ceph-mon[98489]: pgmap v307: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:57 smithi173 ceph-mon[135182]: pgmap v307: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:57 smithi092 ceph-mon[134093]: pgmap v307: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2023-10-08T12:40:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.888+0000 7fb4af355700 1 -- 172.21.15.59:0/152418880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a8101260 msgr2=0x7fb4a810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.888+0000 7fb4af355700 1 --2- 172.21.15.59:0/152418880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a8101260 0x7fb4a810d650 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000b0a0 tx=0x7fb4a000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.888+0000 7fb4af355700 1 -- 172.21.15.59:0/152418880 shutdown_connections 2023-10-08T12:40:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.888+0000 7fb4af355700 1 --2- 172.21.15.59:0/152418880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4a81057c0 0x7fb4a8105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.888+0000 7fb4af355700 1 --2- 172.21.15.59:0/152418880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a8101260 0x7fb4a810d650 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.888+0000 7fb4af355700 1 --2- 172.21.15.59:0/152418880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4a81008a0 0x7fb4a8100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.888+0000 7fb4af355700 1 -- 172.21.15.59:0/152418880 >> 172.21.15.59:0/152418880 conn(0x7fb4a80779e0 msgr2=0x7fb4a8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.888+0000 7fb4af355700 1 -- 172.21.15.59:0/152418880 shutdown_connections 2023-10-08T12:40:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.889+0000 7fb4af355700 1 -- 172.21.15.59:0/152418880 wait complete. 2023-10-08T12:40:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.890+0000 7fb4af355700 1 Processor -- start 2023-10-08T12:40:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.890+0000 7fb4af355700 1 -- start start 2023-10-08T12:40:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.891+0000 7fb4af355700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4a81008a0 0x7fb4a819c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.891+0000 7fb4af355700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4a8101260 0x7fb4a819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.891+0000 7fb4af355700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a81057c0 0x7fb4a8196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.891+0000 7fb4af355700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a8197180 con 0x7fb4a81057c0 2023-10-08T12:40:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.891+0000 7fb4af355700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81972c0 con 0x7fb4a81008a0 2023-10-08T12:40:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.891+0000 7fb4af355700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a8197480 con 0x7fb4a8101260 2023-10-08T12:40:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.891+0000 7fb4ad8f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a81057c0 0x7fb4a8196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.891+0000 7fb4ad0f1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4a81008a0 0x7fb4a819c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.891+0000 7fb4ad8f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a81057c0 0x7fb4a8196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45338/0 (socket says 172.21.15.59:45338) 2023-10-08T12:40:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.891+0000 7fb4ad8f2700 1 -- 172.21.15.59:0/280371622 learned_addr learned my addr 172.21.15.59:0/280371622 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.891+0000 7fb4ac8f0700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4a8101260 0x7fb4a819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb4ad8f2700 1 -- 172.21.15.59:0/280371622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4a8101260 msgr2=0x7fb4a819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb4ad8f2700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4a8101260 0x7fb4a819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb4ad8f2700 1 -- 172.21.15.59:0/280371622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4a81008a0 msgr2=0x7fb4a819c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb4ad8f2700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4a81008a0 0x7fb4a819c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb4ad8f2700 1 -- 172.21.15.59:0/280371622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a0009d00 con 0x7fb4a81057c0 2023-10-08T12:40:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb4ad0f1700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4a81008a0 0x7fb4a819c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb4ad8f2700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a81057c0 0x7fb4a8196b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000ceb0 tx=0x7fb4a000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb49e7fc700 1 -- 172.21.15.59:0/280371622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a000e040 con 0x7fb4a81057c0 2023-10-08T12:40:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb49e7fc700 1 -- 172.21.15.59:0/280371622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4a001b450 con 0x7fb4a81057c0 2023-10-08T12:40:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb4af355700 1 -- 172.21.15.59:0/280371622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a8197700 con 0x7fb4a81057c0 2023-10-08T12:40:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb49e7fc700 1 -- 172.21.15.59:0/280371622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a00052a0 con 0x7fb4a81057c0 2023-10-08T12:40:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.892+0000 7fb4af355700 1 -- 172.21.15.59:0/280371622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a81a3a20 con 0x7fb4a81057c0 2023-10-08T12:40:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.893+0000 7fb4af355700 1 -- 172.21.15.59:0/280371622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a8108da0 con 0x7fb4a81057c0 2023-10-08T12:40:58.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.895+0000 7fb49e7fc700 1 -- 172.21.15.59:0/280371622 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb4a001b5c0 con 0x7fb4a81057c0 2023-10-08T12:40:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.897+0000 7fb49e7fc700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4940a1550 0x7fb4940a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.897+0000 7fb49e7fc700 1 -- 172.21.15.59:0/280371622 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb4a00ce390 con 0x7fb4a81057c0 2023-10-08T12:40:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.897+0000 7fb4ad0f1700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4940a1550 0x7fb4940a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.897+0000 7fb4ad0f1700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4940a1550 0x7fb4940a3a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8101930 tx=0x7fb4a400b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:58.901+0000 7fb49e7fc700 1 -- 172.21.15.59:0/280371622 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb4a0097980 con 0x7fb4a81057c0 2023-10-08T12:40:59.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.112+0000 7fb4af355700 1 -- 172.21.15.59:0/280371622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fb4a8101f30 con 0x7fb4a81057c0 2023-10-08T12:40:59.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.113+0000 7fb49e7fc700 1 -- 172.21.15.59:0/280371622 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v86) v1 ==== 56+0+5626 (secure 0 0 0) 0x7fb4a009afa0 con 0x7fb4a81057c0 2023-10-08T12:40:59.114 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 86 2023-10-08T12:40:59.114 INFO:teuthology.orchestra.run.smithi059.stdout:fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T12:40:59.114 INFO:teuthology.orchestra.run.smithi059.stdout:created 2023-10-08T12:30:57.612939+0000 2023-10-08T12:40:59.114 INFO:teuthology.orchestra.run.smithi059.stdout:modified 2023-10-08T12:40:11.783762+0000 2023-10-08T12:40:59.114 INFO:teuthology.orchestra.run.smithi059.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:crush_version 26 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:full_ratio 0.95 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:backfillfull_ratio 0.9 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:nearfull_ratio 0.85 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:require_min_compat_client luminous 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:min_compat_client luminous 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:require_osd_release reef 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:stretch_mode_enabled false 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-10-08T12:40:59.115 INFO:teuthology.orchestra.run.smithi059.stdout:max_osd 12 2023-10-08T12:40:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0 up in weight 1 up_from 9 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6802/2710052555,v1:172.21.15.59:6803/2710052555] [v2:172.21.15.59:6804/2710052555,v1:172.21.15.59:6805/2710052555] exists,up b5340c12-0b40-4986-9508-e0a83f131b0a 2023-10-08T12:40:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1 up in weight 1 up_from 14 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6800/2233119167,v1:172.21.15.92:6801/2233119167] [v2:172.21.15.92:6802/2233119167,v1:172.21.15.92:6803/2233119167] exists,up a81a353e-18b3-4793-912d-cd6a9809bcbb 2023-10-08T12:40:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2 up in weight 1 up_from 19 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6800/425637029,v1:172.21.15.173:6801/425637029] [v2:172.21.15.173:6802/425637029,v1:172.21.15.173:6803/425637029] exists,up 59e0e0de-0540-4276-902c-0026e2feec5c 2023-10-08T12:40:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3 up in weight 1 up_from 26 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6810/2771486592,v1:172.21.15.59:6811/2771486592] [v2:172.21.15.59:6812/2771486592,v1:172.21.15.59:6813/2771486592] exists,up e6ce7d51-2782-4f16-9a52-a8dff84acc46 2023-10-08T12:40:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4 up in weight 1 up_from 34 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6808/1499509480,v1:172.21.15.92:6809/1499509480] [v2:172.21.15.92:6810/1499509480,v1:172.21.15.92:6811/1499509480] exists,up c6e0c7a3-d272-4904-93fa-3eb06fc83324 2023-10-08T12:40:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5 up in weight 1 up_from 39 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6808/2710761573,v1:172.21.15.173:6809/2710761573] [v2:172.21.15.173:6810/2710761573,v1:172.21.15.173:6811/2710761573] exists,up 486b651d-5ecc-4757-8c84-0d0fa61e123a 2023-10-08T12:40:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6 up in weight 1 up_from 47 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6818/4121704527,v1:172.21.15.59:6819/4121704527] [v2:172.21.15.59:6820/4121704527,v1:172.21.15.59:6821/4121704527] exists,up 1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5 2023-10-08T12:40:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7 up in weight 1 up_from 52 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6816/2022263685,v1:172.21.15.92:6817/2022263685] [v2:172.21.15.92:6818/2022263685,v1:172.21.15.92:6819/2022263685] exists,up d05083d7-e1a9-4bfb-947c-2c5533d36805 2023-10-08T12:40:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8 up in weight 1 up_from 59 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6816/993161392,v1:172.21.15.173:6817/993161392] [v2:172.21.15.173:6818/993161392,v1:172.21.15.173:6819/993161392] exists,up 1865ed29-0774-44e9-bc01-344d59472acc 2023-10-08T12:40:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9 up in weight 1 up_from 67 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6826/3574607237,v1:172.21.15.59:6827/3574607237] [v2:172.21.15.59:6828/3574607237,v1:172.21.15.59:6829/3574607237] exists,up d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6 2023-10-08T12:40:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10 up in weight 1 up_from 72 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6824/1729220812,v1:172.21.15.92:6825/1729220812] [v2:172.21.15.92:6826/1729220812,v1:172.21.15.92:6827/1729220812] exists,up d721b22c-e46e-4550-b90f-cdc148a73e09 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11 up in weight 1 up_from 79 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6824/1114623233,v1:172.21.15.173:6825/1114623233] [v2:172.21.15.173:6826/1114623233,v1:172.21.15.173:6827/1114623233] exists,up efc98d79-da04-4983-9ba6-929f1024786f 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 2.6 [8,11] 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 2.a [2,11] 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.5 [3,9] 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.e [5,9] 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.13 [4,9] 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.17 [4,6] 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.23 [4,8] 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/1331508923 expires 2023-10-09T12:33:10.699093+0000 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6801/2617395869 expires 2023-10-09T12:33:10.699093+0000 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6800/2617395869 expires 2023-10-09T12:33:10.699093+0000 2023-10-08T12:40:59.117 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/3230671169 expires 2023-10-09T12:33:10.699093+0000 2023-10-08T12:40:59.118 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/333444394 expires 2023-10-09T12:33:10.699093+0000 2023-10-08T12:40:59.118 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/3151805130 expires 2023-10-09T12:31:58.782739+0000 2023-10-08T12:40:59.118 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/3634455687 expires 2023-10-09T12:31:58.782739+0000 2023-10-08T12:40:59.118 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/354272646 expires 2023-10-09T12:31:58.782739+0000 2023-10-08T12:40:59.118 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6801/815242566 expires 2023-10-09T12:31:58.782739+0000 2023-10-08T12:40:59.118 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6800/3663319995 expires 2023-10-09T12:31:30.486951+0000 2023-10-08T12:40:59.118 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/1786512478 expires 2023-10-09T12:31:30.486951+0000 2023-10-08T12:40:59.118 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6801/3663319995 expires 2023-10-09T12:31:30.486951+0000 2023-10-08T12:40:59.118 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/899027669 expires 2023-10-09T12:31:30.486951+0000 2023-10-08T12:40:59.118 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/4060854750 expires 2023-10-09T12:31:30.486951+0000 2023-10-08T12:40:59.118 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6800/815242566 expires 2023-10-09T12:31:58.782739+0000 2023-10-08T12:40:59.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.115+0000 7fb4af355700 1 -- 172.21.15.59:0/280371622 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4940a1550 msgr2=0x7fb4940a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:59.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.115+0000 7fb4af355700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4940a1550 0x7fb4940a3a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8101930 tx=0x7fb4a400b410 comp rx=0 tx=0).stop 2023-10-08T12:40:59.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.115+0000 7fb4af355700 1 -- 172.21.15.59:0/280371622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a81057c0 msgr2=0x7fb4a8196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:59.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.115+0000 7fb4af355700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a81057c0 0x7fb4a8196b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000ceb0 tx=0x7fb4a000cee0 comp rx=0 tx=0).stop 2023-10-08T12:40:59.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.115+0000 7fb4af355700 1 -- 172.21.15.59:0/280371622 shutdown_connections 2023-10-08T12:40:59.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.115+0000 7fb4af355700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4940a1550 0x7fb4940a3a10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:59.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.115+0000 7fb4af355700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4a81008a0 0x7fb4a819c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:59.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.115+0000 7fb4af355700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a81057c0 0x7fb4a8196b20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:59.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.115+0000 7fb4af355700 1 --2- 172.21.15.59:0/280371622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4a8101260 0x7fb4a819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:59.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.115+0000 7fb4af355700 1 -- 172.21.15.59:0/280371622 >> 172.21.15.59:0/280371622 conn(0x7fb4a80779e0 msgr2=0x7fb4a80fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:59.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.116+0000 7fb4af355700 1 -- 172.21.15.59:0/280371622 shutdown_connections 2023-10-08T12:40:59.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.116+0000 7fb4af355700 1 -- 172.21.15.59:0/280371622 wait complete. 2023-10-08T12:40:59.595 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-08T12:40:59.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:40:59.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.817+0000 7f55447ff700 1 -- 172.21.15.59:0/1562645817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c100ff0 msgr2=0x7f553c10d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:59.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.817+0000 7f55447ff700 1 --2- 172.21.15.59:0/1562645817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c100ff0 0x7f553c10d500 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f553400b0a0 tx=0x7f553400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:59.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.817+0000 7f55447ff700 1 -- 172.21.15.59:0/1562645817 shutdown_connections 2023-10-08T12:40:59.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.817+0000 7f55447ff700 1 --2- 172.21.15.59:0/1562645817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c100ff0 0x7f553c10d500 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:59.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.817+0000 7f55447ff700 1 --2- 172.21.15.59:0/1562645817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553c106640 0x7f553c106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:59.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.817+0000 7f55447ff700 1 --2- 172.21.15.59:0/1562645817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f553c100630 0x7f553c100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:59.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.817+0000 7f55447ff700 1 -- 172.21.15.59:0/1562645817 >> 172.21.15.59:0/1562645817 conn(0x7f553c0fc140 msgr2=0x7f553c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:59.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.817+0000 7f55447ff700 1 -- 172.21.15.59:0/1562645817 shutdown_connections 2023-10-08T12:40:59.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.817+0000 7f55447ff700 1 -- 172.21.15.59:0/1562645817 wait complete. 2023-10-08T12:40:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.818+0000 7f55447ff700 1 Processor -- start 2023-10-08T12:40:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.819+0000 7f55447ff700 1 -- start start 2023-10-08T12:40:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.819+0000 7f55447ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c100630 0x7f553c19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.819+0000 7f55447ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f553c100ff0 0x7f553c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.819+0000 7f55447ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553c106640 0x7f553c198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.819+0000 7f55447ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c199130 con 0x7f553c100630 2023-10-08T12:40:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.819+0000 7f55447ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c1992a0 con 0x7f553c100ff0 2023-10-08T12:40:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.819+0000 7f55447ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c199460 con 0x7f553c106640 2023-10-08T12:40:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.819+0000 7f554259b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c100630 0x7f553c19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.819+0000 7f554259b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c100630 0x7f553c19e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45346/0 (socket says 172.21.15.59:45346) 2023-10-08T12:40:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.819+0000 7f554259b700 1 -- 172.21.15.59:0/971803837 learned_addr learned my addr 172.21.15.59:0/971803837 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:40:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f5542d9c700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553c106640 0x7f553c198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f5541d9a700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f553c100ff0 0x7f553c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:59.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f554259b700 1 -- 172.21.15.59:0/971803837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553c106640 msgr2=0x7f553c198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:59.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f554259b700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553c106640 0x7f553c198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f554259b700 1 -- 172.21.15.59:0/971803837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f553c100ff0 msgr2=0x7f553c19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f554259b700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f553c100ff0 0x7f553c19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f554259b700 1 -- 172.21.15.59:0/971803837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5534009d00 con 0x7f553c100630 2023-10-08T12:40:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f554259b700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c100630 0x7f553c19e950 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f553800e9a0 tx=0x7f553800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f55337fe700 1 -- 172.21.15.59:0/971803837 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538009790 con 0x7f553c100630 2023-10-08T12:40:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f55337fe700 1 -- 172.21.15.59:0/971803837 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5538010430 con 0x7f553c100630 2023-10-08T12:40:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f55447ff700 1 -- 172.21.15.59:0/971803837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c199740 con 0x7f553c100630 2023-10-08T12:40:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.820+0000 7f55337fe700 1 -- 172.21.15.59:0/971803837 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538018680 con 0x7f553c100630 2023-10-08T12:40:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.821+0000 7f55447ff700 1 -- 172.21.15.59:0/971803837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c1a5940 con 0x7f553c100630 2023-10-08T12:40:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.821+0000 7f55447ff700 1 -- 172.21.15.59:0/971803837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c101d70 con 0x7f553c100630 2023-10-08T12:40:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.823+0000 7f55337fe700 1 -- 172.21.15.59:0/971803837 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f55380105a0 con 0x7f553c100630 2023-10-08T12:40:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.825+0000 7f55337fe700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55280a14d0 0x7f55280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.825+0000 7f55337fe700 1 -- 172.21.15.59:0/971803837 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5538014070 con 0x7f553c100630 2023-10-08T12:40:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.825+0000 7f5541d9a700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55280a14d0 0x7f55280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.826+0000 7f5541d9a700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55280a14d0 0x7f55280a3990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f553c199c40 tx=0x7f552c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:59.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:40:59.827+0000 7f55337fe700 1 -- 172.21.15.59:0/971803837 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f55380966e0 con 0x7f553c100630 2023-10-08T12:41:00.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:59 smithi059 ceph-mon[98489]: pgmap v308: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:00.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:40:59 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/280371622' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T12:41:00.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.040+0000 7f55447ff700 1 -- 172.21.15.59:0/971803837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f553c110570 con 0x7f553c100630 2023-10-08T12:41:00.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.042+0000 7f55337fe700 1 -- 172.21.15.59:0/971803837 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22725 (secure 0 0 0) 0x7f5538099d00 con 0x7f553c100630 2023-10-08T12:41:00.043 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:00.044 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":86,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:40:11.783762+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:41:00.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.044+0000 7f55447ff700 1 -- 172.21.15.59:0/971803837 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55280a14d0 msgr2=0x7f55280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.044+0000 7f55447ff700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55280a14d0 0x7f55280a3990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f553c199c40 tx=0x7f552c009260 comp rx=0 tx=0).stop 2023-10-08T12:41:00.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.044+0000 7f55447ff700 1 -- 172.21.15.59:0/971803837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c100630 msgr2=0x7f553c19e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.044+0000 7f55447ff700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c100630 0x7f553c19e950 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f553800e9a0 tx=0x7f553800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.044+0000 7f55447ff700 1 -- 172.21.15.59:0/971803837 shutdown_connections 2023-10-08T12:41:00.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.044+0000 7f55447ff700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55280a14d0 0x7f55280a3990 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.044+0000 7f55447ff700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553c106640 0x7f553c198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.044+0000 7f55447ff700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c100630 0x7f553c19e950 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.044+0000 7f55447ff700 1 --2- 172.21.15.59:0/971803837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f553c100ff0 0x7f553c19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.044+0000 7f55447ff700 1 -- 172.21.15.59:0/971803837 >> 172.21.15.59:0/971803837 conn(0x7f553c0fc140 msgr2=0x7f553c0fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:00.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.044+0000 7f55447ff700 1 -- 172.21.15.59:0/971803837 shutdown_connections 2023-10-08T12:41:00.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.045+0000 7f55447ff700 1 -- 172.21.15.59:0/971803837 wait complete. 2023-10-08T12:41:00.064 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:39:12.134451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:39:13.186137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:41:00.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:41:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:59 smithi092 ceph-mon[134093]: pgmap v308: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:40:59 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/280371622' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T12:41:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:59 smithi173 ceph-mon[135182]: pgmap v308: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:40:59 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/280371622' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T12:41:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.272+0000 7ff2897ff700 1 -- 172.21.15.59:0/2056340172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff284072c20 msgr2=0x7ff284073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.272+0000 7ff2897ff700 1 --2- 172.21.15.59:0/2056340172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff284072c20 0x7ff284073000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff274009990 tx=0x7ff274009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.272+0000 7ff2897ff700 1 -- 172.21.15.59:0/2056340172 shutdown_connections 2023-10-08T12:41:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.272+0000 7ff2897ff700 1 --2- 172.21.15.59:0/2056340172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff284072c20 0x7ff284073000 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.272+0000 7ff2897ff700 1 --2- 172.21.15.59:0/2056340172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28410cf70 0x7ff28410f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.272+0000 7ff2897ff700 1 --2- 172.21.15.59:0/2056340172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff284073540 0x7ff28410ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.272+0000 7ff2897ff700 1 -- 172.21.15.59:0/2056340172 >> 172.21.15.59:0/2056340172 conn(0x7ff2840fc200 msgr2=0x7ff2840fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.272+0000 7ff2897ff700 1 -- 172.21.15.59:0/2056340172 shutdown_connections 2023-10-08T12:41:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.272+0000 7ff2897ff700 1 -- 172.21.15.59:0/2056340172 wait complete. 2023-10-08T12:41:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.273+0000 7ff2897ff700 1 Processor -- start 2023-10-08T12:41:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.273+0000 7ff2897ff700 1 -- start start 2023-10-08T12:41:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2897ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff284072c20 0x7ff284198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2897ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff284073540 0x7ff2841993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2897ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff28410cf70 0x7ff28419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2897ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28419dd60 con 0x7ff284073540 2023-10-08T12:41:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2897ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28419ded0 con 0x7ff284072c20 2023-10-08T12:41:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2897ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28419e090 con 0x7ff28410cf70 2023-10-08T12:41:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2827fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff284073540 0x7ff2841993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2827fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff284073540 0x7ff2841993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45370/0 (socket says 172.21.15.59:45370) 2023-10-08T12:41:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2827fc700 1 -- 172.21.15.59:0/1921979613 learned_addr learned my addr 172.21.15.59:0/1921979613 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff282ffd700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff284072c20 0x7ff284198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2837fe700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff28410cf70 0x7ff28419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2827fc700 1 -- 172.21.15.59:0/1921979613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff28410cf70 msgr2=0x7ff28419d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2827fc700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff28410cf70 0x7ff28419d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2827fc700 1 -- 172.21.15.59:0/1921979613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff284072c20 msgr2=0x7ff284198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2827fc700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff284072c20 0x7ff284198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.274+0000 7ff2827fc700 1 -- 172.21.15.59:0/1921979613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2740095f0 con 0x7ff284073540 2023-10-08T12:41:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.275+0000 7ff2827fc700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff284073540 0x7ff2841993d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff27800e9a0 tx=0x7ff27800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.275+0000 7ff26bfff700 1 -- 172.21.15.59:0/1921979613 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278009790 con 0x7ff284073540 2023-10-08T12:41:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.275+0000 7ff2897ff700 1 -- 172.21.15.59:0/1921979613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28419e370 con 0x7ff284073540 2023-10-08T12:41:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.275+0000 7ff26bfff700 1 -- 172.21.15.59:0/1921979613 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff278010430 con 0x7ff284073540 2023-10-08T12:41:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.275+0000 7ff26bfff700 1 -- 172.21.15.59:0/1921979613 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278018680 con 0x7ff284073540 2023-10-08T12:41:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.275+0000 7ff2897ff700 1 -- 172.21.15.59:0/1921979613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2841a5bb0 con 0x7ff284073540 2023-10-08T12:41:00.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.276+0000 7ff2897ff700 1 -- 172.21.15.59:0/1921979613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff284108180 con 0x7ff284073540 2023-10-08T12:41:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.279+0000 7ff26bfff700 1 -- 172.21.15.59:0/1921979613 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff2780105a0 con 0x7ff284073540 2023-10-08T12:41:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.281+0000 7ff26bfff700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff26c0a1550 0x7ff26c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.281+0000 7ff26bfff700 1 -- 172.21.15.59:0/1921979613 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff278014070 con 0x7ff284073540 2023-10-08T12:41:00.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.281+0000 7ff282ffd700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff26c0a1550 0x7ff26c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:00.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.281+0000 7ff282ffd700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff26c0a1550 0x7ff26c0a3a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff27400b2e0 tx=0x7ff274005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.283+0000 7ff26bfff700 1 -- 172.21.15.59:0/1921979613 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff278096780 con 0x7ff284073540 2023-10-08T12:41:00.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.493+0000 7ff2897ff700 1 -- 172.21.15.59:0/1921979613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff28419a140 con 0x7ff284073540 2023-10-08T12:41:00.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.493+0000 7ff26bfff700 1 -- 172.21.15.59:0/1921979613 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff278026020 con 0x7ff284073540 2023-10-08T12:41:00.494 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T12:41:00.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 -- 172.21.15.59:0/1921979613 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff26c0a1550 msgr2=0x7ff26c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff26c0a1550 0x7ff26c0a3a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff27400b2e0 tx=0x7ff274005fd0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 -- 172.21.15.59:0/1921979613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff284073540 msgr2=0x7ff2841993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff284073540 0x7ff2841993d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff27800e9a0 tx=0x7ff27800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 -- 172.21.15.59:0/1921979613 shutdown_connections 2023-10-08T12:41:00.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff26c0a1550 0x7ff26c0a3a10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff284072c20 0x7ff284198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff28410cf70 0x7ff28419d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 --2- 172.21.15.59:0/1921979613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff284073540 0x7ff2841993d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 -- 172.21.15.59:0/1921979613 >> 172.21.15.59:0/1921979613 conn(0x7ff2840fc200 msgr2=0x7ff2840fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 -- 172.21.15.59:0/1921979613 shutdown_connections 2023-10-08T12:41:00.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.496+0000 7ff2897ff700 1 -- 172.21.15.59:0/1921979613 wait complete. 2023-10-08T12:41:00.516 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:41:00.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.721+0000 7fe953dff700 1 -- 172.21.15.59:0/2566565171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c1010f0 msgr2=0x7fe94c10d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.721+0000 7fe953dff700 1 --2- 172.21.15.59:0/2566565171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c1010f0 0x7fe94c10d600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe94400b0a0 tx=0x7fe94400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.721+0000 7fe953dff700 1 -- 172.21.15.59:0/2566565171 shutdown_connections 2023-10-08T12:41:00.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.721+0000 7fe953dff700 1 --2- 172.21.15.59:0/2566565171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe94c106740 0x7fe94c106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.721+0000 7fe953dff700 1 --2- 172.21.15.59:0/2566565171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c1010f0 0x7fe94c10d600 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.721+0000 7fe953dff700 1 --2- 172.21.15.59:0/2566565171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c100730 0x7fe94c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.721+0000 7fe953dff700 1 -- 172.21.15.59:0/2566565171 >> 172.21.15.59:0/2566565171 conn(0x7fe94c0fc200 msgr2=0x7fe94c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:00.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.721+0000 7fe953dff700 1 -- 172.21.15.59:0/2566565171 shutdown_connections 2023-10-08T12:41:00.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.721+0000 7fe953dff700 1 -- 172.21.15.59:0/2566565171 wait complete. 2023-10-08T12:41:00.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.722+0000 7fe953dff700 1 Processor -- start 2023-10-08T12:41:00.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.722+0000 7fe953dff700 1 -- start start 2023-10-08T12:41:00.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe953dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c100730 0x7fe94c19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:00.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe953dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c1010f0 0x7fe94c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe953dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe94c106740 0x7fe94c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe953dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c199190 con 0x7fe94c1010f0 2023-10-08T12:41:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe953dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c199300 con 0x7fe94c106740 2023-10-08T12:41:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe953dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c1994c0 con 0x7fe94c100730 2023-10-08T12:41:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe95139a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c1010f0 0x7fe94c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe95139a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c1010f0 0x7fe94c19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37632/0 (socket says 172.21.15.59:37632) 2023-10-08T12:41:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe95139a700 1 -- 172.21.15.59:0/3653276827 learned_addr learned my addr 172.21.15.59:0/3653276827 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe951b9b700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c100730 0x7fe94c19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe95239c700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe94c106740 0x7fe94c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe95139a700 1 -- 172.21.15.59:0/3653276827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c100730 msgr2=0x7fe94c19e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe95139a700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c100730 0x7fe94c19e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe95139a700 1 -- 172.21.15.59:0/3653276827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe94c106740 msgr2=0x7fe94c198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe95139a700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe94c106740 0x7fe94c198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.723+0000 7fe95139a700 1 -- 172.21.15.59:0/3653276827 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944009d00 con 0x7fe94c1010f0 2023-10-08T12:41:00.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.724+0000 7fe95139a700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c1010f0 0x7fe94c19eee0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00e9a0 tx=0x7fe93c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:00.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.724+0000 7fe942ffd700 1 -- 172.21.15.59:0/3653276827 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c009790 con 0x7fe94c1010f0 2023-10-08T12:41:00.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.724+0000 7fe942ffd700 1 -- 172.21.15.59:0/3653276827 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe93c010430 con 0x7fe94c1010f0 2023-10-08T12:41:00.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.724+0000 7fe942ffd700 1 -- 172.21.15.59:0/3653276827 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c018680 con 0x7fe94c1010f0 2023-10-08T12:41:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.724+0000 7fe953dff700 1 -- 172.21.15.59:0/3653276827 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94c1997a0 con 0x7fe94c1010f0 2023-10-08T12:41:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.724+0000 7fe953dff700 1 -- 172.21.15.59:0/3653276827 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c1a5a40 con 0x7fe94c1010f0 2023-10-08T12:41:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.725+0000 7fe953dff700 1 -- 172.21.15.59:0/3653276827 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c101e70 con 0x7fe94c1010f0 2023-10-08T12:41:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.727+0000 7fe942ffd700 1 -- 172.21.15.59:0/3653276827 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe93c0105a0 con 0x7fe94c1010f0 2023-10-08T12:41:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.728+0000 7fe942ffd700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe9380a1550 0x7fe9380a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.729+0000 7fe942ffd700 1 -- 172.21.15.59:0/3653276827 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe93c014070 con 0x7fe94c1010f0 2023-10-08T12:41:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.729+0000 7fe951b9b700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe9380a1550 0x7fe9380a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:00.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.729+0000 7fe951b9b700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe9380a1550 0x7fe9380a3a10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe948009be0 tx=0x7fe948009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.732+0000 7fe942ffd700 1 -- 172.21.15.59:0/3653276827 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe93c096510 con 0x7fe94c1010f0 2023-10-08T12:41:00.764 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:00 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/971803837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:00.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:00 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1921979613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.945+0000 7fe953dff700 1 -- 172.21.15.59:0/3653276827 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe94c1106a0 con 0x7fe94c1010f0 2023-10-08T12:41:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.945+0000 7fe942ffd700 1 -- 172.21.15.59:0/3653276827 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe93c099b30 con 0x7fe94c1010f0 2023-10-08T12:41:00.946 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-08T12:41:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 -- 172.21.15.59:0/3653276827 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe9380a1550 msgr2=0x7fe9380a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe9380a1550 0x7fe9380a3a10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe948009be0 tx=0x7fe948009260 comp rx=0 tx=0).stop 2023-10-08T12:41:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 -- 172.21.15.59:0/3653276827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c1010f0 msgr2=0x7fe94c19eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c1010f0 0x7fe94c19eee0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00e9a0 tx=0x7fe93c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 -- 172.21.15.59:0/3653276827 shutdown_connections 2023-10-08T12:41:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe9380a1550 0x7fe9380a3a10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe94c106740 0x7fe94c198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c100730 0x7fe94c19e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 --2- 172.21.15.59:0/3653276827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c1010f0 0x7fe94c19eee0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 -- 172.21.15.59:0/3653276827 >> 172.21.15.59:0/3653276827 conn(0x7fe94c0fc200 msgr2=0x7fe94c10ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 -- 172.21.15.59:0/3653276827 shutdown_connections 2023-10-08T12:41:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:00.947+0000 7fe953dff700 1 -- 172.21.15.59:0/3653276827 wait complete. 2023-10-08T12:41:00.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:41:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:00 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/971803837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:00 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1921979613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:01.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.173+0000 7fbc51fff700 1 -- 172.21.15.59:0/55614725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc4c100730 msgr2=0x7fbc4c100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:01.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.173+0000 7fbc51fff700 1 --2- 172.21.15.59:0/55614725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc4c100730 0x7fbc4c100bb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009990 tx=0x7fbc40009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.173+0000 7fbc51fff700 1 -- 172.21.15.59:0/55614725 shutdown_connections 2023-10-08T12:41:01.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.173+0000 7fbc51fff700 1 --2- 172.21.15.59:0/55614725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc4c1010f0 0x7fbc4c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.173+0000 7fbc51fff700 1 --2- 172.21.15.59:0/55614725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc4c106740 0x7fbc4c106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.173+0000 7fbc51fff700 1 --2- 172.21.15.59:0/55614725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc4c100730 0x7fbc4c100bb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.173+0000 7fbc51fff700 1 -- 172.21.15.59:0/55614725 >> 172.21.15.59:0/55614725 conn(0x7fbc4c0fc200 msgr2=0x7fbc4c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:01.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.173+0000 7fbc51fff700 1 -- 172.21.15.59:0/55614725 shutdown_connections 2023-10-08T12:41:01.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.173+0000 7fbc51fff700 1 -- 172.21.15.59:0/55614725 wait complete. 2023-10-08T12:41:01.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.174+0000 7fbc51fff700 1 Processor -- start 2023-10-08T12:41:01.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.174+0000 7fbc51fff700 1 -- start start 2023-10-08T12:41:01.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.174+0000 7fbc51fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc4c100730 0x7fbc4c198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:01.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.174+0000 7fbc51fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc4c1010f0 0x7fbc4c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:01.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.174+0000 7fbc51fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc4c106740 0x7fbc4c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:01.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.174+0000 7fbc51fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c19dd00 con 0x7fbc4c100730 2023-10-08T12:41:01.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.174+0000 7fbc51fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c19de70 con 0x7fbc4c1010f0 2023-10-08T12:41:01.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.174+0000 7fbc51fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c19e030 con 0x7fbc4c106740 2023-10-08T12:41:01.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.175+0000 7fbc4b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc4c100730 0x7fbc4c198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:01.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.175+0000 7fbc4b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc4c100730 0x7fbc4c198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37662/0 (socket says 172.21.15.59:37662) 2023-10-08T12:41:01.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.175+0000 7fbc4b7fe700 1 -- 172.21.15.59:0/4129724927 learned_addr learned my addr 172.21.15.59:0/4129724927 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:01.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.175+0000 7fbc4affd700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc4c1010f0 0x7fbc4c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:01.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.175+0000 7fbc4bfff700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc4c106740 0x7fbc4c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:01.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.175+0000 7fbc4b7fe700 1 -- 172.21.15.59:0/4129724927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc4c106740 msgr2=0x7fbc4c19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:01.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.175+0000 7fbc4b7fe700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc4c106740 0x7fbc4c19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.175+0000 7fbc4b7fe700 1 -- 172.21.15.59:0/4129724927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc4c1010f0 msgr2=0x7fbc4c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:01.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.175+0000 7fbc4b7fe700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc4c1010f0 0x7fbc4c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.175+0000 7fbc4b7fe700 1 -- 172.21.15.59:0/4129724927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc400095f0 con 0x7fbc4c100730 2023-10-08T12:41:01.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.175+0000 7fbc4b7fe700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc4c100730 0x7fbc4c198de0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00d950 tx=0x7fbc3c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:01.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.176+0000 7fbc48ff9700 1 -- 172.21.15.59:0/4129724927 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c00f890 con 0x7fbc4c100730 2023-10-08T12:41:01.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.176+0000 7fbc48ff9700 1 -- 172.21.15.59:0/4129724927 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc3c010460 con 0x7fbc4c100730 2023-10-08T12:41:01.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.176+0000 7fbc51fff700 1 -- 172.21.15.59:0/4129724927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4c19e310 con 0x7fbc4c100730 2023-10-08T12:41:01.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.176+0000 7fbc48ff9700 1 -- 172.21.15.59:0/4129724927 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c00e610 con 0x7fbc4c100730 2023-10-08T12:41:01.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.176+0000 7fbc51fff700 1 -- 172.21.15.59:0/4129724927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c1a5b50 con 0x7fbc4c100730 2023-10-08T12:41:01.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.177+0000 7fbc51fff700 1 -- 172.21.15.59:0/4129724927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4c101e70 con 0x7fbc4c100730 2023-10-08T12:41:01.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.179+0000 7fbc48ff9700 1 -- 172.21.15.59:0/4129724927 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fbc3c0108d0 con 0x7fbc4c100730 2023-10-08T12:41:01.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.180+0000 7fbc48ff9700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc340a14d0 0x7fbc340a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:01.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.180+0000 7fbc48ff9700 1 -- 172.21.15.59:0/4129724927 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbc3c0ccbf0 con 0x7fbc4c100730 2023-10-08T12:41:01.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.180+0000 7fbc4affd700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc340a14d0 0x7fbc340a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:01.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.181+0000 7fbc4affd700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc340a14d0 0x7fbc340a3990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c19a330 tx=0x7fbc4000b540 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:01.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.184+0000 7fbc48ff9700 1 -- 172.21.15.59:0/4129724927 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbc3c096150 con 0x7fbc4c100730 2023-10-08T12:41:01.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:00 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/971803837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:00 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1921979613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:01.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.396+0000 7fbc51fff700 1 -- 172.21.15.59:0/4129724927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc4c19a180 con 0x7fbc4c100730 2023-10-08T12:41:01.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.396+0000 7fbc48ff9700 1 -- 172.21.15.59:0/4129724927 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc3c0160a0 con 0x7fbc4c100730 2023-10-08T12:41:01.397 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-08T12:41:01.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.398+0000 7fbc51fff700 1 -- 172.21.15.59:0/4129724927 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc340a14d0 msgr2=0x7fbc340a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:01.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.398+0000 7fbc51fff700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc340a14d0 0x7fbc340a3990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c19a330 tx=0x7fbc4000b540 comp rx=0 tx=0).stop 2023-10-08T12:41:01.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.398+0000 7fbc51fff700 1 -- 172.21.15.59:0/4129724927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc4c100730 msgr2=0x7fbc4c198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:01.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.398+0000 7fbc51fff700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc4c100730 0x7fbc4c198de0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00d950 tx=0x7fbc3c00dc60 comp rx=0 tx=0).stop 2023-10-08T12:41:01.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.399+0000 7fbc51fff700 1 -- 172.21.15.59:0/4129724927 shutdown_connections 2023-10-08T12:41:01.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.399+0000 7fbc51fff700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbc340a14d0 0x7fbc340a3990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.399+0000 7fbc51fff700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc4c106740 0x7fbc4c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.399+0000 7fbc51fff700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc4c100730 0x7fbc4c198de0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.399+0000 7fbc51fff700 1 --2- 172.21.15.59:0/4129724927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc4c1010f0 0x7fbc4c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.399+0000 7fbc51fff700 1 -- 172.21.15.59:0/4129724927 >> 172.21.15.59:0/4129724927 conn(0x7fbc4c0fc200 msgr2=0x7fbc4c10bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:01.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.399+0000 7fbc51fff700 1 -- 172.21.15.59:0/4129724927 shutdown_connections 2023-10-08T12:41:01.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.399+0000 7fbc51fff700 1 -- 172.21.15.59:0/4129724927 wait complete. 2023-10-08T12:41:01.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:41:01.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.620+0000 7f57cabff700 1 -- 172.21.15.59:0/2746041335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c4100ff0 msgr2=0x7f57c410d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:01.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.620+0000 7f57cabff700 1 --2- 172.21.15.59:0/2746041335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c4100ff0 0x7f57c410d500 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00b0a0 tx=0x7f57bc00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.620+0000 7f57cabff700 1 -- 172.21.15.59:0/2746041335 shutdown_connections 2023-10-08T12:41:01.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.620+0000 7f57cabff700 1 --2- 172.21.15.59:0/2746041335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57c4106640 0x7f57c4106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.620+0000 7f57cabff700 1 --2- 172.21.15.59:0/2746041335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c4100ff0 0x7f57c410d500 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.620+0000 7f57cabff700 1 --2- 172.21.15.59:0/2746041335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57c4100630 0x7f57c4100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.620+0000 7f57cabff700 1 -- 172.21.15.59:0/2746041335 >> 172.21.15.59:0/2746041335 conn(0x7f57c40fc1a0 msgr2=0x7f57c40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:01.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.620+0000 7f57cabff700 1 -- 172.21.15.59:0/2746041335 shutdown_connections 2023-10-08T12:41:01.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.621+0000 7f57cabff700 1 -- 172.21.15.59:0/2746041335 wait complete. 2023-10-08T12:41:01.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.622+0000 7f57cabff700 1 Processor -- start 2023-10-08T12:41:01.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.622+0000 7f57cabff700 1 -- start start 2023-10-08T12:41:01.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.622+0000 7f57cabff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57c4100630 0x7f57c419e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:01.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.622+0000 7f57cabff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c4100ff0 0x7f57c419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:01.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.622+0000 7f57cabff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57c4106640 0x7f57c4198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:01.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.622+0000 7f57cabff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c4199150 con 0x7f57c4100ff0 2023-10-08T12:41:01.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.622+0000 7f57cabff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c41992c0 con 0x7f57c4100630 2023-10-08T12:41:01.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.622+0000 7f57cabff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c4199480 con 0x7f57c4106640 2023-10-08T12:41:01.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.622+0000 7f57c3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c4100ff0 0x7f57c419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:01.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c899b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57c4100630 0x7f57c419e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:01.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c4100ff0 0x7f57c419eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37678/0 (socket says 172.21.15.59:37678) 2023-10-08T12:41:01.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c3fff700 1 -- 172.21.15.59:0/2919448918 learned_addr learned my addr 172.21.15.59:0/2919448918 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:01.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c919c700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57c4106640 0x7f57c4198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:01.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c3fff700 1 -- 172.21.15.59:0/2919448918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57c4106640 msgr2=0x7f57c4198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:01.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c3fff700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57c4106640 0x7f57c4198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c3fff700 1 -- 172.21.15.59:0/2919448918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57c4100630 msgr2=0x7f57c419e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:01.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c3fff700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57c4100630 0x7f57c419e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c3fff700 1 -- 172.21.15.59:0/2919448918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc009d00 con 0x7f57c4100ff0 2023-10-08T12:41:01.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c3fff700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c4100ff0 0x7f57c419eeb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f57b000e9a0 tx=0x7f57b000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:01.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c1ffb700 1 -- 172.21.15.59:0/2919448918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0009790 con 0x7f57c4100ff0 2023-10-08T12:41:01.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c1ffb700 1 -- 172.21.15.59:0/2919448918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57b0010430 con 0x7f57c4100ff0 2023-10-08T12:41:01.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57cabff700 1 -- 172.21.15.59:0/2919448918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c4199760 con 0x7f57c4100ff0 2023-10-08T12:41:01.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.623+0000 7f57c1ffb700 1 -- 172.21.15.59:0/2919448918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0018680 con 0x7f57c4100ff0 2023-10-08T12:41:01.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.624+0000 7f57cabff700 1 -- 172.21.15.59:0/2919448918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c41a5960 con 0x7f57c4100ff0 2023-10-08T12:41:01.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.624+0000 7f57cabff700 1 -- 172.21.15.59:0/2919448918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c4101d70 con 0x7f57c4100ff0 2023-10-08T12:41:01.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.626+0000 7f57c1ffb700 1 -- 172.21.15.59:0/2919448918 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f57b00105a0 con 0x7f57c4100ff0 2023-10-08T12:41:01.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.628+0000 7f57c1ffb700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57b40a14d0 0x7f57b40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:01.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.628+0000 7f57c1ffb700 1 -- 172.21.15.59:0/2919448918 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f57b0014070 con 0x7f57c4100ff0 2023-10-08T12:41:01.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.628+0000 7f57c899b700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57b40a14d0 0x7f57b40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:01.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.629+0000 7f57c899b700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57b40a14d0 0x7f57b40a3990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009be0 tx=0x7f57b8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:01.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.630+0000 7f57c1ffb700 1 -- 172.21.15.59:0/2919448918 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f57b0096760 con 0x7f57c4100ff0 2023-10-08T12:41:01.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.902+0000 7f57cabff700 1 -- 172.21.15.59:0/2919448918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57c4067450 con 0x7f57c4100ff0 2023-10-08T12:41:01.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.903+0000 7f57c1ffb700 1 -- 172.21.15.59:0/2919448918 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f57b0026090 con 0x7f57c4100ff0 2023-10-08T12:41:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:01.908 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:41:01.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.905+0000 7f57cabff700 1 -- 172.21.15.59:0/2919448918 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57b40a14d0 msgr2=0x7f57b40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:01.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.905+0000 7f57cabff700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57b40a14d0 0x7f57b40a3990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009be0 tx=0x7f57b8009260 comp rx=0 tx=0).stop 2023-10-08T12:41:01.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.905+0000 7f57cabff700 1 -- 172.21.15.59:0/2919448918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c4100ff0 msgr2=0x7f57c419eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:01.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.905+0000 7f57cabff700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c4100ff0 0x7f57c419eeb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f57b000e9a0 tx=0x7f57b000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.905+0000 7f57cabff700 1 -- 172.21.15.59:0/2919448918 shutdown_connections 2023-10-08T12:41:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.905+0000 7f57cabff700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57b40a14d0 0x7f57b40a3990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.905+0000 7f57cabff700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57c4100630 0x7f57c419e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.905+0000 7f57cabff700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57c4106640 0x7f57c4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.905+0000 7f57cabff700 1 --2- 172.21.15.59:0/2919448918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c4100ff0 0x7f57c419eeb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.905+0000 7f57cabff700 1 -- 172.21.15.59:0/2919448918 >> 172.21.15.59:0/2919448918 conn(0x7f57c40fc1a0 msgr2=0x7f57c40fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.906+0000 7f57cabff700 1 -- 172.21.15.59:0/2919448918 shutdown_connections 2023-10-08T12:41:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:01.906+0000 7f57cabff700 1 -- 172.21.15.59:0/2919448918 wait complete. 2023-10-08T12:41:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:41:01.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:41:02.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:01 smithi059 ceph-mon[98489]: pgmap v309: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:02.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:01 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3653276827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:02.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:01 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4129724927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:01 smithi092 ceph-mon[134093]: pgmap v309: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:01 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3653276827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:01 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4129724927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.129+0000 7fc180dff700 1 -- 172.21.15.59:0/801979459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c106640 msgr2=0x7fc17c106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.129+0000 7fc180dff700 1 --2- 172.21.15.59:0/801979459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c106640 0x7fc17c106a20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009990 tx=0x7fc16c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.129+0000 7fc180dff700 1 -- 172.21.15.59:0/801979459 shutdown_connections 2023-10-08T12:41:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.129+0000 7fc180dff700 1 --2- 172.21.15.59:0/801979459 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c100ff0 0x7fc17c10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.129+0000 7fc180dff700 1 --2- 172.21.15.59:0/801979459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c106640 0x7fc17c106a20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.129+0000 7fc180dff700 1 --2- 172.21.15.59:0/801979459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc17c100630 0x7fc17c100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.129+0000 7fc180dff700 1 -- 172.21.15.59:0/801979459 >> 172.21.15.59:0/801979459 conn(0x7fc17c0fc140 msgr2=0x7fc17c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.129+0000 7fc180dff700 1 -- 172.21.15.59:0/801979459 shutdown_connections 2023-10-08T12:41:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.129+0000 7fc180dff700 1 -- 172.21.15.59:0/801979459 wait complete. 2023-10-08T12:41:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.130+0000 7fc180dff700 1 Processor -- start 2023-10-08T12:41:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.130+0000 7fc180dff700 1 -- start start 2023-10-08T12:41:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc180dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c100630 0x7fc17c19c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc180dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c100ff0 0x7fc17c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc180dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc17c106640 0x7fc17c196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc180dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c196fb0 con 0x7fc17c100ff0 2023-10-08T12:41:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc180dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c197120 con 0x7fc17c100630 2023-10-08T12:41:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc180dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1972e0 con 0x7fc17c106640 2023-10-08T12:41:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc179d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c100ff0 0x7fc17c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc179d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c100ff0 0x7fc17c19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37702/0 (socket says 172.21.15.59:37702) 2023-10-08T12:41:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc179d9b700 1 -- 172.21.15.59:0/332617246 learned_addr learned my addr 172.21.15.59:0/332617246 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc17a59c700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c100630 0x7fc17c19c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc17ad9d700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc17c106640 0x7fc17c196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc179d9b700 1 -- 172.21.15.59:0/332617246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc17c106640 msgr2=0x7fc17c196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc179d9b700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc17c106640 0x7fc17c196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc179d9b700 1 -- 172.21.15.59:0/332617246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c100630 msgr2=0x7fc17c19c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc179d9b700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c100630 0x7fc17c19c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc179d9b700 1 -- 172.21.15.59:0/332617246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc174009c40 con 0x7fc17c100ff0 2023-10-08T12:41:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.131+0000 7fc17ad9d700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc17c106640 0x7fc17c196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.132+0000 7fc179d9b700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c100ff0 0x7fc17c19cd60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc17000e9a0 tx=0x7fc17000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.132+0000 7fc16b7fe700 1 -- 172.21.15.59:0/332617246 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170009790 con 0x7fc17c100ff0 2023-10-08T12:41:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.132+0000 7fc180dff700 1 -- 172.21.15.59:0/332617246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16c0095f0 con 0x7fc17c100ff0 2023-10-08T12:41:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.132+0000 7fc16b7fe700 1 -- 172.21.15.59:0/332617246 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc17000cbd0 con 0x7fc17c100ff0 2023-10-08T12:41:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.132+0000 7fc16b7fe700 1 -- 172.21.15.59:0/332617246 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170018680 con 0x7fc17c100ff0 2023-10-08T12:41:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.132+0000 7fc180dff700 1 -- 172.21.15.59:0/332617246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c1977b0 con 0x7fc17c100ff0 2023-10-08T12:41:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.133+0000 7fc180dff700 1 -- 172.21.15.59:0/332617246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c108c30 con 0x7fc17c100ff0 2023-10-08T12:41:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.135+0000 7fc16b7fe700 1 -- 172.21.15.59:0/332617246 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc17000cd40 con 0x7fc17c100ff0 2023-10-08T12:41:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.136+0000 7fc16b7fe700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1640a14d0 0x7fc1640a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.137+0000 7fc16b7fe700 1 -- 172.21.15.59:0/332617246 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc170014070 con 0x7fc17c100ff0 2023-10-08T12:41:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.137+0000 7fc17a59c700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1640a14d0 0x7fc1640a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.137+0000 7fc17a59c700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1640a14d0 0x7fc1640a3990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc16c006010 tx=0x7fc16c00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:02.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.140+0000 7fc16b7fe700 1 -- 172.21.15.59:0/332617246 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc170052100 con 0x7fc17c100ff0 2023-10-08T12:41:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:01 smithi173 ceph-mon[135182]: pgmap v309: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:01 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3653276827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:01 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4129724927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:02.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.356+0000 7fc180dff700 1 -- 172.21.15.59:0/332617246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc17c101d70 con 0x7fc17c100ff0 2023-10-08T12:41:02.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.358+0000 7fc16b7fe700 1 -- 172.21.15.59:0/332617246 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22725 (secure 0 0 0) 0x7fc170096660 con 0x7fc17c100ff0 2023-10-08T12:41:02.359 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:02.359 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":86,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:40:11.783762+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:41:02.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 -- 172.21.15.59:0/332617246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1640a14d0 msgr2=0x7fc1640a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:02.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1640a14d0 0x7fc1640a3990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc16c006010 tx=0x7fc16c00b260 comp rx=0 tx=0).stop 2023-10-08T12:41:02.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 -- 172.21.15.59:0/332617246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c100ff0 msgr2=0x7fc17c19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c100ff0 0x7fc17c19cd60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc17000e9a0 tx=0x7fc17000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 -- 172.21.15.59:0/332617246 shutdown_connections 2023-10-08T12:41:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1640a14d0 0x7fc1640a3990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c100630 0x7fc17c19c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc17c106640 0x7fc17c196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 --2- 172.21.15.59:0/332617246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c100ff0 0x7fc17c19cd60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 -- 172.21.15.59:0/332617246 >> 172.21.15.59:0/332617246 conn(0x7fc17c0fc140 msgr2=0x7fc17c0fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 -- 172.21.15.59:0/332617246 shutdown_connections 2023-10-08T12:41:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.360+0000 7fc180dff700 1 -- 172.21.15.59:0/332617246 wait complete. 2023-10-08T12:41:02.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:39:12.134451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:39:13.186137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:41:02.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:41:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.585+0000 7f74437ff700 1 -- 172.21.15.59:0/2418773487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f743c106740 msgr2=0x7f743c106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.585+0000 7f74437ff700 1 --2- 172.21.15.59:0/2418773487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f743c106740 0x7f743c106b20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7438009990 tx=0x7f7438009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.585+0000 7f74437ff700 1 -- 172.21.15.59:0/2418773487 shutdown_connections 2023-10-08T12:41:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.585+0000 7f74437ff700 1 --2- 172.21.15.59:0/2418773487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f743c1010f0 0x7f743c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.585+0000 7f74437ff700 1 --2- 172.21.15.59:0/2418773487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f743c106740 0x7f743c106b20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.585+0000 7f74437ff700 1 --2- 172.21.15.59:0/2418773487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f743c100730 0x7f743c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.585+0000 7f74437ff700 1 -- 172.21.15.59:0/2418773487 >> 172.21.15.59:0/2418773487 conn(0x7f743c0fc200 msgr2=0x7f743c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.585+0000 7f74437ff700 1 -- 172.21.15.59:0/2418773487 shutdown_connections 2023-10-08T12:41:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.585+0000 7f74437ff700 1 -- 172.21.15.59:0/2418773487 wait complete. 2023-10-08T12:41:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.586+0000 7f74437ff700 1 Processor -- start 2023-10-08T12:41:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.586+0000 7f74437ff700 1 -- start start 2023-10-08T12:41:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f74437ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f743c100730 0x7f743c198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f74437ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f743c1010f0 0x7f743c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f74437ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f743c106740 0x7f743c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f74437ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c19dd00 con 0x7f743c106740 2023-10-08T12:41:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f74437ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c19de70 con 0x7f743c1010f0 2023-10-08T12:41:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f74437ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c19e030 con 0x7f743c100730 2023-10-08T12:41:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f7441d9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f743c106740 0x7f743c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f7440d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f743c1010f0 0x7f743c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f7440d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f743c1010f0 0x7f743c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:46542/0 (socket says 172.21.15.59:46542) 2023-10-08T12:41:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f7440d9a700 1 -- 172.21.15.59:0/4115859514 learned_addr learned my addr 172.21.15.59:0/4115859514 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f744159b700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f743c100730 0x7f743c198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f7440d9a700 1 -- 172.21.15.59:0/4115859514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f743c100730 msgr2=0x7f743c198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f7440d9a700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f743c100730 0x7f743c198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f7440d9a700 1 -- 172.21.15.59:0/4115859514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f743c106740 msgr2=0x7f743c19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f7440d9a700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f743c106740 0x7f743c19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f7440d9a700 1 -- 172.21.15.59:0/4115859514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380095f0 con 0x7f743c1010f0 2023-10-08T12:41:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.587+0000 7f7440d9a700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f743c1010f0 0x7f743c199320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f742c00e9a0 tx=0x7f742c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.588+0000 7f74327fc700 1 -- 172.21.15.59:0/4115859514 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c009790 con 0x7f743c1010f0 2023-10-08T12:41:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.588+0000 7f74437ff700 1 -- 172.21.15.59:0/4115859514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c19e310 con 0x7f743c1010f0 2023-10-08T12:41:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.588+0000 7f74327fc700 1 -- 172.21.15.59:0/4115859514 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f742c010430 con 0x7f743c1010f0 2023-10-08T12:41:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.588+0000 7f74327fc700 1 -- 172.21.15.59:0/4115859514 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c018680 con 0x7f743c1010f0 2023-10-08T12:41:02.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.588+0000 7f74437ff700 1 -- 172.21.15.59:0/4115859514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c1a5b50 con 0x7f743c1010f0 2023-10-08T12:41:02.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.589+0000 7f74437ff700 1 -- 172.21.15.59:0/4115859514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c101e70 con 0x7f743c1010f0 2023-10-08T12:41:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.591+0000 7f74327fc700 1 -- 172.21.15.59:0/4115859514 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f742c0105a0 con 0x7f743c1010f0 2023-10-08T12:41:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.592+0000 7f74327fc700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f74280a14d0 0x7f74280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.593+0000 7f74327fc700 1 -- 172.21.15.59:0/4115859514 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f742c014070 con 0x7f743c1010f0 2023-10-08T12:41:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.593+0000 7f744159b700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f74280a14d0 0x7f74280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.593+0000 7f744159b700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f74280a14d0 0x7f74280a3990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7438006010 tx=0x7f743800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.595+0000 7f74327fc700 1 -- 172.21.15.59:0/4115859514 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f742c0967a0 con 0x7f743c1010f0 2023-10-08T12:41:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.809+0000 7f74437ff700 1 -- 172.21.15.59:0/4115859514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f743c19a0e0 con 0x7f743c1010f0 2023-10-08T12:41:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.810+0000 7f74327fc700 1 -- 172.21.15.59:0/4115859514 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f742c0260a0 con 0x7f743c1010f0 2023-10-08T12:41:02.812 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T12:41:02.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.813+0000 7f74437ff700 1 -- 172.21.15.59:0/4115859514 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f74280a14d0 msgr2=0x7f74280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:02.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.813+0000 7f74437ff700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f74280a14d0 0x7f74280a3990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7438006010 tx=0x7f743800b260 comp rx=0 tx=0).stop 2023-10-08T12:41:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.813+0000 7f74437ff700 1 -- 172.21.15.59:0/4115859514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f743c1010f0 msgr2=0x7f743c199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.813+0000 7f74437ff700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f743c1010f0 0x7f743c199320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f742c00e9a0 tx=0x7f742c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.813+0000 7f74437ff700 1 -- 172.21.15.59:0/4115859514 shutdown_connections 2023-10-08T12:41:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.813+0000 7f74437ff700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f74280a14d0 0x7f74280a3990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.813+0000 7f74437ff700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f743c106740 0x7f743c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.813+0000 7f74437ff700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f743c100730 0x7f743c198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.813+0000 7f74437ff700 1 --2- 172.21.15.59:0/4115859514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f743c1010f0 0x7f743c199320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.813+0000 7f74437ff700 1 -- 172.21.15.59:0/4115859514 >> 172.21.15.59:0/4115859514 conn(0x7f743c0fc200 msgr2=0x7f743c10be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.813+0000 7f74437ff700 1 -- 172.21.15.59:0/4115859514 shutdown_connections 2023-10-08T12:41:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:02.814+0000 7f74437ff700 1 -- 172.21.15.59:0/4115859514 wait complete. 2023-10-08T12:41:02.833 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:41:03.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:02 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2919448918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:03.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:02 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/332617246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.039+0000 7fb6effff700 1 -- 172.21.15.59:0/1694938102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6e8100730 msgr2=0x7fb6e8100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.039+0000 7fb6effff700 1 --2- 172.21.15.59:0/1694938102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6e8100730 0x7fb6e8100bb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009990 tx=0x7fb6d8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.039+0000 7fb6effff700 1 -- 172.21.15.59:0/1694938102 shutdown_connections 2023-10-08T12:41:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.039+0000 7fb6effff700 1 --2- 172.21.15.59:0/1694938102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e81010f0 0x7fb6e810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.039+0000 7fb6effff700 1 --2- 172.21.15.59:0/1694938102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e8106740 0x7fb6e8106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.039+0000 7fb6effff700 1 --2- 172.21.15.59:0/1694938102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6e8100730 0x7fb6e8100bb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.039+0000 7fb6effff700 1 -- 172.21.15.59:0/1694938102 >> 172.21.15.59:0/1694938102 conn(0x7fb6e80fc200 msgr2=0x7fb6e80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.039+0000 7fb6effff700 1 -- 172.21.15.59:0/1694938102 shutdown_connections 2023-10-08T12:41:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.039+0000 7fb6effff700 1 -- 172.21.15.59:0/1694938102 wait complete. 2023-10-08T12:41:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.040+0000 7fb6effff700 1 Processor -- start 2023-10-08T12:41:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6effff700 1 -- start start 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6effff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e8100730 0x7fb6e8198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6effff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e81010f0 0x7fb6e8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6effff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6e8106740 0x7fb6e819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6effff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e819dce0 con 0x7fb6e81010f0 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6effff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e819de50 con 0x7fb6e8106740 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6effff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e819e010 con 0x7fb6e8100730 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6ed59a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e81010f0 0x7fb6e8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6edd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e8100730 0x7fb6e8198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6edd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e8100730 0x7fb6e8198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:42412/0 (socket says 172.21.15.59:42412) 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6ed59a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e81010f0 0x7fb6e8199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37742/0 (socket says 172.21.15.59:37742) 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6edd9b700 1 -- 172.21.15.59:0/849398784 learned_addr learned my addr 172.21.15.59:0/849398784 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.041+0000 7fb6ee59c700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6e8106740 0x7fb6e819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6edd9b700 1 -- 172.21.15.59:0/849398784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6e8106740 msgr2=0x7fb6e819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6edd9b700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6e8106740 0x7fb6e819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6edd9b700 1 -- 172.21.15.59:0/849398784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e81010f0 msgr2=0x7fb6e8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6edd9b700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e81010f0 0x7fb6e8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6edd9b700 1 -- 172.21.15.59:0/849398784 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80095f0 con 0x7fb6e8100730 2023-10-08T12:41:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6ed59a700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e81010f0 0x7fb6e8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6edd9b700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e8100730 0x7fb6e8198dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400e9a0 tx=0x7fb6e400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6deffd700 1 -- 172.21.15.59:0/849398784 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4009790 con 0x7fb6e8100730 2023-10-08T12:41:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6effff700 1 -- 172.21.15.59:0/849398784 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e819e2f0 con 0x7fb6e8100730 2023-10-08T12:41:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6deffd700 1 -- 172.21.15.59:0/849398784 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6e4010430 con 0x7fb6e8100730 2023-10-08T12:41:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6deffd700 1 -- 172.21.15.59:0/849398784 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4018680 con 0x7fb6e8100730 2023-10-08T12:41:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.042+0000 7fb6effff700 1 -- 172.21.15.59:0/849398784 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e81a5b30 con 0x7fb6e8100730 2023-10-08T12:41:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.043+0000 7fb6effff700 1 -- 172.21.15.59:0/849398784 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e8101e70 con 0x7fb6e8100730 2023-10-08T12:41:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.045+0000 7fb6deffd700 1 -- 172.21.15.59:0/849398784 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb6e40105a0 con 0x7fb6e8100730 2023-10-08T12:41:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.047+0000 7fb6deffd700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb6d40a14d0 0x7fb6d40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.047+0000 7fb6deffd700 1 -- 172.21.15.59:0/849398784 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb6e4014070 con 0x7fb6e8100730 2023-10-08T12:41:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.047+0000 7fb6ed59a700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb6d40a14d0 0x7fb6d40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.047+0000 7fb6ed59a700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb6d40a14d0 0x7fb6d40a3990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb6e819a310 tx=0x7fb6d800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.049+0000 7fb6deffd700 1 -- 172.21.15.59:0/849398784 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb6e40966e0 con 0x7fb6e8100730 2023-10-08T12:41:03.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:02 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2919448918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:03.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:02 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/332617246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:02 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2919448918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:02 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/332617246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:03.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.262+0000 7fb6effff700 1 -- 172.21.15.59:0/849398784 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6e819a160 con 0x7fb6e8100730 2023-10-08T12:41:03.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.263+0000 7fb6deffd700 1 -- 172.21.15.59:0/849398784 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6e4099d00 con 0x7fb6e8100730 2023-10-08T12:41:03.264 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-08T12:41:03.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.265+0000 7fb6effff700 1 -- 172.21.15.59:0/849398784 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb6d40a14d0 msgr2=0x7fb6d40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.265+0000 7fb6effff700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb6d40a14d0 0x7fb6d40a3990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb6e819a310 tx=0x7fb6d800b260 comp rx=0 tx=0).stop 2023-10-08T12:41:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.265+0000 7fb6effff700 1 -- 172.21.15.59:0/849398784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e8100730 msgr2=0x7fb6e8198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.265+0000 7fb6effff700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e8100730 0x7fb6e8198dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400e9a0 tx=0x7fb6e400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.265+0000 7fb6effff700 1 -- 172.21.15.59:0/849398784 shutdown_connections 2023-10-08T12:41:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.265+0000 7fb6effff700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb6d40a14d0 0x7fb6d40a3990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.265+0000 7fb6effff700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6e8106740 0x7fb6e819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.265+0000 7fb6effff700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e8100730 0x7fb6e8198dc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.265+0000 7fb6effff700 1 --2- 172.21.15.59:0/849398784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e81010f0 0x7fb6e8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.265+0000 7fb6effff700 1 -- 172.21.15.59:0/849398784 >> 172.21.15.59:0/849398784 conn(0x7fb6e80fc200 msgr2=0x7fb6e810be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.266+0000 7fb6effff700 1 -- 172.21.15.59:0/849398784 shutdown_connections 2023-10-08T12:41:03.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.266+0000 7fb6effff700 1 -- 172.21.15.59:0/849398784 wait complete. 2023-10-08T12:41:03.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:41:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.490+0000 7efe427ff700 1 -- 172.21.15.59:0/467474966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c1010f0 msgr2=0x7efe3c10d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.490+0000 7efe427ff700 1 --2- 172.21.15.59:0/467474966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c1010f0 0x7efe3c10d600 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efe3400b0a0 tx=0x7efe3400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.491+0000 7efe427ff700 1 -- 172.21.15.59:0/467474966 shutdown_connections 2023-10-08T12:41:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.491+0000 7efe427ff700 1 --2- 172.21.15.59:0/467474966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe3c106740 0x7efe3c106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.491+0000 7efe427ff700 1 --2- 172.21.15.59:0/467474966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c1010f0 0x7efe3c10d600 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.491+0000 7efe427ff700 1 --2- 172.21.15.59:0/467474966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe3c100730 0x7efe3c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.491+0000 7efe427ff700 1 -- 172.21.15.59:0/467474966 >> 172.21.15.59:0/467474966 conn(0x7efe3c0fc200 msgr2=0x7efe3c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:03.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.491+0000 7efe427ff700 1 -- 172.21.15.59:0/467474966 shutdown_connections 2023-10-08T12:41:03.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.491+0000 7efe427ff700 1 -- 172.21.15.59:0/467474966 wait complete. 2023-10-08T12:41:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.492+0000 7efe427ff700 1 Processor -- start 2023-10-08T12:41:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.492+0000 7efe427ff700 1 -- start start 2023-10-08T12:41:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.492+0000 7efe427ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c100730 0x7efe3c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.492+0000 7efe427ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe3c1010f0 0x7efe3c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.492+0000 7efe427ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe3c106740 0x7efe3c19c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.492+0000 7efe427ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c19cb60 con 0x7efe3c100730 2023-10-08T12:41:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.492+0000 7efe427ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c19ccd0 con 0x7efe3c1010f0 2023-10-08T12:41:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.492+0000 7efe427ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c19ce90 con 0x7efe3c106740 2023-10-08T12:41:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.492+0000 7efe3bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c100730 0x7efe3c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.492+0000 7efe3bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c100730 0x7efe3c198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37764/0 (socket says 172.21.15.59:37764) 2023-10-08T12:41:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.492+0000 7efe3bfff700 1 -- 172.21.15.59:0/3702407192 learned_addr learned my addr 172.21.15.59:0/3702407192 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe3b7fe700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe3c1010f0 0x7efe3c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe40d9c700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe3c106740 0x7efe3c19c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe3bfff700 1 -- 172.21.15.59:0/3702407192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe3c106740 msgr2=0x7efe3c19c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe3bfff700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe3c106740 0x7efe3c19c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe3bfff700 1 -- 172.21.15.59:0/3702407192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe3c1010f0 msgr2=0x7efe3c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe3bfff700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe3c1010f0 0x7efe3c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe3bfff700 1 -- 172.21.15.59:0/3702407192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe34009d00 con 0x7efe3c100730 2023-10-08T12:41:03.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe40d9c700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe3c106740 0x7efe3c19c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:03.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe3b7fe700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe3c1010f0 0x7efe3c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:03.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe3bfff700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c100730 0x7efe3c198d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00e9a0 tx=0x7efe2c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:03.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe397fa700 1 -- 172.21.15.59:0/3702407192 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c009790 con 0x7efe3c100730 2023-10-08T12:41:03.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe397fa700 1 -- 172.21.15.59:0/3702407192 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe2c00cbd0 con 0x7efe3c100730 2023-10-08T12:41:03.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe427ff700 1 -- 172.21.15.59:0/3702407192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c19d170 con 0x7efe3c100730 2023-10-08T12:41:03.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe397fa700 1 -- 172.21.15.59:0/3702407192 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c018680 con 0x7efe3c100730 2023-10-08T12:41:03.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.493+0000 7efe427ff700 1 -- 172.21.15.59:0/3702407192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c1a5ad0 con 0x7efe3c100730 2023-10-08T12:41:03.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.495+0000 7efe427ff700 1 -- 172.21.15.59:0/3702407192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c101e70 con 0x7efe3c100730 2023-10-08T12:41:03.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.496+0000 7efe397fa700 1 -- 172.21.15.59:0/3702407192 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7efe2c00cd40 con 0x7efe3c100730 2023-10-08T12:41:03.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.498+0000 7efe397fa700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efe240a14d0 0x7efe240a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.498+0000 7efe397fa700 1 -- 172.21.15.59:0/3702407192 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efe2c014070 con 0x7efe3c100730 2023-10-08T12:41:03.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.498+0000 7efe3b7fe700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efe240a14d0 0x7efe240a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.499+0000 7efe3b7fe700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efe240a14d0 0x7efe240a3990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efe30005950 tx=0x7efe300058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.502+0000 7efe397fa700 1 -- 172.21.15.59:0/3702407192 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efe2c0966a0 con 0x7efe3c100730 2023-10-08T12:41:03.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.716+0000 7efe427ff700 1 -- 172.21.15.59:0/3702407192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe3c19a090 con 0x7efe3c100730 2023-10-08T12:41:03.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.717+0000 7efe397fa700 1 -- 172.21.15.59:0/3702407192 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7efe2c099cc0 con 0x7efe3c100730 2023-10-08T12:41:03.718 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-08T12:41:03.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 -- 172.21.15.59:0/3702407192 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efe240a14d0 msgr2=0x7efe240a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efe240a14d0 0x7efe240a3990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efe30005950 tx=0x7efe300058e0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 -- 172.21.15.59:0/3702407192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c100730 msgr2=0x7efe3c198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c100730 0x7efe3c198d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00e9a0 tx=0x7efe2c00ed60 comp rx=0 tx=0).stop 2023-10-08T12:41:03.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 -- 172.21.15.59:0/3702407192 shutdown_connections 2023-10-08T12:41:03.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efe240a14d0 0x7efe240a3990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe3c106740 0x7efe3c19c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c100730 0x7efe3c198d80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 --2- 172.21.15.59:0/3702407192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe3c1010f0 0x7efe3c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 -- 172.21.15.59:0/3702407192 >> 172.21.15.59:0/3702407192 conn(0x7efe3c0fc200 msgr2=0x7efe3c0fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:03.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 -- 172.21.15.59:0/3702407192 shutdown_connections 2023-10-08T12:41:03.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.719+0000 7efe427ff700 1 -- 172.21.15.59:0/3702407192 wait complete. 2023-10-08T12:41:03.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:41:03.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.944+0000 7f03ce5ff700 1 -- 172.21.15.59:0/3180689259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c8100ff0 msgr2=0x7f03c810d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.944+0000 7f03ce5ff700 1 --2- 172.21.15.59:0/3180689259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c8100ff0 0x7f03c810d500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f03c000b0a0 tx=0x7f03c000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.944+0000 7f03ce5ff700 1 -- 172.21.15.59:0/3180689259 shutdown_connections 2023-10-08T12:41:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.944+0000 7f03ce5ff700 1 --2- 172.21.15.59:0/3180689259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c8100ff0 0x7f03c810d500 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.944+0000 7f03ce5ff700 1 --2- 172.21.15.59:0/3180689259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03c8106640 0x7f03c8106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.944+0000 7f03ce5ff700 1 --2- 172.21.15.59:0/3180689259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c8100630 0x7f03c8100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.944+0000 7f03ce5ff700 1 -- 172.21.15.59:0/3180689259 >> 172.21.15.59:0/3180689259 conn(0x7f03c80fc140 msgr2=0x7f03c80fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.944+0000 7f03ce5ff700 1 -- 172.21.15.59:0/3180689259 shutdown_connections 2023-10-08T12:41:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.944+0000 7f03ce5ff700 1 -- 172.21.15.59:0/3180689259 wait complete. 2023-10-08T12:41:03.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.945+0000 7f03ce5ff700 1 Processor -- start 2023-10-08T12:41:03.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.945+0000 7f03ce5ff700 1 -- start start 2023-10-08T12:41:03.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03ce5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c8100630 0x7f03c819e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03ce5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c8100ff0 0x7f03c819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03ce5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03c8106640 0x7f03c8198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03ce5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c8199130 con 0x7f03c8100ff0 2023-10-08T12:41:03.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03ce5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c81992a0 con 0x7f03c8100630 2023-10-08T12:41:03.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03ce5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c8199460 con 0x7f03c8106640 2023-10-08T12:41:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03c77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c8100ff0 0x7f03c819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03c7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c8100630 0x7f03c819e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03c77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c8100ff0 0x7f03c819ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37792/0 (socket says 172.21.15.59:37792) 2023-10-08T12:41:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03c77fe700 1 -- 172.21.15.59:0/31990331 learned_addr learned my addr 172.21.15.59:0/31990331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03ccb9c700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03c8106640 0x7f03c8198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03c7fff700 1 -- 172.21.15.59:0/31990331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03c8106640 msgr2=0x7f03c8198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03c7fff700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03c8106640 0x7f03c8198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03c7fff700 1 -- 172.21.15.59:0/31990331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c8100ff0 msgr2=0x7f03c819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03c7fff700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c8100ff0 0x7f03c819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03c7fff700 1 -- 172.21.15.59:0/31990331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0009d00 con 0x7f03c8100630 2023-10-08T12:41:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03ccb9c700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03c8106640 0x7f03c8198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.946+0000 7f03c77fe700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c8100ff0 0x7f03c819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.947+0000 7f03c7fff700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c8100630 0x7f03c819e950 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f03b800e9f0 tx=0x7f03b800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.947+0000 7f03c57fa700 1 -- 172.21.15.59:0/31990331 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b800c9c0 con 0x7f03c8100630 2023-10-08T12:41:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.947+0000 7f03ce5ff700 1 -- 172.21.15.59:0/31990331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c8199740 con 0x7f03c8100630 2023-10-08T12:41:03.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.947+0000 7f03c57fa700 1 -- 172.21.15.59:0/31990331 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03b8010430 con 0x7f03c8100630 2023-10-08T12:41:03.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.947+0000 7f03c57fa700 1 -- 172.21.15.59:0/31990331 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8018680 con 0x7f03c8100630 2023-10-08T12:41:03.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.947+0000 7f03ce5ff700 1 -- 172.21.15.59:0/31990331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c81a5940 con 0x7f03c8100630 2023-10-08T12:41:03.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.948+0000 7f03ce5ff700 1 -- 172.21.15.59:0/31990331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c8101d70 con 0x7f03c8100630 2023-10-08T12:41:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.950+0000 7f03c57fa700 1 -- 172.21.15.59:0/31990331 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f03b8010860 con 0x7f03c8100630 2023-10-08T12:41:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.951+0000 7f03c57fa700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03b00a14d0 0x7f03b00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.951+0000 7f03c57fa700 1 -- 172.21.15.59:0/31990331 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f03b8014070 con 0x7f03c8100630 2023-10-08T12:41:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.951+0000 7f03c77fe700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03b00a14d0 0x7f03b00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.952+0000 7f03c77fe700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03b00a14d0 0x7f03b00a3990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f03c8199c40 tx=0x7f03bc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:03.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:03.953+0000 7f03c57fa700 1 -- 172.21.15.59:0/31990331 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f03b8096440 con 0x7f03c8100630 2023-10-08T12:41:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:03 smithi059 ceph-mon[98489]: pgmap v310: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:03 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4115859514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:03 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/849398784' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:04.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:03 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3702407192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:03 smithi092 ceph-mon[134093]: pgmap v310: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:03 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4115859514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:03 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/849398784' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:04.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:03 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3702407192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.214+0000 7f03ce5ff700 1 -- 172.21.15.59:0/31990331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03c8067450 con 0x7f03c8100630 2023-10-08T12:41:04.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.215+0000 7f03c57fa700 1 -- 172.21.15.59:0/31990331 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f03b8099a60 con 0x7f03c8100630 2023-10-08T12:41:04.216 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:04.216 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:41:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:03 smithi173 ceph-mon[135182]: pgmap v310: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:03 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4115859514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:03 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/849398784' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:03 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3702407192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 -- 172.21.15.59:0/31990331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03b00a14d0 msgr2=0x7f03b00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03b00a14d0 0x7f03b00a3990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f03c8199c40 tx=0x7f03bc009260 comp rx=0 tx=0).stop 2023-10-08T12:41:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 -- 172.21.15.59:0/31990331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c8100630 msgr2=0x7f03c819e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c8100630 0x7f03c819e950 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f03b800e9f0 tx=0x7f03b800ed00 comp rx=0 tx=0).stop 2023-10-08T12:41:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 -- 172.21.15.59:0/31990331 shutdown_connections 2023-10-08T12:41:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03b00a14d0 0x7f03b00a3990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c8100630 0x7f03c819e950 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03c8106640 0x7f03c8198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 --2- 172.21.15.59:0/31990331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c8100ff0 0x7f03c819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 -- 172.21.15.59:0/31990331 >> 172.21.15.59:0/31990331 conn(0x7f03c80fc140 msgr2=0x7f03c80fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 -- 172.21.15.59:0/31990331 shutdown_connections 2023-10-08T12:41:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.218+0000 7f03ce5ff700 1 -- 172.21.15.59:0/31990331 wait complete. 2023-10-08T12:41:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:41:04.238 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:41:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.440+0000 7f4f96dff700 1 -- 172.21.15.59:0/4202171488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f90106640 msgr2=0x7f4f90106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.440+0000 7f4f96dff700 1 --2- 172.21.15.59:0/4202171488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f90106640 0x7f4f90106a20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f84009990 tx=0x7f4f84009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.440+0000 7f4f96dff700 1 -- 172.21.15.59:0/4202171488 shutdown_connections 2023-10-08T12:41:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.440+0000 7f4f96dff700 1 --2- 172.21.15.59:0/4202171488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f90100ff0 0x7f4f9010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.440+0000 7f4f96dff700 1 --2- 172.21.15.59:0/4202171488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f90106640 0x7f4f90106a20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.440+0000 7f4f96dff700 1 --2- 172.21.15.59:0/4202171488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f90100630 0x7f4f90100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.440+0000 7f4f96dff700 1 -- 172.21.15.59:0/4202171488 >> 172.21.15.59:0/4202171488 conn(0x7f4f900fc140 msgr2=0x7f4f900fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.440+0000 7f4f96dff700 1 -- 172.21.15.59:0/4202171488 shutdown_connections 2023-10-08T12:41:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.440+0000 7f4f96dff700 1 -- 172.21.15.59:0/4202171488 wait complete. 2023-10-08T12:41:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.441+0000 7f4f96dff700 1 Processor -- start 2023-10-08T12:41:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f96dff700 1 -- start start 2023-10-08T12:41:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f96dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f90100630 0x7f4f90198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f96dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f90100ff0 0x7f4f90199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f96dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f90106640 0x7f4f9019c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f96dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9019cb50 con 0x7f4f90100ff0 2023-10-08T12:41:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f96dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9019ccc0 con 0x7f4f90100630 2023-10-08T12:41:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f96dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9019ce80 con 0x7f4f90106640 2023-10-08T12:41:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f90100ff0 0x7f4f90199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f90100ff0 0x7f4f90199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37820/0 (socket says 172.21.15.59:37820) 2023-10-08T12:41:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f8ffff700 1 -- 172.21.15.59:0/2237158994 learned_addr learned my addr 172.21.15.59:0/2237158994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f94b9b700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f90100630 0x7f4f90198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.442+0000 7f4f9539c700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f90106640 0x7f4f9019c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.443+0000 7f4f8ffff700 1 -- 172.21.15.59:0/2237158994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f90106640 msgr2=0x7f4f9019c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.443+0000 7f4f8ffff700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f90106640 0x7f4f9019c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.443+0000 7f4f8ffff700 1 -- 172.21.15.59:0/2237158994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f90100630 msgr2=0x7f4f90198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.443+0000 7f4f8ffff700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f90100630 0x7f4f90198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.443+0000 7f4f8ffff700 1 -- 172.21.15.59:0/2237158994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f88009c40 con 0x7f4f90100ff0 2023-10-08T12:41:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.443+0000 7f4f8ffff700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f90100ff0 0x7f4f90199260 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00e9a0 tx=0x7f4f7c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.443+0000 7f4f8dffb700 1 -- 172.21.15.59:0/2237158994 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c009790 con 0x7f4f90100ff0 2023-10-08T12:41:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.443+0000 7f4f8dffb700 1 -- 172.21.15.59:0/2237158994 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f7c00ce80 con 0x7f4f90100ff0 2023-10-08T12:41:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.443+0000 7f4f8dffb700 1 -- 172.21.15.59:0/2237158994 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c018680 con 0x7f4f90100ff0 2023-10-08T12:41:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.443+0000 7f4f96dff700 1 -- 172.21.15.59:0/2237158994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f840095f0 con 0x7f4f90100ff0 2023-10-08T12:41:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.443+0000 7f4f96dff700 1 -- 172.21.15.59:0/2237158994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f901a58e0 con 0x7f4f90100ff0 2023-10-08T12:41:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.444+0000 7f4f96dff700 1 -- 172.21.15.59:0/2237158994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f90101d70 con 0x7f4f90100ff0 2023-10-08T12:41:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.446+0000 7f4f8dffb700 1 -- 172.21.15.59:0/2237158994 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f4f7c010430 con 0x7f4f90100ff0 2023-10-08T12:41:04.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.449+0000 7f4f8dffb700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f800a1550 0x7f4f800a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.449+0000 7f4f8dffb700 1 -- 172.21.15.59:0/2237158994 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f4f7c014070 con 0x7f4f90100ff0 2023-10-08T12:41:04.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.449+0000 7f4f94b9b700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f800a1550 0x7f4f800a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.450+0000 7f4f94b9b700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f800a1550 0x7f4f800a3a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4f84006010 tx=0x7f4f8400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.452+0000 7f4f8dffb700 1 -- 172.21.15.59:0/2237158994 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4f7c096890 con 0x7f4f90100ff0 2023-10-08T12:41:04.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.664+0000 7f4f96dff700 1 -- 172.21.15.59:0/2237158994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f90110610 con 0x7f4f90100ff0 2023-10-08T12:41:04.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.666+0000 7f4f8dffb700 1 -- 172.21.15.59:0/2237158994 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22725 (secure 0 0 0) 0x7f4f7c026090 con 0x7f4f90100ff0 2023-10-08T12:41:04.667 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:04.667 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":86,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:40:11.783762+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:41:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 -- 172.21.15.59:0/2237158994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f800a1550 msgr2=0x7f4f800a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f800a1550 0x7f4f800a3a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4f84006010 tx=0x7f4f8400b260 comp rx=0 tx=0).stop 2023-10-08T12:41:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 -- 172.21.15.59:0/2237158994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f90100ff0 msgr2=0x7f4f90199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f90100ff0 0x7f4f90199260 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00e9a0 tx=0x7f4f7c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 -- 172.21.15.59:0/2237158994 shutdown_connections 2023-10-08T12:41:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f800a1550 0x7f4f800a3a10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f90100630 0x7f4f90198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f90106640 0x7f4f9019c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 --2- 172.21.15.59:0/2237158994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f90100ff0 0x7f4f90199260 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 -- 172.21.15.59:0/2237158994 >> 172.21.15.59:0/2237158994 conn(0x7f4f900fc140 msgr2=0x7f4f9010bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 -- 172.21.15.59:0/2237158994 shutdown_connections 2023-10-08T12:41:04.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.668+0000 7f4f96dff700 1 -- 172.21.15.59:0/2237158994 wait complete. 2023-10-08T12:41:04.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-08T12:39:13.722264+0000', 'modified': '2023-10-08T12:39:18.723320+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24710}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24673': {'gid': 24673, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6839/2951536251', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 2951536251}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 2951536251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24710': {'gid': 24710, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6839/2979385377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 2979385377}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 2979385377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T12:41:04.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T12:41:04.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T12:41:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.894+0000 7f2e359ff700 1 -- 172.21.15.59:0/2225201838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30067ce0 msgr2=0x7f2e300680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.894+0000 7f2e359ff700 1 --2- 172.21.15.59:0/2225201838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30067ce0 0x7f2e300680c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2e200099c0 tx=0x7f2e20009cd0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.894+0000 7f2e359ff700 1 -- 172.21.15.59:0/2225201838 shutdown_connections 2023-10-08T12:41:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.894+0000 7f2e359ff700 1 --2- 172.21.15.59:0/2225201838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e30105b80 0x7f2e3010d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.894+0000 7f2e359ff700 1 --2- 172.21.15.59:0/2225201838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30067ce0 0x7f2e300680c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.894+0000 7f2e359ff700 1 --2- 172.21.15.59:0/2225201838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e301051c0 0x7f2e30105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.894+0000 7f2e359ff700 1 -- 172.21.15.59:0/2225201838 >> 172.21.15.59:0/2225201838 conn(0x7f2e30076780 msgr2=0x7f2e30076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:04.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.894+0000 7f2e359ff700 1 -- 172.21.15.59:0/2225201838 shutdown_connections 2023-10-08T12:41:04.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.894+0000 7f2e359ff700 1 -- 172.21.15.59:0/2225201838 wait complete. 2023-10-08T12:41:04.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.895+0000 7f2e359ff700 1 Processor -- start 2023-10-08T12:41:04.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.895+0000 7f2e359ff700 1 -- start start 2023-10-08T12:41:04.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e359ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30067ce0 0x7f2e300ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e359ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e301051c0 0x7f2e300ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e359ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e30105b80 0x7f2e30100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e359ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301a5030 con 0x7f2e30067ce0 2023-10-08T12:41:04.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e359ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301a51a0 con 0x7f2e301051c0 2023-10-08T12:41:04.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e359ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301a5360 con 0x7f2e30105b80 2023-10-08T12:41:04.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e2effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30067ce0 0x7f2e300ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e2e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e301051c0 0x7f2e300ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e2e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e301051c0 0x7f2e300ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:46652/0 (socket says 172.21.15.59:46652) 2023-10-08T12:41:04.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e2e7fc700 1 -- 172.21.15.59:0/3187196810 learned_addr learned my addr 172.21.15.59:0/3187196810 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:04.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e2f7fe700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e30105b80 0x7f2e30100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e2effd700 1 -- 172.21.15.59:0/3187196810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e30105b80 msgr2=0x7f2e30100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e2effd700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e30105b80 0x7f2e30100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e2effd700 1 -- 172.21.15.59:0/3187196810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e301051c0 msgr2=0x7f2e300ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e2effd700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e301051c0 0x7f2e300ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.896+0000 7f2e2effd700 1 -- 172.21.15.59:0/3187196810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e200095f0 con 0x7f2e30067ce0 2023-10-08T12:41:04.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.897+0000 7f2e2effd700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30067ce0 0x7f2e300ff6b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2e200098e0 tx=0x7f2e2000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:04.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.897+0000 7f2e349fd700 1 -- 172.21.15.59:0/3187196810 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2001c070 con 0x7f2e30067ce0 2023-10-08T12:41:04.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.897+0000 7f2e359ff700 1 -- 172.21.15.59:0/3187196810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e301a55e0 con 0x7f2e30067ce0 2023-10-08T12:41:04.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.897+0000 7f2e349fd700 1 -- 172.21.15.59:0/3187196810 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e2000fd80 con 0x7f2e30067ce0 2023-10-08T12:41:04.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.897+0000 7f2e349fd700 1 -- 172.21.15.59:0/3187196810 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20004970 con 0x7f2e30067ce0 2023-10-08T12:41:04.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.897+0000 7f2e359ff700 1 -- 172.21.15.59:0/3187196810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e301a5a00 con 0x7f2e30067ce0 2023-10-08T12:41:04.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.900+0000 7f2e349fd700 1 -- 172.21.15.59:0/3187196810 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f2e20020070 con 0x7f2e30067ce0 2023-10-08T12:41:04.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.902+0000 7f2e4923bb80 1 Processor -- start 2023-10-08T12:41:04.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.902+0000 7f2e349fd700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2e180a14d0 0x7f2e180a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.902+0000 7f2e349fd700 1 -- 172.21.15.59:0/3187196810 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2e200cd890 con 0x7f2e30067ce0 2023-10-08T12:41:04.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.902+0000 7f2e4923bb80 1 -- start start 2023-10-08T12:41:04.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.902+0000 7f2e2e7fc700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2e180a14d0 0x7f2e180a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.902+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c145a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.902+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c145a750 0x5610c14650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.902+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1465600 0x5610c14679f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.902+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c13c3410 con 0x5610c1459e30 2023-10-08T12:41:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.902+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c13b4bd0 con 0x5610c1465600 2023-10-08T12:41:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.902+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c13b24f0 con 0x5610c145a750 2023-10-08T12:41:04.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c145a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c145a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37832/0 (socket says 172.21.15.59:37832) 2023-10-08T12:41:04.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2effd700 1 -- 172.21.15.59:0/181853254 learned_addr learned my addr 172.21.15.59:0/181853254 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:04.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2e7fc700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2e180a14d0 0x7f2e180a3990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2e30100de0 tx=0x7f2e24009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:04.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2f7fe700 1 --2- 172.21.15.59:0/181853254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1465600 0x5610c14679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2e7fc700 1 --2- 172.21.15.59:0/181853254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c145a750 0x5610c14650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2effd700 1 -- 172.21.15.59:0/181853254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c145a750 msgr2=0x5610c14650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:04.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2effd700 1 --2- 172.21.15.59:0/181853254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c145a750 0x5610c14650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2effd700 1 -- 172.21.15.59:0/181853254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1465600 msgr2=0x5610c14679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:04.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2effd700 1 --2- 172.21.15.59:0/181853254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1465600 0x5610c14679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2effd700 1 -- 172.21.15.59:0/181853254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610c11d8d90 con 0x5610c1459e30 2023-10-08T12:41:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2f7fe700 1 --2- 172.21.15.59:0/181853254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1465600 0x5610c14679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2e7fc700 1 --2- 172.21.15.59:0/181853254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c145a750 0x5610c14650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e2effd700 1 --2- 172.21.15.59:0/181853254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c145a210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2e20097040 tx=0x7f2e2009a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bf94d6ba8dd6df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e15ffb700 1 -- 172.21.15.59:0/181853254 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2009ab40 con 0x5610c1459e30 2023-10-08T12:41:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e15ffb700 1 -- 172.21.15.59:0/181853254 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e2009ec90 con 0x5610c1459e30 2023-10-08T12:41:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.903+0000 7f2e15ffb700 1 -- 172.21.15.59:0/181853254 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2009afa0 con 0x5610c1459e30 2023-10-08T12:41:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.904+0000 7f2e4923bb80 1 -- 172.21.15.59:0/181853254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 msgr2=0x5610c145a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.904+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/181853254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c145a210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2e20097040 tx=0x7f2e2009a700 comp rx=0 tx=0).stop 2023-10-08T12:41:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.904+0000 7f2e4923bb80 1 -- 172.21.15.59:0/181853254 shutdown_connections 2023-10-08T12:41:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.904+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/181853254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1465600 0x5610c14679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.904+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/181853254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c145a210 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.904+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/181853254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c145a750 0x5610c14650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.904+0000 7f2e4923bb80 1 -- 172.21.15.59:0/181853254 >> 172.21.15.59:0/181853254 conn(0x5610c13cf210 msgr2=0x5610c1456280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.904+0000 7f2e4923bb80 1 -- 172.21.15.59:0/181853254 shutdown_connections 2023-10-08T12:41:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.904+0000 7f2e4923bb80 1 -- 172.21.15.59:0/181853254 wait complete. 2023-10-08T12:41:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.905+0000 7f2e4923bb80 1 -- start start 2023-10-08T12:41:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.905+0000 7f2e4923bb80 1 Processor -- start 2023-10-08T12:41:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 0x5610c14659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c1465f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 0x5610c1466460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c13adde0 con 0x5610c145a750 2023-10-08T12:41:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c134a6c0 con 0x5610c1459e30 2023-10-08T12:41:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c134a360 con 0x5610c1465600 2023-10-08T12:41:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e4923bb80 10 client.0 _ll_register_callbacks cb 0x5610c11a77b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 0x5610c1466460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c1465f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 0x5610c1466460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:42514/0 (socket says 172.21.15.59:42514) 2023-10-08T12:41:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c1465f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37840/0 (socket says 172.21.15.59:37840) 2023-10-08T12:41:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2f7fe700 1 -- 172.21.15.59:0/2200809953 learned_addr learned my addr 172.21.15.59:0/2200809953 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2effd700 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 0x5610c14659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2f7fe700 1 -- 172.21.15.59:0/2200809953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 msgr2=0x5610c14659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2f7fe700 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 0x5610c14659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2f7fe700 1 -- 172.21.15.59:0/2200809953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 msgr2=0x5610c1465f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2f7fe700 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c1465f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2f7fe700 1 -- 172.21.15.59:0/2200809953 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e301a5a00 con 0x5610c1465600 2023-10-08T12:41:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2effd700 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 0x5610c14659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.906+0000 7f2e2e7fc700 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c1465f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.907+0000 7f2e2f7fe700 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 0x5610c1466460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e280060b0 tx=0x7f2e28004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b241cd9d335491a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.907+0000 7f2e0effd700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:41:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.907+0000 7f2e0effd700 1 -- 172.21.15.59:0/2200809953 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28007710 con 0x5610c1465600 2023-10-08T12:41:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.907+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2200809953 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610c1375e60 con 0x5610c1465600 2023-10-08T12:41:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.907+0000 7f2e0effd700 1 -- 172.21.15.59:0/2200809953 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2e28007870 con 0x5610c1465600 2023-10-08T12:41:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.907+0000 7f2e0effd700 1 -- 172.21.15.59:0/2200809953 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e28007a30 con 0x5610c1465600 2023-10-08T12:41:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.907+0000 7f2e4923bb80 10 client.25240 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.907+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2200809953 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5610c11c1c10 con 0x5610c1465600 2023-10-08T12:41:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.907+0000 7f2e0effd700 1 -- 172.21.15.59:0/2200809953 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5610c1375e60 con 0x5610c1465600 2023-10-08T12:41:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.908+0000 7f2e0effd700 1 -- 172.21.15.59:0/2200809953 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2e28014070 con 0x5610c1465600 2023-10-08T12:41:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.908+0000 7f2e4923bb80 10 client.25240 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.908+0000 7f2e4923bb80 10 client.25240 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T12:41:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.908+0000 7f2e4923bb80 20 client.25240 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.908+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610c1474df0 0x5610c1473830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.908+0000 7f2e4923bb80 4 client.25240 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.908+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2200809953 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610c13a6dc0 con 0x5610c1474df0 2023-10-08T12:41:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.908+0000 7f2e2effd700 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610c1474df0 0x5610c1473830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.908+0000 7f2e2effd700 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610c1474df0 0x5610c1473830 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40517b8c49c7a30a server_cookie=624cf0244921837b in_seq=0 out_seq=0 2023-10-08T12:41:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.908+0000 7f2e0effd700 10 client.25240 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.909+0000 7f2e0effd700 1 -- 172.21.15.59:0/2200809953 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5610c13a6dc0 con 0x5610c1474df0 2023-10-08T12:41:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.909+0000 7f2e0effd700 10 client.25240 handle_command_reply: tid=0 2023-10-08T12:41:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.909+0000 7f2e4923bb80 1 client.25240 shutdown 2023-10-08T12:41:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.909+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2200809953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 msgr2=0x5610c1466460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.909+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 0x5610c1466460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e280060b0 tx=0x7f2e28004320 comp rx=0 tx=0).stop 2023-10-08T12:41:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.910+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2200809953 shutdown_connections 2023-10-08T12:41:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.910+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610c1474df0 0x5610c1473830 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.910+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 0x5610c14659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.910+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 0x5610c1466460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.910+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2200809953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c1465f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.910+0000 7f2e0effd700 0 client.25240 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.910+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2200809953 >> 172.21.15.59:0/2200809953 conn(0x5610c13cf210 msgr2=0x5610c1455e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.910+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2200809953 shutdown_connections 2023-10-08T12:41:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.910+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2200809953 wait complete. 2023-10-08T12:41:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.910+0000 7f2e4923bb80 20 client.25240 trim_cache size 0 max 16384 2023-10-08T12:41:04.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e4923bb80 1 Processor -- start 2023-10-08T12:41:04.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e4923bb80 1 -- start start 2023-10-08T12:41:04.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c1463060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c145a750 0x5610c14635a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1465600 0x5610c1473830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c122e8d0 con 0x5610c1459e30 2023-10-08T12:41:04.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c13a9ed0 con 0x5610c1465600 2023-10-08T12:41:04.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c13544d0 con 0x5610c145a750 2023-10-08T12:41:04.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e2effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c1463060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e2effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c1463060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37844/0 (socket says 172.21.15.59:37844) 2023-10-08T12:41:04.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e2e7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c145a750 0x5610c14635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.928+0000 7f2e2effd700 1 -- 172.21.15.59:0/724482984 learned_addr learned my addr 172.21.15.59:0/724482984 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:04.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.929+0000 7f2e2f7fe700 1 --2- 172.21.15.59:0/724482984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1465600 0x5610c1473830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.929+0000 7f2e2effd700 1 -- 172.21.15.59:0/724482984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c145a750 msgr2=0x5610c14635a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:04.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.929+0000 7f2e2effd700 1 --2- 172.21.15.59:0/724482984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c145a750 0x5610c14635a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.929+0000 7f2e2effd700 1 -- 172.21.15.59:0/724482984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1465600 msgr2=0x5610c1473830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:04.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.929+0000 7f2e2effd700 1 --2- 172.21.15.59:0/724482984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1465600 0x5610c1473830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.929+0000 7f2e2effd700 1 -- 172.21.15.59:0/724482984 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610c11ff200 con 0x5610c1459e30 2023-10-08T12:41:04.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.929+0000 7f2e2effd700 1 --2- 172.21.15.59:0/724482984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c1463060 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2e20005cb0 tx=0x7f2e200b9fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3868d1ddf1e3c13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:04.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.929+0000 7f2e167fc700 1 -- 172.21.15.59:0/724482984 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e200b7070 con 0x5610c1459e30 2023-10-08T12:41:04.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.929+0000 7f2e167fc700 1 -- 172.21.15.59:0/724482984 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e2009abc0 con 0x5610c1459e30 2023-10-08T12:41:04.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.929+0000 7f2e167fc700 1 -- 172.21.15.59:0/724482984 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2009a030 con 0x5610c1459e30 2023-10-08T12:41:04.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.930+0000 7f2e4923bb80 1 -- 172.21.15.59:0/724482984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 msgr2=0x5610c1463060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.930+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/724482984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c1463060 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2e20005cb0 tx=0x7f2e200b9fc0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.930+0000 7f2e4923bb80 1 -- 172.21.15.59:0/724482984 shutdown_connections 2023-10-08T12:41:04.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.930+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/724482984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1465600 0x5610c1473830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.930+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/724482984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c1459e30 0x5610c1463060 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.930+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/724482984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c145a750 0x5610c14635a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.930+0000 7f2e4923bb80 1 -- 172.21.15.59:0/724482984 >> 172.21.15.59:0/724482984 conn(0x5610c13cf210 msgr2=0x5610c1464020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:04.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.930+0000 7f2e4923bb80 1 -- 172.21.15.59:0/724482984 shutdown_connections 2023-10-08T12:41:04.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.930+0000 7f2e4923bb80 1 -- 172.21.15.59:0/724482984 wait complete. 2023-10-08T12:41:04.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.930+0000 7f2e4923bb80 1 -- start start 2023-10-08T12:41:04.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.931+0000 7f2e4923bb80 1 Processor -- start 2023-10-08T12:41:04.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.931+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 0x5610c147d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.931+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c147d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e4923bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 0x5610c1477810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c1477ef0 con 0x5610c145a750 2023-10-08T12:41:04.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c1478030 con 0x5610c1459e30 2023-10-08T12:41:04.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e4923bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c14781f0 con 0x5610c1465600 2023-10-08T12:41:04.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e4923bb80 10 client.0 _ll_register_callbacks cb 0x7f2e28009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:04.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e2e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c147d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e2e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c147d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37858/0 (socket says 172.21.15.59:37858) 2023-10-08T12:41:04.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e2e7fc700 1 -- 172.21.15.59:0/2231081881 learned_addr learned my addr 172.21.15.59:0/2231081881 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:04.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e2effd700 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 0x5610c147d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e2f7fe700 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 0x5610c1477810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e2e7fc700 1 -- 172.21.15.59:0/2231081881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 msgr2=0x5610c1477810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e2e7fc700 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 0x5610c1477810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e2e7fc700 1 -- 172.21.15.59:0/2231081881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 msgr2=0x5610c147d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e2e7fc700 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 0x5610c147d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e2e7fc700 1 -- 172.21.15.59:0/2231081881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610c11d8d90 con 0x5610c145a750 2023-10-08T12:41:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.932+0000 7f2e2effd700 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 0x5610c147d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.933+0000 7f2e2e7fc700 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c147d830 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009be0 tx=0x7f2e240047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69222bbce07aaee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.933+0000 7f2e0effd700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:41:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.933+0000 7f2e0effd700 1 -- 172.21.15.59:0/2231081881 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24009ec0 con 0x5610c145a750 2023-10-08T12:41:04.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.933+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2231081881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e2009ec90 con 0x5610c145a750 2023-10-08T12:41:04.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.933+0000 7f2e0effd700 1 -- 172.21.15.59:0/2231081881 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2e2401bc40 con 0x5610c145a750 2023-10-08T12:41:04.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.933+0000 7f2e0effd700 1 -- 172.21.15.59:0/2231081881 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e2401be00 con 0x5610c145a750 2023-10-08T12:41:04.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.933+0000 7f2e4923bb80 10 client.15249 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:04.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.933+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2231081881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5610c11d7260 con 0x5610c145a750 2023-10-08T12:41:04.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.933+0000 7f2e0effd700 1 -- 172.21.15.59:0/2231081881 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e2009ec90 con 0x5610c145a750 2023-10-08T12:41:04.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.933+0000 7f2e0effd700 1 -- 172.21.15.59:0/2231081881 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2e24026070 con 0x5610c145a750 2023-10-08T12:41:04.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.934+0000 7f2e4923bb80 10 client.15249 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:04.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.934+0000 7f2e4923bb80 10 client.15249 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T12:41:04.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.934+0000 7f2e4923bb80 20 client.15249 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:04.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.934+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610c14cd750 0x5610c14c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:04.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.934+0000 7f2e4923bb80 4 client.15249 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:41:04.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.934+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2231081881 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5610c13a6ae0 con 0x5610c14cd750 2023-10-08T12:41:04.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.934+0000 7f2e2effd700 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610c14cd750 0x5610c14c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:04.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.934+0000 7f2e2effd700 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610c14cd750 0x5610c14c9bd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54ec8b5297acdb0e server_cookie=ea5db17630e870a5 in_seq=0 out_seq=0 2023-10-08T12:41:04.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.934+0000 7f2e0effd700 10 client.15249 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:04.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e0effd700 1 -- 172.21.15.59:0/2231081881 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x5610c13a6ae0 con 0x5610c14cd750 2023-10-08T12:41:04.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e0effd700 10 client.15249 handle_command_reply: tid=0 2023-10-08T12:41:04.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 1 client.15249 shutdown 2023-10-08T12:41:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2231081881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 msgr2=0x5610c147d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c147d830 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009be0 tx=0x7f2e240047c0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2231081881 shutdown_connections 2023-10-08T12:41:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610c14cd750 0x5610c14c9bd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610c1459e30 0x5610c147d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610c1465600 0x5610c1477810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 1 --2- 172.21.15.59:0/2231081881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610c145a750 0x5610c147d830 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e0effd700 0 client.15249 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2231081881 >> 172.21.15.59:0/2231081881 conn(0x5610c13cf210 msgr2=0x5610c1462fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:04.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2231081881 shutdown_connections 2023-10-08T12:41:04.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 1 -- 172.21.15.59:0/2231081881 wait complete. 2023-10-08T12:41:04.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.935+0000 7f2e4923bb80 20 client.15249 trim_cache size 0 max 16384 2023-10-08T12:41:04.943 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:41:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "6a005028-65d6-11ee-8db5-212e2dc638e7", 2023-10-08T12:41:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-10-08T12:41:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24710, 2023-10-08T12:41:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-10-08T12:41:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-10-08T12:41:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-10-08T12:41:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 110.239612083, 2023-10-08T12:41:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 20, 2023-10-08T12:41:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 86, 2023-10-08T12:41:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:41:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 117.131926114 2023-10-08T12:41:04.944 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:41:04.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 -- 172.21.15.59:0/3187196810 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2e180a14d0 msgr2=0x7f2e180a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2e180a14d0 0x7f2e180a3990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2e30100de0 tx=0x7f2e24009260 comp rx=0 tx=0).stop 2023-10-08T12:41:04.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 -- 172.21.15.59:0/3187196810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30067ce0 msgr2=0x7f2e300ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:04.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30067ce0 0x7f2e300ff6b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2e200098e0 tx=0x7f2e2000f690 comp rx=0 tx=0).stop 2023-10-08T12:41:04.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 -- 172.21.15.59:0/3187196810 shutdown_connections 2023-10-08T12:41:04.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2e180a14d0 0x7f2e180a3990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e30105b80 0x7f2e30100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30067ce0 0x7f2e300ff6b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 --2- 172.21.15.59:0/3187196810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e301051c0 0x7f2e300ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:04.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 -- 172.21.15.59:0/3187196810 >> 172.21.15.59:0/3187196810 conn(0x7f2e30076780 msgr2=0x7f2e300fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:04.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 -- 172.21.15.59:0/3187196810 shutdown_connections 2023-10-08T12:41:04.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:04.936+0000 7f2e359ff700 1 -- 172.21.15.59:0/3187196810 wait complete. 2023-10-08T12:41:04.953 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:04 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/31990331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:04.953 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:04 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2237158994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:04.956 INFO:teuthology.run_tasks:Running task kclient... 2023-10-08T12:41:04.983 INFO:tasks.kclient:Mounting kernel clients... 2023-10-08T12:41:04.983 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-08T12:41:04.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:04.983 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-08T12:41:05.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:05.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2023-10-08T12:41:05.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:04 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/31990331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:05.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:04 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2237158994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:05.140 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2023-10-08T12:41:05.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:41:05.144 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2023-10-08T12:41:05.144 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T12:41:05.144 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T12:41:05.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-08T12:41:05.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:04 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/31990331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:04 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2237158994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:41:06.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:05 smithi059 ceph-mon[98489]: pgmap v311: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:06.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:05 smithi092 ceph-mon[134093]: pgmap v311: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:05 smithi173 ceph-mon[135182]: pgmap v311: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.400+0000 7f6d25144700 1 -- 172.21.15.59:0/1028813855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d201057c0 msgr2=0x7f6d20105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.400+0000 7f6d25144700 1 --2- 172.21.15.59:0/1028813855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d201057c0 0x7f6d20105ba0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009990 tx=0x7f6d10009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.400+0000 7f6d25144700 1 -- 172.21.15.59:0/1028813855 shutdown_connections 2023-10-08T12:41:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.400+0000 7f6d25144700 1 --2- 172.21.15.59:0/1028813855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d20101260 0x7f6d2010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.400+0000 7f6d25144700 1 --2- 172.21.15.59:0/1028813855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d201057c0 0x7f6d20105ba0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.400+0000 7f6d25144700 1 --2- 172.21.15.59:0/1028813855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d201008a0 0x7f6d20100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.400+0000 7f6d25144700 1 -- 172.21.15.59:0/1028813855 >> 172.21.15.59:0/1028813855 conn(0x7f6d200779e0 msgr2=0x7f6d20077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.400+0000 7f6d25144700 1 -- 172.21.15.59:0/1028813855 shutdown_connections 2023-10-08T12:41:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.400+0000 7f6d25144700 1 -- 172.21.15.59:0/1028813855 wait complete. 2023-10-08T12:41:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.401+0000 7f6d25144700 1 Processor -- start 2023-10-08T12:41:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.401+0000 7f6d25144700 1 -- start start 2023-10-08T12:41:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d25144700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d201008a0 0x7f6d20198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d25144700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d20101260 0x7f6d201993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d25144700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d201057c0 0x7f6d2019d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d25144700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2019dd60 con 0x7f6d201008a0 2023-10-08T12:41:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d25144700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2019ded0 con 0x7f6d201057c0 2023-10-08T12:41:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d25144700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2019e090 con 0x7f6d20101260 2023-10-08T12:41:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d1ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d201008a0 0x7f6d20198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d1ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d201008a0 0x7f6d20198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37870/0 (socket says 172.21.15.59:37870) 2023-10-08T12:41:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d1ed9d700 1 -- 172.21.15.59:0/25859293 learned_addr learned my addr 172.21.15.59:0/25859293 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d1f59e700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d201057c0 0x7f6d2019d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d1e59c700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d20101260 0x7f6d201993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d1ed9d700 1 -- 172.21.15.59:0/25859293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d20101260 msgr2=0x7f6d201993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d1ed9d700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d20101260 0x7f6d201993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d1ed9d700 1 -- 172.21.15.59:0/25859293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d201057c0 msgr2=0x7f6d2019d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:07.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d1ed9d700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d201057c0 0x7f6d2019d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:07.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.402+0000 7f6d1ed9d700 1 -- 172.21.15.59:0/25859293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d100095f0 con 0x7f6d201008a0 2023-10-08T12:41:07.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.403+0000 7f6d1ed9d700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d201008a0 0x7f6d20198e60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6d10000c00 tx=0x7f6d10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:07.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.403+0000 7f6d07fff700 1 -- 172.21.15.59:0/25859293 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1001d070 con 0x7f6d201008a0 2023-10-08T12:41:07.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.403+0000 7f6d07fff700 1 -- 172.21.15.59:0/25859293 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d10021410 con 0x7f6d201008a0 2023-10-08T12:41:07.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.403+0000 7f6d25144700 1 -- 172.21.15.59:0/25859293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2019e310 con 0x7f6d201008a0 2023-10-08T12:41:07.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.403+0000 7f6d07fff700 1 -- 172.21.15.59:0/25859293 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10017650 con 0x7f6d201008a0 2023-10-08T12:41:07.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.403+0000 7f6d25144700 1 -- 172.21.15.59:0/25859293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d201a5bd0 con 0x7f6d201008a0 2023-10-08T12:41:07.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.404+0000 7f6d25144700 1 -- 172.21.15.59:0/25859293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d20101f30 con 0x7f6d201008a0 2023-10-08T12:41:07.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.406+0000 7f6d07fff700 1 -- 172.21.15.59:0/25859293 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f6d10021580 con 0x7f6d201008a0 2023-10-08T12:41:07.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.407+0000 7f6d07fff700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6d080a1550 0x7f6d080a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:07.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.407+0000 7f6d07fff700 1 -- 172.21.15.59:0/25859293 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f6d100cded0 con 0x7f6d201008a0 2023-10-08T12:41:07.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.407+0000 7f6d1e59c700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6d080a1550 0x7f6d080a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.408+0000 7f6d1e59c700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6d080a1550 0x7f6d080a3a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6d2019a3c0 tx=0x7f6d14009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.411+0000 7f6d07fff700 1 -- 172.21.15.59:0/25859293 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6d100974c0 con 0x7f6d201008a0 2023-10-08T12:41:07.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.667+0000 7f6d25144700 1 -- 172.21.15.59:0/25859293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6d2019a170 con 0x7f6d201008a0 2023-10-08T12:41:07.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.668+0000 7f6d07fff700 1 -- 172.21.15.59:0/25859293 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6d1009aae0 con 0x7f6d201008a0 2023-10-08T12:41:07.669 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T12:41:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.670+0000 7f6d25144700 1 -- 172.21.15.59:0/25859293 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6d080a1550 msgr2=0x7f6d080a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.670+0000 7f6d25144700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6d080a1550 0x7f6d080a3a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6d2019a3c0 tx=0x7f6d14009260 comp rx=0 tx=0).stop 2023-10-08T12:41:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.670+0000 7f6d25144700 1 -- 172.21.15.59:0/25859293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d201008a0 msgr2=0x7f6d20198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.670+0000 7f6d25144700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d201008a0 0x7f6d20198e60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6d10000c00 tx=0x7f6d10004730 comp rx=0 tx=0).stop 2023-10-08T12:41:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.670+0000 7f6d25144700 1 -- 172.21.15.59:0/25859293 shutdown_connections 2023-10-08T12:41:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.670+0000 7f6d25144700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6d080a1550 0x7f6d080a3a10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.670+0000 7f6d25144700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d201057c0 0x7f6d2019d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.670+0000 7f6d25144700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d201008a0 0x7f6d20198e60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.670+0000 7f6d25144700 1 --2- 172.21.15.59:0/25859293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d20101260 0x7f6d201993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.670+0000 7f6d25144700 1 -- 172.21.15.59:0/25859293 >> 172.21.15.59:0/25859293 conn(0x7f6d200779e0 msgr2=0x7f6d2010ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.670+0000 7f6d25144700 1 -- 172.21.15.59:0/25859293 shutdown_connections 2023-10-08T12:41:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:07.671+0000 7f6d25144700 1 -- 172.21.15.59:0/25859293 wait complete. 2023-10-08T12:41:08.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:07 smithi059 ceph-mon[98489]: pgmap v312: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:08.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:07 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/25859293' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T12:41:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:07 smithi092 ceph-mon[134093]: pgmap v312: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:08.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:07 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/25859293' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T12:41:08.162 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T12:41:08.162 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T12:41:08.162 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-08T12:41:08.162 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T12:41:08.162 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T12:41:08.162 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T12:41:08.162 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T12:41:08.162 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T12:41:08.162 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:41:08.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:08.163 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-08T12:41:08.209 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:41:08.209 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:41:08.209 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:41:08.209 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:41:08.210 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-08T12:41:08.210 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:41:08.210 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:41:08.210 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-08T12:41:08.210 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-08T12:41:08.210 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:41:08.211 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-08T12:41:08.211 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-08T12:41:08.211 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T12:41:08.211 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-08T12:41:08.211 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-08T12:41:08.211 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T12:41:08.212 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41482sec preferred_lft 41482sec 2023-10-08T12:41:08.212 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-08T12:41:08.212 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:41:08.212 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:41:08.212 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-08T12:41:08.213 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-08T12:41:08.213 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T12:41:08.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:08.214 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-08T12:41:08.214 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-08T12:41:08.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2023-10-08T12:41:08.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2023-10-08T12:41:08.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2023-10-08T12:41:08.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T12:41:08.215 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-08T12:41:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:07 smithi173 ceph-mon[135182]: pgmap v312: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:08.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:07 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/25859293' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T12:41:08.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:08.697 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T12:41:08.770 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-08T12:41:08.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:08.774 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-08T12:41:08.836 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-08T12:41:08.837 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T12:41:08.837 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T12:41:08.837 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T12:41:08.837 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T12:41:08.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:08.838 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-08T12:41:08.838 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-08T12:41:08.838 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T12:41:08.838 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T12:41:08.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T12:41:08.839 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-08T12:41:09.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:09.590 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-08T12:41:09.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:09.636 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2023-10-08T12:41:09.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:09.721 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-08T12:41:09.721 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-08T12:41:09.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T12:41:09.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T12:41:09.722 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-08T12:41:09.865 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:09 smithi059 ceph-mon[98489]: pgmap v313: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:09.910 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T12:41:09.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:09.911 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-08T12:41:09.911 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-08T12:41:09.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T12:41:09.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T12:41:09.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T12:41:09.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T12:41:09.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T12:41:09.911 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-08T12:41:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:09 smithi092 ceph-mon[134093]: pgmap v313: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:10.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:10.195 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-08T12:41:10.195 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-08T12:41:10.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-08T12:41:10.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T12:41:10.195 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-08T12:41:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:09 smithi173 ceph-mon[135182]: pgmap v313: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:10.371 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:41:10.371 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T12:41:10.415 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:41:10.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:41:10.416 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T12:41:10.498 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-10-08T12:41:10.499 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-10-08T12:41:10.499 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/_nogroup/sv_1/65ebba8a-ac05-4349-97a1-9947341e5926 2023-10-08T12:41:10.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:10.499 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/_nogroup/sv_1/65ebba8a-ac05-4349-97a1-9947341e5926 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2023-10-08T12:41:10.657 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2023-10-08T12:41:10.657 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2023-10-08T12:41:11.131 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2023-10-08T12:41:11.132 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2023-10-08T12:41:11.132 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.92:6789,172.21.15.173:6789" 2023-10-08T12:41:11.132 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with new device syntax: 0@6a005028-65d6-11ee-8db5-212e2dc638e7.cephfs=/volumes/_nogroup/sv_1/65ebba8a-ac05-4349-97a1-9947341e5926 2023-10-08T12:41:11.132 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,name=0,key=0,mon_addr=172.21.15.59:6789/172.21.15.92:6789/172.21.15.173:6789" will pass to kernel 2023-10-08T12:41:11.138 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T12:41:11.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:11.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T12:41:11.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:11.211 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:41:11.308 INFO:teuthology.orchestra.run.smithi059.stdout:client15258 2023-10-08T12:41:11.308 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:41:11.308 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:41:11.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:11.352 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:41:11.479 INFO:teuthology.orchestra.run.smithi059.stdout:client15258 2023-10-08T12:41:11.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:11.479 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:41:11.566 INFO:teuthology.orchestra.run.smithi059.stdout:client15258 2023-10-08T12:41:11.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:41:11.566 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7.client15258/status') 2023-10-08T12:41:11.675 INFO:teuthology.orchestra.run.smithi059.stdout:instance: client.15258 (3)192.168.0.1:0/2012274479 2023-10-08T12:41:11.675 INFO:teuthology.orchestra.run.smithi059.stdout:blocklisted: false 2023-10-08T12:41:11.676 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2023-10-08T12:41:11.676 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2023-10-08T12:41:11.676 INFO:teuthology.orchestra.run.smithi059.stderr:70 bytes copied, 6.8835e-05 s, 1.0 MB/s 2023-10-08T12:41:11.678 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-08T12:41:11.689 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-08T12:41:11.732 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:41:11.928 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:11 smithi059 ceph-mon[98489]: pgmap v314: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:11.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.937+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1048603951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0073540 msgr2=0x7f7ec010c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:11.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.937+0000 7f7ec7dff700 1 --2- 172.21.15.59:0/1048603951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0073540 0x7f7ec010c930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009990 tx=0x7f7eb0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:11.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.937+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1048603951 shutdown_connections 2023-10-08T12:41:11.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.937+0000 7f7ec7dff700 1 --2- 172.21.15.59:0/1048603951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0072c20 0x7f7ec0073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:11.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.937+0000 7f7ec7dff700 1 --2- 172.21.15.59:0/1048603951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec010ce70 0x7f7ec010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:11.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.937+0000 7f7ec7dff700 1 --2- 172.21.15.59:0/1048603951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0073540 0x7f7ec010c930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:11.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.937+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1048603951 >> 172.21.15.59:0/1048603951 conn(0x7f7ec00fc140 msgr2=0x7f7ec00fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:11.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.937+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1048603951 shutdown_connections 2023-10-08T12:41:11.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.937+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1048603951 wait complete. 2023-10-08T12:41:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.938+0000 7f7ec7dff700 1 Processor -- start 2023-10-08T12:41:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.938+0000 7f7ec7dff700 1 -- start start 2023-10-08T12:41:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec7dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0072c20 0x7f7ec0198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec7dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec0073540 0x7f7ec01992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec7dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec010ce70 0x7f7ec019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec7dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec019dc90 con 0x7f7ec0072c20 2023-10-08T12:41:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec7dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec019de00 con 0x7f7ec010ce70 2023-10-08T12:41:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec7dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec019dfc0 con 0x7f7ec0073540 2023-10-08T12:41:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec5b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0072c20 0x7f7ec0198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec5b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0072c20 0x7f7ec0198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42886/0 (socket says 172.21.15.59:42886) 2023-10-08T12:41:11.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec5b9b700 1 -- 172.21.15.59:0/1587267856 learned_addr learned my addr 172.21.15.59:0/1587267856 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:11.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec539a700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec0073540 0x7f7ec01992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:11.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec639c700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec010ce70 0x7f7ec019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:11.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec5b9b700 1 -- 172.21.15.59:0/1587267856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec0073540 msgr2=0x7f7ec01992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec5b9b700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec0073540 0x7f7ec01992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec5b9b700 1 -- 172.21.15.59:0/1587267856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec010ce70 msgr2=0x7f7ec019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec5b9b700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec010ce70 0x7f7ec019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.939+0000 7f7ec5b9b700 1 -- 172.21.15.59:0/1587267856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb00095f0 con 0x7f7ec0072c20 2023-10-08T12:41:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.940+0000 7f7ec5b9b700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0072c20 0x7f7ec0198d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e9a0 tx=0x7f7ebc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.940+0000 7f7eb6ffd700 1 -- 172.21.15.59:0/1587267856 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc009790 con 0x7f7ec0072c20 2023-10-08T12:41:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.940+0000 7f7eb6ffd700 1 -- 172.21.15.59:0/1587267856 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ebc010430 con 0x7f7ec0072c20 2023-10-08T12:41:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.940+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1587267856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec019e2a0 con 0x7f7ec0072c20 2023-10-08T12:41:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.940+0000 7f7eb6ffd700 1 -- 172.21.15.59:0/1587267856 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc018680 con 0x7f7ec0072c20 2023-10-08T12:41:11.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.940+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1587267856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec01a5ae0 con 0x7f7ec0072c20 2023-10-08T12:41:11.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.941+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1587267856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec0108080 con 0x7f7ec0072c20 2023-10-08T12:41:11.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.943+0000 7f7eb6ffd700 1 -- 172.21.15.59:0/1587267856 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f7ebc0105a0 con 0x7f7ec0072c20 2023-10-08T12:41:11.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.944+0000 7f7eb6ffd700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1550 0x7f7eac0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:11.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.945+0000 7f7eb6ffd700 1 -- 172.21.15.59:0/1587267856 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7ebc014070 con 0x7f7ec0072c20 2023-10-08T12:41:11.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.945+0000 7f7ec539a700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1550 0x7f7eac0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:11.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.945+0000 7f7ec539a700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1550 0x7f7eac0a3a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ec019a2c0 tx=0x7f7eb000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:11.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:11.949+0000 7f7eb6ffd700 1 -- 172.21.15.59:0/1587267856 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7ebc0964e0 con 0x7f7ec0072c20 2023-10-08T12:41:12.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:11 smithi092 ceph-mon[134093]: pgmap v314: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:12.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.163+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1587267856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ec00742d0 con 0x7f7ec0072c20 2023-10-08T12:41:12.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.164+0000 7f7eb6ffd700 1 -- 172.21.15.59:0/1587267856 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22725 (secure 0 0 0) 0x7f7ebc099b00 con 0x7f7ec0072c20 2023-10-08T12:41:12.166 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:12.166 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":86,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:40:11.783762+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:41:12.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1587267856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1550 msgr2=0x7f7eac0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:12.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1550 0x7f7eac0a3a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ec019a2c0 tx=0x7f7eb000b260 comp rx=0 tx=0).stop 2023-10-08T12:41:12.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1587267856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0072c20 msgr2=0x7f7ec0198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:12.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0072c20 0x7f7ec0198d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e9a0 tx=0x7f7ebc00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1587267856 shutdown_connections 2023-10-08T12:41:12.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1550 0x7f7eac0a3a10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec010ce70 0x7f7ec019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0072c20 0x7f7ec0198d70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 --2- 172.21.15.59:0/1587267856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec0073540 0x7f7ec01992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1587267856 >> 172.21.15.59:0/1587267856 conn(0x7f7ec00fc140 msgr2=0x7f7ec00fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:12.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1587267856 shutdown_connections 2023-10-08T12:41:12.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.167+0000 7f7ec7dff700 1 -- 172.21.15.59:0/1587267856 wait complete. 2023-10-08T12:41:12.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:39:12.134451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:39:13.186137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:41:12.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:41:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:11 smithi173 ceph-mon[135182]: pgmap v314: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.392+0000 7f92951ff700 1 -- 172.21.15.59:0/1765099350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9290073540 msgr2=0x7f929010ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:12.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.392+0000 7f92951ff700 1 --2- 172.21.15.59:0/1765099350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9290073540 0x7f929010ca30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9284009990 tx=0x7f9284009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.392+0000 7f92951ff700 1 -- 172.21.15.59:0/1765099350 shutdown_connections 2023-10-08T12:41:12.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.392+0000 7f92951ff700 1 --2- 172.21.15.59:0/1765099350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9290072c20 0x7f9290073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.392+0000 7f92951ff700 1 --2- 172.21.15.59:0/1765099350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f929010cf70 0x7f929010f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.392+0000 7f92951ff700 1 --2- 172.21.15.59:0/1765099350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9290073540 0x7f929010ca30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.392+0000 7f92951ff700 1 -- 172.21.15.59:0/1765099350 >> 172.21.15.59:0/1765099350 conn(0x7f92900fc200 msgr2=0x7f92900fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:12.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.392+0000 7f92951ff700 1 -- 172.21.15.59:0/1765099350 shutdown_connections 2023-10-08T12:41:12.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.392+0000 7f92951ff700 1 -- 172.21.15.59:0/1765099350 wait complete. 2023-10-08T12:41:12.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.393+0000 7f92951ff700 1 Processor -- start 2023-10-08T12:41:12.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.393+0000 7f92951ff700 1 -- start start 2023-10-08T12:41:12.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f92951ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9290072c20 0x7f9290198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f92951ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9290073540 0x7f9290199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f92951ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f929010cf70 0x7f929019d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f92951ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929019dd70 con 0x7f9290073540 2023-10-08T12:41:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f92951ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929019dee0 con 0x7f929010cf70 2023-10-08T12:41:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f92951ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929019e0a0 con 0x7f9290072c20 2023-10-08T12:41:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f928e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9290073540 0x7f9290199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f928ed9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9290072c20 0x7f9290198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f928e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9290073540 0x7f9290199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42900/0 (socket says 172.21.15.59:42900) 2023-10-08T12:41:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f928e59c700 1 -- 172.21.15.59:0/1184945139 learned_addr learned my addr 172.21.15.59:0/1184945139 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f928f59e700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f929010cf70 0x7f929019d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f928e59c700 1 -- 172.21.15.59:0/1184945139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9290072c20 msgr2=0x7f9290198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f928e59c700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9290072c20 0x7f9290198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.394+0000 7f928e59c700 1 -- 172.21.15.59:0/1184945139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f929010cf70 msgr2=0x7f929019d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.395+0000 7f928e59c700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f929010cf70 0x7f929019d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.395+0000 7f928e59c700 1 -- 172.21.15.59:0/1184945139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92840095f0 con 0x7f9290073540 2023-10-08T12:41:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.395+0000 7f928e59c700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9290073540 0x7f9290199390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f92840095c0 tx=0x7f928400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.395+0000 7f9277fff700 1 -- 172.21.15.59:0/1184945139 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928401d070 con 0x7f9290073540 2023-10-08T12:41:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.395+0000 7f9277fff700 1 -- 172.21.15.59:0/1184945139 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9284005050 con 0x7f9290073540 2023-10-08T12:41:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.395+0000 7f9277fff700 1 -- 172.21.15.59:0/1184945139 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284004a70 con 0x7f9290073540 2023-10-08T12:41:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.395+0000 7f92951ff700 1 -- 172.21.15.59:0/1184945139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929019e320 con 0x7f9290073540 2023-10-08T12:41:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.395+0000 7f92951ff700 1 -- 172.21.15.59:0/1184945139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92901a5bc0 con 0x7f9290073540 2023-10-08T12:41:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.396+0000 7f92951ff700 1 -- 172.21.15.59:0/1184945139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9290108180 con 0x7f9290073540 2023-10-08T12:41:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.398+0000 7f9277fff700 1 -- 172.21.15.59:0/1184945139 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f92840051c0 con 0x7f9290073540 2023-10-08T12:41:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.400+0000 7f9277fff700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92780a1550 0x7f92780a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.400+0000 7f9277fff700 1 -- 172.21.15.59:0/1184945139 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f92840cdf80 con 0x7f9290073540 2023-10-08T12:41:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.400+0000 7f928ed9d700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92780a1550 0x7f92780a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.400+0000 7f928ed9d700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92780a1550 0x7f92780a3a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9280007be0 tx=0x7f92800073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:12.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.401+0000 7f9277fff700 1 -- 172.21.15.59:0/1184945139 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9284097570 con 0x7f9290073540 2023-10-08T12:41:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.614+0000 7f92951ff700 1 -- 172.21.15.59:0/1184945139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9290067560 con 0x7f9290073540 2023-10-08T12:41:12.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.615+0000 7f9277fff700 1 -- 172.21.15.59:0/1184945139 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f928409ab90 con 0x7f9290073540 2023-10-08T12:41:12.616 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T12:41:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 -- 172.21.15.59:0/1184945139 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92780a1550 msgr2=0x7f92780a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92780a1550 0x7f92780a3a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9280007be0 tx=0x7f92800073d0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 -- 172.21.15.59:0/1184945139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9290073540 msgr2=0x7f9290199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9290073540 0x7f9290199390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f92840095c0 tx=0x7f928400f690 comp rx=0 tx=0).stop 2023-10-08T12:41:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 -- 172.21.15.59:0/1184945139 shutdown_connections 2023-10-08T12:41:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92780a1550 0x7f92780a3a10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f929010cf70 0x7f929019d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9290072c20 0x7f9290198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 --2- 172.21.15.59:0/1184945139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9290073540 0x7f9290199390 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 -- 172.21.15.59:0/1184945139 >> 172.21.15.59:0/1184945139 conn(0x7f92900fc200 msgr2=0x7f92900fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 -- 172.21.15.59:0/1184945139 shutdown_connections 2023-10-08T12:41:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.617+0000 7f92951ff700 1 -- 172.21.15.59:0/1184945139 wait complete. 2023-10-08T12:41:12.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:41:12.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.846+0000 7f2e047ff700 1 -- 172.21.15.59:0/2774770418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dfc072c20 msgr2=0x7f2dfc073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:12.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.846+0000 7f2e047ff700 1 --2- 172.21.15.59:0/2774770418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dfc072c20 0x7f2dfc073000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2df80098f0 tx=0x7f2df8009c00 comp rx=0 tx=0).stop 2023-10-08T12:41:12.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.846+0000 7f2e047ff700 1 -- 172.21.15.59:0/2774770418 shutdown_connections 2023-10-08T12:41:12.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.846+0000 7f2e047ff700 1 --2- 172.21.15.59:0/2774770418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dfc10cf70 0x7f2dfc10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.846+0000 7f2e047ff700 1 --2- 172.21.15.59:0/2774770418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dfc072c20 0x7f2dfc073000 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.846+0000 7f2e047ff700 1 --2- 172.21.15.59:0/2774770418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc073540 0x7f2dfc10ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.846+0000 7f2e047ff700 1 -- 172.21.15.59:0/2774770418 >> 172.21.15.59:0/2774770418 conn(0x7f2dfc0fc200 msgr2=0x7f2dfc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:12.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.846+0000 7f2e047ff700 1 -- 172.21.15.59:0/2774770418 shutdown_connections 2023-10-08T12:41:12.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.846+0000 7f2e047ff700 1 -- 172.21.15.59:0/2774770418 wait complete. 2023-10-08T12:41:12.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.847+0000 7f2e047ff700 1 Processor -- start 2023-10-08T12:41:12.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.847+0000 7f2e047ff700 1 -- start start 2023-10-08T12:41:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.847+0000 7f2e047ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc072c20 0x7f2dfc198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.847+0000 7f2e047ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dfc073540 0x7f2dfc1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e047ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dfc10cf70 0x7f2dfc19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e047ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc19dd70 con 0x7f2dfc072c20 2023-10-08T12:41:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e047ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc19dee0 con 0x7f2dfc10cf70 2023-10-08T12:41:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e047ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc19e0a0 con 0x7f2dfc073540 2023-10-08T12:41:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e0259b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc072c20 0x7f2dfc198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e01d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dfc073540 0x7f2dfc1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e0259b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc072c20 0x7f2dfc198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42922/0 (socket says 172.21.15.59:42922) 2023-10-08T12:41:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e02d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dfc10cf70 0x7f2dfc19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e0259b700 1 -- 172.21.15.59:0/1693789359 learned_addr learned my addr 172.21.15.59:0/1693789359 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e01d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dfc073540 0x7f2dfc1993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56228/0 (socket says 172.21.15.59:56228) 2023-10-08T12:41:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e01d9a700 1 -- 172.21.15.59:0/1693789359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dfc10cf70 msgr2=0x7f2dfc19d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e01d9a700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dfc10cf70 0x7f2dfc19d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e01d9a700 1 -- 172.21.15.59:0/1693789359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc072c20 msgr2=0x7f2dfc198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:12.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e01d9a700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc072c20 0x7f2dfc198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:12.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e01d9a700 1 -- 172.21.15.59:0/1693789359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df8009520 con 0x7f2dfc073540 2023-10-08T12:41:12.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.848+0000 7f2e0259b700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc072c20 0x7f2dfc198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:12.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.849+0000 7f2e01d9a700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dfc073540 0x7f2dfc1993e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00e9c0 tx=0x7f2dec00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:12.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.849+0000 7f2df37fe700 1 -- 172.21.15.59:0/1693789359 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec00c9c0 con 0x7f2dfc073540 2023-10-08T12:41:12.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.849+0000 7f2df37fe700 1 -- 172.21.15.59:0/1693789359 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2dec010430 con 0x7f2dfc073540 2023-10-08T12:41:12.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.849+0000 7f2df37fe700 1 -- 172.21.15.59:0/1693789359 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec018680 con 0x7f2dfc073540 2023-10-08T12:41:12.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.849+0000 7f2e047ff700 1 -- 172.21.15.59:0/1693789359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dfc19e380 con 0x7f2dfc073540 2023-10-08T12:41:12.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.849+0000 7f2e047ff700 1 -- 172.21.15.59:0/1693789359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dfc1a5bc0 con 0x7f2dfc073540 2023-10-08T12:41:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.850+0000 7f2e047ff700 1 -- 172.21.15.59:0/1693789359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dfc108180 con 0x7f2dfc073540 2023-10-08T12:41:12.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.852+0000 7f2df37fe700 1 -- 172.21.15.59:0/1693789359 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f2dec010860 con 0x7f2dfc073540 2023-10-08T12:41:12.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.854+0000 7f2df37fe700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2de80a14d0 0x7f2de80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:12.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.854+0000 7f2df37fe700 1 -- 172.21.15.59:0/1693789359 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2dec014070 con 0x7f2dfc073540 2023-10-08T12:41:12.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.854+0000 7f2e0259b700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2de80a14d0 0x7f2de80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:12.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.855+0000 7f2e0259b700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2de80a14d0 0x7f2de80a3990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2df80094f0 tx=0x7f2df8019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:12.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:12.856+0000 7f2df37fe700 1 -- 172.21.15.59:0/1693789359 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2dec096620 con 0x7f2dfc073540 2023-10-08T12:41:13.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:12 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1587267856' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:13.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:12 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1184945139' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:13.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.073+0000 7f2e047ff700 1 -- 172.21.15.59:0/1693789359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2dfc19a150 con 0x7f2dfc073540 2023-10-08T12:41:13.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.074+0000 7f2df37fe700 1 -- 172.21.15.59:0/1693789359 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2dec099c40 con 0x7f2dfc073540 2023-10-08T12:41:13.074 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-08T12:41:13.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 -- 172.21.15.59:0/1693789359 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2de80a14d0 msgr2=0x7f2de80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2de80a14d0 0x7f2de80a3990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2df80094f0 tx=0x7f2df8019040 comp rx=0 tx=0).stop 2023-10-08T12:41:13.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 -- 172.21.15.59:0/1693789359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dfc073540 msgr2=0x7f2dfc1993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dfc073540 0x7f2dfc1993e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00e9c0 tx=0x7f2dec00ecd0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 -- 172.21.15.59:0/1693789359 shutdown_connections 2023-10-08T12:41:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2de80a14d0 0x7f2de80a3990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dfc10cf70 0x7f2dfc19d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc072c20 0x7f2dfc198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 --2- 172.21.15.59:0/1693789359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dfc073540 0x7f2dfc1993e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 -- 172.21.15.59:0/1693789359 >> 172.21.15.59:0/1693789359 conn(0x7f2dfc0fc200 msgr2=0x7f2dfc0fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 -- 172.21.15.59:0/1693789359 shutdown_connections 2023-10-08T12:41:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.076+0000 7f2e047ff700 1 -- 172.21.15.59:0/1693789359 wait complete. 2023-10-08T12:41:13.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:41:13.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:12 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1587267856' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:13.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:12 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1184945139' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:12 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1587267856' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:12 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1184945139' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:13.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.303+0000 7f9aaadff700 1 -- 172.21.15.59:0/1104313816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aa4101100 msgr2=0x7f9aa410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.303+0000 7f9aaadff700 1 --2- 172.21.15.59:0/1104313816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aa4101100 0x7f9aa410d610 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00b0a0 tx=0x7f9a9c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.303+0000 7f9aaadff700 1 -- 172.21.15.59:0/1104313816 shutdown_connections 2023-10-08T12:41:13.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.303+0000 7f9aaadff700 1 --2- 172.21.15.59:0/1104313816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa4106750 0x7f9aa4106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.303+0000 7f9aaadff700 1 --2- 172.21.15.59:0/1104313816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aa4101100 0x7f9aa410d610 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.303+0000 7f9aaadff700 1 --2- 172.21.15.59:0/1104313816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9aa4100740 0x7f9aa4100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.303+0000 7f9aaadff700 1 -- 172.21.15.59:0/1104313816 >> 172.21.15.59:0/1104313816 conn(0x7f9aa40fc230 msgr2=0x7f9aa40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:13.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.303+0000 7f9aaadff700 1 -- 172.21.15.59:0/1104313816 shutdown_connections 2023-10-08T12:41:13.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.304+0000 7f9aaadff700 1 -- 172.21.15.59:0/1104313816 wait complete. 2023-10-08T12:41:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.304+0000 7f9aaadff700 1 Processor -- start 2023-10-08T12:41:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aaadff700 1 -- start start 2023-10-08T12:41:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aaadff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa4100740 0x7f9aa419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aaadff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9aa4101100 0x7f9aa419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aaadff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aa4106750 0x7f9aa4196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aaadff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa4197140 con 0x7f9aa4106750 2023-10-08T12:41:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aaadff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa41972b0 con 0x7f9aa4100740 2023-10-08T12:41:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aaadff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa4197470 con 0x7f9aa4101100 2023-10-08T12:41:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aa939c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aa4106750 0x7f9aa4196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aa3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9aa4101100 0x7f9aa419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aa8b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa4100740 0x7f9aa419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aa939c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aa4106750 0x7f9aa4196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42946/0 (socket says 172.21.15.59:42946) 2023-10-08T12:41:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aa3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9aa4101100 0x7f9aa419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56254/0 (socket says 172.21.15.59:56254) 2023-10-08T12:41:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aa8b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa4100740 0x7f9aa419c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:40694/0 (socket says 172.21.15.59:40694) 2023-10-08T12:41:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.305+0000 7f9aa939c700 1 -- 172.21.15.59:0/3025862040 learned_addr learned my addr 172.21.15.59:0/3025862040 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.306+0000 7f9aa939c700 1 -- 172.21.15.59:0/3025862040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9aa4101100 msgr2=0x7f9aa419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.306+0000 7f9aa939c700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9aa4101100 0x7f9aa419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.306+0000 7f9aa939c700 1 -- 172.21.15.59:0/3025862040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa4100740 msgr2=0x7f9aa419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.306+0000 7f9aa939c700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa4100740 0x7f9aa419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.306+0000 7f9aa939c700 1 -- 172.21.15.59:0/3025862040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c009d00 con 0x7f9aa4106750 2023-10-08T12:41:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.306+0000 7f9aa8b9b700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa4100740 0x7f9aa419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.306+0000 7f9aa939c700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aa4106750 0x7f9aa4196970 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00b070 tx=0x7f9a9c0077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.306+0000 7f9aa1ffb700 1 -- 172.21.15.59:0/3025862040 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00e040 con 0x7f9aa4106750 2023-10-08T12:41:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.306+0000 7f9aaadff700 1 -- 172.21.15.59:0/3025862040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa41976f0 con 0x7f9aa4106750 2023-10-08T12:41:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.306+0000 7f9aa1ffb700 1 -- 172.21.15.59:0/3025862040 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a9c0094c0 con 0x7f9aa4106750 2023-10-08T12:41:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.306+0000 7f9aa1ffb700 1 -- 172.21.15.59:0/3025862040 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0043a0 con 0x7f9aa4106750 2023-10-08T12:41:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.307+0000 7f9aaadff700 1 -- 172.21.15.59:0/3025862040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa41a3850 con 0x7f9aa4106750 2023-10-08T12:41:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.308+0000 7f9aaadff700 1 -- 172.21.15.59:0/3025862040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa4108d40 con 0x7f9aa4106750 2023-10-08T12:41:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.310+0000 7f9aa1ffb700 1 -- 172.21.15.59:0/3025862040 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f9a9c004500 con 0x7f9aa4106750 2023-10-08T12:41:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.311+0000 7f9aa1ffb700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a940a14d0 0x7f9a940a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.311+0000 7f9aa1ffb700 1 -- 172.21.15.59:0/3025862040 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9a9c0cdcb0 con 0x7f9aa4106750 2023-10-08T12:41:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.311+0000 7f9aa8b9b700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a940a14d0 0x7f9a940a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.312+0000 7f9aa8b9b700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a940a14d0 0x7f9a940a3990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009fd0 tx=0x7f9a98009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:13.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.315+0000 7f9aa1ffb700 1 -- 172.21.15.59:0/3025862040 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9a9c0972a0 con 0x7f9aa4106750 2023-10-08T12:41:13.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.529+0000 7f9aaadff700 1 -- 172.21.15.59:0/3025862040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9aa4101e80 con 0x7f9aa4106750 2023-10-08T12:41:13.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.530+0000 7f9aa1ffb700 1 -- 172.21.15.59:0/3025862040 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a9c09a8c0 con 0x7f9aa4106750 2023-10-08T12:41:13.531 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-08T12:41:13.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.532+0000 7f9aaadff700 1 -- 172.21.15.59:0/3025862040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a940a14d0 msgr2=0x7f9a940a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.532+0000 7f9aaadff700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a940a14d0 0x7f9a940a3990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009fd0 tx=0x7f9a98009260 comp rx=0 tx=0).stop 2023-10-08T12:41:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.532+0000 7f9aaadff700 1 -- 172.21.15.59:0/3025862040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aa4106750 msgr2=0x7f9aa4196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.532+0000 7f9aaadff700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aa4106750 0x7f9aa4196970 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00b070 tx=0x7f9a9c0077f0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.532+0000 7f9aaadff700 1 -- 172.21.15.59:0/3025862040 shutdown_connections 2023-10-08T12:41:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.532+0000 7f9aaadff700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a940a14d0 0x7f9a940a3990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.532+0000 7f9aaadff700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa4100740 0x7f9aa419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.532+0000 7f9aaadff700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9aa4106750 0x7f9aa4196970 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.532+0000 7f9aaadff700 1 --2- 172.21.15.59:0/3025862040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9aa4101100 0x7f9aa419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.532+0000 7f9aaadff700 1 -- 172.21.15.59:0/3025862040 >> 172.21.15.59:0/3025862040 conn(0x7f9aa40fc230 msgr2=0x7f9aa40fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.533+0000 7f9aaadff700 1 -- 172.21.15.59:0/3025862040 shutdown_connections 2023-10-08T12:41:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.533+0000 7f9aaadff700 1 -- 172.21.15.59:0/3025862040 wait complete. 2023-10-08T12:41:13.553 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:41:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.756+0000 7fe501dff700 1 -- 172.21.15.59:0/242460418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4fc100ff0 msgr2=0x7fe4fc10d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.756+0000 7fe501dff700 1 --2- 172.21.15.59:0/242460418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4fc100ff0 0x7fe4fc10d500 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400b0a0 tx=0x7fe4f400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.756+0000 7fe501dff700 1 -- 172.21.15.59:0/242460418 shutdown_connections 2023-10-08T12:41:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.756+0000 7fe501dff700 1 --2- 172.21.15.59:0/242460418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4fc100ff0 0x7fe4fc10d500 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.756+0000 7fe501dff700 1 --2- 172.21.15.59:0/242460418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4fc106640 0x7fe4fc106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.756+0000 7fe501dff700 1 --2- 172.21.15.59:0/242460418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4fc100630 0x7fe4fc100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.756+0000 7fe501dff700 1 -- 172.21.15.59:0/242460418 >> 172.21.15.59:0/242460418 conn(0x7fe4fc0fc140 msgr2=0x7fe4fc0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.756+0000 7fe501dff700 1 -- 172.21.15.59:0/242460418 shutdown_connections 2023-10-08T12:41:13.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.756+0000 7fe501dff700 1 -- 172.21.15.59:0/242460418 wait complete. 2023-10-08T12:41:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.758+0000 7fe501dff700 1 Processor -- start 2023-10-08T12:41:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.758+0000 7fe501dff700 1 -- start start 2023-10-08T12:41:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.758+0000 7fe501dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4fc100630 0x7fe4fc19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.758+0000 7fe501dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4fc100ff0 0x7fe4fc19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.758+0000 7fe501dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4fc106640 0x7fe4fc198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.758+0000 7fe501dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc1992c0 con 0x7fe4fc100ff0 2023-10-08T12:41:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.758+0000 7fe501dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc199430 con 0x7fe4fc100630 2023-10-08T12:41:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.758+0000 7fe501dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc1995f0 con 0x7fe4fc106640 2023-10-08T12:41:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4faffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4fc100ff0 0x7fe4fc19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4fb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4fc100630 0x7fe4fc19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4faffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4fc100ff0 0x7fe4fc19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42954/0 (socket says 172.21.15.59:42954) 2023-10-08T12:41:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4fb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4fc100630 0x7fe4fc19ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:40710/0 (socket says 172.21.15.59:40710) 2023-10-08T12:41:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4faffd700 1 -- 172.21.15.59:0/4285553745 learned_addr learned my addr 172.21.15.59:0/4285553745 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4fbfff700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4fc106640 0x7fe4fc198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4faffd700 1 -- 172.21.15.59:0/4285553745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4fc106640 msgr2=0x7fe4fc198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4faffd700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4fc106640 0x7fe4fc198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4faffd700 1 -- 172.21.15.59:0/4285553745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4fc100630 msgr2=0x7fe4fc19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4faffd700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4fc100630 0x7fe4fc19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4faffd700 1 -- 172.21.15.59:0/4285553745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f4009d00 con 0x7fe4fc100ff0 2023-10-08T12:41:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4fb7fe700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4fc100630 0x7fe4fc19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4fbfff700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4fc106640 0x7fe4fc198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.759+0000 7fe4faffd700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4fc100ff0 0x7fe4fc19ef90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000e9a0 tx=0x7fe4f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.760+0000 7fe4f8ff9700 1 -- 172.21.15.59:0/4285553745 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0009790 con 0x7fe4fc100ff0 2023-10-08T12:41:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.760+0000 7fe501dff700 1 -- 172.21.15.59:0/4285553745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4fc1998d0 con 0x7fe4fc100ff0 2023-10-08T12:41:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.760+0000 7fe4f8ff9700 1 -- 172.21.15.59:0/4285553745 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4f0010430 con 0x7fe4fc100ff0 2023-10-08T12:41:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.760+0000 7fe4f8ff9700 1 -- 172.21.15.59:0/4285553745 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0018680 con 0x7fe4fc100ff0 2023-10-08T12:41:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.760+0000 7fe501dff700 1 -- 172.21.15.59:0/4285553745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4fc1a5a20 con 0x7fe4fc100ff0 2023-10-08T12:41:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.761+0000 7fe501dff700 1 -- 172.21.15.59:0/4285553745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4fc101d70 con 0x7fe4fc100ff0 2023-10-08T12:41:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.763+0000 7fe4f8ff9700 1 -- 172.21.15.59:0/4285553745 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe4f00105a0 con 0x7fe4fc100ff0 2023-10-08T12:41:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.764+0000 7fe4f8ff9700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e40a14d0 0x7fe4e40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.764+0000 7fe4f8ff9700 1 -- 172.21.15.59:0/4285553745 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe4f0014070 con 0x7fe4fc100ff0 2023-10-08T12:41:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.765+0000 7fe4fb7fe700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e40a14d0 0x7fe4e40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:13.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.765+0000 7fe4fb7fe700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e40a14d0 0x7fe4e40a3990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009fd0 tx=0x7fe4ec009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:13.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.768+0000 7fe4f8ff9700 1 -- 172.21.15.59:0/4285553745 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe4f0052100 con 0x7fe4fc100ff0 2023-10-08T12:41:13.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.985+0000 7fe501dff700 1 -- 172.21.15.59:0/4285553745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4fc110570 con 0x7fe4fc100ff0 2023-10-08T12:41:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.986+0000 7fe4f8ff9700 1 -- 172.21.15.59:0/4285553745 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22725 (secure 0 0 0) 0x7fe4f0096560 con 0x7fe4fc100ff0 2023-10-08T12:41:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:13.988 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":86,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:40:11.783762+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:41:13.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 -- 172.21.15.59:0/4285553745 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e40a14d0 msgr2=0x7fe4e40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e40a14d0 0x7fe4e40a3990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009fd0 tx=0x7fe4ec009260 comp rx=0 tx=0).stop 2023-10-08T12:41:13.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 -- 172.21.15.59:0/4285553745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4fc100ff0 msgr2=0x7fe4fc19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:13.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4fc100ff0 0x7fe4fc19ef90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000e9a0 tx=0x7fe4f000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 -- 172.21.15.59:0/4285553745 shutdown_connections 2023-10-08T12:41:13.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe4e40a14d0 0x7fe4e40a3990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4fc100630 0x7fe4fc19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4fc106640 0x7fe4fc198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 --2- 172.21.15.59:0/4285553745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4fc100ff0 0x7fe4fc19ef90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:13.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 -- 172.21.15.59:0/4285553745 >> 172.21.15.59:0/4285553745 conn(0x7fe4fc0fc140 msgr2=0x7fe4fc10b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:13.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 -- 172.21.15.59:0/4285553745 shutdown_connections 2023-10-08T12:41:13.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:13.989+0000 7fe501dff700 1 -- 172.21.15.59:0/4285553745 wait complete. 2023-10-08T12:41:14.009 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:39:12.134451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:39:13.186137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:41:14.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:41:14.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:13 smithi092 ceph-mon[134093]: pgmap v315: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:14.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:13 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1693789359' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:14.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:13 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3025862040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:13 smithi173 ceph-mon[135182]: pgmap v315: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:13 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1693789359' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:14.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:13 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3025862040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:14.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.218+0000 7fca709ff700 1 -- 172.21.15.59:0/1448637210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca6c1010e0 msgr2=0x7fca6c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:14.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.218+0000 7fca709ff700 1 --2- 172.21.15.59:0/1448637210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca6c1010e0 0x7fca6c10d5f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fca64009f90 tx=0x7fca6400b330 comp rx=0 tx=0).stop 2023-10-08T12:41:14.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.218+0000 7fca709ff700 1 -- 172.21.15.59:0/1448637210 shutdown_connections 2023-10-08T12:41:14.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.218+0000 7fca709ff700 1 --2- 172.21.15.59:0/1448637210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca6c106730 0x7fca6c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.218+0000 7fca709ff700 1 --2- 172.21.15.59:0/1448637210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca6c1010e0 0x7fca6c10d5f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.218+0000 7fca709ff700 1 --2- 172.21.15.59:0/1448637210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c100720 0x7fca6c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.218+0000 7fca709ff700 1 -- 172.21.15.59:0/1448637210 >> 172.21.15.59:0/1448637210 conn(0x7fca6c0fc230 msgr2=0x7fca6c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:14.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.218+0000 7fca709ff700 1 -- 172.21.15.59:0/1448637210 shutdown_connections 2023-10-08T12:41:14.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.218+0000 7fca709ff700 1 -- 172.21.15.59:0/1448637210 wait complete. 2023-10-08T12:41:14.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.220+0000 7fca709ff700 1 Processor -- start 2023-10-08T12:41:14.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.220+0000 7fca709ff700 1 -- start start 2023-10-08T12:41:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.220+0000 7fca709ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c100720 0x7fca6c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.220+0000 7fca709ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca6c1010e0 0x7fca6c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.220+0000 7fca709ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca6c106730 0x7fca6c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.220+0000 7fca709ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c1a4ea0 con 0x7fca6c100720 2023-10-08T12:41:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.220+0000 7fca709ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c1a5010 con 0x7fca6c1010e0 2023-10-08T12:41:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.220+0000 7fca709ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c1a51d0 con 0x7fca6c106730 2023-10-08T12:41:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.220+0000 7fca6a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c100720 0x7fca6c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca6a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c100720 0x7fca6c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42982/0 (socket says 172.21.15.59:42982) 2023-10-08T12:41:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca69d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca6c1010e0 0x7fca6c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca6a59c700 1 -- 172.21.15.59:0/1124707699 learned_addr learned my addr 172.21.15.59:0/1124707699 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca6ad9d700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca6c106730 0x7fca6c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca69d9b700 1 -- 172.21.15.59:0/1124707699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca6c106730 msgr2=0x7fca6c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca69d9b700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca6c106730 0x7fca6c073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca69d9b700 1 -- 172.21.15.59:0/1124707699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c100720 msgr2=0x7fca6c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca69d9b700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c100720 0x7fca6c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca69d9b700 1 -- 172.21.15.59:0/1124707699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca600095f0 con 0x7fca6c1010e0 2023-10-08T12:41:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca6a59c700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c100720 0x7fca6c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca69d9b700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca6c1010e0 0x7fca6c073030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca6000eb90 tx=0x7fca6000eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.221+0000 7fca5b7fe700 1 -- 172.21.15.59:0/1124707699 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60009970 con 0x7fca6c1010e0 2023-10-08T12:41:14.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.222+0000 7fca709ff700 1 -- 172.21.15.59:0/1124707699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5c009520 con 0x7fca6c1010e0 2023-10-08T12:41:14.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.222+0000 7fca709ff700 1 -- 172.21.15.59:0/1124707699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca64009c40 con 0x7fca6c1010e0 2023-10-08T12:41:14.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.222+0000 7fca5b7fe700 1 -- 172.21.15.59:0/1124707699 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca600044e0 con 0x7fca6c1010e0 2023-10-08T12:41:14.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.222+0000 7fca5b7fe700 1 -- 172.21.15.59:0/1124707699 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60003e40 con 0x7fca6c1010e0 2023-10-08T12:41:14.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.223+0000 7fca709ff700 1 -- 172.21.15.59:0/1124707699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c0052f0 con 0x7fca6c1010e0 2023-10-08T12:41:14.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.225+0000 7fca5b7fe700 1 -- 172.21.15.59:0/1124707699 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fca6000cc90 con 0x7fca6c1010e0 2023-10-08T12:41:14.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.226+0000 7fca5b7fe700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca540a1550 0x7fca540a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:14.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.227+0000 7fca5b7fe700 1 -- 172.21.15.59:0/1124707699 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fca60014070 con 0x7fca6c1010e0 2023-10-08T12:41:14.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.227+0000 7fca6a59c700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca540a1550 0x7fca540a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:14.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.227+0000 7fca6a59c700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca540a1550 0x7fca540a3a10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0116b0 tx=0x7fca5c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:14.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.231+0000 7fca5b7fe700 1 -- 172.21.15.59:0/1124707699 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fca60096730 con 0x7fca6c1010e0 2023-10-08T12:41:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:13 smithi059 ceph-mon[98489]: pgmap v315: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:13 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1693789359' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:13 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3025862040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.441+0000 7fca709ff700 1 -- 172.21.15.59:0/1124707699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca4c005b20 con 0x7fca6c1010e0 2023-10-08T12:41:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.442+0000 7fca5b7fe700 1 -- 172.21.15.59:0/1124707699 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca60099d50 con 0x7fca6c1010e0 2023-10-08T12:41:14.443 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T12:41:14.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 -- 172.21.15.59:0/1124707699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca540a1550 msgr2=0x7fca540a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:14.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca540a1550 0x7fca540a3a10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0116b0 tx=0x7fca5c009260 comp rx=0 tx=0).stop 2023-10-08T12:41:14.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 -- 172.21.15.59:0/1124707699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca6c1010e0 msgr2=0x7fca6c073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:14.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca6c1010e0 0x7fca6c073030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca6000eb90 tx=0x7fca6000eea0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 -- 172.21.15.59:0/1124707699 shutdown_connections 2023-10-08T12:41:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca540a1550 0x7fca540a3a10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca6c106730 0x7fca6c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c100720 0x7fca6c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 --2- 172.21.15.59:0/1124707699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca6c1010e0 0x7fca6c073030 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 -- 172.21.15.59:0/1124707699 >> 172.21.15.59:0/1124707699 conn(0x7fca6c0fc230 msgr2=0x7fca6c0fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 -- 172.21.15.59:0/1124707699 shutdown_connections 2023-10-08T12:41:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.444+0000 7fca709ff700 1 -- 172.21.15.59:0/1124707699 wait complete. 2023-10-08T12:41:14.464 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:41:14.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.670+0000 7fd9667ff700 1 -- 172.21.15.59:0/4044179171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd960106740 msgr2=0x7fd960106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:14.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.670+0000 7fd9667ff700 1 --2- 172.21.15.59:0/4044179171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd960106740 0x7fd960106b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd950009990 tx=0x7fd950009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.670+0000 7fd9667ff700 1 -- 172.21.15.59:0/4044179171 shutdown_connections 2023-10-08T12:41:14.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.670+0000 7fd9667ff700 1 --2- 172.21.15.59:0/4044179171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9601010f0 0x7fd96010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.670+0000 7fd9667ff700 1 --2- 172.21.15.59:0/4044179171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd960106740 0x7fd960106b20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.670+0000 7fd9667ff700 1 --2- 172.21.15.59:0/4044179171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd960100730 0x7fd960100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.670+0000 7fd9667ff700 1 -- 172.21.15.59:0/4044179171 >> 172.21.15.59:0/4044179171 conn(0x7fd9600fc200 msgr2=0x7fd9600fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:14.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.670+0000 7fd9667ff700 1 -- 172.21.15.59:0/4044179171 shutdown_connections 2023-10-08T12:41:14.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.670+0000 7fd9667ff700 1 -- 172.21.15.59:0/4044179171 wait complete. 2023-10-08T12:41:14.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.671+0000 7fd9667ff700 1 Processor -- start 2023-10-08T12:41:14.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.671+0000 7fd9667ff700 1 -- start start 2023-10-08T12:41:14.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.671+0000 7fd9667ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd960100730 0x7fd960072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:14.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.671+0000 7fd9667ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9601010f0 0x7fd960073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.671+0000 7fd9667ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd960106740 0x7fd960073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd9667ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9601a4f80 con 0x7fd9601010f0 2023-10-08T12:41:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd9667ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9601a50f0 con 0x7fd960106740 2023-10-08T12:41:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd9667ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9601a52b0 con 0x7fd960100730 2023-10-08T12:41:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd95f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9601010f0 0x7fd960073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd95ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd960100730 0x7fd960072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd95ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd960100730 0x7fd960072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56320/0 (socket says 172.21.15.59:56320) 2023-10-08T12:41:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd95ffff700 1 -- 172.21.15.59:0/1445400581 learned_addr learned my addr 172.21.15.59:0/1445400581 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd964d9c700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd960106740 0x7fd960073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd95ffff700 1 -- 172.21.15.59:0/1445400581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd960106740 msgr2=0x7fd960073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd95ffff700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd960106740 0x7fd960073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd95ffff700 1 -- 172.21.15.59:0/1445400581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9601010f0 msgr2=0x7fd960073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd95ffff700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9601010f0 0x7fd960073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd95ffff700 1 -- 172.21.15.59:0/1445400581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9500095f0 con 0x7fd960100730 2023-10-08T12:41:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd964d9c700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd960106740 0x7fd960073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.672+0000 7fd95ffff700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd960100730 0x7fd960072af0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd950000c00 tx=0x7fd950005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.673+0000 7fd95d7fa700 1 -- 172.21.15.59:0/1445400581 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95001d070 con 0x7fd960100730 2023-10-08T12:41:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.673+0000 7fd95d7fa700 1 -- 172.21.15.59:0/1445400581 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd950022470 con 0x7fd960100730 2023-10-08T12:41:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.673+0000 7fd9667ff700 1 -- 172.21.15.59:0/1445400581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9601a5530 con 0x7fd960100730 2023-10-08T12:41:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.673+0000 7fd95d7fa700 1 -- 172.21.15.59:0/1445400581 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950017650 con 0x7fd960100730 2023-10-08T12:41:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.673+0000 7fd9667ff700 1 -- 172.21.15.59:0/1445400581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9601a5a10 con 0x7fd960100730 2023-10-08T12:41:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.674+0000 7fd9667ff700 1 -- 172.21.15.59:0/1445400581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd960108d30 con 0x7fd960100730 2023-10-08T12:41:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.676+0000 7fd95d7fa700 1 -- 172.21.15.59:0/1445400581 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd9500225e0 con 0x7fd960100730 2023-10-08T12:41:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.677+0000 7fd95d7fa700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9480a14d0 0x7fd9480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.678+0000 7fd95d7fa700 1 -- 172.21.15.59:0/1445400581 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd9500ce7f0 con 0x7fd960100730 2023-10-08T12:41:14.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.678+0000 7fd95f7fe700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9480a14d0 0x7fd9480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:14.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.678+0000 7fd95f7fe700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9480a14d0 0x7fd9480a3990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd960074220 tx=0x7fd954009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:14.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.680+0000 7fd95d7fa700 1 -- 172.21.15.59:0/1445400581 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd950097de0 con 0x7fd960100730 2023-10-08T12:41:14.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.900+0000 7fd9667ff700 1 -- 172.21.15.59:0/1445400581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd960073fd0 con 0x7fd960100730 2023-10-08T12:41:14.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.901+0000 7fd95d7fa700 1 -- 172.21.15.59:0/1445400581 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd95009b400 con 0x7fd960100730 2023-10-08T12:41:14.902 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-08T12:41:14.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.903+0000 7fd9667ff700 1 -- 172.21.15.59:0/1445400581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9480a14d0 msgr2=0x7fd9480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:14.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.903+0000 7fd9667ff700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9480a14d0 0x7fd9480a3990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd960074220 tx=0x7fd954009260 comp rx=0 tx=0).stop 2023-10-08T12:41:14.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.903+0000 7fd9667ff700 1 -- 172.21.15.59:0/1445400581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd960100730 msgr2=0x7fd960072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.903+0000 7fd9667ff700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd960100730 0x7fd960072af0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd950000c00 tx=0x7fd950005740 comp rx=0 tx=0).stop 2023-10-08T12:41:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.903+0000 7fd9667ff700 1 -- 172.21.15.59:0/1445400581 shutdown_connections 2023-10-08T12:41:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.903+0000 7fd9667ff700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9480a14d0 0x7fd9480a3990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.903+0000 7fd9667ff700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd960106740 0x7fd960073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.903+0000 7fd9667ff700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd960100730 0x7fd960072af0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.903+0000 7fd9667ff700 1 --2- 172.21.15.59:0/1445400581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9601010f0 0x7fd960073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.903+0000 7fd9667ff700 1 -- 172.21.15.59:0/1445400581 >> 172.21.15.59:0/1445400581 conn(0x7fd9600fc200 msgr2=0x7fd9600fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.903+0000 7fd9667ff700 1 -- 172.21.15.59:0/1445400581 shutdown_connections 2023-10-08T12:41:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:14.904+0000 7fd9667ff700 1 -- 172.21.15.59:0/1445400581 wait complete. 2023-10-08T12:41:14.923 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:41:15.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.129+0000 7f877f7ff700 1 -- 172.21.15.59:0/775997905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8778108950 msgr2=0x7f8778108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:15.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.129+0000 7f877f7ff700 1 --2- 172.21.15.59:0/775997905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8778108950 0x7f8778108d30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8774009990 tx=0x7f8774009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.129+0000 7f877f7ff700 1 -- 172.21.15.59:0/775997905 shutdown_connections 2023-10-08T12:41:15.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.129+0000 7f877f7ff700 1 --2- 172.21.15.59:0/775997905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8778103300 0x7f877810f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.129+0000 7f877f7ff700 1 --2- 172.21.15.59:0/775997905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8778108950 0x7f8778108d30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.129+0000 7f877f7ff700 1 --2- 172.21.15.59:0/775997905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8778102940 0x7f8778102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.129+0000 7f877f7ff700 1 -- 172.21.15.59:0/775997905 >> 172.21.15.59:0/775997905 conn(0x7f87780fe3d0 msgr2=0x7f87781007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:15.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.130+0000 7f877f7ff700 1 -- 172.21.15.59:0/775997905 shutdown_connections 2023-10-08T12:41:15.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.130+0000 7f877f7ff700 1 -- 172.21.15.59:0/775997905 wait complete. 2023-10-08T12:41:15.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.131+0000 7f877f7ff700 1 Processor -- start 2023-10-08T12:41:15.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.131+0000 7f877f7ff700 1 -- start start 2023-10-08T12:41:15.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877f7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8778102940 0x7f8778198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:15.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877f7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8778103300 0x7f87781992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:15.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877f7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8778108950 0x7f877819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:15.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877f7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877819dc90 con 0x7f8778103300 2023-10-08T12:41:15.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877f7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877819de00 con 0x7f8778108950 2023-10-08T12:41:15.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877f7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877819dfc0 con 0x7f8778102940 2023-10-08T12:41:15.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877cd9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8778103300 0x7f87781992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:15.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877d59b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8778102940 0x7f8778198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:15.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877cd9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8778103300 0x7f87781992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43014/0 (socket says 172.21.15.59:43014) 2023-10-08T12:41:15.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877cd9a700 1 -- 172.21.15.59:0/1906702452 learned_addr learned my addr 172.21.15.59:0/1906702452 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:15.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877dd9c700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8778108950 0x7f877819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:15.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877cd9a700 1 -- 172.21.15.59:0/1906702452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8778102940 msgr2=0x7f8778198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:15.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877cd9a700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8778102940 0x7f8778198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877cd9a700 1 -- 172.21.15.59:0/1906702452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8778108950 msgr2=0x7f877819d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:15.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877cd9a700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8778108950 0x7f877819d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.132+0000 7f877cd9a700 1 -- 172.21.15.59:0/1906702452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87740095f0 con 0x7f8778103300 2023-10-08T12:41:15.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.133+0000 7f877cd9a700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8778103300 0x7f87781992b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f876800e9a0 tx=0x7f876800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:15.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.133+0000 7f876e7fc700 1 -- 172.21.15.59:0/1906702452 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768009790 con 0x7f8778103300 2023-10-08T12:41:15.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.133+0000 7f877f7ff700 1 -- 172.21.15.59:0/1906702452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877819e2a0 con 0x7f8778103300 2023-10-08T12:41:15.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.133+0000 7f876e7fc700 1 -- 172.21.15.59:0/1906702452 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8768010430 con 0x7f8778103300 2023-10-08T12:41:15.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.133+0000 7f876e7fc700 1 -- 172.21.15.59:0/1906702452 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768018680 con 0x7f8778103300 2023-10-08T12:41:15.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.133+0000 7f877f7ff700 1 -- 172.21.15.59:0/1906702452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87781a5ae0 con 0x7f8778103300 2023-10-08T12:41:15.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.134+0000 7f877f7ff700 1 -- 172.21.15.59:0/1906702452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877810af40 con 0x7f8778103300 2023-10-08T12:41:15.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.136+0000 7f876e7fc700 1 -- 172.21.15.59:0/1906702452 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f87680105a0 con 0x7f8778103300 2023-10-08T12:41:15.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.138+0000 7f876e7fc700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f87640a14d0 0x7f87640a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:15.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.138+0000 7f876e7fc700 1 -- 172.21.15.59:0/1906702452 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8768014070 con 0x7f8778103300 2023-10-08T12:41:15.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.138+0000 7f877d59b700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f87640a14d0 0x7f87640a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:15.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.139+0000 7f877d59b700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f87640a14d0 0x7f87640a3990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f877400b2e0 tx=0x7f8774005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:15.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.140+0000 7f876e7fc700 1 -- 172.21.15.59:0/1906702452 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8768096760 con 0x7f8778103300 2023-10-08T12:41:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:14 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4285553745' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:15.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:14 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1124707699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:15.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:14 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4285553745' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:14 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1124707699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:15.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.353+0000 7f877f7ff700 1 -- 172.21.15.59:0/1906702452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f877819a070 con 0x7f8778103300 2023-10-08T12:41:15.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.354+0000 7f876e7fc700 1 -- 172.21.15.59:0/1906702452 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87680260a0 con 0x7f8778103300 2023-10-08T12:41:15.355 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-08T12:41:15.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 -- 172.21.15.59:0/1906702452 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f87640a14d0 msgr2=0x7f87640a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:15.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f87640a14d0 0x7f87640a3990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f877400b2e0 tx=0x7f8774005960 comp rx=0 tx=0).stop 2023-10-08T12:41:15.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 -- 172.21.15.59:0/1906702452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8778103300 msgr2=0x7f87781992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:15.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8778103300 0x7f87781992b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f876800e9a0 tx=0x7f876800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 -- 172.21.15.59:0/1906702452 shutdown_connections 2023-10-08T12:41:15.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f87640a14d0 0x7f87640a3990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8778108950 0x7f877819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8778102940 0x7f8778198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 --2- 172.21.15.59:0/1906702452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8778103300 0x7f87781992b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 -- 172.21.15.59:0/1906702452 >> 172.21.15.59:0/1906702452 conn(0x7f87780fe3d0 msgr2=0x7f87780fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 -- 172.21.15.59:0/1906702452 shutdown_connections 2023-10-08T12:41:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.356+0000 7f877f7ff700 1 -- 172.21.15.59:0/1906702452 wait complete. 2023-10-08T12:41:15.376 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-08T12:41:15.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:41:15.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:14 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4285553745' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:15.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:14 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1124707699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:15.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.579+0000 7f46487ff700 1 -- 172.21.15.59:0/3562572226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4640106640 msgr2=0x7f4640106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.579+0000 7f46487ff700 1 --2- 172.21.15.59:0/3562572226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4640106640 0x7f4640106a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f463c009990 tx=0x7f463c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.580+0000 7f46487ff700 1 -- 172.21.15.59:0/3562572226 shutdown_connections 2023-10-08T12:41:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.580+0000 7f46487ff700 1 --2- 172.21.15.59:0/3562572226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100ff0 0x7f464010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.580+0000 7f46487ff700 1 --2- 172.21.15.59:0/3562572226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4640106640 0x7f4640106a20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.580+0000 7f46487ff700 1 --2- 172.21.15.59:0/3562572226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4640100630 0x7f4640100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.580+0000 7f46487ff700 1 -- 172.21.15.59:0/3562572226 >> 172.21.15.59:0/3562572226 conn(0x7f46400fc140 msgr2=0x7f46400fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.580+0000 7f46487ff700 1 -- 172.21.15.59:0/3562572226 shutdown_connections 2023-10-08T12:41:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.580+0000 7f46487ff700 1 -- 172.21.15.59:0/3562572226 wait complete. 2023-10-08T12:41:15.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.581+0000 7f46487ff700 1 Processor -- start 2023-10-08T12:41:15.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.581+0000 7f46487ff700 1 -- start start 2023-10-08T12:41:15.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.581+0000 7f46487ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4640100630 0x7f464019ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:15.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.581+0000 7f46487ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100ff0 0x7f464019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:15.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.581+0000 7f46487ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4640106640 0x7f4640198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:15.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.581+0000 7f46487ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46401992c0 con 0x7f4640106640 2023-10-08T12:41:15.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.581+0000 7f46487ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4640199430 con 0x7f4640100630 2023-10-08T12:41:15.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.581+0000 7f46487ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46401995f0 con 0x7f4640100ff0 2023-10-08T12:41:15.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.581+0000 7f4646d9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4640106640 0x7f4640198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:15.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.581+0000 7f4646d9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4640106640 0x7f4640198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43044/0 (socket says 172.21.15.59:43044) 2023-10-08T12:41:15.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f464659b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4640100630 0x7f464019ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:15.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f4646d9c700 1 -- 172.21.15.59:0/2343618109 learned_addr learned my addr 172.21.15.59:0/2343618109 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:15.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f4645d9a700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100ff0 0x7f464019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:15.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f464659b700 1 -- 172.21.15.59:0/2343618109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100ff0 msgr2=0x7f464019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f464659b700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100ff0 0x7f464019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f464659b700 1 -- 172.21.15.59:0/2343618109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4640106640 msgr2=0x7f4640198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f464659b700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4640106640 0x7f4640198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f464659b700 1 -- 172.21.15.59:0/2343618109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4630009520 con 0x7f4640100630 2023-10-08T12:41:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f464659b700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4640100630 0x7f464019ea50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f463c000c00 tx=0x7f463c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f46377fe700 1 -- 172.21.15.59:0/2343618109 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c01d070 con 0x7f4640100630 2023-10-08T12:41:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f46487ff700 1 -- 172.21.15.59:0/2343618109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c0095f0 con 0x7f4640100630 2023-10-08T12:41:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f46377fe700 1 -- 172.21.15.59:0/2343618109 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f463c021410 con 0x7f4640100630 2023-10-08T12:41:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.582+0000 7f46377fe700 1 -- 172.21.15.59:0/2343618109 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c021ea0 con 0x7f4640100630 2023-10-08T12:41:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.583+0000 7f46487ff700 1 -- 172.21.15.59:0/2343618109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46401a57f0 con 0x7f4640100630 2023-10-08T12:41:15.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.583+0000 7f46487ff700 1 -- 172.21.15.59:0/2343618109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4640101d70 con 0x7f4640100630 2023-10-08T12:41:15.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.586+0000 7f46377fe700 1 -- 172.21.15.59:0/2343618109 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f463c021580 con 0x7f4640100630 2023-10-08T12:41:15.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.587+0000 7f46377fe700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f462c0a14d0 0x7f462c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:15.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.587+0000 7f46377fe700 1 -- 172.21.15.59:0/2343618109 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f463c0ce280 con 0x7f4640100630 2023-10-08T12:41:15.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.587+0000 7f4645d9a700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f462c0a14d0 0x7f462c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:15.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.588+0000 7f4645d9a700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f462c0a14d0 0x7f462c0a3990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f464019a260 tx=0x7f4630009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:15.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.589+0000 7f46377fe700 1 -- 172.21.15.59:0/2343618109 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f463c097870 con 0x7f4640100630 2023-10-08T12:41:15.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.848+0000 7f46487ff700 1 -- 172.21.15.59:0/2343618109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4640067450 con 0x7f4640100630 2023-10-08T12:41:15.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.849+0000 7f46377fe700 1 -- 172.21.15.59:0/2343618109 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f463c09ae90 con 0x7f4640100630 2023-10-08T12:41:15.853 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:15.853 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:41:15.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 -- 172.21.15.59:0/2343618109 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f462c0a14d0 msgr2=0x7f462c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:15.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f462c0a14d0 0x7f462c0a3990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f464019a260 tx=0x7f4630009260 comp rx=0 tx=0).stop 2023-10-08T12:41:15.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 -- 172.21.15.59:0/2343618109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4640100630 msgr2=0x7f464019ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:15.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4640100630 0x7f464019ea50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f463c000c00 tx=0x7f463c004730 comp rx=0 tx=0).stop 2023-10-08T12:41:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 -- 172.21.15.59:0/2343618109 shutdown_connections 2023-10-08T12:41:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f462c0a14d0 0x7f462c0a3990 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4640100630 0x7f464019ea50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4640106640 0x7f4640198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 --2- 172.21.15.59:0/2343618109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100ff0 0x7f464019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 -- 172.21.15.59:0/2343618109 >> 172.21.15.59:0/2343618109 conn(0x7f46400fc140 msgr2=0x7f464010bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 -- 172.21.15.59:0/2343618109 shutdown_connections 2023-10-08T12:41:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:15.852+0000 7f46487ff700 1 -- 172.21.15.59:0/2343618109 wait complete. 2023-10-08T12:41:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:41:15.871 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-08T12:41:15.871 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-08T12:41:15.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:41:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.076+0000 7f1165fff700 1 -- 172.21.15.59:0/233225503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1160106640 msgr2=0x7f1160106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.076+0000 7f1165fff700 1 --2- 172.21.15.59:0/233225503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1160106640 0x7f1160106a20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1150009990 tx=0x7f1150009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.076+0000 7f1165fff700 1 -- 172.21.15.59:0/233225503 shutdown_connections 2023-10-08T12:41:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.076+0000 7f1165fff700 1 --2- 172.21.15.59:0/233225503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1160100ff0 0x7f116010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.076+0000 7f1165fff700 1 --2- 172.21.15.59:0/233225503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1160106640 0x7f1160106a20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.076+0000 7f1165fff700 1 --2- 172.21.15.59:0/233225503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160100630 0x7f1160100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.076+0000 7f1165fff700 1 -- 172.21.15.59:0/233225503 >> 172.21.15.59:0/233225503 conn(0x7f11600fc140 msgr2=0x7f11600fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:16.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.076+0000 7f1165fff700 1 -- 172.21.15.59:0/233225503 shutdown_connections 2023-10-08T12:41:16.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.076+0000 7f1165fff700 1 -- 172.21.15.59:0/233225503 wait complete. 2023-10-08T12:41:16.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.077+0000 7f1165fff700 1 Processor -- start 2023-10-08T12:41:16.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.077+0000 7f1165fff700 1 -- start start 2023-10-08T12:41:16.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.077+0000 7f1165fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160100630 0x7f1160072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:16.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.077+0000 7f1165fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1160100ff0 0x7f1160073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:16.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.077+0000 7f1165fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1160106640 0x7f1160073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:16.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.077+0000 7f1165fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11601a4ed0 con 0x7f1160106640 2023-10-08T12:41:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.077+0000 7f1165fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11601a5040 con 0x7f1160100ff0 2023-10-08T12:41:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.077+0000 7f1165fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11601a5200 con 0x7f1160100630 2023-10-08T12:41:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1160106640 0x7f1160073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160100630 0x7f1160072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1160106640 0x7f1160073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43054/0 (socket says 172.21.15.59:43054) 2023-10-08T12:41:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115ffff700 1 -- 172.21.15.59:0/1631956963 learned_addr learned my addr 172.21.15.59:0/1631956963 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115effd700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1160100ff0 0x7f1160073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115f7fe700 1 -- 172.21.15.59:0/1631956963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1160100ff0 msgr2=0x7f1160073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115f7fe700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1160100ff0 0x7f1160073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115f7fe700 1 -- 172.21.15.59:0/1631956963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1160106640 msgr2=0x7f1160073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115f7fe700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1160106640 0x7f1160073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115f7fe700 1 -- 172.21.15.59:0/1631956963 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500095f0 con 0x7f1160100630 2023-10-08T12:41:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115ffff700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1160106640 0x7f1160073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.078+0000 7f115f7fe700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160100630 0x7f1160072af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11500098e0 tx=0x7f1150005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.079+0000 7f115cff9700 1 -- 172.21.15.59:0/1631956963 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115001d070 con 0x7f1160100630 2023-10-08T12:41:16.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.079+0000 7f115cff9700 1 -- 172.21.15.59:0/1631956963 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1150022470 con 0x7f1160100630 2023-10-08T12:41:16.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.079+0000 7f115cff9700 1 -- 172.21.15.59:0/1631956963 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150017650 con 0x7f1160100630 2023-10-08T12:41:16.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.079+0000 7f1165fff700 1 -- 172.21.15.59:0/1631956963 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11601a5480 con 0x7f1160100630 2023-10-08T12:41:16.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.079+0000 7f1165fff700 1 -- 172.21.15.59:0/1631956963 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11601a5910 con 0x7f1160100630 2023-10-08T12:41:16.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.080+0000 7f1165fff700 1 -- 172.21.15.59:0/1631956963 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1160108c30 con 0x7f1160100630 2023-10-08T12:41:16.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.082+0000 7f115cff9700 1 -- 172.21.15.59:0/1631956963 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f11500225e0 con 0x7f1160100630 2023-10-08T12:41:16.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.083+0000 7f115cff9700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11480a14d0 0x7f11480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:16.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.083+0000 7f115cff9700 1 -- 172.21.15.59:0/1631956963 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f11500ce370 con 0x7f1160100630 2023-10-08T12:41:16.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.083+0000 7f115effd700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11480a14d0 0x7f11480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:16.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.084+0000 7f115effd700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11480a14d0 0x7f11480a3990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1160074220 tx=0x7f1154009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.085+0000 7f115cff9700 1 -- 172.21.15.59:0/1631956963 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1150097960 con 0x7f1160100630 2023-10-08T12:41:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:15 smithi173 ceph-mon[135182]: pgmap v316: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2023-10-08T12:41:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:15 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1445400581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:15 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1906702452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:15 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2343618109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:16.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:15 smithi059 ceph-mon[98489]: pgmap v316: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2023-10-08T12:41:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:15 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1445400581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:15 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1906702452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:15 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2343618109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:16.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.294+0000 7f1165fff700 1 -- 172.21.15.59:0/1631956963 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1160110570 con 0x7f11480a14d0 2023-10-08T12:41:16.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.305+0000 7f115cff9700 1 -- 172.21.15.59:0/1631956963 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344079 (secure 0 0 0) 0x7f1160110570 con 0x7f11480a14d0 2023-10-08T12:41:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 -- 172.21.15.59:0/1631956963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11480a14d0 msgr2=0x7f11480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11480a14d0 0x7f11480a3990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1160074220 tx=0x7f1154009260 comp rx=0 tx=0).stop 2023-10-08T12:41:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 -- 172.21.15.59:0/1631956963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160100630 msgr2=0x7f1160072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160100630 0x7f1160072af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11500098e0 tx=0x7f1150005740 comp rx=0 tx=0).stop 2023-10-08T12:41:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 -- 172.21.15.59:0/1631956963 shutdown_connections 2023-10-08T12:41:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11480a14d0 0x7f11480a3990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1160106640 0x7f1160073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160100630 0x7f1160072af0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 --2- 172.21.15.59:0/1631956963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1160100ff0 0x7f1160073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 -- 172.21.15.59:0/1631956963 >> 172.21.15.59:0/1631956963 conn(0x7f11600fc140 msgr2=0x7f11600fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 -- 172.21.15.59:0/1631956963 shutdown_connections 2023-10-08T12:41:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.310+0000 7f1165fff700 1 -- 172.21.15.59:0/1631956963 wait complete. 2023-10-08T12:41:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-08T12:41:16.330 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2023-10-08T12:41:14.811631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650821,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":377,"num_read_kb":299,"num_write":258,"num_write_kb":3022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180859,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":704,"ondisk_log_size":704,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335488,"kb_used_data":11296,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606336,"statfs":{"total":1151940427776,"available":1151596888064,"internally_reserved":0,"allocated":11567104,"data_stored":7497540,"data_compressed":181917,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002700"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844446+0000","last_change":"2023-10-08T12:39:14.206423+0000","last_active":"2023-10-08T12:40:40.844446+0000","last_peered":"2023-10-08T12:40:40.844446+0000","last_clean":"2023-10-08T12:40:40.844446+0000","last_became_active":"2023-10-08T12:39:14.205454+0000","last_became_peered":"2023-10-08T12:39:14.205454+0000","last_unstale":"2023-10-08T12:40:40.844446+0000","last_undegraded":"2023-10-08T12:40:40.844446+0000","last_fullsized":"2023-10-08T12:40:40.844446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:37.669007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844574+0000","last_change":"2023-10-08T12:39:14.215711+0000","last_active":"2023-10-08T12:40:40.844574+0000","last_peered":"2023-10-08T12:40:40.844574+0000","last_clean":"2023-10-08T12:40:40.844574+0000","last_became_active":"2023-10-08T12:39:14.215283+0000","last_became_peered":"2023-10-08T12:39:14.215283+0000","last_unstale":"2023-10-08T12:40:40.844574+0000","last_undegraded":"2023-10-08T12:40:40.844574+0000","last_fullsized":"2023-10-08T12:40:40.844574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:29.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845917+0000","last_change":"2023-10-08T12:39:14.209843+0000","last_active":"2023-10-08T12:40:40.845917+0000","last_peered":"2023-10-08T12:40:40.845917+0000","last_clean":"2023-10-08T12:40:40.845917+0000","last_became_active":"2023-10-08T12:39:14.209528+0000","last_became_peered":"2023-10-08T12:39:14.209528+0000","last_unstale":"2023-10-08T12:40:40.845917+0000","last_undegraded":"2023-10-08T12:40:40.845917+0000","last_fullsized":"2023-10-08T12:40:40.845917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:54.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.838144+0000","last_change":"2023-10-08T12:39:14.204891+0000","last_active":"2023-10-08T12:40:40.838144+0000","last_peered":"2023-10-08T12:40:40.838144+0000","last_clean":"2023-10-08T12:40:40.838144+0000","last_became_active":"2023-10-08T12:39:14.204075+0000","last_became_peered":"2023-10-08T12:39:14.204075+0000","last_unstale":"2023-10-08T12:40:40.838144+0000","last_undegraded":"2023-10-08T12:40:40.838144+0000","last_fullsized":"2023-10-08T12:40:40.838144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:18.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.820311+0000","last_change":"2023-10-08T12:39:14.212527+0000","last_active":"2023-10-08T12:40:40.820311+0000","last_peered":"2023-10-08T12:40:40.820311+0000","last_clean":"2023-10-08T12:40:40.820311+0000","last_became_active":"2023-10-08T12:39:14.212188+0000","last_became_peered":"2023-10-08T12:39:14.212188+0000","last_unstale":"2023-10-08T12:40:40.820311+0000","last_undegraded":"2023-10-08T12:40:40.820311+0000","last_fullsized":"2023-10-08T12:40:40.820311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:28.952210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.829543+0000","last_change":"2023-10-08T12:39:14.216842+0000","last_active":"2023-10-08T12:40:40.829543+0000","last_peered":"2023-10-08T12:40:40.829543+0000","last_clean":"2023-10-08T12:40:40.829543+0000","last_became_active":"2023-10-08T12:39:14.216446+0000","last_became_peered":"2023-10-08T12:39:14.216446+0000","last_unstale":"2023-10-08T12:40:40.829543+0000","last_undegraded":"2023-10-08T12:40:40.829543+0000","last_fullsized":"2023-10-08T12:40:40.829543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:40.718246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839089+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:40.839089+0000","last_peered":"2023-10-08T12:40:40.839089+0000","last_clean":"2023-10-08T12:40:40.839089+0000","last_became_active":"2023-10-08T12:39:14.222410+0000","last_became_peered":"2023-10-08T12:39:14.222410+0000","last_unstale":"2023-10-08T12:40:40.839089+0000","last_undegraded":"2023-10-08T12:40:40.839089+0000","last_fullsized":"2023-10-08T12:40:40.839089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:03.599610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831130+0000","last_change":"2023-10-08T12:39:14.209422+0000","last_active":"2023-10-08T12:40:40.831130+0000","last_peered":"2023-10-08T12:40:40.831130+0000","last_clean":"2023-10-08T12:40:40.831130+0000","last_became_active":"2023-10-08T12:39:14.209073+0000","last_became_peered":"2023-10-08T12:39:14.209073+0000","last_unstale":"2023-10-08T12:40:40.831130+0000","last_undegraded":"2023-10-08T12:40:40.831130+0000","last_fullsized":"2023-10-08T12:40:40.831130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:09.587414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839131+0000","last_change":"2023-10-08T12:39:14.211228+0000","last_active":"2023-10-08T12:40:40.839131+0000","last_peered":"2023-10-08T12:40:40.839131+0000","last_clean":"2023-10-08T12:40:40.839131+0000","last_became_active":"2023-10-08T12:39:14.210940+0000","last_became_peered":"2023-10-08T12:39:14.210940+0000","last_unstale":"2023-10-08T12:40:40.839131+0000","last_undegraded":"2023-10-08T12:40:40.839131+0000","last_fullsized":"2023-10-08T12:40:40.839131+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:52.683409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.825575+0000","last_change":"2023-10-08T12:39:14.207071+0000","last_active":"2023-10-08T12:40:40.825575+0000","last_peered":"2023-10-08T12:40:40.825575+0000","last_clean":"2023-10-08T12:40:40.825575+0000","last_became_active":"2023-10-08T12:39:14.206770+0000","last_became_peered":"2023-10-08T12:39:14.206770+0000","last_unstale":"2023-10-08T12:40:40.825575+0000","last_undegraded":"2023-10-08T12:40:40.825575+0000","last_fullsized":"2023-10-08T12:40:40.825575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:19.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.833356+0000","last_change":"2023-10-08T12:39:14.212780+0000","last_active":"2023-10-08T12:40:40.833356+0000","last_peered":"2023-10-08T12:40:40.833356+0000","last_clean":"2023-10-08T12:40:40.833356+0000","last_became_active":"2023-10-08T12:39:14.212167+0000","last_became_peered":"2023-10-08T12:39:14.212167+0000","last_unstale":"2023-10-08T12:40:40.833356+0000","last_undegraded":"2023-10-08T12:40:40.833356+0000","last_fullsized":"2023-10-08T12:40:40.833356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:17.332257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.838112+0000","last_change":"2023-10-08T12:39:14.204506+0000","last_active":"2023-10-08T12:40:40.838112+0000","last_peered":"2023-10-08T12:40:40.838112+0000","last_clean":"2023-10-08T12:40:40.838112+0000","last_became_active":"2023-10-08T12:39:14.204184+0000","last_became_peered":"2023-10-08T12:39:14.204184+0000","last_unstale":"2023-10-08T12:40:40.838112+0000","last_undegraded":"2023-10-08T12:40:40.838112+0000","last_fullsized":"2023-10-08T12:40:40.838112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:05.696554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839192+0000","last_change":"2023-10-08T12:39:14.211957+0000","last_active":"2023-10-08T12:40:40.839192+0000","last_peered":"2023-10-08T12:40:40.839192+0000","last_clean":"2023-10-08T12:40:40.839192+0000","last_became_active":"2023-10-08T12:39:14.211629+0000","last_became_peered":"2023-10-08T12:39:14.211629+0000","last_unstale":"2023-10-08T12:40:40.839192+0000","last_undegraded":"2023-10-08T12:40:40.839192+0000","last_fullsized":"2023-10-08T12:40:40.839192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:10.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844830+0000","last_change":"2023-10-08T12:39:14.207006+0000","last_active":"2023-10-08T12:40:40.844830+0000","last_peered":"2023-10-08T12:40:40.844830+0000","last_clean":"2023-10-08T12:40:40.844830+0000","last_became_active":"2023-10-08T12:39:14.206624+0000","last_became_peered":"2023-10-08T12:39:14.206624+0000","last_unstale":"2023-10-08T12:40:40.844830+0000","last_undegraded":"2023-10-08T12:40:40.844830+0000","last_fullsized":"2023-10-08T12:40:40.844830+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:11.232875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845182+0000","last_change":"2023-10-08T12:39:14.213865+0000","last_active":"2023-10-08T12:40:40.845182+0000","last_peered":"2023-10-08T12:40:40.845182+0000","last_clean":"2023-10-08T12:40:40.845182+0000","last_became_active":"2023-10-08T12:39:14.207972+0000","last_became_peered":"2023-10-08T12:39:14.207972+0000","last_unstale":"2023-10-08T12:40:40.845182+0000","last_undegraded":"2023-10-08T12:40:40.845182+0000","last_fullsized":"2023-10-08T12:40:40.845182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:01.434731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.846397+0000","last_change":"2023-10-08T12:39:14.206313+0000","last_active":"2023-10-08T12:40:40.846397+0000","last_peered":"2023-10-08T12:40:40.846397+0000","last_clean":"2023-10-08T12:40:40.846397+0000","last_became_active":"2023-10-08T12:39:14.206001+0000","last_became_peered":"2023-10-08T12:39:14.206001+0000","last_unstale":"2023-10-08T12:40:40.846397+0000","last_undegraded":"2023-10-08T12:40:40.846397+0000","last_fullsized":"2023-10-08T12:40:40.846397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:43.912356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844356+0000","last_change":"2023-10-08T12:39:14.205752+0000","last_active":"2023-10-08T12:40:40.844356+0000","last_peered":"2023-10-08T12:40:40.844356+0000","last_clean":"2023-10-08T12:40:40.844356+0000","last_became_active":"2023-10-08T12:39:14.204696+0000","last_became_peered":"2023-10-08T12:39:14.204696+0000","last_unstale":"2023-10-08T12:40:40.844356+0000","last_undegraded":"2023-10-08T12:40:40.844356+0000","last_fullsized":"2023-10-08T12:40:40.844356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:42.409107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841359+0000","last_change":"2023-10-08T12:39:14.203373+0000","last_active":"2023-10-08T12:40:40.841359+0000","last_peered":"2023-10-08T12:40:40.841359+0000","last_clean":"2023-10-08T12:40:40.841359+0000","last_became_active":"2023-10-08T12:39:14.202966+0000","last_became_peered":"2023-10-08T12:39:14.202966+0000","last_unstale":"2023-10-08T12:40:40.841359+0000","last_undegraded":"2023-10-08T12:40:40.841359+0000","last_fullsized":"2023-10-08T12:40:40.841359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:00.114475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.826269+0000","last_change":"2023-10-08T12:39:14.216154+0000","last_active":"2023-10-08T12:40:40.826269+0000","last_peered":"2023-10-08T12:40:40.826269+0000","last_clean":"2023-10-08T12:40:40.826269+0000","last_became_active":"2023-10-08T12:39:14.215868+0000","last_became_peered":"2023-10-08T12:39:14.215868+0000","last_unstale":"2023-10-08T12:40:40.826269+0000","last_undegraded":"2023-10-08T12:40:40.826269+0000","last_fullsized":"2023-10-08T12:40:40.826269+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:53.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786840+0000","last_change":"2023-10-08T12:39:13.214538+0000","last_active":"2023-10-08T12:40:10.786840+0000","last_peered":"2023-10-08T12:40:10.786840+0000","last_clean":"2023-10-08T12:40:10.786840+0000","last_became_active":"2023-10-08T12:39:13.214162+0000","last_became_peered":"2023-10-08T12:39:13.214162+0000","last_unstale":"2023-10-08T12:40:10.786840+0000","last_undegraded":"2023-10-08T12:40:10.786840+0000","last_fullsized":"2023-10-08T12:40:10.786840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:11.500815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831387+0000","last_change":"2023-10-08T12:39:14.211308+0000","last_active":"2023-10-08T12:40:40.831387+0000","last_peered":"2023-10-08T12:40:40.831387+0000","last_clean":"2023-10-08T12:40:40.831387+0000","last_became_active":"2023-10-08T12:39:14.210961+0000","last_became_peered":"2023-10-08T12:39:14.210961+0000","last_unstale":"2023-10-08T12:40:40.831387+0000","last_undegraded":"2023-10-08T12:40:40.831387+0000","last_fullsized":"2023-10-08T12:40:40.831387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.221981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.790623+0000","last_change":"2023-10-08T12:39:13.219982+0000","last_active":"2023-10-08T12:40:11.790623+0000","last_peered":"2023-10-08T12:40:11.790623+0000","last_clean":"2023-10-08T12:40:11.790623+0000","last_became_active":"2023-10-08T12:39:13.219668+0000","last_became_peered":"2023-10-08T12:39:13.219668+0000","last_unstale":"2023-10-08T12:40:11.790623+0000","last_undegraded":"2023-10-08T12:40:11.790623+0000","last_fullsized":"2023-10-08T12:40:11.790623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.664553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843418+0000","last_change":"2023-10-08T12:39:14.216922+0000","last_active":"2023-10-08T12:40:40.843418+0000","last_peered":"2023-10-08T12:40:40.843418+0000","last_clean":"2023-10-08T12:40:40.843418+0000","last_became_active":"2023-10-08T12:39:14.216634+0000","last_became_peered":"2023-10-08T12:39:14.216634+0000","last_unstale":"2023-10-08T12:40:40.843418+0000","last_undegraded":"2023-10-08T12:40:40.843418+0000","last_fullsized":"2023-10-08T12:40:40.843418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:21.254178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790823+0000","last_change":"2023-10-08T12:39:13.220262+0000","last_active":"2023-10-08T12:40:10.790823+0000","last_peered":"2023-10-08T12:40:10.790823+0000","last_clean":"2023-10-08T12:40:10.790823+0000","last_became_active":"2023-10-08T12:39:13.219917+0000","last_became_peered":"2023-10-08T12:39:13.219917+0000","last_unstale":"2023-10-08T12:40:10.790823+0000","last_undegraded":"2023-10-08T12:40:10.790823+0000","last_fullsized":"2023-10-08T12:40:10.790823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:34.368119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842418+0000","last_change":"2023-10-08T12:39:14.212620+0000","last_active":"2023-10-08T12:40:40.842418+0000","last_peered":"2023-10-08T12:40:40.842418+0000","last_clean":"2023-10-08T12:40:40.842418+0000","last_became_active":"2023-10-08T12:39:14.212128+0000","last_became_peered":"2023-10-08T12:39:14.212128+0000","last_unstale":"2023-10-08T12:40:40.842418+0000","last_undegraded":"2023-10-08T12:40:40.842418+0000","last_fullsized":"2023-10-08T12:40:40.842418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:40.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790321+0000","last_change":"2023-10-08T12:39:13.218291+0000","last_active":"2023-10-08T12:40:10.790321+0000","last_peered":"2023-10-08T12:40:10.790321+0000","last_clean":"2023-10-08T12:40:10.790321+0000","last_became_active":"2023-10-08T12:39:13.217907+0000","last_became_peered":"2023-10-08T12:39:13.217907+0000","last_unstale":"2023-10-08T12:40:10.790321+0000","last_undegraded":"2023-10-08T12:40:10.790321+0000","last_fullsized":"2023-10-08T12:40:10.790321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:54:46.891553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839228+0000","last_change":"2023-10-08T12:39:14.207991+0000","last_active":"2023-10-08T12:40:40.839228+0000","last_peered":"2023-10-08T12:40:40.839228+0000","last_clean":"2023-10-08T12:40:40.839228+0000","last_became_active":"2023-10-08T12:39:14.207683+0000","last_became_peered":"2023-10-08T12:39:14.207683+0000","last_unstale":"2023-10-08T12:40:40.839228+0000","last_undegraded":"2023-10-08T12:40:40.839228+0000","last_fullsized":"2023-10-08T12:40:40.839228+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:47.809553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786504+0000","last_change":"2023-10-08T12:39:13.214704+0000","last_active":"2023-10-08T12:40:10.786504+0000","last_peered":"2023-10-08T12:40:10.786504+0000","last_clean":"2023-10-08T12:40:10.786504+0000","last_became_active":"2023-10-08T12:39:13.214205+0000","last_became_peered":"2023-10-08T12:39:13.214205+0000","last_unstale":"2023-10-08T12:40:10.786504+0000","last_undegraded":"2023-10-08T12:40:10.786504+0000","last_fullsized":"2023-10-08T12:40:10.786504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:58.572620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.823756+0000","last_change":"2023-10-08T12:39:14.219813+0000","last_active":"2023-10-08T12:40:40.823756+0000","last_peered":"2023-10-08T12:40:40.823756+0000","last_clean":"2023-10-08T12:40:40.823756+0000","last_became_active":"2023-10-08T12:39:14.219511+0000","last_became_peered":"2023-10-08T12:39:14.219511+0000","last_unstale":"2023-10-08T12:40:40.823756+0000","last_undegraded":"2023-10-08T12:40:40.823756+0000","last_fullsized":"2023-10-08T12:40:40.823756+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:43.716871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786848+0000","last_change":"2023-10-08T12:39:13.212567+0000","last_active":"2023-10-08T12:40:10.786848+0000","last_peered":"2023-10-08T12:40:10.786848+0000","last_clean":"2023-10-08T12:40:10.786848+0000","last_became_active":"2023-10-08T12:39:13.212079+0000","last_became_peered":"2023-10-08T12:39:13.212079+0000","last_unstale":"2023-10-08T12:40:10.786848+0000","last_undegraded":"2023-10-08T12:40:10.786848+0000","last_fullsized":"2023-10-08T12:40:10.786848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:35.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.829438+0000","last_change":"2023-10-08T12:39:14.208760+0000","last_active":"2023-10-08T12:40:40.829438+0000","last_peered":"2023-10-08T12:40:40.829438+0000","last_clean":"2023-10-08T12:40:40.829438+0000","last_became_active":"2023-10-08T12:39:14.208490+0000","last_became_peered":"2023-10-08T12:39:14.208490+0000","last_unstale":"2023-10-08T12:40:40.829438+0000","last_undegraded":"2023-10-08T12:40:40.829438+0000","last_fullsized":"2023-10-08T12:40:40.829438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:19:56.423514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791638+0000","last_change":"2023-10-08T12:39:13.214197+0000","last_active":"2023-10-08T12:40:10.791638+0000","last_peered":"2023-10-08T12:40:10.791638+0000","last_clean":"2023-10-08T12:40:10.791638+0000","last_became_active":"2023-10-08T12:39:13.213829+0000","last_became_peered":"2023-10-08T12:39:13.213829+0000","last_unstale":"2023-10-08T12:40:10.791638+0000","last_undegraded":"2023-10-08T12:40:10.791638+0000","last_fullsized":"2023-10-08T12:40:10.791638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:29:05.080370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.826518+0000","last_change":"2023-10-08T12:39:14.212369+0000","last_active":"2023-10-08T12:40:40.826518+0000","last_peered":"2023-10-08T12:40:40.826518+0000","last_clean":"2023-10-08T12:40:40.826518+0000","last_became_active":"2023-10-08T12:39:14.211917+0000","last_became_peered":"2023-10-08T12:39:14.211917+0000","last_unstale":"2023-10-08T12:40:40.826518+0000","last_undegraded":"2023-10-08T12:40:40.826518+0000","last_fullsized":"2023-10-08T12:40:40.826518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:27.265251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786322+0000","last_change":"2023-10-08T12:39:13.217339+0000","last_active":"2023-10-08T12:40:10.786322+0000","last_peered":"2023-10-08T12:40:10.786322+0000","last_clean":"2023-10-08T12:40:10.786322+0000","last_became_active":"2023-10-08T12:39:13.216973+0000","last_became_peered":"2023-10-08T12:39:13.216973+0000","last_unstale":"2023-10-08T12:40:10.786322+0000","last_undegraded":"2023-10-08T12:40:10.786322+0000","last_fullsized":"2023-10-08T12:40:10.786322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:35.899844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.837738+0000","last_change":"2023-10-08T12:39:14.218870+0000","last_active":"2023-10-08T12:40:40.837738+0000","last_peered":"2023-10-08T12:40:40.837738+0000","last_clean":"2023-10-08T12:40:40.837738+0000","last_became_active":"2023-10-08T12:39:14.217879+0000","last_became_peered":"2023-10-08T12:39:14.217879+0000","last_unstale":"2023-10-08T12:40:40.837738+0000","last_undegraded":"2023-10-08T12:40:40.837738+0000","last_fullsized":"2023-10-08T12:40:40.837738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:06.769081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787188+0000","last_change":"2023-10-08T12:39:13.209120+0000","last_active":"2023-10-08T12:40:10.787188+0000","last_peered":"2023-10-08T12:40:10.787188+0000","last_clean":"2023-10-08T12:40:10.787188+0000","last_became_active":"2023-10-08T12:39:13.208755+0000","last_became_peered":"2023-10-08T12:39:13.208755+0000","last_unstale":"2023-10-08T12:40:10.787188+0000","last_undegraded":"2023-10-08T12:40:10.787188+0000","last_fullsized":"2023-10-08T12:40:10.787188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:48.977375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842992+0000","last_change":"2023-10-08T12:39:14.208187+0000","last_active":"2023-10-08T12:40:40.842992+0000","last_peered":"2023-10-08T12:40:40.842992+0000","last_clean":"2023-10-08T12:40:40.842992+0000","last_became_active":"2023-10-08T12:39:14.207868+0000","last_became_peered":"2023-10-08T12:39:14.207868+0000","last_unstale":"2023-10-08T12:40:40.842992+0000","last_undegraded":"2023-10-08T12:40:40.842992+0000","last_fullsized":"2023-10-08T12:40:40.842992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:50.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794276+0000","last_change":"2023-10-08T12:39:13.220447+0000","last_active":"2023-10-08T12:40:10.794276+0000","last_peered":"2023-10-08T12:40:10.794276+0000","last_clean":"2023-10-08T12:40:10.794276+0000","last_became_active":"2023-10-08T12:39:13.220032+0000","last_became_peered":"2023-10-08T12:39:13.220032+0000","last_unstale":"2023-10-08T12:40:10.794276+0000","last_undegraded":"2023-10-08T12:40:10.794276+0000","last_fullsized":"2023-10-08T12:40:10.794276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:22.223707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845944+0000","last_change":"2023-10-08T12:40:11.807692+0000","last_active":"2023-10-08T12:40:40.845944+0000","last_peered":"2023-10-08T12:40:40.845944+0000","last_clean":"2023-10-08T12:40:40.845944+0000","last_became_active":"2023-10-08T12:40:11.807311+0000","last_became_peered":"2023-10-08T12:40:11.807311+0000","last_unstale":"2023-10-08T12:40:40.845944+0000","last_undegraded":"2023-10-08T12:40:40.845944+0000","last_fullsized":"2023-10-08T12:40:40.845944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:42.114689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786798+0000","last_change":"2023-10-08T12:39:13.219131+0000","last_active":"2023-10-08T12:40:10.786798+0000","last_peered":"2023-10-08T12:40:10.786798+0000","last_clean":"2023-10-08T12:40:10.786798+0000","last_became_active":"2023-10-08T12:39:13.218639+0000","last_became_peered":"2023-10-08T12:39:13.218639+0000","last_unstale":"2023-10-08T12:40:10.786798+0000","last_undegraded":"2023-10-08T12:40:10.786798+0000","last_fullsized":"2023-10-08T12:40:10.786798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.316153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841798+0000","last_change":"2023-10-08T12:39:14.212352+0000","last_active":"2023-10-08T12:40:40.841798+0000","last_peered":"2023-10-08T12:40:40.841798+0000","last_clean":"2023-10-08T12:40:40.841798+0000","last_became_active":"2023-10-08T12:39:14.211342+0000","last_became_peered":"2023-10-08T12:39:14.211342+0000","last_unstale":"2023-10-08T12:40:40.841798+0000","last_undegraded":"2023-10-08T12:40:40.841798+0000","last_fullsized":"2023-10-08T12:40:40.841798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:39:00.731860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'28","reported_seq":278,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:41:10.419234+0000","last_change":"2023-10-08T12:39:13.209967+0000","last_active":"2023-10-08T12:41:10.419234+0000","last_peered":"2023-10-08T12:41:10.419234+0000","last_clean":"2023-10-08T12:41:10.419234+0000","last_became_active":"2023-10-08T12:39:13.209650+0000","last_became_peered":"2023-10-08T12:39:13.209650+0000","last_unstale":"2023-10-08T12:41:10.419234+0000","last_undegraded":"2023-10-08T12:41:10.419234+0000","last_fullsized":"2023-10-08T12:41:10.419234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:08.206168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59409,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":235,"num_read_kb":174,"num_write":28,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.818859+0000","last_change":"2023-10-08T12:39:14.211335+0000","last_active":"2023-10-08T12:40:40.818859+0000","last_peered":"2023-10-08T12:40:40.818859+0000","last_clean":"2023-10-08T12:40:40.818859+0000","last_became_active":"2023-10-08T12:39:14.211003+0000","last_became_peered":"2023-10-08T12:39:14.211003+0000","last_unstale":"2023-10-08T12:40:40.818859+0000","last_undegraded":"2023-10-08T12:40:40.818859+0000","last_fullsized":"2023-10-08T12:40:40.818859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:00.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793676+0000","last_change":"2023-10-08T12:39:13.215379+0000","last_active":"2023-10-08T12:40:10.793676+0000","last_peered":"2023-10-08T12:40:10.793676+0000","last_clean":"2023-10-08T12:40:10.793676+0000","last_became_active":"2023-10-08T12:39:13.215036+0000","last_became_peered":"2023-10-08T12:39:13.215036+0000","last_unstale":"2023-10-08T12:40:10.793676+0000","last_undegraded":"2023-10-08T12:40:10.793676+0000","last_fullsized":"2023-10-08T12:40:10.793676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:24.690473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834969+0000","last_change":"2023-10-08T12:39:14.207907+0000","last_active":"2023-10-08T12:40:40.834969+0000","last_peered":"2023-10-08T12:40:40.834969+0000","last_clean":"2023-10-08T12:40:40.834969+0000","last_became_active":"2023-10-08T12:39:14.207620+0000","last_became_peered":"2023-10-08T12:39:14.207620+0000","last_unstale":"2023-10-08T12:40:40.834969+0000","last_undegraded":"2023-10-08T12:40:40.834969+0000","last_fullsized":"2023-10-08T12:40:40.834969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:49:11.866245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786468+0000","last_change":"2023-10-08T12:39:13.214521+0000","last_active":"2023-10-08T12:40:10.786468+0000","last_peered":"2023-10-08T12:40:10.786468+0000","last_clean":"2023-10-08T12:40:10.786468+0000","last_became_active":"2023-10-08T12:39:13.214127+0000","last_became_peered":"2023-10-08T12:39:13.214127+0000","last_unstale":"2023-10-08T12:40:10.786468+0000","last_undegraded":"2023-10-08T12:40:10.786468+0000","last_fullsized":"2023-10-08T12:40:10.786468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:46.735663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841774+0000","last_change":"2023-10-08T12:40:11.796744+0000","last_active":"2023-10-08T12:40:40.841774+0000","last_peered":"2023-10-08T12:40:40.841774+0000","last_clean":"2023-10-08T12:40:40.841774+0000","last_became_active":"2023-10-08T12:40:11.796418+0000","last_became_peered":"2023-10-08T12:40:11.796418+0000","last_unstale":"2023-10-08T12:40:40.841774+0000","last_undegraded":"2023-10-08T12:40:40.841774+0000","last_fullsized":"2023-10-08T12:40:40.841774+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:22.693079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791530+0000","last_change":"2023-10-08T12:39:13.214758+0000","last_active":"2023-10-08T12:40:10.791530+0000","last_peered":"2023-10-08T12:40:10.791530+0000","last_clean":"2023-10-08T12:40:10.791530+0000","last_became_active":"2023-10-08T12:39:13.214304+0000","last_became_peered":"2023-10-08T12:39:13.214304+0000","last_unstale":"2023-10-08T12:40:10.791530+0000","last_undegraded":"2023-10-08T12:40:10.791530+0000","last_fullsized":"2023-10-08T12:40:10.791530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:34.074248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.835144+0000","last_change":"2023-10-08T12:39:14.208071+0000","last_active":"2023-10-08T12:40:40.835144+0000","last_peered":"2023-10-08T12:40:40.835144+0000","last_clean":"2023-10-08T12:40:40.835144+0000","last_became_active":"2023-10-08T12:39:14.207787+0000","last_became_peered":"2023-10-08T12:39:14.207787+0000","last_unstale":"2023-10-08T12:40:40.835144+0000","last_undegraded":"2023-10-08T12:40:40.835144+0000","last_fullsized":"2023-10-08T12:40:40.835144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:40.869575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789406+0000","last_change":"2023-10-08T12:39:13.219105+0000","last_active":"2023-10-08T12:40:10.789406+0000","last_peered":"2023-10-08T12:40:10.789406+0000","last_clean":"2023-10-08T12:40:10.789406+0000","last_became_active":"2023-10-08T12:39:13.218767+0000","last_became_peered":"2023-10-08T12:39:13.218767+0000","last_unstale":"2023-10-08T12:40:10.789406+0000","last_undegraded":"2023-10-08T12:40:10.789406+0000","last_fullsized":"2023-10-08T12:40:10.789406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:22.763921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834522+0000","last_change":"2023-10-08T12:39:14.210037+0000","last_active":"2023-10-08T12:40:40.834522+0000","last_peered":"2023-10-08T12:40:40.834522+0000","last_clean":"2023-10-08T12:40:40.834522+0000","last_became_active":"2023-10-08T12:39:14.208140+0000","last_became_peered":"2023-10-08T12:39:14.208140+0000","last_unstale":"2023-10-08T12:40:40.834522+0000","last_undegraded":"2023-10-08T12:40:40.834522+0000","last_fullsized":"2023-10-08T12:40:40.834522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:38.475668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790878+0000","last_change":"2023-10-08T12:39:13.219229+0000","last_active":"2023-10-08T12:40:10.790878+0000","last_peered":"2023-10-08T12:40:10.790878+0000","last_clean":"2023-10-08T12:40:10.790878+0000","last_became_active":"2023-10-08T12:39:13.217964+0000","last_became_peered":"2023-10-08T12:39:13.217964+0000","last_unstale":"2023-10-08T12:40:10.790878+0000","last_undegraded":"2023-10-08T12:40:10.790878+0000","last_fullsized":"2023-10-08T12:40:10.790878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:47.480351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834255+0000","last_change":"2023-10-08T12:40:11.808035+0000","last_active":"2023-10-08T12:40:40.834255+0000","last_peered":"2023-10-08T12:40:40.834255+0000","last_clean":"2023-10-08T12:40:40.834255+0000","last_became_active":"2023-10-08T12:40:11.807611+0000","last_became_peered":"2023-10-08T12:40:11.807611+0000","last_unstale":"2023-10-08T12:40:40.834255+0000","last_undegraded":"2023-10-08T12:40:40.834255+0000","last_fullsized":"2023-10-08T12:40:40.834255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:51.833325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786745+0000","last_change":"2023-10-08T12:39:13.212791+0000","last_active":"2023-10-08T12:40:10.786745+0000","last_peered":"2023-10-08T12:40:10.786745+0000","last_clean":"2023-10-08T12:40:10.786745+0000","last_became_active":"2023-10-08T12:39:13.212146+0000","last_became_peered":"2023-10-08T12:39:13.212146+0000","last_unstale":"2023-10-08T12:40:10.786745+0000","last_undegraded":"2023-10-08T12:40:10.786745+0000","last_fullsized":"2023-10-08T12:40:10.786745+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:37.452859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830275+0000","last_change":"2023-10-08T12:40:11.800095+0000","last_active":"2023-10-08T12:40:40.830275+0000","last_peered":"2023-10-08T12:40:40.830275+0000","last_clean":"2023-10-08T12:40:40.830275+0000","last_became_active":"2023-10-08T12:40:11.795780+0000","last_became_peered":"2023-10-08T12:40:11.795780+0000","last_unstale":"2023-10-08T12:40:40.830275+0000","last_undegraded":"2023-10-08T12:40:40.830275+0000","last_fullsized":"2023-10-08T12:40:40.830275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:15.163613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794197+0000","last_change":"2023-10-08T12:39:13.217672+0000","last_active":"2023-10-08T12:40:10.794197+0000","last_peered":"2023-10-08T12:40:10.794197+0000","last_clean":"2023-10-08T12:40:10.794197+0000","last_became_active":"2023-10-08T12:39:13.217277+0000","last_became_peered":"2023-10-08T12:39:13.217277+0000","last_unstale":"2023-10-08T12:40:10.794197+0000","last_undegraded":"2023-10-08T12:40:10.794197+0000","last_fullsized":"2023-10-08T12:40:10.794197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:41.097439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845967+0000","last_change":"2023-10-08T12:39:14.219261+0000","last_active":"2023-10-08T12:40:40.845967+0000","last_peered":"2023-10-08T12:40:40.845967+0000","last_clean":"2023-10-08T12:40:40.845967+0000","last_became_active":"2023-10-08T12:39:14.218963+0000","last_became_peered":"2023-10-08T12:39:14.218963+0000","last_unstale":"2023-10-08T12:40:40.845967+0000","last_undegraded":"2023-10-08T12:40:40.845967+0000","last_fullsized":"2023-10-08T12:40:40.845967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:19.573306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830576+0000","last_change":"2023-10-08T12:39:14.207923+0000","last_active":"2023-10-08T12:40:40.830576+0000","last_peered":"2023-10-08T12:40:40.830576+0000","last_clean":"2023-10-08T12:40:40.830576+0000","last_became_active":"2023-10-08T12:39:14.207634+0000","last_became_peered":"2023-10-08T12:39:14.207634+0000","last_unstale":"2023-10-08T12:40:40.830576+0000","last_undegraded":"2023-10-08T12:40:40.830576+0000","last_fullsized":"2023-10-08T12:40:40.830576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:39.634945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791515+0000","last_change":"2023-10-08T12:39:13.223021+0000","last_active":"2023-10-08T12:40:10.791515+0000","last_peered":"2023-10-08T12:40:10.791515+0000","last_clean":"2023-10-08T12:40:10.791515+0000","last_became_active":"2023-10-08T12:39:13.222680+0000","last_became_peered":"2023-10-08T12:39:13.222680+0000","last_unstale":"2023-10-08T12:40:10.791515+0000","last_undegraded":"2023-10-08T12:40:10.791515+0000","last_fullsized":"2023-10-08T12:40:10.791515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:40.454436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.836073+0000","last_change":"2023-10-08T12:39:14.217364+0000","last_active":"2023-10-08T12:40:40.836073+0000","last_peered":"2023-10-08T12:40:40.836073+0000","last_clean":"2023-10-08T12:40:40.836073+0000","last_became_active":"2023-10-08T12:39:14.216984+0000","last_became_peered":"2023-10-08T12:39:14.216984+0000","last_unstale":"2023-10-08T12:40:40.836073+0000","last_undegraded":"2023-10-08T12:40:40.836073+0000","last_fullsized":"2023-10-08T12:40:40.836073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:11:51.818034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792124+0000","last_change":"2023-10-08T12:39:13.207687+0000","last_active":"2023-10-08T12:40:10.792124+0000","last_peered":"2023-10-08T12:40:10.792124+0000","last_clean":"2023-10-08T12:40:10.792124+0000","last_became_active":"2023-10-08T12:39:13.207270+0000","last_became_peered":"2023-10-08T12:39:13.207270+0000","last_unstale":"2023-10-08T12:40:10.792124+0000","last_undegraded":"2023-10-08T12:40:10.792124+0000","last_fullsized":"2023-10-08T12:40:10.792124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:44.673383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":319,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.791524+0000","last_change":"2023-10-08T12:38:07.696721+0000","last_active":"2023-10-08T12:40:11.791524+0000","last_peered":"2023-10-08T12:40:11.791524+0000","last_clean":"2023-10-08T12:40:11.791524+0000","last_became_active":"2023-10-08T12:38:07.696336+0000","last_became_peered":"2023-10-08T12:38:07.696336+0000","last_unstale":"2023-10-08T12:40:11.791524+0000","last_undegraded":"2023-10-08T12:40:11.791524+0000","last_fullsized":"2023-10-08T12:40:11.791524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_clean_scrub_stamp":"2023-10-08T12:34:57.643348+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:01.821924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.838753+0000","last_change":"2023-10-08T12:39:14.208845+0000","last_active":"2023-10-08T12:40:40.838753+0000","last_peered":"2023-10-08T12:40:40.838753+0000","last_clean":"2023-10-08T12:40:40.838753+0000","last_became_active":"2023-10-08T12:39:14.208487+0000","last_became_peered":"2023-10-08T12:39:14.208487+0000","last_unstale":"2023-10-08T12:40:40.838753+0000","last_undegraded":"2023-10-08T12:40:40.838753+0000","last_fullsized":"2023-10-08T12:40:40.838753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:26.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793636+0000","last_change":"2023-10-08T12:39:13.216627+0000","last_active":"2023-10-08T12:40:10.793636+0000","last_peered":"2023-10-08T12:40:10.793636+0000","last_clean":"2023-10-08T12:40:10.793636+0000","last_became_active":"2023-10-08T12:39:13.216201+0000","last_became_peered":"2023-10-08T12:39:13.216201+0000","last_unstale":"2023-10-08T12:40:10.793636+0000","last_undegraded":"2023-10-08T12:40:10.793636+0000","last_fullsized":"2023-10-08T12:40:10.793636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:19.873615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790683+0000","last_change":"2023-10-08T12:39:13.219222+0000","last_active":"2023-10-08T12:40:10.790683+0000","last_peered":"2023-10-08T12:40:10.790683+0000","last_clean":"2023-10-08T12:40:10.790683+0000","last_became_active":"2023-10-08T12:39:13.218757+0000","last_became_peered":"2023-10-08T12:39:13.218757+0000","last_unstale":"2023-10-08T12:40:10.790683+0000","last_undegraded":"2023-10-08T12:40:10.790683+0000","last_fullsized":"2023-10-08T12:40:10.790683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:15.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839490+0000","last_change":"2023-10-08T12:39:14.221945+0000","last_active":"2023-10-08T12:40:40.839490+0000","last_peered":"2023-10-08T12:40:40.839490+0000","last_clean":"2023-10-08T12:40:40.839490+0000","last_became_active":"2023-10-08T12:39:14.221625+0000","last_became_peered":"2023-10-08T12:39:14.221625+0000","last_unstale":"2023-10-08T12:40:40.839490+0000","last_undegraded":"2023-10-08T12:40:40.839490+0000","last_fullsized":"2023-10-08T12:40:40.839490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:50.424023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:42.809929+0000","last_change":"2023-10-08T12:40:11.799358+0000","last_active":"2023-10-08T12:40:42.809929+0000","last_peered":"2023-10-08T12:40:42.809929+0000","last_clean":"2023-10-08T12:40:42.809929+0000","last_became_active":"2023-10-08T12:40:11.792992+0000","last_became_peered":"2023-10-08T12:40:11.792992+0000","last_unstale":"2023-10-08T12:40:42.809929+0000","last_undegraded":"2023-10-08T12:40:42.809929+0000","last_fullsized":"2023-10-08T12:40:42.809929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:26.689160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.837841+0000","last_change":"2023-10-08T12:39:14.214849+0000","last_active":"2023-10-08T12:40:40.837841+0000","last_peered":"2023-10-08T12:40:40.837841+0000","last_clean":"2023-10-08T12:40:40.837841+0000","last_became_active":"2023-10-08T12:39:14.214573+0000","last_became_peered":"2023-10-08T12:39:14.214573+0000","last_unstale":"2023-10-08T12:40:40.837841+0000","last_undegraded":"2023-10-08T12:40:40.837841+0000","last_fullsized":"2023-10-08T12:40:40.837841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:50.922519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791629+0000","last_change":"2023-10-08T12:39:13.206518+0000","last_active":"2023-10-08T12:40:10.791629+0000","last_peered":"2023-10-08T12:40:10.791629+0000","last_clean":"2023-10-08T12:40:10.791629+0000","last_became_active":"2023-10-08T12:39:13.206082+0000","last_became_peered":"2023-10-08T12:39:13.206082+0000","last_unstale":"2023-10-08T12:40:10.791629+0000","last_undegraded":"2023-10-08T12:40:10.791629+0000","last_fullsized":"2023-10-08T12:40:10.791629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:47.980651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843426+0000","last_change":"2023-10-08T12:39:14.220897+0000","last_active":"2023-10-08T12:40:40.843426+0000","last_peered":"2023-10-08T12:40:40.843426+0000","last_clean":"2023-10-08T12:40:40.843426+0000","last_became_active":"2023-10-08T12:39:14.220173+0000","last_became_peered":"2023-10-08T12:39:14.220173+0000","last_unstale":"2023-10-08T12:40:40.843426+0000","last_undegraded":"2023-10-08T12:40:40.843426+0000","last_fullsized":"2023-10-08T12:40:40.843426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:09:02.588054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.281984+0000","last_change":"2023-10-08T12:39:13.213505+0000","last_active":"2023-10-08T12:40:11.281984+0000","last_peered":"2023-10-08T12:40:11.281984+0000","last_clean":"2023-10-08T12:40:11.281984+0000","last_became_active":"2023-10-08T12:39:13.213199+0000","last_became_peered":"2023-10-08T12:39:13.213199+0000","last_unstale":"2023-10-08T12:40:11.281984+0000","last_undegraded":"2023-10-08T12:40:11.281984+0000","last_fullsized":"2023-10-08T12:40:11.281984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:49.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.799945+0000","last_change":"2023-10-08T12:39:14.208080+0000","last_active":"2023-10-08T12:40:40.799945+0000","last_peered":"2023-10-08T12:40:40.799945+0000","last_clean":"2023-10-08T12:40:40.799945+0000","last_became_active":"2023-10-08T12:39:14.207788+0000","last_became_peered":"2023-10-08T12:39:14.207788+0000","last_unstale":"2023-10-08T12:40:40.799945+0000","last_undegraded":"2023-10-08T12:40:40.799945+0000","last_fullsized":"2023-10-08T12:40:40.799945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:44.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791994+0000","last_change":"2023-10-08T12:39:13.216003+0000","last_active":"2023-10-08T12:40:10.791994+0000","last_peered":"2023-10-08T12:40:10.791994+0000","last_clean":"2023-10-08T12:40:10.791994+0000","last_became_active":"2023-10-08T12:39:13.215662+0000","last_became_peered":"2023-10-08T12:39:13.215662+0000","last_unstale":"2023-10-08T12:40:10.791994+0000","last_undegraded":"2023-10-08T12:40:10.791994+0000","last_fullsized":"2023-10-08T12:40:10.791994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:28.310430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843188+0000","last_change":"2023-10-08T12:39:14.204336+0000","last_active":"2023-10-08T12:40:40.843188+0000","last_peered":"2023-10-08T12:40:40.843188+0000","last_clean":"2023-10-08T12:40:40.843188+0000","last_became_active":"2023-10-08T12:39:14.203993+0000","last_became_peered":"2023-10-08T12:39:14.203993+0000","last_unstale":"2023-10-08T12:40:40.843188+0000","last_undegraded":"2023-10-08T12:40:40.843188+0000","last_fullsized":"2023-10-08T12:40:40.843188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:54.545166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.793371+0000","last_change":"2023-10-08T12:40:11.793371+0000","last_active":"2023-10-08T12:40:11.793371+0000","last_peered":"2023-10-08T12:40:11.793371+0000","last_clean":"2023-10-08T12:40:11.793371+0000","last_became_active":"2023-10-08T12:40:11.792968+0000","last_became_peered":"2023-10-08T12:40:11.792968+0000","last_unstale":"2023-10-08T12:40:11.793371+0000","last_undegraded":"2023-10-08T12:40:11.793371+0000","last_fullsized":"2023-10-08T12:40:11.793371+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:20.744535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842815+0000","last_change":"2023-10-08T12:39:14.221040+0000","last_active":"2023-10-08T12:40:40.842815+0000","last_peered":"2023-10-08T12:40:40.842815+0000","last_clean":"2023-10-08T12:40:40.842815+0000","last_became_active":"2023-10-08T12:39:14.220724+0000","last_became_peered":"2023-10-08T12:39:14.220724+0000","last_unstale":"2023-10-08T12:40:40.842815+0000","last_undegraded":"2023-10-08T12:40:40.842815+0000","last_fullsized":"2023-10-08T12:40:40.842815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:52.824228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790002+0000","last_change":"2023-10-08T12:39:13.212244+0000","last_active":"2023-10-08T12:40:10.790002+0000","last_peered":"2023-10-08T12:40:10.790002+0000","last_clean":"2023-10-08T12:40:10.790002+0000","last_became_active":"2023-10-08T12:39:13.212028+0000","last_became_peered":"2023-10-08T12:39:13.212028+0000","last_unstale":"2023-10-08T12:40:10.790002+0000","last_undegraded":"2023-10-08T12:40:10.790002+0000","last_fullsized":"2023-10-08T12:40:10.790002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:06.111807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.833089+0000","last_change":"2023-10-08T12:39:14.216665+0000","last_active":"2023-10-08T12:40:40.833089+0000","last_peered":"2023-10-08T12:40:40.833089+0000","last_clean":"2023-10-08T12:40:40.833089+0000","last_became_active":"2023-10-08T12:39:14.216330+0000","last_became_peered":"2023-10-08T12:39:14.216330+0000","last_unstale":"2023-10-08T12:40:40.833089+0000","last_undegraded":"2023-10-08T12:40:40.833089+0000","last_fullsized":"2023-10-08T12:40:40.833089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.658600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793792+0000","last_change":"2023-10-08T12:39:13.214495+0000","last_active":"2023-10-08T12:40:10.793792+0000","last_peered":"2023-10-08T12:40:10.793792+0000","last_clean":"2023-10-08T12:40:10.793792+0000","last_became_active":"2023-10-08T12:39:13.213930+0000","last_became_peered":"2023-10-08T12:39:13.213930+0000","last_unstale":"2023-10-08T12:40:10.793792+0000","last_undegraded":"2023-10-08T12:40:10.793792+0000","last_fullsized":"2023-10-08T12:40:10.793792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:20:38.096164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.833346+0000","last_change":"2023-10-08T12:39:14.212566+0000","last_active":"2023-10-08T12:40:40.833346+0000","last_peered":"2023-10-08T12:40:40.833346+0000","last_clean":"2023-10-08T12:40:40.833346+0000","last_became_active":"2023-10-08T12:39:14.211756+0000","last_became_peered":"2023-10-08T12:39:14.211756+0000","last_unstale":"2023-10-08T12:40:40.833346+0000","last_undegraded":"2023-10-08T12:40:40.833346+0000","last_fullsized":"2023-10-08T12:40:40.833346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:12.741640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786680+0000","last_change":"2023-10-08T12:39:13.217914+0000","last_active":"2023-10-08T12:40:10.786680+0000","last_peered":"2023-10-08T12:40:10.786680+0000","last_clean":"2023-10-08T12:40:10.786680+0000","last_became_active":"2023-10-08T12:39:13.217571+0000","last_became_peered":"2023-10-08T12:39:13.217571+0000","last_unstale":"2023-10-08T12:40:10.786680+0000","last_undegraded":"2023-10-08T12:40:10.786680+0000","last_fullsized":"2023-10-08T12:40:10.786680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:10.826007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834977+0000","last_change":"2023-10-08T12:39:14.214280+0000","last_active":"2023-10-08T12:40:40.834977+0000","last_peered":"2023-10-08T12:40:40.834977+0000","last_clean":"2023-10-08T12:40:40.834977+0000","last_became_active":"2023-10-08T12:39:14.213942+0000","last_became_peered":"2023-10-08T12:39:14.213942+0000","last_unstale":"2023-10-08T12:40:40.834977+0000","last_undegraded":"2023-10-08T12:40:40.834977+0000","last_fullsized":"2023-10-08T12:40:40.834977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:17:21.450265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791974+0000","last_change":"2023-10-08T12:39:13.222484+0000","last_active":"2023-10-08T12:40:10.791974+0000","last_peered":"2023-10-08T12:40:10.791974+0000","last_clean":"2023-10-08T12:40:10.791974+0000","last_became_active":"2023-10-08T12:39:13.222091+0000","last_became_peered":"2023-10-08T12:39:13.222091+0000","last_unstale":"2023-10-08T12:40:10.791974+0000","last_undegraded":"2023-10-08T12:40:10.791974+0000","last_fullsized":"2023-10-08T12:40:10.791974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:00.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.835374+0000","last_change":"2023-10-08T12:39:14.207715+0000","last_active":"2023-10-08T12:40:40.835374+0000","last_peered":"2023-10-08T12:40:40.835374+0000","last_clean":"2023-10-08T12:40:40.835374+0000","last_became_active":"2023-10-08T12:39:14.207429+0000","last_became_peered":"2023-10-08T12:39:14.207429+0000","last_unstale":"2023-10-08T12:40:40.835374+0000","last_undegraded":"2023-10-08T12:40:40.835374+0000","last_fullsized":"2023-10-08T12:40:40.835374+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:16.991831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831848+0000","last_change":"2023-10-08T12:39:14.200398+0000","last_active":"2023-10-08T12:40:40.831848+0000","last_peered":"2023-10-08T12:40:40.831848+0000","last_clean":"2023-10-08T12:40:40.831848+0000","last_became_active":"2023-10-08T12:39:14.200035+0000","last_became_peered":"2023-10-08T12:39:14.200035+0000","last_unstale":"2023-10-08T12:40:40.831848+0000","last_undegraded":"2023-10-08T12:40:40.831848+0000","last_fullsized":"2023-10-08T12:40:40.831848+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:13.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834439+0000","last_change":"2023-10-08T12:39:14.202185+0000","last_active":"2023-10-08T12:40:40.834439+0000","last_peered":"2023-10-08T12:40:40.834439+0000","last_clean":"2023-10-08T12:40:40.834439+0000","last_became_active":"2023-10-08T12:39:14.201232+0000","last_became_peered":"2023-10-08T12:39:14.201232+0000","last_unstale":"2023-10-08T12:40:40.834439+0000","last_undegraded":"2023-10-08T12:40:40.834439+0000","last_fullsized":"2023-10-08T12:40:40.834439+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:50.949047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845543+0000","last_change":"2023-10-08T12:39:14.208014+0000","last_active":"2023-10-08T12:40:40.845543+0000","last_peered":"2023-10-08T12:40:40.845543+0000","last_clean":"2023-10-08T12:40:40.845543+0000","last_became_active":"2023-10-08T12:39:14.207579+0000","last_became_peered":"2023-10-08T12:39:14.207579+0000","last_unstale":"2023-10-08T12:40:40.845543+0000","last_undegraded":"2023-10-08T12:40:40.845543+0000","last_fullsized":"2023-10-08T12:40:40.845543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:37.352827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842605+0000","last_change":"2023-10-08T12:40:11.796652+0000","last_active":"2023-10-08T12:40:40.842605+0000","last_peered":"2023-10-08T12:40:40.842605+0000","last_clean":"2023-10-08T12:40:40.842605+0000","last_became_active":"2023-10-08T12:40:11.796346+0000","last_became_peered":"2023-10-08T12:40:11.796346+0000","last_unstale":"2023-10-08T12:40:40.842605+0000","last_undegraded":"2023-10-08T12:40:40.842605+0000","last_fullsized":"2023-10-08T12:40:40.842605+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:25:31.781651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843767+0000","last_change":"2023-10-08T12:39:14.222630+0000","last_active":"2023-10-08T12:40:40.843767+0000","last_peered":"2023-10-08T12:40:40.843767+0000","last_clean":"2023-10-08T12:40:40.843767+0000","last_became_active":"2023-10-08T12:39:14.222300+0000","last_became_peered":"2023-10-08T12:39:14.222300+0000","last_unstale":"2023-10-08T12:40:40.843767+0000","last_undegraded":"2023-10-08T12:40:40.843767+0000","last_fullsized":"2023-10-08T12:40:40.843767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.040227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830931+0000","last_change":"2023-10-08T12:39:14.207144+0000","last_active":"2023-10-08T12:40:40.830931+0000","last_peered":"2023-10-08T12:40:40.830931+0000","last_clean":"2023-10-08T12:40:40.830931+0000","last_became_active":"2023-10-08T12:39:14.206775+0000","last_became_peered":"2023-10-08T12:39:14.206775+0000","last_unstale":"2023-10-08T12:40:40.830931+0000","last_undegraded":"2023-10-08T12:40:40.830931+0000","last_fullsized":"2023-10-08T12:40:40.830931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:55.224270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841229+0000","last_change":"2023-10-08T12:39:14.204123+0000","last_active":"2023-10-08T12:40:40.841229+0000","last_peered":"2023-10-08T12:40:40.841229+0000","last_clean":"2023-10-08T12:40:40.841229+0000","last_became_active":"2023-10-08T12:39:14.203123+0000","last_became_peered":"2023-10-08T12:39:14.203123+0000","last_unstale":"2023-10-08T12:40:40.841229+0000","last_undegraded":"2023-10-08T12:40:40.841229+0000","last_fullsized":"2023-10-08T12:40:40.841229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:45.423095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830346+0000","last_change":"2023-10-08T12:39:14.211049+0000","last_active":"2023-10-08T12:40:40.830346+0000","last_peered":"2023-10-08T12:40:40.830346+0000","last_clean":"2023-10-08T12:40:40.830346+0000","last_became_active":"2023-10-08T12:39:14.210738+0000","last_became_peered":"2023-10-08T12:39:14.210738+0000","last_unstale":"2023-10-08T12:40:40.830346+0000","last_undegraded":"2023-10-08T12:40:40.830346+0000","last_fullsized":"2023-10-08T12:40:40.830346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:12.535857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.827735+0000","last_change":"2023-10-08T12:39:14.220013+0000","last_active":"2023-10-08T12:40:40.827735+0000","last_peered":"2023-10-08T12:40:40.827735+0000","last_clean":"2023-10-08T12:40:40.827735+0000","last_became_active":"2023-10-08T12:39:14.219711+0000","last_became_peered":"2023-10-08T12:39:14.219711+0000","last_unstale":"2023-10-08T12:40:40.827735+0000","last_undegraded":"2023-10-08T12:40:40.827735+0000","last_fullsized":"2023-10-08T12:40:40.827735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:23.205074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831620+0000","last_change":"2023-10-08T12:39:14.214237+0000","last_active":"2023-10-08T12:40:40.831620+0000","last_peered":"2023-10-08T12:40:40.831620+0000","last_clean":"2023-10-08T12:40:40.831620+0000","last_became_active":"2023-10-08T12:39:14.213891+0000","last_became_peered":"2023-10-08T12:39:14.213891+0000","last_unstale":"2023-10-08T12:40:40.831620+0000","last_undegraded":"2023-10-08T12:40:40.831620+0000","last_fullsized":"2023-10-08T12:40:40.831620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:11.348411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842349+0000","last_change":"2023-10-08T12:39:14.209037+0000","last_active":"2023-10-08T12:40:40.842349+0000","last_peered":"2023-10-08T12:40:40.842349+0000","last_clean":"2023-10-08T12:40:40.842349+0000","last_became_active":"2023-10-08T12:39:14.208728+0000","last_became_peered":"2023-10-08T12:39:14.208728+0000","last_unstale":"2023-10-08T12:40:40.842349+0000","last_undegraded":"2023-10-08T12:40:40.842349+0000","last_fullsized":"2023-10-08T12:40:40.842349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:23.440413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844397+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:40.844397+0000","last_peered":"2023-10-08T12:40:40.844397+0000","last_clean":"2023-10-08T12:40:40.844397+0000","last_became_active":"2023-10-08T12:39:14.222393+0000","last_became_peered":"2023-10-08T12:39:14.222393+0000","last_unstale":"2023-10-08T12:40:40.844397+0000","last_undegraded":"2023-10-08T12:40:40.844397+0000","last_fullsized":"2023-10-08T12:40:40.844397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:19.704140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834058+0000","last_change":"2023-10-08T12:39:14.200858+0000","last_active":"2023-10-08T12:40:40.834058+0000","last_peered":"2023-10-08T12:40:40.834058+0000","last_clean":"2023-10-08T12:40:40.834058+0000","last_became_active":"2023-10-08T12:39:14.199948+0000","last_became_peered":"2023-10-08T12:39:14.199948+0000","last_unstale":"2023-10-08T12:40:40.834058+0000","last_undegraded":"2023-10-08T12:40:40.834058+0000","last_fullsized":"2023-10-08T12:40:40.834058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:10.366380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281436,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60207,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":241,"num_read_kb":180,"num_write":75,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":181253,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416421,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":462175,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.626},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.55200000000000005}]},{"osd":2,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71799999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":4,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.056,"5min":1.175,"15min":1.175},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.45900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.623}]},{"osd":5,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96599999999999997,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90300000000000002,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.80800000000000005,"15min":0.81599999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.028,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53600000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.71299999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.53200000000000003}]},{"osd":9,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85399999999999998,"15min":0.86799999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2430000000000001,"5min":1.639,"15min":1.639},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.61599999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.099,"5min":1.196,"15min":1.196},"last":0.88100000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0409999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94799999999999995,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.754}]}]},{"osd":10,"up_from":72,"seq":309237645352,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":1111938,"data_compressed":43212,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.57699999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45500000000000002,"15min":0.46800000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54000000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.314,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60299999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.5}]},{"osd":2,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61199999999999999,"15min":0.58999999999999997},"min":{"1min":0.55800000000000005,"5min":0.376,"15min":0.376},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63100000000000001,"15min":0.627},"min":{"1min":0.56599999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82999999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60899999999999999,"15min":0.628},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70999999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.63600000000000001,"15min":0.65100000000000002},"min":{"1min":0.40000000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.83299999999999996,"5min":1.01,"15min":1.01},"last":0.69199999999999995}]},{"osd":4,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82499999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.34399999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76700000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.80600000000000005},"min":{"1min":0.53200000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.89500000000000002,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70099999999999996,"15min":0.69799999999999995},"min":{"1min":0.495,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.872,"5min":1.569,"15min":1.569},"last":0.81399999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73199999999999998,"15min":0.76000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.503,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90700000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65900000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.83699999999999997,"15min":0.878},"min":{"1min":0.52900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98499999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78400000000000003,"15min":0.78600000000000003},"min":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98099999999999998,"5min":1.669,"15min":1.669},"last":0.77000000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":0.80800000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.01,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.80400000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.59899999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95199999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.60699999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":1.522,"15min":1.522},"last":0.88300000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":462880,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93899999999999995,"5min":3.101,"15min":3.101},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.56000000000000005,"15min":0.57799999999999996},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.90000000000000002,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.70199999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0960000000000001,"5min":2.944,"15min":2.944},"last":0.77000000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.749,"15min":0.76800000000000002},"min":{"1min":0.52600000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.99099999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.4990000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.81100000000000005,"15min":0.82499999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1339999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63500000000000001,"15min":0.66500000000000004},"min":{"1min":0.34499999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.875,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.46},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.752,"15min":0.76800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.056,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.88700000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58299999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.212,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.80100000000000005,"15min":0.82599999999999996},"min":{"1min":0.54000000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95599999999999996,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.85199999999999998,"15min":0.88900000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94899999999999995,"5min":1.325,"15min":1.325},"last":1.538}]},{"osd":6,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.88700000000000001,"15min":0.93000000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.169,"5min":3.0720000000000001,"15min":3.0720000000000001},"last":1.6559999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.81699999999999995,"15min":0.85699999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.86599999999999999,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.86599999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.88300000000000001,"15min":0.93100000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96799999999999997,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.573},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.95899999999999996,"15min":0.98899999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2090000000000001,"5min":2.98,"15min":2.98},"last":0.85399999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.97599999999999998,"15min":1.012},"min":{"1min":0.63400000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.23,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.92200000000000004,"15min":0.95799999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.004,"5min":2.496,"15min":2.496},"last":0.83099999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.64400000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.038,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.875,"15min":0.89500000000000002},"min":{"1min":0.57299999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96499999999999997,"5min":2.536,"15min":2.536},"last":0.75700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":8,"up_from":59,"seq":253403070513,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462448,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85599999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.46999999999999997}]},{"osd":1,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84699999999999998,"5min":1.026,"15min":1.026},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90700000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58199999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.47599999999999998,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.435},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80300000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86199999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67000000000000004}]},{"osd":4,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.995,"5min":1.044,"15min":1.044},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94199999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.59999999999999998,"15min":0.58799999999999997},"min":{"1min":0.45000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.89000000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72599999999999998,"15min":0.71899999999999997},"min":{"1min":0.54800000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77200000000000002,"15min":0.76500000000000001},"min":{"1min":0.64600000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.72999999999999998,"15min":0.70999999999999996},"min":{"1min":0.63100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59399999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.085,"5min":1.181,"15min":1.181},"last":0.78100000000000003}]},{"osd":9,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.78400000000000003,"15min":0.76100000000000001},"min":{"1min":0.65500000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.71399999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0209999999999999,"5min":1.45,"15min":1.45},"last":0.752}]},{"osd":10,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.79800000000000004,"15min":0.77300000000000002},"min":{"1min":0.63300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.048,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.78200000000000003,"15min":0.755},"min":{"1min":0.74299999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.80900000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.86099999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":1053248,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.877,"15min":0.877},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.434},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69299999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59699999999999998,"15min":0.58699999999999997},"min":{"1min":0.44700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.57799999999999996,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81299999999999994,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.504,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79000000000000004,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.49299999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86099999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.33600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76600000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.495,"5min":0.501,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.5}]},{"osd":5,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.51600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.64500000000000002},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.84499999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.68400000000000005},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94099999999999995,"5min":1.204,"15min":1.204},"last":0.88500000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.70999999999999996,"15min":0.69199999999999995},"min":{"1min":0.56299999999999994,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.56000000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70399999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.87}]},{"osd":10,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.59799999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93799999999999994,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.745},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65000000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.91900000000000004}]}]},{"osd":6,"up_from":47,"seq":201863462970,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462298,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.61399999999999999,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.0129999999999999,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.079,"5min":0.65000000000000002,"15min":0.58499999999999996},"min":{"1min":0.35199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":10.076000000000001,"5min":10.076000000000001,"15min":10.076000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":0.747,"15min":0.65900000000000003},"min":{"1min":0.53500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":7.3250000000000002,"5min":7.3250000000000002,"15min":7.3250000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.8049999999999999,"5min":0.89100000000000001,"15min":0.73399999999999999},"min":{"1min":0.44,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":20.783000000000001,"5min":20.783000000000001,"15min":20.783000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":0.82399999999999995,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.495},"max":{"1min":10.036,"5min":10.036,"15min":10.036},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.6699999999999999,"5min":0.93999999999999995,"15min":0.82999999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":15.960000000000001,"5min":15.960000000000001,"15min":15.960000000000001},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":0.78400000000000003,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":13.558,"5min":13.558,"15min":13.558},"last":0.437},{"interface":"front","average":{"1min":1.49,"5min":0.82699999999999996,"15min":0.72299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":14.855,"5min":14.855,"15min":14.855},"last":0.626}]},{"osd":4,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80400000000000005,"15min":0.73999999999999999},"min":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.2650000000000001,"5min":6.875,"15min":6.875},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.25,"5min":0.88500000000000001,"15min":0.81499999999999995},"min":{"1min":0.66500000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":7.3689999999999998,"5min":7.3689999999999998,"15min":7.3689999999999998},"last":0.56499999999999995}]},{"osd":5,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":0.94099999999999995,"15min":0.85099999999999998},"min":{"1min":0.624,"5min":0.5,"15min":0.5},"max":{"1min":13.835000000000001,"5min":13.835000000000001,"15min":13.835000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.85499999999999998,"15min":0.84099999999999997},"min":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.9060000000000001,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.78800000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":0.995,"15min":0.84699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":18.009,"5min":18.009,"15min":18.009},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.306,"5min":0.95899999999999996,"15min":0.86499999999999999},"min":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":10.234,"5min":10.234,"15min":10.234},"last":0.66100000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.94799999999999995,"15min":0.97099999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84099999999999997,"15min":0.85099999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.84999999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94699999999999995,"15min":0.96499999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.0030000000000001,"5min":4.0030000000000001,"15min":4.0030000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.109,"15min":1.032},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":14.185,"5min":14.185,"15min":14.185},"last":0.75900000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.98399999999999999,"15min":0.998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.452,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82799999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":521569,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.46500000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.2010000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.38100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3129999999999999,"5min":1.452,"15min":1.452},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.60299999999999998,"15min":0.53300000000000003},"min":{"1min":0.46899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.59299999999999997,"15min":0.53900000000000003},"min":{"1min":0.54800000000000004,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.61399999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.60699999999999998,"15min":0.55700000000000005},"min":{"1min":0.44800000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2789999999999999,"5min":1.413,"15min":1.413},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.64100000000000001,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.224,"5min":1.427,"15min":1.427},"last":0.57399999999999995}]},{"osd":4,"last update":"Sun Oct 8 12:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.40600000000000003},"min":{"1min":0.36499999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76000000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.40899999999999997},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.69499999999999995,"15min":0.60499999999999998},"min":{"1min":0.53900000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.66400000000000003,"15min":0.60199999999999998},"min":{"1min":0.61899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:40:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.47499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.24,"5min":1.355,"15min":1.355},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.70099999999999996,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2629999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sun Oct 8 12:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.59599999999999997,"15min":0.54800000000000004},"min":{"1min":0.41699999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0169999999999999,"5min":1.04,"15min":1.04},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.67400000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.66700000000000004,"15min":0.63700000000000001},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.69899999999999995,"15min":0.64900000000000002},"min":{"1min":0.59099999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.85699999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.754,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.755,"15min":0.72899999999999998},"min":{"1min":0.63400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.1870000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.77000000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.79300000000000004,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.0700000000000001,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.752,"15min":0.72799999999999998},"min":{"1min":0.59999999999999998,"5min":0.498,"15min":0.498},"max":{"1min":0.96099999999999997,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.66000000000000003}]},{"osd":11,"last update":"Sun Oct 8 12:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.81000000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462265,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.56599999999999995},"min":{"1min":0.437,"5min":0.314,"15min":0.314},"max":{"1min":0.83399999999999996,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66200000000000003,"15min":0.57899999999999996},"min":{"1min":0.46999999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94799999999999995,"5min":1.046,"15min":1.046},"last":0.75}]},{"osd":2,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65600000000000003,"15min":0.58899999999999997},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0089999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64100000000000001,"15min":0.58899999999999997},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.079,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.74299999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64600000000000002,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.623},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.619,"5min":1.911,"15min":1.911},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.497,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.76100000000000001,"15min":0.73399999999999999},"min":{"1min":0.433,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.45800000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.50600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.59299999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":2.1819999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.85599999999999998,"15min":0.89000000000000001},"min":{"1min":0.48999999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.504},{"interface":"front","average":{"1min":0.875,"5min":0.91300000000000003,"15min":0.93799999999999994},"min":{"1min":0.60199999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.68100000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.94299999999999995,"15min":0.96599999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.65000000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.94099999999999995,"15min":0.94699999999999995},"min":{"1min":0.68600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1679999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.66900000000000004}]}]},{"osd":2,"up_from":19,"seq":81604378702,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":521934,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.35699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72699999999999998,"5min":0.88500000000000001,"15min":1.0129999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.77900000000000003,"5min":0.89600000000000002,"15min":1.194},"last":0.55200000000000005}]},{"osd":1,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59599999999999997,"15min":0.53200000000000003},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.621,"15min":0.53800000000000003},"min":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.875,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.875}]},{"osd":3,"last update":"Sun Oct 8 12:40:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61699999999999999,"15min":0.59599999999999997},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0129999999999999,"5min":1.073,"15min":1.073},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79300000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.70799999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.44400000000000001,"15min":0.41599999999999998},"min":{"1min":0.36699999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66700000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.434},"min":{"1min":0.371,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.67600000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.64700000000000002,"15min":0.60599999999999998},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.64600000000000002,"15min":0.60699999999999998},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.04,"15min":1.04},"last":0.752}]},{"osd":7,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:40:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98799999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61399999999999999},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83799999999999997,"5min":1.006,"15min":1.006},"last":0.78700000000000003}]},{"osd":9,"last update":"Sun Oct 8 12:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53100000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":1.087,"15min":1.087},"last":0.86299999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.58899999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88100000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.60699999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.89500000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.94599999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":462071,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.88500000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.51200000000000001,"15min":0.47399999999999998},"min":{"1min":0.36599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77500000000000002,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Sun Oct 8 12:40:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.61499999999999999},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0429999999999999,"5min":1.081,"15min":1.081},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.60599999999999998},"min":{"1min":0.47199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.81100000000000005,"5min":1.05,"15min":1.05},"last":0.70799999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:40:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.66000000000000003},"min":{"1min":0.48599999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90200000000000002,"5min":1.077,"15min":1.077},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.51800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.91200000000000003,"5min":1.23,"15min":1.23},"last":0.58199999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.71399999999999997,"15min":0.64100000000000001},"min":{"1min":0.63600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92100000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.748,"15min":0.67600000000000005},"min":{"1min":0.65400000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95899999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89200000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.70699999999999996,"15min":0.69099999999999995},"min":{"1min":0.52700000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89400000000000002,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.749}]},{"osd":6,"last update":"Sun Oct 8 12:40:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0169999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.879},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72199999999999998,"15min":0.71299999999999997},"min":{"1min":0.50800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.90400000000000003,"5min":1.109,"15min":1.109},"last":0.91800000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.65600000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.012,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81299999999999994,"15min":0.80000000000000004},"min":{"1min":0.65300000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.998,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.66900000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.89400000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.91200000000000003,"15min":0.97999999999999998},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.01,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.89300000000000002,"15min":0.92600000000000005},"min":{"1min":0.626,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98699999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.63200000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.90800000000000003,"15min":0.94099999999999995},"min":{"1min":0.65100000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0669999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.92400000000000004,"15min":0.96599999999999997},"min":{"1min":0.69299999999999995,"5min":0.63,"15min":0.63},"max":{"1min":0.95599999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.93100000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.89500000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888133,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462197,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67100000000000004,"15min":0.71999999999999997},"min":{"1min":0.439,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":6.0549999999999997,"15min":6.0549999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41399999999999998,"15min":0.36799999999999999},"min":{"1min":0.309,"5min":0.223,"15min":0.223},"max":{"1min":0.58899999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.39100000000000001},"min":{"1min":0.35799999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.61599999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.61499999999999999,"15min":0.56899999999999995},"min":{"1min":0.46500000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61399999999999999,"15min":0.56499999999999995},"min":{"1min":0.51900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48399999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.54100000000000004},"min":{"1min":0.50800000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.875,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.54300000000000004},"min":{"1min":0.40200000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78000000000000003,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65600000000000003,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92100000000000004,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.65200000000000002,"15min":0.58399999999999996},"min":{"1min":0.58499999999999996,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54500000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64800000000000002,"15min":0.60899999999999999},"min":{"1min":0.57299999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85499999999999998,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.93000000000000005,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.61299999999999999,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.042,"5min":1.046,"15min":1.046},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.64600000000000002,"15min":0.57599999999999996},"min":{"1min":0.434,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98699999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.71999999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:40:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70399999999999996,"15min":0.67900000000000005},"min":{"1min":0.56399999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.73699999999999999,"15min":0.70899999999999996},"min":{"1min":0.67500000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":1.242,"15min":1.242},"last":0.75600000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.014,"5min":1.349,"15min":1.349},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.83299999999999996},"min":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.028,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.70399999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.61899999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0960000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.79800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0009999999999999,"5min":1.171,"15min":1.171},"last":0.83699999999999997}]},{"osd":11,"last update":"Sun Oct 8 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.86399999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724607,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":1052517,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.39600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.437}]},{"osd":1,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.498,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81999999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.47999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.498}]},{"osd":2,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.40500000000000003},"min":{"1min":0.318,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.372},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.40699999999999997},"min":{"1min":0.29499999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41099999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.59499999999999997,"15min":0.56100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.81000000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.60499999999999998,"15min":0.57499999999999996},"min":{"1min":0.54400000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83599999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64800000000000002}]},{"osd":6,"last update":"Sun Oct 8 12:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65800000000000003,"15min":0.61699999999999999},"min":{"1min":0.42899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89100000000000001,"5min":1.268,"15min":1.268},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.61299999999999999},"min":{"1min":0.56200000000000006,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89800000000000002,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.63100000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.48299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67500000000000004,"15min":0.64000000000000001},"min":{"1min":0.58999999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68500000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.59999999999999998,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.59499999999999997,"15min":0.57299999999999995},"min":{"1min":0.46800000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.70099999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81899999999999995,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94999999999999996,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.76900000000000002},"min":{"1min":0.626,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.976,"15min":1.976},"last":0.755}]},{"osd":10,"last update":"Sun Oct 8 12:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.752,"15min":0.73099999999999998},"min":{"1min":0.60099999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98099999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77300000000000002,"15min":0.75800000000000001},"min":{"1min":0.66200000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98199999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59725,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59759,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59603,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:41:16.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:41:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:15 smithi092 ceph-mon[134093]: pgmap v316: 97 pgs: 97 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2023-10-08T12:41:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:15 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1445400581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:15 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1906702452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:15 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2343618109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:16.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.574+0000 7fa280d9d700 1 -- 172.21.15.59:0/193505745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa27c073540 msgr2=0x7fa27c10c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:16.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.574+0000 7fa280d9d700 1 --2- 172.21.15.59:0/193505745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa27c073540 0x7fa27c10c8f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa270009990 tx=0x7fa270009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.574+0000 7fa280d9d700 1 -- 172.21.15.59:0/193505745 shutdown_connections 2023-10-08T12:41:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.574+0000 7fa280d9d700 1 --2- 172.21.15.59:0/193505745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa27c072c20 0x7fa27c073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.574+0000 7fa280d9d700 1 --2- 172.21.15.59:0/193505745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa27c10ce30 0x7fa27c10f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.574+0000 7fa280d9d700 1 --2- 172.21.15.59:0/193505745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa27c073540 0x7fa27c10c8f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.574+0000 7fa280d9d700 1 -- 172.21.15.59:0/193505745 >> 172.21.15.59:0/193505745 conn(0x7fa27c0fc0e0 msgr2=0x7fa27c0fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.574+0000 7fa280d9d700 1 -- 172.21.15.59:0/193505745 shutdown_connections 2023-10-08T12:41:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.574+0000 7fa280d9d700 1 -- 172.21.15.59:0/193505745 wait complete. 2023-10-08T12:41:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.575+0000 7fa280d9d700 1 Processor -- start 2023-10-08T12:41:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.575+0000 7fa280d9d700 1 -- start start 2023-10-08T12:41:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa280d9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa27c072c20 0x7fa27c19e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa280d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa27c073540 0x7fa27c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa280d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa27c10ce30 0x7fa27c198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa280d9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c1991b0 con 0x7fa27c073540 2023-10-08T12:41:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa280d9d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c199320 con 0x7fa27c10ce30 2023-10-08T12:41:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa280d9d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c1994e0 con 0x7fa27c072c20 2023-10-08T12:41:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa27affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa27c073540 0x7fa27c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa27affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa27c073540 0x7fa27c19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43066/0 (socket says 172.21.15.59:43066) 2023-10-08T12:41:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa27bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa27c10ce30 0x7fa27c198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa27affd700 1 -- 172.21.15.59:0/469956248 learned_addr learned my addr 172.21.15.59:0/469956248 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa27b7fe700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa27c072c20 0x7fa27c19e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa27affd700 1 -- 172.21.15.59:0/469956248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa27c072c20 msgr2=0x7fa27c19e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa27affd700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa27c072c20 0x7fa27c19e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa27affd700 1 -- 172.21.15.59:0/469956248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa27c10ce30 msgr2=0x7fa27c198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.576+0000 7fa27affd700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa27c10ce30 0x7fa27c198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.577+0000 7fa27affd700 1 -- 172.21.15.59:0/469956248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2700095f0 con 0x7fa27c073540 2023-10-08T12:41:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.577+0000 7fa27bfff700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa27c10ce30 0x7fa27c198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.577+0000 7fa27affd700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa27c073540 0x7fa27c19ef00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa270000c00 tx=0x7fa270005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.577+0000 7fa278ff9700 1 -- 172.21.15.59:0/469956248 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27001d070 con 0x7fa27c073540 2023-10-08T12:41:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.577+0000 7fa278ff9700 1 -- 172.21.15.59:0/469956248 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa270022470 con 0x7fa27c073540 2023-10-08T12:41:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.577+0000 7fa280d9d700 1 -- 172.21.15.59:0/469956248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27c199760 con 0x7fa27c073540 2023-10-08T12:41:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.577+0000 7fa278ff9700 1 -- 172.21.15.59:0/469956248 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270017650 con 0x7fa27c073540 2023-10-08T12:41:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.577+0000 7fa280d9d700 1 -- 172.21.15.59:0/469956248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c1a5a60 con 0x7fa27c073540 2023-10-08T12:41:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.578+0000 7fa280d9d700 1 -- 172.21.15.59:0/469956248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27c108040 con 0x7fa27c073540 2023-10-08T12:41:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.580+0000 7fa278ff9700 1 -- 172.21.15.59:0/469956248 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa2700225e0 con 0x7fa27c073540 2023-10-08T12:41:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.581+0000 7fa278ff9700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2640a1550 0x7fa2640a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.582+0000 7fa278ff9700 1 -- 172.21.15.59:0/469956248 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa2700ce230 con 0x7fa27c073540 2023-10-08T12:41:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.582+0000 7fa27b7fe700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2640a1550 0x7fa2640a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:16.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.582+0000 7fa27b7fe700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2640a1550 0x7fa2640a3a10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009c60 tx=0x7fa26c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.585+0000 7fa278ff9700 1 -- 172.21.15.59:0/469956248 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa270097940 con 0x7fa27c073540 2023-10-08T12:41:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.793+0000 7fa280d9d700 1 -- 172.21.15.59:0/469956248 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa27c0673e0 con 0x7fa2640a1550 2023-10-08T12:41:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.803+0000 7fa278ff9700 1 -- 172.21.15.59:0/469956248 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344079 (secure 0 0 0) 0x7fa27c0673e0 con 0x7fa2640a1550 2023-10-08T12:41:16.810 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.808+0000 7fa280d9d700 1 -- 172.21.15.59:0/469956248 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2640a1550 msgr2=0x7fa2640a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.808+0000 7fa280d9d700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2640a1550 0x7fa2640a3a10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009c60 tx=0x7fa26c009260 comp rx=0 tx=0).stop 2023-10-08T12:41:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.808+0000 7fa280d9d700 1 -- 172.21.15.59:0/469956248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa27c073540 msgr2=0x7fa27c19ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.808+0000 7fa280d9d700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa27c073540 0x7fa27c19ef00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa270000c00 tx=0x7fa270005740 comp rx=0 tx=0).stop 2023-10-08T12:41:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.809+0000 7fa280d9d700 1 -- 172.21.15.59:0/469956248 shutdown_connections 2023-10-08T12:41:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.809+0000 7fa280d9d700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2640a1550 0x7fa2640a3a10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.809+0000 7fa280d9d700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa27c10ce30 0x7fa27c198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.809+0000 7fa280d9d700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa27c072c20 0x7fa27c19e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.809+0000 7fa280d9d700 1 --2- 172.21.15.59:0/469956248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa27c073540 0x7fa27c19ef00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:16.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.809+0000 7fa280d9d700 1 -- 172.21.15.59:0/469956248 >> 172.21.15.59:0/469956248 conn(0x7fa27c0fc0e0 msgr2=0x7fa27c0fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:16.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.809+0000 7fa280d9d700 1 -- 172.21.15.59:0/469956248 shutdown_connections 2023-10-08T12:41:16.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:16.809+0000 7fa280d9d700 1 -- 172.21.15.59:0/469956248 wait complete. 2023-10-08T12:41:16.814 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-08T12:41:16.829 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2023-10-08T12:41:14.811631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650821,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":377,"num_read_kb":299,"num_write":258,"num_write_kb":3022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180859,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":704,"ondisk_log_size":704,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335488,"kb_used_data":11296,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606336,"statfs":{"total":1151940427776,"available":1151596888064,"internally_reserved":0,"allocated":11567104,"data_stored":7497540,"data_compressed":181917,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002700"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844446+0000","last_change":"2023-10-08T12:39:14.206423+0000","last_active":"2023-10-08T12:40:40.844446+0000","last_peered":"2023-10-08T12:40:40.844446+0000","last_clean":"2023-10-08T12:40:40.844446+0000","last_became_active":"2023-10-08T12:39:14.205454+0000","last_became_peered":"2023-10-08T12:39:14.205454+0000","last_unstale":"2023-10-08T12:40:40.844446+0000","last_undegraded":"2023-10-08T12:40:40.844446+0000","last_fullsized":"2023-10-08T12:40:40.844446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:37.669007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844574+0000","last_change":"2023-10-08T12:39:14.215711+0000","last_active":"2023-10-08T12:40:40.844574+0000","last_peered":"2023-10-08T12:40:40.844574+0000","last_clean":"2023-10-08T12:40:40.844574+0000","last_became_active":"2023-10-08T12:39:14.215283+0000","last_became_peered":"2023-10-08T12:39:14.215283+0000","last_unstale":"2023-10-08T12:40:40.844574+0000","last_undegraded":"2023-10-08T12:40:40.844574+0000","last_fullsized":"2023-10-08T12:40:40.844574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:29.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845917+0000","last_change":"2023-10-08T12:39:14.209843+0000","last_active":"2023-10-08T12:40:40.845917+0000","last_peered":"2023-10-08T12:40:40.845917+0000","last_clean":"2023-10-08T12:40:40.845917+0000","last_became_active":"2023-10-08T12:39:14.209528+0000","last_became_peered":"2023-10-08T12:39:14.209528+0000","last_unstale":"2023-10-08T12:40:40.845917+0000","last_undegraded":"2023-10-08T12:40:40.845917+0000","last_fullsized":"2023-10-08T12:40:40.845917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:54.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.838144+0000","last_change":"2023-10-08T12:39:14.204891+0000","last_active":"2023-10-08T12:40:40.838144+0000","last_peered":"2023-10-08T12:40:40.838144+0000","last_clean":"2023-10-08T12:40:40.838144+0000","last_became_active":"2023-10-08T12:39:14.204075+0000","last_became_peered":"2023-10-08T12:39:14.204075+0000","last_unstale":"2023-10-08T12:40:40.838144+0000","last_undegraded":"2023-10-08T12:40:40.838144+0000","last_fullsized":"2023-10-08T12:40:40.838144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:18.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.820311+0000","last_change":"2023-10-08T12:39:14.212527+0000","last_active":"2023-10-08T12:40:40.820311+0000","last_peered":"2023-10-08T12:40:40.820311+0000","last_clean":"2023-10-08T12:40:40.820311+0000","last_became_active":"2023-10-08T12:39:14.212188+0000","last_became_peered":"2023-10-08T12:39:14.212188+0000","last_unstale":"2023-10-08T12:40:40.820311+0000","last_undegraded":"2023-10-08T12:40:40.820311+0000","last_fullsized":"2023-10-08T12:40:40.820311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:28.952210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.829543+0000","last_change":"2023-10-08T12:39:14.216842+0000","last_active":"2023-10-08T12:40:40.829543+0000","last_peered":"2023-10-08T12:40:40.829543+0000","last_clean":"2023-10-08T12:40:40.829543+0000","last_became_active":"2023-10-08T12:39:14.216446+0000","last_became_peered":"2023-10-08T12:39:14.216446+0000","last_unstale":"2023-10-08T12:40:40.829543+0000","last_undegraded":"2023-10-08T12:40:40.829543+0000","last_fullsized":"2023-10-08T12:40:40.829543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:40.718246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839089+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:40.839089+0000","last_peered":"2023-10-08T12:40:40.839089+0000","last_clean":"2023-10-08T12:40:40.839089+0000","last_became_active":"2023-10-08T12:39:14.222410+0000","last_became_peered":"2023-10-08T12:39:14.222410+0000","last_unstale":"2023-10-08T12:40:40.839089+0000","last_undegraded":"2023-10-08T12:40:40.839089+0000","last_fullsized":"2023-10-08T12:40:40.839089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:03.599610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831130+0000","last_change":"2023-10-08T12:39:14.209422+0000","last_active":"2023-10-08T12:40:40.831130+0000","last_peered":"2023-10-08T12:40:40.831130+0000","last_clean":"2023-10-08T12:40:40.831130+0000","last_became_active":"2023-10-08T12:39:14.209073+0000","last_became_peered":"2023-10-08T12:39:14.209073+0000","last_unstale":"2023-10-08T12:40:40.831130+0000","last_undegraded":"2023-10-08T12:40:40.831130+0000","last_fullsized":"2023-10-08T12:40:40.831130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:09.587414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839131+0000","last_change":"2023-10-08T12:39:14.211228+0000","last_active":"2023-10-08T12:40:40.839131+0000","last_peered":"2023-10-08T12:40:40.839131+0000","last_clean":"2023-10-08T12:40:40.839131+0000","last_became_active":"2023-10-08T12:39:14.210940+0000","last_became_peered":"2023-10-08T12:39:14.210940+0000","last_unstale":"2023-10-08T12:40:40.839131+0000","last_undegraded":"2023-10-08T12:40:40.839131+0000","last_fullsized":"2023-10-08T12:40:40.839131+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:52.683409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.825575+0000","last_change":"2023-10-08T12:39:14.207071+0000","last_active":"2023-10-08T12:40:40.825575+0000","last_peered":"2023-10-08T12:40:40.825575+0000","last_clean":"2023-10-08T12:40:40.825575+0000","last_became_active":"2023-10-08T12:39:14.206770+0000","last_became_peered":"2023-10-08T12:39:14.206770+0000","last_unstale":"2023-10-08T12:40:40.825575+0000","last_undegraded":"2023-10-08T12:40:40.825575+0000","last_fullsized":"2023-10-08T12:40:40.825575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:19.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.833356+0000","last_change":"2023-10-08T12:39:14.212780+0000","last_active":"2023-10-08T12:40:40.833356+0000","last_peered":"2023-10-08T12:40:40.833356+0000","last_clean":"2023-10-08T12:40:40.833356+0000","last_became_active":"2023-10-08T12:39:14.212167+0000","last_became_peered":"2023-10-08T12:39:14.212167+0000","last_unstale":"2023-10-08T12:40:40.833356+0000","last_undegraded":"2023-10-08T12:40:40.833356+0000","last_fullsized":"2023-10-08T12:40:40.833356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:17.332257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.838112+0000","last_change":"2023-10-08T12:39:14.204506+0000","last_active":"2023-10-08T12:40:40.838112+0000","last_peered":"2023-10-08T12:40:40.838112+0000","last_clean":"2023-10-08T12:40:40.838112+0000","last_became_active":"2023-10-08T12:39:14.204184+0000","last_became_peered":"2023-10-08T12:39:14.204184+0000","last_unstale":"2023-10-08T12:40:40.838112+0000","last_undegraded":"2023-10-08T12:40:40.838112+0000","last_fullsized":"2023-10-08T12:40:40.838112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:05.696554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839192+0000","last_change":"2023-10-08T12:39:14.211957+0000","last_active":"2023-10-08T12:40:40.839192+0000","last_peered":"2023-10-08T12:40:40.839192+0000","last_clean":"2023-10-08T12:40:40.839192+0000","last_became_active":"2023-10-08T12:39:14.211629+0000","last_became_peered":"2023-10-08T12:39:14.211629+0000","last_unstale":"2023-10-08T12:40:40.839192+0000","last_undegraded":"2023-10-08T12:40:40.839192+0000","last_fullsized":"2023-10-08T12:40:40.839192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:10.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844830+0000","last_change":"2023-10-08T12:39:14.207006+0000","last_active":"2023-10-08T12:40:40.844830+0000","last_peered":"2023-10-08T12:40:40.844830+0000","last_clean":"2023-10-08T12:40:40.844830+0000","last_became_active":"2023-10-08T12:39:14.206624+0000","last_became_peered":"2023-10-08T12:39:14.206624+0000","last_unstale":"2023-10-08T12:40:40.844830+0000","last_undegraded":"2023-10-08T12:40:40.844830+0000","last_fullsized":"2023-10-08T12:40:40.844830+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:11.232875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845182+0000","last_change":"2023-10-08T12:39:14.213865+0000","last_active":"2023-10-08T12:40:40.845182+0000","last_peered":"2023-10-08T12:40:40.845182+0000","last_clean":"2023-10-08T12:40:40.845182+0000","last_became_active":"2023-10-08T12:39:14.207972+0000","last_became_peered":"2023-10-08T12:39:14.207972+0000","last_unstale":"2023-10-08T12:40:40.845182+0000","last_undegraded":"2023-10-08T12:40:40.845182+0000","last_fullsized":"2023-10-08T12:40:40.845182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:01.434731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.846397+0000","last_change":"2023-10-08T12:39:14.206313+0000","last_active":"2023-10-08T12:40:40.846397+0000","last_peered":"2023-10-08T12:40:40.846397+0000","last_clean":"2023-10-08T12:40:40.846397+0000","last_became_active":"2023-10-08T12:39:14.206001+0000","last_became_peered":"2023-10-08T12:39:14.206001+0000","last_unstale":"2023-10-08T12:40:40.846397+0000","last_undegraded":"2023-10-08T12:40:40.846397+0000","last_fullsized":"2023-10-08T12:40:40.846397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:43.912356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844356+0000","last_change":"2023-10-08T12:39:14.205752+0000","last_active":"2023-10-08T12:40:40.844356+0000","last_peered":"2023-10-08T12:40:40.844356+0000","last_clean":"2023-10-08T12:40:40.844356+0000","last_became_active":"2023-10-08T12:39:14.204696+0000","last_became_peered":"2023-10-08T12:39:14.204696+0000","last_unstale":"2023-10-08T12:40:40.844356+0000","last_undegraded":"2023-10-08T12:40:40.844356+0000","last_fullsized":"2023-10-08T12:40:40.844356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:42.409107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841359+0000","last_change":"2023-10-08T12:39:14.203373+0000","last_active":"2023-10-08T12:40:40.841359+0000","last_peered":"2023-10-08T12:40:40.841359+0000","last_clean":"2023-10-08T12:40:40.841359+0000","last_became_active":"2023-10-08T12:39:14.202966+0000","last_became_peered":"2023-10-08T12:39:14.202966+0000","last_unstale":"2023-10-08T12:40:40.841359+0000","last_undegraded":"2023-10-08T12:40:40.841359+0000","last_fullsized":"2023-10-08T12:40:40.841359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:00.114475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.826269+0000","last_change":"2023-10-08T12:39:14.216154+0000","last_active":"2023-10-08T12:40:40.826269+0000","last_peered":"2023-10-08T12:40:40.826269+0000","last_clean":"2023-10-08T12:40:40.826269+0000","last_became_active":"2023-10-08T12:39:14.215868+0000","last_became_peered":"2023-10-08T12:39:14.215868+0000","last_unstale":"2023-10-08T12:40:40.826269+0000","last_undegraded":"2023-10-08T12:40:40.826269+0000","last_fullsized":"2023-10-08T12:40:40.826269+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:53.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786840+0000","last_change":"2023-10-08T12:39:13.214538+0000","last_active":"2023-10-08T12:40:10.786840+0000","last_peered":"2023-10-08T12:40:10.786840+0000","last_clean":"2023-10-08T12:40:10.786840+0000","last_became_active":"2023-10-08T12:39:13.214162+0000","last_became_peered":"2023-10-08T12:39:13.214162+0000","last_unstale":"2023-10-08T12:40:10.786840+0000","last_undegraded":"2023-10-08T12:40:10.786840+0000","last_fullsized":"2023-10-08T12:40:10.786840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:11.500815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831387+0000","last_change":"2023-10-08T12:39:14.211308+0000","last_active":"2023-10-08T12:40:40.831387+0000","last_peered":"2023-10-08T12:40:40.831387+0000","last_clean":"2023-10-08T12:40:40.831387+0000","last_became_active":"2023-10-08T12:39:14.210961+0000","last_became_peered":"2023-10-08T12:39:14.210961+0000","last_unstale":"2023-10-08T12:40:40.831387+0000","last_undegraded":"2023-10-08T12:40:40.831387+0000","last_fullsized":"2023-10-08T12:40:40.831387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.221981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.790623+0000","last_change":"2023-10-08T12:39:13.219982+0000","last_active":"2023-10-08T12:40:11.790623+0000","last_peered":"2023-10-08T12:40:11.790623+0000","last_clean":"2023-10-08T12:40:11.790623+0000","last_became_active":"2023-10-08T12:39:13.219668+0000","last_became_peered":"2023-10-08T12:39:13.219668+0000","last_unstale":"2023-10-08T12:40:11.790623+0000","last_undegraded":"2023-10-08T12:40:11.790623+0000","last_fullsized":"2023-10-08T12:40:11.790623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.664553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843418+0000","last_change":"2023-10-08T12:39:14.216922+0000","last_active":"2023-10-08T12:40:40.843418+0000","last_peered":"2023-10-08T12:40:40.843418+0000","last_clean":"2023-10-08T12:40:40.843418+0000","last_became_active":"2023-10-08T12:39:14.216634+0000","last_became_peered":"2023-10-08T12:39:14.216634+0000","last_unstale":"2023-10-08T12:40:40.843418+0000","last_undegraded":"2023-10-08T12:40:40.843418+0000","last_fullsized":"2023-10-08T12:40:40.843418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:21.254178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790823+0000","last_change":"2023-10-08T12:39:13.220262+0000","last_active":"2023-10-08T12:40:10.790823+0000","last_peered":"2023-10-08T12:40:10.790823+0000","last_clean":"2023-10-08T12:40:10.790823+0000","last_became_active":"2023-10-08T12:39:13.219917+0000","last_became_peered":"2023-10-08T12:39:13.219917+0000","last_unstale":"2023-10-08T12:40:10.790823+0000","last_undegraded":"2023-10-08T12:40:10.790823+0000","last_fullsized":"2023-10-08T12:40:10.790823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:34.368119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842418+0000","last_change":"2023-10-08T12:39:14.212620+0000","last_active":"2023-10-08T12:40:40.842418+0000","last_peered":"2023-10-08T12:40:40.842418+0000","last_clean":"2023-10-08T12:40:40.842418+0000","last_became_active":"2023-10-08T12:39:14.212128+0000","last_became_peered":"2023-10-08T12:39:14.212128+0000","last_unstale":"2023-10-08T12:40:40.842418+0000","last_undegraded":"2023-10-08T12:40:40.842418+0000","last_fullsized":"2023-10-08T12:40:40.842418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:40.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790321+0000","last_change":"2023-10-08T12:39:13.218291+0000","last_active":"2023-10-08T12:40:10.790321+0000","last_peered":"2023-10-08T12:40:10.790321+0000","last_clean":"2023-10-08T12:40:10.790321+0000","last_became_active":"2023-10-08T12:39:13.217907+0000","last_became_peered":"2023-10-08T12:39:13.217907+0000","last_unstale":"2023-10-08T12:40:10.790321+0000","last_undegraded":"2023-10-08T12:40:10.790321+0000","last_fullsized":"2023-10-08T12:40:10.790321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:54:46.891553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839228+0000","last_change":"2023-10-08T12:39:14.207991+0000","last_active":"2023-10-08T12:40:40.839228+0000","last_peered":"2023-10-08T12:40:40.839228+0000","last_clean":"2023-10-08T12:40:40.839228+0000","last_became_active":"2023-10-08T12:39:14.207683+0000","last_became_peered":"2023-10-08T12:39:14.207683+0000","last_unstale":"2023-10-08T12:40:40.839228+0000","last_undegraded":"2023-10-08T12:40:40.839228+0000","last_fullsized":"2023-10-08T12:40:40.839228+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:47.809553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786504+0000","last_change":"2023-10-08T12:39:13.214704+0000","last_active":"2023-10-08T12:40:10.786504+0000","last_peered":"2023-10-08T12:40:10.786504+0000","last_clean":"2023-10-08T12:40:10.786504+0000","last_became_active":"2023-10-08T12:39:13.214205+0000","last_became_peered":"2023-10-08T12:39:13.214205+0000","last_unstale":"2023-10-08T12:40:10.786504+0000","last_undegraded":"2023-10-08T12:40:10.786504+0000","last_fullsized":"2023-10-08T12:40:10.786504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:58.572620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.823756+0000","last_change":"2023-10-08T12:39:14.219813+0000","last_active":"2023-10-08T12:40:40.823756+0000","last_peered":"2023-10-08T12:40:40.823756+0000","last_clean":"2023-10-08T12:40:40.823756+0000","last_became_active":"2023-10-08T12:39:14.219511+0000","last_became_peered":"2023-10-08T12:39:14.219511+0000","last_unstale":"2023-10-08T12:40:40.823756+0000","last_undegraded":"2023-10-08T12:40:40.823756+0000","last_fullsized":"2023-10-08T12:40:40.823756+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:43.716871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786848+0000","last_change":"2023-10-08T12:39:13.212567+0000","last_active":"2023-10-08T12:40:10.786848+0000","last_peered":"2023-10-08T12:40:10.786848+0000","last_clean":"2023-10-08T12:40:10.786848+0000","last_became_active":"2023-10-08T12:39:13.212079+0000","last_became_peered":"2023-10-08T12:39:13.212079+0000","last_unstale":"2023-10-08T12:40:10.786848+0000","last_undegraded":"2023-10-08T12:40:10.786848+0000","last_fullsized":"2023-10-08T12:40:10.786848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:35.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.829438+0000","last_change":"2023-10-08T12:39:14.208760+0000","last_active":"2023-10-08T12:40:40.829438+0000","last_peered":"2023-10-08T12:40:40.829438+0000","last_clean":"2023-10-08T12:40:40.829438+0000","last_became_active":"2023-10-08T12:39:14.208490+0000","last_became_peered":"2023-10-08T12:39:14.208490+0000","last_unstale":"2023-10-08T12:40:40.829438+0000","last_undegraded":"2023-10-08T12:40:40.829438+0000","last_fullsized":"2023-10-08T12:40:40.829438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:19:56.423514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791638+0000","last_change":"2023-10-08T12:39:13.214197+0000","last_active":"2023-10-08T12:40:10.791638+0000","last_peered":"2023-10-08T12:40:10.791638+0000","last_clean":"2023-10-08T12:40:10.791638+0000","last_became_active":"2023-10-08T12:39:13.213829+0000","last_became_peered":"2023-10-08T12:39:13.213829+0000","last_unstale":"2023-10-08T12:40:10.791638+0000","last_undegraded":"2023-10-08T12:40:10.791638+0000","last_fullsized":"2023-10-08T12:40:10.791638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:29:05.080370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.826518+0000","last_change":"2023-10-08T12:39:14.212369+0000","last_active":"2023-10-08T12:40:40.826518+0000","last_peered":"2023-10-08T12:40:40.826518+0000","last_clean":"2023-10-08T12:40:40.826518+0000","last_became_active":"2023-10-08T12:39:14.211917+0000","last_became_peered":"2023-10-08T12:39:14.211917+0000","last_unstale":"2023-10-08T12:40:40.826518+0000","last_undegraded":"2023-10-08T12:40:40.826518+0000","last_fullsized":"2023-10-08T12:40:40.826518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:27.265251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786322+0000","last_change":"2023-10-08T12:39:13.217339+0000","last_active":"2023-10-08T12:40:10.786322+0000","last_peered":"2023-10-08T12:40:10.786322+0000","last_clean":"2023-10-08T12:40:10.786322+0000","last_became_active":"2023-10-08T12:39:13.216973+0000","last_became_peered":"2023-10-08T12:39:13.216973+0000","last_unstale":"2023-10-08T12:40:10.786322+0000","last_undegraded":"2023-10-08T12:40:10.786322+0000","last_fullsized":"2023-10-08T12:40:10.786322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:35.899844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.837738+0000","last_change":"2023-10-08T12:39:14.218870+0000","last_active":"2023-10-08T12:40:40.837738+0000","last_peered":"2023-10-08T12:40:40.837738+0000","last_clean":"2023-10-08T12:40:40.837738+0000","last_became_active":"2023-10-08T12:39:14.217879+0000","last_became_peered":"2023-10-08T12:39:14.217879+0000","last_unstale":"2023-10-08T12:40:40.837738+0000","last_undegraded":"2023-10-08T12:40:40.837738+0000","last_fullsized":"2023-10-08T12:40:40.837738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:06.769081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787188+0000","last_change":"2023-10-08T12:39:13.209120+0000","last_active":"2023-10-08T12:40:10.787188+0000","last_peered":"2023-10-08T12:40:10.787188+0000","last_clean":"2023-10-08T12:40:10.787188+0000","last_became_active":"2023-10-08T12:39:13.208755+0000","last_became_peered":"2023-10-08T12:39:13.208755+0000","last_unstale":"2023-10-08T12:40:10.787188+0000","last_undegraded":"2023-10-08T12:40:10.787188+0000","last_fullsized":"2023-10-08T12:40:10.787188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:48.977375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842992+0000","last_change":"2023-10-08T12:39:14.208187+0000","last_active":"2023-10-08T12:40:40.842992+0000","last_peered":"2023-10-08T12:40:40.842992+0000","last_clean":"2023-10-08T12:40:40.842992+0000","last_became_active":"2023-10-08T12:39:14.207868+0000","last_became_peered":"2023-10-08T12:39:14.207868+0000","last_unstale":"2023-10-08T12:40:40.842992+0000","last_undegraded":"2023-10-08T12:40:40.842992+0000","last_fullsized":"2023-10-08T12:40:40.842992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:50.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794276+0000","last_change":"2023-10-08T12:39:13.220447+0000","last_active":"2023-10-08T12:40:10.794276+0000","last_peered":"2023-10-08T12:40:10.794276+0000","last_clean":"2023-10-08T12:40:10.794276+0000","last_became_active":"2023-10-08T12:39:13.220032+0000","last_became_peered":"2023-10-08T12:39:13.220032+0000","last_unstale":"2023-10-08T12:40:10.794276+0000","last_undegraded":"2023-10-08T12:40:10.794276+0000","last_fullsized":"2023-10-08T12:40:10.794276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:22.223707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845944+0000","last_change":"2023-10-08T12:40:11.807692+0000","last_active":"2023-10-08T12:40:40.845944+0000","last_peered":"2023-10-08T12:40:40.845944+0000","last_clean":"2023-10-08T12:40:40.845944+0000","last_became_active":"2023-10-08T12:40:11.807311+0000","last_became_peered":"2023-10-08T12:40:11.807311+0000","last_unstale":"2023-10-08T12:40:40.845944+0000","last_undegraded":"2023-10-08T12:40:40.845944+0000","last_fullsized":"2023-10-08T12:40:40.845944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:42.114689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786798+0000","last_change":"2023-10-08T12:39:13.219131+0000","last_active":"2023-10-08T12:40:10.786798+0000","last_peered":"2023-10-08T12:40:10.786798+0000","last_clean":"2023-10-08T12:40:10.786798+0000","last_became_active":"2023-10-08T12:39:13.218639+0000","last_became_peered":"2023-10-08T12:39:13.218639+0000","last_unstale":"2023-10-08T12:40:10.786798+0000","last_undegraded":"2023-10-08T12:40:10.786798+0000","last_fullsized":"2023-10-08T12:40:10.786798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.316153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841798+0000","last_change":"2023-10-08T12:39:14.212352+0000","last_active":"2023-10-08T12:40:40.841798+0000","last_peered":"2023-10-08T12:40:40.841798+0000","last_clean":"2023-10-08T12:40:40.841798+0000","last_became_active":"2023-10-08T12:39:14.211342+0000","last_became_peered":"2023-10-08T12:39:14.211342+0000","last_unstale":"2023-10-08T12:40:40.841798+0000","last_undegraded":"2023-10-08T12:40:40.841798+0000","last_fullsized":"2023-10-08T12:40:40.841798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:39:00.731860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'28","reported_seq":278,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:41:10.419234+0000","last_change":"2023-10-08T12:39:13.209967+0000","last_active":"2023-10-08T12:41:10.419234+0000","last_peered":"2023-10-08T12:41:10.419234+0000","last_clean":"2023-10-08T12:41:10.419234+0000","last_became_active":"2023-10-08T12:39:13.209650+0000","last_became_peered":"2023-10-08T12:39:13.209650+0000","last_unstale":"2023-10-08T12:41:10.419234+0000","last_undegraded":"2023-10-08T12:41:10.419234+0000","last_fullsized":"2023-10-08T12:41:10.419234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:08.206168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59409,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":235,"num_read_kb":174,"num_write":28,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.818859+0000","last_change":"2023-10-08T12:39:14.211335+0000","last_active":"2023-10-08T12:40:40.818859+0000","last_peered":"2023-10-08T12:40:40.818859+0000","last_clean":"2023-10-08T12:40:40.818859+0000","last_became_active":"2023-10-08T12:39:14.211003+0000","last_became_peered":"2023-10-08T12:39:14.211003+0000","last_unstale":"2023-10-08T12:40:40.818859+0000","last_undegraded":"2023-10-08T12:40:40.818859+0000","last_fullsized":"2023-10-08T12:40:40.818859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:00.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793676+0000","last_change":"2023-10-08T12:39:13.215379+0000","last_active":"2023-10-08T12:40:10.793676+0000","last_peered":"2023-10-08T12:40:10.793676+0000","last_clean":"2023-10-08T12:40:10.793676+0000","last_became_active":"2023-10-08T12:39:13.215036+0000","last_became_peered":"2023-10-08T12:39:13.215036+0000","last_unstale":"2023-10-08T12:40:10.793676+0000","last_undegraded":"2023-10-08T12:40:10.793676+0000","last_fullsized":"2023-10-08T12:40:10.793676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:24.690473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834969+0000","last_change":"2023-10-08T12:39:14.207907+0000","last_active":"2023-10-08T12:40:40.834969+0000","last_peered":"2023-10-08T12:40:40.834969+0000","last_clean":"2023-10-08T12:40:40.834969+0000","last_became_active":"2023-10-08T12:39:14.207620+0000","last_became_peered":"2023-10-08T12:39:14.207620+0000","last_unstale":"2023-10-08T12:40:40.834969+0000","last_undegraded":"2023-10-08T12:40:40.834969+0000","last_fullsized":"2023-10-08T12:40:40.834969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:49:11.866245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786468+0000","last_change":"2023-10-08T12:39:13.214521+0000","last_active":"2023-10-08T12:40:10.786468+0000","last_peered":"2023-10-08T12:40:10.786468+0000","last_clean":"2023-10-08T12:40:10.786468+0000","last_became_active":"2023-10-08T12:39:13.214127+0000","last_became_peered":"2023-10-08T12:39:13.214127+0000","last_unstale":"2023-10-08T12:40:10.786468+0000","last_undegraded":"2023-10-08T12:40:10.786468+0000","last_fullsized":"2023-10-08T12:40:10.786468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:46.735663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841774+0000","last_change":"2023-10-08T12:40:11.796744+0000","last_active":"2023-10-08T12:40:40.841774+0000","last_peered":"2023-10-08T12:40:40.841774+0000","last_clean":"2023-10-08T12:40:40.841774+0000","last_became_active":"2023-10-08T12:40:11.796418+0000","last_became_peered":"2023-10-08T12:40:11.796418+0000","last_unstale":"2023-10-08T12:40:40.841774+0000","last_undegraded":"2023-10-08T12:40:40.841774+0000","last_fullsized":"2023-10-08T12:40:40.841774+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:22.693079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791530+0000","last_change":"2023-10-08T12:39:13.214758+0000","last_active":"2023-10-08T12:40:10.791530+0000","last_peered":"2023-10-08T12:40:10.791530+0000","last_clean":"2023-10-08T12:40:10.791530+0000","last_became_active":"2023-10-08T12:39:13.214304+0000","last_became_peered":"2023-10-08T12:39:13.214304+0000","last_unstale":"2023-10-08T12:40:10.791530+0000","last_undegraded":"2023-10-08T12:40:10.791530+0000","last_fullsized":"2023-10-08T12:40:10.791530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:34.074248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.835144+0000","last_change":"2023-10-08T12:39:14.208071+0000","last_active":"2023-10-08T12:40:40.835144+0000","last_peered":"2023-10-08T12:40:40.835144+0000","last_clean":"2023-10-08T12:40:40.835144+0000","last_became_active":"2023-10-08T12:39:14.207787+0000","last_became_peered":"2023-10-08T12:39:14.207787+0000","last_unstale":"2023-10-08T12:40:40.835144+0000","last_undegraded":"2023-10-08T12:40:40.835144+0000","last_fullsized":"2023-10-08T12:40:40.835144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:40.869575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789406+0000","last_change":"2023-10-08T12:39:13.219105+0000","last_active":"2023-10-08T12:40:10.789406+0000","last_peered":"2023-10-08T12:40:10.789406+0000","last_clean":"2023-10-08T12:40:10.789406+0000","last_became_active":"2023-10-08T12:39:13.218767+0000","last_became_peered":"2023-10-08T12:39:13.218767+0000","last_unstale":"2023-10-08T12:40:10.789406+0000","last_undegraded":"2023-10-08T12:40:10.789406+0000","last_fullsized":"2023-10-08T12:40:10.789406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:22.763921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834522+0000","last_change":"2023-10-08T12:39:14.210037+0000","last_active":"2023-10-08T12:40:40.834522+0000","last_peered":"2023-10-08T12:40:40.834522+0000","last_clean":"2023-10-08T12:40:40.834522+0000","last_became_active":"2023-10-08T12:39:14.208140+0000","last_became_peered":"2023-10-08T12:39:14.208140+0000","last_unstale":"2023-10-08T12:40:40.834522+0000","last_undegraded":"2023-10-08T12:40:40.834522+0000","last_fullsized":"2023-10-08T12:40:40.834522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:38.475668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790878+0000","last_change":"2023-10-08T12:39:13.219229+0000","last_active":"2023-10-08T12:40:10.790878+0000","last_peered":"2023-10-08T12:40:10.790878+0000","last_clean":"2023-10-08T12:40:10.790878+0000","last_became_active":"2023-10-08T12:39:13.217964+0000","last_became_peered":"2023-10-08T12:39:13.217964+0000","last_unstale":"2023-10-08T12:40:10.790878+0000","last_undegraded":"2023-10-08T12:40:10.790878+0000","last_fullsized":"2023-10-08T12:40:10.790878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:47.480351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834255+0000","last_change":"2023-10-08T12:40:11.808035+0000","last_active":"2023-10-08T12:40:40.834255+0000","last_peered":"2023-10-08T12:40:40.834255+0000","last_clean":"2023-10-08T12:40:40.834255+0000","last_became_active":"2023-10-08T12:40:11.807611+0000","last_became_peered":"2023-10-08T12:40:11.807611+0000","last_unstale":"2023-10-08T12:40:40.834255+0000","last_undegraded":"2023-10-08T12:40:40.834255+0000","last_fullsized":"2023-10-08T12:40:40.834255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:51.833325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786745+0000","last_change":"2023-10-08T12:39:13.212791+0000","last_active":"2023-10-08T12:40:10.786745+0000","last_peered":"2023-10-08T12:40:10.786745+0000","last_clean":"2023-10-08T12:40:10.786745+0000","last_became_active":"2023-10-08T12:39:13.212146+0000","last_became_peered":"2023-10-08T12:39:13.212146+0000","last_unstale":"2023-10-08T12:40:10.786745+0000","last_undegraded":"2023-10-08T12:40:10.786745+0000","last_fullsized":"2023-10-08T12:40:10.786745+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:37.452859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830275+0000","last_change":"2023-10-08T12:40:11.800095+0000","last_active":"2023-10-08T12:40:40.830275+0000","last_peered":"2023-10-08T12:40:40.830275+0000","last_clean":"2023-10-08T12:40:40.830275+0000","last_became_active":"2023-10-08T12:40:11.795780+0000","last_became_peered":"2023-10-08T12:40:11.795780+0000","last_unstale":"2023-10-08T12:40:40.830275+0000","last_undegraded":"2023-10-08T12:40:40.830275+0000","last_fullsized":"2023-10-08T12:40:40.830275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:15.163613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794197+0000","last_change":"2023-10-08T12:39:13.217672+0000","last_active":"2023-10-08T12:40:10.794197+0000","last_peered":"2023-10-08T12:40:10.794197+0000","last_clean":"2023-10-08T12:40:10.794197+0000","last_became_active":"2023-10-08T12:39:13.217277+0000","last_became_peered":"2023-10-08T12:39:13.217277+0000","last_unstale":"2023-10-08T12:40:10.794197+0000","last_undegraded":"2023-10-08T12:40:10.794197+0000","last_fullsized":"2023-10-08T12:40:10.794197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:41.097439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845967+0000","last_change":"2023-10-08T12:39:14.219261+0000","last_active":"2023-10-08T12:40:40.845967+0000","last_peered":"2023-10-08T12:40:40.845967+0000","last_clean":"2023-10-08T12:40:40.845967+0000","last_became_active":"2023-10-08T12:39:14.218963+0000","last_became_peered":"2023-10-08T12:39:14.218963+0000","last_unstale":"2023-10-08T12:40:40.845967+0000","last_undegraded":"2023-10-08T12:40:40.845967+0000","last_fullsized":"2023-10-08T12:40:40.845967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:19.573306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830576+0000","last_change":"2023-10-08T12:39:14.207923+0000","last_active":"2023-10-08T12:40:40.830576+0000","last_peered":"2023-10-08T12:40:40.830576+0000","last_clean":"2023-10-08T12:40:40.830576+0000","last_became_active":"2023-10-08T12:39:14.207634+0000","last_became_peered":"2023-10-08T12:39:14.207634+0000","last_unstale":"2023-10-08T12:40:40.830576+0000","last_undegraded":"2023-10-08T12:40:40.830576+0000","last_fullsized":"2023-10-08T12:40:40.830576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:39.634945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791515+0000","last_change":"2023-10-08T12:39:13.223021+0000","last_active":"2023-10-08T12:40:10.791515+0000","last_peered":"2023-10-08T12:40:10.791515+0000","last_clean":"2023-10-08T12:40:10.791515+0000","last_became_active":"2023-10-08T12:39:13.222680+0000","last_became_peered":"2023-10-08T12:39:13.222680+0000","last_unstale":"2023-10-08T12:40:10.791515+0000","last_undegraded":"2023-10-08T12:40:10.791515+0000","last_fullsized":"2023-10-08T12:40:10.791515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:40.454436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.836073+0000","last_change":"2023-10-08T12:39:14.217364+0000","last_active":"2023-10-08T12:40:40.836073+0000","last_peered":"2023-10-08T12:40:40.836073+0000","last_clean":"2023-10-08T12:40:40.836073+0000","last_became_active":"2023-10-08T12:39:14.216984+0000","last_became_peered":"2023-10-08T12:39:14.216984+0000","last_unstale":"2023-10-08T12:40:40.836073+0000","last_undegraded":"2023-10-08T12:40:40.836073+0000","last_fullsized":"2023-10-08T12:40:40.836073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:11:51.818034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792124+0000","last_change":"2023-10-08T12:39:13.207687+0000","last_active":"2023-10-08T12:40:10.792124+0000","last_peered":"2023-10-08T12:40:10.792124+0000","last_clean":"2023-10-08T12:40:10.792124+0000","last_became_active":"2023-10-08T12:39:13.207270+0000","last_became_peered":"2023-10-08T12:39:13.207270+0000","last_unstale":"2023-10-08T12:40:10.792124+0000","last_undegraded":"2023-10-08T12:40:10.792124+0000","last_fullsized":"2023-10-08T12:40:10.792124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:44.673383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":319,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.791524+0000","last_change":"2023-10-08T12:38:07.696721+0000","last_active":"2023-10-08T12:40:11.791524+0000","last_peered":"2023-10-08T12:40:11.791524+0000","last_clean":"2023-10-08T12:40:11.791524+0000","last_became_active":"2023-10-08T12:38:07.696336+0000","last_became_peered":"2023-10-08T12:38:07.696336+0000","last_unstale":"2023-10-08T12:40:11.791524+0000","last_undegraded":"2023-10-08T12:40:11.791524+0000","last_fullsized":"2023-10-08T12:40:11.791524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_clean_scrub_stamp":"2023-10-08T12:34:57.643348+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:01.821924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.838753+0000","last_change":"2023-10-08T12:39:14.208845+0000","last_active":"2023-10-08T12:40:40.838753+0000","last_peered":"2023-10-08T12:40:40.838753+0000","last_clean":"2023-10-08T12:40:40.838753+0000","last_became_active":"2023-10-08T12:39:14.208487+0000","last_became_peered":"2023-10-08T12:39:14.208487+0000","last_unstale":"2023-10-08T12:40:40.838753+0000","last_undegraded":"2023-10-08T12:40:40.838753+0000","last_fullsized":"2023-10-08T12:40:40.838753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:26.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793636+0000","last_change":"2023-10-08T12:39:13.216627+0000","last_active":"2023-10-08T12:40:10.793636+0000","last_peered":"2023-10-08T12:40:10.793636+0000","last_clean":"2023-10-08T12:40:10.793636+0000","last_became_active":"2023-10-08T12:39:13.216201+0000","last_became_peered":"2023-10-08T12:39:13.216201+0000","last_unstale":"2023-10-08T12:40:10.793636+0000","last_undegraded":"2023-10-08T12:40:10.793636+0000","last_fullsized":"2023-10-08T12:40:10.793636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:19.873615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790683+0000","last_change":"2023-10-08T12:39:13.219222+0000","last_active":"2023-10-08T12:40:10.790683+0000","last_peered":"2023-10-08T12:40:10.790683+0000","last_clean":"2023-10-08T12:40:10.790683+0000","last_became_active":"2023-10-08T12:39:13.218757+0000","last_became_peered":"2023-10-08T12:39:13.218757+0000","last_unstale":"2023-10-08T12:40:10.790683+0000","last_undegraded":"2023-10-08T12:40:10.790683+0000","last_fullsized":"2023-10-08T12:40:10.790683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:15.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839490+0000","last_change":"2023-10-08T12:39:14.221945+0000","last_active":"2023-10-08T12:40:40.839490+0000","last_peered":"2023-10-08T12:40:40.839490+0000","last_clean":"2023-10-08T12:40:40.839490+0000","last_became_active":"2023-10-08T12:39:14.221625+0000","last_became_peered":"2023-10-08T12:39:14.221625+0000","last_unstale":"2023-10-08T12:40:40.839490+0000","last_undegraded":"2023-10-08T12:40:40.839490+0000","last_fullsized":"2023-10-08T12:40:40.839490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:50.424023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:42.809929+0000","last_change":"2023-10-08T12:40:11.799358+0000","last_active":"2023-10-08T12:40:42.809929+0000","last_peered":"2023-10-08T12:40:42.809929+0000","last_clean":"2023-10-08T12:40:42.809929+0000","last_became_active":"2023-10-08T12:40:11.792992+0000","last_became_peered":"2023-10-08T12:40:11.792992+0000","last_unstale":"2023-10-08T12:40:42.809929+0000","last_undegraded":"2023-10-08T12:40:42.809929+0000","last_fullsized":"2023-10-08T12:40:42.809929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:26.689160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.837841+0000","last_change":"2023-10-08T12:39:14.214849+0000","last_active":"2023-10-08T12:40:40.837841+0000","last_peered":"2023-10-08T12:40:40.837841+0000","last_clean":"2023-10-08T12:40:40.837841+0000","last_became_active":"2023-10-08T12:39:14.214573+0000","last_became_peered":"2023-10-08T12:39:14.214573+0000","last_unstale":"2023-10-08T12:40:40.837841+0000","last_undegraded":"2023-10-08T12:40:40.837841+0000","last_fullsized":"2023-10-08T12:40:40.837841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:50.922519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791629+0000","last_change":"2023-10-08T12:39:13.206518+0000","last_active":"2023-10-08T12:40:10.791629+0000","last_peered":"2023-10-08T12:40:10.791629+0000","last_clean":"2023-10-08T12:40:10.791629+0000","last_became_active":"2023-10-08T12:39:13.206082+0000","last_became_peered":"2023-10-08T12:39:13.206082+0000","last_unstale":"2023-10-08T12:40:10.791629+0000","last_undegraded":"2023-10-08T12:40:10.791629+0000","last_fullsized":"2023-10-08T12:40:10.791629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:47.980651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843426+0000","last_change":"2023-10-08T12:39:14.220897+0000","last_active":"2023-10-08T12:40:40.843426+0000","last_peered":"2023-10-08T12:40:40.843426+0000","last_clean":"2023-10-08T12:40:40.843426+0000","last_became_active":"2023-10-08T12:39:14.220173+0000","last_became_peered":"2023-10-08T12:39:14.220173+0000","last_unstale":"2023-10-08T12:40:40.843426+0000","last_undegraded":"2023-10-08T12:40:40.843426+0000","last_fullsized":"2023-10-08T12:40:40.843426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:09:02.588054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.281984+0000","last_change":"2023-10-08T12:39:13.213505+0000","last_active":"2023-10-08T12:40:11.281984+0000","last_peered":"2023-10-08T12:40:11.281984+0000","last_clean":"2023-10-08T12:40:11.281984+0000","last_became_active":"2023-10-08T12:39:13.213199+0000","last_became_peered":"2023-10-08T12:39:13.213199+0000","last_unstale":"2023-10-08T12:40:11.281984+0000","last_undegraded":"2023-10-08T12:40:11.281984+0000","last_fullsized":"2023-10-08T12:40:11.281984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:49.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.799945+0000","last_change":"2023-10-08T12:39:14.208080+0000","last_active":"2023-10-08T12:40:40.799945+0000","last_peered":"2023-10-08T12:40:40.799945+0000","last_clean":"2023-10-08T12:40:40.799945+0000","last_became_active":"2023-10-08T12:39:14.207788+0000","last_became_peered":"2023-10-08T12:39:14.207788+0000","last_unstale":"2023-10-08T12:40:40.799945+0000","last_undegraded":"2023-10-08T12:40:40.799945+0000","last_fullsized":"2023-10-08T12:40:40.799945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:44.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791994+0000","last_change":"2023-10-08T12:39:13.216003+0000","last_active":"2023-10-08T12:40:10.791994+0000","last_peered":"2023-10-08T12:40:10.791994+0000","last_clean":"2023-10-08T12:40:10.791994+0000","last_became_active":"2023-10-08T12:39:13.215662+0000","last_became_peered":"2023-10-08T12:39:13.215662+0000","last_unstale":"2023-10-08T12:40:10.791994+0000","last_undegraded":"2023-10-08T12:40:10.791994+0000","last_fullsized":"2023-10-08T12:40:10.791994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:28.310430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843188+0000","last_change":"2023-10-08T12:39:14.204336+0000","last_active":"2023-10-08T12:40:40.843188+0000","last_peered":"2023-10-08T12:40:40.843188+0000","last_clean":"2023-10-08T12:40:40.843188+0000","last_became_active":"2023-10-08T12:39:14.203993+0000","last_became_peered":"2023-10-08T12:39:14.203993+0000","last_unstale":"2023-10-08T12:40:40.843188+0000","last_undegraded":"2023-10-08T12:40:40.843188+0000","last_fullsized":"2023-10-08T12:40:40.843188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:54.545166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.793371+0000","last_change":"2023-10-08T12:40:11.793371+0000","last_active":"2023-10-08T12:40:11.793371+0000","last_peered":"2023-10-08T12:40:11.793371+0000","last_clean":"2023-10-08T12:40:11.793371+0000","last_became_active":"2023-10-08T12:40:11.792968+0000","last_became_peered":"2023-10-08T12:40:11.792968+0000","last_unstale":"2023-10-08T12:40:11.793371+0000","last_undegraded":"2023-10-08T12:40:11.793371+0000","last_fullsized":"2023-10-08T12:40:11.793371+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:20.744535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842815+0000","last_change":"2023-10-08T12:39:14.221040+0000","last_active":"2023-10-08T12:40:40.842815+0000","last_peered":"2023-10-08T12:40:40.842815+0000","last_clean":"2023-10-08T12:40:40.842815+0000","last_became_active":"2023-10-08T12:39:14.220724+0000","last_became_peered":"2023-10-08T12:39:14.220724+0000","last_unstale":"2023-10-08T12:40:40.842815+0000","last_undegraded":"2023-10-08T12:40:40.842815+0000","last_fullsized":"2023-10-08T12:40:40.842815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:52.824228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790002+0000","last_change":"2023-10-08T12:39:13.212244+0000","last_active":"2023-10-08T12:40:10.790002+0000","last_peered":"2023-10-08T12:40:10.790002+0000","last_clean":"2023-10-08T12:40:10.790002+0000","last_became_active":"2023-10-08T12:39:13.212028+0000","last_became_peered":"2023-10-08T12:39:13.212028+0000","last_unstale":"2023-10-08T12:40:10.790002+0000","last_undegraded":"2023-10-08T12:40:10.790002+0000","last_fullsized":"2023-10-08T12:40:10.790002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:06.111807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.833089+0000","last_change":"2023-10-08T12:39:14.216665+0000","last_active":"2023-10-08T12:40:40.833089+0000","last_peered":"2023-10-08T12:40:40.833089+0000","last_clean":"2023-10-08T12:40:40.833089+0000","last_became_active":"2023-10-08T12:39:14.216330+0000","last_became_peered":"2023-10-08T12:39:14.216330+0000","last_unstale":"2023-10-08T12:40:40.833089+0000","last_undegraded":"2023-10-08T12:40:40.833089+0000","last_fullsized":"2023-10-08T12:40:40.833089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.658600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793792+0000","last_change":"2023-10-08T12:39:13.214495+0000","last_active":"2023-10-08T12:40:10.793792+0000","last_peered":"2023-10-08T12:40:10.793792+0000","last_clean":"2023-10-08T12:40:10.793792+0000","last_became_active":"2023-10-08T12:39:13.213930+0000","last_became_peered":"2023-10-08T12:39:13.213930+0000","last_unstale":"2023-10-08T12:40:10.793792+0000","last_undegraded":"2023-10-08T12:40:10.793792+0000","last_fullsized":"2023-10-08T12:40:10.793792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:20:38.096164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.833346+0000","last_change":"2023-10-08T12:39:14.212566+0000","last_active":"2023-10-08T12:40:40.833346+0000","last_peered":"2023-10-08T12:40:40.833346+0000","last_clean":"2023-10-08T12:40:40.833346+0000","last_became_active":"2023-10-08T12:39:14.211756+0000","last_became_peered":"2023-10-08T12:39:14.211756+0000","last_unstale":"2023-10-08T12:40:40.833346+0000","last_undegraded":"2023-10-08T12:40:40.833346+0000","last_fullsized":"2023-10-08T12:40:40.833346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:12.741640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786680+0000","last_change":"2023-10-08T12:39:13.217914+0000","last_active":"2023-10-08T12:40:10.786680+0000","last_peered":"2023-10-08T12:40:10.786680+0000","last_clean":"2023-10-08T12:40:10.786680+0000","last_became_active":"2023-10-08T12:39:13.217571+0000","last_became_peered":"2023-10-08T12:39:13.217571+0000","last_unstale":"2023-10-08T12:40:10.786680+0000","last_undegraded":"2023-10-08T12:40:10.786680+0000","last_fullsized":"2023-10-08T12:40:10.786680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:10.826007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834977+0000","last_change":"2023-10-08T12:39:14.214280+0000","last_active":"2023-10-08T12:40:40.834977+0000","last_peered":"2023-10-08T12:40:40.834977+0000","last_clean":"2023-10-08T12:40:40.834977+0000","last_became_active":"2023-10-08T12:39:14.213942+0000","last_became_peered":"2023-10-08T12:39:14.213942+0000","last_unstale":"2023-10-08T12:40:40.834977+0000","last_undegraded":"2023-10-08T12:40:40.834977+0000","last_fullsized":"2023-10-08T12:40:40.834977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:17:21.450265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791974+0000","last_change":"2023-10-08T12:39:13.222484+0000","last_active":"2023-10-08T12:40:10.791974+0000","last_peered":"2023-10-08T12:40:10.791974+0000","last_clean":"2023-10-08T12:40:10.791974+0000","last_became_active":"2023-10-08T12:39:13.222091+0000","last_became_peered":"2023-10-08T12:39:13.222091+0000","last_unstale":"2023-10-08T12:40:10.791974+0000","last_undegraded":"2023-10-08T12:40:10.791974+0000","last_fullsized":"2023-10-08T12:40:10.791974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:00.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.835374+0000","last_change":"2023-10-08T12:39:14.207715+0000","last_active":"2023-10-08T12:40:40.835374+0000","last_peered":"2023-10-08T12:40:40.835374+0000","last_clean":"2023-10-08T12:40:40.835374+0000","last_became_active":"2023-10-08T12:39:14.207429+0000","last_became_peered":"2023-10-08T12:39:14.207429+0000","last_unstale":"2023-10-08T12:40:40.835374+0000","last_undegraded":"2023-10-08T12:40:40.835374+0000","last_fullsized":"2023-10-08T12:40:40.835374+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:16.991831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831848+0000","last_change":"2023-10-08T12:39:14.200398+0000","last_active":"2023-10-08T12:40:40.831848+0000","last_peered":"2023-10-08T12:40:40.831848+0000","last_clean":"2023-10-08T12:40:40.831848+0000","last_became_active":"2023-10-08T12:39:14.200035+0000","last_became_peered":"2023-10-08T12:39:14.200035+0000","last_unstale":"2023-10-08T12:40:40.831848+0000","last_undegraded":"2023-10-08T12:40:40.831848+0000","last_fullsized":"2023-10-08T12:40:40.831848+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:13.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834439+0000","last_change":"2023-10-08T12:39:14.202185+0000","last_active":"2023-10-08T12:40:40.834439+0000","last_peered":"2023-10-08T12:40:40.834439+0000","last_clean":"2023-10-08T12:40:40.834439+0000","last_became_active":"2023-10-08T12:39:14.201232+0000","last_became_peered":"2023-10-08T12:39:14.201232+0000","last_unstale":"2023-10-08T12:40:40.834439+0000","last_undegraded":"2023-10-08T12:40:40.834439+0000","last_fullsized":"2023-10-08T12:40:40.834439+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:50.949047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845543+0000","last_change":"2023-10-08T12:39:14.208014+0000","last_active":"2023-10-08T12:40:40.845543+0000","last_peered":"2023-10-08T12:40:40.845543+0000","last_clean":"2023-10-08T12:40:40.845543+0000","last_became_active":"2023-10-08T12:39:14.207579+0000","last_became_peered":"2023-10-08T12:39:14.207579+0000","last_unstale":"2023-10-08T12:40:40.845543+0000","last_undegraded":"2023-10-08T12:40:40.845543+0000","last_fullsized":"2023-10-08T12:40:40.845543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:37.352827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842605+0000","last_change":"2023-10-08T12:40:11.796652+0000","last_active":"2023-10-08T12:40:40.842605+0000","last_peered":"2023-10-08T12:40:40.842605+0000","last_clean":"2023-10-08T12:40:40.842605+0000","last_became_active":"2023-10-08T12:40:11.796346+0000","last_became_peered":"2023-10-08T12:40:11.796346+0000","last_unstale":"2023-10-08T12:40:40.842605+0000","last_undegraded":"2023-10-08T12:40:40.842605+0000","last_fullsized":"2023-10-08T12:40:40.842605+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:25:31.781651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843767+0000","last_change":"2023-10-08T12:39:14.222630+0000","last_active":"2023-10-08T12:40:40.843767+0000","last_peered":"2023-10-08T12:40:40.843767+0000","last_clean":"2023-10-08T12:40:40.843767+0000","last_became_active":"2023-10-08T12:39:14.222300+0000","last_became_peered":"2023-10-08T12:39:14.222300+0000","last_unstale":"2023-10-08T12:40:40.843767+0000","last_undegraded":"2023-10-08T12:40:40.843767+0000","last_fullsized":"2023-10-08T12:40:40.843767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.040227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830931+0000","last_change":"2023-10-08T12:39:14.207144+0000","last_active":"2023-10-08T12:40:40.830931+0000","last_peered":"2023-10-08T12:40:40.830931+0000","last_clean":"2023-10-08T12:40:40.830931+0000","last_became_active":"2023-10-08T12:39:14.206775+0000","last_became_peered":"2023-10-08T12:39:14.206775+0000","last_unstale":"2023-10-08T12:40:40.830931+0000","last_undegraded":"2023-10-08T12:40:40.830931+0000","last_fullsized":"2023-10-08T12:40:40.830931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:55.224270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841229+0000","last_change":"2023-10-08T12:39:14.204123+0000","last_active":"2023-10-08T12:40:40.841229+0000","last_peered":"2023-10-08T12:40:40.841229+0000","last_clean":"2023-10-08T12:40:40.841229+0000","last_became_active":"2023-10-08T12:39:14.203123+0000","last_became_peered":"2023-10-08T12:39:14.203123+0000","last_unstale":"2023-10-08T12:40:40.841229+0000","last_undegraded":"2023-10-08T12:40:40.841229+0000","last_fullsized":"2023-10-08T12:40:40.841229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:45.423095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830346+0000","last_change":"2023-10-08T12:39:14.211049+0000","last_active":"2023-10-08T12:40:40.830346+0000","last_peered":"2023-10-08T12:40:40.830346+0000","last_clean":"2023-10-08T12:40:40.830346+0000","last_became_active":"2023-10-08T12:39:14.210738+0000","last_became_peered":"2023-10-08T12:39:14.210738+0000","last_unstale":"2023-10-08T12:40:40.830346+0000","last_undegraded":"2023-10-08T12:40:40.830346+0000","last_fullsized":"2023-10-08T12:40:40.830346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:12.535857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.827735+0000","last_change":"2023-10-08T12:39:14.220013+0000","last_active":"2023-10-08T12:40:40.827735+0000","last_peered":"2023-10-08T12:40:40.827735+0000","last_clean":"2023-10-08T12:40:40.827735+0000","last_became_active":"2023-10-08T12:39:14.219711+0000","last_became_peered":"2023-10-08T12:39:14.219711+0000","last_unstale":"2023-10-08T12:40:40.827735+0000","last_undegraded":"2023-10-08T12:40:40.827735+0000","last_fullsized":"2023-10-08T12:40:40.827735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:23.205074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831620+0000","last_change":"2023-10-08T12:39:14.214237+0000","last_active":"2023-10-08T12:40:40.831620+0000","last_peered":"2023-10-08T12:40:40.831620+0000","last_clean":"2023-10-08T12:40:40.831620+0000","last_became_active":"2023-10-08T12:39:14.213891+0000","last_became_peered":"2023-10-08T12:39:14.213891+0000","last_unstale":"2023-10-08T12:40:40.831620+0000","last_undegraded":"2023-10-08T12:40:40.831620+0000","last_fullsized":"2023-10-08T12:40:40.831620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:11.348411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842349+0000","last_change":"2023-10-08T12:39:14.209037+0000","last_active":"2023-10-08T12:40:40.842349+0000","last_peered":"2023-10-08T12:40:40.842349+0000","last_clean":"2023-10-08T12:40:40.842349+0000","last_became_active":"2023-10-08T12:39:14.208728+0000","last_became_peered":"2023-10-08T12:39:14.208728+0000","last_unstale":"2023-10-08T12:40:40.842349+0000","last_undegraded":"2023-10-08T12:40:40.842349+0000","last_fullsized":"2023-10-08T12:40:40.842349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:23.440413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844397+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:40.844397+0000","last_peered":"2023-10-08T12:40:40.844397+0000","last_clean":"2023-10-08T12:40:40.844397+0000","last_became_active":"2023-10-08T12:39:14.222393+0000","last_became_peered":"2023-10-08T12:39:14.222393+0000","last_unstale":"2023-10-08T12:40:40.844397+0000","last_undegraded":"2023-10-08T12:40:40.844397+0000","last_fullsized":"2023-10-08T12:40:40.844397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:19.704140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834058+0000","last_change":"2023-10-08T12:39:14.200858+0000","last_active":"2023-10-08T12:40:40.834058+0000","last_peered":"2023-10-08T12:40:40.834058+0000","last_clean":"2023-10-08T12:40:40.834058+0000","last_became_active":"2023-10-08T12:39:14.199948+0000","last_became_peered":"2023-10-08T12:39:14.199948+0000","last_unstale":"2023-10-08T12:40:40.834058+0000","last_undegraded":"2023-10-08T12:40:40.834058+0000","last_fullsized":"2023-10-08T12:40:40.834058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:10.366380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281436,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60207,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":241,"num_read_kb":180,"num_write":75,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":181253,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416421,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":462175,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.626},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.55200000000000005}]},{"osd":2,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71799999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":4,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.056,"5min":1.175,"15min":1.175},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.45900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.623}]},{"osd":5,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96599999999999997,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90300000000000002,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.80800000000000005,"15min":0.81599999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.028,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53600000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.71299999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.53200000000000003}]},{"osd":9,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85399999999999998,"15min":0.86799999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2430000000000001,"5min":1.639,"15min":1.639},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.61599999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.099,"5min":1.196,"15min":1.196},"last":0.88100000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0409999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94799999999999995,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.754}]}]},{"osd":10,"up_from":72,"seq":309237645352,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":1111938,"data_compressed":43212,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.57699999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45500000000000002,"15min":0.46800000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54000000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.314,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60299999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.5}]},{"osd":2,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61199999999999999,"15min":0.58999999999999997},"min":{"1min":0.55800000000000005,"5min":0.376,"15min":0.376},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63100000000000001,"15min":0.627},"min":{"1min":0.56599999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82999999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60899999999999999,"15min":0.628},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70999999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.63600000000000001,"15min":0.65100000000000002},"min":{"1min":0.40000000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.83299999999999996,"5min":1.01,"15min":1.01},"last":0.69199999999999995}]},{"osd":4,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82499999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.34399999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76700000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.80600000000000005},"min":{"1min":0.53200000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.89500000000000002,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70099999999999996,"15min":0.69799999999999995},"min":{"1min":0.495,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.872,"5min":1.569,"15min":1.569},"last":0.81399999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73199999999999998,"15min":0.76000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.503,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90700000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65900000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.83699999999999997,"15min":0.878},"min":{"1min":0.52900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98499999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78400000000000003,"15min":0.78600000000000003},"min":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98099999999999998,"5min":1.669,"15min":1.669},"last":0.77000000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":0.80800000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.01,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.80400000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.59899999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95199999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.60699999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":1.522,"15min":1.522},"last":0.88300000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":462880,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93899999999999995,"5min":3.101,"15min":3.101},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.56000000000000005,"15min":0.57799999999999996},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.90000000000000002,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.70199999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0960000000000001,"5min":2.944,"15min":2.944},"last":0.77000000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.749,"15min":0.76800000000000002},"min":{"1min":0.52600000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.99099999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.4990000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.81100000000000005,"15min":0.82499999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1339999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63500000000000001,"15min":0.66500000000000004},"min":{"1min":0.34499999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.875,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.46},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.752,"15min":0.76800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.056,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.88700000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58299999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.212,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.80100000000000005,"15min":0.82599999999999996},"min":{"1min":0.54000000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95599999999999996,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.85199999999999998,"15min":0.88900000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94899999999999995,"5min":1.325,"15min":1.325},"last":1.538}]},{"osd":6,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.88700000000000001,"15min":0.93000000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.169,"5min":3.0720000000000001,"15min":3.0720000000000001},"last":1.6559999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.81699999999999995,"15min":0.85699999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.86599999999999999,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.86599999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.88300000000000001,"15min":0.93100000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96799999999999997,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.573},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.95899999999999996,"15min":0.98899999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2090000000000001,"5min":2.98,"15min":2.98},"last":0.85399999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.97599999999999998,"15min":1.012},"min":{"1min":0.63400000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.23,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.92200000000000004,"15min":0.95799999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.004,"5min":2.496,"15min":2.496},"last":0.83099999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.64400000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.038,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.875,"15min":0.89500000000000002},"min":{"1min":0.57299999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96499999999999997,"5min":2.536,"15min":2.536},"last":0.75700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":8,"up_from":59,"seq":253403070513,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462448,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85599999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.46999999999999997}]},{"osd":1,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84699999999999998,"5min":1.026,"15min":1.026},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90700000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58199999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.47599999999999998,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.435},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80300000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86199999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67000000000000004}]},{"osd":4,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.995,"5min":1.044,"15min":1.044},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94199999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.59999999999999998,"15min":0.58799999999999997},"min":{"1min":0.45000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.89000000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72599999999999998,"15min":0.71899999999999997},"min":{"1min":0.54800000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77200000000000002,"15min":0.76500000000000001},"min":{"1min":0.64600000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.72999999999999998,"15min":0.70999999999999996},"min":{"1min":0.63100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59399999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.085,"5min":1.181,"15min":1.181},"last":0.78100000000000003}]},{"osd":9,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.78400000000000003,"15min":0.76100000000000001},"min":{"1min":0.65500000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.71399999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0209999999999999,"5min":1.45,"15min":1.45},"last":0.752}]},{"osd":10,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.79800000000000004,"15min":0.77300000000000002},"min":{"1min":0.63300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.048,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.78200000000000003,"15min":0.755},"min":{"1min":0.74299999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.80900000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.86099999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":1053248,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.877,"15min":0.877},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.434},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69299999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59699999999999998,"15min":0.58699999999999997},"min":{"1min":0.44700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.57799999999999996,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81299999999999994,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.504,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79000000000000004,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.49299999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86099999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.33600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76600000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.495,"5min":0.501,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.5}]},{"osd":5,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.51600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.64500000000000002},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.84499999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.68400000000000005},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94099999999999995,"5min":1.204,"15min":1.204},"last":0.88500000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.70999999999999996,"15min":0.69199999999999995},"min":{"1min":0.56299999999999994,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.56000000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70399999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.87}]},{"osd":10,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.59799999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93799999999999994,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.745},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65000000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.91900000000000004}]}]},{"osd":6,"up_from":47,"seq":201863462970,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462298,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.61399999999999999,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.0129999999999999,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.079,"5min":0.65000000000000002,"15min":0.58499999999999996},"min":{"1min":0.35199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":10.076000000000001,"5min":10.076000000000001,"15min":10.076000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":0.747,"15min":0.65900000000000003},"min":{"1min":0.53500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":7.3250000000000002,"5min":7.3250000000000002,"15min":7.3250000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.8049999999999999,"5min":0.89100000000000001,"15min":0.73399999999999999},"min":{"1min":0.44,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":20.783000000000001,"5min":20.783000000000001,"15min":20.783000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":0.82399999999999995,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.495},"max":{"1min":10.036,"5min":10.036,"15min":10.036},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.6699999999999999,"5min":0.93999999999999995,"15min":0.82999999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":15.960000000000001,"5min":15.960000000000001,"15min":15.960000000000001},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":0.78400000000000003,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":13.558,"5min":13.558,"15min":13.558},"last":0.437},{"interface":"front","average":{"1min":1.49,"5min":0.82699999999999996,"15min":0.72299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":14.855,"5min":14.855,"15min":14.855},"last":0.626}]},{"osd":4,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80400000000000005,"15min":0.73999999999999999},"min":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.2650000000000001,"5min":6.875,"15min":6.875},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.25,"5min":0.88500000000000001,"15min":0.81499999999999995},"min":{"1min":0.66500000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":7.3689999999999998,"5min":7.3689999999999998,"15min":7.3689999999999998},"last":0.56499999999999995}]},{"osd":5,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":0.94099999999999995,"15min":0.85099999999999998},"min":{"1min":0.624,"5min":0.5,"15min":0.5},"max":{"1min":13.835000000000001,"5min":13.835000000000001,"15min":13.835000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.85499999999999998,"15min":0.84099999999999997},"min":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.9060000000000001,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.78800000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":0.995,"15min":0.84699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":18.009,"5min":18.009,"15min":18.009},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.306,"5min":0.95899999999999996,"15min":0.86499999999999999},"min":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":10.234,"5min":10.234,"15min":10.234},"last":0.66100000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.94799999999999995,"15min":0.97099999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84099999999999997,"15min":0.85099999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.84999999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94699999999999995,"15min":0.96499999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.0030000000000001,"5min":4.0030000000000001,"15min":4.0030000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.109,"15min":1.032},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":14.185,"5min":14.185,"15min":14.185},"last":0.75900000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.98399999999999999,"15min":0.998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.452,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82799999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":521569,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.46500000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.2010000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.38100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3129999999999999,"5min":1.452,"15min":1.452},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.60299999999999998,"15min":0.53300000000000003},"min":{"1min":0.46899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.59299999999999997,"15min":0.53900000000000003},"min":{"1min":0.54800000000000004,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.61399999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.60699999999999998,"15min":0.55700000000000005},"min":{"1min":0.44800000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2789999999999999,"5min":1.413,"15min":1.413},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.64100000000000001,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.224,"5min":1.427,"15min":1.427},"last":0.57399999999999995}]},{"osd":4,"last update":"Sun Oct 8 12:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.40600000000000003},"min":{"1min":0.36499999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76000000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.40899999999999997},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.69499999999999995,"15min":0.60499999999999998},"min":{"1min":0.53900000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.66400000000000003,"15min":0.60199999999999998},"min":{"1min":0.61899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:40:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.47499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.24,"5min":1.355,"15min":1.355},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.70099999999999996,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2629999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sun Oct 8 12:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.59599999999999997,"15min":0.54800000000000004},"min":{"1min":0.41699999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0169999999999999,"5min":1.04,"15min":1.04},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.67400000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.66700000000000004,"15min":0.63700000000000001},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.69899999999999995,"15min":0.64900000000000002},"min":{"1min":0.59099999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.85699999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.754,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.755,"15min":0.72899999999999998},"min":{"1min":0.63400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.1870000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.77000000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.79300000000000004,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.0700000000000001,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.752,"15min":0.72799999999999998},"min":{"1min":0.59999999999999998,"5min":0.498,"15min":0.498},"max":{"1min":0.96099999999999997,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.66000000000000003}]},{"osd":11,"last update":"Sun Oct 8 12:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.81000000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462265,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.56599999999999995},"min":{"1min":0.437,"5min":0.314,"15min":0.314},"max":{"1min":0.83399999999999996,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66200000000000003,"15min":0.57899999999999996},"min":{"1min":0.46999999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94799999999999995,"5min":1.046,"15min":1.046},"last":0.75}]},{"osd":2,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65600000000000003,"15min":0.58899999999999997},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0089999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64100000000000001,"15min":0.58899999999999997},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.079,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.74299999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64600000000000002,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.623},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.619,"5min":1.911,"15min":1.911},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.497,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.76100000000000001,"15min":0.73399999999999999},"min":{"1min":0.433,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.45800000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.50600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.59299999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":2.1819999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.85599999999999998,"15min":0.89000000000000001},"min":{"1min":0.48999999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.504},{"interface":"front","average":{"1min":0.875,"5min":0.91300000000000003,"15min":0.93799999999999994},"min":{"1min":0.60199999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.68100000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.94299999999999995,"15min":0.96599999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.65000000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.94099999999999995,"15min":0.94699999999999995},"min":{"1min":0.68600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1679999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.66900000000000004}]}]},{"osd":2,"up_from":19,"seq":81604378702,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":521934,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.35699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72699999999999998,"5min":0.88500000000000001,"15min":1.0129999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.77900000000000003,"5min":0.89600000000000002,"15min":1.194},"last":0.55200000000000005}]},{"osd":1,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59599999999999997,"15min":0.53200000000000003},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.621,"15min":0.53800000000000003},"min":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.875,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.875}]},{"osd":3,"last update":"Sun Oct 8 12:40:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61699999999999999,"15min":0.59599999999999997},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0129999999999999,"5min":1.073,"15min":1.073},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79300000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.70799999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.44400000000000001,"15min":0.41599999999999998},"min":{"1min":0.36699999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66700000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.434},"min":{"1min":0.371,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.67600000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.64700000000000002,"15min":0.60599999999999998},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.64600000000000002,"15min":0.60699999999999998},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.04,"15min":1.04},"last":0.752}]},{"osd":7,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:40:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98799999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61399999999999999},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83799999999999997,"5min":1.006,"15min":1.006},"last":0.78700000000000003}]},{"osd":9,"last update":"Sun Oct 8 12:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53100000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":1.087,"15min":1.087},"last":0.86299999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.58899999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88100000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.60699999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.89500000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.94599999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":462071,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.88500000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.51200000000000001,"15min":0.47399999999999998},"min":{"1min":0.36599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77500000000000002,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Sun Oct 8 12:40:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.61499999999999999},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0429999999999999,"5min":1.081,"15min":1.081},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.60599999999999998},"min":{"1min":0.47199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.81100000000000005,"5min":1.05,"15min":1.05},"last":0.70799999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:40:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.66000000000000003},"min":{"1min":0.48599999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90200000000000002,"5min":1.077,"15min":1.077},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.51800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.91200000000000003,"5min":1.23,"15min":1.23},"last":0.58199999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.71399999999999997,"15min":0.64100000000000001},"min":{"1min":0.63600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92100000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.748,"15min":0.67600000000000005},"min":{"1min":0.65400000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95899999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89200000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.70699999999999996,"15min":0.69099999999999995},"min":{"1min":0.52700000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89400000000000002,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.749}]},{"osd":6,"last update":"Sun Oct 8 12:40:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0169999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.879},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72199999999999998,"15min":0.71299999999999997},"min":{"1min":0.50800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.90400000000000003,"5min":1.109,"15min":1.109},"last":0.91800000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.65600000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.012,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81299999999999994,"15min":0.80000000000000004},"min":{"1min":0.65300000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.998,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.66900000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.89400000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.91200000000000003,"15min":0.97999999999999998},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.01,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.89300000000000002,"15min":0.92600000000000005},"min":{"1min":0.626,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98699999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.63200000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.90800000000000003,"15min":0.94099999999999995},"min":{"1min":0.65100000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0669999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.92400000000000004,"15min":0.96599999999999997},"min":{"1min":0.69299999999999995,"5min":0.63,"15min":0.63},"max":{"1min":0.95599999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.93100000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.89500000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888133,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462197,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67100000000000004,"15min":0.71999999999999997},"min":{"1min":0.439,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":6.0549999999999997,"15min":6.0549999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41399999999999998,"15min":0.36799999999999999},"min":{"1min":0.309,"5min":0.223,"15min":0.223},"max":{"1min":0.58899999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.39100000000000001},"min":{"1min":0.35799999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.61599999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.61499999999999999,"15min":0.56899999999999995},"min":{"1min":0.46500000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61399999999999999,"15min":0.56499999999999995},"min":{"1min":0.51900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48399999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.54100000000000004},"min":{"1min":0.50800000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.875,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.54300000000000004},"min":{"1min":0.40200000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78000000000000003,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65600000000000003,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92100000000000004,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.65200000000000002,"15min":0.58399999999999996},"min":{"1min":0.58499999999999996,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54500000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64800000000000002,"15min":0.60899999999999999},"min":{"1min":0.57299999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85499999999999998,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.93000000000000005,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.61299999999999999,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.042,"5min":1.046,"15min":1.046},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.64600000000000002,"15min":0.57599999999999996},"min":{"1min":0.434,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98699999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.71999999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:40:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70399999999999996,"15min":0.67900000000000005},"min":{"1min":0.56399999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.73699999999999999,"15min":0.70899999999999996},"min":{"1min":0.67500000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":1.242,"15min":1.242},"last":0.75600000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.014,"5min":1.349,"15min":1.349},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.83299999999999996},"min":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.028,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.70399999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.61899999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0960000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.79800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0009999999999999,"5min":1.171,"15min":1.171},"last":0.83699999999999997}]},{"osd":11,"last update":"Sun Oct 8 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.86399999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724607,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":1052517,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.39600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.437}]},{"osd":1,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.498,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81999999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.47999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.498}]},{"osd":2,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.40500000000000003},"min":{"1min":0.318,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.372},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.40699999999999997},"min":{"1min":0.29499999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41099999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.59499999999999997,"15min":0.56100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.81000000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.60499999999999998,"15min":0.57499999999999996},"min":{"1min":0.54400000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83599999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64800000000000002}]},{"osd":6,"last update":"Sun Oct 8 12:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65800000000000003,"15min":0.61699999999999999},"min":{"1min":0.42899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89100000000000001,"5min":1.268,"15min":1.268},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.61299999999999999},"min":{"1min":0.56200000000000006,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89800000000000002,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.63100000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.48299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67500000000000004,"15min":0.64000000000000001},"min":{"1min":0.58999999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68500000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.59999999999999998,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.59499999999999997,"15min":0.57299999999999995},"min":{"1min":0.46800000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.70099999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81899999999999995,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94999999999999996,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.76900000000000002},"min":{"1min":0.626,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.976,"15min":1.976},"last":0.755}]},{"osd":10,"last update":"Sun Oct 8 12:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.752,"15min":0.73099999999999998},"min":{"1min":0.60099999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98099999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77300000000000002,"15min":0.75800000000000001},"min":{"1min":0.66200000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98199999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59725,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59759,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59603,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:41:16.837 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-08T12:41:16.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:41:17.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.072+0000 7f89285ff700 1 -- 172.21.15.59:0/533395154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f892010ce70 msgr2=0x7f892010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.072+0000 7f89285ff700 1 --2- 172.21.15.59:0/533395154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f892010ce70 0x7f892010f2e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f891800b0a0 tx=0x7f891800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.072+0000 7f89285ff700 1 -- 172.21.15.59:0/533395154 shutdown_connections 2023-10-08T12:41:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.072+0000 7f89285ff700 1 --2- 172.21.15.59:0/533395154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f892010ce70 0x7f892010f2e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.072+0000 7f89285ff700 1 --2- 172.21.15.59:0/533395154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8920072c20 0x7f8920073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.072+0000 7f89285ff700 1 --2- 172.21.15.59:0/533395154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8920073540 0x7f892010c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.072+0000 7f89285ff700 1 -- 172.21.15.59:0/533395154 >> 172.21.15.59:0/533395154 conn(0x7f89200fc140 msgr2=0x7f89200fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.073+0000 7f89285ff700 1 -- 172.21.15.59:0/533395154 shutdown_connections 2023-10-08T12:41:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.073+0000 7f89285ff700 1 -- 172.21.15.59:0/533395154 wait complete. 2023-10-08T12:41:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.074+0000 7f89285ff700 1 Processor -- start 2023-10-08T12:41:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.074+0000 7f89285ff700 1 -- start start 2023-10-08T12:41:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.074+0000 7f89285ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8920072c20 0x7f8920198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.074+0000 7f89285ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8920073540 0x7f8920199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.074+0000 7f89285ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f892010ce70 0x7f892019d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.074+0000 7f89285ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892019ddb0 con 0x7f892010ce70 2023-10-08T12:41:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.074+0000 7f89285ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892019df20 con 0x7f8920073540 2023-10-08T12:41:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.074+0000 7f89285ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892019e0e0 con 0x7f8920072c20 2023-10-08T12:41:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.074+0000 7f8925b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8920073540 0x7f8920199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.074+0000 7f8926b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f892010ce70 0x7f892019d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.075+0000 7f8925b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8920073540 0x7f8920199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:40860/0 (socket says 172.21.15.59:40860) 2023-10-08T12:41:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.075+0000 7f892639b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8920072c20 0x7f8920198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.075+0000 7f8925b9a700 1 -- 172.21.15.59:0/1324921952 learned_addr learned my addr 172.21.15.59:0/1324921952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.075+0000 7f8926b9c700 1 -- 172.21.15.59:0/1324921952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8920072c20 msgr2=0x7f8920198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.075+0000 7f8926b9c700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8920072c20 0x7f8920198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.075+0000 7f8926b9c700 1 -- 172.21.15.59:0/1324921952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8920073540 msgr2=0x7f8920199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.075+0000 7f8926b9c700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8920073540 0x7f8920199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.075+0000 7f8926b9c700 1 -- 172.21.15.59:0/1324921952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910009520 con 0x7f892010ce70 2023-10-08T12:41:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.075+0000 7f8926b9c700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f892010ce70 0x7f892019d770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f891800b070 tx=0x7f8918007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.075+0000 7f89177fe700 1 -- 172.21.15.59:0/1324921952 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891800e040 con 0x7f892010ce70 2023-10-08T12:41:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.076+0000 7f89285ff700 1 -- 172.21.15.59:0/1324921952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8918009d00 con 0x7f892010ce70 2023-10-08T12:41:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.075+0000 7f89177fe700 1 -- 172.21.15.59:0/1324921952 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f891801d470 con 0x7f892010ce70 2023-10-08T12:41:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.076+0000 7f89177fe700 1 -- 172.21.15.59:0/1324921952 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918005280 con 0x7f892010ce70 2023-10-08T12:41:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.076+0000 7f89285ff700 1 -- 172.21.15.59:0/1324921952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89201a5a20 con 0x7f892010ce70 2023-10-08T12:41:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.077+0000 7f89285ff700 1 -- 172.21.15.59:0/1324921952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8920108080 con 0x7f892010ce70 2023-10-08T12:41:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.079+0000 7f89177fe700 1 -- 172.21.15.59:0/1324921952 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f891801d5e0 con 0x7f892010ce70 2023-10-08T12:41:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.081+0000 7f89177fe700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f890c0a1550 0x7f890c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.081+0000 7f89177fe700 1 -- 172.21.15.59:0/1324921952 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f89180cdfe0 con 0x7f892010ce70 2023-10-08T12:41:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.081+0000 7f892639b700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f890c0a1550 0x7f890c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.082+0000 7f892639b700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f890c0a1550 0x7f890c0a3a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f891c009c60 tx=0x7f891c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.085+0000 7f89177fe700 1 -- 172.21.15.59:0/1324921952 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f89180975d0 con 0x7f892010ce70 2023-10-08T12:41:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.293+0000 7f89285ff700 1 -- 172.21.15.59:0/1324921952 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f892019a270 con 0x7f890c0a1550 2023-10-08T12:41:17.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.304+0000 7f89177fe700 1 -- 172.21.15.59:0/1324921952 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344615 (secure 0 0 0) 0x7f892019a270 con 0x7f890c0a1550 2023-10-08T12:41:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:17.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 -- 172.21.15.59:0/1324921952 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f890c0a1550 msgr2=0x7f890c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:17.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f890c0a1550 0x7f890c0a3a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f891c009c60 tx=0x7f891c009260 comp rx=0 tx=0).stop 2023-10-08T12:41:17.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 -- 172.21.15.59:0/1324921952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f892010ce70 msgr2=0x7f892019d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:17.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f892010ce70 0x7f892019d770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f891800b070 tx=0x7f8918007860 comp rx=0 tx=0).stop 2023-10-08T12:41:17.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 -- 172.21.15.59:0/1324921952 shutdown_connections 2023-10-08T12:41:17.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f890c0a1550 0x7f890c0a3a10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f892010ce70 0x7f892019d770 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8920072c20 0x7f8920198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 --2- 172.21.15.59:0/1324921952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8920073540 0x7f8920199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 -- 172.21.15.59:0/1324921952 >> 172.21.15.59:0/1324921952 conn(0x7f89200fc140 msgr2=0x7f89200fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:17.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 -- 172.21.15.59:0/1324921952 shutdown_connections 2023-10-08T12:41:17.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.309+0000 7f89285ff700 1 -- 172.21.15.59:0/1324921952 wait complete. 2023-10-08T12:41:17.313 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-08T12:41:17.329 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2023-10-08T12:41:16.812016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656516,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":389,"num_read_kb":311,"num_write":261,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180859,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":707,"ondisk_log_size":707,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335492,"kb_used_data":11300,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606332,"statfs":{"total":1151940427776,"available":1151596883968,"internally_reserved":0,"allocated":11571200,"data_stored":7503235,"data_compressed":181917,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5695,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":22,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002572"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844446+0000","last_change":"2023-10-08T12:39:14.206423+0000","last_active":"2023-10-08T12:40:40.844446+0000","last_peered":"2023-10-08T12:40:40.844446+0000","last_clean":"2023-10-08T12:40:40.844446+0000","last_became_active":"2023-10-08T12:39:14.205454+0000","last_became_peered":"2023-10-08T12:39:14.205454+0000","last_unstale":"2023-10-08T12:40:40.844446+0000","last_undegraded":"2023-10-08T12:40:40.844446+0000","last_fullsized":"2023-10-08T12:40:40.844446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:37.669007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844574+0000","last_change":"2023-10-08T12:39:14.215711+0000","last_active":"2023-10-08T12:40:40.844574+0000","last_peered":"2023-10-08T12:40:40.844574+0000","last_clean":"2023-10-08T12:40:40.844574+0000","last_became_active":"2023-10-08T12:39:14.215283+0000","last_became_peered":"2023-10-08T12:39:14.215283+0000","last_unstale":"2023-10-08T12:40:40.844574+0000","last_undegraded":"2023-10-08T12:40:40.844574+0000","last_fullsized":"2023-10-08T12:40:40.844574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:29.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845917+0000","last_change":"2023-10-08T12:39:14.209843+0000","last_active":"2023-10-08T12:40:40.845917+0000","last_peered":"2023-10-08T12:40:40.845917+0000","last_clean":"2023-10-08T12:40:40.845917+0000","last_became_active":"2023-10-08T12:39:14.209528+0000","last_became_peered":"2023-10-08T12:39:14.209528+0000","last_unstale":"2023-10-08T12:40:40.845917+0000","last_undegraded":"2023-10-08T12:40:40.845917+0000","last_fullsized":"2023-10-08T12:40:40.845917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:54.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.838144+0000","last_change":"2023-10-08T12:39:14.204891+0000","last_active":"2023-10-08T12:40:40.838144+0000","last_peered":"2023-10-08T12:40:40.838144+0000","last_clean":"2023-10-08T12:40:40.838144+0000","last_became_active":"2023-10-08T12:39:14.204075+0000","last_became_peered":"2023-10-08T12:39:14.204075+0000","last_unstale":"2023-10-08T12:40:40.838144+0000","last_undegraded":"2023-10-08T12:40:40.838144+0000","last_fullsized":"2023-10-08T12:40:40.838144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:18.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.820311+0000","last_change":"2023-10-08T12:39:14.212527+0000","last_active":"2023-10-08T12:40:40.820311+0000","last_peered":"2023-10-08T12:40:40.820311+0000","last_clean":"2023-10-08T12:40:40.820311+0000","last_became_active":"2023-10-08T12:39:14.212188+0000","last_became_peered":"2023-10-08T12:39:14.212188+0000","last_unstale":"2023-10-08T12:40:40.820311+0000","last_undegraded":"2023-10-08T12:40:40.820311+0000","last_fullsized":"2023-10-08T12:40:40.820311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:28.952210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.829543+0000","last_change":"2023-10-08T12:39:14.216842+0000","last_active":"2023-10-08T12:40:40.829543+0000","last_peered":"2023-10-08T12:40:40.829543+0000","last_clean":"2023-10-08T12:40:40.829543+0000","last_became_active":"2023-10-08T12:39:14.216446+0000","last_became_peered":"2023-10-08T12:39:14.216446+0000","last_unstale":"2023-10-08T12:40:40.829543+0000","last_undegraded":"2023-10-08T12:40:40.829543+0000","last_fullsized":"2023-10-08T12:40:40.829543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:40.718246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839089+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:40.839089+0000","last_peered":"2023-10-08T12:40:40.839089+0000","last_clean":"2023-10-08T12:40:40.839089+0000","last_became_active":"2023-10-08T12:39:14.222410+0000","last_became_peered":"2023-10-08T12:39:14.222410+0000","last_unstale":"2023-10-08T12:40:40.839089+0000","last_undegraded":"2023-10-08T12:40:40.839089+0000","last_fullsized":"2023-10-08T12:40:40.839089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:03.599610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831130+0000","last_change":"2023-10-08T12:39:14.209422+0000","last_active":"2023-10-08T12:40:40.831130+0000","last_peered":"2023-10-08T12:40:40.831130+0000","last_clean":"2023-10-08T12:40:40.831130+0000","last_became_active":"2023-10-08T12:39:14.209073+0000","last_became_peered":"2023-10-08T12:39:14.209073+0000","last_unstale":"2023-10-08T12:40:40.831130+0000","last_undegraded":"2023-10-08T12:40:40.831130+0000","last_fullsized":"2023-10-08T12:40:40.831130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:09.587414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839131+0000","last_change":"2023-10-08T12:39:14.211228+0000","last_active":"2023-10-08T12:40:40.839131+0000","last_peered":"2023-10-08T12:40:40.839131+0000","last_clean":"2023-10-08T12:40:40.839131+0000","last_became_active":"2023-10-08T12:39:14.210940+0000","last_became_peered":"2023-10-08T12:39:14.210940+0000","last_unstale":"2023-10-08T12:40:40.839131+0000","last_undegraded":"2023-10-08T12:40:40.839131+0000","last_fullsized":"2023-10-08T12:40:40.839131+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:52.683409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.825575+0000","last_change":"2023-10-08T12:39:14.207071+0000","last_active":"2023-10-08T12:40:40.825575+0000","last_peered":"2023-10-08T12:40:40.825575+0000","last_clean":"2023-10-08T12:40:40.825575+0000","last_became_active":"2023-10-08T12:39:14.206770+0000","last_became_peered":"2023-10-08T12:39:14.206770+0000","last_unstale":"2023-10-08T12:40:40.825575+0000","last_undegraded":"2023-10-08T12:40:40.825575+0000","last_fullsized":"2023-10-08T12:40:40.825575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:19.904049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.833356+0000","last_change":"2023-10-08T12:39:14.212780+0000","last_active":"2023-10-08T12:40:40.833356+0000","last_peered":"2023-10-08T12:40:40.833356+0000","last_clean":"2023-10-08T12:40:40.833356+0000","last_became_active":"2023-10-08T12:39:14.212167+0000","last_became_peered":"2023-10-08T12:39:14.212167+0000","last_unstale":"2023-10-08T12:40:40.833356+0000","last_undegraded":"2023-10-08T12:40:40.833356+0000","last_fullsized":"2023-10-08T12:40:40.833356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:17.332257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.838112+0000","last_change":"2023-10-08T12:39:14.204506+0000","last_active":"2023-10-08T12:40:40.838112+0000","last_peered":"2023-10-08T12:40:40.838112+0000","last_clean":"2023-10-08T12:40:40.838112+0000","last_became_active":"2023-10-08T12:39:14.204184+0000","last_became_peered":"2023-10-08T12:39:14.204184+0000","last_unstale":"2023-10-08T12:40:40.838112+0000","last_undegraded":"2023-10-08T12:40:40.838112+0000","last_fullsized":"2023-10-08T12:40:40.838112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:05.696554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839192+0000","last_change":"2023-10-08T12:39:14.211957+0000","last_active":"2023-10-08T12:40:40.839192+0000","last_peered":"2023-10-08T12:40:40.839192+0000","last_clean":"2023-10-08T12:40:40.839192+0000","last_became_active":"2023-10-08T12:39:14.211629+0000","last_became_peered":"2023-10-08T12:39:14.211629+0000","last_unstale":"2023-10-08T12:40:40.839192+0000","last_undegraded":"2023-10-08T12:40:40.839192+0000","last_fullsized":"2023-10-08T12:40:40.839192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:10.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844830+0000","last_change":"2023-10-08T12:39:14.207006+0000","last_active":"2023-10-08T12:40:40.844830+0000","last_peered":"2023-10-08T12:40:40.844830+0000","last_clean":"2023-10-08T12:40:40.844830+0000","last_became_active":"2023-10-08T12:39:14.206624+0000","last_became_peered":"2023-10-08T12:39:14.206624+0000","last_unstale":"2023-10-08T12:40:40.844830+0000","last_undegraded":"2023-10-08T12:40:40.844830+0000","last_fullsized":"2023-10-08T12:40:40.844830+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:11.232875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845182+0000","last_change":"2023-10-08T12:39:14.213865+0000","last_active":"2023-10-08T12:40:40.845182+0000","last_peered":"2023-10-08T12:40:40.845182+0000","last_clean":"2023-10-08T12:40:40.845182+0000","last_became_active":"2023-10-08T12:39:14.207972+0000","last_became_peered":"2023-10-08T12:39:14.207972+0000","last_unstale":"2023-10-08T12:40:40.845182+0000","last_undegraded":"2023-10-08T12:40:40.845182+0000","last_fullsized":"2023-10-08T12:40:40.845182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:01.434731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.846397+0000","last_change":"2023-10-08T12:39:14.206313+0000","last_active":"2023-10-08T12:40:40.846397+0000","last_peered":"2023-10-08T12:40:40.846397+0000","last_clean":"2023-10-08T12:40:40.846397+0000","last_became_active":"2023-10-08T12:39:14.206001+0000","last_became_peered":"2023-10-08T12:39:14.206001+0000","last_unstale":"2023-10-08T12:40:40.846397+0000","last_undegraded":"2023-10-08T12:40:40.846397+0000","last_fullsized":"2023-10-08T12:40:40.846397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:43.912356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844356+0000","last_change":"2023-10-08T12:39:14.205752+0000","last_active":"2023-10-08T12:40:40.844356+0000","last_peered":"2023-10-08T12:40:40.844356+0000","last_clean":"2023-10-08T12:40:40.844356+0000","last_became_active":"2023-10-08T12:39:14.204696+0000","last_became_peered":"2023-10-08T12:39:14.204696+0000","last_unstale":"2023-10-08T12:40:40.844356+0000","last_undegraded":"2023-10-08T12:40:40.844356+0000","last_fullsized":"2023-10-08T12:40:40.844356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:42.409107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841359+0000","last_change":"2023-10-08T12:39:14.203373+0000","last_active":"2023-10-08T12:40:40.841359+0000","last_peered":"2023-10-08T12:40:40.841359+0000","last_clean":"2023-10-08T12:40:40.841359+0000","last_became_active":"2023-10-08T12:39:14.202966+0000","last_became_peered":"2023-10-08T12:39:14.202966+0000","last_unstale":"2023-10-08T12:40:40.841359+0000","last_undegraded":"2023-10-08T12:40:40.841359+0000","last_fullsized":"2023-10-08T12:40:40.841359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:00.114475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.826269+0000","last_change":"2023-10-08T12:39:14.216154+0000","last_active":"2023-10-08T12:40:40.826269+0000","last_peered":"2023-10-08T12:40:40.826269+0000","last_clean":"2023-10-08T12:40:40.826269+0000","last_became_active":"2023-10-08T12:39:14.215868+0000","last_became_peered":"2023-10-08T12:39:14.215868+0000","last_unstale":"2023-10-08T12:40:40.826269+0000","last_undegraded":"2023-10-08T12:40:40.826269+0000","last_fullsized":"2023-10-08T12:40:40.826269+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:53.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786840+0000","last_change":"2023-10-08T12:39:13.214538+0000","last_active":"2023-10-08T12:40:10.786840+0000","last_peered":"2023-10-08T12:40:10.786840+0000","last_clean":"2023-10-08T12:40:10.786840+0000","last_became_active":"2023-10-08T12:39:13.214162+0000","last_became_peered":"2023-10-08T12:39:13.214162+0000","last_unstale":"2023-10-08T12:40:10.786840+0000","last_undegraded":"2023-10-08T12:40:10.786840+0000","last_fullsized":"2023-10-08T12:40:10.786840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:11.500815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831387+0000","last_change":"2023-10-08T12:39:14.211308+0000","last_active":"2023-10-08T12:40:40.831387+0000","last_peered":"2023-10-08T12:40:40.831387+0000","last_clean":"2023-10-08T12:40:40.831387+0000","last_became_active":"2023-10-08T12:39:14.210961+0000","last_became_peered":"2023-10-08T12:39:14.210961+0000","last_unstale":"2023-10-08T12:40:40.831387+0000","last_undegraded":"2023-10-08T12:40:40.831387+0000","last_fullsized":"2023-10-08T12:40:40.831387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.221981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.790623+0000","last_change":"2023-10-08T12:39:13.219982+0000","last_active":"2023-10-08T12:40:11.790623+0000","last_peered":"2023-10-08T12:40:11.790623+0000","last_clean":"2023-10-08T12:40:11.790623+0000","last_became_active":"2023-10-08T12:39:13.219668+0000","last_became_peered":"2023-10-08T12:39:13.219668+0000","last_unstale":"2023-10-08T12:40:11.790623+0000","last_undegraded":"2023-10-08T12:40:11.790623+0000","last_fullsized":"2023-10-08T12:40:11.790623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.664553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843418+0000","last_change":"2023-10-08T12:39:14.216922+0000","last_active":"2023-10-08T12:40:40.843418+0000","last_peered":"2023-10-08T12:40:40.843418+0000","last_clean":"2023-10-08T12:40:40.843418+0000","last_became_active":"2023-10-08T12:39:14.216634+0000","last_became_peered":"2023-10-08T12:39:14.216634+0000","last_unstale":"2023-10-08T12:40:40.843418+0000","last_undegraded":"2023-10-08T12:40:40.843418+0000","last_fullsized":"2023-10-08T12:40:40.843418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:21.254178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790823+0000","last_change":"2023-10-08T12:39:13.220262+0000","last_active":"2023-10-08T12:40:10.790823+0000","last_peered":"2023-10-08T12:40:10.790823+0000","last_clean":"2023-10-08T12:40:10.790823+0000","last_became_active":"2023-10-08T12:39:13.219917+0000","last_became_peered":"2023-10-08T12:39:13.219917+0000","last_unstale":"2023-10-08T12:40:10.790823+0000","last_undegraded":"2023-10-08T12:40:10.790823+0000","last_fullsized":"2023-10-08T12:40:10.790823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:34.368119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842418+0000","last_change":"2023-10-08T12:39:14.212620+0000","last_active":"2023-10-08T12:40:40.842418+0000","last_peered":"2023-10-08T12:40:40.842418+0000","last_clean":"2023-10-08T12:40:40.842418+0000","last_became_active":"2023-10-08T12:39:14.212128+0000","last_became_peered":"2023-10-08T12:39:14.212128+0000","last_unstale":"2023-10-08T12:40:40.842418+0000","last_undegraded":"2023-10-08T12:40:40.842418+0000","last_fullsized":"2023-10-08T12:40:40.842418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:40.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790321+0000","last_change":"2023-10-08T12:39:13.218291+0000","last_active":"2023-10-08T12:40:10.790321+0000","last_peered":"2023-10-08T12:40:10.790321+0000","last_clean":"2023-10-08T12:40:10.790321+0000","last_became_active":"2023-10-08T12:39:13.217907+0000","last_became_peered":"2023-10-08T12:39:13.217907+0000","last_unstale":"2023-10-08T12:40:10.790321+0000","last_undegraded":"2023-10-08T12:40:10.790321+0000","last_fullsized":"2023-10-08T12:40:10.790321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:54:46.891553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839228+0000","last_change":"2023-10-08T12:39:14.207991+0000","last_active":"2023-10-08T12:40:40.839228+0000","last_peered":"2023-10-08T12:40:40.839228+0000","last_clean":"2023-10-08T12:40:40.839228+0000","last_became_active":"2023-10-08T12:39:14.207683+0000","last_became_peered":"2023-10-08T12:39:14.207683+0000","last_unstale":"2023-10-08T12:40:40.839228+0000","last_undegraded":"2023-10-08T12:40:40.839228+0000","last_fullsized":"2023-10-08T12:40:40.839228+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:47.809553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786504+0000","last_change":"2023-10-08T12:39:13.214704+0000","last_active":"2023-10-08T12:40:10.786504+0000","last_peered":"2023-10-08T12:40:10.786504+0000","last_clean":"2023-10-08T12:40:10.786504+0000","last_became_active":"2023-10-08T12:39:13.214205+0000","last_became_peered":"2023-10-08T12:39:13.214205+0000","last_unstale":"2023-10-08T12:40:10.786504+0000","last_undegraded":"2023-10-08T12:40:10.786504+0000","last_fullsized":"2023-10-08T12:40:10.786504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:58.572620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.823756+0000","last_change":"2023-10-08T12:39:14.219813+0000","last_active":"2023-10-08T12:40:40.823756+0000","last_peered":"2023-10-08T12:40:40.823756+0000","last_clean":"2023-10-08T12:40:40.823756+0000","last_became_active":"2023-10-08T12:39:14.219511+0000","last_became_peered":"2023-10-08T12:39:14.219511+0000","last_unstale":"2023-10-08T12:40:40.823756+0000","last_undegraded":"2023-10-08T12:40:40.823756+0000","last_fullsized":"2023-10-08T12:40:40.823756+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:43.716871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786848+0000","last_change":"2023-10-08T12:39:13.212567+0000","last_active":"2023-10-08T12:40:10.786848+0000","last_peered":"2023-10-08T12:40:10.786848+0000","last_clean":"2023-10-08T12:40:10.786848+0000","last_became_active":"2023-10-08T12:39:13.212079+0000","last_became_peered":"2023-10-08T12:39:13.212079+0000","last_unstale":"2023-10-08T12:40:10.786848+0000","last_undegraded":"2023-10-08T12:40:10.786848+0000","last_fullsized":"2023-10-08T12:40:10.786848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:35.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.829438+0000","last_change":"2023-10-08T12:39:14.208760+0000","last_active":"2023-10-08T12:40:40.829438+0000","last_peered":"2023-10-08T12:40:40.829438+0000","last_clean":"2023-10-08T12:40:40.829438+0000","last_became_active":"2023-10-08T12:39:14.208490+0000","last_became_peered":"2023-10-08T12:39:14.208490+0000","last_unstale":"2023-10-08T12:40:40.829438+0000","last_undegraded":"2023-10-08T12:40:40.829438+0000","last_fullsized":"2023-10-08T12:40:40.829438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:19:56.423514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791638+0000","last_change":"2023-10-08T12:39:13.214197+0000","last_active":"2023-10-08T12:40:10.791638+0000","last_peered":"2023-10-08T12:40:10.791638+0000","last_clean":"2023-10-08T12:40:10.791638+0000","last_became_active":"2023-10-08T12:39:13.213829+0000","last_became_peered":"2023-10-08T12:39:13.213829+0000","last_unstale":"2023-10-08T12:40:10.791638+0000","last_undegraded":"2023-10-08T12:40:10.791638+0000","last_fullsized":"2023-10-08T12:40:10.791638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:29:05.080370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.826518+0000","last_change":"2023-10-08T12:39:14.212369+0000","last_active":"2023-10-08T12:40:40.826518+0000","last_peered":"2023-10-08T12:40:40.826518+0000","last_clean":"2023-10-08T12:40:40.826518+0000","last_became_active":"2023-10-08T12:39:14.211917+0000","last_became_peered":"2023-10-08T12:39:14.211917+0000","last_unstale":"2023-10-08T12:40:40.826518+0000","last_undegraded":"2023-10-08T12:40:40.826518+0000","last_fullsized":"2023-10-08T12:40:40.826518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:27.265251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786322+0000","last_change":"2023-10-08T12:39:13.217339+0000","last_active":"2023-10-08T12:40:10.786322+0000","last_peered":"2023-10-08T12:40:10.786322+0000","last_clean":"2023-10-08T12:40:10.786322+0000","last_became_active":"2023-10-08T12:39:13.216973+0000","last_became_peered":"2023-10-08T12:39:13.216973+0000","last_unstale":"2023-10-08T12:40:10.786322+0000","last_undegraded":"2023-10-08T12:40:10.786322+0000","last_fullsized":"2023-10-08T12:40:10.786322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:35.899844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.837738+0000","last_change":"2023-10-08T12:39:14.218870+0000","last_active":"2023-10-08T12:40:40.837738+0000","last_peered":"2023-10-08T12:40:40.837738+0000","last_clean":"2023-10-08T12:40:40.837738+0000","last_became_active":"2023-10-08T12:39:14.217879+0000","last_became_peered":"2023-10-08T12:39:14.217879+0000","last_unstale":"2023-10-08T12:40:40.837738+0000","last_undegraded":"2023-10-08T12:40:40.837738+0000","last_fullsized":"2023-10-08T12:40:40.837738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:06.769081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.787188+0000","last_change":"2023-10-08T12:39:13.209120+0000","last_active":"2023-10-08T12:40:10.787188+0000","last_peered":"2023-10-08T12:40:10.787188+0000","last_clean":"2023-10-08T12:40:10.787188+0000","last_became_active":"2023-10-08T12:39:13.208755+0000","last_became_peered":"2023-10-08T12:39:13.208755+0000","last_unstale":"2023-10-08T12:40:10.787188+0000","last_undegraded":"2023-10-08T12:40:10.787188+0000","last_fullsized":"2023-10-08T12:40:10.787188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:48.977375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842992+0000","last_change":"2023-10-08T12:39:14.208187+0000","last_active":"2023-10-08T12:40:40.842992+0000","last_peered":"2023-10-08T12:40:40.842992+0000","last_clean":"2023-10-08T12:40:40.842992+0000","last_became_active":"2023-10-08T12:39:14.207868+0000","last_became_peered":"2023-10-08T12:39:14.207868+0000","last_unstale":"2023-10-08T12:40:40.842992+0000","last_undegraded":"2023-10-08T12:40:40.842992+0000","last_fullsized":"2023-10-08T12:40:40.842992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:50.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794276+0000","last_change":"2023-10-08T12:39:13.220447+0000","last_active":"2023-10-08T12:40:10.794276+0000","last_peered":"2023-10-08T12:40:10.794276+0000","last_clean":"2023-10-08T12:40:10.794276+0000","last_became_active":"2023-10-08T12:39:13.220032+0000","last_became_peered":"2023-10-08T12:39:13.220032+0000","last_unstale":"2023-10-08T12:40:10.794276+0000","last_undegraded":"2023-10-08T12:40:10.794276+0000","last_fullsized":"2023-10-08T12:40:10.794276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:22.223707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845944+0000","last_change":"2023-10-08T12:40:11.807692+0000","last_active":"2023-10-08T12:40:40.845944+0000","last_peered":"2023-10-08T12:40:40.845944+0000","last_clean":"2023-10-08T12:40:40.845944+0000","last_became_active":"2023-10-08T12:40:11.807311+0000","last_became_peered":"2023-10-08T12:40:11.807311+0000","last_unstale":"2023-10-08T12:40:40.845944+0000","last_undegraded":"2023-10-08T12:40:40.845944+0000","last_fullsized":"2023-10-08T12:40:40.845944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:42.114689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786798+0000","last_change":"2023-10-08T12:39:13.219131+0000","last_active":"2023-10-08T12:40:10.786798+0000","last_peered":"2023-10-08T12:40:10.786798+0000","last_clean":"2023-10-08T12:40:10.786798+0000","last_became_active":"2023-10-08T12:39:13.218639+0000","last_became_peered":"2023-10-08T12:39:13.218639+0000","last_unstale":"2023-10-08T12:40:10.786798+0000","last_undegraded":"2023-10-08T12:40:10.786798+0000","last_fullsized":"2023-10-08T12:40:10.786798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.316153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841798+0000","last_change":"2023-10-08T12:39:14.212352+0000","last_active":"2023-10-08T12:40:40.841798+0000","last_peered":"2023-10-08T12:40:40.841798+0000","last_clean":"2023-10-08T12:40:40.841798+0000","last_became_active":"2023-10-08T12:39:14.211342+0000","last_became_peered":"2023-10-08T12:39:14.211342+0000","last_unstale":"2023-10-08T12:40:40.841798+0000","last_undegraded":"2023-10-08T12:40:40.841798+0000","last_fullsized":"2023-10-08T12:40:40.841798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:39:00.731860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":293,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:41:15.429102+0000","last_change":"2023-10-08T12:39:13.209967+0000","last_active":"2023-10-08T12:41:15.429102+0000","last_peered":"2023-10-08T12:41:15.429102+0000","last_clean":"2023-10-08T12:41:15.429102+0000","last_became_active":"2023-10-08T12:39:13.209650+0000","last_became_peered":"2023-10-08T12:39:13.209650+0000","last_unstale":"2023-10-08T12:41:15.429102+0000","last_undegraded":"2023-10-08T12:41:15.429102+0000","last_fullsized":"2023-10-08T12:41:15.429102+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:08.206168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65104,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":247,"num_read_kb":186,"num_write":31,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.818859+0000","last_change":"2023-10-08T12:39:14.211335+0000","last_active":"2023-10-08T12:40:40.818859+0000","last_peered":"2023-10-08T12:40:40.818859+0000","last_clean":"2023-10-08T12:40:40.818859+0000","last_became_active":"2023-10-08T12:39:14.211003+0000","last_became_peered":"2023-10-08T12:39:14.211003+0000","last_unstale":"2023-10-08T12:40:40.818859+0000","last_undegraded":"2023-10-08T12:40:40.818859+0000","last_fullsized":"2023-10-08T12:40:40.818859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:00.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793676+0000","last_change":"2023-10-08T12:39:13.215379+0000","last_active":"2023-10-08T12:40:10.793676+0000","last_peered":"2023-10-08T12:40:10.793676+0000","last_clean":"2023-10-08T12:40:10.793676+0000","last_became_active":"2023-10-08T12:39:13.215036+0000","last_became_peered":"2023-10-08T12:39:13.215036+0000","last_unstale":"2023-10-08T12:40:10.793676+0000","last_undegraded":"2023-10-08T12:40:10.793676+0000","last_fullsized":"2023-10-08T12:40:10.793676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:24.690473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834969+0000","last_change":"2023-10-08T12:39:14.207907+0000","last_active":"2023-10-08T12:40:40.834969+0000","last_peered":"2023-10-08T12:40:40.834969+0000","last_clean":"2023-10-08T12:40:40.834969+0000","last_became_active":"2023-10-08T12:39:14.207620+0000","last_became_peered":"2023-10-08T12:39:14.207620+0000","last_unstale":"2023-10-08T12:40:40.834969+0000","last_undegraded":"2023-10-08T12:40:40.834969+0000","last_fullsized":"2023-10-08T12:40:40.834969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:49:11.866245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786468+0000","last_change":"2023-10-08T12:39:13.214521+0000","last_active":"2023-10-08T12:40:10.786468+0000","last_peered":"2023-10-08T12:40:10.786468+0000","last_clean":"2023-10-08T12:40:10.786468+0000","last_became_active":"2023-10-08T12:39:13.214127+0000","last_became_peered":"2023-10-08T12:39:13.214127+0000","last_unstale":"2023-10-08T12:40:10.786468+0000","last_undegraded":"2023-10-08T12:40:10.786468+0000","last_fullsized":"2023-10-08T12:40:10.786468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:46.735663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841774+0000","last_change":"2023-10-08T12:40:11.796744+0000","last_active":"2023-10-08T12:40:40.841774+0000","last_peered":"2023-10-08T12:40:40.841774+0000","last_clean":"2023-10-08T12:40:40.841774+0000","last_became_active":"2023-10-08T12:40:11.796418+0000","last_became_peered":"2023-10-08T12:40:11.796418+0000","last_unstale":"2023-10-08T12:40:40.841774+0000","last_undegraded":"2023-10-08T12:40:40.841774+0000","last_fullsized":"2023-10-08T12:40:40.841774+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:22.693079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791530+0000","last_change":"2023-10-08T12:39:13.214758+0000","last_active":"2023-10-08T12:40:10.791530+0000","last_peered":"2023-10-08T12:40:10.791530+0000","last_clean":"2023-10-08T12:40:10.791530+0000","last_became_active":"2023-10-08T12:39:13.214304+0000","last_became_peered":"2023-10-08T12:39:13.214304+0000","last_unstale":"2023-10-08T12:40:10.791530+0000","last_undegraded":"2023-10-08T12:40:10.791530+0000","last_fullsized":"2023-10-08T12:40:10.791530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:34.074248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.835144+0000","last_change":"2023-10-08T12:39:14.208071+0000","last_active":"2023-10-08T12:40:40.835144+0000","last_peered":"2023-10-08T12:40:40.835144+0000","last_clean":"2023-10-08T12:40:40.835144+0000","last_became_active":"2023-10-08T12:39:14.207787+0000","last_became_peered":"2023-10-08T12:39:14.207787+0000","last_unstale":"2023-10-08T12:40:40.835144+0000","last_undegraded":"2023-10-08T12:40:40.835144+0000","last_fullsized":"2023-10-08T12:40:40.835144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:40.869575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.789406+0000","last_change":"2023-10-08T12:39:13.219105+0000","last_active":"2023-10-08T12:40:10.789406+0000","last_peered":"2023-10-08T12:40:10.789406+0000","last_clean":"2023-10-08T12:40:10.789406+0000","last_became_active":"2023-10-08T12:39:13.218767+0000","last_became_peered":"2023-10-08T12:39:13.218767+0000","last_unstale":"2023-10-08T12:40:10.789406+0000","last_undegraded":"2023-10-08T12:40:10.789406+0000","last_fullsized":"2023-10-08T12:40:10.789406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:22.763921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834522+0000","last_change":"2023-10-08T12:39:14.210037+0000","last_active":"2023-10-08T12:40:40.834522+0000","last_peered":"2023-10-08T12:40:40.834522+0000","last_clean":"2023-10-08T12:40:40.834522+0000","last_became_active":"2023-10-08T12:39:14.208140+0000","last_became_peered":"2023-10-08T12:39:14.208140+0000","last_unstale":"2023-10-08T12:40:40.834522+0000","last_undegraded":"2023-10-08T12:40:40.834522+0000","last_fullsized":"2023-10-08T12:40:40.834522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:38.475668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790878+0000","last_change":"2023-10-08T12:39:13.219229+0000","last_active":"2023-10-08T12:40:10.790878+0000","last_peered":"2023-10-08T12:40:10.790878+0000","last_clean":"2023-10-08T12:40:10.790878+0000","last_became_active":"2023-10-08T12:39:13.217964+0000","last_became_peered":"2023-10-08T12:39:13.217964+0000","last_unstale":"2023-10-08T12:40:10.790878+0000","last_undegraded":"2023-10-08T12:40:10.790878+0000","last_fullsized":"2023-10-08T12:40:10.790878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:47.480351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834255+0000","last_change":"2023-10-08T12:40:11.808035+0000","last_active":"2023-10-08T12:40:40.834255+0000","last_peered":"2023-10-08T12:40:40.834255+0000","last_clean":"2023-10-08T12:40:40.834255+0000","last_became_active":"2023-10-08T12:40:11.807611+0000","last_became_peered":"2023-10-08T12:40:11.807611+0000","last_unstale":"2023-10-08T12:40:40.834255+0000","last_undegraded":"2023-10-08T12:40:40.834255+0000","last_fullsized":"2023-10-08T12:40:40.834255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:51.833325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786745+0000","last_change":"2023-10-08T12:39:13.212791+0000","last_active":"2023-10-08T12:40:10.786745+0000","last_peered":"2023-10-08T12:40:10.786745+0000","last_clean":"2023-10-08T12:40:10.786745+0000","last_became_active":"2023-10-08T12:39:13.212146+0000","last_became_peered":"2023-10-08T12:39:13.212146+0000","last_unstale":"2023-10-08T12:40:10.786745+0000","last_undegraded":"2023-10-08T12:40:10.786745+0000","last_fullsized":"2023-10-08T12:40:10.786745+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:37.452859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830275+0000","last_change":"2023-10-08T12:40:11.800095+0000","last_active":"2023-10-08T12:40:40.830275+0000","last_peered":"2023-10-08T12:40:40.830275+0000","last_clean":"2023-10-08T12:40:40.830275+0000","last_became_active":"2023-10-08T12:40:11.795780+0000","last_became_peered":"2023-10-08T12:40:11.795780+0000","last_unstale":"2023-10-08T12:40:40.830275+0000","last_undegraded":"2023-10-08T12:40:40.830275+0000","last_fullsized":"2023-10-08T12:40:40.830275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:15.163613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.794197+0000","last_change":"2023-10-08T12:39:13.217672+0000","last_active":"2023-10-08T12:40:10.794197+0000","last_peered":"2023-10-08T12:40:10.794197+0000","last_clean":"2023-10-08T12:40:10.794197+0000","last_became_active":"2023-10-08T12:39:13.217277+0000","last_became_peered":"2023-10-08T12:39:13.217277+0000","last_unstale":"2023-10-08T12:40:10.794197+0000","last_undegraded":"2023-10-08T12:40:10.794197+0000","last_fullsized":"2023-10-08T12:40:10.794197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:41.097439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845967+0000","last_change":"2023-10-08T12:39:14.219261+0000","last_active":"2023-10-08T12:40:40.845967+0000","last_peered":"2023-10-08T12:40:40.845967+0000","last_clean":"2023-10-08T12:40:40.845967+0000","last_became_active":"2023-10-08T12:39:14.218963+0000","last_became_peered":"2023-10-08T12:39:14.218963+0000","last_unstale":"2023-10-08T12:40:40.845967+0000","last_undegraded":"2023-10-08T12:40:40.845967+0000","last_fullsized":"2023-10-08T12:40:40.845967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:19.573306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830576+0000","last_change":"2023-10-08T12:39:14.207923+0000","last_active":"2023-10-08T12:40:40.830576+0000","last_peered":"2023-10-08T12:40:40.830576+0000","last_clean":"2023-10-08T12:40:40.830576+0000","last_became_active":"2023-10-08T12:39:14.207634+0000","last_became_peered":"2023-10-08T12:39:14.207634+0000","last_unstale":"2023-10-08T12:40:40.830576+0000","last_undegraded":"2023-10-08T12:40:40.830576+0000","last_fullsized":"2023-10-08T12:40:40.830576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:39.634945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791515+0000","last_change":"2023-10-08T12:39:13.223021+0000","last_active":"2023-10-08T12:40:10.791515+0000","last_peered":"2023-10-08T12:40:10.791515+0000","last_clean":"2023-10-08T12:40:10.791515+0000","last_became_active":"2023-10-08T12:39:13.222680+0000","last_became_peered":"2023-10-08T12:39:13.222680+0000","last_unstale":"2023-10-08T12:40:10.791515+0000","last_undegraded":"2023-10-08T12:40:10.791515+0000","last_fullsized":"2023-10-08T12:40:10.791515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:40.454436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.836073+0000","last_change":"2023-10-08T12:39:14.217364+0000","last_active":"2023-10-08T12:40:40.836073+0000","last_peered":"2023-10-08T12:40:40.836073+0000","last_clean":"2023-10-08T12:40:40.836073+0000","last_became_active":"2023-10-08T12:39:14.216984+0000","last_became_peered":"2023-10-08T12:39:14.216984+0000","last_unstale":"2023-10-08T12:40:40.836073+0000","last_undegraded":"2023-10-08T12:40:40.836073+0000","last_fullsized":"2023-10-08T12:40:40.836073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:11:51.818034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.792124+0000","last_change":"2023-10-08T12:39:13.207687+0000","last_active":"2023-10-08T12:40:10.792124+0000","last_peered":"2023-10-08T12:40:10.792124+0000","last_clean":"2023-10-08T12:40:10.792124+0000","last_became_active":"2023-10-08T12:39:13.207270+0000","last_became_peered":"2023-10-08T12:39:13.207270+0000","last_unstale":"2023-10-08T12:40:10.792124+0000","last_undegraded":"2023-10-08T12:40:10.792124+0000","last_fullsized":"2023-10-08T12:40:10.792124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:44.673383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":319,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.791524+0000","last_change":"2023-10-08T12:38:07.696721+0000","last_active":"2023-10-08T12:40:11.791524+0000","last_peered":"2023-10-08T12:40:11.791524+0000","last_clean":"2023-10-08T12:40:11.791524+0000","last_became_active":"2023-10-08T12:38:07.696336+0000","last_became_peered":"2023-10-08T12:38:07.696336+0000","last_unstale":"2023-10-08T12:40:11.791524+0000","last_undegraded":"2023-10-08T12:40:11.791524+0000","last_fullsized":"2023-10-08T12:40:11.791524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:34:57.643348+0000","last_clean_scrub_stamp":"2023-10-08T12:34:57.643348+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:01.821924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.838753+0000","last_change":"2023-10-08T12:39:14.208845+0000","last_active":"2023-10-08T12:40:40.838753+0000","last_peered":"2023-10-08T12:40:40.838753+0000","last_clean":"2023-10-08T12:40:40.838753+0000","last_became_active":"2023-10-08T12:39:14.208487+0000","last_became_peered":"2023-10-08T12:39:14.208487+0000","last_unstale":"2023-10-08T12:40:40.838753+0000","last_undegraded":"2023-10-08T12:40:40.838753+0000","last_fullsized":"2023-10-08T12:40:40.838753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:26.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.791434+0000","last_change":"2023-10-08T12:39:13.216627+0000","last_active":"2023-10-08T12:40:11.791434+0000","last_peered":"2023-10-08T12:40:11.791434+0000","last_clean":"2023-10-08T12:40:11.791434+0000","last_became_active":"2023-10-08T12:39:13.216201+0000","last_became_peered":"2023-10-08T12:39:13.216201+0000","last_unstale":"2023-10-08T12:40:11.791434+0000","last_undegraded":"2023-10-08T12:40:11.791434+0000","last_fullsized":"2023-10-08T12:40:11.791434+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:19.873615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790683+0000","last_change":"2023-10-08T12:39:13.219222+0000","last_active":"2023-10-08T12:40:10.790683+0000","last_peered":"2023-10-08T12:40:10.790683+0000","last_clean":"2023-10-08T12:40:10.790683+0000","last_became_active":"2023-10-08T12:39:13.218757+0000","last_became_peered":"2023-10-08T12:39:13.218757+0000","last_unstale":"2023-10-08T12:40:10.790683+0000","last_undegraded":"2023-10-08T12:40:10.790683+0000","last_fullsized":"2023-10-08T12:40:10.790683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:15.157096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.839490+0000","last_change":"2023-10-08T12:39:14.221945+0000","last_active":"2023-10-08T12:40:40.839490+0000","last_peered":"2023-10-08T12:40:40.839490+0000","last_clean":"2023-10-08T12:40:40.839490+0000","last_became_active":"2023-10-08T12:39:14.221625+0000","last_became_peered":"2023-10-08T12:39:14.221625+0000","last_unstale":"2023-10-08T12:40:40.839490+0000","last_undegraded":"2023-10-08T12:40:40.839490+0000","last_fullsized":"2023-10-08T12:40:40.839490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:32:50.424023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:42.809929+0000","last_change":"2023-10-08T12:40:11.799358+0000","last_active":"2023-10-08T12:40:42.809929+0000","last_peered":"2023-10-08T12:40:42.809929+0000","last_clean":"2023-10-08T12:40:42.809929+0000","last_became_active":"2023-10-08T12:40:11.792992+0000","last_became_peered":"2023-10-08T12:40:11.792992+0000","last_unstale":"2023-10-08T12:40:42.809929+0000","last_undegraded":"2023-10-08T12:40:42.809929+0000","last_fullsized":"2023-10-08T12:40:42.809929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:26.689160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.837841+0000","last_change":"2023-10-08T12:39:14.214849+0000","last_active":"2023-10-08T12:40:40.837841+0000","last_peered":"2023-10-08T12:40:40.837841+0000","last_clean":"2023-10-08T12:40:40.837841+0000","last_became_active":"2023-10-08T12:39:14.214573+0000","last_became_peered":"2023-10-08T12:39:14.214573+0000","last_unstale":"2023-10-08T12:40:40.837841+0000","last_undegraded":"2023-10-08T12:40:40.837841+0000","last_fullsized":"2023-10-08T12:40:40.837841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:50.922519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791629+0000","last_change":"2023-10-08T12:39:13.206518+0000","last_active":"2023-10-08T12:40:10.791629+0000","last_peered":"2023-10-08T12:40:10.791629+0000","last_clean":"2023-10-08T12:40:10.791629+0000","last_became_active":"2023-10-08T12:39:13.206082+0000","last_became_peered":"2023-10-08T12:39:13.206082+0000","last_unstale":"2023-10-08T12:40:10.791629+0000","last_undegraded":"2023-10-08T12:40:10.791629+0000","last_fullsized":"2023-10-08T12:40:10.791629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:47.980651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843426+0000","last_change":"2023-10-08T12:39:14.220897+0000","last_active":"2023-10-08T12:40:40.843426+0000","last_peered":"2023-10-08T12:40:40.843426+0000","last_clean":"2023-10-08T12:40:40.843426+0000","last_became_active":"2023-10-08T12:39:14.220173+0000","last_became_peered":"2023-10-08T12:39:14.220173+0000","last_unstale":"2023-10-08T12:40:40.843426+0000","last_undegraded":"2023-10-08T12:40:40.843426+0000","last_fullsized":"2023-10-08T12:40:40.843426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:09:02.588054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.281984+0000","last_change":"2023-10-08T12:39:13.213505+0000","last_active":"2023-10-08T12:40:11.281984+0000","last_peered":"2023-10-08T12:40:11.281984+0000","last_clean":"2023-10-08T12:40:11.281984+0000","last_became_active":"2023-10-08T12:39:13.213199+0000","last_became_peered":"2023-10-08T12:39:13.213199+0000","last_unstale":"2023-10-08T12:40:11.281984+0000","last_undegraded":"2023-10-08T12:40:11.281984+0000","last_fullsized":"2023-10-08T12:40:11.281984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:49.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.799945+0000","last_change":"2023-10-08T12:39:14.208080+0000","last_active":"2023-10-08T12:40:40.799945+0000","last_peered":"2023-10-08T12:40:40.799945+0000","last_clean":"2023-10-08T12:40:40.799945+0000","last_became_active":"2023-10-08T12:39:14.207788+0000","last_became_peered":"2023-10-08T12:39:14.207788+0000","last_unstale":"2023-10-08T12:40:40.799945+0000","last_undegraded":"2023-10-08T12:40:40.799945+0000","last_fullsized":"2023-10-08T12:40:40.799945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:44.325862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791994+0000","last_change":"2023-10-08T12:39:13.216003+0000","last_active":"2023-10-08T12:40:10.791994+0000","last_peered":"2023-10-08T12:40:10.791994+0000","last_clean":"2023-10-08T12:40:10.791994+0000","last_became_active":"2023-10-08T12:39:13.215662+0000","last_became_peered":"2023-10-08T12:39:13.215662+0000","last_unstale":"2023-10-08T12:40:10.791994+0000","last_undegraded":"2023-10-08T12:40:10.791994+0000","last_fullsized":"2023-10-08T12:40:10.791994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:28.310430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843188+0000","last_change":"2023-10-08T12:39:14.204336+0000","last_active":"2023-10-08T12:40:40.843188+0000","last_peered":"2023-10-08T12:40:40.843188+0000","last_clean":"2023-10-08T12:40:40.843188+0000","last_became_active":"2023-10-08T12:39:14.203993+0000","last_became_peered":"2023-10-08T12:39:14.203993+0000","last_unstale":"2023-10-08T12:40:40.843188+0000","last_undegraded":"2023-10-08T12:40:40.843188+0000","last_fullsized":"2023-10-08T12:40:40.843188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:54.545166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:11.793371+0000","last_change":"2023-10-08T12:40:11.793371+0000","last_active":"2023-10-08T12:40:11.793371+0000","last_peered":"2023-10-08T12:40:11.793371+0000","last_clean":"2023-10-08T12:40:11.793371+0000","last_became_active":"2023-10-08T12:40:11.792968+0000","last_became_peered":"2023-10-08T12:40:11.792968+0000","last_unstale":"2023-10-08T12:40:11.793371+0000","last_undegraded":"2023-10-08T12:40:11.793371+0000","last_fullsized":"2023-10-08T12:40:11.793371+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:20.744535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842815+0000","last_change":"2023-10-08T12:39:14.221040+0000","last_active":"2023-10-08T12:40:40.842815+0000","last_peered":"2023-10-08T12:40:40.842815+0000","last_clean":"2023-10-08T12:40:40.842815+0000","last_became_active":"2023-10-08T12:39:14.220724+0000","last_became_peered":"2023-10-08T12:39:14.220724+0000","last_unstale":"2023-10-08T12:40:40.842815+0000","last_undegraded":"2023-10-08T12:40:40.842815+0000","last_fullsized":"2023-10-08T12:40:40.842815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:52.824228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.790002+0000","last_change":"2023-10-08T12:39:13.212244+0000","last_active":"2023-10-08T12:40:10.790002+0000","last_peered":"2023-10-08T12:40:10.790002+0000","last_clean":"2023-10-08T12:40:10.790002+0000","last_became_active":"2023-10-08T12:39:13.212028+0000","last_became_peered":"2023-10-08T12:39:13.212028+0000","last_unstale":"2023-10-08T12:40:10.790002+0000","last_undegraded":"2023-10-08T12:40:10.790002+0000","last_fullsized":"2023-10-08T12:40:10.790002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:06.111807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.833089+0000","last_change":"2023-10-08T12:39:14.216665+0000","last_active":"2023-10-08T12:40:40.833089+0000","last_peered":"2023-10-08T12:40:40.833089+0000","last_clean":"2023-10-08T12:40:40.833089+0000","last_became_active":"2023-10-08T12:39:14.216330+0000","last_became_peered":"2023-10-08T12:39:14.216330+0000","last_unstale":"2023-10-08T12:40:40.833089+0000","last_undegraded":"2023-10-08T12:40:40.833089+0000","last_fullsized":"2023-10-08T12:40:40.833089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.658600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.793792+0000","last_change":"2023-10-08T12:39:13.214495+0000","last_active":"2023-10-08T12:40:10.793792+0000","last_peered":"2023-10-08T12:40:10.793792+0000","last_clean":"2023-10-08T12:40:10.793792+0000","last_became_active":"2023-10-08T12:39:13.213930+0000","last_became_peered":"2023-10-08T12:39:13.213930+0000","last_unstale":"2023-10-08T12:40:10.793792+0000","last_undegraded":"2023-10-08T12:40:10.793792+0000","last_fullsized":"2023-10-08T12:40:10.793792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:20:38.096164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.833346+0000","last_change":"2023-10-08T12:39:14.212566+0000","last_active":"2023-10-08T12:40:40.833346+0000","last_peered":"2023-10-08T12:40:40.833346+0000","last_clean":"2023-10-08T12:40:40.833346+0000","last_became_active":"2023-10-08T12:39:14.211756+0000","last_became_peered":"2023-10-08T12:39:14.211756+0000","last_unstale":"2023-10-08T12:40:40.833346+0000","last_undegraded":"2023-10-08T12:40:40.833346+0000","last_fullsized":"2023-10-08T12:40:40.833346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:12.741640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.786680+0000","last_change":"2023-10-08T12:39:13.217914+0000","last_active":"2023-10-08T12:40:10.786680+0000","last_peered":"2023-10-08T12:40:10.786680+0000","last_clean":"2023-10-08T12:40:10.786680+0000","last_became_active":"2023-10-08T12:39:13.217571+0000","last_became_peered":"2023-10-08T12:39:13.217571+0000","last_unstale":"2023-10-08T12:40:10.786680+0000","last_undegraded":"2023-10-08T12:40:10.786680+0000","last_fullsized":"2023-10-08T12:40:10.786680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:10.826007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834977+0000","last_change":"2023-10-08T12:39:14.214280+0000","last_active":"2023-10-08T12:40:40.834977+0000","last_peered":"2023-10-08T12:40:40.834977+0000","last_clean":"2023-10-08T12:40:40.834977+0000","last_became_active":"2023-10-08T12:39:14.213942+0000","last_became_peered":"2023-10-08T12:39:14.213942+0000","last_unstale":"2023-10-08T12:40:40.834977+0000","last_undegraded":"2023-10-08T12:40:40.834977+0000","last_fullsized":"2023-10-08T12:40:40.834977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:17:21.450265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:40:10.791974+0000","last_change":"2023-10-08T12:39:13.222484+0000","last_active":"2023-10-08T12:40:10.791974+0000","last_peered":"2023-10-08T12:40:10.791974+0000","last_clean":"2023-10-08T12:40:10.791974+0000","last_became_active":"2023-10-08T12:39:13.222091+0000","last_became_peered":"2023-10-08T12:39:13.222091+0000","last_unstale":"2023-10-08T12:40:10.791974+0000","last_undegraded":"2023-10-08T12:40:10.791974+0000","last_fullsized":"2023-10-08T12:40:10.791974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:12.184592+0000","last_clean_scrub_stamp":"2023-10-08T12:39:12.184592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:00.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.835374+0000","last_change":"2023-10-08T12:39:14.207715+0000","last_active":"2023-10-08T12:40:40.835374+0000","last_peered":"2023-10-08T12:40:40.835374+0000","last_clean":"2023-10-08T12:40:40.835374+0000","last_became_active":"2023-10-08T12:39:14.207429+0000","last_became_peered":"2023-10-08T12:39:14.207429+0000","last_unstale":"2023-10-08T12:40:40.835374+0000","last_undegraded":"2023-10-08T12:40:40.835374+0000","last_fullsized":"2023-10-08T12:40:40.835374+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:16.991831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831848+0000","last_change":"2023-10-08T12:39:14.200398+0000","last_active":"2023-10-08T12:40:40.831848+0000","last_peered":"2023-10-08T12:40:40.831848+0000","last_clean":"2023-10-08T12:40:40.831848+0000","last_became_active":"2023-10-08T12:39:14.200035+0000","last_became_peered":"2023-10-08T12:39:14.200035+0000","last_unstale":"2023-10-08T12:40:40.831848+0000","last_undegraded":"2023-10-08T12:40:40.831848+0000","last_fullsized":"2023-10-08T12:40:40.831848+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:13.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834439+0000","last_change":"2023-10-08T12:39:14.202185+0000","last_active":"2023-10-08T12:40:40.834439+0000","last_peered":"2023-10-08T12:40:40.834439+0000","last_clean":"2023-10-08T12:40:40.834439+0000","last_became_active":"2023-10-08T12:39:14.201232+0000","last_became_peered":"2023-10-08T12:39:14.201232+0000","last_unstale":"2023-10-08T12:40:40.834439+0000","last_undegraded":"2023-10-08T12:40:40.834439+0000","last_fullsized":"2023-10-08T12:40:40.834439+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:25:50.949047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.845543+0000","last_change":"2023-10-08T12:39:14.208014+0000","last_active":"2023-10-08T12:40:40.845543+0000","last_peered":"2023-10-08T12:40:40.845543+0000","last_clean":"2023-10-08T12:40:40.845543+0000","last_became_active":"2023-10-08T12:39:14.207579+0000","last_became_peered":"2023-10-08T12:39:14.207579+0000","last_unstale":"2023-10-08T12:40:40.845543+0000","last_undegraded":"2023-10-08T12:40:40.845543+0000","last_fullsized":"2023-10-08T12:40:40.845543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:37.352827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842605+0000","last_change":"2023-10-08T12:40:11.796652+0000","last_active":"2023-10-08T12:40:40.842605+0000","last_peered":"2023-10-08T12:40:40.842605+0000","last_clean":"2023-10-08T12:40:40.842605+0000","last_became_active":"2023-10-08T12:40:11.796346+0000","last_became_peered":"2023-10-08T12:40:11.796346+0000","last_unstale":"2023-10-08T12:40:40.842605+0000","last_undegraded":"2023-10-08T12:40:40.842605+0000","last_fullsized":"2023-10-08T12:40:40.842605+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:25:31.781651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.843767+0000","last_change":"2023-10-08T12:39:14.222630+0000","last_active":"2023-10-08T12:40:40.843767+0000","last_peered":"2023-10-08T12:40:40.843767+0000","last_clean":"2023-10-08T12:40:40.843767+0000","last_became_active":"2023-10-08T12:39:14.222300+0000","last_became_peered":"2023-10-08T12:39:14.222300+0000","last_unstale":"2023-10-08T12:40:40.843767+0000","last_undegraded":"2023-10-08T12:40:40.843767+0000","last_fullsized":"2023-10-08T12:40:40.843767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.040227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830931+0000","last_change":"2023-10-08T12:39:14.207144+0000","last_active":"2023-10-08T12:40:40.830931+0000","last_peered":"2023-10-08T12:40:40.830931+0000","last_clean":"2023-10-08T12:40:40.830931+0000","last_became_active":"2023-10-08T12:39:14.206775+0000","last_became_peered":"2023-10-08T12:39:14.206775+0000","last_unstale":"2023-10-08T12:40:40.830931+0000","last_undegraded":"2023-10-08T12:40:40.830931+0000","last_fullsized":"2023-10-08T12:40:40.830931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:55.224270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.841229+0000","last_change":"2023-10-08T12:39:14.204123+0000","last_active":"2023-10-08T12:40:40.841229+0000","last_peered":"2023-10-08T12:40:40.841229+0000","last_clean":"2023-10-08T12:40:40.841229+0000","last_became_active":"2023-10-08T12:39:14.203123+0000","last_became_peered":"2023-10-08T12:39:14.203123+0000","last_unstale":"2023-10-08T12:40:40.841229+0000","last_undegraded":"2023-10-08T12:40:40.841229+0000","last_fullsized":"2023-10-08T12:40:40.841229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:45.423095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.830346+0000","last_change":"2023-10-08T12:39:14.211049+0000","last_active":"2023-10-08T12:40:40.830346+0000","last_peered":"2023-10-08T12:40:40.830346+0000","last_clean":"2023-10-08T12:40:40.830346+0000","last_became_active":"2023-10-08T12:39:14.210738+0000","last_became_peered":"2023-10-08T12:39:14.210738+0000","last_unstale":"2023-10-08T12:40:40.830346+0000","last_undegraded":"2023-10-08T12:40:40.830346+0000","last_fullsized":"2023-10-08T12:40:40.830346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:12.535857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.827735+0000","last_change":"2023-10-08T12:39:14.220013+0000","last_active":"2023-10-08T12:40:40.827735+0000","last_peered":"2023-10-08T12:40:40.827735+0000","last_clean":"2023-10-08T12:40:40.827735+0000","last_became_active":"2023-10-08T12:39:14.219711+0000","last_became_peered":"2023-10-08T12:39:14.219711+0000","last_unstale":"2023-10-08T12:40:40.827735+0000","last_undegraded":"2023-10-08T12:40:40.827735+0000","last_fullsized":"2023-10-08T12:40:40.827735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:23.205074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.831620+0000","last_change":"2023-10-08T12:39:14.214237+0000","last_active":"2023-10-08T12:40:40.831620+0000","last_peered":"2023-10-08T12:40:40.831620+0000","last_clean":"2023-10-08T12:40:40.831620+0000","last_became_active":"2023-10-08T12:39:14.213891+0000","last_became_peered":"2023-10-08T12:39:14.213891+0000","last_unstale":"2023-10-08T12:40:40.831620+0000","last_undegraded":"2023-10-08T12:40:40.831620+0000","last_fullsized":"2023-10-08T12:40:40.831620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:11.348411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.842349+0000","last_change":"2023-10-08T12:39:14.209037+0000","last_active":"2023-10-08T12:40:40.842349+0000","last_peered":"2023-10-08T12:40:40.842349+0000","last_clean":"2023-10-08T12:40:40.842349+0000","last_became_active":"2023-10-08T12:39:14.208728+0000","last_became_peered":"2023-10-08T12:39:14.208728+0000","last_unstale":"2023-10-08T12:40:40.842349+0000","last_undegraded":"2023-10-08T12:40:40.842349+0000","last_fullsized":"2023-10-08T12:40:40.842349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:23.440413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.844397+0000","last_change":"2023-10-08T12:39:14.222691+0000","last_active":"2023-10-08T12:40:40.844397+0000","last_peered":"2023-10-08T12:40:40.844397+0000","last_clean":"2023-10-08T12:40:40.844397+0000","last_became_active":"2023-10-08T12:39:14.222393+0000","last_became_peered":"2023-10-08T12:39:14.222393+0000","last_unstale":"2023-10-08T12:40:40.844397+0000","last_undegraded":"2023-10-08T12:40:40.844397+0000","last_fullsized":"2023-10-08T12:40:40.844397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:19.704140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:40:40.834058+0000","last_change":"2023-10-08T12:39:14.200858+0000","last_active":"2023-10-08T12:40:40.834058+0000","last_peered":"2023-10-08T12:40:40.834058+0000","last_clean":"2023-10-08T12:40:40.834058+0000","last_became_active":"2023-10-08T12:39:14.199948+0000","last_became_peered":"2023-10-08T12:39:14.199948+0000","last_unstale":"2023-10-08T12:40:40.834058+0000","last_undegraded":"2023-10-08T12:40:40.834058+0000","last_fullsized":"2023-10-08T12:40:40.834058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:39:13.186896+0000","last_clean_scrub_stamp":"2023-10-08T12:39:13.186896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:10.366380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281436,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65902,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":253,"num_read_kb":192,"num_write":78,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":186948,"data_compressed":4821,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416422,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":462175,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.629},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.626},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.76000000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71799999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67600000000000005}]},{"osd":3,"last update":"Sun Oct 8 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":6.9329999999999998,"5min":6.9329999999999998,"15min":6.9329999999999998},"last":0.56499999999999995}]},{"osd":4,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.056,"5min":1.175,"15min":1.175},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.45900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.80900000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96599999999999997,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90300000000000002,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.498}]},{"osd":6,"last update":"Sun Oct 8 12:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.80800000000000005,"15min":0.81599999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.028,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53600000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72699999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76800000000000002,"15min":0.76600000000000001},"min":{"1min":0.53200000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.97399999999999998,"5min":1.115,"15min":1.115},"last":0.74299999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85399999999999998,"15min":0.86799999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2430000000000001,"5min":1.639,"15min":1.639},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.61599999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.099,"5min":1.196,"15min":1.196},"last":0.70699999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0409999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94799999999999995,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.78300000000000003}]}]},{"osd":10,"up_from":72,"seq":309237645353,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":1117633,"data_compressed":43212,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45500000000000002,"15min":0.46800000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54000000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.314,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60299999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61199999999999999,"15min":0.58999999999999997},"min":{"1min":0.55800000000000005,"5min":0.376,"15min":0.376},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63100000000000001,"15min":0.627},"min":{"1min":0.56599999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82999999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60899999999999999,"15min":0.628},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70999999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.63600000000000001,"15min":0.65100000000000002},"min":{"1min":0.40000000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.83299999999999996,"5min":1.01,"15min":1.01},"last":0.61199999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82499999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.34399999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76700000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.80600000000000005},"min":{"1min":0.53200000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.89500000000000002,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.747},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70099999999999996,"15min":0.69799999999999995},"min":{"1min":0.495,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.872,"5min":1.569,"15min":1.569},"last":0.66200000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73199999999999998,"15min":0.76000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.503,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90700000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65900000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.83699999999999997,"15min":0.878},"min":{"1min":0.52900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98499999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78400000000000003,"15min":0.78600000000000003},"min":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98099999999999998,"5min":1.669,"15min":1.669},"last":0.77700000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":0.80800000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.01,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.81399999999999995}]},{"osd":11,"last update":"Sun Oct 8 12:40:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.59899999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95199999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.60699999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":1.522,"15min":1.522},"last":0.76100000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":462880,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93899999999999995,"5min":3.101,"15min":3.101},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.56000000000000005,"15min":0.57799999999999996},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.90000000000000002,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.70199999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0960000000000001,"5min":2.944,"15min":2.944},"last":0.77000000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.749,"15min":0.76800000000000002},"min":{"1min":0.52600000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.99099999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.4990000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.81100000000000005,"15min":0.82499999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1339999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63500000000000001,"15min":0.66500000000000004},"min":{"1min":0.34499999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.875,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.46},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.752,"15min":0.76800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.056,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.88700000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:39:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.75},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58299999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.212,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.80100000000000005,"15min":0.82599999999999996},"min":{"1min":0.54000000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95599999999999996,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.85199999999999998,"15min":0.88900000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94899999999999995,"5min":1.325,"15min":1.325},"last":1.538}]},{"osd":6,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.88700000000000001,"15min":0.93000000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.169,"5min":3.0720000000000001,"15min":3.0720000000000001},"last":1.6559999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.81699999999999995,"15min":0.85699999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.86599999999999999,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.86599999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.88300000000000001,"15min":0.93100000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96799999999999997,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.573},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.95899999999999996,"15min":0.98899999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2090000000000001,"5min":2.98,"15min":2.98},"last":0.85399999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.97599999999999998,"15min":1.012},"min":{"1min":0.63400000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.23,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.92200000000000004,"15min":0.95799999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.004,"5min":2.496,"15min":2.496},"last":0.83099999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.64400000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.038,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.875,"15min":0.89500000000000002},"min":{"1min":0.57299999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96499999999999997,"5min":2.536,"15min":2.536},"last":0.75700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":8,"up_from":59,"seq":253403070513,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462448,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85599999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.46999999999999997}]},{"osd":1,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84699999999999998,"5min":1.026,"15min":1.026},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90700000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58199999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.47599999999999998,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.435},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80300000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86199999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67000000000000004}]},{"osd":4,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.995,"5min":1.044,"15min":1.044},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94199999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.59999999999999998,"15min":0.58799999999999997},"min":{"1min":0.45000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.89000000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72599999999999998,"15min":0.71899999999999997},"min":{"1min":0.54800000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77200000000000002,"15min":0.76500000000000001},"min":{"1min":0.64600000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.72999999999999998,"15min":0.70999999999999996},"min":{"1min":0.63100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59399999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.085,"5min":1.181,"15min":1.181},"last":0.78100000000000003}]},{"osd":9,"last update":"Sun Oct 8 12:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.78400000000000003,"15min":0.76100000000000001},"min":{"1min":0.65500000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.71399999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0209999999999999,"5min":1.45,"15min":1.45},"last":0.752}]},{"osd":10,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.79800000000000004,"15min":0.77300000000000002},"min":{"1min":0.63300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.048,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.78200000000000003,"15min":0.755},"min":{"1min":0.74299999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97999999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.80900000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.86099999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":1053248,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82099999999999995,"5min":0.877,"15min":0.877},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.434},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69299999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47399999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59699999999999998,"15min":0.58699999999999997},"min":{"1min":0.44700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.57799999999999996,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81299999999999994,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.61199999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.504,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79000000000000004,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.49299999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86099999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.69699999999999995}]},{"osd":4,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.33600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76600000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.501,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59099999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.51600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.64500000000000002},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.49099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.751},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.68400000000000005},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94099999999999995,"5min":1.204,"15min":1.204},"last":0.78000000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.70999999999999996,"15min":0.69199999999999995},"min":{"1min":0.56299999999999994,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.56000000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.72799999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.76500000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.59799999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93799999999999994,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.81000000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.879}]}]},{"osd":6,"up_from":47,"seq":201863462971,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462298,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.61399999999999999,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.0129999999999999,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":1.079,"5min":0.65000000000000002,"15min":0.58499999999999996},"min":{"1min":0.35199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":10.076000000000001,"5min":10.076000000000001,"15min":10.076000000000001},"last":0.56200000000000006}]},{"osd":1,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":0.747,"15min":0.65900000000000003},"min":{"1min":0.53500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":7.3250000000000002,"5min":7.3250000000000002,"15min":7.3250000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":1.8049999999999999,"5min":0.89100000000000001,"15min":0.73399999999999999},"min":{"1min":0.44,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":20.783000000000001,"5min":20.783000000000001,"15min":20.783000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":0.82399999999999995,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.495},"max":{"1min":10.036,"5min":10.036,"15min":10.036},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.6699999999999999,"5min":0.93999999999999995,"15min":0.82999999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":15.960000000000001,"5min":15.960000000000001,"15min":15.960000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":0.78400000000000003,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":13.558,"5min":13.558,"15min":13.558},"last":0.503},{"interface":"front","average":{"1min":1.49,"5min":0.82699999999999996,"15min":0.72299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":14.855,"5min":14.855,"15min":14.855},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80400000000000005,"15min":0.73999999999999999},"min":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.2650000000000001,"5min":6.875,"15min":6.875},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.25,"5min":0.88500000000000001,"15min":0.81499999999999995},"min":{"1min":0.66500000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":7.3689999999999998,"5min":7.3689999999999998,"15min":7.3689999999999998},"last":0.61899999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":0.94099999999999995,"15min":0.85099999999999998},"min":{"1min":0.624,"5min":0.5,"15min":0.5},"max":{"1min":13.835000000000001,"5min":13.835000000000001,"15min":13.835000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.85499999999999998,"15min":0.84099999999999997},"min":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.9060000000000001,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.84599999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":0.995,"15min":0.84699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":18.009,"5min":18.009,"15min":18.009},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.306,"5min":0.95899999999999996,"15min":0.86499999999999999},"min":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":10.234,"5min":10.234,"15min":10.234},"last":0.54700000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.94799999999999995,"15min":0.97099999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84099999999999997,"15min":0.85099999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.81100000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94699999999999995,"15min":0.96499999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.0030000000000001,"5min":4.0030000000000001,"15min":4.0030000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.109,"15min":1.032},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":14.185,"5min":14.185,"15min":14.185},"last":0.77400000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.754},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.98399999999999999,"15min":0.998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.452,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.88700000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":521569,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.46500000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.2010000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.38100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3129999999999999,"5min":1.452,"15min":1.452},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.60299999999999998,"15min":0.53300000000000003},"min":{"1min":0.46899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.59299999999999997,"15min":0.53900000000000003},"min":{"1min":0.54800000000000004,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.61399999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.60699999999999998,"15min":0.55700000000000005},"min":{"1min":0.44800000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2789999999999999,"5min":1.413,"15min":1.413},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.64100000000000001,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.224,"5min":1.427,"15min":1.427},"last":0.57399999999999995}]},{"osd":4,"last update":"Sun Oct 8 12:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.40600000000000003},"min":{"1min":0.36499999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76000000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.40899999999999997},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.69499999999999995,"15min":0.60499999999999998},"min":{"1min":0.53900000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.66400000000000003,"15min":0.60199999999999998},"min":{"1min":0.61899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:40:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.47499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.24,"5min":1.355,"15min":1.355},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.70099999999999996,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2629999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sun Oct 8 12:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.59599999999999997,"15min":0.54800000000000004},"min":{"1min":0.41699999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0169999999999999,"5min":1.04,"15min":1.04},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.67400000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.66700000000000004,"15min":0.63700000000000001},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.69899999999999995,"15min":0.64900000000000002},"min":{"1min":0.59099999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.85699999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.754,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.755,"15min":0.72899999999999998},"min":{"1min":0.63400000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.1870000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.77000000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.79300000000000004,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.0700000000000001,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.752,"15min":0.72799999999999998},"min":{"1min":0.59999999999999998,"5min":0.498,"15min":0.498},"max":{"1min":0.96099999999999997,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.66000000000000003}]},{"osd":11,"last update":"Sun Oct 8 12:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.81000000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705751,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462265,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.56599999999999995},"min":{"1min":0.437,"5min":0.314,"15min":0.314},"max":{"1min":0.83399999999999996,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66200000000000003,"15min":0.57899999999999996},"min":{"1min":0.46999999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94799999999999995,"5min":1.046,"15min":1.046},"last":0.68799999999999994}]},{"osd":2,"last update":"Sun Oct 8 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68300000000000005,"15min":0.59799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.008,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65600000000000003,"15min":0.59399999999999997},"min":{"1min":0.42999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88100000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.747},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.47299999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64600000000000002,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.623},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"min":{"1min":0.56799999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93000000000000005,"5min":1.911,"15min":1.911},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.66700000000000004},"min":{"1min":0.52600000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82999999999999996,"5min":1.127,"15min":1.127},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.497,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.76100000000000001,"15min":0.73399999999999999},"min":{"1min":0.433,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.52700000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.50600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.59299999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.65200000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.85599999999999998,"15min":0.89000000000000001},"min":{"1min":0.48999999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.497},{"interface":"front","average":{"1min":0.875,"5min":0.91300000000000003,"15min":0.93799999999999994},"min":{"1min":0.60199999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.76700000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.82499999999999996,"15min":0.85799999999999998},"min":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.038,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.90800000000000003,"15min":0.95399999999999996},"min":{"1min":0.64400000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.119,"5min":1.357,"15min":1.357},"last":0.72999999999999998}]},{"osd":11,"last update":"Sun Oct 8 12:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.94099999999999995,"15min":0.94699999999999995},"min":{"1min":0.68600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1679999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.68200000000000005}]}]},{"osd":2,"up_from":19,"seq":81604378702,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":521934,"data_compressed":7416,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.35699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72699999999999998,"5min":0.88500000000000001,"15min":1.0129999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.77900000000000003,"5min":0.89600000000000002,"15min":1.194},"last":0.55200000000000005}]},{"osd":1,"last update":"Sun Oct 8 12:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59599999999999997,"15min":0.53200000000000003},"min":{"1min":0.443,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.621,"15min":0.53800000000000003},"min":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.875,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.875}]},{"osd":3,"last update":"Sun Oct 8 12:40:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61699999999999999,"15min":0.59599999999999997},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0129999999999999,"5min":1.073,"15min":1.073},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79300000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.70799999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.44400000000000001,"15min":0.41599999999999998},"min":{"1min":0.36699999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66700000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.434},"min":{"1min":0.371,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.67600000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.64700000000000002,"15min":0.60599999999999998},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.64600000000000002,"15min":0.60699999999999998},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.04,"15min":1.04},"last":0.752}]},{"osd":7,"last update":"Sun Oct 8 12:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:40:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98799999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61399999999999999},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83799999999999997,"5min":1.006,"15min":1.006},"last":0.78700000000000003}]},{"osd":9,"last update":"Sun Oct 8 12:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53100000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":1.087,"15min":1.087},"last":0.86299999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.58899999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88100000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.60699999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.89500000000000002}]},{"osd":11,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.94599999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":462071,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.88500000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.51200000000000001,"15min":0.47399999999999998},"min":{"1min":0.36599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77500000000000002,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Sun Oct 8 12:40:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.61499999999999999},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0429999999999999,"5min":1.081,"15min":1.081},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.60599999999999998},"min":{"1min":0.47199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.81100000000000005,"5min":1.05,"15min":1.05},"last":0.70799999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:40:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.66000000000000003},"min":{"1min":0.48599999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90200000000000002,"5min":1.077,"15min":1.077},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.51800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.91200000000000003,"5min":1.23,"15min":1.23},"last":0.58199999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.71399999999999997,"15min":0.64100000000000001},"min":{"1min":0.63600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92100000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.748,"15min":0.67600000000000005},"min":{"1min":0.65400000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95899999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89200000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.70699999999999996,"15min":0.69099999999999995},"min":{"1min":0.52700000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89400000000000002,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.749}]},{"osd":6,"last update":"Sun Oct 8 12:40:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0169999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.879},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72199999999999998,"15min":0.71299999999999997},"min":{"1min":0.50800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.90400000000000003,"5min":1.109,"15min":1.109},"last":0.91800000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.65600000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.012,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81299999999999994,"15min":0.80000000000000004},"min":{"1min":0.65300000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.998,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.66900000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.89400000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.91200000000000003,"15min":0.97999999999999998},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.01,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.89300000000000002,"15min":0.92600000000000005},"min":{"1min":0.626,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98699999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.63200000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.90800000000000003,"15min":0.94099999999999995},"min":{"1min":0.65100000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0669999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.92400000000000004,"15min":0.96599999999999997},"min":{"1min":0.69299999999999995,"5min":0.63,"15min":0.63},"max":{"1min":0.95599999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.93100000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.89500000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888133,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":462197,"data_compressed":5809,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67100000000000004,"15min":0.71999999999999997},"min":{"1min":0.439,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":6.0549999999999997,"15min":6.0549999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.51300000000000001,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41399999999999998,"15min":0.36799999999999999},"min":{"1min":0.309,"5min":0.223,"15min":0.223},"max":{"1min":0.58899999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.39100000000000001},"min":{"1min":0.35799999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.61599999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.61499999999999999,"15min":0.56899999999999995},"min":{"1min":0.46500000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61399999999999999,"15min":0.56499999999999995},"min":{"1min":0.51900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48399999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.54100000000000004},"min":{"1min":0.50800000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.875,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.54300000000000004},"min":{"1min":0.40200000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78000000000000003,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65600000000000003,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92100000000000004,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.65200000000000002,"15min":0.58399999999999996},"min":{"1min":0.58499999999999996,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54500000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64800000000000002,"15min":0.60899999999999999},"min":{"1min":0.57299999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85499999999999998,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.93000000000000005,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.61299999999999999,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.042,"5min":1.046,"15min":1.046},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.64600000000000002,"15min":0.57599999999999996},"min":{"1min":0.434,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98699999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.71999999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:40:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70399999999999996,"15min":0.67900000000000005},"min":{"1min":0.56399999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.73699999999999999,"15min":0.70899999999999996},"min":{"1min":0.67500000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":1.242,"15min":1.242},"last":0.75600000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.014,"5min":1.349,"15min":1.349},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.83299999999999996},"min":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.028,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.70399999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.61899999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0960000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.79800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0009999999999999,"5min":1.171,"15min":1.171},"last":0.83699999999999997}]},{"osd":11,"last update":"Sun Oct 8 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.86399999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724607,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":1052517,"data_compressed":41605,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.39600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.437}]},{"osd":1,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.498,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81999999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.47999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.498}]},{"osd":2,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.40500000000000003},"min":{"1min":0.318,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.372},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.40699999999999997},"min":{"1min":0.29499999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41099999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.59499999999999997,"15min":0.56100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.81000000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.60499999999999998,"15min":0.57499999999999996},"min":{"1min":0.54400000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83599999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64800000000000002}]},{"osd":6,"last update":"Sun Oct 8 12:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65800000000000003,"15min":0.61699999999999999},"min":{"1min":0.42899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89100000000000001,"5min":1.268,"15min":1.268},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.61299999999999999},"min":{"1min":0.56200000000000006,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89800000000000002,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.63100000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.48299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67500000000000004,"15min":0.64000000000000001},"min":{"1min":0.58999999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68500000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.59999999999999998,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.59499999999999997,"15min":0.57299999999999995},"min":{"1min":0.46800000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.70099999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81899999999999995,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94999999999999996,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.76900000000000002},"min":{"1min":0.626,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.976,"15min":1.976},"last":0.755}]},{"osd":10,"last update":"Sun Oct 8 12:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.752,"15min":0.73099999999999998},"min":{"1min":0.60099999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98099999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77300000000000002,"15min":0.75800000000000001},"min":{"1min":0.66200000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98199999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34152,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35796,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59725,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59759,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65298,"data_compressed":1607,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:41:17.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:41:17.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.571+0000 7f75679ff700 1 -- 172.21.15.59:0/3289537270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7560073540 msgr2=0x7f756010c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.571+0000 7f75679ff700 1 --2- 172.21.15.59:0/3289537270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7560073540 0x7f756010c930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7550009990 tx=0x7f7550009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.571+0000 7f75679ff700 1 -- 172.21.15.59:0/3289537270 shutdown_connections 2023-10-08T12:41:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.571+0000 7f75679ff700 1 --2- 172.21.15.59:0/3289537270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560072c20 0x7f7560073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.571+0000 7f75679ff700 1 --2- 172.21.15.59:0/3289537270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f756010ce70 0x7f756010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.571+0000 7f75679ff700 1 --2- 172.21.15.59:0/3289537270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7560073540 0x7f756010c930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.571+0000 7f75679ff700 1 -- 172.21.15.59:0/3289537270 >> 172.21.15.59:0/3289537270 conn(0x7f75600fc140 msgr2=0x7f75600fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.571+0000 7f75679ff700 1 -- 172.21.15.59:0/3289537270 shutdown_connections 2023-10-08T12:41:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.572+0000 7f75679ff700 1 -- 172.21.15.59:0/3289537270 wait complete. 2023-10-08T12:41:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.572+0000 7f75679ff700 1 Processor -- start 2023-10-08T12:41:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f75679ff700 1 -- start start 2023-10-08T12:41:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f75679ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7560072c20 0x7f7560198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f75679ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560073540 0x7f75601992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f75679ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f756010ce70 0x7f756019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f75679ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756019dc90 con 0x7f7560072c20 2023-10-08T12:41:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f75679ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756019de00 con 0x7f7560073540 2023-10-08T12:41:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f75679ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756019dfc0 con 0x7f756010ce70 2023-10-08T12:41:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f756579b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7560072c20 0x7f7560198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f756579b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7560072c20 0x7f7560198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43116/0 (socket says 172.21.15.59:43116) 2023-10-08T12:41:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f756579b700 1 -- 172.21.15.59:0/1607388765 learned_addr learned my addr 172.21.15.59:0/1607388765 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f7565f9c700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f756010ce70 0x7f756019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.573+0000 7f7564f9a700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560073540 0x7f75601992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.574+0000 7f756579b700 1 -- 172.21.15.59:0/1607388765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f756010ce70 msgr2=0x7f756019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.574+0000 7f756579b700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f756010ce70 0x7f756019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.574+0000 7f756579b700 1 -- 172.21.15.59:0/1607388765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560073540 msgr2=0x7f75601992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.574+0000 7f756579b700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560073540 0x7f75601992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.574+0000 7f756579b700 1 -- 172.21.15.59:0/1607388765 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c009520 con 0x7f7560072c20 2023-10-08T12:41:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.574+0000 7f756579b700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7560072c20 0x7f7560198d70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f755c00eb30 tx=0x7f755c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.574+0000 7f75567fc700 1 -- 172.21.15.59:0/1607388765 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c009880 con 0x7f7560072c20 2023-10-08T12:41:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.574+0000 7f75567fc700 1 -- 172.21.15.59:0/1607388765 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f755c0044e0 con 0x7f7560072c20 2023-10-08T12:41:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.574+0000 7f75679ff700 1 -- 172.21.15.59:0/1607388765 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75500095f0 con 0x7f7560072c20 2023-10-08T12:41:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.574+0000 7f75567fc700 1 -- 172.21.15.59:0/1607388765 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c003d80 con 0x7f7560072c20 2023-10-08T12:41:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.574+0000 7f75679ff700 1 -- 172.21.15.59:0/1607388765 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756019e490 con 0x7f7560072c20 2023-10-08T12:41:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.576+0000 7f75679ff700 1 -- 172.21.15.59:0/1607388765 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7560108080 con 0x7f7560072c20 2023-10-08T12:41:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.577+0000 7f75567fc700 1 -- 172.21.15.59:0/1607388765 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f755c003f20 con 0x7f7560072c20 2023-10-08T12:41:17.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.579+0000 7f75567fc700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1550 0x7f754c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:17.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.579+0000 7f75567fc700 1 -- 172.21.15.59:0/1607388765 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f755c014070 con 0x7f7560072c20 2023-10-08T12:41:17.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.579+0000 7f7564f9a700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1550 0x7f754c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:17.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.580+0000 7f7564f9a700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1550 0x7f754c0a3a10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f756019a2c0 tx=0x7f7550005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.583+0000 7f75567fc700 1 -- 172.21.15.59:0/1607388765 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f755c0968a0 con 0x7f7560072c20 2023-10-08T12:41:17.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.796+0000 7f75679ff700 1 -- 172.21.15.59:0/1607388765 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75600742d0 con 0x7f7560072c20 2023-10-08T12:41:17.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.798+0000 7f75567fc700 1 -- 172.21.15.59:0/1607388765 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22725 (secure 0 0 0) 0x7f755c096030 con 0x7f7560072c20 2023-10-08T12:41:17.799 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:17.799 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":86,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:40:11.783762+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:41:17.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 -- 172.21.15.59:0/1607388765 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1550 msgr2=0x7f754c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:17.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1550 0x7f754c0a3a10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f756019a2c0 tx=0x7f7550005fd0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 -- 172.21.15.59:0/1607388765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7560072c20 msgr2=0x7f7560198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:17.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7560072c20 0x7f7560198d70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f755c00eb30 tx=0x7f755c00ee40 comp rx=0 tx=0).stop 2023-10-08T12:41:17.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 -- 172.21.15.59:0/1607388765 shutdown_connections 2023-10-08T12:41:17.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f754c0a1550 0x7f754c0a3a10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f756010ce70 0x7f756019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7560072c20 0x7f7560198d70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 --2- 172.21.15.59:0/1607388765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560073540 0x7f75601992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:17.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 -- 172.21.15.59:0/1607388765 >> 172.21.15.59:0/1607388765 conn(0x7f75600fc140 msgr2=0x7f75600fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:17.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 -- 172.21.15.59:0/1607388765 shutdown_connections 2023-10-08T12:41:17.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:17.800+0000 7f75679ff700 1 -- 172.21.15.59:0/1607388765 wait complete. 2023-10-08T12:41:17.821 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:39:12.134451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:39:13.186137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:41:17.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:41:18.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.027+0000 7f65ebfff700 1 -- 172.21.15.59:0/364951784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e4100740 msgr2=0x7f65e4100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.027+0000 7f65ebfff700 1 --2- 172.21.15.59:0/364951784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e4100740 0x7f65e4100bc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009990 tx=0x7f65d4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.027+0000 7f65ebfff700 1 -- 172.21.15.59:0/364951784 shutdown_connections 2023-10-08T12:41:18.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.027+0000 7f65ebfff700 1 --2- 172.21.15.59:0/364951784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e4101100 0x7f65e410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.027+0000 7f65ebfff700 1 --2- 172.21.15.59:0/364951784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e4106750 0x7f65e4106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.027+0000 7f65ebfff700 1 --2- 172.21.15.59:0/364951784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e4100740 0x7f65e4100bc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.027+0000 7f65ebfff700 1 -- 172.21.15.59:0/364951784 >> 172.21.15.59:0/364951784 conn(0x7f65e40fc230 msgr2=0x7f65e40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.028+0000 7f65ebfff700 1 -- 172.21.15.59:0/364951784 shutdown_connections 2023-10-08T12:41:18.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.028+0000 7f65ebfff700 1 -- 172.21.15.59:0/364951784 wait complete. 2023-10-08T12:41:18.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.029+0000 7f65ebfff700 1 Processor -- start 2023-10-08T12:41:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.029+0000 7f65ebfff700 1 -- start start 2023-10-08T12:41:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.029+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e4100740 0x7f65e419ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.029+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e4101100 0x7f65e419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.029+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e4106750 0x7f65e4198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.029+0000 7f65ebfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4199240 con 0x7f65e4100740 2023-10-08T12:41:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.029+0000 7f65ebfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e41993b0 con 0x7f65e4106750 2023-10-08T12:41:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.029+0000 7f65ebfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4199570 con 0x7f65e4101100 2023-10-08T12:41:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.029+0000 7f65e9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e4100740 0x7f65e419ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65e9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e4100740 0x7f65e419ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43134/0 (socket says 172.21.15.59:43134) 2023-10-08T12:41:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65e9d9b700 1 -- 172.21.15.59:0/3868348722 learned_addr learned my addr 172.21.15.59:0/3868348722 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65e959a700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e4101100 0x7f65e419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65ea59c700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e4106750 0x7f65e4198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65e9d9b700 1 -- 172.21.15.59:0/3868348722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e4101100 msgr2=0x7f65e419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65e9d9b700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e4101100 0x7f65e419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65e9d9b700 1 -- 172.21.15.59:0/3868348722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e4106750 msgr2=0x7f65e4198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65e9d9b700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e4106750 0x7f65e4198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65e9d9b700 1 -- 172.21.15.59:0/3868348722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d40095f0 con 0x7f65e4100740 2023-10-08T12:41:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65e9d9b700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e4100740 0x7f65e419ea60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f65e000e9a0 tx=0x7f65e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65daffd700 1 -- 172.21.15.59:0/3868348722 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0009790 con 0x7f65e4100740 2023-10-08T12:41:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65daffd700 1 -- 172.21.15.59:0/3868348722 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65e0010430 con 0x7f65e4100740 2023-10-08T12:41:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65ebfff700 1 -- 172.21.15.59:0/3868348722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e4199850 con 0x7f65e4100740 2023-10-08T12:41:18.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.030+0000 7f65daffd700 1 -- 172.21.15.59:0/3868348722 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0018680 con 0x7f65e4100740 2023-10-08T12:41:18.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.031+0000 7f65ebfff700 1 -- 172.21.15.59:0/3868348722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e41a5a50 con 0x7f65e4100740 2023-10-08T12:41:18.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.031+0000 7f65ebfff700 1 -- 172.21.15.59:0/3868348722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e4101e80 con 0x7f65e4100740 2023-10-08T12:41:18.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.033+0000 7f65daffd700 1 -- 172.21.15.59:0/3868348722 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f65e00105a0 con 0x7f65e4100740 2023-10-08T12:41:18.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.035+0000 7f65daffd700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65d00a14d0 0x7f65d00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.035+0000 7f65daffd700 1 -- 172.21.15.59:0/3868348722 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f65e0014070 con 0x7f65e4100740 2023-10-08T12:41:18.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.035+0000 7f65e959a700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65d00a14d0 0x7f65d00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.036+0000 7f65e959a700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65d00a14d0 0x7f65d00a3990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f65d40098e0 tx=0x7f65d4005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.039+0000 7f65daffd700 1 -- 172.21.15.59:0/3868348722 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f65e0052100 con 0x7f65e4100740 2023-10-08T12:41:18.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:17 smithi173 ceph-mon[135182]: from='client.25312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:41:18.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:17 smithi173 ceph-mon[135182]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:41:18.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:17 smithi173 ceph-mon[135182]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2023-10-08T12:41:18.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:17 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1607388765' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.249+0000 7f65ebfff700 1 -- 172.21.15.59:0/3868348722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65e41106c0 con 0x7f65e4100740 2023-10-08T12:41:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.249+0000 7f65daffd700 1 -- 172.21.15.59:0/3868348722 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65e0096510 con 0x7f65e4100740 2023-10-08T12:41:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T12:41:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 -- 172.21.15.59:0/3868348722 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65d00a14d0 msgr2=0x7f65d00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65d00a14d0 0x7f65d00a3990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f65d40098e0 tx=0x7f65d4005960 comp rx=0 tx=0).stop 2023-10-08T12:41:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 -- 172.21.15.59:0/3868348722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e4100740 msgr2=0x7f65e419ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e4100740 0x7f65e419ea60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f65e000e9a0 tx=0x7f65e000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 -- 172.21.15.59:0/3868348722 shutdown_connections 2023-10-08T12:41:18.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f65d00a14d0 0x7f65d00a3990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e4106750 0x7f65e4198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e4100740 0x7f65e419ea60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 --2- 172.21.15.59:0/3868348722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e4101100 0x7f65e419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 -- 172.21.15.59:0/3868348722 >> 172.21.15.59:0/3868348722 conn(0x7f65e40fc230 msgr2=0x7f65e40fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 -- 172.21.15.59:0/3868348722 shutdown_connections 2023-10-08T12:41:18.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.252+0000 7f65ebfff700 1 -- 172.21.15.59:0/3868348722 wait complete. 2023-10-08T12:41:18.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:17 smithi059 ceph-mon[98489]: from='client.25312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:41:18.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:17 smithi059 ceph-mon[98489]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:41:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:17 smithi059 ceph-mon[98489]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2023-10-08T12:41:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:17 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1607388765' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:18.272 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:41:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:17 smithi092 ceph-mon[134093]: from='client.25312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:41:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:17 smithi092 ceph-mon[134093]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:41:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:17 smithi092 ceph-mon[134093]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2023-10-08T12:41:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:17 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1607388765' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:18.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.478+0000 7f952c7ff700 1 -- 172.21.15.59:0/3416611599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9524073540 msgr2=0x7f952410ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.478+0000 7f952c7ff700 1 --2- 172.21.15.59:0/3416611599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9524073540 0x7f952410ca30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9514009990 tx=0x7f9514009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.478+0000 7f952c7ff700 1 -- 172.21.15.59:0/3416611599 shutdown_connections 2023-10-08T12:41:18.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.478+0000 7f952c7ff700 1 --2- 172.21.15.59:0/3416611599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f952410cf70 0x7f952410f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.478+0000 7f952c7ff700 1 --2- 172.21.15.59:0/3416611599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9524072c20 0x7f9524073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.478+0000 7f952c7ff700 1 --2- 172.21.15.59:0/3416611599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9524073540 0x7f952410ca30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.478+0000 7f952c7ff700 1 -- 172.21.15.59:0/3416611599 >> 172.21.15.59:0/3416611599 conn(0x7f95240fc200 msgr2=0x7f95240fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.478+0000 7f952c7ff700 1 -- 172.21.15.59:0/3416611599 shutdown_connections 2023-10-08T12:41:18.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.478+0000 7f952c7ff700 1 -- 172.21.15.59:0/3416611599 wait complete. 2023-10-08T12:41:18.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.479+0000 7f952c7ff700 1 Processor -- start 2023-10-08T12:41:18.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.479+0000 7f952c7ff700 1 -- start start 2023-10-08T12:41:18.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952c7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9524072c20 0x7f9524198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952c7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9524073540 0x7f9524199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952c7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f952410cf70 0x7f952419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952c7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419dd70 con 0x7f9524072c20 2023-10-08T12:41:18.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952c7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419dee0 con 0x7f952410cf70 2023-10-08T12:41:18.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952c7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419e0a0 con 0x7f9524073540 2023-10-08T12:41:18.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952a59b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9524072c20 0x7f9524198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952a59b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9524072c20 0x7f9524198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43150/0 (socket says 172.21.15.59:43150) 2023-10-08T12:41:18.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952a59b700 1 -- 172.21.15.59:0/2816000443 learned_addr learned my addr 172.21.15.59:0/2816000443 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:18.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952ad9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f952410cf70 0x7f952419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f9529d9a700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9524073540 0x7f9524199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952a59b700 1 -- 172.21.15.59:0/2816000443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9524073540 msgr2=0x7f9524199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952a59b700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9524073540 0x7f9524199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952a59b700 1 -- 172.21.15.59:0/2816000443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f952410cf70 msgr2=0x7f952419d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952a59b700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f952410cf70 0x7f952419d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.480+0000 7f952a59b700 1 -- 172.21.15.59:0/2816000443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95140095f0 con 0x7f9524072c20 2023-10-08T12:41:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.481+0000 7f952a59b700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9524072c20 0x7f9524198e50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f952000e9a0 tx=0x7f952000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.481+0000 7f951b7fe700 1 -- 172.21.15.59:0/2816000443 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520009790 con 0x7f9524072c20 2023-10-08T12:41:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.481+0000 7f952c7ff700 1 -- 172.21.15.59:0/2816000443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952419e380 con 0x7f9524072c20 2023-10-08T12:41:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.481+0000 7f951b7fe700 1 -- 172.21.15.59:0/2816000443 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9520010430 con 0x7f9524072c20 2023-10-08T12:41:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.481+0000 7f951b7fe700 1 -- 172.21.15.59:0/2816000443 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520018680 con 0x7f9524072c20 2023-10-08T12:41:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.481+0000 7f952c7ff700 1 -- 172.21.15.59:0/2816000443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95241a5bc0 con 0x7f9524072c20 2023-10-08T12:41:18.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.482+0000 7f952c7ff700 1 -- 172.21.15.59:0/2816000443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9524108180 con 0x7f9524072c20 2023-10-08T12:41:18.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.484+0000 7f951b7fe700 1 -- 172.21.15.59:0/2816000443 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f95200105a0 con 0x7f9524072c20 2023-10-08T12:41:18.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.485+0000 7f951b7fe700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95100a14d0 0x7f95100a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.486+0000 7f951b7fe700 1 -- 172.21.15.59:0/2816000443 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9520014070 con 0x7f9524072c20 2023-10-08T12:41:18.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.486+0000 7f9529d9a700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95100a14d0 0x7f95100a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.486+0000 7f9529d9a700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95100a14d0 0x7f95100a3990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f952419a3a0 tx=0x7f9514005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.488+0000 7f951b7fe700 1 -- 172.21.15.59:0/2816000443 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f95200967a0 con 0x7f9524072c20 2023-10-08T12:41:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.700+0000 7f952c7ff700 1 -- 172.21.15.59:0/2816000443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f952419a150 con 0x7f9524072c20 2023-10-08T12:41:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.700+0000 7f951b7fe700 1 -- 172.21.15.59:0/2816000443 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9520099dc0 con 0x7f9524072c20 2023-10-08T12:41:18.701 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-08T12:41:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.702+0000 7f952c7ff700 1 -- 172.21.15.59:0/2816000443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95100a14d0 msgr2=0x7f95100a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.702+0000 7f952c7ff700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95100a14d0 0x7f95100a3990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f952419a3a0 tx=0x7f9514005fd0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.702+0000 7f952c7ff700 1 -- 172.21.15.59:0/2816000443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9524072c20 msgr2=0x7f9524198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.702+0000 7f952c7ff700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9524072c20 0x7f9524198e50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f952000e9a0 tx=0x7f952000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.702+0000 7f952c7ff700 1 -- 172.21.15.59:0/2816000443 shutdown_connections 2023-10-08T12:41:18.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.702+0000 7f952c7ff700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95100a14d0 0x7f95100a3990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.702+0000 7f952c7ff700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f952410cf70 0x7f952419d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.702+0000 7f952c7ff700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9524072c20 0x7f9524198e50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.702+0000 7f952c7ff700 1 --2- 172.21.15.59:0/2816000443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9524073540 0x7f9524199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.702+0000 7f952c7ff700 1 -- 172.21.15.59:0/2816000443 >> 172.21.15.59:0/2816000443 conn(0x7f95240fc200 msgr2=0x7f95240fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.703+0000 7f952c7ff700 1 -- 172.21.15.59:0/2816000443 shutdown_connections 2023-10-08T12:41:18.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.703+0000 7f952c7ff700 1 -- 172.21.15.59:0/2816000443 wait complete. 2023-10-08T12:41:18.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:41:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.981+0000 7f3aca3ff700 1 -- 172.21.15.59:0/158242632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ac4073540 msgr2=0x7f3ac410ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.981+0000 7f3aca3ff700 1 --2- 172.21.15.59:0/158242632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ac4073540 0x7f3ac410ca30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009990 tx=0x7f3ab8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.981+0000 7f3aca3ff700 1 -- 172.21.15.59:0/158242632 shutdown_connections 2023-10-08T12:41:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.981+0000 7f3aca3ff700 1 --2- 172.21.15.59:0/158242632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ac410cf70 0x7f3ac410f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.981+0000 7f3aca3ff700 1 --2- 172.21.15.59:0/158242632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ac4072c20 0x7f3ac4073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.981+0000 7f3aca3ff700 1 --2- 172.21.15.59:0/158242632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ac4073540 0x7f3ac410ca30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.981+0000 7f3aca3ff700 1 -- 172.21.15.59:0/158242632 >> 172.21.15.59:0/158242632 conn(0x7f3ac40fc200 msgr2=0x7f3ac40fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.981+0000 7f3aca3ff700 1 -- 172.21.15.59:0/158242632 shutdown_connections 2023-10-08T12:41:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.981+0000 7f3aca3ff700 1 -- 172.21.15.59:0/158242632 wait complete. 2023-10-08T12:41:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.982+0000 7f3aca3ff700 1 Processor -- start 2023-10-08T12:41:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.982+0000 7f3aca3ff700 1 -- start start 2023-10-08T12:41:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.982+0000 7f3aca3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ac4072c20 0x7f3ac4198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.982+0000 7f3aca3ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ac4073540 0x7f3ac4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.982+0000 7f3aca3ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ac410cf70 0x7f3ac419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.982+0000 7f3aca3ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac419dd00 con 0x7f3ac410cf70 2023-10-08T12:41:18.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.982+0000 7f3aca3ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac419de70 con 0x7f3ac4073540 2023-10-08T12:41:18.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.982+0000 7f3aca3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac419e030 con 0x7f3ac4072c20 2023-10-08T12:41:18.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.983+0000 7f3ac899c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ac410cf70 0x7f3ac419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.983+0000 7f3ac899c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ac410cf70 0x7f3ac419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43176/0 (socket says 172.21.15.59:43176) 2023-10-08T12:41:18.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.983+0000 7f3ac899c700 1 -- 172.21.15.59:0/3062611122 learned_addr learned my addr 172.21.15.59:0/3062611122 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:18.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.983+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ac4073540 0x7f3ac4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.983+0000 7f3ac3fff700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ac4072c20 0x7f3ac4198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.983+0000 7f3ac899c700 1 -- 172.21.15.59:0/3062611122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ac4072c20 msgr2=0x7f3ac4198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.983+0000 7f3ac899c700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ac4072c20 0x7f3ac4198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.983+0000 7f3ac899c700 1 -- 172.21.15.59:0/3062611122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ac4073540 msgr2=0x7f3ac4199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.983+0000 7f3ac899c700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ac4073540 0x7f3ac4199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.983+0000 7f3ac899c700 1 -- 172.21.15.59:0/3062611122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab80095f0 con 0x7f3ac410cf70 2023-10-08T12:41:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.983+0000 7f3ac899c700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ac410cf70 0x7f3ac419d6c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00ef30 tx=0x7f3abc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.984+0000 7f3ac17fa700 1 -- 172.21.15.59:0/3062611122 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc018070 con 0x7f3ac410cf70 2023-10-08T12:41:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.984+0000 7f3aca3ff700 1 -- 172.21.15.59:0/3062611122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac419e2b0 con 0x7f3ac410cf70 2023-10-08T12:41:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.984+0000 7f3ac17fa700 1 -- 172.21.15.59:0/3062611122 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3abc00f040 con 0x7f3ac410cf70 2023-10-08T12:41:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.984+0000 7f3ac17fa700 1 -- 172.21.15.59:0/3062611122 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc00cd00 con 0x7f3ac410cf70 2023-10-08T12:41:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.984+0000 7f3aca3ff700 1 -- 172.21.15.59:0/3062611122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac41a5b50 con 0x7f3ac410cf70 2023-10-08T12:41:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.985+0000 7f3aca3ff700 1 -- 172.21.15.59:0/3062611122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac4108180 con 0x7f3ac410cf70 2023-10-08T12:41:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.987+0000 7f3ac17fa700 1 -- 172.21.15.59:0/3062611122 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3abc003a00 con 0x7f3ac410cf70 2023-10-08T12:41:18.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.989+0000 7f3ac17fa700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3aac0a1550 0x7f3aac0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.989+0000 7f3ac17fa700 1 -- 172.21.15.59:0/3062611122 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f3abc0cd2a0 con 0x7f3ac410cf70 2023-10-08T12:41:18.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.989+0000 7f3ac3fff700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3aac0a1550 0x7f3aac0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.990+0000 7f3ac3fff700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3aac0a1550 0x7f3aac0a3a10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009c60 tx=0x7f3ab4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:18.992+0000 7f3ac17fa700 1 -- 172.21.15.59:0/3062611122 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3abc096890 con 0x7f3ac410cf70 2023-10-08T12:41:19.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:18 smithi059 ceph-mon[98489]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:41:19.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:18 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3868348722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:19.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:18 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2816000443' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:19.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.202+0000 7f3aca3ff700 1 -- 172.21.15.59:0/3062611122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ac419a0e0 con 0x7f3ac410cf70 2023-10-08T12:41:19.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.202+0000 7f3ac17fa700 1 -- 172.21.15.59:0/3062611122 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3abc099eb0 con 0x7f3ac410cf70 2023-10-08T12:41:19.204 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-08T12:41:19.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 -- 172.21.15.59:0/3062611122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3aac0a1550 msgr2=0x7f3aac0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3aac0a1550 0x7f3aac0a3a10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009c60 tx=0x7f3ab4009260 comp rx=0 tx=0).stop 2023-10-08T12:41:19.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 -- 172.21.15.59:0/3062611122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ac410cf70 msgr2=0x7f3ac419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ac410cf70 0x7f3ac419d6c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00ef30 tx=0x7f3abc00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 -- 172.21.15.59:0/3062611122 shutdown_connections 2023-10-08T12:41:19.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3aac0a1550 0x7f3aac0a3a10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ac410cf70 0x7f3ac419d6c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ac4072c20 0x7f3ac4198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 --2- 172.21.15.59:0/3062611122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ac4073540 0x7f3ac4199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 -- 172.21.15.59:0/3062611122 >> 172.21.15.59:0/3062611122 conn(0x7f3ac40fc200 msgr2=0x7f3ac40fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 -- 172.21.15.59:0/3062611122 shutdown_connections 2023-10-08T12:41:19.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.205+0000 7f3aca3ff700 1 -- 172.21.15.59:0/3062611122 wait complete. 2023-10-08T12:41:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:18 smithi173 ceph-mon[135182]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:41:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:18 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3868348722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:19.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:18 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2816000443' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:19.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:41:19.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:18 smithi092 ceph-mon[134093]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:41:19.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:18 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3868348722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:41:19.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:18 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2816000443' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:41:19.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.428+0000 7fa8999ff700 1 -- 172.21.15.59:0/3419887725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa894106640 msgr2=0x7fa894106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.428+0000 7fa8999ff700 1 --2- 172.21.15.59:0/3419887725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa894106640 0x7fa894106a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa884009990 tx=0x7fa884009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.428+0000 7fa8999ff700 1 -- 172.21.15.59:0/3419887725 shutdown_connections 2023-10-08T12:41:19.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.428+0000 7fa8999ff700 1 --2- 172.21.15.59:0/3419887725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa894100ff0 0x7fa89410d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.428+0000 7fa8999ff700 1 --2- 172.21.15.59:0/3419887725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa894106640 0x7fa894106a20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.428+0000 7fa8999ff700 1 --2- 172.21.15.59:0/3419887725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa894100630 0x7fa894100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.428+0000 7fa8999ff700 1 -- 172.21.15.59:0/3419887725 >> 172.21.15.59:0/3419887725 conn(0x7fa8940fc140 msgr2=0x7fa8940fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.428+0000 7fa8999ff700 1 -- 172.21.15.59:0/3419887725 shutdown_connections 2023-10-08T12:41:19.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.428+0000 7fa8999ff700 1 -- 172.21.15.59:0/3419887725 wait complete. 2023-10-08T12:41:19.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.429+0000 7fa8999ff700 1 Processor -- start 2023-10-08T12:41:19.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.429+0000 7fa8999ff700 1 -- start start 2023-10-08T12:41:19.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.429+0000 7fa8999ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa894100630 0x7fa894072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa8999ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa894100ff0 0x7fa894073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa8999ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa894106640 0x7fa894073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa8999ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941a4eb0 con 0x7fa894106640 2023-10-08T12:41:19.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa8999ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941a5020 con 0x7fa894100630 2023-10-08T12:41:19.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa8999ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941a51e0 con 0x7fa894100ff0 2023-10-08T12:41:19.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa892ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa894100630 0x7fa894072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa892ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa894100630 0x7fa894072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:40946/0 (socket says 172.21.15.59:40946) 2023-10-08T12:41:19.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa892ffd700 1 -- 172.21.15.59:0/541596075 learned_addr learned my addr 172.21.15.59:0/541596075 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:19.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa8937fe700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa894106640 0x7fa894073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa88bfff700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa894100ff0 0x7fa894073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa892ffd700 1 -- 172.21.15.59:0/541596075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa894100ff0 msgr2=0x7fa894073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa892ffd700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa894100ff0 0x7fa894073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa892ffd700 1 -- 172.21.15.59:0/541596075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa894106640 msgr2=0x7fa894073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa892ffd700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa894106640 0x7fa894073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.430+0000 7fa892ffd700 1 -- 172.21.15.59:0/541596075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8840095f0 con 0x7fa894100630 2023-10-08T12:41:19.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.431+0000 7fa892ffd700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa894100630 0x7fa894072af0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa884000c00 tx=0x7fa884005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.431+0000 7fa8989fd700 1 -- 172.21.15.59:0/541596075 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88401d070 con 0x7fa894100630 2023-10-08T12:41:19.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.431+0000 7fa8999ff700 1 -- 172.21.15.59:0/541596075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8941a5460 con 0x7fa894100630 2023-10-08T12:41:19.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.431+0000 7fa8989fd700 1 -- 172.21.15.59:0/541596075 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa884022470 con 0x7fa894100630 2023-10-08T12:41:19.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.431+0000 7fa8989fd700 1 -- 172.21.15.59:0/541596075 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884017650 con 0x7fa894100630 2023-10-08T12:41:19.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.431+0000 7fa8999ff700 1 -- 172.21.15.59:0/541596075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8941a5990 con 0x7fa894100630 2023-10-08T12:41:19.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.432+0000 7fa8999ff700 1 -- 172.21.15.59:0/541596075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa894108c30 con 0x7fa894100630 2023-10-08T12:41:19.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.434+0000 7fa8989fd700 1 -- 172.21.15.59:0/541596075 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa8840225e0 con 0x7fa894100630 2023-10-08T12:41:19.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.436+0000 7fa8989fd700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8800a14d0 0x7fa8800a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.436+0000 7fa8989fd700 1 -- 172.21.15.59:0/541596075 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa8840ce7f0 con 0x7fa894100630 2023-10-08T12:41:19.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.436+0000 7fa88bfff700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8800a14d0 0x7fa8800a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.437+0000 7fa88bfff700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8800a14d0 0x7fa8800a3990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa894074220 tx=0x7fa87c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.437+0000 7fa8989fd700 1 -- 172.21.15.59:0/541596075 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa884097de0 con 0x7fa894100630 2023-10-08T12:41:19.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.699+0000 7fa8999ff700 1 -- 172.21.15.59:0/541596075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa894073fd0 con 0x7fa894100630 2023-10-08T12:41:19.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.701+0000 7fa8989fd700 1 -- 172.21.15.59:0/541596075 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fa88409b400 con 0x7fa894100630 2023-10-08T12:41:19.702 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:19.702 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:41:19.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.703+0000 7fa8999ff700 1 -- 172.21.15.59:0/541596075 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8800a14d0 msgr2=0x7fa8800a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.703+0000 7fa8999ff700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8800a14d0 0x7fa8800a3990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa894074220 tx=0x7fa87c009260 comp rx=0 tx=0).stop 2023-10-08T12:41:19.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.703+0000 7fa8999ff700 1 -- 172.21.15.59:0/541596075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa894100630 msgr2=0x7fa894072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.703+0000 7fa8999ff700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa894100630 0x7fa894072af0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa884000c00 tx=0x7fa884005740 comp rx=0 tx=0).stop 2023-10-08T12:41:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.703+0000 7fa8999ff700 1 -- 172.21.15.59:0/541596075 shutdown_connections 2023-10-08T12:41:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.703+0000 7fa8999ff700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa8800a14d0 0x7fa8800a3990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.703+0000 7fa8999ff700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa894100630 0x7fa894072af0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.703+0000 7fa8999ff700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa894106640 0x7fa894073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.703+0000 7fa8999ff700 1 --2- 172.21.15.59:0/541596075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa894100ff0 0x7fa894073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.703+0000 7fa8999ff700 1 -- 172.21.15.59:0/541596075 >> 172.21.15.59:0/541596075 conn(0x7fa8940fc140 msgr2=0x7fa8940fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.704+0000 7fa8999ff700 1 -- 172.21.15.59:0/541596075 shutdown_connections 2023-10-08T12:41:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.704+0000 7fa8999ff700 1 -- 172.21.15.59:0/541596075 wait complete. 2023-10-08T12:41:19.706 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:41:19.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:41:19.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.929+0000 7f8a55bff700 1 -- 172.21.15.59:0/171490927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a50106640 msgr2=0x7f8a50106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.929+0000 7f8a55bff700 1 --2- 172.21.15.59:0/171490927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a50106640 0x7f8a50106a20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009990 tx=0x7f8a40009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.929+0000 7f8a55bff700 1 -- 172.21.15.59:0/171490927 shutdown_connections 2023-10-08T12:41:19.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.929+0000 7f8a55bff700 1 --2- 172.21.15.59:0/171490927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a50100ff0 0x7f8a5010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.929+0000 7f8a55bff700 1 --2- 172.21.15.59:0/171490927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a50106640 0x7f8a50106a20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.929+0000 7f8a55bff700 1 --2- 172.21.15.59:0/171490927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a50100630 0x7f8a50100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.929+0000 7f8a55bff700 1 -- 172.21.15.59:0/171490927 >> 172.21.15.59:0/171490927 conn(0x7f8a500fc140 msgr2=0x7f8a500fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.929+0000 7f8a55bff700 1 -- 172.21.15.59:0/171490927 shutdown_connections 2023-10-08T12:41:19.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.929+0000 7f8a55bff700 1 -- 172.21.15.59:0/171490927 wait complete. 2023-10-08T12:41:19.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.930+0000 7f8a55bff700 1 Processor -- start 2023-10-08T12:41:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.930+0000 7f8a55bff700 1 -- start start 2023-10-08T12:41:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.930+0000 7f8a55bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a50100630 0x7f8a5019ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.930+0000 7f8a55bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a50100ff0 0x7f8a5019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a55bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a50106640 0x7f8a50198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a55bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a50199190 con 0x7f8a50100ff0 2023-10-08T12:41:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a55bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a50199300 con 0x7f8a50100630 2023-10-08T12:41:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a55bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a501994c0 con 0x7f8a50106640 2023-10-08T12:41:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a4effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a50100ff0 0x7f8a5019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a4effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a50100ff0 0x7f8a5019ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43208/0 (socket says 172.21.15.59:43208) 2023-10-08T12:41:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a4effd700 1 -- 172.21.15.59:0/1322265799 learned_addr learned my addr 172.21.15.59:0/1322265799 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a4f7fe700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a50100630 0x7f8a5019ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a4ffff700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a50106640 0x7f8a50198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a4effd700 1 -- 172.21.15.59:0/1322265799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a50106640 msgr2=0x7f8a50198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a4effd700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a50106640 0x7f8a50198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a4effd700 1 -- 172.21.15.59:0/1322265799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a50100630 msgr2=0x7f8a5019ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a4effd700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a50100630 0x7f8a5019ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a4effd700 1 -- 172.21.15.59:0/1322265799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a400095f0 con 0x7f8a50100ff0 2023-10-08T12:41:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.931+0000 7f8a4effd700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a50100ff0 0x7f8a5019ef40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400e9a0 tx=0x7f8a4400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.932+0000 7f8a4cff9700 1 -- 172.21.15.59:0/1322265799 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44009790 con 0x7f8a50100ff0 2023-10-08T12:41:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.932+0000 7f8a4cff9700 1 -- 172.21.15.59:0/1322265799 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a44010430 con 0x7f8a50100ff0 2023-10-08T12:41:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.932+0000 7f8a55bff700 1 -- 172.21.15.59:0/1322265799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a501997a0 con 0x7f8a50100ff0 2023-10-08T12:41:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.932+0000 7f8a4cff9700 1 -- 172.21.15.59:0/1322265799 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44018680 con 0x7f8a50100ff0 2023-10-08T12:41:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.932+0000 7f8a55bff700 1 -- 172.21.15.59:0/1322265799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a501a59f0 con 0x7f8a50100ff0 2023-10-08T12:41:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.933+0000 7f8a55bff700 1 -- 172.21.15.59:0/1322265799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a50101d70 con 0x7f8a50100ff0 2023-10-08T12:41:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.935+0000 7f8a4cff9700 1 -- 172.21.15.59:0/1322265799 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8a440105a0 con 0x7f8a50100ff0 2023-10-08T12:41:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.936+0000 7f8a4cff9700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a380a1550 0x7f8a380a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.936+0000 7f8a4cff9700 1 -- 172.21.15.59:0/1322265799 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8a44014070 con 0x7f8a50100ff0 2023-10-08T12:41:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.937+0000 7f8a4f7fe700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a380a1550 0x7f8a380a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.937+0000 7f8a4f7fe700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a380a1550 0x7f8a380a3a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006010 tx=0x7f8a4000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:19.938+0000 7f8a4cff9700 1 -- 172.21.15.59:0/1322265799 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8a440967b0 con 0x7f8a50100ff0 2023-10-08T12:41:20.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:19 smithi059 ceph-mon[98489]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2023-10-08T12:41:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:19 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3062611122' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:20.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:19 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/541596075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:20.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.151+0000 7f8a55bff700 1 -- 172.21.15.59:0/1322265799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a50067450 con 0x7f8a50100ff0 2023-10-08T12:41:20.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.153+0000 7f8a4cff9700 1 -- 172.21.15.59:0/1322265799 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22725 (secure 0 0 0) 0x7f8a44026020 con 0x7f8a50100ff0 2023-10-08T12:41:20.154 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:20.154 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":86,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T12:40:11.783762+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:41:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 -- 172.21.15.59:0/1322265799 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a380a1550 msgr2=0x7f8a380a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a380a1550 0x7f8a380a3a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006010 tx=0x7f8a4000b260 comp rx=0 tx=0).stop 2023-10-08T12:41:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 -- 172.21.15.59:0/1322265799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a50100ff0 msgr2=0x7f8a5019ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a50100ff0 0x7f8a5019ef40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400e9a0 tx=0x7f8a4400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 -- 172.21.15.59:0/1322265799 shutdown_connections 2023-10-08T12:41:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8a380a1550 0x7f8a380a3a10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a50100630 0x7f8a5019ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a50106640 0x7f8a50198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 --2- 172.21.15.59:0/1322265799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a50100ff0 0x7f8a5019ef40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 -- 172.21.15.59:0/1322265799 >> 172.21.15.59:0/1322265799 conn(0x7f8a500fc140 msgr2=0x7f8a500fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 -- 172.21.15.59:0/1322265799 shutdown_connections 2023-10-08T12:41:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.155+0000 7f8a55bff700 1 -- 172.21.15.59:0/1322265799 wait complete. 2023-10-08T12:41:20.176 DEBUG:tasks.fwd_scrub:Yielding 2023-10-08T12:41:20.176 INFO:teuthology.run_tasks:Running task exec... 2023-10-08T12:41:20.187 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T12:41:20.187 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2023-10-08T12:41:20.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2023-10-08T12:41:20.188 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-08T12:41:20.188 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:41:20.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:41:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:19 smithi173 ceph-mon[135182]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2023-10-08T12:41:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:19 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3062611122' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:19 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/541596075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:19 smithi092 ceph-mon[134093]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2023-10-08T12:41:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:19 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3062611122' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:41:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:19 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/541596075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:20.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.390+0000 7fed6c9ff700 1 -- 172.21.15.59:0/3666777679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed681006c0 msgr2=0x7fed68100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.390+0000 7fed6c9ff700 1 --2- 172.21.15.59:0/3666777679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed681006c0 0x7fed68100b40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009990 tx=0x7fed5c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.390+0000 7fed6c9ff700 1 -- 172.21.15.59:0/3666777679 shutdown_connections 2023-10-08T12:41:20.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.390+0000 7fed6c9ff700 1 --2- 172.21.15.59:0/3666777679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed681066d0 0x7fed68106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.390+0000 7fed6c9ff700 1 --2- 172.21.15.59:0/3666777679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed68101080 0x7fed6810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.390+0000 7fed6c9ff700 1 --2- 172.21.15.59:0/3666777679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed681006c0 0x7fed68100b40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.390+0000 7fed6c9ff700 1 -- 172.21.15.59:0/3666777679 >> 172.21.15.59:0/3666777679 conn(0x7fed680fc190 msgr2=0x7fed680fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.390+0000 7fed6c9ff700 1 -- 172.21.15.59:0/3666777679 shutdown_connections 2023-10-08T12:41:20.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.390+0000 7fed6c9ff700 1 -- 172.21.15.59:0/3666777679 wait complete. 2023-10-08T12:41:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.391+0000 7fed6c9ff700 1 Processor -- start 2023-10-08T12:41:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed6c9ff700 1 -- start start 2023-10-08T12:41:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed6c9ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed681006c0 0x7fed68198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed6c9ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed68101080 0x7fed68199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed6c9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed681066d0 0x7fed6819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed6c9ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6819cb50 con 0x7fed681006c0 2023-10-08T12:41:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed6c9ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6819ccc0 con 0x7fed68101080 2023-10-08T12:41:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed6c9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6819ce80 con 0x7fed681066d0 2023-10-08T12:41:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed6659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed681006c0 0x7fed68198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed6659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed681006c0 0x7fed68198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43228/0 (socket says 172.21.15.59:43228) 2023-10-08T12:41:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed6659c700 1 -- 172.21.15.59:0/2725401286 learned_addr learned my addr 172.21.15.59:0/2725401286 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed66d9d700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed681066d0 0x7fed6819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.392+0000 7fed65d9b700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed68101080 0x7fed68199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.393+0000 7fed6659c700 1 -- 172.21.15.59:0/2725401286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed681066d0 msgr2=0x7fed6819c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.393+0000 7fed6659c700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed681066d0 0x7fed6819c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.393+0000 7fed6659c700 1 -- 172.21.15.59:0/2725401286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed68101080 msgr2=0x7fed68199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.393+0000 7fed6659c700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed68101080 0x7fed68199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.393+0000 7fed6659c700 1 -- 172.21.15.59:0/2725401286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0095f0 con 0x7fed681006c0 2023-10-08T12:41:20.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.393+0000 7fed6659c700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed681006c0 0x7fed68198d20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fed5800e9a0 tx=0x7fed5800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.393+0000 7fed577fe700 1 -- 172.21.15.59:0/2725401286 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58009790 con 0x7fed681006c0 2023-10-08T12:41:20.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.393+0000 7fed577fe700 1 -- 172.21.15.59:0/2725401286 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed58010430 con 0x7fed681006c0 2023-10-08T12:41:20.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.393+0000 7fed577fe700 1 -- 172.21.15.59:0/2725401286 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58018680 con 0x7fed681006c0 2023-10-08T12:41:20.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.393+0000 7fed6c9ff700 1 -- 172.21.15.59:0/2725401286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6819d160 con 0x7fed681006c0 2023-10-08T12:41:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.393+0000 7fed6c9ff700 1 -- 172.21.15.59:0/2725401286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed681a5ac0 con 0x7fed681006c0 2023-10-08T12:41:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.394+0000 7fed6c9ff700 1 -- 172.21.15.59:0/2725401286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed68101e00 con 0x7fed681006c0 2023-10-08T12:41:20.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.397+0000 7fed577fe700 1 -- 172.21.15.59:0/2725401286 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fed580105a0 con 0x7fed681006c0 2023-10-08T12:41:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.399+0000 7fed577fe700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fed500a14d0 0x7fed500a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.399+0000 7fed577fe700 1 -- 172.21.15.59:0/2725401286 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fed58014070 con 0x7fed681006c0 2023-10-08T12:41:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.399+0000 7fed65d9b700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fed500a14d0 0x7fed500a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.400+0000 7fed65d9b700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fed500a14d0 0x7fed500a3990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fed6819a2d0 tx=0x7fed5c005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.403+0000 7fed577fe700 1 -- 172.21.15.59:0/2725401286 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fed58052100 con 0x7fed681006c0 2023-10-08T12:41:20.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.404+0000 7f86921ff700 1 -- 172.21.15.59:0/3468127516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c073540 msgr2=0x7f868c10ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.404+0000 7f86921ff700 1 --2- 172.21.15.59:0/3468127516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c073540 0x7f868c10ca40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8680009990 tx=0x7f8680009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.404+0000 7f86921ff700 1 -- 172.21.15.59:0/3468127516 shutdown_connections 2023-10-08T12:41:20.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.404+0000 7f86921ff700 1 --2- 172.21.15.59:0/3468127516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c072c20 0x7f868c073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.404+0000 7f86921ff700 1 --2- 172.21.15.59:0/3468127516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f868c10cf80 0x7f868c10f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.404+0000 7f86921ff700 1 --2- 172.21.15.59:0/3468127516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c073540 0x7f868c10ca40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.404+0000 7f86921ff700 1 -- 172.21.15.59:0/3468127516 >> 172.21.15.59:0/3468127516 conn(0x7f868c0fc230 msgr2=0x7f868c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.404+0000 7f86921ff700 1 -- 172.21.15.59:0/3468127516 shutdown_connections 2023-10-08T12:41:20.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.404+0000 7f86921ff700 1 -- 172.21.15.59:0/3468127516 wait complete. 2023-10-08T12:41:20.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.405+0000 7f86921ff700 1 Processor -- start 2023-10-08T12:41:20.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.405+0000 7f86921ff700 1 -- start start 2023-10-08T12:41:20.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f86921ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c072c20 0x7f868c198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f86921ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f868c073540 0x7f868c199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f86921ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c10cf80 0x7f868c19d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f86921ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c19dd60 con 0x7f868c10cf80 2023-10-08T12:41:20.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f86921ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c19ded0 con 0x7f868c072c20 2023-10-08T12:41:20.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f86921ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c19e090 con 0x7f868c073540 2023-10-08T12:41:20.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f868b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c072c20 0x7f868c198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f868b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c072c20 0x7f868c198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:40994/0 (socket says 172.21.15.59:40994) 2023-10-08T12:41:20.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f868b7fe700 1 -- 172.21.15.59:0/3927708324 learned_addr learned my addr 172.21.15.59:0/3927708324 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:20.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f868affd700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f868c073540 0x7f868c199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f868bfff700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c10cf80 0x7f868c19d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.406+0000 7f868b7fe700 1 -- 172.21.15.59:0/3927708324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f868c073540 msgr2=0x7f868c199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f868b7fe700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f868c073540 0x7f868c199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f868b7fe700 1 -- 172.21.15.59:0/3927708324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c10cf80 msgr2=0x7f868c19d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f868b7fe700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c10cf80 0x7f868c19d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f868b7fe700 1 -- 172.21.15.59:0/3927708324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800095f0 con 0x7f868c072c20 2023-10-08T12:41:20.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f868bfff700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c10cf80 0x7f868c19d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:20.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f868affd700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f868c073540 0x7f868c199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:20.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f868b7fe700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c072c20 0x7f868c198e40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f867c00e9a0 tx=0x7f867c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f8688ff9700 1 -- 172.21.15.59:0/3927708324 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c009790 con 0x7f868c072c20 2023-10-08T12:41:20.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f8688ff9700 1 -- 172.21.15.59:0/3927708324 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f867c00cbd0 con 0x7f868c072c20 2023-10-08T12:41:20.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f86921ff700 1 -- 172.21.15.59:0/3927708324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c19e370 con 0x7f868c072c20 2023-10-08T12:41:20.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f8688ff9700 1 -- 172.21.15.59:0/3927708324 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c018680 con 0x7f868c072c20 2023-10-08T12:41:20.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.407+0000 7f86921ff700 1 -- 172.21.15.59:0/3927708324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c1a5bb0 con 0x7f868c072c20 2023-10-08T12:41:20.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.412+0000 7f86a5bc2b80 1 Processor -- start 2023-10-08T12:41:20.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.412+0000 7f86a5bc2b80 1 -- start start 2023-10-08T12:41:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.412+0000 7f8688ff9700 1 -- 172.21.15.59:0/3927708324 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f867c00cd40 con 0x7f868c072c20 2023-10-08T12:41:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af2529f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529f820 0x55af252aa190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af252acac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af252084e0 con 0x55af2529f820 2023-10-08T12:41:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af251f9ca0 con 0x55af2529ef00 2023-10-08T12:41:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af251f75c0 con 0x55af252aa6d0 2023-10-08T12:41:20.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f868bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af2529f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f868b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529f820 0x55af252aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f868bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af2529f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41000/0 (socket says 172.21.15.59:41000) 2023-10-08T12:41:20.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f868affd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af252acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f868bfff700 1 -- 172.21.15.59:0/949338255 learned_addr learned my addr 172.21.15.59:0/949338255 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:20.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f868bfff700 1 -- 172.21.15.59:0/949338255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 msgr2=0x55af252acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f868bfff700 1 --2- 172.21.15.59:0/949338255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af252acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f868bfff700 1 -- 172.21.15.59:0/949338255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529f820 msgr2=0x55af252aa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f868bfff700 1 --2- 172.21.15.59:0/949338255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529f820 0x55af252aa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.413+0000 7f868bfff700 1 -- 172.21.15.59:0/949338255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af2501de60 con 0x55af2529ef00 2023-10-08T12:41:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.414+0000 7f868bfff700 1 --2- 172.21.15.59:0/949338255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af2529f2e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8684009470 tx=0x7f8684009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddc12292ee88ab72 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.414+0000 7f8671ffb700 1 -- 172.21.15.59:0/949338255 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400e070 con 0x55af2529ef00 2023-10-08T12:41:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.414+0000 7f8671ffb700 1 -- 172.21.15.59:0/949338255 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f868400f040 con 0x55af2529ef00 2023-10-08T12:41:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.414+0000 7f8671ffb700 1 -- 172.21.15.59:0/949338255 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684015b90 con 0x55af2529ef00 2023-10-08T12:41:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.414+0000 7f8688ff9700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86740a14d0 0x7f86740a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.414+0000 7f8688ff9700 1 -- 172.21.15.59:0/3927708324 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f867c014070 con 0x7f868c072c20 2023-10-08T12:41:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.415+0000 7f868b7fe700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86740a14d0 0x7f86740a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.415+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/949338255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 msgr2=0x55af2529f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.415+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/949338255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af2529f2e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8684009470 tx=0x7f8684009920 comp rx=0 tx=0).stop 2023-10-08T12:41:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.415+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/949338255 shutdown_connections 2023-10-08T12:41:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.415+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/949338255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af2529f2e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.415+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/949338255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af252acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.415+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/949338255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529f820 0x55af252aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.415+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/949338255 >> 172.21.15.59:0/949338255 conn(0x55af252142e0 msgr2=0x55af2529b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.415+0000 7f868b7fe700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86740a14d0 0x7f86740a3990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f867c09a020 tx=0x7f867c0d0980 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.415+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/949338255 shutdown_connections 2023-10-08T12:41:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.415+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/949338255 wait complete. 2023-10-08T12:41:20.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.416+0000 7f86a5bc2b80 1 -- start start 2023-10-08T12:41:20.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.416+0000 7f86a5bc2b80 1 Processor -- start 2023-10-08T12:41:20.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.417+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 0x55af252aa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.417+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af2529f820 0x55af252a73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.417+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af252aa6d0 0x55af252a7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.417+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af251f2eb0 con 0x55af2529ef00 2023-10-08T12:41:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.417+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2518f790 con 0x55af252aa6d0 2023-10-08T12:41:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.417+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2518f430 con 0x55af2529f820 2023-10-08T12:41:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.417+0000 7f86a5bc2b80 10 client.0 _ll_register_callbacks cb 0x55af24fec880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.417+0000 7f868bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 0x55af252aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f868bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 0x55af252aa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43260/0 (socket says 172.21.15.59:43260) 2023-10-08T12:41:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f868bfff700 1 -- 172.21.15.59:0/3762624050 learned_addr learned my addr 172.21.15.59:0/3762624050 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f868bfff700 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af252aa6d0 0x55af252a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f868affd700 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af2529f820 0x55af252a73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f868bfff700 1 -- 172.21.15.59:0/3762624050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af2529f820 msgr2=0x55af252a73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f868bfff700 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af2529f820 0x55af252a73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f868bfff700 1 -- 172.21.15.59:0/3762624050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af252aa6d0 msgr2=0x55af252a7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f868bfff700 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af252aa6d0 0x55af252a7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f868bfff700 1 -- 172.21.15.59:0/3762624050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86840090f0 con 0x55af2529ef00 2023-10-08T12:41:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f868bfff700 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 0x55af252aa080 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8684014040 tx=0x7f8684015440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96769661ad3e0436 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f866affd700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:41:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.418+0000 7f866affd700 1 -- 172.21.15.59:0/3762624050 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400e040 con 0x55af2529ef00 2023-10-08T12:41:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.419+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/3762624050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af251baf30 con 0x55af2529ef00 2023-10-08T12:41:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.419+0000 7f866affd700 1 -- 172.21.15.59:0/3762624050 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8684013750 con 0x55af2529ef00 2023-10-08T12:41:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.419+0000 7f866affd700 1 -- 172.21.15.59:0/3762624050 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8684013910 con 0x55af2529ef00 2023-10-08T12:41:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.419+0000 7f86a5bc2b80 10 client.15384 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.419+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/3762624050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55af25006ce0 con 0x55af2529ef00 2023-10-08T12:41:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.419+0000 7f866affd700 1 -- 172.21.15.59:0/3762624050 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55af251baf30 con 0x55af2529ef00 2023-10-08T12:41:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.419+0000 7f866affd700 1 -- 172.21.15.59:0/3762624050 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f868401c050 con 0x55af2529ef00 2023-10-08T12:41:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.419+0000 7f86a5bc2b80 10 client.15384 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.419+0000 7f86a5bc2b80 10 client.15384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.420+0000 7f86a5bc2b80 20 client.15384 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.420+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55af252ba050 0x55af252bc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.420+0000 7f86a5bc2b80 4 client.15384 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.420+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/3762624050 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af251ebe90 con 0x55af252ba050 2023-10-08T12:41:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.420+0000 7f868affd700 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55af252ba050 0x55af252bc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.420+0000 7f868affd700 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55af252ba050 0x55af252bc470 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c51cb3982a360c9d server_cookie=c0a9d77e9a615c2e in_seq=0 out_seq=0 2023-10-08T12:41:20.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.420+0000 7f866affd700 10 client.15384 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:20.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.421+0000 7f866affd700 1 -- 172.21.15.59:0/3762624050 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55af251ebe90 con 0x55af252ba050 2023-10-08T12:41:20.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.421+0000 7f866affd700 10 client.15384 handle_command_reply: tid=0 2023-10-08T12:41:20.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.421+0000 7f86a5bc2b80 1 client.15384 shutdown 2023-10-08T12:41:20.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.421+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/3762624050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 msgr2=0x55af252aa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.421+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 0x55af252aa080 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8684014040 tx=0x7f8684015440 comp rx=0 tx=0).stop 2023-10-08T12:41:20.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.422+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/3762624050 shutdown_connections 2023-10-08T12:41:20.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.422+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55af252ba050 0x55af252bc470 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.422+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af252aa6d0 0x55af252a7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.422+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 0x55af252aa080 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.422+0000 7f866affd700 0 client.15384 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:20.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.422+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/3762624050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af2529f820 0x55af252a73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.422+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/3762624050 >> 172.21.15.59:0/3762624050 conn(0x55af252142e0 msgr2=0x55af2529af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.422+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/3762624050 shutdown_connections 2023-10-08T12:41:20.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.422+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/3762624050 wait complete. 2023-10-08T12:41:20.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.422+0000 7f86a5bc2b80 20 client.15384 trim_cache size 0 max 16384 2023-10-08T12:41:20.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f86a5bc2b80 1 Processor -- start 2023-10-08T12:41:20.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f86a5bc2b80 1 -- start start 2023-10-08T12:41:20.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 0x55af252b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529f820 0x55af252a2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af2529add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af250739a0 con 0x55af2529ef00 2023-10-08T12:41:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af252a8940 con 0x55af2529f820 2023-10-08T12:41:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af252955f0 con 0x55af252aa6d0 2023-10-08T12:41:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f868bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 0x55af252b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f868affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529f820 0x55af252a2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f868affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529f820 0x55af252a2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41006/0 (socket says 172.21.15.59:41006) 2023-10-08T12:41:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f868affd700 1 -- 172.21.15.59:0/2020322470 learned_addr learned my addr 172.21.15.59:0/2020322470 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.440+0000 7f868bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 0x55af252b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43262/0 (socket says 172.21.15.59:43262) 2023-10-08T12:41:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.441+0000 7f868bfff700 1 --2- 172.21.15.59:0/2020322470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af2529add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.441+0000 7f868affd700 1 -- 172.21.15.59:0/2020322470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 msgr2=0x55af2529add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.441+0000 7f868affd700 1 --2- 172.21.15.59:0/2020322470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af2529add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.441+0000 7f868affd700 1 -- 172.21.15.59:0/2020322470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 msgr2=0x55af252b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.441+0000 7f868affd700 1 --2- 172.21.15.59:0/2020322470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 0x55af252b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.441+0000 7f868affd700 1 -- 172.21.15.59:0/2020322470 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af2529a820 con 0x55af2529f820 2023-10-08T12:41:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.441+0000 7f868bfff700 1 --2- 172.21.15.59:0/2020322470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af2529add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.441+0000 7f868affd700 1 --2- 172.21.15.59:0/2020322470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529f820 0x55af252a2730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8680009990 tx=0x7f868000b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc36da2e7983ab31 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.441+0000 7f86727fc700 1 -- 172.21.15.59:0/2020322470 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868001d040 con 0x55af2529f820 2023-10-08T12:41:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.442+0000 7f86727fc700 1 -- 172.21.15.59:0/2020322470 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f868001e040 con 0x55af2529f820 2023-10-08T12:41:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.442+0000 7f86727fc700 1 -- 172.21.15.59:0/2020322470 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680004500 con 0x55af2529f820 2023-10-08T12:41:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.442+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/2020322470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529f820 msgr2=0x55af252a2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.442+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/2020322470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529f820 0x55af252a2730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8680009990 tx=0x7f868000b260 comp rx=0 tx=0).stop 2023-10-08T12:41:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.442+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/2020322470 shutdown_connections 2023-10-08T12:41:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.442+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/2020322470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af2529add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.442+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/2020322470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529ef00 0x55af252b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.442+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/2020322470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529f820 0x55af252a2730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.442+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/2020322470 >> 172.21.15.59:0/2020322470 conn(0x55af252142e0 msgr2=0x55af25296fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.442+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/2020322470 shutdown_connections 2023-10-08T12:41:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.442+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/2020322470 wait complete. 2023-10-08T12:41:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.443+0000 7f86a5bc2b80 1 -- start start 2023-10-08T12:41:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.443+0000 7f86a5bc2b80 1 Processor -- start 2023-10-08T12:41:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.443+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af252b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.443+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529f820 0x55af252b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.443+0000 7f86a5bc2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af25307380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.443+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af25307930 con 0x55af2529f820 2023-10-08T12:41:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.443+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af25307aa0 con 0x55af2529ef00 2023-10-08T12:41:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.443+0000 7f86a5bc2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af25307c60 con 0x55af252aa6d0 2023-10-08T12:41:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.443+0000 7f86a5bc2b80 10 client.0 _ll_register_callbacks cb 0x7f867c0d0850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f868bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af252b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f868affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529f820 0x55af252b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f868bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af252b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41008/0 (socket says 172.21.15.59:41008) 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f868bfff700 1 -- 172.21.15.59:0/1776026322 learned_addr learned my addr 172.21.15.59:0/1776026322 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f868bfff700 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af25307380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f868bfff700 1 -- 172.21.15.59:0/1776026322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 msgr2=0x55af25307380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f868bfff700 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af25307380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f868bfff700 1 -- 172.21.15.59:0/1776026322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529f820 msgr2=0x55af252b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f868bfff700 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529f820 0x55af252b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f868bfff700 1 -- 172.21.15.59:0/1776026322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c1100b0 con 0x55af2529ef00 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f868bfff700 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af252b07e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8684014040 tx=0x7f868402f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3a28591d757bbc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.444+0000 7f866affd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.445+0000 7f866affd700 1 -- 172.21.15.59:0/1776026322 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400e070 con 0x55af2529ef00 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.445+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/1776026322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f868400f040 con 0x55af2529ef00 2023-10-08T12:41:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.445+0000 7f866affd700 1 -- 172.21.15.59:0/1776026322 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8684016450 con 0x55af2529ef00 2023-10-08T12:41:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.445+0000 7f866affd700 1 -- 172.21.15.59:0/1776026322 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8684003a00 con 0x55af2529ef00 2023-10-08T12:41:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.445+0000 7f86a5bc2b80 10 client.25385 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.445+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/1776026322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55af250442d0 con 0x55af2529ef00 2023-10-08T12:41:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.445+0000 7f866affd700 1 -- 172.21.15.59:0/1776026322 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8684046080 con 0x55af2529ef00 2023-10-08T12:41:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.446+0000 7f866affd700 1 -- 172.21.15.59:0/1776026322 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f868401c070 con 0x55af2529ef00 2023-10-08T12:41:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.446+0000 7f86a5bc2b80 10 client.25385 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.446+0000 7f86a5bc2b80 10 client.25385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.446+0000 7f86a5bc2b80 20 client.25385 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.446+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55af25310340 0x55af25312760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.446+0000 7f86a5bc2b80 4 client.25385 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:41:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.446+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/1776026322 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55af251ebbb0 con 0x55af25310340 2023-10-08T12:41:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.446+0000 7f868affd700 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55af25310340 0x55af25312760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.447+0000 7f868affd700 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55af25310340 0x55af25312760 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d0e8c70b8148640 server_cookie=5d586115353b7710 in_seq=0 out_seq=0 2023-10-08T12:41:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.447+0000 7f866affd700 10 client.25385 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f866affd700 1 -- 172.21.15.59:0/1776026322 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55af251ebbb0 con 0x55af25310340 2023-10-08T12:41:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f866affd700 10 client.25385 handle_command_reply: tid=0 2023-10-08T12:41:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f86a5bc2b80 1 client.25385 shutdown 2023-10-08T12:41:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/1776026322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 msgr2=0x55af252b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af252b07e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8684014040 tx=0x7f868402f040 comp rx=0 tx=0).stop 2023-10-08T12:41:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/1776026322 shutdown_connections 2023-10-08T12:41:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55af25310340 0x55af25312760 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af2529ef00 0x55af252b07e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55af252aa6d0 0x55af25307380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f86a5bc2b80 1 --2- 172.21.15.59:0/1776026322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af2529f820 0x55af252b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f866affd700 0 client.25385 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.448+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/1776026322 >> 172.21.15.59:0/1776026322 conn(0x55af252142e0 msgr2=0x55af252a2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/1776026322 shutdown_connections 2023-10-08T12:41:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86a5bc2b80 1 -- 172.21.15.59:0/1776026322 wait complete. 2023-10-08T12:41:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86a5bc2b80 20 client.25385 trim_cache size 0 max 16384 2023-10-08T12:41:20.453 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:41:20.454 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:41:20.454 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "d9f67354-0da6-4841-a7f0-d420a8e1bf46", 2023-10-08T12:41:20.454 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:41:20.454 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:41:20.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86921ff700 1 -- 172.21.15.59:0/3927708324 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86740a14d0 msgr2=0x7f86740a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86921ff700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86740a14d0 0x7f86740a3990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f867c09a020 tx=0x7f867c0d0980 comp rx=0 tx=0).stop 2023-10-08T12:41:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86921ff700 1 -- 172.21.15.59:0/3927708324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c072c20 msgr2=0x7f868c198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86921ff700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c072c20 0x7f868c198e40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f867c00e9a0 tx=0x7f867c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86921ff700 1 -- 172.21.15.59:0/3927708324 shutdown_connections 2023-10-08T12:41:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86921ff700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86740a14d0 0x7f86740a3990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86921ff700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c072c20 0x7f868c198e40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86921ff700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c10cf80 0x7f868c19d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86921ff700 1 --2- 172.21.15.59:0/3927708324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f868c073540 0x7f868c199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.449+0000 7f86921ff700 1 -- 172.21.15.59:0/3927708324 >> 172.21.15.59:0/3927708324 conn(0x7f868c0fc230 msgr2=0x7f868c0fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.450+0000 7f86921ff700 1 -- 172.21.15.59:0/3927708324 shutdown_connections 2023-10-08T12:41:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.450+0000 7f86921ff700 1 -- 172.21.15.59:0/3927708324 wait complete. 2023-10-08T12:41:20.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:41:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.655+0000 7fed6c9ff700 1 -- 172.21.15.59:0/2725401286 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7fed68110640 con 0x7fed500a14d0 2023-10-08T12:41:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.677+0000 7f820e5ff700 1 -- 172.21.15.59:0/1346461444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82081056b0 msgr2=0x7f8208105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.677+0000 7f820e5ff700 1 --2- 172.21.15.59:0/1346461444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82081056b0 0x7f8208105a90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009990 tx=0x7f81f8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.677+0000 7f820e5ff700 1 -- 172.21.15.59:0/1346461444 shutdown_connections 2023-10-08T12:41:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.677+0000 7f820e5ff700 1 --2- 172.21.15.59:0/1346461444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82080fffe0 0x7f820810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.677+0000 7f820e5ff700 1 --2- 172.21.15.59:0/1346461444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82081056b0 0x7f8208105a90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.677+0000 7f820e5ff700 1 --2- 172.21.15.59:0/1346461444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82080ff620 0x7f82080ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.677+0000 7f820e5ff700 1 -- 172.21.15.59:0/1346461444 >> 172.21.15.59:0/1346461444 conn(0x7f8208076780 msgr2=0x7f8208076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.677+0000 7f820e5ff700 1 -- 172.21.15.59:0/1346461444 shutdown_connections 2023-10-08T12:41:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.677+0000 7f820e5ff700 1 -- 172.21.15.59:0/1346461444 wait complete. 2023-10-08T12:41:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.678+0000 7f820e5ff700 1 Processor -- start 2023-10-08T12:41:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f820e5ff700 1 -- start start 2023-10-08T12:41:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f820e5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82080ff620 0x7f8208198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f820e5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82080fffe0 0x7f82081992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f820e5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82081056b0 0x7f820819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f820e5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820819dcb0 con 0x7f82080fffe0 2023-10-08T12:41:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f820e5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820819de20 con 0x7f82081056b0 2023-10-08T12:41:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f820e5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820819dfe0 con 0x7f82080ff620 2023-10-08T12:41:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f82077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82080fffe0 0x7f82081992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f8207fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82080ff620 0x7f8208198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f82077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82080fffe0 0x7f82081992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34526/0 (socket says 172.21.15.59:34526) 2023-10-08T12:41:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f82077fe700 1 -- 172.21.15.59:0/2021728253 learned_addr learned my addr 172.21.15.59:0/2021728253 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.679+0000 7f820cb9c700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82081056b0 0x7f820819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.680+0000 7f8207fff700 1 -- 172.21.15.59:0/2021728253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82081056b0 msgr2=0x7f820819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.680+0000 7f8207fff700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82081056b0 0x7f820819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.680+0000 7f8207fff700 1 -- 172.21.15.59:0/2021728253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82080fffe0 msgr2=0x7f82081992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.680+0000 7f8207fff700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82080fffe0 0x7f82081992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.680+0000 7f8207fff700 1 -- 172.21.15.59:0/2021728253 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc009520 con 0x7f82080ff620 2023-10-08T12:41:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.680+0000 7f820cb9c700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82081056b0 0x7f820819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.680+0000 7f8207fff700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82080ff620 0x7f8208198d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009990 tx=0x7f81f8005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.680+0000 7f82057fa700 1 -- 172.21.15.59:0/2021728253 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f801d070 con 0x7f82080ff620 2023-10-08T12:41:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.680+0000 7f82057fa700 1 -- 172.21.15.59:0/2021728253 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81f8022470 con 0x7f82080ff620 2023-10-08T12:41:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.680+0000 7f82057fa700 1 -- 172.21.15.59:0/2021728253 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8017650 con 0x7f82080ff620 2023-10-08T12:41:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.680+0000 7f820e5ff700 1 -- 172.21.15.59:0/2021728253 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8200009c40 con 0x7f82080ff620 2023-10-08T12:41:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.681+0000 7f820e5ff700 1 -- 172.21.15.59:0/2021728253 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f80095f0 con 0x7f82080ff620 2023-10-08T12:41:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.684+0000 7f82057fa700 1 -- 172.21.15.59:0/2021728253 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f81f80225e0 con 0x7f82080ff620 2023-10-08T12:41:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.687+0000 7f8221f22b80 1 Processor -- start 2023-10-08T12:41:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.687+0000 7f82057fa700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81f00a1550 0x7f81f00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.687+0000 7f8221f22b80 1 -- start start 2023-10-08T12:41:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.687+0000 7f82057fa700 1 -- 172.21.15.59:0/2021728253 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f81f80cdf10 con 0x7f82080ff620 2023-10-08T12:41:20.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.687+0000 7f820cb9c700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81f00a1550 0x7f81f00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce223260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce2237a0 0x5583ce22e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 0x5583ce230a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8221f22b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce18c460 con 0x5583ce2237a0 2023-10-08T12:41:20.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8221f22b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce17dc20 con 0x5583ce222e80 2023-10-08T12:41:20.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8221f22b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce17b540 con 0x5583ce22e650 2023-10-08T12:41:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8207fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce223260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f82077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce2237a0 0x5583ce22e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f82077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce2237a0 0x5583ce22e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34534/0 (socket says 172.21.15.59:34534) 2023-10-08T12:41:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f82077fe700 1 -- 172.21.15.59:0/339583917 learned_addr learned my addr 172.21.15.59:0/339583917 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8207fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce223260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:56334/0 (socket says 172.21.15.59:56334) 2023-10-08T12:41:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f820cb9c700 1 --2- 172.21.15.59:0/339583917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 0x5583ce230a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8207fff700 1 -- 172.21.15.59:0/339583917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 msgr2=0x5583ce230a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8207fff700 1 --2- 172.21.15.59:0/339583917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 0x5583ce230a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8207fff700 1 -- 172.21.15.59:0/339583917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce2237a0 msgr2=0x5583ce22e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8207fff700 1 --2- 172.21.15.59:0/339583917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce2237a0 0x5583ce22e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f8207fff700 1 -- 172.21.15.59:0/339583917 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583cdfa1de0 con 0x5583ce222e80 2023-10-08T12:41:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f820cb9c700 1 --2- 172.21.15.59:0/339583917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 0x5583ce230a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.688+0000 7f82077fe700 1 --2- 172.21.15.59:0/339583917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce2237a0 0x5583ce22e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.689+0000 7f820cb9c700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81f00a1550 0x7f81f00a3a10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8200007610 tx=0x7f8200009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.689+0000 7f8207fff700 1 --2- 172.21.15.59:0/339583917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce223260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81f80cb8e0 tx=0x7f81f809af90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4946875f45aa1038 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.689+0000 7f81ee7fc700 1 -- 172.21.15.59:0/339583917 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f809f130 con 0x5583ce222e80 2023-10-08T12:41:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.689+0000 7f81ee7fc700 1 -- 172.21.15.59:0/339583917 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81f809b8c0 con 0x5583ce222e80 2023-10-08T12:41:20.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.689+0000 7f81ee7fc700 1 -- 172.21.15.59:0/339583917 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8099680 con 0x5583ce222e80 2023-10-08T12:41:20.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.690+0000 7f8221f22b80 1 -- 172.21.15.59:0/339583917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 msgr2=0x5583ce223260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.690+0000 7f8221f22b80 1 --2- 172.21.15.59:0/339583917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce223260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81f80cb8e0 tx=0x7f81f809af90 comp rx=0 tx=0).stop 2023-10-08T12:41:20.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.690+0000 7f8221f22b80 1 -- 172.21.15.59:0/339583917 shutdown_connections 2023-10-08T12:41:20.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.690+0000 7f8221f22b80 1 --2- 172.21.15.59:0/339583917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce223260 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.690+0000 7f8221f22b80 1 --2- 172.21.15.59:0/339583917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 0x5583ce230a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.690+0000 7f8221f22b80 1 --2- 172.21.15.59:0/339583917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce2237a0 0x5583ce22e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.690+0000 7f8221f22b80 1 -- 172.21.15.59:0/339583917 >> 172.21.15.59:0/339583917 conn(0x5583ce198260 msgr2=0x5583ce21f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.690+0000 7f8221f22b80 1 -- 172.21.15.59:0/339583917 shutdown_connections 2023-10-08T12:41:20.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.690+0000 7f8221f22b80 1 -- 172.21.15.59:0/339583917 wait complete. 2023-10-08T12:41:20.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.691+0000 7f8221f22b80 1 -- start start 2023-10-08T12:41:20.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.691+0000 7f8221f22b80 1 Processor -- start 2023-10-08T12:41:20.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.691+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce222e80 0x5583ce22ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.691+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 0x5583ce22ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.691+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce22e650 0x5583ce239ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.691+0000 7f8221f22b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce176e30 con 0x5583ce22e650 2023-10-08T12:41:20.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.691+0000 7f8221f22b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce113710 con 0x5583ce2237a0 2023-10-08T12:41:20.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.691+0000 7f8221f22b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce1133b0 con 0x5583ce222e80 2023-10-08T12:41:20.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f8221f22b80 10 client.0 _ll_register_callbacks cb 0x5583cdf70800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:20.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f8207fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce222e80 0x5583ce22ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f82077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 0x5583ce22ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f82077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 0x5583ce22ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:56344/0 (socket says 172.21.15.59:56344) 2023-10-08T12:41:20.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f82077fe700 1 -- 172.21.15.59:0/1086252593 learned_addr learned my addr 172.21.15.59:0/1086252593 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f820cb9c700 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce22e650 0x5583ce239ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f8207fff700 1 -- 172.21.15.59:0/1086252593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 msgr2=0x5583ce22ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f8207fff700 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 0x5583ce22ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f8207fff700 1 -- 172.21.15.59:0/1086252593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce22e650 msgr2=0x5583ce239ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f8207fff700 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce22e650 0x5583ce239ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f8207fff700 1 -- 172.21.15.59:0/1086252593 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f80095f0 con 0x5583ce222e80 2023-10-08T12:41:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.692+0000 7f82077fe700 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 0x5583ce22ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.693+0000 7f8207fff700 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce222e80 0x5583ce22ea30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f81f809d000 tx=0x7f81f809f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90403c159152be39 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.693+0000 7f81e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:41:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.693+0000 7f81e77fe700 1 -- 172.21.15.59:0/1086252593 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f809f310 con 0x5583ce222e80 2023-10-08T12:41:20.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.693+0000 7f81e77fe700 1 -- 172.21.15.59:0/1086252593 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f81f80a34c0 con 0x5583ce222e80 2023-10-08T12:41:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.693+0000 7f8221f22b80 1 -- 172.21.15.59:0/1086252593 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583ce13eeb0 con 0x5583ce222e80 2023-10-08T12:41:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.693+0000 7f81e77fe700 1 -- 172.21.15.59:0/1086252593 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81f80b92d0 con 0x5583ce222e80 2023-10-08T12:41:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.693+0000 7f8221f22b80 10 client.25396 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.693+0000 7f8221f22b80 1 -- 172.21.15.59:0/1086252593 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5583cdf8ac60 con 0x5583ce222e80 2023-10-08T12:41:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.694+0000 7f81e77fe700 1 -- 172.21.15.59:0/1086252593 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5583ce13eeb0 con 0x5583ce222e80 2023-10-08T12:41:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.694+0000 7f81e77fe700 1 -- 172.21.15.59:0/1086252593 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f81f80a3150 con 0x5583ce222e80 2023-10-08T12:41:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.694+0000 7f8221f22b80 10 client.25396 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.694+0000 7f8221f22b80 10 client.25396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.695+0000 7f8221f22b80 20 client.25396 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.695+0000 7f8221f22b80 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5583ce23d850 0x5583ce23fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.695+0000 7f8221f22b80 4 client.25396 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:20.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.695+0000 7f8221f22b80 1 -- 172.21.15.59:0/1086252593 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5583ce16fe10 con 0x5583ce23d850 2023-10-08T12:41:20.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.695+0000 7f82077fe700 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5583ce23d850 0x5583ce23fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.696+0000 7f82077fe700 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5583ce23d850 0x5583ce23fc40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1b60a2bc5d6dc52 server_cookie=7f7ad221b309eed6 in_seq=0 out_seq=0 2023-10-08T12:41:20.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.696+0000 7f81e77fe700 10 client.25396 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:20.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.696+0000 7f81e77fe700 1 -- 172.21.15.59:0/1086252593 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5583ce16fe10 con 0x5583ce23d850 2023-10-08T12:41:20.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.696+0000 7f81e77fe700 10 client.25396 handle_command_reply: tid=0 2023-10-08T12:41:20.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.697+0000 7f8221f22b80 1 client.25396 shutdown 2023-10-08T12:41:20.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.697+0000 7f8221f22b80 1 -- 172.21.15.59:0/1086252593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce222e80 msgr2=0x5583ce22ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.697+0000 7f8221f22b80 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce222e80 0x5583ce22ea30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f81f809d000 tx=0x7f81f809f130 comp rx=0 tx=0).stop 2023-10-08T12:41:20.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.697+0000 7f8221f22b80 1 -- 172.21.15.59:0/1086252593 shutdown_connections 2023-10-08T12:41:20.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.697+0000 7f8221f22b80 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5583ce23d850 0x5583ce23fc40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.697+0000 7f8221f22b80 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce22e650 0x5583ce239ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.697+0000 7f8221f22b80 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce222e80 0x5583ce22ea30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.697+0000 7f8221f22b80 1 --2- 172.21.15.59:0/1086252593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 0x5583ce22ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.697+0000 7f81e77fe700 0 client.25396 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:20.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.697+0000 7f8221f22b80 1 -- 172.21.15.59:0/1086252593 >> 172.21.15.59:0/1086252593 conn(0x5583ce198260 msgr2=0x5583ce21eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.698+0000 7f8221f22b80 1 -- 172.21.15.59:0/1086252593 shutdown_connections 2023-10-08T12:41:20.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.698+0000 7f8221f22b80 1 -- 172.21.15.59:0/1086252593 wait complete. 2023-10-08T12:41:20.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.698+0000 7f8221f22b80 20 client.25396 trim_cache size 0 max 16384 2023-10-08T12:41:20.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.722+0000 7f8221f22b80 1 Processor -- start 2023-10-08T12:41:20.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.722+0000 7f8221f22b80 1 -- start start 2023-10-08T12:41:20.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce2338c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce2237a0 0x5583ce228bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce22e650 0x5583ce229110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8221f22b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583cdff7920 con 0x5583ce22e650 2023-10-08T12:41:20.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8221f22b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce22de10 con 0x5583ce222e80 2023-10-08T12:41:20.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8221f22b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce23a270 con 0x5583ce2237a0 2023-10-08T12:41:20.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8207fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce2338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8207fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce2338c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:56348/0 (socket says 172.21.15.59:56348) 2023-10-08T12:41:20.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8207fff700 1 -- 172.21.15.59:0/1542982886 learned_addr learned my addr 172.21.15.59:0/1542982886 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:20.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f82077fe700 1 --2- 172.21.15.59:0/1542982886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce2237a0 0x5583ce228bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f820cb9c700 1 --2- 172.21.15.59:0/1542982886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce22e650 0x5583ce229110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8207fff700 1 -- 172.21.15.59:0/1542982886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce2237a0 msgr2=0x5583ce228bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8207fff700 1 --2- 172.21.15.59:0/1542982886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce2237a0 0x5583ce228bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8207fff700 1 -- 172.21.15.59:0/1542982886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce22e650 msgr2=0x5583ce229110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.723+0000 7f8207fff700 1 --2- 172.21.15.59:0/1542982886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce22e650 0x5583ce229110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.724+0000 7f8207fff700 1 -- 172.21.15.59:0/1542982886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583ce244870 con 0x5583ce222e80 2023-10-08T12:41:20.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.724+0000 7f8207fff700 1 --2- 172.21.15.59:0/1542982886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce2338c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f81f80976c0 tx=0x7f81f809b340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac22c8588e95f0d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.724+0000 7f81eeffd700 1 -- 172.21.15.59:0/1542982886 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f80b92d0 con 0x5583ce222e80 2023-10-08T12:41:20.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.724+0000 7f81eeffd700 1 -- 172.21.15.59:0/1542982886 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81f80a34c0 con 0x5583ce222e80 2023-10-08T12:41:20.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.724+0000 7f81eeffd700 1 -- 172.21.15.59:0/1542982886 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f80a3230 con 0x5583ce222e80 2023-10-08T12:41:20.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.725+0000 7f8221f22b80 1 -- 172.21.15.59:0/1542982886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 msgr2=0x5583ce2338c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.725+0000 7f8221f22b80 1 --2- 172.21.15.59:0/1542982886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce2338c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f81f80976c0 tx=0x7f81f809b340 comp rx=0 tx=0).stop 2023-10-08T12:41:20.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.725+0000 7f8221f22b80 1 -- 172.21.15.59:0/1542982886 shutdown_connections 2023-10-08T12:41:20.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.725+0000 7f8221f22b80 1 --2- 172.21.15.59:0/1542982886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce222e80 0x5583ce2338c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.725+0000 7f8221f22b80 1 --2- 172.21.15.59:0/1542982886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce22e650 0x5583ce229110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.725+0000 7f8221f22b80 1 --2- 172.21.15.59:0/1542982886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce2237a0 0x5583ce228bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.725+0000 7f8221f22b80 1 -- 172.21.15.59:0/1542982886 >> 172.21.15.59:0/1542982886 conn(0x5583ce198260 msgr2=0x5583ce22ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.725+0000 7f8221f22b80 1 -- 172.21.15.59:0/1542982886 shutdown_connections 2023-10-08T12:41:20.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.725+0000 7f8221f22b80 1 -- 172.21.15.59:0/1542982886 wait complete. 2023-10-08T12:41:20.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.726+0000 7f8221f22b80 1 -- start start 2023-10-08T12:41:20.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.726+0000 7f8221f22b80 1 Processor -- start 2023-10-08T12:41:20.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.727+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce222e80 0x5583ce2899a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.727+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 0x5583ce289ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.727+0000 7f8221f22b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 0x5583ce28a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.727+0000 7f8221f22b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce28ad20 con 0x5583ce222e80 2023-10-08T12:41:20.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.727+0000 7f8221f22b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce28ae90 con 0x5583ce2237a0 2023-10-08T12:41:20.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.727+0000 7f8221f22b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce28b050 con 0x5583ce22e650 2023-10-08T12:41:20.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.727+0000 7f8221f22b80 10 client.0 _ll_register_callbacks cb 0x7f81f8097540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:20.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.727+0000 7f820cb9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 0x5583ce28a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.727+0000 7f820cb9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 0x5583ce28a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:57918/0 (socket says 172.21.15.59:57918) 2023-10-08T12:41:20.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.727+0000 7f820cb9c700 1 -- 172.21.15.59:0/4164884799 learned_addr learned my addr 172.21.15.59:0/4164884799 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.727+0000 7f82077fe700 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 0x5583ce289ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.728+0000 7f8207fff700 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce222e80 0x5583ce2899a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.728+0000 7f820cb9c700 1 -- 172.21.15.59:0/4164884799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 msgr2=0x5583ce289ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.728+0000 7f820cb9c700 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 0x5583ce289ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.728+0000 7f820cb9c700 1 -- 172.21.15.59:0/4164884799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce222e80 msgr2=0x5583ce2899a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.728+0000 7f820cb9c700 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce222e80 0x5583ce2899a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.728+0000 7f820cb9c700 1 -- 172.21.15.59:0/4164884799 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583cdf8ac60 con 0x5583ce22e650 2023-10-08T12:41:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.728+0000 7f820cb9c700 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 0x5583ce28a710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8200009550 tx=0x7f8200015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5a38997b0b15572 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.728+0000 7f81e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:41:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f81e77fe700 1 -- 172.21.15.59:0/4164884799 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820000e050 con 0x5583ce22e650 2023-10-08T12:41:20.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f8221f22b80 1 -- 172.21.15.59:0/4164884799 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81f809b8c0 con 0x5583ce22e650 2023-10-08T12:41:20.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f81e77fe700 1 -- 172.21.15.59:0/4164884799 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8200026470 con 0x5583ce22e650 2023-10-08T12:41:20.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f81e77fe700 1 -- 172.21.15.59:0/4164884799 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8200026630 con 0x5583ce22e650 2023-10-08T12:41:20.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f8221f22b80 10 client.25402 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:20.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f8221f22b80 1 -- 172.21.15.59:0/4164884799 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5583cdfc8250 con 0x5583ce22e650 2023-10-08T12:41:20.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f81e77fe700 1 -- 172.21.15.59:0/4164884799 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81f809b8c0 con 0x5583ce22e650 2023-10-08T12:41:20.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f81e77fe700 1 -- 172.21.15.59:0/4164884799 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8200030810 con 0x5583ce22e650 2023-10-08T12:41:20.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f8221f22b80 10 client.25402 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:20.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f8221f22b80 10 client.25402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:20.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f8221f22b80 20 client.25402 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:20.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.729+0000 7f8221f22b80 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5583ce2929d0 0x5583ce294df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.730+0000 7f8221f22b80 4 client.25402 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:41:20.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.730+0000 7f8221f22b80 1 -- 172.21.15.59:0/4164884799 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5583ce16fb30 con 0x5583ce2929d0 2023-10-08T12:41:20.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.730+0000 7f8207fff700 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5583ce2929d0 0x5583ce294df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.730+0000 7f8207fff700 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5583ce2929d0 0x5583ce294df0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=344a94da47bb8f99 server_cookie=5cb732478bb084de in_seq=0 out_seq=0 2023-10-08T12:41:20.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.730+0000 7f81e77fe700 10 client.25402 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:20.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f81e77fe700 1 -- 172.21.15.59:0/4164884799 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5583ce16fb30 con 0x5583ce2929d0 2023-10-08T12:41:20.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f81e77fe700 10 client.25402 handle_command_reply: tid=0 2023-10-08T12:41:20.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f8221f22b80 1 client.25402 shutdown 2023-10-08T12:41:20.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f8221f22b80 1 -- 172.21.15.59:0/4164884799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 msgr2=0x5583ce28a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f8221f22b80 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 0x5583ce28a710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8200009550 tx=0x7f8200015000 comp rx=0 tx=0).stop 2023-10-08T12:41:20.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f8221f22b80 1 -- 172.21.15.59:0/4164884799 shutdown_connections 2023-10-08T12:41:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f8221f22b80 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5583ce2929d0 0x5583ce294df0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f8221f22b80 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583ce22e650 0x5583ce28a710 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f8221f22b80 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583ce222e80 0x5583ce2899a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f81e77fe700 0 client.25402 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f8221f22b80 1 --2- 172.21.15.59:0/4164884799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583ce2237a0 0x5583ce289ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f8221f22b80 1 -- 172.21.15.59:0/4164884799 >> 172.21.15.59:0/4164884799 conn(0x5583ce198260 msgr2=0x5583ce22ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f8221f22b80 1 -- 172.21.15.59:0/4164884799 shutdown_connections 2023-10-08T12:41:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.731+0000 7f8221f22b80 1 -- 172.21.15.59:0/4164884799 wait complete. 2023-10-08T12:41:20.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.732+0000 7f8221f22b80 20 client.25402 trim_cache size 0 max 16384 2023-10-08T12:41:20.738 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:41:20.738 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:41:20.738 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:41:20.738 INFO:teuthology.orchestra.run.smithi059.stdout: "d9f67354-0da6-4841-a7f0-d420a8e1bf46": { 2023-10-08T12:41:20.738 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:41:20.738 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "d9f67354-0da6-4841-a7f0-d420a8e1bf46", 2023-10-08T12:41:20.738 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:41:20.738 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:41:20.739 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:41:20.739 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:41:20.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.732+0000 7f820e5ff700 1 -- 172.21.15.59:0/2021728253 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81f00a1550 msgr2=0x7f81f00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.732+0000 7f820e5ff700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81f00a1550 0x7f81f00a3a10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8200007610 tx=0x7f8200009920 comp rx=0 tx=0).stop 2023-10-08T12:41:20.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.732+0000 7f820e5ff700 1 -- 172.21.15.59:0/2021728253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82080ff620 msgr2=0x7f8208198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.732+0000 7f820e5ff700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82080ff620 0x7f8208198d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009990 tx=0x7f81f8005740 comp rx=0 tx=0).stop 2023-10-08T12:41:20.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.732+0000 7f820e5ff700 1 -- 172.21.15.59:0/2021728253 shutdown_connections 2023-10-08T12:41:20.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.732+0000 7f820e5ff700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81f00a1550 0x7f81f00a3a10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.732+0000 7f820e5ff700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82081056b0 0x7f820819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.732+0000 7f820e5ff700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82080ff620 0x7f8208198d90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.732+0000 7f820e5ff700 1 --2- 172.21.15.59:0/2021728253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82080fffe0 0x7f82081992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.732+0000 7f820e5ff700 1 -- 172.21.15.59:0/2021728253 >> 172.21.15.59:0/2021728253 conn(0x7f8208076780 msgr2=0x7f8208067860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.733+0000 7f820e5ff700 1 -- 172.21.15.59:0/2021728253 shutdown_connections 2023-10-08T12:41:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.733+0000 7f820e5ff700 1 -- 172.21.15.59:0/2021728253 wait complete. 2023-10-08T12:41:20.756 INFO:tasks.cephfs.filesystem:scrub status for tag:d9f67354-0da6-4841-a7f0-d420a8e1bf46 - {'path': '/', 'tag': 'd9f67354-0da6-4841-a7f0-d420a8e1bf46', 'options': 'recursive,force'} 2023-10-08T12:41:20.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.776+0000 7fed577fe700 1 -- 172.21.15.59:0/2725401286 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fed68110640 con 0x7fed500a14d0 2023-10-08T12:41:20.777 INFO:teuthology.orchestra.run.smithi059.stdout:Schedule set for path / 2023-10-08T12:41:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.778+0000 7fed6c9ff700 1 -- 172.21.15.59:0/2725401286 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fed500a14d0 msgr2=0x7fed500a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.778+0000 7fed6c9ff700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fed500a14d0 0x7fed500a3990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fed6819a2d0 tx=0x7fed5c005960 comp rx=0 tx=0).stop 2023-10-08T12:41:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.779+0000 7fed6c9ff700 1 -- 172.21.15.59:0/2725401286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed681006c0 msgr2=0x7fed68198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.779+0000 7fed6c9ff700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed681006c0 0x7fed68198d20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fed5800e9a0 tx=0x7fed5800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.779+0000 7fed6c9ff700 1 -- 172.21.15.59:0/2725401286 shutdown_connections 2023-10-08T12:41:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.779+0000 7fed6c9ff700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fed500a14d0 0x7fed500a3990 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.779+0000 7fed6c9ff700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed681066d0 0x7fed6819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.779+0000 7fed6c9ff700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed681006c0 0x7fed68198d20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.779+0000 7fed6c9ff700 1 --2- 172.21.15.59:0/2725401286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed68101080 0x7fed68199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.779+0000 7fed6c9ff700 1 -- 172.21.15.59:0/2725401286 >> 172.21.15.59:0/2725401286 conn(0x7fed680fc190 msgr2=0x7fed68072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.779+0000 7fed6c9ff700 1 -- 172.21.15.59:0/2725401286 shutdown_connections 2023-10-08T12:41:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:20.779+0000 7fed6c9ff700 1 -- 172.21.15.59:0/2725401286 wait complete. 2023-10-08T12:41:20.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2023-10-08T12:41:21.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:20 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1322265799' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:21.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:20 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:41:21.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:20 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:21.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:20 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:41:21.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:20 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.040+0000 7f49eb7ff700 1 -- 172.21.15.59:0/2019956244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e4073540 msgr2=0x7f49e410c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.040+0000 7f49eb7ff700 1 --2- 172.21.15.59:0/2019956244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e4073540 0x7f49e410c9e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009990 tx=0x7f49d4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.040+0000 7f49eb7ff700 1 -- 172.21.15.59:0/2019956244 shutdown_connections 2023-10-08T12:41:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.040+0000 7f49eb7ff700 1 --2- 172.21.15.59:0/2019956244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e4072c20 0x7f49e4073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.040+0000 7f49eb7ff700 1 --2- 172.21.15.59:0/2019956244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49e410cf20 0x7f49e410f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.040+0000 7f49eb7ff700 1 --2- 172.21.15.59:0/2019956244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e4073540 0x7f49e410c9e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.040+0000 7f49eb7ff700 1 -- 172.21.15.59:0/2019956244 >> 172.21.15.59:0/2019956244 conn(0x7f49e40fc1f0 msgr2=0x7f49e40fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.040+0000 7f49eb7ff700 1 -- 172.21.15.59:0/2019956244 shutdown_connections 2023-10-08T12:41:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.040+0000 7f49eb7ff700 1 -- 172.21.15.59:0/2019956244 wait complete. 2023-10-08T12:41:21.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.041+0000 7f49eb7ff700 1 Processor -- start 2023-10-08T12:41:21.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49eb7ff700 1 -- start start 2023-10-08T12:41:21.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49eb7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e4072c20 0x7f49e4198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49eb7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49e4073540 0x7f49e4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49eb7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e410cf20 0x7f49e419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49eb7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e419dd00 con 0x7f49e4072c20 2023-10-08T12:41:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49eb7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e419de70 con 0x7f49e410cf20 2023-10-08T12:41:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49eb7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e419e030 con 0x7f49e4073540 2023-10-08T12:41:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49e959b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e4072c20 0x7f49e4198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49e8d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49e4073540 0x7f49e4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49e959b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e4072c20 0x7f49e4198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34566/0 (socket says 172.21.15.59:34566) 2023-10-08T12:41:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49e959b700 1 -- 172.21.15.59:0/31002122 learned_addr learned my addr 172.21.15.59:0/31002122 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.042+0000 7f49e9d9c700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e410cf20 0x7f49e419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49e959b700 1 -- 172.21.15.59:0/31002122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49e4073540 msgr2=0x7f49e4199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49e959b700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49e4073540 0x7f49e4199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49e959b700 1 -- 172.21.15.59:0/31002122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e410cf20 msgr2=0x7f49e419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49e959b700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e410cf20 0x7f49e419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49e959b700 1 -- 172.21.15.59:0/31002122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d40095f0 con 0x7f49e4072c20 2023-10-08T12:41:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49e9d9c700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e410cf20 0x7f49e419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49e959b700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e4072c20 0x7f49e4198de0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f49e000e9a0 tx=0x7f49e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49da7fc700 1 -- 172.21.15.59:0/31002122 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0009790 con 0x7f49e4072c20 2023-10-08T12:41:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49eb7ff700 1 -- 172.21.15.59:0/31002122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e419e310 con 0x7f49e4072c20 2023-10-08T12:41:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49da7fc700 1 -- 172.21.15.59:0/31002122 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49e0010430 con 0x7f49e4072c20 2023-10-08T12:41:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49da7fc700 1 -- 172.21.15.59:0/31002122 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0018680 con 0x7f49e4072c20 2023-10-08T12:41:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.043+0000 7f49eb7ff700 1 -- 172.21.15.59:0/31002122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e41a5b50 con 0x7f49e4072c20 2023-10-08T12:41:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.044+0000 7f49eb7ff700 1 -- 172.21.15.59:0/31002122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e4108130 con 0x7f49e4072c20 2023-10-08T12:41:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.047+0000 7f49da7fc700 1 -- 172.21.15.59:0/31002122 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f49e00105a0 con 0x7f49e4072c20 2023-10-08T12:41:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.048+0000 7f49da7fc700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f49d00a1550 0x7f49d00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.048+0000 7f49da7fc700 1 -- 172.21.15.59:0/31002122 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f49e0014070 con 0x7f49e4072c20 2023-10-08T12:41:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.048+0000 7f49e8d9a700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f49d00a1550 0x7f49d00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.049+0000 7f49e8d9a700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f49d00a1550 0x7f49d00a3a10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f49e419a330 tx=0x7f49d4005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:21.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.050+0000 7f49da7fc700 1 -- 172.21.15.59:0/31002122 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f49e0096780 con 0x7f49e4072c20 2023-10-08T12:41:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:20 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1322265799' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:20 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:41:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:20 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:20 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:41:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:20 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:21.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.291+0000 7f49eb7ff700 1 -- 172.21.15.59:0/31002122 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f49e419a180 con 0x7f49d00a1550 2023-10-08T12:41:21.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.351+0000 7f49da7fc700 1 -- 172.21.15.59:0/31002122 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f49e419a180 con 0x7f49d00a1550 2023-10-08T12:41:21.352 INFO:teuthology.orchestra.run.smithi059.stdout:Retention added to path / 2023-10-08T12:41:21.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.353+0000 7f49eb7ff700 1 -- 172.21.15.59:0/31002122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f49d00a1550 msgr2=0x7f49d00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.353+0000 7f49eb7ff700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f49d00a1550 0x7f49d00a3a10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f49e419a330 tx=0x7f49d4005fd0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.354+0000 7f49eb7ff700 1 -- 172.21.15.59:0/31002122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e4072c20 msgr2=0x7f49e4198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.354+0000 7f49eb7ff700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e4072c20 0x7f49e4198de0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f49e000e9a0 tx=0x7f49e000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.354+0000 7f49eb7ff700 1 -- 172.21.15.59:0/31002122 shutdown_connections 2023-10-08T12:41:21.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.354+0000 7f49eb7ff700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f49d00a1550 0x7f49d00a3a10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.354+0000 7f49eb7ff700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49e410cf20 0x7f49e419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.354+0000 7f49eb7ff700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e4072c20 0x7f49e4198de0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.354+0000 7f49eb7ff700 1 --2- 172.21.15.59:0/31002122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49e4073540 0x7f49e4199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.354+0000 7f49eb7ff700 1 -- 172.21.15.59:0/31002122 >> 172.21.15.59:0/31002122 conn(0x7f49e40fc1f0 msgr2=0x7f49e40fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:21.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.354+0000 7f49eb7ff700 1 -- 172.21.15.59:0/31002122 shutdown_connections 2023-10-08T12:41:21.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.354+0000 7f49eb7ff700 1 -- 172.21.15.59:0/31002122 wait complete. 2023-10-08T12:41:21.373 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-08T12:41:21.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:20 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1322265799' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:41:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:20 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:41:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:20 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:20 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:41:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:20 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:21.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.572+0000 7efc4a3ff700 1 -- 172.21.15.59:0/2838785140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44073540 msgr2=0x7efc4410c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.572+0000 7efc4a3ff700 1 --2- 172.21.15.59:0/2838785140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44073540 0x7efc4410c9e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efc38009990 tx=0x7efc38009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.572+0000 7efc4a3ff700 1 -- 172.21.15.59:0/2838785140 shutdown_connections 2023-10-08T12:41:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.572+0000 7efc4a3ff700 1 --2- 172.21.15.59:0/2838785140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc4410cf20 0x7efc4410f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.572+0000 7efc4a3ff700 1 --2- 172.21.15.59:0/2838785140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc44072c20 0x7efc44073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.572+0000 7efc4a3ff700 1 --2- 172.21.15.59:0/2838785140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44073540 0x7efc4410c9e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.572+0000 7efc4a3ff700 1 -- 172.21.15.59:0/2838785140 >> 172.21.15.59:0/2838785140 conn(0x7efc440fc1f0 msgr2=0x7efc440fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.572+0000 7efc4a3ff700 1 -- 172.21.15.59:0/2838785140 shutdown_connections 2023-10-08T12:41:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.572+0000 7efc4a3ff700 1 -- 172.21.15.59:0/2838785140 wait complete. 2023-10-08T12:41:21.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.573+0000 7efc4a3ff700 1 Processor -- start 2023-10-08T12:41:21.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc4a3ff700 1 -- start start 2023-10-08T12:41:21.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc4a3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc44072c20 0x7efc44198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc4a3ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44073540 0x7efc441992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc4a3ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc4410cf20 0x7efc4419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc4a3ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4419dcc0 con 0x7efc44073540 2023-10-08T12:41:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc4a3ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4419de30 con 0x7efc4410cf20 2023-10-08T12:41:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc4a3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4419dff0 con 0x7efc44072c20 2023-10-08T12:41:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc437fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44073540 0x7efc441992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc437fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44073540 0x7efc441992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34596/0 (socket says 172.21.15.59:34596) 2023-10-08T12:41:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc437fe700 1 -- 172.21.15.59:0/3857136796 learned_addr learned my addr 172.21.15.59:0/3857136796 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc43fff700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc44072c20 0x7efc44198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.574+0000 7efc4899c700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc4410cf20 0x7efc4419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc437fe700 1 -- 172.21.15.59:0/3857136796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc44072c20 msgr2=0x7efc44198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc437fe700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc44072c20 0x7efc44198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc437fe700 1 -- 172.21.15.59:0/3857136796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc4410cf20 msgr2=0x7efc4419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc437fe700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc4410cf20 0x7efc4419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc437fe700 1 -- 172.21.15.59:0/3857136796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380095f0 con 0x7efc44073540 2023-10-08T12:41:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc4899c700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc4410cf20 0x7efc4419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc437fe700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44073540 0x7efc441992e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efc38000c00 tx=0x7efc38005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc417fa700 1 -- 172.21.15.59:0/3857136796 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3801d070 con 0x7efc44073540 2023-10-08T12:41:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc417fa700 1 -- 172.21.15.59:0/3857136796 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc38022470 con 0x7efc44073540 2023-10-08T12:41:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc4a3ff700 1 -- 172.21.15.59:0/3857136796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4419e270 con 0x7efc44073540 2023-10-08T12:41:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc417fa700 1 -- 172.21.15.59:0/3857136796 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38017650 con 0x7efc44073540 2023-10-08T12:41:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.575+0000 7efc4a3ff700 1 -- 172.21.15.59:0/3857136796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc441a5b10 con 0x7efc44073540 2023-10-08T12:41:21.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.576+0000 7efc4a3ff700 1 -- 172.21.15.59:0/3857136796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc44108130 con 0x7efc44073540 2023-10-08T12:41:21.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.578+0000 7efc417fa700 1 -- 172.21.15.59:0/3857136796 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7efc380225e0 con 0x7efc44073540 2023-10-08T12:41:21.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.580+0000 7efc417fa700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc2c0a14d0 0x7efc2c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.580+0000 7efc417fa700 1 -- 172.21.15.59:0/3857136796 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efc380ce0e0 con 0x7efc44073540 2023-10-08T12:41:21.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.580+0000 7efc43fff700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc2c0a14d0 0x7efc2c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.581+0000 7efc43fff700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc2c0a14d0 0x7efc2c0a3990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efc34009c60 tx=0x7efc34009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:21.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.584+0000 7efc417fa700 1 -- 172.21.15.59:0/3857136796 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efc3805d100 con 0x7efc44073540 2023-10-08T12:41:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.824+0000 7efc4a3ff700 1 -- 172.21.15.59:0/3857136796 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7efc4419a0a0 con 0x7efc2c0a14d0 2023-10-08T12:41:21.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.832+0000 7efc417fa700 1 -- 172.21.15.59:0/3857136796 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7efc4419a0a0 con 0x7efc2c0a14d0 2023-10-08T12:41:21.833 INFO:teuthology.orchestra.run.smithi059.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T12:41:20", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-10-08T12:41:21.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 -- 172.21.15.59:0/3857136796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc2c0a14d0 msgr2=0x7efc2c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc2c0a14d0 0x7efc2c0a3990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efc34009c60 tx=0x7efc34009260 comp rx=0 tx=0).stop 2023-10-08T12:41:21.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 -- 172.21.15.59:0/3857136796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44073540 msgr2=0x7efc441992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44073540 0x7efc441992e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efc38000c00 tx=0x7efc38005740 comp rx=0 tx=0).stop 2023-10-08T12:41:21.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 -- 172.21.15.59:0/3857136796 shutdown_connections 2023-10-08T12:41:21.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc2c0a14d0 0x7efc2c0a3990 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc4410cf20 0x7efc4419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc44072c20 0x7efc44198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 --2- 172.21.15.59:0/3857136796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc44073540 0x7efc441992e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 -- 172.21.15.59:0/3857136796 >> 172.21.15.59:0/3857136796 conn(0x7efc440fc1f0 msgr2=0x7efc440fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:21.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 -- 172.21.15.59:0/3857136796 shutdown_connections 2023-10-08T12:41:21.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:21.835+0000 7efc4a3ff700 1 -- 172.21.15.59:0/3857136796 wait complete. 2023-10-08T12:41:21.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-08T12:41:22.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.063+0000 7f8636bff700 1 -- 172.21.15.59:0/76104128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86301006e0 msgr2=0x7f8630100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.063+0000 7f8636bff700 1 --2- 172.21.15.59:0/76104128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86301006e0 0x7f8630100b60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f86200098f0 tx=0x7f8620009c00 comp rx=0 tx=0).stop 2023-10-08T12:41:22.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.063+0000 7f8636bff700 1 -- 172.21.15.59:0/76104128 shutdown_connections 2023-10-08T12:41:22.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.063+0000 7f8636bff700 1 --2- 172.21.15.59:0/76104128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86301010a0 0x7f863010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.063+0000 7f8636bff700 1 --2- 172.21.15.59:0/76104128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86301066f0 0x7f8630106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.063+0000 7f8636bff700 1 --2- 172.21.15.59:0/76104128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86301006e0 0x7f8630100b60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.063+0000 7f8636bff700 1 -- 172.21.15.59:0/76104128 >> 172.21.15.59:0/76104128 conn(0x7f86300fc1f0 msgr2=0x7f86300fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:22.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.063+0000 7f8636bff700 1 -- 172.21.15.59:0/76104128 shutdown_connections 2023-10-08T12:41:22.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.064+0000 7f8636bff700 1 -- 172.21.15.59:0/76104128 wait complete. 2023-10-08T12:41:22.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.064+0000 7f8636bff700 1 Processor -- start 2023-10-08T12:41:22.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f8636bff700 1 -- start start 2023-10-08T12:41:22.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f8636bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86301006e0 0x7f863019c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f8636bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86301010a0 0x7f863019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f8636bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86301066f0 0x7f8630196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f8636bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8630197070 con 0x7f86301006e0 2023-10-08T12:41:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f8636bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86301971e0 con 0x7f86301010a0 2023-10-08T12:41:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f8636bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86301973a0 con 0x7f86301066f0 2023-10-08T12:41:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f863499b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86301006e0 0x7f863019c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f863499b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86301006e0 0x7f863019c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34620/0 (socket says 172.21.15.59:34620) 2023-10-08T12:41:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f863499b700 1 -- 172.21.15.59:0/1388565946 learned_addr learned my addr 172.21.15.59:0/1388565946 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f863519c700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86301066f0 0x7f8630196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.065+0000 7f8627fff700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86301010a0 0x7f863019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.066+0000 7f863499b700 1 -- 172.21.15.59:0/1388565946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86301066f0 msgr2=0x7f8630196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.066+0000 7f863499b700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86301066f0 0x7f8630196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.066+0000 7f863499b700 1 -- 172.21.15.59:0/1388565946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86301010a0 msgr2=0x7f863019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.066+0000 7f863499b700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86301010a0 0x7f863019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.066+0000 7f863499b700 1 -- 172.21.15.59:0/1388565946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280095f0 con 0x7f86301006e0 2023-10-08T12:41:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.066+0000 7f863499b700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86301006e0 0x7f863019c8e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f862c00ef10 tx=0x7f862c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.066+0000 7f8625ffb700 1 -- 172.21.15.59:0/1388565946 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c00c9c0 con 0x7f86301006e0 2023-10-08T12:41:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.066+0000 7f8625ffb700 1 -- 172.21.15.59:0/1388565946 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f862c00f040 con 0x7f86301006e0 2023-10-08T12:41:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.066+0000 7f8625ffb700 1 -- 172.21.15.59:0/1388565946 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c014480 con 0x7f86301006e0 2023-10-08T12:41:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.066+0000 7f8636bff700 1 -- 172.21.15.59:0/1388565946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8620009520 con 0x7f86301006e0 2023-10-08T12:41:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.066+0000 7f8636bff700 1 -- 172.21.15.59:0/1388565946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86301a36f0 con 0x7f86301006e0 2023-10-08T12:41:22.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.067+0000 7f8636bff700 1 -- 172.21.15.59:0/1388565946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8630108ce0 con 0x7f86301006e0 2023-10-08T12:41:22.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.069+0000 7f8625ffb700 1 -- 172.21.15.59:0/1388565946 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 23) v1 ==== 136077+0+0 (secure 0 0 0) 0x7f862c007690 con 0x7f86301006e0 2023-10-08T12:41:22.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.071+0000 7f8625ffb700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86180a15e0 0x7f86180a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.071+0000 7f8625ffb700 1 -- 172.21.15.59:0/1388565946 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f862c0cd7b0 con 0x7f86301006e0 2023-10-08T12:41:22.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.071+0000 7f8627fff700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86180a15e0 0x7f86180a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.072+0000 7f8627fff700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86180a15e0 0x7f86180a3aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f86200098c0 tx=0x7f8620019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:22.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.074+0000 7f8625ffb700 1 -- 172.21.15.59:0/1388565946 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f862c096bb0 con 0x7f86301006e0 2023-10-08T12:41:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:21 smithi173 ceph-mon[135182]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:21 smithi173 ceph-mon[135182]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 3 op/s 2023-10-08T12:41:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:21 smithi059 ceph-mon[98489]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:21 smithi059 ceph-mon[98489]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 3 op/s 2023-10-08T12:41:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.317+0000 7f8636bff700 1 -- 172.21.15.59:0/1388565946 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8630197f40 con 0x7f86180a15e0 2023-10-08T12:41:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.324+0000 7f8625ffb700 1 -- 172.21.15.59:0/1388565946 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f8630197f40 con 0x7f86180a15e0 2023-10-08T12:41:22.326 INFO:teuthology.orchestra.run.smithi059.stdout:/ 1m 6m3h 2023-10-08T12:41:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 -- 172.21.15.59:0/1388565946 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86180a15e0 msgr2=0x7f86180a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86180a15e0 0x7f86180a3aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f86200098c0 tx=0x7f8620019040 comp rx=0 tx=0).stop 2023-10-08T12:41:22.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 -- 172.21.15.59:0/1388565946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86301006e0 msgr2=0x7f863019c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86301006e0 0x7f863019c8e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f862c00ef10 tx=0x7f862c00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 -- 172.21.15.59:0/1388565946 shutdown_connections 2023-10-08T12:41:22.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f86180a15e0 0x7f86180a3aa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86301066f0 0x7f8630196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86301006e0 0x7f863019c8e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 --2- 172.21.15.59:0/1388565946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86301010a0 0x7f863019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 -- 172.21.15.59:0/1388565946 >> 172.21.15.59:0/1388565946 conn(0x7f86300fc1f0 msgr2=0x7f86300fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:22.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 -- 172.21.15.59:0/1388565946 shutdown_connections 2023-10-08T12:41:22.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:22.327+0000 7f8636bff700 1 -- 172.21.15.59:0/1388565946 wait complete. 2023-10-08T12:41:22.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-10-08T12:41:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:21 smithi092 ceph-mon[134093]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:22.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:21 smithi092 ceph-mon[134093]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 3 op/s 2023-10-08T12:41:22.449 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-10-08T12:41:22.460 INFO:teuthology.run_tasks:Running task workunit... 2023-10-08T12:41:22.512 INFO:tasks.workunit:Pulling workunits from ref 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:41:22.513 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-08T12:41:22.513 INFO:tasks.workunit:timeout=3h 2023-10-08T12:41:22.513 INFO:tasks.workunit:cleanup=True 2023-10-08T12:41:22.513 DEBUG:teuthology.orchestra.run.smithi059:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-08T12:41:22.561 INFO:teuthology.orchestra.run.smithi059.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-08T12:41:22.561 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-08T12:41:22.561 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 79h/121d Inode: 1099511628283 Links: 2 2023-10-08T12:41:22.561 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:41:22.561 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:cephfs_t:s0 2023-10-08T12:41:22.561 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-08 12:39:21.224688131 +0000 2023-10-08T12:41:22.562 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-08 12:39:21.224688131 +0000 2023-10-08T12:41:22.562 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-08 12:41:11.204711023 +0000 2023-10-08T12:41:22.562 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2023-10-08 12:39:21.224688131 +0000 2023-10-08T12:41:22.562 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-08T12:41:22.562 DEBUG:teuthology.orchestra.run.smithi059:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-08T12:41:22.660 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:41:22.707 INFO:tasks.workunit.client.0.smithi059.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-08T12:41:23.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:22 smithi173 ceph-mon[135182]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:22 smithi173 ceph-mon[135182]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:22 smithi173 ceph-mon[135182]: mgrmap e23: x(active, since 8m), standbys: z, y 2023-10-08T12:41:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:22 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:41:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:22 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:41:23.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:22 smithi059 ceph-mon[98489]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:23.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:22 smithi059 ceph-mon[98489]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:23.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:22 smithi059 ceph-mon[98489]: mgrmap e23: x(active, since 8m), standbys: z, y 2023-10-08T12:41:23.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:22 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:41:23.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:22 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:41:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:22 smithi092 ceph-mon[134093]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:22 smithi092 ceph-mon[134093]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:22 smithi092 ceph-mon[134093]: mgrmap e23: x(active, since 8m), standbys: z, y 2023-10-08T12:41:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:22 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:41:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:22 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:41:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:23 smithi173 ceph-mon[135182]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:23 smithi173 ceph-mon[135182]: pgmap v320: 97 pgs: 97 active+clean; 962 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-10-08T12:41:24.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:23 smithi059 ceph-mon[98489]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:24.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:23 smithi059 ceph-mon[98489]: pgmap v320: 97 pgs: 97 active+clean; 962 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-10-08T12:41:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:23 smithi092 ceph-mon[134093]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:41:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:23 smithi092 ceph-mon[134093]: pgmap v320: 97 pgs: 97 active+clean; 962 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-10-08T12:41:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:25 smithi173 ceph-mon[135182]: pgmap v321: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 36 op/s 2023-10-08T12:41:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:25 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:26.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:25 smithi059 ceph-mon[98489]: pgmap v321: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 36 op/s 2023-10-08T12:41:26.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:26.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:26.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:26.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:25 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:25 smithi092 ceph-mon[134093]: pgmap v321: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 36 op/s 2023-10-08T12:41:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:25 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:41:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:41:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:27.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:27.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:27.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:41:27.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:41:27.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:41:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:41:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:41:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:28 smithi092 ceph-mon[134093]: pgmap v322: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 115 KiB/s wr, 37 op/s 2023-10-08T12:41:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:28 smithi173 ceph-mon[135182]: pgmap v322: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 115 KiB/s wr, 37 op/s 2023-10-08T12:41:28.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:28 smithi059 ceph-mon[98489]: pgmap v322: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 115 KiB/s wr, 37 op/s 2023-10-08T12:41:30.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:29 smithi059 ceph-mon[98489]: pgmap v323: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 36 op/s 2023-10-08T12:41:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:29 smithi092 ceph-mon[134093]: pgmap v323: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 36 op/s 2023-10-08T12:41:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:29 smithi173 ceph-mon[135182]: pgmap v323: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 36 op/s 2023-10-08T12:41:32.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:31 smithi092 ceph-mon[134093]: pgmap v324: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 36 op/s 2023-10-08T12:41:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:31 smithi173 ceph-mon[135182]: pgmap v324: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 36 op/s 2023-10-08T12:41:32.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:31 smithi059 ceph-mon[98489]: pgmap v324: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 36 op/s 2023-10-08T12:41:34.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:33 smithi092 ceph-mon[134093]: pgmap v325: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 35 op/s 2023-10-08T12:41:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:33 smithi173 ceph-mon[135182]: pgmap v325: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 35 op/s 2023-10-08T12:41:34.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:33 smithi059 ceph-mon[98489]: pgmap v325: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 115 KiB/s wr, 35 op/s 2023-10-08T12:41:36.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:35 smithi092 ceph-mon[134093]: pgmap v326: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 70 KiB/s wr, 30 op/s 2023-10-08T12:41:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:35 smithi173 ceph-mon[135182]: pgmap v326: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 70 KiB/s wr, 30 op/s 2023-10-08T12:41:36.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:35 smithi059 ceph-mon[98489]: pgmap v326: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 70 KiB/s wr, 30 op/s 2023-10-08T12:41:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:37 smithi173 ceph-mon[135182]: pgmap v327: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2023-10-08T12:41:38.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:37 smithi059 ceph-mon[98489]: pgmap v327: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2023-10-08T12:41:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:37 smithi092 ceph-mon[134093]: pgmap v327: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2023-10-08T12:41:40.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:39 smithi059 ceph-mon[98489]: pgmap v328: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:39 smithi092 ceph-mon[134093]: pgmap v328: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:39 smithi173 ceph-mon[135182]: pgmap v328: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:42.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:41 smithi092 ceph-mon[134093]: pgmap v329: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:41 smithi173 ceph-mon[135182]: pgmap v329: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:41 smithi059 ceph-mon[98489]: pgmap v329: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:44.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:43 smithi092 ceph-mon[134093]: pgmap v330: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:43 smithi173 ceph-mon[135182]: pgmap v330: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:44.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:43 smithi059 ceph-mon[98489]: pgmap v330: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:45 smithi173 ceph-mon[135182]: pgmap v331: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:45 smithi059 ceph-mon[98489]: pgmap v331: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:46.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:45 smithi092 ceph-mon[134093]: pgmap v331: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:47 smithi173 ceph-mon[135182]: pgmap v332: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:48.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:47 smithi059 ceph-mon[98489]: pgmap v332: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:47 smithi092 ceph-mon[134093]: pgmap v332: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:50.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:49 smithi059 ceph-mon[98489]: pgmap v333: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:49 smithi092 ceph-mon[134093]: pgmap v333: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:49 smithi173 ceph-mon[135182]: pgmap v333: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:50.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:41:50.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.983+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3205896512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b601020b0 msgr2=0x7f5b6010a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.983+0000 7f5b65f9d700 1 --2- 172.21.15.59:0/3205896512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b601020b0 0x7f5b6010a590 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009990 tx=0x7f5b4c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.983+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3205896512 shutdown_connections 2023-10-08T12:41:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.983+0000 7f5b65f9d700 1 --2- 172.21.15.59:0/3205896512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b60101790 0x7f5b60101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.983+0000 7f5b65f9d700 1 --2- 172.21.15.59:0/3205896512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b6010ab60 0x7f5b6010d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.983+0000 7f5b65f9d700 1 --2- 172.21.15.59:0/3205896512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b601020b0 0x7f5b6010a590 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.983+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3205896512 >> 172.21.15.59:0/3205896512 conn(0x7f5b600faf50 msgr2=0x7f5b600fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.983+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3205896512 shutdown_connections 2023-10-08T12:41:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.983+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3205896512 wait complete. 2023-10-08T12:41:50.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.984+0000 7f5b65f9d700 1 Processor -- start 2023-10-08T12:41:50.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.984+0000 7f5b65f9d700 1 -- start start 2023-10-08T12:41:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.985+0000 7f5b65f9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60101790 0x7f5b6019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.985+0000 7f5b65f9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b601020b0 0x7f5b6019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.985+0000 7f5b65f9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b6010ab60 0x7f5b60198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.985+0000 7f5b65f9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60199140 con 0x7f5b60101790 2023-10-08T12:41:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.985+0000 7f5b65f9d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b601992b0 con 0x7f5b601020b0 2023-10-08T12:41:50.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.985+0000 7f5b65f9d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60199470 con 0x7f5b6010ab60 2023-10-08T12:41:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.985+0000 7f5b64f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60101790 0x7f5b6019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.985+0000 7f5b64f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60101790 0x7f5b6019e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33300/0 (socket says 172.21.15.59:33300) 2023-10-08T12:41:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.985+0000 7f5b64f9b700 1 -- 172.21.15.59:0/3450742603 learned_addr learned my addr 172.21.15.59:0/3450742603 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.985+0000 7f5b6579c700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b6010ab60 0x7f5b60198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:50.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.985+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b601020b0 0x7f5b6019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:50.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.986+0000 7f5b64f9b700 1 -- 172.21.15.59:0/3450742603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b6010ab60 msgr2=0x7f5b60198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:50.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.986+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b6010ab60 0x7f5b60198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:50.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.986+0000 7f5b64f9b700 1 -- 172.21.15.59:0/3450742603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b601020b0 msgr2=0x7f5b6019eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:50.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.986+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b601020b0 0x7f5b6019eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:50.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.986+0000 7f5b64f9b700 1 -- 172.21.15.59:0/3450742603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b54009520 con 0x7f5b60101790 2023-10-08T12:41:50.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.986+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60101790 0x7f5b6019e960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400eb30 tx=0x7f5b5400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:50.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.986+0000 7f5b5dffb700 1 -- 172.21.15.59:0/3450742603 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54009880 con 0x7f5b60101790 2023-10-08T12:41:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.986+0000 7f5b5dffb700 1 -- 172.21.15.59:0/3450742603 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b540044e0 con 0x7f5b60101790 2023-10-08T12:41:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.986+0000 7f5b5dffb700 1 -- 172.21.15.59:0/3450742603 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54003d80 con 0x7f5b60101790 2023-10-08T12:41:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.986+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3450742603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c0095f0 con 0x7f5b60101790 2023-10-08T12:41:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.987+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3450742603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b601a5770 con 0x7f5b60101790 2023-10-08T12:41:50.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.991+0000 7f5b5dffb700 1 -- 172.21.15.59:0/3450742603 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 23) v1 ==== 136077+0+0 (secure 0 0 0) 0x7f5b54003f20 con 0x7f5b60101790 2023-10-08T12:41:50.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.992+0000 7f5b5dffb700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5b500a15e0 0x7f5b500a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:50.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.992+0000 7f5b7abebb80 1 Processor -- start 2023-10-08T12:41:50.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.992+0000 7f5b5dffb700 1 -- 172.21.15.59:0/3450742603 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5b54014070 con 0x7f5b60101790 2023-10-08T12:41:50.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.992+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5b500a15e0 0x7f5b500a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.992+0000 7f5b7abebb80 1 -- start start 2023-10-08T12:41:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb2d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb2d970 0x5555cdb382c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb38800 0x5555cdb3abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cda96460 con 0x5555cdb2d050 2023-10-08T12:41:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cda87c20 con 0x5555cdb38800 2023-10-08T12:41:50.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cda85540 con 0x5555cdb2d970 2023-10-08T12:41:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b64f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb2d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b64f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb2d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33316/0 (socket says 172.21.15.59:33316) 2023-10-08T12:41:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b64f9b700 1 -- 172.21.15.59:0/628541834 learned_addr learned my addr 172.21.15.59:0/628541834 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5b500a15e0 0x7f5b500a3aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0098e0 tx=0x7f5b4c005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/628541834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb2d970 0x5555cdb382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:50.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.993+0000 7f5b6579c700 1 --2- 172.21.15.59:0/628541834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb38800 0x5555cdb3abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.994+0000 7f5b64f9b700 1 -- 172.21.15.59:0/628541834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb2d970 msgr2=0x5555cdb382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.994+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/628541834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb2d970 0x5555cdb382c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.994+0000 7f5b64f9b700 1 -- 172.21.15.59:0/628541834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb38800 msgr2=0x5555cdb3abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.994+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/628541834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb38800 0x5555cdb3abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.994+0000 7f5b64f9b700 1 -- 172.21.15.59:0/628541834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555cd8abde0 con 0x5555cdb2d050 2023-10-08T12:41:51.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.994+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/628541834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb2d430 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5b54096a70 tx=0x7f5b5409a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b542865aeffe2e6c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.994+0000 7f5b4affd700 1 -- 172.21.15.59:0/628541834 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5409ac70 con 0x5555cdb2d050 2023-10-08T12:41:51.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.994+0000 7f5b4affd700 1 -- 172.21.15.59:0/628541834 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b5409a570 con 0x5555cdb2d050 2023-10-08T12:41:51.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.994+0000 7f5b4affd700 1 -- 172.21.15.59:0/628541834 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5401fef0 con 0x5555cdb2d050 2023-10-08T12:41:51.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.995+0000 7f5b7abebb80 1 -- 172.21.15.59:0/628541834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 msgr2=0x5555cdb2d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.995+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/628541834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb2d430 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5b54096a70 tx=0x7f5b5409a130 comp rx=0 tx=0).stop 2023-10-08T12:41:51.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.995+0000 7f5b7abebb80 1 -- 172.21.15.59:0/628541834 shutdown_connections 2023-10-08T12:41:51.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.995+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/628541834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb38800 0x5555cdb3abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.995+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/628541834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb2d430 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.995+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/628541834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb2d970 0x5555cdb382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.995+0000 7f5b7abebb80 1 -- 172.21.15.59:0/628541834 >> 172.21.15.59:0/628541834 conn(0x5555cdaa2260 msgr2=0x5555cdb29460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.995+0000 7f5b7abebb80 1 -- 172.21.15.59:0/628541834 shutdown_connections 2023-10-08T12:41:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.995+0000 7f5b7abebb80 1 -- 172.21.15.59:0/628541834 wait complete. 2023-10-08T12:41:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.996+0000 7f5b7abebb80 1 -- start start 2023-10-08T12:41:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.996+0000 7f5b7abebb80 1 Processor -- start 2023-10-08T12:41:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.996+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb2d050 0x5555cdb38270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.996+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb355f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb38800 0x5555cdb35d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cda80e30 con 0x5555cdb38800 2023-10-08T12:41:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cda1d710 con 0x5555cdb2d970 2023-10-08T12:41:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cda1d3b0 con 0x5555cdb2d050 2023-10-08T12:41:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b7abebb80 10 client.0 _ll_register_callbacks cb 0x5555cd87a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b64f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb2d050 0x5555cdb38270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b6579c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb38800 0x5555cdb35d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb355f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:39100/0 (socket says 172.21.15.59:39100) 2023-10-08T12:41:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b5ffff700 1 -- 172.21.15.59:0/2512035967 learned_addr learned my addr 172.21.15.59:0/2512035967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b5ffff700 1 -- 172.21.15.59:0/2512035967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb2d050 msgr2=0x5555cdb38270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb2d050 0x5555cdb38270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b5ffff700 1 -- 172.21.15.59:0/2512035967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb38800 msgr2=0x5555cdb35d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb38800 0x5555cdb35d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b5ffff700 1 -- 172.21.15.59:0/2512035967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b601a5770 con 0x5555cdb2d970 2023-10-08T12:41:51.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb2d050 0x5555cdb38270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:51.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.997+0000 7f5b6579c700 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb38800 0x5555cdb35d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:51.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.998+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb355f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009990 tx=0x7f5b4c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31612543fc27479b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.998+0000 7f5b3ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:41:51.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.998+0000 7f5b3ffff700 1 -- 172.21.15.59:0/2512035967 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c005720 con 0x5555cdb2d970 2023-10-08T12:41:51.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.998+0000 7f5b7abebb80 1 -- 172.21.15.59:0/2512035967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555cda48eb0 con 0x5555cdb2d970 2023-10-08T12:41:51.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.998+0000 7f5b3ffff700 1 -- 172.21.15.59:0/2512035967 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5b4c004dc0 con 0x5555cdb2d970 2023-10-08T12:41:51.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.998+0000 7f5b3ffff700 1 -- 172.21.15.59:0/2512035967 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b4c00f460 con 0x5555cdb2d970 2023-10-08T12:41:51.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.998+0000 7f5b7abebb80 10 client.25439 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:51.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.998+0000 7f5b7abebb80 1 -- 172.21.15.59:0/2512035967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5555cd894c60 con 0x5555cdb2d970 2023-10-08T12:41:51.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.999+0000 7f5b3ffff700 1 -- 172.21.15.59:0/2512035967 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5555cda48eb0 con 0x5555cdb2d970 2023-10-08T12:41:51.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.999+0000 7f5b3ffff700 1 -- 172.21.15.59:0/2512035967 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5b4c02f740 con 0x5555cdb2d970 2023-10-08T12:41:51.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.999+0000 7f5b7abebb80 10 client.25439 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:51.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.999+0000 7f5b7abebb80 10 client.25439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:51.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.999+0000 7f5b7abebb80 20 client.25439 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:51.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.999+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5555cdb482c0 0x5555cdb4a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.999+0000 7f5b7abebb80 4 client.25439 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:51.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:50.999+0000 7f5b7abebb80 1 -- 172.21.15.59:0/2512035967 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555cda79e10 con 0x5555cdb482c0 2023-10-08T12:41:51.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.000+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5555cdb482c0 0x5555cdb4a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.000+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5555cdb482c0 0x5555cdb4a6e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4502284a0d7948a server_cookie=e170e990f22c2ea6 in_seq=0 out_seq=0 2023-10-08T12:41:51.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.000+0000 7f5b3ffff700 10 client.25439 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:51.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b3ffff700 1 -- 172.21.15.59:0/2512035967 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5555cda79e10 con 0x5555cdb482c0 2023-10-08T12:41:51.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b3ffff700 10 client.25439 handle_command_reply: tid=0 2023-10-08T12:41:51.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b7abebb80 1 client.25439 shutdown 2023-10-08T12:41:51.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b7abebb80 1 -- 172.21.15.59:0/2512035967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 msgr2=0x5555cdb355f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb355f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009990 tx=0x7f5b4c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b7abebb80 1 -- 172.21.15.59:0/2512035967 shutdown_connections 2023-10-08T12:41:51.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5555cdb482c0 0x5555cdb4a6e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb38800 0x5555cdb35d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb2d050 0x5555cdb38270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b3ffff700 0 client.25439 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:51.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/2512035967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb355f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b7abebb80 1 -- 172.21.15.59:0/2512035967 >> 172.21.15.59:0/2512035967 conn(0x5555cdaa2260 msgr2=0x5555cdb2f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b7abebb80 1 -- 172.21.15.59:0/2512035967 shutdown_connections 2023-10-08T12:41:51.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.001+0000 7f5b7abebb80 1 -- 172.21.15.59:0/2512035967 wait complete. 2023-10-08T12:41:51.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.002+0000 7f5b7abebb80 20 client.25439 trim_cache size 0 max 16384 2023-10-08T12:41:51.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.032+0000 7f5b7abebb80 1 Processor -- start 2023-10-08T12:41:51.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.032+0000 7f5b7abebb80 1 -- start start 2023-10-08T12:41:51.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.032+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb29420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.032+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb34eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.032+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb38800 0x5555cdb3f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.032+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cd901920 con 0x5555cdb2d050 2023-10-08T12:41:51.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.032+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cdb2eeb0 con 0x5555cdb2d970 2023-10-08T12:41:51.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.032+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cdb36090 con 0x5555cdb38800 2023-10-08T12:41:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.032+0000 7f5b64f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb29420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.032+0000 7f5b64f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb29420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33346/0 (socket says 172.21.15.59:33346) 2023-10-08T12:41:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.032+0000 7f5b64f9b700 1 -- 172.21.15.59:0/1501813090 learned_addr learned my addr 172.21.15.59:0/1501813090 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/1501813090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb34eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b6579c700 1 --2- 172.21.15.59:0/1501813090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb38800 0x5555cdb3f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b64f9b700 1 -- 172.21.15.59:0/1501813090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb38800 msgr2=0x5555cdb3f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/1501813090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb38800 0x5555cdb3f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b64f9b700 1 -- 172.21.15.59:0/1501813090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 msgr2=0x5555cdb34eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/1501813090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb34eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b64f9b700 1 -- 172.21.15.59:0/1501813090 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555cd8d2250 con 0x5555cdb2d050 2023-10-08T12:41:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/1501813090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb34eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/1501813090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb29420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5b540036c0 tx=0x7f5b540969e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bf1cb0b2efa8dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b4b7fe700 1 -- 172.21.15.59:0/1501813090 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b540b8040 con 0x5555cdb2d050 2023-10-08T12:41:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b4b7fe700 1 -- 172.21.15.59:0/1501813090 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b540a2900 con 0x5555cdb2d050 2023-10-08T12:41:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.033+0000 7f5b4b7fe700 1 -- 172.21.15.59:0/1501813090 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b540cafb0 con 0x5555cdb2d050 2023-10-08T12:41:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.034+0000 7f5b7abebb80 1 -- 172.21.15.59:0/1501813090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 msgr2=0x5555cdb29420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.034+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/1501813090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb29420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5b540036c0 tx=0x7f5b540969e0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.034+0000 7f5b7abebb80 1 -- 172.21.15.59:0/1501813090 shutdown_connections 2023-10-08T12:41:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.034+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/1501813090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb38800 0x5555cdb3f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.034+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/1501813090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb29420 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.034+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/1501813090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb34eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.034+0000 7f5b7abebb80 1 -- 172.21.15.59:0/1501813090 >> 172.21.15.59:0/1501813090 conn(0x5555cdaa2260 msgr2=0x5555cdb28d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.034+0000 7f5b7abebb80 1 -- 172.21.15.59:0/1501813090 shutdown_connections 2023-10-08T12:41:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.035+0000 7f5b7abebb80 1 -- 172.21.15.59:0/1501813090 wait complete. 2023-10-08T12:41:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.035+0000 7f5b7abebb80 1 -- start start 2023-10-08T12:41:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.035+0000 7f5b7abebb80 1 Processor -- start 2023-10-08T12:41:51.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb3f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb3d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b7abebb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb38800 0x5555cdb3dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cdb3e570 con 0x5555cdb2d050 2023-10-08T12:41:51.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cdb3e6e0 con 0x5555cdb2d970 2023-10-08T12:41:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b7abebb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555cdb9c100 con 0x5555cdb38800 2023-10-08T12:41:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b7abebb80 10 client.0 _ll_register_callbacks cb 0x7f5b4c00ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b64f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb3f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b64f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb3f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33354/0 (socket says 172.21.15.59:33354) 2023-10-08T12:41:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b64f9b700 1 -- 172.21.15.59:0/4130253693 learned_addr learned my addr 172.21.15.59:0/4130253693 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb3d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.036+0000 7f5b6579c700 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb38800 0x5555cdb3dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b64f9b700 1 -- 172.21.15.59:0/4130253693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb38800 msgr2=0x5555cdb3dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb38800 0x5555cdb3dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b64f9b700 1 -- 172.21.15.59:0/4130253693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 msgr2=0x5555cdb3d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb3d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b64f9b700 1 -- 172.21.15.59:0/4130253693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555cd894c60 con 0x5555cdb2d050 2023-10-08T12:41:51.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b64f9b700 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb3f3d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5b5409a500 tx=0x7f5b54099fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4724266210429c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b3ffff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:41:51.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b3ffff700 1 -- 172.21.15.59:0/4130253693 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5409e6c0 con 0x5555cdb2d050 2023-10-08T12:41:51.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b3ffff700 1 -- 172.21.15.59:0/4130253693 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5b5400cdd0 con 0x5555cdb2d050 2023-10-08T12:41:51.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b7abebb80 1 -- 172.21.15.59:0/4130253693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b5409a570 con 0x5555cdb2d050 2023-10-08T12:41:51.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b3ffff700 1 -- 172.21.15.59:0/4130253693 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b540cafb0 con 0x5555cdb2d050 2023-10-08T12:41:51.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b7abebb80 10 client.15450 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:51.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.037+0000 7f5b7abebb80 1 -- 172.21.15.59:0/4130253693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5555cd8abde0 con 0x5555cdb2d050 2023-10-08T12:41:51.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.038+0000 7f5b3ffff700 1 -- 172.21.15.59:0/4130253693 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b5409a570 con 0x5555cdb2d050 2023-10-08T12:41:51.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.038+0000 7f5b3ffff700 1 -- 172.21.15.59:0/4130253693 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5b540a2470 con 0x5555cdb2d050 2023-10-08T12:41:51.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.038+0000 7f5b7abebb80 10 client.15450 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.038+0000 7f5b7abebb80 10 client.15450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.038+0000 7f5b7abebb80 20 client.15450 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.038+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5555cdb9d390 0x5555cdb9f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.038+0000 7f5b7abebb80 4 client.15450 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:41:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.038+0000 7f5b7abebb80 1 -- 172.21.15.59:0/4130253693 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5555cda79b30 con 0x5555cdb9d390 2023-10-08T12:41:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.038+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5555cdb9d390 0x5555cdb9f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b5ffff700 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5555cdb9d390 0x5555cdb9f780 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ad8965117899270 server_cookie=5a38f730baf6ea4f in_seq=0 out_seq=0 2023-10-08T12:41:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b3ffff700 10 client.15450 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b3ffff700 1 -- 172.21.15.59:0/4130253693 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5555cda79b30 con 0x5555cdb9d390 2023-10-08T12:41:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b3ffff700 10 client.15450 handle_command_reply: tid=0 2023-10-08T12:41:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b7abebb80 1 client.15450 shutdown 2023-10-08T12:41:51.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b7abebb80 1 -- 172.21.15.59:0/4130253693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 msgr2=0x5555cdb3f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb3f3d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5b5409a500 tx=0x7f5b54099fd0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b7abebb80 1 -- 172.21.15.59:0/4130253693 shutdown_connections 2023-10-08T12:41:51.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5555cdb9d390 0x5555cdb9f780 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555cdb38800 0x5555cdb3dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b3ffff700 0 client.15450 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5555cdb2d050 0x5555cdb3f3d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b7abebb80 1 --2- 172.21.15.59:0/4130253693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5555cdb2d970 0x5555cdb3d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.039+0000 7f5b7abebb80 1 -- 172.21.15.59:0/4130253693 >> 172.21.15.59:0/4130253693 conn(0x5555cdaa2260 msgr2=0x5555cdb223a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b7abebb80 1 -- 172.21.15.59:0/4130253693 shutdown_connections 2023-10-08T12:41:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b7abebb80 1 -- 172.21.15.59:0/4130253693 wait complete. 2023-10-08T12:41:51.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b7abebb80 20 client.15450 trim_cache size 0 max 16384 2023-10-08T12:41:51.050 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:41:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:41:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:41:51.051 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:41:51.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3450742603 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5b500a15e0 msgr2=0x7f5b500a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b65f9d700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5b500a15e0 0x7f5b500a3aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0098e0 tx=0x7f5b4c005960 comp rx=0 tx=0).stop 2023-10-08T12:41:51.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3450742603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60101790 msgr2=0x7f5b6019e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b65f9d700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60101790 0x7f5b6019e960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400eb30 tx=0x7f5b5400ee40 comp rx=0 tx=0).stop 2023-10-08T12:41:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3450742603 shutdown_connections 2023-10-08T12:41:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b65f9d700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5b500a15e0 0x7f5b500a3aa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b65f9d700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b6010ab60 0x7f5b60198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b65f9d700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60101790 0x7f5b6019e960 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.040+0000 7f5b65f9d700 1 --2- 172.21.15.59:0/3450742603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b601020b0 0x7f5b6019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.041+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3450742603 >> 172.21.15.59:0/3450742603 conn(0x7f5b600faf50 msgr2=0x7f5b60100560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.041+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3450742603 shutdown_connections 2023-10-08T12:41:51.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.041+0000 7f5b65f9d700 1 -- 172.21.15.59:0/3450742603 wait complete. 2023-10-08T12:41:51.059 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:41:51.060 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:41:51.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.271+0000 7fef313ff700 1 -- 172.21.15.59:0/695004693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef2c100630 msgr2=0x7fef2c100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.271+0000 7fef313ff700 1 --2- 172.21.15.59:0/695004693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef2c100630 0x7fef2c100ab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef20009990 tx=0x7fef20009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.272+0000 7fef313ff700 1 -- 172.21.15.59:0/695004693 shutdown_connections 2023-10-08T12:41:51.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.272+0000 7fef313ff700 1 --2- 172.21.15.59:0/695004693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c100ff0 0x7fef2c10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.272+0000 7fef313ff700 1 --2- 172.21.15.59:0/695004693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef2c106640 0x7fef2c106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.272+0000 7fef313ff700 1 --2- 172.21.15.59:0/695004693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef2c100630 0x7fef2c100ab0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.272+0000 7fef313ff700 1 -- 172.21.15.59:0/695004693 >> 172.21.15.59:0/695004693 conn(0x7fef2c0fc140 msgr2=0x7fef2c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.272+0000 7fef313ff700 1 -- 172.21.15.59:0/695004693 shutdown_connections 2023-10-08T12:41:51.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.272+0000 7fef313ff700 1 -- 172.21.15.59:0/695004693 wait complete. 2023-10-08T12:41:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.273+0000 7fef313ff700 1 Processor -- start 2023-10-08T12:41:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.273+0000 7fef313ff700 1 -- start start 2023-10-08T12:41:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.273+0000 7fef313ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c100630 0x7fef2c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.273+0000 7fef313ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef2c100ff0 0x7fef2c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.273+0000 7fef313ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef2c106640 0x7fef2c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.273+0000 7fef313ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c1a4eb0 con 0x7fef2c100630 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.273+0000 7fef313ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c1a5020 con 0x7fef2c100ff0 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.273+0000 7fef313ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c1a51e0 con 0x7fef2c106640 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.274+0000 7fef2affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c100630 0x7fef2c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.274+0000 7fef2affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c100630 0x7fef2c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33376/0 (socket says 172.21.15.59:33376) 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.274+0000 7fef2affd700 1 -- 172.21.15.59:0/3748079556 learned_addr learned my addr 172.21.15.59:0/3748079556 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.274+0000 7fef2a7fc700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef2c100ff0 0x7fef2c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.274+0000 7fef2b7fe700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef2c106640 0x7fef2c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.274+0000 7fef2affd700 1 -- 172.21.15.59:0/3748079556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef2c106640 msgr2=0x7fef2c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.274+0000 7fef2affd700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef2c106640 0x7fef2c073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.274+0000 7fef2affd700 1 -- 172.21.15.59:0/3748079556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef2c100ff0 msgr2=0x7fef2c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.274+0000 7fef2affd700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef2c100ff0 0x7fef2c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.274+0000 7fef2affd700 1 -- 172.21.15.59:0/3748079556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef200095f0 con 0x7fef2c100630 2023-10-08T12:41:51.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.274+0000 7fef2affd700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c100630 0x7fef2c072af0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00e9a0 tx=0x7fef1c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.275+0000 7fef13fff700 1 -- 172.21.15.59:0/3748079556 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c009790 con 0x7fef2c100630 2023-10-08T12:41:51.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.275+0000 7fef313ff700 1 -- 172.21.15.59:0/3748079556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c1a54c0 con 0x7fef2c100630 2023-10-08T12:41:51.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.275+0000 7fef13fff700 1 -- 172.21.15.59:0/3748079556 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef1c010430 con 0x7fef2c100630 2023-10-08T12:41:51.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.275+0000 7fef13fff700 1 -- 172.21.15.59:0/3748079556 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c018680 con 0x7fef2c100630 2023-10-08T12:41:51.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.275+0000 7fef313ff700 1 -- 172.21.15.59:0/3748079556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c1a59d0 con 0x7fef2c100630 2023-10-08T12:41:51.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.276+0000 7fef313ff700 1 -- 172.21.15.59:0/3748079556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c108c50 con 0x7fef2c100630 2023-10-08T12:41:51.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.278+0000 7fef13fff700 1 -- 172.21.15.59:0/3748079556 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 23) v1 ==== 136077+0+0 (secure 0 0 0) 0x7fef1c0105a0 con 0x7fef2c100630 2023-10-08T12:41:51.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.280+0000 7fef13fff700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fef140a1560 0x7fef140a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.280+0000 7fef13fff700 1 -- 172.21.15.59:0/3748079556 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fef1c014070 con 0x7fef2c100630 2023-10-08T12:41:51.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.280+0000 7fef2a7fc700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fef140a1560 0x7fef140a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.281+0000 7fef2a7fc700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fef140a1560 0x7fef140a3a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fef2c074220 tx=0x7fef2000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.284+0000 7fef13fff700 1 -- 172.21.15.59:0/3748079556 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fef1c052100 con 0x7fef2c100630 2023-10-08T12:41:51.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.554+0000 7fef313ff700 1 -- 172.21.15.59:0/3748079556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef2c101d70 con 0x7fef2c100630 2023-10-08T12:41:51.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.555+0000 7fef13fff700 1 -- 172.21.15.59:0/3748079556 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fef1c096540 con 0x7fef2c100630 2023-10-08T12:41:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:41:51.556 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:41:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 -- 172.21.15.59:0/3748079556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fef140a1560 msgr2=0x7fef140a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fef140a1560 0x7fef140a3a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fef2c074220 tx=0x7fef2000b260 comp rx=0 tx=0).stop 2023-10-08T12:41:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 -- 172.21.15.59:0/3748079556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c100630 msgr2=0x7fef2c072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c100630 0x7fef2c072af0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00e9a0 tx=0x7fef1c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 -- 172.21.15.59:0/3748079556 shutdown_connections 2023-10-08T12:41:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fef140a1560 0x7fef140a3a20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef2c106640 0x7fef2c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c100630 0x7fef2c072af0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 --2- 172.21.15.59:0/3748079556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef2c100ff0 0x7fef2c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 -- 172.21.15.59:0/3748079556 >> 172.21.15.59:0/3748079556 conn(0x7fef2c0fc140 msgr2=0x7fef2c0fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 -- 172.21.15.59:0/3748079556 shutdown_connections 2023-10-08T12:41:51.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.558+0000 7fef313ff700 1 -- 172.21.15.59:0/3748079556 wait complete. 2023-10-08T12:41:51.560 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:41:51.578 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:41:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.808+0000 7faf9c1ff700 1 -- 172.21.15.59:0/3354941508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf94100740 msgr2=0x7faf94100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.808+0000 7faf9c1ff700 1 --2- 172.21.15.59:0/3354941508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf94100740 0x7faf94100bc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf84009990 tx=0x7faf84009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.808+0000 7faf9c1ff700 1 -- 172.21.15.59:0/3354941508 shutdown_connections 2023-10-08T12:41:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.808+0000 7faf9c1ff700 1 --2- 172.21.15.59:0/3354941508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf94101100 0x7faf9410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.808+0000 7faf9c1ff700 1 --2- 172.21.15.59:0/3354941508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf94106750 0x7faf94106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.808+0000 7faf9c1ff700 1 --2- 172.21.15.59:0/3354941508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf94100740 0x7faf94100bc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.808+0000 7faf9c1ff700 1 -- 172.21.15.59:0/3354941508 >> 172.21.15.59:0/3354941508 conn(0x7faf940fc230 msgr2=0x7faf940fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.808+0000 7faf9c1ff700 1 -- 172.21.15.59:0/3354941508 shutdown_connections 2023-10-08T12:41:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.809+0000 7faf9c1ff700 1 -- 172.21.15.59:0/3354941508 wait complete. 2023-10-08T12:41:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.810+0000 7faf9c1ff700 1 Processor -- start 2023-10-08T12:41:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.810+0000 7faf9c1ff700 1 -- start start 2023-10-08T12:41:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.810+0000 7faf9c1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf94100740 0x7faf94198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.810+0000 7faf9c1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf94101100 0x7faf94199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.810+0000 7faf9c1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf94106750 0x7faf9419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.810+0000 7faf9c1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9419dd00 con 0x7faf94106750 2023-10-08T12:41:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.810+0000 7faf9c1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9419de70 con 0x7faf94100740 2023-10-08T12:41:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.810+0000 7faf9c1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9419e030 con 0x7faf94101100 2023-10-08T12:41:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf9a79c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf94106750 0x7faf9419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf9979a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf94101100 0x7faf94199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf99f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf94100740 0x7faf94198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf9a79c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf94106750 0x7faf9419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33402/0 (socket says 172.21.15.59:33402) 2023-10-08T12:41:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf9a79c700 1 -- 172.21.15.59:0/2062099904 learned_addr learned my addr 172.21.15.59:0/2062099904 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf9979a700 1 -- 172.21.15.59:0/2062099904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf94100740 msgr2=0x7faf94198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf9979a700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf94100740 0x7faf94198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf9979a700 1 -- 172.21.15.59:0/2062099904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf94106750 msgr2=0x7faf9419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf9979a700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf94106750 0x7faf9419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf9979a700 1 -- 172.21.15.59:0/2062099904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840095f0 con 0x7faf94101100 2023-10-08T12:41:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf9a79c700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf94106750 0x7faf9419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:51.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf99f9b700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf94100740 0x7faf94198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:51.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.811+0000 7faf9979a700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf94101100 0x7faf94199320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faf84000c00 tx=0x7faf84004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.812+0000 7faf8affd700 1 -- 172.21.15.59:0/2062099904 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8401d070 con 0x7faf94101100 2023-10-08T12:41:51.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.812+0000 7faf8affd700 1 -- 172.21.15.59:0/2062099904 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf84021410 con 0x7faf94101100 2023-10-08T12:41:51.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.812+0000 7faf8affd700 1 -- 172.21.15.59:0/2062099904 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84021ea0 con 0x7faf94101100 2023-10-08T12:41:51.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.812+0000 7faf9c1ff700 1 -- 172.21.15.59:0/2062099904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9419e2b0 con 0x7faf94101100 2023-10-08T12:41:51.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.812+0000 7faf9c1ff700 1 -- 172.21.15.59:0/2062099904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf941a5b50 con 0x7faf94101100 2023-10-08T12:41:51.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.817+0000 7faf8affd700 1 -- 172.21.15.59:0/2062099904 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 23) v1 ==== 136077+0+0 (secure 0 0 0) 0x7faf84021580 con 0x7faf94101100 2023-10-08T12:41:51.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.818+0000 7fafafa47b80 1 Processor -- start 2023-10-08T12:41:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.818+0000 7fafafa47b80 1 -- start start 2023-10-08T12:41:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7faf8affd700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faf800a15e0 0x7faf800a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 0x559049d7b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d86110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d86650 0x559049d88a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7fafafa47b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049ce4460 con 0x559049d7ae80 2023-10-08T12:41:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7fafafa47b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049cd5c20 con 0x559049d7b7a0 2023-10-08T12:41:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7fafafa47b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049cd3540 con 0x559049d86650 2023-10-08T12:41:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7faf8affd700 1 -- 172.21.15.59:0/2062099904 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7faf840cde50 con 0x7faf94101100 2023-10-08T12:41:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7faf9a79c700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faf800a15e0 0x7faf800a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7faf9979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d86110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7faf9979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d86110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:39164/0 (socket says 172.21.15.59:39164) 2023-10-08T12:41:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7faf9979a700 1 -- 172.21.15.59:0/369237884 learned_addr learned my addr 172.21.15.59:0/369237884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7faf99f9b700 1 --2- 172.21.15.59:0/369237884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 0x559049d7b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7faf9a79c700 1 --2- 172.21.15.59:0/369237884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d86650 0x559049d88a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7faf9979a700 1 -- 172.21.15.59:0/369237884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d86650 msgr2=0x559049d88a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.819+0000 7faf9979a700 1 --2- 172.21.15.59:0/369237884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d86650 0x559049d88a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.820+0000 7faf9979a700 1 -- 172.21.15.59:0/369237884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 msgr2=0x559049d7b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.820+0000 7faf9979a700 1 --2- 172.21.15.59:0/369237884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 0x559049d7b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.820+0000 7faf9979a700 1 -- 172.21.15.59:0/369237884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559049af9de0 con 0x559049d7b7a0 2023-10-08T12:41:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.820+0000 7faf9979a700 1 --2- 172.21.15.59:0/369237884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d86110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf8409ad00 tx=0x7faf84097410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=162be2dd5dc744ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.820+0000 7faf9a79c700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faf800a15e0 0x7faf800a3aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009c10 tx=0x7faf8c009400 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.820+0000 7faf7ffff700 1 -- 172.21.15.59:0/369237884 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8409a960 con 0x559049d7b7a0 2023-10-08T12:41:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.820+0000 7faf7ffff700 1 -- 172.21.15.59:0/369237884 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf8409fe90 con 0x559049d7b7a0 2023-10-08T12:41:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.820+0000 7faf7ffff700 1 -- 172.21.15.59:0/369237884 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8409b000 con 0x559049d7b7a0 2023-10-08T12:41:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.821+0000 7fafafa47b80 1 -- 172.21.15.59:0/369237884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 msgr2=0x559049d86110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.821+0000 7fafafa47b80 1 --2- 172.21.15.59:0/369237884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d86110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf8409ad00 tx=0x7faf84097410 comp rx=0 tx=0).stop 2023-10-08T12:41:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.821+0000 7fafafa47b80 1 -- 172.21.15.59:0/369237884 shutdown_connections 2023-10-08T12:41:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.821+0000 7fafafa47b80 1 --2- 172.21.15.59:0/369237884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d86650 0x559049d88a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.821+0000 7fafafa47b80 1 --2- 172.21.15.59:0/369237884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 0x559049d7b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.821+0000 7fafafa47b80 1 --2- 172.21.15.59:0/369237884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d86110 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.821+0000 7fafafa47b80 1 -- 172.21.15.59:0/369237884 >> 172.21.15.59:0/369237884 conn(0x559049cf0260 msgr2=0x559049d772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.821+0000 7fafafa47b80 1 -- 172.21.15.59:0/369237884 shutdown_connections 2023-10-08T12:41:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.821+0000 7fafafa47b80 1 -- 172.21.15.59:0/369237884 wait complete. 2023-10-08T12:41:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.822+0000 7fafafa47b80 1 -- start start 2023-10-08T12:41:51.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.822+0000 7fafafa47b80 1 Processor -- start 2023-10-08T12:41:51.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d7ae80 0x559049d86a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d86f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d874f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7fafafa47b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049ccee30 con 0x559049d86650 2023-10-08T12:41:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7fafafa47b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049c6b710 con 0x559049d7b7a0 2023-10-08T12:41:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7fafafa47b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049c6b3b0 con 0x559049d7ae80 2023-10-08T12:41:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7fafafa47b80 10 client.0 _ll_register_callbacks cb 0x559049ac8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7faf9a79c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d874f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7faf99f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d7ae80 0x559049d86a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7faf9a79c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d874f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33422/0 (socket says 172.21.15.59:33422) 2023-10-08T12:41:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7faf9a79c700 1 -- 172.21.15.59:0/3282226242 learned_addr learned my addr 172.21.15.59:0/3282226242 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.823+0000 7faf9979a700 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d86f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.824+0000 7faf9a79c700 1 -- 172.21.15.59:0/3282226242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d7ae80 msgr2=0x559049d86a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.824+0000 7faf9a79c700 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d7ae80 0x559049d86a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.824+0000 7faf9a79c700 1 -- 172.21.15.59:0/3282226242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 msgr2=0x559049d86f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.824+0000 7faf9a79c700 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d86f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.824+0000 7faf9a79c700 1 -- 172.21.15.59:0/3282226242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf941a5b50 con 0x559049d86650 2023-10-08T12:41:51.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.824+0000 7faf99f9b700 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d7ae80 0x559049d86a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:51.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.824+0000 7faf9979a700 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:51.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.824+0000 7faf9a79c700 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d874f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009690 tx=0x7faf8c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d519553e0ff4c8ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.824+0000 7faf7d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:41:51.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.824+0000 7faf7d7fa700 1 -- 172.21.15.59:0/3282226242 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c025640 con 0x559049d86650 2023-10-08T12:41:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.824+0000 7fafafa47b80 1 -- 172.21.15.59:0/3282226242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559049c96eb0 con 0x559049d86650 2023-10-08T12:41:51.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7faf7d7fa700 1 -- 172.21.15.59:0/3282226242 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7faf8c021040 con 0x559049d86650 2023-10-08T12:41:51.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7faf7d7fa700 1 -- 172.21.15.59:0/3282226242 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf8c0257a0 con 0x559049d86650 2023-10-08T12:41:51.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7fafafa47b80 10 client.15468 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:51.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7fafafa47b80 1 -- 172.21.15.59:0/3282226242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x559049ae2c60 con 0x559049d86650 2023-10-08T12:41:51.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7faf7d7fa700 1 -- 172.21.15.59:0/3282226242 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559049c96eb0 con 0x559049d86650 2023-10-08T12:41:51.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7faf7d7fa700 1 -- 172.21.15.59:0/3282226242 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faf8c01a7f0 con 0x559049d86650 2023-10-08T12:41:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7fafafa47b80 10 client.15468 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7fafafa47b80 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7fafafa47b80 20 client.15468 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7fafafa47b80 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559049d95d60 0x559049d98180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7fafafa47b80 4 client.15468 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.825+0000 7fafafa47b80 1 -- 172.21.15.59:0/3282226242 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559049cc7e10 con 0x559049d95d60 2023-10-08T12:41:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.826+0000 7faf99f9b700 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559049d95d60 0x559049d98180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.826+0000 7faf99f9b700 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559049d95d60 0x559049d98180 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ae350ee7821ca73 server_cookie=c36c7380fc77bf3c in_seq=0 out_seq=0 2023-10-08T12:41:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.826+0000 7faf7d7fa700 10 client.15468 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.827+0000 7faf7d7fa700 1 -- 172.21.15.59:0/3282226242 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559049cc7e10 con 0x559049d95d60 2023-10-08T12:41:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.827+0000 7faf7d7fa700 10 client.15468 handle_command_reply: tid=0 2023-10-08T12:41:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.827+0000 7fafafa47b80 1 client.15468 shutdown 2023-10-08T12:41:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.827+0000 7fafafa47b80 1 -- 172.21.15.59:0/3282226242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 msgr2=0x559049d874f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.827+0000 7fafafa47b80 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d874f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009690 tx=0x7faf8c004b40 comp rx=0 tx=0).stop 2023-10-08T12:41:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.827+0000 7fafafa47b80 1 -- 172.21.15.59:0/3282226242 shutdown_connections 2023-10-08T12:41:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.827+0000 7fafafa47b80 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559049d95d60 0x559049d98180 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.828+0000 7fafafa47b80 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d874f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.828+0000 7fafafa47b80 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d7ae80 0x559049d86a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.828+0000 7fafafa47b80 1 --2- 172.21.15.59:0/3282226242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.828+0000 7fafafa47b80 1 -- 172.21.15.59:0/3282226242 >> 172.21.15.59:0/3282226242 conn(0x559049cf0260 msgr2=0x559049d76ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.828+0000 7faf7d7fa700 0 client.15468 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:51.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.828+0000 7fafafa47b80 1 -- 172.21.15.59:0/3282226242 shutdown_connections 2023-10-08T12:41:51.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.828+0000 7fafafa47b80 1 -- 172.21.15.59:0/3282226242 wait complete. 2023-10-08T12:41:51.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.828+0000 7fafafa47b80 20 client.15468 trim_cache size 0 max 16384 2023-10-08T12:41:51.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.843+0000 7fafafa47b80 1 Processor -- start 2023-10-08T12:41:51.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.843+0000 7fafafa47b80 1 -- start start 2023-10-08T12:41:51.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 0x559049d8aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d85020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d86650 0x559049d97d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7fafafa47b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049b4f920 con 0x559049d7ae80 2023-10-08T12:41:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7fafafa47b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049d91b70 con 0x559049d7b7a0 2023-10-08T12:41:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7fafafa47b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049d7c970 con 0x559049d86650 2023-10-08T12:41:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7faf99f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 0x559049d8aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7faf9979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d85020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7faf9979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d85020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:39174/0 (socket says 172.21.15.59:39174) 2023-10-08T12:41:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7faf99f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 0x559049d8aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33434/0 (socket says 172.21.15.59:33434) 2023-10-08T12:41:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7faf9979a700 1 -- 172.21.15.59:0/3322908567 learned_addr learned my addr 172.21.15.59:0/3322908567 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.844+0000 7faf9a79c700 1 --2- 172.21.15.59:0/3322908567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d86650 0x559049d97d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.845+0000 7faf9979a700 1 -- 172.21.15.59:0/3322908567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d86650 msgr2=0x559049d97d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.845+0000 7faf9979a700 1 --2- 172.21.15.59:0/3322908567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d86650 0x559049d97d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.845+0000 7faf9979a700 1 -- 172.21.15.59:0/3322908567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 msgr2=0x559049d8aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.845+0000 7faf9979a700 1 --2- 172.21.15.59:0/3322908567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 0x559049d8aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.845+0000 7faf9979a700 1 -- 172.21.15.59:0/3322908567 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559049b20250 con 0x559049d7b7a0 2023-10-08T12:41:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.845+0000 7faf99f9b700 1 --2- 172.21.15.59:0/3322908567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 0x559049d8aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.845+0000 7faf9979a700 1 --2- 172.21.15.59:0/3322908567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d85020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faf84009ce0 tx=0x7faf84096d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97ecbe030facdd3f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.845+0000 7faf88ff9700 1 -- 172.21.15.59:0/3322908567 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8409a960 con 0x559049d7b7a0 2023-10-08T12:41:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.845+0000 7faf88ff9700 1 -- 172.21.15.59:0/3322908567 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf8409b700 con 0x559049d7b7a0 2023-10-08T12:41:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.845+0000 7faf88ff9700 1 -- 172.21.15.59:0/3322908567 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8409b070 con 0x559049d7b7a0 2023-10-08T12:41:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.846+0000 7fafafa47b80 1 -- 172.21.15.59:0/3322908567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 msgr2=0x559049d85020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.846+0000 7fafafa47b80 1 --2- 172.21.15.59:0/3322908567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d85020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faf84009ce0 tx=0x7faf84096d40 comp rx=0 tx=0).stop 2023-10-08T12:41:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.846+0000 7fafafa47b80 1 -- 172.21.15.59:0/3322908567 shutdown_connections 2023-10-08T12:41:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.846+0000 7fafafa47b80 1 --2- 172.21.15.59:0/3322908567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d86650 0x559049d97d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.846+0000 7fafafa47b80 1 --2- 172.21.15.59:0/3322908567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d7ae80 0x559049d8aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.846+0000 7fafafa47b80 1 --2- 172.21.15.59:0/3322908567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049d85020 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.846+0000 7fafafa47b80 1 -- 172.21.15.59:0/3322908567 >> 172.21.15.59:0/3322908567 conn(0x559049cf0260 msgr2=0x559049d7ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.846+0000 7fafafa47b80 1 -- 172.21.15.59:0/3322908567 shutdown_connections 2023-10-08T12:41:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.846+0000 7fafafa47b80 1 -- 172.21.15.59:0/3322908567 wait complete. 2023-10-08T12:41:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.846+0000 7fafafa47b80 1 -- start start 2023-10-08T12:41:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.847+0000 7fafafa47b80 1 Processor -- start 2023-10-08T12:41:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.847+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d7ae80 0x559049de11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.847+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049de1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.847+0000 7fafafa47b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d89de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.847+0000 7fafafa47b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049d8a3b0 con 0x559049d86650 2023-10-08T12:41:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.847+0000 7fafafa47b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049d8a4f0 con 0x559049d7b7a0 2023-10-08T12:41:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.847+0000 7fafafa47b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559049d8a6b0 con 0x559049d7ae80 2023-10-08T12:41:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.847+0000 7fafafa47b80 10 client.0 _ll_register_callbacks cb 0x7faf8c007620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9a79c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d89de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049de1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9a79c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d89de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33442/0 (socket says 172.21.15.59:33442) 2023-10-08T12:41:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049de1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:39176/0 (socket says 172.21.15.59:39176) 2023-10-08T12:41:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9a79c700 1 -- 172.21.15.59:0/2369606264 learned_addr learned my addr 172.21.15.59:0/2369606264 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf99f9b700 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d7ae80 0x559049de11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9979a700 1 -- 172.21.15.59:0/2369606264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d7ae80 msgr2=0x559049de11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9979a700 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d7ae80 0x559049de11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9979a700 1 -- 172.21.15.59:0/2369606264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 msgr2=0x559049d89de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9979a700 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d89de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9979a700 1 -- 172.21.15.59:0/2369606264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf90012840 con 0x559049d7b7a0 2023-10-08T12:41:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9a79c700 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d89de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf9979a700 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049de1720 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x559049cc7e30 tx=0x7faf8409b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1862e035a5788bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf7d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:41:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf7d7fa700 1 -- 172.21.15.59:0/2369606264 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8409a6f0 con 0x559049d7b7a0 2023-10-08T12:41:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7fafafa47b80 1 -- 172.21.15.59:0/2369606264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf8409fe90 con 0x559049d7b7a0 2023-10-08T12:41:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.848+0000 7faf7d7fa700 1 -- 172.21.15.59:0/2369606264 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7faf8409f150 con 0x559049d7b7a0 2023-10-08T12:41:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7faf7d7fa700 1 -- 172.21.15.59:0/2369606264 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf8409a960 con 0x559049d7b7a0 2023-10-08T12:41:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7fafafa47b80 10 client.25469 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7fafafa47b80 1 -- 172.21.15.59:0/2369606264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x559049af9de0 con 0x559049d7b7a0 2023-10-08T12:41:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7faf7d7fa700 1 -- 172.21.15.59:0/2369606264 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf840b2080 con 0x559049d7b7a0 2023-10-08T12:41:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7faf7d7fa700 1 -- 172.21.15.59:0/2369606264 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faf84084110 con 0x559049d7b7a0 2023-10-08T12:41:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7fafafa47b80 10 client.25469 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7fafafa47b80 10 client.25469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7fafafa47b80 20 client.25469 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7fafafa47b80 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559049de9ce0 0x559049dec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7fafafa47b80 4 client.25469 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:41:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7fafafa47b80 1 -- 172.21.15.59:0/2369606264 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559049cc7b30 con 0x559049de9ce0 2023-10-08T12:41:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.849+0000 7faf99f9b700 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559049de9ce0 0x559049dec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.850+0000 7faf99f9b700 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559049de9ce0 0x559049dec0d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95693688875401c2 server_cookie=6cffb82a5d2ab3d6 in_seq=0 out_seq=0 2023-10-08T12:41:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.850+0000 7faf7d7fa700 10 client.25469 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.850+0000 7faf7d7fa700 1 -- 172.21.15.59:0/2369606264 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559049cc7b30 con 0x559049de9ce0 2023-10-08T12:41:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.850+0000 7faf7d7fa700 10 client.25469 handle_command_reply: tid=0 2023-10-08T12:41:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.850+0000 7fafafa47b80 1 client.25469 shutdown 2023-10-08T12:41:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.850+0000 7fafafa47b80 1 -- 172.21.15.59:0/2369606264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 msgr2=0x559049de1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.850+0000 7fafafa47b80 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049de1720 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x559049cc7e30 tx=0x7faf8409b870 comp rx=0 tx=0).stop 2023-10-08T12:41:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.851+0000 7fafafa47b80 1 -- 172.21.15.59:0/2369606264 shutdown_connections 2023-10-08T12:41:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.851+0000 7fafafa47b80 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559049de9ce0 0x559049dec0d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.851+0000 7fafafa47b80 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559049d86650 0x559049d89de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.851+0000 7fafafa47b80 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559049d7ae80 0x559049de11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.851+0000 7faf7d7fa700 0 client.25469 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:51.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.851+0000 7fafafa47b80 1 --2- 172.21.15.59:0/2369606264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559049d7b7a0 0x559049de1720 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.851+0000 7fafafa47b80 1 -- 172.21.15.59:0/2369606264 >> 172.21.15.59:0/2369606264 conn(0x559049cf0260 msgr2=0x559049d97d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.851+0000 7fafafa47b80 1 -- 172.21.15.59:0/2369606264 shutdown_connections 2023-10-08T12:41:51.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.851+0000 7fafafa47b80 1 -- 172.21.15.59:0/2369606264 wait complete. 2023-10-08T12:41:51.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.851+0000 7fafafa47b80 20 client.25469 trim_cache size 0 max 16384 2023-10-08T12:41:51.861 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:41:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 -- 172.21.15.59:0/2062099904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faf800a15e0 msgr2=0x7faf800a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faf800a15e0 0x7faf800a3aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009c10 tx=0x7faf8c009400 comp rx=0 tx=0).stop 2023-10-08T12:41:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 -- 172.21.15.59:0/2062099904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf94101100 msgr2=0x7faf94199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf94101100 0x7faf94199320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faf84000c00 tx=0x7faf84004730 comp rx=0 tx=0).stop 2023-10-08T12:41:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 -- 172.21.15.59:0/2062099904 shutdown_connections 2023-10-08T12:41:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faf800a15e0 0x7faf800a3aa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf94100740 0x7faf94198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf94106750 0x7faf9419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 --2- 172.21.15.59:0/2062099904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf94101100 0x7faf94199320 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 -- 172.21.15.59:0/2062099904 >> 172.21.15.59:0/2062099904 conn(0x7faf940fc230 msgr2=0x7faf94072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 -- 172.21.15.59:0/2062099904 shutdown_connections 2023-10-08T12:41:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:51.852+0000 7faf9c1ff700 1 -- 172.21.15.59:0/2062099904 wait complete. 2023-10-08T12:41:51.876 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:51 smithi059 ceph-mon[98489]: pgmap v334: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:51.876 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:51 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3748079556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:52.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:51 smithi092 ceph-mon[134093]: pgmap v334: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:52.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:51 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3748079556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:51 smithi173 ceph-mon[135182]: pgmap v334: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:41:52.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:51 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3748079556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:52.879 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:41:52.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:41:53.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.093+0000 7faf135ff700 1 -- 172.21.15.59:0/2010227027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c072c20 msgr2=0x7faf0c073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.093+0000 7faf135ff700 1 --2- 172.21.15.59:0/2010227027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c072c20 0x7faf0c073000 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faf08009990 tx=0x7faf08009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.093+0000 7faf135ff700 1 -- 172.21.15.59:0/2010227027 shutdown_connections 2023-10-08T12:41:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.093+0000 7faf135ff700 1 --2- 172.21.15.59:0/2010227027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf0c10cf70 0x7faf0c10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.093+0000 7faf135ff700 1 --2- 172.21.15.59:0/2010227027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c072c20 0x7faf0c073000 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.093+0000 7faf135ff700 1 --2- 172.21.15.59:0/2010227027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf0c073540 0x7faf0c10ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.093+0000 7faf135ff700 1 -- 172.21.15.59:0/2010227027 >> 172.21.15.59:0/2010227027 conn(0x7faf0c0fc200 msgr2=0x7faf0c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.093+0000 7faf135ff700 1 -- 172.21.15.59:0/2010227027 shutdown_connections 2023-10-08T12:41:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.093+0000 7faf135ff700 1 -- 172.21.15.59:0/2010227027 wait complete. 2023-10-08T12:41:53.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.094+0000 7faf135ff700 1 Processor -- start 2023-10-08T12:41:53.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.094+0000 7faf135ff700 1 -- start start 2023-10-08T12:41:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf135ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf0c072c20 0x7faf0c198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf135ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf0c073540 0x7faf0c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf135ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c10cf70 0x7faf0c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf135ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c19dd00 con 0x7faf0c10cf70 2023-10-08T12:41:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf135ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c19de70 con 0x7faf0c072c20 2023-10-08T12:41:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf135ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c19e030 con 0x7faf0c073540 2023-10-08T12:41:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf11b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c10cf70 0x7faf0c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf1139b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf0c072c20 0x7faf0c198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf11b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c10cf70 0x7faf0c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33448/0 (socket says 172.21.15.59:33448) 2023-10-08T12:41:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf11b9c700 1 -- 172.21.15.59:0/332178772 learned_addr learned my addr 172.21.15.59:0/332178772 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf10b9a700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf0c073540 0x7faf0c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf11b9c700 1 -- 172.21.15.59:0/332178772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf0c073540 msgr2=0x7faf0c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.095+0000 7faf11b9c700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf0c073540 0x7faf0c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.096+0000 7faf11b9c700 1 -- 172.21.15.59:0/332178772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf0c072c20 msgr2=0x7faf0c198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.096+0000 7faf11b9c700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf0c072c20 0x7faf0c198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.096+0000 7faf11b9c700 1 -- 172.21.15.59:0/332178772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf080095f0 con 0x7faf0c10cf70 2023-10-08T12:41:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.096+0000 7faf1139b700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf0c072c20 0x7faf0c198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.096+0000 7faf11b9c700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c10cf70 0x7faf0c19d6c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faf0400ef30 tx=0x7faf0400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.096+0000 7faf027fc700 1 -- 172.21.15.59:0/332178772 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04018070 con 0x7faf0c10cf70 2023-10-08T12:41:53.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.096+0000 7faf027fc700 1 -- 172.21.15.59:0/332178772 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf0400f040 con 0x7faf0c10cf70 2023-10-08T12:41:53.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.096+0000 7faf135ff700 1 -- 172.21.15.59:0/332178772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c19e2b0 con 0x7faf0c10cf70 2023-10-08T12:41:53.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.096+0000 7faf027fc700 1 -- 172.21.15.59:0/332178772 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0400cd00 con 0x7faf0c10cf70 2023-10-08T12:41:53.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.096+0000 7faf135ff700 1 -- 172.21.15.59:0/332178772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c1a5b50 con 0x7faf0c10cf70 2023-10-08T12:41:53.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.099+0000 7faf027fc700 1 -- 172.21.15.59:0/332178772 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 23) v1 ==== 136077+0+0 (secure 0 0 0) 0x7faf04003a00 con 0x7faf0c10cf70 2023-10-08T12:41:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.101+0000 7faf26fd2b80 1 Processor -- start 2023-10-08T12:41:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.101+0000 7faf027fc700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faef80a15e0 0x7faef80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.102+0000 7faf26fd2b80 1 -- start start 2023-10-08T12:41:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.102+0000 7faf027fc700 1 -- 172.21.15.59:0/332178772 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7faf040cca70 con 0x7faf0c10cf70 2023-10-08T12:41:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.102+0000 7faf1139b700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faef80a15e0 0x7faef80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.102+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221906cf00 0x56221906d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.102+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906d820 0x562219078190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.102+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622190786d0 0x56221907aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.102+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562218fd64e0 con 0x56221906cf00 2023-10-08T12:41:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.102+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562218fc7ca0 con 0x56221906d820 2023-10-08T12:41:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.102+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562218fc55c0 con 0x5622190786d0 2023-10-08T12:41:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.102+0000 7faf11b9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622190786d0 0x56221907aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf10b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906d820 0x562219078190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf11b9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622190786d0 0x56221907aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:50320/0 (socket says 172.21.15.59:50320) 2023-10-08T12:41:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf11b9c700 1 -- 172.21.15.59:0/848432008 learned_addr learned my addr 172.21.15.59:0/848432008 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf1139b700 1 --2- 172.21.15.59:0/848432008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221906cf00 0x56221906d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf11b9c700 1 -- 172.21.15.59:0/848432008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906d820 msgr2=0x562219078190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf11b9c700 1 --2- 172.21.15.59:0/848432008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906d820 0x562219078190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf11b9c700 1 -- 172.21.15.59:0/848432008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221906cf00 msgr2=0x56221906d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf11b9c700 1 --2- 172.21.15.59:0/848432008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221906cf00 0x56221906d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf11b9c700 1 -- 172.21.15.59:0/848432008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562218debe60 con 0x5622190786d0 2023-10-08T12:41:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf1139b700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faef80a15e0 0x7faef80a3aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faf080098e0 tx=0x7faf0800bbc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf10b9a700 1 --2- 172.21.15.59:0/848432008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906d820 0x562219078190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.103+0000 7faf11b9c700 1 --2- 172.21.15.59:0/848432008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622190786d0 0x56221907aac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf04009c10 tx=0x7faf04099780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef5b99010ffb867 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.104+0000 7faef77fe700 1 -- 172.21.15.59:0/848432008 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04004ad0 con 0x5622190786d0 2023-10-08T12:41:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.104+0000 7faef77fe700 1 -- 172.21.15.59:0/848432008 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf0401b320 con 0x5622190786d0 2023-10-08T12:41:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.104+0000 7faef77fe700 1 -- 172.21.15.59:0/848432008 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040a1ec0 con 0x5622190786d0 2023-10-08T12:41:53.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.104+0000 7faf26fd2b80 1 -- 172.21.15.59:0/848432008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622190786d0 msgr2=0x56221907aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.104+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/848432008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622190786d0 0x56221907aac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf04009c10 tx=0x7faf04099780 comp rx=0 tx=0).stop 2023-10-08T12:41:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.104+0000 7faf26fd2b80 1 -- 172.21.15.59:0/848432008 shutdown_connections 2023-10-08T12:41:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.104+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/848432008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622190786d0 0x56221907aac0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.104+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/848432008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221906cf00 0x56221906d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.104+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/848432008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906d820 0x562219078190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.104+0000 7faf26fd2b80 1 -- 172.21.15.59:0/848432008 >> 172.21.15.59:0/848432008 conn(0x562218fe22e0 msgr2=0x562219069350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.104+0000 7faf26fd2b80 1 -- 172.21.15.59:0/848432008 shutdown_connections 2023-10-08T12:41:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.105+0000 7faf26fd2b80 1 -- 172.21.15.59:0/848432008 wait complete. 2023-10-08T12:41:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.105+0000 7faf26fd2b80 1 -- start start 2023-10-08T12:41:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.105+0000 7faf26fd2b80 1 Processor -- start 2023-10-08T12:41:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906cf00 0x5622190754a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 0x5622190759e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x562219075f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562218fc0eb0 con 0x5622190786d0 2023-10-08T12:41:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562218f5d790 con 0x56221906cf00 2023-10-08T12:41:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562218f5d430 con 0x56221906d820 2023-10-08T12:41:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf26fd2b80 10 client.0 _ll_register_callbacks cb 0x562218dba880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf11b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x562219075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf10b9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 0x5622190759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf11b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x562219075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33462/0 (socket says 172.21.15.59:33462) 2023-10-08T12:41:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf11b9c700 1 -- 172.21.15.59:0/4267892686 learned_addr learned my addr 172.21.15.59:0/4267892686 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf10b9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 0x5622190759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:50334/0 (socket says 172.21.15.59:50334) 2023-10-08T12:41:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.106+0000 7faf1139b700 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906cf00 0x5622190754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faf11b9c700 1 -- 172.21.15.59:0/4267892686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 msgr2=0x5622190759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faf11b9c700 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 0x5622190759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faf11b9c700 1 -- 172.21.15.59:0/4267892686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906cf00 msgr2=0x5622190754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faf11b9c700 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906cf00 0x5622190754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faf11b9c700 1 -- 172.21.15.59:0/4267892686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc0098e0 con 0x5622190786d0 2023-10-08T12:41:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faf10b9a700 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 0x5622190759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faf11b9c700 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x562219075f20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faf040090a0 tx=0x7faf0401b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0b4431c92a8e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faef4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:41:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faef4ff9700 1 -- 172.21.15.59:0/4267892686 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04004ad0 con 0x5622190786d0 2023-10-08T12:41:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faf26fd2b80 1 -- 172.21.15.59:0/4267892686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562218f88f30 con 0x5622190786d0 2023-10-08T12:41:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faef4ff9700 1 -- 172.21.15.59:0/4267892686 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7faf04099bc0 con 0x5622190786d0 2023-10-08T12:41:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faef4ff9700 1 -- 172.21.15.59:0/4267892686 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf0409a2c0 con 0x5622190786d0 2023-10-08T12:41:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faf26fd2b80 10 client.15486 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.107+0000 7faf26fd2b80 1 -- 172.21.15.59:0/4267892686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7faf0c1a5b50 con 0x5622190786d0 2023-10-08T12:41:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.108+0000 7faef4ff9700 1 -- 172.21.15.59:0/4267892686 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562218f88f30 con 0x5622190786d0 2023-10-08T12:41:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.108+0000 7faef4ff9700 1 -- 172.21.15.59:0/4267892686 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faf040a1a30 con 0x5622190786d0 2023-10-08T12:41:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.108+0000 7faf26fd2b80 10 client.15486 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.108+0000 7faf26fd2b80 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.108+0000 7faf26fd2b80 20 client.15486 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.108+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562219087de0 0x56221908a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.108+0000 7faf26fd2b80 4 client.15486 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.108+0000 7faf26fd2b80 1 -- 172.21.15.59:0/4267892686 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562218fb9e90 con 0x562219087de0 2023-10-08T12:41:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.109+0000 7faf1139b700 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562219087de0 0x56221908a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.109+0000 7faf1139b700 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562219087de0 0x56221908a200 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c3345c38385e5a6 server_cookie=8f088d0cb8a8895f in_seq=0 out_seq=0 2023-10-08T12:41:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.109+0000 7faef4ff9700 10 client.15486 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faef4ff9700 1 -- 172.21.15.59:0/4267892686 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562218fb9e90 con 0x562219087de0 2023-10-08T12:41:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faef4ff9700 10 client.15486 handle_command_reply: tid=0 2023-10-08T12:41:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faf26fd2b80 1 client.15486 shutdown 2023-10-08T12:41:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faf26fd2b80 1 -- 172.21.15.59:0/4267892686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 msgr2=0x562219075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x562219075f20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faf040090a0 tx=0x7faf0401b490 comp rx=0 tx=0).stop 2023-10-08T12:41:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faf26fd2b80 1 -- 172.21.15.59:0/4267892686 shutdown_connections 2023-10-08T12:41:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562219087de0 0x56221908a200 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906cf00 0x5622190754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x562219075f20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/4267892686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 0x5622190759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faf26fd2b80 1 -- 172.21.15.59:0/4267892686 >> 172.21.15.59:0/4267892686 conn(0x562218fe22e0 msgr2=0x562219068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.110+0000 7faef4ff9700 0 client.15486 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.111+0000 7faf26fd2b80 1 -- 172.21.15.59:0/4267892686 shutdown_connections 2023-10-08T12:41:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.111+0000 7faf26fd2b80 1 -- 172.21.15.59:0/4267892686 wait complete. 2023-10-08T12:41:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.111+0000 7faf26fd2b80 20 client.15486 trim_cache size 0 max 16384 2023-10-08T12:41:53.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.133+0000 7faf26fd2b80 1 Processor -- start 2023-10-08T12:41:53.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.133+0000 7faf26fd2b80 1 -- start start 2023-10-08T12:41:53.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.133+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221906cf00 0x56221906fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.133+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 0x562219074390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.133+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622190786d0 0x562219072760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.133+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562218e419a0 con 0x56221906cf00 2023-10-08T12:41:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.133+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562219069f50 con 0x5622190786d0 2023-10-08T12:41:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.133+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221906a980 con 0x56221906d820 2023-10-08T12:41:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf10b9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 0x562219074390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf11b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622190786d0 0x562219072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf11b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622190786d0 0x562219072760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:39210/0 (socket says 172.21.15.59:39210) 2023-10-08T12:41:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf10b9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 0x562219074390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:50350/0 (socket says 172.21.15.59:50350) 2023-10-08T12:41:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf11b9c700 1 -- 172.21.15.59:0/2215326771 learned_addr learned my addr 172.21.15.59:0/2215326771 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf1139b700 1 --2- 172.21.15.59:0/2215326771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221906cf00 0x56221906fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf11b9c700 1 -- 172.21.15.59:0/2215326771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 msgr2=0x562219074390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf11b9c700 1 --2- 172.21.15.59:0/2215326771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 0x562219074390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf11b9c700 1 -- 172.21.15.59:0/2215326771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221906cf00 msgr2=0x56221906fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf11b9c700 1 --2- 172.21.15.59:0/2215326771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221906cf00 0x56221906fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf11b9c700 1 -- 172.21.15.59:0/2215326771 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56221908edf0 con 0x5622190786d0 2023-10-08T12:41:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf1139b700 1 --2- 172.21.15.59:0/2215326771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221906cf00 0x56221906fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faf11b9c700 1 --2- 172.21.15.59:0/2215326771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622190786d0 0x562219072760 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf04099b50 tx=0x7faf04096030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48c11dc0da0d6c5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.134+0000 7faef7fff700 1 -- 172.21.15.59:0/2215326771 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0409dd10 con 0x5622190786d0 2023-10-08T12:41:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.135+0000 7faef7fff700 1 -- 172.21.15.59:0/2215326771 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf040b2420 con 0x5622190786d0 2023-10-08T12:41:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.135+0000 7faef7fff700 1 -- 172.21.15.59:0/2215326771 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040a1ec0 con 0x5622190786d0 2023-10-08T12:41:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.135+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2215326771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622190786d0 msgr2=0x562219072760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.135+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/2215326771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622190786d0 0x562219072760 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf04099b50 tx=0x7faf04096030 comp rx=0 tx=0).stop 2023-10-08T12:41:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.135+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2215326771 shutdown_connections 2023-10-08T12:41:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.135+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/2215326771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622190786d0 0x562219072760 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.135+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/2215326771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221906cf00 0x56221906fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.135+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/2215326771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906d820 0x562219074390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.135+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2215326771 >> 172.21.15.59:0/2215326771 conn(0x562218fe22e0 msgr2=0x562219073c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.135+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2215326771 shutdown_connections 2023-10-08T12:41:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.135+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2215326771 wait complete. 2023-10-08T12:41:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.136+0000 7faf26fd2b80 1 -- start start 2023-10-08T12:41:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.136+0000 7faf26fd2b80 1 Processor -- start 2023-10-08T12:41:53.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.137+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906cf00 0x56221907f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.137+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906d820 0x56221907d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.137+0000 7faf26fd2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x56221907dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.137+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221907e5f0 con 0x5622190786d0 2023-10-08T12:41:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.137+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622190dbbe0 con 0x56221906d820 2023-10-08T12:41:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.137+0000 7faf26fd2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622190dbd20 con 0x56221906cf00 2023-10-08T12:41:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.137+0000 7faf26fd2b80 10 client.0 _ll_register_callbacks cb 0x7faf0800b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.137+0000 7faf11b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x56221907dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.137+0000 7faf1139b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906cf00 0x56221907f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.137+0000 7faf11b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x56221907dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33474/0 (socket says 172.21.15.59:33474) 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.137+0000 7faf11b9c700 1 -- 172.21.15.59:0/2202679467 learned_addr learned my addr 172.21.15.59:0/2202679467 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.138+0000 7faf10b9a700 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906d820 0x56221907d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.138+0000 7faf11b9c700 1 -- 172.21.15.59:0/2202679467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906cf00 msgr2=0x56221907f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.138+0000 7faf11b9c700 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906cf00 0x56221907f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.138+0000 7faf11b9c700 1 -- 172.21.15.59:0/2202679467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906d820 msgr2=0x56221907d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.138+0000 7faf11b9c700 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906d820 0x56221907d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.138+0000 7faf11b9c700 1 -- 172.21.15.59:0/2202679467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c1a5b50 con 0x5622190786d0 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.138+0000 7faf11b9c700 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x56221907dee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faf040998c0 tx=0x7faf040092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b404de06875702 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.138+0000 7faef4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.138+0000 7faef4ff9700 1 -- 172.21.15.59:0/2202679467 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040a1c30 con 0x5622190786d0 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.138+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2202679467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf0401b320 con 0x5622190786d0 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.138+0000 7faef4ff9700 1 -- 172.21.15.59:0/2202679467 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7faf0407d030 con 0x5622190786d0 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.139+0000 7faef4ff9700 1 -- 172.21.15.59:0/2202679467 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf0409dd10 con 0x5622190786d0 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.139+0000 7faf26fd2b80 10 client.15492 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.139+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2202679467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x562218dd4ce0 con 0x5622190786d0 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.139+0000 7faef4ff9700 1 -- 172.21.15.59:0/2202679467 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf0401b320 con 0x5622190786d0 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.139+0000 7faef4ff9700 1 -- 172.21.15.59:0/2202679467 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faf040990b0 con 0x5622190786d0 2023-10-08T12:41:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.139+0000 7faf26fd2b80 10 client.15492 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.139+0000 7faf26fd2b80 10 client.15492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.139+0000 7faf26fd2b80 20 client.15492 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.139+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622190dd040 0x5622190df460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.139+0000 7faf26fd2b80 4 client.15492 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:41:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.139+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2202679467 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562218fb9bb0 con 0x5622190dd040 2023-10-08T12:41:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.140+0000 7faf1139b700 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622190dd040 0x5622190df460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.140+0000 7faf1139b700 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622190dd040 0x5622190df460 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b355c228b939d37 server_cookie=7f89fbb8f9b4398b in_seq=0 out_seq=0 2023-10-08T12:41:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.140+0000 7faef4ff9700 10 client.15492 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.141+0000 7faef4ff9700 1 -- 172.21.15.59:0/2202679467 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562218fb9bb0 con 0x5622190dd040 2023-10-08T12:41:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.141+0000 7faef4ff9700 10 client.15492 handle_command_reply: tid=0 2023-10-08T12:41:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.141+0000 7faf26fd2b80 1 client.15492 shutdown 2023-10-08T12:41:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2202679467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 msgr2=0x56221907dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x56221907dee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faf040998c0 tx=0x7faf040092e0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2202679467 shutdown_connections 2023-10-08T12:41:53.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622190dd040 0x5622190df460 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622190786d0 0x56221907dee0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56221906cf00 0x56221907f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faf26fd2b80 1 --2- 172.21.15.59:0/2202679467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221906d820 0x56221907d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2202679467 >> 172.21.15.59:0/2202679467 conn(0x562218fe22e0 msgr2=0x562219074510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faef4ff9700 0 client.15492 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:53.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2202679467 shutdown_connections 2023-10-08T12:41:53.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faf26fd2b80 1 -- 172.21.15.59:0/2202679467 wait complete. 2023-10-08T12:41:53.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.142+0000 7faf26fd2b80 20 client.15492 trim_cache size 0 max 16384 2023-10-08T12:41:53.156 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:41:53.156 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:41:53.156 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "1caa74da-a63e-4f8e-811a-56ff3483eb0f", 2023-10-08T12:41:53.156 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:41:53.156 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:41:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 -- 172.21.15.59:0/332178772 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faef80a15e0 msgr2=0x7faef80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faef80a15e0 0x7faef80a3aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faf080098e0 tx=0x7faf0800bbc0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 -- 172.21.15.59:0/332178772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c10cf70 msgr2=0x7faf0c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c10cf70 0x7faf0c19d6c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faf0400ef30 tx=0x7faf0400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 -- 172.21.15.59:0/332178772 shutdown_connections 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faef80a15e0 0x7faef80a3aa0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf0c072c20 0x7faf0c198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c10cf70 0x7faf0c19d6c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 --2- 172.21.15.59:0/332178772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf0c073540 0x7faf0c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 -- 172.21.15.59:0/332178772 >> 172.21.15.59:0/332178772 conn(0x7faf0c0fc200 msgr2=0x7faf0c0fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 -- 172.21.15.59:0/332178772 shutdown_connections 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.143+0000 7faf135ff700 1 -- 172.21.15.59:0/332178772 wait complete. 2023-10-08T12:41:53.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:41:53.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.399+0000 7fc153fff700 1 -- 172.21.15.59:0/1276990486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc14c108950 msgr2=0x7fc14c108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.399+0000 7fc153fff700 1 --2- 172.21.15.59:0/1276990486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc14c108950 0x7fc14c108d30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc1480098f0 tx=0x7fc148009c00 comp rx=0 tx=0).stop 2023-10-08T12:41:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.399+0000 7fc153fff700 1 -- 172.21.15.59:0/1276990486 shutdown_connections 2023-10-08T12:41:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.399+0000 7fc153fff700 1 --2- 172.21.15.59:0/1276990486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc14c108950 0x7fc14c108d30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.399+0000 7fc153fff700 1 --2- 172.21.15.59:0/1276990486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc14c103300 0x7fc14c10f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.399+0000 7fc153fff700 1 --2- 172.21.15.59:0/1276990486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c102940 0x7fc14c102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.399+0000 7fc153fff700 1 -- 172.21.15.59:0/1276990486 >> 172.21.15.59:0/1276990486 conn(0x7fc14c0fe3d0 msgr2=0x7fc14c1007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.399+0000 7fc153fff700 1 -- 172.21.15.59:0/1276990486 shutdown_connections 2023-10-08T12:41:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.399+0000 7fc153fff700 1 -- 172.21.15.59:0/1276990486 wait complete. 2023-10-08T12:41:53.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.401+0000 7fc153fff700 1 Processor -- start 2023-10-08T12:41:53.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.401+0000 7fc153fff700 1 -- start start 2023-10-08T12:41:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.401+0000 7fc153fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc14c102940 0x7fc14c198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc153fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc14c103300 0x7fc14c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc153fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c108950 0x7fc14c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc153fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c19dcf0 con 0x7fc14c108950 2023-10-08T12:41:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc153fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c19de60 con 0x7fc14c102940 2023-10-08T12:41:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc153fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c19e020 con 0x7fc14c103300 2023-10-08T12:41:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc151d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc14c102940 0x7fc14c198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc151d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc14c102940 0x7fc14c198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:39250/0 (socket says 172.21.15.59:39250) 2023-10-08T12:41:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc151d9b700 1 -- 172.21.15.59:0/220785863 learned_addr learned my addr 172.21.15.59:0/220785863 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc15259c700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c108950 0x7fc14c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc15159a700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc14c103300 0x7fc14c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc151d9b700 1 -- 172.21.15.59:0/220785863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc14c103300 msgr2=0x7fc14c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc151d9b700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc14c103300 0x7fc14c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc151d9b700 1 -- 172.21.15.59:0/220785863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c108950 msgr2=0x7fc14c19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc151d9b700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c108950 0x7fc14c19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.402+0000 7fc151d9b700 1 -- 172.21.15.59:0/220785863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc148009520 con 0x7fc14c102940 2023-10-08T12:41:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.403+0000 7fc151d9b700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc14c102940 0x7fc14c198dd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc148005950 tx=0x7fc14800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.403+0000 7fc142ffd700 1 -- 172.21.15.59:0/220785863 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14801c070 con 0x7fc14c102940 2023-10-08T12:41:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.403+0000 7fc153fff700 1 -- 172.21.15.59:0/220785863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c19e2a0 con 0x7fc14c102940 2023-10-08T12:41:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.403+0000 7fc142ffd700 1 -- 172.21.15.59:0/220785863 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc14800bb20 con 0x7fc14c102940 2023-10-08T12:41:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.403+0000 7fc142ffd700 1 -- 172.21.15.59:0/220785863 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480038e0 con 0x7fc14c102940 2023-10-08T12:41:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.403+0000 7fc153fff700 1 -- 172.21.15.59:0/220785863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c1a5b40 con 0x7fc14c102940 2023-10-08T12:41:53.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.406+0000 7fc142ffd700 1 -- 172.21.15.59:0/220785863 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) v1 ==== 136077+0+0 (secure 0 0 0) 0x7fc148020030 con 0x7fc14c102940 2023-10-08T12:41:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.408+0000 7fc142ffd700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1380a1560 0x7fc1380a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.408+0000 7fc142ffd700 1 -- 172.21.15.59:0/220785863 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc1480cdd60 con 0x7fc14c102940 2023-10-08T12:41:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.408+0000 7fc1678c4b80 1 Processor -- start 2023-10-08T12:41:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.408+0000 7fc15159a700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1380a1560 0x7fc1380a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.408+0000 7fc1678c4b80 1 -- start start 2023-10-08T12:41:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.408+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaa9a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.408+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaaa5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.408+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaaa5650 0x559faaaa7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.408+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faaa03460 con 0x559faaaa5650 2023-10-08T12:41:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.408+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faa9f4c20 con 0x559faaa9a7a0 2023-10-08T12:41:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.408+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faa9f2540 con 0x559faaa99e80 2023-10-08T12:41:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc151d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaa9a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc15259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaaa5650 0x559faaaa7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc15159a700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1380a1560 0x7fc1380a3a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc14c19a320 tx=0x7fc13c009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc15159a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaaa5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc151d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaa9a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:50390/0 (socket says 172.21.15.59:50390) 2023-10-08T12:41:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc151d9b700 1 -- 172.21.15.59:0/2621986511 learned_addr learned my addr 172.21.15.59:0/2621986511 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc151d9b700 1 -- 172.21.15.59:0/2621986511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 msgr2=0x559faaaa5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc151d9b700 1 --2- 172.21.15.59:0/2621986511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaaa5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc151d9b700 1 -- 172.21.15.59:0/2621986511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaaa5650 msgr2=0x559faaaa7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc151d9b700 1 --2- 172.21.15.59:0/2621986511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaaa5650 0x559faaaa7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc151d9b700 1 -- 172.21.15.59:0/2621986511 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559faa818de0 con 0x559faaa99e80 2023-10-08T12:41:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc15259c700 1 --2- 172.21.15.59:0/2621986511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaaa5650 0x559faaaa7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc15159a700 1 --2- 172.21.15.59:0/2621986511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaaa5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.409+0000 7fc151d9b700 1 --2- 172.21.15.59:0/2621986511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaa9a260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1480973b0 tx=0x7fc14800bc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e24335fecc12914a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.410+0000 7fc137fff700 1 -- 172.21.15.59:0/2621986511 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14809f000 con 0x559faaa99e80 2023-10-08T12:41:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.410+0000 7fc137fff700 1 -- 172.21.15.59:0/2621986511 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1480a31b0 con 0x559faaa99e80 2023-10-08T12:41:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.410+0000 7fc137fff700 1 -- 172.21.15.59:0/2621986511 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148005360 con 0x559faaa99e80 2023-10-08T12:41:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.411+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2621986511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 msgr2=0x559faaa9a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.411+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/2621986511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaa9a260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1480973b0 tx=0x7fc14800bc90 comp rx=0 tx=0).stop 2023-10-08T12:41:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.411+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2621986511 shutdown_connections 2023-10-08T12:41:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.411+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/2621986511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaaa5650 0x559faaaa7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.411+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/2621986511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaa9a260 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.411+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/2621986511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaaa5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.411+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2621986511 >> 172.21.15.59:0/2621986511 conn(0x559faaa0f260 msgr2=0x559faaa962d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.411+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2621986511 shutdown_connections 2023-10-08T12:41:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.411+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2621986511 wait complete. 2023-10-08T12:41:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.411+0000 7fc1678c4b80 1 -- start start 2023-10-08T12:41:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc1678c4b80 1 Processor -- start 2023-10-08T12:41:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaaa5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaaa5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaaa5650 0x559faaab0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faa9ede30 con 0x559faaaa5650 2023-10-08T12:41:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faa98a710 con 0x559faaa9a7a0 2023-10-08T12:41:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faa98a3b0 con 0x559faaa99e80 2023-10-08T12:41:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc1678c4b80 10 client.0 _ll_register_callbacks cb 0x559faa7e7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc151d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaaa5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc15159a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaaa5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc151d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaaa5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:50402/0 (socket says 172.21.15.59:50402) 2023-10-08T12:41:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc151d9b700 1 -- 172.21.15.59:0/2412756920 learned_addr learned my addr 172.21.15.59:0/2412756920 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.412+0000 7fc15259c700 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaaa5650 0x559faaab0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.413+0000 7fc151d9b700 1 -- 172.21.15.59:0/2412756920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 msgr2=0x559faaaa5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.413+0000 7fc151d9b700 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaaa5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.413+0000 7fc151d9b700 1 -- 172.21.15.59:0/2412756920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaaa5650 msgr2=0x559faaab0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.413+0000 7fc151d9b700 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaaa5650 0x559faaab0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.413+0000 7fc151d9b700 1 -- 172.21.15.59:0/2412756920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13c017070 con 0x559faaa99e80 2023-10-08T12:41:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.413+0000 7fc151d9b700 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaaa5a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc14809ae40 tx=0x7fc148009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66246cd0aa37d6c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.413+0000 7fc1357fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:41:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.413+0000 7fc1357fa700 1 -- 172.21.15.59:0/2412756920 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480b3070 con 0x559faaa99e80 2023-10-08T12:41:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.413+0000 7fc1357fa700 1 -- 172.21.15.59:0/2412756920 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc14809f000 con 0x559faaa99e80 2023-10-08T12:41:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.413+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2412756920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559faa9b5eb0 con 0x559faaa99e80 2023-10-08T12:41:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc1357fa700 1 -- 172.21.15.59:0/2412756920 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1480975c0 con 0x559faaa99e80 2023-10-08T12:41:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc1678c4b80 10 client.25492 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2412756920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fc14c1a5b40 con 0x559faaa99e80 2023-10-08T12:41:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc1357fa700 1 -- 172.21.15.59:0/2412756920 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc14807d070 con 0x559faaa99e80 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc1357fa700 1 -- 172.21.15.59:0/2412756920 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc148021380 con 0x559faaa99e80 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc1678c4b80 10 client.25492 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc1678c4b80 10 client.25492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc1678c4b80 20 client.25492 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559faaab4a40 0x559faaab6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc1678c4b80 4 client.25492 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2412756920 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559faa9e6e10 con 0x559faaab4a40 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.414+0000 7fc15159a700 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559faaab4a40 0x559faaab6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.415+0000 7fc15159a700 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559faaab4a40 0x559faaab6e60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f876ca561be44fdb server_cookie=347f5c3ad9039334 in_seq=0 out_seq=0 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.415+0000 7fc1357fa700 10 client.25492 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1357fa700 1 -- 172.21.15.59:0/2412756920 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559faa9e6e10 con 0x559faaab4a40 2023-10-08T12:41:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1357fa700 10 client.25492 handle_command_reply: tid=0 2023-10-08T12:41:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1678c4b80 1 client.25492 shutdown 2023-10-08T12:41:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2412756920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 msgr2=0x559faaaa5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaaa5a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc14809ae40 tx=0x7fc148009c00 comp rx=0 tx=0).stop 2023-10-08T12:41:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2412756920 shutdown_connections 2023-10-08T12:41:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559faaab4a40 0x559faaab6e60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaaa5650 0x559faaab0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faaaa5a30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/2412756920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaaa5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2412756920 >> 172.21.15.59:0/2412756920 conn(0x559faaa0f260 msgr2=0x559faaa95ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1357fa700 0 client.25492 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:53.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2412756920 shutdown_connections 2023-10-08T12:41:53.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.416+0000 7fc1678c4b80 1 -- 172.21.15.59:0/2412756920 wait complete. 2023-10-08T12:41:53.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.417+0000 7fc1678c4b80 20 client.25492 trim_cache size 0 max 16384 2023-10-08T12:41:53.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.435+0000 7fc1678c4b80 1 Processor -- start 2023-10-08T12:41:53.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.435+0000 7fc1678c4b80 1 -- start start 2023-10-08T12:41:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.435+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa99e80 0x559faaaaaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.435+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaa9fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.435+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaaa5650 0x559faaaa00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.435+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faa86e920 con 0x559faaa99e80 2023-10-08T12:41:53.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.435+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faaa90570 con 0x559faaa9a7a0 2023-10-08T12:41:53.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.435+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faaaa4980 con 0x559faaaa5650 2023-10-08T12:41:53.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc151d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa99e80 0x559faaaaaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc15159a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaa9fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc15259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaaa5650 0x559faaaa00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc151d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa99e80 0x559faaaaaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33520/0 (socket says 172.21.15.59:33520) 2023-10-08T12:41:53.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc15159a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaa9fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:39280/0 (socket says 172.21.15.59:39280) 2023-10-08T12:41:53.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc151d9b700 1 -- 172.21.15.59:0/3442926252 learned_addr learned my addr 172.21.15.59:0/3442926252 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:53.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc15159a700 1 -- 172.21.15.59:0/3442926252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaaa5650 msgr2=0x559faaaa00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc15159a700 1 --2- 172.21.15.59:0/3442926252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaaa5650 0x559faaaa00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc15159a700 1 -- 172.21.15.59:0/3442926252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa99e80 msgr2=0x559faaaaaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc15159a700 1 --2- 172.21.15.59:0/3442926252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa99e80 0x559faaaaaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc15159a700 1 -- 172.21.15.59:0/3442926252 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559faa801c60 con 0x559faaa9a7a0 2023-10-08T12:41:53.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.436+0000 7fc15159a700 1 --2- 172.21.15.59:0/3442926252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaa9fb60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x559faaab7770 tx=0x7fc13c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbac4cfaeb357f40 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.437+0000 7fc140ff9700 1 -- 172.21.15.59:0/3442926252 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c024040 con 0x559faaa9a7a0 2023-10-08T12:41:53.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.437+0000 7fc140ff9700 1 -- 172.21.15.59:0/3442926252 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc13c0295b0 con 0x559faaa9a7a0 2023-10-08T12:41:53.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.437+0000 7fc140ff9700 1 -- 172.21.15.59:0/3442926252 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c01e980 con 0x559faaa9a7a0 2023-10-08T12:41:53.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.437+0000 7fc1678c4b80 1 -- 172.21.15.59:0/3442926252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 msgr2=0x559faaa9fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.437+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/3442926252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaa9fb60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x559faaab7770 tx=0x7fc13c014000 comp rx=0 tx=0).stop 2023-10-08T12:41:53.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.437+0000 7fc1678c4b80 1 -- 172.21.15.59:0/3442926252 shutdown_connections 2023-10-08T12:41:53.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.437+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/3442926252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaaa5650 0x559faaaa00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.437+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/3442926252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa99e80 0x559faaaaaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.437+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/3442926252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaa9a7a0 0x559faaa9fb60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.437+0000 7fc1678c4b80 1 -- 172.21.15.59:0/3442926252 >> 172.21.15.59:0/3442926252 conn(0x559faaa0f260 msgr2=0x559faaaa40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.437+0000 7fc1678c4b80 1 -- 172.21.15.59:0/3442926252 shutdown_connections 2023-10-08T12:41:53.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.438+0000 7fc1678c4b80 1 -- 172.21.15.59:0/3442926252 wait complete. 2023-10-08T12:41:53.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.438+0000 7fc1678c4b80 1 -- start start 2023-10-08T12:41:53.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.438+0000 7fc1678c4b80 1 Processor -- start 2023-10-08T12:41:53.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faab02100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa9a7a0 0x559faab02640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc1678c4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaaa5650 0x559faaafc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faaafcef0 con 0x559faaa9a7a0 2023-10-08T12:41:53.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faaafd060 con 0x559faaaa5650 2023-10-08T12:41:53.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc1678c4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559faaafd220 con 0x559faaa99e80 2023-10-08T12:41:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc1678c4b80 10 client.0 _ll_register_callbacks cb 0x7fc13c009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc15159a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa9a7a0 0x559faab02640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc15259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaaa5650 0x559faaafc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc15259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaaa5650 0x559faaafc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:39290/0 (socket says 172.21.15.59:39290) 2023-10-08T12:41:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc15259c700 1 -- 172.21.15.59:0/4081003608 learned_addr learned my addr 172.21.15.59:0/4081003608 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:41:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc151d9b700 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faab02100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc15259c700 1 -- 172.21.15.59:0/4081003608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 msgr2=0x559faab02100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc15259c700 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faab02100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc15259c700 1 -- 172.21.15.59:0/4081003608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa9a7a0 msgr2=0x559faab02640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc15259c700 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa9a7a0 0x559faab02640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc15259c700 1 -- 172.21.15.59:0/4081003608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13c004440 con 0x559faaaa5650 2023-10-08T12:41:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc151d9b700 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faab02100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.439+0000 7fc15159a700 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa9a7a0 0x559faab02640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.440+0000 7fc15259c700 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaaa5650 0x559faaafc800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc144007f00 tx=0x7fc144007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=306478b2e6cf31ae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.440+0000 7fc1357fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:41:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.440+0000 7fc1357fa700 1 -- 172.21.15.59:0/4081003608 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14400e040 con 0x559faaaa5650 2023-10-08T12:41:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.440+0000 7fc1678c4b80 1 -- 172.21.15.59:0/4081003608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559faa9e6b30 con 0x559faaaa5650 2023-10-08T12:41:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.440+0000 7fc1357fa700 1 -- 172.21.15.59:0/4081003608 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc144004db0 con 0x559faaaa5650 2023-10-08T12:41:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.440+0000 7fc1357fa700 1 -- 172.21.15.59:0/4081003608 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc144018a40 con 0x559faaaa5650 2023-10-08T12:41:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.440+0000 7fc1678c4b80 10 client.25505 fetch_fsmap learned FSMap version 20 2023-10-08T12:41:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.440+0000 7fc1678c4b80 1 -- 172.21.15.59:0/4081003608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x559faa83f250 con 0x559faaaa5650 2023-10-08T12:41:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.441+0000 7fc1357fa700 1 -- 172.21.15.59:0/4081003608 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559faa9e6b30 con 0x559faaaa5650 2023-10-08T12:41:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.441+0000 7fc1357fa700 1 -- 172.21.15.59:0/4081003608 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc144005850 con 0x559faaaa5650 2023-10-08T12:41:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.441+0000 7fc1678c4b80 10 client.25505 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:41:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.441+0000 7fc1678c4b80 10 client.25505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.441+0000 7fc1678c4b80 20 client.25505 populate_metadata read hostname 'smithi059' 2023-10-08T12:41:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.441+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559faab0a0e0 0x559faab0c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.441+0000 7fc1678c4b80 4 client.25505 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:41:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.441+0000 7fc1678c4b80 1 -- 172.21.15.59:0/4081003608 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559faa839f70 con 0x559faab0a0e0 2023-10-08T12:41:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.441+0000 7fc151d9b700 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559faab0a0e0 0x559faab0c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc151d9b700 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559faab0a0e0 0x559faab0c500 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b64cc6b87be4a304 server_cookie=e87c58fc557e6d73 in_seq=0 out_seq=0 2023-10-08T12:41:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1357fa700 10 client.25505 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1357fa700 1 -- 172.21.15.59:0/4081003608 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559faa839f70 con 0x559faab0a0e0 2023-10-08T12:41:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1357fa700 10 client.25505 handle_command_reply: tid=0 2023-10-08T12:41:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1678c4b80 1 client.25505 shutdown 2023-10-08T12:41:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1678c4b80 1 -- 172.21.15.59:0/4081003608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaaa5650 msgr2=0x559faaafc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaaa5650 0x559faaafc800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc144007f00 tx=0x7fc144007f30 comp rx=0 tx=0).stop 2023-10-08T12:41:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1678c4b80 1 -- 172.21.15.59:0/4081003608 shutdown_connections 2023-10-08T12:41:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559faab0a0e0 0x559faab0c500 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559faaaa5650 0x559faaafc800 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559faaa99e80 0x559faab02100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1357fa700 0 client.25505 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:41:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1678c4b80 1 --2- 172.21.15.59:0/4081003608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559faaa9a7a0 0x559faab02640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.442+0000 7fc1678c4b80 1 -- 172.21.15.59:0/4081003608 >> 172.21.15.59:0/4081003608 conn(0x559faaa0f260 msgr2=0x559faaa9fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.443+0000 7fc1678c4b80 1 -- 172.21.15.59:0/4081003608 shutdown_connections 2023-10-08T12:41:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.443+0000 7fc1678c4b80 1 -- 172.21.15.59:0/4081003608 wait complete. 2023-10-08T12:41:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.443+0000 7fc1678c4b80 20 client.25505 trim_cache size 0 max 16384 2023-10-08T12:41:53.450 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:41:53.450 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:41:53.450 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:41:53.450 INFO:teuthology.orchestra.run.smithi059.stdout: "1caa74da-a63e-4f8e-811a-56ff3483eb0f": { 2023-10-08T12:41:53.450 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:41:53.450 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "1caa74da-a63e-4f8e-811a-56ff3483eb0f", 2023-10-08T12:41:53.450 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:41:53.450 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:41:53.450 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:41:53.451 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:41:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.443+0000 7fc153fff700 1 -- 172.21.15.59:0/220785863 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1380a1560 msgr2=0x7fc1380a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.443+0000 7fc153fff700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1380a1560 0x7fc1380a3a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc14c19a320 tx=0x7fc13c009310 comp rx=0 tx=0).stop 2023-10-08T12:41:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.443+0000 7fc153fff700 1 -- 172.21.15.59:0/220785863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc14c102940 msgr2=0x7fc14c198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.443+0000 7fc153fff700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc14c102940 0x7fc14c198dd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc148005950 tx=0x7fc14800fa00 comp rx=0 tx=0).stop 2023-10-08T12:41:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.443+0000 7fc153fff700 1 -- 172.21.15.59:0/220785863 shutdown_connections 2023-10-08T12:41:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.444+0000 7fc153fff700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc1380a1560 0x7fc1380a3a20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.444+0000 7fc153fff700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc14c102940 0x7fc14c198dd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.444+0000 7fc153fff700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c108950 0x7fc14c19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.444+0000 7fc153fff700 1 --2- 172.21.15.59:0/220785863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc14c103300 0x7fc14c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.444+0000 7fc153fff700 1 -- 172.21.15.59:0/220785863 >> 172.21.15.59:0/220785863 conn(0x7fc14c0fe3d0 msgr2=0x7fc14c0fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.444+0000 7fc153fff700 1 -- 172.21.15.59:0/220785863 shutdown_connections 2023-10-08T12:41:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:41:53.444+0000 7fc153fff700 1 -- 172.21.15.59:0/220785863 wait complete. 2023-10-08T12:41:53.462 INFO:tasks.cephfs.filesystem:scrub status for tag:1caa74da-a63e-4f8e-811a-56ff3483eb0f - {'path': '/', 'tag': '1caa74da-a63e-4f8e-811a-56ff3483eb0f', 'options': 'recursive,force'} 2023-10-08T12:41:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:53 smithi173 ceph-mon[135182]: pgmap v335: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:53 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:41:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:53 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:53 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:41:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:53 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:54.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:53 smithi059 ceph-mon[98489]: pgmap v335: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:53 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:41:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:53 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:53 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:41:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:53 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:53 smithi092 ceph-mon[134093]: pgmap v335: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:41:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:53 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:41:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:53 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:53 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:41:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:53 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:55 smithi173 ceph-mon[135182]: pgmap v336: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2023-10-08T12:41:56.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:55 smithi059 ceph-mon[98489]: pgmap v336: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2023-10-08T12:41:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:55 smithi092 ceph-mon[134093]: pgmap v336: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2023-10-08T12:41:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:57 smithi173 ceph-mon[135182]: pgmap v337: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2023-10-08T12:41:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:57 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:41:58.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:57 smithi059 ceph-mon[98489]: pgmap v337: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2023-10-08T12:41:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:57 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:41:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:57 smithi092 ceph-mon[134093]: pgmap v337: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2023-10-08T12:41:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:57 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:42:00.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:41:59 smithi059 ceph-mon[98489]: pgmap v338: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2023-10-08T12:42:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:41:59 smithi092 ceph-mon[134093]: pgmap v338: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2023-10-08T12:42:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:41:59 smithi173 ceph-mon[135182]: pgmap v338: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2023-10-08T12:42:00.765 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:42:00 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:42:00.366+0000 7f0625607700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:42:00.765 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:42:00 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:42:00.366+0000 7f0625607700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:42:00.765 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:42:00 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:42:00.366+0000 7f0625607700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:42:00.765 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:42:00 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:42:00.366+0000 7f0625607700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:42:00.765 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 12:42:00 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T12:42:00.366+0000 7f0625607700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:42:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:01 smithi173 ceph-mon[135182]: pgmap v339: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 938 B/s wr, 3 op/s 2023-10-08T12:42:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:01 smithi059 ceph-mon[98489]: pgmap v339: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 938 B/s wr, 3 op/s 2023-10-08T12:42:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:01 smithi092 ceph-mon[134093]: pgmap v339: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 938 B/s wr, 3 op/s 2023-10-08T12:42:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:02 smithi173 ceph-mon[135182]: mgrmap e24: x(active, since 8m), standbys: z, y 2023-10-08T12:42:03.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:02 smithi059 ceph-mon[98489]: mgrmap e24: x(active, since 8m), standbys: z, y 2023-10-08T12:42:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:02 smithi092 ceph-mon[134093]: mgrmap e24: x(active, since 8m), standbys: z, y 2023-10-08T12:42:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:03 smithi173 ceph-mon[135182]: pgmap v340: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 12 KiB/s wr, 3 op/s 2023-10-08T12:42:04.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:03 smithi059 ceph-mon[98489]: pgmap v340: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 12 KiB/s wr, 3 op/s 2023-10-08T12:42:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:03 smithi092 ceph-mon[134093]: pgmap v340: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 12 KiB/s wr, 3 op/s 2023-10-08T12:42:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:05 smithi173 ceph-mon[135182]: pgmap v341: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-10-08T12:42:06.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:05 smithi059 ceph-mon[98489]: pgmap v341: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-10-08T12:42:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:05 smithi092 ceph-mon[134093]: pgmap v341: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-10-08T12:42:08.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:07 smithi173 ceph-mon[135182]: pgmap v342: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 23 KiB/s wr, 15 op/s 2023-10-08T12:42:08.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:07 smithi059 ceph-mon[98489]: pgmap v342: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 23 KiB/s wr, 15 op/s 2023-10-08T12:42:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:07 smithi092 ceph-mon[134093]: pgmap v342: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 23 KiB/s wr, 15 op/s 2023-10-08T12:42:10.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:09 smithi059 ceph-mon[98489]: pgmap v343: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-10-08T12:42:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:09 smithi092 ceph-mon[134093]: pgmap v343: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-10-08T12:42:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:09 smithi173 ceph-mon[135182]: pgmap v343: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-10-08T12:42:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:11 smithi173 ceph-mon[135182]: pgmap v344: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 23 KiB/s wr, 15 op/s 2023-10-08T12:42:12.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:11 smithi059 ceph-mon[98489]: pgmap v344: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 23 KiB/s wr, 15 op/s 2023-10-08T12:42:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:11 smithi092 ceph-mon[134093]: pgmap v344: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 23 KiB/s wr, 15 op/s 2023-10-08T12:42:14.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:13 smithi173 ceph-mon[135182]: pgmap v345: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 22 KiB/s wr, 14 op/s 2023-10-08T12:42:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:13 smithi059 ceph-mon[98489]: pgmap v345: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 22 KiB/s wr, 14 op/s 2023-10-08T12:42:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:13 smithi092 ceph-mon[134093]: pgmap v345: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 22 KiB/s wr, 14 op/s 2023-10-08T12:42:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:15 smithi173 ceph-mon[135182]: pgmap v346: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T12:42:16.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:15 smithi059 ceph-mon[98489]: pgmap v346: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T12:42:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:15 smithi092 ceph-mon[134093]: pgmap v346: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T12:42:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:17 smithi173 ceph-mon[135182]: pgmap v347: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2023-10-08T12:42:18.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:17 smithi059 ceph-mon[98489]: pgmap v347: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2023-10-08T12:42:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:17 smithi092 ceph-mon[134093]: pgmap v347: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2023-10-08T12:42:20.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:19 smithi059 ceph-mon[98489]: pgmap v348: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2023-10-08T12:42:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:19 smithi092 ceph-mon[134093]: pgmap v348: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2023-10-08T12:42:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:19 smithi173 ceph-mon[135182]: pgmap v348: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2023-10-08T12:42:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:21 smithi173 ceph-mon[135182]: pgmap v349: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2023-10-08T12:42:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:21 smithi059 ceph-mon[98489]: pgmap v349: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2023-10-08T12:42:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:21 smithi092 ceph-mon[134093]: pgmap v349: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2023-10-08T12:42:23.463 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:42:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.784+0000 7fd2d67ff700 1 -- 172.21.15.59:0/2351270821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2d0102940 msgr2=0x7fd2d0102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.784+0000 7fd2d67ff700 1 --2- 172.21.15.59:0/2351270821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2d0102940 0x7fd2d0102dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40098f0 tx=0x7fd2c4009c00 comp rx=0 tx=0).stop 2023-10-08T12:42:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.784+0000 7fd2d67ff700 1 -- 172.21.15.59:0/2351270821 shutdown_connections 2023-10-08T12:42:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.784+0000 7fd2d67ff700 1 --2- 172.21.15.59:0/2351270821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d0103300 0x7fd2d010f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.784+0000 7fd2d67ff700 1 --2- 172.21.15.59:0/2351270821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2d0108950 0x7fd2d0108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.784+0000 7fd2d67ff700 1 --2- 172.21.15.59:0/2351270821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2d0102940 0x7fd2d0102dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.784+0000 7fd2d67ff700 1 -- 172.21.15.59:0/2351270821 >> 172.21.15.59:0/2351270821 conn(0x7fd2d00fe3d0 msgr2=0x7fd2d01007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:23.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.784+0000 7fd2d67ff700 1 -- 172.21.15.59:0/2351270821 shutdown_connections 2023-10-08T12:42:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.784+0000 7fd2d67ff700 1 -- 172.21.15.59:0/2351270821 wait complete. 2023-10-08T12:42:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.786+0000 7fd2d67ff700 1 Processor -- start 2023-10-08T12:42:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.786+0000 7fd2d67ff700 1 -- start start 2023-10-08T12:42:23.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.786+0000 7fd2d67ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2d0102940 0x7fd2d0198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.786+0000 7fd2d67ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2d0103300 0x7fd2d0199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.786+0000 7fd2d67ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d0108950 0x7fd2d019d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.786+0000 7fd2d67ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d019dd70 con 0x7fd2d0102940 2023-10-08T12:42:23.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.786+0000 7fd2d67ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d019dee0 con 0x7fd2d0103300 2023-10-08T12:42:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.786+0000 7fd2d67ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d019e0a0 con 0x7fd2d0108950 2023-10-08T12:42:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.787+0000 7fd2cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2d0102940 0x7fd2d0198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.787+0000 7fd2d4d9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d0108950 0x7fd2d019d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.787+0000 7fd2cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2d0102940 0x7fd2d0198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34762/0 (socket says 172.21.15.59:34762) 2023-10-08T12:42:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.787+0000 7fd2cffff700 1 -- 172.21.15.59:0/1532083731 learned_addr learned my addr 172.21.15.59:0/1532083731 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.787+0000 7fd2cf7fe700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2d0103300 0x7fd2d0199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.787+0000 7fd2d4d9c700 1 -- 172.21.15.59:0/1532083731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2d0103300 msgr2=0x7fd2d0199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.787+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2d0103300 0x7fd2d0199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.787+0000 7fd2d4d9c700 1 -- 172.21.15.59:0/1532083731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2d0102940 msgr2=0x7fd2d0198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.787+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2d0102940 0x7fd2d0198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.787+0000 7fd2d4d9c700 1 -- 172.21.15.59:0/1532083731 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8009d00 con 0x7fd2d0108950 2023-10-08T12:42:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.788+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d0108950 0x7fd2d019d730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009cd0 tx=0x7fd2c800c620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.788+0000 7fd2cd7fa700 1 -- 172.21.15.59:0/1532083731 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8017070 con 0x7fd2d0108950 2023-10-08T12:42:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.788+0000 7fd2d67ff700 1 -- 172.21.15.59:0/1532083731 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c4009520 con 0x7fd2d0108950 2023-10-08T12:42:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.788+0000 7fd2cd7fa700 1 -- 172.21.15.59:0/1532083731 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2c800f040 con 0x7fd2d0108950 2023-10-08T12:42:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.788+0000 7fd2cd7fa700 1 -- 172.21.15.59:0/1532083731 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800e050 con 0x7fd2d0108950 2023-10-08T12:42:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.788+0000 7fd2d67ff700 1 -- 172.21.15.59:0/1532083731 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d01a59e0 con 0x7fd2d0108950 2023-10-08T12:42:23.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.793+0000 7fd2cd7fa700 1 -- 172.21.15.59:0/1532083731 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd2c8003a00 con 0x7fd2d0108950 2023-10-08T12:42:23.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.795+0000 7fd2ea140b80 1 Processor -- start 2023-10-08T12:42:23.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.795+0000 7fd2cd7fa700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2b80a15f0 0x7fd2b80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.795+0000 7fd2ea140b80 1 -- start start 2023-10-08T12:42:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.795+0000 7fd2cd7fa700 1 -- 172.21.15.59:0/1532083731 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd2c80ccb20 con 0x7fd2d0108950 2023-10-08T12:42:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.796+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf08e80 0x55b9acf09260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.796+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf097a0 0x55b9acf1c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.796+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf0e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.796+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ace72460 con 0x55b9acf08e80 2023-10-08T12:42:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.796+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ace63c20 con 0x55b9acf0c0b0 2023-10-08T12:42:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.796+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ace61540 con 0x55b9acf097a0 2023-10-08T12:42:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.796+0000 7fd2cf7fe700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2b80a15f0 0x7fd2b80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf08e80 0x55b9acf09260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf08e80 0x55b9acf09260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34772/0 (socket says 172.21.15.59:34772) 2023-10-08T12:42:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2cffff700 1 -- 172.21.15.59:0/3772668549 learned_addr learned my addr 172.21.15.59:0/3772668549 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:23.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/3772668549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf0e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2cf7fe700 1 --2- 172.21.15.59:0/3772668549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf097a0 0x55b9acf1c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2d4d9c700 1 -- 172.21.15.59:0/3772668549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf097a0 msgr2=0x55b9acf1c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:23.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/3772668549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf097a0 0x55b9acf1c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2d4d9c700 1 -- 172.21.15.59:0/3772668549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf08e80 msgr2=0x55b9acf09260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:23.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/3772668549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf08e80 0x55b9acf09260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2d4d9c700 1 -- 172.21.15.59:0/3772668549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9acc87de0 con 0x55b9acf0c0b0 2023-10-08T12:42:23.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/3772668549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf0e540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80ca290 tx=0x7fd2c800ce40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f61e616fb0a848f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:23.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.797+0000 7fd2b67fc700 1 -- 172.21.15.59:0/3772668549 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c809dc70 con 0x55b9acf0c0b0 2023-10-08T12:42:23.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.798+0000 7fd2b67fc700 1 -- 172.21.15.59:0/3772668549 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2c80a1eb0 con 0x55b9acf0c0b0 2023-10-08T12:42:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.798+0000 7fd2b67fc700 1 -- 172.21.15.59:0/3772668549 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8099230 con 0x55b9acf0c0b0 2023-10-08T12:42:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.798+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3772668549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 msgr2=0x55b9acf0e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.798+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/3772668549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf0e540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80ca290 tx=0x7fd2c800ce40 comp rx=0 tx=0).stop 2023-10-08T12:42:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.798+0000 7fd2cf7fe700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2b80a15f0 0x7fd2b80a3ab0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd2d019a3a0 tx=0x7fd2c4009f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.799+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3772668549 shutdown_connections 2023-10-08T12:42:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.799+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/3772668549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf0e540 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.799+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/3772668549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf08e80 0x55b9acf09260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.799+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/3772668549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf097a0 0x55b9acf1c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.799+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3772668549 >> 172.21.15.59:0/3772668549 conn(0x55b9ace7e260 msgr2=0x55b9acf052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.799+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3772668549 shutdown_connections 2023-10-08T12:42:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.799+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3772668549 wait complete. 2023-10-08T12:42:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.800+0000 7fd2ea140b80 1 -- start start 2023-10-08T12:42:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.800+0000 7fd2ea140b80 1 Processor -- start 2023-10-08T12:42:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf08e80 0x55b9acf13ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 0x55b9acf14530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf18810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ace5ce30 con 0x55b9acf097a0 2023-10-08T12:42:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9acdf9710 con 0x55b9acf0c0b0 2023-10-08T12:42:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9acdf93b0 con 0x55b9acf08e80 2023-10-08T12:42:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2ea140b80 10 client.0 _ll_register_callbacks cb 0x55b9acc56800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2cf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 0x55b9acf14530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2cf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 0x55b9acf14530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34778/0 (socket says 172.21.15.59:34778) 2023-10-08T12:42:23.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2cf7fe700 1 -- 172.21.15.59:0/3569262476 learned_addr learned my addr 172.21.15.59:0/3569262476 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:23.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2cffff700 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf08e80 0x55b9acf13ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.801+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf18810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.802+0000 7fd2cf7fe700 1 -- 172.21.15.59:0/3569262476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf08e80 msgr2=0x55b9acf13ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:23.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.802+0000 7fd2cf7fe700 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf08e80 0x55b9acf13ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.802+0000 7fd2cf7fe700 1 -- 172.21.15.59:0/3569262476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 msgr2=0x55b9acf18810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:23.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.802+0000 7fd2cf7fe700 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf18810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.802+0000 7fd2cf7fe700 1 -- 172.21.15.59:0/3569262476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d01a59e0 con 0x55b9acf097a0 2023-10-08T12:42:23.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.802+0000 7fd2cffff700 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf08e80 0x55b9acf13ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:42:23.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.802+0000 7fd2cf7fe700 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 0x55b9acf14530 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40098f0 tx=0x7fd2c4019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a34ccd93840feb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.802+0000 7fd2af7fe700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:42:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.803+0000 7fd2af7fe700 1 -- 172.21.15.59:0/3569262476 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400fc30 con 0x55b9acf097a0 2023-10-08T12:42:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.803+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3569262476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9ace24eb0 con 0x55b9acf097a0 2023-10-08T12:42:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.803+0000 7fd2af7fe700 1 -- 172.21.15.59:0/3569262476 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd2c400b9c0 con 0x55b9acf097a0 2023-10-08T12:42:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.803+0000 7fd2af7fe700 1 -- 172.21.15.59:0/3569262476 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2c400bb80 con 0x55b9acf097a0 2023-10-08T12:42:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.803+0000 7fd2ea140b80 10 client.15528 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.803+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3569262476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b9acc70c60 con 0x55b9acf097a0 2023-10-08T12:42:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.804+0000 7fd2af7fe700 1 -- 172.21.15.59:0/3569262476 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b9ace24eb0 con 0x55b9acf097a0 2023-10-08T12:42:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.804+0000 7fd2af7fe700 1 -- 172.21.15.59:0/3569262476 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd2c4004950 con 0x55b9acf097a0 2023-10-08T12:42:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.804+0000 7fd2ea140b80 10 client.15528 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.804+0000 7fd2ea140b80 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.804+0000 7fd2ea140b80 20 client.15528 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.804+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b9acf35310 0x55b9acf37730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.804+0000 7fd2ea140b80 4 client.15528 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.804+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3569262476 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9ace55e10 con 0x55b9acf35310 2023-10-08T12:42:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.805+0000 7fd2cffff700 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b9acf35310 0x55b9acf37730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.805+0000 7fd2cffff700 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b9acf35310 0x55b9acf37730 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e267f646a52a7b9 server_cookie=7d097f3900dab9fa in_seq=0 out_seq=0 2023-10-08T12:42:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.805+0000 7fd2af7fe700 10 client.15528 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.806+0000 7fd2af7fe700 1 -- 172.21.15.59:0/3569262476 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b9ace55e10 con 0x55b9acf35310 2023-10-08T12:42:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.806+0000 7fd2af7fe700 10 client.15528 handle_command_reply: tid=0 2023-10-08T12:42:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.806+0000 7fd2ea140b80 1 client.15528 shutdown 2023-10-08T12:42:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.806+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3569262476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 msgr2=0x55b9acf14530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.806+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 0x55b9acf14530 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40098f0 tx=0x7fd2c4019040 comp rx=0 tx=0).stop 2023-10-08T12:42:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.807+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3569262476 shutdown_connections 2023-10-08T12:42:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.807+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b9acf35310 0x55b9acf37730 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.807+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf18810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.807+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf08e80 0x55b9acf13ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.807+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/3569262476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 0x55b9acf14530 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.807+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3569262476 >> 172.21.15.59:0/3569262476 conn(0x55b9ace7e260 msgr2=0x55b9acf04ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.807+0000 7fd2af7fe700 0 client.15528 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.807+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3569262476 shutdown_connections 2023-10-08T12:42:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.807+0000 7fd2ea140b80 1 -- 172.21.15.59:0/3569262476 wait complete. 2023-10-08T12:42:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.807+0000 7fd2ea140b80 20 client.15528 trim_cache size 0 max 16384 2023-10-08T12:42:23.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.842+0000 7fd2ea140b80 1 Processor -- start 2023-10-08T12:42:23.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.842+0000 7fd2ea140b80 1 -- start start 2023-10-08T12:42:23.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.842+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf08e80 0x55b9acf18810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.842+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf097a0 0x55b9acf04d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.842+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf0c0b0 0x55b9acf052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.842+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9accdd920 con 0x55b9acf0c0b0 2023-10-08T12:42:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.842+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9acf0eea0 con 0x55b9acf08e80 2023-10-08T12:42:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.842+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9acf057f0 con 0x55b9acf097a0 2023-10-08T12:42:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.843+0000 7fd2cffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf08e80 0x55b9acf18810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.843+0000 7fd2d4d9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf0c0b0 0x55b9acf052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.843+0000 7fd2cffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf08e80 0x55b9acf18810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53320/0 (socket says 172.21.15.59:53320) 2023-10-08T12:42:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.843+0000 7fd2cffff700 1 -- 172.21.15.59:0/1905644344 learned_addr learned my addr 172.21.15.59:0/1905644344 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.843+0000 7fd2cf7fe700 1 --2- 172.21.15.59:0/1905644344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf097a0 0x55b9acf04d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.843+0000 7fd2cffff700 1 -- 172.21.15.59:0/1905644344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf097a0 msgr2=0x55b9acf04d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.843+0000 7fd2cffff700 1 --2- 172.21.15.59:0/1905644344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf097a0 0x55b9acf04d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.843+0000 7fd2cffff700 1 -- 172.21.15.59:0/1905644344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf0c0b0 msgr2=0x55b9acf052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.843+0000 7fd2cffff700 1 --2- 172.21.15.59:0/1905644344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf0c0b0 0x55b9acf052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.843+0000 7fd2cffff700 1 -- 172.21.15.59:0/1905644344 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9accae250 con 0x55b9acf08e80 2023-10-08T12:42:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.843+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/1905644344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf0c0b0 0x55b9acf052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.844+0000 7fd2cffff700 1 --2- 172.21.15.59:0/1905644344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf08e80 0x55b9acf18810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009880 tx=0x7fd2c0004460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d9547a870d45d64 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.844+0000 7fd2b6ffd700 1 -- 172.21.15.59:0/1905644344 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0017030 con 0x55b9acf08e80 2023-10-08T12:42:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.844+0000 7fd2b6ffd700 1 -- 172.21.15.59:0/1905644344 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2c0018040 con 0x55b9acf08e80 2023-10-08T12:42:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.844+0000 7fd2b6ffd700 1 -- 172.21.15.59:0/1905644344 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c001b730 con 0x55b9acf08e80 2023-10-08T12:42:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.845+0000 7fd2ea140b80 1 -- 172.21.15.59:0/1905644344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf08e80 msgr2=0x55b9acf18810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.845+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/1905644344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf08e80 0x55b9acf18810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009880 tx=0x7fd2c0004460 comp rx=0 tx=0).stop 2023-10-08T12:42:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.845+0000 7fd2ea140b80 1 -- 172.21.15.59:0/1905644344 shutdown_connections 2023-10-08T12:42:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.845+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/1905644344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf08e80 0x55b9acf18810 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.845+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/1905644344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf0c0b0 0x55b9acf052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.845+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/1905644344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf097a0 0x55b9acf04d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.845+0000 7fd2ea140b80 1 -- 172.21.15.59:0/1905644344 >> 172.21.15.59:0/1905644344 conn(0x55b9ace7e260 msgr2=0x55b9acf12920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.846+0000 7fd2ea140b80 1 -- 172.21.15.59:0/1905644344 shutdown_connections 2023-10-08T12:42:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.846+0000 7fd2ea140b80 1 -- 172.21.15.59:0/1905644344 wait complete. 2023-10-08T12:42:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.846+0000 7fd2ea140b80 1 -- start start 2023-10-08T12:42:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.847+0000 7fd2ea140b80 1 Processor -- start 2023-10-08T12:42:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.847+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf08e80 0x55b9acf430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.847+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 0x55b9acf43610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.847+0000 7fd2ea140b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf82810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.847+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9acf82d50 con 0x55b9acf097a0 2023-10-08T12:42:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.847+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9acf82ec0 con 0x55b9acf0c0b0 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.847+0000 7fd2ea140b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9acf83080 con 0x55b9acf08e80 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.847+0000 7fd2ea140b80 10 client.0 _ll_register_callbacks cb 0x7fd2c400f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2d4d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf82810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2cffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf08e80 0x55b9acf430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2d4d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf82810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53324/0 (socket says 172.21.15.59:53324) 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2d4d9c700 1 -- 172.21.15.59:0/7797100 learned_addr learned my addr 172.21.15.59:0/7797100 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2cf7fe700 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 0x55b9acf43610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2d4d9c700 1 -- 172.21.15.59:0/7797100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf08e80 msgr2=0x55b9acf430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf08e80 0x55b9acf430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2d4d9c700 1 -- 172.21.15.59:0/7797100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 msgr2=0x55b9acf43610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 0x55b9acf43610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2d4d9c700 1 -- 172.21.15.59:0/7797100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b9acc87de0 con 0x55b9acf0c0b0 2023-10-08T12:42:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2cf7fe700 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 0x55b9acf43610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:42:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2d4d9c700 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf82810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009fd0 tx=0x7fd2c800e1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6ae71ae529c94a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.848+0000 7fd2af7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:42:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.849+0000 7fd2af7fe700 1 -- 172.21.15.59:0/7797100 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8099210 con 0x55b9acf0c0b0 2023-10-08T12:42:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.849+0000 7fd2ea140b80 1 -- 172.21.15.59:0/7797100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd2c80a1eb0 con 0x55b9acf0c0b0 2023-10-08T12:42:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.849+0000 7fd2af7fe700 1 -- 172.21.15.59:0/7797100 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd2c80b1030 con 0x55b9acf0c0b0 2023-10-08T12:42:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.849+0000 7fd2af7fe700 1 -- 172.21.15.59:0/7797100 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2c8099d80 con 0x55b9acf0c0b0 2023-10-08T12:42:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.849+0000 7fd2ea140b80 10 client.25529 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.849+0000 7fd2ea140b80 1 -- 172.21.15.59:0/7797100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b9acc862b0 con 0x55b9acf0c0b0 2023-10-08T12:42:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.849+0000 7fd2af7fe700 1 -- 172.21.15.59:0/7797100 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2c8065030 con 0x55b9acf0c0b0 2023-10-08T12:42:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.849+0000 7fd2af7fe700 1 -- 172.21.15.59:0/7797100 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd2c80a1b40 con 0x55b9acf0c0b0 2023-10-08T12:42:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.850+0000 7fd2ea140b80 10 client.25529 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.850+0000 7fd2ea140b80 10 client.25529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.850+0000 7fd2ea140b80 20 client.25529 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.850+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b9acf8a6a0 0x55b9acf8cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.850+0000 7fd2ea140b80 4 client.25529 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:42:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.850+0000 7fd2ea140b80 1 -- 172.21.15.59:0/7797100 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b9ace55b30 con 0x55b9acf8a6a0 2023-10-08T12:42:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.850+0000 7fd2cffff700 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b9acf8a6a0 0x55b9acf8cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.851+0000 7fd2cffff700 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b9acf8a6a0 0x55b9acf8cac0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2b766bf429b1a7d server_cookie=8bdf493bb12850 in_seq=0 out_seq=0 2023-10-08T12:42:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.851+0000 7fd2af7fe700 10 client.25529 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.851+0000 7fd2af7fe700 1 -- 172.21.15.59:0/7797100 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b9ace55b30 con 0x55b9acf8a6a0 2023-10-08T12:42:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.851+0000 7fd2af7fe700 10 client.25529 handle_command_reply: tid=0 2023-10-08T12:42:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.851+0000 7fd2ea140b80 1 client.25529 shutdown 2023-10-08T12:42:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2ea140b80 1 -- 172.21.15.59:0/7797100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 msgr2=0x55b9acf82810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf82810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009fd0 tx=0x7fd2c800e1b0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2ea140b80 1 -- 172.21.15.59:0/7797100 shutdown_connections 2023-10-08T12:42:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b9acf8a6a0 0x55b9acf8cac0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9acf0c0b0 0x55b9acf82810 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9acf08e80 0x55b9acf430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2ea140b80 1 --2- 172.21.15.59:0/7797100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9acf097a0 0x55b9acf43610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2ea140b80 1 -- 172.21.15.59:0/7797100 >> 172.21.15.59:0/7797100 conn(0x55b9ace7e260 msgr2=0x55b9acf128e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2af7fe700 0 client.25529 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2ea140b80 1 -- 172.21.15.59:0/7797100 shutdown_connections 2023-10-08T12:42:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2ea140b80 1 -- 172.21.15.59:0/7797100 wait complete. 2023-10-08T12:42:23.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.852+0000 7fd2ea140b80 20 client.25529 trim_cache size 0 max 16384 2023-10-08T12:42:23.856 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:42:23.856 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:42:23.856 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:42:23.856 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:42:23.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 -- 172.21.15.59:0/1532083731 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2b80a15f0 msgr2=0x7fd2b80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:23.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2b80a15f0 0x7fd2b80a3ab0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd2d019a3a0 tx=0x7fd2c4009f90 comp rx=0 tx=0).stop 2023-10-08T12:42:23.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 -- 172.21.15.59:0/1532083731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d0108950 msgr2=0x7fd2d019d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:23.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d0108950 0x7fd2d019d730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009cd0 tx=0x7fd2c800c620 comp rx=0 tx=0).stop 2023-10-08T12:42:23.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 -- 172.21.15.59:0/1532083731 shutdown_connections 2023-10-08T12:42:23.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2b80a15f0 0x7fd2b80a3ab0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d0108950 0x7fd2d019d730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2d0102940 0x7fd2d0198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 --2- 172.21.15.59:0/1532083731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2d0103300 0x7fd2d0199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:23.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 -- 172.21.15.59:0/1532083731 >> 172.21.15.59:0/1532083731 conn(0x7fd2d00fe3d0 msgr2=0x7fd2d00fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:23.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 -- 172.21.15.59:0/1532083731 shutdown_connections 2023-10-08T12:42:23.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:23.853+0000 7fd2d67ff700 1 -- 172.21.15.59:0/1532083731 wait complete. 2023-10-08T12:42:23.881 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:42:23.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:42:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.100+0000 7f1c2959d700 1 -- 172.21.15.59:0/246953826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c240ff390 msgr2=0x7f1c240ff770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.100+0000 7f1c2959d700 1 --2- 172.21.15.59:0/246953826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c240ff390 0x7f1c240ff770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009990 tx=0x7f1c14009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.101+0000 7f1c2959d700 1 -- 172.21.15.59:0/246953826 shutdown_connections 2023-10-08T12:42:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.101+0000 7f1c2959d700 1 --2- 172.21.15.59:0/246953826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c240ff390 0x7f1c240ff770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.101+0000 7f1c2959d700 1 --2- 172.21.15.59:0/246953826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c2410cf40 0x7f1c2410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.101+0000 7f1c2959d700 1 --2- 172.21.15.59:0/246953826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c240ffd40 0x7f1c2410ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.101+0000 7f1c2959d700 1 -- 172.21.15.59:0/246953826 >> 172.21.15.59:0/246953826 conn(0x7f1c240fafd0 msgr2=0x7f1c240fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:24.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.101+0000 7f1c2959d700 1 -- 172.21.15.59:0/246953826 shutdown_connections 2023-10-08T12:42:24.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.101+0000 7f1c2959d700 1 -- 172.21.15.59:0/246953826 wait complete. 2023-10-08T12:42:24.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.102+0000 7f1c2959d700 1 Processor -- start 2023-10-08T12:42:24.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.102+0000 7f1c2959d700 1 -- start start 2023-10-08T12:42:24.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.102+0000 7f1c2959d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c240ff390 0x7f1c2419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.102+0000 7f1c2959d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c240ffd40 0x7f1c2419f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.102+0000 7f1c2959d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c2410cf40 0x7f1c24198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.102+0000 7f1c2959d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c241993a0 con 0x7f1c2410cf40 2023-10-08T12:42:24.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.102+0000 7f1c2959d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24199510 con 0x7f1c240ffd40 2023-10-08T12:42:24.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.102+0000 7f1c2959d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c241996d0 con 0x7f1c240ff390 2023-10-08T12:42:24.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.103+0000 7f1c23fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c240ff390 0x7f1c2419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.103+0000 7f1c23fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c240ff390 0x7f1c2419eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:49338/0 (socket says 172.21.15.59:49338) 2023-10-08T12:42:24.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.103+0000 7f1c23fff700 1 -- 172.21.15.59:0/3759847730 learned_addr learned my addr 172.21.15.59:0/3759847730 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:24.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.103+0000 7f1c23fff700 1 -- 172.21.15.59:0/3759847730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c240ffd40 msgr2=0x7f1c2419f020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:42:24.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.103+0000 7f1c23fff700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c240ffd40 0x7f1c2419f020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.103+0000 7f1c23fff700 1 -- 172.21.15.59:0/3759847730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c2410cf40 msgr2=0x7f1c24198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.103+0000 7f1c23fff700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c2410cf40 0x7f1c24198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.103+0000 7f1c23fff700 1 -- 172.21.15.59:0/3759847730 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140095f0 con 0x7f1c240ff390 2023-10-08T12:42:24.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.104+0000 7f1c23fff700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c240ff390 0x7f1c2419eae0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c14005910 tx=0x7f1c14009570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.104+0000 7f1c217fa700 1 -- 172.21.15.59:0/3759847730 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1401d070 con 0x7f1c240ff390 2023-10-08T12:42:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.104+0000 7f1c2959d700 1 -- 172.21.15.59:0/3759847730 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c24199950 con 0x7f1c240ff390 2023-10-08T12:42:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.104+0000 7f1c217fa700 1 -- 172.21.15.59:0/3759847730 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c14022470 con 0x7f1c240ff390 2023-10-08T12:42:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.104+0000 7f1c217fa700 1 -- 172.21.15.59:0/3759847730 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14017650 con 0x7f1c240ff390 2023-10-08T12:42:24.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.104+0000 7f1c2959d700 1 -- 172.21.15.59:0/3759847730 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c241a5a60 con 0x7f1c240ff390 2023-10-08T12:42:24.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.105+0000 7f1c2959d700 1 -- 172.21.15.59:0/3759847730 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c24108160 con 0x7f1c240ff390 2023-10-08T12:42:24.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.109+0000 7f1c217fa700 1 -- 172.21.15.59:0/3759847730 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1c140225e0 con 0x7f1c240ff390 2023-10-08T12:42:24.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.111+0000 7f1c217fa700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1c0c0a1670 0x7f1c0c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.111+0000 7f1c217fa700 1 -- 172.21.15.59:0/3759847730 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1c140ceba0 con 0x7f1c240ff390 2023-10-08T12:42:24.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.111+0000 7f1c237fe700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1c0c0a1670 0x7f1c0c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.112+0000 7f1c217fa700 1 -- 172.21.15.59:0/3759847730 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1c1409ba00 con 0x7f1c240ff390 2023-10-08T12:42:24.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.112+0000 7f1c237fe700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1c0c0a1670 0x7f1c0c0a3b30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1c2419a2f0 tx=0x7f1c18006cb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:24.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:23 smithi173 ceph-mon[135182]: pgmap v350: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:42:24.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:23 smithi059 ceph-mon[98489]: pgmap v350: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:42:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:23 smithi092 ceph-mon[134093]: pgmap v350: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:42:24.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.379+0000 7f1c2959d700 1 -- 172.21.15.59:0/3759847730 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c240673e0 con 0x7f1c240ff390 2023-10-08T12:42:24.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.380+0000 7f1c217fa700 1 -- 172.21.15.59:0/3759847730 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f1c14027090 con 0x7f1c240ff390 2023-10-08T12:42:24.381 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:42:24.381 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:42:24.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.382+0000 7f1c2959d700 1 -- 172.21.15.59:0/3759847730 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1c0c0a1670 msgr2=0x7f1c0c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.382+0000 7f1c2959d700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1c0c0a1670 0x7f1c0c0a3b30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1c2419a2f0 tx=0x7f1c18006cb0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.382+0000 7f1c2959d700 1 -- 172.21.15.59:0/3759847730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c240ff390 msgr2=0x7f1c2419eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.382+0000 7f1c2959d700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c240ff390 0x7f1c2419eae0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c14005910 tx=0x7f1c14009570 comp rx=0 tx=0).stop 2023-10-08T12:42:24.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.383+0000 7f1c2959d700 1 -- 172.21.15.59:0/3759847730 shutdown_connections 2023-10-08T12:42:24.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.383+0000 7f1c2959d700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1c0c0a1670 0x7f1c0c0a3b30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.383+0000 7f1c2959d700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c2410cf40 0x7f1c24198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.383+0000 7f1c2959d700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c240ff390 0x7f1c2419eae0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.383+0000 7f1c2959d700 1 --2- 172.21.15.59:0/3759847730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c240ffd40 0x7f1c2419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.383+0000 7f1c2959d700 1 -- 172.21.15.59:0/3759847730 >> 172.21.15.59:0/3759847730 conn(0x7f1c240fafd0 msgr2=0x7f1c240fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:24.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.383+0000 7f1c2959d700 1 -- 172.21.15.59:0/3759847730 shutdown_connections 2023-10-08T12:42:24.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.383+0000 7f1c2959d700 1 -- 172.21.15.59:0/3759847730 wait complete. 2023-10-08T12:42:24.385 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:42:24.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:42:24.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.664+0000 7efd9bdff700 1 -- 172.21.15.59:0/3795672320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd94106750 msgr2=0x7efd94106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.664+0000 7efd9bdff700 1 --2- 172.21.15.59:0/3795672320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd94106750 0x7efd94106b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efd900098f0 tx=0x7efd90009c00 comp rx=0 tx=0).stop 2023-10-08T12:42:24.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.664+0000 7efd9bdff700 1 -- 172.21.15.59:0/3795672320 shutdown_connections 2023-10-08T12:42:24.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.664+0000 7efd9bdff700 1 --2- 172.21.15.59:0/3795672320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd94106750 0x7efd94106b30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.664+0000 7efd9bdff700 1 --2- 172.21.15.59:0/3795672320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd94101100 0x7efd9410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.664+0000 7efd9bdff700 1 --2- 172.21.15.59:0/3795672320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd94100740 0x7efd94100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.664+0000 7efd9bdff700 1 -- 172.21.15.59:0/3795672320 >> 172.21.15.59:0/3795672320 conn(0x7efd940fc230 msgr2=0x7efd940fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:24.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.664+0000 7efd9bdff700 1 -- 172.21.15.59:0/3795672320 shutdown_connections 2023-10-08T12:42:24.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.664+0000 7efd9bdff700 1 -- 172.21.15.59:0/3795672320 wait complete. 2023-10-08T12:42:24.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.665+0000 7efd9bdff700 1 Processor -- start 2023-10-08T12:42:24.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.665+0000 7efd9bdff700 1 -- start start 2023-10-08T12:42:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.665+0000 7efd9bdff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd94100740 0x7efd94198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.665+0000 7efd9bdff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd94101100 0x7efd94199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.665+0000 7efd9bdff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd94106750 0x7efd9419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.665+0000 7efd9bdff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9419dd10 con 0x7efd94100740 2023-10-08T12:42:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.665+0000 7efd9bdff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9419de80 con 0x7efd94106750 2023-10-08T12:42:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.665+0000 7efd9bdff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9419e040 con 0x7efd94101100 2023-10-08T12:42:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd99b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd94100740 0x7efd94198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd99b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd94100740 0x7efd94198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34842/0 (socket says 172.21.15.59:34842) 2023-10-08T12:42:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd99b9b700 1 -- 172.21.15.59:0/72055159 learned_addr learned my addr 172.21.15.59:0/72055159 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd9a39c700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd94106750 0x7efd9419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd9939a700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd94101100 0x7efd94199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd99b9b700 1 -- 172.21.15.59:0/72055159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd94101100 msgr2=0x7efd94199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd99b9b700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd94101100 0x7efd94199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd99b9b700 1 -- 172.21.15.59:0/72055159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd94106750 msgr2=0x7efd9419d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd99b9b700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd94106750 0x7efd9419d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd99b9b700 1 -- 172.21.15.59:0/72055159 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90009520 con 0x7efd94100740 2023-10-08T12:42:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd9a39c700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd94106750 0x7efd9419d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.666+0000 7efd99b9b700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd94100740 0x7efd94198df0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efd90005950 tx=0x7efd9000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.667+0000 7efd8affd700 1 -- 172.21.15.59:0/72055159 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9001c070 con 0x7efd94100740 2023-10-08T12:42:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.667+0000 7efd8affd700 1 -- 172.21.15.59:0/72055159 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd9000bb20 con 0x7efd94100740 2023-10-08T12:42:24.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.667+0000 7efd8affd700 1 -- 172.21.15.59:0/72055159 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd900038e0 con 0x7efd94100740 2023-10-08T12:42:24.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.667+0000 7efd9bdff700 1 -- 172.21.15.59:0/72055159 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9419e2c0 con 0x7efd94100740 2023-10-08T12:42:24.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.667+0000 7efd9bdff700 1 -- 172.21.15.59:0/72055159 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd941a5b60 con 0x7efd94100740 2023-10-08T12:42:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.672+0000 7efd8affd700 1 -- 172.21.15.59:0/72055159 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7efd90020030 con 0x7efd94100740 2023-10-08T12:42:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.672+0000 7efdaf7dcb80 1 Processor -- start 2023-10-08T12:42:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.673+0000 7efdaf7dcb80 1 -- start start 2023-10-08T12:42:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.673+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a080e80 0x55c12a081260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.673+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 0x55c12a08c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.673+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a08c650 0x55c12a08ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.673+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c129fea460 con 0x55c12a0817a0 2023-10-08T12:42:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.673+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c129fdbc20 con 0x55c12a080e80 2023-10-08T12:42:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.673+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c129fd9540 con 0x55c12a08c650 2023-10-08T12:42:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.673+0000 7efd99b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 0x55c12a08c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.673+0000 7efd99b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 0x55c12a08c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34848/0 (socket says 172.21.15.59:34848) 2023-10-08T12:42:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.673+0000 7efd99b9b700 1 -- 172.21.15.59:0/1169268561 learned_addr learned my addr 172.21.15.59:0/1169268561 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.674+0000 7efd9a39c700 1 --2- 172.21.15.59:0/1169268561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a080e80 0x55c12a081260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.674+0000 7efd9939a700 1 --2- 172.21.15.59:0/1169268561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a08c650 0x55c12a08ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.674+0000 7efd9a39c700 1 -- 172.21.15.59:0/1169268561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a08c650 msgr2=0x55c12a08ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.674+0000 7efd9a39c700 1 --2- 172.21.15.59:0/1169268561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a08c650 0x55c12a08ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.674+0000 7efd9a39c700 1 -- 172.21.15.59:0/1169268561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 msgr2=0x55c12a08c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.674+0000 7efd9a39c700 1 --2- 172.21.15.59:0/1169268561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 0x55c12a08c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.674+0000 7efd9a39c700 1 -- 172.21.15.59:0/1169268561 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c129dffde0 con 0x55c12a080e80 2023-10-08T12:42:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.674+0000 7efd9939a700 1 --2- 172.21.15.59:0/1169268561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a08c650 0x55c12a08ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.674+0000 7efd8affd700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efd800a1670 0x7efd800a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.674+0000 7efd9a39c700 1 --2- 172.21.15.59:0/1169268561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a080e80 0x55c12a081260 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efd8c003de0 tx=0x7efd8c0099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c7db04d8d8e045f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.674+0000 7efd8affd700 1 -- 172.21.15.59:0/72055159 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efd900cdeb0 con 0x7efd94100740 2023-10-08T12:42:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.675+0000 7efd99b9b700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efd800a1670 0x7efd800a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.675+0000 7efd7ffff700 1 -- 172.21.15.59:0/1169268561 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0092d0 con 0x55c12a080e80 2023-10-08T12:42:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.675+0000 7efd7ffff700 1 -- 172.21.15.59:0/1169268561 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd8c00f040 con 0x55c12a080e80 2023-10-08T12:42:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.675+0000 7efd7ffff700 1 -- 172.21.15.59:0/1169268561 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c00e820 con 0x55c12a080e80 2023-10-08T12:42:24.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.676+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/1169268561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a080e80 msgr2=0x55c12a081260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.676+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/1169268561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a080e80 0x55c12a081260 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efd8c003de0 tx=0x7efd8c0099e0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.676+0000 7efd99b9b700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efd800a1670 0x7efd800a3b30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd900979b0 tx=0x7efd900d1920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:24.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.676+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/1169268561 shutdown_connections 2023-10-08T12:42:24.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.676+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/1169268561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a080e80 0x55c12a081260 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.676+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/1169268561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a08c650 0x55c12a08ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.676+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/1169268561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 0x55c12a08c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.676+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/1169268561 >> 172.21.15.59:0/1169268561 conn(0x55c129ff6260 msgr2=0x55c12a07d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:24.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.676+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/1169268561 shutdown_connections 2023-10-08T12:42:24.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.676+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/1169268561 wait complete. 2023-10-08T12:42:24.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.676+0000 7efdaf7dcb80 1 -- start start 2023-10-08T12:42:24.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.677+0000 7efdaf7dcb80 1 Processor -- start 2023-10-08T12:42:24.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.677+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a08bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 0x55c12a0892d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a08c650 0x55c12a0898e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c129fd4e30 con 0x55c12a08c650 2023-10-08T12:42:24.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c129f71710 con 0x55c12a0817a0 2023-10-08T12:42:24.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c129f713b0 con 0x55c12a080e80 2023-10-08T12:42:24.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efdaf7dcb80 10 client.0 _ll_register_callbacks cb 0x55c129dce800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:24.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efd9939a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 0x55c12a0892d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efd9939a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 0x55c12a0892d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53368/0 (socket says 172.21.15.59:53368) 2023-10-08T12:42:24.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efd9939a700 1 -- 172.21.15.59:0/3221465768 learned_addr learned my addr 172.21.15.59:0/3221465768 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:24.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efd9a39c700 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a08c650 0x55c12a0898e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efd9a39c700 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a08bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efd9939a700 1 -- 172.21.15.59:0/3221465768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 msgr2=0x55c12a08bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efd9939a700 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a08bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efd9939a700 1 -- 172.21.15.59:0/3221465768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a08c650 msgr2=0x55c12a0898e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efd9939a700 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a08c650 0x55c12a0898e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efd9939a700 1 -- 172.21.15.59:0/3221465768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c003a60 con 0x55c12a0817a0 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.678+0000 7efd9a39c700 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a08bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.679+0000 7efd9939a700 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 0x55c12a0892d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efd8400bb40 tx=0x7efd8400bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4488b609c4e67b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.679+0000 7efd7d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.679+0000 7efd7d7fa700 1 -- 172.21.15.59:0/3221465768 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8401b440 con 0x55c12a0817a0 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.679+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3221465768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c129f9ceb0 con 0x55c12a0817a0 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.679+0000 7efd7d7fa700 1 -- 172.21.15.59:0/3221465768 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efd84011440 con 0x55c12a0817a0 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.679+0000 7efd7d7fa700 1 -- 172.21.15.59:0/3221465768 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd84011600 con 0x55c12a0817a0 2023-10-08T12:42:24.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.679+0000 7efdaf7dcb80 10 client.25544 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:24.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.679+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3221465768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c129de8c60 con 0x55c12a0817a0 2023-10-08T12:42:24.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.679+0000 7efd7d7fa700 1 -- 172.21.15.59:0/3221465768 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c129f9ceb0 con 0x55c12a0817a0 2023-10-08T12:42:24.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.680+0000 7efd7d7fa700 1 -- 172.21.15.59:0/3221465768 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efd8401b9c0 con 0x55c12a0817a0 2023-10-08T12:42:24.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.680+0000 7efdaf7dcb80 10 client.25544 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:24.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.680+0000 7efdaf7dcb80 10 client.25544 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:24.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.680+0000 7efdaf7dcb80 20 client.25544 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:24.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.680+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c12a09c180 0x55c12a09e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.680+0000 7efdaf7dcb80 4 client.25544 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:24.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.680+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3221465768 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c129fcde10 con 0x55c12a09c180 2023-10-08T12:42:24.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.680+0000 7efd9a39c700 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c12a09c180 0x55c12a09e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.681+0000 7efd9a39c700 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c12a09c180 0x55c12a09e5a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7b75a2fee2a721b server_cookie=c700f2bf82818679 in_seq=0 out_seq=0 2023-10-08T12:42:24.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.681+0000 7efd7d7fa700 10 client.25544 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:24.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.681+0000 7efd7d7fa700 1 -- 172.21.15.59:0/3221465768 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c129fcde10 con 0x55c12a09c180 2023-10-08T12:42:24.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.681+0000 7efd7d7fa700 10 client.25544 handle_command_reply: tid=0 2023-10-08T12:42:24.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.681+0000 7efdaf7dcb80 1 client.25544 shutdown 2023-10-08T12:42:24.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3221465768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 msgr2=0x55c12a0892d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 0x55c12a0892d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efd8400bb40 tx=0x7efd8400bf00 comp rx=0 tx=0).stop 2023-10-08T12:42:24.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3221465768 shutdown_connections 2023-10-08T12:42:24.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c12a09c180 0x55c12a09e5a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a08c650 0x55c12a0898e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efd7d7fa700 0 client.25544 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:24.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a08bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/3221465768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 0x55c12a0892d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3221465768 >> 172.21.15.59:0/3221465768 conn(0x55c129ff6260 msgr2=0x55c12a07cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:24.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3221465768 shutdown_connections 2023-10-08T12:42:24.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3221465768 wait complete. 2023-10-08T12:42:24.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.682+0000 7efdaf7dcb80 20 client.25544 trim_cache size 0 max 16384 2023-10-08T12:42:24.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.696+0000 7efdaf7dcb80 1 Processor -- start 2023-10-08T12:42:24.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.696+0000 7efdaf7dcb80 1 -- start start 2023-10-08T12:42:24.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c129ff6260 0x55c12a0931a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a0845b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 0x55c12a084af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c129e55920 con 0x55c129ff6260 2023-10-08T12:42:24.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12a098c80 con 0x55c12a0817a0 2023-10-08T12:42:24.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12a079ae0 con 0x55c12a080e80 2023-10-08T12:42:24.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efd9a39c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c129ff6260 0x55c12a0931a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efd9a39c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c129ff6260 0x55c12a0931a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34854/0 (socket says 172.21.15.59:34854) 2023-10-08T12:42:24.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efd9a39c700 1 -- 172.21.15.59:0/3370899886 learned_addr learned my addr 172.21.15.59:0/3370899886 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:24.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efd9a39c700 1 --2- 172.21.15.59:0/3370899886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 0x55c12a084af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efd9939a700 1 --2- 172.21.15.59:0/3370899886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a0845b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efd9a39c700 1 -- 172.21.15.59:0/3370899886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 msgr2=0x55c12a0845b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:24.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efd9a39c700 1 --2- 172.21.15.59:0/3370899886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a0845b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efd9a39c700 1 -- 172.21.15.59:0/3370899886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 msgr2=0x55c12a084af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:24.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efd9a39c700 1 --2- 172.21.15.59:0/3370899886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 0x55c12a084af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.697+0000 7efd9a39c700 1 -- 172.21.15.59:0/3370899886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c129e26250 con 0x55c129ff6260 2023-10-08T12:42:24.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.698+0000 7efd9a39c700 1 --2- 172.21.15.59:0/3370899886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c129ff6260 0x55c12a0931a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efd8c007f30 tx=0x7efd8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978e6882aea7a5df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:24.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.698+0000 7efd88bff700 1 -- 172.21.15.59:0/3370899886 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c022070 con 0x55c129ff6260 2023-10-08T12:42:24.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.698+0000 7efd88bff700 1 -- 172.21.15.59:0/3370899886 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd8c02b420 con 0x55c129ff6260 2023-10-08T12:42:24.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.698+0000 7efd88bff700 1 -- 172.21.15.59:0/3370899886 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c00e980 con 0x55c129ff6260 2023-10-08T12:42:24.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.699+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3370899886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c129ff6260 msgr2=0x55c12a0931a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.699+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/3370899886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c129ff6260 0x55c12a0931a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efd8c007f30 tx=0x7efd8c00b040 comp rx=0 tx=0).stop 2023-10-08T12:42:24.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.699+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3370899886 shutdown_connections 2023-10-08T12:42:24.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.699+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/3370899886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c12a0817a0 0x55c12a084af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.699+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/3370899886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c129ff6260 0x55c12a0931a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.699+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/3370899886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a0845b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.699+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3370899886 >> 172.21.15.59:0/3370899886 conn(0x55c12a0792a0 msgr2=0x55c12a088810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:24.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.699+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3370899886 shutdown_connections 2023-10-08T12:42:24.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.699+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/3370899886 wait complete. 2023-10-08T12:42:24.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.699+0000 7efdaf7dcb80 1 -- start start 2023-10-08T12:42:24.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.699+0000 7efdaf7dcb80 1 Processor -- start 2023-10-08T12:42:24.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c129ff6260 0x55c12a08f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a08fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efdaf7dcb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 0x55c12a0902f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12a0936f0 con 0x55c12a0817a0 2023-10-08T12:42:24.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12a0eff70 con 0x55c129ff6260 2023-10-08T12:42:24.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efdaf7dcb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12a0f00b0 con 0x55c12a080e80 2023-10-08T12:42:24.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efdaf7dcb80 10 client.0 _ll_register_callbacks cb 0x7efd84004280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:24.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efd9939a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a08fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efd9a39c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c129ff6260 0x55c12a08f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efd9939a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a08fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:49394/0 (socket says 172.21.15.59:49394) 2023-10-08T12:42:24.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efd9939a700 1 -- 172.21.15.59:0/2140561341 learned_addr learned my addr 172.21.15.59:0/2140561341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:24.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.700+0000 7efd9a39c700 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 0x55c12a0902f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.701+0000 7efd9939a700 1 -- 172.21.15.59:0/2140561341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c129ff6260 msgr2=0x55c12a08f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:24.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.701+0000 7efd9939a700 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c129ff6260 0x55c12a08f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.701+0000 7efd9939a700 1 -- 172.21.15.59:0/2140561341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 msgr2=0x55c12a0902f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:24.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.701+0000 7efd9939a700 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 0x55c12a0902f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.701+0000 7efd9939a700 1 -- 172.21.15.59:0/2140561341 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c027040 con 0x55c12a080e80 2023-10-08T12:42:24.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.701+0000 7efd9a39c700 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 0x55c12a0902f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:24.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.701+0000 7efd9939a700 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a08fdb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efd84004370 tx=0x7efd840059e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8178a95a2b8c525d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.701+0000 7efd7d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:42:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.701+0000 7efd7d7fa700 1 -- 172.21.15.59:0/2140561341 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84005240 con 0x55c12a080e80 2023-10-08T12:42:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.701+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/2140561341 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd8c00f040 con 0x55c12a080e80 2023-10-08T12:42:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.701+0000 7efd7d7fa700 1 -- 172.21.15.59:0/2140561341 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efd84020030 con 0x55c12a080e80 2023-10-08T12:42:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.702+0000 7efd7d7fa700 1 -- 172.21.15.59:0/2140561341 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd84005cc0 con 0x55c12a080e80 2023-10-08T12:42:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.702+0000 7efdaf7dcb80 10 client.25540 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.702+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/2140561341 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c129dfe2b0 con 0x55c12a080e80 2023-10-08T12:42:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.702+0000 7efd7d7fa700 1 -- 172.21.15.59:0/2140561341 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd8c00f040 con 0x55c12a080e80 2023-10-08T12:42:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.702+0000 7efd7d7fa700 1 -- 172.21.15.59:0/2140561341 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efd84024700 con 0x55c12a080e80 2023-10-08T12:42:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.702+0000 7efdaf7dcb80 10 client.25540 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.702+0000 7efdaf7dcb80 10 client.25540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.702+0000 7efdaf7dcb80 20 client.25540 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.702+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c12a08c650 0x55c12a0f3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.702+0000 7efdaf7dcb80 4 client.25540 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:42:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.702+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/2140561341 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c129fcdb30 con 0x55c12a08c650 2023-10-08T12:42:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.703+0000 7efd9a39c700 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c12a08c650 0x55c12a0f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.703+0000 7efd9a39c700 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c12a08c650 0x55c12a0f3930 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=769a76a6535f4188 server_cookie=a3bf94b5de7c921e in_seq=0 out_seq=0 2023-10-08T12:42:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.703+0000 7efd7d7fa700 10 client.25540 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efd7d7fa700 1 -- 172.21.15.59:0/2140561341 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c129fcdb30 con 0x55c12a08c650 2023-10-08T12:42:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efd7d7fa700 10 client.25540 handle_command_reply: tid=0 2023-10-08T12:42:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 1 client.25540 shutdown 2023-10-08T12:42:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/2140561341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 msgr2=0x55c12a08fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a08fdb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efd84004370 tx=0x7efd840059e0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/2140561341 shutdown_connections 2023-10-08T12:42:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c12a08c650 0x55c12a0f3930 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c129ff6260 0x55c12a08f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efd7d7fa700 0 client.25540 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:24.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c12a0817a0 0x55c12a0902f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 1 --2- 172.21.15.59:0/2140561341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c12a080e80 0x55c12a08fdb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/2140561341 >> 172.21.15.59:0/2140561341 conn(0x55c12a0792a0 msgr2=0x55c12a0845b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:24.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/2140561341 shutdown_connections 2023-10-08T12:42:24.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 1 -- 172.21.15.59:0/2140561341 wait complete. 2023-10-08T12:42:24.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.704+0000 7efdaf7dcb80 20 client.25540 trim_cache size 0 max 16384 2023-10-08T12:42:24.712 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:42:24.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 -- 172.21.15.59:0/72055159 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efd800a1670 msgr2=0x7efd800a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efd800a1670 0x7efd800a3b30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd900979b0 tx=0x7efd900d1920 comp rx=0 tx=0).stop 2023-10-08T12:42:24.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 -- 172.21.15.59:0/72055159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd94100740 msgr2=0x7efd94198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:24.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd94100740 0x7efd94198df0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efd90005950 tx=0x7efd9000fa00 comp rx=0 tx=0).stop 2023-10-08T12:42:24.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 -- 172.21.15.59:0/72055159 shutdown_connections 2023-10-08T12:42:24.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efd800a1670 0x7efd800a3b30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd94106750 0x7efd9419d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd94100740 0x7efd94198df0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 --2- 172.21.15.59:0/72055159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd94101100 0x7efd94199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:24.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 -- 172.21.15.59:0/72055159 >> 172.21.15.59:0/72055159 conn(0x7efd940fc230 msgr2=0x7efd9410be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:24.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 -- 172.21.15.59:0/72055159 shutdown_connections 2023-10-08T12:42:24.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:24.705+0000 7efd9bdff700 1 -- 172.21.15.59:0/72055159 wait complete. 2023-10-08T12:42:25.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:24 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3759847730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:42:25.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:24 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3759847730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:42:25.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:24 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3759847730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:42:25.726 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:42:25.726 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:42:25.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.942+0000 7f584c1ff700 1 -- 172.21.15.59:0/1329433788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58441010f0 msgr2=0x7f584410d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.942+0000 7f584c1ff700 1 --2- 172.21.15.59:0/1329433788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58441010f0 0x7f584410d600 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f583c00b0a0 tx=0x7f583c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.942+0000 7f584c1ff700 1 -- 172.21.15.59:0/1329433788 shutdown_connections 2023-10-08T12:42:25.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.942+0000 7f584c1ff700 1 --2- 172.21.15.59:0/1329433788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5844106740 0x7f5844106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.942+0000 7f584c1ff700 1 --2- 172.21.15.59:0/1329433788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58441010f0 0x7f584410d600 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.942+0000 7f584c1ff700 1 --2- 172.21.15.59:0/1329433788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5844100730 0x7f5844100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.942+0000 7f584c1ff700 1 -- 172.21.15.59:0/1329433788 >> 172.21.15.59:0/1329433788 conn(0x7f58440fc200 msgr2=0x7f58440fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:25.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.942+0000 7f584c1ff700 1 -- 172.21.15.59:0/1329433788 shutdown_connections 2023-10-08T12:42:25.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.942+0000 7f584c1ff700 1 -- 172.21.15.59:0/1329433788 wait complete. 2023-10-08T12:42:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.943+0000 7f584c1ff700 1 Processor -- start 2023-10-08T12:42:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.943+0000 7f584c1ff700 1 -- start start 2023-10-08T12:42:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584c1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5844100730 0x7f584419ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584c1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58441010f0 0x7f584419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584c1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5844106740 0x7f5844198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584c1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5844199340 con 0x7f58441010f0 2023-10-08T12:42:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584c1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58441994b0 con 0x7f5844100730 2023-10-08T12:42:25.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584c1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5844199670 con 0x7f5844106740 2023-10-08T12:42:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584979a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58441010f0 0x7f584419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584979a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58441010f0 0x7f584419f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34878/0 (socket says 172.21.15.59:34878) 2023-10-08T12:42:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584979a700 1 -- 172.21.15.59:0/4167571883 learned_addr learned my addr 172.21.15.59:0/4167571883 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f5849f9b700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5844100730 0x7f584419ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584a79c700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5844106740 0x7f5844198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584979a700 1 -- 172.21.15.59:0/4167571883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5844106740 msgr2=0x7f5844198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584979a700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5844106740 0x7f5844198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584979a700 1 -- 172.21.15.59:0/4167571883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5844100730 msgr2=0x7f584419ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584979a700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5844100730 0x7f584419ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f584979a700 1 -- 172.21.15.59:0/4167571883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c009d00 con 0x7f58441010f0 2023-10-08T12:42:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.944+0000 7f5849f9b700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5844100730 0x7f584419ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.945+0000 7f584979a700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58441010f0 0x7f584419f010 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f583400e9a0 tx=0x7f583400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.945+0000 7f583affd700 1 -- 172.21.15.59:0/4167571883 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834009790 con 0x7f58441010f0 2023-10-08T12:42:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.945+0000 7f583affd700 1 -- 172.21.15.59:0/4167571883 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5834010430 con 0x7f58441010f0 2023-10-08T12:42:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.945+0000 7f584c1ff700 1 -- 172.21.15.59:0/4167571883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5844199950 con 0x7f58441010f0 2023-10-08T12:42:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.945+0000 7f583affd700 1 -- 172.21.15.59:0/4167571883 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834018680 con 0x7f58441010f0 2023-10-08T12:42:25.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.945+0000 7f584c1ff700 1 -- 172.21.15.59:0/4167571883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58441a5aa0 con 0x7f58441010f0 2023-10-08T12:42:25.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.948+0000 7f583affd700 1 -- 172.21.15.59:0/4167571883 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f58340105a0 con 0x7f58441010f0 2023-10-08T12:42:25.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.950+0000 7f583affd700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f58300a1670 0x7f58300a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.950+0000 7f585fbedb80 1 Processor -- start 2023-10-08T12:42:25.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.950+0000 7f583affd700 1 -- 172.21.15.59:0/4167571883 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5834014070 con 0x7f58441010f0 2023-10-08T12:42:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.950+0000 7f5849f9b700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f58300a1670 0x7f58300a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.950+0000 7f585fbedb80 1 -- start start 2023-10-08T12:42:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 0x564950c5f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5f820 0x564950c729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c72ee0 0x564950c752d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f585fbedb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950bc84e0 con 0x564950c72ee0 2023-10-08T12:42:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f585fbedb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950bb9ca0 con 0x564950c5f820 2023-10-08T12:42:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f585fbedb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950bb75c0 con 0x564950c5ef00 2023-10-08T12:42:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f5849f9b700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f58300a1670 0x7f58300a3b30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5840009fd0 tx=0x7f5840009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f5849f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 0x564950c5f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f584a79c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c72ee0 0x564950c752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f5849f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 0x564950c5f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:49422/0 (socket says 172.21.15.59:49422) 2023-10-08T12:42:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f5849f9b700 1 -- 172.21.15.59:0/3600813043 learned_addr learned my addr 172.21.15.59:0/3600813043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:25.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f584979a700 1 --2- 172.21.15.59:0/3600813043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5f820 0x564950c729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f5849f9b700 1 -- 172.21.15.59:0/3600813043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5f820 msgr2=0x564950c729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f5849f9b700 1 --2- 172.21.15.59:0/3600813043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5f820 0x564950c729a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f5849f9b700 1 -- 172.21.15.59:0/3600813043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c72ee0 msgr2=0x564950c752d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f5849f9b700 1 --2- 172.21.15.59:0/3600813043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c72ee0 0x564950c752d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f5849f9b700 1 -- 172.21.15.59:0/3600813043 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649509dde60 con 0x564950c5ef00 2023-10-08T12:42:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.951+0000 7f584979a700 1 --2- 172.21.15.59:0/3600813043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5f820 0x564950c729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.952+0000 7f5849f9b700 1 --2- 172.21.15.59:0/3600813043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 0x564950c5f2e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f584000e720 tx=0x7f5840014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b68c9ed7b9f13ae1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.952+0000 7f582ffff700 1 -- 172.21.15.59:0/3600813043 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840026600 con 0x564950c5ef00 2023-10-08T12:42:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.952+0000 7f582ffff700 1 -- 172.21.15.59:0/3600813043 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5840026c20 con 0x564950c5ef00 2023-10-08T12:42:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.952+0000 7f582ffff700 1 -- 172.21.15.59:0/3600813043 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584001ec70 con 0x564950c5ef00 2023-10-08T12:42:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.953+0000 7f585fbedb80 1 -- 172.21.15.59:0/3600813043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 msgr2=0x564950c5f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.953+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3600813043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 0x564950c5f2e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f584000e720 tx=0x7f5840014000 comp rx=0 tx=0).stop 2023-10-08T12:42:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.953+0000 7f585fbedb80 1 -- 172.21.15.59:0/3600813043 shutdown_connections 2023-10-08T12:42:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.953+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3600813043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c72ee0 0x564950c752d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.953+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3600813043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 0x564950c5f2e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.953+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3600813043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5f820 0x564950c729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.953+0000 7f585fbedb80 1 -- 172.21.15.59:0/3600813043 >> 172.21.15.59:0/3600813043 conn(0x564950bd42e0 msgr2=0x564950c5b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.953+0000 7f585fbedb80 1 -- 172.21.15.59:0/3600813043 shutdown_connections 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.953+0000 7f585fbedb80 1 -- 172.21.15.59:0/3600813043 wait complete. 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.954+0000 7f585fbedb80 1 -- start start 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.954+0000 7f585fbedb80 1 Processor -- start 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 0x564950c72950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c6fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c72ee0 0x564950c70310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f585fbedb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950bb2eb0 con 0x564950c5f820 2023-10-08T12:42:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f585fbedb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950b4f790 con 0x564950c5ef00 2023-10-08T12:42:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f585fbedb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950b4f430 con 0x564950c72ee0 2023-10-08T12:42:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f585fbedb80 10 client.0 _ll_register_callbacks cb 0x5649509ac880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f5849f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 0x564950c72950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f584979a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c6fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f5849f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 0x564950c72950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53402/0 (socket says 172.21.15.59:53402) 2023-10-08T12:42:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f5849f9b700 1 -- 172.21.15.59:0/495759016 learned_addr learned my addr 172.21.15.59:0/495759016 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f584a79c700 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c72ee0 0x564950c70310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f5849f9b700 1 -- 172.21.15.59:0/495759016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c72ee0 msgr2=0x564950c70310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f5849f9b700 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c72ee0 0x564950c70310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f5849f9b700 1 -- 172.21.15.59:0/495759016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 msgr2=0x564950c6fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f5849f9b700 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c6fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.955+0000 7f5849f9b700 1 -- 172.21.15.59:0/495759016 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5840017070 con 0x564950c5ef00 2023-10-08T12:42:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.956+0000 7f5849f9b700 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 0x564950c72950 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f584000e6f0 tx=0x7f584001ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce43fd35ea3d37ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.956+0000 7f582d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:42:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.956+0000 7f582d7fa700 1 -- 172.21.15.59:0/495759016 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584002c070 con 0x564950c5ef00 2023-10-08T12:42:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.956+0000 7f585fbedb80 1 -- 172.21.15.59:0/495759016 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564950b7af30 con 0x564950c5ef00 2023-10-08T12:42:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.956+0000 7f582d7fa700 1 -- 172.21.15.59:0/495759016 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5840026610 con 0x564950c5ef00 2023-10-08T12:42:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.956+0000 7f582d7fa700 1 -- 172.21.15.59:0/495759016 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f584001e610 con 0x564950c5ef00 2023-10-08T12:42:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.956+0000 7f585fbedb80 10 client.25562 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.956+0000 7f585fbedb80 1 -- 172.21.15.59:0/495759016 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5649509c6ce0 con 0x564950c5ef00 2023-10-08T12:42:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.957+0000 7f582d7fa700 1 -- 172.21.15.59:0/495759016 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f584003e080 con 0x564950c5ef00 2023-10-08T12:42:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.957+0000 7f582d7fa700 1 -- 172.21.15.59:0/495759016 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5840024020 con 0x564950c5ef00 2023-10-08T12:42:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.957+0000 7f585fbedb80 10 client.25562 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.957+0000 7f585fbedb80 10 client.25562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.957+0000 7f585fbedb80 20 client.25562 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.957+0000 7f585fbedb80 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564950c82960 0x564950c84d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.957+0000 7f585fbedb80 4 client.25562 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.957+0000 7f585fbedb80 1 -- 172.21.15.59:0/495759016 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564950babe90 con 0x564950c82960 2023-10-08T12:42:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.957+0000 7f584979a700 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564950c82960 0x564950c84d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.958+0000 7f584979a700 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564950c82960 0x564950c84d50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb64d8fec634041f server_cookie=61a6dbcc1cb69961 in_seq=0 out_seq=0 2023-10-08T12:42:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.958+0000 7f582d7fa700 10 client.25562 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.958+0000 7f582d7fa700 1 -- 172.21.15.59:0/495759016 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564950babe90 con 0x564950c82960 2023-10-08T12:42:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.958+0000 7f582d7fa700 10 client.25562 handle_command_reply: tid=0 2023-10-08T12:42:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.958+0000 7f585fbedb80 1 client.25562 shutdown 2023-10-08T12:42:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f585fbedb80 1 -- 172.21.15.59:0/495759016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 msgr2=0x564950c72950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f585fbedb80 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 0x564950c72950 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f584000e6f0 tx=0x7f584001ee60 comp rx=0 tx=0).stop 2023-10-08T12:42:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f585fbedb80 1 -- 172.21.15.59:0/495759016 shutdown_connections 2023-10-08T12:42:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f585fbedb80 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564950c82960 0x564950c84d50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f585fbedb80 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 0x564950c72950 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f585fbedb80 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c72ee0 0x564950c70310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f582d7fa700 0 client.25562 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f585fbedb80 1 --2- 172.21.15.59:0/495759016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c6fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f585fbedb80 1 -- 172.21.15.59:0/495759016 >> 172.21.15.59:0/495759016 conn(0x564950bd42e0 msgr2=0x564950c5af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f585fbedb80 1 -- 172.21.15.59:0/495759016 shutdown_connections 2023-10-08T12:42:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f585fbedb80 1 -- 172.21.15.59:0/495759016 wait complete. 2023-10-08T12:42:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.959+0000 7f585fbedb80 20 client.25562 trim_cache size 0 max 16384 2023-10-08T12:42:25.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.994+0000 7f585fbedb80 1 Processor -- start 2023-10-08T12:42:25.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.994+0000 7f585fbedb80 1 -- start start 2023-10-08T12:42:25.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 0x564950c5b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c79a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c72ee0 0x564950c6f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f585fbedb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950a339a0 con 0x564950c5f820 2023-10-08T12:42:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f585fbedb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950c5abd0 con 0x564950c72ee0 2023-10-08T12:42:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f585fbedb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950c6e170 con 0x564950c5ef00 2023-10-08T12:42:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f584979a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c79a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f584979a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c79a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34900/0 (socket says 172.21.15.59:34900) 2023-10-08T12:42:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f584979a700 1 -- 172.21.15.59:0/3182872921 learned_addr learned my addr 172.21.15.59:0/3182872921 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f5849f9b700 1 --2- 172.21.15.59:0/3182872921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 0x564950c5b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f584a79c700 1 --2- 172.21.15.59:0/3182872921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c72ee0 0x564950c6f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f584979a700 1 -- 172.21.15.59:0/3182872921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 msgr2=0x564950c5b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f584979a700 1 --2- 172.21.15.59:0/3182872921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 0x564950c5b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f584979a700 1 -- 172.21.15.59:0/3182872921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c72ee0 msgr2=0x564950c6f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f584979a700 1 --2- 172.21.15.59:0/3182872921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c72ee0 0x564950c6f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.995+0000 7f584979a700 1 -- 172.21.15.59:0/3182872921 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564950c89980 con 0x564950c5f820 2023-10-08T12:42:26.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.996+0000 7f584979a700 1 --2- 172.21.15.59:0/3182872921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c79a30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f583409a1a0 tx=0x7f5834010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a967ed13268472c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.996+0000 7f5838ff9700 1 -- 172.21.15.59:0/3182872921 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583409e160 con 0x564950c5f820 2023-10-08T12:42:26.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.996+0000 7f5838ff9700 1 -- 172.21.15.59:0/3182872921 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58340cd040 con 0x564950c5f820 2023-10-08T12:42:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.996+0000 7f5838ff9700 1 -- 172.21.15.59:0/3182872921 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834099700 con 0x564950c5f820 2023-10-08T12:42:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.997+0000 7f585fbedb80 1 -- 172.21.15.59:0/3182872921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 msgr2=0x564950c79a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.997+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3182872921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c79a30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f583409a1a0 tx=0x7f5834010c80 comp rx=0 tx=0).stop 2023-10-08T12:42:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.997+0000 7f585fbedb80 1 -- 172.21.15.59:0/3182872921 shutdown_connections 2023-10-08T12:42:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.997+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3182872921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c72ee0 0x564950c6f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.997+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3182872921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c5ef00 0x564950c5b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.997+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3182872921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c79a30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.997+0000 7f585fbedb80 1 -- 172.21.15.59:0/3182872921 >> 172.21.15.59:0/3182872921 conn(0x564950bd42e0 msgr2=0x564950c5adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.997+0000 7f585fbedb80 1 -- 172.21.15.59:0/3182872921 shutdown_connections 2023-10-08T12:42:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.997+0000 7f585fbedb80 1 -- 172.21.15.59:0/3182872921 wait complete. 2023-10-08T12:42:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.997+0000 7f585fbedb80 1 -- start start 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.998+0000 7f585fbedb80 1 Processor -- start 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.998+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 0x564950c78b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.998+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c790c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.998+0000 7f585fbedb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c72ee0 0x564950ccf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.998+0000 7f585fbedb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950ccfce0 con 0x564950c5f820 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.998+0000 7f585fbedb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950ccfe50 con 0x564950c5ef00 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.998+0000 7f585fbedb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564950cd0010 con 0x564950c72ee0 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.998+0000 7f585fbedb80 10 client.0 _ll_register_callbacks cb 0x7f5840005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.998+0000 7f584979a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f584979a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c790c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34904/0 (socket says 172.21.15.59:34904) 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f584979a700 1 -- 172.21.15.59:0/3101867499 learned_addr learned my addr 172.21.15.59:0/3101867499 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f5849f9b700 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 0x564950c78b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f584a79c700 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c72ee0 0x564950ccf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f584979a700 1 -- 172.21.15.59:0/3101867499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c72ee0 msgr2=0x564950ccf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f584979a700 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c72ee0 0x564950ccf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f584979a700 1 -- 172.21.15.59:0/3101867499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 msgr2=0x564950c78b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f584979a700 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 0x564950c78b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f584979a700 1 -- 172.21.15.59:0/3101867499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58441a5aa0 con 0x564950c5f820 2023-10-08T12:42:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f584979a700 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c790c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f583401a010 tx=0x7f5834099fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146bab6dffd92e65 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f582d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:42:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f582d7fa700 1 -- 172.21.15.59:0/3101867499 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340b8480 con 0x564950c5f820 2023-10-08T12:42:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f585fbedb80 1 -- 172.21.15.59:0/3101867499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5840026c20 con 0x564950c5f820 2023-10-08T12:42:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:25.999+0000 7f582d7fa700 1 -- 172.21.15.59:0/3101867499 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f58340a25a0 con 0x564950c5f820 2023-10-08T12:42:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.000+0000 7f582d7fa700 1 -- 172.21.15.59:0/3101867499 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5834010880 con 0x564950c5f820 2023-10-08T12:42:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.000+0000 7f585fbedb80 10 client.15567 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.000+0000 7f585fbedb80 1 -- 172.21.15.59:0/3101867499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x564950a042d0 con 0x564950c5f820 2023-10-08T12:42:26.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.000+0000 7f582d7fa700 1 -- 172.21.15.59:0/3101867499 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5840026c20 con 0x564950c5f820 2023-10-08T12:42:26.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.000+0000 7f582d7fa700 1 -- 172.21.15.59:0/3101867499 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f58340a2110 con 0x564950c5f820 2023-10-08T12:42:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.000+0000 7f585fbedb80 10 client.15567 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.000+0000 7f585fbedb80 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.000+0000 7f585fbedb80 20 client.15567 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.000+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564950cd8600 0x564950cda9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.000+0000 7f585fbedb80 4 client.15567 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:42:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.000+0000 7f585fbedb80 1 -- 172.21.15.59:0/3101867499 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x564950babbb0 con 0x564950cd8600 2023-10-08T12:42:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.001+0000 7f5849f9b700 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564950cd8600 0x564950cda9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.001+0000 7f5849f9b700 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564950cd8600 0x564950cda9f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f467aac9b260893a server_cookie=fc85d54a7ad89c32 in_seq=0 out_seq=0 2023-10-08T12:42:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.001+0000 7f582d7fa700 10 client.15567 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.002+0000 7f582d7fa700 1 -- 172.21.15.59:0/3101867499 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564950babbb0 con 0x564950cd8600 2023-10-08T12:42:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.002+0000 7f582d7fa700 10 client.15567 handle_command_reply: tid=0 2023-10-08T12:42:26.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.002+0000 7f585fbedb80 1 client.15567 shutdown 2023-10-08T12:42:26.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.002+0000 7f585fbedb80 1 -- 172.21.15.59:0/3101867499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 msgr2=0x564950c790c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.002+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c790c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f583401a010 tx=0x7f5834099fe0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.003+0000 7f585fbedb80 1 -- 172.21.15.59:0/3101867499 shutdown_connections 2023-10-08T12:42:26.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.003+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564950cd8600 0x564950cda9f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.003+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564950c5ef00 0x564950c78b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.003+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564950c72ee0 0x564950ccf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.003+0000 7f585fbedb80 1 --2- 172.21.15.59:0/3101867499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564950c5f820 0x564950c790c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.003+0000 7f585fbedb80 1 -- 172.21.15.59:0/3101867499 >> 172.21.15.59:0/3101867499 conn(0x564950bd42e0 msgr2=0x564950c60dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.003+0000 7f582d7fa700 0 client.15567 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:26.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.003+0000 7f585fbedb80 1 -- 172.21.15.59:0/3101867499 shutdown_connections 2023-10-08T12:42:26.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.003+0000 7f585fbedb80 1 -- 172.21.15.59:0/3101867499 wait complete. 2023-10-08T12:42:26.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.003+0000 7f585fbedb80 20 client.15567 trim_cache size 0 max 16384 2023-10-08T12:42:26.008 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:42:26.008 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:42:26.008 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "5fb88e6d-edd6-4491-bb62-feb1c3663056", 2023-10-08T12:42:26.008 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:42:26.008 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:42:26.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 -- 172.21.15.59:0/4167571883 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f58300a1670 msgr2=0x7f58300a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f58300a1670 0x7f58300a3b30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5840009fd0 tx=0x7f5840009260 comp rx=0 tx=0).stop 2023-10-08T12:42:26.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 -- 172.21.15.59:0/4167571883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58441010f0 msgr2=0x7f584419f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58441010f0 0x7f584419f010 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f583400e9a0 tx=0x7f583400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 -- 172.21.15.59:0/4167571883 shutdown_connections 2023-10-08T12:42:26.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f58300a1670 0x7f58300a3b30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5844100730 0x7f584419ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5844106740 0x7f5844198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 --2- 172.21.15.59:0/4167571883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58441010f0 0x7f584419f010 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 -- 172.21.15.59:0/4167571883 >> 172.21.15.59:0/4167571883 conn(0x7f58440fc200 msgr2=0x7f584410bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 -- 172.21.15.59:0/4167571883 shutdown_connections 2023-10-08T12:42:26.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.004+0000 7f584c1ff700 1 -- 172.21.15.59:0/4167571883 wait complete. 2023-10-08T12:42:26.024 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:42:26.086 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:25 smithi059 ceph-mon[98489]: pgmap v351: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:42:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:25 smithi173 ceph-mon[135182]: pgmap v351: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:42:26.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.235+0000 7f5ee7dff700 1 -- 172.21.15.59:0/3826330620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee0072c20 msgr2=0x7f5ee0073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.236+0000 7f5ee7dff700 1 --2- 172.21.15.59:0/3826330620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee0072c20 0x7f5ee0073000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009990 tx=0x7f5edc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.236+0000 7f5ee7dff700 1 -- 172.21.15.59:0/3826330620 shutdown_connections 2023-10-08T12:42:26.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.236+0000 7f5ee7dff700 1 --2- 172.21.15.59:0/3826330620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee0072c20 0x7f5ee0073000 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.236+0000 7f5ee7dff700 1 --2- 172.21.15.59:0/3826330620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ee010cf80 0x7f5ee010f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.236+0000 7f5ee7dff700 1 --2- 172.21.15.59:0/3826330620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ee0073540 0x7f5ee010ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.236+0000 7f5ee7dff700 1 -- 172.21.15.59:0/3826330620 >> 172.21.15.59:0/3826330620 conn(0x7f5ee00fc230 msgr2=0x7f5ee00fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.236+0000 7f5ee7dff700 1 -- 172.21.15.59:0/3826330620 shutdown_connections 2023-10-08T12:42:26.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.236+0000 7f5ee7dff700 1 -- 172.21.15.59:0/3826330620 wait complete. 2023-10-08T12:42:26.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.237+0000 7f5ee7dff700 1 Processor -- start 2023-10-08T12:42:26.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.237+0000 7f5ee7dff700 1 -- start start 2023-10-08T12:42:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.238+0000 7f5ee7dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ee0072c20 0x7f5ee0198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.238+0000 7f5ee7dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee0073540 0x7f5ee0199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.238+0000 7f5ee7dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ee010cf80 0x7f5ee019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.238+0000 7f5ee7dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee019dd60 con 0x7f5ee0072c20 2023-10-08T12:42:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.238+0000 7f5ee7dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee019ded0 con 0x7f5ee0073540 2023-10-08T12:42:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.238+0000 7f5ee7dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee019e090 con 0x7f5ee010cf80 2023-10-08T12:42:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.238+0000 7f5ee5b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ee0072c20 0x7f5ee0198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.238+0000 7f5ee5b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ee0072c20 0x7f5ee0198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34920/0 (socket says 172.21.15.59:34920) 2023-10-08T12:42:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.238+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/1943426904 learned_addr learned my addr 172.21.15.59:0/1943426904 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.238+0000 7f5ee639c700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ee010cf80 0x7f5ee019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.238+0000 7f5ee539a700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee0073540 0x7f5ee0199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.239+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/1943426904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ee010cf80 msgr2=0x7f5ee019d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.239+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ee010cf80 0x7f5ee019d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.239+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/1943426904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee0073540 msgr2=0x7f5ee0199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.239+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee0073540 0x7f5ee0199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.239+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/1943426904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc0095f0 con 0x7f5ee0072c20 2023-10-08T12:42:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.239+0000 7f5ee639c700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ee010cf80 0x7f5ee019d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.239+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ee0072c20 0x7f5ee0198e40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5edc000c00 tx=0x7f5edc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.239+0000 7f5ed6ffd700 1 -- 172.21.15.59:0/1943426904 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc01d070 con 0x7f5ee0072c20 2023-10-08T12:42:26.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.239+0000 7f5ee7dff700 1 -- 172.21.15.59:0/1943426904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee019e310 con 0x7f5ee0072c20 2023-10-08T12:42:26.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.239+0000 7f5ed6ffd700 1 -- 172.21.15.59:0/1943426904 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5edc022470 con 0x7f5ee0072c20 2023-10-08T12:42:26.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.239+0000 7f5ed6ffd700 1 -- 172.21.15.59:0/1943426904 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc017650 con 0x7f5ee0072c20 2023-10-08T12:42:26.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.240+0000 7f5ee7dff700 1 -- 172.21.15.59:0/1943426904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee01a5bb0 con 0x7f5ee0072c20 2023-10-08T12:42:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.244+0000 7f5ed6ffd700 1 -- 172.21.15.59:0/1943426904 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5edc0225e0 con 0x7f5ee0072c20 2023-10-08T12:42:26.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.245+0000 7f5efb763b80 1 Processor -- start 2023-10-08T12:42:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.246+0000 7f5efb763b80 1 -- start start 2023-10-08T12:42:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.246+0000 7f5ed6ffd700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ecc0a15f0 0x7f5ecc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.246+0000 7f5ed6ffd700 1 -- 172.21.15.59:0/1943426904 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5edc0ce590 con 0x7f5ee0072c20 2023-10-08T12:42:26.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.246+0000 7f5ee639c700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ecc0a15f0 0x7f5ecc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.246+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 0x55619f508260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.246+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f513110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.246+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f515a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.246+0000 7f5efb763b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f471460 con 0x55619f513650 2023-10-08T12:42:26.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.246+0000 7f5efb763b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f462c20 con 0x55619f5087a0 2023-10-08T12:42:26.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.246+0000 7f5efb763b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f460540 con 0x55619f507e80 2023-10-08T12:42:26.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee5b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 0x55619f508260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee5b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 0x55619f508260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:49476/0 (socket says 172.21.15.59:49476) 2023-10-08T12:42:26.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/174762484 learned_addr learned my addr 172.21.15.59:0/174762484 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee539a700 1 --2- 172.21.15.59:0/174762484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f513110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee639c700 1 --2- 172.21.15.59:0/174762484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f515a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/174762484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 msgr2=0x55619f513110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/174762484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f513110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/174762484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 msgr2=0x55619f515a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/174762484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f515a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/174762484 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55619f286de0 con 0x55619f507e80 2023-10-08T12:42:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee639c700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ecc0a15f0 0x7f5ecc0a3ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8003e80 tx=0x7f5ed8009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.247+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/174762484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 0x55619f508260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5edc09b440 tx=0x7f5edc022b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d347aa5ebef17a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.248+0000 7f5ecbfff700 1 -- 172.21.15.59:0/174762484 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc09b0a0 con 0x55619f507e80 2023-10-08T12:42:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.248+0000 7f5ecbfff700 1 -- 172.21.15.59:0/174762484 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5edc09be40 con 0x55619f507e80 2023-10-08T12:42:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.248+0000 7f5ecbfff700 1 -- 172.21.15.59:0/174762484 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc09b9a0 con 0x55619f507e80 2023-10-08T12:42:26.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.248+0000 7f5efb763b80 1 -- 172.21.15.59:0/174762484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 msgr2=0x55619f508260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.248+0000 7f5efb763b80 1 --2- 172.21.15.59:0/174762484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 0x55619f508260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5edc09b440 tx=0x7f5edc022b90 comp rx=0 tx=0).stop 2023-10-08T12:42:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.248+0000 7f5efb763b80 1 -- 172.21.15.59:0/174762484 shutdown_connections 2023-10-08T12:42:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.248+0000 7f5efb763b80 1 --2- 172.21.15.59:0/174762484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f515a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.249+0000 7f5efb763b80 1 --2- 172.21.15.59:0/174762484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 0x55619f508260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.249+0000 7f5efb763b80 1 --2- 172.21.15.59:0/174762484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f513110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.249+0000 7f5efb763b80 1 -- 172.21.15.59:0/174762484 >> 172.21.15.59:0/174762484 conn(0x55619f47d260 msgr2=0x55619f5042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.249+0000 7f5efb763b80 1 -- 172.21.15.59:0/174762484 shutdown_connections 2023-10-08T12:42:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.249+0000 7f5efb763b80 1 -- 172.21.15.59:0/174762484 wait complete. 2023-10-08T12:42:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.249+0000 7f5efb763b80 1 -- start start 2023-10-08T12:42:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.250+0000 7f5efb763b80 1 Processor -- start 2023-10-08T12:42:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.250+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f507e80 0x55619f513a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.250+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f513f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.250+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f513650 0x55619f51eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.250+0000 7f5efb763b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f45be30 con 0x55619f507e80 2023-10-08T12:42:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.250+0000 7f5efb763b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f3f8710 con 0x55619f5087a0 2023-10-08T12:42:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5efb763b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f3f83b0 con 0x55619f513650 2023-10-08T12:42:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5efb763b80 10 client.0 _ll_register_callbacks cb 0x55619f255800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee5b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f507e80 0x55619f513a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee5b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f507e80 0x55619f513a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34944/0 (socket says 172.21.15.59:34944) 2023-10-08T12:42:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/2737652995 learned_addr learned my addr 172.21.15.59:0/2737652995 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee639c700 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f513650 0x55619f51eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee539a700 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f513f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/2737652995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f513650 msgr2=0x55619f51eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f513650 0x55619f51eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/2737652995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 msgr2=0x55619f513f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f513f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/2737652995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee01a5bb0 con 0x55619f507e80 2023-10-08T12:42:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee639c700 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f513650 0x55619f51eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.251+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f507e80 0x55619f513a30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5edc099a90 tx=0x7f5edc022af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af41ef00e65f5a40 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.252+0000 7f5ec97fa700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:42:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.252+0000 7f5ec97fa700 1 -- 172.21.15.59:0/2737652995 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc09f890 con 0x55619f507e80 2023-10-08T12:42:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.252+0000 7f5ec97fa700 1 -- 172.21.15.59:0/2737652995 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5edc0a3a40 con 0x55619f507e80 2023-10-08T12:42:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.252+0000 7f5efb763b80 1 -- 172.21.15.59:0/2737652995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55619f423eb0 con 0x55619f507e80 2023-10-08T12:42:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.252+0000 7f5ec97fa700 1 -- 172.21.15.59:0/2737652995 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5edc09bbb0 con 0x55619f507e80 2023-10-08T12:42:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.252+0000 7f5efb763b80 10 client.15579 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.252+0000 7f5efb763b80 1 -- 172.21.15.59:0/2737652995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55619f26fc60 con 0x55619f507e80 2023-10-08T12:42:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.252+0000 7f5ec97fa700 1 -- 172.21.15.59:0/2737652995 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55619f423eb0 con 0x55619f507e80 2023-10-08T12:42:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.252+0000 7f5ec97fa700 1 -- 172.21.15.59:0/2737652995 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5edc0b7070 con 0x55619f507e80 2023-10-08T12:42:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.252+0000 7f5efb763b80 10 client.15579 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.252+0000 7f5efb763b80 10 client.15579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.253+0000 7f5efb763b80 20 client.15579 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.253+0000 7f5efb763b80 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55619f522920 0x55619f524d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.253+0000 7f5efb763b80 4 client.15579 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.253+0000 7f5efb763b80 1 -- 172.21.15.59:0/2737652995 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55619f454e10 con 0x55619f522920 2023-10-08T12:42:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.253+0000 7f5ee539a700 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55619f522920 0x55619f524d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.253+0000 7f5ec97fa700 10 client.15579 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.253+0000 7f5ee539a700 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55619f522920 0x55619f524d40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0f3146289b50eab server_cookie=424bb134e5906146 in_seq=0 out_seq=0 2023-10-08T12:42:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.254+0000 7f5ec97fa700 1 -- 172.21.15.59:0/2737652995 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55619f454e10 con 0x55619f522920 2023-10-08T12:42:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.254+0000 7f5ec97fa700 10 client.15579 handle_command_reply: tid=0 2023-10-08T12:42:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.254+0000 7f5efb763b80 1 client.15579 shutdown 2023-10-08T12:42:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.254+0000 7f5efb763b80 1 -- 172.21.15.59:0/2737652995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f507e80 msgr2=0x55619f513a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.254+0000 7f5efb763b80 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f507e80 0x55619f513a30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5edc099a90 tx=0x7f5edc022af0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.255+0000 7f5efb763b80 1 -- 172.21.15.59:0/2737652995 shutdown_connections 2023-10-08T12:42:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.255+0000 7f5efb763b80 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55619f522920 0x55619f524d40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.255+0000 7f5efb763b80 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f513650 0x55619f51eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.255+0000 7f5efb763b80 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f507e80 0x55619f513a30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.255+0000 7f5efb763b80 1 --2- 172.21.15.59:0/2737652995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f513f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.255+0000 7f5ec97fa700 0 client.15579 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.255+0000 7f5efb763b80 1 -- 172.21.15.59:0/2737652995 >> 172.21.15.59:0/2737652995 conn(0x55619f47d260 msgr2=0x55619f503ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.255+0000 7f5efb763b80 1 -- 172.21.15.59:0/2737652995 shutdown_connections 2023-10-08T12:42:26.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.255+0000 7f5efb763b80 1 -- 172.21.15.59:0/2737652995 wait complete. 2023-10-08T12:42:26.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.255+0000 7f5efb763b80 20 client.15579 trim_cache size 0 max 16384 2023-10-08T12:42:26.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5efb763b80 1 Processor -- start 2023-10-08T12:42:26.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5efb763b80 1 -- start start 2023-10-08T12:42:26.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 0x55619f518900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f50cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f50d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5efb763b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f2dc920 con 0x55619f513650 2023-10-08T12:42:26.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5efb763b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f5142e0 con 0x55619f5087a0 2023-10-08T12:42:26.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5efb763b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f518e40 con 0x55619f507e80 2023-10-08T12:42:26.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5ee639c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f50d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5ee639c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f50d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34956/0 (socket says 172.21.15.59:34956) 2023-10-08T12:42:26.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5ee639c700 1 -- 172.21.15.59:0/2315753436 learned_addr learned my addr 172.21.15.59:0/2315753436 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:26.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/2315753436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 0x55619f518900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.273+0000 7f5ee539a700 1 --2- 172.21.15.59:0/2315753436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f50cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.274+0000 7f5ee539a700 1 -- 172.21.15.59:0/2315753436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 msgr2=0x55619f518900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.274+0000 7f5ee539a700 1 --2- 172.21.15.59:0/2315753436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 0x55619f518900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.274+0000 7f5ee539a700 1 -- 172.21.15.59:0/2315753436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 msgr2=0x55619f50d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.274+0000 7f5ee539a700 1 --2- 172.21.15.59:0/2315753436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f50d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.274+0000 7f5ee539a700 1 -- 172.21.15.59:0/2315753436 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55619f2ad250 con 0x55619f5087a0 2023-10-08T12:42:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.274+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/2315753436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 0x55619f518900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.274+0000 7f5ee539a700 1 --2- 172.21.15.59:0/2315753436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f50cd60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55619f5255b0 tx=0x7f5ed0004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=240ce170031622a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.274+0000 7f5ed4bff700 1 -- 172.21.15.59:0/2315753436 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0017070 con 0x55619f5087a0 2023-10-08T12:42:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.274+0000 7f5ed4bff700 1 -- 172.21.15.59:0/2315753436 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ed0018040 con 0x55619f5087a0 2023-10-08T12:42:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.274+0000 7f5ed4bff700 1 -- 172.21.15.59:0/2315753436 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00106b0 con 0x55619f5087a0 2023-10-08T12:42:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.275+0000 7f5efb763b80 1 -- 172.21.15.59:0/2315753436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 msgr2=0x55619f50cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.275+0000 7f5efb763b80 1 --2- 172.21.15.59:0/2315753436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f50cd60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55619f5255b0 tx=0x7f5ed0004320 comp rx=0 tx=0).stop 2023-10-08T12:42:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.275+0000 7f5efb763b80 1 -- 172.21.15.59:0/2315753436 shutdown_connections 2023-10-08T12:42:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.275+0000 7f5efb763b80 1 --2- 172.21.15.59:0/2315753436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f50d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.275+0000 7f5efb763b80 1 --2- 172.21.15.59:0/2315753436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f507e80 0x55619f518900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.275+0000 7f5efb763b80 1 --2- 172.21.15.59:0/2315753436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f5087a0 0x55619f50cd60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.275+0000 7f5efb763b80 1 -- 172.21.15.59:0/2315753436 >> 172.21.15.59:0/2315753436 conn(0x55619f47d260 msgr2=0x55619f5120d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.275+0000 7f5efb763b80 1 -- 172.21.15.59:0/2315753436 shutdown_connections 2023-10-08T12:42:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.275+0000 7f5efb763b80 1 -- 172.21.15.59:0/2315753436 wait complete. 2023-10-08T12:42:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.276+0000 7f5efb763b80 1 -- start start 2023-10-08T12:42:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.276+0000 7f5efb763b80 1 Processor -- start 2023-10-08T12:42:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.276+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f507e80 0x55619f56fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.276+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f5087a0 0x55619f5703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.276+0000 7f5efb763b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f56a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.276+0000 7f5efb763b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f56adb0 con 0x55619f513650 2023-10-08T12:42:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.276+0000 7f5efb763b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f56af20 con 0x55619f507e80 2023-10-08T12:42:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.276+0000 7f5efb763b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55619f56b0e0 con 0x55619f5087a0 2023-10-08T12:42:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.276+0000 7f5efb763b80 10 client.0 _ll_register_callbacks cb 0x55619f255800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee639c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f56a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee5b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f507e80 0x55619f56fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee5b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f507e80 0x55619f56fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53484/0 (socket says 172.21.15.59:53484) 2023-10-08T12:42:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee639c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f56a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34968/0 (socket says 172.21.15.59:34968) 2023-10-08T12:42:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/1239059497 learned_addr learned my addr 172.21.15.59:0/1239059497 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee539a700 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f5087a0 0x55619f5703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/1239059497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f5087a0 msgr2=0x55619f5703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f5087a0 0x55619f5703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/1239059497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 msgr2=0x55619f56a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f56a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee5b9b700 1 -- 172.21.15.59:0/1239059497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55619f26fc60 con 0x55619f507e80 2023-10-08T12:42:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ee5b9b700 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f507e80 0x55619f56fe70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00f740 tx=0x7f5edc0cbde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffefbdc1296ab719 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ec97fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:42:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.277+0000 7f5ec97fa700 1 -- 172.21.15.59:0/1239059497 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc09b0a0 con 0x55619f507e80 2023-10-08T12:42:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5ec97fa700 1 -- 172.21.15.59:0/1239059497 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5edc0a3a40 con 0x55619f507e80 2023-10-08T12:42:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5efb763b80 1 -- 172.21.15.59:0/1239059497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5edc09be40 con 0x55619f507e80 2023-10-08T12:42:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5ec97fa700 1 -- 172.21.15.59:0/1239059497 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5edc0978b0 con 0x55619f507e80 2023-10-08T12:42:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5efb763b80 10 client.25586 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5efb763b80 1 -- 172.21.15.59:0/1239059497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f5ed0009b30 con 0x55619f507e80 2023-10-08T12:42:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5ec97fa700 1 -- 172.21.15.59:0/1239059497 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5edc09be40 con 0x55619f507e80 2023-10-08T12:42:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5ec97fa700 1 -- 172.21.15.59:0/1239059497 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5edc097e50 con 0x55619f507e80 2023-10-08T12:42:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5efb763b80 10 client.25586 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5efb763b80 10 client.25586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5efb763b80 20 client.25586 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5efb763b80 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55619f577870 0x55619f579c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5efb763b80 4 client.25586 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:42:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.278+0000 7f5efb763b80 1 -- 172.21.15.59:0/1239059497 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55619f454b30 con 0x55619f577870 2023-10-08T12:42:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.279+0000 7f5ee539a700 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55619f577870 0x55619f579c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.279+0000 7f5ee539a700 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55619f577870 0x55619f579c60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=996768f1c29a94da server_cookie=9d473bd46a3775cc in_seq=0 out_seq=0 2023-10-08T12:42:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.279+0000 7f5ec97fa700 10 client.25586 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.279+0000 7f5ec97fa700 1 -- 172.21.15.59:0/1239059497 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55619f454b30 con 0x55619f577870 2023-10-08T12:42:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.279+0000 7f5ec97fa700 10 client.25586 handle_command_reply: tid=0 2023-10-08T12:42:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.279+0000 7f5efb763b80 1 client.25586 shutdown 2023-10-08T12:42:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.279+0000 7f5efb763b80 1 -- 172.21.15.59:0/1239059497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f507e80 msgr2=0x55619f56fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.279+0000 7f5efb763b80 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f507e80 0x55619f56fe70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00f740 tx=0x7f5edc0cbde0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5efb763b80 1 -- 172.21.15.59:0/1239059497 shutdown_connections 2023-10-08T12:42:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5efb763b80 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55619f577870 0x55619f579c60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5efb763b80 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55619f507e80 0x55619f56fe70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5efb763b80 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55619f513650 0x55619f56a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5efb763b80 1 --2- 172.21.15.59:0/1239059497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55619f5087a0 0x55619f5703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5ec97fa700 0 client.25586 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5efb763b80 1 -- 172.21.15.59:0/1239059497 >> 172.21.15.59:0/1239059497 conn(0x55619f47d260 msgr2=0x55619f50db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5efb763b80 1 -- 172.21.15.59:0/1239059497 shutdown_connections 2023-10-08T12:42:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5efb763b80 1 -- 172.21.15.59:0/1239059497 wait complete. 2023-10-08T12:42:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5efb763b80 20 client.25586 trim_cache size 0 max 16384 2023-10-08T12:42:26.288 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:42:26.288 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:42:26.289 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:42:26.289 INFO:teuthology.orchestra.run.smithi059.stdout: "5fb88e6d-edd6-4491-bb62-feb1c3663056": { 2023-10-08T12:42:26.289 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:42:26.289 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "5fb88e6d-edd6-4491-bb62-feb1c3663056", 2023-10-08T12:42:26.289 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:42:26.289 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:42:26.289 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:42:26.289 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:42:26.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5ee7dff700 1 -- 172.21.15.59:0/1943426904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ecc0a15f0 msgr2=0x7f5ecc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5ee7dff700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ecc0a15f0 0x7f5ecc0a3ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8003e80 tx=0x7f5ed8009920 comp rx=0 tx=0).stop 2023-10-08T12:42:26.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5ee7dff700 1 -- 172.21.15.59:0/1943426904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ee0072c20 msgr2=0x7f5ee0198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.280+0000 7f5ee7dff700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ee0072c20 0x7f5ee0198e40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5edc000c00 tx=0x7f5edc005740 comp rx=0 tx=0).stop 2023-10-08T12:42:26.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.281+0000 7f5ee7dff700 1 -- 172.21.15.59:0/1943426904 shutdown_connections 2023-10-08T12:42:26.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.281+0000 7f5ee7dff700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5ecc0a15f0 0x7f5ecc0a3ab0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.281+0000 7f5ee7dff700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ee010cf80 0x7f5ee019d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.281+0000 7f5ee7dff700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ee0072c20 0x7f5ee0198e40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.281+0000 7f5ee7dff700 1 --2- 172.21.15.59:0/1943426904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee0073540 0x7f5ee0199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.281+0000 7f5ee7dff700 1 -- 172.21.15.59:0/1943426904 >> 172.21.15.59:0/1943426904 conn(0x7f5ee00fc230 msgr2=0x7f5ee00fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.281+0000 7f5ee7dff700 1 -- 172.21.15.59:0/1943426904 shutdown_connections 2023-10-08T12:42:26.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:26.281+0000 7f5ee7dff700 1 -- 172.21.15.59:0/1943426904 wait complete. 2023-10-08T12:42:26.300 INFO:tasks.cephfs.filesystem:scrub status for tag:5fb88e6d-edd6-4491-bb62-feb1c3663056 - {'path': '/', 'tag': '5fb88e6d-edd6-4491-bb62-feb1c3663056', 'options': 'recursive,force'} 2023-10-08T12:42:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:25 smithi092 ceph-mon[134093]: pgmap v351: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2023-10-08T12:42:27.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:26 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:42:27.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:26 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:26 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:42:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:26 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:27.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:26 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:42:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:26 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:26 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:42:27.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:26 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:27.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:26 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:42:27.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:26 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:27.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:26 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:42:27.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:26 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:28.133 INFO:tasks.workunit.client.0.smithi059.stderr:Updating files: 61% (7441/12065) Updating files: 62% (7481/12065) Updating files: 63% (7601/12065) Updating files: 64% (7722/12065) Updating files: 65% (7843/12065) Updating files: 66% (7963/12065) Updating files: 67% (8084/12065) Updating files: 68% (8205/12065) Updating files: 69% (8325/12065) Updating files: 70% (8446/12065) Updating files: 71% (8567/12065) Updating files: 72% (8687/12065) Updating files: 73% (8808/12065) Updating files: 74% (8929/12065) Updating files: 75% (9049/12065) Updating files: 76% (9170/12065) Updating files: 77% (9291/12065) Updating files: 78% (9411/12065) Updating files: 79% (9532/12065) Updating files: 80% (9652/12065) Updating files: 81% (9773/12065) Updating files: 82% (9894/12065) Updating files: 83% (10014/12065) Updating files: 84% (10135/12065) Updating files: 85% (10256/12065) Updating files: 86% (10376/12065) Updating files: 87% (10497/12065) Updating files: 88% (10618/12065) Updating files: 89% (10738/12065) Updating files: 90% (10859/12065) Updating files: 91% (10980/12065) Updating files: 92% (11100/12065) Updating files: 93% (11221/12065) Updating files: 94% (11342/12065) Updating files: 95% (11462/12065) Updating files: 95% (11581/12065) Updating files: 96% (11583/12065) Updating files: 97% (11704/12065) Updating files: 98% (11824/12065) Updating files: 99% (11945/12065) Updating files: 100% (12065/12065) Updating files: 100% (12065/12065), done. 2023-10-08T12:42:28.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:27 smithi173 ceph-mon[135182]: pgmap v352: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:42:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:42:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:27 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:27 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:42:28.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:27 smithi059 ceph-mon[98489]: pgmap v352: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:42:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:42:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:27 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:27 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:42:28.304 INFO:tasks.workunit.client.0.smithi059.stderr:Note: switching to '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'. 2023-10-08T12:42:28.305 INFO:tasks.workunit.client.0.smithi059.stderr: 2023-10-08T12:42:28.305 INFO:tasks.workunit.client.0.smithi059.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-08T12:42:28.305 INFO:tasks.workunit.client.0.smithi059.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-08T12:42:28.305 INFO:tasks.workunit.client.0.smithi059.stderr:state without impacting any branches by switching back to a branch. 2023-10-08T12:42:28.305 INFO:tasks.workunit.client.0.smithi059.stderr: 2023-10-08T12:42:28.305 INFO:tasks.workunit.client.0.smithi059.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-08T12:42:28.305 INFO:tasks.workunit.client.0.smithi059.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-08T12:42:28.305 INFO:tasks.workunit.client.0.smithi059.stderr: 2023-10-08T12:42:28.305 INFO:tasks.workunit.client.0.smithi059.stderr: git switch -c 2023-10-08T12:42:28.305 INFO:tasks.workunit.client.0.smithi059.stderr: 2023-10-08T12:42:28.305 INFO:tasks.workunit.client.0.smithi059.stderr:Or undo this operation with: 2023-10-08T12:42:28.306 INFO:tasks.workunit.client.0.smithi059.stderr: 2023-10-08T12:42:28.306 INFO:tasks.workunit.client.0.smithi059.stderr: git switch - 2023-10-08T12:42:28.306 INFO:tasks.workunit.client.0.smithi059.stderr: 2023-10-08T12:42:28.306 INFO:tasks.workunit.client.0.smithi059.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-08T12:42:28.306 INFO:tasks.workunit.client.0.smithi059.stderr: 2023-10-08T12:42:28.306 INFO:tasks.workunit.client.0.smithi059.stderr:HEAD is now at 7b3143bae3b Merge PR #48130 into wip-batrick-testing-20231007.154158 2023-10-08T12:42:28.308 DEBUG:teuthology.orchestra.run.smithi059:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-08T12:42:28.362 INFO:tasks.workunit.client.0.smithi059.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-08T12:42:28.367 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-08T12:42:28.367 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-08T12:42:28.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:27 smithi092 ceph-mon[134093]: pgmap v352: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2023-10-08T12:42:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:42:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:27 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:27 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:42:28.955 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-08T12:42:29.049 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-08T12:42:29.114 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-08T12:42:29.117 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-08T12:42:29.117 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-08T12:42:29.181 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-08T12:42:29.188 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T12:42:29.188 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-08T12:42:29.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:28 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:42:29.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:28 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:42:29.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:28 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:29.232 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-10-08T12:42:29.233 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-10-08T12:42:29.233 DEBUG:teuthology.orchestra.run.smithi059:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-10-08T12:42:29.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:28 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:42:29.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:28 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:42:29.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:28 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:29.323 INFO:tasks.workunit.client.0.smithi059.stderr:+ dbench 1 2023-10-08T12:42:29.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:28 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:42:29.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:28 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:42:29.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:28 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:42:29.393 INFO:tasks.workunit.client.0.smithi059.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-10-08T12:42:29.393 INFO:tasks.workunit.client.0.smithi059.stdout: 2023-10-08T12:42:29.393 INFO:tasks.workunit.client.0.smithi059.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-10-08T12:42:29.394 INFO:tasks.workunit.client.0.smithi059.stdout:0 of 1 processes prepared for launch 0 sec 2023-10-08T12:42:29.495 INFO:tasks.workunit.client.0.smithi059.stdout:1 of 1 processes prepared for launch 0 sec 2023-10-08T12:42:29.495 INFO:tasks.workunit.client.0.smithi059.stdout:releasing clients 2023-10-08T12:42:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:29 smithi173 ceph-mon[135182]: pgmap v353: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2023-10-08T12:42:30.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:29 smithi059 ceph-mon[98489]: pgmap v353: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2023-10-08T12:42:30.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:29 smithi092 ceph-mon[134093]: pgmap v353: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2023-10-08T12:42:30.495 INFO:tasks.workunit.client.0.smithi059.stdout: 1 2922 33.48 MB/sec warmup 1 sec latency 6.308 ms 2023-10-08T12:42:31.495 INFO:tasks.workunit.client.0.smithi059.stdout: 1 6009 23.61 MB/sec warmup 2 sec latency 7.666 ms 2023-10-08T12:42:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:31 smithi173 ceph-mon[135182]: pgmap v354: 97 pgs: 97 active+clean; 1.9 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 66 KiB/s wr, 18 op/s 2023-10-08T12:42:32.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:31 smithi059 ceph-mon[98489]: pgmap v354: 97 pgs: 97 active+clean; 1.9 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 66 KiB/s wr, 18 op/s 2023-10-08T12:42:32.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:31 smithi092 ceph-mon[134093]: pgmap v354: 97 pgs: 97 active+clean; 1.9 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 66 KiB/s wr, 18 op/s 2023-10-08T12:42:32.495 INFO:tasks.workunit.client.0.smithi059.stdout: 1 8661 21.44 MB/sec warmup 3 sec latency 8.047 ms 2023-10-08T12:42:33.495 INFO:tasks.workunit.client.0.smithi059.stdout: 1 11638 19.81 MB/sec warmup 4 sec latency 8.723 ms 2023-10-08T12:42:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:33 smithi173 ceph-mon[135182]: pgmap v355: 97 pgs: 97 active+clean; 3.0 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 169 KiB/s wr, 22 op/s 2023-10-08T12:42:34.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:33 smithi059 ceph-mon[98489]: pgmap v355: 97 pgs: 97 active+clean; 3.0 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 169 KiB/s wr, 22 op/s 2023-10-08T12:42:34.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:33 smithi092 ceph-mon[134093]: pgmap v355: 97 pgs: 97 active+clean; 3.0 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 169 KiB/s wr, 22 op/s 2023-10-08T12:42:34.495 INFO:tasks.workunit.client.0.smithi059.stdout: 1 14791 19.49 MB/sec warmup 5 sec latency 23.598 ms 2023-10-08T12:42:35.495 INFO:tasks.workunit.client.0.smithi059.stdout: 1 17861 19.20 MB/sec warmup 6 sec latency 97.120 ms 2023-10-08T12:42:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:35 smithi173 ceph-mon[135182]: pgmap v356: 97 pgs: 97 active+clean; 3.6 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 236 KiB/s wr, 25 op/s 2023-10-08T12:42:36.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:35 smithi059 ceph-mon[98489]: pgmap v356: 97 pgs: 97 active+clean; 3.6 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 236 KiB/s wr, 25 op/s 2023-10-08T12:42:36.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:35 smithi092 ceph-mon[134093]: pgmap v356: 97 pgs: 97 active+clean; 3.6 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 236 KiB/s wr, 25 op/s 2023-10-08T12:42:36.495 INFO:tasks.workunit.client.0.smithi059.stdout: 1 20955 18.54 MB/sec warmup 7 sec latency 5.707 ms 2023-10-08T12:42:37.495 INFO:tasks.workunit.client.0.smithi059.stdout: 1 23907 17.97 MB/sec warmup 8 sec latency 7.364 ms 2023-10-08T12:42:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:37 smithi173 ceph-mon[135182]: pgmap v357: 97 pgs: 97 active+clean; 8.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 745 KiB/s wr, 95 op/s 2023-10-08T12:42:38.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:37 smithi059 ceph-mon[98489]: pgmap v357: 97 pgs: 97 active+clean; 8.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 745 KiB/s wr, 95 op/s 2023-10-08T12:42:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:37 smithi092 ceph-mon[134093]: pgmap v357: 97 pgs: 97 active+clean; 8.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 745 KiB/s wr, 95 op/s 2023-10-08T12:42:38.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 26721 17.81 MB/sec warmup 9 sec latency 17.499 ms 2023-10-08T12:42:39.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 29571 17.60 MB/sec warmup 10 sec latency 8.380 ms 2023-10-08T12:42:40.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:39 smithi059 ceph-mon[98489]: pgmap v358: 97 pgs: 97 active+clean; 12 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2023-10-08T12:42:40.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:39 smithi092 ceph-mon[134093]: pgmap v358: 97 pgs: 97 active+clean; 12 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2023-10-08T12:42:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:39 smithi173 ceph-mon[135182]: pgmap v358: 97 pgs: 97 active+clean; 12 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2023-10-08T12:42:40.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 32511 17.55 MB/sec warmup 11 sec latency 93.970 ms 2023-10-08T12:42:41.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 35763 17.66 MB/sec warmup 12 sec latency 36.272 ms 2023-10-08T12:42:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:41 smithi173 ceph-mon[135182]: pgmap v359: 97 pgs: 97 active+clean; 13 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 1.2 MiB/s wr, 148 op/s 2023-10-08T12:42:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:41 smithi059 ceph-mon[98489]: pgmap v359: 97 pgs: 97 active+clean; 13 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 1.2 MiB/s wr, 148 op/s 2023-10-08T12:42:42.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:41 smithi092 ceph-mon[134093]: pgmap v359: 97 pgs: 97 active+clean; 13 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 1.2 MiB/s wr, 148 op/s 2023-10-08T12:42:42.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 39049 17.67 MB/sec warmup 13 sec latency 5.696 ms 2023-10-08T12:42:43.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 41616 17.09 MB/sec warmup 14 sec latency 10.467 ms 2023-10-08T12:42:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:43 smithi173 ceph-mon[135182]: pgmap v360: 97 pgs: 97 active+clean; 19 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.7 MiB/s wr, 210 op/s 2023-10-08T12:42:44.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:43 smithi059 ceph-mon[98489]: pgmap v360: 97 pgs: 97 active+clean; 19 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.7 MiB/s wr, 210 op/s 2023-10-08T12:42:44.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:43 smithi092 ceph-mon[134093]: pgmap v360: 97 pgs: 97 active+clean; 19 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.7 MiB/s wr, 210 op/s 2023-10-08T12:42:44.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 44408 17.05 MB/sec warmup 15 sec latency 7.348 ms 2023-10-08T12:42:45.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 46869 16.86 MB/sec warmup 16 sec latency 95.285 ms 2023-10-08T12:42:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:45 smithi173 ceph-mon[135182]: pgmap v361: 97 pgs: 97 active+clean; 19 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.7 MiB/s wr, 208 op/s 2023-10-08T12:42:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:45 smithi059 ceph-mon[98489]: pgmap v361: 97 pgs: 97 active+clean; 19 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.7 MiB/s wr, 208 op/s 2023-10-08T12:42:46.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:45 smithi092 ceph-mon[134093]: pgmap v361: 97 pgs: 97 active+clean; 19 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.7 MiB/s wr, 208 op/s 2023-10-08T12:42:46.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 50079 16.98 MB/sec warmup 17 sec latency 16.857 ms 2023-10-08T12:42:47.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 53380 17.03 MB/sec warmup 18 sec latency 6.118 ms 2023-10-08T12:42:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:47 smithi173 ceph-mon[135182]: pgmap v362: 97 pgs: 97 active+clean; 20 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.7 MiB/s wr, 216 op/s 2023-10-08T12:42:48.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:47 smithi059 ceph-mon[98489]: pgmap v362: 97 pgs: 97 active+clean; 20 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.7 MiB/s wr, 216 op/s 2023-10-08T12:42:48.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:47 smithi092 ceph-mon[134093]: pgmap v362: 97 pgs: 97 active+clean; 20 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.7 MiB/s wr, 216 op/s 2023-10-08T12:42:48.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 56138 16.82 MB/sec warmup 19 sec latency 14.029 ms 2023-10-08T12:42:49.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 59169 16.70 MB/sec warmup 20 sec latency 6.169 ms 2023-10-08T12:42:50.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:49 smithi059 ceph-mon[98489]: pgmap v363: 97 pgs: 97 active+clean; 26 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 236 op/s 2023-10-08T12:42:50.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:49 smithi092 ceph-mon[134093]: pgmap v363: 97 pgs: 97 active+clean; 26 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 236 op/s 2023-10-08T12:42:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:49 smithi173 ceph-mon[135182]: pgmap v363: 97 pgs: 97 active+clean; 26 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 236 op/s 2023-10-08T12:42:50.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 61754 16.72 MB/sec warmup 21 sec latency 6.729 ms 2023-10-08T12:42:51.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 64593 16.61 MB/sec warmup 22 sec latency 22.715 ms 2023-10-08T12:42:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:51 smithi173 ceph-mon[135182]: pgmap v364: 97 pgs: 97 active+clean; 29 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1.8 MiB/s wr, 230 op/s 2023-10-08T12:42:52.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:51 smithi059 ceph-mon[98489]: pgmap v364: 97 pgs: 97 active+clean; 29 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1.8 MiB/s wr, 230 op/s 2023-10-08T12:42:52.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:51 smithi092 ceph-mon[134093]: pgmap v364: 97 pgs: 97 active+clean; 29 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1.8 MiB/s wr, 230 op/s 2023-10-08T12:42:52.496 INFO:tasks.workunit.client.0.smithi059.stdout: 1 67809 16.71 MB/sec warmup 23 sec latency 7.017 ms 2023-10-08T12:42:53.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 71036 16.75 MB/sec warmup 24 sec latency 18.396 ms 2023-10-08T12:42:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:53 smithi173 ceph-mon[135182]: pgmap v365: 97 pgs: 97 active+clean; 31 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.8 MiB/s wr, 230 op/s 2023-10-08T12:42:54.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:53 smithi059 ceph-mon[98489]: pgmap v365: 97 pgs: 97 active+clean; 31 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.8 MiB/s wr, 230 op/s 2023-10-08T12:42:54.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:53 smithi092 ceph-mon[134093]: pgmap v365: 97 pgs: 97 active+clean; 31 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.8 MiB/s wr, 230 op/s 2023-10-08T12:42:54.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 73755 16.58 MB/sec warmup 25 sec latency 21.532 ms 2023-10-08T12:42:55.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 76437 16.46 MB/sec warmup 26 sec latency 6.181 ms 2023-10-08T12:42:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:55 smithi173 ceph-mon[135182]: pgmap v366: 97 pgs: 97 active+clean; 32 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.4 MiB/s wr, 169 op/s 2023-10-08T12:42:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:55 smithi059 ceph-mon[98489]: pgmap v366: 97 pgs: 97 active+clean; 32 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.4 MiB/s wr, 169 op/s 2023-10-08T12:42:56.301 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:42:56.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:55 smithi092 ceph-mon[134093]: pgmap v366: 97 pgs: 97 active+clean; 32 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.4 MiB/s wr, 169 op/s 2023-10-08T12:42:56.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 79256 16.44 MB/sec warmup 27 sec latency 6.085 ms 2023-10-08T12:42:56.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.534+0000 7f05039ff700 1 -- 172.21.15.59:0/447023353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc100740 msgr2=0x7f04fc100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.534+0000 7f05039ff700 1 --2- 172.21.15.59:0/447023353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc100740 0x7f04fc100bc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009990 tx=0x7f04ec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.534+0000 7f05039ff700 1 -- 172.21.15.59:0/447023353 shutdown_connections 2023-10-08T12:42:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.534+0000 7f05039ff700 1 --2- 172.21.15.59:0/447023353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04fc101100 0x7f04fc10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.534+0000 7f05039ff700 1 --2- 172.21.15.59:0/447023353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc106750 0x7f04fc106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.534+0000 7f05039ff700 1 --2- 172.21.15.59:0/447023353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc100740 0x7f04fc100bc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.534+0000 7f05039ff700 1 -- 172.21.15.59:0/447023353 >> 172.21.15.59:0/447023353 conn(0x7f04fc0fc230 msgr2=0x7f04fc0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.535+0000 7f05039ff700 1 -- 172.21.15.59:0/447023353 shutdown_connections 2023-10-08T12:42:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.535+0000 7f05039ff700 1 -- 172.21.15.59:0/447023353 wait complete. 2023-10-08T12:42:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f05039ff700 1 Processor -- start 2023-10-08T12:42:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f05039ff700 1 -- start start 2023-10-08T12:42:56.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f05039ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04fc100740 0x7f04fc198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f05039ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc101100 0x7f04fc199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f05039ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc106750 0x7f04fc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f05039ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc19dce0 con 0x7f04fc101100 2023-10-08T12:42:56.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f05039ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc19de50 con 0x7f04fc100740 2023-10-08T12:42:56.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f05039ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc19e010 con 0x7f04fc106750 2023-10-08T12:42:56.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f050179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04fc100740 0x7f04fc198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f050179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04fc100740 0x7f04fc198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:59896/0 (socket says 172.21.15.59:59896) 2023-10-08T12:42:56.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f050179b700 1 -- 172.21.15.59:0/2493353991 learned_addr learned my addr 172.21.15.59:0/2493353991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:56.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.536+0000 7f0500f9a700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc101100 0x7f04fc199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f0501f9c700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc106750 0x7f04fc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f050179b700 1 -- 172.21.15.59:0/2493353991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc106750 msgr2=0x7f04fc19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f050179b700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc106750 0x7f04fc19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f050179b700 1 -- 172.21.15.59:0/2493353991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc101100 msgr2=0x7f04fc199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f050179b700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc101100 0x7f04fc199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f050179b700 1 -- 172.21.15.59:0/2493353991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec0095f0 con 0x7f04fc100740 2023-10-08T12:42:56.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f050179b700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04fc100740 0x7f04fc198dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f04f800e9a0 tx=0x7f04f800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:56.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f04f27fc700 1 -- 172.21.15.59:0/2493353991 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8009790 con 0x7f04fc100740 2023-10-08T12:42:56.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f04f27fc700 1 -- 172.21.15.59:0/2493353991 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04f8010430 con 0x7f04fc100740 2023-10-08T12:42:56.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f05039ff700 1 -- 172.21.15.59:0/2493353991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc19e2f0 con 0x7f04fc100740 2023-10-08T12:42:56.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f04f27fc700 1 -- 172.21.15.59:0/2493353991 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8018680 con 0x7f04fc100740 2023-10-08T12:42:56.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.537+0000 7f05039ff700 1 -- 172.21.15.59:0/2493353991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc1a5b30 con 0x7f04fc100740 2023-10-08T12:42:56.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.542+0000 7f04f27fc700 1 -- 172.21.15.59:0/2493353991 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f04f80105a0 con 0x7f04fc100740 2023-10-08T12:42:56.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.544+0000 7f05172d2b80 1 Processor -- start 2023-10-08T12:42:56.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.544+0000 7f05172d2b80 1 -- start start 2023-10-08T12:42:56.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.544+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0b9ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.544+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 0x5561a0ba6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.544+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 0x5561a0ba9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.544+0000 7f05172d2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0afc460 con 0x5561a0ba6e60 2023-10-08T12:42:56.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f05172d2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0aedc20 con 0x5561a0b9bfb0 2023-10-08T12:42:56.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f05172d2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0aeb540 con 0x5561a0b9b690 2023-10-08T12:42:56.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f050179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 0x5561a0ba6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f0500f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 0x5561a0ba9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f050179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 0x5561a0ba6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:59906/0 (socket says 172.21.15.59:59906) 2023-10-08T12:42:56.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f050179b700 1 -- 172.21.15.59:0/574768617 learned_addr learned my addr 172.21.15.59:0/574768617 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:56.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f0501f9c700 1 --2- 172.21.15.59:0/574768617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0b9ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f04f27fc700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04e80a15f0 0x7f04e80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f050179b700 1 -- 172.21.15.59:0/574768617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 msgr2=0x5561a0b9ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:56.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f050179b700 1 --2- 172.21.15.59:0/574768617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0b9ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f050179b700 1 -- 172.21.15.59:0/574768617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 msgr2=0x5561a0ba9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:56.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f050179b700 1 --2- 172.21.15.59:0/574768617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 0x5561a0ba9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f050179b700 1 -- 172.21.15.59:0/574768617 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a0911de0 con 0x5561a0b9bfb0 2023-10-08T12:42:56.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f0500f9a700 1 --2- 172.21.15.59:0/574768617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 0x5561a0ba9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:56.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f0501f9c700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04e80a15f0 0x7f04e80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.545+0000 7f04f27fc700 1 -- 172.21.15.59:0/2493353991 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f04f8014070 con 0x7f04fc100740 2023-10-08T12:42:56.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.546+0000 7f050179b700 1 --2- 172.21.15.59:0/574768617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 0x5561a0ba6920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f04f8096cb0 tx=0x7f04f8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80c570424187d10 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:56.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.546+0000 7f04e77fe700 1 -- 172.21.15.59:0/574768617 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8099d80 con 0x5561a0b9bfb0 2023-10-08T12:42:56.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.546+0000 7f04e77fe700 1 -- 172.21.15.59:0/574768617 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04f8099ba0 con 0x5561a0b9bfb0 2023-10-08T12:42:56.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.546+0000 7f04e77fe700 1 -- 172.21.15.59:0/574768617 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8016e50 con 0x5561a0b9bfb0 2023-10-08T12:42:56.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.547+0000 7f05172d2b80 1 -- 172.21.15.59:0/574768617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 msgr2=0x5561a0ba6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.547+0000 7f05172d2b80 1 --2- 172.21.15.59:0/574768617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 0x5561a0ba6920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f04f8096cb0 tx=0x7f04f8017000 comp rx=0 tx=0).stop 2023-10-08T12:42:56.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.547+0000 7f0501f9c700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04e80a15f0 0x7f04e80a3ab0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009ec0 tx=0x7f04f4009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:56.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.547+0000 7f05172d2b80 1 -- 172.21.15.59:0/574768617 shutdown_connections 2023-10-08T12:42:56.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.547+0000 7f05172d2b80 1 --2- 172.21.15.59:0/574768617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 0x5561a0ba9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.547+0000 7f05172d2b80 1 --2- 172.21.15.59:0/574768617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0b9ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.547+0000 7f05172d2b80 1 --2- 172.21.15.59:0/574768617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 0x5561a0ba6920 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.547+0000 7f05172d2b80 1 -- 172.21.15.59:0/574768617 >> 172.21.15.59:0/574768617 conn(0x5561a0b08260 msgr2=0x5561a0b8f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.547+0000 7f05172d2b80 1 -- 172.21.15.59:0/574768617 shutdown_connections 2023-10-08T12:42:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.547+0000 7f05172d2b80 1 -- 172.21.15.59:0/574768617 wait complete. 2023-10-08T12:42:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.548+0000 7f05172d2b80 1 -- start start 2023-10-08T12:42:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.548+0000 7f05172d2b80 1 Processor -- start 2023-10-08T12:42:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.548+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0ba67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.548+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0b9bfb0 0x5561a0ba3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.548+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 0x5561a0ba41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.548+0000 7f05172d2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0ae6e30 con 0x5561a0b9bfb0 2023-10-08T12:42:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.548+0000 7f05172d2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0a83710 con 0x5561a0ba6e60 2023-10-08T12:42:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.548+0000 7f05172d2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0a833b0 con 0x5561a0b9b690 2023-10-08T12:42:56.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.549+0000 7f05172d2b80 10 client.0 _ll_register_callbacks cb 0x5561a08e0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:56.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.549+0000 7f0501f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 0x5561a0ba41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.549+0000 7f0501f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 0x5561a0ba41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:59910/0 (socket says 172.21.15.59:59910) 2023-10-08T12:42:56.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.549+0000 7f0501f9c700 1 -- 172.21.15.59:0/1126715977 learned_addr learned my addr 172.21.15.59:0/1126715977 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:56.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.549+0000 7f050179b700 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0ba67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.549+0000 7f0500f9a700 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0b9bfb0 0x5561a0ba3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.549+0000 7f0501f9c700 1 -- 172.21.15.59:0/1126715977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 msgr2=0x5561a0ba67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:56.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.549+0000 7f0501f9c700 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0ba67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.549+0000 7f0501f9c700 1 -- 172.21.15.59:0/1126715977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0b9bfb0 msgr2=0x5561a0ba3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.549+0000 7f0501f9c700 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0b9bfb0 0x5561a0ba3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.549+0000 7f0501f9c700 1 -- 172.21.15.59:0/1126715977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc10df10 con 0x5561a0ba6e60 2023-10-08T12:42:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.550+0000 7f0501f9c700 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 0x5561a0ba41c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f04f4018d80 tx=0x7f04f4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59f239cef39b05b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.550+0000 7f04e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:42:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.550+0000 7f04e4ff9700 1 -- 172.21.15.59:0/1126715977 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f400e040 con 0x5561a0ba6e60 2023-10-08T12:42:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.550+0000 7f05172d2b80 1 -- 172.21.15.59:0/1126715977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561a0aaeeb0 con 0x5561a0ba6e60 2023-10-08T12:42:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.550+0000 7f04e4ff9700 1 -- 172.21.15.59:0/1126715977 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f04f4016d40 con 0x5561a0ba6e60 2023-10-08T12:42:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.550+0000 7f04e4ff9700 1 -- 172.21.15.59:0/1126715977 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04f4018ed0 con 0x5561a0ba6e60 2023-10-08T12:42:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.550+0000 7f05172d2b80 10 client.25598 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.550+0000 7f05172d2b80 1 -- 172.21.15.59:0/1126715977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f04fc1a5b30 con 0x5561a0ba6e60 2023-10-08T12:42:56.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.550+0000 7f04e4ff9700 1 -- 172.21.15.59:0/1126715977 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5561a0aaeeb0 con 0x5561a0ba6e60 2023-10-08T12:42:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.551+0000 7f04e4ff9700 1 -- 172.21.15.59:0/1126715977 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f04f40214c0 con 0x5561a0ba6e60 2023-10-08T12:42:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.551+0000 7f05172d2b80 10 client.25598 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.551+0000 7f05172d2b80 10 client.25598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.551+0000 7f05172d2b80 20 client.25598 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.551+0000 7f05172d2b80 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561a0bb68f0 0x5561a0bb8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.551+0000 7f05172d2b80 4 client.25598 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.551+0000 7f05172d2b80 1 -- 172.21.15.59:0/1126715977 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561a0adfe10 con 0x5561a0bb68f0 2023-10-08T12:42:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.551+0000 7f050179b700 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561a0bb68f0 0x5561a0bb8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.551+0000 7f050179b700 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561a0bb68f0 0x5561a0bb8d10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=159bf1e20bdae925 server_cookie=6bd5f731a9597faa in_seq=0 out_seq=0 2023-10-08T12:42:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.551+0000 7f04e4ff9700 10 client.25598 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.552+0000 7f04e4ff9700 1 -- 172.21.15.59:0/1126715977 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5561a0adfe10 con 0x5561a0bb68f0 2023-10-08T12:42:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.552+0000 7f04e4ff9700 10 client.25598 handle_command_reply: tid=0 2023-10-08T12:42:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.552+0000 7f05172d2b80 1 client.25598 shutdown 2023-10-08T12:42:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.552+0000 7f05172d2b80 1 -- 172.21.15.59:0/1126715977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 msgr2=0x5561a0ba41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.552+0000 7f05172d2b80 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 0x5561a0ba41c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f04f4018d80 tx=0x7f04f4004ad0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.552+0000 7f05172d2b80 1 -- 172.21.15.59:0/1126715977 shutdown_connections 2023-10-08T12:42:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.552+0000 7f05172d2b80 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561a0bb68f0 0x5561a0bb8d10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.553+0000 7f05172d2b80 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 0x5561a0ba41c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.553+0000 7f04e4ff9700 0 client.25598 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.553+0000 7f05172d2b80 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0ba67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.553+0000 7f05172d2b80 1 --2- 172.21.15.59:0/1126715977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0b9bfb0 0x5561a0ba3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.553+0000 7f05172d2b80 1 -- 172.21.15.59:0/1126715977 >> 172.21.15.59:0/1126715977 conn(0x5561a0b08260 msgr2=0x5561a0b8eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.553+0000 7f05172d2b80 1 -- 172.21.15.59:0/1126715977 shutdown_connections 2023-10-08T12:42:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.553+0000 7f05172d2b80 1 -- 172.21.15.59:0/1126715977 wait complete. 2023-10-08T12:42:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.553+0000 7f05172d2b80 20 client.25598 trim_cache size 0 max 16384 2023-10-08T12:42:56.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.572+0000 7f05172d2b80 1 Processor -- start 2023-10-08T12:42:56.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.572+0000 7f05172d2b80 1 -- start start 2023-10-08T12:42:56.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.573+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0b9b690 0x5561a0b9e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.573+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9bfb0 0x5561a0bad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.573+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 0x5561a0b9efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.573+0000 7f05172d2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0967920 con 0x5561a0b9b690 2023-10-08T12:42:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.573+0000 7f05172d2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0bb3370 con 0x5561a0ba6e60 2023-10-08T12:42:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.573+0000 7f05172d2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0b9c910 con 0x5561a0b9bfb0 2023-10-08T12:42:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.573+0000 7f050179b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0b9b690 0x5561a0b9e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.573+0000 7f0500f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9bfb0 0x5561a0bad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.573+0000 7f0501f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 0x5561a0b9efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.573+0000 7f0500f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9bfb0 0x5561a0bad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44036/0 (socket says 172.21.15.59:44036) 2023-10-08T12:42:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.573+0000 7f0500f9a700 1 -- 172.21.15.59:0/574072698 learned_addr learned my addr 172.21.15.59:0/574072698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.574+0000 7f0500f9a700 1 -- 172.21.15.59:0/574072698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 msgr2=0x5561a0b9efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.574+0000 7f0500f9a700 1 --2- 172.21.15.59:0/574072698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 0x5561a0b9efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.574+0000 7f0500f9a700 1 -- 172.21.15.59:0/574072698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0b9b690 msgr2=0x5561a0b9e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:56.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.574+0000 7f0500f9a700 1 --2- 172.21.15.59:0/574072698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0b9b690 0x5561a0b9e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.574+0000 7f0500f9a700 1 -- 172.21.15.59:0/574072698 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a08fac60 con 0x5561a0b9bfb0 2023-10-08T12:42:56.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.574+0000 7f0501f9c700 1 --2- 172.21.15.59:0/574072698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 0x5561a0b9efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:56.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.574+0000 7f0500f9a700 1 --2- 172.21.15.59:0/574072698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9bfb0 0x5561a0bad8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f04ec015000 tx=0x7f04ec005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2e0b77cf2dd69ee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:56.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.574+0000 7f04e7fff700 1 -- 172.21.15.59:0/574072698 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec01d030 con 0x5561a0b9bfb0 2023-10-08T12:42:56.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.574+0000 7f04e7fff700 1 -- 172.21.15.59:0/574072698 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04ec01e040 con 0x5561a0b9bfb0 2023-10-08T12:42:56.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.574+0000 7f04e7fff700 1 -- 172.21.15.59:0/574072698 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec004740 con 0x5561a0b9bfb0 2023-10-08T12:42:56.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.575+0000 7f05172d2b80 1 -- 172.21.15.59:0/574072698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9bfb0 msgr2=0x5561a0bad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.575+0000 7f05172d2b80 1 --2- 172.21.15.59:0/574072698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9bfb0 0x5561a0bad8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f04ec015000 tx=0x7f04ec005fd0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.575+0000 7f05172d2b80 1 -- 172.21.15.59:0/574072698 shutdown_connections 2023-10-08T12:42:56.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.575+0000 7f05172d2b80 1 --2- 172.21.15.59:0/574072698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0ba6e60 0x5561a0b9efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.575+0000 7f05172d2b80 1 --2- 172.21.15.59:0/574072698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0b9b690 0x5561a0b9e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.575+0000 7f05172d2b80 1 --2- 172.21.15.59:0/574072698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9bfb0 0x5561a0bad8f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.575+0000 7f05172d2b80 1 -- 172.21.15.59:0/574072698 >> 172.21.15.59:0/574072698 conn(0x5561a0b08260 msgr2=0x5561a0bbd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:56.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.575+0000 7f05172d2b80 1 -- 172.21.15.59:0/574072698 shutdown_connections 2023-10-08T12:42:56.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.575+0000 7f05172d2b80 1 -- 172.21.15.59:0/574072698 wait complete. 2023-10-08T12:42:56.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.576+0000 7f05172d2b80 1 -- start start 2023-10-08T12:42:56.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.576+0000 7f05172d2b80 1 Processor -- start 2023-10-08T12:42:56.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.576+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0bad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.576+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 0x5561a0babce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.576+0000 7f05172d2b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 0x5561a0bac220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.576+0000 7f05172d2b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0bac760 con 0x5561a0ba6e60 2023-10-08T12:42:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.576+0000 7f05172d2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0bac8a0 con 0x5561a0b9bfb0 2023-10-08T12:42:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.576+0000 7f05172d2b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a0baca30 con 0x5561a0b9b690 2023-10-08T12:42:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f05172d2b80 10 client.0 _ll_register_callbacks cb 0x7f04f4018930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f050179b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0bad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f050179b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0bad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44048/0 (socket says 172.21.15.59:44048) 2023-10-08T12:42:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f050179b700 1 -- 172.21.15.59:0/2914537957 learned_addr learned my addr 172.21.15.59:0/2914537957 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f0500f9a700 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 0x5561a0babce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f0501f9c700 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 0x5561a0bac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f050179b700 1 -- 172.21.15.59:0/2914537957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 msgr2=0x5561a0babce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f050179b700 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 0x5561a0babce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f050179b700 1 -- 172.21.15.59:0/2914537957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 msgr2=0x5561a0bac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f050179b700 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 0x5561a0bac220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f050179b700 1 -- 172.21.15.59:0/2914537957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc1a5b30 con 0x5561a0b9b690 2023-10-08T12:42:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.577+0000 7f0501f9c700 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 0x5561a0bac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.578+0000 7f050179b700 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0bad750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f04f8000c00 tx=0x7f04f800c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18769da444f519cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.578+0000 7f04e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:42:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.578+0000 7f04e4ff9700 1 -- 172.21.15.59:0/2914537957 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f809a940 con 0x5561a0b9b690 2023-10-08T12:42:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.578+0000 7f04e4ff9700 1 -- 172.21.15.59:0/2914537957 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f04f809a240 con 0x5561a0b9b690 2023-10-08T12:42:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.578+0000 7f05172d2b80 1 -- 172.21.15.59:0/2914537957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04f8099ba0 con 0x5561a0b9b690 2023-10-08T12:42:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.578+0000 7f04e4ff9700 1 -- 172.21.15.59:0/2914537957 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04f809e390 con 0x5561a0b9b690 2023-10-08T12:42:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.578+0000 7f05172d2b80 10 client.25594 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.578+0000 7f05172d2b80 1 -- 172.21.15.59:0/2914537957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f04ec005040 con 0x5561a0b9b690 2023-10-08T12:42:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.579+0000 7f04e4ff9700 1 -- 172.21.15.59:0/2914537957 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04f8063020 con 0x5561a0b9b690 2023-10-08T12:42:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.579+0000 7f04e4ff9700 1 -- 172.21.15.59:0/2914537957 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f04f8096950 con 0x5561a0b9b690 2023-10-08T12:42:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.579+0000 7f05172d2b80 10 client.25594 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.579+0000 7f05172d2b80 10 client.25594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.579+0000 7f05172d2b80 20 client.25594 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.579+0000 7f05172d2b80 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561a0c0b9a0 0x5561a0c0dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.579+0000 7f05172d2b80 4 client.25594 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:42:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.579+0000 7f05172d2b80 1 -- 172.21.15.59:0/2914537957 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5561a0adfb30 con 0x5561a0c0b9a0 2023-10-08T12:42:56.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.579+0000 7f0500f9a700 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561a0c0b9a0 0x5561a0c0dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.580+0000 7f0500f9a700 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561a0c0b9a0 0x5561a0c0dd90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f0c84ab4183321c server_cookie=f21cb1fa2b622abf in_seq=0 out_seq=0 2023-10-08T12:42:56.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.580+0000 7f04e4ff9700 10 client.25594 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f04e4ff9700 1 -- 172.21.15.59:0/2914537957 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5561a0adfb30 con 0x5561a0c0b9a0 2023-10-08T12:42:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f04e4ff9700 10 client.25594 handle_command_reply: tid=0 2023-10-08T12:42:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f05172d2b80 1 client.25594 shutdown 2023-10-08T12:42:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f05172d2b80 1 -- 172.21.15.59:0/2914537957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 msgr2=0x5561a0bad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f05172d2b80 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0bad750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f04f8000c00 tx=0x7f04f800c480 comp rx=0 tx=0).stop 2023-10-08T12:42:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f05172d2b80 1 -- 172.21.15.59:0/2914537957 shutdown_connections 2023-10-08T12:42:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f05172d2b80 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561a0c0b9a0 0x5561a0c0dd90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f05172d2b80 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561a0ba6e60 0x5561a0bac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f05172d2b80 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561a0b9b690 0x5561a0bad750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f04e4ff9700 0 client.25594 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f05172d2b80 1 --2- 172.21.15.59:0/2914537957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561a0b9bfb0 0x5561a0babce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f05172d2b80 1 -- 172.21.15.59:0/2914537957 >> 172.21.15.59:0/2914537957 conn(0x5561a0b08260 msgr2=0x5561a0b9efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f05172d2b80 1 -- 172.21.15.59:0/2914537957 shutdown_connections 2023-10-08T12:42:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.582+0000 7f05172d2b80 1 -- 172.21.15.59:0/2914537957 wait complete. 2023-10-08T12:42:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05172d2b80 20 client.25594 trim_cache size 0 max 16384 2023-10-08T12:42:56.589 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:42:56.589 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:42:56.590 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:42:56.590 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:42:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 -- 172.21.15.59:0/2493353991 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04e80a15f0 msgr2=0x7f04e80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04e80a15f0 0x7f04e80a3ab0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009ec0 tx=0x7f04f4009040 comp rx=0 tx=0).stop 2023-10-08T12:42:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 -- 172.21.15.59:0/2493353991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04fc100740 msgr2=0x7f04fc198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04fc100740 0x7f04fc198dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f04f800e9a0 tx=0x7f04f800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 -- 172.21.15.59:0/2493353991 shutdown_connections 2023-10-08T12:42:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f04e80a15f0 0x7f04e80a3ab0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04fc100740 0x7f04fc198dc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc106750 0x7f04fc19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 --2- 172.21.15.59:0/2493353991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc101100 0x7f04fc199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 -- 172.21.15.59:0/2493353991 >> 172.21.15.59:0/2493353991 conn(0x7f04fc0fc230 msgr2=0x7f04fc10ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 -- 172.21.15.59:0/2493353991 shutdown_connections 2023-10-08T12:42:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.583+0000 7f05039ff700 1 -- 172.21.15.59:0/2493353991 wait complete. 2023-10-08T12:42:56.604 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:42:56.604 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:42:56.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.830+0000 7fa17d5ff700 1 -- 172.21.15.59:0/1836342931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa178100630 msgr2=0x7fa178100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.830+0000 7fa17d5ff700 1 --2- 172.21.15.59:0/1836342931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa178100630 0x7fa178100ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009990 tx=0x7fa16c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.831+0000 7fa17d5ff700 1 -- 172.21.15.59:0/1836342931 shutdown_connections 2023-10-08T12:42:56.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.831+0000 7fa17d5ff700 1 --2- 172.21.15.59:0/1836342931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa178100ff0 0x7fa17810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.831+0000 7fa17d5ff700 1 --2- 172.21.15.59:0/1836342931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa178106640 0x7fa178106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.831+0000 7fa17d5ff700 1 --2- 172.21.15.59:0/1836342931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa178100630 0x7fa178100ab0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.831+0000 7fa17d5ff700 1 -- 172.21.15.59:0/1836342931 >> 172.21.15.59:0/1836342931 conn(0x7fa1780fc140 msgr2=0x7fa1780fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:56.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.831+0000 7fa17d5ff700 1 -- 172.21.15.59:0/1836342931 shutdown_connections 2023-10-08T12:42:56.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.831+0000 7fa17d5ff700 1 -- 172.21.15.59:0/1836342931 wait complete. 2023-10-08T12:42:56.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.832+0000 7fa17d5ff700 1 Processor -- start 2023-10-08T12:42:56.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.832+0000 7fa17d5ff700 1 -- start start 2023-10-08T12:42:56.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.832+0000 7fa17d5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa178100630 0x7fa17819ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.832+0000 7fa17d5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa178100ff0 0x7fa17819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.832+0000 7fa17d5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa178106640 0x7fa178198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.832+0000 7fa17d5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1781991e0 con 0x7fa178100ff0 2023-10-08T12:42:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.832+0000 7fa17d5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa178199350 con 0x7fa178106640 2023-10-08T12:42:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.832+0000 7fa17d5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa178199510 con 0x7fa178100630 2023-10-08T12:42:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.832+0000 7fa1777fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa178106640 0x7fa178198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.832+0000 7fa1767fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa178100ff0 0x7fa17819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa1767fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa178100ff0 0x7fa17819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36278/0 (socket says 172.21.15.59:36278) 2023-10-08T12:42:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa1777fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa178106640 0x7fa178198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:59948/0 (socket says 172.21.15.59:59948) 2023-10-08T12:42:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa1767fc700 1 -- 172.21.15.59:0/3070463690 learned_addr learned my addr 172.21.15.59:0/3070463690 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa176ffd700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa178100630 0x7fa17819ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa1767fc700 1 -- 172.21.15.59:0/3070463690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa178100630 msgr2=0x7fa17819ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa1767fc700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa178100630 0x7fa17819ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa1767fc700 1 -- 172.21.15.59:0/3070463690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa178106640 msgr2=0x7fa178198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa1767fc700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa178106640 0x7fa178198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa1767fc700 1 -- 172.21.15.59:0/3070463690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c0095f0 con 0x7fa178100ff0 2023-10-08T12:42:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa1767fc700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa178100ff0 0x7fa17819ef40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa16c000c00 tx=0x7fa16c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa15ffff700 1 -- 172.21.15.59:0/3070463690 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c01d070 con 0x7fa178100ff0 2023-10-08T12:42:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa15ffff700 1 -- 172.21.15.59:0/3070463690 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa16c022470 con 0x7fa178100ff0 2023-10-08T12:42:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa15ffff700 1 -- 172.21.15.59:0/3070463690 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c017650 con 0x7fa178100ff0 2023-10-08T12:42:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.833+0000 7fa17d5ff700 1 -- 172.21.15.59:0/3070463690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa178199790 con 0x7fa178100ff0 2023-10-08T12:42:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.834+0000 7fa17d5ff700 1 -- 172.21.15.59:0/3070463690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1781a59f0 con 0x7fa178100ff0 2023-10-08T12:42:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.835+0000 7fa17d5ff700 1 -- 172.21.15.59:0/3070463690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa178101d70 con 0x7fa178100ff0 2023-10-08T12:42:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.837+0000 7fa15ffff700 1 -- 172.21.15.59:0/3070463690 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa16c0225e0 con 0x7fa178100ff0 2023-10-08T12:42:56.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.838+0000 7fa15ffff700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1600a1670 0x7fa1600a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:56.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.838+0000 7fa15ffff700 1 -- 172.21.15.59:0/3070463690 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa16c0ceab0 con 0x7fa178100ff0 2023-10-08T12:42:56.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.838+0000 7fa176ffd700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1600a1670 0x7fa1600a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:56.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.839+0000 7fa176ffd700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1600a1670 0x7fa1600a3b30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa168007b60 tx=0x7fa1680073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:56.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:56.841+0000 7fa15ffff700 1 -- 172.21.15.59:0/3070463690 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa16c097e80 con 0x7fa178100ff0 2023-10-08T12:42:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.131+0000 7fa17d5ff700 1 -- 172.21.15.59:0/3070463690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa178067450 con 0x7fa178100ff0 2023-10-08T12:42:57.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.131+0000 7fa15ffff700 1 -- 172.21.15.59:0/3070463690 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fa16c09b4a0 con 0x7fa178100ff0 2023-10-08T12:42:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:42:57.133 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:42:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 -- 172.21.15.59:0/3070463690 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1600a1670 msgr2=0x7fa1600a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1600a1670 0x7fa1600a3b30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa168007b60 tx=0x7fa1680073d0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 -- 172.21.15.59:0/3070463690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa178100ff0 msgr2=0x7fa17819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa178100ff0 0x7fa17819ef40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa16c000c00 tx=0x7fa16c005740 comp rx=0 tx=0).stop 2023-10-08T12:42:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 -- 172.21.15.59:0/3070463690 shutdown_connections 2023-10-08T12:42:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1600a1670 0x7fa1600a3b30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa178106640 0x7fa178198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa178100630 0x7fa17819ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 --2- 172.21.15.59:0/3070463690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa178100ff0 0x7fa17819ef40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 -- 172.21.15.59:0/3070463690 >> 172.21.15.59:0/3070463690 conn(0x7fa1780fc140 msgr2=0x7fa1780fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 -- 172.21.15.59:0/3070463690 shutdown_connections 2023-10-08T12:42:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.134+0000 7fa17d5ff700 1 -- 172.21.15.59:0/3070463690 wait complete. 2023-10-08T12:42:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:42:57.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:42:57.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.384+0000 7f2153bff700 1 -- 172.21.15.59:0/2799753925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f214c105630 msgr2=0x7f214c105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:57.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.384+0000 7f2153bff700 1 --2- 172.21.15.59:0/2799753925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f214c105630 0x7f214c105a10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2148009990 tx=0x7f2148009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.384+0000 7f2153bff700 1 -- 172.21.15.59:0/2799753925 shutdown_connections 2023-10-08T12:42:57.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.384+0000 7f2153bff700 1 --2- 172.21.15.59:0/2799753925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c0ffff0 0x7f214c10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.384+0000 7f2153bff700 1 --2- 172.21.15.59:0/2799753925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f214c105630 0x7f214c105a10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.384+0000 7f2153bff700 1 --2- 172.21.15.59:0/2799753925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f214c0ff630 0x7f214c0ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.384+0000 7f2153bff700 1 -- 172.21.15.59:0/2799753925 >> 172.21.15.59:0/2799753925 conn(0x7f214c076790 msgr2=0x7f214c076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:57.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.384+0000 7f2153bff700 1 -- 172.21.15.59:0/2799753925 shutdown_connections 2023-10-08T12:42:57.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.384+0000 7f2153bff700 1 -- 172.21.15.59:0/2799753925 wait complete. 2023-10-08T12:42:57.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.385+0000 7f2153bff700 1 Processor -- start 2023-10-08T12:42:57.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.385+0000 7f2153bff700 1 -- start start 2023-10-08T12:42:57.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f2153bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f214c0ff630 0x7f214c198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f2153bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c0ffff0 0x7f214c199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f2153bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f214c105630 0x7f214c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f2153bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c19dd10 con 0x7f214c0ff630 2023-10-08T12:42:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f2153bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c19de80 con 0x7f214c0ffff0 2023-10-08T12:42:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f2153bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c19e040 con 0x7f214c105630 2023-10-08T12:42:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f215199b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f214c0ff630 0x7f214c198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f215219c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f214c105630 0x7f214c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f215219c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f214c105630 0x7f214c19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44086/0 (socket says 172.21.15.59:44086) 2023-10-08T12:42:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f215219c700 1 -- 172.21.15.59:0/2742758910 learned_addr learned my addr 172.21.15.59:0/2742758910 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f215119a700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c0ffff0 0x7f214c199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f215219c700 1 -- 172.21.15.59:0/2742758910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c0ffff0 msgr2=0x7f214c199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.386+0000 7f215219c700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c0ffff0 0x7f214c199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.387+0000 7f215219c700 1 -- 172.21.15.59:0/2742758910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f214c0ff630 msgr2=0x7f214c198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.387+0000 7f215219c700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f214c0ff630 0x7f214c198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.387+0000 7f215219c700 1 -- 172.21.15.59:0/2742758910 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480095f0 con 0x7f214c105630 2023-10-08T12:42:57.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.387+0000 7f215219c700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f214c105630 0x7f214c19d6d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f214400ef30 tx=0x7f214400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.387+0000 7f2142ffd700 1 -- 172.21.15.59:0/2742758910 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144018070 con 0x7f214c105630 2023-10-08T12:42:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.387+0000 7f2142ffd700 1 -- 172.21.15.59:0/2742758910 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f214400f040 con 0x7f214c105630 2023-10-08T12:42:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.387+0000 7f2153bff700 1 -- 172.21.15.59:0/2742758910 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c19e2c0 con 0x7f214c105630 2023-10-08T12:42:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.387+0000 7f2142ffd700 1 -- 172.21.15.59:0/2742758910 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400cd00 con 0x7f214c105630 2023-10-08T12:42:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.387+0000 7f2153bff700 1 -- 172.21.15.59:0/2742758910 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c1a5b60 con 0x7f214c105630 2023-10-08T12:42:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.390+0000 7f2142ffd700 1 -- 172.21.15.59:0/2742758910 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2144003a00 con 0x7f214c105630 2023-10-08T12:42:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.392+0000 7f2142ffd700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f21380a1670 0x7f21380a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.392+0000 7f2167458b80 1 Processor -- start 2023-10-08T12:42:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.392+0000 7f2142ffd700 1 -- 172.21.15.59:0/2742758910 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f21440ccb70 con 0x7f214c105630 2023-10-08T12:42:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.393+0000 7f215199b700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f21380a1670 0x7f21380a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.393+0000 7f2167458b80 1 -- start start 2023-10-08T12:42:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.393+0000 7f215199b700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f21380a1670 0x7f21380a3b30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f214800b2e0 tx=0x7f2148005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.393+0000 7f2167458b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3690 0x55baae9f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.393+0000 7f2167458b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baae9fe920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.393+0000 7f2167458b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baaea01250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.393+0000 7f2167458b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baae954460 con 0x55baae9f3690 2023-10-08T12:42:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.393+0000 7f2167458b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baae945c20 con 0x55baae9f3fb0 2023-10-08T12:42:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.393+0000 7f2167458b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baae943540 con 0x55baae9fee60 2023-10-08T12:42:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215199b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3690 0x55baae9f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215119a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baae9fe920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215219c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baaea01250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215119a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baae9fe920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:59966/0 (socket says 172.21.15.59:59966) 2023-10-08T12:42:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215119a700 1 -- 172.21.15.59:0/1435630767 learned_addr learned my addr 172.21.15.59:0/1435630767 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215199b700 1 --2- 172.21.15.59:0/1435630767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3690 0x55baae9f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36308/0 (socket says 172.21.15.59:36308) 2023-10-08T12:42:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215219c700 1 -- 172.21.15.59:0/1435630767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 msgr2=0x55baae9fe920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215219c700 1 --2- 172.21.15.59:0/1435630767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baae9fe920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215219c700 1 -- 172.21.15.59:0/1435630767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3690 msgr2=0x55baae9f3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215219c700 1 --2- 172.21.15.59:0/1435630767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3690 0x55baae9f3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215219c700 1 -- 172.21.15.59:0/1435630767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baae769de0 con 0x55baae9fee60 2023-10-08T12:42:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f215219c700 1 --2- 172.21.15.59:0/1435630767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baaea01250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f21440ca2b0 tx=0x7f21440997c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fb87186cd69aaaf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f2137fff700 1 -- 172.21.15.59:0/1435630767 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144004ad0 con 0x55baae9fee60 2023-10-08T12:42:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f2137fff700 1 -- 172.21.15.59:0/1435630767 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f214401b320 con 0x55baae9fee60 2023-10-08T12:42:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.394+0000 7f2137fff700 1 -- 172.21.15.59:0/1435630767 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144096310 con 0x55baae9fee60 2023-10-08T12:42:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.395+0000 7f2167458b80 1 -- 172.21.15.59:0/1435630767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 msgr2=0x55baaea01250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.395+0000 7f2167458b80 1 --2- 172.21.15.59:0/1435630767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baaea01250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f21440ca2b0 tx=0x7f21440997c0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.395+0000 7f2167458b80 1 -- 172.21.15.59:0/1435630767 shutdown_connections 2023-10-08T12:42:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.395+0000 7f2167458b80 1 --2- 172.21.15.59:0/1435630767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baaea01250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.395+0000 7f2167458b80 1 --2- 172.21.15.59:0/1435630767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3690 0x55baae9f3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.395+0000 7f2167458b80 1 --2- 172.21.15.59:0/1435630767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baae9fe920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.395+0000 7f2167458b80 1 -- 172.21.15.59:0/1435630767 >> 172.21.15.59:0/1435630767 conn(0x55baae960260 msgr2=0x55baae9e72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.395+0000 7f2167458b80 1 -- 172.21.15.59:0/1435630767 shutdown_connections 2023-10-08T12:42:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.396+0000 7f2167458b80 1 -- 172.21.15.59:0/1435630767 wait complete. 2023-10-08T12:42:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.396+0000 7f2167458b80 1 -- start start 2023-10-08T12:42:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.396+0000 7f2167458b80 1 Processor -- start 2023-10-08T12:42:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f2167458b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3690 0x55baae9fbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f2167458b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baae9fc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f2167458b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baae9fc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f2167458b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baae93ee30 con 0x55baae9f3690 2023-10-08T12:42:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f2167458b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baae8db710 con 0x55baae9f3fb0 2023-10-08T12:42:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f2167458b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baae8db3b0 con 0x55baae9fee60 2023-10-08T12:42:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f2167458b80 10 client.0 _ll_register_callbacks cb 0x55baae738800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f215119a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baae9fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f215119a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baae9fc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:59970/0 (socket says 172.21.15.59:59970) 2023-10-08T12:42:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f215119a700 1 -- 172.21.15.59:0/1756779026 learned_addr learned my addr 172.21.15.59:0/1756779026 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f215199b700 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3690 0x55baae9fbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.397+0000 7f215219c700 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baae9fc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.398+0000 7f215119a700 1 -- 172.21.15.59:0/1756779026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 msgr2=0x55baae9fc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.398+0000 7f215119a700 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baae9fc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.398+0000 7f215119a700 1 -- 172.21.15.59:0/1756779026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3690 msgr2=0x55baae9fbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.398+0000 7f215119a700 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3690 0x55baae9fbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.398+0000 7f215119a700 1 -- 172.21.15.59:0/1756779026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c1a5b60 con 0x55baae9f3fb0 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.398+0000 7f215119a700 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baae9fc110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f213c012840 tx=0x7f213c012b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b45e93ac08ea79ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.398+0000 7f21357fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.398+0000 7f21357fa700 1 -- 172.21.15.59:0/1756779026 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c017070 con 0x55baae9f3fb0 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.398+0000 7f21357fa700 1 -- 172.21.15.59:0/1756779026 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f213c004050 con 0x55baae9f3fb0 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.399+0000 7f2167458b80 1 -- 172.21.15.59:0/1756779026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55baae906eb0 con 0x55baae9f3fb0 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.399+0000 7f21357fa700 1 -- 172.21.15.59:0/1756779026 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f213c004250 con 0x55baae9f3fb0 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.399+0000 7f2167458b80 10 client.25622 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.399+0000 7f2167458b80 1 -- 172.21.15.59:0/1756779026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55baae752c60 con 0x55baae9f3fb0 2023-10-08T12:42:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.399+0000 7f21357fa700 1 -- 172.21.15.59:0/1756779026 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55baae906eb0 con 0x55baae9f3fb0 2023-10-08T12:42:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.400+0000 7f21357fa700 1 -- 172.21.15.59:0/1756779026 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f213c00f5d0 con 0x55baae9f3fb0 2023-10-08T12:42:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.400+0000 7f2167458b80 10 client.25622 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.400+0000 7f2167458b80 10 client.25622 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.400+0000 7f2167458b80 20 client.25622 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.400+0000 7f2167458b80 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55baaea0ea50 0x55baaea10e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.400+0000 7f2167458b80 4 client.25622 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.400+0000 7f2167458b80 1 -- 172.21.15.59:0/1756779026 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55baae937e10 con 0x55baaea0ea50 2023-10-08T12:42:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.400+0000 7f215199b700 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55baaea0ea50 0x55baaea10e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.400+0000 7f21357fa700 10 client.25622 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.400+0000 7f215199b700 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55baaea0ea50 0x55baaea10e70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d999b8b2901c607 server_cookie=467ffd09df7c5028 in_seq=0 out_seq=0 2023-10-08T12:42:57.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.401+0000 7f21357fa700 1 -- 172.21.15.59:0/1756779026 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55baae937e10 con 0x55baaea0ea50 2023-10-08T12:42:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.401+0000 7f21357fa700 10 client.25622 handle_command_reply: tid=0 2023-10-08T12:42:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.401+0000 7f2167458b80 1 client.25622 shutdown 2023-10-08T12:42:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.401+0000 7f2167458b80 1 -- 172.21.15.59:0/1756779026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 msgr2=0x55baae9fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.401+0000 7f2167458b80 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baae9fc110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f213c012840 tx=0x7f213c012b50 comp rx=0 tx=0).stop 2023-10-08T12:42:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.401+0000 7f2167458b80 1 -- 172.21.15.59:0/1756779026 shutdown_connections 2023-10-08T12:42:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.401+0000 7f2167458b80 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55baaea0ea50 0x55baaea10e70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.402+0000 7f2167458b80 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baae9fc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.402+0000 7f2167458b80 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3690 0x55baae9fbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.402+0000 7f2167458b80 1 --2- 172.21.15.59:0/1756779026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baae9fc110 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.402+0000 7f21357fa700 0 client.25622 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.402+0000 7f2167458b80 1 -- 172.21.15.59:0/1756779026 >> 172.21.15.59:0/1756779026 conn(0x55baae960260 msgr2=0x55baae9e6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.402+0000 7f2167458b80 1 -- 172.21.15.59:0/1756779026 shutdown_connections 2023-10-08T12:42:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.402+0000 7f2167458b80 1 -- 172.21.15.59:0/1756779026 wait complete. 2023-10-08T12:42:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.402+0000 7f2167458b80 20 client.25622 trim_cache size 0 max 16384 2023-10-08T12:42:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.416+0000 7f2167458b80 1 Processor -- start 2023-10-08T12:42:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f2167458b80 1 -- start start 2023-10-08T12:42:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f2167458b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9f3690 0x55baae9f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f2167458b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baaea059b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f2167458b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9fee60 0x55baae9f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f2167458b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baae7bf920 con 0x55baae9fee60 2023-10-08T12:42:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f2167458b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baae9fd240 con 0x55baae9f3fb0 2023-10-08T12:42:57.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f2167458b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baae9f48e0 con 0x55baae9f3690 2023-10-08T12:42:57.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f215119a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baaea059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f215119a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baaea059b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:59986/0 (socket says 172.21.15.59:59986) 2023-10-08T12:42:57.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f215119a700 1 -- 172.21.15.59:0/1776741413 learned_addr learned my addr 172.21.15.59:0/1776741413 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:57.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f215199b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9f3690 0x55baae9f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.417+0000 7f215219c700 1 --2- 172.21.15.59:0/1776741413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9fee60 0x55baae9f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.418+0000 7f215119a700 1 -- 172.21.15.59:0/1776741413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9f3690 msgr2=0x55baae9f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:57.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.418+0000 7f215119a700 1 --2- 172.21.15.59:0/1776741413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9f3690 0x55baae9f65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.418+0000 7f215119a700 1 -- 172.21.15.59:0/1776741413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9fee60 msgr2=0x55baae9f6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.418+0000 7f215119a700 1 --2- 172.21.15.59:0/1776741413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9fee60 0x55baae9f6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.418+0000 7f215119a700 1 -- 172.21.15.59:0/1776741413 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baae790250 con 0x55baae9f3fb0 2023-10-08T12:42:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.418+0000 7f215199b700 1 --2- 172.21.15.59:0/1776741413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9f3690 0x55baae9f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.418+0000 7f215119a700 1 --2- 172.21.15.59:0/1776741413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baaea059b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f213c012810 tx=0x7f213c009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51459a861c3296b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.418+0000 7f2140bff700 1 -- 172.21.15.59:0/1776741413 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c012ea0 con 0x55baae9f3fb0 2023-10-08T12:42:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.418+0000 7f2140bff700 1 -- 172.21.15.59:0/1776741413 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f213c02c070 con 0x55baae9f3fb0 2023-10-08T12:42:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.418+0000 7f2140bff700 1 -- 172.21.15.59:0/1776741413 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c017040 con 0x55baae9f3fb0 2023-10-08T12:42:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.419+0000 7f2167458b80 1 -- 172.21.15.59:0/1776741413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 msgr2=0x55baaea059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.419+0000 7f2167458b80 1 --2- 172.21.15.59:0/1776741413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baaea059b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f213c012810 tx=0x7f213c009750 comp rx=0 tx=0).stop 2023-10-08T12:42:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.419+0000 7f2167458b80 1 -- 172.21.15.59:0/1776741413 shutdown_connections 2023-10-08T12:42:57.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.419+0000 7f2167458b80 1 --2- 172.21.15.59:0/1776741413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9fee60 0x55baae9f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.419+0000 7f2167458b80 1 --2- 172.21.15.59:0/1776741413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9f3690 0x55baae9f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.419+0000 7f2167458b80 1 --2- 172.21.15.59:0/1776741413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3fb0 0x55baaea059b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.419+0000 7f2167458b80 1 -- 172.21.15.59:0/1776741413 >> 172.21.15.59:0/1776741413 conn(0x55baae960260 msgr2=0x55baae9e2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:57.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.419+0000 7f2167458b80 1 -- 172.21.15.59:0/1776741413 shutdown_connections 2023-10-08T12:42:57.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.420+0000 7f2167458b80 1 -- 172.21.15.59:0/1776741413 wait complete. 2023-10-08T12:42:57.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.420+0000 7f2167458b80 1 -- start start 2023-10-08T12:42:57.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.421+0000 7f2167458b80 1 Processor -- start 2023-10-08T12:42:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.421+0000 7f2167458b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3690 0x55baaea054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.421+0000 7f2167458b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3fb0 0x55baaea039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.421+0000 7f2167458b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baaea03ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.421+0000 7f2167458b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baaea05da0 con 0x55baae9f3fb0 2023-10-08T12:42:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.421+0000 7f2167458b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baaea04430 con 0x55baae9f3690 2023-10-08T12:42:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.421+0000 7f2167458b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baaea045f0 con 0x55baae9fee60 2023-10-08T12:42:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.421+0000 7f2167458b80 10 client.0 _ll_register_callbacks cb 0x7f213c009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f215199b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3690 0x55baaea054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f215199b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3690 0x55baaea054c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:59998/0 (socket says 172.21.15.59:59998) 2023-10-08T12:42:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f215199b700 1 -- 172.21.15.59:0/2252918634 learned_addr learned my addr 172.21.15.59:0/2252918634 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f215219c700 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baaea03ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f215119a700 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3fb0 0x55baaea039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f215199b700 1 -- 172.21.15.59:0/2252918634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 msgr2=0x55baaea03ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:57.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f215199b700 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baaea03ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f215199b700 1 -- 172.21.15.59:0/2252918634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3fb0 msgr2=0x55baaea039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:57.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f215199b700 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3fb0 0x55baaea039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f215199b700 1 -- 172.21.15.59:0/2252918634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c068cf0 con 0x55baae9f3690 2023-10-08T12:42:57.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f215199b700 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3690 0x55baaea054c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f21480098e0 tx=0x7f2148009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8d9ed72f383470b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:57.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f21357fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:42:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.422+0000 7f21357fa700 1 -- 172.21.15.59:0/2252918634 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214800bd80 con 0x55baae9f3690 2023-10-08T12:42:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f2167458b80 1 -- 172.21.15.59:0/2252918634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f214401b320 con 0x55baae9f3690 2023-10-08T12:42:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f21357fa700 1 -- 172.21.15.59:0/2252918634 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f21480360b0 con 0x55baae9f3690 2023-10-08T12:42:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f21357fa700 1 -- 172.21.15.59:0/2252918634 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f214800bee0 con 0x55baae9f3690 2023-10-08T12:42:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f2167458b80 10 client.25628 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f2167458b80 1 -- 172.21.15.59:0/2252918634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55baae752c60 con 0x55baae9f3690 2023-10-08T12:42:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f21357fa700 1 -- 172.21.15.59:0/2252918634 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f214401b320 con 0x55baae9f3690 2023-10-08T12:42:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f21357fa700 1 -- 172.21.15.59:0/2252918634 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f214800fc50 con 0x55baae9f3690 2023-10-08T12:42:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f2167458b80 10 client.25628 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f2167458b80 10 client.25628 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f2167458b80 20 client.25628 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f2167458b80 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55baaea63bb0 0x55baaea65fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f2167458b80 4 client.25628 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:42:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.423+0000 7f2167458b80 1 -- 172.21.15.59:0/2252918634 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55baae937b30 con 0x55baaea63bb0 2023-10-08T12:42:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.424+0000 7f215119a700 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55baaea63bb0 0x55baaea65fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.424+0000 7f215119a700 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55baaea63bb0 0x55baaea65fd0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66243c4e91574b35 server_cookie=e8fee0b0c6ab05a6 in_seq=0 out_seq=0 2023-10-08T12:42:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.424+0000 7f21357fa700 10 client.25628 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.424+0000 7f21357fa700 1 -- 172.21.15.59:0/2252918634 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55baae937b30 con 0x55baaea63bb0 2023-10-08T12:42:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.424+0000 7f21357fa700 10 client.25628 handle_command_reply: tid=0 2023-10-08T12:42:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.424+0000 7f2167458b80 1 client.25628 shutdown 2023-10-08T12:42:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.425+0000 7f2167458b80 1 -- 172.21.15.59:0/2252918634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3690 msgr2=0x55baaea054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.425+0000 7f2167458b80 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3690 0x55baaea054c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f21480098e0 tx=0x7f2148009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.425+0000 7f2167458b80 1 -- 172.21.15.59:0/2252918634 shutdown_connections 2023-10-08T12:42:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.425+0000 7f2167458b80 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55baaea63bb0 0x55baaea65fd0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.425+0000 7f2167458b80 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55baae9f3690 0x55baaea054c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.425+0000 7f2167458b80 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55baae9fee60 0x55baaea03ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.425+0000 7f2167458b80 1 --2- 172.21.15.59:0/2252918634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baae9f3fb0 0x55baaea039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.425+0000 7f2167458b80 1 -- 172.21.15.59:0/2252918634 >> 172.21.15.59:0/2252918634 conn(0x55baae960260 msgr2=0x55baae9f6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.425+0000 7f21357fa700 0 client.25628 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.425+0000 7f2167458b80 1 -- 172.21.15.59:0/2252918634 shutdown_connections 2023-10-08T12:42:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.425+0000 7f2167458b80 1 -- 172.21.15.59:0/2252918634 wait complete. 2023-10-08T12:42:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2167458b80 20 client.25628 trim_cache size 0 max 16384 2023-10-08T12:42:57.431 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:42:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 -- 172.21.15.59:0/2742758910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f21380a1670 msgr2=0x7f21380a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f21380a1670 0x7f21380a3b30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f214800b2e0 tx=0x7f2148005fd0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 -- 172.21.15.59:0/2742758910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f214c105630 msgr2=0x7f214c19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f214c105630 0x7f214c19d6d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f214400ef30 tx=0x7f214400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 -- 172.21.15.59:0/2742758910 shutdown_connections 2023-10-08T12:42:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f21380a1670 0x7f21380a3b30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f214c105630 0x7f214c19d6d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f214c0ff630 0x7f214c198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 --2- 172.21.15.59:0/2742758910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f214c0ffff0 0x7f214c199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 -- 172.21.15.59:0/2742758910 >> 172.21.15.59:0/2742758910 conn(0x7f214c076790 msgr2=0x7f214c101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 -- 172.21.15.59:0/2742758910 shutdown_connections 2023-10-08T12:42:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:57.426+0000 7f2153bff700 1 -- 172.21.15.59:0/2742758910 wait complete. 2023-10-08T12:42:57.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 81628 16.40 MB/sec warmup 28 sec latency 274.239 ms 2023-10-08T12:42:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:57 smithi173 ceph-mon[135182]: pgmap v367: 97 pgs: 97 active+clean; 36 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.7 MiB/s wr, 219 op/s 2023-10-08T12:42:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:57 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3070463690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:42:58.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:57 smithi059 ceph-mon[98489]: pgmap v367: 97 pgs: 97 active+clean; 36 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.7 MiB/s wr, 219 op/s 2023-10-08T12:42:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:57 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3070463690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:42:58.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:57 smithi092 ceph-mon[134093]: pgmap v367: 97 pgs: 97 active+clean; 36 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.7 MiB/s wr, 219 op/s 2023-10-08T12:42:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:57 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3070463690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:42:58.447 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:42:58.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:42:58.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 84244 16.17 MB/sec warmup 29 sec latency 18.389 ms 2023-10-08T12:42:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.661+0000 7f2c09fff700 1 -- 172.21.15.59:0/3561192911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c04100150 msgr2=0x7f2c04100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.661+0000 7f2c09fff700 1 --2- 172.21.15.59:0/3561192911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c04100150 0x7f2c04100530 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009990 tx=0x7f2bf4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.661+0000 7f2c09fff700 1 -- 172.21.15.59:0/3561192911 shutdown_connections 2023-10-08T12:42:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.661+0000 7f2c09fff700 1 --2- 172.21.15.59:0/3561192911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c0410d190 0x7f2c0410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.661+0000 7f2c09fff700 1 --2- 172.21.15.59:0/3561192911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c04100150 0x7f2c04100530 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.661+0000 7f2c09fff700 1 --2- 172.21.15.59:0/3561192911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c04100a70 0x7f2c0410cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.661+0000 7f2c09fff700 1 -- 172.21.15.59:0/3561192911 >> 172.21.15.59:0/3561192911 conn(0x7f2c04076780 msgr2=0x7f2c04076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.661+0000 7f2c09fff700 1 -- 172.21.15.59:0/3561192911 shutdown_connections 2023-10-08T12:42:58.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.662+0000 7f2c09fff700 1 -- 172.21.15.59:0/3561192911 wait complete. 2023-10-08T12:42:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.663+0000 7f2c09fff700 1 Processor -- start 2023-10-08T12:42:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.663+0000 7f2c09fff700 1 -- start start 2023-10-08T12:42:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c09fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c04100150 0x7f2c04198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c09fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c04100a70 0x7f2c04199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c09fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c0410d190 0x7f2c0419d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c09fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0419dde0 con 0x7f2c0410d190 2023-10-08T12:42:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c09fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0419df50 con 0x7f2c04100a70 2023-10-08T12:42:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c09fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0419e110 con 0x7f2c04100150 2023-10-08T12:42:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c037fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c04100150 0x7f2c04198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c02ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c04100a70 0x7f2c04199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c037fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c04100150 0x7f2c04198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44148/0 (socket says 172.21.15.59:44148) 2023-10-08T12:42:58.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c02ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c04100a70 0x7f2c04199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60014/0 (socket says 172.21.15.59:60014) 2023-10-08T12:42:58.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c037fe700 1 -- 172.21.15.59:0/1771970650 learned_addr learned my addr 172.21.15.59:0/1771970650 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:58.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c03fff700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c0410d190 0x7f2c0419d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c037fe700 1 -- 172.21.15.59:0/1771970650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c04100a70 msgr2=0x7f2c04199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c037fe700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c04100a70 0x7f2c04199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c037fe700 1 -- 172.21.15.59:0/1771970650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c0410d190 msgr2=0x7f2c0419d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c037fe700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c0410d190 0x7f2c0419d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c037fe700 1 -- 172.21.15.59:0/1771970650 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc009c40 con 0x7f2c04100150 2023-10-08T12:42:58.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.664+0000 7f2c02ffd700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c04100a70 0x7f2c04199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:58.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.665+0000 7f2c037fe700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c04100150 0x7f2c04198ec0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4000c00 tx=0x7f2bf4005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.665+0000 7f2c00ff9700 1 -- 172.21.15.59:0/1771970650 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf401d070 con 0x7f2c04100150 2023-10-08T12:42:58.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.665+0000 7f2c09fff700 1 -- 172.21.15.59:0/1771970650 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf40095f0 con 0x7f2c04100150 2023-10-08T12:42:58.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.665+0000 7f2c00ff9700 1 -- 172.21.15.59:0/1771970650 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2bf4022470 con 0x7f2c04100150 2023-10-08T12:42:58.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.665+0000 7f2c00ff9700 1 -- 172.21.15.59:0/1771970650 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4017650 con 0x7f2c04100150 2023-10-08T12:42:58.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.665+0000 7f2c09fff700 1 -- 172.21.15.59:0/1771970650 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c041a5a50 con 0x7f2c04100150 2023-10-08T12:42:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.670+0000 7f2c00ff9700 1 -- 172.21.15.59:0/1771970650 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2bf40225e0 con 0x7f2c04100150 2023-10-08T12:42:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.671+0000 7f2c1d85cb80 1 Processor -- start 2023-10-08T12:42:58.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.671+0000 7f2c1d85cb80 1 -- start start 2023-10-08T12:42:58.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.671+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 0x5556ead612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.671+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead61820 0x5556ead6c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.671+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead6c6d0 0x5556ead6eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.671+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556eacca4e0 con 0x5556ead61820 2023-10-08T12:42:58.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.671+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556eacbbca0 con 0x5556ead6c6d0 2023-10-08T12:42:58.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.671+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556eacb95c0 con 0x5556ead60f00 2023-10-08T12:42:58.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c02ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead6c6d0 0x5556ead6eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c03fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 0x5556ead612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c03fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 0x5556ead612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44154/0 (socket says 172.21.15.59:44154) 2023-10-08T12:42:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c03fff700 1 -- 172.21.15.59:0/3244086087 learned_addr learned my addr 172.21.15.59:0/3244086087 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c037fe700 1 --2- 172.21.15.59:0/3244086087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead61820 0x5556ead6c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c03fff700 1 -- 172.21.15.59:0/3244086087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead6c6d0 msgr2=0x5556ead6eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c03fff700 1 --2- 172.21.15.59:0/3244086087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead6c6d0 0x5556ead6eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c03fff700 1 -- 172.21.15.59:0/3244086087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead61820 msgr2=0x5556ead6c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c03fff700 1 --2- 172.21.15.59:0/3244086087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead61820 0x5556ead6c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c03fff700 1 -- 172.21.15.59:0/3244086087 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556eaadfe60 con 0x5556ead60f00 2023-10-08T12:42:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c02ffd700 1 --2- 172.21.15.59:0/3244086087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead6c6d0 0x5556ead6eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:58.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.672+0000 7f2c03fff700 1 --2- 172.21.15.59:0/3244086087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 0x5556ead612e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00e6f0 tx=0x7f2bfc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c27a2f6abdb47ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.673+0000 7f2c00ff9700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2bec0a1670 0x7f2bec0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.673+0000 7f2be9ffb700 1 -- 172.21.15.59:0/3244086087 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00e040 con 0x5556ead60f00 2023-10-08T12:42:58.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.673+0000 7f2be9ffb700 1 -- 172.21.15.59:0/3244086087 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2bfc00f040 con 0x5556ead60f00 2023-10-08T12:42:58.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.673+0000 7f2be9ffb700 1 -- 172.21.15.59:0/3244086087 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc004790 con 0x5556ead60f00 2023-10-08T12:42:58.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.673+0000 7f2c00ff9700 1 -- 172.21.15.59:0/1771970650 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2bf40ce2d0 con 0x7f2c04100150 2023-10-08T12:42:58.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.673+0000 7f2c037fe700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2bec0a1670 0x7f2bec0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.673+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3244086087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 msgr2=0x5556ead612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.673+0000 7f2c037fe700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2bec0a1670 0x7f2bec0a3b30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4097dd0 tx=0x7f2bf4097040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.673+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/3244086087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 0x5556ead612e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00e6f0 tx=0x7f2bfc009920 comp rx=0 tx=0).stop 2023-10-08T12:42:58.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.674+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3244086087 shutdown_connections 2023-10-08T12:42:58.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.674+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/3244086087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead6c6d0 0x5556ead6eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.674+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/3244086087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 0x5556ead612e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.674+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/3244086087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead61820 0x5556ead6c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.674+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3244086087 >> 172.21.15.59:0/3244086087 conn(0x5556eacd62e0 msgr2=0x5556ead5d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.674+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3244086087 shutdown_connections 2023-10-08T12:42:58.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.674+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3244086087 wait complete. 2023-10-08T12:42:58.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.674+0000 7f2c1d85cb80 1 -- start start 2023-10-08T12:42:58.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.674+0000 7f2c1d85cb80 1 Processor -- start 2023-10-08T12:42:58.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead6c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556ead692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead6c6d0 0x5556ead69880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556eacb4eb0 con 0x5556ead60f00 2023-10-08T12:42:58.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556eac51790 con 0x5556ead61820 2023-10-08T12:42:58.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556eac51430 con 0x5556ead6c6d0 2023-10-08T12:42:58.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c1d85cb80 10 client.0 _ll_register_callbacks cb 0x5556eaaae880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:58.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c03fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead6c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c02ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556ead692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c03fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead6c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36370/0 (socket says 172.21.15.59:36370) 2023-10-08T12:42:58.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c03fff700 1 -- 172.21.15.59:0/3092390141 learned_addr learned my addr 172.21.15.59:0/3092390141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:58.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c02ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556ead692e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60042/0 (socket says 172.21.15.59:60042) 2023-10-08T12:42:58.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.675+0000 7f2c03fff700 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead6c6d0 0x5556ead69880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2c02ffd700 1 -- 172.21.15.59:0/3092390141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead6c6d0 msgr2=0x5556ead69880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2c02ffd700 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead6c6d0 0x5556ead69880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2c02ffd700 1 -- 172.21.15.59:0/3092390141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 msgr2=0x5556ead6c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2c02ffd700 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead6c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2c02ffd700 1 -- 172.21.15.59:0/3092390141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf8009c90 con 0x5556ead61820 2023-10-08T12:42:58.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2c03fff700 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead6c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:58.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2c02ffd700 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556ead692e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c0419a410 tx=0x7f2bf800f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f14e6358dd830c62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2be2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:42:58.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2be2ffd700 1 -- 172.21.15.59:0/3092390141 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8016070 con 0x5556ead61820 2023-10-08T12:42:58.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3092390141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5556eac7cf30 con 0x5556ead61820 2023-10-08T12:42:58.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2be2ffd700 1 -- 172.21.15.59:0/3092390141 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2bf8004030 con 0x5556ead61820 2023-10-08T12:42:58.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2be2ffd700 1 -- 172.21.15.59:0/3092390141 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bf800fea0 con 0x5556ead61820 2023-10-08T12:42:58.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2c1d85cb80 10 client.25640 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:58.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.676+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3092390141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f2bfc00e370 con 0x5556ead61820 2023-10-08T12:42:58.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.677+0000 7f2be2ffd700 1 -- 172.21.15.59:0/3092390141 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2bf8028080 con 0x5556ead61820 2023-10-08T12:42:58.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.677+0000 7f2be2ffd700 1 -- 172.21.15.59:0/3092390141 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2bf80244c0 con 0x5556ead61820 2023-10-08T12:42:58.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.677+0000 7f2c1d85cb80 10 client.25640 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:58.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.677+0000 7f2c1d85cb80 10 client.25640 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:58.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.677+0000 7f2c1d85cb80 20 client.25640 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:58.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.677+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5556ead7c2b0 0x5556ead7e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.677+0000 7f2c1d85cb80 4 client.25640 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:58.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.677+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3092390141 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5556eacade90 con 0x5556ead7c2b0 2023-10-08T12:42:58.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.677+0000 7f2c03fff700 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5556ead7c2b0 0x5556ead7e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.678+0000 7f2be2ffd700 10 client.25640 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:58.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.678+0000 7f2c03fff700 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5556ead7c2b0 0x5556ead7e6d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d432a0bb3ee5914 server_cookie=d12e41d0230fdd2e in_seq=0 out_seq=0 2023-10-08T12:42:58.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2be2ffd700 1 -- 172.21.15.59:0/3092390141 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5556eacade90 con 0x5556ead7c2b0 2023-10-08T12:42:58.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2be2ffd700 10 client.25640 handle_command_reply: tid=0 2023-10-08T12:42:58.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2c1d85cb80 1 client.25640 shutdown 2023-10-08T12:42:58.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3092390141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 msgr2=0x5556ead692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556ead692e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c0419a410 tx=0x7f2bf800f6a0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3092390141 shutdown_connections 2023-10-08T12:42:58.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5556ead7c2b0 0x5556ead7e6d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead6c6d0 0x5556ead69880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead6c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2be2ffd700 0 client.25640 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:58.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/3092390141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556ead692e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3092390141 >> 172.21.15.59:0/3092390141 conn(0x5556eacd62e0 msgr2=0x5556ead5cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.679+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3092390141 shutdown_connections 2023-10-08T12:42:58.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.680+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/3092390141 wait complete. 2023-10-08T12:42:58.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.680+0000 7f2c1d85cb80 20 client.25640 trim_cache size 0 max 16384 2023-10-08T12:42:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.697+0000 7f2c1d85cb80 1 Processor -- start 2023-10-08T12:42:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.697+0000 7f2c1d85cb80 1 -- start start 2023-10-08T12:42:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.698+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead780f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.698+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead61820 0x5556ead73290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.698+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead6c6d0 0x5556ead6bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.698+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556eab359a0 con 0x5556ead60f00 2023-10-08T12:42:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.698+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556ead62150 con 0x5556ead6c6d0 2023-10-08T12:42:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.698+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556ead575f0 con 0x5556ead61820 2023-10-08T12:42:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.698+0000 7f2c03fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.698+0000 7f2c03fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead780f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36372/0 (socket says 172.21.15.59:36372) 2023-10-08T12:42:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.698+0000 7f2c03fff700 1 -- 172.21.15.59:0/1714135749 learned_addr learned my addr 172.21.15.59:0/1714135749 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.698+0000 7f2c02ffd700 1 --2- 172.21.15.59:0/1714135749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead61820 0x5556ead73290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.698+0000 7f2c03fff700 1 --2- 172.21.15.59:0/1714135749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead6c6d0 0x5556ead6bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.699+0000 7f2c03fff700 1 -- 172.21.15.59:0/1714135749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead61820 msgr2=0x5556ead73290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.699+0000 7f2c03fff700 1 --2- 172.21.15.59:0/1714135749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead61820 0x5556ead73290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.699+0000 7f2c03fff700 1 -- 172.21.15.59:0/1714135749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead6c6d0 msgr2=0x5556ead6bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.699+0000 7f2c03fff700 1 --2- 172.21.15.59:0/1714135749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead6c6d0 0x5556ead6bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.699+0000 7f2c03fff700 1 -- 172.21.15.59:0/1714135749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556ead832c0 con 0x5556ead60f00 2023-10-08T12:42:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.699+0000 7f2c02ffd700 1 --2- 172.21.15.59:0/1714135749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead61820 0x5556ead73290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.699+0000 7f2c03fff700 1 --2- 172.21.15.59:0/1714135749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead780f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00e6f0 tx=0x7f2bfc004370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b287c515186b46 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.699+0000 7f2bea7fc700 1 -- 172.21.15.59:0/1714135749 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc02d070 con 0x5556ead60f00 2023-10-08T12:42:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.699+0000 7f2bea7fc700 1 -- 172.21.15.59:0/1714135749 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2bfc025070 con 0x5556ead60f00 2023-10-08T12:42:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.699+0000 7f2bea7fc700 1 -- 172.21.15.59:0/1714135749 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00e040 con 0x5556ead60f00 2023-10-08T12:42:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.700+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/1714135749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 msgr2=0x5556ead780f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.700+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/1714135749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead780f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00e6f0 tx=0x7f2bfc004370 comp rx=0 tx=0).stop 2023-10-08T12:42:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.700+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/1714135749 shutdown_connections 2023-10-08T12:42:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.700+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/1714135749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead6c6d0 0x5556ead6bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.700+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/1714135749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead60f00 0x5556ead780f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.700+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/1714135749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead61820 0x5556ead73290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.700+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/1714135749 >> 172.21.15.59:0/1714135749 conn(0x5556eacd62e0 msgr2=0x5556ead779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.700+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/1714135749 shutdown_connections 2023-10-08T12:42:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.700+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/1714135749 wait complete. 2023-10-08T12:42:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.701+0000 7f2c1d85cb80 1 -- start start 2023-10-08T12:42:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.701+0000 7f2c1d85cb80 1 Processor -- start 2023-10-08T12:42:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.701+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 0x5556eadca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.701+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556eadcab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.701+0000 7f2c1d85cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead6c6d0 0x5556ead723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.701+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556ead72ab0 con 0x5556ead6c6d0 2023-10-08T12:42:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.701+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556ead72c20 con 0x5556ead61820 2023-10-08T12:42:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.701+0000 7f2c1d85cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556ead72de0 con 0x5556ead60f00 2023-10-08T12:42:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.701+0000 7f2c1d85cb80 10 client.0 _ll_register_callbacks cb 0x7f2bf80117e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c02ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556eadcab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c02ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556eadcab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60052/0 (socket says 172.21.15.59:60052) 2023-10-08T12:42:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c02ffd700 1 -- 172.21.15.59:0/2857645969 learned_addr learned my addr 172.21.15.59:0/2857645969 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c03fff700 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 0x5556eadca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c03fff700 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead6c6d0 0x5556ead723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c02ffd700 1 -- 172.21.15.59:0/2857645969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 msgr2=0x5556eadca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c02ffd700 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 0x5556eadca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c02ffd700 1 -- 172.21.15.59:0/2857645969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead6c6d0 msgr2=0x5556ead723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c02ffd700 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead6c6d0 0x5556ead723d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c02ffd700 1 -- 172.21.15.59:0/2857645969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc00e370 con 0x5556ead61820 2023-10-08T12:42:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c02ffd700 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556eadcab00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8000c00 tx=0x7f2bf800fea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb4b74b3a08ad6a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2be2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:42:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2be2ffd700 1 -- 172.21.15.59:0/2857645969 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf802c070 con 0x5556ead61820 2023-10-08T12:42:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/2857645969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2bfc00f040 con 0x5556ead61820 2023-10-08T12:42:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.702+0000 7f2be2ffd700 1 -- 172.21.15.59:0/2857645969 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2bf80050b0 con 0x5556ead61820 2023-10-08T12:42:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2be2ffd700 1 -- 172.21.15.59:0/2857645969 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bf8016040 con 0x5556ead61820 2023-10-08T12:42:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2c1d85cb80 10 client.25646 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/2857645969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5556eaadfe60 con 0x5556ead61820 2023-10-08T12:42:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2be2ffd700 1 -- 172.21.15.59:0/2857645969 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2bfc00f040 con 0x5556ead61820 2023-10-08T12:42:58.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2be2ffd700 1 -- 172.21.15.59:0/2857645969 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2bf8003bf0 con 0x5556ead61820 2023-10-08T12:42:58.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2c1d85cb80 10 client.25646 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:58.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2c1d85cb80 10 client.25646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:58.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2c1d85cb80 20 client.25646 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:58.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5556eadd2500 0x5556eadd4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2c1d85cb80 4 client.25646 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:42:58.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/2857645969 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5556eacadbb0 con 0x5556eadd2500 2023-10-08T12:42:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.703+0000 7f2c03fff700 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5556eadd2500 0x5556eadd4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.704+0000 7f2c03fff700 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5556eadd2500 0x5556eadd4920 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1db46f3feb51857 server_cookie=b1c2c5838d62260a in_seq=0 out_seq=0 2023-10-08T12:42:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.704+0000 7f2be2ffd700 10 client.25646 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:58.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2be2ffd700 1 -- 172.21.15.59:0/2857645969 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5556eacadbb0 con 0x5556eadd2500 2023-10-08T12:42:58.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2be2ffd700 10 client.25646 handle_command_reply: tid=0 2023-10-08T12:42:58.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 1 client.25646 shutdown 2023-10-08T12:42:58.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/2857645969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 msgr2=0x5556eadcab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556eadcab00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8000c00 tx=0x7f2bf800fea0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/2857645969 shutdown_connections 2023-10-08T12:42:58.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5556eadd2500 0x5556eadd4920 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ead6c6d0 0x5556ead723d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556ead60f00 0x5556eadca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2be2ffd700 0 client.25646 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:58.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 1 --2- 172.21.15.59:0/2857645969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556ead61820 0x5556eadcab00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/2857645969 >> 172.21.15.59:0/2857645969 conn(0x5556eacd62e0 msgr2=0x5556ead68030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/2857645969 shutdown_connections 2023-10-08T12:42:58.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 1 -- 172.21.15.59:0/2857645969 wait complete. 2023-10-08T12:42:58.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.706+0000 7f2c1d85cb80 20 client.25646 trim_cache size 0 max 16384 2023-10-08T12:42:58.723 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:42:58.723 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:42:58.723 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "4a9d3637-e9aa-4de0-b6e8-b1419c8fd830", 2023-10-08T12:42:58.723 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:42:58.723 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:42:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 -- 172.21.15.59:0/1771970650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2bec0a1670 msgr2=0x7f2bec0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2bec0a1670 0x7f2bec0a3b30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4097dd0 tx=0x7f2bf4097040 comp rx=0 tx=0).stop 2023-10-08T12:42:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 -- 172.21.15.59:0/1771970650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c04100150 msgr2=0x7f2c04198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c04100150 0x7f2c04198ec0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4000c00 tx=0x7f2bf4005740 comp rx=0 tx=0).stop 2023-10-08T12:42:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 -- 172.21.15.59:0/1771970650 shutdown_connections 2023-10-08T12:42:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2bec0a1670 0x7f2bec0a3b30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c0410d190 0x7f2c0419d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c04100150 0x7f2c04198ec0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 --2- 172.21.15.59:0/1771970650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c04100a70 0x7f2c04199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 -- 172.21.15.59:0/1771970650 >> 172.21.15.59:0/1771970650 conn(0x7f2c04076780 msgr2=0x7f2c0410e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 -- 172.21.15.59:0/1771970650 shutdown_connections 2023-10-08T12:42:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.707+0000 7f2c09fff700 1 -- 172.21.15.59:0/1771970650 wait complete. 2023-10-08T12:42:58.727 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:42:58.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.938+0000 7fb510dff700 1 -- 172.21.15.59:0/2165033913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb50c106750 msgr2=0x7fb50c106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.938+0000 7fb510dff700 1 --2- 172.21.15.59:0/2165033913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb50c106750 0x7fb50c106b30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009990 tx=0x7fb4fc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.938+0000 7fb510dff700 1 -- 172.21.15.59:0/2165033913 shutdown_connections 2023-10-08T12:42:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.938+0000 7fb510dff700 1 --2- 172.21.15.59:0/2165033913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb50c0693c0 0x7fb50c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.938+0000 7fb510dff700 1 --2- 172.21.15.59:0/2165033913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb50c106750 0x7fb50c106b30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.938+0000 7fb510dff700 1 --2- 172.21.15.59:0/2165033913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb50c068a00 0x7fb50c068e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.938+0000 7fb510dff700 1 -- 172.21.15.59:0/2165033913 >> 172.21.15.59:0/2165033913 conn(0x7fb50c076850 msgr2=0x7fb50c076c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.938+0000 7fb510dff700 1 -- 172.21.15.59:0/2165033913 shutdown_connections 2023-10-08T12:42:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.938+0000 7fb510dff700 1 -- 172.21.15.59:0/2165033913 wait complete. 2023-10-08T12:42:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.939+0000 7fb510dff700 1 Processor -- start 2023-10-08T12:42:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.939+0000 7fb510dff700 1 -- start start 2023-10-08T12:42:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.940+0000 7fb510dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb50c068a00 0x7fb50c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.940+0000 7fb510dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb50c0693c0 0x7fb50c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.940+0000 7fb510dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb50c106750 0x7fb50c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.940+0000 7fb510dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c19dcd0 con 0x7fb50c106750 2023-10-08T12:42:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.940+0000 7fb510dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c19de40 con 0x7fb50c0693c0 2023-10-08T12:42:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.940+0000 7fb510dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c19e000 con 0x7fb50c068a00 2023-10-08T12:42:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.940+0000 7fb50a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb50c068a00 0x7fb50c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.940+0000 7fb50a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb50c068a00 0x7fb50c198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44198/0 (socket says 172.21.15.59:44198) 2023-10-08T12:42:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.940+0000 7fb50a59c700 1 -- 172.21.15.59:0/1899079699 learned_addr learned my addr 172.21.15.59:0/1899079699 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.940+0000 7fb503fff700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb50c0693c0 0x7fb50c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.940+0000 7fb50ad9d700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb50c106750 0x7fb50c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb50a59c700 1 -- 172.21.15.59:0/1899079699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb50c0693c0 msgr2=0x7fb50c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb50a59c700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb50c0693c0 0x7fb50c1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb50a59c700 1 -- 172.21.15.59:0/1899079699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb50c106750 msgr2=0x7fb50c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb50a59c700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb50c106750 0x7fb50c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb50a59c700 1 -- 172.21.15.59:0/1899079699 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc0095f0 con 0x7fb50c068a00 2023-10-08T12:42:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb503fff700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb50c0693c0 0x7fb50c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb50a59c700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb50c068a00 0x7fb50c198db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc000c00 tx=0x7fb4fc005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb5037fe700 1 -- 172.21.15.59:0/1899079699 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc01d070 con 0x7fb50c068a00 2023-10-08T12:42:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb5037fe700 1 -- 172.21.15.59:0/1899079699 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4fc022470 con 0x7fb50c068a00 2023-10-08T12:42:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb5037fe700 1 -- 172.21.15.59:0/1899079699 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc017650 con 0x7fb50c068a00 2023-10-08T12:42:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb510dff700 1 -- 172.21.15.59:0/1899079699 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c19e280 con 0x7fb50c068a00 2023-10-08T12:42:58.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.941+0000 7fb510dff700 1 -- 172.21.15.59:0/1899079699 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c1a5b20 con 0x7fb50c068a00 2023-10-08T12:42:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.945+0000 7fb5037fe700 1 -- 172.21.15.59:0/1899079699 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb4fc0225e0 con 0x7fb50c068a00 2023-10-08T12:42:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.946+0000 7fb524739b80 1 Processor -- start 2023-10-08T12:42:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.946+0000 7fb524739b80 1 -- start start 2023-10-08T12:42:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.946+0000 7fb524739b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec037260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb524739b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec0377a0 0x5610ec042110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb524739b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 0x5610ec044a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb524739b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ebfa0460 con 0x5610ec036e80 2023-10-08T12:42:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb524739b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ebf91c20 con 0x5610ec042650 2023-10-08T12:42:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb524739b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ebf8f540 con 0x5610ec0377a0 2023-10-08T12:42:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb50ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec037260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb50ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec037260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36396/0 (socket says 172.21.15.59:36396) 2023-10-08T12:42:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb50ad9d700 1 -- 172.21.15.59:0/3580832506 learned_addr learned my addr 172.21.15.59:0/3580832506 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb50a59c700 1 --2- 172.21.15.59:0/3580832506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec0377a0 0x5610ec042110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb503fff700 1 --2- 172.21.15.59:0/3580832506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 0x5610ec044a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb5037fe700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f80a15f0 0x7fb4f80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb50ad9d700 1 -- 172.21.15.59:0/3580832506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec0377a0 msgr2=0x5610ec042110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb50ad9d700 1 --2- 172.21.15.59:0/3580832506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec0377a0 0x5610ec042110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb50ad9d700 1 -- 172.21.15.59:0/3580832506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 msgr2=0x5610ec044a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb50ad9d700 1 --2- 172.21.15.59:0/3580832506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 0x5610ec044a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb50ad9d700 1 -- 172.21.15.59:0/3580832506 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610ebdb5de0 con 0x5610ec036e80 2023-10-08T12:42:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.947+0000 7fb5037fe700 1 -- 172.21.15.59:0/1899079699 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb4fc0ce310 con 0x7fb50c068a00 2023-10-08T12:42:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.948+0000 7fb50ad9d700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f80a15f0 0x7fb4f80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.948+0000 7fb50ad9d700 1 --2- 172.21.15.59:0/3580832506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec037260 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb504009430 tx=0x7fb504009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897ff6b43a3dc49d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.948+0000 7fb500ff9700 1 -- 172.21.15.59:0/3580832506 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400e070 con 0x5610ec036e80 2023-10-08T12:42:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.948+0000 7fb500ff9700 1 -- 172.21.15.59:0/3580832506 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb50400f040 con 0x5610ec036e80 2023-10-08T12:42:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.948+0000 7fb500ff9700 1 -- 172.21.15.59:0/3580832506 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504014740 con 0x5610ec036e80 2023-10-08T12:42:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.949+0000 7fb524739b80 1 -- 172.21.15.59:0/3580832506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 msgr2=0x5610ec037260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.949+0000 7fb50ad9d700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f80a15f0 0x7fb4f80a3ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb50401e000 tx=0x7fb504021000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.949+0000 7fb524739b80 1 --2- 172.21.15.59:0/3580832506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec037260 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb504009430 tx=0x7fb504009920 comp rx=0 tx=0).stop 2023-10-08T12:42:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.949+0000 7fb524739b80 1 -- 172.21.15.59:0/3580832506 shutdown_connections 2023-10-08T12:42:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.949+0000 7fb524739b80 1 --2- 172.21.15.59:0/3580832506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 0x5610ec044a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.949+0000 7fb524739b80 1 --2- 172.21.15.59:0/3580832506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec037260 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.949+0000 7fb524739b80 1 --2- 172.21.15.59:0/3580832506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec0377a0 0x5610ec042110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.949+0000 7fb524739b80 1 -- 172.21.15.59:0/3580832506 >> 172.21.15.59:0/3580832506 conn(0x5610ebfac260 msgr2=0x5610ec0332d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.949+0000 7fb524739b80 1 -- 172.21.15.59:0/3580832506 shutdown_connections 2023-10-08T12:42:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.949+0000 7fb524739b80 1 -- 172.21.15.59:0/3580832506 wait complete. 2023-10-08T12:42:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.950+0000 7fb524739b80 1 -- start start 2023-10-08T12:42:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.950+0000 7fb524739b80 1 Processor -- start 2023-10-08T12:42:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.950+0000 7fb524739b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec036e80 0x5610ec041fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.950+0000 7fb524739b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec0377a0 0x5610ec03f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.950+0000 7fb524739b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec042650 0x5610ec03f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.950+0000 7fb524739b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ebf8ae30 con 0x5610ec0377a0 2023-10-08T12:42:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.950+0000 7fb524739b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ebf27710 con 0x5610ec036e80 2023-10-08T12:42:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.950+0000 7fb524739b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ebf273b0 con 0x5610ec042650 2023-10-08T12:42:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb524739b80 10 client.0 _ll_register_callbacks cb 0x5610ebd84800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb50a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec036e80 0x5610ec041fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb50a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec036e80 0x5610ec041fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60074/0 (socket says 172.21.15.59:60074) 2023-10-08T12:42:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb50a59c700 1 -- 172.21.15.59:0/3144148037 learned_addr learned my addr 172.21.15.59:0/3144148037 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb50ad9d700 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec042650 0x5610ec03f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb503fff700 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec0377a0 0x5610ec03f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb50a59c700 1 -- 172.21.15.59:0/3144148037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec042650 msgr2=0x5610ec03f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb50a59c700 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec042650 0x5610ec03f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb50a59c700 1 -- 172.21.15.59:0/3144148037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec0377a0 msgr2=0x5610ec03f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb50a59c700 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec0377a0 0x5610ec03f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb50a59c700 1 -- 172.21.15.59:0/3144148037 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb504009110 con 0x5610ec036e80 2023-10-08T12:42:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb50a59c700 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec036e80 0x5610ec041fd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00f740 tx=0x7fb4fc0cbfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95920ab3f7b398ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.951+0000 7fb4f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:42:58.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/3144148037 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0976e0 con 0x5610ec036e80 2023-10-08T12:42:58.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb524739b80 1 -- 172.21.15.59:0/3144148037 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610ebf52eb0 con 0x5610ec036e80 2023-10-08T12:42:58.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/3144148037 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb4fc09baa0 con 0x5610ec036e80 2023-10-08T12:42:58.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/3144148037 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4fc09b170 con 0x5610ec036e80 2023-10-08T12:42:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb524739b80 10 client.25658 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb524739b80 1 -- 172.21.15.59:0/3144148037 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5610ebd9ec60 con 0x5610ec036e80 2023-10-08T12:42:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/3144148037 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5610ebf52eb0 con 0x5610ec036e80 2023-10-08T12:42:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/3144148037 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb4fc09b600 con 0x5610ec036e80 2023-10-08T12:42:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb524739b80 10 client.25658 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb524739b80 10 client.25658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb524739b80 20 client.25658 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb524739b80 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610ec051dc0 0x5610ec0541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb524739b80 4 client.25658 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.952+0000 7fb524739b80 1 -- 172.21.15.59:0/3144148037 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610ebf83e10 con 0x5610ec051dc0 2023-10-08T12:42:58.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.953+0000 7fb503fff700 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610ec051dc0 0x5610ec0541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.953+0000 7fb503fff700 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610ec051dc0 0x5610ec0541b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3927f0f1f60d0d8 server_cookie=d4fe227d1d1f5a19 in_seq=0 out_seq=0 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.953+0000 7fb4f1ffb700 10 client.25658 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.954+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/3144148037 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5610ebf83e10 con 0x5610ec051dc0 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.954+0000 7fb4f1ffb700 10 client.25658 handle_command_reply: tid=0 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.954+0000 7fb524739b80 1 client.25658 shutdown 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb524739b80 1 -- 172.21.15.59:0/3144148037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec036e80 msgr2=0x5610ec041fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb524739b80 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec036e80 0x5610ec041fd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00f740 tx=0x7fb4fc0cbfe0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb524739b80 1 -- 172.21.15.59:0/3144148037 shutdown_connections 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb524739b80 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610ec051dc0 0x5610ec0541b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb524739b80 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec036e80 0x5610ec041fd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb524739b80 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec042650 0x5610ec03f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb524739b80 1 --2- 172.21.15.59:0/3144148037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec0377a0 0x5610ec03f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb4f1ffb700 0 client.25658 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:58.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb524739b80 1 -- 172.21.15.59:0/3144148037 >> 172.21.15.59:0/3144148037 conn(0x5610ebfac260 msgr2=0x5610ec032ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb524739b80 1 -- 172.21.15.59:0/3144148037 shutdown_connections 2023-10-08T12:42:58.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb524739b80 1 -- 172.21.15.59:0/3144148037 wait complete. 2023-10-08T12:42:58.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.955+0000 7fb524739b80 20 client.25658 trim_cache size 0 max 16384 2023-10-08T12:42:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb524739b80 1 Processor -- start 2023-10-08T12:42:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb524739b80 1 -- start start 2023-10-08T12:42:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb524739b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec04d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb524739b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec0377a0 0x5610ec04dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb524739b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 0x5610ec03c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb524739b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ebe0b920 con 0x5610ec036e80 2023-10-08T12:42:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb524739b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ec037f60 con 0x5610ec042650 2023-10-08T12:42:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb524739b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ec034060 con 0x5610ec0377a0 2023-10-08T12:42:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb50a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec04d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb503fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec0377a0 0x5610ec04dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb50ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 0x5610ec03c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb503fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec0377a0 0x5610ec04dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44222/0 (socket says 172.21.15.59:44222) 2023-10-08T12:42:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb50ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 0x5610ec03c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60088/0 (socket says 172.21.15.59:60088) 2023-10-08T12:42:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.973+0000 7fb503fff700 1 -- 172.21.15.59:0/2560200848 learned_addr learned my addr 172.21.15.59:0/2560200848 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.974+0000 7fb50ad9d700 1 -- 172.21.15.59:0/2560200848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec0377a0 msgr2=0x5610ec04dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.974+0000 7fb50ad9d700 1 --2- 172.21.15.59:0/2560200848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec0377a0 0x5610ec04dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.974+0000 7fb50ad9d700 1 -- 172.21.15.59:0/2560200848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 msgr2=0x5610ec04d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.974+0000 7fb50ad9d700 1 --2- 172.21.15.59:0/2560200848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec04d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.974+0000 7fb50ad9d700 1 -- 172.21.15.59:0/2560200848 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610ebddc250 con 0x5610ec042650 2023-10-08T12:42:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.974+0000 7fb50ad9d700 1 --2- 172.21.15.59:0/2560200848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 0x5610ec03c570 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb504017f40 tx=0x7fb504026000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=653fd1486c8c488f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.974+0000 7fb5017fa700 1 -- 172.21.15.59:0/2560200848 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400e040 con 0x5610ec042650 2023-10-08T12:42:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.974+0000 7fb5017fa700 1 -- 172.21.15.59:0/2560200848 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb504012850 con 0x5610ec042650 2023-10-08T12:42:58.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.974+0000 7fb5017fa700 1 -- 172.21.15.59:0/2560200848 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504003c60 con 0x5610ec042650 2023-10-08T12:42:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.975+0000 7fb524739b80 1 -- 172.21.15.59:0/2560200848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 msgr2=0x5610ec03c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.975+0000 7fb524739b80 1 --2- 172.21.15.59:0/2560200848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 0x5610ec03c570 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb504017f40 tx=0x7fb504026000 comp rx=0 tx=0).stop 2023-10-08T12:42:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.975+0000 7fb524739b80 1 -- 172.21.15.59:0/2560200848 shutdown_connections 2023-10-08T12:42:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.975+0000 7fb524739b80 1 --2- 172.21.15.59:0/2560200848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec042650 0x5610ec03c570 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.975+0000 7fb524739b80 1 --2- 172.21.15.59:0/2560200848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec04d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.975+0000 7fb524739b80 1 --2- 172.21.15.59:0/2560200848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec0377a0 0x5610ec04dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.975+0000 7fb524739b80 1 -- 172.21.15.59:0/2560200848 >> 172.21.15.59:0/2560200848 conn(0x5610ebfac260 msgr2=0x5610ec03dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.975+0000 7fb524739b80 1 -- 172.21.15.59:0/2560200848 shutdown_connections 2023-10-08T12:42:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.975+0000 7fb524739b80 1 -- 172.21.15.59:0/2560200848 wait complete. 2023-10-08T12:42:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.975+0000 7fb524739b80 1 -- start start 2023-10-08T12:42:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb524739b80 1 Processor -- start 2023-10-08T12:42:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb524739b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec047a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb524739b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec0377a0 0x5610ec047fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb524739b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec042650 0x5610ec048510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb524739b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ec0a5c10 con 0x5610ec036e80 2023-10-08T12:42:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb524739b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ec0a5d50 con 0x5610ec0377a0 2023-10-08T12:42:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb524739b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ec0a5ec0 con 0x5610ec042650 2023-10-08T12:42:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb524739b80 10 client.0 _ll_register_callbacks cb 0x5610ebd84800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb503fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec0377a0 0x5610ec047fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb50a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec047a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb503fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec0377a0 0x5610ec047fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60104/0 (socket says 172.21.15.59:60104) 2023-10-08T12:42:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb503fff700 1 -- 172.21.15.59:0/1271728466 learned_addr learned my addr 172.21.15.59:0/1271728466 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:42:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.976+0000 7fb50ad9d700 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec042650 0x5610ec048510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.977+0000 7fb503fff700 1 -- 172.21.15.59:0/1271728466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec042650 msgr2=0x5610ec048510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.977+0000 7fb503fff700 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec042650 0x5610ec048510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.977+0000 7fb503fff700 1 -- 172.21.15.59:0/1271728466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 msgr2=0x5610ec047a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.977+0000 7fb503fff700 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec047a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.977+0000 7fb503fff700 1 -- 172.21.15.59:0/1271728466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb504028040 con 0x5610ec0377a0 2023-10-08T12:42:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.977+0000 7fb50a59c700 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec047a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.977+0000 7fb503fff700 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec0377a0 0x5610ec047fd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb50c19a300 tx=0x7fb4f401ff30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb4ac1e644d881f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.977+0000 7fb4f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:42:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.977+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/1271728466 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4016040 con 0x5610ec0377a0 2023-10-08T12:42:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.977+0000 7fb524739b80 1 -- 172.21.15.59:0/1271728466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb50400f040 con 0x5610ec0377a0 2023-10-08T12:42:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.977+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/1271728466 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb4f401f040 con 0x5610ec0377a0 2023-10-08T12:42:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/1271728466 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4f4012e90 con 0x5610ec0377a0 2023-10-08T12:42:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb524739b80 10 client.25664 fetch_fsmap learned FSMap version 20 2023-10-08T12:42:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb524739b80 1 -- 172.21.15.59:0/1271728466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5610ebdb42b0 con 0x5610ec0377a0 2023-10-08T12:42:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/1271728466 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb50400f040 con 0x5610ec0377a0 2023-10-08T12:42:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/1271728466 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb4f4032450 con 0x5610ec0377a0 2023-10-08T12:42:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb524739b80 10 client.25664 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:42:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb524739b80 10 client.25664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb524739b80 20 client.25664 populate_metadata read hostname 'smithi059' 2023-10-08T12:42:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb524739b80 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610ec0a76f0 0x5610ec0a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb524739b80 4 client.25664 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:42:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb524739b80 1 -- 172.21.15.59:0/1271728466 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5610ebf83b30 con 0x5610ec0a76f0 2023-10-08T12:42:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.978+0000 7fb50a59c700 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610ec0a76f0 0x5610ec0a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb4f1ffb700 10 client.25664 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb50a59c700 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610ec0a76f0 0x5610ec0a9b10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec91f5fb931491ff server_cookie=d678d501d3f10510 in_seq=0 out_seq=0 2023-10-08T12:42:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb4f1ffb700 1 -- 172.21.15.59:0/1271728466 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5610ebf83b30 con 0x5610ec0a76f0 2023-10-08T12:42:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb4f1ffb700 10 client.25664 handle_command_reply: tid=0 2023-10-08T12:42:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb524739b80 1 client.25664 shutdown 2023-10-08T12:42:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb524739b80 1 -- 172.21.15.59:0/1271728466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec0377a0 msgr2=0x5610ec047fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb524739b80 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec0377a0 0x5610ec047fd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb50c19a300 tx=0x7fb4f401ff30 comp rx=0 tx=0).stop 2023-10-08T12:42:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb524739b80 1 -- 172.21.15.59:0/1271728466 shutdown_connections 2023-10-08T12:42:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb524739b80 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5610ec0a76f0 0x5610ec0a9b10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb524739b80 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610ec042650 0x5610ec048510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb524739b80 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ec036e80 0x5610ec047a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb524739b80 1 --2- 172.21.15.59:0/1271728466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5610ec0377a0 0x5610ec047fd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb4f1ffb700 0 client.25664 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:42:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.979+0000 7fb524739b80 1 -- 172.21.15.59:0/1271728466 >> 172.21.15.59:0/1271728466 conn(0x5610ebfac260 msgr2=0x5610ec04e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb524739b80 1 -- 172.21.15.59:0/1271728466 shutdown_connections 2023-10-08T12:42:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb524739b80 1 -- 172.21.15.59:0/1271728466 wait complete. 2023-10-08T12:42:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb524739b80 20 client.25664 trim_cache size 0 max 16384 2023-10-08T12:42:58.987 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:42:58.987 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:42:58.987 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:42:58.987 INFO:teuthology.orchestra.run.smithi059.stdout: "4a9d3637-e9aa-4de0-b6e8-b1419c8fd830": { 2023-10-08T12:42:58.987 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:42:58.987 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "4a9d3637-e9aa-4de0-b6e8-b1419c8fd830", 2023-10-08T12:42:58.987 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:42:58.987 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:42:58.987 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:42:58.987 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:42:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb510dff700 1 -- 172.21.15.59:0/1899079699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f80a15f0 msgr2=0x7fb4f80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb510dff700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f80a15f0 0x7fb4f80a3ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb50401e000 tx=0x7fb504021000 comp rx=0 tx=0).stop 2023-10-08T12:42:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb510dff700 1 -- 172.21.15.59:0/1899079699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb50c068a00 msgr2=0x7fb50c198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb510dff700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb50c068a00 0x7fb50c198db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc000c00 tx=0x7fb4fc005740 comp rx=0 tx=0).stop 2023-10-08T12:42:58.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb510dff700 1 -- 172.21.15.59:0/1899079699 shutdown_connections 2023-10-08T12:42:58.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb510dff700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f80a15f0 0x7fb4f80a3ab0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb510dff700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb50c106750 0x7fb50c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb510dff700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb50c068a00 0x7fb50c198db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb510dff700 1 --2- 172.21.15.59:0/1899079699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb50c0693c0 0x7fb50c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:58.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.980+0000 7fb510dff700 1 -- 172.21.15.59:0/1899079699 >> 172.21.15.59:0/1899079699 conn(0x7fb50c076850 msgr2=0x7fb50c10bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:58.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.981+0000 7fb510dff700 1 -- 172.21.15.59:0/1899079699 shutdown_connections 2023-10-08T12:42:58.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:42:58.981+0000 7fb510dff700 1 -- 172.21.15.59:0/1899079699 wait complete. 2023-10-08T12:42:58.999 INFO:tasks.cephfs.filesystem:scrub status for tag:4a9d3637-e9aa-4de0-b6e8-b1419c8fd830 - {'path': '/', 'tag': '4a9d3637-e9aa-4de0-b6e8-b1419c8fd830', 'options': 'recursive,force'} 2023-10-08T12:42:59.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 86706 16.17 MB/sec warmup 30 sec latency 69.737 ms 2023-10-08T12:43:00.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:59 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:43:00.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:59 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:00.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:59 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:43:00.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:59 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:00.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:42:59 smithi059 ceph-mon[98489]: pgmap v368: 97 pgs: 97 active+clean; 36 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.6 MiB/s wr, 213 op/s 2023-10-08T12:43:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:59 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:43:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:59 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:59 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:43:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:59 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:42:59 smithi092 ceph-mon[134093]: pgmap v368: 97 pgs: 97 active+clean; 36 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.6 MiB/s wr, 213 op/s 2023-10-08T12:43:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:59 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:43:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:59 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:59 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:43:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:59 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:42:59 smithi173 ceph-mon[135182]: pgmap v368: 97 pgs: 97 active+clean; 36 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.6 MiB/s wr, 213 op/s 2023-10-08T12:43:00.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 89304 16.10 MB/sec warmup 31 sec latency 35.564 ms 2023-10-08T12:43:01.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 92099 16.05 MB/sec warmup 32 sec latency 135.781 ms 2023-10-08T12:43:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:01 smithi173 ceph-mon[135182]: pgmap v369: 97 pgs: 97 active+clean; 42 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2023-10-08T12:43:02.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:01 smithi059 ceph-mon[98489]: pgmap v369: 97 pgs: 97 active+clean; 42 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2023-10-08T12:43:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:01 smithi092 ceph-mon[134093]: pgmap v369: 97 pgs: 97 active+clean; 42 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2023-10-08T12:43:02.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 94749 15.94 MB/sec warmup 33 sec latency 35.871 ms 2023-10-08T12:43:03.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:02 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:43:03.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:02 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:43:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:02 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:43:03.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 97241 15.95 MB/sec warmup 34 sec latency 11.089 ms 2023-10-08T12:43:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:03 smithi173 ceph-mon[135182]: pgmap v370: 97 pgs: 97 active+clean; 57 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 3.5 MiB/s wr, 226 op/s 2023-10-08T12:43:04.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:03 smithi059 ceph-mon[98489]: pgmap v370: 97 pgs: 97 active+clean; 57 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 3.5 MiB/s wr, 226 op/s 2023-10-08T12:43:04.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:03 smithi092 ceph-mon[134093]: pgmap v370: 97 pgs: 97 active+clean; 57 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 3.5 MiB/s wr, 226 op/s 2023-10-08T12:43:04.497 INFO:tasks.workunit.client.0.smithi059.stdout: 1 100072 15.91 MB/sec warmup 35 sec latency 12.096 ms 2023-10-08T12:43:05.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 103276 15.99 MB/sec warmup 36 sec latency 5.938 ms 2023-10-08T12:43:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:05 smithi173 ceph-mon[135182]: pgmap v371: 97 pgs: 97 active+clean; 61 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 3.8 MiB/s wr, 237 op/s 2023-10-08T12:43:06.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:05 smithi059 ceph-mon[98489]: pgmap v371: 97 pgs: 97 active+clean; 61 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 3.8 MiB/s wr, 237 op/s 2023-10-08T12:43:06.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:05 smithi092 ceph-mon[134093]: pgmap v371: 97 pgs: 97 active+clean; 61 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 3.8 MiB/s wr, 237 op/s 2023-10-08T12:43:06.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 104406 15.69 MB/sec warmup 37 sec latency 195.424 ms 2023-10-08T12:43:07.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 106283 15.53 MB/sec warmup 38 sec latency 315.172 ms 2023-10-08T12:43:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:07 smithi173 ceph-mon[135182]: pgmap v372: 97 pgs: 97 active+clean; 70 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 4.6 MiB/s wr, 248 op/s 2023-10-08T12:43:08.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:07 smithi059 ceph-mon[98489]: pgmap v372: 97 pgs: 97 active+clean; 70 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 4.6 MiB/s wr, 248 op/s 2023-10-08T12:43:08.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:07 smithi092 ceph-mon[134093]: pgmap v372: 97 pgs: 97 active+clean; 70 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 4.6 MiB/s wr, 248 op/s 2023-10-08T12:43:08.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 108918 15.44 MB/sec warmup 39 sec latency 10.128 ms 2023-10-08T12:43:09.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 111559 15.47 MB/sec warmup 40 sec latency 8.003 ms 2023-10-08T12:43:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:09 smithi092 ceph-mon[134093]: pgmap v373: 97 pgs: 97 active+clean; 71 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.4 MiB/s wr, 309 op/s 2023-10-08T12:43:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:09 smithi173 ceph-mon[135182]: pgmap v373: 97 pgs: 97 active+clean; 71 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.4 MiB/s wr, 309 op/s 2023-10-08T12:43:10.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:09 smithi059 ceph-mon[98489]: pgmap v373: 97 pgs: 97 active+clean; 71 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.4 MiB/s wr, 309 op/s 2023-10-08T12:43:10.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 114208 15.44 MB/sec warmup 41 sec latency 22.259 ms 2023-10-08T12:43:11.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 117359 15.52 MB/sec warmup 42 sec latency 13.148 ms 2023-10-08T12:43:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:11 smithi173 ceph-mon[135182]: pgmap v374: 97 pgs: 97 active+clean; 72 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.6 MiB/s wr, 393 op/s 2023-10-08T12:43:12.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:11 smithi059 ceph-mon[98489]: pgmap v374: 97 pgs: 97 active+clean; 72 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.6 MiB/s wr, 393 op/s 2023-10-08T12:43:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:11 smithi092 ceph-mon[134093]: pgmap v374: 97 pgs: 97 active+clean; 72 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.6 MiB/s wr, 393 op/s 2023-10-08T12:43:12.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 120393 15.50 MB/sec warmup 43 sec latency 6.830 ms 2023-10-08T12:43:13.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 122968 15.41 MB/sec warmup 44 sec latency 17.807 ms 2023-10-08T12:43:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:13 smithi173 ceph-mon[135182]: pgmap v375: 97 pgs: 97 active+clean; 69 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.4 MiB/s wr, 444 op/s 2023-10-08T12:43:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:13 smithi059 ceph-mon[98489]: pgmap v375: 97 pgs: 97 active+clean; 69 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.4 MiB/s wr, 444 op/s 2023-10-08T12:43:14.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:13 smithi092 ceph-mon[134093]: pgmap v375: 97 pgs: 97 active+clean; 69 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.4 MiB/s wr, 444 op/s 2023-10-08T12:43:14.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 125255 15.38 MB/sec warmup 45 sec latency 9.999 ms 2023-10-08T12:43:15.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 128288 15.42 MB/sec warmup 46 sec latency 12.067 ms 2023-10-08T12:43:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:15 smithi173 ceph-mon[135182]: pgmap v376: 97 pgs: 97 active+clean; 69 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.3 MiB/s wr, 351 op/s 2023-10-08T12:43:16.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:15 smithi059 ceph-mon[98489]: pgmap v376: 97 pgs: 97 active+clean; 69 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.3 MiB/s wr, 351 op/s 2023-10-08T12:43:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:15 smithi092 ceph-mon[134093]: pgmap v376: 97 pgs: 97 active+clean; 69 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.3 MiB/s wr, 351 op/s 2023-10-08T12:43:16.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 131514 15.49 MB/sec warmup 47 sec latency 15.622 ms 2023-10-08T12:43:17.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 134298 15.44 MB/sec warmup 48 sec latency 10.004 ms 2023-10-08T12:43:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:17 smithi173 ceph-mon[135182]: pgmap v377: 97 pgs: 97 active+clean; 74 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.3 MiB/s wr, 389 op/s 2023-10-08T12:43:18.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:17 smithi059 ceph-mon[98489]: pgmap v377: 97 pgs: 97 active+clean; 74 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.3 MiB/s wr, 389 op/s 2023-10-08T12:43:18.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:17 smithi092 ceph-mon[134093]: pgmap v377: 97 pgs: 97 active+clean; 74 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.3 MiB/s wr, 389 op/s 2023-10-08T12:43:18.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 137262 15.40 MB/sec warmup 49 sec latency 9.315 ms 2023-10-08T12:43:19.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 138753 15.34 MB/sec warmup 50 sec latency 360.698 ms 2023-10-08T12:43:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:19 smithi092 ceph-mon[134093]: pgmap v378: 97 pgs: 97 active+clean; 75 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.3 MiB/s wr, 368 op/s 2023-10-08T12:43:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:19 smithi173 ceph-mon[135182]: pgmap v378: 97 pgs: 97 active+clean; 75 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.3 MiB/s wr, 368 op/s 2023-10-08T12:43:20.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:19 smithi059 ceph-mon[98489]: pgmap v378: 97 pgs: 97 active+clean; 75 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.3 MiB/s wr, 368 op/s 2023-10-08T12:43:20.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 141895 15.38 MB/sec warmup 51 sec latency 6.556 ms 2023-10-08T12:43:21.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 144348 15.25 MB/sec warmup 52 sec latency 10.411 ms 2023-10-08T12:43:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:21 smithi173 ceph-mon[135182]: pgmap v379: 97 pgs: 97 active+clean; 81 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.8 MiB/s wr, 320 op/s 2023-10-08T12:43:22.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:21 smithi059 ceph-mon[98489]: pgmap v379: 97 pgs: 97 active+clean; 81 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.8 MiB/s wr, 320 op/s 2023-10-08T12:43:22.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:21 smithi092 ceph-mon[134093]: pgmap v379: 97 pgs: 97 active+clean; 81 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.8 MiB/s wr, 320 op/s 2023-10-08T12:43:22.498 INFO:tasks.workunit.client.0.smithi059.stdout: 1 146532 15.23 MB/sec warmup 53 sec latency 14.165 ms 2023-10-08T12:43:23.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 149580 15.26 MB/sec warmup 54 sec latency 6.368 ms 2023-10-08T12:43:24.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:23 smithi173 ceph-mon[135182]: pgmap v380: 97 pgs: 97 active+clean; 84 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 283 op/s 2023-10-08T12:43:24.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:23 smithi059 ceph-mon[98489]: pgmap v380: 97 pgs: 97 active+clean; 84 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 283 op/s 2023-10-08T12:43:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:23 smithi092 ceph-mon[134093]: pgmap v380: 97 pgs: 97 active+clean; 84 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 283 op/s 2023-10-08T12:43:24.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 152620 15.30 MB/sec warmup 55 sec latency 84.208 ms 2023-10-08T12:43:25.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 155472 15.28 MB/sec warmup 56 sec latency 6.333 ms 2023-10-08T12:43:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:25 smithi173 ceph-mon[135182]: pgmap v381: 97 pgs: 97 active+clean; 85 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 188 op/s 2023-10-08T12:43:26.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:25 smithi059 ceph-mon[98489]: pgmap v381: 97 pgs: 97 active+clean; 85 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 188 op/s 2023-10-08T12:43:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:25 smithi092 ceph-mon[134093]: pgmap v381: 97 pgs: 97 active+clean; 85 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 188 op/s 2023-10-08T12:43:26.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 158429 15.25 MB/sec warmup 57 sec latency 5.863 ms 2023-10-08T12:43:27.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 160620 15.21 MB/sec warmup 58 sec latency 17.356 ms 2023-10-08T12:43:28.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:27 smithi173 ceph-mon[135182]: pgmap v382: 97 pgs: 97 active+clean; 86 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 198 op/s 2023-10-08T12:43:28.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:27 smithi059 ceph-mon[98489]: pgmap v382: 97 pgs: 97 active+clean; 86 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 198 op/s 2023-10-08T12:43:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:27 smithi092 ceph-mon[134093]: pgmap v382: 97 pgs: 97 active+clean; 86 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 198 op/s 2023-10-08T12:43:28.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 163667 15.26 MB/sec warmup 59 sec latency 7.202 ms 2023-10-08T12:43:29.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:43:29.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.230+0000 7fbf6dfff700 1 -- 172.21.15.59:0/2684419418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf68106750 msgr2=0x7fbf68106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.230+0000 7fbf6dfff700 1 --2- 172.21.15.59:0/2684419418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf68106750 0x7fbf68106b30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009990 tx=0x7fbf58009ca0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.230+0000 7fbf6dfff700 1 -- 172.21.15.59:0/2684419418 shutdown_connections 2023-10-08T12:43:29.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.230+0000 7fbf6dfff700 1 --2- 172.21.15.59:0/2684419418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf68106750 0x7fbf68106b30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.230+0000 7fbf6dfff700 1 --2- 172.21.15.59:0/2684419418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf68101100 0x7fbf6810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.230+0000 7fbf6dfff700 1 --2- 172.21.15.59:0/2684419418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf68100740 0x7fbf68100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.230+0000 7fbf6dfff700 1 -- 172.21.15.59:0/2684419418 >> 172.21.15.59:0/2684419418 conn(0x7fbf680fc230 msgr2=0x7fbf680fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:29.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.230+0000 7fbf6dfff700 1 -- 172.21.15.59:0/2684419418 shutdown_connections 2023-10-08T12:43:29.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.230+0000 7fbf6dfff700 1 -- 172.21.15.59:0/2684419418 wait complete. 2023-10-08T12:43:29.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.232+0000 7fbf6dfff700 1 Processor -- start 2023-10-08T12:43:29.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.232+0000 7fbf6dfff700 1 -- start start 2023-10-08T12:43:29.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf6dfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf68100740 0x7fbf68072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf6dfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf68101100 0x7fbf68073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf6dfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf68106750 0x7fbf68073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf6dfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf681a4f40 con 0x7fbf68101100 2023-10-08T12:43:29.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf6dfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf681a50b0 con 0x7fbf68106750 2023-10-08T12:43:29.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf6dfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf681a5270 con 0x7fbf68100740 2023-10-08T12:43:29.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf677fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf68100740 0x7fbf68072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf677fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf68100740 0x7fbf68072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:45072/0 (socket says 172.21.15.59:45072) 2023-10-08T12:43:29.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf677fe700 1 -- 172.21.15.59:0/1574713111 learned_addr learned my addr 172.21.15.59:0/1574713111 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:29.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf67fff700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf68106750 0x7fbf68073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf66ffd700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf68101100 0x7fbf68073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf677fe700 1 -- 172.21.15.59:0/1574713111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf68106750 msgr2=0x7fbf68073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf677fe700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf68106750 0x7fbf68073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf677fe700 1 -- 172.21.15.59:0/1574713111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf68101100 msgr2=0x7fbf68073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf677fe700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf68101100 0x7fbf68073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf677fe700 1 -- 172.21.15.59:0/1574713111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf580095f0 con 0x7fbf68100740 2023-10-08T12:43:29.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.233+0000 7fbf67fff700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf68106750 0x7fbf68073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:29.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.234+0000 7fbf677fe700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf68100740 0x7fbf68072af0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbf58005910 tx=0x7fbf58004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:29.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.234+0000 7fbf64ff9700 1 -- 172.21.15.59:0/1574713111 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5801d070 con 0x7fbf68100740 2023-10-08T12:43:29.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.234+0000 7fbf64ff9700 1 -- 172.21.15.59:0/1574713111 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf58022470 con 0x7fbf68100740 2023-10-08T12:43:29.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.234+0000 7fbf64ff9700 1 -- 172.21.15.59:0/1574713111 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58017650 con 0x7fbf68100740 2023-10-08T12:43:29.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.234+0000 7fbf6dfff700 1 -- 172.21.15.59:0/1574713111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf681a54f0 con 0x7fbf68100740 2023-10-08T12:43:29.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.234+0000 7fbf6dfff700 1 -- 172.21.15.59:0/1574713111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf681a5980 con 0x7fbf68100740 2023-10-08T12:43:29.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.238+0000 7fbf64ff9700 1 -- 172.21.15.59:0/1574713111 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbf580225e0 con 0x7fbf68100740 2023-10-08T12:43:29.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.240+0000 7fbf81821b80 1 Processor -- start 2023-10-08T12:43:29.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.240+0000 7fbf81821b80 1 -- start start 2023-10-08T12:43:29.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.240+0000 7fbf64ff9700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbf500a1670 0x7fbf500a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.240+0000 7fbf64ff9700 1 -- 172.21.15.59:0/1574713111 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbf580ce270 con 0x7fbf68100740 2023-10-08T12:43:29.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf67fff700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbf500a1670 0x7fbf500a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342ace80 0x5603342ad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ad7a0 0x5603342b8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 0x5603342baa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf81821b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560334216460 con 0x5603342ad7a0 2023-10-08T12:43:29.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf81821b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560334207c20 con 0x5603342b8650 2023-10-08T12:43:29.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf81821b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560334205540 con 0x5603342ace80 2023-10-08T12:43:29.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf66ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ad7a0 0x5603342b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf66ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ad7a0 0x5603342b8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34334/0 (socket says 172.21.15.59:34334) 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf66ffd700 1 -- 172.21.15.59:0/1313939443 learned_addr learned my addr 172.21.15.59:0/1313939443 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf677fe700 1 --2- 172.21.15.59:0/1313939443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342ace80 0x5603342ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf67fff700 1 --2- 172.21.15.59:0/1313939443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 0x5603342baa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf677fe700 1 -- 172.21.15.59:0/1313939443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 msgr2=0x5603342baa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.241+0000 7fbf677fe700 1 --2- 172.21.15.59:0/1313939443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 0x5603342baa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.242+0000 7fbf677fe700 1 -- 172.21.15.59:0/1313939443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ad7a0 msgr2=0x5603342b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.242+0000 7fbf677fe700 1 --2- 172.21.15.59:0/1313939443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ad7a0 0x5603342b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.242+0000 7fbf677fe700 1 -- 172.21.15.59:0/1313939443 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56033402bde0 con 0x5603342ace80 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.242+0000 7fbf66ffd700 1 --2- 172.21.15.59:0/1313939443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ad7a0 0x5603342b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.242+0000 7fbf67fff700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbf500a1670 0x7fbf500a3b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbf60003e40 tx=0x7fbf60009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.242+0000 7fbf677fe700 1 --2- 172.21.15.59:0/1313939443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342ace80 0x5603342ad260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf580cb9f0 tx=0x7fbf58022f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55c5b140f4dade5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.242+0000 7fbf4dffb700 1 -- 172.21.15.59:0/1313939443 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5809adc0 con 0x5603342ace80 2023-10-08T12:43:29.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.242+0000 7fbf4dffb700 1 -- 172.21.15.59:0/1313939443 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf580b3e90 con 0x5603342ace80 2023-10-08T12:43:29.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.242+0000 7fbf4dffb700 1 -- 172.21.15.59:0/1313939443 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5809b6c0 con 0x5603342ace80 2023-10-08T12:43:29.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.243+0000 7fbf81821b80 1 -- 172.21.15.59:0/1313939443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342ace80 msgr2=0x5603342ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.243+0000 7fbf81821b80 1 --2- 172.21.15.59:0/1313939443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342ace80 0x5603342ad260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf580cb9f0 tx=0x7fbf58022f90 comp rx=0 tx=0).stop 2023-10-08T12:43:29.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.243+0000 7fbf81821b80 1 -- 172.21.15.59:0/1313939443 shutdown_connections 2023-10-08T12:43:29.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.243+0000 7fbf81821b80 1 --2- 172.21.15.59:0/1313939443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 0x5603342baa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.243+0000 7fbf81821b80 1 --2- 172.21.15.59:0/1313939443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342ace80 0x5603342ad260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.243+0000 7fbf81821b80 1 --2- 172.21.15.59:0/1313939443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ad7a0 0x5603342b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.243+0000 7fbf81821b80 1 -- 172.21.15.59:0/1313939443 >> 172.21.15.59:0/1313939443 conn(0x560334222260 msgr2=0x5603342a92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:29.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.243+0000 7fbf81821b80 1 -- 172.21.15.59:0/1313939443 shutdown_connections 2023-10-08T12:43:29.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.243+0000 7fbf81821b80 1 -- 172.21.15.59:0/1313939443 wait complete. 2023-10-08T12:43:29.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.244+0000 7fbf81821b80 1 -- start start 2023-10-08T12:43:29.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.244+0000 7fbf81821b80 1 Processor -- start 2023-10-08T12:43:29.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342b8650 0x5603342c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf81821b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560334200e30 con 0x5603342ace80 2023-10-08T12:43:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf81821b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033419d710 con 0x5603342ad7a0 2023-10-08T12:43:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf81821b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033419d3b0 con 0x5603342b8650 2023-10-08T12:43:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf81821b80 10 client.0 _ll_register_callbacks cb 0x560333ffa800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf66ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf66ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342b8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38918/0 (socket says 172.21.15.59:38918) 2023-10-08T12:43:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf66ffd700 1 -- 172.21.15.59:0/3423739605 learned_addr learned my addr 172.21.15.59:0/3423739605 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf677fe700 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.245+0000 7fbf67fff700 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342b8650 0x5603342c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.246+0000 7fbf66ffd700 1 -- 172.21.15.59:0/3423739605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342b8650 msgr2=0x5603342c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.246+0000 7fbf66ffd700 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342b8650 0x5603342c3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.246+0000 7fbf66ffd700 1 -- 172.21.15.59:0/3423739605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 msgr2=0x5603342b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.246+0000 7fbf66ffd700 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342b8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.246+0000 7fbf66ffd700 1 -- 172.21.15.59:0/3423739605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c009980 con 0x5603342ad7a0 2023-10-08T12:43:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.246+0000 7fbf67fff700 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342b8650 0x5603342c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.246+0000 7fbf66ffd700 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342b8f70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c012980 tx=0x7fbf5c012c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f5ab810fc6c56ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.246+0000 7fbf46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:43:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.246+0000 7fbf46ffd700 1 -- 172.21.15.59:0/3423739605 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c017070 con 0x5603342ad7a0 2023-10-08T12:43:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.246+0000 7fbf46ffd700 1 -- 172.21.15.59:0/3423739605 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbf5c004020 con 0x5603342ad7a0 2023-10-08T12:43:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.246+0000 7fbf81821b80 1 -- 172.21.15.59:0/3423739605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603341c8eb0 con 0x5603342ad7a0 2023-10-08T12:43:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.247+0000 7fbf46ffd700 1 -- 172.21.15.59:0/3423739605 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf5c0041e0 con 0x5603342ad7a0 2023-10-08T12:43:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.247+0000 7fbf81821b80 10 client.25676 fetch_fsmap learned FSMap version 20 2023-10-08T12:43:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.247+0000 7fbf81821b80 1 -- 172.21.15.59:0/3423739605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fbf681a5980 con 0x5603342ad7a0 2023-10-08T12:43:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.247+0000 7fbf46ffd700 1 -- 172.21.15.59:0/3423739605 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5603341c8eb0 con 0x5603342ad7a0 2023-10-08T12:43:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.247+0000 7fbf46ffd700 1 -- 172.21.15.59:0/3423739605 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbf5c003760 con 0x5603342ad7a0 2023-10-08T12:43:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.247+0000 7fbf81821b80 10 client.25676 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:43:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.247+0000 7fbf81821b80 10 client.25676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.247+0000 7fbf81821b80 20 client.25676 populate_metadata read hostname 'smithi059' 2023-10-08T12:43:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.247+0000 7fbf81821b80 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5603342c7e50 0x5603342ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.247+0000 7fbf81821b80 4 client.25676 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.247+0000 7fbf81821b80 1 -- 172.21.15.59:0/3423739605 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603341f9e10 con 0x5603342c7e50 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.248+0000 7fbf677fe700 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5603342c7e50 0x5603342ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.248+0000 7fbf677fe700 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5603342c7e50 0x5603342ca270 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29bf60fc7ff3ec9c server_cookie=c59ca90dc9ce2197 in_seq=0 out_seq=0 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.248+0000 7fbf46ffd700 10 client.25676 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf46ffd700 1 -- 172.21.15.59:0/3423739605 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5603341f9e10 con 0x5603342c7e50 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf46ffd700 10 client.25676 handle_command_reply: tid=0 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf81821b80 1 client.25676 shutdown 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf81821b80 1 -- 172.21.15.59:0/3423739605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 msgr2=0x5603342b8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf81821b80 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342b8f70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c012980 tx=0x7fbf5c012c90 comp rx=0 tx=0).stop 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf81821b80 1 -- 172.21.15.59:0/3423739605 shutdown_connections 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf81821b80 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5603342c7e50 0x5603342ca270 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf81821b80 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342b8650 0x5603342c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf81821b80 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf81821b80 1 --2- 172.21.15.59:0/3423739605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342b8f70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf46ffd700 0 client.25676 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.249+0000 7fbf81821b80 1 -- 172.21.15.59:0/3423739605 >> 172.21.15.59:0/3423739605 conn(0x560334222260 msgr2=0x5603342a8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.250+0000 7fbf81821b80 1 -- 172.21.15.59:0/3423739605 shutdown_connections 2023-10-08T12:43:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.250+0000 7fbf81821b80 1 -- 172.21.15.59:0/3423739605 wait complete. 2023-10-08T12:43:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.250+0000 7fbf81821b80 20 client.25676 trim_cache size 0 max 16384 2023-10-08T12:43:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.269+0000 7fbf81821b80 1 Processor -- start 2023-10-08T12:43:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.269+0000 7fbf81821b80 1 -- start start 2023-10-08T12:43:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.269+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.269+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342ad7a0 0x5603342bd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.270+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 0x5603342b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.270+0000 7fbf81821b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560334081920 con 0x5603342ace80 2023-10-08T12:43:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.270+0000 7fbf81821b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603342c4950 con 0x5603342b8650 2023-10-08T12:43:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.270+0000 7fbf81821b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603342a9ea0 con 0x5603342ad7a0 2023-10-08T12:43:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.270+0000 7fbf67fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 0x5603342b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.270+0000 7fbf677fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.270+0000 7fbf66ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342ad7a0 0x5603342bd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.270+0000 7fbf67fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 0x5603342b6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38932/0 (socket says 172.21.15.59:38932) 2023-10-08T12:43:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.270+0000 7fbf67fff700 1 -- 172.21.15.59:0/554556822 learned_addr learned my addr 172.21.15.59:0/554556822 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.271+0000 7fbf67fff700 1 -- 172.21.15.59:0/554556822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342ad7a0 msgr2=0x5603342bd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.271+0000 7fbf67fff700 1 --2- 172.21.15.59:0/554556822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342ad7a0 0x5603342bd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.271+0000 7fbf67fff700 1 -- 172.21.15.59:0/554556822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 msgr2=0x5603342ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.271+0000 7fbf67fff700 1 --2- 172.21.15.59:0/554556822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.271+0000 7fbf67fff700 1 -- 172.21.15.59:0/554556822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560334014c60 con 0x5603342b8650 2023-10-08T12:43:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.271+0000 7fbf67fff700 1 --2- 172.21.15.59:0/554556822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 0x5603342b6150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000e8c0 tx=0x7fbf6001c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1acdcaa50e5cc3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.272+0000 7fbf4e7fc700 1 -- 172.21.15.59:0/554556822 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf600196f0 con 0x5603342b8650 2023-10-08T12:43:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.272+0000 7fbf4e7fc700 1 -- 172.21.15.59:0/554556822 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf6000f040 con 0x5603342b8650 2023-10-08T12:43:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.272+0000 7fbf4e7fc700 1 -- 172.21.15.59:0/554556822 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf60017c40 con 0x5603342b8650 2023-10-08T12:43:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.273+0000 7fbf81821b80 1 -- 172.21.15.59:0/554556822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 msgr2=0x5603342b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.273+0000 7fbf81821b80 1 --2- 172.21.15.59:0/554556822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 0x5603342b6150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000e8c0 tx=0x7fbf6001c000 comp rx=0 tx=0).stop 2023-10-08T12:43:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.273+0000 7fbf81821b80 1 -- 172.21.15.59:0/554556822 shutdown_connections 2023-10-08T12:43:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.273+0000 7fbf81821b80 1 --2- 172.21.15.59:0/554556822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342b8650 0x5603342b6150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.273+0000 7fbf81821b80 1 --2- 172.21.15.59:0/554556822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.273+0000 7fbf81821b80 1 --2- 172.21.15.59:0/554556822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342ad7a0 0x5603342bd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.273+0000 7fbf81821b80 1 -- 172.21.15.59:0/554556822 >> 172.21.15.59:0/554556822 conn(0x560334222260 msgr2=0x5603342b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:29.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.273+0000 7fbf81821b80 1 -- 172.21.15.59:0/554556822 shutdown_connections 2023-10-08T12:43:29.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.273+0000 7fbf81821b80 1 -- 172.21.15.59:0/554556822 wait complete. 2023-10-08T12:43:29.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.273+0000 7fbf81821b80 1 -- start start 2023-10-08T12:43:29.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.274+0000 7fbf81821b80 1 Processor -- start 2023-10-08T12:43:29.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.274+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.274+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342bc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.274+0000 7fbf81821b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342b8650 0x5603342bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.274+0000 7fbf81821b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033431bc90 con 0x5603342ace80 2023-10-08T12:43:29.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.274+0000 7fbf81821b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033431bdd0 con 0x5603342ad7a0 2023-10-08T12:43:29.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.274+0000 7fbf81821b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033431bf10 con 0x5603342b8650 2023-10-08T12:43:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.274+0000 7fbf81821b80 10 client.0 _ll_register_callbacks cb 0x7fbf5c012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.275+0000 7fbf66ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342bc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.275+0000 7fbf66ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342bc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38938/0 (socket says 172.21.15.59:38938) 2023-10-08T12:43:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.275+0000 7fbf66ffd700 1 -- 172.21.15.59:0/1540475271 learned_addr learned my addr 172.21.15.59:0/1540475271 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.275+0000 7fbf677fe700 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.275+0000 7fbf67fff700 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342b8650 0x5603342bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.275+0000 7fbf66ffd700 1 -- 172.21.15.59:0/1540475271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342b8650 msgr2=0x5603342bcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.275+0000 7fbf66ffd700 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342b8650 0x5603342bcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.275+0000 7fbf66ffd700 1 -- 172.21.15.59:0/1540475271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 msgr2=0x5603342bc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.275+0000 7fbf66ffd700 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342bc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.275+0000 7fbf66ffd700 1 -- 172.21.15.59:0/1540475271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6000e4f0 con 0x5603342ad7a0 2023-10-08T12:43:29.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.276+0000 7fbf66ffd700 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342bc620 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009950 tx=0x7fbf5c0094b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=273f259b287fdb5c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:29.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.276+0000 7fbf46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:43:29.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.276+0000 7fbf46ffd700 1 -- 172.21.15.59:0/1540475271 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c017040 con 0x5603342ad7a0 2023-10-08T12:43:29.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.276+0000 7fbf81821b80 1 -- 172.21.15.59:0/1540475271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf580b3e90 con 0x5603342ad7a0 2023-10-08T12:43:29.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.276+0000 7fbf46ffd700 1 -- 172.21.15.59:0/1540475271 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbf5c02b020 con 0x5603342ad7a0 2023-10-08T12:43:29.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.276+0000 7fbf46ffd700 1 -- 172.21.15.59:0/1540475271 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf5c00fa30 con 0x5603342ad7a0 2023-10-08T12:43:29.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.276+0000 7fbf81821b80 10 client.25682 fetch_fsmap learned FSMap version 20 2023-10-08T12:43:29.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.276+0000 7fbf81821b80 1 -- 172.21.15.59:0/1540475271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x560334052250 con 0x5603342ad7a0 2023-10-08T12:43:29.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.276+0000 7fbf46ffd700 1 -- 172.21.15.59:0/1540475271 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf580b3e90 con 0x5603342ad7a0 2023-10-08T12:43:29.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.277+0000 7fbf46ffd700 1 -- 172.21.15.59:0/1540475271 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbf5c01c4f0 con 0x5603342ad7a0 2023-10-08T12:43:29.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.277+0000 7fbf81821b80 10 client.25682 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:43:29.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.277+0000 7fbf81821b80 10 client.25682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:29.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.277+0000 7fbf81821b80 20 client.25682 populate_metadata read hostname 'smithi059' 2023-10-08T12:43:29.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.277+0000 7fbf81821b80 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56033431d750 0x56033431fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.277+0000 7fbf81821b80 4 client.25682 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:43:29.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.277+0000 7fbf81821b80 1 -- 172.21.15.59:0/1540475271 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5603341f9b30 con 0x56033431d750 2023-10-08T12:43:29.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.277+0000 7fbf677fe700 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56033431d750 0x56033431fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.277+0000 7fbf677fe700 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56033431d750 0x56033431fb70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f4335086d931cdd server_cookie=a4ee4e4b9ef5fab1 in_seq=0 out_seq=0 2023-10-08T12:43:29.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.277+0000 7fbf46ffd700 10 client.25682 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:29.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.278+0000 7fbf46ffd700 1 -- 172.21.15.59:0/1540475271 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5603341f9b30 con 0x56033431d750 2023-10-08T12:43:29.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.278+0000 7fbf46ffd700 10 client.25682 handle_command_reply: tid=0 2023-10-08T12:43:29.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.278+0000 7fbf81821b80 1 client.25682 shutdown 2023-10-08T12:43:29.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf81821b80 1 -- 172.21.15.59:0/1540475271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 msgr2=0x5603342bc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf81821b80 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342bc620 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009950 tx=0x7fbf5c0094b0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf81821b80 1 -- 172.21.15.59:0/1540475271 shutdown_connections 2023-10-08T12:43:29.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf81821b80 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56033431d750 0x56033431fb70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf81821b80 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603342b8650 0x5603342bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf81821b80 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603342ace80 0x5603342bc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf46ffd700 0 client.25682 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:29.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf81821b80 1 --2- 172.21.15.59:0/1540475271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603342ad7a0 0x5603342bc620 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf81821b80 1 -- 172.21.15.59:0/1540475271 >> 172.21.15.59:0/1540475271 conn(0x560334222260 msgr2=0x5603342b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:29.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf81821b80 1 -- 172.21.15.59:0/1540475271 shutdown_connections 2023-10-08T12:43:29.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf81821b80 1 -- 172.21.15.59:0/1540475271 wait complete. 2023-10-08T12:43:29.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.279+0000 7fbf81821b80 20 client.25682 trim_cache size 0 max 16384 2023-10-08T12:43:29.282 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:43:29.282 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:43:29.282 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:43:29.282 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:43:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 -- 172.21.15.59:0/1574713111 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbf500a1670 msgr2=0x7fbf500a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbf500a1670 0x7fbf500a3b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbf60003e40 tx=0x7fbf60009920 comp rx=0 tx=0).stop 2023-10-08T12:43:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 -- 172.21.15.59:0/1574713111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf68100740 msgr2=0x7fbf68072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf68100740 0x7fbf68072af0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbf58005910 tx=0x7fbf58004730 comp rx=0 tx=0).stop 2023-10-08T12:43:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 -- 172.21.15.59:0/1574713111 shutdown_connections 2023-10-08T12:43:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbf500a1670 0x7fbf500a3b30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf68106750 0x7fbf68073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf68100740 0x7fbf68072af0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 --2- 172.21.15.59:0/1574713111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf68101100 0x7fbf68073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 -- 172.21.15.59:0/1574713111 >> 172.21.15.59:0/1574713111 conn(0x7fbf680fc230 msgr2=0x7fbf680fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:29.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 -- 172.21.15.59:0/1574713111 shutdown_connections 2023-10-08T12:43:29.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.280+0000 7fbf6dfff700 1 -- 172.21.15.59:0/1574713111 wait complete. 2023-10-08T12:43:29.300 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:43:29.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:43:29.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 166801 15.30 MB/sec warmup 60 sec latency 17.387 ms 2023-10-08T12:43:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.530+0000 7ff93679d700 1 -- 172.21.15.59:0/172445563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9301066b0 msgr2=0x7ff930106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.530+0000 7ff93679d700 1 --2- 172.21.15.59:0/172445563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9301066b0 0x7ff930106a90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009990 tx=0x7ff92c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.530+0000 7ff93679d700 1 -- 172.21.15.59:0/172445563 shutdown_connections 2023-10-08T12:43:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.530+0000 7ff93679d700 1 --2- 172.21.15.59:0/172445563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9301066b0 0x7ff930106a90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.530+0000 7ff93679d700 1 --2- 172.21.15.59:0/172445563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff930100fd0 0x7ff93010d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.530+0000 7ff93679d700 1 --2- 172.21.15.59:0/172445563 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff930100610 0x7ff930100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.530+0000 7ff93679d700 1 -- 172.21.15.59:0/172445563 >> 172.21.15.59:0/172445563 conn(0x7ff9300fc120 msgr2=0x7ff9300fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:29.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.530+0000 7ff93679d700 1 -- 172.21.15.59:0/172445563 shutdown_connections 2023-10-08T12:43:29.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.530+0000 7ff93679d700 1 -- 172.21.15.59:0/172445563 wait complete. 2023-10-08T12:43:29.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.531+0000 7ff93679d700 1 Processor -- start 2023-10-08T12:43:29.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.531+0000 7ff93679d700 1 -- start start 2023-10-08T12:43:29.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.531+0000 7ff93679d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff930100610 0x7ff93019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff93679d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff930100fd0 0x7ff93019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff93679d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9301066b0 0x7ff930196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff93679d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff930196f00 con 0x7ff9301066b0 2023-10-08T12:43:29.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff93679d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff930197070 con 0x7ff930100fd0 2023-10-08T12:43:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff93679d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff930197230 con 0x7ff930100610 2023-10-08T12:43:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff934f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff930100fd0 0x7ff93019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff934f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff930100fd0 0x7ff93019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38970/0 (socket says 172.21.15.59:38970) 2023-10-08T12:43:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff934f9a700 1 -- 172.21.15.59:0/2939582374 learned_addr learned my addr 172.21.15.59:0/2939582374 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff935f9c700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9301066b0 0x7ff930196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff93579b700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff930100610 0x7ff93019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff934f9a700 1 -- 172.21.15.59:0/2939582374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff930100610 msgr2=0x7ff93019c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff934f9a700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff930100610 0x7ff93019c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff934f9a700 1 -- 172.21.15.59:0/2939582374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9301066b0 msgr2=0x7ff930196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff934f9a700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9301066b0 0x7ff930196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff934f9a700 1 -- 172.21.15.59:0/2939582374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c0095f0 con 0x7ff930100fd0 2023-10-08T12:43:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.532+0000 7ff935f9c700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9301066b0 0x7ff930196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.533+0000 7ff934f9a700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff930100fd0 0x7ff93019cbd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff92000e9a0 tx=0x7ff92000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.533+0000 7ff9267fc700 1 -- 172.21.15.59:0/2939582374 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920009790 con 0x7ff930100fd0 2023-10-08T12:43:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.533+0000 7ff9267fc700 1 -- 172.21.15.59:0/2939582374 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff92000cbd0 con 0x7ff930100fd0 2023-10-08T12:43:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.533+0000 7ff93679d700 1 -- 172.21.15.59:0/2939582374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff930197510 con 0x7ff930100fd0 2023-10-08T12:43:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.533+0000 7ff9267fc700 1 -- 172.21.15.59:0/2939582374 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920018680 con 0x7ff930100fd0 2023-10-08T12:43:29.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.533+0000 7ff93679d700 1 -- 172.21.15.59:0/2939582374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9301a36c0 con 0x7ff930100fd0 2023-10-08T12:43:29.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.534+0000 7ff93679d700 1 -- 172.21.15.59:0/2939582374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff930108c10 con 0x7ff930100fd0 2023-10-08T12:43:29.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.536+0000 7ff9267fc700 1 -- 172.21.15.59:0/2939582374 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff92000cd40 con 0x7ff930100fd0 2023-10-08T12:43:29.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.538+0000 7ff9267fc700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff91c0a1670 0x7ff91c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:29.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.538+0000 7ff9267fc700 1 -- 172.21.15.59:0/2939582374 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff920014070 con 0x7ff930100fd0 2023-10-08T12:43:29.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.538+0000 7ff93579b700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff91c0a1670 0x7ff91c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:29.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.539+0000 7ff93579b700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff91c0a1670 0x7ff91c0a3b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff92c006010 tx=0x7ff92c00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:29.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.540+0000 7ff9267fc700 1 -- 172.21.15.59:0/2939582374 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff9200966f0 con 0x7ff930100fd0 2023-10-08T12:43:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.821+0000 7ff93679d700 1 -- 172.21.15.59:0/2939582374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff930197d30 con 0x7ff930100fd0 2023-10-08T12:43:29.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.821+0000 7ff9267fc700 1 -- 172.21.15.59:0/2939582374 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7ff920099d10 con 0x7ff930100fd0 2023-10-08T12:43:29.821 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:43:29.821 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:43:29.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 -- 172.21.15.59:0/2939582374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff91c0a1670 msgr2=0x7ff91c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff91c0a1670 0x7ff91c0a3b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff92c006010 tx=0x7ff92c00b260 comp rx=0 tx=0).stop 2023-10-08T12:43:29.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 -- 172.21.15.59:0/2939582374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff930100fd0 msgr2=0x7ff93019cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:29.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff930100fd0 0x7ff93019cbd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff92000e9a0 tx=0x7ff92000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 -- 172.21.15.59:0/2939582374 shutdown_connections 2023-10-08T12:43:29.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff91c0a1670 0x7ff91c0a3b30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9301066b0 0x7ff930196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff930100610 0x7ff93019c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 --2- 172.21.15.59:0/2939582374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff930100fd0 0x7ff93019cbd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:29.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 -- 172.21.15.59:0/2939582374 >> 172.21.15.59:0/2939582374 conn(0x7ff9300fc120 msgr2=0x7ff9300fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:29.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 -- 172.21.15.59:0/2939582374 shutdown_connections 2023-10-08T12:43:29.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:29.824+0000 7ff93679d700 1 -- 172.21.15.59:0/2939582374 wait complete. 2023-10-08T12:43:29.826 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:43:29.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:43:30.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.070+0000 7fb94bbff700 1 -- 172.21.15.59:0/2604400491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb944105b80 msgr2=0x7fb94410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:30.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.070+0000 7fb94bbff700 1 --2- 172.21.15.59:0/2604400491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb944105b80 0x7fb94410d590 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009fc0 tx=0x7fb93c00b330 comp rx=0 tx=0).stop 2023-10-08T12:43:30.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.070+0000 7fb94bbff700 1 -- 172.21.15.59:0/2604400491 shutdown_connections 2023-10-08T12:43:30.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.070+0000 7fb94bbff700 1 --2- 172.21.15.59:0/2604400491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb944067ce0 0x7fb9440680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.070+0000 7fb94bbff700 1 --2- 172.21.15.59:0/2604400491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb944105b80 0x7fb94410d590 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.070+0000 7fb94bbff700 1 --2- 172.21.15.59:0/2604400491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9441051c0 0x7fb944105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.070+0000 7fb94bbff700 1 -- 172.21.15.59:0/2604400491 >> 172.21.15.59:0/2604400491 conn(0x7fb944076780 msgr2=0x7fb944076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:30.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.071+0000 7fb94bbff700 1 -- 172.21.15.59:0/2604400491 shutdown_connections 2023-10-08T12:43:30.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.071+0000 7fb94bbff700 1 -- 172.21.15.59:0/2604400491 wait complete. 2023-10-08T12:43:30.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.072+0000 7fb94bbff700 1 Processor -- start 2023-10-08T12:43:30.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.072+0000 7fb94bbff700 1 -- start start 2023-10-08T12:43:30.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.072+0000 7fb94bbff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb944067ce0 0x7fb94419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.072+0000 7fb94bbff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9441051c0 0x7fb94419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.072+0000 7fb94bbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb944105b80 0x7fb944196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.072+0000 7fb94bbff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9441971d0 con 0x7fb944067ce0 2023-10-08T12:43:30.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.072+0000 7fb94bbff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb944197340 con 0x7fb9441051c0 2023-10-08T12:43:30.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.072+0000 7fb94bbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb944197500 con 0x7fb944105b80 2023-10-08T12:43:30.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.073+0000 7fb94999b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb944067ce0 0x7fb94419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.073+0000 7fb94919a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9441051c0 0x7fb94419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.073+0000 7fb94a19c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb944105b80 0x7fb944196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.073+0000 7fb94919a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9441051c0 0x7fb94419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38994/0 (socket says 172.21.15.59:38994) 2023-10-08T12:43:30.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.073+0000 7fb94919a700 1 -- 172.21.15.59:0/3898325337 learned_addr learned my addr 172.21.15.59:0/3898325337 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:30.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.073+0000 7fb94a19c700 1 -- 172.21.15.59:0/3898325337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9441051c0 msgr2=0x7fb94419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:30.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.073+0000 7fb94a19c700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9441051c0 0x7fb94419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.073+0000 7fb94a19c700 1 -- 172.21.15.59:0/3898325337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb944067ce0 msgr2=0x7fb94419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:30.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.073+0000 7fb94a19c700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb944067ce0 0x7fb94419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.073+0000 7fb94a19c700 1 -- 172.21.15.59:0/3898325337 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c009c40 con 0x7fb944105b80 2023-10-08T12:43:30.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.073+0000 7fb94a19c700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb944105b80 0x7fb944196b70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb93c015000 tx=0x7fb93c0093b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:30.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.074+0000 7fb93affd700 1 -- 172.21.15.59:0/3898325337 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c00e040 con 0x7fb944105b80 2023-10-08T12:43:30.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.074+0000 7fb93affd700 1 -- 172.21.15.59:0/3898325337 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb93c01b450 con 0x7fb944105b80 2023-10-08T12:43:30.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.074+0000 7fb94bbff700 1 -- 172.21.15.59:0/3898325337 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb944197780 con 0x7fb944105b80 2023-10-08T12:43:30.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.074+0000 7fb93affd700 1 -- 172.21.15.59:0/3898325337 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0052a0 con 0x7fb944105b80 2023-10-08T12:43:30.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.074+0000 7fb94bbff700 1 -- 172.21.15.59:0/3898325337 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9441a39e0 con 0x7fb944105b80 2023-10-08T12:43:30.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.078+0000 7fb93affd700 1 -- 172.21.15.59:0/3898325337 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb93c01b8c0 con 0x7fb944105b80 2023-10-08T12:43:30.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.079+0000 7fb95f5bab80 1 Processor -- start 2023-10-08T12:43:30.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.079+0000 7fb95f5bab80 1 -- start start 2023-10-08T12:43:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.079+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d156e80 0x55674d157260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.079+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d166520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d166a60 0x55674d168e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674d0c0460 con 0x55674d156e80 2023-10-08T12:43:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674d0b1c20 con 0x55674d1577a0 2023-10-08T12:43:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674d0af540 con 0x55674d166a60 2023-10-08T12:43:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb94999b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d166520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb94999b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d166520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:39006/0 (socket says 172.21.15.59:39006) 2023-10-08T12:43:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb94999b700 1 -- 172.21.15.59:0/3656142996 learned_addr learned my addr 172.21.15.59:0/3656142996 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb94919a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d156e80 0x55674d157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb94919a700 1 --2- 172.21.15.59:0/3656142996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d166a60 0x55674d168e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb94999b700 1 -- 172.21.15.59:0/3656142996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d166a60 msgr2=0x55674d168e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb94999b700 1 --2- 172.21.15.59:0/3656142996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d166a60 0x55674d168e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb94999b700 1 -- 172.21.15.59:0/3656142996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d156e80 msgr2=0x55674d157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb94999b700 1 --2- 172.21.15.59:0/3656142996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d156e80 0x55674d157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb94999b700 1 -- 172.21.15.59:0/3656142996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55674ced5de0 con 0x55674d1577a0 2023-10-08T12:43:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb94919a700 1 --2- 172.21.15.59:0/3656142996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d156e80 0x55674d157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb93affd700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb9300a1670 0x7fb9300a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.080+0000 7fb93affd700 1 -- 172.21.15.59:0/3898325337 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb93c0ce200 con 0x7fb944105b80 2023-10-08T12:43:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.081+0000 7fb94999b700 1 --2- 172.21.15.59:0/3656142996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d166520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb940009d90 tx=0x7fb940011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=508a0c45ec30b78 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.081+0000 7fb94919a700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb9300a1670 0x7fb9300a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.081+0000 7fb92ffff700 1 -- 172.21.15.59:0/3656142996 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940019630 con 0x55674d1577a0 2023-10-08T12:43:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.081+0000 7fb92ffff700 1 -- 172.21.15.59:0/3656142996 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb940019c50 con 0x55674d1577a0 2023-10-08T12:43:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.081+0000 7fb92ffff700 1 -- 172.21.15.59:0/3656142996 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000ec50 con 0x55674d1577a0 2023-10-08T12:43:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.082+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3656142996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 msgr2=0x55674d166520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.082+0000 7fb94919a700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb9300a1670 0x7fb9300a3b30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb9340096b0 tx=0x7fb934015040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.082+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/3656142996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d166520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb940009d90 tx=0x7fb940011720 comp rx=0 tx=0).stop 2023-10-08T12:43:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.082+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3656142996 shutdown_connections 2023-10-08T12:43:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.082+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/3656142996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d166a60 0x55674d168e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.082+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/3656142996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d156e80 0x55674d157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.082+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/3656142996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d166520 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.082+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3656142996 >> 172.21.15.59:0/3656142996 conn(0x55674d0cc260 msgr2=0x55674d1532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.082+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3656142996 shutdown_connections 2023-10-08T12:43:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.082+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3656142996 wait complete. 2023-10-08T12:43:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.083+0000 7fb95f5bab80 1 -- start start 2023-10-08T12:43:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.083+0000 7fb95f5bab80 1 Processor -- start 2023-10-08T12:43:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.083+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d156e80 0x55674d166410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.083+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d163750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.083+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d166a60 0x55674d163d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.083+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674d0aae30 con 0x55674d156e80 2023-10-08T12:43:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.083+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674d047710 con 0x55674d1577a0 2023-10-08T12:43:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.083+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674d0473b0 con 0x55674d166a60 2023-10-08T12:43:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.083+0000 7fb95f5bab80 10 client.0 _ll_register_callbacks cb 0x55674cea4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94919a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d163750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94919a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d163750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:39022/0 (socket says 172.21.15.59:39022) 2023-10-08T12:43:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94919a700 1 -- 172.21.15.59:0/2793089740 learned_addr learned my addr 172.21.15.59:0/2793089740 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94a19c700 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d166a60 0x55674d163d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94999b700 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d156e80 0x55674d166410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94919a700 1 -- 172.21.15.59:0/2793089740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d166a60 msgr2=0x55674d163d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94919a700 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d166a60 0x55674d163d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94919a700 1 -- 172.21.15.59:0/2793089740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d156e80 msgr2=0x55674d166410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94919a700 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d156e80 0x55674d166410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94919a700 1 -- 172.21.15.59:0/2793089740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9400099c0 con 0x55674d1577a0 2023-10-08T12:43:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94a19c700 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d166a60 0x55674d163d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb94919a700 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d163750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb934011ba0 tx=0x7fb9340095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4a649212f80c336 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.084+0000 7fb92d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:43:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.085+0000 7fb92d7fa700 1 -- 172.21.15.59:0/2793089740 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934020860 con 0x55674d1577a0 2023-10-08T12:43:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.085+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2793089740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55674d072eb0 con 0x55674d1577a0 2023-10-08T12:43:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.085+0000 7fb92d7fa700 1 -- 172.21.15.59:0/2793089740 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb9340209c0 con 0x55674d1577a0 2023-10-08T12:43:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.085+0000 7fb92d7fa700 1 -- 172.21.15.59:0/2793089740 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb934020b80 con 0x55674d1577a0 2023-10-08T12:43:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.085+0000 7fb95f5bab80 10 client.25700 fetch_fsmap learned FSMap version 20 2023-10-08T12:43:30.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.085+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2793089740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55674cebec60 con 0x55674d1577a0 2023-10-08T12:43:30.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.085+0000 7fb92d7fa700 1 -- 172.21.15.59:0/2793089740 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55674d072eb0 con 0x55674d1577a0 2023-10-08T12:43:30.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.085+0000 7fb92d7fa700 1 -- 172.21.15.59:0/2793089740 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb93402a430 con 0x55674d1577a0 2023-10-08T12:43:30.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.086+0000 7fb95f5bab80 10 client.25700 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:43:30.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.086+0000 7fb95f5bab80 10 client.25700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:30.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.086+0000 7fb95f5bab80 20 client.25700 populate_metadata read hostname 'smithi059' 2023-10-08T12:43:30.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.086+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55674d176650 0x55674d178a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.086+0000 7fb95f5bab80 4 client.25700 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:30.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.086+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2793089740 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55674d0a3e10 con 0x55674d176650 2023-10-08T12:43:30.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.086+0000 7fb94999b700 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55674d176650 0x55674d178a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.086+0000 7fb94999b700 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55674d176650 0x55674d178a70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2267b94e05cf2123 server_cookie=3211b18a86f7e831 in_seq=0 out_seq=0 2023-10-08T12:43:30.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.086+0000 7fb92d7fa700 10 client.25700 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:30.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb92d7fa700 1 -- 172.21.15.59:0/2793089740 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55674d0a3e10 con 0x55674d176650 2023-10-08T12:43:30.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb92d7fa700 10 client.25700 handle_command_reply: tid=0 2023-10-08T12:43:30.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb95f5bab80 1 client.25700 shutdown 2023-10-08T12:43:30.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2793089740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 msgr2=0x55674d163750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:30.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d163750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb934011ba0 tx=0x7fb9340095c0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2793089740 shutdown_connections 2023-10-08T12:43:30.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55674d176650 0x55674d178a70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d166a60 0x55674d163d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d156e80 0x55674d166410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/2793089740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d163750 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb92d7fa700 0 client.25700 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:30.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.087+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2793089740 >> 172.21.15.59:0/2793089740 conn(0x55674d0cc260 msgr2=0x55674d152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:30.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.088+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2793089740 shutdown_connections 2023-10-08T12:43:30.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.088+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2793089740 wait complete. 2023-10-08T12:43:30.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.088+0000 7fb95f5bab80 20 client.25700 trim_cache size 0 max 16384 2023-10-08T12:43:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb95f5bab80 1 Processor -- start 2023-10-08T12:43:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb95f5bab80 1 -- start start 2023-10-08T12:43:30.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d156e80 0x55674d16d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d1577a0 0x55674d152d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d166a60 0x55674d1532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674cf2b920 con 0x55674d166a60 2023-10-08T12:43:30.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674d16daf0 con 0x55674d156e80 2023-10-08T12:43:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674d1548b0 con 0x55674d1577a0 2023-10-08T12:43:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb94919a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d1577a0 0x55674d152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb94999b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d156e80 0x55674d16d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb94919a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d1577a0 0x55674d152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:45150/0 (socket says 172.21.15.59:45150) 2023-10-08T12:43:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb94919a700 1 -- 172.21.15.59:0/2960756439 learned_addr learned my addr 172.21.15.59:0/2960756439 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.103+0000 7fb94a19c700 1 --2- 172.21.15.59:0/2960756439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d166a60 0x55674d1532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.104+0000 7fb94919a700 1 -- 172.21.15.59:0/2960756439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d156e80 msgr2=0x55674d16d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.104+0000 7fb94919a700 1 --2- 172.21.15.59:0/2960756439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d156e80 0x55674d16d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.104+0000 7fb94919a700 1 -- 172.21.15.59:0/2960756439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d166a60 msgr2=0x55674d1532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.104+0000 7fb94919a700 1 --2- 172.21.15.59:0/2960756439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d166a60 0x55674d1532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.104+0000 7fb94919a700 1 -- 172.21.15.59:0/2960756439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55674cefc250 con 0x55674d1577a0 2023-10-08T12:43:30.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.104+0000 7fb94999b700 1 --2- 172.21.15.59:0/2960756439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d156e80 0x55674d16d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:30.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.104+0000 7fb94919a700 1 --2- 172.21.15.59:0/2960756439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d1577a0 0x55674d152d70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb93402a8e0 tx=0x7fb934011f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db2b8da9a4186272 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:30.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.104+0000 7fb938bff700 1 -- 172.21.15.59:0/2960756439 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93402a430 con 0x55674d1577a0 2023-10-08T12:43:30.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.104+0000 7fb938bff700 1 -- 172.21.15.59:0/2960756439 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb934025070 con 0x55674d1577a0 2023-10-08T12:43:30.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.104+0000 7fb938bff700 1 -- 172.21.15.59:0/2960756439 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934020d10 con 0x55674d1577a0 2023-10-08T12:43:30.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.105+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2960756439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d1577a0 msgr2=0x55674d152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:30.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.105+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/2960756439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d1577a0 0x55674d152d70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb93402a8e0 tx=0x7fb934011f70 comp rx=0 tx=0).stop 2023-10-08T12:43:30.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.105+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2960756439 shutdown_connections 2023-10-08T12:43:30.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.105+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/2960756439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d156e80 0x55674d16d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.105+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/2960756439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d166a60 0x55674d1532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.105+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/2960756439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d1577a0 0x55674d152d70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.105+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2960756439 >> 172.21.15.59:0/2960756439 conn(0x55674d0cc260 msgr2=0x55674d15ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:30.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.105+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2960756439 shutdown_connections 2023-10-08T12:43:30.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.105+0000 7fb95f5bab80 1 -- 172.21.15.59:0/2960756439 wait complete. 2023-10-08T12:43:30.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.105+0000 7fb95f5bab80 1 -- start start 2023-10-08T12:43:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.106+0000 7fb95f5bab80 1 Processor -- start 2023-10-08T12:43:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.106+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d156e80 0x55674d16d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.106+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d16b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.106+0000 7fb95f5bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d166a60 0x55674d16bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.106+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674d16c4a0 con 0x55674d166a60 2023-10-08T12:43:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.106+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674d16c610 con 0x55674d1577a0 2023-10-08T12:43:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.106+0000 7fb95f5bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55674d1ca490 con 0x55674d156e80 2023-10-08T12:43:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.106+0000 7fb95f5bab80 10 client.0 _ll_register_callbacks cb 0x7fb934011750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb94999b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d156e80 0x55674d16d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb94999b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d156e80 0x55674d16d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:45154/0 (socket says 172.21.15.59:45154) 2023-10-08T12:43:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb94999b700 1 -- 172.21.15.59:0/3216892516 learned_addr learned my addr 172.21.15.59:0/3216892516 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb94919a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d16b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb94a19c700 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d166a60 0x55674d16bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb94999b700 1 -- 172.21.15.59:0/3216892516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 msgr2=0x55674d16b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb94999b700 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d16b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb94999b700 1 -- 172.21.15.59:0/3216892516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d166a60 msgr2=0x55674d16bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb94999b700 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d166a60 0x55674d16bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb94999b700 1 -- 172.21.15.59:0/3216892516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55674ced5de0 con 0x55674d156e80 2023-10-08T12:43:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb94999b700 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d156e80 0x55674d16d4a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb94001c040 tx=0x7fb94000e7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3870ec5419cbf0e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb92d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:43:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb92d7fa700 1 -- 172.21.15.59:0/3216892516 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940029040 con 0x55674d156e80 2023-10-08T12:43:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3216892516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb940019c50 con 0x55674d156e80 2023-10-08T12:43:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.107+0000 7fb92d7fa700 1 -- 172.21.15.59:0/3216892516 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb94002c530 con 0x55674d156e80 2023-10-08T12:43:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb92d7fa700 1 -- 172.21.15.59:0/3216892516 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb94002c880 con 0x55674d156e80 2023-10-08T12:43:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb95f5bab80 10 client.25696 fetch_fsmap learned FSMap version 20 2023-10-08T12:43:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3216892516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55674cebec60 con 0x55674d156e80 2023-10-08T12:43:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb92d7fa700 1 -- 172.21.15.59:0/3216892516 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb940019c50 con 0x55674d156e80 2023-10-08T12:43:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb92d7fa700 1 -- 172.21.15.59:0/3216892516 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb94002c050 con 0x55674d156e80 2023-10-08T12:43:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb95f5bab80 10 client.25696 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:43:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb95f5bab80 10 client.25696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb95f5bab80 20 client.25696 populate_metadata read hostname 'smithi059' 2023-10-08T12:43:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55674d1cbbc0 0x55674d1cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb95f5bab80 4 client.25696 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:43:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3216892516 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55674d0a3b30 con 0x55674d1cbbc0 2023-10-08T12:43:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.108+0000 7fb94919a700 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55674d1cbbc0 0x55674d1cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb94919a700 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55674d1cbbc0 0x55674d1cdfe0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=480f8b2848b50213 server_cookie=74d6d74d3648a4ff in_seq=0 out_seq=0 2023-10-08T12:43:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb92d7fa700 10 client.25696 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb92d7fa700 1 -- 172.21.15.59:0/3216892516 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55674d0a3b30 con 0x55674d1cbbc0 2023-10-08T12:43:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb92d7fa700 10 client.25696 handle_command_reply: tid=0 2023-10-08T12:43:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb95f5bab80 1 client.25696 shutdown 2023-10-08T12:43:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3216892516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d156e80 msgr2=0x55674d16d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d156e80 0x55674d16d4a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb94001c040 tx=0x7fb94000e7b0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3216892516 shutdown_connections 2023-10-08T12:43:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55674d1cbbc0 0x55674d1cdfe0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55674d166a60 0x55674d16bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674d156e80 0x55674d16d4a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb92d7fa700 0 client.25696 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.109+0000 7fb95f5bab80 1 --2- 172.21.15.59:0/3216892516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674d1577a0 0x55674d16b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.110+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3216892516 >> 172.21.15.59:0/3216892516 conn(0x55674d0cc260 msgr2=0x55674d15ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.110+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3216892516 shutdown_connections 2023-10-08T12:43:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.110+0000 7fb95f5bab80 1 -- 172.21.15.59:0/3216892516 wait complete. 2023-10-08T12:43:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.110+0000 7fb95f5bab80 20 client.25696 trim_cache size 0 max 16384 2023-10-08T12:43:30.117 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:43:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 -- 172.21.15.59:0/3898325337 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb9300a1670 msgr2=0x7fb9300a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb9300a1670 0x7fb9300a3b30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb9340096b0 tx=0x7fb934015040 comp rx=0 tx=0).stop 2023-10-08T12:43:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 -- 172.21.15.59:0/3898325337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb944105b80 msgr2=0x7fb944196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb944105b80 0x7fb944196b70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb93c015000 tx=0x7fb93c0093b0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 -- 172.21.15.59:0/3898325337 shutdown_connections 2023-10-08T12:43:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb9300a1670 0x7fb9300a3b30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb944105b80 0x7fb944196b70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb944067ce0 0x7fb94419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 --2- 172.21.15.59:0/3898325337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9441051c0 0x7fb94419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 -- 172.21.15.59:0/3898325337 >> 172.21.15.59:0/3898325337 conn(0x7fb944076780 msgr2=0x7fb9440fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 -- 172.21.15.59:0/3898325337 shutdown_connections 2023-10-08T12:43:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:30.111+0000 7fb94bbff700 1 -- 172.21.15.59:0/3898325337 wait complete. 2023-10-08T12:43:30.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:29 smithi092 ceph-mon[134093]: pgmap v383: 97 pgs: 97 active+clean; 92 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 216 op/s 2023-10-08T12:43:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:29 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:43:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:29 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:43:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:29 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:43:30.128 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:29 smithi059 ceph-mon[98489]: pgmap v383: 97 pgs: 97 active+clean; 92 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 216 op/s 2023-10-08T12:43:30.128 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:29 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:43:30.128 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:29 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:43:30.128 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:29 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:43:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:29 smithi173 ceph-mon[135182]: pgmap v383: 97 pgs: 97 active+clean; 92 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 216 op/s 2023-10-08T12:43:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:29 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:43:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:29 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:43:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:29 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:43:30.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 169303 15.21 MB/sec warmup 61 sec latency 9.993 ms 2023-10-08T12:43:31.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:30 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:43:31.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:30 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:43:31.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:30 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:43:31.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:30 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2939582374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:43:31.130 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:43:31.130 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:43:31.195 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:30 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:43:31.195 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:30 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:43:31.195 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:30 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:43:31.195 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:30 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2939582374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:43:31.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:30 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:43:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:30 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:43:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:30 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:43:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:30 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2939582374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:43:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.352+0000 7f90d11ff700 1 -- 172.21.15.59:0/246532762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc106740 msgr2=0x7f90cc106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.352+0000 7f90d11ff700 1 --2- 172.21.15.59:0/246532762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc106740 0x7f90cc106b20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009990 tx=0x7f90bc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.353+0000 7f90d11ff700 1 -- 172.21.15.59:0/246532762 shutdown_connections 2023-10-08T12:43:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.353+0000 7f90d11ff700 1 --2- 172.21.15.59:0/246532762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90cc1010f0 0x7f90cc10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.353+0000 7f90d11ff700 1 --2- 172.21.15.59:0/246532762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc106740 0x7f90cc106b20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.353+0000 7f90d11ff700 1 --2- 172.21.15.59:0/246532762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc100730 0x7f90cc100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.353+0000 7f90d11ff700 1 -- 172.21.15.59:0/246532762 >> 172.21.15.59:0/246532762 conn(0x7f90cc0fc200 msgr2=0x7f90cc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.353+0000 7f90d11ff700 1 -- 172.21.15.59:0/246532762 shutdown_connections 2023-10-08T12:43:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.353+0000 7f90d11ff700 1 -- 172.21.15.59:0/246532762 wait complete. 2023-10-08T12:43:31.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.354+0000 7f90d11ff700 1 Processor -- start 2023-10-08T12:43:31.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.354+0000 7f90d11ff700 1 -- start start 2023-10-08T12:43:31.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.354+0000 7f90d11ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc100730 0x7f90cc198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.354+0000 7f90d11ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90cc1010f0 0x7f90cc1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.354+0000 7f90d11ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc106740 0x7f90cc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.354+0000 7f90d11ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc19dcc0 con 0x7f90cc100730 2023-10-08T12:43:31.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.354+0000 7f90d11ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc19de30 con 0x7f90cc1010f0 2023-10-08T12:43:31.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.354+0000 7f90d11ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc19dff0 con 0x7f90cc106740 2023-10-08T12:43:31.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90ca59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90cc1010f0 0x7f90cc1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc100730 0x7f90cc198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90ca59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90cc1010f0 0x7f90cc1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57720/0 (socket says 172.21.15.59:57720) 2023-10-08T12:43:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90ca59c700 1 -- 172.21.15.59:0/1184188631 learned_addr learned my addr 172.21.15.59:0/1184188631 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90cb59e700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc106740 0x7f90cc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90ca59c700 1 -- 172.21.15.59:0/1184188631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc106740 msgr2=0x7f90cc19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90ca59c700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc106740 0x7f90cc19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90ca59c700 1 -- 172.21.15.59:0/1184188631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc100730 msgr2=0x7f90cc198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90ca59c700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc100730 0x7f90cc198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90ca59c700 1 -- 172.21.15.59:0/1184188631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4009c40 con 0x7f90cc1010f0 2023-10-08T12:43:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90ca59c700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90cc1010f0 0x7f90cc1992e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90c000e9a0 tx=0x7f90c000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.355+0000 7f90b3fff700 1 -- 172.21.15.59:0/1184188631 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0009790 con 0x7f90cc1010f0 2023-10-08T12:43:31.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.356+0000 7f90b3fff700 1 -- 172.21.15.59:0/1184188631 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90c000cbd0 con 0x7f90cc1010f0 2023-10-08T12:43:31.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.356+0000 7f90d11ff700 1 -- 172.21.15.59:0/1184188631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc0095f0 con 0x7f90cc1010f0 2023-10-08T12:43:31.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.356+0000 7f90b3fff700 1 -- 172.21.15.59:0/1184188631 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0018680 con 0x7f90cc1010f0 2023-10-08T12:43:31.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.356+0000 7f90d11ff700 1 -- 172.21.15.59:0/1184188631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc19e4c0 con 0x7f90cc1010f0 2023-10-08T12:43:31.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.359+0000 7f90b3fff700 1 -- 172.21.15.59:0/1184188631 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f90c000cd40 con 0x7f90cc1010f0 2023-10-08T12:43:31.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.360+0000 7f90e4b29b80 1 Processor -- start 2023-10-08T12:43:31.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.360+0000 7f90e4b29b80 1 -- start start 2023-10-08T12:43:31.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbdf00 0x55e648dbe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648dc9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 0x55e648dcbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648d274e0 con 0x55e648dbe820 2023-10-08T12:43:31.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648d18ca0 con 0x55e648dc96d0 2023-10-08T12:43:31.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648d165c0 con 0x55e648dbdf00 2023-10-08T12:43:31.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90b3fff700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f90b40a1670 0x7f90b40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90ca59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 0x55e648dcbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90cb59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbdf00 0x55e648dbe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648dc9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90cb59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbdf00 0x55e648dbe2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:37662/0 (socket says 172.21.15.59:37662) 2023-10-08T12:43:31.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.361+0000 7f90cb59e700 1 -- 172.21.15.59:0/3260653794 learned_addr learned my addr 172.21.15.59:0/3260653794 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:31.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90cb59e700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f90b40a1670 0x7f90b40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90b3fff700 1 -- 172.21.15.59:0/1184188631 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f90c0014070 con 0x7f90cc1010f0 2023-10-08T12:43:31.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90cad9d700 1 -- 172.21.15.59:0/3260653794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbdf00 msgr2=0x55e648dbe2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90cad9d700 1 --2- 172.21.15.59:0/3260653794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbdf00 0x55e648dbe2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90cad9d700 1 -- 172.21.15.59:0/3260653794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 msgr2=0x55e648dcbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90cad9d700 1 --2- 172.21.15.59:0/3260653794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 0x55e648dcbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90cad9d700 1 -- 172.21.15.59:0/3260653794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e648b3ce60 con 0x55e648dbe820 2023-10-08T12:43:31.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90ca59c700 1 --2- 172.21.15.59:0/3260653794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 0x55e648dcbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:31.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90cad9d700 1 --2- 172.21.15.59:0/3260653794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648dc9190 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f90bc006010 tx=0x7f90bc00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f680cec2ab0d5c5b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90cb59e700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f90b40a1670 0x7f90b40a3b30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009fd0 tx=0x7f90c4009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90b17fa700 1 -- 172.21.15.59:0/3260653794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc01d070 con 0x55e648dbe820 2023-10-08T12:43:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90b17fa700 1 -- 172.21.15.59:0/3260653794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90bc01e040 con 0x55e648dbe820 2023-10-08T12:43:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.362+0000 7f90b17fa700 1 -- 172.21.15.59:0/3260653794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc004760 con 0x55e648dbe820 2023-10-08T12:43:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.363+0000 7f90e4b29b80 1 -- 172.21.15.59:0/3260653794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 msgr2=0x55e648dc9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.363+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/3260653794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648dc9190 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f90bc006010 tx=0x7f90bc00b610 comp rx=0 tx=0).stop 2023-10-08T12:43:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.363+0000 7f90e4b29b80 1 -- 172.21.15.59:0/3260653794 shutdown_connections 2023-10-08T12:43:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.363+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/3260653794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 0x55e648dcbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.363+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/3260653794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbdf00 0x55e648dbe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.363+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/3260653794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648dc9190 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.363+0000 7f90e4b29b80 1 -- 172.21.15.59:0/3260653794 >> 172.21.15.59:0/3260653794 conn(0x55e648d332e0 msgr2=0x55e648dba350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.363+0000 7f90e4b29b80 1 -- 172.21.15.59:0/3260653794 shutdown_connections 2023-10-08T12:43:31.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.363+0000 7f90e4b29b80 1 -- 172.21.15.59:0/3260653794 wait complete. 2023-10-08T12:43:31.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.364+0000 7f90e4b29b80 1 -- start start 2023-10-08T12:43:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.364+0000 7f90e4b29b80 1 Processor -- start 2023-10-08T12:43:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbdf00 0x55e648dc9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbe820 0x55e648dc6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 0x55e648dc68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648d11eb0 con 0x55e648dbdf00 2023-10-08T12:43:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648cae790 con 0x55e648dc96d0 2023-10-08T12:43:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648cae430 con 0x55e648dbe820 2023-10-08T12:43:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90e4b29b80 10 client.0 _ll_register_callbacks cb 0x55e648b0b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90cb59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 0x55e648dc68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90cb59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 0x55e648dc68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57730/0 (socket says 172.21.15.59:57730) 2023-10-08T12:43:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90cb59e700 1 -- 172.21.15.59:0/2823965775 learned_addr learned my addr 172.21.15.59:0/2823965775 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90ca59c700 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbe820 0x55e648dc6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90cad9d700 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbdf00 0x55e648dc9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90ca59c700 1 -- 172.21.15.59:0/2823965775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 msgr2=0x55e648dc68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.365+0000 7f90ca59c700 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 0x55e648dc68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90ca59c700 1 -- 172.21.15.59:0/2823965775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbdf00 msgr2=0x55e648dc9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90ca59c700 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbdf00 0x55e648dc9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90ca59c700 1 -- 172.21.15.59:0/2823965775 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc19e4c0 con 0x55e648dbe820 2023-10-08T12:43:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90cb59e700 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 0x55e648dc68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:31.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90ca59c700 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbe820 0x55e648dc6300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f90c00caa30 tx=0x7f90c0096390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f38ebfbe736eefe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90aeff5700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90aeff5700 1 -- 172.21.15.59:0/2823965775 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c009a9c0 con 0x55e648dbe820 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90aeff5700 1 -- 172.21.15.59:0/2823965775 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f90c00cf2f0 con 0x55e648dbe820 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2823965775 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e648cd9f30 con 0x55e648dbe820 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90aeff5700 1 -- 172.21.15.59:0/2823965775 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90c009a2c0 con 0x55e648dbe820 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90e4b29b80 10 client.25708 fetch_fsmap learned FSMap version 20 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2823965775 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f90cc10df00 con 0x55e648dbe820 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.366+0000 7f90aeff5700 1 -- 172.21.15.59:0/2823965775 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e648cd9f30 con 0x55e648dbe820 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.367+0000 7f90aeff5700 1 -- 172.21.15.59:0/2823965775 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f90c00997b0 con 0x55e648dbe820 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.367+0000 7f90e4b29b80 10 client.25708 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.367+0000 7f90e4b29b80 10 client.25708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.367+0000 7f90e4b29b80 20 client.25708 populate_metadata read hostname 'smithi059' 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.367+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e648dd9080 0x55e648ddb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.367+0000 7f90e4b29b80 4 client.25708 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.367+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2823965775 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e648d0ae90 con 0x55e648dd9080 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.367+0000 7f90cad9d700 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e648dd9080 0x55e648ddb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.367+0000 7f90cad9d700 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e648dd9080 0x55e648ddb4a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8164aa3a6a373308 server_cookie=5d930ac04b0303ba in_seq=0 out_seq=0 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.367+0000 7f90aeff5700 10 client.25708 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.368+0000 7f90aeff5700 1 -- 172.21.15.59:0/2823965775 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e648d0ae90 con 0x55e648dd9080 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.368+0000 7f90aeff5700 10 client.25708 handle_command_reply: tid=0 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.368+0000 7f90e4b29b80 1 client.25708 shutdown 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.368+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2823965775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbe820 msgr2=0x55e648dc6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.368+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbe820 0x55e648dc6300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f90c00caa30 tx=0x7f90c0096390 comp rx=0 tx=0).stop 2023-10-08T12:43:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.369+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2823965775 shutdown_connections 2023-10-08T12:43:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.369+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e648dd9080 0x55e648ddb4a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.369+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dc96d0 0x55e648dc68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.369+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbdf00 0x55e648dc9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.369+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2823965775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dbe820 0x55e648dc6300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.369+0000 7f90aeff5700 0 client.25708 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.369+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2823965775 >> 172.21.15.59:0/2823965775 conn(0x55e648d332e0 msgr2=0x55e648db9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.369+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2823965775 shutdown_connections 2023-10-08T12:43:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.369+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2823965775 wait complete. 2023-10-08T12:43:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.369+0000 7f90e4b29b80 20 client.25708 trim_cache size 0 max 16384 2023-10-08T12:43:31.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.387+0000 7f90e4b29b80 1 Processor -- start 2023-10-08T12:43:31.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.387+0000 7f90e4b29b80 1 -- start start 2023-10-08T12:43:31.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.387+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.387+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648db9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.387+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dc96d0 0x55e648dba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.387+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648b929a0 con 0x55e648dbe820 2023-10-08T12:43:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.387+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648db6b60 con 0x55e648dbdf00 2023-10-08T12:43:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.387+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648dbf150 con 0x55e648dc96d0 2023-10-08T12:43:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90ca59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648db9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57738/0 (socket says 172.21.15.59:57738) 2023-10-08T12:43:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90cad9d700 1 -- 172.21.15.59:0/1358983143 learned_addr learned my addr 172.21.15.59:0/1358983143 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90cb59e700 1 --2- 172.21.15.59:0/1358983143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dc96d0 0x55e648dba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90cad9d700 1 -- 172.21.15.59:0/1358983143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dc96d0 msgr2=0x55e648dba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90cad9d700 1 --2- 172.21.15.59:0/1358983143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dc96d0 0x55e648dba330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90cad9d700 1 -- 172.21.15.59:0/1358983143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 msgr2=0x55e648db9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90cad9d700 1 --2- 172.21.15.59:0/1358983143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648db9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90cad9d700 1 -- 172.21.15.59:0/1358983143 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e648b25ce0 con 0x55e648dbdf00 2023-10-08T12:43:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90cad9d700 1 --2- 172.21.15.59:0/1358983143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f90bc000c00 tx=0x7f90bc00b2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a36352260dc1e5c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.388+0000 7f90b1ffb700 1 -- 172.21.15.59:0/1358983143 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc01d040 con 0x55e648dbdf00 2023-10-08T12:43:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.389+0000 7f90b1ffb700 1 -- 172.21.15.59:0/1358983143 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90bc005320 con 0x55e648dbdf00 2023-10-08T12:43:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.389+0000 7f90b1ffb700 1 -- 172.21.15.59:0/1358983143 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc00bc90 con 0x55e648dbdf00 2023-10-08T12:43:31.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.389+0000 7f90e4b29b80 1 -- 172.21.15.59:0/1358983143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 msgr2=0x55e648dd01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.389+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/1358983143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f90bc000c00 tx=0x7f90bc00b2a0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.389+0000 7f90e4b29b80 1 -- 172.21.15.59:0/1358983143 shutdown_connections 2023-10-08T12:43:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.389+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/1358983143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.389+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/1358983143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dc96d0 0x55e648dba330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.389+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/1358983143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648db9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.389+0000 7f90e4b29b80 1 -- 172.21.15.59:0/1358983143 >> 172.21.15.59:0/1358983143 conn(0x55e648d332e0 msgr2=0x55e648dc4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.389+0000 7f90e4b29b80 1 -- 172.21.15.59:0/1358983143 shutdown_connections 2023-10-08T12:43:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.389+0000 7f90e4b29b80 1 -- 172.21.15.59:0/1358983143 wait complete. 2023-10-08T12:43:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.390+0000 7f90e4b29b80 1 -- start start 2023-10-08T12:43:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.390+0000 7f90e4b29b80 1 Processor -- start 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.390+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.390+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648dce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90e4b29b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dc96d0 0x55e648dce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648dcec20 con 0x55e648dbe820 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648dced90 con 0x55e648dbdf00 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90e4b29b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e648dcef50 con 0x55e648dc96d0 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90e4b29b80 10 client.0 _ll_register_callbacks cb 0x7f90c000eef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57742/0 (socket says 172.21.15.59:57742) 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90cad9d700 1 -- 172.21.15.59:0/2127966843 learned_addr learned my addr 172.21.15.59:0/2127966843 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90ca59c700 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648dce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90cb59e700 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dc96d0 0x55e648dce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90cad9d700 1 -- 172.21.15.59:0/2127966843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dc96d0 msgr2=0x55e648dce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90cad9d700 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dc96d0 0x55e648dce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90cad9d700 1 -- 172.21.15.59:0/2127966843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 msgr2=0x55e648dce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90cad9d700 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648dce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90cad9d700 1 -- 172.21.15.59:0/2127966843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e648b3ce60 con 0x55e648dbdf00 2023-10-08T12:43:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90ca59c700 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648dce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90cad9d700 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90bc005370 tx=0x7f90bc0053a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ec174ffc2e5ce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.391+0000 7f90aeff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:43:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.392+0000 7f90aeff5700 1 -- 172.21.15.59:0/2127966843 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc01d040 con 0x55e648dbdf00 2023-10-08T12:43:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.392+0000 7f90aeff5700 1 -- 172.21.15.59:0/2127966843 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f90bc032040 con 0x55e648dbdf00 2023-10-08T12:43:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.392+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2127966843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e648d0abb0 con 0x55e648dbdf00 2023-10-08T12:43:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.392+0000 7f90aeff5700 1 -- 172.21.15.59:0/2127966843 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90bc035a80 con 0x55e648dbdf00 2023-10-08T12:43:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.392+0000 7f90e4b29b80 10 client.25724 fetch_fsmap learned FSMap version 20 2023-10-08T12:43:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.392+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2127966843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e648b632d0 con 0x55e648dbdf00 2023-10-08T12:43:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.392+0000 7f90aeff5700 1 -- 172.21.15.59:0/2127966843 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e648d0abb0 con 0x55e648dbdf00 2023-10-08T12:43:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.392+0000 7f90aeff5700 1 -- 172.21.15.59:0/2127966843 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f90bc03d030 con 0x55e648dbdf00 2023-10-08T12:43:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.393+0000 7f90e4b29b80 10 client.25724 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:43:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.393+0000 7f90e4b29b80 10 client.25724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.393+0000 7f90e4b29b80 20 client.25724 populate_metadata read hostname 'smithi059' 2023-10-08T12:43:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.393+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e648e2efa0 0x55e648e31390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.393+0000 7f90e4b29b80 4 client.25724 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:43:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.393+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2127966843 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e648b5dff0 con 0x55e648e2efa0 2023-10-08T12:43:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.393+0000 7f90ca59c700 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e648e2efa0 0x55e648e31390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.393+0000 7f90ca59c700 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e648e2efa0 0x55e648e31390 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f33a60172e12297 server_cookie=849cdb8219ad4d26 in_seq=0 out_seq=0 2023-10-08T12:43:31.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.393+0000 7f90aeff5700 10 client.25724 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:31.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90aeff5700 1 -- 172.21.15.59:0/2127966843 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e648b5dff0 con 0x55e648e2efa0 2023-10-08T12:43:31.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90aeff5700 10 client.25724 handle_command_reply: tid=0 2023-10-08T12:43:31.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90e4b29b80 1 client.25724 shutdown 2023-10-08T12:43:31.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2127966843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 msgr2=0x55e648dd01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90bc005370 tx=0x7f90bc0053a0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2127966843 shutdown_connections 2023-10-08T12:43:31.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e648e2efa0 0x55e648e31390 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e648dbdf00 0x55e648dd01c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e648dc96d0 0x55e648dce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90e4b29b80 1 --2- 172.21.15.59:0/2127966843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e648dbe820 0x55e648dce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90aeff5700 0 client.25724 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:31.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.395+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2127966843 >> 172.21.15.59:0/2127966843 conn(0x55e648d332e0 msgr2=0x55e648dc4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2127966843 shutdown_connections 2023-10-08T12:43:31.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90e4b29b80 1 -- 172.21.15.59:0/2127966843 wait complete. 2023-10-08T12:43:31.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90e4b29b80 20 client.25724 trim_cache size 0 max 16384 2023-10-08T12:43:31.401 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:43:31.401 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:43:31.401 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "8ee10c04-8753-467b-b042-e3d301f6541d", 2023-10-08T12:43:31.401 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:43:31.401 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:43:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90d11ff700 1 -- 172.21.15.59:0/1184188631 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f90b40a1670 msgr2=0x7f90b40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90d11ff700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f90b40a1670 0x7f90b40a3b30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009fd0 tx=0x7f90c4009040 comp rx=0 tx=0).stop 2023-10-08T12:43:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90d11ff700 1 -- 172.21.15.59:0/1184188631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90cc1010f0 msgr2=0x7f90cc1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90d11ff700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90cc1010f0 0x7f90cc1992e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90c000e9a0 tx=0x7f90c000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90d11ff700 1 -- 172.21.15.59:0/1184188631 shutdown_connections 2023-10-08T12:43:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90d11ff700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f90b40a1670 0x7f90b40a3b30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90d11ff700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc106740 0x7f90cc19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90d11ff700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90cc100730 0x7f90cc198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90d11ff700 1 --2- 172.21.15.59:0/1184188631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90cc1010f0 0x7f90cc1992e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.396+0000 7f90d11ff700 1 -- 172.21.15.59:0/1184188631 >> 172.21.15.59:0/1184188631 conn(0x7f90cc0fc200 msgr2=0x7f90cc10be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.397+0000 7f90d11ff700 1 -- 172.21.15.59:0/1184188631 shutdown_connections 2023-10-08T12:43:31.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.397+0000 7f90d11ff700 1 -- 172.21.15.59:0/1184188631 wait complete. 2023-10-08T12:43:31.417 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:43:31.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 171831 15.23 MB/sec warmup 62 sec latency 12.469 ms 2023-10-08T12:43:31.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.644+0000 7f61e699d700 1 -- 172.21.15.59:0/3282730919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e0106660 msgr2=0x7f61e0106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.644+0000 7f61e699d700 1 --2- 172.21.15.59:0/3282730919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e0106660 0x7f61e0106a40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009990 tx=0x7f61dc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.644+0000 7f61e699d700 1 -- 172.21.15.59:0/3282730919 shutdown_connections 2023-10-08T12:43:31.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.644+0000 7f61e699d700 1 --2- 172.21.15.59:0/3282730919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e0100f60 0x7f61e010d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.644+0000 7f61e699d700 1 --2- 172.21.15.59:0/3282730919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e0106660 0x7f61e0106a40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.644+0000 7f61e699d700 1 --2- 172.21.15.59:0/3282730919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e01005a0 0x7f61e0100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.644+0000 7f61e699d700 1 -- 172.21.15.59:0/3282730919 >> 172.21.15.59:0/3282730919 conn(0x7f61e00fc090 msgr2=0x7f61e00fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.644+0000 7f61e699d700 1 -- 172.21.15.59:0/3282730919 shutdown_connections 2023-10-08T12:43:31.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.644+0000 7f61e699d700 1 -- 172.21.15.59:0/3282730919 wait complete. 2023-10-08T12:43:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.645+0000 7f61e699d700 1 Processor -- start 2023-10-08T12:43:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e699d700 1 -- start start 2023-10-08T12:43:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e699d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e01005a0 0x7f61e019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e699d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0100f60 0x7f61e019ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e699d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e0106660 0x7f61e0198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e699d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0199080 con 0x7f61e0100f60 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e699d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e01991f0 con 0x7f61e0106660 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e699d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e01993b0 con 0x7f61e01005a0 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e519a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0100f60 0x7f61e019ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e619c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e0106660 0x7f61e0198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e519a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0100f60 0x7f61e019ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58368/0 (socket says 172.21.15.59:58368) 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e519a700 1 -- 172.21.15.59:0/3143436230 learned_addr learned my addr 172.21.15.59:0/3143436230 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.646+0000 7f61e599b700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e01005a0 0x7f61e019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.647+0000 7f61e619c700 1 -- 172.21.15.59:0/3143436230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e01005a0 msgr2=0x7f61e019e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.647+0000 7f61e619c700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e01005a0 0x7f61e019e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.647+0000 7f61e619c700 1 -- 172.21.15.59:0/3143436230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0100f60 msgr2=0x7f61e019ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.647+0000 7f61e619c700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0100f60 0x7f61e019ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.647+0000 7f61e619c700 1 -- 172.21.15.59:0/3143436230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc0095f0 con 0x7f61e0106660 2023-10-08T12:43:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.647+0000 7f61e619c700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e0106660 0x7f61e0198a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f61d800efc0 tx=0x7f61d800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.647+0000 7f61d6ffd700 1 -- 172.21.15.59:0/3143436230 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8018070 con 0x7f61e0106660 2023-10-08T12:43:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.647+0000 7f61d6ffd700 1 -- 172.21.15.59:0/3143436230 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61d800f040 con 0x7f61e0106660 2023-10-08T12:43:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.647+0000 7f61d6ffd700 1 -- 172.21.15.59:0/3143436230 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d800cd40 con 0x7f61e0106660 2023-10-08T12:43:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.647+0000 7f61e699d700 1 -- 172.21.15.59:0/3143436230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e0199630 con 0x7f61e0106660 2023-10-08T12:43:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.647+0000 7f61e699d700 1 -- 172.21.15.59:0/3143436230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e01a58e0 con 0x7f61e0106660 2023-10-08T12:43:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.651+0000 7f61d6ffd700 1 -- 172.21.15.59:0/3143436230 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f61d8003a00 con 0x7f61e0106660 2023-10-08T12:43:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.652+0000 7f61fb61db80 1 Processor -- start 2023-10-08T12:43:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.652+0000 7f61fb61db80 1 -- start start 2023-10-08T12:43:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.652+0000 7f61d6ffd700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f61cc0a1670 0x7f61cc0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61d6ffd700 1 -- 172.21.15.59:0/3143436230 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f61d80ccc30 con 0x7f61e0106660 2023-10-08T12:43:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a9547430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61e519a700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f61cc0a1670 0x7f61cc0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a95522c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a9554bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61fb61db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a94b0460 con 0x55a8a9547970 2023-10-08T12:43:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61fb61db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a94a1c20 con 0x55a8a9547050 2023-10-08T12:43:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61fb61db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a949f540 con 0x55a8a9552800 2023-10-08T12:43:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61e599b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a9547430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61e599b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a9547430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57762/0 (socket says 172.21.15.59:57762) 2023-10-08T12:43:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61e599b700 1 -- 172.21.15.59:0/3932330720 learned_addr learned my addr 172.21.15.59:0/3932330720 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61e619c700 1 --2- 172.21.15.59:0/3932330720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a9554bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61e519a700 1 --2- 172.21.15.59:0/3932330720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a95522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61e599b700 1 -- 172.21.15.59:0/3932330720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 msgr2=0x55a8a9554bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61e599b700 1 --2- 172.21.15.59:0/3932330720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a9554bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61e599b700 1 -- 172.21.15.59:0/3932330720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 msgr2=0x55a8a95522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61e599b700 1 --2- 172.21.15.59:0/3932330720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a95522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.653+0000 7f61e599b700 1 -- 172.21.15.59:0/3932330720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8a92c5de0 con 0x55a8a9547050 2023-10-08T12:43:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.654+0000 7f61e599b700 1 --2- 172.21.15.59:0/3932330720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a9547430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f61dc005ec0 tx=0x7f61dc005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b50e131489ed113 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.654+0000 7f61e519a700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f61cc0a1670 0x7f61cc0a3b30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f61d00046e0 tx=0x7f61d0009810 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.654+0000 7f61cbfff700 1 -- 172.21.15.59:0/3932330720 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc01d070 con 0x55a8a9547050 2023-10-08T12:43:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.654+0000 7f61cbfff700 1 -- 172.21.15.59:0/3932330720 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61dc01e040 con 0x55a8a9547050 2023-10-08T12:43:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.654+0000 7f61cbfff700 1 -- 172.21.15.59:0/3932330720 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc004880 con 0x55a8a9547050 2023-10-08T12:43:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.655+0000 7f61fb61db80 1 -- 172.21.15.59:0/3932330720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 msgr2=0x55a8a9547430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.655+0000 7f61fb61db80 1 --2- 172.21.15.59:0/3932330720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a9547430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f61dc005ec0 tx=0x7f61dc005ef0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.655+0000 7f61fb61db80 1 -- 172.21.15.59:0/3932330720 shutdown_connections 2023-10-08T12:43:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.655+0000 7f61fb61db80 1 --2- 172.21.15.59:0/3932330720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a9547430 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.655+0000 7f61fb61db80 1 --2- 172.21.15.59:0/3932330720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a9554bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.655+0000 7f61fb61db80 1 --2- 172.21.15.59:0/3932330720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a95522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.655+0000 7f61fb61db80 1 -- 172.21.15.59:0/3932330720 >> 172.21.15.59:0/3932330720 conn(0x55a8a94bc260 msgr2=0x55a8a9543460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.655+0000 7f61fb61db80 1 -- 172.21.15.59:0/3932330720 shutdown_connections 2023-10-08T12:43:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.655+0000 7f61fb61db80 1 -- 172.21.15.59:0/3932330720 wait complete. 2023-10-08T12:43:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.656+0000 7f61fb61db80 1 -- start start 2023-10-08T12:43:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.656+0000 7f61fb61db80 1 Processor -- start 2023-10-08T12:43:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.656+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a9552240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.656+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a954f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.656+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a954fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.656+0000 7f61fb61db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a949ae30 con 0x55a8a9547970 2023-10-08T12:43:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.656+0000 7f61fb61db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a9437710 con 0x55a8a9547050 2023-10-08T12:43:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.656+0000 7f61fb61db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a94373b0 con 0x55a8a9552800 2023-10-08T12:43:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61fb61db80 10 client.0 _ll_register_callbacks cb 0x55a8a9294800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e519a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a954f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e599b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a9552240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e519a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a954f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58384/0 (socket says 172.21.15.59:58384) 2023-10-08T12:43:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e519a700 1 -- 172.21.15.59:0/4063467449 learned_addr learned my addr 172.21.15.59:0/4063467449 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e619c700 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a954fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e619c700 1 -- 172.21.15.59:0/4063467449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 msgr2=0x55a8a9552240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e619c700 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a9552240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e619c700 1 -- 172.21.15.59:0/4063467449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 msgr2=0x55a8a954f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e619c700 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a954f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e619c700 1 -- 172.21.15.59:0/4063467449 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e010dd20 con 0x55a8a9552800 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e519a700 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a954f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61e619c700 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a954fc70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61d80ca3a0 tx=0x7f61d80996a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2db2b7bb29ae7f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.657+0000 7f61c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61c97fa700 1 -- 172.21.15.59:0/4063467449 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d80b9040 con 0x55a8a9552800 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61c97fa700 1 -- 172.21.15.59:0/4063467449 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f61d809a3c0 con 0x55a8a9552800 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61fb61db80 1 -- 172.21.15.59:0/4063467449 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8a9462eb0 con 0x55a8a9552800 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61c97fa700 1 -- 172.21.15.59:0/4063467449 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61d8099cc0 con 0x55a8a9552800 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61fb61db80 10 client.25726 fetch_fsmap learned FSMap version 20 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61fb61db80 1 -- 172.21.15.59:0/4063467449 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55a8a92aec60 con 0x55a8a9552800 2023-10-08T12:43:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61c97fa700 1 -- 172.21.15.59:0/4063467449 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a8a9462eb0 con 0x55a8a9552800 2023-10-08T12:43:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61c97fa700 1 -- 172.21.15.59:0/4063467449 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f61d80a1b30 con 0x55a8a9552800 2023-10-08T12:43:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61fb61db80 10 client.25726 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:43:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61fb61db80 10 client.25726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61fb61db80 20 client.25726 populate_metadata read hostname 'smithi059' 2023-10-08T12:43:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61fb61db80 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a8a9562330 0x55a8a9564750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61fb61db80 4 client.25726 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.658+0000 7f61fb61db80 1 -- 172.21.15.59:0/4063467449 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8a9493e10 con 0x55a8a9562330 2023-10-08T12:43:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.659+0000 7f61e599b700 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a8a9562330 0x55a8a9564750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.659+0000 7f61c97fa700 10 client.25726 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.659+0000 7f61e599b700 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a8a9562330 0x55a8a9564750 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4296056c0462abc server_cookie=2d163622661fff05 in_seq=0 out_seq=0 2023-10-08T12:43:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61c97fa700 1 -- 172.21.15.59:0/4063467449 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a8a9493e10 con 0x55a8a9562330 2023-10-08T12:43:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61c97fa700 10 client.25726 handle_command_reply: tid=0 2023-10-08T12:43:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61fb61db80 1 client.25726 shutdown 2023-10-08T12:43:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61fb61db80 1 -- 172.21.15.59:0/4063467449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 msgr2=0x55a8a954fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61fb61db80 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a954fc70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61d80ca3a0 tx=0x7f61d80996a0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61fb61db80 1 -- 172.21.15.59:0/4063467449 shutdown_connections 2023-10-08T12:43:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61fb61db80 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a8a9562330 0x55a8a9564750 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61fb61db80 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a9552240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61fb61db80 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a954fc70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61fb61db80 1 --2- 172.21.15.59:0/4063467449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a954f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61fb61db80 1 -- 172.21.15.59:0/4063467449 >> 172.21.15.59:0/4063467449 conn(0x55a8a94bc260 msgr2=0x55a8a95490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61c97fa700 0 client.25726 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61fb61db80 1 -- 172.21.15.59:0/4063467449 shutdown_connections 2023-10-08T12:43:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.660+0000 7f61fb61db80 1 -- 172.21.15.59:0/4063467449 wait complete. 2023-10-08T12:43:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.661+0000 7f61fb61db80 20 client.25726 trim_cache size 0 max 16384 2023-10-08T12:43:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.678+0000 7f61fb61db80 1 Processor -- start 2023-10-08T12:43:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61fb61db80 1 -- start start 2023-10-08T12:43:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a95592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a954de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a954e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61fb61db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a931b920 con 0x55a8a9547970 2023-10-08T12:43:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61fb61db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a9548b30 con 0x55a8a9547050 2023-10-08T12:43:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61fb61db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a953fc40 con 0x55a8a9552800 2023-10-08T12:43:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61e599b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a95592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61e599b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a95592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57780/0 (socket says 172.21.15.59:57780) 2023-10-08T12:43:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61e599b700 1 -- 172.21.15.59:0/3691559190 learned_addr learned my addr 172.21.15.59:0/3691559190 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61e519a700 1 --2- 172.21.15.59:0/3691559190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a954de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.679+0000 7f61e619c700 1 --2- 172.21.15.59:0/3691559190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a954e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.680+0000 7f61e599b700 1 -- 172.21.15.59:0/3691559190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 msgr2=0x55a8a954e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.680+0000 7f61e599b700 1 --2- 172.21.15.59:0/3691559190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a954e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.680+0000 7f61e599b700 1 -- 172.21.15.59:0/3691559190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 msgr2=0x55a8a954de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.680+0000 7f61e599b700 1 --2- 172.21.15.59:0/3691559190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a954de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.680+0000 7f61e599b700 1 -- 172.21.15.59:0/3691559190 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8a92ec250 con 0x55a8a9547050 2023-10-08T12:43:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.680+0000 7f61e619c700 1 --2- 172.21.15.59:0/3691559190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a954e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.680+0000 7f61e599b700 1 --2- 172.21.15.59:0/3691559190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a95592c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009ce0 tx=0x7f61dc01a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52032d9a554298e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.680+0000 7f61d4bff700 1 -- 172.21.15.59:0/3691559190 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc01d040 con 0x55a8a9547050 2023-10-08T12:43:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.680+0000 7f61d4bff700 1 -- 172.21.15.59:0/3691559190 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61dc034cd0 con 0x55a8a9547050 2023-10-08T12:43:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.680+0000 7f61d4bff700 1 -- 172.21.15.59:0/3691559190 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00bab0 con 0x55a8a9547050 2023-10-08T12:43:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.681+0000 7f61fb61db80 1 -- 172.21.15.59:0/3691559190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 msgr2=0x55a8a95592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.681+0000 7f61fb61db80 1 --2- 172.21.15.59:0/3691559190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a95592c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009ce0 tx=0x7f61dc01a040 comp rx=0 tx=0).stop 2023-10-08T12:43:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.681+0000 7f61fb61db80 1 -- 172.21.15.59:0/3691559190 shutdown_connections 2023-10-08T12:43:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.681+0000 7f61fb61db80 1 --2- 172.21.15.59:0/3691559190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547050 0x55a8a95592c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.681+0000 7f61fb61db80 1 --2- 172.21.15.59:0/3691559190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a954e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.681+0000 7f61fb61db80 1 --2- 172.21.15.59:0/3691559190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547970 0x55a8a954de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.681+0000 7f61fb61db80 1 -- 172.21.15.59:0/3691559190 >> 172.21.15.59:0/3691559190 conn(0x55a8a94bc260 msgr2=0x55a8a9542d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.681+0000 7f61fb61db80 1 -- 172.21.15.59:0/3691559190 shutdown_connections 2023-10-08T12:43:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.681+0000 7f61fb61db80 1 -- 172.21.15.59:0/3691559190 wait complete. 2023-10-08T12:43:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.681+0000 7f61fb61db80 1 -- start start 2023-10-08T12:43:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.682+0000 7f61fb61db80 1 Processor -- start 2023-10-08T12:43:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.682+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547050 0x55a8a9556d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.682+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547970 0x55a8a95572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.682+0000 7f61fb61db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a95b5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.682+0000 7f61fb61db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a9557b80 con 0x55a8a9547050 2023-10-08T12:43:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.682+0000 7f61fb61db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a95b56a0 con 0x55a8a9547970 2023-10-08T12:43:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.682+0000 7f61fb61db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8a95b57e0 con 0x55a8a9552800 2023-10-08T12:43:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.682+0000 7f61fb61db80 10 client.0 _ll_register_callbacks cb 0x7f61d8099ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.682+0000 7f61e519a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547970 0x55a8a95572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.682+0000 7f61e519a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547970 0x55a8a95572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57786/0 (socket says 172.21.15.59:57786) 2023-10-08T12:43:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.682+0000 7f61e519a700 1 -- 172.21.15.59:0/1922362765 learned_addr learned my addr 172.21.15.59:0/1922362765 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:43:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61e599b700 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547050 0x55a8a9556d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61e619c700 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a95b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61e519a700 1 -- 172.21.15.59:0/1922362765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 msgr2=0x55a8a95b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61e519a700 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a95b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61e519a700 1 -- 172.21.15.59:0/1922362765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547050 msgr2=0x55a8a9556d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61e519a700 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547050 0x55a8a9556d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61e519a700 1 -- 172.21.15.59:0/1922362765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8a92c5de0 con 0x55a8a9547970 2023-10-08T12:43:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61e599b700 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547050 0x55a8a9556d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61e519a700 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547970 0x55a8a95572c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009ef0 tx=0x7f61d0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67cdb27cc3cd0035 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:43:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61c97fa700 1 -- 172.21.15.59:0/1922362765 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011be0 con 0x55a8a9547970 2023-10-08T12:43:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.683+0000 7f61fb61db80 1 -- 172.21.15.59:0/1922362765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61dc01e040 con 0x55a8a9547970 2023-10-08T12:43:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61c97fa700 1 -- 172.21.15.59:0/1922362765 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f61d0011d40 con 0x55a8a9547970 2023-10-08T12:43:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61c97fa700 1 -- 172.21.15.59:0/1922362765 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61d0035430 con 0x55a8a9547970 2023-10-08T12:43:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61fb61db80 10 client.25742 fetch_fsmap learned FSMap version 20 2023-10-08T12:43:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61fb61db80 1 -- 172.21.15.59:0/1922362765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55a8a92c42b0 con 0x55a8a9547970 2023-10-08T12:43:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61c97fa700 1 -- 172.21.15.59:0/1922362765 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61dc01e040 con 0x55a8a9547970 2023-10-08T12:43:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61c97fa700 1 -- 172.21.15.59:0/1922362765 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f61d002b3f0 con 0x55a8a9547970 2023-10-08T12:43:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61fb61db80 10 client.25742 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:43:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61fb61db80 10 client.25742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61fb61db80 20 client.25742 populate_metadata read hostname 'smithi059' 2023-10-08T12:43:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61fb61db80 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a8a95b7060 0x55a8a95b9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61fb61db80 4 client.25742 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:43:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.684+0000 7f61fb61db80 1 -- 172.21.15.59:0/1922362765 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a8a9493b30 con 0x55a8a95b7060 2023-10-08T12:43:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61e599b700 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a8a95b7060 0x55a8a95b9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61e599b700 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a8a95b7060 0x55a8a95b9480 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b02e6123a92000ab server_cookie=68cbae6b0522dfab in_seq=0 out_seq=0 2023-10-08T12:43:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61c97fa700 10 client.25742 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61c97fa700 1 -- 172.21.15.59:0/1922362765 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a8a9493b30 con 0x55a8a95b7060 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61c97fa700 10 client.25742 handle_command_reply: tid=0 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61fb61db80 1 client.25742 shutdown 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61fb61db80 1 -- 172.21.15.59:0/1922362765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547970 msgr2=0x55a8a95572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61fb61db80 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547970 0x55a8a95572c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009ef0 tx=0x7f61d0009260 comp rx=0 tx=0).stop 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61fb61db80 1 -- 172.21.15.59:0/1922362765 shutdown_connections 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61fb61db80 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a8a95b7060 0x55a8a95b9480 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61fb61db80 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8a9552800 0x55a8a95b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61fb61db80 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8a9547050 0x55a8a9556d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61c97fa700 0 client.25742 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61fb61db80 1 --2- 172.21.15.59:0/1922362765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8a9547970 0x55a8a95572c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61fb61db80 1 -- 172.21.15.59:0/1922362765 >> 172.21.15.59:0/1922362765 conn(0x55a8a94bc260 msgr2=0x55a8a9542d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.685+0000 7f61fb61db80 1 -- 172.21.15.59:0/1922362765 shutdown_connections 2023-10-08T12:43:31.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61fb61db80 1 -- 172.21.15.59:0/1922362765 wait complete. 2023-10-08T12:43:31.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61fb61db80 20 client.25742 trim_cache size 0 max 16384 2023-10-08T12:43:31.692 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:43:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:43:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:43:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "8ee10c04-8753-467b-b042-e3d301f6541d": { 2023-10-08T12:43:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:43:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "8ee10c04-8753-467b-b042-e3d301f6541d", 2023-10-08T12:43:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:43:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:43:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:43:31.693 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:43:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 -- 172.21.15.59:0/3143436230 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f61cc0a1670 msgr2=0x7f61cc0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f61cc0a1670 0x7f61cc0a3b30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f61d00046e0 tx=0x7f61d0009810 comp rx=0 tx=0).stop 2023-10-08T12:43:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 -- 172.21.15.59:0/3143436230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e0106660 msgr2=0x7f61e0198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e0106660 0x7f61e0198a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f61d800efc0 tx=0x7f61d800c3a0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 -- 172.21.15.59:0/3143436230 shutdown_connections 2023-10-08T12:43:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f61cc0a1670 0x7f61cc0a3b30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e0106660 0x7f61e0198a20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e01005a0 0x7f61e019e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 --2- 172.21.15.59:0/3143436230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0100f60 0x7f61e019ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 -- 172.21.15.59:0/3143436230 >> 172.21.15.59:0/3143436230 conn(0x7f61e00fc090 msgr2=0x7f61e00fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 -- 172.21.15.59:0/3143436230 shutdown_connections 2023-10-08T12:43:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:43:31.686+0000 7f61e699d700 1 -- 172.21.15.59:0/3143436230 wait complete. 2023-10-08T12:43:31.705 INFO:tasks.cephfs.filesystem:scrub status for tag:8ee10c04-8753-467b-b042-e3d301f6541d - {'path': '/', 'tag': '8ee10c04-8753-467b-b042-e3d301f6541d', 'options': 'recursive,force'} 2023-10-08T12:43:32.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:31 smithi092 ceph-mon[134093]: pgmap v384: 97 pgs: 97 active+clean; 93 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 219 op/s 2023-10-08T12:43:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:31 smithi173 ceph-mon[135182]: pgmap v384: 97 pgs: 97 active+clean; 93 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 219 op/s 2023-10-08T12:43:32.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:31 smithi059 ceph-mon[98489]: pgmap v384: 97 pgs: 97 active+clean; 93 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 219 op/s 2023-10-08T12:43:32.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 174411 15.21 MB/sec warmup 63 sec latency 27.245 ms 2023-10-08T12:43:33.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:32 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:43:33.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:32 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:33.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:32 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:43:33.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:32 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:32 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:43:33.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:32 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:33.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:32 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:43:33.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:32 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:33.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:32 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:43:33.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:32 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:33.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:32 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:43:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:32 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:33.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 177608 15.26 MB/sec warmup 64 sec latency 8.025 ms 2023-10-08T12:43:34.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:33 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:43:34.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:33 smithi092 ceph-mon[134093]: pgmap v385: 97 pgs: 97 active+clean; 99 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 233 op/s 2023-10-08T12:43:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:33 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:43:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:33 smithi173 ceph-mon[135182]: pgmap v385: 97 pgs: 97 active+clean; 99 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 233 op/s 2023-10-08T12:43:34.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:33 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:43:34.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:33 smithi059 ceph-mon[98489]: pgmap v385: 97 pgs: 97 active+clean; 99 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 233 op/s 2023-10-08T12:43:34.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 180293 15.22 MB/sec warmup 65 sec latency 20.809 ms 2023-10-08T12:43:35.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 181645 15.10 MB/sec warmup 66 sec latency 210.171 ms 2023-10-08T12:43:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:35 smithi173 ceph-mon[135182]: pgmap v386: 97 pgs: 97 active+clean; 100 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2023-10-08T12:43:36.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:35 smithi059 ceph-mon[98489]: pgmap v386: 97 pgs: 97 active+clean; 100 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2023-10-08T12:43:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:35 smithi092 ceph-mon[134093]: pgmap v386: 97 pgs: 97 active+clean; 100 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2023-10-08T12:43:36.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 184711 15.15 MB/sec warmup 67 sec latency 151.492 ms 2023-10-08T12:43:37.499 INFO:tasks.workunit.client.0.smithi059.stdout: 1 186910 15.04 MB/sec warmup 68 sec latency 60.159 ms 2023-10-08T12:43:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:37 smithi173 ceph-mon[135182]: pgmap v387: 97 pgs: 97 active+clean; 101 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 197 op/s 2023-10-08T12:43:38.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:37 smithi059 ceph-mon[98489]: pgmap v387: 97 pgs: 97 active+clean; 101 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 197 op/s 2023-10-08T12:43:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:37 smithi092 ceph-mon[134093]: pgmap v387: 97 pgs: 97 active+clean; 101 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 197 op/s 2023-10-08T12:43:38.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 189390 15.06 MB/sec warmup 69 sec latency 7.270 ms 2023-10-08T12:43:39.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 192284 15.06 MB/sec warmup 70 sec latency 7.103 ms 2023-10-08T12:43:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:39 smithi092 ceph-mon[134093]: pgmap v388: 97 pgs: 97 active+clean; 104 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 236 op/s 2023-10-08T12:43:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:39 smithi173 ceph-mon[135182]: pgmap v388: 97 pgs: 97 active+clean; 104 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 236 op/s 2023-10-08T12:43:40.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:39 smithi059 ceph-mon[98489]: pgmap v388: 97 pgs: 97 active+clean; 104 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 236 op/s 2023-10-08T12:43:40.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 195373 15.10 MB/sec warmup 71 sec latency 57.233 ms 2023-10-08T12:43:41.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 197697 15.01 MB/sec warmup 72 sec latency 90.781 ms 2023-10-08T12:43:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:41 smithi173 ceph-mon[135182]: pgmap v389: 97 pgs: 97 active+clean; 107 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 213 op/s 2023-10-08T12:43:42.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:41 smithi059 ceph-mon[98489]: pgmap v389: 97 pgs: 97 active+clean; 107 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 213 op/s 2023-10-08T12:43:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:41 smithi092 ceph-mon[134093]: pgmap v389: 97 pgs: 97 active+clean; 107 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 213 op/s 2023-10-08T12:43:42.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 199628 14.97 MB/sec warmup 73 sec latency 70.171 ms 2023-10-08T12:43:43.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 202660 15.01 MB/sec warmup 74 sec latency 9.694 ms 2023-10-08T12:43:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:43 smithi173 ceph-mon[135182]: pgmap v390: 97 pgs: 97 active+clean; 111 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 281 op/s 2023-10-08T12:43:44.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:43 smithi059 ceph-mon[98489]: pgmap v390: 97 pgs: 97 active+clean; 111 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 281 op/s 2023-10-08T12:43:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:43 smithi092 ceph-mon[134093]: pgmap v390: 97 pgs: 97 active+clean; 111 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 281 op/s 2023-10-08T12:43:44.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 205848 15.05 MB/sec warmup 75 sec latency 83.608 ms 2023-10-08T12:43:45.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 208656 15.03 MB/sec warmup 76 sec latency 7.031 ms 2023-10-08T12:43:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:45 smithi173 ceph-mon[135182]: pgmap v391: 97 pgs: 97 active+clean; 111 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 207 op/s 2023-10-08T12:43:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:45 smithi059 ceph-mon[98489]: pgmap v391: 97 pgs: 97 active+clean; 111 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 207 op/s 2023-10-08T12:43:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:45 smithi092 ceph-mon[134093]: pgmap v391: 97 pgs: 97 active+clean; 111 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 207 op/s 2023-10-08T12:43:46.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 210530 14.95 MB/sec warmup 77 sec latency 84.123 ms 2023-10-08T12:43:47.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 213194 14.98 MB/sec warmup 78 sec latency 58.581 ms 2023-10-08T12:43:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:47 smithi173 ceph-mon[135182]: pgmap v392: 97 pgs: 97 active+clean; 115 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 272 op/s 2023-10-08T12:43:48.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:47 smithi059 ceph-mon[98489]: pgmap v392: 97 pgs: 97 active+clean; 115 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 272 op/s 2023-10-08T12:43:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:47 smithi092 ceph-mon[134093]: pgmap v392: 97 pgs: 97 active+clean; 115 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 272 op/s 2023-10-08T12:43:48.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 216262 14.97 MB/sec warmup 79 sec latency 25.860 ms 2023-10-08T12:43:49.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 218852 14.93 MB/sec warmup 80 sec latency 20.324 ms 2023-10-08T12:43:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:49 smithi092 ceph-mon[134093]: pgmap v393: 97 pgs: 97 active+clean; 119 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 288 op/s 2023-10-08T12:43:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:49 smithi173 ceph-mon[135182]: pgmap v393: 97 pgs: 97 active+clean; 119 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 288 op/s 2023-10-08T12:43:50.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:49 smithi059 ceph-mon[98489]: pgmap v393: 97 pgs: 97 active+clean; 119 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 288 op/s 2023-10-08T12:43:50.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 221417 14.96 MB/sec warmup 81 sec latency 6.139 ms 2023-10-08T12:43:51.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 224321 14.95 MB/sec warmup 82 sec latency 11.623 ms 2023-10-08T12:43:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:51 smithi173 ceph-mon[135182]: pgmap v394: 97 pgs: 97 active+clean; 120 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 270 op/s 2023-10-08T12:43:52.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:51 smithi059 ceph-mon[98489]: pgmap v394: 97 pgs: 97 active+clean; 120 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 270 op/s 2023-10-08T12:43:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:51 smithi092 ceph-mon[134093]: pgmap v394: 97 pgs: 97 active+clean; 120 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 270 op/s 2023-10-08T12:43:52.500 INFO:tasks.workunit.client.0.smithi059.stdout: 1 227196 14.98 MB/sec warmup 83 sec latency 85.301 ms 2023-10-08T12:43:53.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 229955 14.96 MB/sec warmup 84 sec latency 15.034 ms 2023-10-08T12:43:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:53 smithi173 ceph-mon[135182]: pgmap v395: 97 pgs: 97 active+clean; 128 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 314 op/s 2023-10-08T12:43:54.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:53 smithi059 ceph-mon[98489]: pgmap v395: 97 pgs: 97 active+clean; 128 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 314 op/s 2023-10-08T12:43:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:53 smithi092 ceph-mon[134093]: pgmap v395: 97 pgs: 97 active+clean; 128 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 314 op/s 2023-10-08T12:43:54.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 232994 14.95 MB/sec warmup 85 sec latency 8.581 ms 2023-10-08T12:43:55.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 235400 14.94 MB/sec warmup 86 sec latency 24.426 ms 2023-10-08T12:43:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:55 smithi173 ceph-mon[135182]: pgmap v396: 97 pgs: 97 active+clean; 128 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 244 op/s 2023-10-08T12:43:56.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:55 smithi059 ceph-mon[98489]: pgmap v396: 97 pgs: 97 active+clean; 128 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 244 op/s 2023-10-08T12:43:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:55 smithi092 ceph-mon[134093]: pgmap v396: 97 pgs: 97 active+clean; 128 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 244 op/s 2023-10-08T12:43:56.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 238419 14.97 MB/sec warmup 87 sec latency 6.417 ms 2023-10-08T12:43:57.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 241454 15.01 MB/sec warmup 88 sec latency 67.284 ms 2023-10-08T12:43:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:57 smithi173 ceph-mon[135182]: pgmap v397: 97 pgs: 97 active+clean; 128 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 264 op/s 2023-10-08T12:43:58.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:57 smithi059 ceph-mon[98489]: pgmap v397: 97 pgs: 97 active+clean; 128 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 264 op/s 2023-10-08T12:43:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:57 smithi092 ceph-mon[134093]: pgmap v397: 97 pgs: 97 active+clean; 128 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 264 op/s 2023-10-08T12:43:58.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 242664 14.90 MB/sec warmup 89 sec latency 257.236 ms 2023-10-08T12:43:59.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 245594 14.90 MB/sec warmup 90 sec latency 6.276 ms 2023-10-08T12:44:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:43:59 smithi092 ceph-mon[134093]: pgmap v398: 97 pgs: 97 active+clean; 133 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 276 op/s 2023-10-08T12:44:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:43:59 smithi173 ceph-mon[135182]: pgmap v398: 97 pgs: 97 active+clean; 133 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 276 op/s 2023-10-08T12:44:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:43:59 smithi059 ceph-mon[98489]: pgmap v398: 97 pgs: 97 active+clean; 133 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 276 op/s 2023-10-08T12:44:00.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 248721 14.94 MB/sec warmup 91 sec latency 20.699 ms 2023-10-08T12:44:01.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 250731 14.85 MB/sec warmup 92 sec latency 35.261 ms 2023-10-08T12:44:01.707 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:44:01.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.928+0000 7fb84d9ff700 1 -- 172.21.15.59:0/1624527064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb848072c20 msgr2=0x7fb848073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:01.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.928+0000 7fb84d9ff700 1 --2- 172.21.15.59:0/1624527064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb848072c20 0x7fb848073000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb838009990 tx=0x7fb838009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.929+0000 7fb84d9ff700 1 -- 172.21.15.59:0/1624527064 shutdown_connections 2023-10-08T12:44:01.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.929+0000 7fb84d9ff700 1 --2- 172.21.15.59:0/1624527064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb84810cf70 0x7fb84810f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.929+0000 7fb84d9ff700 1 --2- 172.21.15.59:0/1624527064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb848072c20 0x7fb848073000 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.929+0000 7fb84d9ff700 1 --2- 172.21.15.59:0/1624527064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848073540 0x7fb84810ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.929+0000 7fb84d9ff700 1 -- 172.21.15.59:0/1624527064 >> 172.21.15.59:0/1624527064 conn(0x7fb8480fc200 msgr2=0x7fb8480fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:01.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.929+0000 7fb84d9ff700 1 -- 172.21.15.59:0/1624527064 shutdown_connections 2023-10-08T12:44:01.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.929+0000 7fb84d9ff700 1 -- 172.21.15.59:0/1624527064 wait complete. 2023-10-08T12:44:01.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.930+0000 7fb84d9ff700 1 Processor -- start 2023-10-08T12:44:01.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.930+0000 7fb84d9ff700 1 -- start start 2023-10-08T12:44:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.930+0000 7fb84d9ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848072c20 0x7fb848198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.930+0000 7fb84d9ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb848073540 0x7fb8481993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.930+0000 7fb84d9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84810cf70 0x7fb84819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.930+0000 7fb84d9ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84819dd60 con 0x7fb848072c20 2023-10-08T12:44:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.930+0000 7fb84d9ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84819ded0 con 0x7fb848073540 2023-10-08T12:44:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.930+0000 7fb84d9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84819e090 con 0x7fb84810cf70 2023-10-08T12:44:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb846ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848072c20 0x7fb848198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb8467fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb848073540 0x7fb8481993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb846ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848072c20 0x7fb848198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53908/0 (socket says 172.21.15.59:53908) 2023-10-08T12:44:01.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb8477fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84810cf70 0x7fb84819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb846ffd700 1 -- 172.21.15.59:0/3733261097 learned_addr learned my addr 172.21.15.59:0/3733261097 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb8477fe700 1 -- 172.21.15.59:0/3733261097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb848073540 msgr2=0x7fb8481993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb8477fe700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb848073540 0x7fb8481993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb8477fe700 1 -- 172.21.15.59:0/3733261097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848072c20 msgr2=0x7fb848198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb8477fe700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848072c20 0x7fb848198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb8477fe700 1 -- 172.21.15.59:0/3733261097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840009c40 con 0x7fb84810cf70 2023-10-08T12:44:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb8467fc700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb848073540 0x7fb8481993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb846ffd700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848072c20 0x7fb848198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.931+0000 7fb8477fe700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84810cf70 0x7fb84819d720 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb84000efb0 tx=0x7fb84000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.932+0000 7fb84c9fd700 1 -- 172.21.15.59:0/3733261097 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840003a00 con 0x7fb84810cf70 2023-10-08T12:44:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.932+0000 7fb84c9fd700 1 -- 172.21.15.59:0/3733261097 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb84000f040 con 0x7fb84810cf70 2023-10-08T12:44:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.932+0000 7fb84c9fd700 1 -- 172.21.15.59:0/3733261097 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840004540 con 0x7fb84810cf70 2023-10-08T12:44:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.932+0000 7fb84d9ff700 1 -- 172.21.15.59:0/3733261097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8380095f0 con 0x7fb84810cf70 2023-10-08T12:44:01.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.932+0000 7fb84d9ff700 1 -- 172.21.15.59:0/3733261097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8481a59d0 con 0x7fb84810cf70 2023-10-08T12:44:01.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.936+0000 7fb84c9fd700 1 -- 172.21.15.59:0/3733261097 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb840003bf0 con 0x7fb84810cf70 2023-10-08T12:44:01.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.937+0000 7fb8612d4b80 1 Processor -- start 2023-10-08T12:44:01.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.937+0000 7fb84c9fd700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb8300a1670 0x7fb8300a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb8612d4b80 1 -- start start 2023-10-08T12:44:01.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb84c9fd700 1 -- 172.21.15.59:0/3733261097 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb8400ccc40 con 0x7fb84810cf70 2023-10-08T12:44:01.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb846ffd700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb8300a1670 0x7fb8300a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094ce80 0x55b57094d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 0x55b570958110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5708b6460 con 0x55b57094ce80 2023-10-08T12:44:01.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5708a7c20 con 0x55b570958650 2023-10-08T12:44:01.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5708a5540 con 0x55b57094d7a0 2023-10-08T12:44:01.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb8477fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb8467fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 0x55b570958110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb8477fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45370/0 (socket says 172.21.15.59:45370) 2023-10-08T12:44:01.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.938+0000 7fb8477fe700 1 -- 172.21.15.59:0/2936334722 learned_addr learned my addr 172.21.15.59:0/2936334722 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:01.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb846ffd700 1 --2- 172.21.15.59:0/2936334722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094ce80 0x55b57094d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb8477fe700 1 -- 172.21.15.59:0/2936334722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 msgr2=0x55b570958110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:01.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb8477fe700 1 --2- 172.21.15.59:0/2936334722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 0x55b570958110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb8477fe700 1 -- 172.21.15.59:0/2936334722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094ce80 msgr2=0x55b57094d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:01.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb8477fe700 1 --2- 172.21.15.59:0/2936334722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094ce80 0x55b57094d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb8477fe700 1 -- 172.21.15.59:0/2936334722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5706cbde0 con 0x55b570958650 2023-10-08T12:44:01.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb846ffd700 1 --2- 172.21.15.59:0/2936334722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094ce80 0x55b57094d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:01.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb846ffd700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb8300a1670 0x7fb8300a3b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb838006010 tx=0x7fb83800bbc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:01.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb8477fe700 1 --2- 172.21.15.59:0/2936334722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095aa40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb840096740 tx=0x7fb840099b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c191671ddbcf3e11 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:01.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb82dffb700 1 -- 172.21.15.59:0/2936334722 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84009a3d0 con 0x55b570958650 2023-10-08T12:44:01.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb82dffb700 1 -- 172.21.15.59:0/2936334722 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8400b9040 con 0x55b570958650 2023-10-08T12:44:01.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.939+0000 7fb82dffb700 1 -- 172.21.15.59:0/2936334722 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400046a0 con 0x55b570958650 2023-10-08T12:44:01.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.940+0000 7fb8612d4b80 1 -- 172.21.15.59:0/2936334722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 msgr2=0x55b57095aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:01.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.940+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/2936334722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095aa40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb840096740 tx=0x7fb840099b20 comp rx=0 tx=0).stop 2023-10-08T12:44:01.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.940+0000 7fb8612d4b80 1 -- 172.21.15.59:0/2936334722 shutdown_connections 2023-10-08T12:44:01.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.940+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/2936334722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095aa40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.940+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/2936334722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094ce80 0x55b57094d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.940+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/2936334722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 0x55b570958110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.940+0000 7fb8612d4b80 1 -- 172.21.15.59:0/2936334722 >> 172.21.15.59:0/2936334722 conn(0x55b5708c2260 msgr2=0x55b5709492d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:01.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.940+0000 7fb8612d4b80 1 -- 172.21.15.59:0/2936334722 shutdown_connections 2023-10-08T12:44:01.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.940+0000 7fb8612d4b80 1 -- 172.21.15.59:0/2936334722 wait complete. 2023-10-08T12:44:01.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.941+0000 7fb8612d4b80 1 -- start start 2023-10-08T12:44:01.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.941+0000 7fb8612d4b80 1 Processor -- start 2023-10-08T12:44:01.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.941+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b57094ce80 0x55b570958030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.941+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094d7a0 0x55b570955390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.941+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b570958650 0x55b5709559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.941+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5708a0e30 con 0x55b57094d7a0 2023-10-08T12:44:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.941+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57083d710 con 0x55b57094ce80 2023-10-08T12:44:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.941+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57083d3b0 con 0x55b570958650 2023-10-08T12:44:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb8612d4b80 10 client.0 _ll_register_callbacks cb 0x55b57069a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb846ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b57094ce80 0x55b570958030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb846ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b57094ce80 0x55b570958030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45372/0 (socket says 172.21.15.59:45372) 2023-10-08T12:44:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb846ffd700 1 -- 172.21.15.59:0/334237338 learned_addr learned my addr 172.21.15.59:0/334237338 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb8467fc700 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094d7a0 0x55b570955390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb8477fe700 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b570958650 0x55b5709559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb846ffd700 1 -- 172.21.15.59:0/334237338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b570958650 msgr2=0x55b5709559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb846ffd700 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b570958650 0x55b5709559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb846ffd700 1 -- 172.21.15.59:0/334237338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094d7a0 msgr2=0x55b570955390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb846ffd700 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094d7a0 0x55b570955390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb846ffd700 1 -- 172.21.15.59:0/334237338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8481a59d0 con 0x55b57094ce80 2023-10-08T12:44:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb8467fc700 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094d7a0 0x55b570955390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.942+0000 7fb846ffd700 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b57094ce80 0x55b570958030 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb838005670 tx=0x7fb838009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fc84a30cdde4012 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.943+0000 7fb826ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:44:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.943+0000 7fb826ffd700 1 -- 172.21.15.59:0/334237338 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380056a0 con 0x55b57094ce80 2023-10-08T12:44:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.943+0000 7fb826ffd700 1 -- 172.21.15.59:0/334237338 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb83802c040 con 0x55b57094ce80 2023-10-08T12:44:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.943+0000 7fb8612d4b80 1 -- 172.21.15.59:0/334237338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b570868eb0 con 0x55b57094ce80 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.943+0000 7fb826ffd700 1 -- 172.21.15.59:0/334237338 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb83800f460 con 0x55b57094ce80 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.943+0000 7fb8612d4b80 10 client.25754 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.943+0000 7fb8612d4b80 1 -- 172.21.15.59:0/334237338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b5706b4c60 con 0x55b57094ce80 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.943+0000 7fb826ffd700 1 -- 172.21.15.59:0/334237338 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b570868eb0 con 0x55b57094ce80 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.943+0000 7fb826ffd700 1 -- 172.21.15.59:0/334237338 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb838030720 con 0x55b57094ce80 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.944+0000 7fb8612d4b80 10 client.25754 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.944+0000 7fb8612d4b80 10 client.25754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.944+0000 7fb8612d4b80 20 client.25754 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.944+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b570968100 0x55b57096a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.944+0000 7fb8612d4b80 4 client.25754 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.944+0000 7fb8612d4b80 1 -- 172.21.15.59:0/334237338 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b570899e10 con 0x55b570968100 2023-10-08T12:44:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.944+0000 7fb8467fc700 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b570968100 0x55b57096a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.944+0000 7fb8467fc700 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b570968100 0x55b57096a520 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2efb66e63a5423f9 server_cookie=3d4e10592aef488e in_seq=0 out_seq=0 2023-10-08T12:44:01.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.944+0000 7fb826ffd700 10 client.25754 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:01.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb826ffd700 1 -- 172.21.15.59:0/334237338 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b570899e10 con 0x55b570968100 2023-10-08T12:44:01.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb826ffd700 10 client.25754 handle_command_reply: tid=0 2023-10-08T12:44:01.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 1 client.25754 shutdown 2023-10-08T12:44:01.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 1 -- 172.21.15.59:0/334237338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b57094ce80 msgr2=0x55b570958030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:01.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b57094ce80 0x55b570958030 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb838005670 tx=0x7fb838009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 1 -- 172.21.15.59:0/334237338 shutdown_connections 2023-10-08T12:44:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b570968100 0x55b57096a520 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b57094ce80 0x55b570958030 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b570958650 0x55b5709559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/334237338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094d7a0 0x55b570955390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb826ffd700 0 client.25754 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 1 -- 172.21.15.59:0/334237338 >> 172.21.15.59:0/334237338 conn(0x55b5708c2260 msgr2=0x55b570948e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:01.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 1 -- 172.21.15.59:0/334237338 shutdown_connections 2023-10-08T12:44:01.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 1 -- 172.21.15.59:0/334237338 wait complete. 2023-10-08T12:44:01.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.947+0000 7fb8612d4b80 20 client.25754 trim_cache size 0 max 16384 2023-10-08T12:44:01.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.965+0000 7fb8612d4b80 1 Processor -- start 2023-10-08T12:44:01.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.965+0000 7fb8612d4b80 1 -- start start 2023-10-08T12:44:01.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094ce80 0x55b57096a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 0x55b57094fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b570721920 con 0x55b57094ce80 2023-10-08T12:44:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57094e970 con 0x55b570958650 2023-10-08T12:44:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57095f720 con 0x55b57094d7a0 2023-10-08T12:44:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8467fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 0x55b57094fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8477fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8467fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 0x55b57094fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:32912/0 (socket says 172.21.15.59:32912) 2023-10-08T12:44:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8467fc700 1 -- 172.21.15.59:0/434402133 learned_addr learned my addr 172.21.15.59:0/434402133 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb846ffd700 1 --2- 172.21.15.59:0/434402133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094ce80 0x55b57096a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8467fc700 1 -- 172.21.15.59:0/434402133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 msgr2=0x55b57095f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:01.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8467fc700 1 --2- 172.21.15.59:0/434402133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8467fc700 1 -- 172.21.15.59:0/434402133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094ce80 msgr2=0x55b57096a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:01.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8467fc700 1 --2- 172.21.15.59:0/434402133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094ce80 0x55b57096a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.966+0000 7fb8467fc700 1 -- 172.21.15.59:0/434402133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5706f2250 con 0x55b57094d7a0 2023-10-08T12:44:01.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.967+0000 7fb8467fc700 1 --2- 172.21.15.59:0/434402133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 0x55b57094fdb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55b570948cf0 tx=0x7fb83c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a9632c4cb663b57 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:01.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.967+0000 7fb82e7fc700 1 -- 172.21.15.59:0/434402133 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011d60 con 0x55b57094d7a0 2023-10-08T12:44:01.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.967+0000 7fb82e7fc700 1 -- 172.21.15.59:0/434402133 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb83c018040 con 0x55b57094d7a0 2023-10-08T12:44:01.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.967+0000 7fb82e7fc700 1 -- 172.21.15.59:0/434402133 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c004a90 con 0x55b57094d7a0 2023-10-08T12:44:01.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.968+0000 7fb8612d4b80 1 -- 172.21.15.59:0/434402133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 msgr2=0x55b57094fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:01.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.968+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/434402133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 0x55b57094fdb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55b570948cf0 tx=0x7fb83c009260 comp rx=0 tx=0).stop 2023-10-08T12:44:01.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.968+0000 7fb8612d4b80 1 -- 172.21.15.59:0/434402133 shutdown_connections 2023-10-08T12:44:01.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.968+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/434402133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.968+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/434402133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094ce80 0x55b57096a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.968+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/434402133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094d7a0 0x55b57094fdb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.968+0000 7fb8612d4b80 1 -- 172.21.15.59:0/434402133 >> 172.21.15.59:0/434402133 conn(0x55b5708c2260 msgr2=0x55b5709484d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:01.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.968+0000 7fb8612d4b80 1 -- 172.21.15.59:0/434402133 shutdown_connections 2023-10-08T12:44:01.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.968+0000 7fb8612d4b80 1 -- 172.21.15.59:0/434402133 wait complete. 2023-10-08T12:44:01.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.968+0000 7fb8612d4b80 1 -- start start 2023-10-08T12:44:01.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.968+0000 7fb8612d4b80 1 Processor -- start 2023-10-08T12:44:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094ce80 0x55b57095d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094d7a0 0x55b57095daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb8612d4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57095ed10 con 0x55b57094d7a0 2023-10-08T12:44:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57095ee80 con 0x55b570958650 2023-10-08T12:44:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb8612d4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57095f040 con 0x55b57094ce80 2023-10-08T12:44:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb8612d4b80 10 client.0 _ll_register_callbacks cb 0x7fb8380051d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb8477fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb8467fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094d7a0 0x55b57095daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb846ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094ce80 0x55b57095d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb8477fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45392/0 (socket says 172.21.15.59:45392) 2023-10-08T12:44:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.969+0000 7fb8477fe700 1 -- 172.21.15.59:0/1958654032 learned_addr learned my addr 172.21.15.59:0/1958654032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb8477fe700 1 -- 172.21.15.59:0/1958654032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094ce80 msgr2=0x55b57095d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb8477fe700 1 --2- 172.21.15.59:0/1958654032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094ce80 0x55b57095d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb8477fe700 1 -- 172.21.15.59:0/1958654032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094d7a0 msgr2=0x55b57095daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb8477fe700 1 --2- 172.21.15.59:0/1958654032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094d7a0 0x55b57095daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb8477fe700 1 -- 172.21.15.59:0/1958654032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c01f9f0 con 0x55b570958650 2023-10-08T12:44:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb8477fe700 1 --2- 172.21.15.59:0/1958654032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095e710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb8400999d0 tx=0x7fb840095980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b42dbb0d7c4305 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb826ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:44:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb826ffd700 1 -- 172.21.15.59:0/1958654032 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400048a0 con 0x55b570958650 2023-10-08T12:44:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb8612d4b80 1 -- 172.21.15.59:0/1958654032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8400b9040 con 0x55b570958650 2023-10-08T12:44:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb826ffd700 1 -- 172.21.15.59:0/1958654032 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb8400a1fd0 con 0x55b570958650 2023-10-08T12:44:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb826ffd700 1 -- 172.21.15.59:0/1958654032 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb84009de20 con 0x55b570958650 2023-10-08T12:44:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb8612d4b80 10 client.25760 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.970+0000 7fb8612d4b80 1 -- 172.21.15.59:0/1958654032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b5706ca2b0 con 0x55b570958650 2023-10-08T12:44:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.971+0000 7fb826ffd700 1 -- 172.21.15.59:0/1958654032 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8400b9040 con 0x55b570958650 2023-10-08T12:44:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.971+0000 7fb826ffd700 1 -- 172.21.15.59:0/1958654032 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb840084040 con 0x55b570958650 2023-10-08T12:44:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.971+0000 7fb8612d4b80 10 client.25760 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.971+0000 7fb8612d4b80 10 client.25760 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.971+0000 7fb8612d4b80 20 client.25760 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.971+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/1958654032 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b5709bceb0 0x55b5709bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.971+0000 7fb8612d4b80 4 client.25760 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:44:01.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.971+0000 7fb8612d4b80 1 -- 172.21.15.59:0/1958654032 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b570899b30 con 0x55b5709bceb0 2023-10-08T12:44:01.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.971+0000 7fb846ffd700 1 --2- 172.21.15.59:0/1958654032 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b5709bceb0 0x55b5709bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:01.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.971+0000 7fb846ffd700 1 --2- 172.21.15.59:0/1958654032 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b5709bceb0 0x55b5709bf2a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cedc5152094fdc61 server_cookie=392caf5d64a84779 in_seq=0 out_seq=0 2023-10-08T12:44:01.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.971+0000 7fb826ffd700 10 client.25760 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:01.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb826ffd700 1 -- 172.21.15.59:0/1958654032 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b570899b30 con 0x55b5709bceb0 2023-10-08T12:44:01.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb826ffd700 10 client.25760 handle_command_reply: tid=0 2023-10-08T12:44:01.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 1 client.25760 shutdown 2023-10-08T12:44:01.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 1 -- 172.21.15.59:0/1958654032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 msgr2=0x55b57095e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:01.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/1958654032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095e710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb8400999d0 tx=0x7fb840095980 comp rx=0 tx=0).stop 2023-10-08T12:44:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 1 -- 172.21.15.59:0/1958654032 shutdown_connections 2023-10-08T12:44:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/1958654032 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b5709bceb0 0x55b5709bf2a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/1958654032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b570958650 0x55b57095e710 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/1958654032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b57094ce80 0x55b57095d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 1 --2- 172.21.15.59:0/1958654032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b57094d7a0 0x55b57095daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 1 -- 172.21.15.59:0/1958654032 >> 172.21.15.59:0/1958654032 conn(0x55b5708c2260 msgr2=0x55b570957cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb826ffd700 0 client.25760 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 1 -- 172.21.15.59:0/1958654032 shutdown_connections 2023-10-08T12:44:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 1 -- 172.21.15.59:0/1958654032 wait complete. 2023-10-08T12:44:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.972+0000 7fb8612d4b80 20 client.25760 trim_cache size 0 max 16384 2023-10-08T12:44:01.981 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:44:01.981 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:44:01.981 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:44:01.981 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:44:01.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 -- 172.21.15.59:0/3733261097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb8300a1670 msgr2=0x7fb8300a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:01.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb8300a1670 0x7fb8300a3b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb838006010 tx=0x7fb83800bbc0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 -- 172.21.15.59:0/3733261097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84810cf70 msgr2=0x7fb84819d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:01.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84810cf70 0x7fb84819d720 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb84000efb0 tx=0x7fb84000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 -- 172.21.15.59:0/3733261097 shutdown_connections 2023-10-08T12:44:01.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb8300a1670 0x7fb8300a3b30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84810cf70 0x7fb84819d720 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848072c20 0x7fb848198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 --2- 172.21.15.59:0/3733261097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb848073540 0x7fb8481993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:01.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 -- 172.21.15.59:0/3733261097 >> 172.21.15.59:0/3733261097 conn(0x7fb8480fc200 msgr2=0x7fb8480fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:01.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 -- 172.21.15.59:0/3733261097 shutdown_connections 2023-10-08T12:44:01.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:01.973+0000 7fb84d9ff700 1 -- 172.21.15.59:0/3733261097 wait complete. 2023-10-08T12:44:01.992 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:44:01.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:44:02.055 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:01 smithi059 ceph-mon[98489]: pgmap v399: 97 pgs: 97 active+clean; 133 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 283 op/s 2023-10-08T12:44:02.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.203+0000 7f9561dff700 1 -- 172.21.15.59:0/259051752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f955c0734b0 msgr2=0x7f955c111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.203+0000 7f9561dff700 1 --2- 172.21.15.59:0/259051752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f955c0734b0 0x7f955c111100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9550009990 tx=0x7f9550009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.203+0000 7f9561dff700 1 -- 172.21.15.59:0/259051752 shutdown_connections 2023-10-08T12:44:02.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.203+0000 7f9561dff700 1 --2- 172.21.15.59:0/259051752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f955c111640 0x7f955c113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.203+0000 7f9561dff700 1 --2- 172.21.15.59:0/259051752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f955c072b90 0x7f955c072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.203+0000 7f9561dff700 1 --2- 172.21.15.59:0/259051752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f955c0734b0 0x7f955c111100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.203+0000 7f9561dff700 1 -- 172.21.15.59:0/259051752 >> 172.21.15.59:0/259051752 conn(0x7f955c0fc140 msgr2=0x7f955c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:02.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.203+0000 7f9561dff700 1 -- 172.21.15.59:0/259051752 shutdown_connections 2023-10-08T12:44:02.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.203+0000 7f9561dff700 1 -- 172.21.15.59:0/259051752 wait complete. 2023-10-08T12:44:02.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.204+0000 7f9561dff700 1 Processor -- start 2023-10-08T12:44:02.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.204+0000 7f9561dff700 1 -- start start 2023-10-08T12:44:02.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.204+0000 7f9561dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f955c072b90 0x7f955c19d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.204+0000 7f9561dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f955c0734b0 0x7f955c19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.204+0000 7f9561dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f955c111640 0x7f955c1a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.204+0000 7f9561dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c1a20c0 con 0x7f955c0734b0 2023-10-08T12:44:02.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.204+0000 7f9561dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c1a2230 con 0x7f955c072b90 2023-10-08T12:44:02.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.204+0000 7f9561dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c1a23f0 con 0x7f955c111640 2023-10-08T12:44:02.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.205+0000 7f955b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f955c072b90 0x7f955c19d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.205+0000 7f955b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f955c072b90 0x7f955c19d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45416/0 (socket says 172.21.15.59:45416) 2023-10-08T12:44:02.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.205+0000 7f955b7fe700 1 -- 172.21.15.59:0/4201923988 learned_addr learned my addr 172.21.15.59:0/4201923988 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.205+0000 7f955affd700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f955c0734b0 0x7f955c19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.205+0000 7f955bfff700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f955c111640 0x7f955c1a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.205+0000 7f955b7fe700 1 -- 172.21.15.59:0/4201923988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f955c111640 msgr2=0x7f955c1a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.205+0000 7f955b7fe700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f955c111640 0x7f955c1a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.205+0000 7f955b7fe700 1 -- 172.21.15.59:0/4201923988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f955c0734b0 msgr2=0x7f955c19d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.205+0000 7f955b7fe700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f955c0734b0 0x7f955c19d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.205+0000 7f955b7fe700 1 -- 172.21.15.59:0/4201923988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95500095f0 con 0x7f955c072b90 2023-10-08T12:44:02.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.205+0000 7f955b7fe700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f955c072b90 0x7f955c19d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f954c00e9a0 tx=0x7f954c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:02.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.206+0000 7f9558ff9700 1 -- 172.21.15.59:0/4201923988 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c009790 con 0x7f955c072b90 2023-10-08T12:44:02.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.206+0000 7f9558ff9700 1 -- 172.21.15.59:0/4201923988 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f954c010430 con 0x7f955c072b90 2023-10-08T12:44:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.206+0000 7f9561dff700 1 -- 172.21.15.59:0/4201923988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955c1a26d0 con 0x7f955c072b90 2023-10-08T12:44:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.206+0000 7f9558ff9700 1 -- 172.21.15.59:0/4201923988 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c018680 con 0x7f955c072b90 2023-10-08T12:44:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.206+0000 7f9561dff700 1 -- 172.21.15.59:0/4201923988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955c1a9f10 con 0x7f955c072b90 2023-10-08T12:44:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.207+0000 7f9561dff700 1 -- 172.21.15.59:0/4201923988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955c103b40 con 0x7f955c072b90 2023-10-08T12:44:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.209+0000 7f9558ff9700 1 -- 172.21.15.59:0/4201923988 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f954c0105a0 con 0x7f955c072b90 2023-10-08T12:44:02.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:01 smithi173 ceph-mon[135182]: pgmap v399: 97 pgs: 97 active+clean; 133 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 283 op/s 2023-10-08T12:44:02.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.211+0000 7f9558ff9700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95440a1670 0x7f95440a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.211+0000 7f9558ff9700 1 -- 172.21.15.59:0/4201923988 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f954c014070 con 0x7f955c072b90 2023-10-08T12:44:02.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.211+0000 7f955affd700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95440a1670 0x7f95440a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.212+0000 7f955affd700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95440a1670 0x7f95440a3b30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f955c19e6f0 tx=0x7f955000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:02.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.218+0000 7f9558ff9700 1 -- 172.21.15.59:0/4201923988 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f954c096550 con 0x7f955c072b90 2023-10-08T12:44:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:01 smithi092 ceph-mon[134093]: pgmap v399: 97 pgs: 97 active+clean; 133 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 283 op/s 2023-10-08T12:44:02.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 252601 14.83 MB/sec warmup 93 sec latency 126.769 ms 2023-10-08T12:44:02.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.551+0000 7f9561dff700 1 -- 172.21.15.59:0/4201923988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f955c0742d0 con 0x7f955c072b90 2023-10-08T12:44:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.552+0000 7f9558ff9700 1 -- 172.21.15.59:0/4201923988 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f954c099b70 con 0x7f955c072b90 2023-10-08T12:44:02.553 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:44:02.554 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:44:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.555+0000 7f9561dff700 1 -- 172.21.15.59:0/4201923988 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95440a1670 msgr2=0x7f95440a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.555+0000 7f9561dff700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95440a1670 0x7f95440a3b30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f955c19e6f0 tx=0x7f955000b260 comp rx=0 tx=0).stop 2023-10-08T12:44:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.555+0000 7f9561dff700 1 -- 172.21.15.59:0/4201923988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f955c072b90 msgr2=0x7f955c19d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.555+0000 7f9561dff700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f955c072b90 0x7f955c19d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f954c00e9a0 tx=0x7f954c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.556+0000 7f9561dff700 1 -- 172.21.15.59:0/4201923988 shutdown_connections 2023-10-08T12:44:02.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.556+0000 7f9561dff700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f95440a1670 0x7f95440a3b30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.556+0000 7f9561dff700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f955c072b90 0x7f955c19d1a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.556+0000 7f9561dff700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f955c111640 0x7f955c1a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.556+0000 7f9561dff700 1 --2- 172.21.15.59:0/4201923988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f955c0734b0 0x7f955c19d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.556+0000 7f9561dff700 1 -- 172.21.15.59:0/4201923988 >> 172.21.15.59:0/4201923988 conn(0x7f955c0fc140 msgr2=0x7f955c0fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:02.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.556+0000 7f9561dff700 1 -- 172.21.15.59:0/4201923988 shutdown_connections 2023-10-08T12:44:02.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.556+0000 7f9561dff700 1 -- 172.21.15.59:0/4201923988 wait complete. 2023-10-08T12:44:02.559 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:44:02.577 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:44:02.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.790+0000 7feac5fff700 1 -- 172.21.15.59:0/1586824555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feac0072ba0 msgr2=0x7feac0072f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.790+0000 7feac5fff700 1 --2- 172.21.15.59:0/1586824555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feac0072ba0 0x7feac0072f80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7feab0009990 tx=0x7feab0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.790+0000 7feac5fff700 1 -- 172.21.15.59:0/1586824555 shutdown_connections 2023-10-08T12:44:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.790+0000 7feac5fff700 1 --2- 172.21.15.59:0/1586824555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feac010d000 0x7feac010f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.790+0000 7feac5fff700 1 --2- 172.21.15.59:0/1586824555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feac0072ba0 0x7feac0072f80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.790+0000 7feac5fff700 1 --2- 172.21.15.59:0/1586824555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac00734c0 0x7feac010cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.790+0000 7feac5fff700 1 -- 172.21.15.59:0/1586824555 >> 172.21.15.59:0/1586824555 conn(0x7feac00fc230 msgr2=0x7feac00fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.790+0000 7feac5fff700 1 -- 172.21.15.59:0/1586824555 shutdown_connections 2023-10-08T12:44:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.790+0000 7feac5fff700 1 -- 172.21.15.59:0/1586824555 wait complete. 2023-10-08T12:44:02.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.791+0000 7feac5fff700 1 Processor -- start 2023-10-08T12:44:02.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.791+0000 7feac5fff700 1 -- start start 2023-10-08T12:44:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feac5fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feac0072ba0 0x7feac0198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feac5fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feac00734c0 0x7feac01992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feac5fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac010d000 0x7feac019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feac5fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac019dcd0 con 0x7feac0072ba0 2023-10-08T12:44:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feac5fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac019de40 con 0x7feac00734c0 2023-10-08T12:44:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feac5fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac019e000 con 0x7feac010d000 2023-10-08T12:44:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feabf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feac0072ba0 0x7feac0198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feabf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feac0072ba0 0x7feac0198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53990/0 (socket says 172.21.15.59:53990) 2023-10-08T12:44:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feabf7fe700 1 -- 172.21.15.59:0/3466324854 learned_addr learned my addr 172.21.15.59:0/3466324854 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feabeffd700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feac00734c0 0x7feac01992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feabffff700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac010d000 0x7feac019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feabf7fe700 1 -- 172.21.15.59:0/3466324854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac010d000 msgr2=0x7feac019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feabf7fe700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac010d000 0x7feac019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feabf7fe700 1 -- 172.21.15.59:0/3466324854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feac00734c0 msgr2=0x7feac01992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feabf7fe700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feac00734c0 0x7feac01992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.792+0000 7feabf7fe700 1 -- 172.21.15.59:0/3466324854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab00095f0 con 0x7feac0072ba0 2023-10-08T12:44:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.793+0000 7feabf7fe700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feac0072ba0 0x7feac0198db0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feab0000c00 tx=0x7feab0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.793+0000 7feabcff9700 1 -- 172.21.15.59:0/3466324854 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab001d070 con 0x7feac0072ba0 2023-10-08T12:44:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.793+0000 7feabcff9700 1 -- 172.21.15.59:0/3466324854 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feab0022470 con 0x7feac0072ba0 2023-10-08T12:44:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.793+0000 7feac5fff700 1 -- 172.21.15.59:0/3466324854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac019e280 con 0x7feac0072ba0 2023-10-08T12:44:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.793+0000 7feabcff9700 1 -- 172.21.15.59:0/3466324854 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0017650 con 0x7feac0072ba0 2023-10-08T12:44:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.793+0000 7feac5fff700 1 -- 172.21.15.59:0/3466324854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac01a5b20 con 0x7feac0072ba0 2023-10-08T12:44:02.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.797+0000 7feabcff9700 1 -- 172.21.15.59:0/3466324854 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7feab00225e0 con 0x7feac0072ba0 2023-10-08T12:44:02.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.798+0000 7fead9934b80 1 Processor -- start 2023-10-08T12:44:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.798+0000 7feabcff9700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feaa80a1670 0x7feaa80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.798+0000 7fead9934b80 1 -- start start 2023-10-08T12:44:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.798+0000 7feabcff9700 1 -- 172.21.15.59:0/3466324854 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7feab00ce200 con 0x7feac0072ba0 2023-10-08T12:44:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.798+0000 7fead9934b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b0623e80 0x55f8b0624260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.798+0000 7fead9934b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.798+0000 7fead9934b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b062f650 0x55f8b0631a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.798+0000 7fead9934b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b058d460 con 0x55f8b06247a0 2023-10-08T12:44:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.798+0000 7fead9934b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b057ec20 con 0x55f8b062f650 2023-10-08T12:44:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.798+0000 7fead9934b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b057c540 con 0x55f8b0623e80 2023-10-08T12:44:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabffff700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feaa80a1670 0x7feaa80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53996/0 (socket says 172.21.15.59:53996) 2023-10-08T12:44:02.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabeffd700 1 -- 172.21.15.59:0/2847549463 learned_addr learned my addr 172.21.15.59:0/2847549463 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:02.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabf7fe700 1 --2- 172.21.15.59:0/2847549463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b0623e80 0x55f8b0624260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabf7fe700 1 -- 172.21.15.59:0/2847549463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b062f650 msgr2=0x55f8b0631a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:44:02.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabf7fe700 1 --2- 172.21.15.59:0/2847549463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b062f650 0x55f8b0631a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabf7fe700 1 -- 172.21.15.59:0/2847549463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 msgr2=0x55f8b062f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:02.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabf7fe700 1 --2- 172.21.15.59:0/2847549463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabf7fe700 1 -- 172.21.15.59:0/2847549463 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8b03a2de0 con 0x55f8b0623e80 2023-10-08T12:44:02.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabeffd700 1 --2- 172.21.15.59:0/2847549463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:02.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabf7fe700 1 --2- 172.21.15.59:0/2847549463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b0623e80 0x55f8b0624260 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feab00cb940 tx=0x7feab009ae50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f328d6f22fdb4db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.799+0000 7feabffff700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feaa80a1670 0x7feaa80a3b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feab800f5d0 tx=0x7feab800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.800+0000 7feaa5ffb700 1 -- 172.21.15.59:0/2847549463 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0095ea0 con 0x55f8b0623e80 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.800+0000 7feaa5ffb700 1 -- 172.21.15.59:0/2847549463 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feab009b290 con 0x55f8b0623e80 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.800+0000 7feaa5ffb700 1 -- 172.21.15.59:0/2847549463 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab009b4f0 con 0x55f8b0623e80 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.800+0000 7fead9934b80 1 -- 172.21.15.59:0/2847549463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b0623e80 msgr2=0x55f8b0624260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.800+0000 7fead9934b80 1 --2- 172.21.15.59:0/2847549463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b0623e80 0x55f8b0624260 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feab00cb940 tx=0x7feab009ae50 comp rx=0 tx=0).stop 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.800+0000 7fead9934b80 1 -- 172.21.15.59:0/2847549463 shutdown_connections 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.800+0000 7fead9934b80 1 --2- 172.21.15.59:0/2847549463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b062f650 0x55f8b0631a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.800+0000 7fead9934b80 1 --2- 172.21.15.59:0/2847549463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b0623e80 0x55f8b0624260 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.800+0000 7fead9934b80 1 --2- 172.21.15.59:0/2847549463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.800+0000 7fead9934b80 1 -- 172.21.15.59:0/2847549463 >> 172.21.15.59:0/2847549463 conn(0x55f8b0599260 msgr2=0x55f8b06202d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.800+0000 7fead9934b80 1 -- 172.21.15.59:0/2847549463 shutdown_connections 2023-10-08T12:44:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.801+0000 7fead9934b80 1 -- 172.21.15.59:0/2847549463 wait complete. 2023-10-08T12:44:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.801+0000 7fead9934b80 1 -- start start 2023-10-08T12:44:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.801+0000 7fead9934b80 1 Processor -- start 2023-10-08T12:44:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7fead9934b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b0623e80 0x55f8b062fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7fead9934b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7fead9934b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b062f650 0x55f8b063aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7fead9934b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b0577e30 con 0x55f8b06247a0 2023-10-08T12:44:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7fead9934b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b0514710 con 0x55f8b062f650 2023-10-08T12:44:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7fead9934b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b05143b0 con 0x55f8b0623e80 2023-10-08T12:44:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7fead9934b80 10 client.0 _ll_register_callbacks cb 0x55f8b0371800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7feabeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7feabeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53998/0 (socket says 172.21.15.59:53998) 2023-10-08T12:44:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7feabeffd700 1 -- 172.21.15.59:0/4129131991 learned_addr learned my addr 172.21.15.59:0/4129131991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7feabffff700 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b062f650 0x55f8b063aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7feabf7fe700 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b0623e80 0x55f8b062fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7feabeffd700 1 -- 172.21.15.59:0/4129131991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b0623e80 msgr2=0x55f8b062fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7feabeffd700 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b0623e80 0x55f8b062fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7feabeffd700 1 -- 172.21.15.59:0/4129131991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b062f650 msgr2=0x55f8b063aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7feabeffd700 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b062f650 0x55f8b063aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.802+0000 7feabeffd700 1 -- 172.21.15.59:0/4129131991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab4009980 con 0x55f8b06247a0 2023-10-08T12:44:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.803+0000 7feabeffd700 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062ff70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feab4012980 tx=0x7feab4012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa533dd274b66941 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.803+0000 7fea9effd700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:44:02.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.803+0000 7fea9effd700 1 -- 172.21.15.59:0/4129131991 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4017070 con 0x55f8b06247a0 2023-10-08T12:44:02.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.803+0000 7fea9effd700 1 -- 172.21.15.59:0/4129131991 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7feab4004020 con 0x55f8b06247a0 2023-10-08T12:44:02.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.803+0000 7fead9934b80 1 -- 172.21.15.59:0/4129131991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8b053feb0 con 0x55f8b06247a0 2023-10-08T12:44:02.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.803+0000 7fea9effd700 1 -- 172.21.15.59:0/4129131991 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7feab40041e0 con 0x55f8b06247a0 2023-10-08T12:44:02.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.803+0000 7fead9934b80 10 client.15777 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:02.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.803+0000 7fead9934b80 1 -- 172.21.15.59:0/4129131991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7feac01a5b20 con 0x55f8b06247a0 2023-10-08T12:44:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.803+0000 7fea9effd700 1 -- 172.21.15.59:0/4129131991 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f8b053feb0 con 0x55f8b06247a0 2023-10-08T12:44:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.804+0000 7fea9effd700 1 -- 172.21.15.59:0/4129131991 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7feab400f5e0 con 0x55f8b06247a0 2023-10-08T12:44:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.804+0000 7fead9934b80 10 client.15777 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.804+0000 7fead9934b80 10 client.15777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.804+0000 7fead9934b80 20 client.15777 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.804+0000 7fead9934b80 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f8b063eef0 0x55f8b0641310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.804+0000 7fead9934b80 4 client.15777 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.804+0000 7fead9934b80 1 -- 172.21.15.59:0/4129131991 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8b0570e10 con 0x55f8b063eef0 2023-10-08T12:44:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.804+0000 7feabf7fe700 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f8b063eef0 0x55f8b0641310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.805+0000 7feabf7fe700 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f8b063eef0 0x55f8b0641310 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36aad68539290e77 server_cookie=476e64fe23987b4a in_seq=0 out_seq=0 2023-10-08T12:44:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.805+0000 7fea9effd700 10 client.15777 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.805+0000 7fea9effd700 1 -- 172.21.15.59:0/4129131991 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f8b0570e10 con 0x55f8b063eef0 2023-10-08T12:44:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.805+0000 7fea9effd700 10 client.15777 handle_command_reply: tid=0 2023-10-08T12:44:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.805+0000 7fead9934b80 1 client.15777 shutdown 2023-10-08T12:44:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.805+0000 7fead9934b80 1 -- 172.21.15.59:0/4129131991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 msgr2=0x55f8b062ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.806+0000 7fead9934b80 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062ff70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feab4012980 tx=0x7feab4012c90 comp rx=0 tx=0).stop 2023-10-08T12:44:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.806+0000 7fead9934b80 1 -- 172.21.15.59:0/4129131991 shutdown_connections 2023-10-08T12:44:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.806+0000 7fead9934b80 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f8b063eef0 0x55f8b0641310 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.806+0000 7fead9934b80 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b062f650 0x55f8b063aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.806+0000 7fead9934b80 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b0623e80 0x55f8b062fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.806+0000 7fea9effd700 0 client.15777 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.806+0000 7fead9934b80 1 --2- 172.21.15.59:0/4129131991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b06247a0 0x55f8b062ff70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.806+0000 7fead9934b80 1 -- 172.21.15.59:0/4129131991 >> 172.21.15.59:0/4129131991 conn(0x55f8b0599260 msgr2=0x55f8b061fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.806+0000 7fead9934b80 1 -- 172.21.15.59:0/4129131991 shutdown_connections 2023-10-08T12:44:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.806+0000 7fead9934b80 1 -- 172.21.15.59:0/4129131991 wait complete. 2023-10-08T12:44:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.806+0000 7fead9934b80 20 client.15777 trim_cache size 0 max 16384 2023-10-08T12:44:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.820+0000 7fead9934b80 1 Processor -- start 2023-10-08T12:44:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.820+0000 7fead9934b80 1 -- start start 2023-10-08T12:44:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.820+0000 7fead9934b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 0x55f8b0634a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.820+0000 7fead9934b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 0x55f8b062d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.820+0000 7fead9934b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b062f650 0x55f8b062d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.820+0000 7fead9934b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b03f8920 con 0x55f8b062f650 2023-10-08T12:44:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.820+0000 7fead9934b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b053feb0 con 0x55f8b0623e80 2023-10-08T12:44:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.820+0000 7fead9934b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b062ef10 con 0x55f8b06247a0 2023-10-08T12:44:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabeffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 0x55f8b062d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b062f650 0x55f8b062d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabeffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 0x55f8b062d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:32964/0 (socket says 172.21.15.59:32964) 2023-10-08T12:44:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabeffd700 1 -- 172.21.15.59:0/2434635497 learned_addr learned my addr 172.21.15.59:0/2434635497 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabf7fe700 1 --2- 172.21.15.59:0/2434635497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 0x55f8b0634a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabeffd700 1 -- 172.21.15.59:0/2434635497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 msgr2=0x55f8b0634a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabeffd700 1 --2- 172.21.15.59:0/2434635497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 0x55f8b0634a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabeffd700 1 -- 172.21.15.59:0/2434635497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b062f650 msgr2=0x55f8b062d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabeffd700 1 --2- 172.21.15.59:0/2434635497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b062f650 0x55f8b062d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabeffd700 1 -- 172.21.15.59:0/2434635497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8b038bc60 con 0x55f8b06247a0 2023-10-08T12:44:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabffff700 1 --2- 172.21.15.59:0/2434635497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b062f650 0x55f8b062d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.821+0000 7feabeffd700 1 --2- 172.21.15.59:0/2434635497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 0x55f8b062d1b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feab4000c00 tx=0x7feab40123a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd91de05f0ca0f60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7feaa67fc700 1 -- 172.21.15.59:0/2434635497 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4017040 con 0x55f8b06247a0 2023-10-08T12:44:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7feaa67fc700 1 -- 172.21.15.59:0/2434635497 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feab400f5e0 con 0x55f8b06247a0 2023-10-08T12:44:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7feaa67fc700 1 -- 172.21.15.59:0/2434635497 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab40038e0 con 0x55f8b06247a0 2023-10-08T12:44:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7fead9934b80 1 -- 172.21.15.59:0/2434635497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 msgr2=0x55f8b062d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7fead9934b80 1 --2- 172.21.15.59:0/2434635497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 0x55f8b062d1b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feab4000c00 tx=0x7feab40123a0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7fead9934b80 1 -- 172.21.15.59:0/2434635497 shutdown_connections 2023-10-08T12:44:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7fead9934b80 1 --2- 172.21.15.59:0/2434635497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 0x55f8b0634a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7fead9934b80 1 --2- 172.21.15.59:0/2434635497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b062f650 0x55f8b062d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7fead9934b80 1 --2- 172.21.15.59:0/2434635497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 0x55f8b062d1b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7fead9934b80 1 -- 172.21.15.59:0/2434635497 >> 172.21.15.59:0/2434635497 conn(0x55f8b0599260 msgr2=0x55f8b0629bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7fead9934b80 1 -- 172.21.15.59:0/2434635497 shutdown_connections 2023-10-08T12:44:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.822+0000 7fead9934b80 1 -- 172.21.15.59:0/2434635497 wait complete. 2023-10-08T12:44:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.823+0000 7fead9934b80 1 -- start start 2023-10-08T12:44:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.823+0000 7fead9934b80 1 Processor -- start 2023-10-08T12:44:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7fead9934b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 0x55f8b0686e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7fead9934b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 0x55f8b06873a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7fead9934b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b062f650 0x55f8b0691cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7fead9934b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b0692230 con 0x55f8b062f650 2023-10-08T12:44:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7fead9934b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b0692370 con 0x55f8b0623e80 2023-10-08T12:44:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7fead9934b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8b0692530 con 0x55f8b06247a0 2023-10-08T12:44:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7fead9934b80 10 client.0 _ll_register_callbacks cb 0x7feab4012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7feabf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 0x55f8b0686e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7feabf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 0x55f8b0686e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45462/0 (socket says 172.21.15.59:45462) 2023-10-08T12:44:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7feabf7fe700 1 -- 172.21.15.59:0/1250043000 learned_addr learned my addr 172.21.15.59:0/1250043000 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7feabffff700 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b062f650 0x55f8b0691cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7feabeffd700 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 0x55f8b06873a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7feabf7fe700 1 -- 172.21.15.59:0/1250043000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 msgr2=0x55f8b06873a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7feabf7fe700 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 0x55f8b06873a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7feabf7fe700 1 -- 172.21.15.59:0/1250043000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b062f650 msgr2=0x55f8b0691cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7feabf7fe700 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b062f650 0x55f8b0691cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.824+0000 7feabf7fe700 1 -- 172.21.15.59:0/1250043000 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab80090f0 con 0x55f8b0623e80 2023-10-08T12:44:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7feabf7fe700 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 0x55f8b0686e60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feab0022890 tx=0x7feab0009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39456e72959742a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fea9effd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:44:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fea9effd700 1 -- 172.21.15.59:0/1250043000 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0095ea0 con 0x55f8b0623e80 2023-10-08T12:44:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fead9934b80 1 -- 172.21.15.59:0/1250043000 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feab009b290 con 0x55f8b0623e80 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fea9effd700 1 -- 172.21.15.59:0/1250043000 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7feab009f040 con 0x55f8b0623e80 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fea9effd700 1 -- 172.21.15.59:0/1250043000 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7feab009f200 con 0x55f8b0623e80 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fead9934b80 10 client.25781 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fead9934b80 1 -- 172.21.15.59:0/1250043000 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7feac01a5b20 con 0x55f8b0623e80 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fea9effd700 1 -- 172.21.15.59:0/1250043000 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feab009b290 con 0x55f8b0623e80 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fea9effd700 1 -- 172.21.15.59:0/1250043000 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7feab009a780 con 0x55f8b0623e80 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fead9934b80 10 client.25781 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fead9934b80 10 client.25781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fead9934b80 20 client.25781 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.825+0000 7fead9934b80 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f8b0693960 0x55f8b0695d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.826+0000 7fead9934b80 4 client.25781 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:44:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.826+0000 7fead9934b80 1 -- 172.21.15.59:0/1250043000 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f8b0570b30 con 0x55f8b0693960 2023-10-08T12:44:02.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.826+0000 7feabeffd700 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f8b0693960 0x55f8b0695d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:02.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.826+0000 7feabeffd700 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f8b0693960 0x55f8b0695d50 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46c80b3b5393bf41 server_cookie=eb50ae4c4e87097a in_seq=0 out_seq=0 2023-10-08T12:44:02.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.826+0000 7fea9effd700 10 client.25781 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:02.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.826+0000 7fea9effd700 1 -- 172.21.15.59:0/1250043000 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f8b0570b30 con 0x55f8b0693960 2023-10-08T12:44:02.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.826+0000 7fea9effd700 10 client.25781 handle_command_reply: tid=0 2023-10-08T12:44:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.826+0000 7fead9934b80 1 client.25781 shutdown 2023-10-08T12:44:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fead9934b80 1 -- 172.21.15.59:0/1250043000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 msgr2=0x55f8b0686e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fead9934b80 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 0x55f8b0686e60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feab0022890 tx=0x7feab0009310 comp rx=0 tx=0).stop 2023-10-08T12:44:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fead9934b80 1 -- 172.21.15.59:0/1250043000 shutdown_connections 2023-10-08T12:44:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fead9934b80 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f8b0693960 0x55f8b0695d50 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fead9934b80 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f8b0623e80 0x55f8b0686e60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fead9934b80 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f8b062f650 0x55f8b0691cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fea9effd700 0 client.25781 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fead9934b80 1 --2- 172.21.15.59:0/1250043000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8b06247a0 0x55f8b06873a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fead9934b80 1 -- 172.21.15.59:0/1250043000 >> 172.21.15.59:0/1250043000 conn(0x55f8b0599260 msgr2=0x55f8b062d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fead9934b80 1 -- 172.21.15.59:0/1250043000 shutdown_connections 2023-10-08T12:44:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fead9934b80 1 -- 172.21.15.59:0/1250043000 wait complete. 2023-10-08T12:44:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.827+0000 7fead9934b80 20 client.25781 trim_cache size 0 max 16384 2023-10-08T12:44:02.838 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:44:02.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 -- 172.21.15.59:0/3466324854 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feaa80a1670 msgr2=0x7feaa80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feaa80a1670 0x7feaa80a3b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feab800f5d0 tx=0x7feab800b040 comp rx=0 tx=0).stop 2023-10-08T12:44:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 -- 172.21.15.59:0/3466324854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feac0072ba0 msgr2=0x7feac0198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feac0072ba0 0x7feac0198db0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feab0000c00 tx=0x7feab0004730 comp rx=0 tx=0).stop 2023-10-08T12:44:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 -- 172.21.15.59:0/3466324854 shutdown_connections 2023-10-08T12:44:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7feaa80a1670 0x7feaa80a3b30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac010d000 0x7feac019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feac0072ba0 0x7feac0198db0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 --2- 172.21.15.59:0/3466324854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feac00734c0 0x7feac01992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 -- 172.21.15.59:0/3466324854 >> 172.21.15.59:0/3466324854 conn(0x7feac00fc230 msgr2=0x7feac00fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 -- 172.21.15.59:0/3466324854 shutdown_connections 2023-10-08T12:44:02.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:02.828+0000 7feac5fff700 1 -- 172.21.15.59:0/3466324854 wait complete. 2023-10-08T12:44:03.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:02 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4201923988' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:44:03.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:02 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4201923988' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:44:03.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:02 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4201923988' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:44:03.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 255505 14.85 MB/sec warmup 94 sec latency 121.850 ms 2023-10-08T12:44:03.849 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:44:03.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:44:04.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.064+0000 7ff82c1ff700 1 -- 172.21.15.59:0/1765682297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff824106750 msgr2=0x7ff824106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.064+0000 7ff82c1ff700 1 --2- 172.21.15.59:0/1765682297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff824106750 0x7ff824106b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff820009990 tx=0x7ff820009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.064+0000 7ff82c1ff700 1 -- 172.21.15.59:0/1765682297 shutdown_connections 2023-10-08T12:44:04.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.064+0000 7ff82c1ff700 1 --2- 172.21.15.59:0/1765682297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824101100 0x7ff82410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.064+0000 7ff82c1ff700 1 --2- 172.21.15.59:0/1765682297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff824106750 0x7ff824106b30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.064+0000 7ff82c1ff700 1 --2- 172.21.15.59:0/1765682297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff824100740 0x7ff824100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.064+0000 7ff82c1ff700 1 -- 172.21.15.59:0/1765682297 >> 172.21.15.59:0/1765682297 conn(0x7ff8240fc230 msgr2=0x7ff8240fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.064+0000 7ff82c1ff700 1 -- 172.21.15.59:0/1765682297 shutdown_connections 2023-10-08T12:44:04.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.064+0000 7ff82c1ff700 1 -- 172.21.15.59:0/1765682297 wait complete. 2023-10-08T12:44:04.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.065+0000 7ff82c1ff700 1 Processor -- start 2023-10-08T12:44:04.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.065+0000 7ff82c1ff700 1 -- start start 2023-10-08T12:44:04.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82c1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff824100740 0x7ff824072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82c1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824101100 0x7ff824073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82c1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff824106750 0x7ff824073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82c1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8241a4f70 con 0x7ff824100740 2023-10-08T12:44:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82c1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8241a50e0 con 0x7ff824101100 2023-10-08T12:44:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82c1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8241a52a0 con 0x7ff824106750 2023-10-08T12:44:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824101100 0x7ff824073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff829f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff824100740 0x7ff824072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82a79c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff824106750 0x7ff824073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824101100 0x7ff824073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45466/0 (socket says 172.21.15.59:45466) 2023-10-08T12:44:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82a79c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff824106750 0x7ff824073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:32984/0 (socket says 172.21.15.59:32984) 2023-10-08T12:44:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82979a700 1 -- 172.21.15.59:0/2279601055 learned_addr learned my addr 172.21.15.59:0/2279601055 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82979a700 1 -- 172.21.15.59:0/2279601055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff824106750 msgr2=0x7ff824073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82979a700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff824106750 0x7ff824073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82979a700 1 -- 172.21.15.59:0/2279601055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff824100740 msgr2=0x7ff824072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82979a700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff824100740 0x7ff824072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.066+0000 7ff82979a700 1 -- 172.21.15.59:0/2279601055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8200095f0 con 0x7ff824101100 2023-10-08T12:44:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.067+0000 7ff82979a700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824101100 0x7ff824073030 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff81400e9a0 tx=0x7ff81400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.067+0000 7ff81affd700 1 -- 172.21.15.59:0/2279601055 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814009790 con 0x7ff824101100 2023-10-08T12:44:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.067+0000 7ff82c1ff700 1 -- 172.21.15.59:0/2279601055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8241a5580 con 0x7ff824101100 2023-10-08T12:44:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.067+0000 7ff81affd700 1 -- 172.21.15.59:0/2279601055 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff814010430 con 0x7ff824101100 2023-10-08T12:44:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.067+0000 7ff81affd700 1 -- 172.21.15.59:0/2279601055 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814018680 con 0x7ff824101100 2023-10-08T12:44:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.067+0000 7ff82c1ff700 1 -- 172.21.15.59:0/2279601055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8241a5ae0 con 0x7ff824101100 2023-10-08T12:44:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.070+0000 7ff81affd700 1 -- 172.21.15.59:0/2279601055 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff8140105a0 con 0x7ff824101100 2023-10-08T12:44:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.071+0000 7ff83fa60b80 1 Processor -- start 2023-10-08T12:44:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff83fa60b80 1 -- start start 2023-10-08T12:44:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff81affd700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8100a15f0 0x7ff8100a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 0x55aab46122e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff81affd700 1 -- 172.21.15.59:0/2279601055 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff814014070 con 0x7ff824101100 2023-10-08T12:44:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4612820 0x55aab461d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab461d6d0 0x55aab461fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab457b4e0 con 0x55aab4611f00 2023-10-08T12:44:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab456cca0 con 0x55aab461d6d0 2023-10-08T12:44:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab456a5c0 con 0x55aab4612820 2023-10-08T12:44:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff82a79c700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8100a15f0 0x7ff8100a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff82979a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4612820 0x55aab461d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff82979a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4612820 0x55aab461d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:32990/0 (socket says 172.21.15.59:32990) 2023-10-08T12:44:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff82979a700 1 -- 172.21.15.59:0/80107167 learned_addr learned my addr 172.21.15.59:0/80107167 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff829f9b700 1 --2- 172.21.15.59:0/80107167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 0x55aab46122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.072+0000 7ff82a79c700 1 --2- 172.21.15.59:0/80107167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab461d6d0 0x55aab461fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.073+0000 7ff82979a700 1 -- 172.21.15.59:0/80107167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab461d6d0 msgr2=0x55aab461fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.073+0000 7ff82979a700 1 --2- 172.21.15.59:0/80107167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab461d6d0 0x55aab461fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.073+0000 7ff82979a700 1 -- 172.21.15.59:0/80107167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 msgr2=0x55aab46122e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.073+0000 7ff82979a700 1 --2- 172.21.15.59:0/80107167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 0x55aab46122e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.073+0000 7ff82979a700 1 -- 172.21.15.59:0/80107167 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aab4390e60 con 0x55aab4612820 2023-10-08T12:44:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.073+0000 7ff829f9b700 1 --2- 172.21.15.59:0/80107167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 0x55aab46122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.073+0000 7ff82979a700 1 --2- 172.21.15.59:0/80107167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4612820 0x55aab461d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff814099fa0 tx=0x7ff814099f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c4e24448b4cd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.073+0000 7ff82a79c700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8100a15f0 0x7ff8100a3ab0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009ec0 tx=0x7ff81c009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.073+0000 7ff80ffff700 1 -- 172.21.15.59:0/80107167 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8140b1070 con 0x55aab4612820 2023-10-08T12:44:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.073+0000 7ff80ffff700 1 -- 172.21.15.59:0/80107167 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff81409e1b0 con 0x55aab4612820 2023-10-08T12:44:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.073+0000 7ff80ffff700 1 -- 172.21.15.59:0/80107167 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81409a760 con 0x55aab4612820 2023-10-08T12:44:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.074+0000 7ff83fa60b80 1 -- 172.21.15.59:0/80107167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4612820 msgr2=0x55aab461d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.074+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/80107167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4612820 0x55aab461d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff814099fa0 tx=0x7ff814099f10 comp rx=0 tx=0).stop 2023-10-08T12:44:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.074+0000 7ff83fa60b80 1 -- 172.21.15.59:0/80107167 shutdown_connections 2023-10-08T12:44:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.074+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/80107167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab461d6d0 0x55aab461fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.074+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/80107167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 0x55aab46122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.074+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/80107167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4612820 0x55aab461d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.074+0000 7ff83fa60b80 1 -- 172.21.15.59:0/80107167 >> 172.21.15.59:0/80107167 conn(0x55aab45872e0 msgr2=0x55aab460e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.074+0000 7ff83fa60b80 1 -- 172.21.15.59:0/80107167 shutdown_connections 2023-10-08T12:44:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.074+0000 7ff83fa60b80 1 -- 172.21.15.59:0/80107167 wait complete. 2023-10-08T12:44:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.075+0000 7ff83fa60b80 1 -- start start 2023-10-08T12:44:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.075+0000 7ff83fa60b80 1 Processor -- start 2023-10-08T12:44:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.075+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 0x55aab461a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.075+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 0x55aab461a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.075+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 0x55aab461af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.075+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab4565eb0 con 0x55aab4611f00 2023-10-08T12:44:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.075+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab4502790 con 0x55aab4612820 2023-10-08T12:44:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.075+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab4502430 con 0x55aab461d6d0 2023-10-08T12:44:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.075+0000 7ff83fa60b80 10 client.0 _ll_register_callbacks cb 0x55aab435f880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff829f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 0x55aab461a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 0x55aab461a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82a79c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 0x55aab461af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 0x55aab461a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45488/0 (socket says 172.21.15.59:45488) 2023-10-08T12:44:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82a79c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 0x55aab461af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:32996/0 (socket says 172.21.15.59:32996) 2023-10-08T12:44:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82979a700 1 -- 172.21.15.59:0/2475386850 learned_addr learned my addr 172.21.15.59:0/2475386850 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff829f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 0x55aab461a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54056/0 (socket says 172.21.15.59:54056) 2023-10-08T12:44:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82979a700 1 -- 172.21.15.59:0/2475386850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 msgr2=0x55aab461af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82979a700 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 0x55aab461af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82979a700 1 -- 172.21.15.59:0/2475386850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 msgr2=0x55aab461a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82979a700 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 0x55aab461a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82979a700 1 -- 172.21.15.59:0/2475386850 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8241a5ae0 con 0x55aab4612820 2023-10-08T12:44:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82a79c700 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 0x55aab461af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff82979a700 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 0x55aab461a9d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff8140a2100 tx=0x7ff8140ca980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ce247c8642621cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff80d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:44:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2475386850 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8140b1070 con 0x55aab4612820 2023-10-08T12:44:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2475386850 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff81409e3f0 con 0x55aab4612820 2023-10-08T12:44:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.076+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2475386850 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aab452df30 con 0x55aab4612820 2023-10-08T12:44:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.077+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2475386850 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff81409a500 con 0x55aab4612820 2023-10-08T12:44:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.077+0000 7ff83fa60b80 10 client.25793 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.077+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2475386850 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55aab4379ce0 con 0x55aab4612820 2023-10-08T12:44:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.077+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2475386850 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55aab452df30 con 0x55aab4612820 2023-10-08T12:44:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.077+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2475386850 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff81407d050 con 0x55aab4612820 2023-10-08T12:44:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.077+0000 7ff83fa60b80 10 client.25793 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:04.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.077+0000 7ff83fa60b80 10 client.25793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:04.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.077+0000 7ff83fa60b80 20 client.25793 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:04.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.077+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55aab462ce90 0x55aab462f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.077+0000 7ff83fa60b80 4 client.25793 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:04.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.077+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2475386850 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aab455ee90 con 0x55aab462ce90 2023-10-08T12:44:04.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.078+0000 7ff829f9b700 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55aab462ce90 0x55aab462f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.078+0000 7ff829f9b700 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55aab462ce90 0x55aab462f280 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=589a4d981250976b server_cookie=2c8c8abd4b9f82a0 in_seq=0 out_seq=0 2023-10-08T12:44:04.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.078+0000 7ff80d7fa700 10 client.25793 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:04.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2475386850 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55aab455ee90 con 0x55aab462ce90 2023-10-08T12:44:04.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff80d7fa700 10 client.25793 handle_command_reply: tid=0 2023-10-08T12:44:04.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 1 client.25793 shutdown 2023-10-08T12:44:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2475386850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 msgr2=0x55aab461a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 0x55aab461a9d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff8140a2100 tx=0x7ff8140ca980 comp rx=0 tx=0).stop 2023-10-08T12:44:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2475386850 shutdown_connections 2023-10-08T12:44:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55aab462ce90 0x55aab462f280 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 0x55aab461af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4611f00 0x55aab461a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2475386850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 0x55aab461a9d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff80d7fa700 0 client.25793 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2475386850 >> 172.21.15.59:0/2475386850 conn(0x55aab45872e0 msgr2=0x55aab460df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2475386850 shutdown_connections 2023-10-08T12:44:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2475386850 wait complete. 2023-10-08T12:44:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.079+0000 7ff83fa60b80 20 client.25793 trim_cache size 0 max 16384 2023-10-08T12:44:04.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.098+0000 7ff83fa60b80 1 Processor -- start 2023-10-08T12:44:04.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.098+0000 7ff83fa60b80 1 -- start start 2023-10-08T12:44:04.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.098+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4611f00 0x55aab4614dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.098+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4612820 0x55aab461ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.098+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 0x55aab46176f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.098+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab43e69a0 con 0x55aab4612820 2023-10-08T12:44:04.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.098+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab461d500 con 0x55aab4611f00 2023-10-08T12:44:04.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.098+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab455ee90 con 0x55aab461d6d0 2023-10-08T12:44:04.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.098+0000 7ff829f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4611f00 0x55aab4614dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff829f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4611f00 0x55aab4614dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45492/0 (socket says 172.21.15.59:45492) 2023-10-08T12:44:04.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff829f9b700 1 -- 172.21.15.59:0/3737635399 learned_addr learned my addr 172.21.15.59:0/3737635399 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:04.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff82a79c700 1 --2- 172.21.15.59:0/3737635399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 0x55aab46176f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff82979a700 1 --2- 172.21.15.59:0/3737635399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4612820 0x55aab461ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff829f9b700 1 -- 172.21.15.59:0/3737635399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 msgr2=0x55aab46176f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff829f9b700 1 --2- 172.21.15.59:0/3737635399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 0x55aab46176f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff829f9b700 1 -- 172.21.15.59:0/3737635399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4612820 msgr2=0x55aab461ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff829f9b700 1 --2- 172.21.15.59:0/3737635399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4612820 0x55aab461ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff829f9b700 1 -- 172.21.15.59:0/3737635399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aab4633e70 con 0x55aab4611f00 2023-10-08T12:44:04.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff829f9b700 1 --2- 172.21.15.59:0/3737635399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4611f00 0x55aab4614dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff8200098e0 tx=0x7ff820005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af18bc1fc56d820c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff818ff9700 1 -- 172.21.15.59:0/3737635399 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82001d040 con 0x55aab4611f00 2023-10-08T12:44:04.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff818ff9700 1 -- 172.21.15.59:0/3737635399 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff82001e040 con 0x55aab4611f00 2023-10-08T12:44:04.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.099+0000 7ff818ff9700 1 -- 172.21.15.59:0/3737635399 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000b990 con 0x55aab4611f00 2023-10-08T12:44:04.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.100+0000 7ff83fa60b80 1 -- 172.21.15.59:0/3737635399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4611f00 msgr2=0x55aab4614dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.100+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/3737635399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4611f00 0x55aab4614dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff8200098e0 tx=0x7ff820005fd0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.100+0000 7ff83fa60b80 1 -- 172.21.15.59:0/3737635399 shutdown_connections 2023-10-08T12:44:04.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.100+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/3737635399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4611f00 0x55aab4614dd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.100+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/3737635399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab461d6d0 0x55aab46176f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.100+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/3737635399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab4612820 0x55aab461ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.100+0000 7ff83fa60b80 1 -- 172.21.15.59:0/3737635399 >> 172.21.15.59:0/3737635399 conn(0x55aab45872e0 msgr2=0x55aab46194c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.100+0000 7ff83fa60b80 1 -- 172.21.15.59:0/3737635399 shutdown_connections 2023-10-08T12:44:04.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.100+0000 7ff83fa60b80 1 -- 172.21.15.59:0/3737635399 wait complete. 2023-10-08T12:44:04.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.101+0000 7ff83fa60b80 1 -- start start 2023-10-08T12:44:04.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.101+0000 7ff83fa60b80 1 Processor -- start 2023-10-08T12:44:04.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.101+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4611f00 0x55aab46230e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.101+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 0x55aab4623620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.101+0000 7ff83fa60b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab461d6d0 0x55aab4680c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.101+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab46811a0 con 0x55aab461d6d0 2023-10-08T12:44:04.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.101+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab46812e0 con 0x55aab4612820 2023-10-08T12:44:04.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.101+0000 7ff83fa60b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab4681450 con 0x55aab4611f00 2023-10-08T12:44:04.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.101+0000 7ff83fa60b80 10 client.0 _ll_register_callbacks cb 0x7ff81c013970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff829f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4611f00 0x55aab46230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff829f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4611f00 0x55aab46230e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:33012/0 (socket says 172.21.15.59:33012) 2023-10-08T12:44:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff829f9b700 1 -- 172.21.15.59:0/2402435529 learned_addr learned my addr 172.21.15.59:0/2402435529 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff82979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 0x55aab4623620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff82a79c700 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab461d6d0 0x55aab4680c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff829f9b700 1 -- 172.21.15.59:0/2402435529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 msgr2=0x55aab4623620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff829f9b700 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 0x55aab4623620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff829f9b700 1 -- 172.21.15.59:0/2402435529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab461d6d0 msgr2=0x55aab4680c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff829f9b700 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab461d6d0 0x55aab4680c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff829f9b700 1 -- 172.21.15.59:0/2402435529 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82410df10 con 0x55aab4611f00 2023-10-08T12:44:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff829f9b700 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4611f00 0x55aab46230e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff820009ce0 tx=0x7ff82000b6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ab86db799753c40 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff80d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:44:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2402435529 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82001d040 con 0x55aab4611f00 2023-10-08T12:44:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2402435529 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff81409e1b0 con 0x55aab4611f00 2023-10-08T12:44:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.102+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2402435529 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff820005600 con 0x55aab4611f00 2023-10-08T12:44:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2402435529 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff820029af0 con 0x55aab4611f00 2023-10-08T12:44:04.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff83fa60b80 10 client.25792 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:04.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2402435529 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55aab43b72d0 con 0x55aab4611f00 2023-10-08T12:44:04.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2402435529 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff81409e1b0 con 0x55aab4611f00 2023-10-08T12:44:04.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2402435529 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff82000f460 con 0x55aab4611f00 2023-10-08T12:44:04.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff83fa60b80 10 client.25792 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:04.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff83fa60b80 10 client.25792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:04.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff83fa60b80 20 client.25792 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:04.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55aab46827b0 0x55aab4684ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff83fa60b80 4 client.25792 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:44:04.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2402435529 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55aab455ebb0 con 0x55aab46827b0 2023-10-08T12:44:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.103+0000 7ff82979a700 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55aab46827b0 0x55aab4684ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.104+0000 7ff82979a700 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55aab46827b0 0x55aab4684ba0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6ed5b09b634e5a9 server_cookie=ffd4982bbd565946 in_seq=0 out_seq=0 2023-10-08T12:44:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.104+0000 7ff80d7fa700 10 client.25792 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff80d7fa700 1 -- 172.21.15.59:0/2402435529 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55aab455ebb0 con 0x55aab46827b0 2023-10-08T12:44:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff80d7fa700 10 client.25792 handle_command_reply: tid=0 2023-10-08T12:44:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 1 client.25792 shutdown 2023-10-08T12:44:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2402435529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4611f00 msgr2=0x55aab46230e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4611f00 0x55aab46230e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff820009ce0 tx=0x7ff82000b6b0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2402435529 shutdown_connections 2023-10-08T12:44:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55aab46827b0 0x55aab4684ba0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aab461d6d0 0x55aab4680c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aab4611f00 0x55aab46230e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff80d7fa700 0 client.25792 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:04.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 1 --2- 172.21.15.59:0/2402435529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aab4612820 0x55aab4623620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2402435529 >> 172.21.15.59:0/2402435529 conn(0x55aab45872e0 msgr2=0x55aab461bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2402435529 shutdown_connections 2023-10-08T12:44:04.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 1 -- 172.21.15.59:0/2402435529 wait complete. 2023-10-08T12:44:04.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.105+0000 7ff83fa60b80 20 client.25792 trim_cache size 0 max 16384 2023-10-08T12:44:04.111 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:44:04.112 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:44:04.112 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "3731fa66-8963-4f44-bf63-4cb8ddb9a60b", 2023-10-08T12:44:04.112 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:44:04.112 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:44:04.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 -- 172.21.15.59:0/2279601055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8100a15f0 msgr2=0x7ff8100a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8100a15f0 0x7ff8100a3ab0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009ec0 tx=0x7ff81c009920 comp rx=0 tx=0).stop 2023-10-08T12:44:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 -- 172.21.15.59:0/2279601055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824101100 msgr2=0x7ff824073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824101100 0x7ff824073030 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff81400e9a0 tx=0x7ff81400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 -- 172.21.15.59:0/2279601055 shutdown_connections 2023-10-08T12:44:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8100a15f0 0x7ff8100a3ab0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff824106750 0x7ff824073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff824100740 0x7ff824072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 --2- 172.21.15.59:0/2279601055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824101100 0x7ff824073030 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 -- 172.21.15.59:0/2279601055 >> 172.21.15.59:0/2279601055 conn(0x7ff8240fc230 msgr2=0x7ff8240fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 -- 172.21.15.59:0/2279601055 shutdown_connections 2023-10-08T12:44:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.106+0000 7ff82c1ff700 1 -- 172.21.15.59:0/2279601055 wait complete. 2023-10-08T12:44:04.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:44:04.188 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:03 smithi059 ceph-mon[98489]: pgmap v400: 97 pgs: 97 active+clean; 135 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 315 op/s 2023-10-08T12:44:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:03 smithi173 ceph-mon[135182]: pgmap v400: 97 pgs: 97 active+clean; 135 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 315 op/s 2023-10-08T12:44:04.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.340+0000 7fdc133ff700 1 -- 172.21.15.59:0/271721498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0c101100 msgr2=0x7fdc0c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.340+0000 7fdc133ff700 1 --2- 172.21.15.59:0/271721498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0c101100 0x7fdc0c10d610 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400b0a0 tx=0x7fdc0400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.340+0000 7fdc133ff700 1 -- 172.21.15.59:0/271721498 shutdown_connections 2023-10-08T12:44:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.340+0000 7fdc133ff700 1 --2- 172.21.15.59:0/271721498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c106750 0x7fdc0c106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.340+0000 7fdc133ff700 1 --2- 172.21.15.59:0/271721498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0c101100 0x7fdc0c10d610 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.340+0000 7fdc133ff700 1 --2- 172.21.15.59:0/271721498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc0c100740 0x7fdc0c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.340+0000 7fdc133ff700 1 -- 172.21.15.59:0/271721498 >> 172.21.15.59:0/271721498 conn(0x7fdc0c0fc230 msgr2=0x7fdc0c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.340+0000 7fdc133ff700 1 -- 172.21.15.59:0/271721498 shutdown_connections 2023-10-08T12:44:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.340+0000 7fdc133ff700 1 -- 172.21.15.59:0/271721498 wait complete. 2023-10-08T12:44:04.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.341+0000 7fdc133ff700 1 Processor -- start 2023-10-08T12:44:04.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.342+0000 7fdc133ff700 1 -- start start 2023-10-08T12:44:04.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.342+0000 7fdc133ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c100740 0x7fdc0c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.342+0000 7fdc133ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc0c101100 0x7fdc0c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.342+0000 7fdc133ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0c106750 0x7fdc0c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.342+0000 7fdc133ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c19dc90 con 0x7fdc0c106750 2023-10-08T12:44:04.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.342+0000 7fdc133ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c19de00 con 0x7fdc0c100740 2023-10-08T12:44:04.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.342+0000 7fdc133ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c19dfc0 con 0x7fdc0c101100 2023-10-08T12:44:04.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c100740 0x7fdc0c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1199c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0c106750 0x7fdc0c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1099a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc0c101100 0x7fdc0c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c100740 0x7fdc0c198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45516/0 (socket says 172.21.15.59:45516) 2023-10-08T12:44:04.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1119b700 1 -- 172.21.15.59:0/3194497593 learned_addr learned my addr 172.21.15.59:0/3194497593 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1119b700 1 -- 172.21.15.59:0/3194497593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc0c101100 msgr2=0x7fdc0c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1119b700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc0c101100 0x7fdc0c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1119b700 1 -- 172.21.15.59:0/3194497593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0c106750 msgr2=0x7fdc0c19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1119b700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0c106750 0x7fdc0c19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1119b700 1 -- 172.21.15.59:0/3194497593 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc08009520 con 0x7fdc0c100740 2023-10-08T12:44:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1199c700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0c106750 0x7fdc0c19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc1119b700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c100740 0x7fdc0c198d70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800eb30 tx=0x7fdc0800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc027fc700 1 -- 172.21.15.59:0/3194497593 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08009880 con 0x7fdc0c100740 2023-10-08T12:44:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc027fc700 1 -- 172.21.15.59:0/3194497593 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc080044e0 con 0x7fdc0c100740 2023-10-08T12:44:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.343+0000 7fdc133ff700 1 -- 172.21.15.59:0/3194497593 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc04009d00 con 0x7fdc0c100740 2023-10-08T12:44:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.344+0000 7fdc027fc700 1 -- 172.21.15.59:0/3194497593 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08003d80 con 0x7fdc0c100740 2023-10-08T12:44:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.344+0000 7fdc133ff700 1 -- 172.21.15.59:0/3194497593 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c19e490 con 0x7fdc0c100740 2023-10-08T12:44:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.347+0000 7fdc027fc700 1 -- 172.21.15.59:0/3194497593 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fdc08003f20 con 0x7fdc0c100740 2023-10-08T12:44:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.348+0000 7fdc26c40b80 1 Processor -- start 2023-10-08T12:44:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.348+0000 7fdc26c40b80 1 -- start start 2023-10-08T12:44:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.348+0000 7fdc027fc700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdbf80a1670 0x7fdbf80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.348+0000 7fdc027fc700 1 -- 172.21.15.59:0/3194497593 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fdc08014070 con 0x7fdc0c100740 2023-10-08T12:44:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 0x55f82d16c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 0x55f82d16ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82d0ca460 con 0x55f82d16c650 2023-10-08T12:44:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82d0bbc20 con 0x55f82d1617a0 2023-10-08T12:44:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1199c700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdbf80a1670 0x7fdbf80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82d0b9540 con 0x55f82d160e80 2023-10-08T12:44:04.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1119b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1119b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:33046/0 (socket says 172.21.15.59:33046) 2023-10-08T12:44:04.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1119b700 1 -- 172.21.15.59:0/1715814269 learned_addr learned my addr 172.21.15.59:0/1715814269 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:04.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1099a700 1 --2- 172.21.15.59:0/1715814269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 0x55f82d16c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1199c700 1 --2- 172.21.15.59:0/1715814269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 0x55f82d16ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1119b700 1 -- 172.21.15.59:0/1715814269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 msgr2=0x55f82d16c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1119b700 1 --2- 172.21.15.59:0/1715814269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 0x55f82d16c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1119b700 1 -- 172.21.15.59:0/1715814269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 msgr2=0x55f82d16ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1119b700 1 --2- 172.21.15.59:0/1715814269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 0x55f82d16ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1119b700 1 -- 172.21.15.59:0/1715814269 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f82cedfde0 con 0x55f82d160e80 2023-10-08T12:44:04.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.349+0000 7fdc1199c700 1 --2- 172.21.15.59:0/1715814269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 0x55f82d16ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:04.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.350+0000 7fdc1119b700 1 --2- 172.21.15.59:0/1715814269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d161260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc080a23b0 tx=0x7fdc080969c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42a81368c68560ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.350+0000 7fdc1199c700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdbf80a1670 0x7fdbf80a3b30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdc040060b0 tx=0x7fdc04006040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.350+0000 7fdbf77fe700 1 -- 172.21.15.59:0/1715814269 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0809a550 con 0x55f82d160e80 2023-10-08T12:44:04.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.350+0000 7fdbf77fe700 1 -- 172.21.15.59:0/1715814269 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc0809e6a0 con 0x55f82d160e80 2023-10-08T12:44:04.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.350+0000 7fdbf77fe700 1 -- 172.21.15.59:0/1715814269 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc080cd0d0 con 0x55f82d160e80 2023-10-08T12:44:04.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.351+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1715814269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 msgr2=0x55f82d161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.351+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/1715814269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d161260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc080a23b0 tx=0x7fdc080969c0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.351+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1715814269 shutdown_connections 2023-10-08T12:44:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.351+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/1715814269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 0x55f82d16ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.351+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/1715814269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d161260 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.351+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/1715814269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 0x55f82d16c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.351+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1715814269 >> 172.21.15.59:0/1715814269 conn(0x55f82d0d6260 msgr2=0x55f82d15d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.351+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1715814269 shutdown_connections 2023-10-08T12:44:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.351+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1715814269 wait complete. 2023-10-08T12:44:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.351+0000 7fdc26c40b80 1 -- start start 2023-10-08T12:44:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.352+0000 7fdc26c40b80 1 Processor -- start 2023-10-08T12:44:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.352+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d16c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.352+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 0x55f82d1693e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.352+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d16c650 0x55f82d169b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.352+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82d0b4e30 con 0x55f82d1617a0 2023-10-08T12:44:04.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.352+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82d051710 con 0x55f82d160e80 2023-10-08T12:44:04.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.352+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82d0513b0 con 0x55f82d16c650 2023-10-08T12:44:04.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.352+0000 7fdc1119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d16c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.352+0000 7fdc26c40b80 10 client.0 _ll_register_callbacks cb 0x55f82ceae800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:04.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.352+0000 7fdc1119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d16c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45542/0 (socket says 172.21.15.59:45542) 2023-10-08T12:44:04.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.352+0000 7fdc1119b700 1 -- 172.21.15.59:0/3217309245 learned_addr learned my addr 172.21.15.59:0/3217309245 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:04.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc1099a700 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 0x55f82d1693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc1199c700 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d16c650 0x55f82d169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc1119b700 1 -- 172.21.15.59:0/3217309245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d16c650 msgr2=0x55f82d169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc1119b700 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d16c650 0x55f82d169b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc1119b700 1 -- 172.21.15.59:0/3217309245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 msgr2=0x55f82d1693e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc1119b700 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 0x55f82d1693e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc1119b700 1 -- 172.21.15.59:0/3217309245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c19e490 con 0x55f82d160e80 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc1099a700 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 0x55f82d1693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc1119b700 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d16c0a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009230 tx=0x7fdc08020fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cef323dc3dcac71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdbf4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/3217309245 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0809a550 con 0x55f82d160e80 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc26c40b80 1 -- 172.21.15.59:0/3217309245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f82d07ceb0 con 0x55f82d160e80 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/3217309245 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fdc0800cdd0 con 0x55f82d160e80 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/3217309245 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc080cd0d0 con 0x55f82d160e80 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc26c40b80 10 client.25811 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.353+0000 7fdc26c40b80 1 -- 172.21.15.59:0/3217309245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55f82cec8c60 con 0x55f82d160e80 2023-10-08T12:44:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.354+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/3217309245 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f82d07ceb0 con 0x55f82d160e80 2023-10-08T12:44:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.354+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/3217309245 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdc0809a890 con 0x55f82d160e80 2023-10-08T12:44:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.354+0000 7fdc26c40b80 10 client.25811 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.354+0000 7fdc26c40b80 10 client.25811 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.354+0000 7fdc26c40b80 20 client.25811 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.354+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f82d17bcd0 0x55f82d17e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.354+0000 7fdc26c40b80 4 client.25811 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.354+0000 7fdc26c40b80 1 -- 172.21.15.59:0/3217309245 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f82d0ade10 con 0x55f82d17bcd0 2023-10-08T12:44:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.354+0000 7fdc1099a700 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f82d17bcd0 0x55f82d17e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.355+0000 7fdbf4ff9700 10 client.25811 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.355+0000 7fdc1099a700 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f82d17bcd0 0x55f82d17e0c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80eb6e5e3d8a50f4 server_cookie=b5cc71ae2b47ef9d in_seq=0 out_seq=0 2023-10-08T12:44:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/3217309245 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f82d0ade10 con 0x55f82d17bcd0 2023-10-08T12:44:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdbf4ff9700 10 client.25811 handle_command_reply: tid=0 2023-10-08T12:44:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 1 client.25811 shutdown 2023-10-08T12:44:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 1 -- 172.21.15.59:0/3217309245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 msgr2=0x55f82d16c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d16c0a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009230 tx=0x7fdc08020fb0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 1 -- 172.21.15.59:0/3217309245 shutdown_connections 2023-10-08T12:44:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f82d17bcd0 0x55f82d17e0c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d16c0a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d16c650 0x55f82d169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdbf4ff9700 0 client.25811 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/3217309245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 0x55f82d1693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 1 -- 172.21.15.59:0/3217309245 >> 172.21.15.59:0/3217309245 conn(0x55f82d0d6260 msgr2=0x55f82d15ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 1 -- 172.21.15.59:0/3217309245 shutdown_connections 2023-10-08T12:44:04.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 1 -- 172.21.15.59:0/3217309245 wait complete. 2023-10-08T12:44:04.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.356+0000 7fdc26c40b80 20 client.25811 trim_cache size 0 max 16384 2023-10-08T12:44:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.373+0000 7fdc26c40b80 1 Processor -- start 2023-10-08T12:44:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc26c40b80 1 -- start start 2023-10-08T12:44:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d17e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 0x55f82d1731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 0x55f82d1646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82cf35920 con 0x55f82d16c650 2023-10-08T12:44:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82d15e060 con 0x55f82d1617a0 2023-10-08T12:44:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82d1736e0 con 0x55f82d160e80 2023-10-08T12:44:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc1119b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d17e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc1099a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 0x55f82d1731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc1099a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 0x55f82d1731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45544/0 (socket says 172.21.15.59:45544) 2023-10-08T12:44:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc1119b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d17e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:33070/0 (socket says 172.21.15.59:33070) 2023-10-08T12:44:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc1099a700 1 -- 172.21.15.59:0/816144374 learned_addr learned my addr 172.21.15.59:0/816144374 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc1199c700 1 --2- 172.21.15.59:0/816144374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 0x55f82d1646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.374+0000 7fdc1099a700 1 -- 172.21.15.59:0/816144374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 msgr2=0x55f82d17e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.375+0000 7fdc1099a700 1 --2- 172.21.15.59:0/816144374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d17e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.375+0000 7fdc1099a700 1 -- 172.21.15.59:0/816144374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 msgr2=0x55f82d1646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.375+0000 7fdc1099a700 1 --2- 172.21.15.59:0/816144374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 0x55f82d1646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.375+0000 7fdc1099a700 1 -- 172.21.15.59:0/816144374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f82cf06250 con 0x55f82d1617a0 2023-10-08T12:44:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.375+0000 7fdc1119b700 1 --2- 172.21.15.59:0/816144374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d17e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.375+0000 7fdc1199c700 1 --2- 172.21.15.59:0/816144374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 0x55f82d1646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.375+0000 7fdc1099a700 1 --2- 172.21.15.59:0/816144374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 0x55f82d1731a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55f82d17e9f0 tx=0x7fdbfc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5070aab267ec0835 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.375+0000 7fdbf7fff700 1 -- 172.21.15.59:0/816144374 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc01f250 con 0x55f82d1617a0 2023-10-08T12:44:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.375+0000 7fdbf7fff700 1 -- 172.21.15.59:0/816144374 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbfc018040 con 0x55f82d1617a0 2023-10-08T12:44:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.375+0000 7fdbf7fff700 1 -- 172.21.15.59:0/816144374 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc01e820 con 0x55f82d1617a0 2023-10-08T12:44:04.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:03 smithi092 ceph-mon[134093]: pgmap v400: 97 pgs: 97 active+clean; 135 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 315 op/s 2023-10-08T12:44:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.376+0000 7fdc26c40b80 1 -- 172.21.15.59:0/816144374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 msgr2=0x55f82d1731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.376+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/816144374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 0x55f82d1731a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55f82d17e9f0 tx=0x7fdbfc009260 comp rx=0 tx=0).stop 2023-10-08T12:44:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.376+0000 7fdc26c40b80 1 -- 172.21.15.59:0/816144374 shutdown_connections 2023-10-08T12:44:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.376+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/816144374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d16c650 0x55f82d1646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.376+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/816144374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d160e80 0x55f82d17e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.376+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/816144374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d1617a0 0x55f82d1731a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.376+0000 7fdc26c40b80 1 -- 172.21.15.59:0/816144374 >> 172.21.15.59:0/816144374 conn(0x55f82d0d6260 msgr2=0x55f82d15c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.376+0000 7fdc26c40b80 1 -- 172.21.15.59:0/816144374 shutdown_connections 2023-10-08T12:44:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.376+0000 7fdc26c40b80 1 -- 172.21.15.59:0/816144374 wait complete. 2023-10-08T12:44:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.376+0000 7fdc26c40b80 1 -- start start 2023-10-08T12:44:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.377+0000 7fdc26c40b80 1 Processor -- start 2023-10-08T12:44:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.377+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d170eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.377+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 0x55f82d1713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.377+0000 7fdc26c40b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d16c650 0x55f82d1ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.377+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82d1cf030 con 0x55f82d1617a0 2023-10-08T12:44:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.377+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82d1cf170 con 0x55f82d160e80 2023-10-08T12:44:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.377+0000 7fdc26c40b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82d1cf300 con 0x55f82d16c650 2023-10-08T12:44:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.377+0000 7fdc26c40b80 10 client.0 _ll_register_callbacks cb 0x7fdbfc009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.377+0000 7fdc1119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d170eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc1119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d170eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45550/0 (socket says 172.21.15.59:45550) 2023-10-08T12:44:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc1119b700 1 -- 172.21.15.59:0/1972095183 learned_addr learned my addr 172.21.15.59:0/1972095183 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc1199c700 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d16c650 0x55f82d1ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc1099a700 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 0x55f82d1713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc1119b700 1 -- 172.21.15.59:0/1972095183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d16c650 msgr2=0x55f82d1ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc1119b700 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d16c650 0x55f82d1ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc1119b700 1 -- 172.21.15.59:0/1972095183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 msgr2=0x55f82d1713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc1119b700 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 0x55f82d1713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc1119b700 1 -- 172.21.15.59:0/1972095183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f82cec8c60 con 0x55f82d160e80 2023-10-08T12:44:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc1099a700 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 0x55f82d1713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc1119b700 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d170eb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdc08096fc0 tx=0x7fdc08009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb2d004e422d6171 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdbf4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:44:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/1972095183 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc080a2450 con 0x55f82d160e80 2023-10-08T12:44:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1972095183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc0809e6a0 con 0x55f82d160e80 2023-10-08T12:44:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.378+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/1972095183 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fdc0800cdd0 con 0x55f82d160e80 2023-10-08T12:44:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/1972095183 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc08096890 con 0x55f82d160e80 2023-10-08T12:44:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdc26c40b80 10 client.25817 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1972095183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fdbfc01f9f0 con 0x55f82d160e80 2023-10-08T12:44:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/1972095183 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc0809e6a0 con 0x55f82d160e80 2023-10-08T12:44:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/1972095183 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdc0809e240 con 0x55f82d160e80 2023-10-08T12:44:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdc26c40b80 10 client.25817 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdc26c40b80 10 client.25817 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdc26c40b80 20 client.25817 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f82d1d0630 0x55f82d1d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdc26c40b80 4 client.25817 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:44:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1972095183 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f82d0adb30 con 0x55f82d1d0630 2023-10-08T12:44:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.379+0000 7fdc1099a700 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f82d1d0630 0x55f82d1d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc1099a700 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f82d1d0630 0x55f82d1d2a20 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=160166bb93f9fcec server_cookie=36a8035d464a8ce4 in_seq=0 out_seq=0 2023-10-08T12:44:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdbf4ff9700 10 client.25817 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdbf4ff9700 1 -- 172.21.15.59:0/1972095183 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f82d0adb30 con 0x55f82d1d0630 2023-10-08T12:44:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdbf4ff9700 10 client.25817 handle_command_reply: tid=0 2023-10-08T12:44:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc26c40b80 1 client.25817 shutdown 2023-10-08T12:44:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1972095183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 msgr2=0x55f82d170eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d170eb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdc08096fc0 tx=0x7fdc08009f60 comp rx=0 tx=0).stop 2023-10-08T12:44:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1972095183 shutdown_connections 2023-10-08T12:44:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f82d1d0630 0x55f82d1d2a20 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f82d160e80 0x55f82d170eb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdbf4ff9700 0 client.25817 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f82d16c650 0x55f82d1ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc26c40b80 1 --2- 172.21.15.59:0/1972095183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f82d1617a0 0x55f82d1713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1972095183 >> 172.21.15.59:0/1972095183 conn(0x55f82d0d6260 msgr2=0x55f82d1646b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1972095183 shutdown_connections 2023-10-08T12:44:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.380+0000 7fdc26c40b80 1 -- 172.21.15.59:0/1972095183 wait complete. 2023-10-08T12:44:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc26c40b80 20 client.25817 trim_cache size 0 max 16384 2023-10-08T12:44:04.392 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:44:04.392 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:44:04.392 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:44:04.392 INFO:teuthology.orchestra.run.smithi059.stdout: "3731fa66-8963-4f44-bf63-4cb8ddb9a60b": { 2023-10-08T12:44:04.392 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:44:04.392 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "3731fa66-8963-4f44-bf63-4cb8ddb9a60b", 2023-10-08T12:44:04.392 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:44:04.392 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:44:04.392 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:44:04.393 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:44:04.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc133ff700 1 -- 172.21.15.59:0/3194497593 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdbf80a1670 msgr2=0x7fdbf80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc133ff700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdbf80a1670 0x7fdbf80a3b30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdc040060b0 tx=0x7fdc04006040 comp rx=0 tx=0).stop 2023-10-08T12:44:04.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc133ff700 1 -- 172.21.15.59:0/3194497593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c100740 msgr2=0x7fdc0c198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:04.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc133ff700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c100740 0x7fdc0c198d70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800eb30 tx=0x7fdc0800ee40 comp rx=0 tx=0).stop 2023-10-08T12:44:04.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc133ff700 1 -- 172.21.15.59:0/3194497593 shutdown_connections 2023-10-08T12:44:04.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc133ff700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdbf80a1670 0x7fdbf80a3b30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc133ff700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc0c100740 0x7fdc0c198d70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc133ff700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0c106750 0x7fdc0c19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc133ff700 1 --2- 172.21.15.59:0/3194497593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc0c101100 0x7fdc0c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:04.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc133ff700 1 -- 172.21.15.59:0/3194497593 >> 172.21.15.59:0/3194497593 conn(0x7fdc0c0fc230 msgr2=0x7fdc0c10bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:04.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.381+0000 7fdc133ff700 1 -- 172.21.15.59:0/3194497593 shutdown_connections 2023-10-08T12:44:04.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:04.382+0000 7fdc133ff700 1 -- 172.21.15.59:0/3194497593 wait complete. 2023-10-08T12:44:04.400 INFO:tasks.cephfs.filesystem:scrub status for tag:3731fa66-8963-4f44-bf63-4cb8ddb9a60b - {'path': '/', 'tag': '3731fa66-8963-4f44-bf63-4cb8ddb9a60b', 'options': 'recursive,force'} 2023-10-08T12:44:04.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 258023 14.80 MB/sec warmup 95 sec latency 11.229 ms 2023-10-08T12:44:05.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:04 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:44:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:04 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:04 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:44:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:04 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:05.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:04 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:44:05.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:04 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:05.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:04 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:44:05.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:04 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:05.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:04 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:44:05.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:04 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:05.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:04 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:44:05.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:04 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:05.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 260492 14.81 MB/sec warmup 96 sec latency 38.106 ms 2023-10-08T12:44:06.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:05 smithi173 ceph-mon[135182]: pgmap v401: 97 pgs: 97 active+clean; 136 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 3.4 MiB/s wr, 245 op/s 2023-10-08T12:44:06.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:05 smithi059 ceph-mon[98489]: pgmap v401: 97 pgs: 97 active+clean; 136 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 3.4 MiB/s wr, 245 op/s 2023-10-08T12:44:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:05 smithi092 ceph-mon[134093]: pgmap v401: 97 pgs: 97 active+clean; 136 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 3.4 MiB/s wr, 245 op/s 2023-10-08T12:44:06.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 263179 14.81 MB/sec warmup 97 sec latency 17.362 ms 2023-10-08T12:44:07.501 INFO:tasks.workunit.client.0.smithi059.stdout: 1 266301 14.85 MB/sec warmup 98 sec latency 32.629 ms 2023-10-08T12:44:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:07 smithi173 ceph-mon[135182]: pgmap v402: 97 pgs: 97 active+clean; 139 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 293 op/s 2023-10-08T12:44:08.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:07 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:44:08.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:07 smithi059 ceph-mon[98489]: pgmap v402: 97 pgs: 97 active+clean; 139 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 293 op/s 2023-10-08T12:44:08.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:07 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:44:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:07 smithi092 ceph-mon[134093]: pgmap v402: 97 pgs: 97 active+clean; 139 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 293 op/s 2023-10-08T12:44:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:07 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:44:08.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 268515 14.77 MB/sec warmup 99 sec latency 71.973 ms 2023-10-08T12:44:09.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 270860 14.76 MB/sec warmup 100 sec latency 6.784 ms 2023-10-08T12:44:10.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:09 smithi092 ceph-mon[134093]: pgmap v403: 97 pgs: 97 active+clean; 144 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 330 op/s 2023-10-08T12:44:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:09 smithi173 ceph-mon[135182]: pgmap v403: 97 pgs: 97 active+clean; 144 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 330 op/s 2023-10-08T12:44:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:09 smithi059 ceph-mon[98489]: pgmap v403: 97 pgs: 97 active+clean; 144 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 330 op/s 2023-10-08T12:44:10.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 273754 14.79 MB/sec warmup 101 sec latency 14.497 ms 2023-10-08T12:44:11.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 277012 14.83 MB/sec warmup 102 sec latency 7.048 ms 2023-10-08T12:44:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:11 smithi173 ceph-mon[135182]: pgmap v404: 97 pgs: 97 active+clean; 149 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 317 op/s 2023-10-08T12:44:12.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:11 smithi059 ceph-mon[98489]: pgmap v404: 97 pgs: 97 active+clean; 149 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 317 op/s 2023-10-08T12:44:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:11 smithi092 ceph-mon[134093]: pgmap v404: 97 pgs: 97 active+clean; 149 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 317 op/s 2023-10-08T12:44:12.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 279691 14.81 MB/sec warmup 103 sec latency 22.795 ms 2023-10-08T12:44:13.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 281463 14.75 MB/sec warmup 104 sec latency 82.188 ms 2023-10-08T12:44:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:13 smithi173 ceph-mon[135182]: pgmap v405: 97 pgs: 97 active+clean; 147 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 301 op/s 2023-10-08T12:44:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:13 smithi059 ceph-mon[98489]: pgmap v405: 97 pgs: 97 active+clean; 147 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 301 op/s 2023-10-08T12:44:14.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:13 smithi092 ceph-mon[134093]: pgmap v405: 97 pgs: 97 active+clean; 147 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 301 op/s 2023-10-08T12:44:14.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 284446 14.77 MB/sec warmup 105 sec latency 13.643 ms 2023-10-08T12:44:15.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 287651 14.81 MB/sec warmup 106 sec latency 7.194 ms 2023-10-08T12:44:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:15 smithi173 ceph-mon[135182]: pgmap v406: 97 pgs: 97 active+clean; 147 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 243 op/s 2023-10-08T12:44:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:15 smithi059 ceph-mon[98489]: pgmap v406: 97 pgs: 97 active+clean; 147 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 243 op/s 2023-10-08T12:44:16.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:15 smithi092 ceph-mon[134093]: pgmap v406: 97 pgs: 97 active+clean; 147 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 243 op/s 2023-10-08T12:44:16.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 290707 14.81 MB/sec warmup 107 sec latency 10.603 ms 2023-10-08T12:44:17.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 293329 14.78 MB/sec warmup 108 sec latency 24.236 ms 2023-10-08T12:44:18.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:17 smithi173 ceph-mon[135182]: pgmap v407: 97 pgs: 97 active+clean; 153 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 307 op/s 2023-10-08T12:44:18.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:17 smithi059 ceph-mon[98489]: pgmap v407: 97 pgs: 97 active+clean; 153 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 307 op/s 2023-10-08T12:44:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:17 smithi092 ceph-mon[134093]: pgmap v407: 97 pgs: 97 active+clean; 153 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 307 op/s 2023-10-08T12:44:18.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 295165 14.76 MB/sec warmup 109 sec latency 112.690 ms 2023-10-08T12:44:19.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 298337 14.79 MB/sec warmup 110 sec latency 6.386 ms 2023-10-08T12:44:20.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:19 smithi092 ceph-mon[134093]: pgmap v408: 97 pgs: 97 active+clean; 155 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2023-10-08T12:44:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:19 smithi173 ceph-mon[135182]: pgmap v408: 97 pgs: 97 active+clean; 155 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2023-10-08T12:44:20.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:19 smithi059 ceph-mon[98489]: pgmap v408: 97 pgs: 97 active+clean; 155 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2023-10-08T12:44:20.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 299152 14.68 MB/sec warmup 111 sec latency 381.477 ms 2023-10-08T12:44:21.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 302083 14.70 MB/sec warmup 112 sec latency 8.527 ms 2023-10-08T12:44:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:21 smithi173 ceph-mon[135182]: pgmap v409: 97 pgs: 97 active+clean; 161 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 268 op/s 2023-10-08T12:44:22.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:21 smithi059 ceph-mon[98489]: pgmap v409: 97 pgs: 97 active+clean; 161 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 268 op/s 2023-10-08T12:44:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:21 smithi092 ceph-mon[134093]: pgmap v409: 97 pgs: 97 active+clean; 161 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 268 op/s 2023-10-08T12:44:22.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 305313 14.74 MB/sec warmup 113 sec latency 8.977 ms 2023-10-08T12:44:23.502 INFO:tasks.workunit.client.0.smithi059.stdout: 1 307463 14.67 MB/sec warmup 114 sec latency 54.653 ms 2023-10-08T12:44:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:23 smithi173 ceph-mon[135182]: pgmap v410: 97 pgs: 97 active+clean; 161 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2023-10-08T12:44:24.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:23 smithi059 ceph-mon[98489]: pgmap v410: 97 pgs: 97 active+clean; 161 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2023-10-08T12:44:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:23 smithi092 ceph-mon[134093]: pgmap v410: 97 pgs: 97 active+clean; 161 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2023-10-08T12:44:24.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 309796 14.67 MB/sec warmup 115 sec latency 6.793 ms 2023-10-08T12:44:25.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 312557 14.69 MB/sec warmup 116 sec latency 78.309 ms 2023-10-08T12:44:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:25 smithi173 ceph-mon[135182]: pgmap v411: 97 pgs: 97 active+clean; 160 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 234 op/s 2023-10-08T12:44:26.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:25 smithi059 ceph-mon[98489]: pgmap v411: 97 pgs: 97 active+clean; 160 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 234 op/s 2023-10-08T12:44:26.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:25 smithi092 ceph-mon[134093]: pgmap v411: 97 pgs: 97 active+clean; 160 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 234 op/s 2023-10-08T12:44:26.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 315545 14.69 MB/sec warmup 117 sec latency 39.402 ms 2023-10-08T12:44:27.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 318039 14.66 MB/sec warmup 118 sec latency 85.312 ms 2023-10-08T12:44:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:27 smithi173 ceph-mon[135182]: pgmap v412: 97 pgs: 97 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 303 op/s 2023-10-08T12:44:28.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:27 smithi059 ceph-mon[98489]: pgmap v412: 97 pgs: 97 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 303 op/s 2023-10-08T12:44:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:27 smithi092 ceph-mon[134093]: pgmap v412: 97 pgs: 97 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 303 op/s 2023-10-08T12:44:28.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 319848 14.64 MB/sec warmup 119 sec latency 61.522 ms 2023-10-08T12:44:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:29 smithi092 ceph-mon[134093]: pgmap v413: 97 pgs: 97 active+clean; 168 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 272 op/s 2023-10-08T12:44:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:29 smithi173 ceph-mon[135182]: pgmap v413: 97 pgs: 97 active+clean; 168 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 272 op/s 2023-10-08T12:44:30.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:29 smithi059 ceph-mon[98489]: pgmap v413: 97 pgs: 97 active+clean; 168 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 272 op/s 2023-10-08T12:44:30.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 325968 13.48 MB/sec execute 1 sec latency 24.951 ms 2023-10-08T12:44:31.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:30 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:44:31.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:30 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:44:31.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:30 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:44:31.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 328673 13.15 MB/sec execute 2 sec latency 8.830 ms 2023-10-08T12:44:32.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:31 smithi092 ceph-mon[134093]: pgmap v414: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 266 op/s 2023-10-08T12:44:32.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:44:32.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:44:32.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:44:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:31 smithi173 ceph-mon[135182]: pgmap v414: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 266 op/s 2023-10-08T12:44:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:44:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:44:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:44:32.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:31 smithi059 ceph-mon[98489]: pgmap v414: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 266 op/s 2023-10-08T12:44:32.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:44:32.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:44:32.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:44:32.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 330864 13.14 MB/sec execute 3 sec latency 14.118 ms 2023-10-08T12:44:33.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 333684 14.34 MB/sec execute 4 sec latency 57.590 ms 2023-10-08T12:44:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:33 smithi173 ceph-mon[135182]: pgmap v415: 97 pgs: 97 active+clean; 174 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 306 op/s 2023-10-08T12:44:34.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:33 smithi059 ceph-mon[98489]: pgmap v415: 97 pgs: 97 active+clean; 174 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 306 op/s 2023-10-08T12:44:34.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:33 smithi092 ceph-mon[134093]: pgmap v415: 97 pgs: 97 active+clean; 174 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 306 op/s 2023-10-08T12:44:34.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:44:34.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 336450 14.05 MB/sec execute 5 sec latency 7.518 ms 2023-10-08T12:44:34.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.626+0000 7f01ea1ff700 1 -- 172.21.15.59:0/3607820337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4106750 msgr2=0x7f01e4106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.626+0000 7f01ea1ff700 1 --2- 172.21.15.59:0/3607820337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4106750 0x7f01e4106b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009990 tx=0x7f01d4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.627+0000 7f01ea1ff700 1 -- 172.21.15.59:0/3607820337 shutdown_connections 2023-10-08T12:44:34.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.627+0000 7f01ea1ff700 1 --2- 172.21.15.59:0/3607820337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e4101100 0x7f01e410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.627+0000 7f01ea1ff700 1 --2- 172.21.15.59:0/3607820337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4106750 0x7f01e4106b30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.627+0000 7f01ea1ff700 1 --2- 172.21.15.59:0/3607820337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01e4100740 0x7f01e4100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.627+0000 7f01ea1ff700 1 -- 172.21.15.59:0/3607820337 >> 172.21.15.59:0/3607820337 conn(0x7f01e40fc230 msgr2=0x7f01e40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:34.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.627+0000 7f01ea1ff700 1 -- 172.21.15.59:0/3607820337 shutdown_connections 2023-10-08T12:44:34.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.627+0000 7f01ea1ff700 1 -- 172.21.15.59:0/3607820337 wait complete. 2023-10-08T12:44:34.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.628+0000 7f01ea1ff700 1 Processor -- start 2023-10-08T12:44:34.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.628+0000 7f01ea1ff700 1 -- start start 2023-10-08T12:44:34.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.628+0000 7f01ea1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4100740 0x7f01e4198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.628+0000 7f01ea1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e4101100 0x7f01e41992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.628+0000 7f01ea1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01e4106750 0x7f01e419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.628+0000 7f01ea1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e419dcb0 con 0x7f01e4106750 2023-10-08T12:44:34.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.628+0000 7f01ea1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e419de20 con 0x7f01e4101100 2023-10-08T12:44:34.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.628+0000 7f01ea1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e419dfe0 con 0x7f01e4100740 2023-10-08T12:44:34.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e4101100 0x7f01e41992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e4101100 0x7f01e41992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53626/0 (socket says 172.21.15.59:53626) 2023-10-08T12:44:34.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e2ffd700 1 -- 172.21.15.59:0/2396239100 learned_addr learned my addr 172.21.15.59:0/2396239100 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:34.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e3fff700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01e4106750 0x7f01e419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e37fe700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4100740 0x7f01e4198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e2ffd700 1 -- 172.21.15.59:0/2396239100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4100740 msgr2=0x7f01e4198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4100740 0x7f01e4198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e2ffd700 1 -- 172.21.15.59:0/2396239100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01e4106750 msgr2=0x7f01e419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01e4106750 0x7f01e419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e2ffd700 1 -- 172.21.15.59:0/2396239100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d40095f0 con 0x7f01e4101100 2023-10-08T12:44:34.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e4101100 0x7f01e41992d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f01d800e9a0 tx=0x7f01d800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:34.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.629+0000 7f01e0ff9700 1 -- 172.21.15.59:0/2396239100 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8009790 con 0x7f01e4101100 2023-10-08T12:44:34.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.630+0000 7f01e0ff9700 1 -- 172.21.15.59:0/2396239100 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01d8010430 con 0x7f01e4101100 2023-10-08T12:44:34.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.630+0000 7f01e0ff9700 1 -- 172.21.15.59:0/2396239100 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8018680 con 0x7f01e4101100 2023-10-08T12:44:34.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.630+0000 7f01ea1ff700 1 -- 172.21.15.59:0/2396239100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e419e2c0 con 0x7f01e4101100 2023-10-08T12:44:34.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.630+0000 7f01ea1ff700 1 -- 172.21.15.59:0/2396239100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e41a5b00 con 0x7f01e4101100 2023-10-08T12:44:34.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.634+0000 7f01e0ff9700 1 -- 172.21.15.59:0/2396239100 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f01d80105a0 con 0x7f01e4101100 2023-10-08T12:44:34.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.635+0000 7f01fdb86b80 1 Processor -- start 2023-10-08T12:44:34.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.635+0000 7f01fdb86b80 1 -- start start 2023-10-08T12:44:34.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c121e80 0x559d2c122260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 0x559d2c12d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 0x559d2c12fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2c08b460 con 0x559d2c1227a0 2023-10-08T12:44:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2c07cc20 con 0x559d2c12d650 2023-10-08T12:44:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2c07a540 con 0x559d2c121e80 2023-10-08T12:44:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01e3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c121e80 0x559d2c122260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01e0ff9700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01cc0a15f0 0x7f01cc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01e3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c121e80 0x559d2c122260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40796/0 (socket says 172.21.15.59:40796) 2023-10-08T12:44:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01e3fff700 1 -- 172.21.15.59:0/515437745 learned_addr learned my addr 172.21.15.59:0/515437745 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01e37fe700 1 --2- 172.21.15.59:0/515437745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 0x559d2c12d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.636+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/515437745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 0x559d2c12fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01e0ff9700 1 -- 172.21.15.59:0/2396239100 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f01d8014070 con 0x7f01e4101100 2023-10-08T12:44:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01e3fff700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01cc0a15f0 0x7f01cc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01e37fe700 1 -- 172.21.15.59:0/515437745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c121e80 msgr2=0x559d2c122260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:34.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01e37fe700 1 --2- 172.21.15.59:0/515437745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c121e80 0x559d2c122260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01e37fe700 1 -- 172.21.15.59:0/515437745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 msgr2=0x559d2c12fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:34.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01e37fe700 1 --2- 172.21.15.59:0/515437745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 0x559d2c12fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01e37fe700 1 -- 172.21.15.59:0/515437745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d2bea0de0 con 0x559d2c1227a0 2023-10-08T12:44:34.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/515437745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 0x559d2c12fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:34.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01e37fe700 1 --2- 172.21.15.59:0/515437745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 0x559d2c12d110 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f01d40098e0 tx=0x7f01d4005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c1f4a2ca40da8f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:34.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01e3fff700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01cc0a15f0 0x7f01cc0a3ab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00ff10 tx=0x7f01dc004b40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:34.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01c9ffb700 1 -- 172.21.15.59:0/515437745 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d401d070 con 0x559d2c1227a0 2023-10-08T12:44:34.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01c9ffb700 1 -- 172.21.15.59:0/515437745 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01d401e040 con 0x559d2c1227a0 2023-10-08T12:44:34.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.637+0000 7f01c9ffb700 1 -- 172.21.15.59:0/515437745 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d40047f0 con 0x559d2c1227a0 2023-10-08T12:44:34.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.638+0000 7f01fdb86b80 1 -- 172.21.15.59:0/515437745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 msgr2=0x559d2c12d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.638+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/515437745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 0x559d2c12d110 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f01d40098e0 tx=0x7f01d4005ec0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.638+0000 7f01fdb86b80 1 -- 172.21.15.59:0/515437745 shutdown_connections 2023-10-08T12:44:34.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.638+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/515437745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 0x559d2c12fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.638+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/515437745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c121e80 0x559d2c122260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.638+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/515437745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 0x559d2c12d110 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.638+0000 7f01fdb86b80 1 -- 172.21.15.59:0/515437745 >> 172.21.15.59:0/515437745 conn(0x559d2c097260 msgr2=0x559d2c11e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:34.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.638+0000 7f01fdb86b80 1 -- 172.21.15.59:0/515437745 shutdown_connections 2023-10-08T12:44:34.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.638+0000 7f01fdb86b80 1 -- 172.21.15.59:0/515437745 wait complete. 2023-10-08T12:44:34.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.639+0000 7f01fdb86b80 1 -- start start 2023-10-08T12:44:34.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.639+0000 7f01fdb86b80 1 Processor -- start 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 0x559d2c12cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c1227a0 0x559d2c12a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 0x559d2c12a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2c075e30 con 0x559d2c121e80 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2c012710 con 0x559d2c12d650 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2c0123b0 con 0x559d2c1227a0 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01fdb86b80 10 client.0 _ll_register_callbacks cb 0x559d2be6f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01e37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 0x559d2c12cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01e3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 0x559d2c12a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01e37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 0x559d2c12cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40052/0 (socket says 172.21.15.59:40052) 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01e37fe700 1 -- 172.21.15.59:0/3873484694 learned_addr learned my addr 172.21.15.59:0/3873484694 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:34.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01e3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 0x559d2c12a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53642/0 (socket says 172.21.15.59:53642) 2023-10-08T12:44:34.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.640+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c1227a0 0x559d2c12a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.641+0000 7f01e37fe700 1 -- 172.21.15.59:0/3873484694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c1227a0 msgr2=0x559d2c12a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:34.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.641+0000 7f01e37fe700 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c1227a0 0x559d2c12a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.641+0000 7f01e37fe700 1 -- 172.21.15.59:0/3873484694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 msgr2=0x559d2c12a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:34.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.641+0000 7f01e37fe700 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 0x559d2c12a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.641+0000 7f01e37fe700 1 -- 172.21.15.59:0/3873484694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e41a5b00 con 0x559d2c121e80 2023-10-08T12:44:34.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.641+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c1227a0 0x559d2c12a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:34.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.641+0000 7f01e37fe700 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 0x559d2c12cff0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f01d400bf20 tx=0x7f01d400b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1781696a049446a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:34.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.641+0000 7f01c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:44:34.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01c2ffd700 1 -- 172.21.15.59:0/3873484694 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d401d070 con 0x559d2c121e80 2023-10-08T12:44:34.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01fdb86b80 1 -- 172.21.15.59:0/3873484694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d2c03deb0 con 0x559d2c121e80 2023-10-08T12:44:34.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01c2ffd700 1 -- 172.21.15.59:0/3873484694 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f01d4005980 con 0x559d2c121e80 2023-10-08T12:44:34.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01c2ffd700 1 -- 172.21.15.59:0/3873484694 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01d4004700 con 0x559d2c121e80 2023-10-08T12:44:34.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01fdb86b80 10 client.15831 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:34.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01fdb86b80 1 -- 172.21.15.59:0/3873484694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f01e410df10 con 0x559d2c121e80 2023-10-08T12:44:34.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01c2ffd700 1 -- 172.21.15.59:0/3873484694 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01d403b080 con 0x559d2c121e80 2023-10-08T12:44:34.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01c2ffd700 1 -- 172.21.15.59:0/3873484694 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f01d400f760 con 0x559d2c121e80 2023-10-08T12:44:34.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01fdb86b80 10 client.15831 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:34.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01fdb86b80 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:34.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01fdb86b80 20 client.15831 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:34.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d2c13cc40 0x559d2c13f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01fdb86b80 4 client.15831 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:34.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.642+0000 7f01fdb86b80 1 -- 172.21.15.59:0/3873484694 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d2c06ee10 con 0x559d2c13cc40 2023-10-08T12:44:34.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.643+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d2c13cc40 0x559d2c13f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.643+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d2c13cc40 0x559d2c13f030 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8ebdd68467d96a5 server_cookie=388849a39514b10c in_seq=0 out_seq=0 2023-10-08T12:44:34.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.643+0000 7f01c2ffd700 10 client.15831 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:34.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01c2ffd700 1 -- 172.21.15.59:0/3873484694 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559d2c06ee10 con 0x559d2c13cc40 2023-10-08T12:44:34.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01c2ffd700 10 client.15831 handle_command_reply: tid=0 2023-10-08T12:44:34.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01fdb86b80 1 client.15831 shutdown 2023-10-08T12:44:34.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01fdb86b80 1 -- 172.21.15.59:0/3873484694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 msgr2=0x559d2c12cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 0x559d2c12cff0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f01d400bf20 tx=0x7f01d400b980 comp rx=0 tx=0).stop 2023-10-08T12:44:34.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01fdb86b80 1 -- 172.21.15.59:0/3873484694 shutdown_connections 2023-10-08T12:44:34.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d2c13cc40 0x559d2c13f030 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c12d650 0x559d2c12a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 0x559d2c12cff0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/3873484694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c1227a0 0x559d2c12a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01c2ffd700 0 client.15831 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:34.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.645+0000 7f01fdb86b80 1 -- 172.21.15.59:0/3873484694 >> 172.21.15.59:0/3873484694 conn(0x559d2c097260 msgr2=0x559d2c11dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:34.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.646+0000 7f01fdb86b80 1 -- 172.21.15.59:0/3873484694 shutdown_connections 2023-10-08T12:44:34.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.646+0000 7f01fdb86b80 1 -- 172.21.15.59:0/3873484694 wait complete. 2023-10-08T12:44:34.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.646+0000 7f01fdb86b80 20 client.15831 trim_cache size 0 max 16384 2023-10-08T12:44:34.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.668+0000 7f01fdb86b80 1 Processor -- start 2023-10-08T12:44:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.669+0000 7f01fdb86b80 1 -- start start 2023-10-08T12:44:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.669+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 0x559d2c134180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.669+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c121e80 0x559d2c11dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.669+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 0x559d2c11e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.669+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2bef6920 con 0x559d2c1227a0 2023-10-08T12:44:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.669+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2c11aae0 con 0x559d2c121e80 2023-10-08T12:44:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.669+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2c12b630 con 0x559d2c097260 2023-10-08T12:44:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.669+0000 7f01e2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c121e80 0x559d2c11dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.669+0000 7f01e2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c121e80 0x559d2c11dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53650/0 (socket says 172.21.15.59:53650) 2023-10-08T12:44:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01e2ffd700 1 -- 172.21.15.59:0/2539522059 learned_addr learned my addr 172.21.15.59:0/2539522059 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.669+0000 7f01e37fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 0x559d2c134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01e3fff700 1 --2- 172.21.15.59:0/2539522059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 0x559d2c11e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01e2ffd700 1 -- 172.21.15.59:0/2539522059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 msgr2=0x559d2c134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/2539522059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 0x559d2c134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01e2ffd700 1 -- 172.21.15.59:0/2539522059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 msgr2=0x559d2c11e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/2539522059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 0x559d2c11e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01e2ffd700 1 -- 172.21.15.59:0/2539522059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d2be89c60 con 0x559d2c121e80 2023-10-08T12:44:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01e3fff700 1 --2- 172.21.15.59:0/2539522059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 0x559d2c11e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/2539522059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c121e80 0x559d2c11dcb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f01d80967a0 tx=0x7f01d806d210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b602a0d1f537b53 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01ca7fc700 1 -- 172.21.15.59:0/2539522059 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d809a2a0 con 0x559d2c121e80 2023-10-08T12:44:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01ca7fc700 1 -- 172.21.15.59:0/2539522059 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01d809e3f0 con 0x559d2c121e80 2023-10-08T12:44:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.670+0000 7f01ca7fc700 1 -- 172.21.15.59:0/2539522059 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8098760 con 0x559d2c121e80 2023-10-08T12:44:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.671+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2539522059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c121e80 msgr2=0x559d2c11dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.671+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/2539522059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c121e80 0x559d2c11dcb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f01d80967a0 tx=0x7f01d806d210 comp rx=0 tx=0).stop 2023-10-08T12:44:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.671+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2539522059 shutdown_connections 2023-10-08T12:44:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.671+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/2539522059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c1227a0 0x559d2c11e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.671+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/2539522059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 0x559d2c134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.671+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/2539522059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c121e80 0x559d2c11dcb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.671+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2539522059 >> 172.21.15.59:0/2539522059 conn(0x559d2c11a2a0 msgr2=0x559d2c1255d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.671+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2539522059 shutdown_connections 2023-10-08T12:44:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.671+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2539522059 wait complete. 2023-10-08T12:44:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.672+0000 7f01fdb86b80 1 -- start start 2023-10-08T12:44:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.672+0000 7f01fdb86b80 1 Processor -- start 2023-10-08T12:44:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 0x559d2c132cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 0x559d2c133230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01fdb86b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c1227a0 0x559d2c190a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2c133ac0 con 0x559d2c121e80 2023-10-08T12:44:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2c190f40 con 0x559d2c1227a0 2023-10-08T12:44:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01fdb86b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2c191080 con 0x559d2c097260 2023-10-08T12:44:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01fdb86b80 10 client.0 _ll_register_callbacks cb 0x7f01d8010b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01e37fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 0x559d2c132cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01e2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 0x559d2c133230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01e37fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 0x559d2c132cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40808/0 (socket says 172.21.15.59:40808) 2023-10-08T12:44:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01e37fe700 1 -- 172.21.15.59:0/2364118661 learned_addr learned my addr 172.21.15.59:0/2364118661 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01e3fff700 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c1227a0 0x559d2c190a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01e37fe700 1 -- 172.21.15.59:0/2364118661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c1227a0 msgr2=0x559d2c190a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01e37fe700 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c1227a0 0x559d2c190a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01e37fe700 1 -- 172.21.15.59:0/2364118661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 msgr2=0x559d2c133230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01e37fe700 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 0x559d2c133230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.673+0000 7f01e37fe700 1 -- 172.21.15.59:0/2364118661 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d80cc040 con 0x559d2c097260 2023-10-08T12:44:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.674+0000 7f01e37fe700 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 0x559d2c132cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009ce0 tx=0x7f01d400b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=894ab9f1ecc2ee53 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:34.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.674+0000 7f01c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:44:34.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.674+0000 7f01c2ffd700 1 -- 172.21.15.59:0/2364118661 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d401d070 con 0x559d2c097260 2023-10-08T12:44:34.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.674+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2364118661 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01d401e040 con 0x559d2c097260 2023-10-08T12:44:34.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.674+0000 7f01c2ffd700 1 -- 172.21.15.59:0/2364118661 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f01d4000e40 con 0x559d2c097260 2023-10-08T12:44:34.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.674+0000 7f01c2ffd700 1 -- 172.21.15.59:0/2364118661 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01d400b9f0 con 0x559d2c097260 2023-10-08T12:44:34.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.674+0000 7f01fdb86b80 10 client.25828 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:34.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.674+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2364118661 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x559d2bec7250 con 0x559d2c097260 2023-10-08T12:44:34.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.675+0000 7f01c2ffd700 1 -- 172.21.15.59:0/2364118661 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01d401e040 con 0x559d2c097260 2023-10-08T12:44:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.675+0000 7f01c2ffd700 1 -- 172.21.15.59:0/2364118661 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f01d4041070 con 0x559d2c097260 2023-10-08T12:44:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.675+0000 7f01fdb86b80 10 client.25828 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.675+0000 7f01fdb86b80 10 client.25828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.675+0000 7f01fdb86b80 20 client.25828 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.675+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d2c12d650 0x559d2c1942c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.675+0000 7f01fdb86b80 4 client.25828 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:44:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.675+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2364118661 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559d2c06eb30 con 0x559d2c12d650 2023-10-08T12:44:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.675+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d2c12d650 0x559d2c1942c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01e2ffd700 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d2c12d650 0x559d2c1942c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15eb2905abf90ae server_cookie=8a74d95cd10383cd in_seq=0 out_seq=0 2023-10-08T12:44:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01c2ffd700 10 client.25828 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01c2ffd700 1 -- 172.21.15.59:0/2364118661 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559d2c06eb30 con 0x559d2c12d650 2023-10-08T12:44:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01c2ffd700 10 client.25828 handle_command_reply: tid=0 2023-10-08T12:44:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01fdb86b80 1 client.25828 shutdown 2023-10-08T12:44:34.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2364118661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 msgr2=0x559d2c132cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 0x559d2c132cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009ce0 tx=0x7f01d400b480 comp rx=0 tx=0).stop 2023-10-08T12:44:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2364118661 shutdown_connections 2023-10-08T12:44:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d2c12d650 0x559d2c1942c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d2c1227a0 0x559d2c190a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d2c097260 0x559d2c132cf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01fdb86b80 1 --2- 172.21.15.59:0/2364118661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2c121e80 0x559d2c133230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2364118661 >> 172.21.15.59:0/2364118661 conn(0x559d2c11a2a0 msgr2=0x559d2c1255d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01c2ffd700 0 client.25828 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.676+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2364118661 shutdown_connections 2023-10-08T12:44:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01fdb86b80 1 -- 172.21.15.59:0/2364118661 wait complete. 2023-10-08T12:44:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01fdb86b80 20 client.25828 trim_cache size 0 max 16384 2023-10-08T12:44:34.685 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:44:34.685 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:44:34.685 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:44:34.685 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:44:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01ea1ff700 1 -- 172.21.15.59:0/2396239100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01cc0a15f0 msgr2=0x7f01cc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01ea1ff700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01cc0a15f0 0x7f01cc0a3ab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00ff10 tx=0x7f01dc004b40 comp rx=0 tx=0).stop 2023-10-08T12:44:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01ea1ff700 1 -- 172.21.15.59:0/2396239100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e4101100 msgr2=0x7f01e41992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01ea1ff700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e4101100 0x7f01e41992d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f01d800e9a0 tx=0x7f01d800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01ea1ff700 1 -- 172.21.15.59:0/2396239100 shutdown_connections 2023-10-08T12:44:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01ea1ff700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01cc0a15f0 0x7f01cc0a3ab0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01ea1ff700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01e4106750 0x7f01e419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01ea1ff700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4100740 0x7f01e4198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01ea1ff700 1 --2- 172.21.15.59:0/2396239100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e4101100 0x7f01e41992d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.677+0000 7f01ea1ff700 1 -- 172.21.15.59:0/2396239100 >> 172.21.15.59:0/2396239100 conn(0x7f01e40fc230 msgr2=0x7f01e410be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.678+0000 7f01ea1ff700 1 -- 172.21.15.59:0/2396239100 shutdown_connections 2023-10-08T12:44:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.678+0000 7f01ea1ff700 1 -- 172.21.15.59:0/2396239100 wait complete. 2023-10-08T12:44:34.696 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:44:34.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:44:34.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.921+0000 7fcc289ff700 1 -- 172.21.15.59:0/66761065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc24106660 msgr2=0x7fcc24106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.921+0000 7fcc289ff700 1 --2- 172.21.15.59:0/66761065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc24106660 0x7fcc24106a40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009990 tx=0x7fcc14009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.921+0000 7fcc289ff700 1 -- 172.21.15.59:0/66761065 shutdown_connections 2023-10-08T12:44:34.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.921+0000 7fcc289ff700 1 --2- 172.21.15.59:0/66761065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc24101010 0x7fcc2410d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.921+0000 7fcc289ff700 1 --2- 172.21.15.59:0/66761065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc24106660 0x7fcc24106a40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.921+0000 7fcc289ff700 1 --2- 172.21.15.59:0/66761065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc24100650 0x7fcc24100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.921+0000 7fcc289ff700 1 -- 172.21.15.59:0/66761065 >> 172.21.15.59:0/66761065 conn(0x7fcc240fc180 msgr2=0x7fcc240fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:34.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.921+0000 7fcc289ff700 1 -- 172.21.15.59:0/66761065 shutdown_connections 2023-10-08T12:44:34.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.921+0000 7fcc289ff700 1 -- 172.21.15.59:0/66761065 wait complete. 2023-10-08T12:44:34.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.923+0000 7fcc289ff700 1 Processor -- start 2023-10-08T12:44:34.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.923+0000 7fcc289ff700 1 -- start start 2023-10-08T12:44:34.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc289ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc24100650 0x7fcc2419e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc289ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc24101010 0x7fcc2419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc289ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc24106660 0x7fcc24198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc289ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24199150 con 0x7fcc24101010 2023-10-08T12:44:34.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc289ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc241992c0 con 0x7fcc24106660 2023-10-08T12:44:34.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc289ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24199480 con 0x7fcc24100650 2023-10-08T12:44:34.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc21d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc24101010 0x7fcc2419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc22d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc24106660 0x7fcc24198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc21d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc24101010 0x7fcc2419ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40100/0 (socket says 172.21.15.59:40100) 2023-10-08T12:44:34.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc22d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc24106660 0x7fcc24198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53682/0 (socket says 172.21.15.59:53682) 2023-10-08T12:44:34.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc21d9b700 1 -- 172.21.15.59:0/587987972 learned_addr learned my addr 172.21.15.59:0/587987972 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:34.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc2259c700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc24100650 0x7fcc2419e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc22d9d700 1 -- 172.21.15.59:0/587987972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc24100650 msgr2=0x7fcc2419e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc22d9d700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc24100650 0x7fcc2419e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc22d9d700 1 -- 172.21.15.59:0/587987972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc24101010 msgr2=0x7fcc2419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:34.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc22d9d700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc24101010 0x7fcc2419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:34.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.924+0000 7fcc22d9d700 1 -- 172.21.15.59:0/587987972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140095f0 con 0x7fcc24106660 2023-10-08T12:44:34.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.925+0000 7fcc22d9d700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc24106660 0x7fcc24198af0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00efc0 tx=0x7fcc1c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:34.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.925+0000 7fcc137fe700 1 -- 172.21.15.59:0/587987972 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c018070 con 0x7fcc24106660 2023-10-08T12:44:34.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.925+0000 7fcc137fe700 1 -- 172.21.15.59:0/587987972 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc1c00f040 con 0x7fcc24106660 2023-10-08T12:44:34.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.925+0000 7fcc289ff700 1 -- 172.21.15.59:0/587987972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc24199700 con 0x7fcc24106660 2023-10-08T12:44:34.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.925+0000 7fcc137fe700 1 -- 172.21.15.59:0/587987972 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00cd40 con 0x7fcc24106660 2023-10-08T12:44:34.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.925+0000 7fcc289ff700 1 -- 172.21.15.59:0/587987972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc241a59b0 con 0x7fcc24106660 2023-10-08T12:44:34.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.926+0000 7fcc289ff700 1 -- 172.21.15.59:0/587987972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc24101d90 con 0x7fcc24106660 2023-10-08T12:44:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.928+0000 7fcc137fe700 1 -- 172.21.15.59:0/587987972 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fcc1c003a00 con 0x7fcc24106660 2023-10-08T12:44:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.930+0000 7fcc137fe700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcc0c0a15f0 0x7fcc0c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:34.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.930+0000 7fcc137fe700 1 -- 172.21.15.59:0/587987972 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fcc1c0ccc20 con 0x7fcc24106660 2023-10-08T12:44:34.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.930+0000 7fcc2259c700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcc0c0a15f0 0x7fcc0c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:34.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.930+0000 7fcc2259c700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcc0c0a15f0 0x7fcc0c0a3ab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc14006010 tx=0x7fcc1400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:34.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:34.936+0000 7fcc137fe700 1 -- 172.21.15.59:0/587987972 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcc1c095ff0 con 0x7fcc24106660 2023-10-08T12:44:35.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.234+0000 7fcc289ff700 1 -- 172.21.15.59:0/587987972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc24067450 con 0x7fcc24106660 2023-10-08T12:44:35.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.235+0000 7fcc137fe700 1 -- 172.21.15.59:0/587987972 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fcc1c099610 con 0x7fcc24106660 2023-10-08T12:44:35.235 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:44:35.236 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:44:35.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 -- 172.21.15.59:0/587987972 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcc0c0a15f0 msgr2=0x7fcc0c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:35.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcc0c0a15f0 0x7fcc0c0a3ab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc14006010 tx=0x7fcc1400b260 comp rx=0 tx=0).stop 2023-10-08T12:44:35.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 -- 172.21.15.59:0/587987972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc24106660 msgr2=0x7fcc24198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc24106660 0x7fcc24198af0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00efc0 tx=0x7fcc1c00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 -- 172.21.15.59:0/587987972 shutdown_connections 2023-10-08T12:44:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcc0c0a15f0 0x7fcc0c0a3ab0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc24106660 0x7fcc24198af0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc24100650 0x7fcc2419e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 --2- 172.21.15.59:0/587987972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc24101010 0x7fcc2419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 -- 172.21.15.59:0/587987972 >> 172.21.15.59:0/587987972 conn(0x7fcc240fc180 msgr2=0x7fcc2410bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 -- 172.21.15.59:0/587987972 shutdown_connections 2023-10-08T12:44:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.238+0000 7fcc289ff700 1 -- 172.21.15.59:0/587987972 wait complete. 2023-10-08T12:44:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:44:35.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:44:35.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.485+0000 7f0f347ff700 1 -- 172.21.15.59:0/719365586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c106750 msgr2=0x7f0f2c106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.485+0000 7f0f347ff700 1 --2- 172.21.15.59:0/719365586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c106750 0x7f0f2c106b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009990 tx=0x7f0f20009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.486+0000 7f0f347ff700 1 -- 172.21.15.59:0/719365586 shutdown_connections 2023-10-08T12:44:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.486+0000 7f0f347ff700 1 --2- 172.21.15.59:0/719365586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c106750 0x7f0f2c106b30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.486+0000 7f0f347ff700 1 --2- 172.21.15.59:0/719365586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f2c101100 0x7f0f2c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.486+0000 7f0f347ff700 1 --2- 172.21.15.59:0/719365586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f2c100740 0x7f0f2c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.486+0000 7f0f347ff700 1 -- 172.21.15.59:0/719365586 >> 172.21.15.59:0/719365586 conn(0x7f0f2c0fc230 msgr2=0x7f0f2c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.486+0000 7f0f347ff700 1 -- 172.21.15.59:0/719365586 shutdown_connections 2023-10-08T12:44:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.486+0000 7f0f347ff700 1 -- 172.21.15.59:0/719365586 wait complete. 2023-10-08T12:44:35.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.487+0000 7f0f347ff700 1 Processor -- start 2023-10-08T12:44:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.487+0000 7f0f347ff700 1 -- start start 2023-10-08T12:44:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.487+0000 7f0f347ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f2c100740 0x7f0f2c19c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.487+0000 7f0f347ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f2c101100 0x7f0f2c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.487+0000 7f0f347ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c106750 0x7f0f2c1969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.487+0000 7f0f347ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c197180 con 0x7f0f2c100740 2023-10-08T12:44:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.487+0000 7f0f347ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c1972f0 con 0x7f0f2c106750 2023-10-08T12:44:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.487+0000 7f0f347ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c1974b0 con 0x7f0f2c101100 2023-10-08T12:44:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.487+0000 7f0f32d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c106750 0x7f0f2c1969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.487+0000 7f0f3259b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f2c100740 0x7f0f2c19c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.487+0000 7f0f32d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c106750 0x7f0f2c1969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53708/0 (socket says 172.21.15.59:53708) 2023-10-08T12:44:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f32d9c700 1 -- 172.21.15.59:0/4025110720 learned_addr learned my addr 172.21.15.59:0/4025110720 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f31d9a700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f2c101100 0x7f0f2c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f32d9c700 1 -- 172.21.15.59:0/4025110720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f2c101100 msgr2=0x7f0f2c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f2c101100 0x7f0f2c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f32d9c700 1 -- 172.21.15.59:0/4025110720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f2c100740 msgr2=0x7f0f2c19c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f2c100740 0x7f0f2c19c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f32d9c700 1 -- 172.21.15.59:0/4025110720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f200095f0 con 0x7f0f2c106750 2023-10-08T12:44:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f31d9a700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f2c101100 0x7f0f2c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c106750 0x7f0f2c1969b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ef30 tx=0x7f0f2400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:35.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f2b7fe700 1 -- 172.21.15.59:0/4025110720 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24018070 con 0x7f0f2c106750 2023-10-08T12:44:35.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f2b7fe700 1 -- 172.21.15.59:0/4025110720 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f2400f040 con 0x7f0f2c106750 2023-10-08T12:44:35.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f347ff700 1 -- 172.21.15.59:0/4025110720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2c197730 con 0x7f0f2c106750 2023-10-08T12:44:35.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f2b7fe700 1 -- 172.21.15.59:0/4025110720 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400cdb0 con 0x7f0f2c106750 2023-10-08T12:44:35.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.488+0000 7f0f347ff700 1 -- 172.21.15.59:0/4025110720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2c1a3890 con 0x7f0f2c106750 2023-10-08T12:44:35.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.492+0000 7f0f2b7fe700 1 -- 172.21.15.59:0/4025110720 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0f24003a00 con 0x7f0f2c106750 2023-10-08T12:44:35.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.493+0000 7f0f480b6b80 1 Processor -- start 2023-10-08T12:44:35.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.494+0000 7f0f2b7fe700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f1c0a1670 0x7f0f1c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.494+0000 7f0f480b6b80 1 -- start start 2023-10-08T12:44:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.494+0000 7f0f2b7fe700 1 -- 172.21.15.59:0/4025110720 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0f240ccbe0 con 0x7f0f2c106750 2023-10-08T12:44:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.494+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f7a40 0x5649df3f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.494+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f63c0 0x5649df3f6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.494+0000 7f0f31d9a700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f1c0a1670 0x7f0f1c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.494+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df40c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.494+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df35f460 con 0x5649df3f63c0 2023-10-08T12:44:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.494+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df350c20 con 0x5649df409cf0 2023-10-08T12:44:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.494+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df34e540 con 0x5649df3f7a40 2023-10-08T12:44:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f32d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df40c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f32d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df40c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53714/0 (socket says 172.21.15.59:53714) 2023-10-08T12:44:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f32d9c700 1 -- 172.21.15.59:0/3754685584 learned_addr learned my addr 172.21.15.59:0/3754685584 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f3259b700 1 --2- 172.21.15.59:0/3754685584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f7a40 0x5649df3f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f31d9a700 1 --2- 172.21.15.59:0/3754685584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f63c0 0x5649df3f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f32d9c700 1 -- 172.21.15.59:0/3754685584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f7a40 msgr2=0x5649df3f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:35.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/3754685584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f7a40 0x5649df3f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f32d9c700 1 -- 172.21.15.59:0/3754685584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f63c0 msgr2=0x5649df3f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:35.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/3754685584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f63c0 0x5649df3f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f32d9c700 1 -- 172.21.15.59:0/3754685584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649df174de0 con 0x5649df409cf0 2023-10-08T12:44:35.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f31d9a700 1 --2- 172.21.15.59:0/3754685584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f63c0 0x5649df3f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:44:35.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/3754685584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df40c0e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009c10 tx=0x7f0f24099ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5c7f7c9df9dcca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:35.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f31d9a700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f1c0a1670 0x7f0f1c0a3b30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0f18005950 tx=0x7f0f1800b6e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:35.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f28ff9700 1 -- 172.21.15.59:0/3754685584 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24004ad0 con 0x5649df409cf0 2023-10-08T12:44:35.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f28ff9700 1 -- 172.21.15.59:0/3754685584 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f2401b320 con 0x5649df409cf0 2023-10-08T12:44:35.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.495+0000 7f0f28ff9700 1 -- 172.21.15.59:0/3754685584 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24099ed0 con 0x5649df409cf0 2023-10-08T12:44:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.496+0000 7f0f480b6b80 1 -- 172.21.15.59:0/3754685584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 msgr2=0x5649df40c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.496+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/3754685584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df40c0e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009c10 tx=0x7f0f24099ac0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.496+0000 7f0f480b6b80 1 -- 172.21.15.59:0/3754685584 shutdown_connections 2023-10-08T12:44:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.496+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/3754685584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df40c0e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.496+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/3754685584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f7a40 0x5649df3f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.496+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/3754685584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f63c0 0x5649df3f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.496+0000 7f0f480b6b80 1 -- 172.21.15.59:0/3754685584 >> 172.21.15.59:0/3754685584 conn(0x5649df36b260 msgr2=0x5649df3f22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.496+0000 7f0f480b6b80 1 -- 172.21.15.59:0/3754685584 shutdown_connections 2023-10-08T12:44:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.496+0000 7f0f480b6b80 1 -- 172.21.15.59:0/3754685584 wait complete. 2023-10-08T12:44:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.497+0000 7f0f480b6b80 1 -- start start 2023-10-08T12:44:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.497+0000 7f0f480b6b80 1 Processor -- start 2023-10-08T12:44:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f63c0 0x5649df3fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f7a40 0x5649df3f9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df3fa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df349e30 con 0x5649df3f7a40 2023-10-08T12:44:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df2e6710 con 0x5649df409cf0 2023-10-08T12:44:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df2e63b0 con 0x5649df3f63c0 2023-10-08T12:44:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f480b6b80 10 client.0 _ll_register_callbacks cb 0x5649df143800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f31d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f7a40 0x5649df3f9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f32d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df3fa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f31d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f7a40 0x5649df3f9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40144/0 (socket says 172.21.15.59:40144) 2023-10-08T12:44:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f31d9a700 1 -- 172.21.15.59:0/4092533817 learned_addr learned my addr 172.21.15.59:0/4092533817 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f3259b700 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f63c0 0x5649df3fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f32d9c700 1 -- 172.21.15.59:0/4092533817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f63c0 msgr2=0x5649df3fcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f63c0 0x5649df3fcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f32d9c700 1 -- 172.21.15.59:0/4092533817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f7a40 msgr2=0x5649df3f9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f7a40 0x5649df3f9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f32d9c700 1 -- 172.21.15.59:0/4092533817 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2c1a3890 con 0x5649df409cf0 2023-10-08T12:44:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.498+0000 7f0f3259b700 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f63c0 0x5649df3fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.499+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df3fa4b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0f24099970 tx=0x7f0f24099410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43ee34c787dea472 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.499+0000 7f0f15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.499+0000 7f0f15ffb700 1 -- 172.21.15.59:0/4092533817 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24004ad0 con 0x5649df409cf0 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.499+0000 7f0f15ffb700 1 -- 172.21.15.59:0/4092533817 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0f24099c70 con 0x5649df409cf0 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.499+0000 7f0f480b6b80 1 -- 172.21.15.59:0/4092533817 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649df311eb0 con 0x5649df409cf0 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.499+0000 7f0f15ffb700 1 -- 172.21.15.59:0/4092533817 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f2409a370 con 0x5649df409cf0 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.499+0000 7f0f480b6b80 10 client.25853 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.499+0000 7f0f480b6b80 1 -- 172.21.15.59:0/4092533817 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5649df15dc60 con 0x5649df409cf0 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.499+0000 7f0f15ffb700 1 -- 172.21.15.59:0/4092533817 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5649df311eb0 con 0x5649df409cf0 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.499+0000 7f0f15ffb700 1 -- 172.21.15.59:0/4092533817 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0f240b21a0 con 0x5649df409cf0 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.500+0000 7f0f480b6b80 10 client.25853 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.500+0000 7f0f480b6b80 10 client.25853 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:35.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.500+0000 7f0f480b6b80 20 client.25853 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:35.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.500+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649df4193c0 0x5649df41b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.500+0000 7f0f480b6b80 4 client.25853 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:35.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.500+0000 7f0f480b6b80 1 -- 172.21.15.59:0/4092533817 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649df342e10 con 0x5649df4193c0 2023-10-08T12:44:35.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.500+0000 7f0f3259b700 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649df4193c0 0x5649df41b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.500+0000 7f0f3259b700 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649df4193c0 0x5649df41b7b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c31f0ab549770ff4 server_cookie=ab57136a161d9795 in_seq=0 out_seq=0 2023-10-08T12:44:35.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.500+0000 7f0f15ffb700 10 client.25853 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:35.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.502+0000 7f0f15ffb700 1 -- 172.21.15.59:0/4092533817 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5649df342e10 con 0x5649df4193c0 2023-10-08T12:44:35.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.502+0000 7f0f15ffb700 10 client.25853 handle_command_reply: tid=0 2023-10-08T12:44:35.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.502+0000 7f0f480b6b80 1 client.25853 shutdown 2023-10-08T12:44:35.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.502+0000 7f0f480b6b80 1 -- 172.21.15.59:0/4092533817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 msgr2=0x5649df3fa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:35.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.502+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df3fa4b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0f24099970 tx=0x7f0f24099410 comp rx=0 tx=0).stop 2023-10-08T12:44:35.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.503+0000 7f0f480b6b80 1 -- 172.21.15.59:0/4092533817 shutdown_connections 2023-10-08T12:44:35.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.503+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649df4193c0 0x5649df41b7b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.503+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df3fa4b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.503+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f63c0 0x5649df3fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.503+0000 7f0f15ffb700 0 client.25853 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:35.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.503+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/4092533817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f7a40 0x5649df3f9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.503+0000 7f0f480b6b80 1 -- 172.21.15.59:0/4092533817 >> 172.21.15.59:0/4092533817 conn(0x5649df36b260 msgr2=0x5649df3f1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:35.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.503+0000 7f0f480b6b80 1 -- 172.21.15.59:0/4092533817 shutdown_connections 2023-10-08T12:44:35.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.503+0000 7f0f480b6b80 1 -- 172.21.15.59:0/4092533817 wait complete. 2023-10-08T12:44:35.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.503+0000 7f0f480b6b80 20 client.25853 trim_cache size 0 max 16384 2023-10-08T12:44:35.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 339313 13.94 MB/sec execute 6 sec latency 11.981 ms 2023-10-08T12:44:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.519+0000 7f0f480b6b80 1 Processor -- start 2023-10-08T12:44:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.519+0000 7f0f480b6b80 1 -- start start 2023-10-08T12:44:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.519+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f63c0 0x5649df409360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.519+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f7a40 0x5649df415130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.519+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df415670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.519+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df1ca920 con 0x5649df3f63c0 2023-10-08T12:44:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df311eb0 con 0x5649df409cf0 2023-10-08T12:44:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df3f3870 con 0x5649df3f7a40 2023-10-08T12:44:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f32d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df415670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f3259b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f63c0 0x5649df409360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f32d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df415670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53734/0 (socket says 172.21.15.59:53734) 2023-10-08T12:44:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f32d9c700 1 -- 172.21.15.59:0/1800730532 learned_addr learned my addr 172.21.15.59:0/1800730532 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f31d9a700 1 --2- 172.21.15.59:0/1800730532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f7a40 0x5649df415130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f32d9c700 1 -- 172.21.15.59:0/1800730532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f7a40 msgr2=0x5649df415130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:35.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/1800730532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f7a40 0x5649df415130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f32d9c700 1 -- 172.21.15.59:0/1800730532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f63c0 msgr2=0x5649df409360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:35.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/1800730532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f63c0 0x5649df409360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f32d9c700 1 -- 172.21.15.59:0/1800730532 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649df4203c0 con 0x5649df409cf0 2023-10-08T12:44:35.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f31d9a700 1 --2- 172.21.15.59:0/1800730532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f7a40 0x5649df415130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:35.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.520+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/1800730532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df415670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ef00 tx=0x7f0f24004dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5933e6a358c3c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:35.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.521+0000 7f0f297fa700 1 -- 172.21.15.59:0/1800730532 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240caaa0 con 0x5649df409cf0 2023-10-08T12:44:35.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.521+0000 7f0f297fa700 1 -- 172.21.15.59:0/1800730532 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f240997b0 con 0x5649df409cf0 2023-10-08T12:44:35.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.521+0000 7f0f297fa700 1 -- 172.21.15.59:0/1800730532 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240b21a0 con 0x5649df409cf0 2023-10-08T12:44:35.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.521+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1800730532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 msgr2=0x5649df415670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:35.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.521+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/1800730532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df415670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ef00 tx=0x7f0f24004dc0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.521+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1800730532 shutdown_connections 2023-10-08T12:44:35.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.521+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/1800730532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df409cf0 0x5649df415670 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.521+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/1800730532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df3f63c0 0x5649df409360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.521+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/1800730532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f7a40 0x5649df415130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.521+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1800730532 >> 172.21.15.59:0/1800730532 conn(0x5649df36b260 msgr2=0x5649df3f67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.522+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1800730532 shutdown_connections 2023-10-08T12:44:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.522+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1800730532 wait complete. 2023-10-08T12:44:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.522+0000 7f0f480b6b80 1 -- start start 2023-10-08T12:44:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.522+0000 7f0f480b6b80 1 Processor -- start 2023-10-08T12:44:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f63c0 0x5649df4107d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df3f7a40 0x5649df40edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f480b6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df409cf0 0x5649df40f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df40f850 con 0x5649df409cf0 2023-10-08T12:44:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df40f9c0 con 0x5649df3f7a40 2023-10-08T12:44:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f480b6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649df40fb30 con 0x5649df3f63c0 2023-10-08T12:44:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f480b6b80 10 client.0 _ll_register_callbacks cb 0x7f0f240097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f31d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df3f7a40 0x5649df40edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f32d9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df409cf0 0x5649df40f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f31d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df3f7a40 0x5649df40edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53750/0 (socket says 172.21.15.59:53750) 2023-10-08T12:44:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f31d9a700 1 -- 172.21.15.59:0/1039841133 learned_addr learned my addr 172.21.15.59:0/1039841133 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.523+0000 7f0f3259b700 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f63c0 0x5649df4107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.524+0000 7f0f31d9a700 1 -- 172.21.15.59:0/1039841133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f63c0 msgr2=0x5649df4107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.524+0000 7f0f31d9a700 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f63c0 0x5649df4107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.524+0000 7f0f31d9a700 1 -- 172.21.15.59:0/1039841133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df409cf0 msgr2=0x5649df40f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.524+0000 7f0f31d9a700 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df409cf0 0x5649df40f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.524+0000 7f0f31d9a700 1 -- 172.21.15.59:0/1039841133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649df15dc60 con 0x5649df3f7a40 2023-10-08T12:44:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.524+0000 7f0f32d9c700 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df409cf0 0x5649df40f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.524+0000 7f0f31d9a700 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df3f7a40 0x5649df40edd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f180124e0 tx=0x7f0f18004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=402ca6be663cb558 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.524+0000 7f0f15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:44:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.524+0000 7f0f15ffb700 1 -- 172.21.15.59:0/1039841133 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18004020 con 0x5649df3f7a40 2023-10-08T12:44:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.524+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1039841133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f2401b320 con 0x5649df3f7a40 2023-10-08T12:44:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.524+0000 7f0f15ffb700 1 -- 172.21.15.59:0/1039841133 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0f18004180 con 0x5649df3f7a40 2023-10-08T12:44:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.525+0000 7f0f15ffb700 1 -- 172.21.15.59:0/1039841133 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f18004340 con 0x5649df3f7a40 2023-10-08T12:44:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.525+0000 7f0f480b6b80 10 client.25859 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.525+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1039841133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5649df19b250 con 0x5649df3f7a40 2023-10-08T12:44:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.525+0000 7f0f15ffb700 1 -- 172.21.15.59:0/1039841133 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f2401b320 con 0x5649df3f7a40 2023-10-08T12:44:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.525+0000 7f0f15ffb700 1 -- 172.21.15.59:0/1039841133 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0f18034660 con 0x5649df3f7a40 2023-10-08T12:44:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.525+0000 7f0f480b6b80 10 client.25859 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.525+0000 7f0f480b6b80 10 client.25859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.525+0000 7f0f480b6b80 20 client.25859 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.525+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649df46e760 0x5649df470b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.525+0000 7f0f480b6b80 4 client.25859 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:44:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.525+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1039841133 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5649df342b30 con 0x5649df46e760 2023-10-08T12:44:35.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.526+0000 7f0f3259b700 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649df46e760 0x5649df470b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:35.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.526+0000 7f0f3259b700 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649df46e760 0x5649df470b80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=333184dca34df50c server_cookie=cc724f22978ce9ac in_seq=0 out_seq=0 2023-10-08T12:44:35.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.526+0000 7f0f15ffb700 10 client.25859 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:35.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.526+0000 7f0f15ffb700 1 -- 172.21.15.59:0/1039841133 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5649df342b30 con 0x5649df46e760 2023-10-08T12:44:35.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.526+0000 7f0f15ffb700 10 client.25859 handle_command_reply: tid=0 2023-10-08T12:44:35.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.526+0000 7f0f480b6b80 1 client.25859 shutdown 2023-10-08T12:44:35.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1039841133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df3f7a40 msgr2=0x5649df40edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:35.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df3f7a40 0x5649df40edd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f180124e0 tx=0x7f0f18004750 comp rx=0 tx=0).stop 2023-10-08T12:44:35.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1039841133 shutdown_connections 2023-10-08T12:44:35.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649df46e760 0x5649df470b80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649df409cf0 0x5649df40f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649df3f63c0 0x5649df4107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f15ffb700 0 client.25859 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:35.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f480b6b80 1 --2- 172.21.15.59:0/1039841133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649df3f7a40 0x5649df40edd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1039841133 >> 172.21.15.59:0/1039841133 conn(0x5649df36b260 msgr2=0x5649df415130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:35.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1039841133 shutdown_connections 2023-10-08T12:44:35.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f480b6b80 1 -- 172.21.15.59:0/1039841133 wait complete. 2023-10-08T12:44:35.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.527+0000 7f0f480b6b80 20 client.25859 trim_cache size 0 max 16384 2023-10-08T12:44:35.532 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:44:35.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 -- 172.21.15.59:0/4025110720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f1c0a1670 msgr2=0x7f0f1c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:35.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f1c0a1670 0x7f0f1c0a3b30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0f18005950 tx=0x7f0f1800b6e0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 -- 172.21.15.59:0/4025110720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c106750 msgr2=0x7f0f2c1969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:35.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c106750 0x7f0f2c1969b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ef30 tx=0x7f0f2400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 -- 172.21.15.59:0/4025110720 shutdown_connections 2023-10-08T12:44:35.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f1c0a1670 0x7f0f1c0a3b30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c106750 0x7f0f2c1969b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f2c100740 0x7f0f2c19c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 --2- 172.21.15.59:0/4025110720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f2c101100 0x7f0f2c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:35.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 -- 172.21.15.59:0/4025110720 >> 172.21.15.59:0/4025110720 conn(0x7f0f2c0fc230 msgr2=0x7f0f2c0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:35.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 -- 172.21.15.59:0/4025110720 shutdown_connections 2023-10-08T12:44:35.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:35.528+0000 7f0f347ff700 1 -- 172.21.15.59:0/4025110720 wait complete. 2023-10-08T12:44:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:35 smithi173 ceph-mon[135182]: pgmap v416: 97 pgs: 97 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 277 op/s 2023-10-08T12:44:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:35 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/587987972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:44:36.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:35 smithi059 ceph-mon[98489]: pgmap v416: 97 pgs: 97 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 277 op/s 2023-10-08T12:44:36.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:35 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/587987972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:44:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:35 smithi092 ceph-mon[134093]: pgmap v416: 97 pgs: 97 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 277 op/s 2023-10-08T12:44:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:35 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/587987972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:44:36.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 340984 13.70 MB/sec execute 7 sec latency 212.368 ms 2023-10-08T12:44:36.548 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:44:36.548 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:44:36.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.770+0000 7f10e41ff700 1 -- 172.21.15.59:0/3406308129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10dc072c20 msgr2=0x7f10dc073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:36.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.770+0000 7f10e41ff700 1 --2- 172.21.15.59:0/3406308129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10dc072c20 0x7f10dc073000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009990 tx=0x7f10d8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.770+0000 7f10e41ff700 1 -- 172.21.15.59:0/3406308129 shutdown_connections 2023-10-08T12:44:36.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.770+0000 7f10e41ff700 1 --2- 172.21.15.59:0/3406308129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10dc072c20 0x7f10dc073000 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.770+0000 7f10e41ff700 1 --2- 172.21.15.59:0/3406308129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10dc10cf70 0x7f10dc10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.770+0000 7f10e41ff700 1 --2- 172.21.15.59:0/3406308129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10dc073540 0x7f10dc10ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.770+0000 7f10e41ff700 1 -- 172.21.15.59:0/3406308129 >> 172.21.15.59:0/3406308129 conn(0x7f10dc0fc200 msgr2=0x7f10dc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:36.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.771+0000 7f10e41ff700 1 -- 172.21.15.59:0/3406308129 shutdown_connections 2023-10-08T12:44:36.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.771+0000 7f10e41ff700 1 -- 172.21.15.59:0/3406308129 wait complete. 2023-10-08T12:44:36.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.772+0000 7f10e41ff700 1 Processor -- start 2023-10-08T12:44:36.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.772+0000 7f10e41ff700 1 -- start start 2023-10-08T12:44:36.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.772+0000 7f10e41ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10dc072c20 0x7f10dc198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.772+0000 7f10e41ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10dc073540 0x7f10dc1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.772+0000 7f10e41ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10dc10cf70 0x7f10dc19d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.772+0000 7f10e41ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc19dd90 con 0x7f10dc072c20 2023-10-08T12:44:36.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.772+0000 7f10e41ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc19df00 con 0x7f10dc073540 2023-10-08T12:44:36.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.772+0000 7f10e41ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc19e0c0 con 0x7f10dc10cf70 2023-10-08T12:44:36.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.772+0000 7f10e179a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10dc073540 0x7f10dc1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.772+0000 7f10e1f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10dc072c20 0x7f10dc198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10e179a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10dc073540 0x7f10dc1993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53778/0 (socket says 172.21.15.59:53778) 2023-10-08T12:44:36.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10e1f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10dc072c20 0x7f10dc198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40182/0 (socket says 172.21.15.59:40182) 2023-10-08T12:44:36.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10e279c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10dc10cf70 0x7f10dc19d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10e179a700 1 -- 172.21.15.59:0/41593650 learned_addr learned my addr 172.21.15.59:0/41593650 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:36.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10e179a700 1 -- 172.21.15.59:0/41593650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10dc10cf70 msgr2=0x7f10dc19d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:36.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10e179a700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10dc10cf70 0x7f10dc19d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10e179a700 1 -- 172.21.15.59:0/41593650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10dc072c20 msgr2=0x7f10dc198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:36.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10e179a700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10dc072c20 0x7f10dc198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10e179a700 1 -- 172.21.15.59:0/41593650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d80095f0 con 0x7f10dc073540 2023-10-08T12:44:36.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10e179a700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10dc073540 0x7f10dc1993b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00e9a0 tx=0x7f10cc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:36.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10d2ffd700 1 -- 172.21.15.59:0/41593650 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc009790 con 0x7f10dc073540 2023-10-08T12:44:36.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10e41ff700 1 -- 172.21.15.59:0/41593650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc19e3a0 con 0x7f10dc073540 2023-10-08T12:44:36.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10d2ffd700 1 -- 172.21.15.59:0/41593650 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10cc010430 con 0x7f10dc073540 2023-10-08T12:44:36.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.773+0000 7f10d2ffd700 1 -- 172.21.15.59:0/41593650 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc018680 con 0x7f10dc073540 2023-10-08T12:44:36.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.774+0000 7f10e41ff700 1 -- 172.21.15.59:0/41593650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc1a5be0 con 0x7f10dc073540 2023-10-08T12:44:36.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.777+0000 7f10d2ffd700 1 -- 172.21.15.59:0/41593650 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f10cc0105a0 con 0x7f10dc073540 2023-10-08T12:44:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.778+0000 7f10d2ffd700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10c80a15f0 0x7f10c80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.779+0000 7f10f7c1eb80 1 Processor -- start 2023-10-08T12:44:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.779+0000 7f10d2ffd700 1 -- 172.21.15.59:0/41593650 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f10cc014070 con 0x7f10dc073540 2023-10-08T12:44:36.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.779+0000 7f10e1f9b700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10c80a15f0 0x7f10c80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.779+0000 7f10f7c1eb80 1 -- start start 2023-10-08T12:44:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed3119f00 0x55eed311a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 0x55eed3125190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed31256d0 0x55eed3127ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed30834e0 con 0x55eed3119f00 2023-10-08T12:44:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed3074ca0 con 0x55eed311a820 2023-10-08T12:44:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed30725c0 con 0x55eed31256d0 2023-10-08T12:44:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e179a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 0x55eed3125190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e179a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 0x55eed3125190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53790/0 (socket says 172.21.15.59:53790) 2023-10-08T12:44:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e179a700 1 -- 172.21.15.59:0/761020610 learned_addr learned my addr 172.21.15.59:0/761020610 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e1f9b700 1 --2- 172.21.15.59:0/761020610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed3119f00 0x55eed311a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e279c700 1 --2- 172.21.15.59:0/761020610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed31256d0 0x55eed3127ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e179a700 1 -- 172.21.15.59:0/761020610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed31256d0 msgr2=0x55eed3127ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e1f9b700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10c80a15f0 0x7f10c80a3ab0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f10d800b2e0 tx=0x7f10d8005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e179a700 1 --2- 172.21.15.59:0/761020610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed31256d0 0x55eed3127ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e179a700 1 -- 172.21.15.59:0/761020610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed3119f00 msgr2=0x55eed311a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e179a700 1 --2- 172.21.15.59:0/761020610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed3119f00 0x55eed311a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e179a700 1 -- 172.21.15.59:0/761020610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eed2e98e60 con 0x55eed311a820 2023-10-08T12:44:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.780+0000 7f10e1f9b700 1 --2- 172.21.15.59:0/761020610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed3119f00 0x55eed311a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.781+0000 7f10e179a700 1 --2- 172.21.15.59:0/761020610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 0x55eed3125190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f10cc099fa0 tx=0x7f10cc099f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e08f54ca41d5da9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.781+0000 7f10c7fff700 1 -- 172.21.15.59:0/761020610 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0b1070 con 0x55eed311a820 2023-10-08T12:44:36.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.781+0000 7f10c7fff700 1 -- 172.21.15.59:0/761020610 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10cc09e1b0 con 0x55eed311a820 2023-10-08T12:44:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.781+0000 7f10c7fff700 1 -- 172.21.15.59:0/761020610 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc09a760 con 0x55eed311a820 2023-10-08T12:44:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.781+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/761020610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 msgr2=0x55eed3125190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.781+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/761020610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 0x55eed3125190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f10cc099fa0 tx=0x7f10cc099f10 comp rx=0 tx=0).stop 2023-10-08T12:44:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.782+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/761020610 shutdown_connections 2023-10-08T12:44:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.782+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/761020610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed31256d0 0x55eed3127ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.782+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/761020610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed3119f00 0x55eed311a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.782+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/761020610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 0x55eed3125190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.782+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/761020610 >> 172.21.15.59:0/761020610 conn(0x55eed308f2e0 msgr2=0x55eed3116350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.782+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/761020610 shutdown_connections 2023-10-08T12:44:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.782+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/761020610 wait complete. 2023-10-08T12:44:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.782+0000 7f10f7c1eb80 1 -- start start 2023-10-08T12:44:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.782+0000 7f10f7c1eb80 1 Processor -- start 2023-10-08T12:44:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed3125120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed311a820 0x55eed3122460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed31256d0 0x55eed3122ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed306deb0 con 0x55eed311a820 2023-10-08T12:44:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed300a790 con 0x55eed3119f00 2023-10-08T12:44:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed300a430 con 0x55eed31256d0 2023-10-08T12:44:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10f7c1eb80 10 client.0 _ll_register_callbacks cb 0x55eed2e67880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10e1f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed3125120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10e1f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed3125120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53792/0 (socket says 172.21.15.59:53792) 2023-10-08T12:44:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10e1f9b700 1 -- 172.21.15.59:0/166322097 learned_addr learned my addr 172.21.15.59:0/166322097 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10e179a700 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed311a820 0x55eed3122460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.783+0000 7f10e279c700 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed31256d0 0x55eed3122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.784+0000 7f10e279c700 1 -- 172.21.15.59:0/166322097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 msgr2=0x55eed3125120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.784+0000 7f10e279c700 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed3125120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.784+0000 7f10e279c700 1 -- 172.21.15.59:0/166322097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed311a820 msgr2=0x55eed3122460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.784+0000 7f10e279c700 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed311a820 0x55eed3122460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.784+0000 7f10e279c700 1 -- 172.21.15.59:0/166322097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc1a5be0 con 0x55eed31256d0 2023-10-08T12:44:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.784+0000 7f10e1f9b700 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed3125120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.784+0000 7f10e279c700 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed31256d0 0x55eed3122ba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009f30 tx=0x7f10d4004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d7a07517706388a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.784+0000 7f10c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:44:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.784+0000 7f10c57fa700 1 -- 172.21.15.59:0/166322097 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4016870 con 0x55eed31256d0 2023-10-08T12:44:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.784+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/166322097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eed3035f30 con 0x55eed31256d0 2023-10-08T12:44:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.784+0000 7f10c57fa700 1 -- 172.21.15.59:0/166322097 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f10d40169d0 con 0x55eed31256d0 2023-10-08T12:44:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10c57fa700 1 -- 172.21.15.59:0/166322097 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10d4016b90 con 0x55eed31256d0 2023-10-08T12:44:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10f7c1eb80 10 client.25864 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/166322097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55eed2e81ce0 con 0x55eed31256d0 2023-10-08T12:44:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10c57fa700 1 -- 172.21.15.59:0/166322097 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55eed3035f30 con 0x55eed31256d0 2023-10-08T12:44:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10c57fa700 1 -- 172.21.15.59:0/166322097 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f10d4014040 con 0x55eed31256d0 2023-10-08T12:44:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10f7c1eb80 10 client.25864 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10f7c1eb80 10 client.25864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10f7c1eb80 20 client.25864 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55eed31352f0 0x55eed3137710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10f7c1eb80 4 client.25864 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/166322097 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eed3066e90 con 0x55eed31352f0 2023-10-08T12:44:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.785+0000 7f10e1f9b700 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55eed31352f0 0x55eed3137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.786+0000 7f10e1f9b700 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55eed31352f0 0x55eed3137710 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a500899ef8a9d57 server_cookie=99cb3d56f525a972 in_seq=0 out_seq=0 2023-10-08T12:44:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.786+0000 7f10c57fa700 10 client.25864 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10c57fa700 1 -- 172.21.15.59:0/166322097 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eed3066e90 con 0x55eed31352f0 2023-10-08T12:44:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10c57fa700 10 client.25864 handle_command_reply: tid=0 2023-10-08T12:44:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10f7c1eb80 1 client.25864 shutdown 2023-10-08T12:44:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/166322097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed31256d0 msgr2=0x55eed3122ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed31256d0 0x55eed3122ba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009f30 tx=0x7f10d4004320 comp rx=0 tx=0).stop 2023-10-08T12:44:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/166322097 shutdown_connections 2023-10-08T12:44:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55eed31352f0 0x55eed3137710 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed3125120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed31256d0 0x55eed3122ba0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10c57fa700 0 client.25864 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/166322097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed311a820 0x55eed3122460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/166322097 >> 172.21.15.59:0/166322097 conn(0x55eed308f2e0 msgr2=0x55eed3115f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/166322097 shutdown_connections 2023-10-08T12:44:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.787+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/166322097 wait complete. 2023-10-08T12:44:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.788+0000 7f10f7c1eb80 20 client.25864 trim_cache size 0 max 16384 2023-10-08T12:44:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10f7c1eb80 1 Processor -- start 2023-10-08T12:44:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10f7c1eb80 1 -- start start 2023-10-08T12:44:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed3119f00 0x55eed312c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 0x55eed3120d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 0x55eed3121290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed2eee9a0 con 0x55eed31256d0 2023-10-08T12:44:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed311b150 con 0x55eed311a820 2023-10-08T12:44:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed3112b60 con 0x55eed3119f00 2023-10-08T12:44:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10e279c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 0x55eed3121290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10e1f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed3119f00 0x55eed312c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10e179a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 0x55eed3120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10e1f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed3119f00 0x55eed312c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40932/0 (socket says 172.21.15.59:40932) 2023-10-08T12:44:36.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10e279c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 0x55eed3121290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40226/0 (socket says 172.21.15.59:40226) 2023-10-08T12:44:36.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.807+0000 7f10e1f9b700 1 -- 172.21.15.59:0/3608948321 learned_addr learned my addr 172.21.15.59:0/3608948321 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:36.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.808+0000 7f10e279c700 1 -- 172.21.15.59:0/3608948321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed3119f00 msgr2=0x55eed312c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:36.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.808+0000 7f10e279c700 1 --2- 172.21.15.59:0/3608948321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed3119f00 0x55eed312c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.808+0000 7f10e279c700 1 -- 172.21.15.59:0/3608948321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 msgr2=0x55eed3120d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:36.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.808+0000 7f10e279c700 1 --2- 172.21.15.59:0/3608948321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 0x55eed3120d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.808+0000 7f10e279c700 1 -- 172.21.15.59:0/3608948321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eed2ebf2d0 con 0x55eed31256d0 2023-10-08T12:44:36.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.808+0000 7f10e179a700 1 --2- 172.21.15.59:0/3608948321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 0x55eed3120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:36.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.808+0000 7f10e279c700 1 --2- 172.21.15.59:0/3608948321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 0x55eed3121290 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f10d4007fd0 tx=0x7f10d40046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37bf4dbb024d56d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:36.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.808+0000 7f10d0ff9700 1 -- 172.21.15.59:0/3608948321 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4005a50 con 0x55eed31256d0 2023-10-08T12:44:36.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.808+0000 7f10d0ff9700 1 -- 172.21.15.59:0/3608948321 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d400f040 con 0x55eed31256d0 2023-10-08T12:44:36.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.808+0000 7f10d0ff9700 1 -- 172.21.15.59:0/3608948321 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d40077e0 con 0x55eed31256d0 2023-10-08T12:44:36.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.809+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/3608948321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 msgr2=0x55eed3121290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:36.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.809+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/3608948321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 0x55eed3121290 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f10d4007fd0 tx=0x7f10d40046f0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.809+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/3608948321 shutdown_connections 2023-10-08T12:44:36.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.809+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/3608948321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 0x55eed3121290 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.809+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/3608948321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed3119f00 0x55eed312c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.809+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/3608948321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed311a820 0x55eed3120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.809+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/3608948321 >> 172.21.15.59:0/3608948321 conn(0x55eed308f2e0 msgr2=0x55eed3130970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:36.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.809+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/3608948321 shutdown_connections 2023-10-08T12:44:36.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.809+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/3608948321 wait complete. 2023-10-08T12:44:36.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.810+0000 7f10f7c1eb80 1 -- start start 2023-10-08T12:44:36.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.810+0000 7f10f7c1eb80 1 Processor -- start 2023-10-08T12:44:36.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.810+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed312aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.810+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed311a820 0x55eed312afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.810+0000 7f10f7c1eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 0x55eed312b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed3189130 con 0x55eed31256d0 2023-10-08T12:44:36.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed31892a0 con 0x55eed3119f00 2023-10-08T12:44:36.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10f7c1eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed3189460 con 0x55eed311a820 2023-10-08T12:44:36.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10f7c1eb80 10 client.0 _ll_register_callbacks cb 0x7f10d4003f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:36.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10e1f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed312aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10e1f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed312aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53800/0 (socket says 172.21.15.59:53800) 2023-10-08T12:44:36.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10e1f9b700 1 -- 172.21.15.59:0/1685225005 learned_addr learned my addr 172.21.15.59:0/1685225005 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:36.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10e279c700 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 0x55eed312b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10e179a700 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed311a820 0x55eed312afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10e1f9b700 1 -- 172.21.15.59:0/1685225005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed311a820 msgr2=0x55eed312afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:36.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10e1f9b700 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed311a820 0x55eed312afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10e1f9b700 1 -- 172.21.15.59:0/1685225005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 msgr2=0x55eed312b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:36.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10e1f9b700 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 0x55eed312b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10e1f9b700 1 -- 172.21.15.59:0/1685225005 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eed2e98e60 con 0x55eed3119f00 2023-10-08T12:44:36.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10e1f9b700 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed312aaa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f10d8015000 tx=0x7f10d8009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab15d9f8a2dde803 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:36.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.811+0000 7f10c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:44:36.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.812+0000 7f10c57fa700 1 -- 172.21.15.59:0/1685225005 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8033a10 con 0x55eed3119f00 2023-10-08T12:44:36.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.812+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/1685225005 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10cc09e1b0 con 0x55eed3119f00 2023-10-08T12:44:36.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.812+0000 7f10c57fa700 1 -- 172.21.15.59:0/1685225005 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f10d8033b70 con 0x55eed3119f00 2023-10-08T12:44:36.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.812+0000 7f10c57fa700 1 -- 172.21.15.59:0/1685225005 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10d8033d30 con 0x55eed3119f00 2023-10-08T12:44:36.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.812+0000 7f10f7c1eb80 10 client.25877 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:36.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.812+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/1685225005 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55eed2e81ce0 con 0x55eed3119f00 2023-10-08T12:44:36.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.812+0000 7f10c57fa700 1 -- 172.21.15.59:0/1685225005 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10cc09e1b0 con 0x55eed3119f00 2023-10-08T12:44:36.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.813+0000 7f10c57fa700 1 -- 172.21.15.59:0/1685225005 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f10d803c460 con 0x55eed3119f00 2023-10-08T12:44:36.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.813+0000 7f10f7c1eb80 10 client.25877 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:36.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.813+0000 7f10f7c1eb80 10 client.25877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.813+0000 7f10f7c1eb80 20 client.25877 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.813+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55eed318ace0 0x55eed318d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.813+0000 7f10f7c1eb80 4 client.25877 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:44:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.813+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/1685225005 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55eed3066bb0 con 0x55eed318ace0 2023-10-08T12:44:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.813+0000 7f10e179a700 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55eed318ace0 0x55eed318d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.813+0000 7f10e179a700 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55eed318ace0 0x55eed318d100 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7eb9a44ba0be2c34 server_cookie=aa666df5abe32571 in_seq=0 out_seq=0 2023-10-08T12:44:36.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.813+0000 7f10c57fa700 10 client.25877 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:36.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10c57fa700 1 -- 172.21.15.59:0/1685225005 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55eed3066bb0 con 0x55eed318ace0 2023-10-08T12:44:36.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10c57fa700 10 client.25877 handle_command_reply: tid=0 2023-10-08T12:44:36.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10f7c1eb80 1 client.25877 shutdown 2023-10-08T12:44:36.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/1685225005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 msgr2=0x55eed312aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:36.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed312aaa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f10d8015000 tx=0x7f10d8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/1685225005 shutdown_connections 2023-10-08T12:44:36.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55eed318ace0 0x55eed318d100 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eed3119f00 0x55eed312aaa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eed31256d0 0x55eed312b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10f7c1eb80 1 --2- 172.21.15.59:0/1685225005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eed311a820 0x55eed312afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/1685225005 >> 172.21.15.59:0/1685225005 conn(0x55eed308f2e0 msgr2=0x55eed3120cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:36.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.815+0000 7f10c57fa700 0 client.25877 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:36.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/1685225005 shutdown_connections 2023-10-08T12:44:36.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10f7c1eb80 1 -- 172.21.15.59:0/1685225005 wait complete. 2023-10-08T12:44:36.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10f7c1eb80 20 client.25877 trim_cache size 0 max 16384 2023-10-08T12:44:36.822 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:44:36.822 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:44:36.822 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "bc599c05-7223-4e4c-891a-cf3aed356eec", 2023-10-08T12:44:36.822 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:44:36.822 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:44:36.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10e41ff700 1 -- 172.21.15.59:0/41593650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10c80a15f0 msgr2=0x7f10c80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:36.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10e41ff700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10c80a15f0 0x7f10c80a3ab0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f10d800b2e0 tx=0x7f10d8005fd0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10e41ff700 1 -- 172.21.15.59:0/41593650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10dc073540 msgr2=0x7f10dc1993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:36.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10e41ff700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10dc073540 0x7f10dc1993b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00e9a0 tx=0x7f10cc00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10e41ff700 1 -- 172.21.15.59:0/41593650 shutdown_connections 2023-10-08T12:44:36.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10e41ff700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f10c80a15f0 0x7f10c80a3ab0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10e41ff700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10dc10cf70 0x7f10dc19d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10e41ff700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10dc072c20 0x7f10dc198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10e41ff700 1 --2- 172.21.15.59:0/41593650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10dc073540 0x7f10dc1993b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:36.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.816+0000 7f10e41ff700 1 -- 172.21.15.59:0/41593650 >> 172.21.15.59:0/41593650 conn(0x7f10dc0fc200 msgr2=0x7f10dc0fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:36.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.817+0000 7f10e41ff700 1 -- 172.21.15.59:0/41593650 shutdown_connections 2023-10-08T12:44:36.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:36.817+0000 7f10e41ff700 1 -- 172.21.15.59:0/41593650 wait complete. 2023-10-08T12:44:36.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:44:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.059+0000 7f82cb9ff700 1 -- 172.21.15.59:0/1751532301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4067d40 msgr2=0x7f82c4068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.059+0000 7f82cb9ff700 1 --2- 172.21.15.59:0/1751532301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4067d40 0x7f82c4068120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f82c00098f0 tx=0x7f82c0009c00 comp rx=0 tx=0).stop 2023-10-08T12:44:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.060+0000 7f82cb9ff700 1 -- 172.21.15.59:0/1751532301 shutdown_connections 2023-10-08T12:44:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.060+0000 7f82cb9ff700 1 --2- 172.21.15.59:0/1751532301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4067d40 0x7f82c4068120 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.060+0000 7f82cb9ff700 1 --2- 172.21.15.59:0/1751532301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c4105b30 0x7f82c410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.060+0000 7f82cb9ff700 1 --2- 172.21.15.59:0/1751532301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82c4105170 0x7f82c41055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.060+0000 7f82cb9ff700 1 -- 172.21.15.59:0/1751532301 >> 172.21.15.59:0/1751532301 conn(0x7f82c4076780 msgr2=0x7f82c4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.060+0000 7f82cb9ff700 1 -- 172.21.15.59:0/1751532301 shutdown_connections 2023-10-08T12:44:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.060+0000 7f82cb9ff700 1 -- 172.21.15.59:0/1751532301 wait complete. 2023-10-08T12:44:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.061+0000 7f82cb9ff700 1 Processor -- start 2023-10-08T12:44:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.061+0000 7f82cb9ff700 1 -- start start 2023-10-08T12:44:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.061+0000 7f82cb9ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c4067d40 0x7f82c4198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.061+0000 7f82cb9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82c4105170 0x7f82c41993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.061+0000 7f82cb9ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4105b30 0x7f82c419d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.061+0000 7f82cb9ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c419dd90 con 0x7f82c4067d40 2023-10-08T12:44:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.061+0000 7f82cb9ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c419df00 con 0x7f82c4105b30 2023-10-08T12:44:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.061+0000 7f82cb9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c419e0c0 con 0x7f82c4105170 2023-10-08T12:44:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c979b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c4067d40 0x7f82c4198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c9f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4105b30 0x7f82c419d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c8f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82c4105170 0x7f82c41993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c9f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4105b30 0x7f82c419d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53820/0 (socket says 172.21.15.59:53820) 2023-10-08T12:44:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c9f9c700 1 -- 172.21.15.59:0/211486321 learned_addr learned my addr 172.21.15.59:0/211486321 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c8f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82c4105170 0x7f82c41993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40960/0 (socket says 172.21.15.59:40960) 2023-10-08T12:44:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c979b700 1 -- 172.21.15.59:0/211486321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82c4105170 msgr2=0x7f82c41993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c979b700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82c4105170 0x7f82c41993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c979b700 1 -- 172.21.15.59:0/211486321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4105b30 msgr2=0x7f82c419d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c979b700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4105b30 0x7f82c419d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c979b700 1 -- 172.21.15.59:0/211486321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b4009520 con 0x7f82c4067d40 2023-10-08T12:44:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c9f9c700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4105b30 0x7f82c419d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.062+0000 7f82c979b700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c4067d40 0x7f82c4198e70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009fd0 tx=0x7f82c000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.063+0000 7f82ba7fc700 1 -- 172.21.15.59:0/211486321 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c001c070 con 0x7f82c4067d40 2023-10-08T12:44:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.063+0000 7f82cb9ff700 1 -- 172.21.15.59:0/211486321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc009d00 con 0x7f82c4067d40 2023-10-08T12:44:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.063+0000 7f82ba7fc700 1 -- 172.21.15.59:0/211486321 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82c000ba20 con 0x7f82c4067d40 2023-10-08T12:44:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.063+0000 7f82ba7fc700 1 -- 172.21.15.59:0/211486321 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c00038e0 con 0x7f82c4067d40 2023-10-08T12:44:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.063+0000 7f82cb9ff700 1 -- 172.21.15.59:0/211486321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c0009520 con 0x7f82c4067d40 2023-10-08T12:44:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.066+0000 7f82ba7fc700 1 -- 172.21.15.59:0/211486321 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f82c0020030 con 0x7f82c4067d40 2023-10-08T12:44:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.067+0000 7f82df338b80 1 Processor -- start 2023-10-08T12:44:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82df338b80 1 -- start start 2023-10-08T12:44:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82ba7fc700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82b00a1670 0x7f82b00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82df338b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0dc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82df338b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82df338b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0e7650 0x5627cd0e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82df338b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd045460 con 0x5627cd0dc7a0 2023-10-08T12:44:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82df338b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd036c20 con 0x5627cd0dbe80 2023-10-08T12:44:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82df338b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd034540 con 0x5627cd0e7650 2023-10-08T12:44:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82ba7fc700 1 -- 172.21.15.59:0/211486321 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f82c00cdd30 con 0x7f82c4067d40 2023-10-08T12:44:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82c979b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0dc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82c9f9c700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82b00a1670 0x7f82b00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82c979b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0dc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53834/0 (socket says 172.21.15.59:53834) 2023-10-08T12:44:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82c979b700 1 -- 172.21.15.59:0/77184216 learned_addr learned my addr 172.21.15.59:0/77184216 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82c9f9c700 1 --2- 172.21.15.59:0/77184216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0e7650 0x5627cd0e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.068+0000 7f82c8f9a700 1 --2- 172.21.15.59:0/77184216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.069+0000 7f82c979b700 1 -- 172.21.15.59:0/77184216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0e7650 msgr2=0x5627cd0e9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.069+0000 7f82c979b700 1 --2- 172.21.15.59:0/77184216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0e7650 0x5627cd0e9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.069+0000 7f82c979b700 1 -- 172.21.15.59:0/77184216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0dc7a0 msgr2=0x5627cd0e7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.069+0000 7f82c979b700 1 --2- 172.21.15.59:0/77184216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.069+0000 7f82c979b700 1 -- 172.21.15.59:0/77184216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627cce5ade0 con 0x5627cd0dbe80 2023-10-08T12:44:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.069+0000 7f82c8f9a700 1 --2- 172.21.15.59:0/77184216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.069+0000 7f82c9f9c700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82b00a1670 0x7f82b00a3b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009fd0 tx=0x7f82bc00c910 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.069+0000 7f82c979b700 1 --2- 172.21.15.59:0/77184216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0dc260 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f82c009ad50 tx=0x7f82c009ab90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccaa0568a9ed6c21 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.069+0000 7f82af7fe700 1 -- 172.21.15.59:0/77184216 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c00bfea0 con 0x5627cd0dbe80 2023-10-08T12:44:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.069+0000 7f82af7fe700 1 -- 172.21.15.59:0/77184216 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82c0021380 con 0x5627cd0dbe80 2023-10-08T12:44:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.069+0000 7f82af7fe700 1 -- 172.21.15.59:0/77184216 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c00974d0 con 0x5627cd0dbe80 2023-10-08T12:44:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.070+0000 7f82df338b80 1 -- 172.21.15.59:0/77184216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 msgr2=0x5627cd0dc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.070+0000 7f82df338b80 1 --2- 172.21.15.59:0/77184216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0dc260 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f82c009ad50 tx=0x7f82c009ab90 comp rx=0 tx=0).stop 2023-10-08T12:44:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.070+0000 7f82df338b80 1 -- 172.21.15.59:0/77184216 shutdown_connections 2023-10-08T12:44:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.070+0000 7f82df338b80 1 --2- 172.21.15.59:0/77184216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0dc260 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.070+0000 7f82df338b80 1 --2- 172.21.15.59:0/77184216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0e7650 0x5627cd0e9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.070+0000 7f82df338b80 1 --2- 172.21.15.59:0/77184216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.070+0000 7f82df338b80 1 -- 172.21.15.59:0/77184216 >> 172.21.15.59:0/77184216 conn(0x5627cd051260 msgr2=0x5627cd0d82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:37.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.070+0000 7f82df338b80 1 -- 172.21.15.59:0/77184216 shutdown_connections 2023-10-08T12:44:37.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.070+0000 7f82df338b80 1 -- 172.21.15.59:0/77184216 wait complete. 2023-10-08T12:44:37.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.071+0000 7f82df338b80 1 -- start start 2023-10-08T12:44:37.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.071+0000 7f82df338b80 1 Processor -- start 2023-10-08T12:44:37.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82df338b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82df338b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82df338b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0e7650 0x5627cd0f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82df338b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd02fe30 con 0x5627cd0e7650 2023-10-08T12:44:37.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82df338b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627ccfcc710 con 0x5627cd0dbe80 2023-10-08T12:44:37.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82df338b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627ccfcc3b0 con 0x5627cd0dc7a0 2023-10-08T12:44:37.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82df338b80 10 client.0 _ll_register_callbacks cb 0x5627cce29800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:37.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82c979b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82c979b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0e7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53844/0 (socket says 172.21.15.59:53844) 2023-10-08T12:44:37.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82c979b700 1 -- 172.21.15.59:0/3957807685 learned_addr learned my addr 172.21.15.59:0/3957807685 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:37.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82c8f9a700 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.072+0000 7f82c9f9c700 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0e7650 0x5627cd0f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82c979b700 1 -- 172.21.15.59:0/3957807685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dc7a0 msgr2=0x5627cd0e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:37.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82c979b700 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82c979b700 1 -- 172.21.15.59:0/3957807685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0e7650 msgr2=0x5627cd0f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:37.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82c979b700 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0e7650 0x5627cd0f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82c979b700 1 -- 172.21.15.59:0/3957807685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c0009520 con 0x5627cd0dbe80 2023-10-08T12:44:37.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82c9f9c700 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0e7650 0x5627cd0f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:37.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82c979b700 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0e7a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f82c00972c0 tx=0x7f82c0005e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34d4a3849524cb4a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:37.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82acff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:44:37.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82acff9700 1 -- 172.21.15.59:0/3957807685 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c00bfea0 con 0x5627cd0dbe80 2023-10-08T12:44:37.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82df338b80 1 -- 172.21.15.59:0/3957807685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627ccff7eb0 con 0x5627cd0dbe80 2023-10-08T12:44:37.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82acff9700 1 -- 172.21.15.59:0/3957807685 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f82c009ef10 con 0x5627cd0dbe80 2023-10-08T12:44:37.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82acff9700 1 -- 172.21.15.59:0/3957807685 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82c00cb920 con 0x5627cd0dbe80 2023-10-08T12:44:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82df338b80 10 client.25889 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82df338b80 1 -- 172.21.15.59:0/3957807685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5627cce43c60 con 0x5627cd0dbe80 2023-10-08T12:44:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.073+0000 7f82acff9700 1 -- 172.21.15.59:0/3957807685 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5627ccff7eb0 con 0x5627cd0dbe80 2023-10-08T12:44:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.074+0000 7f82acff9700 1 -- 172.21.15.59:0/3957807685 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f82c009a340 con 0x5627cd0dbe80 2023-10-08T12:44:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.074+0000 7f82df338b80 10 client.25889 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.074+0000 7f82df338b80 10 client.25889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.074+0000 7f82df338b80 20 client.25889 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.074+0000 7f82df338b80 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5627cd0f69d0 0x5627cd0f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.074+0000 7f82df338b80 4 client.25889 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.074+0000 7f82df338b80 1 -- 172.21.15.59:0/3957807685 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627cd028e10 con 0x5627cd0f69d0 2023-10-08T12:44:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.074+0000 7f82c8f9a700 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5627cd0f69d0 0x5627cd0f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.075+0000 7f82c8f9a700 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5627cd0f69d0 0x5627cd0f8df0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a91bcf2f1d11ab3d server_cookie=6e2b4d1e80fc9f91 in_seq=0 out_seq=0 2023-10-08T12:44:37.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.075+0000 7f82acff9700 10 client.25889 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:37.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.075+0000 7f82acff9700 1 -- 172.21.15.59:0/3957807685 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5627cd028e10 con 0x5627cd0f69d0 2023-10-08T12:44:37.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.075+0000 7f82acff9700 10 client.25889 handle_command_reply: tid=0 2023-10-08T12:44:37.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.075+0000 7f82df338b80 1 client.25889 shutdown 2023-10-08T12:44:37.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82df338b80 1 -- 172.21.15.59:0/3957807685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 msgr2=0x5627cd0e7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:37.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82df338b80 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0e7a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f82c00972c0 tx=0x7f82c0005e30 comp rx=0 tx=0).stop 2023-10-08T12:44:37.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82df338b80 1 -- 172.21.15.59:0/3957807685 shutdown_connections 2023-10-08T12:44:37.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82df338b80 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5627cd0f69d0 0x5627cd0f8df0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82df338b80 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0e7a30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82acff9700 0 client.25889 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:37.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82df338b80 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0e7650 0x5627cd0f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82df338b80 1 --2- 172.21.15.59:0/3957807685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82df338b80 1 -- 172.21.15.59:0/3957807685 >> 172.21.15.59:0/3957807685 conn(0x5627cd051260 msgr2=0x5627cd0d7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:37.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82df338b80 1 -- 172.21.15.59:0/3957807685 shutdown_connections 2023-10-08T12:44:37.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82df338b80 1 -- 172.21.15.59:0/3957807685 wait complete. 2023-10-08T12:44:37.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.076+0000 7f82df338b80 20 client.25889 trim_cache size 0 max 16384 2023-10-08T12:44:37.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.094+0000 7f82df338b80 1 Processor -- start 2023-10-08T12:44:37.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.094+0000 7f82df338b80 1 -- start start 2023-10-08T12:44:37.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.094+0000 7f82df338b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0ec970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.094+0000 7f82df338b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.094+0000 7f82df338b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0e7650 0x5627cd0e2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.094+0000 7f82df338b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cceb0920 con 0x5627cd0e7650 2023-10-08T12:44:37.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.094+0000 7f82df338b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd0d9870 con 0x5627cd0dbe80 2023-10-08T12:44:37.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.094+0000 7f82df338b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd0dcb80 con 0x5627cd0dc7a0 2023-10-08T12:44:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c979b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0ec970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c8f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c979b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0ec970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53856/0 (socket says 172.21.15.59:53856) 2023-10-08T12:44:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c8f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40992/0 (socket says 172.21.15.59:40992) 2023-10-08T12:44:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c979b700 1 -- 172.21.15.59:0/2025377104 learned_addr learned my addr 172.21.15.59:0/2025377104 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c9f9c700 1 --2- 172.21.15.59:0/2025377104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0e7650 0x5627cd0e2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c979b700 1 -- 172.21.15.59:0/2025377104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dc7a0 msgr2=0x5627cd0e1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c979b700 1 --2- 172.21.15.59:0/2025377104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c979b700 1 -- 172.21.15.59:0/2025377104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0e7650 msgr2=0x5627cd0e2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c979b700 1 --2- 172.21.15.59:0/2025377104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0e7650 0x5627cd0e2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c979b700 1 -- 172.21.15.59:0/2025377104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627cce81250 con 0x5627cd0dbe80 2023-10-08T12:44:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82c979b700 1 --2- 172.21.15.59:0/2025377104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0ec970 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f82c0000c00 tx=0x7f82c0099370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a802d65a0484bd8b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82affff700 1 -- 172.21.15.59:0/2025377104 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c00bfea0 con 0x5627cd0dbe80 2023-10-08T12:44:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82affff700 1 -- 172.21.15.59:0/2025377104 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82c009b4c0 con 0x5627cd0dbe80 2023-10-08T12:44:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.095+0000 7f82affff700 1 -- 172.21.15.59:0/2025377104 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c009b220 con 0x5627cd0dbe80 2023-10-08T12:44:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.096+0000 7f82df338b80 1 -- 172.21.15.59:0/2025377104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 msgr2=0x5627cd0ec970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.096+0000 7f82df338b80 1 --2- 172.21.15.59:0/2025377104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0ec970 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f82c0000c00 tx=0x7f82c0099370 comp rx=0 tx=0).stop 2023-10-08T12:44:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.096+0000 7f82df338b80 1 -- 172.21.15.59:0/2025377104 shutdown_connections 2023-10-08T12:44:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.096+0000 7f82df338b80 1 --2- 172.21.15.59:0/2025377104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0dbe80 0x5627cd0ec970 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.096+0000 7f82df338b80 1 --2- 172.21.15.59:0/2025377104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0e7650 0x5627cd0e2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.096+0000 7f82df338b80 1 --2- 172.21.15.59:0/2025377104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dc7a0 0x5627cd0e1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.096+0000 7f82df338b80 1 -- 172.21.15.59:0/2025377104 >> 172.21.15.59:0/2025377104 conn(0x5627cd051260 msgr2=0x5627cd0e0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:37.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.096+0000 7f82df338b80 1 -- 172.21.15.59:0/2025377104 shutdown_connections 2023-10-08T12:44:37.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.096+0000 7f82df338b80 1 -- 172.21.15.59:0/2025377104 wait complete. 2023-10-08T12:44:37.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.096+0000 7f82df338b80 1 -- start start 2023-10-08T12:44:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.097+0000 7f82df338b80 1 Processor -- start 2023-10-08T12:44:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.097+0000 7f82df338b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dbe80 0x5627cd0eb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.097+0000 7f82df338b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0dc7a0 0x5627cd0eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.097+0000 7f82df338b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0e7650 0x5627cd0ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.097+0000 7f82df338b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd14a7d0 con 0x5627cd0dc7a0 2023-10-08T12:44:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.097+0000 7f82df338b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd14a910 con 0x5627cd0e7650 2023-10-08T12:44:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.097+0000 7f82df338b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd14aa50 con 0x5627cd0dbe80 2023-10-08T12:44:37.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.097+0000 7f82df338b80 10 client.0 _ll_register_callbacks cb 0x7f82bc00cde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:37.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82c979b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dbe80 0x5627cd0eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82c979b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dbe80 0x5627cd0eb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41002/0 (socket says 172.21.15.59:41002) 2023-10-08T12:44:37.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82c979b700 1 -- 172.21.15.59:0/1552958549 learned_addr learned my addr 172.21.15.59:0/1552958549 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:44:37.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82c8f9a700 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0dc7a0 0x5627cd0eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82c9f9c700 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0e7650 0x5627cd0ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82c979b700 1 -- 172.21.15.59:0/1552958549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0e7650 msgr2=0x5627cd0ebbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:37.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82c979b700 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0e7650 0x5627cd0ebbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82c979b700 1 -- 172.21.15.59:0/1552958549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0dc7a0 msgr2=0x5627cd0eb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:37.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82c979b700 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0dc7a0 0x5627cd0eb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82c979b700 1 -- 172.21.15.59:0/1552958549 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627cce43c60 con 0x5627cd0dbe80 2023-10-08T12:44:37.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82c979b700 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dbe80 0x5627cd0eb170 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f82c009af80 tx=0x7f82c0005e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=147e897caceeca29 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:37.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.098+0000 7f82acff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:44:37.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82acff9700 1 -- 172.21.15.59:0/1552958549 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c009b220 con 0x5627cd0dbe80 2023-10-08T12:44:37.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82acff9700 1 -- 172.21.15.59:0/1552958549 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f82c00a30c0 con 0x5627cd0dbe80 2023-10-08T12:44:37.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82df338b80 1 -- 172.21.15.59:0/1552958549 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82c0021380 con 0x5627cd0dbe80 2023-10-08T12:44:37.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82acff9700 1 -- 172.21.15.59:0/1552958549 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82c009a2b0 con 0x5627cd0dbe80 2023-10-08T12:44:37.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82df338b80 10 client.25888 fetch_fsmap learned FSMap version 20 2023-10-08T12:44:37.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82df338b80 1 -- 172.21.15.59:0/1552958549 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5627cce592b0 con 0x5627cd0dbe80 2023-10-08T12:44:37.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82acff9700 1 -- 172.21.15.59:0/1552958549 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82c0021380 con 0x5627cd0dbe80 2023-10-08T12:44:37.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82acff9700 1 -- 172.21.15.59:0/1552958549 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f82c00c1070 con 0x5627cd0dbe80 2023-10-08T12:44:37.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82df338b80 10 client.25888 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:44:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82df338b80 10 client.25888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82df338b80 20 client.25888 populate_metadata read hostname 'smithi059' 2023-10-08T12:44:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82df338b80 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5627cd14bd20 0x5627cd14e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82df338b80 4 client.25888 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:44:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.099+0000 7f82df338b80 1 -- 172.21.15.59:0/1552958549 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5627cd028b30 con 0x5627cd14bd20 2023-10-08T12:44:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.100+0000 7f82c8f9a700 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5627cd14bd20 0x5627cd14e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.100+0000 7f82c8f9a700 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5627cd14bd20 0x5627cd14e110 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdc5cdf593953af6 server_cookie=905c1d7addb8d62d in_seq=0 out_seq=0 2023-10-08T12:44:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.100+0000 7f82acff9700 10 client.25888 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82acff9700 1 -- 172.21.15.59:0/1552958549 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5627cd028b30 con 0x5627cd14bd20 2023-10-08T12:44:37.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82acff9700 10 client.25888 handle_command_reply: tid=0 2023-10-08T12:44:37.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 1 client.25888 shutdown 2023-10-08T12:44:37.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 1 -- 172.21.15.59:0/1552958549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dbe80 msgr2=0x5627cd0eb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:37.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dbe80 0x5627cd0eb170 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f82c009af80 tx=0x7f82c0005e30 comp rx=0 tx=0).stop 2023-10-08T12:44:37.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 1 -- 172.21.15.59:0/1552958549 shutdown_connections 2023-10-08T12:44:37.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5627cd14bd20 0x5627cd14e110 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5627cd0e7650 0x5627cd0ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627cd0dbe80 0x5627cd0eb170 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 1 --2- 172.21.15.59:0/1552958549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5627cd0dc7a0 0x5627cd0eb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82acff9700 0 client.25888 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:44:37.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 1 -- 172.21.15.59:0/1552958549 >> 172.21.15.59:0/1552958549 conn(0x5627cd051260 msgr2=0x5627cd0d7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:37.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 1 -- 172.21.15.59:0/1552958549 shutdown_connections 2023-10-08T12:44:37.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 1 -- 172.21.15.59:0/1552958549 wait complete. 2023-10-08T12:44:37.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.101+0000 7f82df338b80 20 client.25888 trim_cache size 0 max 16384 2023-10-08T12:44:37.110 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:44:37.110 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:44:37.110 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:44:37.110 INFO:teuthology.orchestra.run.smithi059.stdout: "bc599c05-7223-4e4c-891a-cf3aed356eec": { 2023-10-08T12:44:37.110 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:44:37.111 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "bc599c05-7223-4e4c-891a-cf3aed356eec", 2023-10-08T12:44:37.111 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:44:37.111 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:44:37.111 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:44:37.111 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:44:37.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 -- 172.21.15.59:0/211486321 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82b00a1670 msgr2=0x7f82b00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:37.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82b00a1670 0x7f82b00a3b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009fd0 tx=0x7f82bc00c910 comp rx=0 tx=0).stop 2023-10-08T12:44:37.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 -- 172.21.15.59:0/211486321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c4067d40 msgr2=0x7f82c4198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:37.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c4067d40 0x7f82c4198e70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009fd0 tx=0x7f82c000fa00 comp rx=0 tx=0).stop 2023-10-08T12:44:37.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 -- 172.21.15.59:0/211486321 shutdown_connections 2023-10-08T12:44:37.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82b00a1670 0x7f82b00a3b30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82c4105b30 0x7f82c419d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c4067d40 0x7f82c4198e70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 --2- 172.21.15.59:0/211486321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82c4105170 0x7f82c41993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:37.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 -- 172.21.15.59:0/211486321 >> 172.21.15.59:0/211486321 conn(0x7f82c4076780 msgr2=0x7f82c4100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:37.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 -- 172.21.15.59:0/211486321 shutdown_connections 2023-10-08T12:44:37.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:44:37.102+0000 7f82cb9ff700 1 -- 172.21.15.59:0/211486321 wait complete. 2023-10-08T12:44:37.120 INFO:tasks.cephfs.filesystem:scrub status for tag:bc599c05-7223-4e4c-891a-cf3aed356eec - {'path': '/', 'tag': 'bc599c05-7223-4e4c-891a-cf3aed356eec', 'options': 'recursive,force'} 2023-10-08T12:44:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:36 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:44:37.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:36 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:37.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:36 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:44:37.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:36 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:37.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:36 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:44:37.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:36 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:37.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:36 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:44:37.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:36 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:37.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:36 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:44:37.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:36 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:37.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:36 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:44:37.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:36 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:37.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 344281 14.34 MB/sec execute 8 sec latency 12.769 ms 2023-10-08T12:44:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:37 smithi173 ceph-mon[135182]: pgmap v417: 97 pgs: 97 active+clean; 176 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 303 op/s 2023-10-08T12:44:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:37 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:44:38.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:37 smithi059 ceph-mon[98489]: pgmap v417: 97 pgs: 97 active+clean; 176 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 303 op/s 2023-10-08T12:44:38.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:37 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:44:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:37 smithi092 ceph-mon[134093]: pgmap v417: 97 pgs: 97 active+clean; 176 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 303 op/s 2023-10-08T12:44:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:37 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:44:38.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 346484 13.57 MB/sec execute 9 sec latency 69.410 ms 2023-10-08T12:44:39.503 INFO:tasks.workunit.client.0.smithi059.stdout: 1 348831 13.62 MB/sec execute 10 sec latency 12.776 ms 2023-10-08T12:44:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:39 smithi092 ceph-mon[134093]: pgmap v418: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 256 op/s 2023-10-08T12:44:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:39 smithi173 ceph-mon[135182]: pgmap v418: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 256 op/s 2023-10-08T12:44:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:39 smithi059 ceph-mon[98489]: pgmap v418: 97 pgs: 97 active+clean; 178 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 256 op/s 2023-10-08T12:44:40.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 351879 13.96 MB/sec execute 11 sec latency 5.616 ms 2023-10-08T12:44:41.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 355083 14.36 MB/sec execute 12 sec latency 8.323 ms 2023-10-08T12:44:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:41 smithi173 ceph-mon[135182]: pgmap v419: 97 pgs: 97 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 249 op/s 2023-10-08T12:44:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:41 smithi059 ceph-mon[98489]: pgmap v419: 97 pgs: 97 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 249 op/s 2023-10-08T12:44:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:41 smithi092 ceph-mon[134093]: pgmap v419: 97 pgs: 97 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 249 op/s 2023-10-08T12:44:42.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 357632 14.22 MB/sec execute 13 sec latency 112.034 ms 2023-10-08T12:44:43.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 359416 13.83 MB/sec execute 14 sec latency 99.047 ms 2023-10-08T12:44:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:43 smithi173 ceph-mon[135182]: pgmap v420: 97 pgs: 97 active+clean; 185 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 286 op/s 2023-10-08T12:44:44.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:43 smithi059 ceph-mon[98489]: pgmap v420: 97 pgs: 97 active+clean; 185 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 286 op/s 2023-10-08T12:44:44.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:43 smithi092 ceph-mon[134093]: pgmap v420: 97 pgs: 97 active+clean; 185 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 286 op/s 2023-10-08T12:44:44.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 362257 14.04 MB/sec execute 15 sec latency 25.849 ms 2023-10-08T12:44:45.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 365549 14.34 MB/sec execute 16 sec latency 14.055 ms 2023-10-08T12:44:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:45 smithi173 ceph-mon[135182]: pgmap v421: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 213 op/s 2023-10-08T12:44:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:45 smithi059 ceph-mon[98489]: pgmap v421: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 213 op/s 2023-10-08T12:44:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:45 smithi092 ceph-mon[134093]: pgmap v421: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 213 op/s 2023-10-08T12:44:46.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 368330 14.25 MB/sec execute 17 sec latency 6.603 ms 2023-10-08T12:44:47.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 370505 14.11 MB/sec execute 18 sec latency 75.943 ms 2023-10-08T12:44:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:47 smithi173 ceph-mon[135182]: pgmap v422: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 272 op/s 2023-10-08T12:44:48.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:47 smithi059 ceph-mon[98489]: pgmap v422: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 272 op/s 2023-10-08T12:44:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:47 smithi092 ceph-mon[134093]: pgmap v422: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 272 op/s 2023-10-08T12:44:48.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 373010 14.10 MB/sec execute 19 sec latency 48.153 ms 2023-10-08T12:44:49.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 376093 14.29 MB/sec execute 20 sec latency 63.573 ms 2023-10-08T12:44:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:49 smithi092 ceph-mon[134093]: pgmap v423: 97 pgs: 97 active+clean; 194 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 281 op/s 2023-10-08T12:44:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:49 smithi173 ceph-mon[135182]: pgmap v423: 97 pgs: 97 active+clean; 194 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 281 op/s 2023-10-08T12:44:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:49 smithi059 ceph-mon[98489]: pgmap v423: 97 pgs: 97 active+clean; 194 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 281 op/s 2023-10-08T12:44:50.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 378764 14.20 MB/sec execute 21 sec latency 6.617 ms 2023-10-08T12:44:51.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 381011 14.15 MB/sec execute 22 sec latency 28.741 ms 2023-10-08T12:44:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:51 smithi173 ceph-mon[135182]: pgmap v424: 97 pgs: 97 active+clean; 194 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 278 op/s 2023-10-08T12:44:52.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:51 smithi059 ceph-mon[98489]: pgmap v424: 97 pgs: 97 active+clean; 194 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 278 op/s 2023-10-08T12:44:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:51 smithi092 ceph-mon[134093]: pgmap v424: 97 pgs: 97 active+clean; 194 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 278 op/s 2023-10-08T12:44:52.504 INFO:tasks.workunit.client.0.smithi059.stdout: 1 383550 14.15 MB/sec execute 23 sec latency 86.599 ms 2023-10-08T12:44:53.505 INFO:tasks.workunit.client.0.smithi059.stdout: 1 386681 14.29 MB/sec execute 24 sec latency 7.463 ms 2023-10-08T12:44:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:53 smithi173 ceph-mon[135182]: pgmap v425: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 284 op/s 2023-10-08T12:44:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:53 smithi059 ceph-mon[98489]: pgmap v425: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 284 op/s 2023-10-08T12:44:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:53 smithi092 ceph-mon[134093]: pgmap v425: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 284 op/s 2023-10-08T12:44:54.505 INFO:tasks.workunit.client.0.smithi059.stdout: 1 388380 13.99 MB/sec execute 25 sec latency 56.161 ms 2023-10-08T12:44:55.505 INFO:tasks.workunit.client.0.smithi059.stdout: 1 390918 14.00 MB/sec execute 26 sec latency 74.776 ms 2023-10-08T12:44:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:55 smithi173 ceph-mon[135182]: pgmap v426: 97 pgs: 97 active+clean; 201 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 274 op/s 2023-10-08T12:44:56.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:55 smithi059 ceph-mon[98489]: pgmap v426: 97 pgs: 97 active+clean; 201 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 274 op/s 2023-10-08T12:44:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:55 smithi092 ceph-mon[134093]: pgmap v426: 97 pgs: 97 active+clean; 201 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 274 op/s 2023-10-08T12:44:56.505 INFO:tasks.workunit.client.0.smithi059.stdout: 1 394008 14.17 MB/sec execute 27 sec latency 8.980 ms 2023-10-08T12:44:57.505 INFO:tasks.workunit.client.0.smithi059.stdout: 1 396682 14.12 MB/sec execute 28 sec latency 15.990 ms 2023-10-08T12:44:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:57 smithi173 ceph-mon[135182]: pgmap v427: 97 pgs: 97 active+clean; 202 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 281 op/s 2023-10-08T12:44:58.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:57 smithi059 ceph-mon[98489]: pgmap v427: 97 pgs: 97 active+clean; 202 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 281 op/s 2023-10-08T12:44:58.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:57 smithi092 ceph-mon[134093]: pgmap v427: 97 pgs: 97 active+clean; 202 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 281 op/s 2023-10-08T12:44:58.505 INFO:tasks.workunit.client.0.smithi059.stdout: 1 399001 14.04 MB/sec execute 29 sec latency 9.324 ms 2023-10-08T12:44:59.505 INFO:tasks.workunit.client.0.smithi059.stdout: 1 401391 14.03 MB/sec execute 30 sec latency 81.636 ms 2023-10-08T12:45:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:44:59 smithi092 ceph-mon[134093]: pgmap v428: 97 pgs: 97 active+clean; 207 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 283 op/s 2023-10-08T12:45:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:44:59 smithi173 ceph-mon[135182]: pgmap v428: 97 pgs: 97 active+clean; 207 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 283 op/s 2023-10-08T12:45:00.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:44:59 smithi059 ceph-mon[98489]: pgmap v428: 97 pgs: 97 active+clean; 207 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 283 op/s 2023-10-08T12:45:00.505 INFO:tasks.workunit.client.0.smithi059.stdout: 1 404663 14.19 MB/sec execute 31 sec latency 7.045 ms 2023-10-08T12:45:01.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 406092 13.92 MB/sec execute 32 sec latency 24.662 ms 2023-10-08T12:45:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:01 smithi173 ceph-mon[135182]: pgmap v429: 97 pgs: 97 active+clean; 208 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 261 op/s 2023-10-08T12:45:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:01 smithi059 ceph-mon[98489]: pgmap v429: 97 pgs: 97 active+clean; 208 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 261 op/s 2023-10-08T12:45:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:01 smithi092 ceph-mon[134093]: pgmap v429: 97 pgs: 97 active+clean; 208 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 261 op/s 2023-10-08T12:45:02.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 408749 13.93 MB/sec execute 33 sec latency 29.706 ms 2023-10-08T12:45:03.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 411878 14.07 MB/sec execute 34 sec latency 7.722 ms 2023-10-08T12:45:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:03 smithi173 ceph-mon[135182]: pgmap v430: 97 pgs: 97 active+clean; 214 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 322 op/s 2023-10-08T12:45:04.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:03 smithi059 ceph-mon[98489]: pgmap v430: 97 pgs: 97 active+clean; 214 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 322 op/s 2023-10-08T12:45:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:03 smithi092 ceph-mon[134093]: pgmap v430: 97 pgs: 97 active+clean; 214 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 322 op/s 2023-10-08T12:45:04.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 413050 13.81 MB/sec execute 35 sec latency 299.652 ms 2023-10-08T12:45:05.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 415719 13.82 MB/sec execute 36 sec latency 83.868 ms 2023-10-08T12:45:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:05 smithi173 ceph-mon[135182]: pgmap v431: 97 pgs: 97 active+clean; 214 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 287 op/s 2023-10-08T12:45:06.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:05 smithi059 ceph-mon[98489]: pgmap v431: 97 pgs: 97 active+clean; 214 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 287 op/s 2023-10-08T12:45:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:05 smithi092 ceph-mon[134093]: pgmap v431: 97 pgs: 97 active+clean; 214 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 287 op/s 2023-10-08T12:45:06.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 418901 13.95 MB/sec execute 37 sec latency 8.646 ms 2023-10-08T12:45:07.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:45:07.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.360+0000 7f1bea5ff700 1 -- 172.21.15.59:0/640848951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1be4106750 msgr2=0x7f1be4106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.360+0000 7f1bea5ff700 1 --2- 172.21.15.59:0/640848951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1be4106750 0x7f1be4106b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009990 tx=0x7f1bd4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.360+0000 7f1bea5ff700 1 -- 172.21.15.59:0/640848951 shutdown_connections 2023-10-08T12:45:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.360+0000 7f1bea5ff700 1 --2- 172.21.15.59:0/640848951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1be4106750 0x7f1be4106b30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.360+0000 7f1bea5ff700 1 --2- 172.21.15.59:0/640848951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be4101100 0x7f1be410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.360+0000 7f1bea5ff700 1 --2- 172.21.15.59:0/640848951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be4100740 0x7f1be4100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.360+0000 7f1bea5ff700 1 -- 172.21.15.59:0/640848951 >> 172.21.15.59:0/640848951 conn(0x7f1be40fc230 msgr2=0x7f1be40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.360+0000 7f1bea5ff700 1 -- 172.21.15.59:0/640848951 shutdown_connections 2023-10-08T12:45:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.360+0000 7f1bea5ff700 1 -- 172.21.15.59:0/640848951 wait complete. 2023-10-08T12:45:07.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.361+0000 7f1bea5ff700 1 Processor -- start 2023-10-08T12:45:07.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1bea5ff700 1 -- start start 2023-10-08T12:45:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1bea5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be4100740 0x7f1be419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1bea5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be4101100 0x7f1be419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1bea5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1be4106750 0x7f1be4198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1bea5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be4199330 con 0x7f1be4100740 2023-10-08T12:45:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1bea5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be41994a0 con 0x7f1be4106750 2023-10-08T12:45:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1bea5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be4199660 con 0x7f1be4101100 2023-10-08T12:45:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1be37fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be4101100 0x7f1be419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1be37fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be4101100 0x7f1be419f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:45496/0 (socket says 172.21.15.59:45496) 2023-10-08T12:45:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1be8b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1be4106750 0x7f1be4198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1be37fe700 1 -- 172.21.15.59:0/2787983891 learned_addr learned my addr 172.21.15.59:0/2787983891 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.362+0000 7f1be3fff700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be4100740 0x7f1be419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.363+0000 7f1be37fe700 1 -- 172.21.15.59:0/2787983891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1be4106750 msgr2=0x7f1be4198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.363+0000 7f1be37fe700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1be4106750 0x7f1be4198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.363+0000 7f1be37fe700 1 -- 172.21.15.59:0/2787983891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be4100740 msgr2=0x7f1be419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.363+0000 7f1be37fe700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be4100740 0x7f1be419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.363+0000 7f1be37fe700 1 -- 172.21.15.59:0/2787983891 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40095f0 con 0x7f1be4101100 2023-10-08T12:45:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.363+0000 7f1be37fe700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be4101100 0x7f1be419f000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e9a0 tx=0x7f1bd800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.363+0000 7f1be17fa700 1 -- 172.21.15.59:0/2787983891 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8009790 con 0x7f1be4101100 2023-10-08T12:45:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.363+0000 7f1bea5ff700 1 -- 172.21.15.59:0/2787983891 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be4199940 con 0x7f1be4101100 2023-10-08T12:45:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.363+0000 7f1be17fa700 1 -- 172.21.15.59:0/2787983891 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bd8010430 con 0x7f1be4101100 2023-10-08T12:45:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.363+0000 7f1be17fa700 1 -- 172.21.15.59:0/2787983891 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8018680 con 0x7f1be4101100 2023-10-08T12:45:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.364+0000 7f1bea5ff700 1 -- 172.21.15.59:0/2787983891 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be41a5a90 con 0x7f1be4101100 2023-10-08T12:45:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.368+0000 7f1be17fa700 1 -- 172.21.15.59:0/2787983891 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1bd80105a0 con 0x7f1be4101100 2023-10-08T12:45:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.369+0000 7f1bfdfcab80 1 Processor -- start 2023-10-08T12:45:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.369+0000 7f1bfdfcab80 1 -- start start 2023-10-08T12:45:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559799693e80 0x559799694260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597996947a0 0x55979969f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x5597996a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597995fd460 con 0x5597996947a0 2023-10-08T12:45:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597995eec20 con 0x559799693e80 2023-10-08T12:45:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597995ec540 con 0x55979969f650 2023-10-08T12:45:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be17fa700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bcc0a1670 0x7f1bcc0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be37fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x5597996a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597996947a0 0x55979969f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be8b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559799693e80 0x559799694260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be37fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x5597996a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:45504/0 (socket says 172.21.15.59:45504) 2023-10-08T12:45:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be37fe700 1 -- 172.21.15.59:0/2540351727 learned_addr learned my addr 172.21.15.59:0/2540351727 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be17fa700 1 -- 172.21.15.59:0/2787983891 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1bd8014070 con 0x7f1be4101100 2023-10-08T12:45:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be8b9c700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bcc0a1670 0x7f1bcc0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be37fe700 1 -- 172.21.15.59:0/2540351727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559799693e80 msgr2=0x559799694260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be37fe700 1 --2- 172.21.15.59:0/2540351727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559799693e80 0x559799694260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be37fe700 1 -- 172.21.15.59:0/2540351727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597996947a0 msgr2=0x55979969f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be37fe700 1 --2- 172.21.15.59:0/2540351727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597996947a0 0x55979969f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.370+0000 7f1be37fe700 1 -- 172.21.15.59:0/2540351727 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559799412de0 con 0x55979969f650 2023-10-08T12:45:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.371+0000 7f1be37fe700 1 --2- 172.21.15.59:0/2540351727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x5597996a1a40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e970 tx=0x7f1bd8099d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef5377b5e466843c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.371+0000 7f1bca7fc700 1 -- 172.21.15.59:0/2540351727 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd809a910 con 0x55979969f650 2023-10-08T12:45:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.371+0000 7f1bca7fc700 1 -- 172.21.15.59:0/2540351727 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bd809e120 con 0x55979969f650 2023-10-08T12:45:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.371+0000 7f1bca7fc700 1 -- 172.21.15.59:0/2540351727 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd809a470 con 0x55979969f650 2023-10-08T12:45:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.372+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/2540351727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 msgr2=0x5597996a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.372+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/2540351727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x5597996a1a40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e970 tx=0x7f1bd8099d50 comp rx=0 tx=0).stop 2023-10-08T12:45:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.372+0000 7f1be8b9c700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bcc0a1670 0x7f1bcc0a3b30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009ec0 tx=0x7f1bdc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.372+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/2540351727 shutdown_connections 2023-10-08T12:45:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.372+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/2540351727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559799693e80 0x559799694260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.372+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/2540351727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x5597996a1a40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.372+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/2540351727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597996947a0 0x55979969f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.372+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/2540351727 >> 172.21.15.59:0/2540351727 conn(0x559799609260 msgr2=0x5597996902d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.372+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/2540351727 shutdown_connections 2023-10-08T12:45:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.372+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/2540351727 wait complete. 2023-10-08T12:45:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.373+0000 7f1bfdfcab80 1 -- start start 2023-10-08T12:45:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.373+0000 7f1bfdfcab80 1 Processor -- start 2023-10-08T12:45:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.374+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559799693e80 0x55979969f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.374+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597996947a0 0x55979969c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.374+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55979969f650 0x55979969cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.374+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597995e7e30 con 0x559799693e80 2023-10-08T12:45:07.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.374+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559799584710 con 0x55979969f650 2023-10-08T12:45:07.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.374+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597995843b0 con 0x5597996947a0 2023-10-08T12:45:07.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.374+0000 7f1bfdfcab80 10 client.0 _ll_register_callbacks cb 0x5597993e1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:07.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.374+0000 7f1be37fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597996947a0 0x55979969c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.374+0000 7f1be37fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597996947a0 0x55979969c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:45512/0 (socket says 172.21.15.59:45512) 2023-10-08T12:45:07.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.374+0000 7f1be37fe700 1 -- 172.21.15.59:0/4083930049 learned_addr learned my addr 172.21.15.59:0/4083930049 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:07.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.374+0000 7f1be3fff700 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559799693e80 0x55979969f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1be8b9c700 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55979969f650 0x55979969cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1be37fe700 1 -- 172.21.15.59:0/4083930049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55979969f650 msgr2=0x55979969cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:07.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1be37fe700 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55979969f650 0x55979969cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1be37fe700 1 -- 172.21.15.59:0/4083930049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559799693e80 msgr2=0x55979969f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1be37fe700 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559799693e80 0x55979969f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1be37fe700 1 -- 172.21.15.59:0/4083930049 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be41a5a90 con 0x5597996947a0 2023-10-08T12:45:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1be8b9c700 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55979969f650 0x55979969cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1be37fe700 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597996947a0 0x55979969c370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8096710 tx=0x7f1bd8010ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1f748a03ba887c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1bc37fe700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:45:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1bc37fe700 1 -- 172.21.15.59:0/4083930049 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd809a210 con 0x5597996947a0 2023-10-08T12:45:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1bc37fe700 1 -- 172.21.15.59:0/4083930049 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1bd8099910 con 0x5597996947a0 2023-10-08T12:45:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/4083930049 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597995afeb0 con 0x5597996947a0 2023-10-08T12:45:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1bc37fe700 1 -- 172.21.15.59:0/4083930049 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bd80b82c0 con 0x5597996947a0 2023-10-08T12:45:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1bfdfcab80 10 client.25900 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.375+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/4083930049 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5597993fbc60 con 0x5597996947a0 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.376+0000 7f1bc37fe700 1 -- 172.21.15.59:0/4083930049 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5597995afeb0 con 0x5597996947a0 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.376+0000 7f1bc37fe700 1 -- 172.21.15.59:0/4083930049 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1bd80a2110 con 0x5597996947a0 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.376+0000 7f1bfdfcab80 10 client.25900 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.376+0000 7f1bfdfcab80 10 client.25900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.376+0000 7f1bfdfcab80 20 client.25900 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.376+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5597996b75f0 0x5597996b99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.376+0000 7f1bfdfcab80 4 client.25900 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.376+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/4083930049 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597995e0e10 con 0x5597996b75f0 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.376+0000 7f1be3fff700 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5597996b75f0 0x5597996b99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.377+0000 7f1be3fff700 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5597996b75f0 0x5597996b99e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=188c17d0c8af303f server_cookie=f467baf53aab784d in_seq=0 out_seq=0 2023-10-08T12:45:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.377+0000 7f1bc37fe700 10 client.25900 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.378+0000 7f1bc37fe700 1 -- 172.21.15.59:0/4083930049 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5597995e0e10 con 0x5597996b75f0 2023-10-08T12:45:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.378+0000 7f1bc37fe700 10 client.25900 handle_command_reply: tid=0 2023-10-08T12:45:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.378+0000 7f1bfdfcab80 1 client.25900 shutdown 2023-10-08T12:45:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/4083930049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597996947a0 msgr2=0x55979969c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597996947a0 0x55979969c370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8096710 tx=0x7f1bd8010ab0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/4083930049 shutdown_connections 2023-10-08T12:45:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5597996b75f0 0x5597996b99e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55979969f650 0x55979969cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559799693e80 0x55979969f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bc37fe700 0 client.25900 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/4083930049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597996947a0 0x55979969c370 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/4083930049 >> 172.21.15.59:0/4083930049 conn(0x559799609260 msgr2=0x55979968fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/4083930049 shutdown_connections 2023-10-08T12:45:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/4083930049 wait complete. 2023-10-08T12:45:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.379+0000 7f1bfdfcab80 20 client.25900 trim_cache size 0 max 16384 2023-10-08T12:45:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.398+0000 7f1bfdfcab80 1 Processor -- start 2023-10-08T12:45:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.398+0000 7f1bfdfcab80 1 -- start start 2023-10-08T12:45:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559799693e80 0x5597996aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597996947a0 0x55979969ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x55979969b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559799468920 con 0x5597996947a0 2023-10-08T12:45:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597996910d0 con 0x559799693e80 2023-10-08T12:45:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979969d2f0 con 0x55979969f650 2023-10-08T12:45:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1be3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559799693e80 0x5597996aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1be8b9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x55979969b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1be3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559799693e80 0x5597996aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34544/0 (socket says 172.21.15.59:34544) 2023-10-08T12:45:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1be3fff700 1 -- 172.21.15.59:0/3165823728 learned_addr learned my addr 172.21.15.59:0/3165823728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1be37fe700 1 --2- 172.21.15.59:0/3165823728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597996947a0 0x55979969ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1be8b9c700 1 -- 172.21.15.59:0/3165823728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559799693e80 msgr2=0x5597996aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1be8b9c700 1 --2- 172.21.15.59:0/3165823728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559799693e80 0x5597996aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1be8b9c700 1 -- 172.21.15.59:0/3165823728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597996947a0 msgr2=0x55979969ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1be8b9c700 1 --2- 172.21.15.59:0/3165823728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597996947a0 0x55979969ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.399+0000 7f1be8b9c700 1 -- 172.21.15.59:0/3165823728 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559799439250 con 0x55979969f650 2023-10-08T12:45:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.400+0000 7f1be8b9c700 1 --2- 172.21.15.59:0/3165823728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x55979969b180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc008450 tx=0x7f1bdc011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79fdbd191b1e7b40 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.400+0000 7f1bcaffd700 1 -- 172.21.15.59:0/3165823728 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00e070 con 0x55979969f650 2023-10-08T12:45:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.400+0000 7f1bcaffd700 1 -- 172.21.15.59:0/3165823728 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bdc020050 con 0x55979969f650 2023-10-08T12:45:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.400+0000 7f1bcaffd700 1 -- 172.21.15.59:0/3165823728 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc007640 con 0x55979969f650 2023-10-08T12:45:07.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.401+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3165823728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 msgr2=0x55979969b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.401+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/3165823728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x55979969b180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc008450 tx=0x7f1bdc011000 comp rx=0 tx=0).stop 2023-10-08T12:45:07.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.401+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3165823728 shutdown_connections 2023-10-08T12:45:07.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.401+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/3165823728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559799693e80 0x5597996aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.401+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/3165823728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x55979969b180 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.401+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/3165823728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597996947a0 0x55979969ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.401+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3165823728 >> 172.21.15.59:0/3165823728 conn(0x559799609260 msgr2=0x559799697650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.401+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3165823728 shutdown_connections 2023-10-08T12:45:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.401+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3165823728 wait complete. 2023-10-08T12:45:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.401+0000 7f1bfdfcab80 1 -- start start 2023-10-08T12:45:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1bfdfcab80 1 Processor -- start 2023-10-08T12:45:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559799693e80 0x5597996ad970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597996947a0 0x5597996adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1bfdfcab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x55979970b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597996ae650 con 0x559799693e80 2023-10-08T12:45:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979970b9b0 con 0x5597996947a0 2023-10-08T12:45:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1bfdfcab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979970bb70 con 0x55979969f650 2023-10-08T12:45:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1bfdfcab80 10 client.0 _ll_register_callbacks cb 0x7f1bdc0097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1be37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597996947a0 0x5597996adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1be8b9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x55979970b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1be3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559799693e80 0x5597996ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1be37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597996947a0 0x5597996adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34552/0 (socket says 172.21.15.59:34552) 2023-10-08T12:45:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.402+0000 7f1be8b9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x55979970b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:45524/0 (socket says 172.21.15.59:45524) 2023-10-08T12:45:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1be37fe700 1 -- 172.21.15.59:0/3594976536 learned_addr learned my addr 172.21.15.59:0/3594976536 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1be37fe700 1 -- 172.21.15.59:0/3594976536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 msgr2=0x55979970b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1be37fe700 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x55979970b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1be37fe700 1 -- 172.21.15.59:0/3594976536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559799693e80 msgr2=0x5597996ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1be37fe700 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559799693e80 0x5597996ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1be37fe700 1 -- 172.21.15.59:0/3594976536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bdc008140 con 0x5597996947a0 2023-10-08T12:45:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1be8b9c700 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x55979970b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1be3fff700 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559799693e80 0x5597996ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1be37fe700 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597996947a0 0x5597996adeb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80caf80 tx=0x7f1bd800c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6c7f393a774f40e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1bc37fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:45:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1bc37fe700 1 -- 172.21.15.59:0/3594976536 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd805bea0 con 0x5597996947a0 2023-10-08T12:45:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3594976536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1bd809e120 con 0x5597996947a0 2023-10-08T12:45:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.403+0000 7f1bc37fe700 1 -- 172.21.15.59:0/3594976536 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1bd809a210 con 0x5597996947a0 2023-10-08T12:45:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.404+0000 7f1bc37fe700 1 -- 172.21.15.59:0/3594976536 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bd80a25a0 con 0x5597996947a0 2023-10-08T12:45:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.404+0000 7f1bfdfcab80 10 client.25910 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.404+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3594976536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5597994112b0 con 0x5597996947a0 2023-10-08T12:45:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.404+0000 7f1bc37fe700 1 -- 172.21.15.59:0/3594976536 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bd809e120 con 0x5597996947a0 2023-10-08T12:45:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.404+0000 7f1bc37fe700 1 -- 172.21.15.59:0/3594976536 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1bd809f0a0 con 0x5597996947a0 2023-10-08T12:45:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.404+0000 7f1bfdfcab80 10 client.25910 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.404+0000 7f1bfdfcab80 10 client.25910 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.404+0000 7f1bfdfcab80 20 client.25910 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.404+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55979970cf10 0x55979970f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.404+0000 7f1bfdfcab80 4 client.25910 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:45:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.404+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3594976536 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5597995e0b30 con 0x55979970cf10 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.405+0000 7f1be3fff700 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55979970cf10 0x55979970f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.405+0000 7f1bc37fe700 10 client.25910 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.405+0000 7f1be3fff700 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55979970cf10 0x55979970f300 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3292f55952086f8c server_cookie=55a37755e752df4d in_seq=0 out_seq=0 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.405+0000 7f1bc37fe700 1 -- 172.21.15.59:0/3594976536 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5597995e0b30 con 0x55979970cf10 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.405+0000 7f1bc37fe700 10 client.25910 handle_command_reply: tid=0 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.405+0000 7f1bfdfcab80 1 client.25910 shutdown 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.405+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3594976536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597996947a0 msgr2=0x5597996adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.405+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597996947a0 0x5597996adeb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80caf80 tx=0x7f1bd800c400 comp rx=0 tx=0).stop 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.405+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3594976536 shutdown_connections 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.405+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55979970cf10 0x55979970f300 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55979969f650 0x55979970b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559799693e80 0x5597996ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bfdfcab80 1 --2- 172.21.15.59:0/3594976536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597996947a0 0x5597996adeb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3594976536 >> 172.21.15.59:0/3594976536 conn(0x559799609260 msgr2=0x55979969ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bc37fe700 0 client.25910 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:07.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3594976536 shutdown_connections 2023-10-08T12:45:07.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bfdfcab80 1 -- 172.21.15.59:0/3594976536 wait complete. 2023-10-08T12:45:07.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bfdfcab80 20 client.25910 trim_cache size 0 max 16384 2023-10-08T12:45:07.414 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:45:07.414 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:45:07.414 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:45:07.415 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:45:07.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bea5ff700 1 -- 172.21.15.59:0/2787983891 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bcc0a1670 msgr2=0x7f1bcc0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bea5ff700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bcc0a1670 0x7f1bcc0a3b30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009ec0 tx=0x7f1bdc00b040 comp rx=0 tx=0).stop 2023-10-08T12:45:07.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bea5ff700 1 -- 172.21.15.59:0/2787983891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be4101100 msgr2=0x7f1be419f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bea5ff700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be4101100 0x7f1be419f000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e9a0 tx=0x7f1bd800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bea5ff700 1 -- 172.21.15.59:0/2787983891 shutdown_connections 2023-10-08T12:45:07.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bea5ff700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bcc0a1670 0x7f1bcc0a3b30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bea5ff700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1be4106750 0x7f1be4198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bea5ff700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be4100740 0x7f1be419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.406+0000 7f1bea5ff700 1 --2- 172.21.15.59:0/2787983891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be4101100 0x7f1be419f000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.407+0000 7f1bea5ff700 1 -- 172.21.15.59:0/2787983891 >> 172.21.15.59:0/2787983891 conn(0x7f1be40fc230 msgr2=0x7f1be410bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.407+0000 7f1bea5ff700 1 -- 172.21.15.59:0/2787983891 shutdown_connections 2023-10-08T12:45:07.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.407+0000 7f1bea5ff700 1 -- 172.21.15.59:0/2787983891 wait complete. 2023-10-08T12:45:07.427 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:45:07.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:45:07.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 421555 13.93 MB/sec execute 38 sec latency 22.649 ms 2023-10-08T12:45:07.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.652+0000 7facfe7ff700 1 -- 172.21.15.59:0/4274691228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facf8106640 msgr2=0x7facf8106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.652+0000 7facfe7ff700 1 --2- 172.21.15.59:0/4274691228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facf8106640 0x7facf8106a20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7face8009990 tx=0x7face8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.652+0000 7facfe7ff700 1 -- 172.21.15.59:0/4274691228 shutdown_connections 2023-10-08T12:45:07.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.652+0000 7facfe7ff700 1 --2- 172.21.15.59:0/4274691228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facf8100ff0 0x7facf810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.652+0000 7facfe7ff700 1 --2- 172.21.15.59:0/4274691228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facf8106640 0x7facf8106a20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.652+0000 7facfe7ff700 1 --2- 172.21.15.59:0/4274691228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facf8100630 0x7facf8100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.652+0000 7facfe7ff700 1 -- 172.21.15.59:0/4274691228 >> 172.21.15.59:0/4274691228 conn(0x7facf80fc140 msgr2=0x7facf80fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.652+0000 7facfe7ff700 1 -- 172.21.15.59:0/4274691228 shutdown_connections 2023-10-08T12:45:07.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.653+0000 7facfe7ff700 1 -- 172.21.15.59:0/4274691228 wait complete. 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.653+0000 7facfe7ff700 1 Processor -- start 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facfe7ff700 1 -- start start 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facfe7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facf8100630 0x7facf819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facfe7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facf8100ff0 0x7facf819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facfe7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facf8106640 0x7facf8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facfe7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf81992b0 con 0x7facf8100ff0 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facfe7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf8199420 con 0x7facf8100630 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facfe7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf81995e0 con 0x7facf8106640 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facfcd9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facf8106640 0x7facf8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facf7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facf8100630 0x7facf819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facf77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facf8100ff0 0x7facf819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facfcd9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facf8106640 0x7facf8198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:45540/0 (socket says 172.21.15.59:45540) 2023-10-08T12:45:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.654+0000 7facfcd9c700 1 -- 172.21.15.59:0/752491751 learned_addr learned my addr 172.21.15.59:0/752491751 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.655+0000 7facf7fff700 1 -- 172.21.15.59:0/752491751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facf8106640 msgr2=0x7facf8198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.655+0000 7facf7fff700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facf8106640 0x7facf8198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.655+0000 7facf7fff700 1 -- 172.21.15.59:0/752491751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facf8100ff0 msgr2=0x7facf819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.655+0000 7facf7fff700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facf8100ff0 0x7facf819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.655+0000 7facf7fff700 1 -- 172.21.15.59:0/752491751 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0009c40 con 0x7facf8100630 2023-10-08T12:45:07.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.655+0000 7facf7fff700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facf8100630 0x7facf819ea40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7face8006010 tx=0x7face8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:07.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.655+0000 7facf57fa700 1 -- 172.21.15.59:0/752491751 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face801d070 con 0x7facf8100630 2023-10-08T12:45:07.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.655+0000 7facf57fa700 1 -- 172.21.15.59:0/752491751 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7face8022470 con 0x7facf8100630 2023-10-08T12:45:07.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.655+0000 7facfe7ff700 1 -- 172.21.15.59:0/752491751 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face80095f0 con 0x7facf8100630 2023-10-08T12:45:07.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.655+0000 7facf57fa700 1 -- 172.21.15.59:0/752491751 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8017650 con 0x7facf8100630 2023-10-08T12:45:07.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.656+0000 7facfe7ff700 1 -- 172.21.15.59:0/752491751 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf8199970 con 0x7facf8100630 2023-10-08T12:45:07.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.656+0000 7facfe7ff700 1 -- 172.21.15.59:0/752491751 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf8101d70 con 0x7facf8100630 2023-10-08T12:45:07.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.659+0000 7facf57fa700 1 -- 172.21.15.59:0/752491751 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7face8022890 con 0x7facf8100630 2023-10-08T12:45:07.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.660+0000 7facf57fa700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7face00a1670 0x7face00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.661+0000 7facf57fa700 1 -- 172.21.15.59:0/752491751 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7face80ce340 con 0x7facf8100630 2023-10-08T12:45:07.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.661+0000 7facf77fe700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7face00a1670 0x7face00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.661+0000 7facf77fe700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7face00a1670 0x7face00a3b30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7facf819a250 tx=0x7facec009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:07.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.663+0000 7facf57fa700 1 -- 172.21.15.59:0/752491751 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7face8097790 con 0x7facf8100630 2023-10-08T12:45:07.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.967+0000 7facfe7ff700 1 -- 172.21.15.59:0/752491751 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facf8067450 con 0x7facf8100630 2023-10-08T12:45:07.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.967+0000 7facf57fa700 1 -- 172.21.15.59:0/752491751 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7face8027020 con 0x7facf8100630 2023-10-08T12:45:07.968 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:45:07.969 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:45:07.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.970+0000 7facfe7ff700 1 -- 172.21.15.59:0/752491751 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7face00a1670 msgr2=0x7face00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.970+0000 7facfe7ff700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7face00a1670 0x7face00a3b30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7facf819a250 tx=0x7facec009260 comp rx=0 tx=0).stop 2023-10-08T12:45:07.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.970+0000 7facfe7ff700 1 -- 172.21.15.59:0/752491751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facf8100630 msgr2=0x7facf819ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.970+0000 7facfe7ff700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facf8100630 0x7facf819ea40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7face8006010 tx=0x7face8005740 comp rx=0 tx=0).stop 2023-10-08T12:45:07.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.970+0000 7facfe7ff700 1 -- 172.21.15.59:0/752491751 shutdown_connections 2023-10-08T12:45:07.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.970+0000 7facfe7ff700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7face00a1670 0x7face00a3b30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.971+0000 7facfe7ff700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facf8100630 0x7facf819ea40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.971+0000 7facfe7ff700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facf8106640 0x7facf8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.971+0000 7facfe7ff700 1 --2- 172.21.15.59:0/752491751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facf8100ff0 0x7facf819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.971+0000 7facfe7ff700 1 -- 172.21.15.59:0/752491751 >> 172.21.15.59:0/752491751 conn(0x7facf80fc140 msgr2=0x7facf810be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.971+0000 7facfe7ff700 1 -- 172.21.15.59:0/752491751 shutdown_connections 2023-10-08T12:45:07.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:07.971+0000 7facfe7ff700 1 -- 172.21.15.59:0/752491751 wait complete. 2023-10-08T12:45:07.973 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:45:07.992 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:45:08.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.216+0000 7fbbb1bff700 1 -- 172.21.15.59:0/114465680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbac1010f0 msgr2=0x7fbbac10d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.216+0000 7fbbb1bff700 1 --2- 172.21.15.59:0/114465680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbac1010f0 0x7fbbac10d600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbba400b0a0 tx=0x7fbba400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.217+0000 7fbbb1bff700 1 -- 172.21.15.59:0/114465680 shutdown_connections 2023-10-08T12:45:08.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.217+0000 7fbbb1bff700 1 --2- 172.21.15.59:0/114465680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbac1010f0 0x7fbbac10d600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.217+0000 7fbbb1bff700 1 --2- 172.21.15.59:0/114465680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbac106740 0x7fbbac106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.217+0000 7fbbb1bff700 1 --2- 172.21.15.59:0/114465680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbac100730 0x7fbbac100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.217+0000 7fbbb1bff700 1 -- 172.21.15.59:0/114465680 >> 172.21.15.59:0/114465680 conn(0x7fbbac0fc200 msgr2=0x7fbbac0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.217+0000 7fbbb1bff700 1 -- 172.21.15.59:0/114465680 shutdown_connections 2023-10-08T12:45:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.217+0000 7fbbb1bff700 1 -- 172.21.15.59:0/114465680 wait complete. 2023-10-08T12:45:08.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:07 smithi173 ceph-mon[135182]: pgmap v432: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 306 op/s 2023-10-08T12:45:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.218+0000 7fbbb1bff700 1 Processor -- start 2023-10-08T12:45:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.218+0000 7fbbb1bff700 1 -- start start 2023-10-08T12:45:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.218+0000 7fbbb1bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbac100730 0x7fbbac072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.218+0000 7fbbb1bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbac1010f0 0x7fbbac073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.218+0000 7fbbb1bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbac106740 0x7fbbac073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.218+0000 7fbbb1bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1a4f00 con 0x7fbbac106740 2023-10-08T12:45:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.218+0000 7fbbb1bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1a5070 con 0x7fbbac100730 2023-10-08T12:45:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.218+0000 7fbbb1bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1a5230 con 0x7fbbac1010f0 2023-10-08T12:45:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.218+0000 7fbbab7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbac100730 0x7fbbac072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.219+0000 7fbbab7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbac100730 0x7fbbac072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34584/0 (socket says 172.21.15.59:34584) 2023-10-08T12:45:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.219+0000 7fbbab7fe700 1 -- 172.21.15.59:0/560639796 learned_addr learned my addr 172.21.15.59:0/560639796 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.219+0000 7fbbabfff700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbac106740 0x7fbbac073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.219+0000 7fbbaaffd700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbac1010f0 0x7fbbac073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.219+0000 7fbbab7fe700 1 -- 172.21.15.59:0/560639796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbac1010f0 msgr2=0x7fbbac073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.219+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbac1010f0 0x7fbbac073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.219+0000 7fbbab7fe700 1 -- 172.21.15.59:0/560639796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbac106740 msgr2=0x7fbbac073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.219+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbac106740 0x7fbbac073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.219+0000 7fbbab7fe700 1 -- 172.21.15.59:0/560639796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba0009520 con 0x7fbbac100730 2023-10-08T12:45:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.219+0000 7fbbaaffd700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbac1010f0 0x7fbbac073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.219+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbac100730 0x7fbbac072af0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00e9a0 tx=0x7fbb9c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.220+0000 7fbba8ff9700 1 -- 172.21.15.59:0/560639796 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c009790 con 0x7fbbac100730 2023-10-08T12:45:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.220+0000 7fbba8ff9700 1 -- 172.21.15.59:0/560639796 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb9c00cbd0 con 0x7fbbac100730 2023-10-08T12:45:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.220+0000 7fbbb1bff700 1 -- 172.21.15.59:0/560639796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba4009d00 con 0x7fbbac100730 2023-10-08T12:45:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.220+0000 7fbba8ff9700 1 -- 172.21.15.59:0/560639796 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c018680 con 0x7fbbac100730 2023-10-08T12:45:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.220+0000 7fbbb1bff700 1 -- 172.21.15.59:0/560639796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac1a58e0 con 0x7fbbac100730 2023-10-08T12:45:08.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.224+0000 7fbba8ff9700 1 -- 172.21.15.59:0/560639796 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbb9c00cd40 con 0x7fbbac100730 2023-10-08T12:45:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.226+0000 7fbbc54cfb80 1 Processor -- start 2023-10-08T12:45:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.226+0000 7fbbc54cfb80 1 -- start start 2023-10-08T12:45:08.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.226+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.226+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6c47a0 0x56471c6cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.226+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.227+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c62d460 con 0x56471c6c3e80 2023-10-08T12:45:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.227+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c61ec20 con 0x56471c6cf650 2023-10-08T12:45:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.227+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c61c540 con 0x56471c6c47a0 2023-10-08T12:45:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.227+0000 7fbba8ff9700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb940a1670 0x7fbb940a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.227+0000 7fbba8ff9700 1 -- 172.21.15.59:0/560639796 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbb9c014070 con 0x7fbbac100730 2023-10-08T12:45:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.227+0000 7fbbabfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.227+0000 7fbbaaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.227+0000 7fbbaaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6d1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34594/0 (socket says 172.21.15.59:34594) 2023-10-08T12:45:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.227+0000 7fbbaaffd700 1 -- 172.21.15.59:0/3792323375 learned_addr learned my addr 172.21.15.59:0/3792323375 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.227+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/3792323375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6c47a0 0x56471c6cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.227+0000 7fbbabfff700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb940a1670 0x7fbb940a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.228+0000 7fbbabfff700 1 -- 172.21.15.59:0/3792323375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6c47a0 msgr2=0x56471c6cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.228+0000 7fbbabfff700 1 --2- 172.21.15.59:0/3792323375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6c47a0 0x56471c6cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.228+0000 7fbbabfff700 1 -- 172.21.15.59:0/3792323375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 msgr2=0x56471c6d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.228+0000 7fbbabfff700 1 --2- 172.21.15.59:0/3792323375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6d1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.228+0000 7fbbabfff700 1 -- 172.21.15.59:0/3792323375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56471c442de0 con 0x56471c6c3e80 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.228+0000 7fbbaaffd700 1 --2- 172.21.15.59:0/3792323375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6d1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.228+0000 7fbbabfff700 1 --2- 172.21.15.59:0/3792323375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6c4260 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009fd0 tx=0x7fbba4008fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33bf35cbce36ce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.229+0000 7fbbabfff700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb940a1670 0x7fbb940a3b30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbba401a000 tx=0x7fbba4026000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.229+0000 7fbb91ffb700 1 -- 172.21.15.59:0/3792323375 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400e040 con 0x56471c6c3e80 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.229+0000 7fbb91ffb700 1 -- 172.21.15.59:0/3792323375 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbba40079a0 con 0x56471c6c3e80 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.229+0000 7fbb91ffb700 1 -- 172.21.15.59:0/3792323375 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4005610 con 0x56471c6c3e80 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.230+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/3792323375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 msgr2=0x56471c6c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.230+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/3792323375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6c4260 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009fd0 tx=0x7fbba4008fd0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.230+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/3792323375 shutdown_connections 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.230+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/3792323375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6d1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.230+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/3792323375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6c4260 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.230+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/3792323375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6c47a0 0x56471c6cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.230+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/3792323375 >> 172.21.15.59:0/3792323375 conn(0x56471c639260 msgr2=0x56471c6c02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.231+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/3792323375 shutdown_connections 2023-10-08T12:45:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.231+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/3792323375 wait complete. 2023-10-08T12:45:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.231+0000 7fbbc54cfb80 1 -- start start 2023-10-08T12:45:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.232+0000 7fbbc54cfb80 1 Processor -- start 2023-10-08T12:45:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c6cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6cf650 0x56471c6ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c617e30 con 0x56471c6c3e80 2023-10-08T12:45:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c5b4710 con 0x56471c6c47a0 2023-10-08T12:45:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c5b43b0 con 0x56471c6cf650 2023-10-08T12:45:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbc54cfb80 10 client.0 _ll_register_callbacks cb 0x56471c411800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbaaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c6cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbaaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c6cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34604/0 (socket says 172.21.15.59:34604) 2023-10-08T12:45:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbaaffd700 1 -- 172.21.15.59:0/307032573 learned_addr learned my addr 172.21.15.59:0/307032573 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbabfff700 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6cf650 0x56471c6ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbaaffd700 1 -- 172.21.15.59:0/307032573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6cf650 msgr2=0x56471c6ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:08.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbaaffd700 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6cf650 0x56471c6ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbaaffd700 1 -- 172.21.15.59:0/307032573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 msgr2=0x56471c6cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:08.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbaaffd700 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.233+0000 7fbbaaffd700 1 -- 172.21.15.59:0/307032573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba0009b40 con 0x56471c6c47a0 2023-10-08T12:45:08.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.234+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:08.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.234+0000 7fbbaaffd700 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c6cca00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbba0012d20 tx=0x7fbba0011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1de250107263f693 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.234+0000 7fbb8affd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:45:08.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.234+0000 7fbb8affd700 1 -- 172.21.15.59:0/307032573 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0017070 con 0x56471c6c47a0 2023-10-08T12:45:08.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.234+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/307032573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56471c5dfeb0 con 0x56471c6c47a0 2023-10-08T12:45:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.234+0000 7fbb8affd700 1 -- 172.21.15.59:0/307032573 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbba000f460 con 0x56471c6c47a0 2023-10-08T12:45:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.234+0000 7fbb8affd700 1 -- 172.21.15.59:0/307032573 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbba0011ec0 con 0x56471c6c47a0 2023-10-08T12:45:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.234+0000 7fbbc54cfb80 10 client.25928 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.234+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/307032573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fbbac10df00 con 0x56471c6c47a0 2023-10-08T12:45:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.235+0000 7fbb8affd700 1 -- 172.21.15.59:0/307032573 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56471c5dfeb0 con 0x56471c6c47a0 2023-10-08T12:45:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.235+0000 7fbb8affd700 1 -- 172.21.15.59:0/307032573 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbba001c750 con 0x56471c6c47a0 2023-10-08T12:45:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.235+0000 7fbbc54cfb80 10 client.25928 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.235+0000 7fbbc54cfb80 10 client.25928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.235+0000 7fbbc54cfb80 20 client.25928 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.235+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56471c6e7b40 0x56471c6e9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.236+0000 7fbbc54cfb80 4 client.25928 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:45:08.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.236+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/307032573 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56471c610e10 con 0x56471c6e7b40 2023-10-08T12:45:08.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.236+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56471c6e7b40 0x56471c6e9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.236+0000 7fbb8affd700 10 client.25928 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:08.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.236+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56471c6e7b40 0x56471c6e9f60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44c5f93fafc6d7ff server_cookie=fcca9d69c1229414 in_seq=0 out_seq=0 2023-10-08T12:45:08.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.237+0000 7fbb8affd700 1 -- 172.21.15.59:0/307032573 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56471c610e10 con 0x56471c6e7b40 2023-10-08T12:45:08.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.237+0000 7fbb8affd700 10 client.25928 handle_command_reply: tid=0 2023-10-08T12:45:08.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbbc54cfb80 1 client.25928 shutdown 2023-10-08T12:45:08.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/307032573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 msgr2=0x56471c6cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c6cca00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbba0012d20 tx=0x7fbba0011720 comp rx=0 tx=0).stop 2023-10-08T12:45:08.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/307032573 shutdown_connections 2023-10-08T12:45:08.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56471c6e7b40 0x56471c6e9f60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6cf650 0x56471c6ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/307032573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c6cca00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/307032573 >> 172.21.15.59:0/307032573 conn(0x56471c639260 msgr2=0x56471c6bfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbb8affd700 0 client.25928 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:08.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/307032573 shutdown_connections 2023-10-08T12:45:08.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.238+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/307032573 wait complete. 2023-10-08T12:45:08.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.239+0000 7fbbc54cfb80 20 client.25928 trim_cache size 0 max 16384 2023-10-08T12:45:08.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.253+0000 7fbbc54cfb80 1 Processor -- start 2023-10-08T12:45:08.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.254+0000 7fbbc54cfb80 1 -- start start 2023-10-08T12:45:08.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.254+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.254+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6c47a0 0x56471c6c0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.254+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.254+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c498920 con 0x56471c6c3e80 2023-10-08T12:45:08.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.254+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c6bfb50 con 0x56471c6cf650 2023-10-08T12:45:08.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.254+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c6bcae0 con 0x56471c6c47a0 2023-10-08T12:45:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.254+0000 7fbbabfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.254+0000 7fbbabfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6ee5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34614/0 (socket says 172.21.15.59:34614) 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.254+0000 7fbbabfff700 1 -- 172.21.15.59:0/1053189855 learned_addr learned my addr 172.21.15.59:0/1053189855 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.254+0000 7fbbaaffd700 1 --2- 172.21.15.59:0/1053189855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6c47a0 0x56471c6c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.255+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/1053189855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.255+0000 7fbbabfff700 1 -- 172.21.15.59:0/1053189855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6c47a0 msgr2=0x56471c6c0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.255+0000 7fbbabfff700 1 --2- 172.21.15.59:0/1053189855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6c47a0 0x56471c6c0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.255+0000 7fbbabfff700 1 -- 172.21.15.59:0/1053189855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 msgr2=0x56471c6d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.255+0000 7fbbabfff700 1 --2- 172.21.15.59:0/1053189855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6d1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.255+0000 7fbbabfff700 1 -- 172.21.15.59:0/1053189855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56471c42bc60 con 0x56471c6cf650 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.255+0000 7fbbabfff700 1 --2- 172.21.15.59:0/1053189855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6ee5f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbba40097e0 tx=0x7fbba4009810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=156cd264e11ed7d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.255+0000 7fbb927fc700 1 -- 172.21.15.59:0/1053189855 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4035070 con 0x56471c6cf650 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.255+0000 7fbb927fc700 1 -- 172.21.15.59:0/1053189855 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbba4008d50 con 0x56471c6cf650 2023-10-08T12:45:08.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.255+0000 7fbb927fc700 1 -- 172.21.15.59:0/1053189855 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba40053d0 con 0x56471c6cf650 2023-10-08T12:45:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.256+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/1053189855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 msgr2=0x56471c6ee5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.256+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/1053189855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6ee5f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbba40097e0 tx=0x7fbba4009810 comp rx=0 tx=0).stop 2023-10-08T12:45:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.256+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/1053189855 shutdown_connections 2023-10-08T12:45:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.256+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/1053189855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6cf650 0x56471c6ee5f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.256+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/1053189855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c6d1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.256+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/1053189855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6c47a0 0x56471c6c0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.256+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/1053189855 >> 172.21.15.59:0/1053189855 conn(0x56471c639260 msgr2=0x56471c6bfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.256+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/1053189855 shutdown_connections 2023-10-08T12:45:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.256+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/1053189855 wait complete. 2023-10-08T12:45:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.257+0000 7fbbc54cfb80 1 -- start start 2023-10-08T12:45:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.257+0000 7fbbc54cfb80 1 Processor -- start 2023-10-08T12:45:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.257+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c72f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.257+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c72ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.257+0000 7fbbc54cfb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6cf650 0x56471c733890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.257+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c733e40 con 0x56471c6c3e80 2023-10-08T12:45:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.257+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c733fb0 con 0x56471c6c47a0 2023-10-08T12:45:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbc54cfb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56471c734170 con 0x56471c6cf650 2023-10-08T12:45:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbc54cfb80 10 client.0 _ll_register_callbacks cb 0x7fbba00127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbaaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c72ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbab7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c72f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbaaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c72ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34618/0 (socket says 172.21.15.59:34618) 2023-10-08T12:45:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbaaffd700 1 -- 172.21.15.59:0/2451010747 learned_addr learned my addr 172.21.15.59:0/2451010747 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbabfff700 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6cf650 0x56471c733890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbaaffd700 1 -- 172.21.15.59:0/2451010747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6cf650 msgr2=0x56471c733890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbaaffd700 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6cf650 0x56471c733890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbaaffd700 1 -- 172.21.15.59:0/2451010747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 msgr2=0x56471c72f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbaaffd700 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c72f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbaaffd700 1 -- 172.21.15.59:0/2451010747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba402d070 con 0x56471c6c47a0 2023-10-08T12:45:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c72f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbbaaffd700 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c72ff10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x56471c6bfcf0 tx=0x7fbba0009ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93ee22771e7b3eae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.258+0000 7fbb8affd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:45:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.259+0000 7fbb8affd700 1 -- 172.21.15.59:0/2451010747 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0017040 con 0x56471c6c47a0 2023-10-08T12:45:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.259+0000 7fbb8affd700 1 -- 172.21.15.59:0/2451010747 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbba0000e40 con 0x56471c6c47a0 2023-10-08T12:45:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.259+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/2451010747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56471c610b30 con 0x56471c6c47a0 2023-10-08T12:45:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.259+0000 7fbb8affd700 1 -- 172.21.15.59:0/2451010747 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbba001c900 con 0x56471c6c47a0 2023-10-08T12:45:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.259+0000 7fbbc54cfb80 10 client.25934 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.259+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/2451010747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56471c469250 con 0x56471c6c47a0 2023-10-08T12:45:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.259+0000 7fbb8affd700 1 -- 172.21.15.59:0/2451010747 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbba003b020 con 0x56471c6c47a0 2023-10-08T12:45:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.259+0000 7fbb8affd700 1 -- 172.21.15.59:0/2451010747 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbba002b070 con 0x56471c6c47a0 2023-10-08T12:45:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.259+0000 7fbbc54cfb80 10 client.25934 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.259+0000 7fbbc54cfb80 10 client.25934 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.259+0000 7fbbc54cfb80 20 client.25934 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.260+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56471c73cc40 0x56471c73f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.260+0000 7fbbc54cfb80 4 client.25934 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:45:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.260+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/2451010747 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56471c463f70 con 0x56471c73cc40 2023-10-08T12:45:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.260+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56471c73cc40 0x56471c73f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.260+0000 7fbbab7fe700 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56471c73cc40 0x56471c73f060 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1847f7f7d8ed2d1 server_cookie=433d92a071d58dd1 in_seq=0 out_seq=0 2023-10-08T12:45:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.260+0000 7fbb8affd700 10 client.25934 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:08.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.260+0000 7fbb8affd700 1 -- 172.21.15.59:0/2451010747 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56471c463f70 con 0x56471c73cc40 2023-10-08T12:45:08.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.260+0000 7fbb8affd700 10 client.25934 handle_command_reply: tid=0 2023-10-08T12:45:08.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.260+0000 7fbbc54cfb80 1 client.25934 shutdown 2023-10-08T12:45:08.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/2451010747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 msgr2=0x56471c72ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c72ff10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x56471c6bfcf0 tx=0x7fbba0009ac0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/2451010747 shutdown_connections 2023-10-08T12:45:08.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56471c73cc40 0x56471c73f060 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56471c6cf650 0x56471c733890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56471c6c3e80 0x56471c72f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbbc54cfb80 1 --2- 172.21.15.59:0/2451010747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56471c6c47a0 0x56471c72ff10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbb8affd700 0 client.25934 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/2451010747 >> 172.21.15.59:0/2451010747 conn(0x56471c639260 msgr2=0x56471c6cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/2451010747 shutdown_connections 2023-10-08T12:45:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbbc54cfb80 1 -- 172.21.15.59:0/2451010747 wait complete. 2023-10-08T12:45:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.261+0000 7fbbc54cfb80 20 client.25934 trim_cache size 0 max 16384 2023-10-08T12:45:08.269 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:45:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 -- 172.21.15.59:0/560639796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb940a1670 msgr2=0x7fbb940a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb940a1670 0x7fbb940a3b30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbba401a000 tx=0x7fbba4026000 comp rx=0 tx=0).stop 2023-10-08T12:45:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 -- 172.21.15.59:0/560639796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbac100730 msgr2=0x7fbbac072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbac100730 0x7fbbac072af0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00e9a0 tx=0x7fbb9c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 -- 172.21.15.59:0/560639796 shutdown_connections 2023-10-08T12:45:08.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb940a1670 0x7fbb940a3b30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbac100730 0x7fbbac072af0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbac106740 0x7fbbac073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 --2- 172.21.15.59:0/560639796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbac1010f0 0x7fbbac073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 -- 172.21.15.59:0/560639796 >> 172.21.15.59:0/560639796 conn(0x7fbbac0fc200 msgr2=0x7fbbac0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 -- 172.21.15.59:0/560639796 shutdown_connections 2023-10-08T12:45:08.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:08.262+0000 7fbbb1bff700 1 -- 172.21.15.59:0/560639796 wait complete. 2023-10-08T12:45:08.272 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:07 smithi059 ceph-mon[98489]: pgmap v432: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 306 op/s 2023-10-08T12:45:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:07 smithi092 ceph-mon[134093]: pgmap v432: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 306 op/s 2023-10-08T12:45:08.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 423638 13.87 MB/sec execute 39 sec latency 13.859 ms 2023-10-08T12:45:09.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:08 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/752491751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:45:09.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:08 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/752491751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:45:09.283 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:45:09.283 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:45:09.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:08 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/752491751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:45:09.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 425885 13.86 MB/sec execute 40 sec latency 103.876 ms 2023-10-08T12:45:09.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.540+0000 7f03f19ff700 1 -- 172.21.15.59:0/449011345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03ec072bc0 msgr2=0x7f03ec072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.540+0000 7f03f19ff700 1 --2- 172.21.15.59:0/449011345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03ec072bc0 0x7f03ec072fa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009990 tx=0x7f03dc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.540+0000 7f03f19ff700 1 -- 172.21.15.59:0/449011345 shutdown_connections 2023-10-08T12:45:09.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.540+0000 7f03f19ff700 1 --2- 172.21.15.59:0/449011345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03ec10cfe0 0x7f03ec10f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.540+0000 7f03f19ff700 1 --2- 172.21.15.59:0/449011345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03ec072bc0 0x7f03ec072fa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.540+0000 7f03f19ff700 1 --2- 172.21.15.59:0/449011345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec0734e0 0x7f03ec10caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.540+0000 7f03f19ff700 1 -- 172.21.15.59:0/449011345 >> 172.21.15.59:0/449011345 conn(0x7f03ec0fc230 msgr2=0x7f03ec0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.540+0000 7f03f19ff700 1 -- 172.21.15.59:0/449011345 shutdown_connections 2023-10-08T12:45:09.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.540+0000 7f03f19ff700 1 -- 172.21.15.59:0/449011345 wait complete. 2023-10-08T12:45:09.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.541+0000 7f03f19ff700 1 Processor -- start 2023-10-08T12:45:09.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03f19ff700 1 -- start start 2023-10-08T12:45:09.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03f19ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec072bc0 0x7f03ec198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03f19ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03ec0734e0 0x7f03ec1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03f19ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03ec10cfe0 0x7f03ec19d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03f19ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec19dd80 con 0x7f03ec072bc0 2023-10-08T12:45:09.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03f19ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec19def0 con 0x7f03ec10cfe0 2023-10-08T12:45:09.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03f19ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec19e0b0 con 0x7f03ec0734e0 2023-10-08T12:45:09.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03eaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec072bc0 0x7f03ec198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03eaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec072bc0 0x7f03ec198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37724/0 (socket says 172.21.15.59:37724) 2023-10-08T12:45:09.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03eaffd700 1 -- 172.21.15.59:0/3739057347 learned_addr learned my addr 172.21.15.59:0/3739057347 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:09.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03eb7fe700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03ec10cfe0 0x7f03ec19d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.542+0000 7f03dbfff700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03ec0734e0 0x7f03ec1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.543+0000 7f03eaffd700 1 -- 172.21.15.59:0/3739057347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03ec0734e0 msgr2=0x7f03ec1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.543+0000 7f03eaffd700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03ec0734e0 0x7f03ec1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.543+0000 7f03eaffd700 1 -- 172.21.15.59:0/3739057347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03ec10cfe0 msgr2=0x7f03ec19d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.543+0000 7f03eaffd700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03ec10cfe0 0x7f03ec19d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.543+0000 7f03eaffd700 1 -- 172.21.15.59:0/3739057347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc0095f0 con 0x7f03ec072bc0 2023-10-08T12:45:09.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.543+0000 7f03eb7fe700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03ec10cfe0 0x7f03ec19d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:09.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.543+0000 7f03eaffd700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec072bc0 0x7f03ec198e60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f03dc000c00 tx=0x7f03dc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.543+0000 7f03f09fd700 1 -- 172.21.15.59:0/3739057347 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc01d070 con 0x7f03ec072bc0 2023-10-08T12:45:09.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.544+0000 7f03f09fd700 1 -- 172.21.15.59:0/3739057347 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03dc022470 con 0x7f03ec072bc0 2023-10-08T12:45:09.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.544+0000 7f03f19ff700 1 -- 172.21.15.59:0/3739057347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec19e330 con 0x7f03ec072bc0 2023-10-08T12:45:09.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.544+0000 7f03f09fd700 1 -- 172.21.15.59:0/3739057347 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc017650 con 0x7f03ec072bc0 2023-10-08T12:45:09.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.544+0000 7f03f19ff700 1 -- 172.21.15.59:0/3739057347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec1a5bd0 con 0x7f03ec072bc0 2023-10-08T12:45:09.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.547+0000 7f03f09fd700 1 -- 172.21.15.59:0/3739057347 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f03dc0225e0 con 0x7f03ec072bc0 2023-10-08T12:45:09.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.549+0000 7f04052d7b80 1 Processor -- start 2023-10-08T12:45:09.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.549+0000 7f04052d7b80 1 -- start start 2023-10-08T12:45:09.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.549+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e05f00 0x5572c2e062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.549+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e06820 0x5572c2e11190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.549+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e116d0 0x5572c2e13ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.549+0000 7f04052d7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2d6f4e0 con 0x5572c2e05f00 2023-10-08T12:45:09.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.549+0000 7f04052d7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2d60ca0 con 0x5572c2e116d0 2023-10-08T12:45:09.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f04052d7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2d5e5c0 con 0x5572c2e06820 2023-10-08T12:45:09.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03dbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e116d0 0x5572c2e13ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03f09fd700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03d40a15f0 0x7f03d40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03dbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e116d0 0x5572c2e13ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34654/0 (socket says 172.21.15.59:34654) 2023-10-08T12:45:09.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03dbfff700 1 -- 172.21.15.59:0/3958930847 learned_addr learned my addr 172.21.15.59:0/3958930847 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03eb7fe700 1 --2- 172.21.15.59:0/3958930847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e05f00 0x5572c2e062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03eaffd700 1 --2- 172.21.15.59:0/3958930847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e06820 0x5572c2e11190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03dbfff700 1 -- 172.21.15.59:0/3958930847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e06820 msgr2=0x5572c2e11190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03dbfff700 1 --2- 172.21.15.59:0/3958930847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e06820 0x5572c2e11190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03dbfff700 1 -- 172.21.15.59:0/3958930847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e05f00 msgr2=0x5572c2e062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03f09fd700 1 -- 172.21.15.59:0/3739057347 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f03dc0ce590 con 0x7f03ec072bc0 2023-10-08T12:45:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03dbfff700 1 --2- 172.21.15.59:0/3958930847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e05f00 0x5572c2e062e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03dbfff700 1 -- 172.21.15.59:0/3958930847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572c2b84e60 con 0x5572c2e116d0 2023-10-08T12:45:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03eb7fe700 1 --2- 172.21.15.59:0/3958930847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e05f00 0x5572c2e062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.550+0000 7f03eb7fe700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03d40a15f0 0x7f03d40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.551+0000 7f03dbfff700 1 --2- 172.21.15.59:0/3958930847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e116d0 0x5572c2e13ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009d50 tx=0x7f03e0011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b93aea76310534f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.551+0000 7f03d9ffb700 1 -- 172.21.15.59:0/3958930847 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0019630 con 0x5572c2e116d0 2023-10-08T12:45:09.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.551+0000 7f03d9ffb700 1 -- 172.21.15.59:0/3958930847 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03e0019c50 con 0x5572c2e116d0 2023-10-08T12:45:09.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.551+0000 7f03d9ffb700 1 -- 172.21.15.59:0/3958930847 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e000ebb0 con 0x5572c2e116d0 2023-10-08T12:45:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.552+0000 7f04052d7b80 1 -- 172.21.15.59:0/3958930847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e116d0 msgr2=0x5572c2e13ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.552+0000 7f04052d7b80 1 --2- 172.21.15.59:0/3958930847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e116d0 0x5572c2e13ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009d50 tx=0x7f03e0011720 comp rx=0 tx=0).stop 2023-10-08T12:45:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.552+0000 7f03eb7fe700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03d40a15f0 0x7f03d40a3ab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009fd0 tx=0x7f03e4009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.552+0000 7f04052d7b80 1 -- 172.21.15.59:0/3958930847 shutdown_connections 2023-10-08T12:45:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.552+0000 7f04052d7b80 1 --2- 172.21.15.59:0/3958930847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e116d0 0x5572c2e13ac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.552+0000 7f04052d7b80 1 --2- 172.21.15.59:0/3958930847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e05f00 0x5572c2e062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.552+0000 7f04052d7b80 1 --2- 172.21.15.59:0/3958930847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e06820 0x5572c2e11190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.552+0000 7f04052d7b80 1 -- 172.21.15.59:0/3958930847 >> 172.21.15.59:0/3958930847 conn(0x5572c2d7b2e0 msgr2=0x5572c2e02350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.552+0000 7f04052d7b80 1 -- 172.21.15.59:0/3958930847 shutdown_connections 2023-10-08T12:45:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.552+0000 7f04052d7b80 1 -- 172.21.15.59:0/3958930847 wait complete. 2023-10-08T12:45:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.553+0000 7f04052d7b80 1 -- start start 2023-10-08T12:45:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.553+0000 7f04052d7b80 1 Processor -- start 2023-10-08T12:45:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.553+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 0x5572c2e11030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.553+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 0x5572c2e0e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.553+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e0e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.553+0000 7f04052d7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2d59eb0 con 0x5572c2e116d0 2023-10-08T12:45:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.553+0000 7f04052d7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2cf6790 con 0x5572c2e06820 2023-10-08T12:45:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.553+0000 7f04052d7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2cf6430 con 0x5572c2e05f00 2023-10-08T12:45:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.553+0000 7f04052d7b80 10 client.0 _ll_register_callbacks cb 0x5572c2b53880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03dbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 0x5572c2e0e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03eb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e0e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03dbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 0x5572c2e0e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34668/0 (socket says 172.21.15.59:34668) 2023-10-08T12:45:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03dbfff700 1 -- 172.21.15.59:0/371234444 learned_addr learned my addr 172.21.15.59:0/371234444 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03eaffd700 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 0x5572c2e11030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03dbfff700 1 -- 172.21.15.59:0/371234444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 msgr2=0x5572c2e11030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03dbfff700 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 0x5572c2e11030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03dbfff700 1 -- 172.21.15.59:0/371234444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 msgr2=0x5572c2e0e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03dbfff700 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e0e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03dbfff700 1 -- 172.21.15.59:0/371234444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e0009980 con 0x5572c2e06820 2023-10-08T12:45:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03dbfff700 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 0x5572c2e0e3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f03e0011a70 tx=0x7f03e0005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=377e908bce8e28b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.554+0000 7f03caffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:45:09.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.555+0000 7f03caffd700 1 -- 172.21.15.59:0/371234444 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e000ede0 con 0x5572c2e06820 2023-10-08T12:45:09.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.555+0000 7f04052d7b80 1 -- 172.21.15.59:0/371234444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5572c2d21f30 con 0x5572c2e06820 2023-10-08T12:45:09.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.555+0000 7f03caffd700 1 -- 172.21.15.59:0/371234444 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f03e0019430 con 0x5572c2e06820 2023-10-08T12:45:09.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.555+0000 7f03caffd700 1 -- 172.21.15.59:0/371234444 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03e00195f0 con 0x5572c2e06820 2023-10-08T12:45:09.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.555+0000 7f04052d7b80 10 client.25946 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:09.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.555+0000 7f04052d7b80 1 -- 172.21.15.59:0/371234444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5572c2b6dce0 con 0x5572c2e06820 2023-10-08T12:45:09.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.555+0000 7f03caffd700 1 -- 172.21.15.59:0/371234444 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5572c2d21f30 con 0x5572c2e06820 2023-10-08T12:45:09.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.555+0000 7f03caffd700 1 -- 172.21.15.59:0/371234444 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f03e0004750 con 0x5572c2e06820 2023-10-08T12:45:09.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.556+0000 7f04052d7b80 10 client.25946 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:09.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.556+0000 7f04052d7b80 10 client.25946 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:09.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.556+0000 7f04052d7b80 20 client.25946 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:09.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.556+0000 7f04052d7b80 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572c2e21160 0x5572c2e23580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.556+0000 7f04052d7b80 4 client.25946 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:45:09.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.556+0000 7f04052d7b80 1 -- 172.21.15.59:0/371234444 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5572c2d52e90 con 0x5572c2e21160 2023-10-08T12:45:09.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.556+0000 7f03eaffd700 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572c2e21160 0x5572c2e23580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.556+0000 7f03caffd700 10 client.25946 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.556+0000 7f03eaffd700 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572c2e21160 0x5572c2e23580 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0c73b4f4cf43a20 server_cookie=e5eb181bc34ec86c in_seq=0 out_seq=0 2023-10-08T12:45:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f03caffd700 1 -- 172.21.15.59:0/371234444 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5572c2d52e90 con 0x5572c2e21160 2023-10-08T12:45:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f03caffd700 10 client.25946 handle_command_reply: tid=0 2023-10-08T12:45:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f04052d7b80 1 client.25946 shutdown 2023-10-08T12:45:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f04052d7b80 1 -- 172.21.15.59:0/371234444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 msgr2=0x5572c2e0e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f04052d7b80 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 0x5572c2e0e3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f03e0011a70 tx=0x7f03e0005e00 comp rx=0 tx=0).stop 2023-10-08T12:45:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f04052d7b80 1 -- 172.21.15.59:0/371234444 shutdown_connections 2023-10-08T12:45:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f04052d7b80 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572c2e21160 0x5572c2e23580 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f04052d7b80 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e0e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f04052d7b80 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 0x5572c2e11030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f04052d7b80 1 --2- 172.21.15.59:0/371234444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 0x5572c2e0e3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f03caffd700 0 client.25946 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f04052d7b80 1 -- 172.21.15.59:0/371234444 >> 172.21.15.59:0/371234444 conn(0x5572c2d7b2e0 msgr2=0x5572c2e01f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f04052d7b80 1 -- 172.21.15.59:0/371234444 shutdown_connections 2023-10-08T12:45:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.558+0000 7f04052d7b80 1 -- 172.21.15.59:0/371234444 wait complete. 2023-10-08T12:45:09.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.559+0000 7f04052d7b80 20 client.25946 trim_cache size 0 max 16384 2023-10-08T12:45:09.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.578+0000 7f04052d7b80 1 Processor -- start 2023-10-08T12:45:09.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.578+0000 7f04052d7b80 1 -- start start 2023-10-08T12:45:09.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e05f00 0x5572c2e18220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e06820 0x5572c2e09690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e09bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f04052d7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2bda9a0 con 0x5572c2e116d0 2023-10-08T12:45:09.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f04052d7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2e07150 con 0x5572c2e05f00 2023-10-08T12:45:09.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f04052d7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2dfc5f0 con 0x5572c2e06820 2023-10-08T12:45:09.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f03eaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e05f00 0x5572c2e18220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f03eaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e05f00 0x5572c2e18220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34672/0 (socket says 172.21.15.59:34672) 2023-10-08T12:45:09.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f03eaffd700 1 -- 172.21.15.59:0/241507726 learned_addr learned my addr 172.21.15.59:0/241507726 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:09.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f03dbfff700 1 --2- 172.21.15.59:0/241507726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e06820 0x5572c2e09690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f03eb7fe700 1 --2- 172.21.15.59:0/241507726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e09bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f03eaffd700 1 -- 172.21.15.59:0/241507726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e06820 msgr2=0x5572c2e09690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f03eaffd700 1 --2- 172.21.15.59:0/241507726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e06820 0x5572c2e09690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f03eaffd700 1 -- 172.21.15.59:0/241507726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 msgr2=0x5572c2e09bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f03eaffd700 1 --2- 172.21.15.59:0/241507726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e09bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.579+0000 7f03eaffd700 1 -- 172.21.15.59:0/241507726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572c2bab2d0 con 0x5572c2e05f00 2023-10-08T12:45:09.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.580+0000 7f03eaffd700 1 --2- 172.21.15.59:0/241507726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e05f00 0x5572c2e18220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0981b0 tx=0x7f03dc0b7040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3de1228617f6305 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.580+0000 7f03da7fc700 1 -- 172.21.15.59:0/241507726 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc09b0a0 con 0x5572c2e05f00 2023-10-08T12:45:09.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.580+0000 7f03da7fc700 1 -- 172.21.15.59:0/241507726 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03dc09be40 con 0x5572c2e05f00 2023-10-08T12:45:09.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.580+0000 7f03da7fc700 1 -- 172.21.15.59:0/241507726 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc0228c0 con 0x5572c2e05f00 2023-10-08T12:45:09.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.581+0000 7f04052d7b80 1 -- 172.21.15.59:0/241507726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e05f00 msgr2=0x5572c2e18220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.581+0000 7f04052d7b80 1 --2- 172.21.15.59:0/241507726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e05f00 0x5572c2e18220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0981b0 tx=0x7f03dc0b7040 comp rx=0 tx=0).stop 2023-10-08T12:45:09.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.581+0000 7f04052d7b80 1 -- 172.21.15.59:0/241507726 shutdown_connections 2023-10-08T12:45:09.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.581+0000 7f04052d7b80 1 --2- 172.21.15.59:0/241507726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e05f00 0x5572c2e18220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.581+0000 7f04052d7b80 1 --2- 172.21.15.59:0/241507726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e09bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.581+0000 7f04052d7b80 1 --2- 172.21.15.59:0/241507726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e06820 0x5572c2e09690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.581+0000 7f04052d7b80 1 -- 172.21.15.59:0/241507726 >> 172.21.15.59:0/241507726 conn(0x5572c2d7b2e0 msgr2=0x5572c2e10cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.581+0000 7f04052d7b80 1 -- 172.21.15.59:0/241507726 shutdown_connections 2023-10-08T12:45:09.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.581+0000 7f04052d7b80 1 -- 172.21.15.59:0/241507726 wait complete. 2023-10-08T12:45:09.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.581+0000 7f04052d7b80 1 -- start start 2023-10-08T12:45:09.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.581+0000 7f04052d7b80 1 Processor -- start 2023-10-08T12:45:09.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 0x5572c2e16da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 0x5572c2e172e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f04052d7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e74f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f04052d7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2e17ac0 con 0x5572c2e116d0 2023-10-08T12:45:09.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f04052d7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2e17c30 con 0x5572c2e06820 2023-10-08T12:45:09.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f04052d7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572c2e754f0 con 0x5572c2e05f00 2023-10-08T12:45:09.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f04052d7b80 10 client.0 _ll_register_callbacks cb 0x7f03dc09b510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:09.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f03eaffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 0x5572c2e16da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f03dbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 0x5572c2e172e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f03eaffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 0x5572c2e16da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:45626/0 (socket says 172.21.15.59:45626) 2023-10-08T12:45:09.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f03eaffd700 1 -- 172.21.15.59:0/3448019427 learned_addr learned my addr 172.21.15.59:0/3448019427 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:09.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f03eb7fe700 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e74f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f03dbfff700 1 -- 172.21.15.59:0/3448019427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 msgr2=0x5572c2e16da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f03dbfff700 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 0x5572c2e16da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f03dbfff700 1 -- 172.21.15.59:0/3448019427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 msgr2=0x5572c2e74f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f03dbfff700 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e74f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f03dbfff700 1 -- 172.21.15.59:0/3448019427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec1a5bd0 con 0x5572c2e06820 2023-10-08T12:45:09.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.582+0000 7f03eaffd700 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 0x5572c2e16da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:09.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.583+0000 7f03dbfff700 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 0x5572c2e172e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f03e0000c00 tx=0x7f03e00098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c332fc618402a86 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.583+0000 7f03caffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:45:09.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.583+0000 7f03caffd700 1 -- 172.21.15.59:0/3448019427 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0019430 con 0x5572c2e06820 2023-10-08T12:45:09.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.583+0000 7f04052d7b80 1 -- 172.21.15.59:0/3448019427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f03e0019c50 con 0x5572c2e06820 2023-10-08T12:45:09.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.583+0000 7f03caffd700 1 -- 172.21.15.59:0/3448019427 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f03e0000e40 con 0x5572c2e06820 2023-10-08T12:45:09.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.583+0000 7f03caffd700 1 -- 172.21.15.59:0/3448019427 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03e0019590 con 0x5572c2e06820 2023-10-08T12:45:09.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.583+0000 7f04052d7b80 10 client.25952 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:09.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.583+0000 7f04052d7b80 1 -- 172.21.15.59:0/3448019427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5572c2b83330 con 0x5572c2e06820 2023-10-08T12:45:09.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.584+0000 7f03caffd700 1 -- 172.21.15.59:0/3448019427 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03e0046020 con 0x5572c2e06820 2023-10-08T12:45:09.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.584+0000 7f03caffd700 1 -- 172.21.15.59:0/3448019427 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f03e0004ea0 con 0x5572c2e06820 2023-10-08T12:45:09.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.584+0000 7f04052d7b80 10 client.25952 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:09.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.584+0000 7f04052d7b80 10 client.25952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:09.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.584+0000 7f04052d7b80 20 client.25952 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:09.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.584+0000 7f04052d7b80 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572c2e769e0 0x5572c2e78e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.584+0000 7f04052d7b80 4 client.25952 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:45:09.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.584+0000 7f04052d7b80 1 -- 172.21.15.59:0/3448019427 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5572c2d52bb0 con 0x5572c2e769e0 2023-10-08T12:45:09.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.584+0000 7f03eaffd700 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572c2e769e0 0x5572c2e78e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.584+0000 7f03caffd700 10 client.25952 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:09.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.584+0000 7f03eaffd700 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572c2e769e0 0x5572c2e78e00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=766ddf0cf4e7e27b server_cookie=65cedea649bcfea8 in_seq=0 out_seq=0 2023-10-08T12:45:09.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f03caffd700 1 -- 172.21.15.59:0/3448019427 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5572c2d52bb0 con 0x5572c2e769e0 2023-10-08T12:45:09.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f03caffd700 10 client.25952 handle_command_reply: tid=0 2023-10-08T12:45:09.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f04052d7b80 1 client.25952 shutdown 2023-10-08T12:45:09.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f04052d7b80 1 -- 172.21.15.59:0/3448019427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 msgr2=0x5572c2e172e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f04052d7b80 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 0x5572c2e172e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f03e0000c00 tx=0x7f03e00098e0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f04052d7b80 1 -- 172.21.15.59:0/3448019427 shutdown_connections 2023-10-08T12:45:09.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f04052d7b80 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572c2e769e0 0x5572c2e78e00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f04052d7b80 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c2e116d0 0x5572c2e74f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f03caffd700 0 client.25952 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:09.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f04052d7b80 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572c2e05f00 0x5572c2e16da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f04052d7b80 1 --2- 172.21.15.59:0/3448019427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572c2e06820 0x5572c2e172e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.586+0000 7f04052d7b80 1 -- 172.21.15.59:0/3448019427 >> 172.21.15.59:0/3448019427 conn(0x5572c2d7b2e0 msgr2=0x5572c2e09690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.587+0000 7f04052d7b80 1 -- 172.21.15.59:0/3448019427 shutdown_connections 2023-10-08T12:45:09.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.587+0000 7f04052d7b80 1 -- 172.21.15.59:0/3448019427 wait complete. 2023-10-08T12:45:09.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.587+0000 7f04052d7b80 20 client.25952 trim_cache size 0 max 16384 2023-10-08T12:45:09.592 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:45:09.593 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:45:09.593 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "52078827-8152-4e7e-a2ab-8ebac9be5b57", 2023-10-08T12:45:09.593 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:45:09.593 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:45:09.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.587+0000 7f03f19ff700 1 -- 172.21.15.59:0/3739057347 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03d40a15f0 msgr2=0x7f03d40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.587+0000 7f03f19ff700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03d40a15f0 0x7f03d40a3ab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009fd0 tx=0x7f03e4009040 comp rx=0 tx=0).stop 2023-10-08T12:45:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.587+0000 7f03f19ff700 1 -- 172.21.15.59:0/3739057347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec072bc0 msgr2=0x7f03ec198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.587+0000 7f03f19ff700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec072bc0 0x7f03ec198e60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f03dc000c00 tx=0x7f03dc005740 comp rx=0 tx=0).stop 2023-10-08T12:45:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.588+0000 7f03f19ff700 1 -- 172.21.15.59:0/3739057347 shutdown_connections 2023-10-08T12:45:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.588+0000 7f03f19ff700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f03d40a15f0 0x7f03d40a3ab0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.588+0000 7f03f19ff700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03ec10cfe0 0x7f03ec19d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.588+0000 7f03f19ff700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec072bc0 0x7f03ec198e60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.588+0000 7f03f19ff700 1 --2- 172.21.15.59:0/3739057347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03ec0734e0 0x7f03ec1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.588+0000 7f03f19ff700 1 -- 172.21.15.59:0/3739057347 >> 172.21.15.59:0/3739057347 conn(0x7f03ec0fc230 msgr2=0x7f03ec0fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.588+0000 7f03f19ff700 1 -- 172.21.15.59:0/3739057347 shutdown_connections 2023-10-08T12:45:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.588+0000 7f03f19ff700 1 -- 172.21.15.59:0/3739057347 wait complete. 2023-10-08T12:45:09.608 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:45:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.824+0000 7f78699ff700 1 -- 172.21.15.59:0/268249661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7864100740 msgr2=0x7f7864100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.824+0000 7f78699ff700 1 --2- 172.21.15.59:0/268249661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7864100740 0x7f7864100bc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7858009990 tx=0x7f7858009ca0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.824+0000 7f78699ff700 1 -- 172.21.15.59:0/268249661 shutdown_connections 2023-10-08T12:45:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.824+0000 7f78699ff700 1 --2- 172.21.15.59:0/268249661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7864101100 0x7f786410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.824+0000 7f78699ff700 1 --2- 172.21.15.59:0/268249661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7864106750 0x7f7864106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.824+0000 7f78699ff700 1 --2- 172.21.15.59:0/268249661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7864100740 0x7f7864100bc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.824+0000 7f78699ff700 1 -- 172.21.15.59:0/268249661 >> 172.21.15.59:0/268249661 conn(0x7f78640fc230 msgr2=0x7f78640fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.824+0000 7f78699ff700 1 -- 172.21.15.59:0/268249661 shutdown_connections 2023-10-08T12:45:09.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.824+0000 7f78699ff700 1 -- 172.21.15.59:0/268249661 wait complete. 2023-10-08T12:45:09.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.826+0000 7f78699ff700 1 Processor -- start 2023-10-08T12:45:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.826+0000 7f78699ff700 1 -- start start 2023-10-08T12:45:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.826+0000 7f78699ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7864100740 0x7f7864198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.826+0000 7f78699ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7864101100 0x7f7864199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f78699ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7864106750 0x7f786419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f78699ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786419dce0 con 0x7f7864100740 2023-10-08T12:45:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f78699ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786419de50 con 0x7f7864106750 2023-10-08T12:45:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f78699ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786419e010 con 0x7f7864101100 2023-10-08T12:45:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f7862ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7864100740 0x7f7864198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f78637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7864106750 0x7f786419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f78627fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7864101100 0x7f7864199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f7862ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7864100740 0x7f7864198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37782/0 (socket says 172.21.15.59:37782) 2023-10-08T12:45:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f78637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7864106750 0x7f786419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34692/0 (socket says 172.21.15.59:34692) 2023-10-08T12:45:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f7862ffd700 1 -- 172.21.15.59:0/4187891466 learned_addr learned my addr 172.21.15.59:0/4187891466 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f7862ffd700 1 -- 172.21.15.59:0/4187891466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7864101100 msgr2=0x7f7864199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f7862ffd700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7864101100 0x7f7864199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f7862ffd700 1 -- 172.21.15.59:0/4187891466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7864106750 msgr2=0x7f786419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f7862ffd700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7864106750 0x7f786419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f7862ffd700 1 -- 172.21.15.59:0/4187891466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78580095f0 con 0x7f7864100740 2023-10-08T12:45:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f78627fc700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7864101100 0x7f7864199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.827+0000 7f78637fe700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7864106750 0x7f786419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.828+0000 7f7862ffd700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7864100740 0x7f7864198dc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f785400e9a0 tx=0x7f785400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.828+0000 7f78689fd700 1 -- 172.21.15.59:0/4187891466 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854009790 con 0x7f7864100740 2023-10-08T12:45:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.828+0000 7f78699ff700 1 -- 172.21.15.59:0/4187891466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786419e2f0 con 0x7f7864100740 2023-10-08T12:45:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.828+0000 7f78689fd700 1 -- 172.21.15.59:0/4187891466 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7854010430 con 0x7f7864100740 2023-10-08T12:45:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.828+0000 7f78689fd700 1 -- 172.21.15.59:0/4187891466 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854018680 con 0x7f7864100740 2023-10-08T12:45:09.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.828+0000 7f78699ff700 1 -- 172.21.15.59:0/4187891466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78641a5b30 con 0x7f7864100740 2023-10-08T12:45:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.832+0000 7f78689fd700 1 -- 172.21.15.59:0/4187891466 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f78540105a0 con 0x7f7864100740 2023-10-08T12:45:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.833+0000 7f787d268b80 1 Processor -- start 2023-10-08T12:45:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.833+0000 7f787d268b80 1 -- start start 2023-10-08T12:45:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.833+0000 7f78689fd700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f784c0a15f0 0x7f784c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.833+0000 7f787d268b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b6d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f787d268b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b78110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f78689fd700 1 -- 172.21.15.59:0/4187891466 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7854014070 con 0x7f7864100740 2023-10-08T12:45:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f787d268b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b78650 0x55e753b7aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f787d268b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753ad6460 con 0x55e753b6d7a0 2023-10-08T12:45:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f787d268b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753ac7c20 con 0x55e753b6ce80 2023-10-08T12:45:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f787d268b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753ac5540 con 0x55e753b78650 2023-10-08T12:45:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f78637fe700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f784c0a15f0 0x7f784c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f7862ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b6d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f78627fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b78110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f7862ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b6d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34706/0 (socket says 172.21.15.59:34706) 2023-10-08T12:45:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f7862ffd700 1 -- 172.21.15.59:0/126581314 learned_addr learned my addr 172.21.15.59:0/126581314 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f78637fe700 1 --2- 172.21.15.59:0/126581314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b78650 0x55e753b7aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f7862ffd700 1 -- 172.21.15.59:0/126581314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b78650 msgr2=0x55e753b7aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f7862ffd700 1 --2- 172.21.15.59:0/126581314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b78650 0x55e753b7aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f7862ffd700 1 -- 172.21.15.59:0/126581314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 msgr2=0x55e753b78110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f7862ffd700 1 --2- 172.21.15.59:0/126581314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b78110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.834+0000 7f7862ffd700 1 -- 172.21.15.59:0/126581314 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7538ebde0 con 0x55e753b6ce80 2023-10-08T12:45:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.835+0000 7f78637fe700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f784c0a15f0 0x7f784c0a3ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f785c009ec0 tx=0x7f785c004570 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.835+0000 7f7862ffd700 1 --2- 172.21.15.59:0/126581314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b6d260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7854099f40 tx=0x7f7854099c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5056356f566f29c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.835+0000 7f7849ffb700 1 -- 172.21.15.59:0/126581314 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785409e170 con 0x55e753b6ce80 2023-10-08T12:45:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.835+0000 7f7849ffb700 1 -- 172.21.15.59:0/126581314 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f785409e390 con 0x55e753b6ce80 2023-10-08T12:45:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.835+0000 7f7849ffb700 1 -- 172.21.15.59:0/126581314 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854099730 con 0x55e753b6ce80 2023-10-08T12:45:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.836+0000 7f787d268b80 1 -- 172.21.15.59:0/126581314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 msgr2=0x55e753b6d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.836+0000 7f787d268b80 1 --2- 172.21.15.59:0/126581314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b6d260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7854099f40 tx=0x7f7854099c90 comp rx=0 tx=0).stop 2023-10-08T12:45:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.836+0000 7f787d268b80 1 -- 172.21.15.59:0/126581314 shutdown_connections 2023-10-08T12:45:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.836+0000 7f787d268b80 1 --2- 172.21.15.59:0/126581314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b6d260 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.836+0000 7f787d268b80 1 --2- 172.21.15.59:0/126581314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b78650 0x55e753b7aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.836+0000 7f787d268b80 1 --2- 172.21.15.59:0/126581314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b78110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.836+0000 7f787d268b80 1 -- 172.21.15.59:0/126581314 >> 172.21.15.59:0/126581314 conn(0x55e753ae2260 msgr2=0x55e753b692d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.836+0000 7f787d268b80 1 -- 172.21.15.59:0/126581314 shutdown_connections 2023-10-08T12:45:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.836+0000 7f787d268b80 1 -- 172.21.15.59:0/126581314 wait complete. 2023-10-08T12:45:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.836+0000 7f787d268b80 1 -- start start 2023-10-08T12:45:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f787d268b80 1 Processor -- start 2023-10-08T12:45:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f787d268b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b78090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f787d268b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b75420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f787d268b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b78650 0x55e753b75b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f787d268b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753ac0e30 con 0x55e753b6d7a0 2023-10-08T12:45:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f787d268b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753a5d710 con 0x55e753b6ce80 2023-10-08T12:45:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f787d268b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753a5d3b0 con 0x55e753b78650 2023-10-08T12:45:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f787d268b80 10 client.0 _ll_register_callbacks cb 0x55e7538ba800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f7862ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b78090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f7862ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b78090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34722/0 (socket says 172.21.15.59:34722) 2023-10-08T12:45:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f7862ffd700 1 -- 172.21.15.59:0/80809878 learned_addr learned my addr 172.21.15.59:0/80809878 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.837+0000 7f78627fc700 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b75420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f78637fe700 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b78650 0x55e753b75b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f7862ffd700 1 -- 172.21.15.59:0/80809878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b78650 msgr2=0x55e753b75b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f7862ffd700 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b78650 0x55e753b75b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f7862ffd700 1 -- 172.21.15.59:0/80809878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 msgr2=0x55e753b75420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f7862ffd700 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b75420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f7862ffd700 1 -- 172.21.15.59:0/80809878 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78641a5b30 con 0x55e753b6ce80 2023-10-08T12:45:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f7862ffd700 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b78090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f78540cd1b0 tx=0x7f78540ca9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef15211c6c10ef1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f7842ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:45:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f7842ffd700 1 -- 172.21.15.59:0/80809878 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78540a25d0 con 0x55e753b6ce80 2023-10-08T12:45:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f7842ffd700 1 -- 172.21.15.59:0/80809878 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f78540b6070 con 0x55e753b6ce80 2023-10-08T12:45:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f787d268b80 1 -- 172.21.15.59:0/80809878 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e753a88eb0 con 0x55e753b6ce80 2023-10-08T12:45:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f7842ffd700 1 -- 172.21.15.59:0/80809878 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f785409a6b0 con 0x55e753b6ce80 2023-10-08T12:45:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f787d268b80 10 client.25964 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.838+0000 7f787d268b80 1 -- 172.21.15.59:0/80809878 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e7538d4c60 con 0x55e753b6ce80 2023-10-08T12:45:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.839+0000 7f7842ffd700 1 -- 172.21.15.59:0/80809878 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e753a88eb0 con 0x55e753b6ce80 2023-10-08T12:45:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.839+0000 7f7842ffd700 1 -- 172.21.15.59:0/80809878 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f78540991a0 con 0x55e753b6ce80 2023-10-08T12:45:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.839+0000 7f787d268b80 10 client.25964 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.839+0000 7f787d268b80 10 client.25964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.839+0000 7f787d268b80 20 client.25964 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.839+0000 7f787d268b80 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e753b87d50 0x55e753b8a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.839+0000 7f787d268b80 4 client.25964 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:45:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.839+0000 7f787d268b80 1 -- 172.21.15.59:0/80809878 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e753ab9e10 con 0x55e753b87d50 2023-10-08T12:45:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.839+0000 7f78627fc700 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e753b87d50 0x55e753b8a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.840+0000 7f78627fc700 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e753b87d50 0x55e753b8a140 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63390f8c6174d07d server_cookie=f154b10919169148 in_seq=0 out_seq=0 2023-10-08T12:45:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.840+0000 7f7842ffd700 10 client.25964 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f7842ffd700 1 -- 172.21.15.59:0/80809878 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e753ab9e10 con 0x55e753b87d50 2023-10-08T12:45:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f7842ffd700 10 client.25964 handle_command_reply: tid=0 2023-10-08T12:45:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f787d268b80 1 client.25964 shutdown 2023-10-08T12:45:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f787d268b80 1 -- 172.21.15.59:0/80809878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 msgr2=0x55e753b78090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f787d268b80 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b78090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f78540cd1b0 tx=0x7f78540ca9d0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f787d268b80 1 -- 172.21.15.59:0/80809878 shutdown_connections 2023-10-08T12:45:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f787d268b80 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e753b87d50 0x55e753b8a140 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f787d268b80 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b6ce80 0x55e753b78090 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f787d268b80 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b78650 0x55e753b75b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f7842ffd700 0 client.25964 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f787d268b80 1 --2- 172.21.15.59:0/80809878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b75420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f787d268b80 1 -- 172.21.15.59:0/80809878 >> 172.21.15.59:0/80809878 conn(0x55e753ae2260 msgr2=0x55e753b68ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f787d268b80 1 -- 172.21.15.59:0/80809878 shutdown_connections 2023-10-08T12:45:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.843+0000 7f787d268b80 1 -- 172.21.15.59:0/80809878 wait complete. 2023-10-08T12:45:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.844+0000 7f787d268b80 20 client.25964 trim_cache size 0 max 16384 2023-10-08T12:45:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.863+0000 7f787d268b80 1 Processor -- start 2023-10-08T12:45:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.863+0000 7f787d268b80 1 -- start start 2023-10-08T12:45:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.864+0000 7f787d268b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6ce80 0x55e753b7f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.864+0000 7f787d268b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6d7a0 0x55e753b707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.864+0000 7f787d268b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 0x55e753b68d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.864+0000 7f787d268b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753941920 con 0x55e753b6ce80 2023-10-08T12:45:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.864+0000 7f787d268b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753b68b50 con 0x55e753b78650 2023-10-08T12:45:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.864+0000 7f787d268b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753b76160 con 0x55e753b6d7a0 2023-10-08T12:45:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.864+0000 7f78637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 0x55e753b68d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.864+0000 7f7862ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6ce80 0x55e753b7f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.864+0000 7f78637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 0x55e753b68d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34728/0 (socket says 172.21.15.59:34728) 2023-10-08T12:45:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.864+0000 7f78637fe700 1 -- 172.21.15.59:0/171502646 learned_addr learned my addr 172.21.15.59:0/171502646 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.864+0000 7f78627fc700 1 --2- 172.21.15.59:0/171502646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6d7a0 0x55e753b707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.865+0000 7f78637fe700 1 -- 172.21.15.59:0/171502646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6d7a0 msgr2=0x55e753b707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.865+0000 7f78637fe700 1 --2- 172.21.15.59:0/171502646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6d7a0 0x55e753b707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.865+0000 7f78637fe700 1 -- 172.21.15.59:0/171502646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6ce80 msgr2=0x55e753b7f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.865+0000 7f78637fe700 1 --2- 172.21.15.59:0/171502646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6ce80 0x55e753b7f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.865+0000 7f78637fe700 1 -- 172.21.15.59:0/171502646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e753912250 con 0x55e753b78650 2023-10-08T12:45:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.865+0000 7f78627fc700 1 --2- 172.21.15.59:0/171502646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6d7a0 0x55e753b707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.865+0000 7f7862ffd700 1 --2- 172.21.15.59:0/171502646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6ce80 0x55e753b7f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.865+0000 7f78637fe700 1 --2- 172.21.15.59:0/171502646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 0x55e753b68d20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f785c00e700 tx=0x7f785c01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339d5563ee2d9326 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.865+0000 7f784a7fc700 1 -- 172.21.15.59:0/171502646 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c01a850 con 0x55e753b78650 2023-10-08T12:45:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.865+0000 7f784a7fc700 1 -- 172.21.15.59:0/171502646 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f785c00f040 con 0x55e753b78650 2023-10-08T12:45:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.865+0000 7f784a7fc700 1 -- 172.21.15.59:0/171502646 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c026c50 con 0x55e753b78650 2023-10-08T12:45:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.866+0000 7f787d268b80 1 -- 172.21.15.59:0/171502646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 msgr2=0x55e753b68d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.866+0000 7f787d268b80 1 --2- 172.21.15.59:0/171502646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 0x55e753b68d20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f785c00e700 tx=0x7f785c01f000 comp rx=0 tx=0).stop 2023-10-08T12:45:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.866+0000 7f787d268b80 1 -- 172.21.15.59:0/171502646 shutdown_connections 2023-10-08T12:45:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.866+0000 7f787d268b80 1 --2- 172.21.15.59:0/171502646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 0x55e753b68d20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.866+0000 7f787d268b80 1 --2- 172.21.15.59:0/171502646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6ce80 0x55e753b7f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.866+0000 7f787d268b80 1 --2- 172.21.15.59:0/171502646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6d7a0 0x55e753b707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.866+0000 7f787d268b80 1 -- 172.21.15.59:0/171502646 >> 172.21.15.59:0/171502646 conn(0x55e753ae2260 msgr2=0x55e753b838f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.866+0000 7f787d268b80 1 -- 172.21.15.59:0/171502646 shutdown_connections 2023-10-08T12:45:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.866+0000 7f787d268b80 1 -- 172.21.15.59:0/171502646 wait complete. 2023-10-08T12:45:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.866+0000 7f787d268b80 1 -- start start 2023-10-08T12:45:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f787d268b80 1 Processor -- start 2023-10-08T12:45:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f787d268b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6ce80 0x55e753b7dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f787d268b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b7e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f787d268b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 0x55e753bdbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f787d268b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753b7ebe0 con 0x55e753b6d7a0 2023-10-08T12:45:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f787d268b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753bdc0c0 con 0x55e753b78650 2023-10-08T12:45:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f787d268b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e753bdc200 con 0x55e753b6ce80 2023-10-08T12:45:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f787d268b80 10 client.0 _ll_register_callbacks cb 0x55e7538ba800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f78637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 0x55e753bdbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f7862ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6ce80 0x55e753b7dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f78637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 0x55e753bdbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:34740/0 (socket says 172.21.15.59:34740) 2023-10-08T12:45:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f78637fe700 1 -- 172.21.15.59:0/2765277828 learned_addr learned my addr 172.21.15.59:0/2765277828 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.867+0000 7f78627fc700 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b7e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f7862ffd700 1 -- 172.21.15.59:0/2765277828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 msgr2=0x55e753bdbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f7862ffd700 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 0x55e753bdbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f7862ffd700 1 -- 172.21.15.59:0/2765277828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 msgr2=0x55e753b7e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f7862ffd700 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b7e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f7862ffd700 1 -- 172.21.15.59:0/2765277828 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7538d4c60 con 0x55e753b6ce80 2023-10-08T12:45:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f7862ffd700 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6ce80 0x55e753b7dfe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7854099f40 tx=0x7f785409f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f54b56867511a420 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f7842ffd700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:45:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f7842ffd700 1 -- 172.21.15.59:0/2765277828 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785409a940 con 0x55e753b6ce80 2023-10-08T12:45:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f7842ffd700 1 -- 172.21.15.59:0/2765277828 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f78540b6070 con 0x55e753b6ce80 2023-10-08T12:45:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f787d268b80 1 -- 172.21.15.59:0/2765277828 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f785409e390 con 0x55e753b6ce80 2023-10-08T12:45:09.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f7842ffd700 1 -- 172.21.15.59:0/2765277828 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78540a25d0 con 0x55e753b6ce80 2023-10-08T12:45:09.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f787d268b80 10 client.25966 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:09.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.868+0000 7f787d268b80 1 -- 172.21.15.59:0/2765277828 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e7538ea2b0 con 0x55e753b6ce80 2023-10-08T12:45:09.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.869+0000 7f7842ffd700 1 -- 172.21.15.59:0/2765277828 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78540a6080 con 0x55e753b6ce80 2023-10-08T12:45:09.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.869+0000 7f7842ffd700 1 -- 172.21.15.59:0/2765277828 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f78540a2140 con 0x55e753b6ce80 2023-10-08T12:45:09.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.869+0000 7f787d268b80 10 client.25966 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:09.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.869+0000 7f787d268b80 10 client.25966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:09.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.869+0000 7f787d268b80 20 client.25966 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:09.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.869+0000 7f787d268b80 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e753bdd520 0x55e753bdf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.869+0000 7f787d268b80 4 client.25966 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:45:09.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.869+0000 7f787d268b80 1 -- 172.21.15.59:0/2765277828 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e753ab9b30 con 0x55e753bdd520 2023-10-08T12:45:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.869+0000 7f78627fc700 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e753bdd520 0x55e753bdf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.870+0000 7f7842ffd700 10 client.25966 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.870+0000 7f78627fc700 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e753bdd520 0x55e753bdf910 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdd42bacf1d9be server_cookie=ef772507b067526f in_seq=0 out_seq=0 2023-10-08T12:45:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f7842ffd700 1 -- 172.21.15.59:0/2765277828 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e753ab9b30 con 0x55e753bdd520 2023-10-08T12:45:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f7842ffd700 10 client.25966 handle_command_reply: tid=0 2023-10-08T12:45:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 1 client.25966 shutdown 2023-10-08T12:45:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 1 -- 172.21.15.59:0/2765277828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6ce80 msgr2=0x55e753b7dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6ce80 0x55e753b7dfe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7854099f40 tx=0x7f785409f1f0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 1 -- 172.21.15.59:0/2765277828 shutdown_connections 2023-10-08T12:45:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e753bdd520 0x55e753bdf910 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e753b78650 0x55e753bdbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f7842ffd700 0 client.25966 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e753b6ce80 0x55e753b7dfe0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 1 --2- 172.21.15.59:0/2765277828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e753b6d7a0 0x55e753b7e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 1 -- 172.21.15.59:0/2765277828 >> 172.21.15.59:0/2765277828 conn(0x55e753ae2260 msgr2=0x55e753b707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 1 -- 172.21.15.59:0/2765277828 shutdown_connections 2023-10-08T12:45:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 1 -- 172.21.15.59:0/2765277828 wait complete. 2023-10-08T12:45:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.873+0000 7f787d268b80 20 client.25966 trim_cache size 0 max 16384 2023-10-08T12:45:09.877 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:45:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:45:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:45:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "52078827-8152-4e7e-a2ab-8ebac9be5b57": { 2023-10-08T12:45:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:45:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "52078827-8152-4e7e-a2ab-8ebac9be5b57", 2023-10-08T12:45:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:45:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:45:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:45:09.878 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:45:09.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 -- 172.21.15.59:0/4187891466 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f784c0a15f0 msgr2=0x7f784c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f784c0a15f0 0x7f784c0a3ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f785c009ec0 tx=0x7f785c004570 comp rx=0 tx=0).stop 2023-10-08T12:45:09.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 -- 172.21.15.59:0/4187891466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7864100740 msgr2=0x7f7864198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7864100740 0x7f7864198dc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f785400e9a0 tx=0x7f785400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 -- 172.21.15.59:0/4187891466 shutdown_connections 2023-10-08T12:45:09.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f784c0a15f0 0x7f784c0a3ab0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7864106750 0x7f786419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7864100740 0x7f7864198dc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 --2- 172.21.15.59:0/4187891466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7864101100 0x7f7864199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 -- 172.21.15.59:0/4187891466 >> 172.21.15.59:0/4187891466 conn(0x7f78640fc230 msgr2=0x7f786410bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 -- 172.21.15.59:0/4187891466 shutdown_connections 2023-10-08T12:45:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:09.874+0000 7f78699ff700 1 -- 172.21.15.59:0/4187891466 wait complete. 2023-10-08T12:45:09.894 INFO:tasks.cephfs.filesystem:scrub status for tag:52078827-8152-4e7e-a2ab-8ebac9be5b57 - {'path': '/', 'tag': '52078827-8152-4e7e-a2ab-8ebac9be5b57', 'options': 'recursive,force'} 2023-10-08T12:45:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:09 smithi173 ceph-mon[135182]: pgmap v433: 97 pgs: 97 active+clean; 221 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2023-10-08T12:45:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:09 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:45:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:09 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:09 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:45:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:09 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:10.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:09 smithi059 ceph-mon[98489]: pgmap v433: 97 pgs: 97 active+clean; 221 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2023-10-08T12:45:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:09 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:45:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:09 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:09 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:45:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:09 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:09 smithi092 ceph-mon[134093]: pgmap v433: 97 pgs: 97 active+clean; 221 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2023-10-08T12:45:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:09 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:45:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:09 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:09 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:45:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:09 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:10.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 428441 13.80 MB/sec execute 41 sec latency 13.488 ms 2023-10-08T12:45:11.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 430443 13.72 MB/sec execute 42 sec latency 16.928 ms 2023-10-08T12:45:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:11 smithi173 ceph-mon[135182]: pgmap v434: 97 pgs: 97 active+clean; 227 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 302 op/s 2023-10-08T12:45:12.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:11 smithi059 ceph-mon[98489]: pgmap v434: 97 pgs: 97 active+clean; 227 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 302 op/s 2023-10-08T12:45:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:11 smithi092 ceph-mon[134093]: pgmap v434: 97 pgs: 97 active+clean; 227 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 302 op/s 2023-10-08T12:45:12.506 INFO:tasks.workunit.client.0.smithi059.stdout: 1 433299 13.79 MB/sec execute 43 sec latency 61.797 ms 2023-10-08T12:45:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:12 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:45:13.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:12 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:45:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:12 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:45:13.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 436520 13.91 MB/sec execute 44 sec latency 17.264 ms 2023-10-08T12:45:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:13 smithi173 ceph-mon[135182]: pgmap v435: 97 pgs: 97 active+clean; 227 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 314 op/s 2023-10-08T12:45:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:13 smithi059 ceph-mon[98489]: pgmap v435: 97 pgs: 97 active+clean; 227 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 314 op/s 2023-10-08T12:45:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:13 smithi092 ceph-mon[134093]: pgmap v435: 97 pgs: 97 active+clean; 227 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 314 op/s 2023-10-08T12:45:14.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 438207 13.73 MB/sec execute 45 sec latency 70.898 ms 2023-10-08T12:45:15.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 440845 13.74 MB/sec execute 46 sec latency 6.779 ms 2023-10-08T12:45:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:15 smithi173 ceph-mon[135182]: pgmap v436: 97 pgs: 97 active+clean; 227 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.7 MiB/s wr, 234 op/s 2023-10-08T12:45:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:15 smithi059 ceph-mon[98489]: pgmap v436: 97 pgs: 97 active+clean; 227 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.7 MiB/s wr, 234 op/s 2023-10-08T12:45:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:15 smithi092 ceph-mon[134093]: pgmap v436: 97 pgs: 97 active+clean; 227 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.7 MiB/s wr, 234 op/s 2023-10-08T12:45:16.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 443866 13.84 MB/sec execute 47 sec latency 11.054 ms 2023-10-08T12:45:17.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 446953 13.91 MB/sec execute 48 sec latency 21.025 ms 2023-10-08T12:45:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:17 smithi173 ceph-mon[135182]: pgmap v437: 97 pgs: 97 active+clean; 235 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 291 op/s 2023-10-08T12:45:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:17 smithi059 ceph-mon[98489]: pgmap v437: 97 pgs: 97 active+clean; 235 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 291 op/s 2023-10-08T12:45:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:17 smithi092 ceph-mon[134093]: pgmap v437: 97 pgs: 97 active+clean; 235 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 291 op/s 2023-10-08T12:45:18.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 449342 13.81 MB/sec execute 49 sec latency 75.134 ms 2023-10-08T12:45:19.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 451103 13.77 MB/sec execute 50 sec latency 61.534 ms 2023-10-08T12:45:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:19 smithi092 ceph-mon[134093]: pgmap v438: 97 pgs: 97 active+clean; 239 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 279 op/s 2023-10-08T12:45:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:19 smithi173 ceph-mon[135182]: pgmap v438: 97 pgs: 97 active+clean; 239 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 279 op/s 2023-10-08T12:45:20.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:19 smithi059 ceph-mon[98489]: pgmap v438: 97 pgs: 97 active+clean; 239 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 279 op/s 2023-10-08T12:45:20.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 454188 13.85 MB/sec execute 51 sec latency 82.137 ms 2023-10-08T12:45:21.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 457017 13.85 MB/sec execute 52 sec latency 6.103 ms 2023-10-08T12:45:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:21 smithi173 ceph-mon[135182]: pgmap v439: 97 pgs: 97 active+clean; 239 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 268 op/s 2023-10-08T12:45:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:21 smithi059 ceph-mon[98489]: pgmap v439: 97 pgs: 97 active+clean; 239 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 268 op/s 2023-10-08T12:45:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:21 smithi092 ceph-mon[134093]: pgmap v439: 97 pgs: 97 active+clean; 239 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 268 op/s 2023-10-08T12:45:22.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 458693 13.96 MB/sec execute 53 sec latency 86.842 ms 2023-10-08T12:45:23.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 462104 14.20 MB/sec execute 54 sec latency 7.009 ms 2023-10-08T12:45:24.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:23 smithi173 ceph-mon[135182]: pgmap v440: 97 pgs: 97 active+clean; 244 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 263 op/s 2023-10-08T12:45:24.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:23 smithi059 ceph-mon[98489]: pgmap v440: 97 pgs: 97 active+clean; 244 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 263 op/s 2023-10-08T12:45:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:23 smithi092 ceph-mon[134093]: pgmap v440: 97 pgs: 97 active+clean; 244 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 263 op/s 2023-10-08T12:45:24.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 464238 14.07 MB/sec execute 55 sec latency 77.524 ms 2023-10-08T12:45:25.507 INFO:tasks.workunit.client.0.smithi059.stdout: 1 466610 14.08 MB/sec execute 56 sec latency 8.564 ms 2023-10-08T12:45:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:25 smithi173 ceph-mon[135182]: pgmap v441: 97 pgs: 97 active+clean; 244 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 237 op/s 2023-10-08T12:45:26.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:25 smithi092 ceph-mon[134093]: pgmap v441: 97 pgs: 97 active+clean; 244 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 237 op/s 2023-10-08T12:45:26.444 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:25 smithi059 ceph-mon[98489]: pgmap v441: 97 pgs: 97 active+clean; 244 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 237 op/s 2023-10-08T12:45:26.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 468807 14.05 MB/sec execute 57 sec latency 318.056 ms 2023-10-08T12:45:27.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 471366 14.01 MB/sec execute 58 sec latency 7.494 ms 2023-10-08T12:45:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:27 smithi173 ceph-mon[135182]: pgmap v442: 97 pgs: 97 active+clean; 250 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 312 op/s 2023-10-08T12:45:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:27 smithi059 ceph-mon[98489]: pgmap v442: 97 pgs: 97 active+clean; 250 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 312 op/s 2023-10-08T12:45:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:27 smithi092 ceph-mon[134093]: pgmap v442: 97 pgs: 97 active+clean; 250 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 312 op/s 2023-10-08T12:45:28.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 473611 14.01 MB/sec execute 59 sec latency 11.311 ms 2023-10-08T12:45:29.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 476386 14.06 MB/sec execute 60 sec latency 86.294 ms 2023-10-08T12:45:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:29 smithi092 ceph-mon[134093]: pgmap v443: 97 pgs: 97 active+clean; 250 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 249 op/s 2023-10-08T12:45:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:29 smithi173 ceph-mon[135182]: pgmap v443: 97 pgs: 97 active+clean; 250 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 249 op/s 2023-10-08T12:45:30.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:29 smithi059 ceph-mon[98489]: pgmap v443: 97 pgs: 97 active+clean; 250 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 249 op/s 2023-10-08T12:45:30.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 478710 13.96 MB/sec execute 61 sec latency 48.751 ms 2023-10-08T12:45:31.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 480649 13.93 MB/sec execute 62 sec latency 74.380 ms 2023-10-08T12:45:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:31 smithi173 ceph-mon[135182]: pgmap v444: 97 pgs: 97 active+clean; 259 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 240 op/s 2023-10-08T12:45:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:31 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:45:32.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:31 smithi059 ceph-mon[98489]: pgmap v444: 97 pgs: 97 active+clean; 259 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 240 op/s 2023-10-08T12:45:32.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:31 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:45:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:31 smithi092 ceph-mon[134093]: pgmap v444: 97 pgs: 97 active+clean; 259 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 240 op/s 2023-10-08T12:45:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:31 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:45:32.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 483666 14.00 MB/sec execute 63 sec latency 13.036 ms 2023-10-08T12:45:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:32 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:45:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:32 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:45:33.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:32 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:45:33.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:32 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:45:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:32 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:45:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:32 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:45:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:32 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:45:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:32 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:45:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:32 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:45:33.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 486970 14.08 MB/sec execute 64 sec latency 7.095 ms 2023-10-08T12:45:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:34 smithi092 ceph-mon[134093]: pgmap v445: 97 pgs: 97 active+clean; 264 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 283 op/s 2023-10-08T12:45:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:34 smithi173 ceph-mon[135182]: pgmap v445: 97 pgs: 97 active+clean; 264 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 283 op/s 2023-10-08T12:45:34.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 489259 13.98 MB/sec execute 65 sec latency 37.662 ms 2023-10-08T12:45:34.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:34 smithi059 ceph-mon[98489]: pgmap v445: 97 pgs: 97 active+clean; 264 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 283 op/s 2023-10-08T12:45:35.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 491434 13.97 MB/sec execute 66 sec latency 52.482 ms 2023-10-08T12:45:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:36 smithi092 ceph-mon[134093]: pgmap v446: 97 pgs: 97 active+clean; 262 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 225 op/s 2023-10-08T12:45:36.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:36 smithi173 ceph-mon[135182]: pgmap v446: 97 pgs: 97 active+clean; 262 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 225 op/s 2023-10-08T12:45:36.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 494139 14.02 MB/sec execute 67 sec latency 95.377 ms 2023-10-08T12:45:36.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:36 smithi059 ceph-mon[98489]: pgmap v446: 97 pgs: 97 active+clean; 262 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 225 op/s 2023-10-08T12:45:37.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 496860 14.00 MB/sec execute 68 sec latency 6.783 ms 2023-10-08T12:45:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:38 smithi092 ceph-mon[134093]: pgmap v447: 97 pgs: 97 active+clean; 265 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 272 op/s 2023-10-08T12:45:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:38 smithi173 ceph-mon[135182]: pgmap v447: 97 pgs: 97 active+clean; 265 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 272 op/s 2023-10-08T12:45:38.508 INFO:tasks.workunit.client.0.smithi059.stdout: 1 499395 13.97 MB/sec execute 69 sec latency 8.480 ms 2023-10-08T12:45:38.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:38 smithi059 ceph-mon[98489]: pgmap v447: 97 pgs: 97 active+clean; 265 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 272 op/s 2023-10-08T12:45:39.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 501815 13.97 MB/sec execute 70 sec latency 10.134 ms 2023-10-08T12:45:39.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:45:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:39 smithi092 ceph-mon[134093]: pgmap v448: 97 pgs: 97 active+clean; 269 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 238 op/s 2023-10-08T12:45:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.127+0000 7f15c319d700 1 -- 172.21.15.59:0/2642865983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15bc100f60 msgr2=0x7f15bc10d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.127+0000 7f15c319d700 1 --2- 172.21.15.59:0/2642865983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15bc100f60 0x7f15bc10d420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009fc0 tx=0x7f15b400b330 comp rx=0 tx=0).stop 2023-10-08T12:45:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.127+0000 7f15c319d700 1 -- 172.21.15.59:0/2642865983 shutdown_connections 2023-10-08T12:45:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.127+0000 7f15c319d700 1 --2- 172.21.15.59:0/2642865983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15bc100f60 0x7f15bc10d420 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.127+0000 7f15c319d700 1 --2- 172.21.15.59:0/2642865983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15bc106660 0x7f15bc106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.127+0000 7f15c319d700 1 --2- 172.21.15.59:0/2642865983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15bc1005a0 0x7f15bc100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.127+0000 7f15c319d700 1 -- 172.21.15.59:0/2642865983 >> 172.21.15.59:0/2642865983 conn(0x7f15bc0fc090 msgr2=0x7f15bc0fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.127+0000 7f15c319d700 1 -- 172.21.15.59:0/2642865983 shutdown_connections 2023-10-08T12:45:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.127+0000 7f15c319d700 1 -- 172.21.15.59:0/2642865983 wait complete. 2023-10-08T12:45:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.128+0000 7f15c319d700 1 Processor -- start 2023-10-08T12:45:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c319d700 1 -- start start 2023-10-08T12:45:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c319d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15bc1005a0 0x7f15bc19e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c319d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15bc100f60 0x7f15bc19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c319d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15bc106660 0x7f15bc198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c319d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc199150 con 0x7f15bc1005a0 2023-10-08T12:45:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c319d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc1992c0 con 0x7f15bc100f60 2023-10-08T12:45:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c319d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc199480 con 0x7f15bc106660 2023-10-08T12:45:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c219b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15bc1005a0 0x7f15bc19e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15bc100f60 0x7f15bc19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c219b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15bc1005a0 0x7f15bc19e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40966/0 (socket says 172.21.15.59:40966) 2023-10-08T12:45:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15bc100f60 0x7f15bc19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54890/0 (socket says 172.21.15.59:54890) 2023-10-08T12:45:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c219b700 1 -- 172.21.15.59:0/2200169374 learned_addr learned my addr 172.21.15.59:0/2200169374 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.129+0000 7f15c299c700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15bc106660 0x7f15bc198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15c219b700 1 -- 172.21.15.59:0/2200169374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15bc106660 msgr2=0x7f15bc198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15c219b700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15bc106660 0x7f15bc198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15c219b700 1 -- 172.21.15.59:0/2200169374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15bc100f60 msgr2=0x7f15bc19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15c219b700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15bc100f60 0x7f15bc19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15c219b700 1 -- 172.21.15.59:0/2200169374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0095f0 con 0x7f15bc1005a0 2023-10-08T12:45:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15c199a700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15bc100f60 0x7f15bc19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15c219b700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15bc1005a0 0x7f15bc19e9c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f15b800e9a0 tx=0x7f15b800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15b37fe700 1 -- 172.21.15.59:0/2200169374 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8009790 con 0x7f15bc1005a0 2023-10-08T12:45:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15b37fe700 1 -- 172.21.15.59:0/2200169374 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15b8010430 con 0x7f15bc1005a0 2023-10-08T12:45:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15c319d700 1 -- 172.21.15.59:0/2200169374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b4009c40 con 0x7f15bc1005a0 2023-10-08T12:45:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15b37fe700 1 -- 172.21.15.59:0/2200169374 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8018680 con 0x7f15bc1005a0 2023-10-08T12:45:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.130+0000 7f15c319d700 1 -- 172.21.15.59:0/2200169374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc199950 con 0x7f15bc1005a0 2023-10-08T12:45:40.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.134+0000 7f15b37fe700 1 -- 172.21.15.59:0/2200169374 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f15b80105a0 con 0x7f15bc1005a0 2023-10-08T12:45:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.135+0000 7f15d7d92b80 1 Processor -- start 2023-10-08T12:45:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15d7d92b80 1 -- start start 2023-10-08T12:45:40.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c18430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 0x556115c232c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 0x556115c25bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556115b81460 con 0x556115c18970 2023-10-08T12:45:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556115b72c20 con 0x556115c23800 2023-10-08T12:45:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556115b70540 con 0x556115c18050 2023-10-08T12:45:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15b37fe700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f15a80a1670 0x7f15a80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15b37fe700 1 -- 172.21.15.59:0/2200169374 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f15b8014070 con 0x7f15bc1005a0 2023-10-08T12:45:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15c219b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 0x556115c232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15c299c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c18430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.136+0000 7f15c199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 0x556115c25bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 0x556115c25bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54902/0 (socket says 172.21.15.59:54902) 2023-10-08T12:45:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c199a700 1 -- 172.21.15.59:0/3470882046 learned_addr learned my addr 172.21.15.59:0/3470882046 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c219b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 0x556115c232c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40976/0 (socket says 172.21.15.59:40976) 2023-10-08T12:45:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c299c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c18430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:52858/0 (socket says 172.21.15.59:52858) 2023-10-08T12:45:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c199a700 1 -- 172.21.15.59:0/3470882046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 msgr2=0x556115c18430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c199a700 1 --2- 172.21.15.59:0/3470882046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c18430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c199a700 1 -- 172.21.15.59:0/3470882046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 msgr2=0x556115c232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c199a700 1 --2- 172.21.15.59:0/3470882046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 0x556115c232c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c199a700 1 -- 172.21.15.59:0/3470882046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556115996de0 con 0x556115c23800 2023-10-08T12:45:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c299c700 1 --2- 172.21.15.59:0/3470882046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c18430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c219b700 1 --2- 172.21.15.59:0/3470882046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 0x556115c232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c299c700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f15a80a1670 0x7f15a80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15c199a700 1 --2- 172.21.15.59:0/3470882046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 0x556115c25bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0117c0 tx=0x7f15ac011ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5e98c9cb87a163c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.137+0000 7f15b0bfe700 1 -- 172.21.15.59:0/3470882046 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac004830 con 0x556115c23800 2023-10-08T12:45:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15b0bfe700 1 -- 172.21.15.59:0/3470882046 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15ac004e50 con 0x556115c23800 2023-10-08T12:45:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15b0bfe700 1 -- 172.21.15.59:0/3470882046 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00f820 con 0x556115c23800 2023-10-08T12:45:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15c299c700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f15a80a1670 0x7f15a80a3b30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f15b400b6c0 tx=0x7f15b4009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15d7d92b80 1 -- 172.21.15.59:0/3470882046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 msgr2=0x556115c25bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/3470882046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 0x556115c25bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0117c0 tx=0x7f15ac011ad0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15d7d92b80 1 -- 172.21.15.59:0/3470882046 shutdown_connections 2023-10-08T12:45:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/3470882046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 0x556115c25bf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/3470882046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c18430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/3470882046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 0x556115c232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15d7d92b80 1 -- 172.21.15.59:0/3470882046 >> 172.21.15.59:0/3470882046 conn(0x556115b8d260 msgr2=0x556115c14460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15d7d92b80 1 -- 172.21.15.59:0/3470882046 shutdown_connections 2023-10-08T12:45:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.138+0000 7f15d7d92b80 1 -- 172.21.15.59:0/3470882046 wait complete. 2023-10-08T12:45:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.139+0000 7f15d7d92b80 1 -- start start 2023-10-08T12:45:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.139+0000 7f15d7d92b80 1 Processor -- start 2023-10-08T12:45:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c23210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 0x556115c20500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 0x556115c20ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556115b6be30 con 0x556115c18970 2023-10-08T12:45:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556115b08710 con 0x556115c23800 2023-10-08T12:45:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556115b083b0 con 0x556115c18050 2023-10-08T12:45:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15d7d92b80 10 client.0 _ll_register_callbacks cb 0x556115965800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15c219b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c23210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15c219b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c23210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:52868/0 (socket says 172.21.15.59:52868) 2023-10-08T12:45:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15c219b700 1 -- 172.21.15.59:0/1243609903 learned_addr learned my addr 172.21.15.59:0/1243609903 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15c199a700 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 0x556115c20500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15c299c700 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 0x556115c20ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15c219b700 1 -- 172.21.15.59:0/1243609903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 msgr2=0x556115c20ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15c219b700 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 0x556115c20ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15c219b700 1 -- 172.21.15.59:0/1243609903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 msgr2=0x556115c20500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15c219b700 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 0x556115c20500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.140+0000 7f15c219b700 1 -- 172.21.15.59:0/1243609903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc199950 con 0x556115c18050 2023-10-08T12:45:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.141+0000 7f15c219b700 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c23210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15b80caa10 tx=0x7f15b801dc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51a8466ab6ae34a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.141+0000 7f15a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:45:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.141+0000 7f15a5ffb700 1 -- 172.21.15.59:0/1243609903 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8096580 con 0x556115c18050 2023-10-08T12:45:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.141+0000 7f15a5ffb700 1 -- 172.21.15.59:0/1243609903 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f15b809a940 con 0x556115c18050 2023-10-08T12:45:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.141+0000 7f15d7d92b80 1 -- 172.21.15.59:0/1243609903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556115b33eb0 con 0x556115c18050 2023-10-08T12:45:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.141+0000 7f15a5ffb700 1 -- 172.21.15.59:0/1243609903 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15b809a240 con 0x556115c18050 2023-10-08T12:45:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.141+0000 7f15d7d92b80 10 client.25978 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.141+0000 7f15d7d92b80 1 -- 172.21.15.59:0/1243609903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f15ac011440 con 0x556115c18050 2023-10-08T12:45:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.141+0000 7f15a5ffb700 1 -- 172.21.15.59:0/1243609903 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556115b33eb0 con 0x556115c18050 2023-10-08T12:45:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.142+0000 7f15a5ffb700 1 -- 172.21.15.59:0/1243609903 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f15b8099730 con 0x556115c18050 2023-10-08T12:45:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.142+0000 7f15d7d92b80 10 client.25978 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.142+0000 7f15d7d92b80 10 client.25978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.142+0000 7f15d7d92b80 20 client.25978 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.142+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556115c33300 0x556115c356f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.142+0000 7f15d7d92b80 4 client.25978 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:45:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.142+0000 7f15d7d92b80 1 -- 172.21.15.59:0/1243609903 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556115b64e10 con 0x556115c33300 2023-10-08T12:45:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.142+0000 7f15c199a700 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556115c33300 0x556115c356f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.142+0000 7f15c199a700 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556115c33300 0x556115c356f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a77dc37e4566b56a server_cookie=5a1f1f827a204643 in_seq=0 out_seq=0 2023-10-08T12:45:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.142+0000 7f15a5ffb700 10 client.25978 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.143+0000 7f15a5ffb700 1 -- 172.21.15.59:0/1243609903 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556115b64e10 con 0x556115c33300 2023-10-08T12:45:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.143+0000 7f15a5ffb700 10 client.25978 handle_command_reply: tid=0 2023-10-08T12:45:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 1 client.25978 shutdown 2023-10-08T12:45:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 1 -- 172.21.15.59:0/1243609903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 msgr2=0x556115c23210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c23210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15b80caa10 tx=0x7f15b801dc80 comp rx=0 tx=0).stop 2023-10-08T12:45:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 1 -- 172.21.15.59:0/1243609903 shutdown_connections 2023-10-08T12:45:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556115c33300 0x556115c356f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c23800 0x556115c20ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c23210 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/1243609903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18970 0x556115c20500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 1 -- 172.21.15.59:0/1243609903 >> 172.21.15.59:0/1243609903 conn(0x556115b8d260 msgr2=0x556115c1a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15a5ffb700 0 client.25978 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 1 -- 172.21.15.59:0/1243609903 shutdown_connections 2023-10-08T12:45:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 1 -- 172.21.15.59:0/1243609903 wait complete. 2023-10-08T12:45:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.144+0000 7f15d7d92b80 20 client.25978 trim_cache size 0 max 16384 2023-10-08T12:45:40.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.163+0000 7f15d7d92b80 1 Processor -- start 2023-10-08T12:45:40.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.163+0000 7f15d7d92b80 1 -- start start 2023-10-08T12:45:40.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18050 0x556115c204c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c2a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c23800 0x556115c1edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561159ec920 con 0x556115c18050 2023-10-08T12:45:40.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556115c19810 con 0x556115c18970 2023-10-08T12:45:40.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556115c10090 con 0x556115c23800 2023-10-08T12:45:40.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15c199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c2a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15c199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c2a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54922/0 (socket says 172.21.15.59:54922) 2023-10-08T12:45:40.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15c199a700 1 -- 172.21.15.59:0/278293427 learned_addr learned my addr 172.21.15.59:0/278293427 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:40.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15c219b700 1 --2- 172.21.15.59:0/278293427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18050 0x556115c204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15c299c700 1 --2- 172.21.15.59:0/278293427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c23800 0x556115c1edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15c199a700 1 -- 172.21.15.59:0/278293427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c23800 msgr2=0x556115c1edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15c199a700 1 --2- 172.21.15.59:0/278293427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c23800 0x556115c1edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15c199a700 1 -- 172.21.15.59:0/278293427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18050 msgr2=0x556115c204c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15c199a700 1 --2- 172.21.15.59:0/278293427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18050 0x556115c204c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.164+0000 7f15c199a700 1 -- 172.21.15.59:0/278293427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55611597fc60 con 0x556115c18970 2023-10-08T12:45:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.165+0000 7f15c199a700 1 --2- 172.21.15.59:0/278293427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c2a2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15ac01b040 tx=0x7f15ac011ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2475ec80e21cc757 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.165+0000 7f15b13ff700 1 -- 172.21.15.59:0/278293427 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac02e070 con 0x556115c18970 2023-10-08T12:45:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.165+0000 7f15b13ff700 1 -- 172.21.15.59:0/278293427 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15ac005c00 con 0x556115c18970 2023-10-08T12:45:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.165+0000 7f15b13ff700 1 -- 172.21.15.59:0/278293427 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac029290 con 0x556115c18970 2023-10-08T12:45:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.165+0000 7f15d7d92b80 1 -- 172.21.15.59:0/278293427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 msgr2=0x556115c2a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.165+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/278293427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c2a2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15ac01b040 tx=0x7f15ac011ad0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.166+0000 7f15d7d92b80 1 -- 172.21.15.59:0/278293427 shutdown_connections 2023-10-08T12:45:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.166+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/278293427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c23800 0x556115c1edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.166+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/278293427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c18050 0x556115c204c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.166+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/278293427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c2a2f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.166+0000 7f15d7d92b80 1 -- 172.21.15.59:0/278293427 >> 172.21.15.59:0/278293427 conn(0x556115b8d260 msgr2=0x556115c1b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.166+0000 7f15d7d92b80 1 -- 172.21.15.59:0/278293427 shutdown_connections 2023-10-08T12:45:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.166+0000 7f15d7d92b80 1 -- 172.21.15.59:0/278293427 wait complete. 2023-10-08T12:45:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.166+0000 7f15d7d92b80 1 -- start start 2023-10-08T12:45:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.166+0000 7f15d7d92b80 1 Processor -- start 2023-10-08T12:45:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c28a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c28fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15d7d92b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c23800 0x556115c29500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556115c2a8c0 con 0x556115c23800 2023-10-08T12:45:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556115c87130 con 0x556115c18970 2023-10-08T12:45:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15d7d92b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556115c872c0 con 0x556115c18050 2023-10-08T12:45:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15d7d92b80 10 client.0 _ll_register_callbacks cb 0x7f15b809a0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c219b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c28a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c28fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c219b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c28a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:52896/0 (socket says 172.21.15.59:52896) 2023-10-08T12:45:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c28fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54924/0 (socket says 172.21.15.59:54924) 2023-10-08T12:45:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c219b700 1 -- 172.21.15.59:0/132895563 learned_addr learned my addr 172.21.15.59:0/132895563 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c299c700 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c23800 0x556115c29500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c219b700 1 -- 172.21.15.59:0/132895563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 msgr2=0x556115c28fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c219b700 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c28fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c219b700 1 -- 172.21.15.59:0/132895563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c23800 msgr2=0x556115c29500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c219b700 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c23800 0x556115c29500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c219b700 1 -- 172.21.15.59:0/132895563 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556115996de0 con 0x556115c18050 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.167+0000 7f15c199a700 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c28fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.168+0000 7f15c219b700 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c28a80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f15b809a1d0 tx=0x7f15b8099eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16de11a5bf396518 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.168+0000 7f15a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.168+0000 7f15a5ffb700 1 -- 172.21.15.59:0/132895563 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8099ba0 con 0x556115c18050 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.168+0000 7f15d7d92b80 1 -- 172.21.15.59:0/132895563 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15ac004e50 con 0x556115c18050 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.168+0000 7f15a5ffb700 1 -- 172.21.15.59:0/132895563 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f15b809a940 con 0x556115c18050 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.168+0000 7f15a5ffb700 1 -- 172.21.15.59:0/132895563 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15b809a240 con 0x556115c18050 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.168+0000 7f15d7d92b80 10 client.25984 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.168+0000 7f15d7d92b80 1 -- 172.21.15.59:0/132895563 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5561159bd250 con 0x556115c18050 2023-10-08T12:45:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.168+0000 7f15a5ffb700 1 -- 172.21.15.59:0/132895563 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15ac004e50 con 0x556115c18050 2023-10-08T12:45:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.168+0000 7f15a5ffb700 1 -- 172.21.15.59:0/132895563 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f15b80b8170 con 0x556115c18050 2023-10-08T12:45:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.169+0000 7f15d7d92b80 10 client.25984 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.169+0000 7f15d7d92b80 10 client.25984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.169+0000 7f15d7d92b80 20 client.25984 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.169+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556115c88830 0x556115c8ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.169+0000 7f15d7d92b80 4 client.25984 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:45:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.169+0000 7f15d7d92b80 1 -- 172.21.15.59:0/132895563 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556115b64b30 con 0x556115c88830 2023-10-08T12:45:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.169+0000 7f15c199a700 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556115c88830 0x556115c8ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.169+0000 7f15c199a700 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556115c88830 0x556115c8ac50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=648bcbbe19acce4d server_cookie=495ee723c5b74c9e in_seq=0 out_seq=0 2023-10-08T12:45:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.169+0000 7f15a5ffb700 10 client.25984 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15a5ffb700 1 -- 172.21.15.59:0/132895563 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556115b64b30 con 0x556115c88830 2023-10-08T12:45:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15a5ffb700 10 client.25984 handle_command_reply: tid=0 2023-10-08T12:45:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15d7d92b80 1 client.25984 shutdown 2023-10-08T12:45:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15d7d92b80 1 -- 172.21.15.59:0/132895563 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 msgr2=0x556115c28a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c28a80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f15b809a1d0 tx=0x7f15b8099eb0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15d7d92b80 1 -- 172.21.15.59:0/132895563 shutdown_connections 2023-10-08T12:45:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556115c88830 0x556115c8ac50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556115c23800 0x556115c29500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15a5ffb700 0 client.25984 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556115c18050 0x556115c28a80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15d7d92b80 1 --2- 172.21.15.59:0/132895563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556115c18970 0x556115c28fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15d7d92b80 1 -- 172.21.15.59:0/132895563 >> 172.21.15.59:0/132895563 conn(0x556115b8d260 msgr2=0x556115c1ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15d7d92b80 1 -- 172.21.15.59:0/132895563 shutdown_connections 2023-10-08T12:45:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.171+0000 7f15d7d92b80 1 -- 172.21.15.59:0/132895563 wait complete. 2023-10-08T12:45:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15d7d92b80 20 client.25984 trim_cache size 0 max 16384 2023-10-08T12:45:40.177 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:45:40.177 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:45:40.177 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:45:40.178 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:45:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 -- 172.21.15.59:0/2200169374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f15a80a1670 msgr2=0x7f15a80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f15a80a1670 0x7f15a80a3b30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f15b400b6c0 tx=0x7f15b4009920 comp rx=0 tx=0).stop 2023-10-08T12:45:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 -- 172.21.15.59:0/2200169374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15bc1005a0 msgr2=0x7f15bc19e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15bc1005a0 0x7f15bc19e9c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f15b800e9a0 tx=0x7f15b800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 -- 172.21.15.59:0/2200169374 shutdown_connections 2023-10-08T12:45:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f15a80a1670 0x7f15a80a3b30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15bc106660 0x7f15bc198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15bc1005a0 0x7f15bc19e9c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 --2- 172.21.15.59:0/2200169374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15bc100f60 0x7f15bc19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 -- 172.21.15.59:0/2200169374 >> 172.21.15.59:0/2200169374 conn(0x7f15bc0fc090 msgr2=0x7f15bc0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 -- 172.21.15.59:0/2200169374 shutdown_connections 2023-10-08T12:45:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.172+0000 7f15c319d700 1 -- 172.21.15.59:0/2200169374 wait complete. 2023-10-08T12:45:40.189 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:39 smithi059 ceph-mon[98489]: pgmap v448: 97 pgs: 97 active+clean; 269 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 238 op/s 2023-10-08T12:45:40.192 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:45:40.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:45:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:39 smithi173 ceph-mon[135182]: pgmap v448: 97 pgs: 97 active+clean; 269 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 238 op/s 2023-10-08T12:45:40.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.403+0000 7fd5671ff700 1 -- 172.21.15.59:0/2776841296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5601021b0 msgr2=0x7fd56010a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.403+0000 7fd5671ff700 1 --2- 172.21.15.59:0/2776841296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5601021b0 0x7fd56010a690 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009990 tx=0x7fd54c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.403+0000 7fd5671ff700 1 -- 172.21.15.59:0/2776841296 shutdown_connections 2023-10-08T12:45:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.403+0000 7fd5671ff700 1 --2- 172.21.15.59:0/2776841296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd560101890 0x7fd560101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.403+0000 7fd5671ff700 1 --2- 172.21.15.59:0/2776841296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd56010ac60 0x7fd56010d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.403+0000 7fd5671ff700 1 --2- 172.21.15.59:0/2776841296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5601021b0 0x7fd56010a690 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.403+0000 7fd5671ff700 1 -- 172.21.15.59:0/2776841296 >> 172.21.15.59:0/2776841296 conn(0x7fd5600fb030 msgr2=0x7fd5600fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.403+0000 7fd5671ff700 1 -- 172.21.15.59:0/2776841296 shutdown_connections 2023-10-08T12:45:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.403+0000 7fd5671ff700 1 -- 172.21.15.59:0/2776841296 wait complete. 2023-10-08T12:45:40.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.404+0000 7fd5671ff700 1 Processor -- start 2023-10-08T12:45:40.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd5671ff700 1 -- start start 2023-10-08T12:45:40.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd5671ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd560101890 0x7fd560198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd5671ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5601021b0 0x7fd560199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd5671ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56010ac60 0x7fd56019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd5671ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56019dd20 con 0x7fd56010ac60 2023-10-08T12:45:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd5671ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56019de90 con 0x7fd560101890 2023-10-08T12:45:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd5671ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56019e050 con 0x7fd5601021b0 2023-10-08T12:45:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd564f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd560101890 0x7fd560198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd56579c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56010ac60 0x7fd56019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd55ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5601021b0 0x7fd560199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd564f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd560101890 0x7fd560198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54942/0 (socket says 172.21.15.59:54942) 2023-10-08T12:45:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.405+0000 7fd564f9b700 1 -- 172.21.15.59:0/3992851520 learned_addr learned my addr 172.21.15.59:0/3992851520 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd564f9b700 1 -- 172.21.15.59:0/3992851520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5601021b0 msgr2=0x7fd560199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd564f9b700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5601021b0 0x7fd560199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd564f9b700 1 -- 172.21.15.59:0/3992851520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56010ac60 msgr2=0x7fd56019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd564f9b700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56010ac60 0x7fd56019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd564f9b700 1 -- 172.21.15.59:0/3992851520 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0095f0 con 0x7fd560101890 2023-10-08T12:45:40.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd55ffff700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5601021b0 0x7fd560199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:40.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd56579c700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56010ac60 0x7fd56019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:40.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd564f9b700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd560101890 0x7fd560198e50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd55400e9a0 tx=0x7fd55400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd55dffb700 1 -- 172.21.15.59:0/3992851520 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554009790 con 0x7fd560101890 2023-10-08T12:45:40.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd55dffb700 1 -- 172.21.15.59:0/3992851520 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd554010430 con 0x7fd560101890 2023-10-08T12:45:40.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd5671ff700 1 -- 172.21.15.59:0/3992851520 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56019e330 con 0x7fd560101890 2023-10-08T12:45:40.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd55dffb700 1 -- 172.21.15.59:0/3992851520 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554018680 con 0x7fd560101890 2023-10-08T12:45:40.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.406+0000 7fd5671ff700 1 -- 172.21.15.59:0/3992851520 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5601a5b70 con 0x7fd560101890 2023-10-08T12:45:40.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.408+0000 7fd5671ff700 1 -- 172.21.15.59:0/3992851520 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd560108180 con 0x7fd560101890 2023-10-08T12:45:40.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.409+0000 7fd55dffb700 1 -- 172.21.15.59:0/3992851520 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd5540105a0 con 0x7fd560101890 2023-10-08T12:45:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.411+0000 7fd55dffb700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5500a15f0 0x7fd5500a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.411+0000 7fd55dffb700 1 -- 172.21.15.59:0/3992851520 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd554014070 con 0x7fd560101890 2023-10-08T12:45:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.411+0000 7fd55ffff700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5500a15f0 0x7fd5500a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.412+0000 7fd55ffff700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5500a15f0 0x7fd5500a3ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd56019a350 tx=0x7fd54c00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.413+0000 7fd55dffb700 1 -- 172.21.15.59:0/3992851520 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd554096570 con 0x7fd560101890 2023-10-08T12:45:40.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 504639 14.02 MB/sec execute 71 sec latency 66.039 ms 2023-10-08T12:45:40.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.700+0000 7fd5671ff700 1 -- 172.21.15.59:0/3992851520 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd560068070 con 0x7fd560101890 2023-10-08T12:45:40.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.701+0000 7fd55dffb700 1 -- 172.21.15.59:0/3992851520 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fd554099b90 con 0x7fd560101890 2023-10-08T12:45:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:45:40.703 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:45:40.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 -- 172.21.15.59:0/3992851520 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5500a15f0 msgr2=0x7fd5500a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5500a15f0 0x7fd5500a3ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd56019a350 tx=0x7fd54c00b260 comp rx=0 tx=0).stop 2023-10-08T12:45:40.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 -- 172.21.15.59:0/3992851520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd560101890 msgr2=0x7fd560198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd560101890 0x7fd560198e50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd55400e9a0 tx=0x7fd55400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 -- 172.21.15.59:0/3992851520 shutdown_connections 2023-10-08T12:45:40.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5500a15f0 0x7fd5500a3ab0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd560101890 0x7fd560198e50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56010ac60 0x7fd56019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 --2- 172.21.15.59:0/3992851520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5601021b0 0x7fd560199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 -- 172.21.15.59:0/3992851520 >> 172.21.15.59:0/3992851520 conn(0x7fd5600fb030 msgr2=0x7fd560100640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 -- 172.21.15.59:0/3992851520 shutdown_connections 2023-10-08T12:45:40.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.704+0000 7fd5671ff700 1 -- 172.21.15.59:0/3992851520 wait complete. 2023-10-08T12:45:40.706 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:45:40.724 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:45:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.944+0000 7efc975ff700 1 -- 172.21.15.59:0/4148725487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc90106750 msgr2=0x7efc90106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.944+0000 7efc975ff700 1 --2- 172.21.15.59:0/4148725487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc90106750 0x7efc90106b30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009990 tx=0x7efc8c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.945+0000 7efc975ff700 1 -- 172.21.15.59:0/4148725487 shutdown_connections 2023-10-08T12:45:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.945+0000 7efc975ff700 1 --2- 172.21.15.59:0/4148725487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc90101100 0x7efc9010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.945+0000 7efc975ff700 1 --2- 172.21.15.59:0/4148725487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc90106750 0x7efc90106b30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.945+0000 7efc975ff700 1 --2- 172.21.15.59:0/4148725487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc90100740 0x7efc90100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.945+0000 7efc975ff700 1 -- 172.21.15.59:0/4148725487 >> 172.21.15.59:0/4148725487 conn(0x7efc900fc230 msgr2=0x7efc900fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.945+0000 7efc975ff700 1 -- 172.21.15.59:0/4148725487 shutdown_connections 2023-10-08T12:45:40.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.945+0000 7efc975ff700 1 -- 172.21.15.59:0/4148725487 wait complete. 2023-10-08T12:45:40.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc975ff700 1 Processor -- start 2023-10-08T12:45:40.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc975ff700 1 -- start start 2023-10-08T12:45:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc975ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc90100740 0x7efc90198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc975ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc90101100 0x7efc901992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc975ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc90106750 0x7efc9019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc975ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9019dcc0 con 0x7efc90106750 2023-10-08T12:45:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc975ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9019de30 con 0x7efc90101100 2023-10-08T12:45:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc975ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9019dff0 con 0x7efc90100740 2023-10-08T12:45:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc94b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc90101100 0x7efc901992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc95b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc90106750 0x7efc9019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc94b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc90101100 0x7efc901992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52844/0 (socket says 172.21.15.59:52844) 2023-10-08T12:45:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc94b9a700 1 -- 172.21.15.59:0/490288715 learned_addr learned my addr 172.21.15.59:0/490288715 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.946+0000 7efc9539b700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc90100740 0x7efc90198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.947+0000 7efc94b9a700 1 -- 172.21.15.59:0/490288715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc90100740 msgr2=0x7efc90198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.947+0000 7efc94b9a700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc90100740 0x7efc90198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.947+0000 7efc94b9a700 1 -- 172.21.15.59:0/490288715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc90106750 msgr2=0x7efc9019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.947+0000 7efc94b9a700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc90106750 0x7efc9019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.947+0000 7efc94b9a700 1 -- 172.21.15.59:0/490288715 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc88009c40 con 0x7efc90101100 2023-10-08T12:45:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.947+0000 7efc94b9a700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc90101100 0x7efc901992e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efc8000e9a0 tx=0x7efc8000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.947+0000 7efc867fc700 1 -- 172.21.15.59:0/490288715 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80009790 con 0x7efc90101100 2023-10-08T12:45:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.947+0000 7efc867fc700 1 -- 172.21.15.59:0/490288715 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc8000ce80 con 0x7efc90101100 2023-10-08T12:45:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.947+0000 7efc867fc700 1 -- 172.21.15.59:0/490288715 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80018680 con 0x7efc90101100 2023-10-08T12:45:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.948+0000 7efc975ff700 1 -- 172.21.15.59:0/490288715 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8c0095f0 con 0x7efc90101100 2023-10-08T12:45:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.948+0000 7efc975ff700 1 -- 172.21.15.59:0/490288715 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc901a5930 con 0x7efc90101100 2023-10-08T12:45:40.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.951+0000 7efc867fc700 1 -- 172.21.15.59:0/490288715 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7efc80010430 con 0x7efc90101100 2023-10-08T12:45:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.953+0000 7efcaafc8b80 1 Processor -- start 2023-10-08T12:45:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.953+0000 7efcaafc8b80 1 -- start start 2023-10-08T12:45:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.953+0000 7efc867fc700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc7c0a1670 0x7efc7c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.953+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bc6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.953+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 0x559275bd1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.953+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 0x559275bd3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.953+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559275b2f460 con 0x559275bc67a0 2023-10-08T12:45:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.953+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559275b20c20 con 0x559275bd1650 2023-10-08T12:45:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.953+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559275b1e540 con 0x559275bc5e80 2023-10-08T12:45:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.953+0000 7efc867fc700 1 -- 172.21.15.59:0/490288715 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efc80014070 con 0x7efc90101100 2023-10-08T12:45:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc94b9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 0x559275bd1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc95b9c700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc7c0a1670 0x7efc7c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc94b9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 0x559275bd1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53604/0 (socket says 172.21.15.59:53604) 2023-10-08T12:45:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc94b9a700 1 -- 172.21.15.59:0/4159418223 learned_addr learned my addr 172.21.15.59:0/4159418223 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc9539b700 1 --2- 172.21.15.59:0/4159418223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bc6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc95b9c700 1 --2- 172.21.15.59:0/4159418223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 0x559275bd3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc94b9a700 1 -- 172.21.15.59:0/4159418223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 msgr2=0x559275bc6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc94b9a700 1 --2- 172.21.15.59:0/4159418223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bc6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc94b9a700 1 -- 172.21.15.59:0/4159418223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 msgr2=0x559275bd3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc94b9a700 1 --2- 172.21.15.59:0/4159418223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 0x559275bd3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc94b9a700 1 -- 172.21.15.59:0/4159418223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559275944de0 con 0x559275bc67a0 2023-10-08T12:45:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc9539b700 1 --2- 172.21.15.59:0/4159418223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bc6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc95b9c700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc7c0a1670 0x7efc7c0a3b30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efc88009fd0 tx=0x7efc88009490 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.954+0000 7efc94b9a700 1 --2- 172.21.15.59:0/4159418223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 0x559275bd1110 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7efc80096cb0 tx=0x7efc80011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c81bc2ea0cedeab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.955+0000 7efc7b7fe700 1 -- 172.21.15.59:0/4159418223 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8009a240 con 0x559275bc67a0 2023-10-08T12:45:40.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.955+0000 7efc7b7fe700 1 -- 172.21.15.59:0/4159418223 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc8009e390 con 0x559275bc67a0 2023-10-08T12:45:40.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.955+0000 7efc7b7fe700 1 -- 172.21.15.59:0/4159418223 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800cac30 con 0x559275bc67a0 2023-10-08T12:45:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.955+0000 7efcaafc8b80 1 -- 172.21.15.59:0/4159418223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 msgr2=0x559275bd1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.955+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/4159418223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 0x559275bd1110 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7efc80096cb0 tx=0x7efc80011e60 comp rx=0 tx=0).stop 2023-10-08T12:45:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.955+0000 7efcaafc8b80 1 -- 172.21.15.59:0/4159418223 shutdown_connections 2023-10-08T12:45:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.955+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/4159418223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 0x559275bd3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.955+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/4159418223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bc6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.955+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/4159418223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 0x559275bd1110 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.955+0000 7efcaafc8b80 1 -- 172.21.15.59:0/4159418223 >> 172.21.15.59:0/4159418223 conn(0x559275b3b260 msgr2=0x559275bc22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.955+0000 7efcaafc8b80 1 -- 172.21.15.59:0/4159418223 shutdown_connections 2023-10-08T12:45:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.956+0000 7efcaafc8b80 1 -- 172.21.15.59:0/4159418223 wait complete. 2023-10-08T12:45:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.956+0000 7efcaafc8b80 1 -- start start 2023-10-08T12:45:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.956+0000 7efcaafc8b80 1 Processor -- start 2023-10-08T12:45:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bd1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 0x559275bce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 0x559275bce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559275b19e30 con 0x559275bc67a0 2023-10-08T12:45:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559275ab6710 con 0x559275bd1650 2023-10-08T12:45:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559275ab63b0 con 0x559275bc5e80 2023-10-08T12:45:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efcaafc8b80 10 client.0 _ll_register_callbacks cb 0x559275913800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efc95b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 0x559275bce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efc9539b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bd1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efc94b9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 0x559275bce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efc95b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 0x559275bce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52868/0 (socket says 172.21.15.59:52868) 2023-10-08T12:45:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efc95b9c700 1 -- 172.21.15.59:0/1098193676 learned_addr learned my addr 172.21.15.59:0/1098193676 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efc95b9c700 1 -- 172.21.15.59:0/1098193676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 msgr2=0x559275bd1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efc95b9c700 1 --2- 172.21.15.59:0/1098193676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bd1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efc95b9c700 1 -- 172.21.15.59:0/1098193676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 msgr2=0x559275bce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efc95b9c700 1 --2- 172.21.15.59:0/1098193676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 0x559275bce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.957+0000 7efc95b9c700 1 -- 172.21.15.59:0/1098193676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc901a5930 con 0x559275bd1650 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.958+0000 7efc95b9c700 1 --2- 172.21.15.59:0/1098193676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 0x559275bce980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efc880086e0 tx=0x7efc8800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0a01f9ade78eac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.958+0000 7efc78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.958+0000 7efc78ff9700 1 -- 172.21.15.59:0/1098193676 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8800e070 con 0x559275bd1650 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.958+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1098193676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559275ae1eb0 con 0x559275bd1650 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.958+0000 7efc78ff9700 1 -- 172.21.15.59:0/1098193676 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efc88021040 con 0x559275bd1650 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.958+0000 7efc78ff9700 1 -- 172.21.15.59:0/1098193676 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc8801aee0 con 0x559275bd1650 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.958+0000 7efcaafc8b80 10 client.26006 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.958+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1098193676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55927592dc60 con 0x559275bd1650 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.958+0000 7efc78ff9700 1 -- 172.21.15.59:0/1098193676 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559275ae1eb0 con 0x559275bd1650 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.959+0000 7efc78ff9700 1 -- 172.21.15.59:0/1098193676 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efc88025070 con 0x559275bd1650 2023-10-08T12:45:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.959+0000 7efcaafc8b80 10 client.26006 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.959+0000 7efcaafc8b80 10 client.26006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.959+0000 7efcaafc8b80 20 client.26006 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.959+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/1098193676 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559275be11b0 0x559275be35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.959+0000 7efcaafc8b80 4 client.26006 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:45:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.959+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1098193676 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559275b12e10 con 0x559275be11b0 2023-10-08T12:45:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.959+0000 7efc9539b700 1 --2- 172.21.15.59:0/1098193676 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559275be11b0 0x559275be35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.960+0000 7efc78ff9700 10 client.26006 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.959+0000 7efc9539b700 1 --2- 172.21.15.59:0/1098193676 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559275be11b0 0x559275be35d0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=932e5c8f44c6927f server_cookie=f7fe16e0b52b908e in_seq=0 out_seq=0 2023-10-08T12:45:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.960+0000 7efc78ff9700 1 -- 172.21.15.59:0/1098193676 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559275b12e10 con 0x559275be11b0 2023-10-08T12:45:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.960+0000 7efc78ff9700 10 client.26006 handle_command_reply: tid=0 2023-10-08T12:45:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.960+0000 7efcaafc8b80 1 client.26006 shutdown 2023-10-08T12:45:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1098193676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 msgr2=0x559275bce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/1098193676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 0x559275bce980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efc880086e0 tx=0x7efc8800b040 comp rx=0 tx=0).stop 2023-10-08T12:45:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1098193676 shutdown_connections 2023-10-08T12:45:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/1098193676 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559275be11b0 0x559275be35d0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/1098193676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bd1650 0x559275bce980 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/1098193676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bd1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efc78ff9700 0 client.26006 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/1098193676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bc67a0 0x559275bce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1098193676 >> 172.21.15.59:0/1098193676 conn(0x559275b3b260 msgr2=0x559275bc1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1098193676 shutdown_connections 2023-10-08T12:45:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1098193676 wait complete. 2023-10-08T12:45:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.961+0000 7efcaafc8b80 20 client.26006 trim_cache size 0 max 16384 2023-10-08T12:45:40.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.977+0000 7efcaafc8b80 1 Processor -- start 2023-10-08T12:45:40.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.977+0000 7efcaafc8b80 1 -- start start 2023-10-08T12:45:40.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.977+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc5e80 0x559275bce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.977+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc67a0 0x559275bd81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.977+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bd1650 0x559275bc1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.977+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927599a920 con 0x559275bd1650 2023-10-08T12:45:40.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.977+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559275bde8b0 con 0x559275bc5e80 2023-10-08T12:45:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.977+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559275bcf290 con 0x559275bc67a0 2023-10-08T12:45:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc9539b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc5e80 0x559275bce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc94b9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc67a0 0x559275bd81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc95b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bd1650 0x559275bc1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc94b9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc67a0 0x559275bd81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44332/0 (socket says 172.21.15.59:44332) 2023-10-08T12:45:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc9539b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc5e80 0x559275bce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52872/0 (socket says 172.21.15.59:52872) 2023-10-08T12:45:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc94b9a700 1 -- 172.21.15.59:0/1783430858 learned_addr learned my addr 172.21.15.59:0/1783430858 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc94b9a700 1 -- 172.21.15.59:0/1783430858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc5e80 msgr2=0x559275bce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc94b9a700 1 --2- 172.21.15.59:0/1783430858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc5e80 0x559275bce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc94b9a700 1 -- 172.21.15.59:0/1783430858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bd1650 msgr2=0x559275bc1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc94b9a700 1 --2- 172.21.15.59:0/1783430858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bd1650 0x559275bc1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc94b9a700 1 -- 172.21.15.59:0/1783430858 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55927596b250 con 0x559275bc67a0 2023-10-08T12:45:40.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc94b9a700 1 --2- 172.21.15.59:0/1783430858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc67a0 0x559275bd81a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efc80011fd0 tx=0x7efc8009a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf943563382c2af7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc7bfff700 1 -- 172.21.15.59:0/1783430858 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80010710 con 0x559275bc67a0 2023-10-08T12:45:40.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc7bfff700 1 -- 172.21.15.59:0/1783430858 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc80010870 con 0x559275bc67a0 2023-10-08T12:45:40.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.978+0000 7efc7bfff700 1 -- 172.21.15.59:0/1783430858 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8009a700 con 0x559275bc67a0 2023-10-08T12:45:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.979+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1783430858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc67a0 msgr2=0x559275bd81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.979+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/1783430858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc67a0 0x559275bd81a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efc80011fd0 tx=0x7efc8009a140 comp rx=0 tx=0).stop 2023-10-08T12:45:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.979+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1783430858 shutdown_connections 2023-10-08T12:45:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.979+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/1783430858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc5e80 0x559275bce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.979+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/1783430858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bd1650 0x559275bc1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.979+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/1783430858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc67a0 0x559275bd81a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.979+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1783430858 >> 172.21.15.59:0/1783430858 conn(0x559275b3b260 msgr2=0x559275bc14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.979+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1783430858 shutdown_connections 2023-10-08T12:45:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.979+0000 7efcaafc8b80 1 -- 172.21.15.59:0/1783430858 wait complete. 2023-10-08T12:45:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.980+0000 7efcaafc8b80 1 -- start start 2023-10-08T12:45:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.980+0000 7efcaafc8b80 1 Processor -- start 2023-10-08T12:45:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.980+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bd6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.980+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc67a0 0x559275bd66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efcaafc8b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bd1650 0x559275c33fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559275bd6f80 con 0x559275bd1650 2023-10-08T12:45:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559275c34520 con 0x559275bc67a0 2023-10-08T12:45:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efcaafc8b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559275c34660 con 0x559275bc5e80 2023-10-08T12:45:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efcaafc8b80 10 client.0 _ll_register_callbacks cb 0x7efc88008630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc9539b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bd6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc94b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc67a0 0x559275bd66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc9539b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bd6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44342/0 (socket says 172.21.15.59:44342) 2023-10-08T12:45:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc9539b700 1 -- 172.21.15.59:0/3868713447 learned_addr learned my addr 172.21.15.59:0/3868713447 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc94b9a700 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc67a0 0x559275bd66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52886/0 (socket says 172.21.15.59:52886) 2023-10-08T12:45:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc95b9c700 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bd1650 0x559275c33fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc94b9a700 1 -- 172.21.15.59:0/3868713447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 msgr2=0x559275bd6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc94b9a700 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bd6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc94b9a700 1 -- 172.21.15.59:0/3868713447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bd1650 msgr2=0x559275c33fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc94b9a700 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bd1650 0x559275c33fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc94b9a700 1 -- 172.21.15.59:0/3868713447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559275944de0 con 0x559275bc67a0 2023-10-08T12:45:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc9539b700 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bd6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc94b9a700 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc67a0 0x559275bd66c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x559275bcfa50 tx=0x7efc800987f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5da389ee40dc5117 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.981+0000 7efc78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:45:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efc78ff9700 1 -- 172.21.15.59:0/3868713447 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80010710 con 0x559275bc67a0 2023-10-08T12:45:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efc78ff9700 1 -- 172.21.15.59:0/3868713447 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efc8009a4a0 con 0x559275bc67a0 2023-10-08T12:45:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efcaafc8b80 1 -- 172.21.15.59:0/3868713447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc8009e390 con 0x559275bc67a0 2023-10-08T12:45:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efc78ff9700 1 -- 172.21.15.59:0/3868713447 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc8009a660 con 0x559275bc67a0 2023-10-08T12:45:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efcaafc8b80 10 client.26012 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efcaafc8b80 1 -- 172.21.15.59:0/3868713447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5592759432b0 con 0x559275bc67a0 2023-10-08T12:45:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efc78ff9700 1 -- 172.21.15.59:0/3868713447 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc8009e390 con 0x559275bc67a0 2023-10-08T12:45:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efc78ff9700 1 -- 172.21.15.59:0/3868713447 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efc80096030 con 0x559275bc67a0 2023-10-08T12:45:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efcaafc8b80 10 client.26012 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efcaafc8b80 10 client.26012 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efcaafc8b80 20 client.26012 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559275c358c0 0x559275c37cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efcaafc8b80 4 client.26012 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:45:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.982+0000 7efcaafc8b80 1 -- 172.21.15.59:0/3868713447 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559275b12b30 con 0x559275c358c0 2023-10-08T12:45:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.983+0000 7efc9539b700 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559275c358c0 0x559275c37cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.983+0000 7efc9539b700 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559275c358c0 0x559275c37cb0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa91fa1ea133fd1f server_cookie=54425b394fde2826 in_seq=0 out_seq=0 2023-10-08T12:45:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.983+0000 7efc78ff9700 10 client.26012 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:40.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.984+0000 7efc78ff9700 1 -- 172.21.15.59:0/3868713447 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559275b12b30 con 0x559275c358c0 2023-10-08T12:45:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.984+0000 7efc78ff9700 10 client.26012 handle_command_reply: tid=0 2023-10-08T12:45:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.984+0000 7efcaafc8b80 1 client.26012 shutdown 2023-10-08T12:45:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.984+0000 7efcaafc8b80 1 -- 172.21.15.59:0/3868713447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc67a0 msgr2=0x559275bd66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.984+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc67a0 0x559275bd66c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x559275bcfa50 tx=0x7efc800987f0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.984+0000 7efcaafc8b80 1 -- 172.21.15.59:0/3868713447 shutdown_connections 2023-10-08T12:45:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.984+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559275c358c0 0x559275c37cb0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.984+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559275bd1650 0x559275c33fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.984+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559275bc5e80 0x559275bd6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efc78ff9700 0 client.26012 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efcaafc8b80 1 --2- 172.21.15.59:0/3868713447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559275bc67a0 0x559275bd66c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efcaafc8b80 1 -- 172.21.15.59:0/3868713447 >> 172.21.15.59:0/3868713447 conn(0x559275b3b260 msgr2=0x559275bc1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efcaafc8b80 1 -- 172.21.15.59:0/3868713447 shutdown_connections 2023-10-08T12:45:40.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efcaafc8b80 1 -- 172.21.15.59:0/3868713447 wait complete. 2023-10-08T12:45:40.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efcaafc8b80 20 client.26012 trim_cache size 0 max 16384 2023-10-08T12:45:40.991 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:45:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efc975ff700 1 -- 172.21.15.59:0/490288715 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc7c0a1670 msgr2=0x7efc7c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efc975ff700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc7c0a1670 0x7efc7c0a3b30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efc88009fd0 tx=0x7efc88009490 comp rx=0 tx=0).stop 2023-10-08T12:45:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efc975ff700 1 -- 172.21.15.59:0/490288715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc90101100 msgr2=0x7efc901992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efc975ff700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc90101100 0x7efc901992e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efc8000e9a0 tx=0x7efc8000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efc975ff700 1 -- 172.21.15.59:0/490288715 shutdown_connections 2023-10-08T12:45:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efc975ff700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7efc7c0a1670 0x7efc7c0a3b30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efc975ff700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc90106750 0x7efc9019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efc975ff700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc90100740 0x7efc90198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efc975ff700 1 --2- 172.21.15.59:0/490288715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc90101100 0x7efc901992e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.985+0000 7efc975ff700 1 -- 172.21.15.59:0/490288715 >> 172.21.15.59:0/490288715 conn(0x7efc900fc230 msgr2=0x7efc900fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.986+0000 7efc975ff700 1 -- 172.21.15.59:0/490288715 shutdown_connections 2023-10-08T12:45:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:40.986+0000 7efc975ff700 1 -- 172.21.15.59:0/490288715 wait complete. 2023-10-08T12:45:41.002 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:40 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3992851520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:45:41.126 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:40 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3992851520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:45:41.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:40 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3992851520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:45:41.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 507377 14.00 MB/sec execute 72 sec latency 14.256 ms 2023-10-08T12:45:42.005 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:45:42.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:45:42.071 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:41 smithi059 ceph-mon[98489]: pgmap v449: 97 pgs: 97 active+clean; 274 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 295 op/s 2023-10-08T12:45:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:41 smithi092 ceph-mon[134093]: pgmap v449: 97 pgs: 97 active+clean; 274 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 295 op/s 2023-10-08T12:45:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:41 smithi173 ceph-mon[135182]: pgmap v449: 97 pgs: 97 active+clean; 274 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 295 op/s 2023-10-08T12:45:42.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.225+0000 7f40fd3ff700 1 -- 172.21.15.59:0/1120434985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f810d000 msgr2=0x7f40f810f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.225+0000 7f40fd3ff700 1 --2- 172.21.15.59:0/1120434985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f810d000 0x7f40f810f3f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f40f000b0a0 tx=0x7f40f000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.226+0000 7f40fd3ff700 1 -- 172.21.15.59:0/1120434985 shutdown_connections 2023-10-08T12:45:42.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.226+0000 7f40fd3ff700 1 --2- 172.21.15.59:0/1120434985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f810d000 0x7f40f810f3f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.226+0000 7f40fd3ff700 1 --2- 172.21.15.59:0/1120434985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f8072ba0 0x7f40f8072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.226+0000 7f40fd3ff700 1 --2- 172.21.15.59:0/1120434985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40f80734c0 0x7f40f810cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.226+0000 7f40fd3ff700 1 -- 172.21.15.59:0/1120434985 >> 172.21.15.59:0/1120434985 conn(0x7f40f80fc230 msgr2=0x7f40f80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.226+0000 7f40fd3ff700 1 -- 172.21.15.59:0/1120434985 shutdown_connections 2023-10-08T12:45:42.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.226+0000 7f40fd3ff700 1 -- 172.21.15.59:0/1120434985 wait complete. 2023-10-08T12:45:42.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.227+0000 7f40fd3ff700 1 Processor -- start 2023-10-08T12:45:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.227+0000 7f40fd3ff700 1 -- start start 2023-10-08T12:45:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.227+0000 7f40fd3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f8072ba0 0x7f40f8198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.227+0000 7f40fd3ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40f80734c0 0x7f40f8199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.227+0000 7f40fd3ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f810d000 0x7f40f819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.227+0000 7f40fd3ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f819de70 con 0x7f40f80734c0 2023-10-08T12:45:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.227+0000 7f40fd3ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f819dfe0 con 0x7f40f810d000 2023-10-08T12:45:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.227+0000 7f40fd3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f819e1a0 con 0x7f40f8072ba0 2023-10-08T12:45:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f8072ba0 0x7f40f8198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40f80734c0 0x7f40f8199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f810d000 0x7f40f819d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f8072ba0 0x7f40f8198f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44354/0 (socket says 172.21.15.59:44354) 2023-10-08T12:45:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40f80734c0 0x7f40f8199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53660/0 (socket says 172.21.15.59:53660) 2023-10-08T12:45:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f6ffd700 1 -- 172.21.15.59:0/2327672343 learned_addr learned my addr 172.21.15.59:0/2327672343 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f77fe700 1 -- 172.21.15.59:0/2327672343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f8072ba0 msgr2=0x7f40f8198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f77fe700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f8072ba0 0x7f40f8198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f77fe700 1 -- 172.21.15.59:0/2327672343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40f80734c0 msgr2=0x7f40f8199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f77fe700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40f80734c0 0x7f40f8199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f77fe700 1 -- 172.21.15.59:0/2327672343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f0009d00 con 0x7f40f810d000 2023-10-08T12:45:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.228+0000 7f40f77fe700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f810d000 0x7f40f819d830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f40f000b070 tx=0x7f40f0007860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.229+0000 7f40dffff700 1 -- 172.21.15.59:0/2327672343 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f000e040 con 0x7f40f810d000 2023-10-08T12:45:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.229+0000 7f40dffff700 1 -- 172.21.15.59:0/2327672343 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40f001d470 con 0x7f40f810d000 2023-10-08T12:45:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.229+0000 7f40dffff700 1 -- 172.21.15.59:0/2327672343 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0005280 con 0x7f40f810d000 2023-10-08T12:45:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.229+0000 7f40fd3ff700 1 -- 172.21.15.59:0/2327672343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f819e420 con 0x7f40f810d000 2023-10-08T12:45:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.229+0000 7f40fd3ff700 1 -- 172.21.15.59:0/2327672343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f81a5cc0 con 0x7f40f810d000 2023-10-08T12:45:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.232+0000 7f40dffff700 1 -- 172.21.15.59:0/2327672343 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f40f001d5e0 con 0x7f40f810d000 2023-10-08T12:45:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.233+0000 7f4110d56b80 1 Processor -- start 2023-10-08T12:45:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.233+0000 7f40dffff700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40e00a1670 0x7f40e00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.233+0000 7f40dffff700 1 -- 172.21.15.59:0/2327672343 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f40f00ce380 con 0x7f40f810d000 2023-10-08T12:45:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.233+0000 7f4110d56b80 1 -- start start 2023-10-08T12:45:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f40f67fc700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40e00a1670 0x7f40e00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf58f00 0x5567edf592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf59820 0x5567edf64190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edf66ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f4110d56b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567edec24e0 con 0x5567edf59820 2023-10-08T12:45:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f4110d56b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567edeb3ca0 con 0x5567edf58f00 2023-10-08T12:45:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f4110d56b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567edeb15c0 con 0x5567edf646d0 2023-10-08T12:45:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f40f6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf58f00 0x5567edf592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f40f6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf58f00 0x5567edf592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52918/0 (socket says 172.21.15.59:52918) 2023-10-08T12:45:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f40f6ffd700 1 -- 172.21.15.59:0/1872092566 learned_addr learned my addr 172.21.15.59:0/1872092566 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f40f77fe700 1 --2- 172.21.15.59:0/1872092566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edf66ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f40f67fc700 1 --2- 172.21.15.59:0/1872092566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf59820 0x5567edf64190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f40f67fc700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40e00a1670 0x7f40e00a3b30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f40f819a4a0 tx=0x7f40ec011440 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f40f6ffd700 1 -- 172.21.15.59:0/1872092566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 msgr2=0x5567edf66ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f40f6ffd700 1 --2- 172.21.15.59:0/1872092566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edf66ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f40f6ffd700 1 -- 172.21.15.59:0/1872092566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf59820 msgr2=0x5567edf64190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.234+0000 7f40f6ffd700 1 --2- 172.21.15.59:0/1872092566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf59820 0x5567edf64190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.235+0000 7f40f6ffd700 1 -- 172.21.15.59:0/1872092566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567edcd7e60 con 0x5567edf58f00 2023-10-08T12:45:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.235+0000 7f40f6ffd700 1 --2- 172.21.15.59:0/1872092566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf58f00 0x5567edf592e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009e80 tx=0x7f40e8011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c72b08b917ea8d43 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.235+0000 7f40dd7fa700 1 -- 172.21.15.59:0/1872092566 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8004a30 con 0x5567edf58f00 2023-10-08T12:45:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.235+0000 7f40dd7fa700 1 -- 172.21.15.59:0/1872092566 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40e80054e0 con 0x5567edf58f00 2023-10-08T12:45:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.235+0000 7f40dd7fa700 1 -- 172.21.15.59:0/1872092566 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e80198b0 con 0x5567edf58f00 2023-10-08T12:45:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.236+0000 7f4110d56b80 1 -- 172.21.15.59:0/1872092566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf58f00 msgr2=0x5567edf592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.236+0000 7f4110d56b80 1 --2- 172.21.15.59:0/1872092566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf58f00 0x5567edf592e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009e80 tx=0x7f40e8011720 comp rx=0 tx=0).stop 2023-10-08T12:45:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.236+0000 7f4110d56b80 1 -- 172.21.15.59:0/1872092566 shutdown_connections 2023-10-08T12:45:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.236+0000 7f4110d56b80 1 --2- 172.21.15.59:0/1872092566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf58f00 0x5567edf592e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.236+0000 7f4110d56b80 1 --2- 172.21.15.59:0/1872092566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edf66ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.236+0000 7f4110d56b80 1 --2- 172.21.15.59:0/1872092566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf59820 0x5567edf64190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.236+0000 7f4110d56b80 1 -- 172.21.15.59:0/1872092566 >> 172.21.15.59:0/1872092566 conn(0x5567edece2e0 msgr2=0x5567edf55350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.236+0000 7f4110d56b80 1 -- 172.21.15.59:0/1872092566 shutdown_connections 2023-10-08T12:45:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.236+0000 7f4110d56b80 1 -- 172.21.15.59:0/1872092566 wait complete. 2023-10-08T12:45:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.237+0000 7f4110d56b80 1 -- start start 2023-10-08T12:45:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.237+0000 7f4110d56b80 1 Processor -- start 2023-10-08T12:45:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf58f00 0x5567edf640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf613d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edf61a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f4110d56b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567edeaceb0 con 0x5567edf58f00 2023-10-08T12:45:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f4110d56b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ede49790 con 0x5567edf59820 2023-10-08T12:45:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f4110d56b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567ede49430 con 0x5567edf646d0 2023-10-08T12:45:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f4110d56b80 10 client.0 _ll_register_callbacks cb 0x5567edca6880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f40f67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f40f67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf613d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52926/0 (socket says 172.21.15.59:52926) 2023-10-08T12:45:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f40f67fc700 1 -- 172.21.15.59:0/515410477 learned_addr learned my addr 172.21.15.59:0/515410477 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f40f6ffd700 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf58f00 0x5567edf640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f40f77fe700 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edf61a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f40f67fc700 1 -- 172.21.15.59:0/515410477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 msgr2=0x5567edf61a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f40f67fc700 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edf61a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f40f67fc700 1 -- 172.21.15.59:0/515410477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf58f00 msgr2=0x5567edf640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f40f67fc700 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf58f00 0x5567edf640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f40f67fc700 1 -- 172.21.15.59:0/515410477 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e8009a80 con 0x5567edf59820 2023-10-08T12:45:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.238+0000 7f40f77fe700 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edf61a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.239+0000 7f40f67fc700 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf613d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f40ec01e9a0 tx=0x7f40ec0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e7ddea5995807c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.239+0000 7f40daff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:45:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.239+0000 7f40daff5700 1 -- 172.21.15.59:0/515410477 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec00f9d0 con 0x5567edf59820 2023-10-08T12:45:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.239+0000 7f4110d56b80 1 -- 172.21.15.59:0/515410477 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567ede74f30 con 0x5567edf59820 2023-10-08T12:45:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.239+0000 7f40daff5700 1 -- 172.21.15.59:0/515410477 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f40ec00fb30 con 0x5567edf59820 2023-10-08T12:45:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.239+0000 7f40daff5700 1 -- 172.21.15.59:0/515410477 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40ec00fd30 con 0x5567edf59820 2023-10-08T12:45:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.239+0000 7f4110d56b80 10 client.26024 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.239+0000 7f4110d56b80 1 -- 172.21.15.59:0/515410477 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5567edcc0ce0 con 0x5567edf59820 2023-10-08T12:45:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.239+0000 7f40daff5700 1 -- 172.21.15.59:0/515410477 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5567ede74f30 con 0x5567edf59820 2023-10-08T12:45:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.239+0000 7f40daff5700 1 -- 172.21.15.59:0/515410477 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f40ec026480 con 0x5567edf59820 2023-10-08T12:45:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.240+0000 7f4110d56b80 10 client.26024 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.240+0000 7f4110d56b80 10 client.26024 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.240+0000 7f4110d56b80 20 client.26024 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.240+0000 7f4110d56b80 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5567edf74310 0x5567edf76730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.240+0000 7f4110d56b80 4 client.26024 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:45:42.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.240+0000 7f4110d56b80 1 -- 172.21.15.59:0/515410477 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5567edea5e90 con 0x5567edf74310 2023-10-08T12:45:42.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.240+0000 7f40f6ffd700 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5567edf74310 0x5567edf76730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.240+0000 7f40f6ffd700 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5567edf74310 0x5567edf76730 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d2ca6ec285459fa server_cookie=88be7c7e80c70fe0 in_seq=0 out_seq=0 2023-10-08T12:45:42.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.240+0000 7f40daff5700 10 client.26024 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:42.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f40daff5700 1 -- 172.21.15.59:0/515410477 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5567edea5e90 con 0x5567edf74310 2023-10-08T12:45:42.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f40daff5700 10 client.26024 handle_command_reply: tid=0 2023-10-08T12:45:42.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f4110d56b80 1 client.26024 shutdown 2023-10-08T12:45:42.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f4110d56b80 1 -- 172.21.15.59:0/515410477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 msgr2=0x5567edf613d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f4110d56b80 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf613d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f40ec01e9a0 tx=0x7f40ec0047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f4110d56b80 1 -- 172.21.15.59:0/515410477 shutdown_connections 2023-10-08T12:45:42.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f4110d56b80 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5567edf74310 0x5567edf76730 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f4110d56b80 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edf61a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f4110d56b80 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf58f00 0x5567edf640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f4110d56b80 1 --2- 172.21.15.59:0/515410477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf613d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f40daff5700 0 client.26024 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.242+0000 7f4110d56b80 1 -- 172.21.15.59:0/515410477 >> 172.21.15.59:0/515410477 conn(0x5567edece2e0 msgr2=0x5567edf54f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.243+0000 7f4110d56b80 1 -- 172.21.15.59:0/515410477 shutdown_connections 2023-10-08T12:45:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.243+0000 7f4110d56b80 1 -- 172.21.15.59:0/515410477 wait complete. 2023-10-08T12:45:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.243+0000 7f4110d56b80 20 client.26024 trim_cache size 0 max 16384 2023-10-08T12:45:42.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.266+0000 7f4110d56b80 1 Processor -- start 2023-10-08T12:45:42.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.266+0000 7f4110d56b80 1 -- start start 2023-10-08T12:45:42.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf58f00 0x5567edf5bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf6b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf646d0 0x5567edf5fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f4110d56b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567edf66f80 con 0x5567edf646d0 2023-10-08T12:45:42.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f4110d56b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567edd2d9a0 con 0x5567edf59820 2023-10-08T12:45:42.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f4110d56b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567edf4f5f0 con 0x5567edf58f00 2023-10-08T12:45:42.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f40f67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf6b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f40f77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf646d0 0x5567edf5fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f40f6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf58f00 0x5567edf5bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f40f67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf6b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52940/0 (socket says 172.21.15.59:52940) 2023-10-08T12:45:42.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f40f67fc700 1 -- 172.21.15.59:0/4252506276 learned_addr learned my addr 172.21.15.59:0/4252506276 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:42.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f40f67fc700 1 -- 172.21.15.59:0/4252506276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf58f00 msgr2=0x5567edf5bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f40f67fc700 1 --2- 172.21.15.59:0/4252506276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf58f00 0x5567edf5bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f40f67fc700 1 -- 172.21.15.59:0/4252506276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf646d0 msgr2=0x5567edf5fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f40f67fc700 1 --2- 172.21.15.59:0/4252506276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf646d0 0x5567edf5fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.267+0000 7f40f67fc700 1 -- 172.21.15.59:0/4252506276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567edf60f30 con 0x5567edf59820 2023-10-08T12:45:42.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.268+0000 7f40f67fc700 1 --2- 172.21.15.59:0/4252506276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf6b220 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009af0 tx=0x7f40ec0118a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55158b911ea6e8c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.268+0000 7f40ddffb700 1 -- 172.21.15.59:0/4252506276 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec026c00 con 0x5567edf59820 2023-10-08T12:45:42.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.268+0000 7f40ddffb700 1 -- 172.21.15.59:0/4252506276 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40ec0263f0 con 0x5567edf59820 2023-10-08T12:45:42.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.268+0000 7f40ddffb700 1 -- 172.21.15.59:0/4252506276 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec030830 con 0x5567edf59820 2023-10-08T12:45:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.269+0000 7f4110d56b80 1 -- 172.21.15.59:0/4252506276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 msgr2=0x5567edf6b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.269+0000 7f4110d56b80 1 --2- 172.21.15.59:0/4252506276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf6b220 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009af0 tx=0x7f40ec0118a0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.269+0000 7f4110d56b80 1 -- 172.21.15.59:0/4252506276 shutdown_connections 2023-10-08T12:45:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.269+0000 7f4110d56b80 1 --2- 172.21.15.59:0/4252506276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf646d0 0x5567edf5fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.269+0000 7f4110d56b80 1 --2- 172.21.15.59:0/4252506276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf58f00 0x5567edf5bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.269+0000 7f4110d56b80 1 --2- 172.21.15.59:0/4252506276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf6b220 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.269+0000 7f4110d56b80 1 -- 172.21.15.59:0/4252506276 >> 172.21.15.59:0/4252506276 conn(0x5567edece2e0 msgr2=0x5567edf61390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.269+0000 7f4110d56b80 1 -- 172.21.15.59:0/4252506276 shutdown_connections 2023-10-08T12:45:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.269+0000 7f4110d56b80 1 -- 172.21.15.59:0/4252506276 wait complete. 2023-10-08T12:45:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.269+0000 7f4110d56b80 1 -- start start 2023-10-08T12:45:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.269+0000 7f4110d56b80 1 Processor -- start 2023-10-08T12:45:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf58f00 0x5567edf680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f4110d56b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edfc8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f4110d56b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567edfc8680 con 0x5567edf58f00 2023-10-08T12:45:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f4110d56b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567edfc87c0 con 0x5567edf59820 2023-10-08T12:45:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f4110d56b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567edfc8950 con 0x5567edf646d0 2023-10-08T12:45:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f4110d56b80 10 client.0 _ll_register_callbacks cb 0x7f40ec01e760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f40f67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f40f67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf685f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52956/0 (socket says 172.21.15.59:52956) 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f40f67fc700 1 -- 172.21.15.59:0/1029291193 learned_addr learned my addr 172.21.15.59:0/1029291193 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f40f77fe700 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edfc8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.270+0000 7f40f6ffd700 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf58f00 0x5567edf680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f40f67fc700 1 -- 172.21.15.59:0/1029291193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 msgr2=0x5567edfc8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f40f67fc700 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edfc8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f40f67fc700 1 -- 172.21.15.59:0/1029291193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf58f00 msgr2=0x5567edf680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f40f67fc700 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf58f00 0x5567edf680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f40f67fc700 1 -- 172.21.15.59:0/1029291193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567edcc0ce0 con 0x5567edf59820 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f40f67fc700 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf685f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f40ec011940 tx=0x7f40ec026a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dc37dcee3e40d7d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f40daff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f40daff5700 1 -- 172.21.15.59:0/1029291193 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec005450 con 0x5567edf59820 2023-10-08T12:45:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f4110d56b80 1 -- 172.21.15.59:0/1029291193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40e80054e0 con 0x5567edf59820 2023-10-08T12:45:42.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f40daff5700 1 -- 172.21.15.59:0/1029291193 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f40ec0055b0 con 0x5567edf59820 2023-10-08T12:45:42.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f40daff5700 1 -- 172.21.15.59:0/1029291193 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40ec004790 con 0x5567edf59820 2023-10-08T12:45:42.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f4110d56b80 10 client.26030 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:42.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.271+0000 7f4110d56b80 1 -- 172.21.15.59:0/1029291193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5567edf51320 con 0x5567edf59820 2023-10-08T12:45:42.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.272+0000 7f40daff5700 1 -- 172.21.15.59:0/1029291193 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40e80054e0 con 0x5567edf59820 2023-10-08T12:45:42.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.272+0000 7f40daff5700 1 -- 172.21.15.59:0/1029291193 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f40ec00fbd0 con 0x5567edf59820 2023-10-08T12:45:42.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.272+0000 7f4110d56b80 10 client.26030 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:42.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.272+0000 7f4110d56b80 10 client.26030 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:42.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.272+0000 7f4110d56b80 20 client.26030 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:42.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.272+0000 7f4110d56b80 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5567edfc9c60 0x5567edfcc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.272+0000 7f4110d56b80 4 client.26030 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:45:42.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.272+0000 7f4110d56b80 1 -- 172.21.15.59:0/1029291193 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5567edea5bb0 con 0x5567edfc9c60 2023-10-08T12:45:42.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.272+0000 7f40f6ffd700 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5567edfc9c60 0x5567edfcc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.272+0000 7f40daff5700 10 client.26030 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:42.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.272+0000 7f40f6ffd700 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5567edfc9c60 0x5567edfcc050 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1a9a7918bcc9793 server_cookie=cd5ff88b79f09dfa in_seq=0 out_seq=0 2023-10-08T12:45:42.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f40daff5700 1 -- 172.21.15.59:0/1029291193 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5567edea5bb0 con 0x5567edfc9c60 2023-10-08T12:45:42.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f40daff5700 10 client.26030 handle_command_reply: tid=0 2023-10-08T12:45:42.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f4110d56b80 1 client.26030 shutdown 2023-10-08T12:45:42.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f4110d56b80 1 -- 172.21.15.59:0/1029291193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 msgr2=0x5567edf685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f4110d56b80 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf685f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f40ec011940 tx=0x7f40ec026a80 comp rx=0 tx=0).stop 2023-10-08T12:45:42.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f4110d56b80 1 -- 172.21.15.59:0/1029291193 shutdown_connections 2023-10-08T12:45:42.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f4110d56b80 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5567edfc9c60 0x5567edfcc050 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f4110d56b80 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5567edf646d0 0x5567edfc8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f4110d56b80 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5567edf58f00 0x5567edf680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f40daff5700 0 client.26030 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:42.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f4110d56b80 1 --2- 172.21.15.59:0/1029291193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567edf59820 0x5567edf685f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f4110d56b80 1 -- 172.21.15.59:0/1029291193 >> 172.21.15.59:0/1029291193 conn(0x5567edece2e0 msgr2=0x5567edf5fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f4110d56b80 1 -- 172.21.15.59:0/1029291193 shutdown_connections 2023-10-08T12:45:42.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.293+0000 7f4110d56b80 1 -- 172.21.15.59:0/1029291193 wait complete. 2023-10-08T12:45:42.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.294+0000 7f4110d56b80 20 client.26030 trim_cache size 0 max 16384 2023-10-08T12:45:42.296 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:45:42.296 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:45:42.296 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "8f0e366b-2db2-4a87-96b4-d813a00efbea", 2023-10-08T12:45:42.297 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:45:42.297 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:45:42.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.294+0000 7f40fd3ff700 1 -- 172.21.15.59:0/2327672343 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40e00a1670 msgr2=0x7f40e00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.294+0000 7f40fd3ff700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40e00a1670 0x7f40e00a3b30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f40f819a4a0 tx=0x7f40ec011440 comp rx=0 tx=0).stop 2023-10-08T12:45:42.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.294+0000 7f40fd3ff700 1 -- 172.21.15.59:0/2327672343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f810d000 msgr2=0x7f40f819d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.294+0000 7f40fd3ff700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f810d000 0x7f40f819d830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f40f000b070 tx=0x7f40f0007860 comp rx=0 tx=0).stop 2023-10-08T12:45:42.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.294+0000 7f40fd3ff700 1 -- 172.21.15.59:0/2327672343 shutdown_connections 2023-10-08T12:45:42.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.294+0000 7f40fd3ff700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40e00a1670 0x7f40e00a3b30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.294+0000 7f40fd3ff700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f810d000 0x7f40f819d830 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.294+0000 7f40fd3ff700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f8072ba0 0x7f40f8198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.294+0000 7f40fd3ff700 1 --2- 172.21.15.59:0/2327672343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40f80734c0 0x7f40f8199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.294+0000 7f40fd3ff700 1 -- 172.21.15.59:0/2327672343 >> 172.21.15.59:0/2327672343 conn(0x7f40f80fc230 msgr2=0x7f40f80fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.295+0000 7f40fd3ff700 1 -- 172.21.15.59:0/2327672343 shutdown_connections 2023-10-08T12:45:42.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.295+0000 7f40fd3ff700 1 -- 172.21.15.59:0/2327672343 wait complete. 2023-10-08T12:45:42.319 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:45:42.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 509091 13.94 MB/sec execute 73 sec latency 113.015 ms 2023-10-08T12:45:42.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.563+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/3315853932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4067ce0 msgr2=0x7f7fd40680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.563+0000 7f7fdb3ff700 1 --2- 172.21.15.59:0/3315853932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4067ce0 0x7f7fd40680c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000b0a0 tx=0x7f7fd000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.564+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/3315853932 shutdown_connections 2023-10-08T12:45:42.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.564+0000 7f7fdb3ff700 1 --2- 172.21.15.59:0/3315853932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4067ce0 0x7f7fd40680c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.564+0000 7f7fdb3ff700 1 --2- 172.21.15.59:0/3315853932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fd4105b80 0x7f7fd410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.564+0000 7f7fdb3ff700 1 --2- 172.21.15.59:0/3315853932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd41051c0 0x7f7fd4105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.564+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/3315853932 >> 172.21.15.59:0/3315853932 conn(0x7f7fd4076780 msgr2=0x7f7fd4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.564+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/3315853932 shutdown_connections 2023-10-08T12:45:42.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.564+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/3315853932 wait complete. 2023-10-08T12:45:42.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.565+0000 7f7fdb3ff700 1 Processor -- start 2023-10-08T12:45:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.565+0000 7f7fdb3ff700 1 -- start start 2023-10-08T12:45:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.565+0000 7f7fdb3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fd4067ce0 0x7f7fd4198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.565+0000 7f7fdb3ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd41051c0 0x7f7fd4199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.565+0000 7f7fdb3ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd4105b80 0x7f7fd419d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.565+0000 7f7fdb3ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd419def0 con 0x7f7fd4105b80 2023-10-08T12:45:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.565+0000 7f7fdb3ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd419e060 con 0x7f7fd41051c0 2023-10-08T12:45:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.565+0000 7f7fdb3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd419e220 con 0x7f7fd4067ce0 2023-10-08T12:45:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd999c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd4105b80 0x7f7fd419d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd899a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd41051c0 0x7f7fd4199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd999c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd4105b80 0x7f7fd419d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53716/0 (socket says 172.21.15.59:53716) 2023-10-08T12:45:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd999c700 1 -- 172.21.15.59:0/2950023696 learned_addr learned my addr 172.21.15.59:0/2950023696 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd899a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd41051c0 0x7f7fd4199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52982/0 (socket says 172.21.15.59:52982) 2023-10-08T12:45:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd919b700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fd4067ce0 0x7f7fd4198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd999c700 1 -- 172.21.15.59:0/2950023696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fd4067ce0 msgr2=0x7f7fd4198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd999c700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fd4067ce0 0x7f7fd4198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd999c700 1 -- 172.21.15.59:0/2950023696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd41051c0 msgr2=0x7f7fd4199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd999c700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd41051c0 0x7f7fd4199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd999c700 1 -- 172.21.15.59:0/2950023696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0009d00 con 0x7f7fd4105b80 2023-10-08T12:45:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd899a700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd41051c0 0x7f7fd4199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fd999c700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd4105b80 0x7f7fd419d8b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00e940 tx=0x7f7fcc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.566+0000 7f7fca7fc700 1 -- 172.21.15.59:0/2950023696 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0097b0 con 0x7f7fd4105b80 2023-10-08T12:45:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.567+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/2950023696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd419e500 con 0x7f7fd4105b80 2023-10-08T12:45:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.567+0000 7f7fca7fc700 1 -- 172.21.15.59:0/2950023696 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fcc005020 con 0x7f7fd4105b80 2023-10-08T12:45:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.567+0000 7f7fca7fc700 1 -- 172.21.15.59:0/2950023696 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc00cc40 con 0x7f7fd4105b80 2023-10-08T12:45:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.567+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/2950023696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd41a5d40 con 0x7f7fd4105b80 2023-10-08T12:45:42.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.570+0000 7f7fca7fc700 1 -- 172.21.15.59:0/2950023696 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7fcc005400 con 0x7f7fd4105b80 2023-10-08T12:45:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7feec3ab80 1 Processor -- start 2023-10-08T12:45:42.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7feec3ab80 1 -- start start 2023-10-08T12:45:42.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 0x558d12d5b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 0x558d12d66110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d68a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12cc4460 con 0x558d12d5b7a0 2023-10-08T12:45:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12cb5c20 con 0x558d12d5ae80 2023-10-08T12:45:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12cb3540 con 0x558d12d66650 2023-10-08T12:45:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7fca7fc700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7fc00a15f0 0x7f7fc00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7fd899a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 0x558d12d5b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7fd899a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 0x558d12d5b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52998/0 (socket says 172.21.15.59:52998) 2023-10-08T12:45:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.572+0000 7f7fd899a700 1 -- 172.21.15.59:0/1768094506 learned_addr learned my addr 172.21.15.59:0/1768094506 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fd919b700 1 --2- 172.21.15.59:0/1768094506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 0x558d12d66110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fca7fc700 1 -- 172.21.15.59:0/2950023696 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7fcc014070 con 0x7f7fd4105b80 2023-10-08T12:45:42.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fd899a700 1 --2- 172.21.15.59:0/1768094506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d68a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fd899a700 1 -- 172.21.15.59:0/1768094506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 msgr2=0x558d12d68a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fd899a700 1 --2- 172.21.15.59:0/1768094506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d68a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fd899a700 1 -- 172.21.15.59:0/1768094506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 msgr2=0x558d12d66110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fd899a700 1 --2- 172.21.15.59:0/1768094506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 0x558d12d66110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fd899a700 1 -- 172.21.15.59:0/1768094506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d12ad9de0 con 0x558d12d5ae80 2023-10-08T12:45:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fd999c700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7fc00a15f0 0x7f7fc00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fd899a700 1 --2- 172.21.15.59:0/1768094506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 0x558d12d5b260 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4013a50 tx=0x7f7fc4009ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7956bbb2755325 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fbf7fe700 1 -- 172.21.15.59:0/1768094506 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4004030 con 0x558d12d5ae80 2023-10-08T12:45:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fbf7fe700 1 -- 172.21.15.59:0/1768094506 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fc400f850 con 0x558d12d5ae80 2023-10-08T12:45:42.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.573+0000 7f7fbf7fe700 1 -- 172.21.15.59:0/1768094506 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4003a20 con 0x558d12d5ae80 2023-10-08T12:45:42.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.574+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1768094506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 msgr2=0x558d12d5b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.574+0000 7f7fd999c700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7fc00a15f0 0x7f7fc00a3ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0967a0 tx=0x7f7fcc086040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.574+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/1768094506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 0x558d12d5b260 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4013a50 tx=0x7f7fc4009ce0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.574+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1768094506 shutdown_connections 2023-10-08T12:45:42.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.574+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/1768094506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 0x558d12d5b260 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.574+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/1768094506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d68a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.574+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/1768094506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 0x558d12d66110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.574+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1768094506 >> 172.21.15.59:0/1768094506 conn(0x558d12cd0260 msgr2=0x558d12d572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.575+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1768094506 shutdown_connections 2023-10-08T12:45:42.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.575+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1768094506 wait complete. 2023-10-08T12:45:42.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.575+0000 7f7feec3ab80 1 -- start start 2023-10-08T12:45:42.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.576+0000 7f7feec3ab80 1 Processor -- start 2023-10-08T12:45:42.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.576+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5ae80 0x558d12d66030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.576+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d5b7a0 0x558d12d63320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.576+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d66650 0x558d12d63980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.576+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12caee30 con 0x558d12d5ae80 2023-10-08T12:45:42.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.576+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12c4b710 con 0x558d12d66650 2023-10-08T12:45:42.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.576+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12c4b3b0 con 0x558d12d5b7a0 2023-10-08T12:45:42.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7feec3ab80 10 client.0 _ll_register_callbacks cb 0x558d12aa8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:42.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd919b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d5b7a0 0x558d12d63320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd919b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d5b7a0 0x558d12d63320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:44434/0 (socket says 172.21.15.59:44434) 2023-10-08T12:45:42.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd919b700 1 -- 172.21.15.59:0/2789417198 learned_addr learned my addr 172.21.15.59:0/2789417198 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:42.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd899a700 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5ae80 0x558d12d66030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd899a700 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d66650 0x558d12d63980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd919b700 1 -- 172.21.15.59:0/2789417198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d66650 msgr2=0x558d12d63980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd919b700 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d66650 0x558d12d63980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd919b700 1 -- 172.21.15.59:0/2789417198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5ae80 msgr2=0x558d12d66030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd919b700 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5ae80 0x558d12d66030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd919b700 1 -- 172.21.15.59:0/2789417198 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc4013620 con 0x558d12d5b7a0 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd899a700 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5ae80 0x558d12d66030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.577+0000 7f7fd919b700 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d5b7a0 0x558d12d63320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000b0a0 tx=0x7f7fd000bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491db76b57741786 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.578+0000 7f7fbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.578+0000 7f7fbcff9700 1 -- 172.21.15.59:0/2789417198 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000e040 con 0x558d12d5b7a0 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.578+0000 7f7feec3ab80 1 -- 172.21.15.59:0/2789417198 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d12c76eb0 con 0x558d12d5b7a0 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.578+0000 7f7fbcff9700 1 -- 172.21.15.59:0/2789417198 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7fd0009480 con 0x558d12d5b7a0 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.578+0000 7f7fbcff9700 1 -- 172.21.15.59:0/2789417198 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fd00074e0 con 0x558d12d5b7a0 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.578+0000 7f7feec3ab80 10 client.26038 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.578+0000 7f7feec3ab80 1 -- 172.21.15.59:0/2789417198 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x558d12ac2c60 con 0x558d12d5b7a0 2023-10-08T12:45:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.578+0000 7f7fbcff9700 1 -- 172.21.15.59:0/2789417198 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558d12c76eb0 con 0x558d12d5b7a0 2023-10-08T12:45:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.579+0000 7f7fbcff9700 1 -- 172.21.15.59:0/2789417198 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7fd0023020 con 0x558d12d5b7a0 2023-10-08T12:45:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.579+0000 7f7feec3ab80 10 client.26038 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.579+0000 7f7feec3ab80 10 client.26038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.579+0000 7f7feec3ab80 20 client.26038 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.579+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558d12d76190 0x558d12d785b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.579+0000 7f7feec3ab80 4 client.26038 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:45:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.579+0000 7f7feec3ab80 1 -- 172.21.15.59:0/2789417198 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d12ca7e10 con 0x558d12d76190 2023-10-08T12:45:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.579+0000 7f7fd899a700 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558d12d76190 0x558d12d785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.579+0000 7f7fd899a700 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558d12d76190 0x558d12d785b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e33fbdda4e972a40 server_cookie=bd4f773e6303152 in_seq=0 out_seq=0 2023-10-08T12:45:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.579+0000 7f7fbcff9700 10 client.26038 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7fbcff9700 1 -- 172.21.15.59:0/2789417198 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558d12ca7e10 con 0x558d12d76190 2023-10-08T12:45:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7fbcff9700 10 client.26038 handle_command_reply: tid=0 2023-10-08T12:45:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7feec3ab80 1 client.26038 shutdown 2023-10-08T12:45:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7feec3ab80 1 -- 172.21.15.59:0/2789417198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d5b7a0 msgr2=0x558d12d63320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d5b7a0 0x558d12d63320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000b0a0 tx=0x7f7fd000bd90 comp rx=0 tx=0).stop 2023-10-08T12:45:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7feec3ab80 1 -- 172.21.15.59:0/2789417198 shutdown_connections 2023-10-08T12:45:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558d12d76190 0x558d12d785b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d66650 0x558d12d63980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5ae80 0x558d12d66030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/2789417198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d5b7a0 0x558d12d63320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7fbcff9700 0 client.26038 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7feec3ab80 1 -- 172.21.15.59:0/2789417198 >> 172.21.15.59:0/2789417198 conn(0x558d12cd0260 msgr2=0x558d12d56ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7feec3ab80 1 -- 172.21.15.59:0/2789417198 shutdown_connections 2023-10-08T12:45:42.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.581+0000 7f7feec3ab80 1 -- 172.21.15.59:0/2789417198 wait complete. 2023-10-08T12:45:42.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.582+0000 7f7feec3ab80 20 client.26038 trim_cache size 0 max 16384 2023-10-08T12:45:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.600+0000 7f7feec3ab80 1 Processor -- start 2023-10-08T12:45:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.600+0000 7f7feec3ab80 1 -- start start 2023-10-08T12:45:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 0x558d12d6d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 0x558d12d61bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d62130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12b2f920 con 0x558d12d5b7a0 2023-10-08T12:45:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12d642c0 con 0x558d12d5ae80 2023-10-08T12:45:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12d62670 con 0x558d12d66650 2023-10-08T12:45:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7fd919b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 0x558d12d61bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7fd919b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 0x558d12d61bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53732/0 (socket says 172.21.15.59:53732) 2023-10-08T12:45:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7fd919b700 1 -- 172.21.15.59:0/52627271 learned_addr learned my addr 172.21.15.59:0/52627271 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7fd899a700 1 --2- 172.21.15.59:0/52627271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 0x558d12d6d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7fd899a700 1 --2- 172.21.15.59:0/52627271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d62130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7fd919b700 1 -- 172.21.15.59:0/52627271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 msgr2=0x558d12d62130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7fd919b700 1 --2- 172.21.15.59:0/52627271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d62130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7fd919b700 1 -- 172.21.15.59:0/52627271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 msgr2=0x558d12d6d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7fd919b700 1 --2- 172.21.15.59:0/52627271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 0x558d12d6d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.601+0000 7f7fd919b700 1 -- 172.21.15.59:0/52627271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d12b00250 con 0x558d12d5b7a0 2023-10-08T12:45:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.602+0000 7f7fd899a700 1 --2- 172.21.15.59:0/52627271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 0x558d12d6d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.602+0000 7f7fd919b700 1 --2- 172.21.15.59:0/52627271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 0x558d12d61bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00059f0 tx=0x7f7fd0009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b129f3f1ae14d58 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.602+0000 7f7fbffff700 1 -- 172.21.15.59:0/52627271 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000e030 con 0x558d12d5b7a0 2023-10-08T12:45:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.602+0000 7f7fbffff700 1 -- 172.21.15.59:0/52627271 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fd0007960 con 0x558d12d5b7a0 2023-10-08T12:45:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.602+0000 7f7fbffff700 1 -- 172.21.15.59:0/52627271 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00054e0 con 0x558d12d5b7a0 2023-10-08T12:45:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.603+0000 7f7feec3ab80 1 -- 172.21.15.59:0/52627271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 msgr2=0x558d12d61bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.603+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/52627271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 0x558d12d61bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00059f0 tx=0x7f7fd0009a60 comp rx=0 tx=0).stop 2023-10-08T12:45:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.603+0000 7f7feec3ab80 1 -- 172.21.15.59:0/52627271 shutdown_connections 2023-10-08T12:45:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.603+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/52627271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5ae80 0x558d12d6d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.603+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/52627271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d62130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.603+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/52627271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5b7a0 0x558d12d61bf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.603+0000 7f7feec3ab80 1 -- 172.21.15.59:0/52627271 >> 172.21.15.59:0/52627271 conn(0x558d12cd0260 msgr2=0x558d12d5e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.603+0000 7f7feec3ab80 1 -- 172.21.15.59:0/52627271 shutdown_connections 2023-10-08T12:45:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.603+0000 7f7feec3ab80 1 -- 172.21.15.59:0/52627271 wait complete. 2023-10-08T12:45:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.603+0000 7f7feec3ab80 1 -- start start 2023-10-08T12:45:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.604+0000 7f7feec3ab80 1 Processor -- start 2023-10-08T12:45:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.604+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5ae80 0x558d12d6d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.604+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5b7a0 0x558d12d6b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.604+0000 7f7feec3ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d6bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.604+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12d6c2f0 con 0x558d12d5ae80 2023-10-08T12:45:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.604+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12d6c460 con 0x558d12d5b7a0 2023-10-08T12:45:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.604+0000 7f7feec3ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d12dc9fb0 con 0x558d12d66650 2023-10-08T12:45:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.604+0000 7f7feec3ab80 10 client.0 _ll_register_callbacks cb 0x7f7fd0007e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.604+0000 7f7fd919b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5b7a0 0x558d12d6b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fd919b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5b7a0 0x558d12d6b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53020/0 (socket says 172.21.15.59:53020) 2023-10-08T12:45:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fd919b700 1 -- 172.21.15.59:0/1082647669 learned_addr learned my addr 172.21.15.59:0/1082647669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:45:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fd899a700 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5ae80 0x558d12d6d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fd899a700 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d6bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fd919b700 1 -- 172.21.15.59:0/1082647669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 msgr2=0x558d12d6bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fd919b700 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d6bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fd919b700 1 -- 172.21.15.59:0/1082647669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5ae80 msgr2=0x558d12d6d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fd919b700 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5ae80 0x558d12d6d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fd919b700 1 -- 172.21.15.59:0/1082647669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d12ad9de0 con 0x558d12d5b7a0 2023-10-08T12:45:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fd899a700 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d6bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fd919b700 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5b7a0 0x558d12d6b6d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0005970 tx=0x7f7fd0006230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50a9499f719d3ff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:45:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fbcff9700 1 -- 172.21.15.59:0/1082647669 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000e040 con 0x558d12d5b7a0 2023-10-08T12:45:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1082647669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7fc400f850 con 0x558d12d5b7a0 2023-10-08T12:45:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.605+0000 7f7fbcff9700 1 -- 172.21.15.59:0/1082647669 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7fd00093f0 con 0x558d12d5b7a0 2023-10-08T12:45:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.606+0000 7f7fbcff9700 1 -- 172.21.15.59:0/1082647669 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fd0003c10 con 0x558d12d5b7a0 2023-10-08T12:45:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.606+0000 7f7feec3ab80 10 client.26048 fetch_fsmap learned FSMap version 20 2023-10-08T12:45:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.606+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1082647669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x558d12ac2c60 con 0x558d12d5b7a0 2023-10-08T12:45:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.606+0000 7f7fbcff9700 1 -- 172.21.15.59:0/1082647669 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fc400f850 con 0x558d12d5b7a0 2023-10-08T12:45:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.606+0000 7f7fbcff9700 1 -- 172.21.15.59:0/1082647669 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7fd0023070 con 0x558d12d5b7a0 2023-10-08T12:45:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.606+0000 7f7feec3ab80 10 client.26048 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:45:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.606+0000 7f7feec3ab80 10 client.26048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.606+0000 7f7feec3ab80 20 client.26048 populate_metadata read hostname 'smithi059' 2023-10-08T12:45:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.606+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558d12dcb200 0x558d12dcd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.606+0000 7f7feec3ab80 4 client.26048 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:45:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.606+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1082647669 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558d12ca7b30 con 0x558d12dcb200 2023-10-08T12:45:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.607+0000 7f7fd899a700 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558d12dcb200 0x558d12dcd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.607+0000 7f7fd899a700 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558d12dcb200 0x558d12dcd5f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb51e1128bdb5ac6 server_cookie=3b003bca2caaa7db in_seq=0 out_seq=0 2023-10-08T12:45:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.607+0000 7f7fbcff9700 10 client.26048 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.607+0000 7f7fbcff9700 1 -- 172.21.15.59:0/1082647669 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558d12ca7b30 con 0x558d12dcb200 2023-10-08T12:45:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.607+0000 7f7fbcff9700 10 client.26048 handle_command_reply: tid=0 2023-10-08T12:45:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.607+0000 7f7feec3ab80 1 client.26048 shutdown 2023-10-08T12:45:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.607+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1082647669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5b7a0 msgr2=0x558d12d6b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.607+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5b7a0 0x558d12d6b6d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0005970 tx=0x7f7fd0006230 comp rx=0 tx=0).stop 2023-10-08T12:45:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1082647669 shutdown_connections 2023-10-08T12:45:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558d12dcb200 0x558d12dcd5f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d12d66650 0x558d12d6bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7fbcff9700 0 client.26048 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:45:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d12d5ae80 0x558d12d6d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7feec3ab80 1 --2- 172.21.15.59:0/1082647669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d12d5b7a0 0x558d12d6b6d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1082647669 >> 172.21.15.59:0/1082647669 conn(0x558d12cd0260 msgr2=0x558d12d61b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1082647669 shutdown_connections 2023-10-08T12:45:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7feec3ab80 1 -- 172.21.15.59:0/1082647669 wait complete. 2023-10-08T12:45:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7feec3ab80 20 client.26048 trim_cache size 0 max 16384 2023-10-08T12:45:42.614 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:45:42.615 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:45:42.615 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:45:42.615 INFO:teuthology.orchestra.run.smithi059.stdout: "8f0e366b-2db2-4a87-96b4-d813a00efbea": { 2023-10-08T12:45:42.615 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:45:42.615 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "8f0e366b-2db2-4a87-96b4-d813a00efbea", 2023-10-08T12:45:42.615 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:45:42.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:45:42.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:45:42.615 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:45:42.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/2950023696 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7fc00a15f0 msgr2=0x7f7fc00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7fdb3ff700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7fc00a15f0 0x7f7fc00a3ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0967a0 tx=0x7f7fcc086040 comp rx=0 tx=0).stop 2023-10-08T12:45:42.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/2950023696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd4105b80 msgr2=0x7f7fd419d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.608+0000 7f7fdb3ff700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd4105b80 0x7f7fd419d8b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00e940 tx=0x7f7fcc00ec50 comp rx=0 tx=0).stop 2023-10-08T12:45:42.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.609+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/2950023696 shutdown_connections 2023-10-08T12:45:42.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.609+0000 7f7fdb3ff700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7fc00a15f0 0x7f7fc00a3ab0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.609+0000 7f7fdb3ff700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fd4105b80 0x7f7fd419d8b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.609+0000 7f7fdb3ff700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fd4067ce0 0x7f7fd4198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.609+0000 7f7fdb3ff700 1 --2- 172.21.15.59:0/2950023696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd41051c0 0x7f7fd4199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.609+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/2950023696 >> 172.21.15.59:0/2950023696 conn(0x7f7fd4076780 msgr2=0x7f7fd410be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.609+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/2950023696 shutdown_connections 2023-10-08T12:45:42.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:45:42.609+0000 7f7fdb3ff700 1 -- 172.21.15.59:0/2950023696 wait complete. 2023-10-08T12:45:42.629 INFO:tasks.cephfs.filesystem:scrub status for tag:8f0e366b-2db2-4a87-96b4-d813a00efbea - {'path': '/', 'tag': '8f0e366b-2db2-4a87-96b4-d813a00efbea', 'options': 'recursive,force'} 2023-10-08T12:45:43.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:42 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:45:43.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:42 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:43.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:42 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:45:43.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:42 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:43.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:42 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:45:43.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:42 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:45:43.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:42 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:43.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:42 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:45:43.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:42 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:43.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:42 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:45:43.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:42 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:45:43.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:42 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:43.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:42 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:45:43.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:42 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:45:43.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:42 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:45:43.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 511961 13.99 MB/sec execute 74 sec latency 12.563 ms 2023-10-08T12:45:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:43 smithi173 ceph-mon[135182]: pgmap v450: 97 pgs: 97 active+clean; 275 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 276 op/s 2023-10-08T12:45:44.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:43 smithi059 ceph-mon[98489]: pgmap v450: 97 pgs: 97 active+clean; 275 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 276 op/s 2023-10-08T12:45:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:43 smithi092 ceph-mon[134093]: pgmap v450: 97 pgs: 97 active+clean; 275 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 276 op/s 2023-10-08T12:45:44.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 514921 13.99 MB/sec execute 75 sec latency 7.080 ms 2023-10-08T12:45:45.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 516612 13.94 MB/sec execute 76 sec latency 59.930 ms 2023-10-08T12:45:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:45 smithi173 ceph-mon[135182]: pgmap v451: 97 pgs: 97 active+clean; 274 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 216 op/s 2023-10-08T12:45:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:45 smithi059 ceph-mon[98489]: pgmap v451: 97 pgs: 97 active+clean; 274 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 216 op/s 2023-10-08T12:45:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:45 smithi092 ceph-mon[134093]: pgmap v451: 97 pgs: 97 active+clean; 274 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 216 op/s 2023-10-08T12:45:46.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 519412 13.94 MB/sec execute 77 sec latency 36.370 ms 2023-10-08T12:45:47.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 522597 14.00 MB/sec execute 78 sec latency 6.497 ms 2023-10-08T12:45:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:47 smithi173 ceph-mon[135182]: pgmap v452: 97 pgs: 97 active+clean; 282 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 283 op/s 2023-10-08T12:45:48.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:47 smithi059 ceph-mon[98489]: pgmap v452: 97 pgs: 97 active+clean; 282 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 283 op/s 2023-10-08T12:45:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:47 smithi092 ceph-mon[134093]: pgmap v452: 97 pgs: 97 active+clean; 282 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 283 op/s 2023-10-08T12:45:48.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 525110 13.98 MB/sec execute 79 sec latency 112.113 ms 2023-10-08T12:45:49.509 INFO:tasks.workunit.client.0.smithi059.stdout: 1 527654 13.96 MB/sec execute 80 sec latency 6.740 ms 2023-10-08T12:45:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:49 smithi092 ceph-mon[134093]: pgmap v453: 97 pgs: 97 active+clean; 287 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 285 op/s 2023-10-08T12:45:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:49 smithi173 ceph-mon[135182]: pgmap v453: 97 pgs: 97 active+clean; 287 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 285 op/s 2023-10-08T12:45:50.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:49 smithi059 ceph-mon[98489]: pgmap v453: 97 pgs: 97 active+clean; 287 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 285 op/s 2023-10-08T12:45:50.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 529771 13.96 MB/sec execute 81 sec latency 68.646 ms 2023-10-08T12:45:51.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 532897 14.00 MB/sec execute 82 sec latency 31.544 ms 2023-10-08T12:45:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:51 smithi173 ceph-mon[135182]: pgmap v454: 97 pgs: 97 active+clean; 285 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 260 op/s 2023-10-08T12:45:52.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:51 smithi059 ceph-mon[98489]: pgmap v454: 97 pgs: 97 active+clean; 285 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 260 op/s 2023-10-08T12:45:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:51 smithi092 ceph-mon[134093]: pgmap v454: 97 pgs: 97 active+clean; 285 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 260 op/s 2023-10-08T12:45:52.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 535385 13.95 MB/sec execute 83 sec latency 36.987 ms 2023-10-08T12:45:53.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 537468 13.94 MB/sec execute 84 sec latency 85.512 ms 2023-10-08T12:45:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:53 smithi173 ceph-mon[135182]: pgmap v455: 97 pgs: 97 active+clean; 292 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 269 op/s 2023-10-08T12:45:54.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:53 smithi059 ceph-mon[98489]: pgmap v455: 97 pgs: 97 active+clean; 292 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 269 op/s 2023-10-08T12:45:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:53 smithi092 ceph-mon[134093]: pgmap v455: 97 pgs: 97 active+clean; 292 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 269 op/s 2023-10-08T12:45:54.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 540370 13.98 MB/sec execute 85 sec latency 7.080 ms 2023-10-08T12:45:55.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 542375 13.90 MB/sec execute 86 sec latency 87.931 ms 2023-10-08T12:45:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:55 smithi173 ceph-mon[135182]: pgmap v456: 97 pgs: 97 active+clean; 292 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 248 op/s 2023-10-08T12:45:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:55 smithi059 ceph-mon[98489]: pgmap v456: 97 pgs: 97 active+clean; 292 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 248 op/s 2023-10-08T12:45:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:55 smithi092 ceph-mon[134093]: pgmap v456: 97 pgs: 97 active+clean; 292 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 248 op/s 2023-10-08T12:45:56.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 544444 13.88 MB/sec execute 87 sec latency 29.629 ms 2023-10-08T12:45:57.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 547454 13.93 MB/sec execute 88 sec latency 8.161 ms 2023-10-08T12:45:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:57 smithi173 ceph-mon[135182]: pgmap v457: 97 pgs: 97 active+clean; 303 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 303 op/s 2023-10-08T12:45:58.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:57 smithi059 ceph-mon[98489]: pgmap v457: 97 pgs: 97 active+clean; 303 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 303 op/s 2023-10-08T12:45:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:57 smithi092 ceph-mon[134093]: pgmap v457: 97 pgs: 97 active+clean; 303 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 303 op/s 2023-10-08T12:45:58.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 550431 13.94 MB/sec execute 89 sec latency 18.702 ms 2023-10-08T12:45:59.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 552992 13.91 MB/sec execute 90 sec latency 7.864 ms 2023-10-08T12:46:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:45:59 smithi092 ceph-mon[134093]: pgmap v458: 97 pgs: 97 active+clean; 313 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 276 op/s 2023-10-08T12:46:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:45:59 smithi173 ceph-mon[135182]: pgmap v458: 97 pgs: 97 active+clean; 313 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 276 op/s 2023-10-08T12:46:00.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:45:59 smithi059 ceph-mon[98489]: pgmap v458: 97 pgs: 97 active+clean; 313 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 276 op/s 2023-10-08T12:46:00.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 554893 13.90 MB/sec execute 91 sec latency 64.751 ms 2023-10-08T12:46:01.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 557134 13.88 MB/sec execute 92 sec latency 24.512 ms 2023-10-08T12:46:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:01 smithi173 ceph-mon[135182]: pgmap v459: 97 pgs: 97 active+clean; 320 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.7 MiB/s wr, 245 op/s 2023-10-08T12:46:02.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:01 smithi059 ceph-mon[98489]: pgmap v459: 97 pgs: 97 active+clean; 320 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.7 MiB/s wr, 245 op/s 2023-10-08T12:46:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:01 smithi092 ceph-mon[134093]: pgmap v459: 97 pgs: 97 active+clean; 320 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.7 MiB/s wr, 245 op/s 2023-10-08T12:46:02.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 559845 13.86 MB/sec execute 93 sec latency 7.593 ms 2023-10-08T12:46:03.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 562312 13.88 MB/sec execute 94 sec latency 8.079 ms 2023-10-08T12:46:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:03 smithi173 ceph-mon[135182]: pgmap v460: 97 pgs: 97 active+clean; 326 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.5 MiB/s wr, 319 op/s 2023-10-08T12:46:04.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:03 smithi059 ceph-mon[98489]: pgmap v460: 97 pgs: 97 active+clean; 326 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.5 MiB/s wr, 319 op/s 2023-10-08T12:46:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:03 smithi092 ceph-mon[134093]: pgmap v460: 97 pgs: 97 active+clean; 326 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.5 MiB/s wr, 319 op/s 2023-10-08T12:46:04.510 INFO:tasks.workunit.client.0.smithi059.stdout: 1 565222 13.91 MB/sec execute 95 sec latency 27.118 ms 2023-10-08T12:46:05.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 567704 13.90 MB/sec execute 96 sec latency 119.494 ms 2023-10-08T12:46:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:05 smithi173 ceph-mon[135182]: pgmap v461: 97 pgs: 97 active+clean; 326 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.3 MiB/s wr, 258 op/s 2023-10-08T12:46:06.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:05 smithi059 ceph-mon[98489]: pgmap v461: 97 pgs: 97 active+clean; 326 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.3 MiB/s wr, 258 op/s 2023-10-08T12:46:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:05 smithi092 ceph-mon[134093]: pgmap v461: 97 pgs: 97 active+clean; 326 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.3 MiB/s wr, 258 op/s 2023-10-08T12:46:06.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 569903 13.88 MB/sec execute 97 sec latency 32.728 ms 2023-10-08T12:46:07.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 572598 13.88 MB/sec execute 98 sec latency 17.013 ms 2023-10-08T12:46:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:07 smithi173 ceph-mon[135182]: pgmap v462: 97 pgs: 97 active+clean; 326 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 276 op/s 2023-10-08T12:46:08.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:07 smithi059 ceph-mon[98489]: pgmap v462: 97 pgs: 97 active+clean; 326 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 276 op/s 2023-10-08T12:46:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:07 smithi092 ceph-mon[134093]: pgmap v462: 97 pgs: 97 active+clean; 326 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 276 op/s 2023-10-08T12:46:08.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 575735 13.93 MB/sec execute 99 sec latency 11.967 ms 2023-10-08T12:46:09.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 578445 13.92 MB/sec execute 100 sec latency 8.763 ms 2023-10-08T12:46:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:09 smithi092 ceph-mon[134093]: pgmap v463: 97 pgs: 97 active+clean; 334 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 291 op/s 2023-10-08T12:46:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:09 smithi173 ceph-mon[135182]: pgmap v463: 97 pgs: 97 active+clean; 334 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 291 op/s 2023-10-08T12:46:10.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:09 smithi059 ceph-mon[98489]: pgmap v463: 97 pgs: 97 active+clean; 334 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 291 op/s 2023-10-08T12:46:10.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 579434 13.84 MB/sec execute 101 sec latency 271.090 ms 2023-10-08T12:46:11.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 582351 13.85 MB/sec execute 102 sec latency 19.264 ms 2023-10-08T12:46:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:11 smithi173 ceph-mon[135182]: pgmap v464: 97 pgs: 97 active+clean; 335 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 267 op/s 2023-10-08T12:46:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:11 smithi059 ceph-mon[98489]: pgmap v464: 97 pgs: 97 active+clean; 335 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 267 op/s 2023-10-08T12:46:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:11 smithi092 ceph-mon[134093]: pgmap v464: 97 pgs: 97 active+clean; 335 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 267 op/s 2023-10-08T12:46:12.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 584981 13.83 MB/sec execute 103 sec latency 8.947 ms 2023-10-08T12:46:12.630 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:46:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.869+0000 7f0154bff700 1 -- 172.21.15.59:0/1002804336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0150100730 msgr2=0x7f0150100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.869+0000 7f0154bff700 1 --2- 172.21.15.59:0/1002804336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0150100730 0x7f0150100bb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0144009990 tx=0x7f0144009ca0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.869+0000 7f0154bff700 1 -- 172.21.15.59:0/1002804336 shutdown_connections 2023-10-08T12:46:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.869+0000 7f0154bff700 1 --2- 172.21.15.59:0/1002804336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01501010f0 0x7f015010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.869+0000 7f0154bff700 1 --2- 172.21.15.59:0/1002804336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150106740 0x7f0150106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.869+0000 7f0154bff700 1 --2- 172.21.15.59:0/1002804336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0150100730 0x7f0150100bb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.869+0000 7f0154bff700 1 -- 172.21.15.59:0/1002804336 >> 172.21.15.59:0/1002804336 conn(0x7f01500fc200 msgr2=0x7f01500fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.869+0000 7f0154bff700 1 -- 172.21.15.59:0/1002804336 shutdown_connections 2023-10-08T12:46:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.869+0000 7f0154bff700 1 -- 172.21.15.59:0/1002804336 wait complete. 2023-10-08T12:46:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.870+0000 7f0154bff700 1 Processor -- start 2023-10-08T12:46:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.870+0000 7f0154bff700 1 -- start start 2023-10-08T12:46:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f0154bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150100730 0x7f0150198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f0154bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01501010f0 0x7f0150199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f0154bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0150106740 0x7f015019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f0154bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015019dd00 con 0x7f01501010f0 2023-10-08T12:46:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f0154bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015019de70 con 0x7f0150106740 2023-10-08T12:46:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f0154bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015019e030 con 0x7f0150100730 2023-10-08T12:46:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f014ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0150106740 0x7f015019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f014e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150100730 0x7f0150198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f014dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01501010f0 0x7f0150199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f014ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0150106740 0x7f015019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60424/0 (socket says 172.21.15.59:60424) 2023-10-08T12:46:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f014e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150100730 0x7f0150198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:45110/0 (socket says 172.21.15.59:45110) 2023-10-08T12:46:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f014ed9d700 1 -- 172.21.15.59:0/3915682707 learned_addr learned my addr 172.21.15.59:0/3915682707 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f014ed9d700 1 -- 172.21.15.59:0/3915682707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150100730 msgr2=0x7f0150198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f014ed9d700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150100730 0x7f0150198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f014ed9d700 1 -- 172.21.15.59:0/3915682707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01501010f0 msgr2=0x7f0150199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f014ed9d700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01501010f0 0x7f0150199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.871+0000 7f014ed9d700 1 -- 172.21.15.59:0/3915682707 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0148009c40 con 0x7f0150106740 2023-10-08T12:46:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.872+0000 7f014ed9d700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0150106740 0x7f015019d6c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f014800c370 tx=0x7f014800c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.872+0000 7f013f7fe700 1 -- 172.21.15.59:0/3915682707 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148017070 con 0x7f0150106740 2023-10-08T12:46:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.872+0000 7f013f7fe700 1 -- 172.21.15.59:0/3915682707 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f014800f040 con 0x7f0150106740 2023-10-08T12:46:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.872+0000 7f0154bff700 1 -- 172.21.15.59:0/3915682707 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01440095f0 con 0x7f0150106740 2023-10-08T12:46:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.872+0000 7f013f7fe700 1 -- 172.21.15.59:0/3915682707 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014800e050 con 0x7f0150106740 2023-10-08T12:46:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.872+0000 7f0154bff700 1 -- 172.21.15.59:0/3915682707 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01501a5970 con 0x7f0150106740 2023-10-08T12:46:12.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.876+0000 7f013f7fe700 1 -- 172.21.15.59:0/3915682707 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f014800cb60 con 0x7f0150106740 2023-10-08T12:46:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.877+0000 7f013f7fe700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01380a15f0 0x7f01380a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.877+0000 7f013f7fe700 1 -- 172.21.15.59:0/3915682707 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f01480cc850 con 0x7f0150106740 2023-10-08T12:46:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.877+0000 7f01685ccb80 1 Processor -- start 2023-10-08T12:46:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.878+0000 7f014e59c700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01380a15f0 0x7f01380a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.878+0000 7f01685ccb80 1 -- start start 2023-10-08T12:46:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.878+0000 7f014e59c700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01380a15f0 0x7f01380a3ab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0140009be0 tx=0x7f0140009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.878+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4de80 0x55d2a8d4e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d59110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d59650 0x55d2a8d5ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f01685ccb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8cb7460 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f01685ccb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8ca8c20 con 0x55d2a8d59650 2023-10-08T12:46:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f01685ccb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8ca6540 con 0x55d2a8d4de80 2023-10-08T12:46:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f014ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d59650 0x55d2a8d5ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f014e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4de80 0x55d2a8d4e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f014ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d59650 0x55d2a8d5ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60430/0 (socket says 172.21.15.59:60430) 2023-10-08T12:46:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f014ed9d700 1 -- 172.21.15.59:0/1970289323 learned_addr learned my addr 172.21.15.59:0/1970289323 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f014dd9b700 1 --2- 172.21.15.59:0/1970289323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d59110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f014e59c700 1 -- 172.21.15.59:0/1970289323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d59650 msgr2=0x55d2a8d5ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f014e59c700 1 --2- 172.21.15.59:0/1970289323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d59650 0x55d2a8d5ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f014e59c700 1 -- 172.21.15.59:0/1970289323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d4e7a0 msgr2=0x55d2a8d59110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f014e59c700 1 --2- 172.21.15.59:0/1970289323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d59110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.879+0000 7f014e59c700 1 -- 172.21.15.59:0/1970289323 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2a8accde0 con 0x55d2a8d4de80 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.880+0000 7f014e59c700 1 --2- 172.21.15.59:0/1970289323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4de80 0x55d2a8d4e260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0140011cd0 tx=0x7f0140014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7119c5d0e1b12c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.880+0000 7f013cff9700 1 -- 172.21.15.59:0/1970289323 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400119e0 con 0x55d2a8d4de80 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.880+0000 7f013cff9700 1 -- 172.21.15.59:0/1970289323 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f014000ed00 con 0x55d2a8d4de80 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.880+0000 7f013cff9700 1 -- 172.21.15.59:0/1970289323 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014001d3b0 con 0x55d2a8d4de80 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.881+0000 7f01685ccb80 1 -- 172.21.15.59:0/1970289323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4de80 msgr2=0x55d2a8d4e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.881+0000 7f01685ccb80 1 --2- 172.21.15.59:0/1970289323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4de80 0x55d2a8d4e260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0140011cd0 tx=0x7f0140014000 comp rx=0 tx=0).stop 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.881+0000 7f01685ccb80 1 -- 172.21.15.59:0/1970289323 shutdown_connections 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.881+0000 7f01685ccb80 1 --2- 172.21.15.59:0/1970289323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d59650 0x55d2a8d5ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.881+0000 7f01685ccb80 1 --2- 172.21.15.59:0/1970289323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4de80 0x55d2a8d4e260 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.881+0000 7f01685ccb80 1 --2- 172.21.15.59:0/1970289323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d59110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.881+0000 7f01685ccb80 1 -- 172.21.15.59:0/1970289323 >> 172.21.15.59:0/1970289323 conn(0x55d2a8cc3260 msgr2=0x55d2a8d4a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.881+0000 7f01685ccb80 1 -- 172.21.15.59:0/1970289323 shutdown_connections 2023-10-08T12:46:12.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.881+0000 7f01685ccb80 1 -- 172.21.15.59:0/1970289323 wait complete. 2023-10-08T12:46:12.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.882+0000 7f01685ccb80 1 -- start start 2023-10-08T12:46:12.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.882+0000 7f01685ccb80 1 Processor -- start 2023-10-08T12:46:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.882+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d4de80 0x55d2a8d59060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d59650 0x55d2a8d569f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f01685ccb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8ca1e30 con 0x55d2a8d4de80 2023-10-08T12:46:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f01685ccb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8c3e710 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f01685ccb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8c3e3b0 con 0x55d2a8d59650 2023-10-08T12:46:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f01685ccb80 10 client.0 _ll_register_callbacks cb 0x55d2a8a9b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f014dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f014dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60432/0 (socket says 172.21.15.59:60432) 2023-10-08T12:46:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f014dd9b700 1 -- 172.21.15.59:0/406340329 learned_addr learned my addr 172.21.15.59:0/406340329 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f014e59c700 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d4de80 0x55d2a8d59060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f014ed9d700 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d59650 0x55d2a8d569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f014dd9b700 1 -- 172.21.15.59:0/406340329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d59650 msgr2=0x55d2a8d569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f014dd9b700 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d59650 0x55d2a8d569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f014dd9b700 1 -- 172.21.15.59:0/406340329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d4de80 msgr2=0x55d2a8d59060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f014dd9b700 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d4de80 0x55d2a8d59060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f014dd9b700 1 -- 172.21.15.59:0/406340329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0140017070 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.883+0000 7f014e59c700 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d4de80 0x55d2a8d59060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.884+0000 7f014dd9b700 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d563e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0144015000 tx=0x7f0144005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa377aeb97f3081 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.884+0000 7f0135ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.884+0000 7f0135ffb700 1 -- 172.21.15.59:0/406340329 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014401d070 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.884+0000 7f01685ccb80 1 -- 172.21.15.59:0/406340329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2a8c69eb0 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.884+0000 7f0135ffb700 1 -- 172.21.15.59:0/406340329 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0144004500 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.884+0000 7f0135ffb700 1 -- 172.21.15.59:0/406340329 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01440046c0 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.884+0000 7f01685ccb80 10 client.26060 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.884+0000 7f01685ccb80 1 -- 172.21.15.59:0/406340329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55d2a8ab5c60 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.885+0000 7f0135ffb700 1 -- 172.21.15.59:0/406340329 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d2a8c69eb0 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.885+0000 7f0135ffb700 1 -- 172.21.15.59:0/406340329 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0144024820 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.885+0000 7f01685ccb80 10 client.26060 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.885+0000 7f01685ccb80 10 client.26060 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.885+0000 7f01685ccb80 20 client.26060 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.885+0000 7f01685ccb80 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d2a8d691e0 0x55d2a8d6b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.885+0000 7f01685ccb80 4 client.26060 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.885+0000 7f01685ccb80 1 -- 172.21.15.59:0/406340329 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2a8c9ae10 con 0x55d2a8d691e0 2023-10-08T12:46:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.885+0000 7f014e59c700 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d2a8d691e0 0x55d2a8d6b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.886+0000 7f014e59c700 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d2a8d691e0 0x55d2a8d6b600 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fac06dc473cf1ba5 server_cookie=666cc05741ddcf74 in_seq=0 out_seq=0 2023-10-08T12:46:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.886+0000 7f0135ffb700 10 client.26060 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f0135ffb700 1 -- 172.21.15.59:0/406340329 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d2a8c9ae10 con 0x55d2a8d691e0 2023-10-08T12:46:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f0135ffb700 10 client.26060 handle_command_reply: tid=0 2023-10-08T12:46:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f01685ccb80 1 client.26060 shutdown 2023-10-08T12:46:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f01685ccb80 1 -- 172.21.15.59:0/406340329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 msgr2=0x55d2a8d563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f01685ccb80 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d563e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0144015000 tx=0x7f0144005800 comp rx=0 tx=0).stop 2023-10-08T12:46:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f01685ccb80 1 -- 172.21.15.59:0/406340329 shutdown_connections 2023-10-08T12:46:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f01685ccb80 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d2a8d691e0 0x55d2a8d6b600 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f01685ccb80 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d59650 0x55d2a8d569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f01685ccb80 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d4de80 0x55d2a8d59060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f0135ffb700 0 client.26060 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f01685ccb80 1 --2- 172.21.15.59:0/406340329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d563e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f01685ccb80 1 -- 172.21.15.59:0/406340329 >> 172.21.15.59:0/406340329 conn(0x55d2a8cc3260 msgr2=0x55d2a8d49ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f01685ccb80 1 -- 172.21.15.59:0/406340329 shutdown_connections 2023-10-08T12:46:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.887+0000 7f01685ccb80 1 -- 172.21.15.59:0/406340329 wait complete. 2023-10-08T12:46:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.888+0000 7f01685ccb80 20 client.26060 trim_cache size 0 max 16384 2023-10-08T12:46:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.906+0000 7f01685ccb80 1 Processor -- start 2023-10-08T12:46:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f01685ccb80 1 -- start start 2023-10-08T12:46:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4de80 0x55d2a8d601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d54c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d59650 0x55d2a8d551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f01685ccb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8b22920 con 0x55d2a8d59650 2023-10-08T12:46:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f01685ccb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8d4f0d0 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f01685ccb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8d58c80 con 0x55d2a8d4de80 2023-10-08T12:46:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f014dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d54c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f014ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d59650 0x55d2a8d551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f014dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d54c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60444/0 (socket says 172.21.15.59:60444) 2023-10-08T12:46:12.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f014dd9b700 1 -- 172.21.15.59:0/1462970818 learned_addr learned my addr 172.21.15.59:0/1462970818 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:12.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.907+0000 7f014e59c700 1 --2- 172.21.15.59:0/1462970818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4de80 0x55d2a8d601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.908+0000 7f014dd9b700 1 -- 172.21.15.59:0/1462970818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4de80 msgr2=0x55d2a8d601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:12.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.908+0000 7f014dd9b700 1 --2- 172.21.15.59:0/1462970818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4de80 0x55d2a8d601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.908+0000 7f014dd9b700 1 -- 172.21.15.59:0/1462970818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d59650 msgr2=0x55d2a8d551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:12.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.908+0000 7f014dd9b700 1 --2- 172.21.15.59:0/1462970818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d59650 0x55d2a8d551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.908+0000 7f014dd9b700 1 -- 172.21.15.59:0/1462970818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2a8af3250 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.908+0000 7f014dd9b700 1 --2- 172.21.15.59:0/1462970818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d54c90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f01440098e0 tx=0x7f014400b370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f80edab74e3af020 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.908+0000 7f013d7fa700 1 -- 172.21.15.59:0/1462970818 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014401d040 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.908+0000 7f013d7fa700 1 -- 172.21.15.59:0/1462970818 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f014401e040 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.908+0000 7f013d7fa700 1 -- 172.21.15.59:0/1462970818 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014400fb10 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.909+0000 7f01685ccb80 1 -- 172.21.15.59:0/1462970818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 msgr2=0x55d2a8d54c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.909+0000 7f01685ccb80 1 --2- 172.21.15.59:0/1462970818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d54c90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f01440098e0 tx=0x7f014400b370 comp rx=0 tx=0).stop 2023-10-08T12:46:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.909+0000 7f01685ccb80 1 -- 172.21.15.59:0/1462970818 shutdown_connections 2023-10-08T12:46:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.909+0000 7f01685ccb80 1 --2- 172.21.15.59:0/1462970818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d59650 0x55d2a8d551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.909+0000 7f01685ccb80 1 --2- 172.21.15.59:0/1462970818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4de80 0x55d2a8d601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.909+0000 7f01685ccb80 1 --2- 172.21.15.59:0/1462970818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d54c90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.909+0000 7f01685ccb80 1 -- 172.21.15.59:0/1462970818 >> 172.21.15.59:0/1462970818 conn(0x55d2a8cc3260 msgr2=0x55d2a8d516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.909+0000 7f01685ccb80 1 -- 172.21.15.59:0/1462970818 shutdown_connections 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.909+0000 7f01685ccb80 1 -- 172.21.15.59:0/1462970818 wait complete. 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.910+0000 7f01685ccb80 1 -- start start 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.910+0000 7f01685ccb80 1 Processor -- start 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4de80 0x55d2a8d600c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d5e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f01685ccb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d59650 0x55d2a8d5eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f01685ccb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8d5f070 con 0x55d2a8d59650 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f01685ccb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8d5f1e0 con 0x55d2a8d4de80 2023-10-08T12:46:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f01685ccb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2a8d5f3a0 con 0x55d2a8d4e7a0 2023-10-08T12:46:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f01685ccb80 10 client.0 _ll_register_callbacks cb 0x55d2a8a9b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f014e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4de80 0x55d2a8d600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f014e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4de80 0x55d2a8d600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60452/0 (socket says 172.21.15.59:60452) 2023-10-08T12:46:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f014e59c700 1 -- 172.21.15.59:0/3213437457 learned_addr learned my addr 172.21.15.59:0/3213437457 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f014ed9d700 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d59650 0x55d2a8d5eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f014dd9b700 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d5e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f014e59c700 1 -- 172.21.15.59:0/3213437457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4e7a0 msgr2=0x55d2a8d5e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f014e59c700 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d5e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f014e59c700 1 -- 172.21.15.59:0/3213437457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d59650 msgr2=0x55d2a8d5eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f014e59c700 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d59650 0x55d2a8d5eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f014e59c700 1 -- 172.21.15.59:0/3213437457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2a8ab5c60 con 0x55d2a8d4de80 2023-10-08T12:46:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.911+0000 7f014dd9b700 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d5e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.912+0000 7f014e59c700 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4de80 0x55d2a8d600c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f014000efd0 tx=0x7f0140011a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31988187e05ebf7c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.912+0000 7f0135ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.912+0000 7f0135ffb700 1 -- 172.21.15.59:0/3213437457 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014002b040 con 0x55d2a8d4de80 2023-10-08T12:46:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.912+0000 7f01685ccb80 1 -- 172.21.15.59:0/3213437457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f014000ed00 con 0x55d2a8d4de80 2023-10-08T12:46:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.912+0000 7f0135ffb700 1 -- 172.21.15.59:0/3213437457 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f014001e6a0 con 0x55d2a8d4de80 2023-10-08T12:46:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.912+0000 7f0135ffb700 1 -- 172.21.15.59:0/3213437457 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f014000e7c0 con 0x55d2a8d4de80 2023-10-08T12:46:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.912+0000 7f01685ccb80 10 client.26066 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.912+0000 7f01685ccb80 1 -- 172.21.15.59:0/3213437457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55d2a8acb2b0 con 0x55d2a8d4de80 2023-10-08T12:46:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.912+0000 7f0135ffb700 1 -- 172.21.15.59:0/3213437457 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f014000ed00 con 0x55d2a8d4de80 2023-10-08T12:46:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.913+0000 7f0135ffb700 1 -- 172.21.15.59:0/3213437457 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0140024020 con 0x55d2a8d4de80 2023-10-08T12:46:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.913+0000 7f01685ccb80 10 client.26066 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.913+0000 7f01685ccb80 10 client.26066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.913+0000 7f01685ccb80 20 client.26066 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.913+0000 7f01685ccb80 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d2a8dbe5e0 0x55d2a8dc0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.913+0000 7f01685ccb80 4 client.26066 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:46:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.913+0000 7f01685ccb80 1 -- 172.21.15.59:0/3213437457 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d2a8c9ab30 con 0x55d2a8dbe5e0 2023-10-08T12:46:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.913+0000 7f014dd9b700 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d2a8dbe5e0 0x55d2a8dc0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.913+0000 7f014dd9b700 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d2a8dbe5e0 0x55d2a8dc0a00 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8187e71bfccb393 server_cookie=ca37ebb511ef09 in_seq=0 out_seq=0 2023-10-08T12:46:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.913+0000 7f0135ffb700 10 client.26066 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f0135ffb700 1 -- 172.21.15.59:0/3213437457 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d2a8c9ab30 con 0x55d2a8dbe5e0 2023-10-08T12:46:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f0135ffb700 10 client.26066 handle_command_reply: tid=0 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 1 client.26066 shutdown 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 1 -- 172.21.15.59:0/3213437457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4de80 msgr2=0x55d2a8d600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4de80 0x55d2a8d600c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f014000efd0 tx=0x7f0140011a60 comp rx=0 tx=0).stop 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 1 -- 172.21.15.59:0/3213437457 shutdown_connections 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d2a8dbe5e0 0x55d2a8dc0a00 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2a8d4de80 0x55d2a8d600c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2a8d59650 0x55d2a8d5eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f0135ffb700 0 client.26066 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 1 --2- 172.21.15.59:0/3213437457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2a8d4e7a0 0x55d2a8d5e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 1 -- 172.21.15.59:0/3213437457 >> 172.21.15.59:0/3213437457 conn(0x55d2a8cc3260 msgr2=0x55d2a8d49c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 1 -- 172.21.15.59:0/3213437457 shutdown_connections 2023-10-08T12:46:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 1 -- 172.21.15.59:0/3213437457 wait complete. 2023-10-08T12:46:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.914+0000 7f01685ccb80 20 client.26066 trim_cache size 0 max 16384 2023-10-08T12:46:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:46:12.920 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:46:12.920 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:46:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:46:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 -- 172.21.15.59:0/3915682707 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01380a15f0 msgr2=0x7f01380a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01380a15f0 0x7f01380a3ab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0140009be0 tx=0x7f0140009260 comp rx=0 tx=0).stop 2023-10-08T12:46:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 -- 172.21.15.59:0/3915682707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0150106740 msgr2=0x7f015019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0150106740 0x7f015019d6c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f014800c370 tx=0x7f014800c680 comp rx=0 tx=0).stop 2023-10-08T12:46:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 -- 172.21.15.59:0/3915682707 shutdown_connections 2023-10-08T12:46:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f01380a15f0 0x7f01380a3ab0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0150106740 0x7f015019d6c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150100730 0x7f0150198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 --2- 172.21.15.59:0/3915682707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01501010f0 0x7f0150199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 -- 172.21.15.59:0/3915682707 >> 172.21.15.59:0/3915682707 conn(0x7f01500fc200 msgr2=0x7f01500fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 -- 172.21.15.59:0/3915682707 shutdown_connections 2023-10-08T12:46:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:12.915+0000 7f0154bff700 1 -- 172.21.15.59:0/3915682707 wait complete. 2023-10-08T12:46:12.935 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:46:12.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:46:13.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.158+0000 7f3d5ffff700 1 -- 172.21.15.59:0/773591284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d58102170 msgr2=0x7f3d5810a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.158+0000 7f3d5ffff700 1 --2- 172.21.15.59:0/773591284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d58102170 0x7f3d5810a650 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009990 tx=0x7f3d48009ca0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.158+0000 7f3d5ffff700 1 -- 172.21.15.59:0/773591284 shutdown_connections 2023-10-08T12:46:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.158+0000 7f3d5ffff700 1 --2- 172.21.15.59:0/773591284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d5810ac20 0x7f3d5810d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.158+0000 7f3d5ffff700 1 --2- 172.21.15.59:0/773591284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d58101850 0x7f3d58101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.158+0000 7f3d5ffff700 1 --2- 172.21.15.59:0/773591284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d58102170 0x7f3d5810a650 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.158+0000 7f3d5ffff700 1 -- 172.21.15.59:0/773591284 >> 172.21.15.59:0/773591284 conn(0x7f3d580fb030 msgr2=0x7f3d580fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.158+0000 7f3d5ffff700 1 -- 172.21.15.59:0/773591284 shutdown_connections 2023-10-08T12:46:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.158+0000 7f3d5ffff700 1 -- 172.21.15.59:0/773591284 wait complete. 2023-10-08T12:46:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.159+0000 7f3d5ffff700 1 Processor -- start 2023-10-08T12:46:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5ffff700 1 -- start start 2023-10-08T12:46:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d58101850 0x7f3d5819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d58102170 0x7f3d5819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d5810ac20 0x7f3d58196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5ffff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d58197070 con 0x7f3d58101850 2023-10-08T12:46:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5ffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d581971e0 con 0x7f3d5810ac20 2023-10-08T12:46:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5ffff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d581973a0 con 0x7f3d58102170 2023-10-08T12:46:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d5810ac20 0x7f3d58196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d58101850 0x7f3d5819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d5810ac20 0x7f3d58196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60478/0 (socket says 172.21.15.59:60478) 2023-10-08T12:46:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5e59c700 1 -- 172.21.15.59:0/1274835536 learned_addr learned my addr 172.21.15.59:0/1274835536 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.160+0000 7f3d5d59a700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d58102170 0x7f3d5819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.161+0000 7f3d5e59c700 1 -- 172.21.15.59:0/1274835536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d58102170 msgr2=0x7f3d5819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.161+0000 7f3d5e59c700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d58102170 0x7f3d5819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.161+0000 7f3d5e59c700 1 -- 172.21.15.59:0/1274835536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d58101850 msgr2=0x7f3d5819c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.161+0000 7f3d5e59c700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d58101850 0x7f3d5819c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.161+0000 7f3d5e59c700 1 -- 172.21.15.59:0/1274835536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d50009c40 con 0x7f3d5810ac20 2023-10-08T12:46:13.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.161+0000 7f3d5e59c700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d5810ac20 0x7f3d58196a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c370 tx=0x7f3d5000c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.161+0000 7f3d4effd700 1 -- 172.21.15.59:0/1274835536 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50017070 con 0x7f3d5810ac20 2023-10-08T12:46:13.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.161+0000 7f3d4effd700 1 -- 172.21.15.59:0/1274835536 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d5000f040 con 0x7f3d5810ac20 2023-10-08T12:46:13.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.161+0000 7f3d4effd700 1 -- 172.21.15.59:0/1274835536 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000e050 con 0x7f3d5810ac20 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.161+0000 7f3d5ffff700 1 -- 172.21.15.59:0/1274835536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d480095f0 con 0x7f3d5810ac20 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.162+0000 7f3d5ffff700 1 -- 172.21.15.59:0/1274835536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d580ff3d0 con 0x7f3d5810ac20 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.163+0000 7f3d5ffff700 1 -- 172.21.15.59:0/1274835536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d58105d40 con 0x7f3d5810ac20 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.165+0000 7f3d4effd700 1 -- 172.21.15.59:0/1274835536 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3d5000cb60 con 0x7f3d5810ac20 2023-10-08T12:46:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.166+0000 7f3d4effd700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d440a1670 0x7f3d440a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.166+0000 7f3d4effd700 1 -- 172.21.15.59:0/1274835536 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f3d500cc950 con 0x7f3d5810ac20 2023-10-08T12:46:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.166+0000 7f3d5dd9b700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d440a1670 0x7f3d440a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.167+0000 7f3d5dd9b700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d440a1670 0x7f3d440a3b30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009c60 tx=0x7f3d54009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.170+0000 7f3d4effd700 1 -- 172.21.15.59:0/1274835536 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3d50095cf0 con 0x7f3d5810ac20 2023-10-08T12:46:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.460+0000 7f3d5ffff700 1 -- 172.21.15.59:0/1274835536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d580680b0 con 0x7f3d5810ac20 2023-10-08T12:46:13.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.461+0000 7f3d4effd700 1 -- 172.21.15.59:0/1274835536 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f3d50099310 con 0x7f3d5810ac20 2023-10-08T12:46:13.463 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:46:13.463 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:46:13.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.464+0000 7f3d5ffff700 1 -- 172.21.15.59:0/1274835536 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d440a1670 msgr2=0x7f3d440a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.464+0000 7f3d5ffff700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d440a1670 0x7f3d440a3b30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009c60 tx=0x7f3d54009260 comp rx=0 tx=0).stop 2023-10-08T12:46:13.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.464+0000 7f3d5ffff700 1 -- 172.21.15.59:0/1274835536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d5810ac20 msgr2=0x7f3d58196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.464+0000 7f3d5ffff700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d5810ac20 0x7f3d58196a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c370 tx=0x7f3d5000c680 comp rx=0 tx=0).stop 2023-10-08T12:46:13.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.464+0000 7f3d5ffff700 1 -- 172.21.15.59:0/1274835536 shutdown_connections 2023-10-08T12:46:13.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.464+0000 7f3d5ffff700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d440a1670 0x7f3d440a3b30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.464+0000 7f3d5ffff700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d5810ac20 0x7f3d58196a10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.464+0000 7f3d5ffff700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d58101850 0x7f3d5819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.464+0000 7f3d5ffff700 1 --2- 172.21.15.59:0/1274835536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d58102170 0x7f3d5819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.464+0000 7f3d5ffff700 1 -- 172.21.15.59:0/1274835536 >> 172.21.15.59:0/1274835536 conn(0x7f3d580fb030 msgr2=0x7f3d580fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.465+0000 7f3d5ffff700 1 -- 172.21.15.59:0/1274835536 shutdown_connections 2023-10-08T12:46:13.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.465+0000 7f3d5ffff700 1 -- 172.21.15.59:0/1274835536 wait complete. 2023-10-08T12:46:13.470 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:46:13.487 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:46:13.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 587015 13.82 MB/sec execute 104 sec latency 22.139 ms 2023-10-08T12:46:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.732+0000 7f84d67ff700 1 -- 172.21.15.59:0/464549819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d0108870 msgr2=0x7f84d0108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.732+0000 7f84d67ff700 1 --2- 172.21.15.59:0/464549819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d0108870 0x7f84d0108c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009990 tx=0x7f84c0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.733+0000 7f84d67ff700 1 -- 172.21.15.59:0/464549819 shutdown_connections 2023-10-08T12:46:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.733+0000 7f84d67ff700 1 --2- 172.21.15.59:0/464549819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0103220 0x7f84d010f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.733+0000 7f84d67ff700 1 --2- 172.21.15.59:0/464549819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d0108870 0x7f84d0108c50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.733+0000 7f84d67ff700 1 --2- 172.21.15.59:0/464549819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d0102860 0x7f84d0102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.733+0000 7f84d67ff700 1 -- 172.21.15.59:0/464549819 >> 172.21.15.59:0/464549819 conn(0x7f84d00fe2f0 msgr2=0x7f84d0100710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.733+0000 7f84d67ff700 1 -- 172.21.15.59:0/464549819 shutdown_connections 2023-10-08T12:46:13.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.733+0000 7f84d67ff700 1 -- 172.21.15.59:0/464549819 wait complete. 2023-10-08T12:46:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.734+0000 7f84d67ff700 1 Processor -- start 2023-10-08T12:46:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.734+0000 7f84d67ff700 1 -- start start 2023-10-08T12:46:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.734+0000 7f84d67ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d0102860 0x7f84d019e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.734+0000 7f84d67ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0103220 0x7f84d019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.734+0000 7f84d67ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d0108870 0x7f84d0198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.734+0000 7f84d67ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d0199170 con 0x7f84d0102860 2023-10-08T12:46:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.734+0000 7f84d67ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d01992e0 con 0x7f84d0103220 2023-10-08T12:46:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.734+0000 7f84d67ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d01994a0 con 0x7f84d0108870 2023-10-08T12:46:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.735+0000 7f84cf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0103220 0x7f84d019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.735+0000 7f84cf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0103220 0x7f84d019ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60496/0 (socket says 172.21.15.59:60496) 2023-10-08T12:46:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.735+0000 7f84cf7fe700 1 -- 172.21.15.59:0/2421303781 learned_addr learned my addr 172.21.15.59:0/2421303781 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.735+0000 7f84cffff700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d0102860 0x7f84d019e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.735+0000 7f84d4d9c700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d0108870 0x7f84d0198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.735+0000 7f84cf7fe700 1 -- 172.21.15.59:0/2421303781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d0108870 msgr2=0x7f84d0198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.735+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d0108870 0x7f84d0198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.735+0000 7f84cf7fe700 1 -- 172.21.15.59:0/2421303781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d0102860 msgr2=0x7f84d019e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.735+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d0102860 0x7f84d019e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.735+0000 7f84cf7fe700 1 -- 172.21.15.59:0/2421303781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c8009c40 con 0x7f84d0103220 2023-10-08T12:46:13.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.735+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0103220 0x7f84d019ef20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f84c400ed60 tx=0x7f84c400c5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.736+0000 7f84cd7fa700 1 -- 172.21.15.59:0/2421303781 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4009790 con 0x7f84d0103220 2023-10-08T12:46:13.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.736+0000 7f84cd7fa700 1 -- 172.21.15.59:0/2421303781 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84c400cdc0 con 0x7f84d0103220 2023-10-08T12:46:13.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.736+0000 7f84cd7fa700 1 -- 172.21.15.59:0/2421303781 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c40187e0 con 0x7f84d0103220 2023-10-08T12:46:13.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.736+0000 7f84d67ff700 1 -- 172.21.15.59:0/2421303781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c00095f0 con 0x7f84d0103220 2023-10-08T12:46:13.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.736+0000 7f84d67ff700 1 -- 172.21.15.59:0/2421303781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d01a57f0 con 0x7f84d0103220 2023-10-08T12:46:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.739+0000 7f84cd7fa700 1 -- 172.21.15.59:0/2421303781 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f84c4010430 con 0x7f84d0103220 2023-10-08T12:46:13.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.740+0000 7f84ea196b80 1 Processor -- start 2023-10-08T12:46:13.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.740+0000 7f84ea196b80 1 -- start start 2023-10-08T12:46:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14ee80 0x556e2d14f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14f7a0 0x556e2d15a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d15a650 0x556e2d15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84ea196b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2d0b8460 con 0x556e2d14f7a0 2023-10-08T12:46:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84ea196b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2d0a9c20 con 0x556e2d14ee80 2023-10-08T12:46:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84ea196b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2d0a7540 con 0x556e2d15a650 2023-10-08T12:46:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84d4d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14ee80 0x556e2d14f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84cf7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d15a650 0x556e2d15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84d4d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14ee80 0x556e2d14f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60510/0 (socket says 172.21.15.59:60510) 2023-10-08T12:46:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84d4d9c700 1 -- 172.21.15.59:0/1596719529 learned_addr learned my addr 172.21.15.59:0/1596719529 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84cffff700 1 --2- 172.21.15.59:0/1596719529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14f7a0 0x556e2d15a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84cd7fa700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84b80a1660 0x7f84b80a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84d4d9c700 1 -- 172.21.15.59:0/1596719529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d15a650 msgr2=0x556e2d15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.741+0000 7f84d4d9c700 1 --2- 172.21.15.59:0/1596719529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d15a650 0x556e2d15ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.742+0000 7f84d4d9c700 1 -- 172.21.15.59:0/1596719529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14f7a0 msgr2=0x556e2d15a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.742+0000 7f84d4d9c700 1 --2- 172.21.15.59:0/1596719529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14f7a0 0x556e2d15a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.742+0000 7f84d4d9c700 1 -- 172.21.15.59:0/1596719529 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e2cecdde0 con 0x556e2d14ee80 2023-10-08T12:46:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.742+0000 7f84cd7fa700 1 -- 172.21.15.59:0/2421303781 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f84c4014070 con 0x7f84d0103220 2023-10-08T12:46:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.742+0000 7f84d4d9c700 1 --2- 172.21.15.59:0/1596719529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14ee80 0x556e2d14f260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f84c800e760 tx=0x7f84c8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f35416465dc0846 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.742+0000 7f84d4d9c700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84b80a1660 0x7f84b80a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.742+0000 7f84b67fc700 1 -- 172.21.15.59:0/1596719529 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800e040 con 0x556e2d14ee80 2023-10-08T12:46:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.742+0000 7f84b67fc700 1 -- 172.21.15.59:0/1596719529 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84c800f040 con 0x556e2d14ee80 2023-10-08T12:46:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.742+0000 7f84b67fc700 1 -- 172.21.15.59:0/1596719529 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c801ec40 con 0x556e2d14ee80 2023-10-08T12:46:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.743+0000 7f84ea196b80 1 -- 172.21.15.59:0/1596719529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14ee80 msgr2=0x556e2d14f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.743+0000 7f84ea196b80 1 --2- 172.21.15.59:0/1596719529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14ee80 0x556e2d14f260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f84c800e760 tx=0x7f84c8009920 comp rx=0 tx=0).stop 2023-10-08T12:46:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.743+0000 7f84d4d9c700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84b80a1660 0x7f84b80a3b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f84c801b000 tx=0x7f84c801ee80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.743+0000 7f84ea196b80 1 -- 172.21.15.59:0/1596719529 shutdown_connections 2023-10-08T12:46:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.743+0000 7f84ea196b80 1 --2- 172.21.15.59:0/1596719529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14ee80 0x556e2d14f260 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.743+0000 7f84ea196b80 1 --2- 172.21.15.59:0/1596719529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d15a650 0x556e2d15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.743+0000 7f84ea196b80 1 --2- 172.21.15.59:0/1596719529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14f7a0 0x556e2d15a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.743+0000 7f84ea196b80 1 -- 172.21.15.59:0/1596719529 >> 172.21.15.59:0/1596719529 conn(0x556e2d0c4260 msgr2=0x556e2d14b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.743+0000 7f84ea196b80 1 -- 172.21.15.59:0/1596719529 shutdown_connections 2023-10-08T12:46:13.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.743+0000 7f84ea196b80 1 -- 172.21.15.59:0/1596719529 wait complete. 2023-10-08T12:46:13.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.744+0000 7f84ea196b80 1 -- start start 2023-10-08T12:46:13.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.744+0000 7f84ea196b80 1 Processor -- start 2023-10-08T12:46:13.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14ee80 0x556e2d15a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d14f7a0 0x556e2d157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d15a650 0x556e2d157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84ea196b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2d0a2e30 con 0x556e2d14ee80 2023-10-08T12:46:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84ea196b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2d03f710 con 0x556e2d15a650 2023-10-08T12:46:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84ea196b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2d03f3b0 con 0x556e2d14f7a0 2023-10-08T12:46:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84ea196b80 10 client.0 _ll_register_callbacks cb 0x556e2ce9c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:13.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84d4d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d15a650 0x556e2d157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14ee80 0x556e2d15a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84d4d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d15a650 0x556e2d157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60512/0 (socket says 172.21.15.59:60512) 2023-10-08T12:46:13.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84d4d9c700 1 -- 172.21.15.59:0/3503651293 learned_addr learned my addr 172.21.15.59:0/3503651293 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:13.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d14f7a0 0x556e2d157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84d4d9c700 1 -- 172.21.15.59:0/3503651293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d14f7a0 msgr2=0x556e2d157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:13.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84d4d9c700 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d14f7a0 0x556e2d157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84d4d9c700 1 -- 172.21.15.59:0/3503651293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14ee80 msgr2=0x556e2d15a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:13.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84d4d9c700 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14ee80 0x556e2d15a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.745+0000 7f84d4d9c700 1 -- 172.21.15.59:0/3503651293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c800e410 con 0x556e2d15a650 2023-10-08T12:46:13.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.746+0000 7f84d4d9c700 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d15a650 0x556e2d157ac0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f84c800e730 tx=0x7f84c801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a802b3c472c83dd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.746+0000 7f84af7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.746+0000 7f84af7fe700 1 -- 172.21.15.59:0/3503651293 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800e050 con 0x556e2d15a650 2023-10-08T12:46:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.746+0000 7f84af7fe700 1 -- 172.21.15.59:0/3503651293 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f84c8004ca0 con 0x556e2d15a650 2023-10-08T12:46:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.746+0000 7f84ea196b80 1 -- 172.21.15.59:0/3503651293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e2d06aeb0 con 0x556e2d15a650 2023-10-08T12:46:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.746+0000 7f84af7fe700 1 -- 172.21.15.59:0/3503651293 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84c8015530 con 0x556e2d15a650 2023-10-08T12:46:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.746+0000 7f84ea196b80 10 client.26084 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.746+0000 7f84ea196b80 1 -- 172.21.15.59:0/3503651293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x556e2ceb6c60 con 0x556e2d15a650 2023-10-08T12:46:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.746+0000 7f84af7fe700 1 -- 172.21.15.59:0/3503651293 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556e2d06aeb0 con 0x556e2d15a650 2023-10-08T12:46:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.747+0000 7f84af7fe700 1 -- 172.21.15.59:0/3503651293 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f84c8027070 con 0x556e2d15a650 2023-10-08T12:46:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.747+0000 7f84ea196b80 10 client.26084 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.747+0000 7f84ea196b80 10 client.26084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.747+0000 7f84ea196b80 20 client.26084 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.747+0000 7f84ea196b80 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556e2d16a0f0 0x556e2d16c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.747+0000 7f84ea196b80 4 client.26084 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.747+0000 7f84ea196b80 1 -- 172.21.15.59:0/3503651293 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e2d09be10 con 0x556e2d16a0f0 2023-10-08T12:46:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.747+0000 7f84cffff700 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556e2d16a0f0 0x556e2d16c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.748+0000 7f84af7fe700 10 client.26084 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.748+0000 7f84cffff700 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556e2d16a0f0 0x556e2d16c510 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=997e09ccdd75253f server_cookie=4348c327aee6eb88 in_seq=0 out_seq=0 2023-10-08T12:46:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.748+0000 7f84af7fe700 1 -- 172.21.15.59:0/3503651293 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556e2d09be10 con 0x556e2d16a0f0 2023-10-08T12:46:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.748+0000 7f84af7fe700 10 client.26084 handle_command_reply: tid=0 2023-10-08T12:46:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 1 client.26084 shutdown 2023-10-08T12:46:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 1 -- 172.21.15.59:0/3503651293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d15a650 msgr2=0x556e2d157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d15a650 0x556e2d157ac0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f84c800e730 tx=0x7f84c801c000 comp rx=0 tx=0).stop 2023-10-08T12:46:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 1 -- 172.21.15.59:0/3503651293 shutdown_connections 2023-10-08T12:46:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556e2d16a0f0 0x556e2d16c510 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d15a650 0x556e2d157ac0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14ee80 0x556e2d15a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 1 --2- 172.21.15.59:0/3503651293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d14f7a0 0x556e2d157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 1 -- 172.21.15.59:0/3503651293 >> 172.21.15.59:0/3503651293 conn(0x556e2d0c4260 msgr2=0x556e2d14aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84af7fe700 0 client.26084 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 1 -- 172.21.15.59:0/3503651293 shutdown_connections 2023-10-08T12:46:13.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 1 -- 172.21.15.59:0/3503651293 wait complete. 2023-10-08T12:46:13.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.749+0000 7f84ea196b80 20 client.26084 trim_cache size 0 max 16384 2023-10-08T12:46:13.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.764+0000 7f84ea196b80 1 Processor -- start 2023-10-08T12:46:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.764+0000 7f84ea196b80 1 -- start start 2023-10-08T12:46:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.764+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14ee80 0x556e2d16c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.764+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d1611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.764+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d15a650 0x556e2d159be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.764+0000 7f84ea196b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2cf23920 con 0x556e2d14ee80 2023-10-08T12:46:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.764+0000 7f84ea196b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2d06aeb0 con 0x556e2d14f7a0 2023-10-08T12:46:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84ea196b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2d158810 con 0x556e2d15a650 2023-10-08T12:46:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84cf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d1611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84cf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d1611e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60516/0 (socket says 172.21.15.59:60516) 2023-10-08T12:46:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84cf7fe700 1 -- 172.21.15.59:0/1181666941 learned_addr learned my addr 172.21.15.59:0/1181666941 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84d4d9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d15a650 0x556e2d159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84cffff700 1 --2- 172.21.15.59:0/1181666941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14ee80 0x556e2d16c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84cf7fe700 1 -- 172.21.15.59:0/1181666941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d15a650 msgr2=0x556e2d159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/1181666941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d15a650 0x556e2d159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84cf7fe700 1 -- 172.21.15.59:0/1181666941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14ee80 msgr2=0x556e2d16c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/1181666941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14ee80 0x556e2d16c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84cf7fe700 1 -- 172.21.15.59:0/1181666941 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e2cef4250 con 0x556e2d14f7a0 2023-10-08T12:46:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84cffff700 1 --2- 172.21.15.59:0/1181666941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14ee80 0x556e2d16c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84d4d9c700 1 --2- 172.21.15.59:0/1181666941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d15a650 0x556e2d159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.765+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/1181666941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d1611e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f84c4096ee0 tx=0x7f84c40d0d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0e8b23a967a26a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.766+0000 7f84b6ffd700 1 -- 172.21.15.59:0/1181666941 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c40d0850 con 0x556e2d14f7a0 2023-10-08T12:46:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.766+0000 7f84b6ffd700 1 -- 172.21.15.59:0/1181666941 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84c40967b0 con 0x556e2d14f7a0 2023-10-08T12:46:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.766+0000 7f84b6ffd700 1 -- 172.21.15.59:0/1181666941 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c409a470 con 0x556e2d14f7a0 2023-10-08T12:46:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.766+0000 7f84ea196b80 1 -- 172.21.15.59:0/1181666941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 msgr2=0x556e2d1611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.766+0000 7f84ea196b80 1 --2- 172.21.15.59:0/1181666941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d1611e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f84c4096ee0 tx=0x7f84c40d0d20 comp rx=0 tx=0).stop 2023-10-08T12:46:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.766+0000 7f84ea196b80 1 -- 172.21.15.59:0/1181666941 shutdown_connections 2023-10-08T12:46:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.766+0000 7f84ea196b80 1 --2- 172.21.15.59:0/1181666941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d15a650 0x556e2d159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.766+0000 7f84ea196b80 1 --2- 172.21.15.59:0/1181666941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d14ee80 0x556e2d16c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.766+0000 7f84ea196b80 1 --2- 172.21.15.59:0/1181666941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d1611e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.766+0000 7f84ea196b80 1 -- 172.21.15.59:0/1181666941 >> 172.21.15.59:0/1181666941 conn(0x556e2d0c4260 msgr2=0x556e2d1527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.767+0000 7f84ea196b80 1 -- 172.21.15.59:0/1181666941 shutdown_connections 2023-10-08T12:46:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.767+0000 7f84ea196b80 1 -- 172.21.15.59:0/1181666941 wait complete. 2023-10-08T12:46:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.767+0000 7f84ea196b80 1 -- start start 2023-10-08T12:46:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.767+0000 7f84ea196b80 1 Processor -- start 2023-10-08T12:46:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d14ee80 0x556e2d160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d15f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84ea196b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d15a650 0x556e2d15f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84ea196b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2d15fce0 con 0x556e2d15a650 2023-10-08T12:46:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84ea196b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2d15fe20 con 0x556e2d14f7a0 2023-10-08T12:46:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84ea196b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2d15ffe0 con 0x556e2d14ee80 2023-10-08T12:46:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84ea196b80 10 client.0 _ll_register_callbacks cb 0x7f84c4005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84cf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d15f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84cf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d15f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60520/0 (socket says 172.21.15.59:60520) 2023-10-08T12:46:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84cf7fe700 1 -- 172.21.15.59:0/221297792 learned_addr learned my addr 172.21.15.59:0/221297792 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84d4d9c700 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d15a650 0x556e2d15f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84cffff700 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d14ee80 0x556e2d160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84cf7fe700 1 -- 172.21.15.59:0/221297792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d14ee80 msgr2=0x556e2d160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d14ee80 0x556e2d160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84cf7fe700 1 -- 172.21.15.59:0/221297792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d15a650 msgr2=0x556e2d15f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d15a650 0x556e2d15f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84cf7fe700 1 -- 172.21.15.59:0/221297792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e2ceb6c60 con 0x556e2d14f7a0 2023-10-08T12:46:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d15f260 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f84c4096970 tx=0x7f84c4005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8446febd90e2ee81 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.768+0000 7f84af7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84af7fe700 1 -- 172.21.15.59:0/221297792 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4099b60 con 0x556e2d14f7a0 2023-10-08T12:46:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84af7fe700 1 -- 172.21.15.59:0/221297792 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f84c409ab70 con 0x556e2d14f7a0 2023-10-08T12:46:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84ea196b80 1 -- 172.21.15.59:0/221297792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f84c800f040 con 0x556e2d14f7a0 2023-10-08T12:46:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84af7fe700 1 -- 172.21.15.59:0/221297792 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84c409a240 con 0x556e2d14f7a0 2023-10-08T12:46:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84ea196b80 10 client.26090 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84ea196b80 1 -- 172.21.15.59:0/221297792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f84d01a57f0 con 0x556e2d14f7a0 2023-10-08T12:46:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84af7fe700 1 -- 172.21.15.59:0/221297792 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84c800f040 con 0x556e2d14f7a0 2023-10-08T12:46:13.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84af7fe700 1 -- 172.21.15.59:0/221297792 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f84c40b0070 con 0x556e2d14f7a0 2023-10-08T12:46:13.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84ea196b80 10 client.26090 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:13.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84ea196b80 10 client.26090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:13.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84ea196b80 20 client.26090 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:13.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84ea196b80 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556e2d1bf230 0x556e2d1c1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84ea196b80 4 client.26090 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:46:13.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.769+0000 7f84ea196b80 1 -- 172.21.15.59:0/221297792 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556e2d09bb30 con 0x556e2d1bf230 2023-10-08T12:46:13.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.770+0000 7f84cffff700 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556e2d1bf230 0x556e2d1c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.770+0000 7f84cffff700 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556e2d1bf230 0x556e2d1c1650 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b274b08bcc1570b6 server_cookie=714eef6ca5577755 in_seq=0 out_seq=0 2023-10-08T12:46:13.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.770+0000 7f84af7fe700 10 client.26090 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:13.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84af7fe700 1 -- 172.21.15.59:0/221297792 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556e2d09bb30 con 0x556e2d1bf230 2023-10-08T12:46:13.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84af7fe700 10 client.26090 handle_command_reply: tid=0 2023-10-08T12:46:13.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84ea196b80 1 client.26090 shutdown 2023-10-08T12:46:13.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84ea196b80 1 -- 172.21.15.59:0/221297792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 msgr2=0x556e2d15f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84ea196b80 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d15f260 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f84c4096970 tx=0x7f84c4005d50 comp rx=0 tx=0).stop 2023-10-08T12:46:13.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84ea196b80 1 -- 172.21.15.59:0/221297792 shutdown_connections 2023-10-08T12:46:13.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84ea196b80 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556e2d1bf230 0x556e2d1c1650 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84ea196b80 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e2d15a650 0x556e2d15f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84ea196b80 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2d14ee80 0x556e2d160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84ea196b80 1 --2- 172.21.15.59:0/221297792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e2d14f7a0 0x556e2d15f260 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84ea196b80 1 -- 172.21.15.59:0/221297792 >> 172.21.15.59:0/221297792 conn(0x556e2d0c4260 msgr2=0x556e2d150d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84af7fe700 0 client.26090 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84ea196b80 1 -- 172.21.15.59:0/221297792 shutdown_connections 2023-10-08T12:46:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.771+0000 7f84ea196b80 1 -- 172.21.15.59:0/221297792 wait complete. 2023-10-08T12:46:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.772+0000 7f84ea196b80 20 client.26090 trim_cache size 0 max 16384 2023-10-08T12:46:13.783 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:46:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.772+0000 7f84d67ff700 1 -- 172.21.15.59:0/2421303781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84b80a1660 msgr2=0x7f84b80a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.772+0000 7f84d67ff700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84b80a1660 0x7f84b80a3b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f84c801b000 tx=0x7f84c801ee80 comp rx=0 tx=0).stop 2023-10-08T12:46:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.772+0000 7f84d67ff700 1 -- 172.21.15.59:0/2421303781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0103220 msgr2=0x7f84d019ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.772+0000 7f84d67ff700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0103220 0x7f84d019ef20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f84c400ed60 tx=0x7f84c400c5b0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.772+0000 7f84d67ff700 1 -- 172.21.15.59:0/2421303781 shutdown_connections 2023-10-08T12:46:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.772+0000 7f84d67ff700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84b80a1660 0x7f84b80a3b20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.772+0000 7f84d67ff700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d0108870 0x7f84d0198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.772+0000 7f84d67ff700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d0102860 0x7f84d019e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.772+0000 7f84d67ff700 1 --2- 172.21.15.59:0/2421303781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0103220 0x7f84d019ef20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.773+0000 7f84d67ff700 1 -- 172.21.15.59:0/2421303781 >> 172.21.15.59:0/2421303781 conn(0x7f84d00fe2f0 msgr2=0x7f84d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.773+0000 7f84d67ff700 1 -- 172.21.15.59:0/2421303781 shutdown_connections 2023-10-08T12:46:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:13.773+0000 7f84d67ff700 1 -- 172.21.15.59:0/2421303781 wait complete. 2023-10-08T12:46:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:13 smithi173 ceph-mon[135182]: pgmap v465: 97 pgs: 97 active+clean; 340 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 306 op/s 2023-10-08T12:46:14.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:13 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1274835536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:46:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:13 smithi059 ceph-mon[98489]: pgmap v465: 97 pgs: 97 active+clean; 340 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 306 op/s 2023-10-08T12:46:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:13 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1274835536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:46:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:13 smithi092 ceph-mon[134093]: pgmap v465: 97 pgs: 97 active+clean; 340 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 306 op/s 2023-10-08T12:46:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:13 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1274835536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:46:14.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 589981 13.86 MB/sec execute 105 sec latency 12.846 ms 2023-10-08T12:46:14.793 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:46:14.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:46:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.022+0000 7f8f48dff700 1 -- 172.21.15.59:0/129606004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f4410cf70 msgr2=0x7f8f4410f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.022+0000 7f8f48dff700 1 --2- 172.21.15.59:0/129606004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f4410cf70 0x7f8f4410f3e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00b0a0 tx=0x7f8f3c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.022+0000 7f8f48dff700 1 -- 172.21.15.59:0/129606004 shutdown_connections 2023-10-08T12:46:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.022+0000 7f8f48dff700 1 --2- 172.21.15.59:0/129606004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f4410cf70 0x7f8f4410f3e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.022+0000 7f8f48dff700 1 --2- 172.21.15.59:0/129606004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f44072c20 0x7f8f44073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.022+0000 7f8f48dff700 1 --2- 172.21.15.59:0/129606004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f44073540 0x7f8f4410ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.022+0000 7f8f48dff700 1 -- 172.21.15.59:0/129606004 >> 172.21.15.59:0/129606004 conn(0x7f8f440fc200 msgr2=0x7f8f440fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.022+0000 7f8f48dff700 1 -- 172.21.15.59:0/129606004 shutdown_connections 2023-10-08T12:46:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.022+0000 7f8f48dff700 1 -- 172.21.15.59:0/129606004 wait complete. 2023-10-08T12:46:15.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.023+0000 7f8f48dff700 1 Processor -- start 2023-10-08T12:46:15.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.023+0000 7f8f48dff700 1 -- start start 2023-10-08T12:46:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.024+0000 7f8f48dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f44072c20 0x7f8f44198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.024+0000 7f8f48dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f44073540 0x7f8f441994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.024+0000 7f8f48dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f4410cf70 0x7f8f4419d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.024+0000 7f8f48dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4419de70 con 0x7f8f44072c20 2023-10-08T12:46:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.024+0000 7f8f48dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4419dfe0 con 0x7f8f44073540 2023-10-08T12:46:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.024+0000 7f8f48dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4419e1a0 con 0x7f8f4410cf70 2023-10-08T12:46:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.024+0000 7f8f4259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f44072c20 0x7f8f44198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.024+0000 7f8f41d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f44073540 0x7f8f441994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.024+0000 7f8f4259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f44072c20 0x7f8f44198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42042/0 (socket says 172.21.15.59:42042) 2023-10-08T12:46:15.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.024+0000 7f8f4259c700 1 -- 172.21.15.59:0/3506420226 learned_addr learned my addr 172.21.15.59:0/3506420226 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.024+0000 7f8f42d9d700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f4410cf70 0x7f8f4419d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.025+0000 7f8f41d9b700 1 -- 172.21.15.59:0/3506420226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f4410cf70 msgr2=0x7f8f4419d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.025+0000 7f8f41d9b700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f4410cf70 0x7f8f4419d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.025+0000 7f8f41d9b700 1 -- 172.21.15.59:0/3506420226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f44072c20 msgr2=0x7f8f44198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.025+0000 7f8f41d9b700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f44072c20 0x7f8f44198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.025+0000 7f8f41d9b700 1 -- 172.21.15.59:0/3506420226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34009520 con 0x7f8f44073540 2023-10-08T12:46:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.025+0000 7f8f41d9b700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f44073540 0x7f8f441994e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800e9f0 tx=0x7f8f3800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.025+0000 7f8f337fe700 1 -- 172.21.15.59:0/3506420226 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800c9c0 con 0x7f8f44073540 2023-10-08T12:46:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.025+0000 7f8f337fe700 1 -- 172.21.15.59:0/3506420226 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f38010430 con 0x7f8f44073540 2023-10-08T12:46:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.025+0000 7f8f337fe700 1 -- 172.21.15.59:0/3506420226 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38018680 con 0x7f8f44073540 2023-10-08T12:46:15.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.025+0000 7f8f48dff700 1 -- 172.21.15.59:0/3506420226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c009d00 con 0x7f8f44073540 2023-10-08T12:46:15.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.025+0000 7f8f48dff700 1 -- 172.21.15.59:0/3506420226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f441a5ae0 con 0x7f8f44073540 2023-10-08T12:46:15.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.029+0000 7f8f337fe700 1 -- 172.21.15.59:0/3506420226 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8f3800cb20 con 0x7f8f44073540 2023-10-08T12:46:15.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.030+0000 7f8f337fe700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f2c0a1670 0x7f8f2c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.030+0000 7f8f337fe700 1 -- 172.21.15.59:0/3506420226 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8f38014070 con 0x7f8f44073540 2023-10-08T12:46:15.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.030+0000 7f8f5c693b80 1 Processor -- start 2023-10-08T12:46:15.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.031+0000 7f8f5c693b80 1 -- start start 2023-10-08T12:46:15.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.031+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.031+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865c8820 0x562a865db9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.031+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865dbee0 0x562a865de2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.031+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a865314e0 con 0x562a865c8820 2023-10-08T12:46:15.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.031+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a86522ca0 con 0x562a865c7f00 2023-10-08T12:46:15.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.031+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a865205c0 con 0x562a865dbee0 2023-10-08T12:46:15.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.032+0000 7f8f4259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.032+0000 7f8f4259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60542/0 (socket says 172.21.15.59:60542) 2023-10-08T12:46:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.032+0000 7f8f4259c700 1 -- 172.21.15.59:0/2874840245 learned_addr learned my addr 172.21.15.59:0/2874840245 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.032+0000 7f8f4259c700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f2c0a1670 0x7f8f2c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.032+0000 7f8f41d9b700 1 --2- 172.21.15.59:0/2874840245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865c8820 0x562a865db9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.032+0000 7f8f42d9d700 1 --2- 172.21.15.59:0/2874840245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865dbee0 0x562a865de2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.032+0000 7f8f4259c700 1 -- 172.21.15.59:0/2874840245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865dbee0 msgr2=0x562a865de2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.032+0000 7f8f4259c700 1 --2- 172.21.15.59:0/2874840245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865dbee0 0x562a865de2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.032+0000 7f8f4259c700 1 -- 172.21.15.59:0/2874840245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865c8820 msgr2=0x562a865db9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.032+0000 7f8f4259c700 1 --2- 172.21.15.59:0/2874840245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865c8820 0x562a865db9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.032+0000 7f8f4259c700 1 -- 172.21.15.59:0/2874840245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a86346e60 con 0x562a865c7f00 2023-10-08T12:46:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.033+0000 7f8f4259c700 1 --2- 172.21.15.59:0/2874840245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c82e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f340119f0 tx=0x7f8f34011d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caa10e2efcd386ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.033+0000 7f8f4259c700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f2c0a1670 0x7f8f2c0a3b30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8f3401c000 tx=0x7f8f3401e000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.033+0000 7f8f30ff9700 1 -- 172.21.15.59:0/2874840245 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3401e480 con 0x562a865c7f00 2023-10-08T12:46:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.033+0000 7f8f30ff9700 1 -- 172.21.15.59:0/2874840245 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f3401eaa0 con 0x562a865c7f00 2023-10-08T12:46:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.033+0000 7f8f30ff9700 1 -- 172.21.15.59:0/2874840245 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3401d7c0 con 0x562a865c7f00 2023-10-08T12:46:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.034+0000 7f8f5c693b80 1 -- 172.21.15.59:0/2874840245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 msgr2=0x562a865c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.034+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/2874840245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c82e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f340119f0 tx=0x7f8f34011d00 comp rx=0 tx=0).stop 2023-10-08T12:46:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.034+0000 7f8f5c693b80 1 -- 172.21.15.59:0/2874840245 shutdown_connections 2023-10-08T12:46:15.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.034+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/2874840245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c82e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.034+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/2874840245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865dbee0 0x562a865de2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.034+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/2874840245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865c8820 0x562a865db9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.034+0000 7f8f5c693b80 1 -- 172.21.15.59:0/2874840245 >> 172.21.15.59:0/2874840245 conn(0x562a8653d2e0 msgr2=0x562a865c4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.034+0000 7f8f5c693b80 1 -- 172.21.15.59:0/2874840245 shutdown_connections 2023-10-08T12:46:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.034+0000 7f8f5c693b80 1 -- 172.21.15.59:0/2874840245 wait complete. 2023-10-08T12:46:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.035+0000 7f8f5c693b80 1 -- start start 2023-10-08T12:46:15.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.035+0000 7f8f5c693b80 1 Processor -- start 2023-10-08T12:46:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.036+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865db8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.036+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865c8820 0x562a865d8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.036+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865dbee0 0x562a865d9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.036+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a8651beb0 con 0x562a865c8820 2023-10-08T12:46:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.036+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a864b8790 con 0x562a865c7f00 2023-10-08T12:46:15.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.036+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a864b8430 con 0x562a865dbee0 2023-10-08T12:46:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.036+0000 7f8f5c693b80 10 client.0 _ll_register_callbacks cb 0x562a86315880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.036+0000 7f8f4259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865db8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.036+0000 7f8f4259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865db8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60550/0 (socket says 172.21.15.59:60550) 2023-10-08T12:46:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.036+0000 7f8f4259c700 1 -- 172.21.15.59:0/4942121 learned_addr learned my addr 172.21.15.59:0/4942121 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.037+0000 7f8f41d9b700 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865c8820 0x562a865d8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.037+0000 7f8f42d9d700 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865dbee0 0x562a865d9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.037+0000 7f8f4259c700 1 -- 172.21.15.59:0/4942121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865dbee0 msgr2=0x562a865d9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.037+0000 7f8f4259c700 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865dbee0 0x562a865d9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.037+0000 7f8f4259c700 1 -- 172.21.15.59:0/4942121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865c8820 msgr2=0x562a865d8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.037+0000 7f8f4259c700 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865c8820 0x562a865d8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.037+0000 7f8f4259c700 1 -- 172.21.15.59:0/4942121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f34019040 con 0x562a865c7f00 2023-10-08T12:46:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.037+0000 7f8f4259c700 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865db8b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8f34010010 tx=0x7f8f3401e6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=795f75ff6efb9f19 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.037+0000 7f8f29ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.038+0000 7f8f29ffb700 1 -- 172.21.15.59:0/4942121 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3401e8a0 con 0x562a865c7f00 2023-10-08T12:46:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.038+0000 7f8f5c693b80 1 -- 172.21.15.59:0/4942121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a864e3f30 con 0x562a865c7f00 2023-10-08T12:46:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.038+0000 7f8f29ffb700 1 -- 172.21.15.59:0/4942121 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8f34005260 con 0x562a865c7f00 2023-10-08T12:46:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.038+0000 7f8f29ffb700 1 -- 172.21.15.59:0/4942121 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f34005420 con 0x562a865c7f00 2023-10-08T12:46:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.038+0000 7f8f5c693b80 10 client.26102 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.038+0000 7f8f5c693b80 1 -- 172.21.15.59:0/4942121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x562a8632fce0 con 0x562a865c7f00 2023-10-08T12:46:15.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.038+0000 7f8f29ffb700 1 -- 172.21.15.59:0/4942121 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562a864e3f30 con 0x562a865c7f00 2023-10-08T12:46:15.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.038+0000 7f8f29ffb700 1 -- 172.21.15.59:0/4942121 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8f3401d530 con 0x562a865c7f00 2023-10-08T12:46:15.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.038+0000 7f8f5c693b80 10 client.26102 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:15.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.038+0000 7f8f5c693b80 10 client.26102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:15.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.038+0000 7f8f5c693b80 20 client.26102 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:15.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.039+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562a865eb910 0x562a865edd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.039+0000 7f8f5c693b80 4 client.26102 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.039+0000 7f8f5c693b80 1 -- 172.21.15.59:0/4942121 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a86514e90 con 0x562a865eb910 2023-10-08T12:46:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.039+0000 7f8f41d9b700 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562a865eb910 0x562a865edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.039+0000 7f8f41d9b700 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562a865eb910 0x562a865edd30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=197c86e117047bd5 server_cookie=c3dae1349e865010 in_seq=0 out_seq=0 2023-10-08T12:46:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.039+0000 7f8f29ffb700 10 client.26102 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.040+0000 7f8f29ffb700 1 -- 172.21.15.59:0/4942121 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562a86514e90 con 0x562a865eb910 2023-10-08T12:46:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.040+0000 7f8f29ffb700 10 client.26102 handle_command_reply: tid=0 2023-10-08T12:46:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.040+0000 7f8f5c693b80 1 client.26102 shutdown 2023-10-08T12:46:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.040+0000 7f8f5c693b80 1 -- 172.21.15.59:0/4942121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 msgr2=0x562a865db8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.040+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865db8b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8f34010010 tx=0x7f8f3401e6b0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.041+0000 7f8f5c693b80 1 -- 172.21.15.59:0/4942121 shutdown_connections 2023-10-08T12:46:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.041+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562a865eb910 0x562a865edd30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.041+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865db8b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.041+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865dbee0 0x562a865d9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.041+0000 7f8f29ffb700 0 client.26102 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.041+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/4942121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865c8820 0x562a865d8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.041+0000 7f8f5c693b80 1 -- 172.21.15.59:0/4942121 >> 172.21.15.59:0/4942121 conn(0x562a8653d2e0 msgr2=0x562a865c3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.041+0000 7f8f5c693b80 1 -- 172.21.15.59:0/4942121 shutdown_connections 2023-10-08T12:46:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.041+0000 7f8f5c693b80 1 -- 172.21.15.59:0/4942121 wait complete. 2023-10-08T12:46:15.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.041+0000 7f8f5c693b80 20 client.26102 trim_cache size 0 max 16384 2023-10-08T12:46:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.061+0000 7f8f5c693b80 1 Processor -- start 2023-10-08T12:46:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.061+0000 7f8f5c693b80 1 -- start start 2023-10-08T12:46:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.061+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.061+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865c8820 0x562a865e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.061+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865dbee0 0x562a865e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.061+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a8639c9a0 con 0x562a865dbee0 2023-10-08T12:46:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.061+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a865e84a0 con 0x562a865c7f00 2023-10-08T12:46:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.061+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a865da1a0 con 0x562a865c8820 2023-10-08T12:46:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.062+0000 7f8f4259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.062+0000 7f8f42d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865dbee0 0x562a865e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.062+0000 7f8f4259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60552/0 (socket says 172.21.15.59:60552) 2023-10-08T12:46:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.062+0000 7f8f4259c700 1 -- 172.21.15.59:0/2523135489 learned_addr learned my addr 172.21.15.59:0/2523135489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.062+0000 7f8f41d9b700 1 --2- 172.21.15.59:0/2523135489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865c8820 0x562a865e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.062+0000 7f8f4259c700 1 -- 172.21.15.59:0/2523135489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865c8820 msgr2=0x562a865e2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.062+0000 7f8f4259c700 1 --2- 172.21.15.59:0/2523135489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865c8820 0x562a865e2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.062+0000 7f8f4259c700 1 -- 172.21.15.59:0/2523135489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865dbee0 msgr2=0x562a865e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.062+0000 7f8f4259c700 1 --2- 172.21.15.59:0/2523135489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865dbee0 0x562a865e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.062+0000 7f8f4259c700 1 -- 172.21.15.59:0/2523135489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a8636d2d0 con 0x562a865c7f00 2023-10-08T12:46:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.062+0000 7f8f4259c700 1 --2- 172.21.15.59:0/2523135489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c4500 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8f340092a0 tx=0x7f8f34009c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e54418781e3837fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.063+0000 7f8f317fa700 1 -- 172.21.15.59:0/2523135489 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34005d40 con 0x562a865c7f00 2023-10-08T12:46:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.063+0000 7f8f317fa700 1 -- 172.21.15.59:0/2523135489 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f34005720 con 0x562a865c7f00 2023-10-08T12:46:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.063+0000 7f8f317fa700 1 -- 172.21.15.59:0/2523135489 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3401d540 con 0x562a865c7f00 2023-10-08T12:46:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.063+0000 7f8f5c693b80 1 -- 172.21.15.59:0/2523135489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 msgr2=0x562a865c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.063+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/2523135489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c4500 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8f340092a0 tx=0x7f8f34009c10 comp rx=0 tx=0).stop 2023-10-08T12:46:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.064+0000 7f8f5c693b80 1 -- 172.21.15.59:0/2523135489 shutdown_connections 2023-10-08T12:46:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.064+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/2523135489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865c4500 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.064+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/2523135489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865dbee0 0x562a865e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.064+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/2523135489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865c8820 0x562a865e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.064+0000 7f8f5c693b80 1 -- 172.21.15.59:0/2523135489 >> 172.21.15.59:0/2523135489 conn(0x562a8653d2e0 msgr2=0x562a865c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.064+0000 7f8f5c693b80 1 -- 172.21.15.59:0/2523135489 shutdown_connections 2023-10-08T12:46:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.064+0000 7f8f5c693b80 1 -- 172.21.15.59:0/2523135489 wait complete. 2023-10-08T12:46:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.064+0000 7f8f5c693b80 1 -- start start 2023-10-08T12:46:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.064+0000 7f8f5c693b80 1 Processor -- start 2023-10-08T12:46:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865e1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865c8820 0x562a865e2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f5c693b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865dbee0 0x562a866397b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a86639cf0 con 0x562a865dbee0 2023-10-08T12:46:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a86639e60 con 0x562a865c7f00 2023-10-08T12:46:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f5c693b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a8663a020 con 0x562a865c8820 2023-10-08T12:46:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f5c693b80 10 client.0 _ll_register_callbacks cb 0x7f8f38096390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f4259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865e1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f4259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865e1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60564/0 (socket says 172.21.15.59:60564) 2023-10-08T12:46:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f4259c700 1 -- 172.21.15.59:0/3380001369 learned_addr learned my addr 172.21.15.59:0/3380001369 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f42d9d700 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865dbee0 0x562a866397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f41d9b700 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865c8820 0x562a865e2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f4259c700 1 -- 172.21.15.59:0/3380001369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865c8820 msgr2=0x562a865e2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f4259c700 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865c8820 0x562a865e2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f4259c700 1 -- 172.21.15.59:0/3380001369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865dbee0 msgr2=0x562a866397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f4259c700 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865dbee0 0x562a866397b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.065+0000 7f8f4259c700 1 -- 172.21.15.59:0/3380001369 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a8632fce0 con 0x562a865c7f00 2023-10-08T12:46:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.066+0000 7f8f4259c700 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865e1c30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8f34011fd0 tx=0x7f8f3400ff70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99322d7275c52348 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.066+0000 7f8f29ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.066+0000 7f8f29ffb700 1 -- 172.21.15.59:0/3380001369 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3401dc70 con 0x562a865c7f00 2023-10-08T12:46:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.066+0000 7f8f5c693b80 1 -- 172.21.15.59:0/3380001369 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f3401eaa0 con 0x562a865c7f00 2023-10-08T12:46:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.066+0000 7f8f29ffb700 1 -- 172.21.15.59:0/3380001369 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8f34035020 con 0x562a865c7f00 2023-10-08T12:46:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.066+0000 7f8f29ffb700 1 -- 172.21.15.59:0/3380001369 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f3401e8a0 con 0x562a865c7f00 2023-10-08T12:46:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.066+0000 7f8f5c693b80 10 client.26108 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.066+0000 7f8f5c693b80 1 -- 172.21.15.59:0/3380001369 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x562a86345330 con 0x562a865c7f00 2023-10-08T12:46:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.066+0000 7f8f29ffb700 1 -- 172.21.15.59:0/3380001369 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f3401eaa0 con 0x562a865c7f00 2023-10-08T12:46:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.067+0000 7f8f29ffb700 1 -- 172.21.15.59:0/3380001369 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8f34003b10 con 0x562a865c7f00 2023-10-08T12:46:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.067+0000 7f8f5c693b80 10 client.26108 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.067+0000 7f8f5c693b80 10 client.26108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.067+0000 7f8f5c693b80 20 client.26108 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.067+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562a86641530 0x562a86643920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.067+0000 7f8f5c693b80 4 client.26108 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:46:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.067+0000 7f8f5c693b80 1 -- 172.21.15.59:0/3380001369 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562a86514bb0 con 0x562a86641530 2023-10-08T12:46:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.067+0000 7f8f41d9b700 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562a86641530 0x562a86643920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.068+0000 7f8f41d9b700 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562a86641530 0x562a86643920 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=245086a2342c7960 server_cookie=f7f3400a2619b302 in_seq=0 out_seq=0 2023-10-08T12:46:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.068+0000 7f8f29ffb700 10 client.26108 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f29ffb700 1 -- 172.21.15.59:0/3380001369 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562a86514bb0 con 0x562a86641530 2023-10-08T12:46:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f29ffb700 10 client.26108 handle_command_reply: tid=0 2023-10-08T12:46:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 1 client.26108 shutdown 2023-10-08T12:46:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 1 -- 172.21.15.59:0/3380001369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 msgr2=0x562a865e1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865e1c30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8f34011fd0 tx=0x7f8f3400ff70 comp rx=0 tx=0).stop 2023-10-08T12:46:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 1 -- 172.21.15.59:0/3380001369 shutdown_connections 2023-10-08T12:46:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562a86641530 0x562a86643920 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a865c7f00 0x562a865e1c30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a865dbee0 0x562a866397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f29ffb700 0 client.26108 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 1 --2- 172.21.15.59:0/3380001369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562a865c8820 0x562a865e2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 1 -- 172.21.15.59:0/3380001369 >> 172.21.15.59:0/3380001369 conn(0x562a8653d2e0 msgr2=0x562a865e71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 1 -- 172.21.15.59:0/3380001369 shutdown_connections 2023-10-08T12:46:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 1 -- 172.21.15.59:0/3380001369 wait complete. 2023-10-08T12:46:15.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.069+0000 7f8f5c693b80 20 client.26108 trim_cache size 0 max 16384 2023-10-08T12:46:15.077 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:46:15.077 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:46:15.078 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "3d8ec6e6-3d60-4bbb-a664-dfff0fbbfc78", 2023-10-08T12:46:15.078 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:46:15.078 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:46:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 -- 172.21.15.59:0/3506420226 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f2c0a1670 msgr2=0x7f8f2c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f2c0a1670 0x7f8f2c0a3b30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8f3401c000 tx=0x7f8f3401e000 comp rx=0 tx=0).stop 2023-10-08T12:46:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 -- 172.21.15.59:0/3506420226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f44073540 msgr2=0x7f8f441994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f44073540 0x7f8f441994e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800e9f0 tx=0x7f8f3800ed00 comp rx=0 tx=0).stop 2023-10-08T12:46:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 -- 172.21.15.59:0/3506420226 shutdown_connections 2023-10-08T12:46:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f2c0a1670 0x7f8f2c0a3b30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f4410cf70 0x7f8f4419d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f44072c20 0x7f8f44198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 --2- 172.21.15.59:0/3506420226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f44073540 0x7f8f441994e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 -- 172.21.15.59:0/3506420226 >> 172.21.15.59:0/3506420226 conn(0x7f8f440fc200 msgr2=0x7f8f440fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 -- 172.21.15.59:0/3506420226 shutdown_connections 2023-10-08T12:46:15.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.070+0000 7f8f48dff700 1 -- 172.21.15.59:0/3506420226 wait complete. 2023-10-08T12:46:15.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:46:15.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.324+0000 7ff50e9ff700 1 -- 172.21.15.59:0/1560703354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508108950 msgr2=0x7ff508108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.324+0000 7ff50e9ff700 1 --2- 172.21.15.59:0/1560703354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508108950 0x7ff508108d30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009990 tx=0x7ff4f8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.324+0000 7ff50e9ff700 1 -- 172.21.15.59:0/1560703354 shutdown_connections 2023-10-08T12:46:15.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.324+0000 7ff50e9ff700 1 --2- 172.21.15.59:0/1560703354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508108950 0x7ff508108d30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.324+0000 7ff50e9ff700 1 --2- 172.21.15.59:0/1560703354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff508103300 0x7ff50810f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.324+0000 7ff50e9ff700 1 --2- 172.21.15.59:0/1560703354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff508102940 0x7ff508102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.324+0000 7ff50e9ff700 1 -- 172.21.15.59:0/1560703354 >> 172.21.15.59:0/1560703354 conn(0x7ff5080fe3d0 msgr2=0x7ff5081007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.324+0000 7ff50e9ff700 1 -- 172.21.15.59:0/1560703354 shutdown_connections 2023-10-08T12:46:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.324+0000 7ff50e9ff700 1 -- 172.21.15.59:0/1560703354 wait complete. 2023-10-08T12:46:15.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.325+0000 7ff50e9ff700 1 Processor -- start 2023-10-08T12:46:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.326+0000 7ff50e9ff700 1 -- start start 2023-10-08T12:46:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.326+0000 7ff50e9ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508102940 0x7ff508198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.326+0000 7ff50e9ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff508103300 0x7ff5081992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.326+0000 7ff50e9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff508108950 0x7ff50819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.326+0000 7ff50e9ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50819dcb0 con 0x7ff508103300 2023-10-08T12:46:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.326+0000 7ff50e9ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50819de20 con 0x7ff508102940 2023-10-08T12:46:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.326+0000 7ff50e9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50819dfe0 con 0x7ff508108950 2023-10-08T12:46:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.326+0000 7ff507fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508102940 0x7ff508198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.326+0000 7ff507fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508102940 0x7ff508198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60592/0 (socket says 172.21.15.59:60592) 2023-10-08T12:46:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.326+0000 7ff507fff700 1 -- 172.21.15.59:0/153683577 learned_addr learned my addr 172.21.15.59:0/153683577 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff5077fe700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff508103300 0x7ff5081992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff50cf9c700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff508108950 0x7ff50819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff507fff700 1 -- 172.21.15.59:0/153683577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff508108950 msgr2=0x7ff50819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff507fff700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff508108950 0x7ff50819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff507fff700 1 -- 172.21.15.59:0/153683577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff508103300 msgr2=0x7ff5081992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff507fff700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff508103300 0x7ff5081992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff507fff700 1 -- 172.21.15.59:0/153683577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80095f0 con 0x7ff508102940 2023-10-08T12:46:15.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff507fff700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508102940 0x7ff508198d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8000c00 tx=0x7ff4f8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff5057fa700 1 -- 172.21.15.59:0/153683577 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f801d070 con 0x7ff508102940 2023-10-08T12:46:15.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff5057fa700 1 -- 172.21.15.59:0/153683577 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4f8022470 con 0x7ff508102940 2023-10-08T12:46:15.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff50e9ff700 1 -- 172.21.15.59:0/153683577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50819e260 con 0x7ff508102940 2023-10-08T12:46:15.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.327+0000 7ff5057fa700 1 -- 172.21.15.59:0/153683577 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8017650 con 0x7ff508102940 2023-10-08T12:46:15.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.328+0000 7ff50e9ff700 1 -- 172.21.15.59:0/153683577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5081a5b00 con 0x7ff508102940 2023-10-08T12:46:15.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.331+0000 7ff5057fa700 1 -- 172.21.15.59:0/153683577 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff4f80225e0 con 0x7ff508102940 2023-10-08T12:46:15.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.332+0000 7ff522291b80 1 Processor -- start 2023-10-08T12:46:15.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff522291b80 1 -- start start 2023-10-08T12:46:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff522291b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cce80 0x55cf0c3cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff522291b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3d8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff522291b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3d8650 0x55cf0c3daa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff522291b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c336460 con 0x55cf0c3cd7a0 2023-10-08T12:46:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff522291b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c327c20 con 0x55cf0c3cce80 2023-10-08T12:46:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff522291b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c325540 con 0x55cf0c3d8650 2023-10-08T12:46:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff5057fa700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff4f00a15f0 0x7ff4f00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff5057fa700 1 -- 172.21.15.59:0/153683577 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff4f80ce3b0 con 0x7ff508102940 2023-10-08T12:46:15.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff50cf9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cce80 0x55cf0c3cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff507fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3d8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff50cf9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cce80 0x55cf0c3cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60604/0 (socket says 172.21.15.59:60604) 2023-10-08T12:46:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff50cf9c700 1 -- 172.21.15.59:0/2972076381 learned_addr learned my addr 172.21.15.59:0/2972076381 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.333+0000 7ff5077fe700 1 --2- 172.21.15.59:0/2972076381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3d8650 0x55cf0c3daa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.334+0000 7ff50cf9c700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff4f00a15f0 0x7ff4f00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.334+0000 7ff50cf9c700 1 -- 172.21.15.59:0/2972076381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3d8650 msgr2=0x55cf0c3daa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.334+0000 7ff50cf9c700 1 --2- 172.21.15.59:0/2972076381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3d8650 0x55cf0c3daa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.334+0000 7ff50cf9c700 1 -- 172.21.15.59:0/2972076381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cd7a0 msgr2=0x55cf0c3d8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.334+0000 7ff50cf9c700 1 --2- 172.21.15.59:0/2972076381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3d8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.334+0000 7ff50cf9c700 1 -- 172.21.15.59:0/2972076381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf0c14bde0 con 0x55cf0c3cce80 2023-10-08T12:46:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.334+0000 7ff50cf9c700 1 --2- 172.21.15.59:0/2972076381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cce80 0x55cf0c3cd260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff500007d00 tx=0x7ff500019650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a427872fadafd03 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.334+0000 7ff50cf9c700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff4f00a15f0 0x7ff4f00a3ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff500009fd0 tx=0x7ff50000d000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.334+0000 7ff4ee7fc700 1 -- 172.21.15.59:0/2972076381 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500007500 con 0x55cf0c3cce80 2023-10-08T12:46:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.335+0000 7ff4ee7fc700 1 -- 172.21.15.59:0/2972076381 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff50000f040 con 0x55cf0c3cce80 2023-10-08T12:46:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.335+0000 7ff4ee7fc700 1 -- 172.21.15.59:0/2972076381 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500004e10 con 0x55cf0c3cce80 2023-10-08T12:46:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.335+0000 7ff522291b80 1 -- 172.21.15.59:0/2972076381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cce80 msgr2=0x55cf0c3cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.335+0000 7ff522291b80 1 --2- 172.21.15.59:0/2972076381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cce80 0x55cf0c3cd260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff500007d00 tx=0x7ff500019650 comp rx=0 tx=0).stop 2023-10-08T12:46:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.335+0000 7ff522291b80 1 -- 172.21.15.59:0/2972076381 shutdown_connections 2023-10-08T12:46:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.335+0000 7ff522291b80 1 --2- 172.21.15.59:0/2972076381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cce80 0x55cf0c3cd260 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.335+0000 7ff522291b80 1 --2- 172.21.15.59:0/2972076381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3d8650 0x55cf0c3daa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.335+0000 7ff522291b80 1 --2- 172.21.15.59:0/2972076381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3d8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.335+0000 7ff522291b80 1 -- 172.21.15.59:0/2972076381 >> 172.21.15.59:0/2972076381 conn(0x55cf0c342260 msgr2=0x55cf0c3c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.336+0000 7ff522291b80 1 -- 172.21.15.59:0/2972076381 shutdown_connections 2023-10-08T12:46:15.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.336+0000 7ff522291b80 1 -- 172.21.15.59:0/2972076381 wait complete. 2023-10-08T12:46:15.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.336+0000 7ff522291b80 1 -- start start 2023-10-08T12:46:15.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.337+0000 7ff522291b80 1 Processor -- start 2023-10-08T12:46:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.337+0000 7ff522291b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 0x55cf0c3d8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.337+0000 7ff522291b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3d5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.337+0000 7ff522291b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3d8650 0x55cf0c3d5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.337+0000 7ff522291b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c320e30 con 0x55cf0c3cce80 2023-10-08T12:46:15.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.337+0000 7ff522291b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c2bd710 con 0x55cf0c3d8650 2023-10-08T12:46:15.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.337+0000 7ff522291b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c2bd3b0 con 0x55cf0c3cd7a0 2023-10-08T12:46:15.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.337+0000 7ff522291b80 10 client.0 _ll_register_callbacks cb 0x55cf0c11a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:15.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.338+0000 7ff507fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 0x55cf0c3d8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.338+0000 7ff507fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 0x55cf0c3d8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42108/0 (socket says 172.21.15.59:42108) 2023-10-08T12:46:15.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.338+0000 7ff507fff700 1 -- 172.21.15.59:0/353295589 learned_addr learned my addr 172.21.15.59:0/353295589 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:15.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.338+0000 7ff5077fe700 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3d5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.338+0000 7ff507fff700 1 -- 172.21.15.59:0/353295589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3cd7a0 msgr2=0x55cf0c3d5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.338+0000 7ff507fff700 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3d5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.338+0000 7ff507fff700 1 -- 172.21.15.59:0/353295589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3d8650 msgr2=0x55cf0c3d5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.338+0000 7ff507fff700 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3d8650 0x55cf0c3d5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.338+0000 7ff507fff700 1 -- 172.21.15.59:0/353295589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff500011040 con 0x55cf0c3cce80 2023-10-08T12:46:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.338+0000 7ff507fff700 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 0x55cf0c3d8070 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8097f10 tx=0x7ff4f800b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be86c8498b769404 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.338+0000 7ff4e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:46:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.339+0000 7ff4e77fe700 1 -- 172.21.15.59:0/353295589 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f809b900 con 0x55cf0c3cce80 2023-10-08T12:46:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.339+0000 7ff4e77fe700 1 -- 172.21.15.59:0/353295589 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff4f809bba0 con 0x55cf0c3cce80 2023-10-08T12:46:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.339+0000 7ff522291b80 1 -- 172.21.15.59:0/353295589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf0c2e8eb0 con 0x55cf0c3cce80 2023-10-08T12:46:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.339+0000 7ff4e77fe700 1 -- 172.21.15.59:0/353295589 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4f809afe0 con 0x55cf0c3cce80 2023-10-08T12:46:15.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.339+0000 7ff522291b80 10 client.16116 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:15.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.339+0000 7ff522291b80 1 -- 172.21.15.59:0/353295589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55cf0c134c60 con 0x55cf0c3cce80 2023-10-08T12:46:15.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.339+0000 7ff4e77fe700 1 -- 172.21.15.59:0/353295589 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cf0c2e8eb0 con 0x55cf0c3cce80 2023-10-08T12:46:15.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.339+0000 7ff4e77fe700 1 -- 172.21.15.59:0/353295589 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff4f8063030 con 0x55cf0c3cce80 2023-10-08T12:46:15.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.339+0000 7ff522291b80 10 client.16116 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:15.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.339+0000 7ff522291b80 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:15.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.339+0000 7ff522291b80 20 client.16116 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:15.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.340+0000 7ff522291b80 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cf0c3e7d20 0x55cf0c3ea140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.340+0000 7ff522291b80 4 client.16116 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:15.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.340+0000 7ff522291b80 1 -- 172.21.15.59:0/353295589 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf0c319e10 con 0x55cf0c3e7d20 2023-10-08T12:46:15.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.340+0000 7ff5077fe700 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cf0c3e7d20 0x55cf0c3ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.340+0000 7ff5077fe700 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cf0c3e7d20 0x55cf0c3ea140 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6b6c117f5a67542 server_cookie=d37b80bad4965079 in_seq=0 out_seq=0 2023-10-08T12:46:15.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.340+0000 7ff4e77fe700 10 client.16116 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:15.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.341+0000 7ff4e77fe700 1 -- 172.21.15.59:0/353295589 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cf0c319e10 con 0x55cf0c3e7d20 2023-10-08T12:46:15.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.341+0000 7ff4e77fe700 10 client.16116 handle_command_reply: tid=0 2023-10-08T12:46:15.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.341+0000 7ff522291b80 1 client.16116 shutdown 2023-10-08T12:46:15.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.341+0000 7ff522291b80 1 -- 172.21.15.59:0/353295589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 msgr2=0x55cf0c3d8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.341+0000 7ff522291b80 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 0x55cf0c3d8070 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8097f10 tx=0x7ff4f800b6b0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.342+0000 7ff522291b80 1 -- 172.21.15.59:0/353295589 shutdown_connections 2023-10-08T12:46:15.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.342+0000 7ff522291b80 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cf0c3e7d20 0x55cf0c3ea140 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.342+0000 7ff522291b80 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3d8650 0x55cf0c3d5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.342+0000 7ff522291b80 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 0x55cf0c3d8070 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.342+0000 7ff4e77fe700 0 client.16116 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:15.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.342+0000 7ff522291b80 1 --2- 172.21.15.59:0/353295589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3d5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.342+0000 7ff522291b80 1 -- 172.21.15.59:0/353295589 >> 172.21.15.59:0/353295589 conn(0x55cf0c342260 msgr2=0x55cf0c3c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.342+0000 7ff522291b80 1 -- 172.21.15.59:0/353295589 shutdown_connections 2023-10-08T12:46:15.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.342+0000 7ff522291b80 1 -- 172.21.15.59:0/353295589 wait complete. 2023-10-08T12:46:15.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.342+0000 7ff522291b80 20 client.16116 trim_cache size 0 max 16384 2023-10-08T12:46:15.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.364+0000 7ff522291b80 1 Processor -- start 2023-10-08T12:46:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.364+0000 7ff522291b80 1 -- start start 2023-10-08T12:46:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff522291b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 0x55cf0c3df0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff522291b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff522291b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3d8650 0x55cf0c3c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff522291b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c1a1920 con 0x55cf0c3cce80 2023-10-08T12:46:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff522291b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c3c5b20 con 0x55cf0c3cd7a0 2023-10-08T12:46:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff522291b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c3d6360 con 0x55cf0c3d8650 2023-10-08T12:46:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff5077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff507fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 0x55cf0c3df0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff5077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60632/0 (socket says 172.21.15.59:60632) 2023-10-08T12:46:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff5077fe700 1 -- 172.21.15.59:0/1193960414 learned_addr learned my addr 172.21.15.59:0/1193960414 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff50cf9c700 1 --2- 172.21.15.59:0/1193960414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3d8650 0x55cf0c3c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff5077fe700 1 -- 172.21.15.59:0/1193960414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3d8650 msgr2=0x55cf0c3c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff5077fe700 1 --2- 172.21.15.59:0/1193960414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3d8650 0x55cf0c3c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff5077fe700 1 -- 172.21.15.59:0/1193960414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 msgr2=0x55cf0c3df0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff5077fe700 1 --2- 172.21.15.59:0/1193960414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 0x55cf0c3df0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.365+0000 7ff5077fe700 1 -- 172.21.15.59:0/1193960414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf0c172250 con 0x55cf0c3cd7a0 2023-10-08T12:46:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.366+0000 7ff5077fe700 1 --2- 172.21.15.59:0/1193960414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3c8d70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff50819a2e0 tx=0x7ff4fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd6a2f1796cdb46c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.366+0000 7ff4eeffd700 1 -- 172.21.15.59:0/1193960414 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc016070 con 0x55cf0c3cd7a0 2023-10-08T12:46:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.366+0000 7ff4eeffd700 1 -- 172.21.15.59:0/1193960414 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4fc017040 con 0x55cf0c3cd7a0 2023-10-08T12:46:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.366+0000 7ff4eeffd700 1 -- 172.21.15.59:0/1193960414 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc01c440 con 0x55cf0c3cd7a0 2023-10-08T12:46:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.367+0000 7ff522291b80 1 -- 172.21.15.59:0/1193960414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 msgr2=0x55cf0c3c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.367+0000 7ff522291b80 1 --2- 172.21.15.59:0/1193960414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3c8d70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff50819a2e0 tx=0x7ff4fc004750 comp rx=0 tx=0).stop 2023-10-08T12:46:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.367+0000 7ff522291b80 1 -- 172.21.15.59:0/1193960414 shutdown_connections 2023-10-08T12:46:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.367+0000 7ff522291b80 1 --2- 172.21.15.59:0/1193960414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3d8650 0x55cf0c3c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.367+0000 7ff522291b80 1 --2- 172.21.15.59:0/1193960414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3cce80 0x55cf0c3df0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.367+0000 7ff522291b80 1 --2- 172.21.15.59:0/1193960414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3c8d70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.367+0000 7ff522291b80 1 -- 172.21.15.59:0/1193960414 >> 172.21.15.59:0/1193960414 conn(0x55cf0c342260 msgr2=0x55cf0c3c84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.367+0000 7ff522291b80 1 -- 172.21.15.59:0/1193960414 shutdown_connections 2023-10-08T12:46:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.367+0000 7ff522291b80 1 -- 172.21.15.59:0/1193960414 wait complete. 2023-10-08T12:46:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.368+0000 7ff522291b80 1 -- start start 2023-10-08T12:46:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.368+0000 7ff522291b80 1 Processor -- start 2023-10-08T12:46:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff522291b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3cce80 0x55cf0c3df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff522291b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3dd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff522291b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3d8650 0x55cf0c3dddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff522291b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c3de4e0 con 0x55cf0c3d8650 2023-10-08T12:46:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff522291b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c444370 con 0x55cf0c3cd7a0 2023-10-08T12:46:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff522291b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0c4444b0 con 0x55cf0c3cce80 2023-10-08T12:46:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff522291b80 10 client.0 _ll_register_callbacks cb 0x7ff4f80057b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff5077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3dd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff5077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3dd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:60642/0 (socket says 172.21.15.59:60642) 2023-10-08T12:46:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff5077fe700 1 -- 172.21.15.59:0/1567900898 learned_addr learned my addr 172.21.15.59:0/1567900898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff507fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3cce80 0x55cf0c3df0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.369+0000 7ff50cf9c700 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3d8650 0x55cf0c3dddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff507fff700 1 -- 172.21.15.59:0/1567900898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 msgr2=0x55cf0c3dd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff507fff700 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3dd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff507fff700 1 -- 172.21.15.59:0/1567900898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3d8650 msgr2=0x55cf0c3dddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff507fff700 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3d8650 0x55cf0c3dddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff507fff700 1 -- 172.21.15.59:0/1567900898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc009c70 con 0x55cf0c3cce80 2023-10-08T12:46:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff5077fe700 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3dd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff507fff700 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3cce80 0x55cf0c3df0d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80a3270 tx=0x7ff4f8009540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f38347319164b4ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff4e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:46:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff4e77fe700 1 -- 172.21.15.59:0/1567900898 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f809afe0 con 0x55cf0c3cce80 2023-10-08T12:46:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff522291b80 1 -- 172.21.15.59:0/1567900898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff50000f040 con 0x55cf0c3cce80 2023-10-08T12:46:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff4e77fe700 1 -- 172.21.15.59:0/1567900898 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff4f809bba0 con 0x55cf0c3cce80 2023-10-08T12:46:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff4e77fe700 1 -- 172.21.15.59:0/1567900898 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4f809ae00 con 0x55cf0c3cce80 2023-10-08T12:46:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff522291b80 10 client.26119 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.370+0000 7ff522291b80 1 -- 172.21.15.59:0/1567900898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55cf0c14a2b0 con 0x55cf0c3cce80 2023-10-08T12:46:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.371+0000 7ff4e77fe700 1 -- 172.21.15.59:0/1567900898 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff50000f040 con 0x55cf0c3cce80 2023-10-08T12:46:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.371+0000 7ff4e77fe700 1 -- 172.21.15.59:0/1567900898 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff4f8063070 con 0x55cf0c3cce80 2023-10-08T12:46:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.371+0000 7ff522291b80 10 client.26119 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.371+0000 7ff522291b80 10 client.26119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.371+0000 7ff522291b80 20 client.26119 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.371+0000 7ff522291b80 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cf0c4456e0 0x55cf0c447ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.371+0000 7ff522291b80 4 client.26119 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:46:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.371+0000 7ff522291b80 1 -- 172.21.15.59:0/1567900898 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cf0c319b30 con 0x55cf0c4456e0 2023-10-08T12:46:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.371+0000 7ff5077fe700 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cf0c4456e0 0x55cf0c447ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff5077fe700 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cf0c4456e0 0x55cf0c447ad0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb3404e1bb8ce323 server_cookie=673d3b74ad217f51 in_seq=0 out_seq=0 2023-10-08T12:46:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff4e77fe700 10 client.26119 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff4e77fe700 1 -- 172.21.15.59:0/1567900898 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55cf0c319b30 con 0x55cf0c4456e0 2023-10-08T12:46:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff4e77fe700 10 client.26119 handle_command_reply: tid=0 2023-10-08T12:46:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff522291b80 1 client.26119 shutdown 2023-10-08T12:46:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff522291b80 1 -- 172.21.15.59:0/1567900898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3cce80 msgr2=0x55cf0c3df0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff522291b80 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3cce80 0x55cf0c3df0d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80a3270 tx=0x7ff4f8009540 comp rx=0 tx=0).stop 2023-10-08T12:46:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff522291b80 1 -- 172.21.15.59:0/1567900898 shutdown_connections 2023-10-08T12:46:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff522291b80 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cf0c4456e0 0x55cf0c447ad0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff522291b80 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cf0c3d8650 0x55cf0c3dddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff4e77fe700 0 client.26119 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff522291b80 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf0c3cce80 0x55cf0c3df0d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff522291b80 1 --2- 172.21.15.59:0/1567900898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf0c3cd7a0 0x55cf0c3dd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff522291b80 1 -- 172.21.15.59:0/1567900898 >> 172.21.15.59:0/1567900898 conn(0x55cf0c342260 msgr2=0x55cf0c3d3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff522291b80 1 -- 172.21.15.59:0/1567900898 shutdown_connections 2023-10-08T12:46:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.372+0000 7ff522291b80 1 -- 172.21.15.59:0/1567900898 wait complete. 2023-10-08T12:46:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.373+0000 7ff522291b80 20 client.26119 trim_cache size 0 max 16384 2023-10-08T12:46:15.380 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:46:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:46:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:46:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "3d8ec6e6-3d60-4bbb-a664-dfff0fbbfc78": { 2023-10-08T12:46:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:46:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "3d8ec6e6-3d60-4bbb-a664-dfff0fbbfc78", 2023-10-08T12:46:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:46:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:46:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:46:15.381 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:46:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.373+0000 7ff50e9ff700 1 -- 172.21.15.59:0/153683577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff4f00a15f0 msgr2=0x7ff4f00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.373+0000 7ff50e9ff700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff4f00a15f0 0x7ff4f00a3ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff500009fd0 tx=0x7ff50000d000 comp rx=0 tx=0).stop 2023-10-08T12:46:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.373+0000 7ff50e9ff700 1 -- 172.21.15.59:0/153683577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508102940 msgr2=0x7ff508198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.373+0000 7ff50e9ff700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508102940 0x7ff508198d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8000c00 tx=0x7ff4f8005740 comp rx=0 tx=0).stop 2023-10-08T12:46:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.374+0000 7ff50e9ff700 1 -- 172.21.15.59:0/153683577 shutdown_connections 2023-10-08T12:46:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.374+0000 7ff50e9ff700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff4f00a15f0 0x7ff4f00a3ab0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.374+0000 7ff50e9ff700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508102940 0x7ff508198d90 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8000c00 tx=0x7ff4f8005740 comp rx=0 tx=0).stop 2023-10-08T12:46:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.374+0000 7ff50e9ff700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff508108950 0x7ff50819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.374+0000 7ff50e9ff700 1 --2- 172.21.15.59:0/153683577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff508103300 0x7ff5081992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.374+0000 7ff50e9ff700 1 -- 172.21.15.59:0/153683577 >> 172.21.15.59:0/153683577 conn(0x7ff5080fe3d0 msgr2=0x7ff5080fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.374+0000 7ff50e9ff700 1 -- 172.21.15.59:0/153683577 shutdown_connections 2023-10-08T12:46:15.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:15.374+0000 7ff50e9ff700 1 -- 172.21.15.59:0/153683577 wait complete. 2023-10-08T12:46:15.396 INFO:tasks.cephfs.filesystem:scrub status for tag:3d8ec6e6-3d60-4bbb-a664-dfff0fbbfc78 - {'path': '/', 'tag': '3d8ec6e6-3d60-4bbb-a664-dfff0fbbfc78', 'options': 'recursive,force'} 2023-10-08T12:46:15.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 592090 13.81 MB/sec execute 106 sec latency 72.012 ms 2023-10-08T12:46:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:15 smithi173 ceph-mon[135182]: pgmap v466: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 271 op/s 2023-10-08T12:46:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:15 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:46:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:15 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:15 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:46:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:15 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:15 smithi059 ceph-mon[98489]: pgmap v466: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 271 op/s 2023-10-08T12:46:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:15 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:46:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:15 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:15 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:46:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:15 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:15 smithi092 ceph-mon[134093]: pgmap v466: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 271 op/s 2023-10-08T12:46:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:15 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:46:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:15 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:15 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:46:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:15 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:16.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 594077 13.79 MB/sec execute 107 sec latency 66.594 ms 2023-10-08T12:46:17.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 597085 13.83 MB/sec execute 108 sec latency 9.259 ms 2023-10-08T12:46:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:17 smithi173 ceph-mon[135182]: pgmap v467: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 278 op/s 2023-10-08T12:46:18.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:17 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:46:18.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:17 smithi059 ceph-mon[98489]: pgmap v467: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 278 op/s 2023-10-08T12:46:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:17 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:46:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:17 smithi092 ceph-mon[134093]: pgmap v467: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 278 op/s 2023-10-08T12:46:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:17 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:46:18.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 599907 13.83 MB/sec execute 109 sec latency 9.396 ms 2023-10-08T12:46:19.511 INFO:tasks.workunit.client.0.smithi059.stdout: 1 602263 13.81 MB/sec execute 110 sec latency 21.416 ms 2023-10-08T12:46:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:19 smithi092 ceph-mon[134093]: pgmap v468: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 273 op/s 2023-10-08T12:46:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:19 smithi173 ceph-mon[135182]: pgmap v468: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 273 op/s 2023-10-08T12:46:20.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:19 smithi059 ceph-mon[98489]: pgmap v468: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 273 op/s 2023-10-08T12:46:20.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 604716 13.81 MB/sec execute 111 sec latency 20.336 ms 2023-10-08T12:46:21.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 607600 13.85 MB/sec execute 112 sec latency 125.867 ms 2023-10-08T12:46:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:21 smithi173 ceph-mon[135182]: pgmap v469: 97 pgs: 97 active+clean; 356 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 285 op/s 2023-10-08T12:46:22.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:21 smithi059 ceph-mon[98489]: pgmap v469: 97 pgs: 97 active+clean; 356 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 285 op/s 2023-10-08T12:46:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:21 smithi092 ceph-mon[134093]: pgmap v469: 97 pgs: 97 active+clean; 356 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 285 op/s 2023-10-08T12:46:22.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 610325 13.84 MB/sec execute 113 sec latency 26.457 ms 2023-10-08T12:46:23.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 612002 13.79 MB/sec execute 114 sec latency 185.059 ms 2023-10-08T12:46:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:23 smithi173 ceph-mon[135182]: pgmap v470: 97 pgs: 97 active+clean; 364 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 311 op/s 2023-10-08T12:46:24.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:23 smithi059 ceph-mon[98489]: pgmap v470: 97 pgs: 97 active+clean; 364 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 311 op/s 2023-10-08T12:46:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:23 smithi092 ceph-mon[134093]: pgmap v470: 97 pgs: 97 active+clean; 364 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 311 op/s 2023-10-08T12:46:24.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 614849 13.82 MB/sec execute 115 sec latency 10.398 ms 2023-10-08T12:46:25.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 617787 13.83 MB/sec execute 116 sec latency 10.202 ms 2023-10-08T12:46:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:25 smithi173 ceph-mon[135182]: pgmap v471: 97 pgs: 97 active+clean; 364 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 253 op/s 2023-10-08T12:46:26.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:25 smithi059 ceph-mon[98489]: pgmap v471: 97 pgs: 97 active+clean; 364 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 253 op/s 2023-10-08T12:46:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:25 smithi092 ceph-mon[134093]: pgmap v471: 97 pgs: 97 active+clean; 364 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 253 op/s 2023-10-08T12:46:26.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 619418 13.79 MB/sec execute 117 sec latency 118.385 ms 2023-10-08T12:46:27.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 621999 13.79 MB/sec execute 118 sec latency 25.503 ms 2023-10-08T12:46:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:27 smithi173 ceph-mon[135182]: pgmap v472: 97 pgs: 97 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 256 op/s 2023-10-08T12:46:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:27 smithi059 ceph-mon[98489]: pgmap v472: 97 pgs: 97 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 256 op/s 2023-10-08T12:46:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:27 smithi092 ceph-mon[134093]: pgmap v472: 97 pgs: 97 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 256 op/s 2023-10-08T12:46:28.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 625217 13.83 MB/sec execute 119 sec latency 14.788 ms 2023-10-08T12:46:29.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 627952 13.82 MB/sec execute 120 sec latency 9.923 ms 2023-10-08T12:46:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:29 smithi092 ceph-mon[134093]: pgmap v473: 97 pgs: 97 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 244 op/s 2023-10-08T12:46:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:29 smithi173 ceph-mon[135182]: pgmap v473: 97 pgs: 97 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 244 op/s 2023-10-08T12:46:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:29 smithi059 ceph-mon[98489]: pgmap v473: 97 pgs: 97 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 244 op/s 2023-10-08T12:46:30.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 630027 13.81 MB/sec execute 121 sec latency 91.263 ms 2023-10-08T12:46:31.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 632551 13.81 MB/sec execute 122 sec latency 47.032 ms 2023-10-08T12:46:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:31 smithi173 ceph-mon[135182]: pgmap v474: 97 pgs: 97 active+clean; 372 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 277 op/s 2023-10-08T12:46:32.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:31 smithi059 ceph-mon[98489]: pgmap v474: 97 pgs: 97 active+clean; 372 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 277 op/s 2023-10-08T12:46:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:31 smithi092 ceph-mon[134093]: pgmap v474: 97 pgs: 97 active+clean; 372 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 277 op/s 2023-10-08T12:46:32.512 INFO:tasks.workunit.client.0.smithi059.stdout: 1 635145 13.80 MB/sec execute 123 sec latency 23.730 ms 2023-10-08T12:46:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:32 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:46:33.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:32 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:46:33.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:32 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:46:33.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 637378 13.79 MB/sec execute 124 sec latency 17.730 ms 2023-10-08T12:46:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:33 smithi173 ceph-mon[135182]: pgmap v475: 97 pgs: 97 active+clean; 375 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 253 op/s 2023-10-08T12:46:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:46:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:46:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:46:34.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:33 smithi059 ceph-mon[98489]: pgmap v475: 97 pgs: 97 active+clean; 375 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 253 op/s 2023-10-08T12:46:34.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:46:34.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:46:34.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:46:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:33 smithi092 ceph-mon[134093]: pgmap v475: 97 pgs: 97 active+clean; 375 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 253 op/s 2023-10-08T12:46:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:46:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:46:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:46:34.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 640123 13.79 MB/sec execute 125 sec latency 16.670 ms 2023-10-08T12:46:35.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 643209 13.83 MB/sec execute 126 sec latency 7.482 ms 2023-10-08T12:46:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:35 smithi173 ceph-mon[135182]: pgmap v476: 97 pgs: 97 active+clean; 375 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 212 op/s 2023-10-08T12:46:36.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:35 smithi059 ceph-mon[98489]: pgmap v476: 97 pgs: 97 active+clean; 375 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 212 op/s 2023-10-08T12:46:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:35 smithi092 ceph-mon[134093]: pgmap v476: 97 pgs: 97 active+clean; 375 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 212 op/s 2023-10-08T12:46:36.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 645577 13.81 MB/sec execute 127 sec latency 56.893 ms 2023-10-08T12:46:37.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 646673 13.76 MB/sec execute 128 sec latency 480.746 ms 2023-10-08T12:46:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:37 smithi173 ceph-mon[135182]: pgmap v477: 97 pgs: 97 active+clean; 384 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 297 op/s 2023-10-08T12:46:38.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:37 smithi059 ceph-mon[98489]: pgmap v477: 97 pgs: 97 active+clean; 384 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 297 op/s 2023-10-08T12:46:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:37 smithi092 ceph-mon[134093]: pgmap v477: 97 pgs: 97 active+clean; 384 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 297 op/s 2023-10-08T12:46:38.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 649336 13.75 MB/sec execute 129 sec latency 22.347 ms 2023-10-08T12:46:39.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 651806 13.74 MB/sec execute 130 sec latency 14.236 ms 2023-10-08T12:46:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:39 smithi092 ceph-mon[134093]: pgmap v478: 97 pgs: 97 active+clean; 380 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 250 op/s 2023-10-08T12:46:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:39 smithi173 ceph-mon[135182]: pgmap v478: 97 pgs: 97 active+clean; 380 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 250 op/s 2023-10-08T12:46:40.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:39 smithi059 ceph-mon[98489]: pgmap v478: 97 pgs: 97 active+clean; 380 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 250 op/s 2023-10-08T12:46:40.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 654265 13.74 MB/sec execute 131 sec latency 7.611 ms 2023-10-08T12:46:41.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 657217 13.78 MB/sec execute 132 sec latency 82.040 ms 2023-10-08T12:46:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:41 smithi173 ceph-mon[135182]: pgmap v479: 97 pgs: 97 active+clean; 376 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 302 op/s 2023-10-08T12:46:42.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:41 smithi059 ceph-mon[98489]: pgmap v479: 97 pgs: 97 active+clean; 376 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 302 op/s 2023-10-08T12:46:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:41 smithi092 ceph-mon[134093]: pgmap v479: 97 pgs: 97 active+clean; 376 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 302 op/s 2023-10-08T12:46:42.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 659742 13.76 MB/sec execute 133 sec latency 21.472 ms 2023-10-08T12:46:43.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 661665 13.73 MB/sec execute 134 sec latency 86.891 ms 2023-10-08T12:46:44.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:43 smithi173 ceph-mon[135182]: pgmap v480: 97 pgs: 97 active+clean; 365 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 289 op/s 2023-10-08T12:46:44.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:43 smithi059 ceph-mon[98489]: pgmap v480: 97 pgs: 97 active+clean; 365 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 289 op/s 2023-10-08T12:46:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:43 smithi092 ceph-mon[134093]: pgmap v480: 97 pgs: 97 active+clean; 365 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 289 op/s 2023-10-08T12:46:44.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 664491 13.76 MB/sec execute 135 sec latency 13.741 ms 2023-10-08T12:46:45.396 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:46:45.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 667333 13.76 MB/sec execute 136 sec latency 8.358 ms 2023-10-08T12:46:45.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.623+0000 7fe607fff700 1 -- 172.21.15.59:0/15640405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe600101100 msgr2=0x7fe60010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.623+0000 7fe607fff700 1 --2- 172.21.15.59:0/15640405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe600101100 0x7fe60010d610 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009f90 tx=0x7fe5f800b330 comp rx=0 tx=0).stop 2023-10-08T12:46:45.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.623+0000 7fe607fff700 1 -- 172.21.15.59:0/15640405 shutdown_connections 2023-10-08T12:46:45.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.623+0000 7fe607fff700 1 --2- 172.21.15.59:0/15640405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe600101100 0x7fe60010d610 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.623+0000 7fe607fff700 1 --2- 172.21.15.59:0/15640405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe600106750 0x7fe600106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.623+0000 7fe607fff700 1 --2- 172.21.15.59:0/15640405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe600100740 0x7fe600100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.623+0000 7fe607fff700 1 -- 172.21.15.59:0/15640405 >> 172.21.15.59:0/15640405 conn(0x7fe6000fc230 msgr2=0x7fe6000fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:45.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.623+0000 7fe607fff700 1 -- 172.21.15.59:0/15640405 shutdown_connections 2023-10-08T12:46:45.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.623+0000 7fe607fff700 1 -- 172.21.15.59:0/15640405 wait complete. 2023-10-08T12:46:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.624+0000 7fe607fff700 1 Processor -- start 2023-10-08T12:46:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.624+0000 7fe607fff700 1 -- start start 2023-10-08T12:46:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.625+0000 7fe607fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe600100740 0x7fe600198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.625+0000 7fe607fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe600101100 0x7fe600199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.625+0000 7fe607fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe600106750 0x7fe60019c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.625+0000 7fe607fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60019cb60 con 0x7fe600100740 2023-10-08T12:46:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.625+0000 7fe607fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60019ccd0 con 0x7fe600106750 2023-10-08T12:46:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.625+0000 7fe607fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60019ce90 con 0x7fe600101100 2023-10-08T12:46:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.625+0000 7fe60559a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe600101100 0x7fe600199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.625+0000 7fe60559a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe600101100 0x7fe600199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51566/0 (socket says 172.21.15.59:51566) 2023-10-08T12:46:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.625+0000 7fe60659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe600106750 0x7fe60019c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.625+0000 7fe60559a700 1 -- 172.21.15.59:0/3705813489 learned_addr learned my addr 172.21.15.59:0/3705813489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.625+0000 7fe605d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe600100740 0x7fe600198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe60659c700 1 -- 172.21.15.59:0/3705813489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe600101100 msgr2=0x7fe600199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe60659c700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe600101100 0x7fe600199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe60659c700 1 -- 172.21.15.59:0/3705813489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe600100740 msgr2=0x7fe600198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe60659c700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe600100740 0x7fe600198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe60659c700 1 -- 172.21.15.59:0/3705813489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8009c40 con 0x7fe600106750 2023-10-08T12:46:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe60559a700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe600101100 0x7fe600199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe60659c700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe600106750 0x7fe60019c560 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800b6c0 tx=0x7fe5f8008fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe5f6ffd700 1 -- 172.21.15.59:0/3705813489 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800e040 con 0x7fe600106750 2023-10-08T12:46:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe5f6ffd700 1 -- 172.21.15.59:0/3705813489 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5f801d470 con 0x7fe600106750 2023-10-08T12:46:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe607fff700 1 -- 172.21.15.59:0/3705813489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60019d110 con 0x7fe600106750 2023-10-08T12:46:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe5f6ffd700 1 -- 172.21.15.59:0/3705813489 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80052a0 con 0x7fe600106750 2023-10-08T12:46:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.626+0000 7fe607fff700 1 -- 172.21.15.59:0/3705813489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6001a5ad0 con 0x7fe600106750 2023-10-08T12:46:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.630+0000 7fe5f6ffd700 1 -- 172.21.15.59:0/3705813489 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe5f801d5e0 con 0x7fe600106750 2023-10-08T12:46:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.631+0000 7fe5f6ffd700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5ec0a15f0 0x7fe5ec0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.631+0000 7fe61b857b80 1 Processor -- start 2023-10-08T12:46:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.632+0000 7fe5f6ffd700 1 -- 172.21.15.59:0/3705813489 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe5f80ce3f0 con 0x7fe600106750 2023-10-08T12:46:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.632+0000 7fe61b857b80 1 -- start start 2023-10-08T12:46:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.632+0000 7fe605d9b700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5ec0a15f0 0x7fe5ec0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.632+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e569110e80 0x55e569111260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.632+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5691117a0 0x55e56911c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.632+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e56911c650 0x55e56911ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.632+0000 7fe61b857b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56907a460 con 0x55e56911c650 2023-10-08T12:46:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.632+0000 7fe61b857b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56906bc20 con 0x55e569110e80 2023-10-08T12:46:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.632+0000 7fe61b857b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e569069540 con 0x55e5691117a0 2023-10-08T12:46:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe605d9b700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5ec0a15f0 0x7fe5ec0a3ab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009be0 tx=0x7fe5fc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe605d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e569110e80 0x55e569111260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe605d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e569110e80 0x55e569111260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50380/0 (socket says 172.21.15.59:50380) 2023-10-08T12:46:45.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe605d9b700 1 -- 172.21.15.59:0/3937776371 learned_addr learned my addr 172.21.15.59:0/3937776371 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:45.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe60659c700 1 --2- 172.21.15.59:0/3937776371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e56911c650 0x55e56911ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe60559a700 1 --2- 172.21.15.59:0/3937776371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5691117a0 0x55e56911c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe605d9b700 1 -- 172.21.15.59:0/3937776371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5691117a0 msgr2=0x55e56911c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe605d9b700 1 --2- 172.21.15.59:0/3937776371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5691117a0 0x55e56911c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe605d9b700 1 -- 172.21.15.59:0/3937776371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e56911c650 msgr2=0x55e56911ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe605d9b700 1 --2- 172.21.15.59:0/3937776371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e56911c650 0x55e56911ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe605d9b700 1 -- 172.21.15.59:0/3937776371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e568e8fde0 con 0x55e569110e80 2023-10-08T12:46:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.633+0000 7fe605d9b700 1 --2- 172.21.15.59:0/3937776371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e569110e80 0x55e569111260 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc011d70 tx=0x7fe5fc014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af3e2b0978010e31 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:45.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.634+0000 7fe5ebfff700 1 -- 172.21.15.59:0/3937776371 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc011da0 con 0x55e569110e80 2023-10-08T12:46:45.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.634+0000 7fe5ebfff700 1 -- 172.21.15.59:0/3937776371 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5fc004830 con 0x55e569110e80 2023-10-08T12:46:45.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.634+0000 7fe5ebfff700 1 -- 172.21.15.59:0/3937776371 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc005390 con 0x55e569110e80 2023-10-08T12:46:45.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.634+0000 7fe61b857b80 1 -- 172.21.15.59:0/3937776371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e569110e80 msgr2=0x55e569111260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.634+0000 7fe61b857b80 1 --2- 172.21.15.59:0/3937776371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e569110e80 0x55e569111260 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc011d70 tx=0x7fe5fc014000 comp rx=0 tx=0).stop 2023-10-08T12:46:45.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.635+0000 7fe61b857b80 1 -- 172.21.15.59:0/3937776371 shutdown_connections 2023-10-08T12:46:45.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.635+0000 7fe61b857b80 1 --2- 172.21.15.59:0/3937776371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e569110e80 0x55e569111260 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.635+0000 7fe61b857b80 1 --2- 172.21.15.59:0/3937776371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e56911c650 0x55e56911ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.635+0000 7fe61b857b80 1 --2- 172.21.15.59:0/3937776371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5691117a0 0x55e56911c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.635+0000 7fe61b857b80 1 -- 172.21.15.59:0/3937776371 >> 172.21.15.59:0/3937776371 conn(0x55e569086260 msgr2=0x55e56910d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.635+0000 7fe61b857b80 1 -- 172.21.15.59:0/3937776371 shutdown_connections 2023-10-08T12:46:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.635+0000 7fe61b857b80 1 -- 172.21.15.59:0/3937776371 wait complete. 2023-10-08T12:46:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.635+0000 7fe61b857b80 1 -- start start 2023-10-08T12:46:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.636+0000 7fe61b857b80 1 Processor -- start 2023-10-08T12:46:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.636+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e56911bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.636+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e5691192c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.636+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e56911c650 0x55e5691198f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.636+0000 7fe61b857b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e569064e30 con 0x55e569110e80 2023-10-08T12:46:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.636+0000 7fe61b857b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e569001710 con 0x55e5691117a0 2023-10-08T12:46:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.636+0000 7fe61b857b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5690013b0 con 0x55e56911c650 2023-10-08T12:46:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.636+0000 7fe61b857b80 10 client.0 _ll_register_callbacks cb 0x55e568e5e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe60559a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e5691192c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe60559a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e5691192c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50392/0 (socket says 172.21.15.59:50392) 2023-10-08T12:46:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe60559a700 1 -- 172.21.15.59:0/2640943513 learned_addr learned my addr 172.21.15.59:0/2640943513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe60659c700 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e56911c650 0x55e5691198f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe605d9b700 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e56911bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe60559a700 1 -- 172.21.15.59:0/2640943513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e56911c650 msgr2=0x55e5691198f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe60559a700 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e56911c650 0x55e5691198f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe60559a700 1 -- 172.21.15.59:0/2640943513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 msgr2=0x55e56911bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe60559a700 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e56911bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe60559a700 1 -- 172.21.15.59:0/2640943513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc017070 con 0x55e5691117a0 2023-10-08T12:46:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe60559a700 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e5691192c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0012d20 tx=0x7fe5f000f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ac5872e91469e86 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.637+0000 7fe5e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.638+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2640943513 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0017070 con 0x55e5691117a0 2023-10-08T12:46:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.638+0000 7fe61b857b80 1 -- 172.21.15.59:0/2640943513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e56902ceb0 con 0x55e5691117a0 2023-10-08T12:46:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.638+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2640943513 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe5f000fb80 con 0x55e5691117a0 2023-10-08T12:46:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.638+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2640943513 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5f000fd40 con 0x55e5691117a0 2023-10-08T12:46:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.638+0000 7fe61b857b80 10 client.26135 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.638+0000 7fe61b857b80 1 -- 172.21.15.59:0/2640943513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e568e78c60 con 0x55e5691117a0 2023-10-08T12:46:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.638+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2640943513 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e56902ceb0 con 0x55e5691117a0 2023-10-08T12:46:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.638+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2640943513 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe5f0003bb0 con 0x55e5691117a0 2023-10-08T12:46:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.639+0000 7fe61b857b80 10 client.26135 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.639+0000 7fe61b857b80 10 client.26135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.639+0000 7fe61b857b80 20 client.26135 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.639+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e56912c0d0 0x55e56912e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.639+0000 7fe61b857b80 4 client.26135 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.639+0000 7fe61b857b80 1 -- 172.21.15.59:0/2640943513 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e56905de10 con 0x55e56912c0d0 2023-10-08T12:46:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.639+0000 7fe605d9b700 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e56912c0d0 0x55e56912e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.639+0000 7fe605d9b700 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e56912c0d0 0x55e56912e4f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324b9a80b9eb632e server_cookie=16ee6d6ca2ea8009 in_seq=0 out_seq=0 2023-10-08T12:46:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.639+0000 7fe5e97fa700 10 client.26135 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.640+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2640943513 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e56905de10 con 0x55e56912c0d0 2023-10-08T12:46:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.640+0000 7fe5e97fa700 10 client.26135 handle_command_reply: tid=0 2023-10-08T12:46:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.640+0000 7fe61b857b80 1 client.26135 shutdown 2023-10-08T12:46:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe61b857b80 1 -- 172.21.15.59:0/2640943513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 msgr2=0x55e5691192c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e5691192c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0012d20 tx=0x7fe5f000f6a0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe61b857b80 1 -- 172.21.15.59:0/2640943513 shutdown_connections 2023-10-08T12:46:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e56912c0d0 0x55e56912e4f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e56911c650 0x55e5691198f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e56911bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2640943513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e5691192c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe61b857b80 1 -- 172.21.15.59:0/2640943513 >> 172.21.15.59:0/2640943513 conn(0x55e569086260 msgr2=0x55e56910cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe5e97fa700 0 client.26135 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe61b857b80 1 -- 172.21.15.59:0/2640943513 shutdown_connections 2023-10-08T12:46:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe61b857b80 1 -- 172.21.15.59:0/2640943513 wait complete. 2023-10-08T12:46:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.641+0000 7fe61b857b80 20 client.26135 trim_cache size 0 max 16384 2023-10-08T12:46:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.660+0000 7fe61b857b80 1 Processor -- start 2023-10-08T12:46:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.660+0000 7fe61b857b80 1 -- start start 2023-10-08T12:46:45.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e5691231a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e569117b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e56911c650 0x55e5691180d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe61b857b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e568ee5920 con 0x55e569110e80 2023-10-08T12:46:45.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe61b857b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e569111b80 con 0x55e5691117a0 2023-10-08T12:46:45.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe61b857b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5691120d0 con 0x55e56911c650 2023-10-08T12:46:45.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe60559a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e569117b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe605d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e5691231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe60559a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e569117b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50400/0 (socket says 172.21.15.59:50400) 2023-10-08T12:46:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe60559a700 1 -- 172.21.15.59:0/1562486302 learned_addr learned my addr 172.21.15.59:0/1562486302 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe60659c700 1 --2- 172.21.15.59:0/1562486302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e56911c650 0x55e5691180d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe60559a700 1 -- 172.21.15.59:0/1562486302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e56911c650 msgr2=0x55e5691180d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe60559a700 1 --2- 172.21.15.59:0/1562486302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e56911c650 0x55e5691180d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe60559a700 1 -- 172.21.15.59:0/1562486302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 msgr2=0x55e5691231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe60559a700 1 --2- 172.21.15.59:0/1562486302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e5691231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.661+0000 7fe60559a700 1 -- 172.21.15.59:0/1562486302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e568eb6250 con 0x55e5691117a0 2023-10-08T12:46:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.662+0000 7fe60559a700 1 --2- 172.21.15.59:0/1562486302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e569117b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009d50 tx=0x7fe5f0005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c96b6b5eb101c3e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:45.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.662+0000 7fe5f4ff9700 1 -- 172.21.15.59:0/1562486302 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0017040 con 0x55e5691117a0 2023-10-08T12:46:45.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.662+0000 7fe5f4ff9700 1 -- 172.21.15.59:0/1562486302 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5f0026e30 con 0x55e5691117a0 2023-10-08T12:46:45.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.662+0000 7fe5f4ff9700 1 -- 172.21.15.59:0/1562486302 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f00055e0 con 0x55e5691117a0 2023-10-08T12:46:45.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.663+0000 7fe61b857b80 1 -- 172.21.15.59:0/1562486302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 msgr2=0x55e569117b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.663+0000 7fe61b857b80 1 --2- 172.21.15.59:0/1562486302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e569117b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009d50 tx=0x7fe5f0005a00 comp rx=0 tx=0).stop 2023-10-08T12:46:45.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.663+0000 7fe61b857b80 1 -- 172.21.15.59:0/1562486302 shutdown_connections 2023-10-08T12:46:45.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.663+0000 7fe61b857b80 1 --2- 172.21.15.59:0/1562486302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e56911c650 0x55e5691180d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.663+0000 7fe61b857b80 1 --2- 172.21.15.59:0/1562486302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e5691231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.663+0000 7fe61b857b80 1 --2- 172.21.15.59:0/1562486302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e5691117a0 0x55e569117b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.663+0000 7fe61b857b80 1 -- 172.21.15.59:0/1562486302 >> 172.21.15.59:0/1562486302 conn(0x55e569086260 msgr2=0x55e56911bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:45.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.663+0000 7fe61b857b80 1 -- 172.21.15.59:0/1562486302 shutdown_connections 2023-10-08T12:46:45.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.663+0000 7fe61b857b80 1 -- 172.21.15.59:0/1562486302 wait complete. 2023-10-08T12:46:45.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.663+0000 7fe61b857b80 1 -- start start 2023-10-08T12:46:45.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.664+0000 7fe61b857b80 1 Processor -- start 2023-10-08T12:46:45.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.664+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e5691218f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.664+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5691117a0 0x55e569121e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.664+0000 7fe61b857b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e56911c650 0x55e569122370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.664+0000 7fe61b857b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e569123750 con 0x55e569110e80 2023-10-08T12:46:45.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.664+0000 7fe61b857b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56917ff30 con 0x55e56911c650 2023-10-08T12:46:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.664+0000 7fe61b857b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5691800a0 con 0x55e5691117a0 2023-10-08T12:46:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.664+0000 7fe61b857b80 10 client.0 _ll_register_callbacks cb 0x7fe5f00127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe605d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e5691218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe60659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e56911c650 0x55e569122370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe605d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e5691218f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41564/0 (socket says 172.21.15.59:41564) 2023-10-08T12:46:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe605d9b700 1 -- 172.21.15.59:0/2869848723 learned_addr learned my addr 172.21.15.59:0/2869848723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe60559a700 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5691117a0 0x55e569121e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe605d9b700 1 -- 172.21.15.59:0/2869848723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5691117a0 msgr2=0x55e569121e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe605d9b700 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5691117a0 0x55e569121e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe605d9b700 1 -- 172.21.15.59:0/2869848723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e56911c650 msgr2=0x55e569122370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe605d9b700 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e56911c650 0x55e569122370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe605d9b700 1 -- 172.21.15.59:0/2869848723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e568e78c60 con 0x55e569110e80 2023-10-08T12:46:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe60659c700 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e56911c650 0x55e569122370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe60559a700 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5691117a0 0x55e569121e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe605d9b700 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e5691218f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00e970 tx=0x7fe5fc009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b7a7ecc405dae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.665+0000 7fe5e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:46:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.666+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2869848723 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc02c040 con 0x55e569110e80 2023-10-08T12:46:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.666+0000 7fe61b857b80 1 -- 172.21.15.59:0/2869848723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe5fc004830 con 0x55e569110e80 2023-10-08T12:46:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.666+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2869848723 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe5fc033540 con 0x55e569110e80 2023-10-08T12:46:45.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.666+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2869848723 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5fc00eca0 con 0x55e569110e80 2023-10-08T12:46:45.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.666+0000 7fe61b857b80 10 client.16140 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:45.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.666+0000 7fe61b857b80 1 -- 172.21.15.59:0/2869848723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e568e8e2b0 con 0x55e569110e80 2023-10-08T12:46:45.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.666+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2869848723 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5fc004830 con 0x55e569110e80 2023-10-08T12:46:45.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.667+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2869848723 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe5fc024030 con 0x55e569110e80 2023-10-08T12:46:45.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.667+0000 7fe61b857b80 10 client.16140 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:45.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.667+0000 7fe61b857b80 10 client.16140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:45.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.667+0000 7fe61b857b80 20 client.16140 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:45.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.667+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e5691817b0 0x55e569183bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.667+0000 7fe61b857b80 4 client.16140 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:46:45.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.667+0000 7fe61b857b80 1 -- 172.21.15.59:0/2869848723 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e56905db30 con 0x55e5691817b0 2023-10-08T12:46:45.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.667+0000 7fe60559a700 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e5691817b0 0x55e569183bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.667+0000 7fe5e97fa700 10 client.16140 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:45.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.667+0000 7fe60559a700 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e5691817b0 0x55e569183bd0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b7ed12937b1c4e3 server_cookie=cbdeb747e62e346c in_seq=0 out_seq=0 2023-10-08T12:46:45.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe5e97fa700 1 -- 172.21.15.59:0/2869848723 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e56905db30 con 0x55e5691817b0 2023-10-08T12:46:45.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe5e97fa700 10 client.16140 handle_command_reply: tid=0 2023-10-08T12:46:45.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 1 client.16140 shutdown 2023-10-08T12:46:45.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 1 -- 172.21.15.59:0/2869848723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 msgr2=0x55e5691218f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e5691218f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00e970 tx=0x7fe5fc009950 comp rx=0 tx=0).stop 2023-10-08T12:46:45.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 1 -- 172.21.15.59:0/2869848723 shutdown_connections 2023-10-08T12:46:45.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e5691817b0 0x55e569183bd0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e56911c650 0x55e569122370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e569110e80 0x55e5691218f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 1 --2- 172.21.15.59:0/2869848723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5691117a0 0x55e569121e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 1 -- 172.21.15.59:0/2869848723 >> 172.21.15.59:0/2869848723 conn(0x55e569086260 msgr2=0x55e569117ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:45.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe5e97fa700 0 client.16140 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:45.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 1 -- 172.21.15.59:0/2869848723 shutdown_connections 2023-10-08T12:46:45.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 1 -- 172.21.15.59:0/2869848723 wait complete. 2023-10-08T12:46:45.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.668+0000 7fe61b857b80 20 client.16140 trim_cache size 0 max 16384 2023-10-08T12:46:45.676 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:46:45.676 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:46:45.676 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:46:45.676 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:46:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 -- 172.21.15.59:0/3705813489 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5ec0a15f0 msgr2=0x7fe5ec0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5ec0a15f0 0x7fe5ec0a3ab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009be0 tx=0x7fe5fc009260 comp rx=0 tx=0).stop 2023-10-08T12:46:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 -- 172.21.15.59:0/3705813489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe600106750 msgr2=0x7fe60019c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe600106750 0x7fe60019c560 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800b6c0 tx=0x7fe5f8008fb0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 -- 172.21.15.59:0/3705813489 shutdown_connections 2023-10-08T12:46:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe5ec0a15f0 0x7fe5ec0a3ab0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe600106750 0x7fe60019c560 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe600100740 0x7fe600198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 --2- 172.21.15.59:0/3705813489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe600101100 0x7fe600199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 -- 172.21.15.59:0/3705813489 >> 172.21.15.59:0/3705813489 conn(0x7fe6000fc230 msgr2=0x7fe600072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 -- 172.21.15.59:0/3705813489 shutdown_connections 2023-10-08T12:46:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.669+0000 7fe607fff700 1 -- 172.21.15.59:0/3705813489 wait complete. 2023-10-08T12:46:45.697 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:46:45.697 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:46:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.930+0000 7fcf251ff700 1 -- 172.21.15.59:0/2014835270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20106640 msgr2=0x7fcf20106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.930+0000 7fcf251ff700 1 --2- 172.21.15.59:0/2014835270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20106640 0x7fcf20106a20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcf100098f0 tx=0x7fcf10009c00 comp rx=0 tx=0).stop 2023-10-08T12:46:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.931+0000 7fcf251ff700 1 -- 172.21.15.59:0/2014835270 shutdown_connections 2023-10-08T12:46:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.931+0000 7fcf251ff700 1 --2- 172.21.15.59:0/2014835270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20106640 0x7fcf20106a20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.931+0000 7fcf251ff700 1 --2- 172.21.15.59:0/2014835270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf20100ff0 0x7fcf2010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.931+0000 7fcf251ff700 1 --2- 172.21.15.59:0/2014835270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf20100630 0x7fcf20100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.931+0000 7fcf251ff700 1 -- 172.21.15.59:0/2014835270 >> 172.21.15.59:0/2014835270 conn(0x7fcf200fc1a0 msgr2=0x7fcf200fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.931+0000 7fcf251ff700 1 -- 172.21.15.59:0/2014835270 shutdown_connections 2023-10-08T12:46:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.931+0000 7fcf251ff700 1 -- 172.21.15.59:0/2014835270 wait complete. 2023-10-08T12:46:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.932+0000 7fcf251ff700 1 Processor -- start 2023-10-08T12:46:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.932+0000 7fcf251ff700 1 -- start start 2023-10-08T12:46:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.933+0000 7fcf251ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20100630 0x7fcf20198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.933+0000 7fcf251ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf20100ff0 0x7fcf20199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.933+0000 7fcf251ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf20106640 0x7fcf2019c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.933+0000 7fcf251ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2019cb30 con 0x7fcf20106640 2023-10-08T12:46:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.933+0000 7fcf251ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2019cca0 con 0x7fcf20100630 2023-10-08T12:46:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.933+0000 7fcf251ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2019ce60 con 0x7fcf20100ff0 2023-10-08T12:46:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.933+0000 7fcf1e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf20100ff0 0x7fcf20199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.933+0000 7fcf1e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf20100ff0 0x7fcf20199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51622/0 (socket says 172.21.15.59:51622) 2023-10-08T12:46:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.933+0000 7fcf1e59c700 1 -- 172.21.15.59:0/1674591121 learned_addr learned my addr 172.21.15.59:0/1674591121 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.933+0000 7fcf1ed9d700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20100630 0x7fcf20198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.933+0000 7fcf1f59e700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf20106640 0x7fcf2019c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf1e59c700 1 -- 172.21.15.59:0/1674591121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20100630 msgr2=0x7fcf20198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf1e59c700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20100630 0x7fcf20198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf1e59c700 1 -- 172.21.15.59:0/1674591121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf20106640 msgr2=0x7fcf2019c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf1e59c700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf20106640 0x7fcf2019c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf1e59c700 1 -- 172.21.15.59:0/1674591121 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140095f0 con 0x7fcf20100ff0 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf1f59e700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf20106640 0x7fcf2019c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf1e59c700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf20100ff0 0x7fcf20199290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400ec10 tx=0x7fcf1400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf07fff700 1 -- 172.21.15.59:0/1674591121 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400cc90 con 0x7fcf20100ff0 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf07fff700 1 -- 172.21.15.59:0/1674591121 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf140044e0 con 0x7fcf20100ff0 2023-10-08T12:46:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf251ff700 1 -- 172.21.15.59:0/1674591121 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf10009520 con 0x7fcf20100ff0 2023-10-08T12:46:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf07fff700 1 -- 172.21.15.59:0/1674591121 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14010430 con 0x7fcf20100ff0 2023-10-08T12:46:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.934+0000 7fcf251ff700 1 -- 172.21.15.59:0/1674591121 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf201a58c0 con 0x7fcf20100ff0 2023-10-08T12:46:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.935+0000 7fcf251ff700 1 -- 172.21.15.59:0/1674591121 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf20101d70 con 0x7fcf20100ff0 2023-10-08T12:46:45.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.937+0000 7fcf07fff700 1 -- 172.21.15.59:0/1674591121 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fcf14003fb0 con 0x7fcf20100ff0 2023-10-08T12:46:45.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.939+0000 7fcf07fff700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcf080a15f0 0x7fcf080a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:45.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.939+0000 7fcf07fff700 1 -- 172.21.15.59:0/1674591121 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fcf14014070 con 0x7fcf20100ff0 2023-10-08T12:46:45.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.939+0000 7fcf1ed9d700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcf080a15f0 0x7fcf080a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:45.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.940+0000 7fcf1ed9d700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcf080a15f0 0x7fcf080a3ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcf100098c0 tx=0x7fcf10019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:45.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:45.941+0000 7fcf07fff700 1 -- 172.21.15.59:0/1674591121 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcf140969c0 con 0x7fcf20100ff0 2023-10-08T12:46:46.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:45 smithi059 ceph-mon[98489]: pgmap v481: 97 pgs: 97 active+clean; 367 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 244 op/s 2023-10-08T12:46:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:45 smithi173 ceph-mon[135182]: pgmap v481: 97 pgs: 97 active+clean; 367 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 244 op/s 2023-10-08T12:46:46.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.255+0000 7fcf251ff700 1 -- 172.21.15.59:0/1674591121 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf20067450 con 0x7fcf20100ff0 2023-10-08T12:46:46.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.256+0000 7fcf07fff700 1 -- 172.21.15.59:0/1674591121 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fcf14099fe0 con 0x7fcf20100ff0 2023-10-08T12:46:46.257 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:46:46.257 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:46:46.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 -- 172.21.15.59:0/1674591121 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcf080a15f0 msgr2=0x7fcf080a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:46.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcf080a15f0 0x7fcf080a3ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcf100098c0 tx=0x7fcf10019040 comp rx=0 tx=0).stop 2023-10-08T12:46:46.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 -- 172.21.15.59:0/1674591121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf20100ff0 msgr2=0x7fcf20199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:46.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf20100ff0 0x7fcf20199290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400ec10 tx=0x7fcf1400ef20 comp rx=0 tx=0).stop 2023-10-08T12:46:46.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 -- 172.21.15.59:0/1674591121 shutdown_connections 2023-10-08T12:46:46.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fcf080a15f0 0x7fcf080a3ab0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20100630 0x7fcf20198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf20106640 0x7fcf2019c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 --2- 172.21.15.59:0/1674591121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf20100ff0 0x7fcf20199290 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 -- 172.21.15.59:0/1674591121 >> 172.21.15.59:0/1674591121 conn(0x7fcf200fc1a0 msgr2=0x7fcf200fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:46.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 -- 172.21.15.59:0/1674591121 shutdown_connections 2023-10-08T12:46:46.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.259+0000 7fcf251ff700 1 -- 172.21.15.59:0/1674591121 wait complete. 2023-10-08T12:46:46.261 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:46:46.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:46:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:45 smithi092 ceph-mon[134093]: pgmap v481: 97 pgs: 97 active+clean; 367 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 244 op/s 2023-10-08T12:46:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.491+0000 7f06e87ff700 1 -- 172.21.15.59:0/3105419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06e0106750 msgr2=0x7f06e0106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.491+0000 7f06e87ff700 1 --2- 172.21.15.59:0/3105419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06e0106750 0x7f06e0106b30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009990 tx=0x7f06dc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.491+0000 7f06e87ff700 1 -- 172.21.15.59:0/3105419 shutdown_connections 2023-10-08T12:46:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.491+0000 7f06e87ff700 1 --2- 172.21.15.59:0/3105419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06e0106750 0x7f06e0106b30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.491+0000 7f06e87ff700 1 --2- 172.21.15.59:0/3105419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e0101100 0x7f06e010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.491+0000 7f06e87ff700 1 --2- 172.21.15.59:0/3105419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06e0100740 0x7f06e0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.491+0000 7f06e87ff700 1 -- 172.21.15.59:0/3105419 >> 172.21.15.59:0/3105419 conn(0x7f06e00fc230 msgr2=0x7f06e00fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.491+0000 7f06e87ff700 1 -- 172.21.15.59:0/3105419 shutdown_connections 2023-10-08T12:46:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.491+0000 7f06e87ff700 1 -- 172.21.15.59:0/3105419 wait complete. 2023-10-08T12:46:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.492+0000 7f06e87ff700 1 Processor -- start 2023-10-08T12:46:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.492+0000 7f06e87ff700 1 -- start start 2023-10-08T12:46:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e87ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06e0100740 0x7f06e019ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e87ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06e0101100 0x7f06e019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e87ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e0106750 0x7f06e0198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e87ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01991f0 con 0x7f06e0106750 2023-10-08T12:46:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e87ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e0199360 con 0x7f06e0101100 2023-10-08T12:46:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e87ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e0199520 con 0x7f06e0100740 2023-10-08T12:46:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e659b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06e0100740 0x7f06e019ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e6d9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e0106750 0x7f06e0198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e5d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06e0101100 0x7f06e019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e659b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06e0100740 0x7f06e019ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51644/0 (socket says 172.21.15.59:51644) 2023-10-08T12:46:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e659b700 1 -- 172.21.15.59:0/2890553723 learned_addr learned my addr 172.21.15.59:0/2890553723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e659b700 1 -- 172.21.15.59:0/2890553723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06e0101100 msgr2=0x7f06e019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e659b700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06e0101100 0x7f06e019efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e659b700 1 -- 172.21.15.59:0/2890553723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e0106750 msgr2=0x7f06e0198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e659b700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e0106750 0x7f06e0198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e659b700 1 -- 172.21.15.59:0/2890553723 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0095f0 con 0x7f06e0100740 2023-10-08T12:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.493+0000 7f06e6d9c700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e0106750 0x7f06e0198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.494+0000 7f06e659b700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06e0100740 0x7f06e019ea60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f06dc005740 tx=0x7f06dc005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.494+0000 7f06d77fe700 1 -- 172.21.15.59:0/2890553723 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc01d070 con 0x7f06e0100740 2023-10-08T12:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.494+0000 7f06d77fe700 1 -- 172.21.15.59:0/2890553723 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06dc022470 con 0x7f06e0100740 2023-10-08T12:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.494+0000 7f06e87ff700 1 -- 172.21.15.59:0/2890553723 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e01997a0 con 0x7f06e0100740 2023-10-08T12:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.494+0000 7f06d77fe700 1 -- 172.21.15.59:0/2890553723 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc017650 con 0x7f06e0100740 2023-10-08T12:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.494+0000 7f06e87ff700 1 -- 172.21.15.59:0/2890553723 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e01a5a50 con 0x7f06e0100740 2023-10-08T12:46:46.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.497+0000 7f06d77fe700 1 -- 172.21.15.59:0/2890553723 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f06dc0225e0 con 0x7f06e0100740 2023-10-08T12:46:46.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.498+0000 7f06fc0a8b80 1 Processor -- start 2023-10-08T12:46:46.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.499+0000 7f06fc0a8b80 1 -- start start 2023-10-08T12:46:46.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.499+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4ce80 0x5572f4e4d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.499+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.499+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e5aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.499+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4db6460 con 0x5572f4e58650 2023-10-08T12:46:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.499+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4da7c20 con 0x5572f4e4ce80 2023-10-08T12:46:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.499+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4da5540 con 0x5572f4e4d7a0 2023-10-08T12:46:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.499+0000 7f06d77fe700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06cc0a1670 0x7f06cc0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e659b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e6d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4ce80 0x5572f4e4d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e659b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51658/0 (socket says 172.21.15.59:51658) 2023-10-08T12:46:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e659b700 1 -- 172.21.15.59:0/1736749934 learned_addr learned my addr 172.21.15.59:0/1736749934 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06d77fe700 1 -- 172.21.15.59:0/2890553723 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f06dc0ce340 con 0x7f06e0100740 2023-10-08T12:46:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e5d9a700 1 --2- 172.21.15.59:0/1736749934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e5aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e6d9c700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06cc0a1670 0x7f06cc0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e659b700 1 -- 172.21.15.59:0/1736749934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4ce80 msgr2=0x5572f4e4d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e659b700 1 --2- 172.21.15.59:0/1736749934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4ce80 0x5572f4e4d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e659b700 1 -- 172.21.15.59:0/1736749934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 msgr2=0x5572f4e5aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e659b700 1 --2- 172.21.15.59:0/1736749934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e5aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e659b700 1 -- 172.21.15.59:0/1736749934 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572f4bcbde0 con 0x5572f4e4d7a0 2023-10-08T12:46:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.500+0000 7f06e659b700 1 --2- 172.21.15.59:0/1736749934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f06dc09b0d0 tx=0x7f06dc090b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c381685b3bd21455 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06e6d9c700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06cc0a1670 0x7f06cc0a3b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009fd0 tx=0x7f06d800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06d4ff9700 1 -- 172.21.15.59:0/1736749934 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc09b1a0 con 0x5572f4e4d7a0 2023-10-08T12:46:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06d4ff9700 1 -- 172.21.15.59:0/1736749934 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06dc09af10 con 0x5572f4e4d7a0 2023-10-08T12:46:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06d4ff9700 1 -- 172.21.15.59:0/1736749934 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0a36d0 con 0x5572f4e4d7a0 2023-10-08T12:46:46.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/1736749934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 msgr2=0x5572f4e58110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:46.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/1736749934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f06dc09b0d0 tx=0x7f06dc090b40 comp rx=0 tx=0).stop 2023-10-08T12:46:46.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/1736749934 shutdown_connections 2023-10-08T12:46:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/1736749934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4ce80 0x5572f4e4d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/1736749934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e5aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/1736749934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58110 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/1736749934 >> 172.21.15.59:0/1736749934 conn(0x5572f4dc2260 msgr2=0x5572f4e492d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.501+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/1736749934 shutdown_connections 2023-10-08T12:46:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.502+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/1736749934 wait complete. 2023-10-08T12:46:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.502+0000 7f06fc0a8b80 1 -- start start 2023-10-08T12:46:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.502+0000 7f06fc0a8b80 1 Processor -- start 2023-10-08T12:46:46.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4ce80 0x5572f4e58a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4da0e30 con 0x5572f4e58650 2023-10-08T12:46:46.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4d3d710 con 0x5572f4e4ce80 2023-10-08T12:46:46.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4d3d3b0 con 0x5572f4e4d7a0 2023-10-08T12:46:46.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06fc0a8b80 10 client.0 _ll_register_callbacks cb 0x5572f4b9a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:46.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06e5d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06e5d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51672/0 (socket says 172.21.15.59:51672) 2023-10-08T12:46:46.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06e5d9a700 1 -- 172.21.15.59:0/301966586 learned_addr learned my addr 172.21.15.59:0/301966586 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:46.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06e659b700 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4ce80 0x5572f4e58a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06e6d9c700 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06e5d9a700 1 -- 172.21.15.59:0/301966586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4ce80 msgr2=0x5572f4e58a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:46.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06e5d9a700 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4ce80 0x5572f4e58a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06e5d9a700 1 -- 172.21.15.59:0/301966586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 msgr2=0x5572f4e594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:46.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06e5d9a700 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06e5d9a700 1 -- 172.21.15.59:0/301966586 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e01a5a50 con 0x5572f4e4d7a0 2023-10-08T12:46:46.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.503+0000 7f06e6d9c700 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:46.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.504+0000 7f06e659b700 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4ce80 0x5572f4e58a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:46.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.504+0000 7f06e5d9a700 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f06d00117c0 tx=0x7f06d0011ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db12e175fcd7ff50 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:46.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.504+0000 7f06c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:46:46.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.504+0000 7f06c9ffb700 1 -- 172.21.15.59:0/301966586 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0016070 con 0x5572f4e4d7a0 2023-10-08T12:46:46.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.504+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/301966586 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5572f4d68eb0 con 0x5572f4e4d7a0 2023-10-08T12:46:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.504+0000 7f06c9ffb700 1 -- 172.21.15.59:0/301966586 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f06d000f810 con 0x5572f4e4d7a0 2023-10-08T12:46:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.504+0000 7f06c9ffb700 1 -- 172.21.15.59:0/301966586 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06d000f9d0 con 0x5572f4e4d7a0 2023-10-08T12:46:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.504+0000 7f06fc0a8b80 10 client.26155 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.504+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/301966586 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5572f4bb4c60 con 0x5572f4e4d7a0 2023-10-08T12:46:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.505+0000 7f06c9ffb700 1 -- 172.21.15.59:0/301966586 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06d0028020 con 0x5572f4e4d7a0 2023-10-08T12:46:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.505+0000 7f06c9ffb700 1 -- 172.21.15.59:0/301966586 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f06d001ac10 con 0x5572f4e4d7a0 2023-10-08T12:46:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.505+0000 7f06fc0a8b80 10 client.26155 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.505+0000 7f06fc0a8b80 10 client.26155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.505+0000 7f06fc0a8b80 20 client.26155 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.505+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572f4e67f80 0x5572f4e6a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.505+0000 7f06fc0a8b80 4 client.26155 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.505+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/301966586 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5572f4d99e10 con 0x5572f4e67f80 2023-10-08T12:46:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.505+0000 7f06e659b700 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572f4e67f80 0x5572f4e6a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.506+0000 7f06e659b700 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572f4e67f80 0x5572f4e6a3a0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69a9b625e345cd9d server_cookie=3507b17544092629 in_seq=0 out_seq=0 2023-10-08T12:46:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.506+0000 7f06c9ffb700 10 client.26155 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.507+0000 7f06c9ffb700 1 -- 172.21.15.59:0/301966586 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5572f4d99e10 con 0x5572f4e67f80 2023-10-08T12:46:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.507+0000 7f06c9ffb700 10 client.26155 handle_command_reply: tid=0 2023-10-08T12:46:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.507+0000 7f06fc0a8b80 1 client.26155 shutdown 2023-10-08T12:46:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.507+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/301966586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 msgr2=0x5572f4e58f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.507+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f06d00117c0 tx=0x7f06d0011ad0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.508+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/301966586 shutdown_connections 2023-10-08T12:46:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.508+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572f4e67f80 0x5572f4e6a3a0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.508+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4ce80 0x5572f4e58a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.508+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.508+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/301966586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4d7a0 0x5572f4e58f70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.508+0000 7f06c9ffb700 0 client.26155 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:46.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.508+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/301966586 >> 172.21.15.59:0/301966586 conn(0x5572f4dc2260 msgr2=0x5572f4e48ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:46.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.508+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/301966586 shutdown_connections 2023-10-08T12:46:46.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.508+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/301966586 wait complete. 2023-10-08T12:46:46.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.508+0000 7f06fc0a8b80 20 client.26155 trim_cache size 0 max 16384 2023-10-08T12:46:46.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 668802 13.71 MB/sec execute 137 sec latency 81.643 ms 2023-10-08T12:46:46.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.521+0000 7f06fc0a8b80 1 Processor -- start 2023-10-08T12:46:46.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.521+0000 7f06fc0a8b80 1 -- start start 2023-10-08T12:46:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4ce80 0x5572f4e5da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e52c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4c21920 con 0x5572f4e58650 2023-10-08T12:46:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4e64930 con 0x5572f4e4d7a0 2023-10-08T12:46:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4e435f0 con 0x5572f4e4ce80 2023-10-08T12:46:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06e659b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4ce80 0x5572f4e5da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06e6d9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e52c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06e5d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06e5d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e631d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50476/0 (socket says 172.21.15.59:50476) 2023-10-08T12:46:46.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06e5d9a700 1 -- 172.21.15.59:0/4285203911 learned_addr learned my addr 172.21.15.59:0/4285203911 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:46.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06e659b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4ce80 0x5572f4e5da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51676/0 (socket says 172.21.15.59:51676) 2023-10-08T12:46:46.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06e5d9a700 1 -- 172.21.15.59:0/4285203911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4ce80 msgr2=0x5572f4e5da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:46.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06e5d9a700 1 --2- 172.21.15.59:0/4285203911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4ce80 0x5572f4e5da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06e5d9a700 1 -- 172.21.15.59:0/4285203911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 msgr2=0x5572f4e52c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06e5d9a700 1 --2- 172.21.15.59:0/4285203911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e52c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.522+0000 7f06e5d9a700 1 -- 172.21.15.59:0/4285203911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572f4bf2250 con 0x5572f4e4d7a0 2023-10-08T12:46:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.523+0000 7f06e5d9a700 1 --2- 172.21.15.59:0/4285203911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e631d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009750 tx=0x7f06d0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=279cc2bf2af8b424 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.523+0000 7f06d57fa700 1 -- 172.21.15.59:0/4285203911 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0016040 con 0x5572f4e4d7a0 2023-10-08T12:46:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.523+0000 7f06d57fa700 1 -- 172.21.15.59:0/4285203911 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06d0028030 con 0x5572f4e4d7a0 2023-10-08T12:46:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.523+0000 7f06d57fa700 1 -- 172.21.15.59:0/4285203911 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00038e0 con 0x5572f4e4d7a0 2023-10-08T12:46:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.524+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/4285203911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 msgr2=0x5572f4e631d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.524+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/4285203911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e631d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009750 tx=0x7f06d0009780 comp rx=0 tx=0).stop 2023-10-08T12:46:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.524+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/4285203911 shutdown_connections 2023-10-08T12:46:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.524+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/4285203911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e58650 0x5572f4e52c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.524+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/4285203911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e4ce80 0x5572f4e5da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.524+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/4285203911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e631d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.524+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/4285203911 >> 172.21.15.59:0/4285203911 conn(0x5572f4dc2260 msgr2=0x5572f4e56e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.524+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/4285203911 shutdown_connections 2023-10-08T12:46:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.524+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/4285203911 wait complete. 2023-10-08T12:46:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.524+0000 7f06fc0a8b80 1 -- start start 2023-10-08T12:46:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.524+0000 7f06fc0a8b80 1 Processor -- start 2023-10-08T12:46:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e4ce80 0x5572f4e5d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e5ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06fc0a8b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e58650 0x5572f4e5bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4e5de50 con 0x5572f4e4ce80 2023-10-08T12:46:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4e5c500 con 0x5572f4e4d7a0 2023-10-08T12:46:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06fc0a8b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f4e5c6c0 con 0x5572f4e58650 2023-10-08T12:46:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06fc0a8b80 10 client.0 _ll_register_callbacks cb 0x7f06d0009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06e5d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e5ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06e659b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e4ce80 0x5572f4e5d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06e5d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e5ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50484/0 (socket says 172.21.15.59:50484) 2023-10-08T12:46:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06e5d9a700 1 -- 172.21.15.59:0/3287610527 learned_addr learned my addr 172.21.15.59:0/3287610527 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06e6d9c700 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e58650 0x5572f4e5bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.525+0000 7f06e5d9a700 1 -- 172.21.15.59:0/3287610527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e58650 msgr2=0x5572f4e5bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06e5d9a700 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e58650 0x5572f4e5bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06e5d9a700 1 -- 172.21.15.59:0/3287610527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e4ce80 msgr2=0x5572f4e5d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06e5d9a700 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e4ce80 0x5572f4e5d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06e5d9a700 1 -- 172.21.15.59:0/3287610527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572f4bb4c60 con 0x5572f4e4d7a0 2023-10-08T12:46:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06e5d9a700 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e5ba50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f06d00053f0 tx=0x7f06d0005420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97c0fa7b9df884c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06c9ffb700 1 -- 172.21.15.59:0/3287610527 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0016070 con 0x5572f4e4d7a0 2023-10-08T12:46:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/3287610527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06dc09af10 con 0x5572f4e4d7a0 2023-10-08T12:46:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06c9ffb700 1 -- 172.21.15.59:0/3287610527 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f06d0000e40 con 0x5572f4e4d7a0 2023-10-08T12:46:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06c9ffb700 1 -- 172.21.15.59:0/3287610527 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06d000fa20 con 0x5572f4e4d7a0 2023-10-08T12:46:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06fc0a8b80 10 client.26165 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.526+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/3287610527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5572f4bca2b0 con 0x5572f4e4d7a0 2023-10-08T12:46:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.527+0000 7f06c9ffb700 1 -- 172.21.15.59:0/3287610527 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06dc09af10 con 0x5572f4e4d7a0 2023-10-08T12:46:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.527+0000 7f06c9ffb700 1 -- 172.21.15.59:0/3287610527 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f06d00235c0 con 0x5572f4e4d7a0 2023-10-08T12:46:46.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.527+0000 7f06fc0a8b80 10 client.26165 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:46.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.527+0000 7f06fc0a8b80 10 client.26165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:46.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.527+0000 7f06fc0a8b80 20 client.26165 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:46.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.527+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572f4ebcf70 0x5572f4ebf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:46.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.527+0000 7f06fc0a8b80 4 client.26165 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:46:46.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.527+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/3287610527 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5572f4d99b30 con 0x5572f4ebcf70 2023-10-08T12:46:46.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.527+0000 7f06e659b700 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572f4ebcf70 0x5572f4ebf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:46.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.527+0000 7f06c9ffb700 10 client.26165 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:46.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.527+0000 7f06e659b700 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572f4ebcf70 0x5572f4ebf360 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b1461abc1e1aa56 server_cookie=d2886921293daefb in_seq=0 out_seq=0 2023-10-08T12:46:46.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06c9ffb700 1 -- 172.21.15.59:0/3287610527 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5572f4d99b30 con 0x5572f4ebcf70 2023-10-08T12:46:46.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06c9ffb700 10 client.26165 handle_command_reply: tid=0 2023-10-08T12:46:46.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 1 client.26165 shutdown 2023-10-08T12:46:46.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/3287610527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 msgr2=0x5572f4e5ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:46.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e5ba50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f06d00053f0 tx=0x7f06d0005420 comp rx=0 tx=0).stop 2023-10-08T12:46:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/3287610527 shutdown_connections 2023-10-08T12:46:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5572f4ebcf70 0x5572f4ebf360 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572f4e58650 0x5572f4e5bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f4e4ce80 0x5572f4e5d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 1 --2- 172.21.15.59:0/3287610527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f4e4d7a0 0x5572f4e5ba50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06c9ffb700 0 client.26165 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/3287610527 >> 172.21.15.59:0/3287610527 conn(0x5572f4dc2260 msgr2=0x5572f4e56e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/3287610527 shutdown_connections 2023-10-08T12:46:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 1 -- 172.21.15.59:0/3287610527 wait complete. 2023-10-08T12:46:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.528+0000 7f06fc0a8b80 20 client.26165 trim_cache size 0 max 16384 2023-10-08T12:46:46.538 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:46:46.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 -- 172.21.15.59:0/2890553723 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06cc0a1670 msgr2=0x7f06cc0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06cc0a1670 0x7f06cc0a3b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009fd0 tx=0x7f06d800b040 comp rx=0 tx=0).stop 2023-10-08T12:46:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 -- 172.21.15.59:0/2890553723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06e0100740 msgr2=0x7f06e019ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06e0100740 0x7f06e019ea60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f06dc005740 tx=0x7f06dc005770 comp rx=0 tx=0).stop 2023-10-08T12:46:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 -- 172.21.15.59:0/2890553723 shutdown_connections 2023-10-08T12:46:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06cc0a1670 0x7f06cc0a3b30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e0106750 0x7f06e0198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06e0100740 0x7f06e019ea60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 --2- 172.21.15.59:0/2890553723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06e0101100 0x7f06e019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 -- 172.21.15.59:0/2890553723 >> 172.21.15.59:0/2890553723 conn(0x7f06e00fc230 msgr2=0x7f06e00fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 -- 172.21.15.59:0/2890553723 shutdown_connections 2023-10-08T12:46:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:46.529+0000 7f06e87ff700 1 -- 172.21.15.59:0/2890553723 wait complete. 2023-10-08T12:46:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:46 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1674591121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:46:47.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:46 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1674591121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:46:47.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:46 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1674591121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:46:47.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 671606 13.73 MB/sec execute 138 sec latency 25.899 ms 2023-10-08T12:46:47.550 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:46:47.551 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:46:47.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.767+0000 7f2f7759e700 1 -- 172.21.15.59:0/3047221942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f78100f50 msgr2=0x7f2f7810d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:47.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.767+0000 7f2f7759e700 1 --2- 172.21.15.59:0/3047221942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f78100f50 0x7f2f7810d410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000b0a0 tx=0x7f2f7000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.767+0000 7f2f7759e700 1 -- 172.21.15.59:0/3047221942 shutdown_connections 2023-10-08T12:46:47.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.768+0000 7f2f7759e700 1 --2- 172.21.15.59:0/3047221942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f78106650 0x7f2f78106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.768+0000 7f2f7759e700 1 --2- 172.21.15.59:0/3047221942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f78100f50 0x7f2f7810d410 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.768+0000 7f2f7759e700 1 --2- 172.21.15.59:0/3047221942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f78100590 0x7f2f78100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.768+0000 7f2f7759e700 1 -- 172.21.15.59:0/3047221942 >> 172.21.15.59:0/3047221942 conn(0x7f2f780fc060 msgr2=0x7f2f780fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:47.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.768+0000 7f2f7759e700 1 -- 172.21.15.59:0/3047221942 shutdown_connections 2023-10-08T12:46:47.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.768+0000 7f2f7759e700 1 -- 172.21.15.59:0/3047221942 wait complete. 2023-10-08T12:46:47.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f7759e700 1 Processor -- start 2023-10-08T12:46:47.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f7759e700 1 -- start start 2023-10-08T12:46:47.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f7759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f78100590 0x7f2f7819ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f7759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f78100f50 0x7f2f7819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f7759e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f78106650 0x7f2f78198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f7759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f78199340 con 0x7f2f78100590 2023-10-08T12:46:47.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f7759e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f781994b0 con 0x7f2f78106650 2023-10-08T12:46:47.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f7759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f78199670 con 0x7f2f78100f50 2023-10-08T12:46:47.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f7659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f78100590 0x7f2f7819ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f76d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f78106650 0x7f2f78198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f76d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f78106650 0x7f2f78198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50502/0 (socket says 172.21.15.59:50502) 2023-10-08T12:46:47.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f76d9d700 1 -- 172.21.15.59:0/2566242312 learned_addr learned my addr 172.21.15.59:0/2566242312 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:47.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.769+0000 7f2f6ffff700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f78100f50 0x7f2f7819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.770+0000 7f2f76d9d700 1 -- 172.21.15.59:0/2566242312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f78100f50 msgr2=0x7f2f7819f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:47.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.770+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f78100f50 0x7f2f7819f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.770+0000 7f2f76d9d700 1 -- 172.21.15.59:0/2566242312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f78100590 msgr2=0x7f2f7819ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:47.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.770+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f78100590 0x7f2f7819ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.770+0000 7f2f76d9d700 1 -- 172.21.15.59:0/2566242312 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70009d00 con 0x7f2f78106650 2023-10-08T12:46:47.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.770+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f78106650 0x7f2f78198b70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000b070 tx=0x7f2f7000bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:47.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.770+0000 7f2f6f7fe700 1 -- 172.21.15.59:0/2566242312 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000e040 con 0x7f2f78106650 2023-10-08T12:46:47.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.770+0000 7f2f7759e700 1 -- 172.21.15.59:0/2566242312 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f781998f0 con 0x7f2f78106650 2023-10-08T12:46:47.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.770+0000 7f2f6f7fe700 1 -- 172.21.15.59:0/2566242312 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f7001d470 con 0x7f2f78106650 2023-10-08T12:46:47.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.770+0000 7f2f6f7fe700 1 -- 172.21.15.59:0/2566242312 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700052a0 con 0x7f2f78106650 2023-10-08T12:46:47.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.770+0000 7f2f7759e700 1 -- 172.21.15.59:0/2566242312 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f781a5a50 con 0x7f2f78106650 2023-10-08T12:46:47.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.774+0000 7f2f6f7fe700 1 -- 172.21.15.59:0/2566242312 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2f7001d850 con 0x7f2f78106650 2023-10-08T12:46:47.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.775+0000 7f2f904d9b80 1 Processor -- start 2023-10-08T12:46:47.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.775+0000 7f2f904d9b80 1 -- start start 2023-10-08T12:46:47.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.775+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c324b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.775+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c329f0 0x55e759c3d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.775+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759c3fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.775+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759b9b4e0 con 0x55e759c329f0 2023-10-08T12:46:47.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.775+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759b8cca0 con 0x55e759c3d880 2023-10-08T12:46:47.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.775+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759b8a5c0 con 0x55e759c320d0 2023-10-08T12:46:47.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c324b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51708/0 (socket says 172.21.15.59:51708) 2023-10-08T12:46:47.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6ffff700 1 -- 172.21.15.59:0/3065088717 learned_addr learned my addr 172.21.15.59:0/3065088717 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:47.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6ffff700 1 --2- 172.21.15.59:0/3065088717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759c3fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f7659c700 1 --2- 172.21.15.59:0/3065088717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c329f0 0x55e759c3d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6ffff700 1 -- 172.21.15.59:0/3065088717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 msgr2=0x55e759c3fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:47.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6ffff700 1 --2- 172.21.15.59:0/3065088717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759c3fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6ffff700 1 -- 172.21.15.59:0/3065088717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c329f0 msgr2=0x55e759c3d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:47.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6ffff700 1 --2- 172.21.15.59:0/3065088717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c329f0 0x55e759c3d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6ffff700 1 -- 172.21.15.59:0/3065088717 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7599b0e60 con 0x55e759c320d0 2023-10-08T12:46:47.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f7659c700 1 --2- 172.21.15.59:0/3065088717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c329f0 0x55e759c3d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:47.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6f7fe700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2f640a15f0 0x7f2f640a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6ffff700 1 --2- 172.21.15.59:0/3065088717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c324b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f600095f0 tx=0x7f2f600058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=578416a8e3c86838 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:47.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f6f7fe700 1 -- 172.21.15.59:0/2566242312 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2f700ce0e0 con 0x7f2f78106650 2023-10-08T12:46:47.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.776+0000 7f2f7659c700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2f640a15f0 0x7f2f640a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f6cff9700 1 -- 172.21.15.59:0/3065088717 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60004030 con 0x55e759c320d0 2023-10-08T12:46:47.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f6cff9700 1 -- 172.21.15.59:0/3065088717 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f60004830 con 0x55e759c320d0 2023-10-08T12:46:47.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f6cff9700 1 -- 172.21.15.59:0/3065088717 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60005380 con 0x55e759c320d0 2023-10-08T12:46:47.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3065088717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 msgr2=0x55e759c324b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:47.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f7659c700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2f640a15f0 0x7f2f640a3ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55e759c351a0 tx=0x7f2f68009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:47.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/3065088717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c324b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f600095f0 tx=0x7f2f600058e0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3065088717 shutdown_connections 2023-10-08T12:46:47.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/3065088717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759c3fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/3065088717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c324b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/3065088717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c329f0 0x55e759c3d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3065088717 >> 172.21.15.59:0/3065088717 conn(0x55e759ba72e0 msgr2=0x55e759c2e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3065088717 shutdown_connections 2023-10-08T12:46:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.777+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3065088717 wait complete. 2023-10-08T12:46:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.778+0000 7f2f904d9b80 1 -- start start 2023-10-08T12:46:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.778+0000 7f2f904d9b80 1 Processor -- start 2023-10-08T12:46:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.779+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c3a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.779+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c329f0 0x55e759c3abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.779+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c3d880 0x55e759c3b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.779+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759b85eb0 con 0x55e759c3d880 2023-10-08T12:46:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.779+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759b22790 con 0x55e759c329f0 2023-10-08T12:46:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.779+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759b22430 con 0x55e759c320d0 2023-10-08T12:46:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.779+0000 7f2f904d9b80 10 client.0 _ll_register_callbacks cb 0x55e75997f880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.779+0000 7f2f6ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c329f0 0x55e759c3abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f7659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c3a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f76d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c3d880 0x55e759c3b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f6ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c329f0 0x55e759c3abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50524/0 (socket says 172.21.15.59:50524) 2023-10-08T12:46:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f6ffff700 1 -- 172.21.15.59:0/2263308991 learned_addr learned my addr 172.21.15.59:0/2263308991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f7659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c3a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51718/0 (socket says 172.21.15.59:51718) 2023-10-08T12:46:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f76d9d700 1 -- 172.21.15.59:0/2263308991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 msgr2=0x55e759c3a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:47.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c3a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f76d9d700 1 -- 172.21.15.59:0/2263308991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c329f0 msgr2=0x55e759c3abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:47.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c329f0 0x55e759c3abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f76d9d700 1 -- 172.21.15.59:0/2263308991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f60019040 con 0x55e759c3d880 2023-10-08T12:46:47.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f7659c700 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c3a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:47.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c3d880 0x55e759c3b110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2f700cb850 tx=0x7f2f7009ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1450cfa4b99dcb30 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:47.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:46:47.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f5dffb700 1 -- 172.21.15.59:0/2263308991 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7009b5d0 con 0x55e759c3d880 2023-10-08T12:46:47.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f5dffb700 1 -- 172.21.15.59:0/2263308991 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2f7009b170 con 0x55e759c3d880 2023-10-08T12:46:47.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.780+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2263308991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e759b4df30 con 0x55e759c3d880 2023-10-08T12:46:47.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.781+0000 7f2f5dffb700 1 -- 172.21.15.59:0/2263308991 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f7009f2c0 con 0x55e759c3d880 2023-10-08T12:46:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.781+0000 7f2f904d9b80 10 client.16176 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.781+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2263308991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e759999ce0 con 0x55e759c3d880 2023-10-08T12:46:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.781+0000 7f2f5dffb700 1 -- 172.21.15.59:0/2263308991 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e759b4df30 con 0x55e759c3d880 2023-10-08T12:46:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.781+0000 7f2f5dffb700 1 -- 172.21.15.59:0/2263308991 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2f700a2fe0 con 0x55e759c3d880 2023-10-08T12:46:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.781+0000 7f2f904d9b80 10 client.16176 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.781+0000 7f2f904d9b80 10 client.16176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.781+0000 7f2f904d9b80 20 client.16176 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.781+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e759c4cff0 0x55e759c4f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.781+0000 7f2f904d9b80 4 client.16176 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.781+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2263308991 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e759b7ee90 con 0x55e759c4cff0 2023-10-08T12:46:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.782+0000 7f2f7659c700 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e759c4cff0 0x55e759c4f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.782+0000 7f2f7659c700 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e759c4cff0 0x55e759c4f3e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43ba6acaf88a0bc0 server_cookie=14dfcd358eb40907 in_seq=0 out_seq=0 2023-10-08T12:46:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.782+0000 7f2f5dffb700 10 client.16176 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f5dffb700 1 -- 172.21.15.59:0/2263308991 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e759b7ee90 con 0x55e759c4cff0 2023-10-08T12:46:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f5dffb700 10 client.16176 handle_command_reply: tid=0 2023-10-08T12:46:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 1 client.16176 shutdown 2023-10-08T12:46:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2263308991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c3d880 msgr2=0x55e759c3b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c3d880 0x55e759c3b110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2f700cb850 tx=0x7f2f7009ada0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2263308991 shutdown_connections 2023-10-08T12:46:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e759c4cff0 0x55e759c4f3e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c3d880 0x55e759c3b110 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c3a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/2263308991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c329f0 0x55e759c3abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f5dffb700 0 client.16176 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:47.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2263308991 >> 172.21.15.59:0/2263308991 conn(0x55e759ba72e0 msgr2=0x55e759c34170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:47.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2263308991 shutdown_connections 2023-10-08T12:46:47.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2263308991 wait complete. 2023-10-08T12:46:47.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.783+0000 7f2f904d9b80 20 client.16176 trim_cache size 0 max 16384 2023-10-08T12:46:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.801+0000 7f2f904d9b80 1 Processor -- start 2023-10-08T12:46:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.801+0000 7f2f904d9b80 1 -- start start 2023-10-08T12:46:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.802+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c443d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.802+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c329f0 0x55e759c27420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.802+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759c27960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.802+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759a069a0 con 0x55e759c329f0 2023-10-08T12:46:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.802+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759c49fd0 con 0x55e759c3d880 2023-10-08T12:46:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.802+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759c33bb0 con 0x55e759c320d0 2023-10-08T12:46:47.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.802+0000 7f2f7659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.802+0000 7f2f6ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c329f0 0x55e759c27420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.802+0000 7f2f76d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759c27960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.802+0000 7f2f7659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51730/0 (socket says 172.21.15.59:51730) 2023-10-08T12:46:47.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.802+0000 7f2f7659c700 1 -- 172.21.15.59:0/2275928980 learned_addr learned my addr 172.21.15.59:0/2275928980 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:47.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.803+0000 7f2f76d9d700 1 -- 172.21.15.59:0/2275928980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 msgr2=0x55e759c443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:47.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.803+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/2275928980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.803+0000 7f2f76d9d700 1 -- 172.21.15.59:0/2275928980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c329f0 msgr2=0x55e759c27420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:47.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.803+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/2275928980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c329f0 0x55e759c27420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.803+0000 7f2f76d9d700 1 -- 172.21.15.59:0/2275928980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7599d72d0 con 0x55e759c3d880 2023-10-08T12:46:47.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.803+0000 7f2f7659c700 1 --2- 172.21.15.59:0/2275928980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:47.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.803+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/2275928980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759c27960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009850 tx=0x7f2f7000bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c48ec381df6a781 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:47.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.803+0000 7f2f6d7fa700 1 -- 172.21.15.59:0/2275928980 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70009b80 con 0x55e759c3d880 2023-10-08T12:46:47.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.803+0000 7f2f6d7fa700 1 -- 172.21.15.59:0/2275928980 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f700b2070 con 0x55e759c3d880 2023-10-08T12:46:47.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.803+0000 7f2f6d7fa700 1 -- 172.21.15.59:0/2275928980 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7009f2c0 con 0x55e759c3d880 2023-10-08T12:46:47.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.804+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2275928980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 msgr2=0x55e759c27960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.804+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/2275928980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759c27960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009850 tx=0x7f2f7000bf90 comp rx=0 tx=0).stop 2023-10-08T12:46:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.804+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2275928980 shutdown_connections 2023-10-08T12:46:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.804+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/2275928980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759c27960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.804+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/2275928980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c320d0 0x55e759c443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.804+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/2275928980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c329f0 0x55e759c27420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.804+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2275928980 >> 172.21.15.59:0/2275928980 conn(0x55e759ba72e0 msgr2=0x55e759c38fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.804+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2275928980 shutdown_connections 2023-10-08T12:46:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.804+0000 7f2f904d9b80 1 -- 172.21.15.59:0/2275928980 wait complete. 2023-10-08T12:46:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.804+0000 7f2f904d9b80 1 -- start start 2023-10-08T12:46:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f904d9b80 1 Processor -- start 2023-10-08T12:46:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c320d0 0x55e759c42fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c329f0 0x55e759c434e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f904d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759ca0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759c43df0 con 0x55e759c320d0 2023-10-08T12:46:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759ca1300 con 0x55e759c3d880 2023-10-08T12:46:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f904d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e759ca1440 con 0x55e759c329f0 2023-10-08T12:46:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f904d9b80 10 client.0 _ll_register_callbacks cb 0x7f2f7009afb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f76d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759ca0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f7659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c320d0 0x55e759c42fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f76d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759ca0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50548/0 (socket says 172.21.15.59:50548) 2023-10-08T12:46:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.805+0000 7f2f76d9d700 1 -- 172.21.15.59:0/3585997294 learned_addr learned my addr 172.21.15.59:0/3585997294 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f6ffff700 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c329f0 0x55e759c434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f76d9d700 1 -- 172.21.15.59:0/3585997294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c329f0 msgr2=0x55e759c434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c329f0 0x55e759c434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f76d9d700 1 -- 172.21.15.59:0/3585997294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c320d0 msgr2=0x55e759c42fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c320d0 0x55e759c42fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f76d9d700 1 -- 172.21.15.59:0/3585997294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6802a980 con 0x55e759c3d880 2023-10-08T12:46:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f7659c700 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c320d0 0x55e759c42fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f76d9d700 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759ca0dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f700a3330 tx=0x7f2f7001dbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79371eddbebc4ac1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f5dffb700 1 -- 172.21.15.59:0/3585997294 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70009b80 con 0x55e759c3d880 2023-10-08T12:46:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f5dffb700 1 -- 172.21.15.59:0/3585997294 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2f700a3470 con 0x55e759c3d880 2023-10-08T12:46:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3585997294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f60004830 con 0x55e759c3d880 2023-10-08T12:46:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f5dffb700 1 -- 172.21.15.59:0/3585997294 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f7009aad0 con 0x55e759c3d880 2023-10-08T12:46:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f904d9b80 10 client.26183 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.806+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3585997294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f2f60019040 con 0x55e759c3d880 2023-10-08T12:46:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.807+0000 7f2f5dffb700 1 -- 172.21.15.59:0/3585997294 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f60004830 con 0x55e759c3d880 2023-10-08T12:46:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.807+0000 7f2f5dffb700 1 -- 172.21.15.59:0/3585997294 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2f70096f60 con 0x55e759c3d880 2023-10-08T12:46:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.807+0000 7f2f904d9b80 10 client.26183 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.807+0000 7f2f904d9b80 10 client.26183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.807+0000 7f2f904d9b80 20 client.26183 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.807+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e759ca26d0 0x55e759ca4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.807+0000 7f2f904d9b80 4 client.26183 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:46:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.807+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3585997294 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e759b7ebb0 con 0x55e759ca26d0 2023-10-08T12:46:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.807+0000 7f2f7659c700 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e759ca26d0 0x55e759ca4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.808+0000 7f2f7659c700 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e759ca26d0 0x55e759ca4ac0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ffe834efcc4cae6 server_cookie=10f508d54a5a2143 in_seq=0 out_seq=0 2023-10-08T12:46:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.808+0000 7f2f5dffb700 10 client.26183 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f5dffb700 1 -- 172.21.15.59:0/3585997294 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e759b7ebb0 con 0x55e759ca26d0 2023-10-08T12:46:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f5dffb700 10 client.26183 handle_command_reply: tid=0 2023-10-08T12:46:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 1 client.26183 shutdown 2023-10-08T12:46:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3585997294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 msgr2=0x55e759ca0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759ca0dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f700a3330 tx=0x7f2f7001dbf0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3585997294 shutdown_connections 2023-10-08T12:46:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e759ca26d0 0x55e759ca4ac0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e759c3d880 0x55e759ca0dc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e759c320d0 0x55e759c42fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 1 --2- 172.21.15.59:0/3585997294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e759c329f0 0x55e759c434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f5dffb700 0 client.26183 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3585997294 >> 172.21.15.59:0/3585997294 conn(0x55e759ba72e0 msgr2=0x55e759c27420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3585997294 shutdown_connections 2023-10-08T12:46:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 1 -- 172.21.15.59:0/3585997294 wait complete. 2023-10-08T12:46:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.809+0000 7f2f904d9b80 20 client.26183 trim_cache size 0 max 16384 2023-10-08T12:46:47.815 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:46:47.815 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:46:47.816 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "d49dfcd6-f8ab-4a8a-8d77-054fc22131a7", 2023-10-08T12:46:47.816 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:46:47.816 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:46:47.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 -- 172.21.15.59:0/2566242312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2f640a15f0 msgr2=0x7f2f640a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2f640a15f0 0x7f2f640a3ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55e759c351a0 tx=0x7f2f68009260 comp rx=0 tx=0).stop 2023-10-08T12:46:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 -- 172.21.15.59:0/2566242312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f78106650 msgr2=0x7f2f78198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f78106650 0x7f2f78198b70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000b070 tx=0x7f2f7000bdb0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 -- 172.21.15.59:0/2566242312 shutdown_connections 2023-10-08T12:46:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2f640a15f0 0x7f2f640a3ab0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f78106650 0x7f2f78198b70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f78100590 0x7f2f7819ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 --2- 172.21.15.59:0/2566242312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f78100f50 0x7f2f7819f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 -- 172.21.15.59:0/2566242312 >> 172.21.15.59:0/2566242312 conn(0x7f2f780fc060 msgr2=0x7f2f780fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 -- 172.21.15.59:0/2566242312 shutdown_connections 2023-10-08T12:46:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:47.810+0000 7f2f7759e700 1 -- 172.21.15.59:0/2566242312 wait complete. 2023-10-08T12:46:47.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:46:48.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.040+0000 7f2d049ff700 1 -- 172.21.15.59:0/2908310172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d00102940 msgr2=0x7f2d00102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.040+0000 7f2d049ff700 1 --2- 172.21.15.59:0/2908310172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d00102940 0x7f2d00102dc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009990 tx=0x7f2cf4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.040+0000 7f2d049ff700 1 -- 172.21.15.59:0/2908310172 shutdown_connections 2023-10-08T12:46:48.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.040+0000 7f2d049ff700 1 --2- 172.21.15.59:0/2908310172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d00103300 0x7f2d0010f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.040+0000 7f2d049ff700 1 --2- 172.21.15.59:0/2908310172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00108950 0x7f2d00108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.040+0000 7f2d049ff700 1 --2- 172.21.15.59:0/2908310172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d00102940 0x7f2d00102dc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.040+0000 7f2d049ff700 1 -- 172.21.15.59:0/2908310172 >> 172.21.15.59:0/2908310172 conn(0x7f2d000fe3d0 msgr2=0x7f2d001007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.040+0000 7f2d049ff700 1 -- 172.21.15.59:0/2908310172 shutdown_connections 2023-10-08T12:46:48.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.040+0000 7f2d049ff700 1 -- 172.21.15.59:0/2908310172 wait complete. 2023-10-08T12:46:48.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.041+0000 7f2d049ff700 1 Processor -- start 2023-10-08T12:46:48.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.041+0000 7f2d049ff700 1 -- start start 2023-10-08T12:46:48.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.041+0000 7f2d049ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d00102940 0x7f2d00198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.041+0000 7f2d049ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00103300 0x7f2d00199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.041+0000 7f2d049ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d00108950 0x7f2d0019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.041+0000 7f2d049ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0019dd50 con 0x7f2d00103300 2023-10-08T12:46:48.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.041+0000 7f2d049ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0019dec0 con 0x7f2d00108950 2023-10-08T12:46:48.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.041+0000 7f2d049ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0019e080 con 0x7f2d00102940 2023-10-08T12:46:48.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.042+0000 7f2cfe59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d00102940 0x7f2d00198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.042+0000 7f2cfe59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d00102940 0x7f2d00198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51758/0 (socket says 172.21.15.59:51758) 2023-10-08T12:46:48.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.042+0000 7f2cfdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00103300 0x7f2d00199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.042+0000 7f2cfe59c700 1 -- 172.21.15.59:0/2101694990 learned_addr learned my addr 172.21.15.59:0/2101694990 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:48.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.042+0000 7f2cfed9d700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d00108950 0x7f2d0019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.042+0000 7f2cfe59c700 1 -- 172.21.15.59:0/2101694990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d00108950 msgr2=0x7f2d0019d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.042+0000 7f2cfe59c700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d00108950 0x7f2d0019d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.042+0000 7f2cfe59c700 1 -- 172.21.15.59:0/2101694990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00103300 msgr2=0x7f2d00199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.042+0000 7f2cfe59c700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00103300 0x7f2d00199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.042+0000 7f2cfe59c700 1 -- 172.21.15.59:0/2101694990 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf40095f0 con 0x7f2d00102940 2023-10-08T12:46:48.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.042+0000 7f2cfe59c700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d00102940 0x7f2d00198e30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000e9a0 tx=0x7f2cf000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.043+0000 7f2cef7fe700 1 -- 172.21.15.59:0/2101694990 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0009790 con 0x7f2d00102940 2023-10-08T12:46:48.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.043+0000 7f2d049ff700 1 -- 172.21.15.59:0/2101694990 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0019e360 con 0x7f2d00102940 2023-10-08T12:46:48.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.043+0000 7f2cef7fe700 1 -- 172.21.15.59:0/2101694990 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf0010430 con 0x7f2d00102940 2023-10-08T12:46:48.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.043+0000 7f2cef7fe700 1 -- 172.21.15.59:0/2101694990 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0018680 con 0x7f2d00102940 2023-10-08T12:46:48.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.043+0000 7f2d049ff700 1 -- 172.21.15.59:0/2101694990 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d001a5ba0 con 0x7f2d00102940 2023-10-08T12:46:48.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.047+0000 7f2cef7fe700 1 -- 172.21.15.59:0/2101694990 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2cf00105a0 con 0x7f2d00102940 2023-10-08T12:46:48.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.048+0000 7f2d18362b80 1 Processor -- start 2023-10-08T12:46:48.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2d18362b80 1 -- start start 2023-10-08T12:46:48.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2cef7fe700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ce80a15f0 0x7f2ce80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99284e80 0x55cc99285260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc992857a0 0x55cc99290110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc99292a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2d18362b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc991ee460 con 0x55cc99284e80 2023-10-08T12:46:48.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2d18362b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc991dfc20 con 0x55cc99290650 2023-10-08T12:46:48.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2d18362b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc991dd540 con 0x55cc992857a0 2023-10-08T12:46:48.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2cef7fe700 1 -- 172.21.15.59:0/2101694990 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2cf0014070 con 0x7f2d00102940 2023-10-08T12:46:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2cfdd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc992857a0 0x55cc99290110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2cfdd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc992857a0 0x55cc99290110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51768/0 (socket says 172.21.15.59:51768) 2023-10-08T12:46:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2cfe59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99284e80 0x55cc99285260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.049+0000 7f2cfdd9b700 1 -- 172.21.15.59:0/2085553551 learned_addr learned my addr 172.21.15.59:0/2085553551 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.050+0000 7f2cfed9d700 1 --2- 172.21.15.59:0/2085553551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc99292a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.050+0000 7f2cfed9d700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ce80a15f0 0x7f2ce80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.050+0000 7f2cfdd9b700 1 -- 172.21.15.59:0/2085553551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 msgr2=0x55cc99292a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.050+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/2085553551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc99292a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.050+0000 7f2cfdd9b700 1 -- 172.21.15.59:0/2085553551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99284e80 msgr2=0x55cc99285260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.050+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/2085553551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99284e80 0x55cc99285260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.050+0000 7f2cfdd9b700 1 -- 172.21.15.59:0/2085553551 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc99003de0 con 0x55cc992857a0 2023-10-08T12:46:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.050+0000 7f2cfe59c700 1 --2- 172.21.15.59:0/2085553551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99284e80 0x55cc99285260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.050+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/2085553551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc992857a0 0x55cc99290110 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4005ec0 tx=0x7f2cf4005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea33f652ca152db7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.050+0000 7f2cecff9700 1 -- 172.21.15.59:0/2085553551 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf401d070 con 0x55cc992857a0 2023-10-08T12:46:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.050+0000 7f2cfed9d700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ce80a15f0 0x7f2ce80a3ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009ec0 tx=0x7f2cf800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.051+0000 7f2cecff9700 1 -- 172.21.15.59:0/2085553551 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf401e040 con 0x55cc992857a0 2023-10-08T12:46:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.051+0000 7f2cecff9700 1 -- 172.21.15.59:0/2085553551 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4004880 con 0x55cc992857a0 2023-10-08T12:46:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.051+0000 7f2d18362b80 1 -- 172.21.15.59:0/2085553551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc992857a0 msgr2=0x55cc99290110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.051+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2085553551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc992857a0 0x55cc99290110 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4005ec0 tx=0x7f2cf4005ef0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.051+0000 7f2d18362b80 1 -- 172.21.15.59:0/2085553551 shutdown_connections 2023-10-08T12:46:48.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.051+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2085553551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc99292a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.051+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2085553551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99284e80 0x55cc99285260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.051+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2085553551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc992857a0 0x55cc99290110 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.051+0000 7f2d18362b80 1 -- 172.21.15.59:0/2085553551 >> 172.21.15.59:0/2085553551 conn(0x55cc991fa260 msgr2=0x55cc992812d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.051+0000 7f2d18362b80 1 -- 172.21.15.59:0/2085553551 shutdown_connections 2023-10-08T12:46:48.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.052+0000 7f2d18362b80 1 -- 172.21.15.59:0/2085553551 wait complete. 2023-10-08T12:46:48.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.052+0000 7f2d18362b80 1 -- start start 2023-10-08T12:46:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.052+0000 7f2d18362b80 1 Processor -- start 2023-10-08T12:46:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc992900a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc9928d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc9928db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2d18362b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc991d8e30 con 0x55cc992857a0 2023-10-08T12:46:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2d18362b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc99175710 con 0x55cc99290650 2023-10-08T12:46:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2d18362b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc991753b0 con 0x55cc99284e80 2023-10-08T12:46:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2d18362b80 10 client.0 _ll_register_callbacks cb 0x55cc98fd2800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2cfe59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc992900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2cfe59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc992900a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51776/0 (socket says 172.21.15.59:51776) 2023-10-08T12:46:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2cfe59c700 1 -- 172.21.15.59:0/2796662469 learned_addr learned my addr 172.21.15.59:0/2796662469 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2cfed9d700 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc9928db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc9928d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2cfe59c700 1 -- 172.21.15.59:0/2796662469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 msgr2=0x55cc9928db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2cfe59c700 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc9928db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2cfe59c700 1 -- 172.21.15.59:0/2796662469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 msgr2=0x55cc9928d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2cfe59c700 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc9928d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.053+0000 7f2cfe59c700 1 -- 172.21.15.59:0/2796662469 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d001a5ba0 con 0x55cc99284e80 2023-10-08T12:46:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.054+0000 7f2cfe59c700 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc992900a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00caa10 tx=0x7f2cf009a240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f4a5a0af793001c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.054+0000 7f2ce5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:46:48.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.054+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/2796662469 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00a25d0 con 0x55cc99284e80 2023-10-08T12:46:48.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.054+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/2796662469 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2cf0057d50 con 0x55cc99284e80 2023-10-08T12:46:48.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.054+0000 7f2d18362b80 1 -- 172.21.15.59:0/2796662469 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc991a0eb0 con 0x55cc99284e80 2023-10-08T12:46:48.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.054+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/2796662469 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cf0057f10 con 0x55cc99284e80 2023-10-08T12:46:48.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.054+0000 7f2d18362b80 10 client.26191 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:48.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.054+0000 7f2d18362b80 1 -- 172.21.15.59:0/2796662469 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f2d00110110 con 0x55cc99284e80 2023-10-08T12:46:48.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.054+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/2796662469 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf00b6020 con 0x55cc99284e80 2023-10-08T12:46:48.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.054+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/2796662469 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2cf00a2140 con 0x55cc99284e80 2023-10-08T12:46:48.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.055+0000 7f2d18362b80 10 client.26191 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.055+0000 7f2d18362b80 10 client.26191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.055+0000 7f2d18362b80 20 client.26191 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.055+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cc992a0110 0x55cc992a2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.055+0000 7f2d18362b80 4 client.26191 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.055+0000 7f2d18362b80 1 -- 172.21.15.59:0/2796662469 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc991d1e10 con 0x55cc992a0110 2023-10-08T12:46:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.055+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cc992a0110 0x55cc992a2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.055+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cc992a0110 0x55cc992a2500 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51b74d5eeb9554e1 server_cookie=17be3979b4666546 in_seq=0 out_seq=0 2023-10-08T12:46:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.055+0000 7f2ce5ffb700 10 client.26191 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/2796662469 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cc991d1e10 con 0x55cc992a0110 2023-10-08T12:46:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2ce5ffb700 10 client.26191 handle_command_reply: tid=0 2023-10-08T12:46:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2d18362b80 1 client.26191 shutdown 2023-10-08T12:46:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2d18362b80 1 -- 172.21.15.59:0/2796662469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 msgr2=0x55cc992900a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc992900a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00caa10 tx=0x7f2cf009a240 comp rx=0 tx=0).stop 2023-10-08T12:46:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2d18362b80 1 -- 172.21.15.59:0/2796662469 shutdown_connections 2023-10-08T12:46:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cc992a0110 0x55cc992a2500 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc9928db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc992900a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2796662469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc9928d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2d18362b80 1 -- 172.21.15.59:0/2796662469 >> 172.21.15.59:0/2796662469 conn(0x55cc991fa260 msgr2=0x55cc99280ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2ce5ffb700 0 client.26191 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.056+0000 7f2d18362b80 1 -- 172.21.15.59:0/2796662469 shutdown_connections 2023-10-08T12:46:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.057+0000 7f2d18362b80 1 -- 172.21.15.59:0/2796662469 wait complete. 2023-10-08T12:46:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.057+0000 7f2d18362b80 20 client.26191 trim_cache size 0 max 16384 2023-10-08T12:46:48.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.074+0000 7f2d18362b80 1 Processor -- start 2023-10-08T12:46:48.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.074+0000 7f2d18362b80 1 -- start start 2023-10-08T12:46:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.074+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc99297180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.074+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc99288750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.074+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc99288c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.074+0000 7f2d18362b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc99059920 con 0x55cc992857a0 2023-10-08T12:46:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.074+0000 7f2d18362b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc9929d860 con 0x55cc99290650 2023-10-08T12:46:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.074+0000 7f2d18362b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc992869c0 con 0x55cc99284e80 2023-10-08T12:46:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc99288750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc99288c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfe59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc99297180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc99288c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50598/0 (socket says 172.21.15.59:50598) 2023-10-08T12:46:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfe59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc99297180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51780/0 (socket says 172.21.15.59:51780) 2023-10-08T12:46:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfed9d700 1 -- 172.21.15.59:0/2965734232 learned_addr learned my addr 172.21.15.59:0/2965734232 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc99288750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41718/0 (socket says 172.21.15.59:41718) 2023-10-08T12:46:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfdd9b700 1 -- 172.21.15.59:0/2965734232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 msgr2=0x55cc99297180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/2965734232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc99297180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfdd9b700 1 -- 172.21.15.59:0/2965734232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 msgr2=0x55cc99288c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/2965734232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc99288c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfdd9b700 1 -- 172.21.15.59:0/2965734232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc98fecc60 con 0x55cc992857a0 2023-10-08T12:46:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfed9d700 1 --2- 172.21.15.59:0/2965734232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc99288c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:48.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.075+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/2965734232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc99288750 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009ce0 tx=0x7f2cf401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad58f866a30b0ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2ced7fa700 1 -- 172.21.15.59:0/2965734232 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf401d040 con 0x55cc992857a0 2023-10-08T12:46:48.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2ced7fa700 1 -- 172.21.15.59:0/2965734232 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf400be40 con 0x55cc992857a0 2023-10-08T12:46:48.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2ced7fa700 1 -- 172.21.15.59:0/2965734232 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4034810 con 0x55cc992857a0 2023-10-08T12:46:48.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2d18362b80 1 -- 172.21.15.59:0/2965734232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 msgr2=0x55cc99288750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2965734232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc99288750 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009ce0 tx=0x7f2cf401a040 comp rx=0 tx=0).stop 2023-10-08T12:46:48.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2d18362b80 1 -- 172.21.15.59:0/2965734232 shutdown_connections 2023-10-08T12:46:48.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2965734232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc99288c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2965734232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc99297180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2d18362b80 1 --2- 172.21.15.59:0/2965734232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc99288750 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2d18362b80 1 -- 172.21.15.59:0/2965734232 >> 172.21.15.59:0/2965734232 conn(0x55cc991fa260 msgr2=0x55cc992804d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2d18362b80 1 -- 172.21.15.59:0/2965734232 shutdown_connections 2023-10-08T12:46:48.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.076+0000 7f2d18362b80 1 -- 172.21.15.59:0/2965734232 wait complete. 2023-10-08T12:46:48.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.077+0000 7f2d18362b80 1 -- start start 2023-10-08T12:46:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.077+0000 7f2d18362b80 1 Processor -- start 2023-10-08T12:46:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.077+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc99296de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.077+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc99297320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.077+0000 7f2d18362b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc992953d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.077+0000 7f2d18362b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc99295ae0 con 0x55cc992857a0 2023-10-08T12:46:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.077+0000 7f2d18362b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc99295c50 con 0x55cc99290650 2023-10-08T12:46:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.077+0000 7f2d18362b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc99295e10 con 0x55cc99284e80 2023-10-08T12:46:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.077+0000 7f2d18362b80 10 client.0 _ll_register_callbacks cb 0x7f2cf0099ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfe59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc99296de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc992953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfe59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc99296de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51790/0 (socket says 172.21.15.59:51790) 2023-10-08T12:46:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfe59c700 1 -- 172.21.15.59:0/1247944830 learned_addr learned my addr 172.21.15.59:0/1247944830 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc99297320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfe59c700 1 -- 172.21.15.59:0/1247944830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 msgr2=0x55cc992953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfe59c700 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc992953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfe59c700 1 -- 172.21.15.59:0/1247944830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 msgr2=0x55cc99297320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfe59c700 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc99297320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfe59c700 1 -- 172.21.15.59:0/1247944830 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf8021040 con 0x55cc99284e80 2023-10-08T12:46:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc99297320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2cfe59c700 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc99296de0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2cf009a1d0 tx=0x7f2cf0010b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5318d4e3ba5d1d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2ce5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:46:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/1247944830 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00a25d0 con 0x55cc99284e80 2023-10-08T12:46:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2d18362b80 1 -- 172.21.15.59:0/1247944830 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cf401e040 con 0x55cc99284e80 2023-10-08T12:46:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.078+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/1247944830 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2cf00b7080 con 0x55cc99284e80 2023-10-08T12:46:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/1247944830 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cf00a2140 con 0x55cc99284e80 2023-10-08T12:46:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2d18362b80 10 client.26197 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2d18362b80 1 -- 172.21.15.59:0/1247944830 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55cc99003de0 con 0x55cc99284e80 2023-10-08T12:46:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/1247944830 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf401e040 con 0x55cc99284e80 2023-10-08T12:46:48.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/1247944830 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2cf009f0d0 con 0x55cc99284e80 2023-10-08T12:46:48.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2d18362b80 10 client.26197 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:48.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2d18362b80 10 client.26197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:48.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2d18362b80 20 client.26197 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:48.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2d18362b80 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cc992f4f80 0x55cc992f7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2d18362b80 4 client.26197 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:46:48.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2d18362b80 1 -- 172.21.15.59:0/1247944830 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cc991d1b30 con 0x55cc992f4f80 2023-10-08T12:46:48.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.079+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cc992f4f80 0x55cc992f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2cfdd9b700 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cc992f4f80 0x55cc992f7370 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f174221c3909f9e6 server_cookie=c75f43f26151d6f2 in_seq=0 out_seq=0 2023-10-08T12:46:48.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2ce5ffb700 10 client.26197 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:48.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2ce5ffb700 1 -- 172.21.15.59:0/1247944830 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55cc991d1b30 con 0x55cc992f4f80 2023-10-08T12:46:48.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2ce5ffb700 10 client.26197 handle_command_reply: tid=0 2023-10-08T12:46:48.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2d18362b80 1 client.26197 shutdown 2023-10-08T12:46:48.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2d18362b80 1 -- 172.21.15.59:0/1247944830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 msgr2=0x55cc99296de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2d18362b80 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc99296de0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2cf009a1d0 tx=0x7f2cf0010b80 comp rx=0 tx=0).stop 2023-10-08T12:46:48.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2d18362b80 1 -- 172.21.15.59:0/1247944830 shutdown_connections 2023-10-08T12:46:48.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2d18362b80 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cc992f4f80 0x55cc992f7370 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2d18362b80 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc99290650 0x55cc992953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2d18362b80 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cc99284e80 0x55cc99296de0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2ce5ffb700 0 client.26197 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:48.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2d18362b80 1 --2- 172.21.15.59:0/1247944830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc992857a0 0x55cc99297320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2d18362b80 1 -- 172.21.15.59:0/1247944830 >> 172.21.15.59:0/1247944830 conn(0x55cc991fa260 msgr2=0x55cc99288750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.080+0000 7f2d18362b80 1 -- 172.21.15.59:0/1247944830 shutdown_connections 2023-10-08T12:46:48.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d18362b80 1 -- 172.21.15.59:0/1247944830 wait complete. 2023-10-08T12:46:48.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d18362b80 20 client.26197 trim_cache size 0 max 16384 2023-10-08T12:46:48.089 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:46:48.089 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:46:48.089 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:46:48.090 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:46:48.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 -- 172.21.15.59:0/2101694990 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ce80a15f0 msgr2=0x7f2ce80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ce80a15f0 0x7f2ce80a3ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009ec0 tx=0x7f2cf800b040 comp rx=0 tx=0).stop 2023-10-08T12:46:48.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 -- 172.21.15.59:0/2101694990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d00102940 msgr2=0x7f2d00198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d00102940 0x7f2d00198e30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000e9a0 tx=0x7f2cf000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 -- 172.21.15.59:0/2101694990 shutdown_connections 2023-10-08T12:46:48.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ce80a15f0 0x7f2ce80a3ab0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d00108950 0x7f2d0019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d00102940 0x7f2d00198e30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 --2- 172.21.15.59:0/2101694990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00103300 0x7f2d00199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 -- 172.21.15.59:0/2101694990 >> 172.21.15.59:0/2101694990 conn(0x7f2d000fe3d0 msgr2=0x7f2d000fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 -- 172.21.15.59:0/2101694990 shutdown_connections 2023-10-08T12:46:48.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.081+0000 7f2d049ff700 1 -- 172.21.15.59:0/2101694990 wait complete. 2023-10-08T12:46:48.100 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:46:48.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:46:48.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:47 smithi059 ceph-mon[98489]: pgmap v482: 97 pgs: 97 active+clean; 367 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 279 op/s 2023-10-08T12:46:48.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:47 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:46:48.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:47 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:48.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:47 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:46:48.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:47 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:48.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:47 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:46:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:47 smithi173 ceph-mon[135182]: pgmap v482: 97 pgs: 97 active+clean; 367 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 279 op/s 2023-10-08T12:46:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:47 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:46:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:47 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:47 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:46:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:47 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:47 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:46:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.315+0000 7f91a31ff700 1 -- 172.21.15.59:0/3798491268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f919c10ce70 msgr2=0x7f919c10f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.315+0000 7f91a31ff700 1 --2- 172.21.15.59:0/3798491268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f919c10ce70 0x7f919c10f2e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f919400b0a0 tx=0x7f919400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.315+0000 7f91a31ff700 1 -- 172.21.15.59:0/3798491268 shutdown_connections 2023-10-08T12:46:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.315+0000 7f91a31ff700 1 --2- 172.21.15.59:0/3798491268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f919c10ce70 0x7f919c10f2e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.315+0000 7f91a31ff700 1 --2- 172.21.15.59:0/3798491268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f919c072c20 0x7f919c073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.315+0000 7f91a31ff700 1 --2- 172.21.15.59:0/3798491268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f919c073540 0x7f919c10c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.315+0000 7f91a31ff700 1 -- 172.21.15.59:0/3798491268 >> 172.21.15.59:0/3798491268 conn(0x7f919c0fc140 msgr2=0x7f919c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.315+0000 7f91a31ff700 1 -- 172.21.15.59:0/3798491268 shutdown_connections 2023-10-08T12:46:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.315+0000 7f91a31ff700 1 -- 172.21.15.59:0/3798491268 wait complete. 2023-10-08T12:46:48.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.316+0000 7f91a31ff700 1 Processor -- start 2023-10-08T12:46:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.316+0000 7f91a31ff700 1 -- start start 2023-10-08T12:46:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f91a31ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f919c072c20 0x7f919c198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f91a31ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f919c073540 0x7f919c1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f91a31ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f919c10ce70 0x7f919c19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f91a31ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c19dd50 con 0x7f919c072c20 2023-10-08T12:46:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f91a31ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c19dec0 con 0x7f919c073540 2023-10-08T12:46:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f91a31ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c19e080 con 0x7f919c10ce70 2023-10-08T12:46:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f919bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f919c073540 0x7f919c1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f91a0f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f919c072c20 0x7f919c198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f919bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f919c073540 0x7f919c1993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50622/0 (socket says 172.21.15.59:50622) 2023-10-08T12:46:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f919bfff700 1 -- 172.21.15.59:0/2936292474 learned_addr learned my addr 172.21.15.59:0/2936292474 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f91a179c700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f919c10ce70 0x7f919c19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f919bfff700 1 -- 172.21.15.59:0/2936292474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f919c10ce70 msgr2=0x7f919c19d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f919bfff700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f919c10ce70 0x7f919c19d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f919bfff700 1 -- 172.21.15.59:0/2936292474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f919c072c20 msgr2=0x7f919c198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f919bfff700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f919c072c20 0x7f919c198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.317+0000 7f919bfff700 1 -- 172.21.15.59:0/2936292474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9194009d00 con 0x7f919c073540 2023-10-08T12:46:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.318+0000 7f919bfff700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f919c073540 0x7f919c1993e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f918800e9a0 tx=0x7f918800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.318+0000 7f9199ffb700 1 -- 172.21.15.59:0/2936292474 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188009790 con 0x7f919c073540 2023-10-08T12:46:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.318+0000 7f9199ffb700 1 -- 172.21.15.59:0/2936292474 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9188010430 con 0x7f919c073540 2023-10-08T12:46:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.318+0000 7f91a31ff700 1 -- 172.21.15.59:0/2936292474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c19e360 con 0x7f919c073540 2023-10-08T12:46:48.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.318+0000 7f9199ffb700 1 -- 172.21.15.59:0/2936292474 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188018680 con 0x7f919c073540 2023-10-08T12:46:48.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.318+0000 7f91a31ff700 1 -- 172.21.15.59:0/2936292474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c1a5ba0 con 0x7f919c073540 2023-10-08T12:46:48.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.319+0000 7f91a31ff700 1 -- 172.21.15.59:0/2936292474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919c108080 con 0x7f919c073540 2023-10-08T12:46:48.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.321+0000 7f9199ffb700 1 -- 172.21.15.59:0/2936292474 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f91880105a0 con 0x7f919c073540 2023-10-08T12:46:48.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.322+0000 7f9199ffb700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f918c0a15f0 0x7f918c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.322+0000 7f9199ffb700 1 -- 172.21.15.59:0/2936292474 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9188014070 con 0x7f919c073540 2023-10-08T12:46:48.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.323+0000 7f91a0f9b700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f918c0a15f0 0x7f918c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.323+0000 7f91a0f9b700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f918c0a15f0 0x7f918c0a3ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9190009c60 tx=0x7f9190009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.325+0000 7f9199ffb700 1 -- 172.21.15.59:0/2936292474 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9188096560 con 0x7f919c073540 2023-10-08T12:46:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:47 smithi092 ceph-mon[134093]: pgmap v482: 97 pgs: 97 active+clean; 367 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 279 op/s 2023-10-08T12:46:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:47 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:46:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:47 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:47 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:46:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:47 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:48.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:47 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:46:48.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 674413 13.73 MB/sec execute 139 sec latency 18.847 ms 2023-10-08T12:46:48.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.612+0000 7f91a31ff700 1 -- 172.21.15.59:0/2936292474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f919c0742d0 con 0x7f919c073540 2023-10-08T12:46:48.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.613+0000 7f9199ffb700 1 -- 172.21.15.59:0/2936292474 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f9188099b80 con 0x7f919c073540 2023-10-08T12:46:48.614 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:46:48.614 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:46:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.615+0000 7f91a31ff700 1 -- 172.21.15.59:0/2936292474 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f918c0a15f0 msgr2=0x7f918c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.615+0000 7f91a31ff700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f918c0a15f0 0x7f918c0a3ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9190009c60 tx=0x7f9190009260 comp rx=0 tx=0).stop 2023-10-08T12:46:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.615+0000 7f91a31ff700 1 -- 172.21.15.59:0/2936292474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f919c073540 msgr2=0x7f919c1993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.615+0000 7f91a31ff700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f919c073540 0x7f919c1993e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f918800e9a0 tx=0x7f918800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.615+0000 7f91a31ff700 1 -- 172.21.15.59:0/2936292474 shutdown_connections 2023-10-08T12:46:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.615+0000 7f91a31ff700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f918c0a15f0 0x7f918c0a3ab0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.615+0000 7f91a31ff700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f919c10ce70 0x7f919c19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.615+0000 7f91a31ff700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f919c072c20 0x7f919c198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.615+0000 7f91a31ff700 1 --2- 172.21.15.59:0/2936292474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f919c073540 0x7f919c1993e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.615+0000 7f91a31ff700 1 -- 172.21.15.59:0/2936292474 >> 172.21.15.59:0/2936292474 conn(0x7f919c0fc140 msgr2=0x7f919c0fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.615+0000 7f91a31ff700 1 -- 172.21.15.59:0/2936292474 shutdown_connections 2023-10-08T12:46:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.616+0000 7f91a31ff700 1 -- 172.21.15.59:0/2936292474 wait complete. 2023-10-08T12:46:48.619 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:46:48.636 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:46:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.850+0000 7f75367ff700 1 -- 172.21.15.59:0/3702192714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7530101100 msgr2=0x7f753010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.850+0000 7f75367ff700 1 --2- 172.21.15.59:0/3702192714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7530101100 0x7f753010d610 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f752800b0a0 tx=0x7f752800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.850+0000 7f75367ff700 1 -- 172.21.15.59:0/3702192714 shutdown_connections 2023-10-08T12:46:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.850+0000 7f75367ff700 1 --2- 172.21.15.59:0/3702192714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7530101100 0x7f753010d610 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.850+0000 7f75367ff700 1 --2- 172.21.15.59:0/3702192714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7530106750 0x7f7530106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.850+0000 7f75367ff700 1 --2- 172.21.15.59:0/3702192714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7530100740 0x7f7530100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.850+0000 7f75367ff700 1 -- 172.21.15.59:0/3702192714 >> 172.21.15.59:0/3702192714 conn(0x7f75300fc230 msgr2=0x7f75300fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.850+0000 7f75367ff700 1 -- 172.21.15.59:0/3702192714 shutdown_connections 2023-10-08T12:46:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.850+0000 7f75367ff700 1 -- 172.21.15.59:0/3702192714 wait complete. 2023-10-08T12:46:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.851+0000 7f75367ff700 1 Processor -- start 2023-10-08T12:46:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.851+0000 7f75367ff700 1 -- start start 2023-10-08T12:46:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.852+0000 7f75367ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7530100740 0x7f7530198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.852+0000 7f75367ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7530101100 0x7f7530199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.852+0000 7f75367ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7530106750 0x7f753019c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.852+0000 7f75367ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753019cb60 con 0x7f7530100740 2023-10-08T12:46:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.852+0000 7f75367ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753019ccd0 con 0x7f7530106750 2023-10-08T12:46:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.852+0000 7f75367ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753019ce90 con 0x7f7530101100 2023-10-08T12:46:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.852+0000 7f752ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7530100740 0x7f7530198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.852+0000 7f752ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7530100740 0x7f7530198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41756/0 (socket says 172.21.15.59:41756) 2023-10-08T12:46:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.852+0000 7f752ffff700 1 -- 172.21.15.59:0/2626927704 learned_addr learned my addr 172.21.15.59:0/2626927704 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.852+0000 7f752f7fe700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7530101100 0x7f7530199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.852+0000 7f7534d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7530106750 0x7f753019c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f752f7fe700 1 -- 172.21.15.59:0/2626927704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7530106750 msgr2=0x7f753019c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f752f7fe700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7530106750 0x7f753019c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f752f7fe700 1 -- 172.21.15.59:0/2626927704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7530100740 msgr2=0x7f7530198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f752f7fe700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7530100740 0x7f7530198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f752f7fe700 1 -- 172.21.15.59:0/2626927704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528009d00 con 0x7f7530101100 2023-10-08T12:46:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f7534d9c700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7530106750 0x7f753019c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f752ffff700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7530100740 0x7f7530198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f752f7fe700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7530101100 0x7f7530199270 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f752400e9f0 tx=0x7f752400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f752d7fa700 1 -- 172.21.15.59:0/2626927704 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400c9c0 con 0x7f7530101100 2023-10-08T12:46:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f75367ff700 1 -- 172.21.15.59:0/2626927704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753019d170 con 0x7f7530101100 2023-10-08T12:46:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f752d7fa700 1 -- 172.21.15.59:0/2626927704 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7524010430 con 0x7f7530101100 2023-10-08T12:46:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.853+0000 7f752d7fa700 1 -- 172.21.15.59:0/2626927704 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524018680 con 0x7f7530101100 2023-10-08T12:46:48.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.854+0000 7f75367ff700 1 -- 172.21.15.59:0/2626927704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75301a5ad0 con 0x7f7530101100 2023-10-08T12:46:48.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.857+0000 7f752d7fa700 1 -- 172.21.15.59:0/2626927704 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7524010860 con 0x7f7530101100 2023-10-08T12:46:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.858+0000 7f754a1bab80 1 Processor -- start 2023-10-08T12:46:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.858+0000 7f752d7fa700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75180a1670 0x7f75180a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.858+0000 7f754a1bab80 1 -- start start 2023-10-08T12:46:48.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f752d7fa700 1 -- 172.21.15.59:0/2626927704 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7524014070 con 0x7f7530101100 2023-10-08T12:46:48.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f7534d9c700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75180a1670 0x7f75180a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824817260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a824822110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824822650 0x55a824824a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f754a1bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a824780460 con 0x55a8248177a0 2023-10-08T12:46:48.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f754a1bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a824771c20 con 0x55a824816e80 2023-10-08T12:46:48.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f754a1bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82476f540 con 0x55a824822650 2023-10-08T12:46:48.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f752ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824817260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f752ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824817260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50646/0 (socket says 172.21.15.59:50646) 2023-10-08T12:46:48.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f752ffff700 1 -- 172.21.15.59:0/2130880357 learned_addr learned my addr 172.21.15.59:0/2130880357 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:48.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f752f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a824822110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f7534d9c700 1 --2- 172.21.15.59:0/2130880357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824822650 0x55a824824a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.859+0000 7f752ffff700 1 -- 172.21.15.59:0/2130880357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824822650 msgr2=0x55a824824a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.860+0000 7f752ffff700 1 --2- 172.21.15.59:0/2130880357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824822650 0x55a824824a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.860+0000 7f752ffff700 1 -- 172.21.15.59:0/2130880357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 msgr2=0x55a824822110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.860+0000 7f752ffff700 1 --2- 172.21.15.59:0/2130880357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a824822110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.860+0000 7f752ffff700 1 -- 172.21.15.59:0/2130880357 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a824595de0 con 0x55a824816e80 2023-10-08T12:46:48.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.860+0000 7f752ffff700 1 --2- 172.21.15.59:0/2130880357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824817260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7520011680 tx=0x7f7520011990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfede599d745924a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.860+0000 7f7534d9c700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75180a1670 0x7f75180a3b30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7528009040 tx=0x7f752800be10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.860+0000 7f75167fc700 1 -- 172.21.15.59:0/2130880357 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520019630 con 0x55a824816e80 2023-10-08T12:46:48.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.860+0000 7f75167fc700 1 -- 172.21.15.59:0/2130880357 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7520019c50 con 0x55a824816e80 2023-10-08T12:46:48.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.860+0000 7f75167fc700 1 -- 172.21.15.59:0/2130880357 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752000edb0 con 0x55a824816e80 2023-10-08T12:46:48.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.861+0000 7f754a1bab80 1 -- 172.21.15.59:0/2130880357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 msgr2=0x55a824817260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.861+0000 7f754a1bab80 1 --2- 172.21.15.59:0/2130880357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824817260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7520011680 tx=0x7f7520011990 comp rx=0 tx=0).stop 2023-10-08T12:46:48.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.861+0000 7f754a1bab80 1 -- 172.21.15.59:0/2130880357 shutdown_connections 2023-10-08T12:46:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.861+0000 7f754a1bab80 1 --2- 172.21.15.59:0/2130880357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824817260 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.861+0000 7f754a1bab80 1 --2- 172.21.15.59:0/2130880357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824822650 0x55a824824a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.861+0000 7f754a1bab80 1 --2- 172.21.15.59:0/2130880357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a824822110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.861+0000 7f754a1bab80 1 -- 172.21.15.59:0/2130880357 >> 172.21.15.59:0/2130880357 conn(0x55a82478c260 msgr2=0x55a8248132d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.861+0000 7f754a1bab80 1 -- 172.21.15.59:0/2130880357 shutdown_connections 2023-10-08T12:46:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.861+0000 7f754a1bab80 1 -- 172.21.15.59:0/2130880357 wait complete. 2023-10-08T12:46:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.862+0000 7f754a1bab80 1 -- start start 2023-10-08T12:46:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.862+0000 7f754a1bab80 1 Processor -- start 2023-10-08T12:46:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824822010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a82481f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824822650 0x55a82481f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f754a1bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82476ae30 con 0x55a8248177a0 2023-10-08T12:46:48.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f754a1bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a824707710 con 0x55a824822650 2023-10-08T12:46:48.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f754a1bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8247073b0 con 0x55a824816e80 2023-10-08T12:46:48.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f754a1bab80 10 client.0 _ll_register_callbacks cb 0x55a824564800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:48.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f752ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824822010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f752ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824822010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51848/0 (socket says 172.21.15.59:51848) 2023-10-08T12:46:48.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f7534d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824822650 0x55a82481f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f752ffff700 1 -- 172.21.15.59:0/2954878654 learned_addr learned my addr 172.21.15.59:0/2954878654 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:48.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.863+0000 7f752f7fe700 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a82481f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f752ffff700 1 -- 172.21.15.59:0/2954878654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824822650 msgr2=0x55a82481f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f752ffff700 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824822650 0x55a82481f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f752ffff700 1 -- 172.21.15.59:0/2954878654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 msgr2=0x55a82481f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f752ffff700 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a82481f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f752ffff700 1 -- 172.21.15.59:0/2954878654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7520009e10 con 0x55a824816e80 2023-10-08T12:46:48.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f7534d9c700 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824822650 0x55a82481f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:48.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f752ffff700 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824822010 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7520009880 tx=0x7f7520005e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aa5f6fe615e6086 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f750f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:46:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f750f7fe700 1 -- 172.21.15.59:0/2954878654 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752000e710 con 0x55a824816e80 2023-10-08T12:46:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f754a1bab80 1 -- 172.21.15.59:0/2954878654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a824732eb0 con 0x55a824816e80 2023-10-08T12:46:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f750f7fe700 1 -- 172.21.15.59:0/2954878654 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7520019430 con 0x55a824816e80 2023-10-08T12:46:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.864+0000 7f750f7fe700 1 -- 172.21.15.59:0/2954878654 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75200195f0 con 0x55a824816e80 2023-10-08T12:46:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.865+0000 7f754a1bab80 10 client.26215 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.865+0000 7f754a1bab80 1 -- 172.21.15.59:0/2954878654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55a82457ec60 con 0x55a824816e80 2023-10-08T12:46:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.865+0000 7f750f7fe700 1 -- 172.21.15.59:0/2954878654 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a824732eb0 con 0x55a824816e80 2023-10-08T12:46:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.865+0000 7f750f7fe700 1 -- 172.21.15.59:0/2954878654 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7520028020 con 0x55a824816e80 2023-10-08T12:46:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.865+0000 7f754a1bab80 10 client.26215 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.865+0000 7f754a1bab80 10 client.26215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.865+0000 7f754a1bab80 20 client.26215 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.865+0000 7f754a1bab80 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a824831fb0 0x55a8248343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.865+0000 7f754a1bab80 4 client.26215 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.865+0000 7f754a1bab80 1 -- 172.21.15.59:0/2954878654 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a824763e10 con 0x55a824831fb0 2023-10-08T12:46:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.865+0000 7f752f7fe700 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a824831fb0 0x55a8248343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.866+0000 7f752f7fe700 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a824831fb0 0x55a8248343a0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=878140534f496787 server_cookie=8da11ac1e1455ee6 in_seq=0 out_seq=0 2023-10-08T12:46:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.866+0000 7f750f7fe700 10 client.26215 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.867+0000 7f750f7fe700 1 -- 172.21.15.59:0/2954878654 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a824763e10 con 0x55a824831fb0 2023-10-08T12:46:48.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.867+0000 7f750f7fe700 10 client.26215 handle_command_reply: tid=0 2023-10-08T12:46:48.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.867+0000 7f754a1bab80 1 client.26215 shutdown 2023-10-08T12:46:48.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f754a1bab80 1 -- 172.21.15.59:0/2954878654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 msgr2=0x55a824822010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f754a1bab80 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824822010 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7520009880 tx=0x7f7520005e20 comp rx=0 tx=0).stop 2023-10-08T12:46:48.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f754a1bab80 1 -- 172.21.15.59:0/2954878654 shutdown_connections 2023-10-08T12:46:48.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f754a1bab80 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a824831fb0 0x55a8248343a0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f754a1bab80 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824822650 0x55a82481f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f754a1bab80 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824822010 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f750f7fe700 0 client.26215 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:48.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f754a1bab80 1 --2- 172.21.15.59:0/2954878654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a82481f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f754a1bab80 1 -- 172.21.15.59:0/2954878654 >> 172.21.15.59:0/2954878654 conn(0x55a82478c260 msgr2=0x55a824812ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f754a1bab80 1 -- 172.21.15.59:0/2954878654 shutdown_connections 2023-10-08T12:46:48.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f754a1bab80 1 -- 172.21.15.59:0/2954878654 wait complete. 2023-10-08T12:46:48.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.868+0000 7f754a1bab80 20 client.26215 trim_cache size 0 max 16384 2023-10-08T12:46:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.883+0000 7f754a1bab80 1 Processor -- start 2023-10-08T12:46:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.883+0000 7f754a1bab80 1 -- start start 2023-10-08T12:46:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.883+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824817260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.883+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a824829210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.883+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824822650 0x55a824821cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.883+0000 7f754a1bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8245eb920 con 0x55a8248177a0 2023-10-08T12:46:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f754a1bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a824818100 con 0x55a824822650 2023-10-08T12:46:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f754a1bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82481af60 con 0x55a824816e80 2023-10-08T12:46:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f752ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824817260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f7534d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824822650 0x55a824821cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f752ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824817260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51852/0 (socket says 172.21.15.59:51852) 2023-10-08T12:46:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f752ffff700 1 -- 172.21.15.59:0/1818581256 learned_addr learned my addr 172.21.15.59:0/1818581256 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f752f7fe700 1 --2- 172.21.15.59:0/1818581256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a824829210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f752ffff700 1 -- 172.21.15.59:0/1818581256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824822650 msgr2=0x55a824821cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f752ffff700 1 --2- 172.21.15.59:0/1818581256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824822650 0x55a824821cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f752ffff700 1 -- 172.21.15.59:0/1818581256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 msgr2=0x55a824829210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f752ffff700 1 --2- 172.21.15.59:0/1818581256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a824829210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f752ffff700 1 -- 172.21.15.59:0/1818581256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8245bc250 con 0x55a824816e80 2023-10-08T12:46:48.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.884+0000 7f752f7fe700 1 --2- 172.21.15.59:0/1818581256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a824829210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.885+0000 7f752ffff700 1 --2- 172.21.15.59:0/1818581256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824817260 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f752000a010 tx=0x7f752000eaa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eed2fca28047f595 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.885+0000 7f7516ffd700 1 -- 172.21.15.59:0/1818581256 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520004d00 con 0x55a824816e80 2023-10-08T12:46:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.885+0000 7f7516ffd700 1 -- 172.21.15.59:0/1818581256 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f752000e6c0 con 0x55a824816e80 2023-10-08T12:46:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.885+0000 7f7516ffd700 1 -- 172.21.15.59:0/1818581256 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520004520 con 0x55a824816e80 2023-10-08T12:46:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.885+0000 7f754a1bab80 1 -- 172.21.15.59:0/1818581256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 msgr2=0x55a824817260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.885+0000 7f754a1bab80 1 --2- 172.21.15.59:0/1818581256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824817260 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f752000a010 tx=0x7f752000eaa0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.885+0000 7f754a1bab80 1 -- 172.21.15.59:0/1818581256 shutdown_connections 2023-10-08T12:46:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.885+0000 7f754a1bab80 1 --2- 172.21.15.59:0/1818581256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824822650 0x55a824821cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.885+0000 7f754a1bab80 1 --2- 172.21.15.59:0/1818581256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a824816e80 0x55a824817260 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.885+0000 7f754a1bab80 1 --2- 172.21.15.59:0/1818581256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8248177a0 0x55a824829210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.885+0000 7f754a1bab80 1 -- 172.21.15.59:0/1818581256 >> 172.21.15.59:0/1818581256 conn(0x55a82478c260 msgr2=0x55a8248124d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.886+0000 7f754a1bab80 1 -- 172.21.15.59:0/1818581256 shutdown_connections 2023-10-08T12:46:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.886+0000 7f754a1bab80 1 -- 172.21.15.59:0/1818581256 wait complete. 2023-10-08T12:46:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.886+0000 7f754a1bab80 1 -- start start 2023-10-08T12:46:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.886+0000 7f754a1bab80 1 Processor -- start 2023-10-08T12:46:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824829210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8248177a0 0x55a8248271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f754a1bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a824822650 0x55a824827730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f754a1bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a824827cb0 con 0x55a824822650 2023-10-08T12:46:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f754a1bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a824827e20 con 0x55a824816e80 2023-10-08T12:46:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f754a1bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a824827fe0 con 0x55a8248177a0 2023-10-08T12:46:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f754a1bab80 10 client.0 _ll_register_callbacks cb 0x7f7524009f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f752ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824829210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f752ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824829210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50666/0 (socket says 172.21.15.59:50666) 2023-10-08T12:46:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f752ffff700 1 -- 172.21.15.59:0/84400907 learned_addr learned my addr 172.21.15.59:0/84400907 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f7534d9c700 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a824822650 0x55a824827730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f752f7fe700 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8248177a0 0x55a8248271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f752ffff700 1 -- 172.21.15.59:0/84400907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8248177a0 msgr2=0x55a8248271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f752ffff700 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8248177a0 0x55a8248271f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f752ffff700 1 -- 172.21.15.59:0/84400907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a824822650 msgr2=0x55a824827730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f752ffff700 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a824822650 0x55a824827730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f752ffff700 1 -- 172.21.15.59:0/84400907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a82457ec60 con 0x55a824816e80 2023-10-08T12:46:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.887+0000 7f752f7fe700 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8248177a0 0x55a8248271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.888+0000 7f752ffff700 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824829210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7520004910 tx=0x7f7520005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b442cbc2499633d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.888+0000 7f750f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.888+0000 7f750f7fe700 1 -- 172.21.15.59:0/84400907 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520019840 con 0x55a824816e80 2023-10-08T12:46:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.888+0000 7f754a1bab80 1 -- 172.21.15.59:0/84400907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7520019c50 con 0x55a824816e80 2023-10-08T12:46:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.888+0000 7f750f7fe700 1 -- 172.21.15.59:0/84400907 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7520000e40 con 0x55a824816e80 2023-10-08T12:46:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.888+0000 7f750f7fe700 1 -- 172.21.15.59:0/84400907 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75200199a0 con 0x55a824816e80 2023-10-08T12:46:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.888+0000 7f754a1bab80 10 client.26225 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.888+0000 7f754a1bab80 1 -- 172.21.15.59:0/84400907 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55a8245942b0 con 0x55a824816e80 2023-10-08T12:46:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.888+0000 7f750f7fe700 1 -- 172.21.15.59:0/84400907 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7520019c50 con 0x55a824816e80 2023-10-08T12:46:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.889+0000 7f750f7fe700 1 -- 172.21.15.59:0/84400907 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f752003c030 con 0x55a824816e80 2023-10-08T12:46:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.889+0000 7f754a1bab80 10 client.26225 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.889+0000 7f754a1bab80 10 client.26225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.889+0000 7f754a1bab80 20 client.26225 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.889+0000 7f754a1bab80 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a824885f60 0x55a824888380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.889+0000 7f754a1bab80 4 client.26225 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:46:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.889+0000 7f754a1bab80 1 -- 172.21.15.59:0/84400907 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a824763b30 con 0x55a824885f60 2023-10-08T12:46:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.889+0000 7f752f7fe700 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a824885f60 0x55a824888380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.889+0000 7f752f7fe700 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a824885f60 0x55a824888380 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=880289551d0488a0 server_cookie=a9bef30e4795275a in_seq=0 out_seq=0 2023-10-08T12:46:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.889+0000 7f750f7fe700 10 client.26225 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f750f7fe700 1 -- 172.21.15.59:0/84400907 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a824763b30 con 0x55a824885f60 2023-10-08T12:46:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f750f7fe700 10 client.26225 handle_command_reply: tid=0 2023-10-08T12:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f754a1bab80 1 client.26225 shutdown 2023-10-08T12:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f754a1bab80 1 -- 172.21.15.59:0/84400907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 msgr2=0x55a824829210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f754a1bab80 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824829210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7520004910 tx=0x7f7520005e00 comp rx=0 tx=0).stop 2023-10-08T12:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f754a1bab80 1 -- 172.21.15.59:0/84400907 shutdown_connections 2023-10-08T12:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f754a1bab80 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a824885f60 0x55a824888380 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f754a1bab80 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a824816e80 0x55a824829210 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f754a1bab80 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a824822650 0x55a824827730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f754a1bab80 1 --2- 172.21.15.59:0/84400907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8248177a0 0x55a8248271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f750f7fe700 0 client.26225 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f754a1bab80 1 -- 172.21.15.59:0/84400907 >> 172.21.15.59:0/84400907 conn(0x55a82478c260 msgr2=0x55a82481db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f754a1bab80 1 -- 172.21.15.59:0/84400907 shutdown_connections 2023-10-08T12:46:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.890+0000 7f754a1bab80 1 -- 172.21.15.59:0/84400907 wait complete. 2023-10-08T12:46:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.891+0000 7f754a1bab80 20 client.26225 trim_cache size 0 max 16384 2023-10-08T12:46:48.898 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:46:48.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.891+0000 7f75367ff700 1 -- 172.21.15.59:0/2626927704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75180a1670 msgr2=0x7f75180a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.891+0000 7f75367ff700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75180a1670 0x7f75180a3b30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7528009040 tx=0x7f752800be10 comp rx=0 tx=0).stop 2023-10-08T12:46:48.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.891+0000 7f75367ff700 1 -- 172.21.15.59:0/2626927704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7530101100 msgr2=0x7f7530199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:48.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.891+0000 7f75367ff700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7530101100 0x7f7530199270 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f752400e9f0 tx=0x7f752400ed00 comp rx=0 tx=0).stop 2023-10-08T12:46:48.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.891+0000 7f75367ff700 1 -- 172.21.15.59:0/2626927704 shutdown_connections 2023-10-08T12:46:48.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.891+0000 7f75367ff700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f75180a1670 0x7f75180a3b30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.891+0000 7f75367ff700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7530106750 0x7f753019c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.891+0000 7f75367ff700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7530100740 0x7f7530198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.891+0000 7f75367ff700 1 --2- 172.21.15.59:0/2626927704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7530101100 0x7f7530199270 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:48.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.891+0000 7f75367ff700 1 -- 172.21.15.59:0/2626927704 >> 172.21.15.59:0/2626927704 conn(0x7f75300fc230 msgr2=0x7f7530072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.892+0000 7f75367ff700 1 -- 172.21.15.59:0/2626927704 shutdown_connections 2023-10-08T12:46:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:48.892+0000 7f75367ff700 1 -- 172.21.15.59:0/2626927704 wait complete. 2023-10-08T12:46:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:48 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2936292474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:46:49.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:48 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2936292474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:46:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:48 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2936292474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:46:49.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 676375 13.71 MB/sec execute 140 sec latency 109.628 ms 2023-10-08T12:46:49.913 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:46:49.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:46:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.141+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/199960045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc8072c20 msgr2=0x7f1bc8073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.141+0000 7f1bcf5ff700 1 --2- 172.21.15.59:0/199960045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc8072c20 0x7f1bc8073000 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009990 tx=0x7f1bc4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.141+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/199960045 shutdown_connections 2023-10-08T12:46:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.141+0000 7f1bcf5ff700 1 --2- 172.21.15.59:0/199960045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc810cf70 0x7f1bc810f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.141+0000 7f1bcf5ff700 1 --2- 172.21.15.59:0/199960045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc8072c20 0x7f1bc8073000 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.141+0000 7f1bcf5ff700 1 --2- 172.21.15.59:0/199960045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bc8073540 0x7f1bc810ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.141+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/199960045 >> 172.21.15.59:0/199960045 conn(0x7f1bc80fc200 msgr2=0x7f1bc80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.141+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/199960045 shutdown_connections 2023-10-08T12:46:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.141+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/199960045 wait complete. 2023-10-08T12:46:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.142+0000 7f1bcf5ff700 1 Processor -- start 2023-10-08T12:46:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.142+0000 7f1bcf5ff700 1 -- start start 2023-10-08T12:46:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.143+0000 7f1bcf5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc8072c20 0x7f1bc8198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.143+0000 7f1bcf5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8073540 0x7f1bc81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.143+0000 7f1bcf5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bc810cf70 0x7f1bc819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.143+0000 7f1bcf5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc819dd90 con 0x7f1bc8072c20 2023-10-08T12:46:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.143+0000 7f1bcf5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc819df00 con 0x7f1bc810cf70 2023-10-08T12:46:50.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.143+0000 7f1bcf5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc819e0c0 con 0x7f1bc8073540 2023-10-08T12:46:50.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.143+0000 7f1bccb9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8073540 0x7f1bc81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.143+0000 7f1bccb9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8073540 0x7f1bc81993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51872/0 (socket says 172.21.15.59:51872) 2023-10-08T12:46:50.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.143+0000 7f1bccb9a700 1 -- 172.21.15.59:0/3591247912 learned_addr learned my addr 172.21.15.59:0/3591247912 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:50.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.143+0000 7f1bcdb9c700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bc810cf70 0x7f1bc819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.143+0000 7f1bcd39b700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc8072c20 0x7f1bc8198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.144+0000 7f1bccb9a700 1 -- 172.21.15.59:0/3591247912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bc810cf70 msgr2=0x7f1bc819d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.144+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bc810cf70 0x7f1bc819d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.144+0000 7f1bccb9a700 1 -- 172.21.15.59:0/3591247912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc8072c20 msgr2=0x7f1bc8198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.144+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc8072c20 0x7f1bc8198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.144+0000 7f1bccb9a700 1 -- 172.21.15.59:0/3591247912 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb8009520 con 0x7f1bc8073540 2023-10-08T12:46:50.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.144+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8073540 0x7f1bc81993b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800eb30 tx=0x7f1bb800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.144+0000 7f1bbe7fc700 1 -- 172.21.15.59:0/3591247912 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8009880 con 0x7f1bc8073540 2023-10-08T12:46:50.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.144+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/3591247912 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc40095f0 con 0x7f1bc8073540 2023-10-08T12:46:50.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.144+0000 7f1bbe7fc700 1 -- 172.21.15.59:0/3591247912 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bb80044e0 con 0x7f1bc8073540 2023-10-08T12:46:50.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.144+0000 7f1bbe7fc700 1 -- 172.21.15.59:0/3591247912 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8003d80 con 0x7f1bc8073540 2023-10-08T12:46:50.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.145+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/3591247912 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc819e590 con 0x7f1bc8073540 2023-10-08T12:46:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.148+0000 7f1bbe7fc700 1 -- 172.21.15.59:0/3591247912 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1bb8003f20 con 0x7f1bc8073540 2023-10-08T12:46:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.149+0000 7f1be2f8eb80 1 Processor -- start 2023-10-08T12:46:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1be2f8eb80 1 -- start start 2023-10-08T12:46:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1bbe7fc700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bb40a1670 0x7f1bb40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa282e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 0x55f66fa33190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa336d0 0x55f66fa35ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66f9914e0 con 0x55f66fa336d0 2023-10-08T12:46:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66f982ca0 con 0x55f66fa28820 2023-10-08T12:46:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66f9805c0 con 0x55f66fa27f00 2023-10-08T12:46:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1bbe7fc700 1 -- 172.21.15.59:0/3591247912 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1bb8014070 con 0x7f1bc8073540 2023-10-08T12:46:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1bcd39b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1bcd39b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa282e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51880/0 (socket says 172.21.15.59:51880) 2023-10-08T12:46:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.150+0000 7f1bcd39b700 1 -- 172.21.15.59:0/485476042 learned_addr learned my addr 172.21.15.59:0/485476042 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bcdb9c700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bb40a1670 0x7f1bb40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/485476042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 0x55f66fa33190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bcdb9c700 1 --2- 172.21.15.59:0/485476042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa336d0 0x55f66fa35ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bccb9a700 1 -- 172.21.15.59:0/485476042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 msgr2=0x55f66fa282e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/485476042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa282e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bccb9a700 1 -- 172.21.15.59:0/485476042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa336d0 msgr2=0x55f66fa35ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/485476042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa336d0 0x55f66fa35ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bccb9a700 1 -- 172.21.15.59:0/485476042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f66f7a6e60 con 0x55f66fa28820 2023-10-08T12:46:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bcd39b700 1 --2- 172.21.15.59:0/485476042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa282e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bcdb9c700 1 --2- 172.21.15.59:0/485476042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa336d0 0x55f66fa35ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/485476042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 0x55f66fa33190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80cad20 tx=0x7f1bb8096a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6b1646475aa3152 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.151+0000 7f1bb37fe700 1 -- 172.21.15.59:0/485476042 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800cbd0 con 0x55f66fa28820 2023-10-08T12:46:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.152+0000 7f1bb37fe700 1 -- 172.21.15.59:0/485476042 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bb809ace0 con 0x55f66fa28820 2023-10-08T12:46:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.152+0000 7f1bb37fe700 1 -- 172.21.15.59:0/485476042 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800ce60 con 0x55f66fa28820 2023-10-08T12:46:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.152+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/485476042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 msgr2=0x55f66fa33190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.152+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/485476042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 0x55f66fa33190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80cad20 tx=0x7f1bb8096a50 comp rx=0 tx=0).stop 2023-10-08T12:46:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.152+0000 7f1bcdb9c700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bb40a1670 0x7f1bb40a3b30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009550 tx=0x7f1bc000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.152+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/485476042 shutdown_connections 2023-10-08T12:46:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.152+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/485476042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa336d0 0x55f66fa35ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.152+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/485476042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa282e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.152+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/485476042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 0x55f66fa33190 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.153+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/485476042 >> 172.21.15.59:0/485476042 conn(0x55f66f99d2e0 msgr2=0x55f66fa24350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.153+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/485476042 shutdown_connections 2023-10-08T12:46:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.153+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/485476042 wait complete. 2023-10-08T12:46:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.153+0000 7f1be2f8eb80 1 -- start start 2023-10-08T12:46:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.154+0000 7f1be2f8eb80 1 Processor -- start 2023-10-08T12:46:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa27f00 0x55f66fa33090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 0x55f66fa30380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa336d0 0x55f66fa30990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66f97beb0 con 0x55f66fa27f00 2023-10-08T12:46:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66f918790 con 0x55f66fa28820 2023-10-08T12:46:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66f918430 con 0x55f66fa336d0 2023-10-08T12:46:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1be2f8eb80 10 client.0 _ll_register_callbacks cb 0x55f66f775880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bccb9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 0x55f66fa30380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bccb9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 0x55f66fa30380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50706/0 (socket says 172.21.15.59:50706) 2023-10-08T12:46:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bccb9a700 1 -- 172.21.15.59:0/811263836 learned_addr learned my addr 172.21.15.59:0/811263836 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bcdb9c700 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa336d0 0x55f66fa30990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bcd39b700 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa27f00 0x55f66fa33090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bccb9a700 1 -- 172.21.15.59:0/811263836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa336d0 msgr2=0x55f66fa30990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa336d0 0x55f66fa30990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bccb9a700 1 -- 172.21.15.59:0/811263836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa27f00 msgr2=0x55f66fa33090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa27f00 0x55f66fa33090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bccb9a700 1 -- 172.21.15.59:0/811263836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc81100a0 con 0x55f66fa28820 2023-10-08T12:46:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 0x55f66fa30380 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1bb809a570 tx=0x7f1bb8003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f17df6354383776 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.155+0000 7f1bb0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/811263836 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80cb1e0 con 0x55f66fa28820 2023-10-08T12:46:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/811263836 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1bb809e730 con 0x55f66fa28820 2023-10-08T12:46:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/811263836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f66f943f30 con 0x55f66fa28820 2023-10-08T12:46:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/811263836 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bb800cdd0 con 0x55f66fa28820 2023-10-08T12:46:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1be2f8eb80 10 client.26237 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/811263836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f1bc819e590 con 0x55f66fa28820 2023-10-08T12:46:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/811263836 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f66f943f30 con 0x55f66fa28820 2023-10-08T12:46:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/811263836 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1bb80a24e0 con 0x55f66fa28820 2023-10-08T12:46:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1be2f8eb80 10 client.26237 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1be2f8eb80 10 client.26237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1be2f8eb80 20 client.26237 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f66fa42d50 0x55f66fa45140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1be2f8eb80 4 client.26237 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.156+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/811263836 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f66f974e90 con 0x55f66fa42d50 2023-10-08T12:46:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.157+0000 7f1bcd39b700 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f66fa42d50 0x55f66fa45140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.157+0000 7f1bcd39b700 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f66fa42d50 0x55f66fa45140 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e209a2f2c52eeb97 server_cookie=1b9aacb9a11979bc in_seq=0 out_seq=0 2023-10-08T12:46:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.157+0000 7f1bb0ff9700 10 client.26237 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/811263836 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f66f974e90 con 0x55f66fa42d50 2023-10-08T12:46:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1bb0ff9700 10 client.26237 handle_command_reply: tid=0 2023-10-08T12:46:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1be2f8eb80 1 client.26237 shutdown 2023-10-08T12:46:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/811263836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 msgr2=0x55f66fa30380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 0x55f66fa30380 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1bb809a570 tx=0x7f1bb8003680 comp rx=0 tx=0).stop 2023-10-08T12:46:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/811263836 shutdown_connections 2023-10-08T12:46:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f66fa42d50 0x55f66fa45140 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa336d0 0x55f66fa30990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa27f00 0x55f66fa33090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1bb0ff9700 0 client.26237 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/811263836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa28820 0x55f66fa30380 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/811263836 >> 172.21.15.59:0/811263836 conn(0x55f66f99d2e0 msgr2=0x55f66fa23f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/811263836 shutdown_connections 2023-10-08T12:46:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.158+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/811263836 wait complete. 2023-10-08T12:46:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.159+0000 7f1be2f8eb80 20 client.26237 trim_cache size 0 max 16384 2023-10-08T12:46:50.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.179+0000 7f1be2f8eb80 1 Processor -- start 2023-10-08T12:46:50.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.179+0000 7f1be2f8eb80 1 -- start start 2023-10-08T12:46:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa27f00 0x55f66fa30320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa28820 0x55f66fa3a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa336d0 0x55f66fa23d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66f7fc9a0 con 0x55f66fa336d0 2023-10-08T12:46:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66fa29150 con 0x55f66fa27f00 2023-10-08T12:46:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66fa1e620 con 0x55f66fa28820 2023-10-08T12:46:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1bcd39b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa27f00 0x55f66fa30320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1bcd39b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa27f00 0x55f66fa30320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50716/0 (socket says 172.21.15.59:50716) 2023-10-08T12:46:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1bcd39b700 1 -- 172.21.15.59:0/4121327423 learned_addr learned my addr 172.21.15.59:0/4121327423 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/4121327423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa28820 0x55f66fa3a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1bcdb9c700 1 --2- 172.21.15.59:0/4121327423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa336d0 0x55f66fa23d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1bcd39b700 1 -- 172.21.15.59:0/4121327423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa28820 msgr2=0x55f66fa3a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1bcd39b700 1 --2- 172.21.15.59:0/4121327423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa28820 0x55f66fa3a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1bcd39b700 1 -- 172.21.15.59:0/4121327423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa336d0 msgr2=0x55f66fa23d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1bcd39b700 1 --2- 172.21.15.59:0/4121327423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa336d0 0x55f66fa23d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.180+0000 7f1bcd39b700 1 -- 172.21.15.59:0/4121327423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f66f78fce0 con 0x55f66fa27f00 2023-10-08T12:46:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.181+0000 7f1bcd39b700 1 --2- 172.21.15.59:0/4121327423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa27f00 0x55f66fa30320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4015000 tx=0x7f1bc400b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d955a6dda74ca92 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.181+0000 7f1bb3fff700 1 -- 172.21.15.59:0/4121327423 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc402a070 con 0x55f66fa27f00 2023-10-08T12:46:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.181+0000 7f1bb3fff700 1 -- 172.21.15.59:0/4121327423 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bc402e020 con 0x55f66fa27f00 2023-10-08T12:46:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.181+0000 7f1bb3fff700 1 -- 172.21.15.59:0/4121327423 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc401d040 con 0x55f66fa27f00 2023-10-08T12:46:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.182+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/4121327423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa27f00 msgr2=0x55f66fa30320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.182+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/4121327423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa27f00 0x55f66fa30320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4015000 tx=0x7f1bc400b260 comp rx=0 tx=0).stop 2023-10-08T12:46:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.182+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/4121327423 shutdown_connections 2023-10-08T12:46:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.182+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/4121327423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa27f00 0x55f66fa30320 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.182+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/4121327423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa336d0 0x55f66fa23d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.182+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/4121327423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa28820 0x55f66fa3a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.182+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/4121327423 >> 172.21.15.59:0/4121327423 conn(0x55f66f99d2e0 msgr2=0x55f66fa2fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.182+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/4121327423 shutdown_connections 2023-10-08T12:46:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.182+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/4121327423 wait complete. 2023-10-08T12:46:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.182+0000 7f1be2f8eb80 1 -- start start 2023-10-08T12:46:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.183+0000 7f1be2f8eb80 1 Processor -- start 2023-10-08T12:46:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.183+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa91420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.183+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa28820 0x55f66fa91960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.183+0000 7f1be2f8eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa336d0 0x55f66fa394f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.183+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66fa39c30 con 0x55f66fa28820 2023-10-08T12:46:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.183+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66fa39da0 con 0x55f66fa336d0 2023-10-08T12:46:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.183+0000 7f1be2f8eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66fa39f60 con 0x55f66fa27f00 2023-10-08T12:46:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.183+0000 7f1be2f8eb80 10 client.0 _ll_register_callbacks cb 0x7f1bb8005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bcd39b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa91420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bcd39b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa91420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51890/0 (socket says 172.21.15.59:51890) 2023-10-08T12:46:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bcd39b700 1 -- 172.21.15.59:0/633619760 learned_addr learned my addr 172.21.15.59:0/633619760 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bcdb9c700 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa336d0 0x55f66fa394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa28820 0x55f66fa91960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bcd39b700 1 -- 172.21.15.59:0/633619760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa336d0 msgr2=0x55f66fa394f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bcd39b700 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa336d0 0x55f66fa394f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bcd39b700 1 -- 172.21.15.59:0/633619760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa28820 msgr2=0x55f66fa91960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bcd39b700 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa28820 0x55f66fa91960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bcd39b700 1 -- 172.21.15.59:0/633619760 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc4005280 con 0x55f66fa27f00 2023-10-08T12:46:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bcd39b700 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa91420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40098e0 tx=0x7f1bc400f600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f35c906d36ad93eb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.184+0000 7f1bb0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:46:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.185+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/633619760 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc402a070 con 0x55f66fa27f00 2023-10-08T12:46:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.185+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/633619760 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1bc402f030 con 0x55f66fa27f00 2023-10-08T12:46:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.185+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/633619760 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1bb809ace0 con 0x55f66fa27f00 2023-10-08T12:46:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.185+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/633619760 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bc401d040 con 0x55f66fa27f00 2023-10-08T12:46:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.185+0000 7f1be2f8eb80 10 client.26239 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.185+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/633619760 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55f66f7cd2d0 con 0x55f66fa27f00 2023-10-08T12:46:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.185+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/633619760 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bb809ace0 con 0x55f66fa27f00 2023-10-08T12:46:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.186+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/633619760 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1bc4025400 con 0x55f66fa27f00 2023-10-08T12:46:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.186+0000 7f1be2f8eb80 10 client.26239 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.186+0000 7f1be2f8eb80 10 client.26239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.186+0000 7f1be2f8eb80 20 client.26239 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.186+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f66fa98ee0 0x55f66fa9b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.186+0000 7f1be2f8eb80 4 client.26239 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:46:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.186+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/633619760 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f66f974bb0 con 0x55f66fa98ee0 2023-10-08T12:46:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.186+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f66fa98ee0 0x55f66fa9b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.187+0000 7f1bb0ff9700 10 client.26239 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.187+0000 7f1bccb9a700 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f66fa98ee0 0x55f66fa9b300 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b9a8f8c1223c8ad server_cookie=5056d609a8a21440 in_seq=0 out_seq=0 2023-10-08T12:46:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1bb0ff9700 1 -- 172.21.15.59:0/633619760 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f66f974bb0 con 0x55f66fa98ee0 2023-10-08T12:46:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1bb0ff9700 10 client.26239 handle_command_reply: tid=0 2023-10-08T12:46:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 1 client.26239 shutdown 2023-10-08T12:46:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/633619760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 msgr2=0x55f66fa91420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa91420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40098e0 tx=0x7f1bc400f600 comp rx=0 tx=0).stop 2023-10-08T12:46:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/633619760 shutdown_connections 2023-10-08T12:46:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f66fa98ee0 0x55f66fa9b300 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f66fa336d0 0x55f66fa394f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f66fa27f00 0x55f66fa91420 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 1 --2- 172.21.15.59:0/633619760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f66fa28820 0x55f66fa91960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1bb0ff9700 0 client.26239 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/633619760 >> 172.21.15.59:0/633619760 conn(0x55f66f99d2e0 msgr2=0x55f66fa23cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/633619760 shutdown_connections 2023-10-08T12:46:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 1 -- 172.21.15.59:0/633619760 wait complete. 2023-10-08T12:46:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.190+0000 7f1be2f8eb80 20 client.26239 trim_cache size 0 max 16384 2023-10-08T12:46:50.194 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:46:50.194 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:46:50.194 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "f1d3fa55-028b-4b81-a0c5-59de07806cc9", 2023-10-08T12:46:50.194 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:46:50.194 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:46:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.191+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/3591247912 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bb40a1670 msgr2=0x7f1bb40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.191+0000 7f1bcf5ff700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bb40a1670 0x7f1bb40a3b30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009550 tx=0x7f1bc000b040 comp rx=0 tx=0).stop 2023-10-08T12:46:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.191+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/3591247912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8073540 msgr2=0x7f1bc81993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.191+0000 7f1bcf5ff700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8073540 0x7f1bc81993b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800eb30 tx=0x7f1bb800ee40 comp rx=0 tx=0).stop 2023-10-08T12:46:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.191+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/3591247912 shutdown_connections 2023-10-08T12:46:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.191+0000 7f1bcf5ff700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1bb40a1670 0x7f1bb40a3b30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.191+0000 7f1bcf5ff700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bc810cf70 0x7f1bc819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.191+0000 7f1bcf5ff700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc8072c20 0x7f1bc8198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.191+0000 7f1bcf5ff700 1 --2- 172.21.15.59:0/3591247912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8073540 0x7f1bc81993b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.191+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/3591247912 >> 172.21.15.59:0/3591247912 conn(0x7f1bc80fc200 msgr2=0x7f1bc80fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.191+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/3591247912 shutdown_connections 2023-10-08T12:46:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.192+0000 7f1bcf5ff700 1 -- 172.21.15.59:0/3591247912 wait complete. 2023-10-08T12:46:50.210 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:49 smithi059 ceph-mon[98489]: pgmap v483: 97 pgs: 97 active+clean; 371 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 230 op/s 2023-10-08T12:46:50.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:46:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:49 smithi173 ceph-mon[135182]: pgmap v483: 97 pgs: 97 active+clean; 371 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 230 op/s 2023-10-08T12:46:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:49 smithi092 ceph-mon[134093]: pgmap v483: 97 pgs: 97 active+clean; 371 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 230 op/s 2023-10-08T12:46:50.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.444+0000 7f725a9ff700 1 -- 172.21.15.59:0/645226811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f725410d190 msgr2=0x7f725410f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.444+0000 7f725a9ff700 1 --2- 172.21.15.59:0/645226811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f725410d190 0x7f725410f580 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f724c009f90 tx=0x7f724c00b330 comp rx=0 tx=0).stop 2023-10-08T12:46:50.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.444+0000 7f725a9ff700 1 -- 172.21.15.59:0/645226811 shutdown_connections 2023-10-08T12:46:50.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.444+0000 7f725a9ff700 1 --2- 172.21.15.59:0/645226811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f725410d190 0x7f725410f580 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.444+0000 7f725a9ff700 1 --2- 172.21.15.59:0/645226811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7254100150 0x7f7254100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.444+0000 7f725a9ff700 1 --2- 172.21.15.59:0/645226811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7254100a70 0x7f725410cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.444+0000 7f725a9ff700 1 -- 172.21.15.59:0/645226811 >> 172.21.15.59:0/645226811 conn(0x7f7254076780 msgr2=0x7f7254076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.444+0000 7f725a9ff700 1 -- 172.21.15.59:0/645226811 shutdown_connections 2023-10-08T12:46:50.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.444+0000 7f725a9ff700 1 -- 172.21.15.59:0/645226811 wait complete. 2023-10-08T12:46:50.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.446+0000 7f725a9ff700 1 Processor -- start 2023-10-08T12:46:50.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.446+0000 7f725a9ff700 1 -- start start 2023-10-08T12:46:50.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.446+0000 7f725a9ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7254100150 0x7f7254198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f725a9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7254100a70 0x7f7254199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f725a9ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f725410d190 0x7f725419d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f725a9ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725419df00 con 0x7f7254100150 2023-10-08T12:46:50.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f725a9ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725419e070 con 0x7f725410d190 2023-10-08T12:46:50.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f725a9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725419e230 con 0x7f7254100a70 2023-10-08T12:46:50.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f7258f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f725410d190 0x7f725419d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f72537fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7254100a70 0x7f7254199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f72537fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7254100a70 0x7f7254199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51914/0 (socket says 172.21.15.59:51914) 2023-10-08T12:46:50.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f7258f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f725410d190 0x7f725419d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50740/0 (socket says 172.21.15.59:50740) 2023-10-08T12:46:50.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f72537fe700 1 -- 172.21.15.59:0/3514361716 learned_addr learned my addr 172.21.15.59:0/3514361716 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:50.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f7253fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7254100150 0x7f7254198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f7258f9c700 1 -- 172.21.15.59:0/3514361716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7254100a70 msgr2=0x7f7254199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f7258f9c700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7254100a70 0x7f7254199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f7258f9c700 1 -- 172.21.15.59:0/3514361716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7254100150 msgr2=0x7f7254198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f7258f9c700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7254100150 0x7f7254198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f7258f9c700 1 -- 172.21.15.59:0/3514361716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7244009520 con 0x7f725410d190 2023-10-08T12:46:50.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.447+0000 7f7253fff700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7254100150 0x7f7254198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:50.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.448+0000 7f7258f9c700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f725410d190 0x7f725419d8c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f724c00b6c0 tx=0x7f724c0094b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.448+0000 7f72517fa700 1 -- 172.21.15.59:0/3514361716 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c00e040 con 0x7f725410d190 2023-10-08T12:46:50.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.448+0000 7f72517fa700 1 -- 172.21.15.59:0/3514361716 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f724c007e10 con 0x7f725410d190 2023-10-08T12:46:50.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.448+0000 7f725a9ff700 1 -- 172.21.15.59:0/3514361716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724c009c40 con 0x7f725410d190 2023-10-08T12:46:50.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.448+0000 7f72517fa700 1 -- 172.21.15.59:0/3514361716 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c005040 con 0x7f725410d190 2023-10-08T12:46:50.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.448+0000 7f725a9ff700 1 -- 172.21.15.59:0/3514361716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72541a5b70 con 0x7f725410d190 2023-10-08T12:46:50.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.451+0000 7f72517fa700 1 -- 172.21.15.59:0/3514361716 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f724c01b450 con 0x7f725410d190 2023-10-08T12:46:50.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.453+0000 7f726e2e6b80 1 Processor -- start 2023-10-08T12:46:50.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.453+0000 7f726e2e6b80 1 -- start start 2023-10-08T12:46:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.453+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d199e80 0x55c21d19a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1a5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d1a5650 0x55c21d1a7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21d103460 con 0x55c21d199e80 2023-10-08T12:46:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21d0f4c20 con 0x55c21d19a7a0 2023-10-08T12:46:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21d0f2540 con 0x55c21d1a5650 2023-10-08T12:46:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f7253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f7253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1a5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50742/0 (socket says 172.21.15.59:50742) 2023-10-08T12:46:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f7253fff700 1 -- 172.21.15.59:0/3060661781 learned_addr learned my addr 172.21.15.59:0/3060661781 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f72537fe700 1 --2- 172.21.15.59:0/3060661781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d199e80 0x55c21d19a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f72517fa700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f723c0a15f0 0x7f723c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f7253fff700 1 -- 172.21.15.59:0/3060661781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d1a5650 msgr2=0x55c21d1a7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f7253fff700 1 --2- 172.21.15.59:0/3060661781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d1a5650 0x55c21d1a7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f7253fff700 1 -- 172.21.15.59:0/3060661781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d199e80 msgr2=0x55c21d19a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f7253fff700 1 --2- 172.21.15.59:0/3060661781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d199e80 0x55c21d19a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f7253fff700 1 -- 172.21.15.59:0/3060661781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c21cf18de0 con 0x55c21d19a7a0 2023-10-08T12:46:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f72537fe700 1 --2- 172.21.15.59:0/3060661781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d199e80 0x55c21d19a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f72517fa700 1 -- 172.21.15.59:0/3514361716 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f724c0ce310 con 0x7f725410d190 2023-10-08T12:46:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.454+0000 7f7258f9c700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f723c0a15f0 0x7f723c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.455+0000 7f7253fff700 1 --2- 172.21.15.59:0/3060661781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1a5110 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7244009fa0 tx=0x7f72440116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddb293b9f73a55a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.455+0000 7f723a7fc700 1 -- 172.21.15.59:0/3060661781 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724401b470 con 0x55c21d19a7a0 2023-10-08T12:46:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.455+0000 7f723a7fc700 1 -- 172.21.15.59:0/3060661781 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f724401ba90 con 0x55c21d19a7a0 2023-10-08T12:46:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.455+0000 7f723a7fc700 1 -- 172.21.15.59:0/3060661781 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244012b60 con 0x55c21d19a7a0 2023-10-08T12:46:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.456+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3060661781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 msgr2=0x55c21d1a5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.456+0000 7f7258f9c700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f723c0a15f0 0x7f723c0a3ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f724c09b0a0 tx=0x7f724c009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.456+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/3060661781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1a5110 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7244009fa0 tx=0x7f72440116c0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.456+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3060661781 shutdown_connections 2023-10-08T12:46:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.456+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/3060661781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d1a5650 0x55c21d1a7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.456+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/3060661781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d199e80 0x55c21d19a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.456+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/3060661781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1a5110 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.456+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3060661781 >> 172.21.15.59:0/3060661781 conn(0x55c21d10f260 msgr2=0x55c21d1962d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.456+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3060661781 shutdown_connections 2023-10-08T12:46:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.456+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3060661781 wait complete. 2023-10-08T12:46:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.457+0000 7f726e2e6b80 1 -- start start 2023-10-08T12:46:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.457+0000 7f726e2e6b80 1 Processor -- start 2023-10-08T12:46:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d199e80 0x55c21d1a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d1a5650 0x55c21d1a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21d0ede30 con 0x55c21d19a7a0 2023-10-08T12:46:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21d08a710 con 0x55c21d199e80 2023-10-08T12:46:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21d08a3b0 con 0x55c21d1a5650 2023-10-08T12:46:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f726e2e6b80 10 client.0 _ll_register_callbacks cb 0x55c21cee7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f7253fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f72537fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d199e80 0x55c21d1a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f7253fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1a2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41886/0 (socket says 172.21.15.59:41886) 2023-10-08T12:46:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f7253fff700 1 -- 172.21.15.59:0/834742592 learned_addr learned my addr 172.21.15.59:0/834742592 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.458+0000 7f72537fe700 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d1a5650 0x55c21d1a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f72537fe700 1 -- 172.21.15.59:0/834742592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d1a5650 msgr2=0x55c21d1a2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f72537fe700 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d1a5650 0x55c21d1a2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f72537fe700 1 -- 172.21.15.59:0/834742592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 msgr2=0x55c21d1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f72537fe700 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1a2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f72537fe700 1 -- 172.21.15.59:0/834742592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7244009ba0 con 0x55c21d199e80 2023-10-08T12:46:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f7253fff700 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1a2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f72537fe700 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d199e80 0x55c21d1a24e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f725419a530 tx=0x7f7248009880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d87dacc4e3ca707 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f72337fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f72337fe700 1 -- 172.21.15.59:0/834742592 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248009e70 con 0x55c21d199e80 2023-10-08T12:46:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f726e2e6b80 1 -- 172.21.15.59:0/834742592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c21d0b5eb0 con 0x55c21d199e80 2023-10-08T12:46:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f72337fe700 1 -- 172.21.15.59:0/834742592 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7248004050 con 0x55c21d199e80 2023-10-08T12:46:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f72337fe700 1 -- 172.21.15.59:0/834742592 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7248004210 con 0x55c21d199e80 2023-10-08T12:46:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f726e2e6b80 10 client.26255 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f726e2e6b80 1 -- 172.21.15.59:0/834742592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c21cf01c60 con 0x55c21d199e80 2023-10-08T12:46:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.459+0000 7f72337fe700 1 -- 172.21.15.59:0/834742592 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c21d0b5eb0 con 0x55c21d199e80 2023-10-08T12:46:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.460+0000 7f72337fe700 1 -- 172.21.15.59:0/834742592 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f724800e440 con 0x55c21d199e80 2023-10-08T12:46:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.460+0000 7f726e2e6b80 10 client.26255 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.460+0000 7f726e2e6b80 10 client.26255 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.460+0000 7f726e2e6b80 20 client.26255 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.460+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c21d1b5240 0x55c21d1b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.460+0000 7f726e2e6b80 4 client.26255 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.460+0000 7f726e2e6b80 1 -- 172.21.15.59:0/834742592 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c21d0e6e10 con 0x55c21d1b5240 2023-10-08T12:46:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.460+0000 7f7253fff700 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c21d1b5240 0x55c21d1b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.460+0000 7f7253fff700 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c21d1b5240 0x55c21d1b7660 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28bbfc90f895e1ff server_cookie=501bc0765b839e86 in_seq=0 out_seq=0 2023-10-08T12:46:50.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.460+0000 7f72337fe700 10 client.26255 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:50.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f72337fe700 1 -- 172.21.15.59:0/834742592 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c21d0e6e10 con 0x55c21d1b5240 2023-10-08T12:46:50.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f72337fe700 10 client.26255 handle_command_reply: tid=0 2023-10-08T12:46:50.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 1 client.26255 shutdown 2023-10-08T12:46:50.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 1 -- 172.21.15.59:0/834742592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d199e80 msgr2=0x55c21d1a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d199e80 0x55c21d1a24e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f725419a530 tx=0x7f7248009880 comp rx=0 tx=0).stop 2023-10-08T12:46:50.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 1 -- 172.21.15.59:0/834742592 shutdown_connections 2023-10-08T12:46:50.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c21d1b5240 0x55c21d1b7660 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d199e80 0x55c21d1a24e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d1a5650 0x55c21d1a2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f72337fe700 0 client.26255 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:50.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/834742592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1a2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 1 -- 172.21.15.59:0/834742592 >> 172.21.15.59:0/834742592 conn(0x55c21d10f260 msgr2=0x55c21d195ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 1 -- 172.21.15.59:0/834742592 shutdown_connections 2023-10-08T12:46:50.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 1 -- 172.21.15.59:0/834742592 wait complete. 2023-10-08T12:46:50.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.462+0000 7f726e2e6b80 20 client.26255 trim_cache size 0 max 16384 2023-10-08T12:46:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.481+0000 7f726e2e6b80 1 Processor -- start 2023-10-08T12:46:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.481+0000 7f726e2e6b80 1 -- start start 2023-10-08T12:46:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.481+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d199e80 0x55c21d1b7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.481+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1ac190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.481+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d1a5650 0x55c21d19d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.481+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21cf6e920 con 0x55c21d19a7a0 2023-10-08T12:46:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.481+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21d19cd50 con 0x55c21d1a5650 2023-10-08T12:46:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.481+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21d1905a0 con 0x55c21d199e80 2023-10-08T12:46:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.482+0000 7f7253fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.482+0000 7f72537fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d199e80 0x55c21d1b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.482+0000 7f7253fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1ac190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41902/0 (socket says 172.21.15.59:41902) 2023-10-08T12:46:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.482+0000 7f7253fff700 1 -- 172.21.15.59:0/2619716917 learned_addr learned my addr 172.21.15.59:0/2619716917 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.482+0000 7f72537fe700 1 --2- 172.21.15.59:0/2619716917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d1a5650 0x55c21d19d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.482+0000 7f7253fff700 1 -- 172.21.15.59:0/2619716917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d199e80 msgr2=0x55c21d1b7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.482+0000 7f7253fff700 1 --2- 172.21.15.59:0/2619716917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d199e80 0x55c21d1b7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.482+0000 7f7253fff700 1 -- 172.21.15.59:0/2619716917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d1a5650 msgr2=0x55c21d19d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.482+0000 7f7253fff700 1 --2- 172.21.15.59:0/2619716917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d1a5650 0x55c21d19d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.482+0000 7f7253fff700 1 -- 172.21.15.59:0/2619716917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c21cf3f250 con 0x55c21d19a7a0 2023-10-08T12:46:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.482+0000 7f7253fff700 1 --2- 172.21.15.59:0/2619716917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1ac190 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f72440126a0 tx=0x7f7244012700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421836f17f1ec0b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f723affd700 1 -- 172.21.15.59:0/2619716917 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244020040 con 0x55c21d19a7a0 2023-10-08T12:46:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f723affd700 1 -- 172.21.15.59:0/2619716917 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f724402e070 con 0x55c21d19a7a0 2023-10-08T12:46:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f723affd700 1 -- 172.21.15.59:0/2619716917 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244004480 con 0x55c21d19a7a0 2023-10-08T12:46:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f726e2e6b80 1 -- 172.21.15.59:0/2619716917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 msgr2=0x55c21d1ac190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/2619716917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1ac190 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f72440126a0 tx=0x7f7244012700 comp rx=0 tx=0).stop 2023-10-08T12:46:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f726e2e6b80 1 -- 172.21.15.59:0/2619716917 shutdown_connections 2023-10-08T12:46:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/2619716917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d1a5650 0x55c21d19d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/2619716917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d199e80 0x55c21d1b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/2619716917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d19a7a0 0x55c21d1ac190 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f726e2e6b80 1 -- 172.21.15.59:0/2619716917 >> 172.21.15.59:0/2619716917 conn(0x55c21d10f260 msgr2=0x55c21d1a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f726e2e6b80 1 -- 172.21.15.59:0/2619716917 shutdown_connections 2023-10-08T12:46:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.483+0000 7f726e2e6b80 1 -- 172.21.15.59:0/2619716917 wait complete. 2023-10-08T12:46:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.484+0000 7f726e2e6b80 1 -- start start 2023-10-08T12:46:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.484+0000 7f726e2e6b80 1 Processor -- start 2023-10-08T12:46:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d199e80 0x55c21d1aba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1abf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f726e2e6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d1a5650 0x55c21d1a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21d1aa610 con 0x55c21d1a5650 2023-10-08T12:46:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21d1aa780 con 0x55c21d19a7a0 2023-10-08T12:46:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f726e2e6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21d1aa940 con 0x55c21d199e80 2023-10-08T12:46:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f726e2e6b80 10 client.0 _ll_register_callbacks cb 0x55c21cee7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f7253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f7253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1abf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50770/0 (socket says 172.21.15.59:50770) 2023-10-08T12:46:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f7253fff700 1 -- 172.21.15.59:0/3168422257 learned_addr learned my addr 172.21.15.59:0/3168422257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:46:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f72537fe700 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d199e80 0x55c21d1aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f72537fe700 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d1a5650 0x55c21d1a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f7253fff700 1 -- 172.21.15.59:0/3168422257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d199e80 msgr2=0x55c21d1aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f7253fff700 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d199e80 0x55c21d1aba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f7253fff700 1 -- 172.21.15.59:0/3168422257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d1a5650 msgr2=0x55c21d1a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f7253fff700 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d1a5650 0x55c21d1a9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f7253fff700 1 -- 172.21.15.59:0/3168422257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c21cf18de0 con 0x55c21d19a7a0 2023-10-08T12:46:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.485+0000 7f72537fe700 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d1a5650 0x55c21d1a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.486+0000 7f7253fff700 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1abf70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f72440059a0 tx=0x7f7244009f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a469898e07e822e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.486+0000 7f72337fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:46:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.486+0000 7f72337fe700 1 -- 172.21.15.59:0/3168422257 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724402aa00 con 0x55c21d19a7a0 2023-10-08T12:46:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.486+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3168422257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f724401ba90 con 0x55c21d19a7a0 2023-10-08T12:46:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.486+0000 7f72337fe700 1 -- 172.21.15.59:0/3168422257 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f724402ab60 con 0x55c21d19a7a0 2023-10-08T12:46:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.486+0000 7f72337fe700 1 -- 172.21.15.59:0/3168422257 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f724402ad20 con 0x55c21d19a7a0 2023-10-08T12:46:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.486+0000 7f726e2e6b80 10 client.26261 fetch_fsmap learned FSMap version 20 2023-10-08T12:46:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.486+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3168422257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c21cf172b0 con 0x55c21d19a7a0 2023-10-08T12:46:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.487+0000 7f72337fe700 1 -- 172.21.15.59:0/3168422257 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f724401ba90 con 0x55c21d19a7a0 2023-10-08T12:46:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.487+0000 7f72337fe700 1 -- 172.21.15.59:0/3168422257 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7244012770 con 0x55c21d19a7a0 2023-10-08T12:46:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.487+0000 7f726e2e6b80 10 client.26261 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:46:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.487+0000 7f726e2e6b80 10 client.26261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.487+0000 7f726e2e6b80 20 client.26261 populate_metadata read hostname 'smithi059' 2023-10-08T12:46:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.487+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c21d209f30 0x55c21d20c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.487+0000 7f726e2e6b80 4 client.26261 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:46:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.487+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3168422257 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c21d0e6b30 con 0x55c21d209f30 2023-10-08T12:46:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.487+0000 7f72537fe700 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c21d209f30 0x55c21d20c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.488+0000 7f72537fe700 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c21d209f30 0x55c21d20c350 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a05718286a8c2538 server_cookie=cf82605332fdb655 in_seq=0 out_seq=0 2023-10-08T12:46:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.488+0000 7f72337fe700 10 client.26261 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f72337fe700 1 -- 172.21.15.59:0/3168422257 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c21d0e6b30 con 0x55c21d209f30 2023-10-08T12:46:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f72337fe700 10 client.26261 handle_command_reply: tid=0 2023-10-08T12:46:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 1 client.26261 shutdown 2023-10-08T12:46:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3168422257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 msgr2=0x55c21d1abf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1abf70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f72440059a0 tx=0x7f7244009f00 comp rx=0 tx=0).stop 2023-10-08T12:46:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3168422257 shutdown_connections 2023-10-08T12:46:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c21d209f30 0x55c21d20c350 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c21d1a5650 0x55c21d1a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c21d199e80 0x55c21d1aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 1 --2- 172.21.15.59:0/3168422257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c21d19a7a0 0x55c21d1abf70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f72337fe700 0 client.26261 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:46:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3168422257 >> 172.21.15.59:0/3168422257 conn(0x55c21d10f260 msgr2=0x55c21d1a3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3168422257 shutdown_connections 2023-10-08T12:46:50.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 1 -- 172.21.15.59:0/3168422257 wait complete. 2023-10-08T12:46:50.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.489+0000 7f726e2e6b80 20 client.26261 trim_cache size 0 max 16384 2023-10-08T12:46:50.495 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:46:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:46:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:46:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "f1d3fa55-028b-4b81-a0c5-59de07806cc9": { 2023-10-08T12:46:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:46:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "f1d3fa55-028b-4b81-a0c5-59de07806cc9", 2023-10-08T12:46:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:46:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:46:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:46:50.496 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:46:50.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 -- 172.21.15.59:0/3514361716 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f723c0a15f0 msgr2=0x7f723c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f723c0a15f0 0x7f723c0a3ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f724c09b0a0 tx=0x7f724c009040 comp rx=0 tx=0).stop 2023-10-08T12:46:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 -- 172.21.15.59:0/3514361716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f725410d190 msgr2=0x7f725419d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f725410d190 0x7f725419d8c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f724c00b6c0 tx=0x7f724c0094b0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 -- 172.21.15.59:0/3514361716 shutdown_connections 2023-10-08T12:46:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f723c0a15f0 0x7f723c0a3ab0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f725410d190 0x7f725419d8c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7254100150 0x7f7254198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 --2- 172.21.15.59:0/3514361716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7254100a70 0x7f7254199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 -- 172.21.15.59:0/3514361716 >> 172.21.15.59:0/3514361716 conn(0x7f7254076780 msgr2=0x7f725410e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 -- 172.21.15.59:0/3514361716 shutdown_connections 2023-10-08T12:46:50.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:46:50.490+0000 7f725a9ff700 1 -- 172.21.15.59:0/3514361716 wait complete. 2023-10-08T12:46:50.509 INFO:tasks.cephfs.filesystem:scrub status for tag:f1d3fa55-028b-4b81-a0c5-59de07806cc9 - {'path': '/', 'tag': 'f1d3fa55-028b-4b81-a0c5-59de07806cc9', 'options': 'recursive,force'} 2023-10-08T12:46:50.513 INFO:tasks.workunit.client.0.smithi059.stdout: 1 678862 13.71 MB/sec execute 141 sec latency 19.897 ms 2023-10-08T12:46:51.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:50 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:46:51.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:50 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:51.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:50 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:46:51.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:50 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:51.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:50 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:46:51.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:50 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:51.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:50 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:46:51.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:50 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:51.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:50 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:46:51.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:50 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:51.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:50 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:46:51.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:50 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:46:51.514 INFO:tasks.workunit.client.0.smithi059.stdout: 1 681645 13.72 MB/sec execute 142 sec latency 64.222 ms 2023-10-08T12:46:52.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:51 smithi173 ceph-mon[135182]: pgmap v484: 97 pgs: 97 active+clean; 375 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 264 op/s 2023-10-08T12:46:52.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:51 smithi059 ceph-mon[98489]: pgmap v484: 97 pgs: 97 active+clean; 375 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 264 op/s 2023-10-08T12:46:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:51 smithi092 ceph-mon[134093]: pgmap v484: 97 pgs: 97 active+clean; 375 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 264 op/s 2023-10-08T12:46:52.514 INFO:tasks.workunit.client.0.smithi059.stdout: 1 684204 13.70 MB/sec execute 143 sec latency 23.961 ms 2023-10-08T12:46:53.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:52 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:46:53.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:52 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:46:53.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:52 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:46:53.514 INFO:tasks.workunit.client.0.smithi059.stdout: 1 686578 13.71 MB/sec execute 144 sec latency 6.663 ms 2023-10-08T12:46:54.384 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:53 smithi092 ceph-mon[134093]: pgmap v485: 97 pgs: 97 active+clean; 378 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 240 op/s 2023-10-08T12:46:54.384 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:53 smithi059 ceph-mon[98489]: pgmap v485: 97 pgs: 97 active+clean; 378 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 240 op/s 2023-10-08T12:46:54.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:53 smithi173 ceph-mon[135182]: pgmap v485: 97 pgs: 97 active+clean; 378 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 240 op/s 2023-10-08T12:46:54.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 689285 13.73 MB/sec execute 145 sec latency 91.968 ms 2023-10-08T12:46:55.514 INFO:tasks.workunit.client.0.smithi059.stdout: 1 691916 13.72 MB/sec execute 146 sec latency 23.204 ms 2023-10-08T12:46:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:55 smithi059 ceph-mon[98489]: pgmap v486: 97 pgs: 97 active+clean; 380 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 226 op/s 2023-10-08T12:46:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:55 smithi092 ceph-mon[134093]: pgmap v486: 97 pgs: 97 active+clean; 380 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 226 op/s 2023-10-08T12:46:56.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:55 smithi173 ceph-mon[135182]: pgmap v486: 97 pgs: 97 active+clean; 380 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 226 op/s 2023-10-08T12:46:56.514 INFO:tasks.workunit.client.0.smithi059.stdout: 1 693916 13.71 MB/sec execute 147 sec latency 50.157 ms 2023-10-08T12:46:57.514 INFO:tasks.workunit.client.0.smithi059.stdout: 1 696598 13.71 MB/sec execute 148 sec latency 30.817 ms 2023-10-08T12:46:58.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:57 smithi059 ceph-mon[98489]: pgmap v487: 97 pgs: 97 active+clean; 384 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2023-10-08T12:46:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:57 smithi092 ceph-mon[134093]: pgmap v487: 97 pgs: 97 active+clean; 384 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2023-10-08T12:46:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:57 smithi173 ceph-mon[135182]: pgmap v487: 97 pgs: 97 active+clean; 384 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2023-10-08T12:46:58.514 INFO:tasks.workunit.client.0.smithi059.stdout: 1 699796 13.75 MB/sec execute 149 sec latency 8.848 ms 2023-10-08T12:46:59.514 INFO:tasks.workunit.client.0.smithi059.stdout: 1 702025 13.70 MB/sec execute 150 sec latency 82.500 ms 2023-10-08T12:47:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:46:59 smithi092 ceph-mon[134093]: pgmap v488: 97 pgs: 97 active+clean; 388 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2023-10-08T12:47:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:46:59 smithi173 ceph-mon[135182]: pgmap v488: 97 pgs: 97 active+clean; 388 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2023-10-08T12:47:00.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:46:59 smithi059 ceph-mon[98489]: pgmap v488: 97 pgs: 97 active+clean; 388 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2023-10-08T12:47:00.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 704238 13.71 MB/sec execute 151 sec latency 28.019 ms 2023-10-08T12:47:01.514 INFO:tasks.workunit.client.0.smithi059.stdout: 1 706627 13.72 MB/sec execute 152 sec latency 23.281 ms 2023-10-08T12:47:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:01 smithi173 ceph-mon[135182]: pgmap v489: 97 pgs: 97 active+clean; 388 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2023-10-08T12:47:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:01 smithi059 ceph-mon[98489]: pgmap v489: 97 pgs: 97 active+clean; 388 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2023-10-08T12:47:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:01 smithi092 ceph-mon[134093]: pgmap v489: 97 pgs: 97 active+clean; 388 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2023-10-08T12:47:02.514 INFO:tasks.workunit.client.0.smithi059.stdout: 1 708108 13.67 MB/sec execute 153 sec latency 88.080 ms 2023-10-08T12:47:03.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 710803 13.67 MB/sec execute 154 sec latency 10.457 ms 2023-10-08T12:47:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:03 smithi173 ceph-mon[135182]: pgmap v490: 97 pgs: 97 active+clean; 400 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 308 op/s 2023-10-08T12:47:04.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:03 smithi059 ceph-mon[98489]: pgmap v490: 97 pgs: 97 active+clean; 400 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 308 op/s 2023-10-08T12:47:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:03 smithi092 ceph-mon[134093]: pgmap v490: 97 pgs: 97 active+clean; 400 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 308 op/s 2023-10-08T12:47:04.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 713938 13.70 MB/sec execute 155 sec latency 9.791 ms 2023-10-08T12:47:05.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 716324 13.67 MB/sec execute 156 sec latency 7.480 ms 2023-10-08T12:47:06.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:05 smithi173 ceph-mon[135182]: pgmap v491: 97 pgs: 97 active+clean; 400 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 289 op/s 2023-10-08T12:47:06.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:05 smithi059 ceph-mon[98489]: pgmap v491: 97 pgs: 97 active+clean; 400 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 289 op/s 2023-10-08T12:47:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:05 smithi092 ceph-mon[134093]: pgmap v491: 97 pgs: 97 active+clean; 400 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 289 op/s 2023-10-08T12:47:06.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 718832 13.69 MB/sec execute 157 sec latency 8.384 ms 2023-10-08T12:47:07.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 721266 13.69 MB/sec execute 158 sec latency 93.221 ms 2023-10-08T12:47:08.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:07 smithi173 ceph-mon[135182]: pgmap v492: 97 pgs: 97 active+clean; 401 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 290 op/s 2023-10-08T12:47:08.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:07 smithi059 ceph-mon[98489]: pgmap v492: 97 pgs: 97 active+clean; 401 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 290 op/s 2023-10-08T12:47:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:07 smithi092 ceph-mon[134093]: pgmap v492: 97 pgs: 97 active+clean; 401 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 290 op/s 2023-10-08T12:47:08.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 724226 13.70 MB/sec execute 159 sec latency 30.474 ms 2023-10-08T12:47:09.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 726895 13.69 MB/sec execute 160 sec latency 7.145 ms 2023-10-08T12:47:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:09 smithi092 ceph-mon[134093]: pgmap v493: 97 pgs: 97 active+clean; 409 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 282 op/s 2023-10-08T12:47:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:09 smithi173 ceph-mon[135182]: pgmap v493: 97 pgs: 97 active+clean; 409 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 282 op/s 2023-10-08T12:47:10.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:09 smithi059 ceph-mon[98489]: pgmap v493: 97 pgs: 97 active+clean; 409 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 282 op/s 2023-10-08T12:47:10.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 729197 13.69 MB/sec execute 161 sec latency 16.517 ms 2023-10-08T12:47:11.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 731695 13.70 MB/sec execute 162 sec latency 198.628 ms 2023-10-08T12:47:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:11 smithi173 ceph-mon[135182]: pgmap v494: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 291 op/s 2023-10-08T12:47:12.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:11 smithi059 ceph-mon[98489]: pgmap v494: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 291 op/s 2023-10-08T12:47:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:11 smithi092 ceph-mon[134093]: pgmap v494: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 291 op/s 2023-10-08T12:47:12.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 733824 13.66 MB/sec execute 163 sec latency 68.927 ms 2023-10-08T12:47:13.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 735818 13.66 MB/sec execute 164 sec latency 24.350 ms 2023-10-08T12:47:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:13 smithi173 ceph-mon[135182]: pgmap v495: 97 pgs: 97 active+clean; 421 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 344 op/s 2023-10-08T12:47:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:13 smithi059 ceph-mon[98489]: pgmap v495: 97 pgs: 97 active+clean; 421 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 344 op/s 2023-10-08T12:47:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:13 smithi092 ceph-mon[134093]: pgmap v495: 97 pgs: 97 active+clean; 421 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 344 op/s 2023-10-08T12:47:14.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 738870 13.69 MB/sec execute 165 sec latency 10.292 ms 2023-10-08T12:47:15.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 741343 13.67 MB/sec execute 166 sec latency 86.556 ms 2023-10-08T12:47:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:15 smithi173 ceph-mon[135182]: pgmap v496: 97 pgs: 97 active+clean; 421 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 235 op/s 2023-10-08T12:47:16.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:15 smithi059 ceph-mon[98489]: pgmap v496: 97 pgs: 97 active+clean; 421 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 235 op/s 2023-10-08T12:47:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:15 smithi092 ceph-mon[134093]: pgmap v496: 97 pgs: 97 active+clean; 421 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 235 op/s 2023-10-08T12:47:16.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 743107 13.65 MB/sec execute 167 sec latency 77.243 ms 2023-10-08T12:47:17.515 INFO:tasks.workunit.client.0.smithi059.stdout: 1 745781 13.66 MB/sec execute 168 sec latency 110.711 ms 2023-10-08T12:47:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:17 smithi173 ceph-mon[135182]: pgmap v497: 97 pgs: 97 active+clean; 415 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 268 op/s 2023-10-08T12:47:18.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:17 smithi059 ceph-mon[98489]: pgmap v497: 97 pgs: 97 active+clean; 415 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 268 op/s 2023-10-08T12:47:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:17 smithi092 ceph-mon[134093]: pgmap v497: 97 pgs: 97 active+clean; 415 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 268 op/s 2023-10-08T12:47:18.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 748085 13.63 MB/sec execute 169 sec latency 26.392 ms 2023-10-08T12:47:19.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 750403 13.64 MB/sec execute 170 sec latency 15.553 ms 2023-10-08T12:47:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:19 smithi092 ceph-mon[134093]: pgmap v498: 97 pgs: 97 active+clean; 401 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 286 op/s 2023-10-08T12:47:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:19 smithi173 ceph-mon[135182]: pgmap v498: 97 pgs: 97 active+clean; 401 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 286 op/s 2023-10-08T12:47:20.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:19 smithi059 ceph-mon[98489]: pgmap v498: 97 pgs: 97 active+clean; 401 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 286 op/s 2023-10-08T12:47:20.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:47:20.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 753238 13.66 MB/sec execute 171 sec latency 13.959 ms 2023-10-08T12:47:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.740+0000 7f1ad71ff700 1 -- 172.21.15.59:0/1306579337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad0105b80 msgr2=0x7f1ad010d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.740+0000 7f1ad71ff700 1 --2- 172.21.15.59:0/1306579337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad0105b80 0x7f1ad010d590 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009f90 tx=0x7f1ac800b330 comp rx=0 tx=0).stop 2023-10-08T12:47:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.741+0000 7f1ad71ff700 1 -- 172.21.15.59:0/1306579337 shutdown_connections 2023-10-08T12:47:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.741+0000 7f1ad71ff700 1 --2- 172.21.15.59:0/1306579337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad0105b80 0x7f1ad010d590 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.741+0000 7f1ad71ff700 1 --2- 172.21.15.59:0/1306579337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad0067ce0 0x7f1ad00680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.741+0000 7f1ad71ff700 1 --2- 172.21.15.59:0/1306579337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad01051c0 0x7f1ad0105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.741+0000 7f1ad71ff700 1 -- 172.21.15.59:0/1306579337 >> 172.21.15.59:0/1306579337 conn(0x7f1ad0076780 msgr2=0x7f1ad0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:20.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.741+0000 7f1ad71ff700 1 -- 172.21.15.59:0/1306579337 shutdown_connections 2023-10-08T12:47:20.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.741+0000 7f1ad71ff700 1 -- 172.21.15.59:0/1306579337 wait complete. 2023-10-08T12:47:20.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.742+0000 7f1ad71ff700 1 Processor -- start 2023-10-08T12:47:20.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.742+0000 7f1ad71ff700 1 -- start start 2023-10-08T12:47:20.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.742+0000 7f1ad71ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad0067ce0 0x7f1ad00ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.742+0000 7f1ad71ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad01051c0 0x7f1ad00ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.742+0000 7f1ad71ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad0105b80 0x7f1ad0100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.742+0000 7f1ad71ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad01a50f0 con 0x7f1ad0067ce0 2023-10-08T12:47:20.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.742+0000 7f1ad71ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad01a5260 con 0x7f1ad0105b80 2023-10-08T12:47:20.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.742+0000 7f1ad71ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad01a5420 con 0x7f1ad01051c0 2023-10-08T12:47:20.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1ad579c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad0105b80 0x7f1ad0100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1ad579c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad0105b80 0x7f1ad0100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38666/0 (socket says 172.21.15.59:38666) 2023-10-08T12:47:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1ad579c700 1 -- 172.21.15.59:0/325671434 learned_addr learned my addr 172.21.15.59:0/325671434 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1ad4f9b700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad0067ce0 0x7f1ad00ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1acffff700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad01051c0 0x7f1ad00ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1ad579c700 1 -- 172.21.15.59:0/325671434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad01051c0 msgr2=0x7f1ad00ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1ad579c700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad01051c0 0x7f1ad00ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1ad579c700 1 -- 172.21.15.59:0/325671434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad0067ce0 msgr2=0x7f1ad00ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1ad579c700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad0067ce0 0x7f1ad00ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1ad579c700 1 -- 172.21.15.59:0/325671434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac40095f0 con 0x7f1ad0105b80 2023-10-08T12:47:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1acffff700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad01051c0 0x7f1ad00ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:47:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1ad579c700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad0105b80 0x7f1ad0100130 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8004fd0 tx=0x7f1ac8009470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:20.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1acdffb700 1 -- 172.21.15.59:0/325671434 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800e040 con 0x7f1ad0105b80 2023-10-08T12:47:20.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1ad71ff700 1 -- 172.21.15.59:0/325671434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac8009c40 con 0x7f1ad0105b80 2023-10-08T12:47:20.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.743+0000 7f1acdffb700 1 -- 172.21.15.59:0/325671434 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ac8007e70 con 0x7f1ad0105b80 2023-10-08T12:47:20.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.744+0000 7f1acdffb700 1 -- 172.21.15.59:0/325671434 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8005040 con 0x7f1ad0105b80 2023-10-08T12:47:20.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.744+0000 7f1ad71ff700 1 -- 172.21.15.59:0/325671434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad01a5990 con 0x7f1ad0105b80 2023-10-08T12:47:20.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.749+0000 7f1acdffb700 1 -- 172.21.15.59:0/325671434 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1ac801b450 con 0x7f1ad0105b80 2023-10-08T12:47:20.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.750+0000 7f1aeab65b80 1 Processor -- start 2023-10-08T12:47:20.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.750+0000 7f1aeab65b80 1 -- start start 2023-10-08T12:47:20.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.750+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b3f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.750+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b4a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.750+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b4ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.750+0000 7f1acdffb700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ac00a15f0 0x7f1ac00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.750+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5aa8460 con 0x55e2a5b4a650 2023-10-08T12:47:20.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.750+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5a99c20 con 0x55e2a5b3ee80 2023-10-08T12:47:20.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.750+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5a97540 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.750+0000 7f1acffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b3f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.750+0000 7f1acffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b3f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38672/0 (socket says 172.21.15.59:38672) 2023-10-08T12:47:20.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.751+0000 7f1acffff700 1 -- 172.21.15.59:0/2468074772 learned_addr learned my addr 172.21.15.59:0/2468074772 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:20.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.751+0000 7f1acdffb700 1 -- 172.21.15.59:0/325671434 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1ac80ce420 con 0x7f1ad0105b80 2023-10-08T12:47:20.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.751+0000 7f1acffff700 1 --2- 172.21.15.59:0/2468074772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b4ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.751+0000 7f1ad4f9b700 1 --2- 172.21.15.59:0/2468074772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b4a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.751+0000 7f1ad579c700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ac00a15f0 0x7f1ac00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.751+0000 7f1acffff700 1 -- 172.21.15.59:0/2468074772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 msgr2=0x55e2a5b4a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:20.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.751+0000 7f1acffff700 1 --2- 172.21.15.59:0/2468074772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b4a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.751+0000 7f1acffff700 1 -- 172.21.15.59:0/2468074772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 msgr2=0x55e2a5b4ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:20.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.751+0000 7f1acffff700 1 --2- 172.21.15.59:0/2468074772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b4ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.751+0000 7f1acffff700 1 -- 172.21.15.59:0/2468074772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2a58bdde0 con 0x55e2a5b3ee80 2023-10-08T12:47:20.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.751+0000 7f1acffff700 1 --2- 172.21.15.59:0/2468074772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b3f260 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1abc012850 tx=0x7f1abc009770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a628295e94dd45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:20.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.752+0000 7f1ad579c700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ac00a15f0 0x7f1ac00a3ab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ac809b1b0 tx=0x7f1ac8009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:20.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.752+0000 7f1abaffd700 1 -- 172.21.15.59:0/2468074772 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc012e70 con 0x55e2a5b3ee80 2023-10-08T12:47:20.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.752+0000 7f1abaffd700 1 -- 172.21.15.59:0/2468074772 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1abc00f910 con 0x55e2a5b3ee80 2023-10-08T12:47:20.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.752+0000 7f1abaffd700 1 -- 172.21.15.59:0/2468074772 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc01e8d0 con 0x55e2a5b3ee80 2023-10-08T12:47:20.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.753+0000 7f1aeab65b80 1 -- 172.21.15.59:0/2468074772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 msgr2=0x55e2a5b3f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:20.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.753+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/2468074772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b3f260 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1abc012850 tx=0x7f1abc009770 comp rx=0 tx=0).stop 2023-10-08T12:47:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.753+0000 7f1aeab65b80 1 -- 172.21.15.59:0/2468074772 shutdown_connections 2023-10-08T12:47:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.753+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/2468074772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b3f260 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.753+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/2468074772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b4ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.753+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/2468074772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b4a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.753+0000 7f1aeab65b80 1 -- 172.21.15.59:0/2468074772 >> 172.21.15.59:0/2468074772 conn(0x55e2a5ab4260 msgr2=0x55e2a5b3b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.753+0000 7f1aeab65b80 1 -- 172.21.15.59:0/2468074772 shutdown_connections 2023-10-08T12:47:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.753+0000 7f1aeab65b80 1 -- 172.21.15.59:0/2468074772 wait complete. 2023-10-08T12:47:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.754+0000 7f1aeab65b80 1 -- start start 2023-10-08T12:47:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.754+0000 7f1aeab65b80 1 Processor -- start 2023-10-08T12:47:20.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.754+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b4a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.754+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b47400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.754+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b47b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.754+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5a92e30 con 0x55e2a5b4a650 2023-10-08T12:47:20.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.754+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5a2f710 con 0x55e2a5b3ee80 2023-10-08T12:47:20.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.754+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5a2f3b0 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.755+0000 7f1aeab65b80 10 client.0 _ll_register_callbacks cb 0x55e2a588c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.755+0000 7f1ad4f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b47400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.755+0000 7f1ad4f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b47400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41776/0 (socket says 172.21.15.59:41776) 2023-10-08T12:47:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.755+0000 7f1ad4f9b700 1 -- 172.21.15.59:0/544710510 learned_addr learned my addr 172.21.15.59:0/544710510 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.755+0000 7f1acffff700 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b4a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.755+0000 7f1acffff700 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b47b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.755+0000 7f1ad4f9b700 1 -- 172.21.15.59:0/544710510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 msgr2=0x55e2a5b4a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.755+0000 7f1ad4f9b700 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b4a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.755+0000 7f1ad4f9b700 1 -- 172.21.15.59:0/544710510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 msgr2=0x55e2a5b47b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.755+0000 7f1ad4f9b700 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b47b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.755+0000 7f1ad4f9b700 1 -- 172.21.15.59:0/544710510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc01a040 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.756+0000 7f1ad4f9b700 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b47400 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40129e0 tx=0x7f1ac4012cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8483f79bd5dc78eb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.756+0000 7f1aaffff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.756+0000 7f1aaffff700 1 -- 172.21.15.59:0/544710510 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4017070 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.756+0000 7f1aeab65b80 1 -- 172.21.15.59:0/544710510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2a5a5aeb0 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.756+0000 7f1aaffff700 1 -- 172.21.15.59:0/544710510 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1ac400f830 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.756+0000 7f1aaffff700 1 -- 172.21.15.59:0/544710510 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ac400f9f0 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.756+0000 7f1aeab65b80 10 client.26266 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.756+0000 7f1aeab65b80 1 -- 172.21.15.59:0/544710510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e2a58a6c60 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.756+0000 7f1aaffff700 1 -- 172.21.15.59:0/544710510 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e2a5a5aeb0 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.757+0000 7f1aaffff700 1 -- 172.21.15.59:0/544710510 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1ac4010b20 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.757+0000 7f1aeab65b80 10 client.26266 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:20.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.757+0000 7f1aeab65b80 10 client.26266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:20.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.757+0000 7f1aeab65b80 20 client.26266 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:20.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.757+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e2a5b5a220 0x55e2a5b5c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.757+0000 7f1aeab65b80 4 client.26266 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:47:20.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.757+0000 7f1aeab65b80 1 -- 172.21.15.59:0/544710510 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2a5a8be10 con 0x55e2a5b5a220 2023-10-08T12:47:20.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.757+0000 7f1acffff700 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e2a5b5a220 0x55e2a5b5c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.758+0000 7f1acffff700 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e2a5b5a220 0x55e2a5b5c640 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c69197d5e6debc1 server_cookie=39f2577642cfaa7e in_seq=0 out_seq=0 2023-10-08T12:47:20.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.758+0000 7f1aaffff700 10 client.26266 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:20.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aaffff700 1 -- 172.21.15.59:0/544710510 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e2a5a8be10 con 0x55e2a5b5a220 2023-10-08T12:47:20.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aaffff700 10 client.26266 handle_command_reply: tid=0 2023-10-08T12:47:20.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 1 client.26266 shutdown 2023-10-08T12:47:20.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 1 -- 172.21.15.59:0/544710510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 msgr2=0x55e2a5b47400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b47400 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40129e0 tx=0x7f1ac4012cf0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 1 -- 172.21.15.59:0/544710510 shutdown_connections 2023-10-08T12:47:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e2a5b5a220 0x55e2a5b5c640 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b4a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b47b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aaffff700 0 client.26266 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/544710510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b47400 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 1 -- 172.21.15.59:0/544710510 >> 172.21.15.59:0/544710510 conn(0x55e2a5ab4260 msgr2=0x55e2a5b3aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 1 -- 172.21.15.59:0/544710510 shutdown_connections 2023-10-08T12:47:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 1 -- 172.21.15.59:0/544710510 wait complete. 2023-10-08T12:47:20.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.759+0000 7f1aeab65b80 20 client.26266 trim_cache size 0 max 16384 2023-10-08T12:47:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.778+0000 7f1aeab65b80 1 Processor -- start 2023-10-08T12:47:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.778+0000 7f1aeab65b80 1 -- start start 2023-10-08T12:47:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.779+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b5c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.779+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b511a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.779+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b4a650 0x55e2a5b49e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.779+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5913920 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.779+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5b43060 con 0x55e2a5b3ee80 2023-10-08T12:47:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.779+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5b40970 con 0x55e2a5b4a650 2023-10-08T12:47:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.779+0000 7f1acffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b5c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.779+0000 7f1acffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b5c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38694/0 (socket says 172.21.15.59:38694) 2023-10-08T12:47:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.779+0000 7f1acffff700 1 -- 172.21.15.59:0/262709444 learned_addr learned my addr 172.21.15.59:0/262709444 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.779+0000 7f1acffff700 1 --2- 172.21.15.59:0/262709444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b4a650 0x55e2a5b49e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.779+0000 7f1ad4f9b700 1 --2- 172.21.15.59:0/262709444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.780+0000 7f1acffff700 1 -- 172.21.15.59:0/262709444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b4a650 msgr2=0x55e2a5b49e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.780+0000 7f1acffff700 1 --2- 172.21.15.59:0/262709444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b4a650 0x55e2a5b49e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.780+0000 7f1acffff700 1 -- 172.21.15.59:0/262709444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b3f7a0 msgr2=0x55e2a5b511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:20.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.780+0000 7f1acffff700 1 --2- 172.21.15.59:0/262709444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.780+0000 7f1acffff700 1 -- 172.21.15.59:0/262709444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2a58e4250 con 0x55e2a5b3ee80 2023-10-08T12:47:20.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.780+0000 7f1acffff700 1 --2- 172.21.15.59:0/262709444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b5c610 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1abc012fd0 tx=0x7f1abc017040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=881e5db8e2bf19a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:20.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.780+0000 7f1abb7fe700 1 -- 172.21.15.59:0/262709444 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00f750 con 0x55e2a5b3ee80 2023-10-08T12:47:20.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.780+0000 7f1abb7fe700 1 -- 172.21.15.59:0/262709444 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1abc033070 con 0x55e2a5b3ee80 2023-10-08T12:47:20.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.780+0000 7f1abb7fe700 1 -- 172.21.15.59:0/262709444 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc02dd30 con 0x55e2a5b3ee80 2023-10-08T12:47:20.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.781+0000 7f1aeab65b80 1 -- 172.21.15.59:0/262709444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 msgr2=0x55e2a5b5c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:20.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.781+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/262709444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b5c610 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1abc012fd0 tx=0x7f1abc017040 comp rx=0 tx=0).stop 2023-10-08T12:47:20.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.781+0000 7f1aeab65b80 1 -- 172.21.15.59:0/262709444 shutdown_connections 2023-10-08T12:47:20.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.781+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/262709444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b5c610 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.781+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/262709444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b4a650 0x55e2a5b49e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.781+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/262709444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.781+0000 7f1aeab65b80 1 -- 172.21.15.59:0/262709444 >> 172.21.15.59:0/262709444 conn(0x55e2a5ab4260 msgr2=0x55e2a5b3a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:20.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.781+0000 7f1aeab65b80 1 -- 172.21.15.59:0/262709444 shutdown_connections 2023-10-08T12:47:20.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.781+0000 7f1aeab65b80 1 -- 172.21.15.59:0/262709444 wait complete. 2023-10-08T12:47:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.782+0000 7f1aeab65b80 1 -- start start 2023-10-08T12:47:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.782+0000 7f1aeab65b80 1 Processor -- start 2023-10-08T12:47:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.782+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b50c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.782+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b4f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.782+0000 7f1aeab65b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b4f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.782+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5b51570 con 0x55e2a5b4a650 2023-10-08T12:47:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.782+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5b4fc00 con 0x55e2a5b3ee80 2023-10-08T12:47:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.782+0000 7f1aeab65b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a5b4fdc0 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.783+0000 7f1aeab65b80 10 client.0 _ll_register_callbacks cb 0x7f1ac40124e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.783+0000 7f1acffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b50c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.783+0000 7f1acffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b50c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38696/0 (socket says 172.21.15.59:38696) 2023-10-08T12:47:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.783+0000 7f1acffff700 1 -- 172.21.15.59:0/3266848382 learned_addr learned my addr 172.21.15.59:0/3266848382 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.783+0000 7f1ad4f9b700 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b4f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.783+0000 7f1acffff700 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b4f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.783+0000 7f1ad4f9b700 1 -- 172.21.15.59:0/3266848382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 msgr2=0x55e2a5b50c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.783+0000 7f1ad4f9b700 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b50c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.783+0000 7f1ad4f9b700 1 -- 172.21.15.59:0/3266848382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 msgr2=0x55e2a5b4f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.783+0000 7f1ad4f9b700 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b4f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.783+0000 7f1ad4f9b700 1 -- 172.21.15.59:0/3266848382 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc028040 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.784+0000 7f1ad4f9b700 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b4f180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55e2a5b40250 tx=0x7f1ac400ff00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8f16d6d00cb3367 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.784+0000 7f1aaffff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:47:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.784+0000 7f1aaffff700 1 -- 172.21.15.59:0/3266848382 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4017030 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.784+0000 7f1aaffff700 1 -- 172.21.15.59:0/3266848382 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1ac4000e40 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.784+0000 7f1aeab65b80 1 -- 172.21.15.59:0/3266848382 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1abc00f910 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.785+0000 7f1aaffff700 1 -- 172.21.15.59:0/3266848382 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ac40052e0 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.785+0000 7f1aeab65b80 10 client.26272 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.785+0000 7f1aeab65b80 1 -- 172.21.15.59:0/3266848382 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e2a58bc2b0 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.785+0000 7f1aaffff700 1 -- 172.21.15.59:0/3266848382 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1abc00f910 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.785+0000 7f1aaffff700 1 -- 172.21.15.59:0/3266848382 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1ac4003c00 con 0x55e2a5b3f7a0 2023-10-08T12:47:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.785+0000 7f1aeab65b80 10 client.26272 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.785+0000 7f1aeab65b80 10 client.26272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.785+0000 7f1aeab65b80 20 client.26272 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.785+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e2a5baf400 0x55e2a5bb1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.785+0000 7f1aeab65b80 4 client.26272 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:47:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.785+0000 7f1aeab65b80 1 -- 172.21.15.59:0/3266848382 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e2a5a8bb30 con 0x55e2a5baf400 2023-10-08T12:47:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.786+0000 7f1acffff700 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e2a5baf400 0x55e2a5bb1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:20.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.786+0000 7f1acffff700 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e2a5baf400 0x55e2a5bb1820 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ec9237d534ee29a server_cookie=7365d69af843186b in_seq=0 out_seq=0 2023-10-08T12:47:20.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.786+0000 7f1aaffff700 10 client.26272 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:20.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aaffff700 1 -- 172.21.15.59:0/3266848382 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e2a5a8bb30 con 0x55e2a5baf400 2023-10-08T12:47:20.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aaffff700 10 client.26272 handle_command_reply: tid=0 2023-10-08T12:47:20.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 1 client.26272 shutdown 2023-10-08T12:47:20.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 1 -- 172.21.15.59:0/3266848382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 msgr2=0x55e2a5b4f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:20.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b4f180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55e2a5b40250 tx=0x7f1ac400ff00 comp rx=0 tx=0).stop 2023-10-08T12:47:20.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 1 -- 172.21.15.59:0/3266848382 shutdown_connections 2023-10-08T12:47:20.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e2a5baf400 0x55e2a5bb1820 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2a5b3ee80 0x55e2a5b50c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e2a5b4a650 0x55e2a5b4f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aaffff700 0 client.26272 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:20.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 1 --2- 172.21.15.59:0/3266848382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2a5b3f7a0 0x55e2a5b4f180 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 1 -- 172.21.15.59:0/3266848382 >> 172.21.15.59:0/3266848382 conn(0x55e2a5ab4260 msgr2=0x55e2a5b49e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:20.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 1 -- 172.21.15.59:0/3266848382 shutdown_connections 2023-10-08T12:47:20.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 1 -- 172.21.15.59:0/3266848382 wait complete. 2023-10-08T12:47:20.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.787+0000 7f1aeab65b80 20 client.26272 trim_cache size 0 max 16384 2023-10-08T12:47:20.791 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:47:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:47:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:47:20.792 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:47:20.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 -- 172.21.15.59:0/325671434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ac00a15f0 msgr2=0x7f1ac00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ac00a15f0 0x7f1ac00a3ab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ac809b1b0 tx=0x7f1ac8009040 comp rx=0 tx=0).stop 2023-10-08T12:47:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 -- 172.21.15.59:0/325671434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad0105b80 msgr2=0x7f1ad0100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad0105b80 0x7f1ad0100130 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8004fd0 tx=0x7f1ac8009470 comp rx=0 tx=0).stop 2023-10-08T12:47:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 -- 172.21.15.59:0/325671434 shutdown_connections 2023-10-08T12:47:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ac00a15f0 0x7f1ac00a3ab0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad0105b80 0x7f1ad0100130 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad0067ce0 0x7f1ad00ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 --2- 172.21.15.59:0/325671434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad01051c0 0x7f1ad00ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 -- 172.21.15.59:0/325671434 >> 172.21.15.59:0/325671434 conn(0x7f1ad0076780 msgr2=0x7f1ad00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 -- 172.21.15.59:0/325671434 shutdown_connections 2023-10-08T12:47:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:20.788+0000 7f1ad71ff700 1 -- 172.21.15.59:0/325671434 wait complete. 2023-10-08T12:47:20.816 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:47:20.816 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:47:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.044+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/1580165130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea80734b0 msgr2=0x7f0ea8111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.044+0000 7f0eaf1ff700 1 --2- 172.21.15.59:0/1580165130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea80734b0 0x7f0ea8111100 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009990 tx=0x7f0e94009ca0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.044+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/1580165130 shutdown_connections 2023-10-08T12:47:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.044+0000 7f0eaf1ff700 1 --2- 172.21.15.59:0/1580165130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ea8111640 0x7f0ea8113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.044+0000 7f0eaf1ff700 1 --2- 172.21.15.59:0/1580165130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8072b90 0x7f0ea8072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.044+0000 7f0eaf1ff700 1 --2- 172.21.15.59:0/1580165130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea80734b0 0x7f0ea8111100 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.044+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/1580165130 >> 172.21.15.59:0/1580165130 conn(0x7f0ea80fc160 msgr2=0x7f0ea80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.044+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/1580165130 shutdown_connections 2023-10-08T12:47:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.044+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/1580165130 wait complete. 2023-10-08T12:47:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.045+0000 7f0eaf1ff700 1 Processor -- start 2023-10-08T12:47:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0eaf1ff700 1 -- start start 2023-10-08T12:47:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0eaf1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8072b90 0x7f0ea819d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0eaf1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ea80734b0 0x7f0ea819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0eaf1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea8111640 0x7f0ea81a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0eaf1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea81a20a0 con 0x7f0ea8111640 2023-10-08T12:47:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0eaf1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea81a2210 con 0x7f0ea80734b0 2023-10-08T12:47:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0eaf1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea81a23d0 con 0x7f0ea8072b90 2023-10-08T12:47:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ea80734b0 0x7f0ea819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ea80734b0 0x7f0ea819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38722/0 (socket says 172.21.15.59:38722) 2023-10-08T12:47:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0ea7fff700 1 -- 172.21.15.59:0/3953360055 learned_addr learned my addr 172.21.15.59:0/3953360055 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0eacf9b700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8072b90 0x7f0ea819d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.046+0000 7f0ead79c700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea8111640 0x7f0ea81a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0ea7fff700 1 -- 172.21.15.59:0/3953360055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8072b90 msgr2=0x7f0ea819d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0ea7fff700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8072b90 0x7f0ea819d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0ea7fff700 1 -- 172.21.15.59:0/3953360055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea8111640 msgr2=0x7f0ea81a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0ea7fff700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea8111640 0x7f0ea81a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0ea7fff700 1 -- 172.21.15.59:0/3953360055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940095f0 con 0x7f0ea80734b0 2023-10-08T12:47:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0eacf9b700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8072b90 0x7f0ea819d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0ea7fff700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ea80734b0 0x7f0ea819d6c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0e94005910 tx=0x7f0e94004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0ea5ffb700 1 -- 172.21.15.59:0/3953360055 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9401d070 con 0x7f0ea80734b0 2023-10-08T12:47:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/3953360055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea81a2650 con 0x7f0ea80734b0 2023-10-08T12:47:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0ea5ffb700 1 -- 172.21.15.59:0/3953360055 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e94022470 con 0x7f0ea80734b0 2023-10-08T12:47:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0ea5ffb700 1 -- 172.21.15.59:0/3953360055 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94017650 con 0x7f0ea80734b0 2023-10-08T12:47:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.047+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/3953360055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea81a9ef0 con 0x7f0ea80734b0 2023-10-08T12:47:21.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.049+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/3953360055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea8103b60 con 0x7f0ea80734b0 2023-10-08T12:47:21.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.051+0000 7f0ea5ffb700 1 -- 172.21.15.59:0/3953360055 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0e940225e0 con 0x7f0ea80734b0 2023-10-08T12:47:21.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.052+0000 7f0ea5ffb700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e980a1670 0x7f0e980a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.052+0000 7f0ea5ffb700 1 -- 172.21.15.59:0/3953360055 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0e940ce290 con 0x7f0ea80734b0 2023-10-08T12:47:21.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.052+0000 7f0eacf9b700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e980a1670 0x7f0e980a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.053+0000 7f0eacf9b700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e980a1670 0x7f0e980a3b30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c011490 tx=0x7f0e9c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.056+0000 7f0ea5ffb700 1 -- 172.21.15.59:0/3953360055 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0e94097660 con 0x7f0ea80734b0 2023-10-08T12:47:21.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.346+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/3953360055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ea819e480 con 0x7f0ea80734b0 2023-10-08T12:47:21.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.347+0000 7f0ea5ffb700 1 -- 172.21.15.59:0/3953360055 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f0e9409ac80 con 0x7f0ea80734b0 2023-10-08T12:47:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:47:21.347 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:47:21.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/3953360055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e980a1670 msgr2=0x7f0e980a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e980a1670 0x7f0e980a3b30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c011490 tx=0x7f0e9c009260 comp rx=0 tx=0).stop 2023-10-08T12:47:21.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/3953360055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ea80734b0 msgr2=0x7f0ea819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ea80734b0 0x7f0ea819d6c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0e94005910 tx=0x7f0e94004730 comp rx=0 tx=0).stop 2023-10-08T12:47:21.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/3953360055 shutdown_connections 2023-10-08T12:47:21.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0e980a1670 0x7f0e980a3b30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea8111640 0x7f0ea81a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8072b90 0x7f0ea819d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 --2- 172.21.15.59:0/3953360055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ea80734b0 0x7f0ea819d6c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/3953360055 >> 172.21.15.59:0/3953360055 conn(0x7f0ea80fc160 msgr2=0x7f0ea80fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:21.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/3953360055 shutdown_connections 2023-10-08T12:47:21.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.350+0000 7f0eaf1ff700 1 -- 172.21.15.59:0/3953360055 wait complete. 2023-10-08T12:47:21.351 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:47:21.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:47:21.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 756316 13.68 MB/sec execute 172 sec latency 15.207 ms 2023-10-08T12:47:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.596+0000 7fb50f3ff700 1 -- 172.21.15.59:0/48641072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb508067ce0 msgr2=0x7fb5080680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.596+0000 7fb50f3ff700 1 --2- 172.21.15.59:0/48641072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb508067ce0 0x7fb5080680c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb504009990 tx=0x7fb504009ca0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.596+0000 7fb50f3ff700 1 -- 172.21.15.59:0/48641072 shutdown_connections 2023-10-08T12:47:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.596+0000 7fb50f3ff700 1 --2- 172.21.15.59:0/48641072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb508067ce0 0x7fb5080680c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.596+0000 7fb50f3ff700 1 --2- 172.21.15.59:0/48641072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb508105b80 0x7fb50810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.596+0000 7fb50f3ff700 1 --2- 172.21.15.59:0/48641072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5081051c0 0x7fb508105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.596+0000 7fb50f3ff700 1 -- 172.21.15.59:0/48641072 >> 172.21.15.59:0/48641072 conn(0x7fb508076780 msgr2=0x7fb508076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.596+0000 7fb50f3ff700 1 -- 172.21.15.59:0/48641072 shutdown_connections 2023-10-08T12:47:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.596+0000 7fb50f3ff700 1 -- 172.21.15.59:0/48641072 wait complete. 2023-10-08T12:47:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.597+0000 7fb50f3ff700 1 Processor -- start 2023-10-08T12:47:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.598+0000 7fb50f3ff700 1 -- start start 2023-10-08T12:47:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.598+0000 7fb50f3ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb508067ce0 0x7fb5081075a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.598+0000 7fb50f3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5081051c0 0x7fb508107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.598+0000 7fb50f3ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb508105b80 0x7fb508108020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.598+0000 7fb50f3ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081a9450 con 0x7fb508067ce0 2023-10-08T12:47:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.598+0000 7fb50f3ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081a9590 con 0x7fb508105b80 2023-10-08T12:47:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.598+0000 7fb50f3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081a9700 con 0x7fb5081051c0 2023-10-08T12:47:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.598+0000 7fb50c99a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5081051c0 0x7fb508107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.598+0000 7fb50c99a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5081051c0 0x7fb508107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41820/0 (socket says 172.21.15.59:41820) 2023-10-08T12:47:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.598+0000 7fb50c99a700 1 -- 172.21.15.59:0/2319333695 learned_addr learned my addr 172.21.15.59:0/2319333695 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.598+0000 7fb50d99c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb508105b80 0x7fb508108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.599+0000 7fb50d19b700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb508067ce0 0x7fb5081075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.599+0000 7fb50c99a700 1 -- 172.21.15.59:0/2319333695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb508105b80 msgr2=0x7fb508108020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.599+0000 7fb50c99a700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb508105b80 0x7fb508108020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.599+0000 7fb50c99a700 1 -- 172.21.15.59:0/2319333695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb508067ce0 msgr2=0x7fb5081075a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.599+0000 7fb50c99a700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb508067ce0 0x7fb5081075a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.599+0000 7fb50c99a700 1 -- 172.21.15.59:0/2319333695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040095f0 con 0x7fb5081051c0 2023-10-08T12:47:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.599+0000 7fb50d99c700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb508105b80 0x7fb508108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.599+0000 7fb50d19b700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb508067ce0 0x7fb5081075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.599+0000 7fb50c99a700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5081051c0 0x7fb508107ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800e9a0 tx=0x7fb4f800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.600+0000 7fb4fe7fc700 1 -- 172.21.15.59:0/2319333695 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8009790 con 0x7fb5081051c0 2023-10-08T12:47:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.600+0000 7fb50f3ff700 1 -- 172.21.15.59:0/2319333695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5081a99e0 con 0x7fb5081051c0 2023-10-08T12:47:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.600+0000 7fb4fe7fc700 1 -- 172.21.15.59:0/2319333695 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4f8010430 con 0x7fb5081051c0 2023-10-08T12:47:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.600+0000 7fb4fe7fc700 1 -- 172.21.15.59:0/2319333695 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8018680 con 0x7fb5081051c0 2023-10-08T12:47:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.600+0000 7fb50f3ff700 1 -- 172.21.15.59:0/2319333695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5081a9f40 con 0x7fb5081051c0 2023-10-08T12:47:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.603+0000 7fb4fe7fc700 1 -- 172.21.15.59:0/2319333695 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb4f80105a0 con 0x7fb5081051c0 2023-10-08T12:47:21.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.604+0000 7fb522c3cb80 1 Processor -- start 2023-10-08T12:47:21.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb522c3cb80 1 -- start start 2023-10-08T12:47:21.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb4fe7fc700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f40a15f0 0x7fb4f40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb4fe7fc700 1 -- 172.21.15.59:0/2319333695 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb4f8014070 con 0x7fb5081051c0 2023-10-08T12:47:21.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 0x561c97b1c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b27110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b27650 0x561c97b29a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb50d99c700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f40a15f0 0x7fb4f40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97a85460 con 0x561c97b27650 2023-10-08T12:47:21.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97a76c20 con 0x561c97b1c7a0 2023-10-08T12:47:21.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97a74540 con 0x561c97b1be80 2023-10-08T12:47:21.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb50d99c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b27650 0x561c97b29a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb50c99a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b27110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.606+0000 7fb50c99a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b27110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38754/0 (socket says 172.21.15.59:38754) 2023-10-08T12:47:21.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.605+0000 7fb50d19b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 0x561c97b1c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.606+0000 7fb50d99c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b27650 0x561c97b29a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41864/0 (socket says 172.21.15.59:41864) 2023-10-08T12:47:21.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.606+0000 7fb50c99a700 1 -- 172.21.15.59:0/2537032232 learned_addr learned my addr 172.21.15.59:0/2537032232 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:21.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.606+0000 7fb50d19b700 1 -- 172.21.15.59:0/2537032232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 msgr2=0x561c97b27110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:21.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.606+0000 7fb50d19b700 1 --2- 172.21.15.59:0/2537032232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b27110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.606+0000 7fb50d19b700 1 -- 172.21.15.59:0/2537032232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b27650 msgr2=0x561c97b29a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:21.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.606+0000 7fb50d19b700 1 --2- 172.21.15.59:0/2537032232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b27650 0x561c97b29a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.606+0000 7fb50d19b700 1 -- 172.21.15.59:0/2537032232 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c9789ade0 con 0x561c97b1be80 2023-10-08T12:47:21.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.606+0000 7fb50c99a700 1 --2- 172.21.15.59:0/2537032232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b27110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:21.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.606+0000 7fb50d99c700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f40a15f0 0x7fb4f40a3ab0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb500009fd0 tx=0x7fb500003cf0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:21.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.606+0000 7fb50d19b700 1 --2- 172.21.15.59:0/2537032232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 0x561c97b1c260 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb504000c00 tx=0x7fb504005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aab12819fedf7b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:21.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.607+0000 7fb4f37fe700 1 -- 172.21.15.59:0/2537032232 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50401d030 con 0x561c97b1be80 2023-10-08T12:47:21.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.607+0000 7fb4f37fe700 1 -- 172.21.15.59:0/2537032232 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb50401e040 con 0x561c97b1be80 2023-10-08T12:47:21.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.607+0000 7fb4f37fe700 1 -- 172.21.15.59:0/2537032232 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504004a30 con 0x561c97b1be80 2023-10-08T12:47:21.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.607+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2537032232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 msgr2=0x561c97b1c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.608+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/2537032232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 0x561c97b1c260 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb504000c00 tx=0x7fb504005f00 comp rx=0 tx=0).stop 2023-10-08T12:47:21.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.608+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2537032232 shutdown_connections 2023-10-08T12:47:21.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.608+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/2537032232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b27650 0x561c97b29a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.608+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/2537032232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 0x561c97b1c260 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.608+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/2537032232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b27110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.608+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2537032232 >> 172.21.15.59:0/2537032232 conn(0x561c97a91260 msgr2=0x561c97b182d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:21.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.608+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2537032232 shutdown_connections 2023-10-08T12:47:21.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.608+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2537032232 wait complete. 2023-10-08T12:47:21.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.608+0000 7fb522c3cb80 1 -- start start 2023-10-08T12:47:21.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.609+0000 7fb522c3cb80 1 Processor -- start 2023-10-08T12:47:21.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.609+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 0x561c97b26fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.609+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 0x561c97b24350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.609+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b27650 0x561c97b24980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.609+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97a6fe30 con 0x561c97b1c7a0 2023-10-08T12:47:21.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.609+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97a0c710 con 0x561c97b27650 2023-10-08T12:47:21.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.609+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97a0c3b0 con 0x561c97b1be80 2023-10-08T12:47:21.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.609+0000 7fb522c3cb80 10 client.0 _ll_register_callbacks cb 0x561c97869800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:21.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50d19b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 0x561c97b26fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50d99c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b27650 0x561c97b24980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50d19b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 0x561c97b26fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41838/0 (socket says 172.21.15.59:41838) 2023-10-08T12:47:21.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50d19b700 1 -- 172.21.15.59:0/2125706302 learned_addr learned my addr 172.21.15.59:0/2125706302 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50c99a700 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 0x561c97b24350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50d19b700 1 -- 172.21.15.59:0/2125706302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b27650 msgr2=0x561c97b24980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50d19b700 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b27650 0x561c97b24980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50d19b700 1 -- 172.21.15.59:0/2125706302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 msgr2=0x561c97b24350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50d19b700 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 0x561c97b24350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50d19b700 1 -- 172.21.15.59:0/2125706302 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5081a9f40 con 0x561c97b1be80 2023-10-08T12:47:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50c99a700 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 0x561c97b24350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:47:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb50d19b700 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 0x561c97b26fc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb504005640 tx=0x7fb504005670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ce692f957de951b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.610+0000 7fb4f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:47:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.611+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/2125706302 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50401d040 con 0x561c97b1be80 2023-10-08T12:47:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.611+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2125706302 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c97a37eb0 con 0x561c97b1be80 2023-10-08T12:47:21.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.611+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/2125706302 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb5040048b0 con 0x561c97b1be80 2023-10-08T12:47:21.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.611+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/2125706302 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb504004a70 con 0x561c97b1be80 2023-10-08T12:47:21.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.611+0000 7fb522c3cb80 10 client.26290 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:21.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.611+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2125706302 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fb50810dec0 con 0x561c97b1be80 2023-10-08T12:47:21.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.611+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/2125706302 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561c97a37eb0 con 0x561c97b1be80 2023-10-08T12:47:21.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.612+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/2125706302 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb50400fc90 con 0x561c97b1be80 2023-10-08T12:47:21.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.612+0000 7fb522c3cb80 10 client.26290 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:21.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.612+0000 7fb522c3cb80 10 client.26290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:21.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.612+0000 7fb522c3cb80 20 client.26290 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:21.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.612+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c97b36ba0 0x561c97b38fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.612+0000 7fb522c3cb80 4 client.26290 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:47:21.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.612+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2125706302 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c97a68e10 con 0x561c97b36ba0 2023-10-08T12:47:21.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.612+0000 7fb50c99a700 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c97b36ba0 0x561c97b38fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.613+0000 7fb50c99a700 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c97b36ba0 0x561c97b38fc0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f119347c9728aaee server_cookie=f4d35e4eee6148b in_seq=0 out_seq=0 2023-10-08T12:47:21.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.613+0000 7fb4f0ff9700 10 client.26290 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/2125706302 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561c97a68e10 con 0x561c97b36ba0 2023-10-08T12:47:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb4f0ff9700 10 client.26290 handle_command_reply: tid=0 2023-10-08T12:47:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb522c3cb80 1 client.26290 shutdown 2023-10-08T12:47:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2125706302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 msgr2=0x561c97b26fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 0x561c97b26fc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb504005640 tx=0x7fb504005670 comp rx=0 tx=0).stop 2023-10-08T12:47:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2125706302 shutdown_connections 2023-10-08T12:47:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c97b36ba0 0x561c97b38fc0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b27650 0x561c97b24980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b1be80 0x561c97b26fc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/2125706302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 0x561c97b24350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb4f0ff9700 0 client.26290 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:21.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2125706302 >> 172.21.15.59:0/2125706302 conn(0x561c97a91260 msgr2=0x561c97b17ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:21.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2125706302 shutdown_connections 2023-10-08T12:47:21.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.615+0000 7fb522c3cb80 1 -- 172.21.15.59:0/2125706302 wait complete. 2023-10-08T12:47:21.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.616+0000 7fb522c3cb80 20 client.26290 trim_cache size 0 max 16384 2023-10-08T12:47:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.630+0000 7fb522c3cb80 1 Processor -- start 2023-10-08T12:47:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.630+0000 7fb522c3cb80 1 -- start start 2023-10-08T12:47:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.630+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1be80 0x561c97b2e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.630+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b1f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b27650 0x561c97b1fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c978f0920 con 0x561c97b1be80 2023-10-08T12:47:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97b29e00 con 0x561c97b1c7a0 2023-10-08T12:47:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97b2e6c0 con 0x561c97b27650 2023-10-08T12:47:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50d19b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1be80 0x561c97b2e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50c99a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b1f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50c99a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b1f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38786/0 (socket says 172.21.15.59:38786) 2023-10-08T12:47:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50d19b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1be80 0x561c97b2e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41872/0 (socket says 172.21.15.59:41872) 2023-10-08T12:47:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50c99a700 1 -- 172.21.15.59:0/1382574 learned_addr learned my addr 172.21.15.59:0/1382574 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50d99c700 1 --2- 172.21.15.59:0/1382574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b27650 0x561c97b1fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50c99a700 1 -- 172.21.15.59:0/1382574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b27650 msgr2=0x561c97b1fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50c99a700 1 --2- 172.21.15.59:0/1382574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b27650 0x561c97b1fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50c99a700 1 -- 172.21.15.59:0/1382574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1be80 msgr2=0x561c97b2e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50c99a700 1 --2- 172.21.15.59:0/1382574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1be80 0x561c97b2e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50c99a700 1 -- 172.21.15.59:0/1382574 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c97883c60 con 0x561c97b1c7a0 2023-10-08T12:47:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.631+0000 7fb50d19b700 1 --2- 172.21.15.59:0/1382574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1be80 0x561c97b2e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.632+0000 7fb50c99a700 1 --2- 172.21.15.59:0/1382574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b1f650 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80caa60 tx=0x7fb4f8096700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a3e26512393871a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.632+0000 7fb4f3fff700 1 -- 172.21.15.59:0/1382574 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8094ea0 con 0x561c97b1c7a0 2023-10-08T12:47:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.632+0000 7fb4f3fff700 1 -- 172.21.15.59:0/1382574 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4f80a2620 con 0x561c97b1c7a0 2023-10-08T12:47:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.632+0000 7fb4f3fff700 1 -- 172.21.15.59:0/1382574 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f809a750 con 0x561c97b1c7a0 2023-10-08T12:47:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.633+0000 7fb522c3cb80 1 -- 172.21.15.59:0/1382574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 msgr2=0x561c97b1f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.633+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/1382574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b1f650 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80caa60 tx=0x7fb4f8096700 comp rx=0 tx=0).stop 2023-10-08T12:47:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.633+0000 7fb522c3cb80 1 -- 172.21.15.59:0/1382574 shutdown_connections 2023-10-08T12:47:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.633+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/1382574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b27650 0x561c97b1fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.633+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/1382574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1be80 0x561c97b2e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.633+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/1382574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1c7a0 0x561c97b1f650 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.633+0000 7fb522c3cb80 1 -- 172.21.15.59:0/1382574 >> 172.21.15.59:0/1382574 conn(0x561c97a91260 msgr2=0x561c97b174d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.633+0000 7fb522c3cb80 1 -- 172.21.15.59:0/1382574 shutdown_connections 2023-10-08T12:47:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.633+0000 7fb522c3cb80 1 -- 172.21.15.59:0/1382574 wait complete. 2023-10-08T12:47:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.633+0000 7fb522c3cb80 1 -- start start 2023-10-08T12:47:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb522c3cb80 1 Processor -- start 2023-10-08T12:47:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1be80 0x561c97b2d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 0x561c97b2dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb522c3cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b27650 0x561c97b2bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97b2c530 con 0x561c97b1c7a0 2023-10-08T12:47:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97b2c6a0 con 0x561c97b1be80 2023-10-08T12:47:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb522c3cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97b2c860 con 0x561c97b27650 2023-10-08T12:47:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb522c3cb80 10 client.0 _ll_register_callbacks cb 0x7fb500004200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb50d19b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1be80 0x561c97b2d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb50d19b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1be80 0x561c97b2d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38794/0 (socket says 172.21.15.59:38794) 2023-10-08T12:47:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb50d19b700 1 -- 172.21.15.59:0/3209847822 learned_addr learned my addr 172.21.15.59:0/3209847822 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.634+0000 7fb50c99a700 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 0x561c97b2dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb50d99c700 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b27650 0x561c97b2bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb50d19b700 1 -- 172.21.15.59:0/3209847822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b27650 msgr2=0x561c97b2bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb50d19b700 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b27650 0x561c97b2bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb50d19b700 1 -- 172.21.15.59:0/3209847822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 msgr2=0x561c97b2dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb50d19b700 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 0x561c97b2dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb50d19b700 1 -- 172.21.15.59:0/3209847822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50810dec0 con 0x561c97b1be80 2023-10-08T12:47:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb50c99a700 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 0x561c97b2dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:47:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb50d19b700 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1be80 0x561c97b2d960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb5040053e0 tx=0x7fb5040048b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b177525d5bcb99d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb4f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:47:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/3209847822 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50401d040 con 0x561c97b1be80 2023-10-08T12:47:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb522c3cb80 1 -- 172.21.15.59:0/3209847822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb50401e040 con 0x561c97b1be80 2023-10-08T12:47:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/3209847822 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb504000e40 con 0x561c97b1be80 2023-10-08T12:47:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.635+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/3209847822 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb50400bee0 con 0x561c97b1be80 2023-10-08T12:47:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.636+0000 7fb522c3cb80 10 client.26303 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.636+0000 7fb522c3cb80 1 -- 172.21.15.59:0/3209847822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fb5081a99e0 con 0x561c97b1be80 2023-10-08T12:47:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.636+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/3209847822 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb50404c080 con 0x561c97b1be80 2023-10-08T12:47:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.636+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/3209847822 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb50400f990 con 0x561c97b1be80 2023-10-08T12:47:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.636+0000 7fb522c3cb80 10 client.26303 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.636+0000 7fb522c3cb80 10 client.26303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.636+0000 7fb522c3cb80 20 client.26303 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.636+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c97b8b7a0 0x561c97b8dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.636+0000 7fb522c3cb80 4 client.26303 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:47:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.636+0000 7fb522c3cb80 1 -- 172.21.15.59:0/3209847822 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561c97a68b30 con 0x561c97b8b7a0 2023-10-08T12:47:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.636+0000 7fb50c99a700 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c97b8b7a0 0x561c97b8dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb50c99a700 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c97b8b7a0 0x561c97b8dbc0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1699a28b26bfbf7 server_cookie=7b473efe97d67969 in_seq=0 out_seq=0 2023-10-08T12:47:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb4f0ff9700 10 client.26303 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb4f0ff9700 1 -- 172.21.15.59:0/3209847822 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561c97a68b30 con 0x561c97b8b7a0 2023-10-08T12:47:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb4f0ff9700 10 client.26303 handle_command_reply: tid=0 2023-10-08T12:47:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb522c3cb80 1 client.26303 shutdown 2023-10-08T12:47:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb522c3cb80 1 -- 172.21.15.59:0/3209847822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1be80 msgr2=0x561c97b2d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1be80 0x561c97b2d960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb5040053e0 tx=0x7fb5040048b0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb522c3cb80 1 -- 172.21.15.59:0/3209847822 shutdown_connections 2023-10-08T12:47:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c97b8b7a0 0x561c97b8dbc0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c97b1be80 0x561c97b2d960 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97b27650 0x561c97b2bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb4f0ff9700 0 client.26303 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb522c3cb80 1 --2- 172.21.15.59:0/3209847822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97b1c7a0 0x561c97b2dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb522c3cb80 1 -- 172.21.15.59:0/3209847822 >> 172.21.15.59:0/3209847822 conn(0x561c97a91260 msgr2=0x561c97b1f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb522c3cb80 1 -- 172.21.15.59:0/3209847822 shutdown_connections 2023-10-08T12:47:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.637+0000 7fb522c3cb80 1 -- 172.21.15.59:0/3209847822 wait complete. 2023-10-08T12:47:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb522c3cb80 20 client.26303 trim_cache size 0 max 16384 2023-10-08T12:47:21.643 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:47:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 -- 172.21.15.59:0/2319333695 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f40a15f0 msgr2=0x7fb4f40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f40a15f0 0x7fb4f40a3ab0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb500009fd0 tx=0x7fb500003cf0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 -- 172.21.15.59:0/2319333695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5081051c0 msgr2=0x7fb508107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5081051c0 0x7fb508107ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800e9a0 tx=0x7fb4f800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 -- 172.21.15.59:0/2319333695 shutdown_connections 2023-10-08T12:47:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb4f40a15f0 0x7fb4f40a3ab0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb508105b80 0x7fb508108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb508067ce0 0x7fb5081075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 --2- 172.21.15.59:0/2319333695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5081051c0 0x7fb508107ae0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 -- 172.21.15.59:0/2319333695 >> 172.21.15.59:0/2319333695 conn(0x7fb508076780 msgr2=0x7fb508100aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 -- 172.21.15.59:0/2319333695 shutdown_connections 2023-10-08T12:47:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:21.638+0000 7fb50f3ff700 1 -- 172.21.15.59:0/2319333695 wait complete. 2023-10-08T12:47:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:21 smithi173 ceph-mon[135182]: pgmap v499: 97 pgs: 97 active+clean; 403 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 279 op/s 2023-10-08T12:47:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:21 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3953360055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:47:22.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:21 smithi059 ceph-mon[98489]: pgmap v499: 97 pgs: 97 active+clean; 403 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 279 op/s 2023-10-08T12:47:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:21 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3953360055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:47:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:21 smithi092 ceph-mon[134093]: pgmap v499: 97 pgs: 97 active+clean; 403 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 279 op/s 2023-10-08T12:47:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:21 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3953360055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:47:22.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 757926 13.64 MB/sec execute 173 sec latency 87.715 ms 2023-10-08T12:47:22.659 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:47:22.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:47:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.914+0000 7f9ec7fff700 1 -- 172.21.15.59:0/1911200708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ec01010f0 msgr2=0x7f9ec010d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.914+0000 7f9ec7fff700 1 --2- 172.21.15.59:0/1911200708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ec01010f0 0x7f9ec010d600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800b0a0 tx=0x7f9eb800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.914+0000 7f9ec7fff700 1 -- 172.21.15.59:0/1911200708 shutdown_connections 2023-10-08T12:47:22.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.914+0000 7f9ec7fff700 1 --2- 172.21.15.59:0/1911200708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ec01010f0 0x7f9ec010d600 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.914+0000 7f9ec7fff700 1 --2- 172.21.15.59:0/1911200708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec0106740 0x7f9ec0106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.914+0000 7f9ec7fff700 1 --2- 172.21.15.59:0/1911200708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec0100730 0x7f9ec0100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.914+0000 7f9ec7fff700 1 -- 172.21.15.59:0/1911200708 >> 172.21.15.59:0/1911200708 conn(0x7f9ec00fc200 msgr2=0x7f9ec00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:22.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.914+0000 7f9ec7fff700 1 -- 172.21.15.59:0/1911200708 shutdown_connections 2023-10-08T12:47:22.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.914+0000 7f9ec7fff700 1 -- 172.21.15.59:0/1911200708 wait complete. 2023-10-08T12:47:22.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.915+0000 7f9ec7fff700 1 Processor -- start 2023-10-08T12:47:22.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.915+0000 7f9ec7fff700 1 -- start start 2023-10-08T12:47:22.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.915+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec0100730 0x7f9ec0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ec01010f0 0x7f9ec0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec0106740 0x7f9ec0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec7fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0074ac0 con 0x7f9ec0100730 2023-10-08T12:47:22.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec7fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec01a9520 con 0x7f9ec01010f0 2023-10-08T12:47:22.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec7fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec01a96e0 con 0x7f9ec0106740 2023-10-08T12:47:22.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec0106740 0x7f9ec0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec559a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ec01010f0 0x7f9ec0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec0106740 0x7f9ec0073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41872/0 (socket says 172.21.15.59:41872) 2023-10-08T12:47:22.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec659c700 1 -- 172.21.15.59:0/2176838750 learned_addr learned my addr 172.21.15.59:0/2176838750 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:22.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec0100730 0x7f9ec0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec659c700 1 -- 172.21.15.59:0/2176838750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ec01010f0 msgr2=0x7f9ec0073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:22.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec659c700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ec01010f0 0x7f9ec0073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec659c700 1 -- 172.21.15.59:0/2176838750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec0100730 msgr2=0x7f9ec0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:22.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec659c700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec0100730 0x7f9ec0072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec659c700 1 -- 172.21.15.59:0/2176838750 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb8009d00 con 0x7f9ec0106740 2023-10-08T12:47:22.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.916+0000 7f9ec659c700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec0106740 0x7f9ec0073570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800b070 tx=0x7f9eb80077f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:22.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.917+0000 7f9eb6ffd700 1 -- 172.21.15.59:0/2176838750 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800e040 con 0x7f9ec0106740 2023-10-08T12:47:22.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.917+0000 7f9eb6ffd700 1 -- 172.21.15.59:0/2176838750 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9eb80094c0 con 0x7f9ec0106740 2023-10-08T12:47:22.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.917+0000 7f9eb6ffd700 1 -- 172.21.15.59:0/2176838750 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80044e0 con 0x7f9ec0106740 2023-10-08T12:47:22.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.917+0000 7f9ec7fff700 1 -- 172.21.15.59:0/2176838750 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec01a9960 con 0x7f9ec0106740 2023-10-08T12:47:22.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.917+0000 7f9ec7fff700 1 -- 172.21.15.59:0/2176838750 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec01a9d90 con 0x7f9ec0106740 2023-10-08T12:47:22.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.923+0000 7f9eb6ffd700 1 -- 172.21.15.59:0/2176838750 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9eb8004640 con 0x7f9ec0106740 2023-10-08T12:47:22.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.923+0000 7f9edb9d4b80 1 Processor -- start 2023-10-08T12:47:22.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9edb9d4b80 1 -- start start 2023-10-08T12:47:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf282f00 0x5590cf2832e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf283820 0x5590cf28e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 0x5590cf290ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf1ec4e0 con 0x5590cf282f00 2023-10-08T12:47:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf1ddca0 con 0x5590cf283820 2023-10-08T12:47:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf1db5c0 con 0x5590cf28e6d0 2023-10-08T12:47:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9ec5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf283820 0x5590cf28e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9ec5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf283820 0x5590cf28e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38812/0 (socket says 172.21.15.59:38812) 2023-10-08T12:47:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9ec5d9b700 1 -- 172.21.15.59:0/4025849399 learned_addr learned my addr 172.21.15.59:0/4025849399 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9ec559a700 1 --2- 172.21.15.59:0/4025849399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf282f00 0x5590cf2832e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.924+0000 7f9eb6ffd700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9eac0a1740 0x7f9eac0a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9ec559a700 1 --2- 172.21.15.59:0/4025849399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 0x5590cf290ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9ec5d9b700 1 -- 172.21.15.59:0/4025849399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 msgr2=0x5590cf290ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:22.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/4025849399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 0x5590cf290ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9ec5d9b700 1 -- 172.21.15.59:0/4025849399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf282f00 msgr2=0x5590cf2832e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:22.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/4025849399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf282f00 0x5590cf2832e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9ec5d9b700 1 -- 172.21.15.59:0/4025849399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590cf001e60 con 0x5590cf283820 2023-10-08T12:47:22.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9ec559a700 1 --2- 172.21.15.59:0/4025849399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf282f00 0x5590cf2832e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:47:22.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9eb6ffd700 1 -- 172.21.15.59:0/2176838750 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9eb80cde50 con 0x7f9ec0106740 2023-10-08T12:47:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9ec659c700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9eac0a1740 0x7f9eac0a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/4025849399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf283820 0x5590cf28e190 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009d20 tx=0x7f9ebc0106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2015a039d73e6154 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9eabfff700 1 -- 172.21.15.59:0/4025849399 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0097c0 con 0x5590cf283820 2023-10-08T12:47:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9eabfff700 1 -- 172.21.15.59:0/4025849399 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ebc015070 con 0x5590cf283820 2023-10-08T12:47:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.925+0000 7f9eabfff700 1 -- 172.21.15.59:0/4025849399 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc019670 con 0x5590cf283820 2023-10-08T12:47:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.926+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/4025849399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf283820 msgr2=0x5590cf28e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.926+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/4025849399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf283820 0x5590cf28e190 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009d20 tx=0x7f9ebc0106b0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.926+0000 7f9ec659c700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9eac0a1740 0x7f9eac0a3c00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80979b0 tx=0x7f9eb8004f20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.926+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/4025849399 shutdown_connections 2023-10-08T12:47:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.926+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/4025849399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 0x5590cf290ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.926+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/4025849399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf282f00 0x5590cf2832e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.926+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/4025849399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf283820 0x5590cf28e190 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.926+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/4025849399 >> 172.21.15.59:0/4025849399 conn(0x5590cf1f82e0 msgr2=0x5590cf27f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.926+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/4025849399 shutdown_connections 2023-10-08T12:47:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.926+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/4025849399 wait complete. 2023-10-08T12:47:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.927+0000 7f9edb9d4b80 1 -- start start 2023-10-08T12:47:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.927+0000 7f9edb9d4b80 1 Processor -- start 2023-10-08T12:47:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf282f00 0x5590cf28e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf283820 0x5590cf28b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf28e6d0 0x5590cf28ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf1d6eb0 con 0x5590cf283820 2023-10-08T12:47:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf173790 con 0x5590cf28e6d0 2023-10-08T12:47:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf173430 con 0x5590cf282f00 2023-10-08T12:47:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9edb9d4b80 10 client.0 _ll_register_callbacks cb 0x5590cefd0880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9ec559a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf282f00 0x5590cf28e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9ec559a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf282f00 0x5590cf28e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41898/0 (socket says 172.21.15.59:41898) 2023-10-08T12:47:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9ec559a700 1 -- 172.21.15.59:0/2566743978 learned_addr learned my addr 172.21.15.59:0/2566743978 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf283820 0x5590cf28b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.928+0000 7f9ec559a700 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf28e6d0 0x5590cf28ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.929+0000 7f9ec559a700 1 -- 172.21.15.59:0/2566743978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf28e6d0 msgr2=0x5590cf28ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.929+0000 7f9ec559a700 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf28e6d0 0x5590cf28ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.929+0000 7f9ec559a700 1 -- 172.21.15.59:0/2566743978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf283820 msgr2=0x5590cf28b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.929+0000 7f9ec559a700 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf283820 0x5590cf28b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.929+0000 7f9ec559a700 1 -- 172.21.15.59:0/2566743978 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc009920 con 0x5590cf282f00 2023-10-08T12:47:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.929+0000 7f9ec559a700 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf282f00 0x5590cf28e070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0010e10 tx=0x7f9eb00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1091c063df951b8e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.929+0000 7f9ea97fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:47:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.929+0000 7f9ea97fa700 1 -- 172.21.15.59:0/2566743978 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0016070 con 0x5590cf282f00 2023-10-08T12:47:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.929+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/2566743978 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590cf19ef30 con 0x5590cf282f00 2023-10-08T12:47:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.929+0000 7f9ea97fa700 1 -- 172.21.15.59:0/2566743978 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9eb0010e40 con 0x5590cf282f00 2023-10-08T12:47:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.929+0000 7f9ea97fa700 1 -- 172.21.15.59:0/2566743978 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9eb0004030 con 0x5590cf282f00 2023-10-08T12:47:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.930+0000 7f9edb9d4b80 10 client.26308 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.930+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/2566743978 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5590cefeace0 con 0x5590cf282f00 2023-10-08T12:47:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.930+0000 7f9ea97fa700 1 -- 172.21.15.59:0/2566743978 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5590cf19ef30 con 0x5590cf282f00 2023-10-08T12:47:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.930+0000 7f9ea97fa700 1 -- 172.21.15.59:0/2566743978 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9eb0003c40 con 0x5590cf282f00 2023-10-08T12:47:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.930+0000 7f9edb9d4b80 10 client.26308 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.930+0000 7f9edb9d4b80 10 client.26308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.930+0000 7f9edb9d4b80 20 client.26308 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.930+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5590cf29e200 0x5590cf2a0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.930+0000 7f9edb9d4b80 4 client.26308 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:47:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.930+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/2566743978 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590cf1cfe90 con 0x5590cf29e200 2023-10-08T12:47:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.931+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5590cf29e200 0x5590cf2a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.931+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5590cf29e200 0x5590cf2a0620 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=693379613fff6d31 server_cookie=14f23fdb84b41f16 in_seq=0 out_seq=0 2023-10-08T12:47:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.931+0000 7f9ea97fa700 10 client.26308 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9ea97fa700 1 -- 172.21.15.59:0/2566743978 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5590cf1cfe90 con 0x5590cf29e200 2023-10-08T12:47:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9ea97fa700 10 client.26308 handle_command_reply: tid=0 2023-10-08T12:47:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9edb9d4b80 1 client.26308 shutdown 2023-10-08T12:47:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/2566743978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf282f00 msgr2=0x5590cf28e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf282f00 0x5590cf28e070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0010e10 tx=0x7f9eb00047c0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/2566743978 shutdown_connections 2023-10-08T12:47:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5590cf29e200 0x5590cf2a0620 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf28e6d0 0x5590cf28ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf282f00 0x5590cf28e070 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/2566743978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf283820 0x5590cf28b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/2566743978 >> 172.21.15.59:0/2566743978 conn(0x5590cf1f82e0 msgr2=0x5590cf27ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:22.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9ea97fa700 0 client.26308 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:22.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/2566743978 shutdown_connections 2023-10-08T12:47:22.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.932+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/2566743978 wait complete. 2023-10-08T12:47:22.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.933+0000 7f9edb9d4b80 20 client.26308 trim_cache size 0 max 16384 2023-10-08T12:47:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.952+0000 7f9edb9d4b80 1 Processor -- start 2023-10-08T12:47:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.952+0000 7f9edb9d4b80 1 -- start start 2023-10-08T12:47:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.953+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf282f00 0x5590cf295220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.953+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf283820 0x5590cf27eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.953+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf28e6d0 0x5590cf27f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.953+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf0579a0 con 0x5590cf28e6d0 2023-10-08T12:47:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.953+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf29ad00 con 0x5590cf282f00 2023-10-08T12:47:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.953+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf283c30 con 0x5590cf283820 2023-10-08T12:47:22.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.953+0000 7f9ec559a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf282f00 0x5590cf295220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.953+0000 7f9ec559a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf28e6d0 0x5590cf27f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.953+0000 7f9ec5d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf283820 0x5590cf27eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.953+0000 7f9ec559a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf282f00 0x5590cf295220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38832/0 (socket says 172.21.15.59:38832) 2023-10-08T12:47:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.954+0000 7f9ec559a700 1 -- 172.21.15.59:0/4150652228 learned_addr learned my addr 172.21.15.59:0/4150652228 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.954+0000 7f9ec5d9b700 1 -- 172.21.15.59:0/4150652228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf282f00 msgr2=0x5590cf295220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.954+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/4150652228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf282f00 0x5590cf295220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.954+0000 7f9ec5d9b700 1 -- 172.21.15.59:0/4150652228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf28e6d0 msgr2=0x5590cf27f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.954+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/4150652228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf28e6d0 0x5590cf27f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.954+0000 7f9ec5d9b700 1 -- 172.21.15.59:0/4150652228 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590cf0282d0 con 0x5590cf283820 2023-10-08T12:47:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.954+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/4150652228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf283820 0x5590cf27eda0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc010ab0 tx=0x7f9ebc011ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96f3757eb7825a18 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.954+0000 7f9eb4ff9700 1 -- 172.21.15.59:0/4150652228 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc010ec0 con 0x5590cf283820 2023-10-08T12:47:22.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.955+0000 7f9eb4ff9700 1 -- 172.21.15.59:0/4150652228 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ebc011cb0 con 0x5590cf283820 2023-10-08T12:47:22.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.955+0000 7f9eb4ff9700 1 -- 172.21.15.59:0/4150652228 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc005340 con 0x5590cf283820 2023-10-08T12:47:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.955+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/4150652228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf283820 msgr2=0x5590cf27eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.955+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/4150652228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf283820 0x5590cf27eda0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc010ab0 tx=0x7f9ebc011ef0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.955+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/4150652228 shutdown_connections 2023-10-08T12:47:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.955+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/4150652228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf282f00 0x5590cf295220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.955+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/4150652228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf28e6d0 0x5590cf27f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.955+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/4150652228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf283820 0x5590cf27eda0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.955+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/4150652228 >> 172.21.15.59:0/4150652228 conn(0x5590cf1f82e0 msgr2=0x5590cf2866d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.955+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/4150652228 shutdown_connections 2023-10-08T12:47:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.956+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/4150652228 wait complete. 2023-10-08T12:47:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.956+0000 7f9edb9d4b80 1 -- start start 2023-10-08T12:47:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.956+0000 7f9edb9d4b80 1 Processor -- start 2023-10-08T12:47:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.957+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf282f00 0x5590cf294550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.957+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf283820 0x5590cf294a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.957+0000 7f9edb9d4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 0x5590cf2eb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.957+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf2eb6c0 con 0x5590cf283820 2023-10-08T12:47:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.957+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf2eb830 con 0x5590cf282f00 2023-10-08T12:47:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.957+0000 7f9edb9d4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590cf2eb9f0 con 0x5590cf28e6d0 2023-10-08T12:47:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.957+0000 7f9edb9d4b80 10 client.0 _ll_register_callbacks cb 0x7f9eb0010b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.957+0000 7f9ec559a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 0x5590cf2eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.958+0000 7f9ec559a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 0x5590cf2eb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41910/0 (socket says 172.21.15.59:41910) 2023-10-08T12:47:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.958+0000 7f9ec559a700 1 -- 172.21.15.59:0/1601623320 learned_addr learned my addr 172.21.15.59:0/1601623320 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.958+0000 7f9ec559a700 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf282f00 0x5590cf294550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.958+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf283820 0x5590cf294a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.958+0000 7f9ec559a700 1 -- 172.21.15.59:0/1601623320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf282f00 msgr2=0x5590cf294550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.958+0000 7f9ec559a700 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf282f00 0x5590cf294550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.958+0000 7f9ec559a700 1 -- 172.21.15.59:0/1601623320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf283820 msgr2=0x5590cf294a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.958+0000 7f9ec559a700 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf283820 0x5590cf294a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.958+0000 7f9ec559a700 1 -- 172.21.15.59:0/1601623320 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc01e040 con 0x5590cf28e6d0 2023-10-08T12:47:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.959+0000 7f9ec559a700 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 0x5590cf2eb110 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009ec0 tx=0x7f9eb0009d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75a182d7a6a5d9b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.959+0000 7f9ea97fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:47:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.959+0000 7f9ea97fa700 1 -- 172.21.15.59:0/1601623320 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0016070 con 0x5590cf28e6d0 2023-10-08T12:47:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.959+0000 7f9ea97fa700 1 -- 172.21.15.59:0/1601623320 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9eb0026030 con 0x5590cf28e6d0 2023-10-08T12:47:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.959+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/1601623320 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ebc015070 con 0x5590cf28e6d0 2023-10-08T12:47:22.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.960+0000 7f9ea97fa700 1 -- 172.21.15.59:0/1601623320 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9eb0004200 con 0x5590cf28e6d0 2023-10-08T12:47:22.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.960+0000 7f9edb9d4b80 10 client.26314 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:22.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.960+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/1601623320 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5590cf000330 con 0x5590cf28e6d0 2023-10-08T12:47:22.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.960+0000 7f9ea97fa700 1 -- 172.21.15.59:0/1601623320 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ebc015070 con 0x5590cf28e6d0 2023-10-08T12:47:22.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.960+0000 7f9ea97fa700 1 -- 172.21.15.59:0/1601623320 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9eb00217c0 con 0x5590cf28e6d0 2023-10-08T12:47:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.961+0000 7f9edb9d4b80 10 client.26314 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.961+0000 7f9edb9d4b80 10 client.26314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.961+0000 7f9edb9d4b80 20 client.26314 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.961+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5590cf2f4270 0x5590cf2f6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.961+0000 7f9edb9d4b80 4 client.26314 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:47:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.961+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/1601623320 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5590cf1cfbb0 con 0x5590cf2f4270 2023-10-08T12:47:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.961+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5590cf2f4270 0x5590cf2f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.961+0000 7f9ec5d9b700 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5590cf2f4270 0x5590cf2f6660 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe65c4739cfb5f4 server_cookie=42ef8666eb049862 in_seq=0 out_seq=0 2023-10-08T12:47:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.961+0000 7f9ea97fa700 10 client.26314 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9ea97fa700 1 -- 172.21.15.59:0/1601623320 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5590cf1cfbb0 con 0x5590cf2f4270 2023-10-08T12:47:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9ea97fa700 10 client.26314 handle_command_reply: tid=0 2023-10-08T12:47:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9edb9d4b80 1 client.26314 shutdown 2023-10-08T12:47:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/1601623320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 msgr2=0x5590cf2eb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 0x5590cf2eb110 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009ec0 tx=0x7f9eb0009d50 comp rx=0 tx=0).stop 2023-10-08T12:47:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/1601623320 shutdown_connections 2023-10-08T12:47:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5590cf2f4270 0x5590cf2f6660 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590cf282f00 0x5590cf294550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590cf28e6d0 0x5590cf2eb110 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9ea97fa700 0 client.26314 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:22.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9edb9d4b80 1 --2- 172.21.15.59:0/1601623320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590cf283820 0x5590cf294a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.963+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/1601623320 >> 172.21.15.59:0/1601623320 conn(0x5590cf1f82e0 msgr2=0x5590cf2866d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:22.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.964+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/1601623320 shutdown_connections 2023-10-08T12:47:22.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.964+0000 7f9edb9d4b80 1 -- 172.21.15.59:0/1601623320 wait complete. 2023-10-08T12:47:22.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.964+0000 7f9edb9d4b80 20 client.26314 trim_cache size 0 max 16384 2023-10-08T12:47:22.966 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:47:22.966 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:47:22.967 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "f5732e32-485b-44f9-93ce-080b90898721", 2023-10-08T12:47:22.967 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:47:22.967 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:47:22.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 -- 172.21.15.59:0/2176838750 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9eac0a1740 msgr2=0x7f9eac0a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:22.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9eac0a1740 0x7f9eac0a3c00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80979b0 tx=0x7f9eb8004f20 comp rx=0 tx=0).stop 2023-10-08T12:47:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 -- 172.21.15.59:0/2176838750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec0106740 msgr2=0x7f9ec0073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec0106740 0x7f9ec0073570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800b070 tx=0x7f9eb80077f0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 -- 172.21.15.59:0/2176838750 shutdown_connections 2023-10-08T12:47:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9eac0a1740 0x7f9eac0a3c00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ec0106740 0x7f9ec0073570 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec0100730 0x7f9ec0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 --2- 172.21.15.59:0/2176838750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ec01010f0 0x7f9ec0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 -- 172.21.15.59:0/2176838750 >> 172.21.15.59:0/2176838750 conn(0x7f9ec00fc200 msgr2=0x7f9ec00fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 -- 172.21.15.59:0/2176838750 shutdown_connections 2023-10-08T12:47:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:22.965+0000 7f9ec7fff700 1 -- 172.21.15.59:0/2176838750 wait complete. 2023-10-08T12:47:22.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:47:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.216+0000 7f347abff700 1 -- 172.21.15.59:0/4203492942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3474072be0 msgr2=0x7f3474072fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.216+0000 7f347abff700 1 --2- 172.21.15.59:0/4203492942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3474072be0 0x7f3474072fc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3470009990 tx=0x7f3470009ca0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.216+0000 7f347abff700 1 -- 172.21.15.59:0/4203492942 shutdown_connections 2023-10-08T12:47:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.216+0000 7f347abff700 1 --2- 172.21.15.59:0/4203492942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3474072be0 0x7f3474072fc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.216+0000 7f347abff700 1 --2- 172.21.15.59:0/4203492942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f347410cfc0 0x7f347410f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.216+0000 7f347abff700 1 --2- 172.21.15.59:0/4203492942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3474073500 0x7f347410ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.216+0000 7f347abff700 1 -- 172.21.15.59:0/4203492942 >> 172.21.15.59:0/4203492942 conn(0x7f34740fc230 msgr2=0x7f34740fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:23.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.216+0000 7f347abff700 1 -- 172.21.15.59:0/4203492942 shutdown_connections 2023-10-08T12:47:23.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.216+0000 7f347abff700 1 -- 172.21.15.59:0/4203492942 wait complete. 2023-10-08T12:47:23.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.217+0000 7f347abff700 1 Processor -- start 2023-10-08T12:47:23.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.217+0000 7f347abff700 1 -- start start 2023-10-08T12:47:23.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.217+0000 7f347abff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3474072be0 0x7f3474198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.217+0000 7f347abff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3474073500 0x7f3474199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.217+0000 7f347abff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f347410cfc0 0x7f347419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.217+0000 7f347abff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347419dd70 con 0x7f347410cfc0 2023-10-08T12:47:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.217+0000 7f347abff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347419dee0 con 0x7f3474072be0 2023-10-08T12:47:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.217+0000 7f347abff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347419e0a0 con 0x7f3474073500 2023-10-08T12:47:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f347899b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3474072be0 0x7f3474198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f347899b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3474072be0 0x7f3474198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38852/0 (socket says 172.21.15.59:38852) 2023-10-08T12:47:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f347899b700 1 -- 172.21.15.59:0/1431546680 learned_addr learned my addr 172.21.15.59:0/1431546680 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f347919c700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f347410cfc0 0x7f347419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f346bfff700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3474073500 0x7f3474199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f347899b700 1 -- 172.21.15.59:0/1431546680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3474073500 msgr2=0x7f3474199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f347899b700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3474073500 0x7f3474199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f347899b700 1 -- 172.21.15.59:0/1431546680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f347410cfc0 msgr2=0x7f347419d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:23.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f347899b700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f347410cfc0 0x7f347419d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f347899b700 1 -- 172.21.15.59:0/1431546680 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009520 con 0x7f3474072be0 2023-10-08T12:47:23.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f346bfff700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3474073500 0x7f3474199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:47:23.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.218+0000 7f347899b700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3474072be0 0x7f3474198e50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3470005910 tx=0x7f3470004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.219+0000 7f3469ffb700 1 -- 172.21.15.59:0/1431546680 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347001d070 con 0x7f3474072be0 2023-10-08T12:47:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.219+0000 7f3469ffb700 1 -- 172.21.15.59:0/1431546680 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3470022470 con 0x7f3474072be0 2023-10-08T12:47:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.219+0000 7f3469ffb700 1 -- 172.21.15.59:0/1431546680 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3470017650 con 0x7f3474072be0 2023-10-08T12:47:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.219+0000 7f347abff700 1 -- 172.21.15.59:0/1431546680 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c009c40 con 0x7f3474072be0 2023-10-08T12:47:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.219+0000 7f347abff700 1 -- 172.21.15.59:0/1431546680 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34700095f0 con 0x7f3474072be0 2023-10-08T12:47:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.222+0000 7f3469ffb700 1 -- 172.21.15.59:0/1431546680 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f34700225e0 con 0x7f3474072be0 2023-10-08T12:47:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.224+0000 7f348e4e7b80 1 Processor -- start 2023-10-08T12:47:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.224+0000 7f348e4e7b80 1 -- start start 2023-10-08T12:47:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.224+0000 7f3469ffb700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f345c0a1670 0x7f345c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.224+0000 7f3469ffb700 1 -- 172.21.15.59:0/1431546680 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f34700ce200 con 0x7f3474072be0 2023-10-08T12:47:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.224+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde8e80 0x55e9bbde9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.224+0000 7f347919c700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f345c0a1670 0x7f345c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.224+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.224+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.224+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbd52460 con 0x55e9bbdf4650 2023-10-08T12:47:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.224+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbd43c20 con 0x55e9bbde97a0 2023-10-08T12:47:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.224+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbd41540 con 0x55e9bbde8e80 2023-10-08T12:47:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f347919c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f346bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f346bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38864/0 (socket says 172.21.15.59:38864) 2023-10-08T12:47:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f346bfff700 1 -- 172.21.15.59:0/2629843442 learned_addr learned my addr 172.21.15.59:0/2629843442 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f347919c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41980/0 (socket says 172.21.15.59:41980) 2023-10-08T12:47:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f347899b700 1 --2- 172.21.15.59:0/2629843442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde8e80 0x55e9bbde9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f346bfff700 1 -- 172.21.15.59:0/2629843442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde8e80 msgr2=0x55e9bbde9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f346bfff700 1 --2- 172.21.15.59:0/2629843442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde8e80 0x55e9bbde9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f346bfff700 1 -- 172.21.15.59:0/2629843442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbdf4650 msgr2=0x55e9bbdf6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f346bfff700 1 --2- 172.21.15.59:0/2629843442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f346bfff700 1 -- 172.21.15.59:0/2629843442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9bbb67de0 con 0x55e9bbde97a0 2023-10-08T12:47:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f347899b700 1 --2- 172.21.15.59:0/2629843442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde8e80 0x55e9bbde9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.225+0000 7f346bfff700 1 --2- 172.21.15.59:0/2629843442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf4110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3464009f40 tx=0x7f34640116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48adcc7df1e2e792 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.226+0000 7f347919c700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f345c0a1670 0x7f345c0a3b30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f346c009fd0 tx=0x7f346c00fdd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.226+0000 7f345affd700 1 -- 172.21.15.59:0/2629843442 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464011ee0 con 0x55e9bbde97a0 2023-10-08T12:47:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.226+0000 7f345affd700 1 -- 172.21.15.59:0/2629843442 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3464012910 con 0x55e9bbde97a0 2023-10-08T12:47:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.226+0000 7f345affd700 1 -- 172.21.15.59:0/2629843442 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346400f900 con 0x55e9bbde97a0 2023-10-08T12:47:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.226+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2629843442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 msgr2=0x55e9bbdf4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.226+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2629843442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf4110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3464009f40 tx=0x7f34640116c0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.226+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2629843442 shutdown_connections 2023-10-08T12:47:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.227+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2629843442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.227+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2629843442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde8e80 0x55e9bbde9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.227+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2629843442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf4110 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.227+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2629843442 >> 172.21.15.59:0/2629843442 conn(0x55e9bbd5e260 msgr2=0x55e9bbde52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.227+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2629843442 shutdown_connections 2023-10-08T12:47:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.227+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2629843442 wait complete. 2023-10-08T12:47:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.227+0000 7f348e4e7b80 1 -- start start 2023-10-08T12:47:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.228+0000 7f348e4e7b80 1 Processor -- start 2023-10-08T12:47:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.228+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbde8e80 0x55e9bbdf4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.228+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.228+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbd3ce30 con 0x55e9bbde8e80 2023-10-08T12:47:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbcd9710 con 0x55e9bbde97a0 2023-10-08T12:47:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbcd93b0 con 0x55e9bbdf4650 2023-10-08T12:47:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f348e4e7b80 10 client.0 _ll_register_callbacks cb 0x55e9bbb36800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f346bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f346bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38878/0 (socket says 172.21.15.59:38878) 2023-10-08T12:47:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f346bfff700 1 -- 172.21.15.59:0/2250754456 learned_addr learned my addr 172.21.15.59:0/2250754456 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f347899b700 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbde8e80 0x55e9bbdf4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f347919c700 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f346bfff700 1 -- 172.21.15.59:0/2250754456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbdf4650 msgr2=0x55e9bbdf1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f346bfff700 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f346bfff700 1 -- 172.21.15.59:0/2250754456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbde8e80 msgr2=0x55e9bbdf4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f346bfff700 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbde8e80 0x55e9bbdf4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f346bfff700 1 -- 172.21.15.59:0/2250754456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34700095f0 con 0x55e9bbde97a0 2023-10-08T12:47:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f346bfff700 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf1320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f346401c040 tx=0x7f3464012850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2d6ad146ca2fe98 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.229+0000 7f3453fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:47:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.230+0000 7f3453fff700 1 -- 172.21.15.59:0/2250754456 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464005240 con 0x55e9bbde97a0 2023-10-08T12:47:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.230+0000 7f3453fff700 1 -- 172.21.15.59:0/2250754456 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f34640053a0 con 0x55e9bbde97a0 2023-10-08T12:47:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.230+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2250754456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9bbd04eb0 con 0x55e9bbde97a0 2023-10-08T12:47:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.230+0000 7f3453fff700 1 -- 172.21.15.59:0/2250754456 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3464005560 con 0x55e9bbde97a0 2023-10-08T12:47:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.230+0000 7f348e4e7b80 10 client.26333 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.230+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2250754456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f3464009b40 con 0x55e9bbde97a0 2023-10-08T12:47:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.230+0000 7f3453fff700 1 -- 172.21.15.59:0/2250754456 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e9bbd04eb0 con 0x55e9bbde97a0 2023-10-08T12:47:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.231+0000 7f3453fff700 1 -- 172.21.15.59:0/2250754456 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3464004a60 con 0x55e9bbde97a0 2023-10-08T12:47:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.231+0000 7f348e4e7b80 10 client.26333 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.231+0000 7f348e4e7b80 10 client.26333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.231+0000 7f348e4e7b80 20 client.26333 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.231+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e9bbe0c7c0 0x55e9bbe0ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.231+0000 7f348e4e7b80 4 client.26333 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:47:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.231+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2250754456 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9bbd35e10 con 0x55e9bbe0c7c0 2023-10-08T12:47:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.231+0000 7f347899b700 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e9bbe0c7c0 0x55e9bbe0ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.231+0000 7f3453fff700 10 client.26333 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.231+0000 7f347899b700 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e9bbe0c7c0 0x55e9bbe0ebe0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef7db2228c80ed5 server_cookie=1660b39ff3df24db in_seq=0 out_seq=0 2023-10-08T12:47:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.232+0000 7f3453fff700 1 -- 172.21.15.59:0/2250754456 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e9bbd35e10 con 0x55e9bbe0c7c0 2023-10-08T12:47:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.232+0000 7f3453fff700 10 client.26333 handle_command_reply: tid=0 2023-10-08T12:47:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.232+0000 7f348e4e7b80 1 client.26333 shutdown 2023-10-08T12:47:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2250754456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 msgr2=0x55e9bbdf1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf1320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f346401c040 tx=0x7f3464012850 comp rx=0 tx=0).stop 2023-10-08T12:47:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2250754456 shutdown_connections 2023-10-08T12:47:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e9bbe0c7c0 0x55e9bbe0ebe0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f3453fff700 0 client.26333 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbde8e80 0x55e9bbdf4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2250754456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf1320 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2250754456 >> 172.21.15.59:0/2250754456 conn(0x55e9bbd5e260 msgr2=0x55e9bbde4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2250754456 shutdown_connections 2023-10-08T12:47:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2250754456 wait complete. 2023-10-08T12:47:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.233+0000 7f348e4e7b80 20 client.26333 trim_cache size 0 max 16384 2023-10-08T12:47:23.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.254+0000 7f348e4e7b80 1 Processor -- start 2023-10-08T12:47:23.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.254+0000 7f348e4e7b80 1 -- start start 2023-10-08T12:47:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.254+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde8e80 0x55e9bbdf1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.254+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbde97a0 0x55e9bbdfb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.254+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbdf4650 0x55e9bbdefbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.254+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbbbd920 con 0x55e9bbde97a0 2023-10-08T12:47:23.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.254+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbddcbe0 con 0x55e9bbdf4650 2023-10-08T12:47:23.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.254+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbdea0d0 con 0x55e9bbde8e80 2023-10-08T12:47:23.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.254+0000 7f347919c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbdf4650 0x55e9bbdefbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.254+0000 7f347919c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbdf4650 0x55e9bbdefbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38882/0 (socket says 172.21.15.59:38882) 2023-10-08T12:47:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.255+0000 7f347919c700 1 -- 172.21.15.59:0/3379509854 learned_addr learned my addr 172.21.15.59:0/3379509854 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.255+0000 7f346bfff700 1 --2- 172.21.15.59:0/3379509854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbde97a0 0x55e9bbdfb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.255+0000 7f347899b700 1 --2- 172.21.15.59:0/3379509854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde8e80 0x55e9bbdf1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.255+0000 7f347919c700 1 -- 172.21.15.59:0/3379509854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde8e80 msgr2=0x55e9bbdf1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.255+0000 7f347919c700 1 --2- 172.21.15.59:0/3379509854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde8e80 0x55e9bbdf1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.255+0000 7f347919c700 1 -- 172.21.15.59:0/3379509854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbde97a0 msgr2=0x55e9bbdfb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.255+0000 7f347919c700 1 --2- 172.21.15.59:0/3379509854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbde97a0 0x55e9bbdfb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.255+0000 7f347919c700 1 -- 172.21.15.59:0/3379509854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9bbb50c60 con 0x55e9bbdf4650 2023-10-08T12:47:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.255+0000 7f346bfff700 1 --2- 172.21.15.59:0/3379509854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbde97a0 0x55e9bbdfb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.255+0000 7f347919c700 1 --2- 172.21.15.59:0/3379509854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbdf4650 0x55e9bbdefbf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f346c003c90 tx=0x7f346c01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40119571848f8fa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.256+0000 7f345b7fe700 1 -- 172.21.15.59:0/3379509854 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c00e040 con 0x55e9bbdf4650 2023-10-08T12:47:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.256+0000 7f345b7fe700 1 -- 172.21.15.59:0/3379509854 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f346c00f040 con 0x55e9bbdf4650 2023-10-08T12:47:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.256+0000 7f345b7fe700 1 -- 172.21.15.59:0/3379509854 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c004780 con 0x55e9bbdf4650 2023-10-08T12:47:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.256+0000 7f348e4e7b80 1 -- 172.21.15.59:0/3379509854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbdf4650 msgr2=0x55e9bbdefbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.256+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/3379509854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbdf4650 0x55e9bbdefbf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f346c003c90 tx=0x7f346c01f000 comp rx=0 tx=0).stop 2023-10-08T12:47:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.256+0000 7f348e4e7b80 1 -- 172.21.15.59:0/3379509854 shutdown_connections 2023-10-08T12:47:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.256+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/3379509854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbdf4650 0x55e9bbdefbf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.256+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/3379509854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde8e80 0x55e9bbdf1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.256+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/3379509854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbde97a0 0x55e9bbdfb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.256+0000 7f348e4e7b80 1 -- 172.21.15.59:0/3379509854 >> 172.21.15.59:0/3379509854 conn(0x55e9bbd5e260 msgr2=0x55e9bbde44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.257+0000 7f348e4e7b80 1 -- 172.21.15.59:0/3379509854 shutdown_connections 2023-10-08T12:47:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.257+0000 7f348e4e7b80 1 -- 172.21.15.59:0/3379509854 wait complete. 2023-10-08T12:47:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.257+0000 7f348e4e7b80 1 -- start start 2023-10-08T12:47:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.257+0000 7f348e4e7b80 1 Processor -- start 2023-10-08T12:47:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde8e80 0x55e9bbdfaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f348e4e7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbdf9e40 con 0x55e9bbdf4650 2023-10-08T12:47:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbdf9f80 con 0x55e9bbde8e80 2023-10-08T12:47:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f348e4e7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bbdfa140 con 0x55e9bbde97a0 2023-10-08T12:47:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f348e4e7b80 10 client.0 _ll_register_callbacks cb 0x7f346c01e050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f347899b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde8e80 0x55e9bbdfaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f347899b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde8e80 0x55e9bbdfaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38896/0 (socket says 172.21.15.59:38896) 2023-10-08T12:47:23.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f347899b700 1 -- 172.21.15.59:0/2202665038 learned_addr learned my addr 172.21.15.59:0/2202665038 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:23.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f346bfff700 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.258+0000 7f347919c700 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f347899b700 1 -- 172.21.15.59:0/2202665038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde97a0 msgr2=0x55e9bbdf92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f347899b700 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f347899b700 1 -- 172.21.15.59:0/2202665038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbdf4650 msgr2=0x55e9bbdf9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f347899b700 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f347899b700 1 -- 172.21.15.59:0/2202665038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3464009b40 con 0x55e9bbde8e80 2023-10-08T12:47:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f347899b700 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde8e80 0x55e9bbdfaef0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f347009b220 tx=0x7f3470022cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=427b1eceb85bddfb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f3453fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:47:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f3453fff700 1 -- 172.21.15.59:0/2202665038 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3470095ea0 con 0x55e9bbde8e80 2023-10-08T12:47:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2202665038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3464012910 con 0x55e9bbde8e80 2023-10-08T12:47:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f3453fff700 1 -- 172.21.15.59:0/2202665038 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f347009b990 con 0x55e9bbde8e80 2023-10-08T12:47:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f3453fff700 1 -- 172.21.15.59:0/2202665038 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f347009b290 con 0x55e9bbde8e80 2023-10-08T12:47:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f348e4e7b80 10 client.26339 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.259+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2202665038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f346c003a00 con 0x55e9bbde8e80 2023-10-08T12:47:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.260+0000 7f3453fff700 1 -- 172.21.15.59:0/2202665038 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3464012910 con 0x55e9bbde8e80 2023-10-08T12:47:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.260+0000 7f3453fff700 1 -- 172.21.15.59:0/2202665038 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f347009b4f0 con 0x55e9bbde8e80 2023-10-08T12:47:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.260+0000 7f348e4e7b80 10 client.26339 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.260+0000 7f348e4e7b80 10 client.26339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.260+0000 7f348e4e7b80 20 client.26339 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.260+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e9bbe618f0 0x55e9bbe63ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.260+0000 7f348e4e7b80 4 client.26339 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:47:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.260+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2202665038 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e9bbd35b30 con 0x55e9bbe618f0 2023-10-08T12:47:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.260+0000 7f346bfff700 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e9bbe618f0 0x55e9bbe63ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.261+0000 7f346bfff700 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e9bbe618f0 0x55e9bbe63ce0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8242afc4c73aad75 server_cookie=d94c3c36d2dcfc48 in_seq=0 out_seq=0 2023-10-08T12:47:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.261+0000 7f3453fff700 10 client.26339 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f3453fff700 1 -- 172.21.15.59:0/2202665038 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e9bbd35b30 con 0x55e9bbe618f0 2023-10-08T12:47:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f3453fff700 10 client.26339 handle_command_reply: tid=0 2023-10-08T12:47:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 1 client.26339 shutdown 2023-10-08T12:47:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2202665038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde8e80 msgr2=0x55e9bbdfaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde8e80 0x55e9bbdfaef0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f347009b220 tx=0x7f3470022cb0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2202665038 shutdown_connections 2023-10-08T12:47:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e9bbe618f0 0x55e9bbe63ce0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9bbde8e80 0x55e9bbdfaef0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9bbdf4650 0x55e9bbdf9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f3453fff700 0 client.26339 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 1 --2- 172.21.15.59:0/2202665038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9bbde97a0 0x55e9bbdf92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2202665038 >> 172.21.15.59:0/2202665038 conn(0x55e9bbd5e260 msgr2=0x55e9bbdefb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2202665038 shutdown_connections 2023-10-08T12:47:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 1 -- 172.21.15.59:0/2202665038 wait complete. 2023-10-08T12:47:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.262+0000 7f348e4e7b80 20 client.26339 trim_cache size 0 max 16384 2023-10-08T12:47:23.270 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:47:23.271 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:47:23.271 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:47:23.271 INFO:teuthology.orchestra.run.smithi059.stdout: "f5732e32-485b-44f9-93ce-080b90898721": { 2023-10-08T12:47:23.271 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:47:23.271 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "f5732e32-485b-44f9-93ce-080b90898721", 2023-10-08T12:47:23.271 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:47:23.271 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:47:23.271 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:47:23.271 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:47:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 -- 172.21.15.59:0/1431546680 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f345c0a1670 msgr2=0x7f345c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f345c0a1670 0x7f345c0a3b30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f346c009fd0 tx=0x7f346c00fdd0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 -- 172.21.15.59:0/1431546680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3474072be0 msgr2=0x7f3474198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3474072be0 0x7f3474198e50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3470005910 tx=0x7f3470004730 comp rx=0 tx=0).stop 2023-10-08T12:47:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 -- 172.21.15.59:0/1431546680 shutdown_connections 2023-10-08T12:47:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f345c0a1670 0x7f345c0a3b30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3474072be0 0x7f3474198e50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f347410cfc0 0x7f347419d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 --2- 172.21.15.59:0/1431546680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3474073500 0x7f3474199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:23.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 -- 172.21.15.59:0/1431546680 >> 172.21.15.59:0/1431546680 conn(0x7f34740fc230 msgr2=0x7f34740fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:23.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 -- 172.21.15.59:0/1431546680 shutdown_connections 2023-10-08T12:47:23.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:23.263+0000 7f347abff700 1 -- 172.21.15.59:0/1431546680 wait complete. 2023-10-08T12:47:23.284 INFO:tasks.cephfs.filesystem:scrub status for tag:f5732e32-485b-44f9-93ce-080b90898721 - {'path': '/', 'tag': 'f5732e32-485b-44f9-93ce-080b90898721', 'options': 'recursive,force'} 2023-10-08T12:47:23.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 760335 13.64 MB/sec execute 174 sec latency 70.861 ms 2023-10-08T12:47:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:23 smithi173 ceph-mon[135182]: pgmap v500: 97 pgs: 97 active+clean; 406 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 261 op/s 2023-10-08T12:47:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:23 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:47:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:23 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:23 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:47:24.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:23 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:24.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:23 smithi059 ceph-mon[98489]: pgmap v500: 97 pgs: 97 active+clean; 406 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 261 op/s 2023-10-08T12:47:24.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:23 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:47:24.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:23 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:24.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:23 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:47:24.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:23 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:23 smithi092 ceph-mon[134093]: pgmap v500: 97 pgs: 97 active+clean; 406 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 261 op/s 2023-10-08T12:47:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:23 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:47:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:23 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:23 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:47:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:23 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:24.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 763525 13.66 MB/sec execute 175 sec latency 7.113 ms 2023-10-08T12:47:25.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 765864 13.63 MB/sec execute 176 sec latency 17.603 ms 2023-10-08T12:47:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:25 smithi173 ceph-mon[135182]: pgmap v501: 97 pgs: 97 active+clean; 413 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 245 op/s 2023-10-08T12:47:26.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:25 smithi059 ceph-mon[98489]: pgmap v501: 97 pgs: 97 active+clean; 413 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 245 op/s 2023-10-08T12:47:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:25 smithi092 ceph-mon[134093]: pgmap v501: 97 pgs: 97 active+clean; 413 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 245 op/s 2023-10-08T12:47:26.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 768140 13.64 MB/sec execute 177 sec latency 8.038 ms 2023-10-08T12:47:27.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 770319 13.63 MB/sec execute 178 sec latency 232.344 ms 2023-10-08T12:47:28.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:27 smithi173 ceph-mon[135182]: pgmap v502: 97 pgs: 97 active+clean; 414 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 271 op/s 2023-10-08T12:47:28.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:27 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:47:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:27 smithi059 ceph-mon[98489]: pgmap v502: 97 pgs: 97 active+clean; 414 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 271 op/s 2023-10-08T12:47:28.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:27 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:47:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:27 smithi092 ceph-mon[134093]: pgmap v502: 97 pgs: 97 active+clean; 414 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 271 op/s 2023-10-08T12:47:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:27 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:47:28.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 772748 13.61 MB/sec execute 179 sec latency 31.371 ms 2023-10-08T12:47:29.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 775180 13.62 MB/sec execute 180 sec latency 8.471 ms 2023-10-08T12:47:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:29 smithi092 ceph-mon[134093]: pgmap v503: 97 pgs: 97 active+clean; 413 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 230 op/s 2023-10-08T12:47:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:29 smithi173 ceph-mon[135182]: pgmap v503: 97 pgs: 97 active+clean; 413 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 230 op/s 2023-10-08T12:47:30.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:29 smithi059 ceph-mon[98489]: pgmap v503: 97 pgs: 97 active+clean; 413 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 230 op/s 2023-10-08T12:47:30.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 778001 13.64 MB/sec execute 181 sec latency 18.645 ms 2023-10-08T12:47:31.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 780949 13.65 MB/sec execute 182 sec latency 10.483 ms 2023-10-08T12:47:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:31 smithi173 ceph-mon[135182]: pgmap v504: 97 pgs: 97 active+clean; 418 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 239 op/s 2023-10-08T12:47:32.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:31 smithi059 ceph-mon[98489]: pgmap v504: 97 pgs: 97 active+clean; 418 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 239 op/s 2023-10-08T12:47:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:31 smithi092 ceph-mon[134093]: pgmap v504: 97 pgs: 97 active+clean; 418 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 239 op/s 2023-10-08T12:47:32.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 782360 13.61 MB/sec execute 183 sec latency 72.713 ms 2023-10-08T12:47:33.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 785090 13.63 MB/sec execute 184 sec latency 22.801 ms 2023-10-08T12:47:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:33 smithi173 ceph-mon[135182]: pgmap v505: 97 pgs: 97 active+clean; 423 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 252 op/s 2023-10-08T12:47:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:33 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:47:34.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:33 smithi059 ceph-mon[98489]: pgmap v505: 97 pgs: 97 active+clean; 423 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 252 op/s 2023-10-08T12:47:34.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:33 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:47:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:33 smithi092 ceph-mon[134093]: pgmap v505: 97 pgs: 97 active+clean; 423 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 252 op/s 2023-10-08T12:47:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:33 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:47:34.516 INFO:tasks.workunit.client.0.smithi059.stdout: 1 787613 13.62 MB/sec execute 185 sec latency 25.315 ms 2023-10-08T12:47:35.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:34 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:47:35.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:34 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:47:35.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:34 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:47:35.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:34 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:47:35.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:34 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:47:35.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:34 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:47:35.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:34 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:47:35.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:34 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:47:35.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:34 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:47:35.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 790185 13.61 MB/sec execute 186 sec latency 13.020 ms 2023-10-08T12:47:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:35 smithi173 ceph-mon[135182]: pgmap v506: 97 pgs: 97 active+clean; 427 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2023-10-08T12:47:36.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:35 smithi059 ceph-mon[98489]: pgmap v506: 97 pgs: 97 active+clean; 427 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2023-10-08T12:47:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:35 smithi092 ceph-mon[134093]: pgmap v506: 97 pgs: 97 active+clean; 427 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 266 op/s 2023-10-08T12:47:36.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 792675 13.62 MB/sec execute 187 sec latency 9.383 ms 2023-10-08T12:47:37.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 795541 13.64 MB/sec execute 188 sec latency 56.796 ms 2023-10-08T12:47:38.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:37 smithi059 ceph-mon[98489]: pgmap v507: 97 pgs: 97 active+clean; 427 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 229 op/s 2023-10-08T12:47:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:37 smithi092 ceph-mon[134093]: pgmap v507: 97 pgs: 97 active+clean; 427 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 229 op/s 2023-10-08T12:47:38.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:37 smithi173 ceph-mon[135182]: pgmap v507: 97 pgs: 97 active+clean; 427 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 229 op/s 2023-10-08T12:47:38.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 797880 13.61 MB/sec execute 189 sec latency 28.776 ms 2023-10-08T12:47:39.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 800094 13.61 MB/sec execute 190 sec latency 56.141 ms 2023-10-08T12:47:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:39 smithi092 ceph-mon[134093]: pgmap v508: 97 pgs: 97 active+clean; 435 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 266 op/s 2023-10-08T12:47:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:39 smithi173 ceph-mon[135182]: pgmap v508: 97 pgs: 97 active+clean; 435 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 266 op/s 2023-10-08T12:47:40.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:39 smithi059 ceph-mon[98489]: pgmap v508: 97 pgs: 97 active+clean; 435 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 266 op/s 2023-10-08T12:47:40.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 803005 13.63 MB/sec execute 191 sec latency 7.963 ms 2023-10-08T12:47:41.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 806094 13.65 MB/sec execute 192 sec latency 19.999 ms 2023-10-08T12:47:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:41 smithi173 ceph-mon[135182]: pgmap v509: 97 pgs: 97 active+clean; 436 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 270 op/s 2023-10-08T12:47:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:41 smithi059 ceph-mon[98489]: pgmap v509: 97 pgs: 97 active+clean; 436 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 270 op/s 2023-10-08T12:47:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:41 smithi092 ceph-mon[134093]: pgmap v509: 97 pgs: 97 active+clean; 436 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 270 op/s 2023-10-08T12:47:42.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 808409 13.62 MB/sec execute 193 sec latency 43.797 ms 2023-10-08T12:47:43.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 810234 13.62 MB/sec execute 194 sec latency 64.280 ms 2023-10-08T12:47:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:43 smithi173 ceph-mon[135182]: pgmap v510: 97 pgs: 97 active+clean; 447 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 311 op/s 2023-10-08T12:47:44.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:43 smithi059 ceph-mon[98489]: pgmap v510: 97 pgs: 97 active+clean; 447 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 311 op/s 2023-10-08T12:47:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:43 smithi092 ceph-mon[134093]: pgmap v510: 97 pgs: 97 active+clean; 447 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 311 op/s 2023-10-08T12:47:44.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 813296 13.64 MB/sec execute 195 sec latency 9.222 ms 2023-10-08T12:47:45.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 815763 13.63 MB/sec execute 196 sec latency 29.599 ms 2023-10-08T12:47:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:45 smithi173 ceph-mon[135182]: pgmap v511: 97 pgs: 97 active+clean; 450 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 281 op/s 2023-10-08T12:47:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:45 smithi059 ceph-mon[98489]: pgmap v511: 97 pgs: 97 active+clean; 450 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 281 op/s 2023-10-08T12:47:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:45 smithi092 ceph-mon[134093]: pgmap v511: 97 pgs: 97 active+clean; 450 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 281 op/s 2023-10-08T12:47:46.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 818003 13.63 MB/sec execute 197 sec latency 7.456 ms 2023-10-08T12:47:47.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 820728 13.63 MB/sec execute 198 sec latency 7.074 ms 2023-10-08T12:47:48.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:47 smithi059 ceph-mon[98489]: pgmap v512: 97 pgs: 97 active+clean; 450 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 261 op/s 2023-10-08T12:47:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:47 smithi092 ceph-mon[134093]: pgmap v512: 97 pgs: 97 active+clean; 450 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 261 op/s 2023-10-08T12:47:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:47 smithi173 ceph-mon[135182]: pgmap v512: 97 pgs: 97 active+clean; 450 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 261 op/s 2023-10-08T12:47:48.517 INFO:tasks.workunit.client.0.smithi059.stdout: 1 823148 13.62 MB/sec execute 199 sec latency 68.155 ms 2023-10-08T12:47:49.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 824351 13.59 MB/sec execute 200 sec latency 393.880 ms 2023-10-08T12:47:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:49 smithi092 ceph-mon[134093]: pgmap v513: 97 pgs: 97 active+clean; 453 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 286 op/s 2023-10-08T12:47:50.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:49 smithi173 ceph-mon[135182]: pgmap v513: 97 pgs: 97 active+clean; 453 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 286 op/s 2023-10-08T12:47:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:49 smithi059 ceph-mon[98489]: pgmap v513: 97 pgs: 97 active+clean; 453 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 286 op/s 2023-10-08T12:47:50.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 827020 13.59 MB/sec execute 201 sec latency 445.279 ms 2023-10-08T12:47:51.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 829575 13.58 MB/sec execute 202 sec latency 8.028 ms 2023-10-08T12:47:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:51 smithi173 ceph-mon[135182]: pgmap v514: 97 pgs: 97 active+clean; 454 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 242 op/s 2023-10-08T12:47:52.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:51 smithi059 ceph-mon[98489]: pgmap v514: 97 pgs: 97 active+clean; 454 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 242 op/s 2023-10-08T12:47:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:51 smithi092 ceph-mon[134093]: pgmap v514: 97 pgs: 97 active+clean; 454 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 242 op/s 2023-10-08T12:47:52.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 831939 13.59 MB/sec execute 203 sec latency 8.689 ms 2023-10-08T12:47:53.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:47:53.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.512+0000 7f9497fff700 1 -- 172.21.15.59:0/3930576330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9498102050 msgr2=0x7f949810a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.512+0000 7f9497fff700 1 --2- 172.21.15.59:0/3930576330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9498102050 0x7f949810a530 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f948c0098f0 tx=0x7f948c009c00 comp rx=0 tx=0).stop 2023-10-08T12:47:53.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.512+0000 7f9497fff700 1 -- 172.21.15.59:0/3930576330 shutdown_connections 2023-10-08T12:47:53.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.512+0000 7f9497fff700 1 --2- 172.21.15.59:0/3930576330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9498101730 0x7f9498101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.512+0000 7f9497fff700 1 --2- 172.21.15.59:0/3930576330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f949810ab50 0x7f949810d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.512+0000 7f9497fff700 1 --2- 172.21.15.59:0/3930576330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9498102050 0x7f949810a530 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.512+0000 7f9497fff700 1 -- 172.21.15.59:0/3930576330 >> 172.21.15.59:0/3930576330 conn(0x7f94980faf50 msgr2=0x7f94980fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:53.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.512+0000 7f9497fff700 1 -- 172.21.15.59:0/3930576330 shutdown_connections 2023-10-08T12:47:53.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.512+0000 7f9497fff700 1 -- 172.21.15.59:0/3930576330 wait complete. 2023-10-08T12:47:53.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.513+0000 7f9497fff700 1 Processor -- start 2023-10-08T12:47:53.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.513+0000 7f9497fff700 1 -- start start 2023-10-08T12:47:53.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.514+0000 7f9497fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9498101730 0x7f949819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.514+0000 7f9497fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9498102050 0x7f949819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.514+0000 7f9497fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949810ab50 0x7f9498198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.514+0000 7f9497fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94981991b0 con 0x7f9498101730 2023-10-08T12:47:53.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.514+0000 7f9497fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9498199320 con 0x7f949810ab50 2023-10-08T12:47:53.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.514+0000 7f9497fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94981994e0 con 0x7f9498102050 2023-10-08T12:47:53.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.514+0000 7f9496ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9498101730 0x7f949819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.514+0000 7f94967fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9498102050 0x7f949819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.514+0000 7f9496ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9498101730 0x7f949819e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51562/0 (socket says 172.21.15.59:51562) 2023-10-08T12:47:53.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.514+0000 7f9496ffd700 1 -- 172.21.15.59:0/2474193430 learned_addr learned my addr 172.21.15.59:0/2474193430 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:53.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.514+0000 7f94977fe700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949810ab50 0x7f9498198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.515+0000 7f94967fc700 1 -- 172.21.15.59:0/2474193430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949810ab50 msgr2=0x7f9498198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.515+0000 7f94967fc700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949810ab50 0x7f9498198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.515+0000 7f94967fc700 1 -- 172.21.15.59:0/2474193430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9498101730 msgr2=0x7f949819e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.515+0000 7f94967fc700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9498101730 0x7f949819e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.515+0000 7f94967fc700 1 -- 172.21.15.59:0/2474193430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c009520 con 0x7f9498102050 2023-10-08T12:47:53.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.515+0000 7f94967fc700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9498102050 0x7f949819ef10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f948c009fd0 tx=0x7f948c00f950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:53.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.515+0000 7f949c9fd700 1 -- 172.21.15.59:0/2474193430 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c01c070 con 0x7f9498102050 2023-10-08T12:47:53.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.515+0000 7f949c9fd700 1 -- 172.21.15.59:0/2474193430 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f948c00ba20 con 0x7f9498102050 2023-10-08T12:47:53.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.515+0000 7f9497fff700 1 -- 172.21.15.59:0/2474193430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9498199760 con 0x7f9498102050 2023-10-08T12:47:53.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.516+0000 7f949c9fd700 1 -- 172.21.15.59:0/2474193430 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c003680 con 0x7f9498102050 2023-10-08T12:47:53.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.516+0000 7f9497fff700 1 -- 172.21.15.59:0/2474193430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94981a59c0 con 0x7f9498102050 2023-10-08T12:47:53.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 834542 13.60 MB/sec execute 204 sec latency 52.421 ms 2023-10-08T12:47:53.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.519+0000 7f949c9fd700 1 -- 172.21.15.59:0/2474193430 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f948c020030 con 0x7f9498102050 2023-10-08T12:47:53.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.520+0000 7f94b12beb80 1 Processor -- start 2023-10-08T12:47:53.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.520+0000 7f94b12beb80 1 -- start start 2023-10-08T12:47:53.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f949c9fd700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94800a15f0 0x7f94800a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8050 0x561fd5aa8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5ab32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f949c9fd700 1 -- 172.21.15.59:0/2474193430 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f948c0cdfa0 con 0x7f9498102050 2023-10-08T12:47:53.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f94b12beb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5a11460 con 0x561fd5aa8050 2023-10-08T12:47:53.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f94b12beb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5a02c20 con 0x561fd5aa8970 2023-10-08T12:47:53.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f94b12beb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5a00540 con 0x561fd5ab3800 2023-10-08T12:47:53.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f94977fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f94977fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:55916/0 (socket says 172.21.15.59:55916) 2023-10-08T12:47:53.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f94977fe700 1 -- 172.21.15.59:0/2572776155 learned_addr learned my addr 172.21.15.59:0/2572776155 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:53.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f9496ffd700 1 --2- 172.21.15.59:0/2572776155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8050 0x561fd5aa8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f94977fe700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94800a15f0 0x7f94800a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.521+0000 7f94967fc700 1 --2- 172.21.15.59:0/2572776155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5ab32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.522+0000 7f94977fe700 1 -- 172.21.15.59:0/2572776155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 msgr2=0x561fd5ab32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:53.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.522+0000 7f94977fe700 1 --2- 172.21.15.59:0/2572776155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5ab32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.522+0000 7f94977fe700 1 -- 172.21.15.59:0/2572776155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8050 msgr2=0x561fd5aa8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:53.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.522+0000 7f94977fe700 1 --2- 172.21.15.59:0/2572776155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8050 0x561fd5aa8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.522+0000 7f94977fe700 1 -- 172.21.15.59:0/2572776155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fd5826de0 con 0x561fd5ab3800 2023-10-08T12:47:53.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.522+0000 7f94977fe700 1 --2- 172.21.15.59:0/2572776155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab5bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9490008fa0 tx=0x7f949001a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d31c2b38732bc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:53.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.522+0000 7f94977fe700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94800a15f0 0x7f94800a3ab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9490009fd0 tx=0x7f949000e000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:53.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.522+0000 7f947dffb700 1 -- 172.21.15.59:0/2572776155 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949000e070 con 0x561fd5ab3800 2023-10-08T12:47:53.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.522+0000 7f947dffb700 1 -- 172.21.15.59:0/2572776155 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f949001f070 con 0x561fd5ab3800 2023-10-08T12:47:53.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.522+0000 7f947dffb700 1 -- 172.21.15.59:0/2572776155 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949001bce0 con 0x561fd5ab3800 2023-10-08T12:47:53.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.523+0000 7f94b12beb80 1 -- 172.21.15.59:0/2572776155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 msgr2=0x561fd5ab5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.523+0000 7f94b12beb80 1 --2- 172.21.15.59:0/2572776155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab5bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9490008fa0 tx=0x7f949001a6c0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.523+0000 7f94b12beb80 1 -- 172.21.15.59:0/2572776155 shutdown_connections 2023-10-08T12:47:53.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.523+0000 7f94b12beb80 1 --2- 172.21.15.59:0/2572776155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab5bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.523+0000 7f94b12beb80 1 --2- 172.21.15.59:0/2572776155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8050 0x561fd5aa8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.523+0000 7f94b12beb80 1 --2- 172.21.15.59:0/2572776155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5ab32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.523+0000 7f94b12beb80 1 -- 172.21.15.59:0/2572776155 >> 172.21.15.59:0/2572776155 conn(0x561fd5a1d260 msgr2=0x561fd5aa4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:53.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.523+0000 7f94b12beb80 1 -- 172.21.15.59:0/2572776155 shutdown_connections 2023-10-08T12:47:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.524+0000 7f94b12beb80 1 -- 172.21.15.59:0/2572776155 wait complete. 2023-10-08T12:47:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.524+0000 7f94b12beb80 1 -- start start 2023-10-08T12:47:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.524+0000 7f94b12beb80 1 Processor -- start 2023-10-08T12:47:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8050 0x561fd5ab0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8970 0x561fd5ab0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f94b12beb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd59fbe30 con 0x561fd5aa8970 2023-10-08T12:47:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f94b12beb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5998710 con 0x561fd5aa8050 2023-10-08T12:47:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f94b12beb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd59983b0 con 0x561fd5ab3800 2023-10-08T12:47:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f94b12beb80 10 client.0 _ll_register_callbacks cb 0x561fd57f5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f9496ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8050 0x561fd5ab0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f9496ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8050 0x561fd5ab0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51000/0 (socket says 172.21.15.59:51000) 2023-10-08T12:47:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f9496ffd700 1 -- 172.21.15.59:0/4248625730 learned_addr learned my addr 172.21.15.59:0/4248625730 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f94977fe700 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f94967fc700 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8970 0x561fd5ab0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f9496ffd700 1 -- 172.21.15.59:0/4248625730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 msgr2=0x561fd5ab1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f9496ffd700 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f9496ffd700 1 -- 172.21.15.59:0/4248625730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8970 msgr2=0x561fd5ab0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f9496ffd700 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8970 0x561fd5ab0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.525+0000 7f9496ffd700 1 -- 172.21.15.59:0/4248625730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9490008b50 con 0x561fd5aa8050 2023-10-08T12:47:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.526+0000 7f9496ffd700 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8050 0x561fd5ab0690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f94880128d0 tx=0x7f9488012be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=828351e96ce239c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.526+0000 7f9476ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:47:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.526+0000 7f9476ffd700 1 -- 172.21.15.59:0/4248625730 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488017070 con 0x561fd5aa8050 2023-10-08T12:47:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.526+0000 7f94b12beb80 1 -- 172.21.15.59:0/4248625730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fd59c3eb0 con 0x561fd5aa8050 2023-10-08T12:47:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.526+0000 7f9476ffd700 1 -- 172.21.15.59:0/4248625730 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9488004020 con 0x561fd5aa8050 2023-10-08T12:47:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.526+0000 7f9476ffd700 1 -- 172.21.15.59:0/4248625730 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94880122e0 con 0x561fd5aa8050 2023-10-08T12:47:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.526+0000 7f94b12beb80 10 client.26351 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.526+0000 7f94b12beb80 1 -- 172.21.15.59:0/4248625730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x561fd580fc60 con 0x561fd5aa8050 2023-10-08T12:47:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.526+0000 7f9476ffd700 1 -- 172.21.15.59:0/4248625730 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561fd59c3eb0 con 0x561fd5aa8050 2023-10-08T12:47:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.527+0000 7f9476ffd700 1 -- 172.21.15.59:0/4248625730 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f948800f560 con 0x561fd5aa8050 2023-10-08T12:47:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.527+0000 7f94b12beb80 10 client.26351 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.527+0000 7f94b12beb80 10 client.26351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.527+0000 7f94b12beb80 20 client.26351 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.527+0000 7f94b12beb80 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561fd5ac32c0 0x561fd5ac56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.527+0000 7f94b12beb80 4 client.26351 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:47:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.527+0000 7f94b12beb80 1 -- 172.21.15.59:0/4248625730 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fd59f4e10 con 0x561fd5ac32c0 2023-10-08T12:47:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.527+0000 7f94967fc700 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561fd5ac32c0 0x561fd5ac56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.527+0000 7f94967fc700 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561fd5ac32c0 0x561fd5ac56e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aee81885d3a66956 server_cookie=5d2c5c742223bd59 in_seq=0 out_seq=0 2023-10-08T12:47:53.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.527+0000 7f9476ffd700 10 client.26351 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:53.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f9476ffd700 1 -- 172.21.15.59:0/4248625730 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561fd59f4e10 con 0x561fd5ac32c0 2023-10-08T12:47:53.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f9476ffd700 10 client.26351 handle_command_reply: tid=0 2023-10-08T12:47:53.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f94b12beb80 1 client.26351 shutdown 2023-10-08T12:47:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f94b12beb80 1 -- 172.21.15.59:0/4248625730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8050 msgr2=0x561fd5ab0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f94b12beb80 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8050 0x561fd5ab0690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f94880128d0 tx=0x7f9488012be0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f94b12beb80 1 -- 172.21.15.59:0/4248625730 shutdown_connections 2023-10-08T12:47:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f94b12beb80 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561fd5ac32c0 0x561fd5ac56e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f94b12beb80 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8050 0x561fd5ab0690 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f94b12beb80 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f94b12beb80 1 --2- 172.21.15.59:0/4248625730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8970 0x561fd5ab0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f9476ffd700 0 client.26351 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f94b12beb80 1 -- 172.21.15.59:0/4248625730 >> 172.21.15.59:0/4248625730 conn(0x561fd5a1d260 msgr2=0x561fd5aaa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.528+0000 7f94b12beb80 1 -- 172.21.15.59:0/4248625730 shutdown_connections 2023-10-08T12:47:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.529+0000 7f94b12beb80 1 -- 172.21.15.59:0/4248625730 wait complete. 2023-10-08T12:47:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.529+0000 7f94b12beb80 20 client.26351 trim_cache size 0 max 16384 2023-10-08T12:47:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94b12beb80 1 Processor -- start 2023-10-08T12:47:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94b12beb80 1 -- start start 2023-10-08T12:47:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5aa8050 0x561fd5a9dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5aa4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5ab3800 0x561fd5aba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94b12beb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd587c920 con 0x561fd5ab3800 2023-10-08T12:47:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94b12beb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd59c3eb0 con 0x561fd5aa8970 2023-10-08T12:47:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94b12beb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5aa48d0 con 0x561fd5aa8050 2023-10-08T12:47:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94967fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5aa4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94977fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5ab3800 0x561fd5aba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94967fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5aa4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51006/0 (socket says 172.21.15.59:51006) 2023-10-08T12:47:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f94967fc700 1 -- 172.21.15.59:0/673281210 learned_addr learned my addr 172.21.15.59:0/673281210 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.548+0000 7f9496ffd700 1 --2- 172.21.15.59:0/673281210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5aa8050 0x561fd5a9dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.549+0000 7f94967fc700 1 -- 172.21.15.59:0/673281210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5aa8050 msgr2=0x561fd5a9dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.549+0000 7f94967fc700 1 --2- 172.21.15.59:0/673281210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5aa8050 0x561fd5a9dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.549+0000 7f94967fc700 1 -- 172.21.15.59:0/673281210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5ab3800 msgr2=0x561fd5aba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.549+0000 7f94967fc700 1 --2- 172.21.15.59:0/673281210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5ab3800 0x561fd5aba230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.549+0000 7f94967fc700 1 -- 172.21.15.59:0/673281210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fd584d250 con 0x561fd5aa8970 2023-10-08T12:47:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.549+0000 7f94967fc700 1 --2- 172.21.15.59:0/673281210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5aa4390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f948c09adf0 tx=0x7f948c019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79541c491ccb8e72 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.549+0000 7f947e7fc700 1 -- 172.21.15.59:0/673281210 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c09b7f0 con 0x561fd5aa8970 2023-10-08T12:47:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.549+0000 7f947e7fc700 1 -- 172.21.15.59:0/673281210 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f948c09b0f0 con 0x561fd5aa8970 2023-10-08T12:47:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.549+0000 7f947e7fc700 1 -- 172.21.15.59:0/673281210 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c099490 con 0x561fd5aa8970 2023-10-08T12:47:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.550+0000 7f94b12beb80 1 -- 172.21.15.59:0/673281210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 msgr2=0x561fd5aa4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.550+0000 7f94b12beb80 1 --2- 172.21.15.59:0/673281210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5aa4390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f948c09adf0 tx=0x7f948c019040 comp rx=0 tx=0).stop 2023-10-08T12:47:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.550+0000 7f94b12beb80 1 -- 172.21.15.59:0/673281210 shutdown_connections 2023-10-08T12:47:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.550+0000 7f94b12beb80 1 --2- 172.21.15.59:0/673281210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5ab3800 0x561fd5aba230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.550+0000 7f94b12beb80 1 --2- 172.21.15.59:0/673281210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5aa8050 0x561fd5a9dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.550+0000 7f94b12beb80 1 --2- 172.21.15.59:0/673281210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5aa4390 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.550+0000 7f94b12beb80 1 -- 172.21.15.59:0/673281210 >> 172.21.15.59:0/673281210 conn(0x561fd5a1d260 msgr2=0x561fd5aaef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:53.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.550+0000 7f94b12beb80 1 -- 172.21.15.59:0/673281210 shutdown_connections 2023-10-08T12:47:53.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.550+0000 7f94b12beb80 1 -- 172.21.15.59:0/673281210 wait complete. 2023-10-08T12:47:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.550+0000 7f94b12beb80 1 -- start start 2023-10-08T12:47:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.551+0000 7f94b12beb80 1 Processor -- start 2023-10-08T12:47:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.551+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8050 0x561fd5aba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.551+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5ab8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.551+0000 7f94b12beb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94b12beb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5ab9190 con 0x561fd5aa8050 2023-10-08T12:47:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94b12beb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5ab9300 con 0x561fd5aa8970 2023-10-08T12:47:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94b12beb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5ab94c0 con 0x561fd5ab3800 2023-10-08T12:47:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94b12beb80 10 client.0 _ll_register_callbacks cb 0x7f9488009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94977fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94977fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:55940/0 (socket says 172.21.15.59:55940) 2023-10-08T12:47:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94977fe700 1 -- 172.21.15.59:0/1124963390 learned_addr learned my addr 172.21.15.59:0/1124963390 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f9496ffd700 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8050 0x561fd5aba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94967fc700 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5ab8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94977fe700 1 -- 172.21.15.59:0/1124963390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 msgr2=0x561fd5ab8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94977fe700 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5ab8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94977fe700 1 -- 172.21.15.59:0/1124963390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8050 msgr2=0x561fd5aba180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94977fe700 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8050 0x561fd5aba180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f94977fe700 1 -- 172.21.15.59:0/1124963390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94981a59c0 con 0x561fd5ab3800 2023-10-08T12:47:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.552+0000 7f9496ffd700 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8050 0x561fd5aba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:47:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f94977fe700 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab8bb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9490009690 tx=0x7f9490003d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9fb432375fff26f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f9476ffd700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:47:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f9476ffd700 1 -- 172.21.15.59:0/1124963390 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9490009290 con 0x561fd5ab3800 2023-10-08T12:47:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f94b12beb80 1 -- 172.21.15.59:0/1124963390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f949001f070 con 0x561fd5ab3800 2023-10-08T12:47:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f9476ffd700 1 -- 172.21.15.59:0/1124963390 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9490008260 con 0x561fd5ab3800 2023-10-08T12:47:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f9476ffd700 1 -- 172.21.15.59:0/1124963390 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f949001b850 con 0x561fd5ab3800 2023-10-08T12:47:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f94b12beb80 10 client.26350 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f94b12beb80 1 -- 172.21.15.59:0/1124963390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x561fd58252b0 con 0x561fd5ab3800 2023-10-08T12:47:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f9476ffd700 1 -- 172.21.15.59:0/1124963390 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f949001f070 con 0x561fd5ab3800 2023-10-08T12:47:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f9476ffd700 1 -- 172.21.15.59:0/1124963390 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f949002b040 con 0x561fd5ab3800 2023-10-08T12:47:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f94b12beb80 10 client.26350 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f94b12beb80 10 client.26350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.553+0000 7f94b12beb80 20 client.26350 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.554+0000 7f94b12beb80 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561fd5b18720 0x561fd5b1ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.554+0000 7f94b12beb80 4 client.26350 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:47:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.554+0000 7f94b12beb80 1 -- 172.21.15.59:0/1124963390 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561fd59f4b30 con 0x561fd5b18720 2023-10-08T12:47:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.554+0000 7f9496ffd700 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561fd5b18720 0x561fd5b1ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.554+0000 7f9496ffd700 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561fd5b18720 0x561fd5b1ab40 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f07a1ce40018ceb6 server_cookie=17d67708a2e85db5 in_seq=0 out_seq=0 2023-10-08T12:47:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.554+0000 7f9476ffd700 10 client.26350 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.555+0000 7f9476ffd700 1 -- 172.21.15.59:0/1124963390 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561fd59f4b30 con 0x561fd5b18720 2023-10-08T12:47:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.555+0000 7f9476ffd700 10 client.26350 handle_command_reply: tid=0 2023-10-08T12:47:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.555+0000 7f94b12beb80 1 client.26350 shutdown 2023-10-08T12:47:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.555+0000 7f94b12beb80 1 -- 172.21.15.59:0/1124963390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 msgr2=0x561fd5ab8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.555+0000 7f94b12beb80 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab8bb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9490009690 tx=0x7f9490003d00 comp rx=0 tx=0).stop 2023-10-08T12:47:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f94b12beb80 1 -- 172.21.15.59:0/1124963390 shutdown_connections 2023-10-08T12:47:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f94b12beb80 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561fd5b18720 0x561fd5b1ab40 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f94b12beb80 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fd5ab3800 0x561fd5ab8bb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f94b12beb80 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fd5aa8050 0x561fd5aba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f94b12beb80 1 --2- 172.21.15.59:0/1124963390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fd5aa8970 0x561fd5ab8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f9476ffd700 0 client.26350 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f94b12beb80 1 -- 172.21.15.59:0/1124963390 >> 172.21.15.59:0/1124963390 conn(0x561fd5a1d260 msgr2=0x561fd5ab2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f94b12beb80 1 -- 172.21.15.59:0/1124963390 shutdown_connections 2023-10-08T12:47:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f94b12beb80 1 -- 172.21.15.59:0/1124963390 wait complete. 2023-10-08T12:47:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f94b12beb80 20 client.26350 trim_cache size 0 max 16384 2023-10-08T12:47:53.561 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:47:53.562 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:47:53.562 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:47:53.562 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:47:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f9497fff700 1 -- 172.21.15.59:0/2474193430 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94800a15f0 msgr2=0x7f94800a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f9497fff700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94800a15f0 0x7f94800a3ab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9490009fd0 tx=0x7f949000e000 comp rx=0 tx=0).stop 2023-10-08T12:47:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f9497fff700 1 -- 172.21.15.59:0/2474193430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9498102050 msgr2=0x7f949819ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.556+0000 7f9497fff700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9498102050 0x7f949819ef10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f948c009fd0 tx=0x7f948c00f950 comp rx=0 tx=0).stop 2023-10-08T12:47:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.557+0000 7f9497fff700 1 -- 172.21.15.59:0/2474193430 shutdown_connections 2023-10-08T12:47:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.557+0000 7f9497fff700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94800a15f0 0x7f94800a3ab0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.557+0000 7f9497fff700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949810ab50 0x7f9498198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.557+0000 7f9497fff700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9498101730 0x7f949819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.557+0000 7f9497fff700 1 --2- 172.21.15.59:0/2474193430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9498102050 0x7f949819ef10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.557+0000 7f9497fff700 1 -- 172.21.15.59:0/2474193430 >> 172.21.15.59:0/2474193430 conn(0x7f94980faf50 msgr2=0x7f9498100660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.557+0000 7f9497fff700 1 -- 172.21.15.59:0/2474193430 shutdown_connections 2023-10-08T12:47:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.557+0000 7f9497fff700 1 -- 172.21.15.59:0/2474193430 wait complete. 2023-10-08T12:47:53.576 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:47:53.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:47:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.792+0000 7f44b53ff700 1 -- 172.21.15.59:0/301241871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b01017f0 msgr2=0x7f44b0101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.792+0000 7f44b53ff700 1 --2- 172.21.15.59:0/301241871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b01017f0 0x7f44b0101bd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009990 tx=0x7f44a0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.792+0000 7f44b53ff700 1 -- 172.21.15.59:0/301241871 shutdown_connections 2023-10-08T12:47:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.792+0000 7f44b53ff700 1 --2- 172.21.15.59:0/301241871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44b010ac10 0x7f44b010d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.792+0000 7f44b53ff700 1 --2- 172.21.15.59:0/301241871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b01017f0 0x7f44b0101bd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.792+0000 7f44b53ff700 1 --2- 172.21.15.59:0/301241871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b0102110 0x7f44b010a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.792+0000 7f44b53ff700 1 -- 172.21.15.59:0/301241871 >> 172.21.15.59:0/301241871 conn(0x7f44b00fb030 msgr2=0x7f44b00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.792+0000 7f44b53ff700 1 -- 172.21.15.59:0/301241871 shutdown_connections 2023-10-08T12:47:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.792+0000 7f44b53ff700 1 -- 172.21.15.59:0/301241871 wait complete. 2023-10-08T12:47:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.793+0000 7f44b53ff700 1 Processor -- start 2023-10-08T12:47:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.793+0000 7f44b53ff700 1 -- start start 2023-10-08T12:47:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44b53ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b01017f0 0x7f44b019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44b53ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44b0102110 0x7f44b019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44b53ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b010ac10 0x7f44b0196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44b53ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b0196fe0 con 0x7f44b010ac10 2023-10-08T12:47:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44b53ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b0197150 con 0x7f44b0102110 2023-10-08T12:47:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44b53ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b0197310 con 0x7f44b01017f0 2023-10-08T12:47:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44ae7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44b0102110 0x7f44b019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44aeffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b01017f0 0x7f44b019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44ae7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44b0102110 0x7f44b019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51020/0 (socket says 172.21.15.59:51020) 2023-10-08T12:47:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44ae7fc700 1 -- 172.21.15.59:0/2518397987 learned_addr learned my addr 172.21.15.59:0/2518397987 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44aeffd700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b01017f0 0x7f44b019c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:55958/0 (socket says 172.21.15.59:55958) 2023-10-08T12:47:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44af7fe700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b010ac10 0x7f44b0196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44ae7fc700 1 -- 172.21.15.59:0/2518397987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b01017f0 msgr2=0x7f44b019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44ae7fc700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b01017f0 0x7f44b019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44ae7fc700 1 -- 172.21.15.59:0/2518397987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b010ac10 msgr2=0x7f44b0196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44ae7fc700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b010ac10 0x7f44b0196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.794+0000 7f44ae7fc700 1 -- 172.21.15.59:0/2518397987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00095f0 con 0x7f44b0102110 2023-10-08T12:47:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.795+0000 7f44ae7fc700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44b0102110 0x7f44b019cd90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f44a400e9f0 tx=0x7f44a400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.795+0000 7f4497fff700 1 -- 172.21.15.59:0/2518397987 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400c9c0 con 0x7f44b0102110 2023-10-08T12:47:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.795+0000 7f4497fff700 1 -- 172.21.15.59:0/2518397987 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44a4010430 con 0x7f44b0102110 2023-10-08T12:47:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.795+0000 7f4497fff700 1 -- 172.21.15.59:0/2518397987 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4018680 con 0x7f44b0102110 2023-10-08T12:47:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.795+0000 7f44b53ff700 1 -- 172.21.15.59:0/2518397987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b01975f0 con 0x7f44b0102110 2023-10-08T12:47:53.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.795+0000 7f44b53ff700 1 -- 172.21.15.59:0/2518397987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b00ff550 con 0x7f44b0102110 2023-10-08T12:47:53.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.797+0000 7f44b53ff700 1 -- 172.21.15.59:0/2518397987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b0105d40 con 0x7f44b0102110 2023-10-08T12:47:53.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.799+0000 7f4497fff700 1 -- 172.21.15.59:0/2518397987 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f44a4010860 con 0x7f44b0102110 2023-10-08T12:47:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.800+0000 7f4497fff700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44980a1670 0x7f44980a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.800+0000 7f4497fff700 1 -- 172.21.15.59:0/2518397987 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f44a4014070 con 0x7f44b0102110 2023-10-08T12:47:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.800+0000 7f44aeffd700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44980a1670 0x7f44980a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:53.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.801+0000 7f44aeffd700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44980a1670 0x7f44980a3b30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f44a0006010 tx=0x7f44a000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:53.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:53.805+0000 7f4497fff700 1 -- 172.21.15.59:0/2518397987 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f44a4052100 con 0x7f44b0102110 2023-10-08T12:47:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.114+0000 7f44b53ff700 1 -- 172.21.15.59:0/2518397987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44b01977e0 con 0x7f44b0102110 2023-10-08T12:47:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.115+0000 7f4497fff700 1 -- 172.21.15.59:0/2518397987 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f44a40966c0 con 0x7f44b0102110 2023-10-08T12:47:54.116 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:47:54.116 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:47:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 -- 172.21.15.59:0/2518397987 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44980a1670 msgr2=0x7f44980a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44980a1670 0x7f44980a3b30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f44a0006010 tx=0x7f44a000b260 comp rx=0 tx=0).stop 2023-10-08T12:47:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 -- 172.21.15.59:0/2518397987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44b0102110 msgr2=0x7f44b019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44b0102110 0x7f44b019cd90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f44a400e9f0 tx=0x7f44a400ed00 comp rx=0 tx=0).stop 2023-10-08T12:47:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 -- 172.21.15.59:0/2518397987 shutdown_connections 2023-10-08T12:47:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44980a1670 0x7f44980a3b30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b010ac10 0x7f44b0196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b01017f0 0x7f44b019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 --2- 172.21.15.59:0/2518397987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44b0102110 0x7f44b019cd90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 -- 172.21.15.59:0/2518397987 >> 172.21.15.59:0/2518397987 conn(0x7f44b00fb030 msgr2=0x7f44b00fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 -- 172.21.15.59:0/2518397987 shutdown_connections 2023-10-08T12:47:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.118+0000 7f44b53ff700 1 -- 172.21.15.59:0/2518397987 wait complete. 2023-10-08T12:47:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:47:54.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:47:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:53 smithi059 ceph-mon[98489]: pgmap v515: 97 pgs: 97 active+clean; 459 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 281 op/s 2023-10-08T12:47:54.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.363+0000 7f510c1ff700 1 -- 172.21.15.59:0/1552832926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5104072c20 msgr2=0x7f5104073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:54.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.363+0000 7f510c1ff700 1 --2- 172.21.15.59:0/1552832926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5104072c20 0x7f5104073000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5100009990 tx=0x7f5100009ca0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.364+0000 7f510c1ff700 1 -- 172.21.15.59:0/1552832926 shutdown_connections 2023-10-08T12:47:54.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.364+0000 7f510c1ff700 1 --2- 172.21.15.59:0/1552832926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5104072c20 0x7f5104073000 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.364+0000 7f510c1ff700 1 --2- 172.21.15.59:0/1552832926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510410cf70 0x7f510410f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.364+0000 7f510c1ff700 1 --2- 172.21.15.59:0/1552832926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104073540 0x7f510410ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.364+0000 7f510c1ff700 1 -- 172.21.15.59:0/1552832926 >> 172.21.15.59:0/1552832926 conn(0x7f51040fc200 msgr2=0x7f51040fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:54.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.364+0000 7f510c1ff700 1 -- 172.21.15.59:0/1552832926 shutdown_connections 2023-10-08T12:47:54.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.364+0000 7f510c1ff700 1 -- 172.21.15.59:0/1552832926 wait complete. 2023-10-08T12:47:54.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.365+0000 7f510c1ff700 1 Processor -- start 2023-10-08T12:47:54.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.365+0000 7f510c1ff700 1 -- start start 2023-10-08T12:47:54.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.365+0000 7f510c1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104072c20 0x7f5104198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.365+0000 7f510c1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5104073540 0x7f51041993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.365+0000 7f510c1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510410cf70 0x7f510419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.365+0000 7f510c1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510419dd60 con 0x7f5104072c20 2023-10-08T12:47:54.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.365+0000 7f510c1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510419ded0 con 0x7f5104073540 2023-10-08T12:47:54.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.365+0000 7f510c1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510419e090 con 0x7f510410cf70 2023-10-08T12:47:54.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.365+0000 7f5109f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104072c20 0x7f5104198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.365+0000 7f510979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5104073540 0x7f51041993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f510979a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5104073540 0x7f51041993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51038/0 (socket says 172.21.15.59:51038) 2023-10-08T12:47:54.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f510979a700 1 -- 172.21.15.59:0/3933447577 learned_addr learned my addr 172.21.15.59:0/3933447577 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:54.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f510a79c700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510410cf70 0x7f510419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f510979a700 1 -- 172.21.15.59:0/3933447577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510410cf70 msgr2=0x7f510419d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:54.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f510979a700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510410cf70 0x7f510419d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f510979a700 1 -- 172.21.15.59:0/3933447577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104072c20 msgr2=0x7f5104198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:54.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f510979a700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104072c20 0x7f5104198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f510979a700 1 -- 172.21.15.59:0/3933447577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51000095f0 con 0x7f5104073540 2023-10-08T12:47:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f510979a700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5104073540 0x7f51041993d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f50f400e9a0 tx=0x7f50f400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f50faffd700 1 -- 172.21.15.59:0/3933447577 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f4009790 con 0x7f5104073540 2023-10-08T12:47:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f50faffd700 1 -- 172.21.15.59:0/3933447577 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50f4010430 con 0x7f5104073540 2023-10-08T12:47:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f50faffd700 1 -- 172.21.15.59:0/3933447577 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f4018680 con 0x7f5104073540 2023-10-08T12:47:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.366+0000 7f510c1ff700 1 -- 172.21.15.59:0/3933447577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510419e370 con 0x7f5104073540 2023-10-08T12:47:54.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.367+0000 7f510c1ff700 1 -- 172.21.15.59:0/3933447577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51041a5bb0 con 0x7f5104073540 2023-10-08T12:47:54.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.370+0000 7f50faffd700 1 -- 172.21.15.59:0/3933447577 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f50f40105a0 con 0x7f5104073540 2023-10-08T12:47:54.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.371+0000 7f511fba1b80 1 Processor -- start 2023-10-08T12:47:54.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.371+0000 7f511fba1b80 1 -- start start 2023-10-08T12:47:54.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f50faffd700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50f00a1670 0x7f50f00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 0x5649a85bf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85bf650 0x5649a85c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f511fba1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a851d460 con 0x5649a85bf650 2023-10-08T12:47:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f511fba1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a850ec20 con 0x5649a85b3e80 2023-10-08T12:47:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f511fba1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a850c540 con 0x5649a85b47a0 2023-10-08T12:47:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f50faffd700 1 -- 172.21.15.59:0/3933447577 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f50f4014070 con 0x7f5104073540 2023-10-08T12:47:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f510979a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 0x5649a85bf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f510a79c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f510a79c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51044/0 (socket says 172.21.15.59:51044) 2023-10-08T12:47:54.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f510979a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 0x5649a85bf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:55990/0 (socket says 172.21.15.59:55990) 2023-10-08T12:47:54.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f510a79c700 1 -- 172.21.15.59:0/3937115337 learned_addr learned my addr 172.21.15.59:0/3937115337 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:54.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.372+0000 7f510a79c700 1 --2- 172.21.15.59:0/3937115337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85bf650 0x5649a85c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.373+0000 7f5109f9b700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50f00a1670 0x7f50f00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.373+0000 7f510a79c700 1 -- 172.21.15.59:0/3937115337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 msgr2=0x5649a85bf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:54.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.373+0000 7f510a79c700 1 --2- 172.21.15.59:0/3937115337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 0x5649a85bf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.373+0000 7f510a79c700 1 -- 172.21.15.59:0/3937115337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85bf650 msgr2=0x5649a85c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:54.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.373+0000 7f510a79c700 1 --2- 172.21.15.59:0/3937115337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85bf650 0x5649a85c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.373+0000 7f510a79c700 1 -- 172.21.15.59:0/3937115337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649a8332de0 con 0x5649a85b3e80 2023-10-08T12:47:54.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.373+0000 7f510a79c700 1 --2- 172.21.15.59:0/3937115337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85b4260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f50fc008d00 tx=0x7f50fc009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71356f8791865009 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:54.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.373+0000 7f5109f9b700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50f00a1670 0x7f50f00a3b30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5100006010 tx=0x7f510000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:54.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.373+0000 7f50effff700 1 -- 172.21.15.59:0/3937115337 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00e050 con 0x5649a85b3e80 2023-10-08T12:47:54.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.373+0000 7f50effff700 1 -- 172.21.15.59:0/3937115337 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50fc00f040 con 0x5649a85b3e80 2023-10-08T12:47:54.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.373+0000 7f50effff700 1 -- 172.21.15.59:0/3937115337 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc004280 con 0x5649a85b3e80 2023-10-08T12:47:54.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:53 smithi092 ceph-mon[134093]: pgmap v515: 97 pgs: 97 active+clean; 459 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 281 op/s 2023-10-08T12:47:54.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.374+0000 7f511fba1b80 1 -- 172.21.15.59:0/3937115337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 msgr2=0x5649a85b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:54.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.374+0000 7f511fba1b80 1 --2- 172.21.15.59:0/3937115337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85b4260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f50fc008d00 tx=0x7f50fc009920 comp rx=0 tx=0).stop 2023-10-08T12:47:54.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.374+0000 7f511fba1b80 1 -- 172.21.15.59:0/3937115337 shutdown_connections 2023-10-08T12:47:54.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.374+0000 7f511fba1b80 1 --2- 172.21.15.59:0/3937115337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85b4260 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.374+0000 7f511fba1b80 1 --2- 172.21.15.59:0/3937115337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85bf650 0x5649a85c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.374+0000 7f511fba1b80 1 --2- 172.21.15.59:0/3937115337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 0x5649a85bf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.374+0000 7f511fba1b80 1 -- 172.21.15.59:0/3937115337 >> 172.21.15.59:0/3937115337 conn(0x5649a8529260 msgr2=0x5649a85b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:54.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.374+0000 7f511fba1b80 1 -- 172.21.15.59:0/3937115337 shutdown_connections 2023-10-08T12:47:54.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.374+0000 7f511fba1b80 1 -- 172.21.15.59:0/3937115337 wait complete. 2023-10-08T12:47:54.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.375+0000 7f511fba1b80 1 -- start start 2023-10-08T12:47:54.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.375+0000 7f511fba1b80 1 Processor -- start 2023-10-08T12:47:54.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b3e80 0x5649a85bc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b47a0 0x5649a85bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85bf650 0x5649a85bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f511fba1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a8507e30 con 0x5649a85bf650 2023-10-08T12:47:54.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f511fba1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a84a4710 con 0x5649a85b47a0 2023-10-08T12:47:54.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f511fba1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a84a43b0 con 0x5649a85b3e80 2023-10-08T12:47:54.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f511fba1b80 10 client.0 _ll_register_callbacks cb 0x5649a8301800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:54.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f5109f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b3e80 0x5649a85bc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f5109f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b3e80 0x5649a85bc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:55994/0 (socket says 172.21.15.59:55994) 2023-10-08T12:47:54.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f5109f9b700 1 -- 172.21.15.59:0/952740933 learned_addr learned my addr 172.21.15.59:0/952740933 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:54.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f510979a700 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b47a0 0x5649a85bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.376+0000 7f510a79c700 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85bf650 0x5649a85bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f5109f9b700 1 -- 172.21.15.59:0/952740933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b47a0 msgr2=0x5649a85bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f5109f9b700 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b47a0 0x5649a85bc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f5109f9b700 1 -- 172.21.15.59:0/952740933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85bf650 msgr2=0x5649a85bcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f5109f9b700 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85bf650 0x5649a85bcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f5109f9b700 1 -- 172.21.15.59:0/952740933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc0089b0 con 0x5649a85b3e80 2023-10-08T12:47:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f510979a700 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b47a0 0x5649a85bc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f5109f9b700 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b3e80 0x5649a85bc440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f510000bb70 tx=0x7f5100009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=519cbc30cb9cd37a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f50ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:47:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f50ed7fa700 1 -- 172.21.15.59:0/952740933 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5100004d20 con 0x5649a85b3e80 2023-10-08T12:47:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f50ed7fa700 1 -- 172.21.15.59:0/952740933 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f510000be80 con 0x5649a85b3e80 2023-10-08T12:47:54.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f511fba1b80 1 -- 172.21.15.59:0/952740933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649a84cfeb0 con 0x5649a85b3e80 2023-10-08T12:47:54.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f50ed7fa700 1 -- 172.21.15.59:0/952740933 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f510000f460 con 0x5649a85b3e80 2023-10-08T12:47:54.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f511fba1b80 10 client.26368 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:54.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.377+0000 7f511fba1b80 1 -- 172.21.15.59:0/952740933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5649a831bc60 con 0x5649a85b3e80 2023-10-08T12:47:54.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.378+0000 7f50ed7fa700 1 -- 172.21.15.59:0/952740933 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5649a84cfeb0 con 0x5649a85b3e80 2023-10-08T12:47:54.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.378+0000 7f50ed7fa700 1 -- 172.21.15.59:0/952740933 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f51000247e0 con 0x5649a85b3e80 2023-10-08T12:47:54.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.378+0000 7f511fba1b80 10 client.26368 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:54.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.378+0000 7f511fba1b80 10 client.26368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:54.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.378+0000 7f511fba1b80 20 client.26368 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:54.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.378+0000 7f511fba1b80 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649a85cf240 0x5649a85d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.378+0000 7f511fba1b80 4 client.26368 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:47:54.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.378+0000 7f511fba1b80 1 -- 172.21.15.59:0/952740933 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649a8500e10 con 0x5649a85cf240 2023-10-08T12:47:54.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.378+0000 7f510979a700 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649a85cf240 0x5649a85d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.379+0000 7f510979a700 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649a85cf240 0x5649a85d1660 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a984a55860f6d028 server_cookie=8692d71f0a89618b in_seq=0 out_seq=0 2023-10-08T12:47:54.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.379+0000 7f50ed7fa700 10 client.26368 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:54.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.379+0000 7f50ed7fa700 1 -- 172.21.15.59:0/952740933 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5649a8500e10 con 0x5649a85cf240 2023-10-08T12:47:54.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.379+0000 7f50ed7fa700 10 client.26368 handle_command_reply: tid=0 2023-10-08T12:47:54.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.379+0000 7f511fba1b80 1 client.26368 shutdown 2023-10-08T12:47:54.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f511fba1b80 1 -- 172.21.15.59:0/952740933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b3e80 msgr2=0x5649a85bc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:54.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f511fba1b80 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b3e80 0x5649a85bc440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f510000bb70 tx=0x7f5100009ca0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f511fba1b80 1 -- 172.21.15.59:0/952740933 shutdown_connections 2023-10-08T12:47:54.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f511fba1b80 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649a85cf240 0x5649a85d1660 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f511fba1b80 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85bf650 0x5649a85bcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f511fba1b80 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b3e80 0x5649a85bc440 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f511fba1b80 1 --2- 172.21.15.59:0/952740933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b47a0 0x5649a85bc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f50ed7fa700 0 client.26368 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f511fba1b80 1 -- 172.21.15.59:0/952740933 >> 172.21.15.59:0/952740933 conn(0x5649a8529260 msgr2=0x5649a85afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f511fba1b80 1 -- 172.21.15.59:0/952740933 shutdown_connections 2023-10-08T12:47:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f511fba1b80 1 -- 172.21.15.59:0/952740933 wait complete. 2023-10-08T12:47:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.380+0000 7f511fba1b80 20 client.26368 trim_cache size 0 max 16384 2023-10-08T12:47:54.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.398+0000 7f511fba1b80 1 Processor -- start 2023-10-08T12:47:54.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.398+0000 7f511fba1b80 1 -- start start 2023-10-08T12:47:54.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85b47a0 0x5649a85bc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85bf650 0x5649a85bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f511fba1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a8388920 con 0x5649a85b47a0 2023-10-08T12:47:54.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f511fba1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a85cbd70 con 0x5649a85b3e80 2023-10-08T12:47:54.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f511fba1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a85b1060 con 0x5649a85bf650 2023-10-08T12:47:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f5109f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f510a79c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85bf650 0x5649a85bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f5109f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51062/0 (socket says 172.21.15.59:51062) 2023-10-08T12:47:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f5109f9b700 1 -- 172.21.15.59:0/2440939270 learned_addr learned my addr 172.21.15.59:0/2440939270 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f510979a700 1 --2- 172.21.15.59:0/2440939270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85b47a0 0x5649a85bc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f5109f9b700 1 -- 172.21.15.59:0/2440939270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85bf650 msgr2=0x5649a85bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f5109f9b700 1 --2- 172.21.15.59:0/2440939270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85bf650 0x5649a85bcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f5109f9b700 1 -- 172.21.15.59:0/2440939270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85b47a0 msgr2=0x5649a85bc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:54.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f5109f9b700 1 --2- 172.21.15.59:0/2440939270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85b47a0 0x5649a85bc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.399+0000 7f5109f9b700 1 -- 172.21.15.59:0/2440939270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649a8359250 con 0x5649a85b3e80 2023-10-08T12:47:54.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.400+0000 7f5109f9b700 1 --2- 172.21.15.59:0/2440939270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85d1630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5100000c00 tx=0x7f5100004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef26dccd043c81b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:54.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.400+0000 7f50f8ff9700 1 -- 172.21.15.59:0/2440939270 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5100004d20 con 0x5649a85b3e80 2023-10-08T12:47:54.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.400+0000 7f50f8ff9700 1 -- 172.21.15.59:0/2440939270 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f510001e040 con 0x5649a85b3e80 2023-10-08T12:47:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.400+0000 7f50f8ff9700 1 -- 172.21.15.59:0/2440939270 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5100018d00 con 0x5649a85b3e80 2023-10-08T12:47:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.401+0000 7f511fba1b80 1 -- 172.21.15.59:0/2440939270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 msgr2=0x5649a85d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.401+0000 7f511fba1b80 1 --2- 172.21.15.59:0/2440939270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85d1630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5100000c00 tx=0x7f5100004860 comp rx=0 tx=0).stop 2023-10-08T12:47:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.401+0000 7f511fba1b80 1 -- 172.21.15.59:0/2440939270 shutdown_connections 2023-10-08T12:47:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.401+0000 7f511fba1b80 1 --2- 172.21.15.59:0/2440939270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85b3e80 0x5649a85d1630 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.401+0000 7f511fba1b80 1 --2- 172.21.15.59:0/2440939270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85bf650 0x5649a85bcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.401+0000 7f511fba1b80 1 --2- 172.21.15.59:0/2440939270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85b47a0 0x5649a85bc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.401+0000 7f511fba1b80 1 -- 172.21.15.59:0/2440939270 >> 172.21.15.59:0/2440939270 conn(0x5649a8529260 msgr2=0x5649a85b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.401+0000 7f511fba1b80 1 -- 172.21.15.59:0/2440939270 shutdown_connections 2023-10-08T12:47:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.401+0000 7f511fba1b80 1 -- 172.21.15.59:0/2440939270 wait complete. 2023-10-08T12:47:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.402+0000 7f511fba1b80 1 -- start start 2023-10-08T12:47:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.402+0000 7f511fba1b80 1 Processor -- start 2023-10-08T12:47:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.403+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85b3e80 0x5649a85c6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.403+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 0x5649a85c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.403+0000 7f511fba1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85bf650 0x5649a85c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.403+0000 7f511fba1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a85c4e10 con 0x5649a85b3e80 2023-10-08T12:47:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.403+0000 7f511fba1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a85c4f80 con 0x5649a85bf650 2023-10-08T12:47:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.403+0000 7f511fba1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a8622050 con 0x5649a85b47a0 2023-10-08T12:47:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.403+0000 7f511fba1b80 10 client.0 _ll_register_callbacks cb 0x5649a8301800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.403+0000 7f510979a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 0x5649a85c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f510979a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 0x5649a85c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56012/0 (socket says 172.21.15.59:56012) 2023-10-08T12:47:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f510979a700 1 -- 172.21.15.59:0/71355029 learned_addr learned my addr 172.21.15.59:0/71355029 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f5109f9b700 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85b3e80 0x5649a85c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f510a79c700 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85bf650 0x5649a85c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f510979a700 1 -- 172.21.15.59:0/71355029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85bf650 msgr2=0x5649a85c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f510979a700 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85bf650 0x5649a85c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f510979a700 1 -- 172.21.15.59:0/71355029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85b3e80 msgr2=0x5649a85c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f510979a700 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85b3e80 0x5649a85c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f510979a700 1 -- 172.21.15.59:0/71355029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649a831bc60 con 0x5649a85b47a0 2023-10-08T12:47:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f510979a700 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 0x5649a85c4180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f50f4096740 tx=0x7f50f4010c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69a7835ec2a7096f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f50ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:47:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f50ed7fa700 1 -- 172.21.15.59:0/71355029 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f409abd0 con 0x5649a85b47a0 2023-10-08T12:47:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.404+0000 7f50ed7fa700 1 -- 172.21.15.59:0/71355029 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f50f409e390 con 0x5649a85b47a0 2023-10-08T12:47:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f511fba1b80 1 -- 172.21.15.59:0/71355029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f50fc00f040 con 0x5649a85b47a0 2023-10-08T12:47:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f50ed7fa700 1 -- 172.21.15.59:0/71355029 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50f40a25d0 con 0x5649a85b47a0 2023-10-08T12:47:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f511fba1b80 10 client.26374 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f511fba1b80 1 -- 172.21.15.59:0/71355029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5649a83312b0 con 0x5649a85b47a0 2023-10-08T12:47:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f50ed7fa700 1 -- 172.21.15.59:0/71355029 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50fc00f040 con 0x5649a85b47a0 2023-10-08T12:47:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f50ed7fa700 1 -- 172.21.15.59:0/71355029 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f50f40a2140 con 0x5649a85b47a0 2023-10-08T12:47:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f511fba1b80 10 client.26374 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f511fba1b80 10 client.26374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f511fba1b80 20 client.26374 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f511fba1b80 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649a8623800 0x5649a8625c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f511fba1b80 4 client.26374 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:47:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.405+0000 7f511fba1b80 1 -- 172.21.15.59:0/71355029 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5649a8500b30 con 0x5649a8623800 2023-10-08T12:47:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.406+0000 7f5109f9b700 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649a8623800 0x5649a8625c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.406+0000 7f5109f9b700 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649a8623800 0x5649a8625c20 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5b41451ec774166 server_cookie=1a5c474157237a20 in_seq=0 out_seq=0 2023-10-08T12:47:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.406+0000 7f50ed7fa700 10 client.26374 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.407+0000 7f50ed7fa700 1 -- 172.21.15.59:0/71355029 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5649a8500b30 con 0x5649a8623800 2023-10-08T12:47:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.407+0000 7f50ed7fa700 10 client.26374 handle_command_reply: tid=0 2023-10-08T12:47:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.407+0000 7f511fba1b80 1 client.26374 shutdown 2023-10-08T12:47:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f511fba1b80 1 -- 172.21.15.59:0/71355029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 msgr2=0x5649a85c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f511fba1b80 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 0x5649a85c4180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f50f4096740 tx=0x7f50f4010c80 comp rx=0 tx=0).stop 2023-10-08T12:47:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f511fba1b80 1 -- 172.21.15.59:0/71355029 shutdown_connections 2023-10-08T12:47:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f511fba1b80 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5649a8623800 0x5649a8625c20 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f511fba1b80 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649a85bf650 0x5649a85c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f511fba1b80 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649a85b3e80 0x5649a85c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f50ed7fa700 0 client.26374 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f511fba1b80 1 --2- 172.21.15.59:0/71355029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649a85b47a0 0x5649a85c4180 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f511fba1b80 1 -- 172.21.15.59:0/71355029 >> 172.21.15.59:0/71355029 conn(0x5649a8529260 msgr2=0x5649a85babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f511fba1b80 1 -- 172.21.15.59:0/71355029 shutdown_connections 2023-10-08T12:47:54.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f511fba1b80 1 -- 172.21.15.59:0/71355029 wait complete. 2023-10-08T12:47:54.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.408+0000 7f511fba1b80 20 client.26374 trim_cache size 0 max 16384 2023-10-08T12:47:54.415 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:47:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 -- 172.21.15.59:0/3933447577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50f00a1670 msgr2=0x7f50f00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50f00a1670 0x7f50f00a3b30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5100006010 tx=0x7f510000b260 comp rx=0 tx=0).stop 2023-10-08T12:47:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 -- 172.21.15.59:0/3933447577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5104073540 msgr2=0x7f51041993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5104073540 0x7f51041993d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f50f400e9a0 tx=0x7f50f400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 -- 172.21.15.59:0/3933447577 shutdown_connections 2023-10-08T12:47:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f50f00a1670 0x7f50f00a3b30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510410cf70 0x7f510419d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104072c20 0x7f5104198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 --2- 172.21.15.59:0/3933447577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5104073540 0x7f51041993d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 -- 172.21.15.59:0/3933447577 >> 172.21.15.59:0/3933447577 conn(0x7f51040fc200 msgr2=0x7f51040fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 -- 172.21.15.59:0/3933447577 shutdown_connections 2023-10-08T12:47:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:54.409+0000 7f510c1ff700 1 -- 172.21.15.59:0/3933447577 wait complete. 2023-10-08T12:47:54.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:53 smithi173 ceph-mon[135182]: pgmap v515: 97 pgs: 97 active+clean; 459 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 281 op/s 2023-10-08T12:47:54.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 836775 13.57 MB/sec execute 205 sec latency 11.962 ms 2023-10-08T12:47:55.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:54 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2518397987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:47:55.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:54 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2518397987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:47:55.429 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:47:55.429 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:47:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:54 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2518397987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:47:55.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 838667 13.57 MB/sec execute 206 sec latency 70.597 ms 2023-10-08T12:47:55.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.648+0000 7f568579d700 1 -- 172.21.15.59:0/4054691620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680106650 msgr2=0x7f5680106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.648+0000 7f568579d700 1 --2- 172.21.15.59:0/4054691620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680106650 0x7f5680106a30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f56700099c0 tx=0x7f5670009cd0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.648+0000 7f568579d700 1 -- 172.21.15.59:0/4054691620 shutdown_connections 2023-10-08T12:47:55.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.648+0000 7f568579d700 1 --2- 172.21.15.59:0/4054691620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680106650 0x7f5680106a30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.648+0000 7f568579d700 1 --2- 172.21.15.59:0/4054691620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5680100f50 0x7f568010d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.648+0000 7f568579d700 1 --2- 172.21.15.59:0/4054691620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5680100590 0x7f5680100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.648+0000 7f568579d700 1 -- 172.21.15.59:0/4054691620 >> 172.21.15.59:0/4054691620 conn(0x7f56800fc060 msgr2=0x7f56800fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:55.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.648+0000 7f568579d700 1 -- 172.21.15.59:0/4054691620 shutdown_connections 2023-10-08T12:47:55.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.648+0000 7f568579d700 1 -- 172.21.15.59:0/4054691620 wait complete. 2023-10-08T12:47:55.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.649+0000 7f568579d700 1 Processor -- start 2023-10-08T12:47:55.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.649+0000 7f568579d700 1 -- start start 2023-10-08T12:47:55.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.650+0000 7f568579d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5680100590 0x7f568019e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.650+0000 7f568579d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680100f50 0x7f568019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.650+0000 7f568579d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5680106650 0x7f5680198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.650+0000 7f568579d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680199100 con 0x7f5680106650 2023-10-08T12:47:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.650+0000 7f568579d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680199270 con 0x7f5680100f50 2023-10-08T12:47:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.650+0000 7f568579d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680199430 con 0x7f5680100590 2023-10-08T12:47:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.650+0000 7f567f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680100f50 0x7f568019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.650+0000 7f567ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5680100590 0x7f568019e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.650+0000 7f567f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680100f50 0x7f568019eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51090/0 (socket says 172.21.15.59:51090) 2023-10-08T12:47:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.650+0000 7f567f7fe700 1 -- 172.21.15.59:0/2611989441 learned_addr learned my addr 172.21.15.59:0/2611989441 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.650+0000 7f5684f9c700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5680106650 0x7f5680198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.651+0000 7f567f7fe700 1 -- 172.21.15.59:0/2611989441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5680100590 msgr2=0x7f568019e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.651+0000 7f567f7fe700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5680100590 0x7f568019e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.651+0000 7f567f7fe700 1 -- 172.21.15.59:0/2611989441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5680106650 msgr2=0x7f5680198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.651+0000 7f567f7fe700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5680106650 0x7f5680198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.651+0000 7f567f7fe700 1 -- 172.21.15.59:0/2611989441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56700095f0 con 0x7f5680100f50 2023-10-08T12:47:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.651+0000 7f567f7fe700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680100f50 0x7f568019eeb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f567400e9a0 tx=0x7f567400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.651+0000 7f567d7fa700 1 -- 172.21.15.59:0/2611989441 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674009790 con 0x7f5680100f50 2023-10-08T12:47:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.651+0000 7f567d7fa700 1 -- 172.21.15.59:0/2611989441 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5674010430 con 0x7f5680100f50 2023-10-08T12:47:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.651+0000 7f568579d700 1 -- 172.21.15.59:0/2611989441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5680199710 con 0x7f5680100f50 2023-10-08T12:47:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.651+0000 7f567d7fa700 1 -- 172.21.15.59:0/2611989441 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674018680 con 0x7f5680100f50 2023-10-08T12:47:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.651+0000 7f568579d700 1 -- 172.21.15.59:0/2611989441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56801a5960 con 0x7f5680100f50 2023-10-08T12:47:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.656+0000 7f567d7fa700 1 -- 172.21.15.59:0/2611989441 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f56740105a0 con 0x7f5680100f50 2023-10-08T12:47:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.657+0000 7f569a37bb80 1 Processor -- start 2023-10-08T12:47:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.657+0000 7f569a37bb80 1 -- start start 2023-10-08T12:47:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.657+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 0x55875acda4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.657+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ace5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.657+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 0x55875ace7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f569a37bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875ac434e0 con 0x55875ace5880 2023-10-08T12:47:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f569a37bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875ac34ca0 con 0x55875acda9f0 2023-10-08T12:47:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f569a37bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875ac325c0 con 0x55875acda0d0 2023-10-08T12:47:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567d7fa700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56680a15f0 0x7f56680a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ace5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567d7fa700 1 -- 172.21.15.59:0/2611989441 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5674014070 con 0x7f5680100f50 2023-10-08T12:47:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ace5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51104/0 (socket says 172.21.15.59:51104) 2023-10-08T12:47:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567ffff700 1 -- 172.21.15.59:0/3028101766 learned_addr learned my addr 172.21.15.59:0/3028101766 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f5684f9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 0x55875acda4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567f7fe700 1 --2- 172.21.15.59:0/3028101766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 0x55875ace7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f5684f9c700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56680a15f0 0x7f56680a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567ffff700 1 -- 172.21.15.59:0/3028101766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 msgr2=0x55875acda4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567ffff700 1 --2- 172.21.15.59:0/3028101766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 0x55875acda4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567ffff700 1 -- 172.21.15.59:0/3028101766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 msgr2=0x55875ace7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567ffff700 1 --2- 172.21.15.59:0/3028101766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 0x55875ace7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567ffff700 1 -- 172.21.15.59:0/3028101766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55875aa58e60 con 0x55875acda9f0 2023-10-08T12:47:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.658+0000 7f567f7fe700 1 --2- 172.21.15.59:0/3028101766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 0x55875ace7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.659+0000 7f567ffff700 1 --2- 172.21.15.59:0/3028101766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ace5340 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f56700099c0 tx=0x7f5670005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aceb055cbfb0a0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.659+0000 7f5684f9c700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56680a15f0 0x7f56680a3ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5678009ec0 tx=0x7f567800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.659+0000 7f56667fc700 1 -- 172.21.15.59:0/3028101766 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567001c050 con 0x55875acda9f0 2023-10-08T12:47:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.659+0000 7f56667fc700 1 -- 172.21.15.59:0/3028101766 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f567001d040 con 0x55875acda9f0 2023-10-08T12:47:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.659+0000 7f56667fc700 1 -- 172.21.15.59:0/3028101766 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56700038c0 con 0x55875acda9f0 2023-10-08T12:47:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.660+0000 7f569a37bb80 1 -- 172.21.15.59:0/3028101766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 msgr2=0x55875ace5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.660+0000 7f569a37bb80 1 --2- 172.21.15.59:0/3028101766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ace5340 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f56700099c0 tx=0x7f5670005fb0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.660+0000 7f569a37bb80 1 -- 172.21.15.59:0/3028101766 shutdown_connections 2023-10-08T12:47:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.660+0000 7f569a37bb80 1 --2- 172.21.15.59:0/3028101766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 0x55875ace7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.660+0000 7f569a37bb80 1 --2- 172.21.15.59:0/3028101766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 0x55875acda4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.660+0000 7f569a37bb80 1 --2- 172.21.15.59:0/3028101766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ace5340 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.660+0000 7f569a37bb80 1 -- 172.21.15.59:0/3028101766 >> 172.21.15.59:0/3028101766 conn(0x55875ac4f2e0 msgr2=0x55875acd64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.660+0000 7f569a37bb80 1 -- 172.21.15.59:0/3028101766 shutdown_connections 2023-10-08T12:47:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.660+0000 7f569a37bb80 1 -- 172.21.15.59:0/3028101766 wait complete. 2023-10-08T12:47:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.660+0000 7f569a37bb80 1 -- start start 2023-10-08T12:47:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.661+0000 7f569a37bb80 1 Processor -- start 2023-10-08T12:47:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.661+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda0d0 0x55875ace5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.661+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda9f0 0x55875ace2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.661+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 0x55875ace2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.661+0000 7f569a37bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875ac2deb0 con 0x55875ace5880 2023-10-08T12:47:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.661+0000 7f569a37bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875abca790 con 0x55875acda0d0 2023-10-08T12:47:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.661+0000 7f569a37bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875abca430 con 0x55875acda9f0 2023-10-08T12:47:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.661+0000 7f569a37bb80 10 client.0 _ll_register_callbacks cb 0x55875aa27880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f567ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda0d0 0x55875ace5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f567f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda9f0 0x55875ace2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f567ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda0d0 0x55875ace5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51118/0 (socket says 172.21.15.59:51118) 2023-10-08T12:47:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f567ffff700 1 -- 172.21.15.59:0/2156389651 learned_addr learned my addr 172.21.15.59:0/2156389651 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f5684f9c700 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 0x55875ace2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f567ffff700 1 -- 172.21.15.59:0/2156389651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda9f0 msgr2=0x55875ace2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f567ffff700 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda9f0 0x55875ace2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f567ffff700 1 -- 172.21.15.59:0/2156389651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 msgr2=0x55875ace2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f567ffff700 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 0x55875ace2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f567ffff700 1 -- 172.21.15.59:0/2156389651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56801a5960 con 0x55875acda0d0 2023-10-08T12:47:55.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f5684f9c700 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 0x55875ace2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:47:55.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f567ffff700 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda0d0 0x55875ace5330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f56700098e0 tx=0x7f567000be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e500c219959fd1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:55.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f565f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:47:55.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f565f7fe700 1 -- 172.21.15.59:0/2156389651 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56700054c0 con 0x55875acda0d0 2023-10-08T12:47:55.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.662+0000 7f569a37bb80 1 -- 172.21.15.59:0/2156389651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55875abf5f30 con 0x55875acda0d0 2023-10-08T12:47:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f565f7fe700 1 -- 172.21.15.59:0/2156389651 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5670003680 con 0x55875acda0d0 2023-10-08T12:47:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f565f7fe700 1 -- 172.21.15.59:0/2156389651 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5670003840 con 0x55875acda0d0 2023-10-08T12:47:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f569a37bb80 10 client.26393 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f569a37bb80 1 -- 172.21.15.59:0/2156389651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f568010dd10 con 0x55875acda0d0 2023-10-08T12:47:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f565f7fe700 1 -- 172.21.15.59:0/2156389651 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55875abf5f30 con 0x55875acda0d0 2023-10-08T12:47:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f565f7fe700 1 -- 172.21.15.59:0/2156389651 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f567000fa30 con 0x55875acda0d0 2023-10-08T12:47:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f569a37bb80 10 client.26393 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f569a37bb80 10 client.26393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f569a37bb80 20 client.26393 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f569a37bb80 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55875acf4e90 0x55875acf7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f569a37bb80 4 client.26393 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:47:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.663+0000 7f569a37bb80 1 -- 172.21.15.59:0/2156389651 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55875ac26e90 con 0x55875acf4e90 2023-10-08T12:47:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.664+0000 7f567f7fe700 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55875acf4e90 0x55875acf7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.664+0000 7f565f7fe700 10 client.26393 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.664+0000 7f567f7fe700 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55875acf4e90 0x55875acf7280 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=107a3984cec40200 server_cookie=dc31c7e31fb0a49e in_seq=0 out_seq=0 2023-10-08T12:47:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f565f7fe700 1 -- 172.21.15.59:0/2156389651 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55875ac26e90 con 0x55875acf4e90 2023-10-08T12:47:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f565f7fe700 10 client.26393 handle_command_reply: tid=0 2023-10-08T12:47:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f569a37bb80 1 client.26393 shutdown 2023-10-08T12:47:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f569a37bb80 1 -- 172.21.15.59:0/2156389651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda0d0 msgr2=0x55875ace5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f569a37bb80 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda0d0 0x55875ace5330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f56700098e0 tx=0x7f567000be80 comp rx=0 tx=0).stop 2023-10-08T12:47:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f569a37bb80 1 -- 172.21.15.59:0/2156389651 shutdown_connections 2023-10-08T12:47:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f569a37bb80 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55875acf4e90 0x55875acf7280 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f569a37bb80 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda0d0 0x55875ace5330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f569a37bb80 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875ace5880 0x55875ace2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f565f7fe700 0 client.26393 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f569a37bb80 1 --2- 172.21.15.59:0/2156389651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda9f0 0x55875ace2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f569a37bb80 1 -- 172.21.15.59:0/2156389651 >> 172.21.15.59:0/2156389651 conn(0x55875ac4f2e0 msgr2=0x55875acdbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f569a37bb80 1 -- 172.21.15.59:0/2156389651 shutdown_connections 2023-10-08T12:47:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.665+0000 7f569a37bb80 1 -- 172.21.15.59:0/2156389651 wait complete. 2023-10-08T12:47:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.666+0000 7f569a37bb80 20 client.26393 trim_cache size 0 max 16384 2023-10-08T12:47:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f569a37bb80 1 Processor -- start 2023-10-08T12:47:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f569a37bb80 1 -- start start 2023-10-08T12:47:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 0x55875acd6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875acda9f0 0x55875accfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875ace5880 0x55875acec340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f569a37bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875aaae9a0 con 0x55875acda9f0 2023-10-08T12:47:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f569a37bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875acd6a90 con 0x55875ace5880 2023-10-08T12:47:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f569a37bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875ace3150 con 0x55875acda0d0 2023-10-08T12:47:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f567ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 0x55875acd6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f567f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875acda9f0 0x55875accfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f567ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 0x55875acd6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56062/0 (socket says 172.21.15.59:56062) 2023-10-08T12:47:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f567ffff700 1 -- 172.21.15.59:0/1048526775 learned_addr learned my addr 172.21.15.59:0/1048526775 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.685+0000 7f5684f9c700 1 --2- 172.21.15.59:0/1048526775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875ace5880 0x55875acec340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.686+0000 7f567ffff700 1 -- 172.21.15.59:0/1048526775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875ace5880 msgr2=0x55875acec340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.686+0000 7f567ffff700 1 --2- 172.21.15.59:0/1048526775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875ace5880 0x55875acec340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.686+0000 7f567ffff700 1 -- 172.21.15.59:0/1048526775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875acda9f0 msgr2=0x55875accfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.686+0000 7f567ffff700 1 --2- 172.21.15.59:0/1048526775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875acda9f0 0x55875accfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.686+0000 7f567ffff700 1 -- 172.21.15.59:0/1048526775 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55875aa41ce0 con 0x55875acda0d0 2023-10-08T12:47:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.686+0000 7f567ffff700 1 --2- 172.21.15.59:0/1048526775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 0x55875acd6410 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5670005bc0 tx=0x7f5670009cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4da6af84be38028 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.686+0000 7f5666ffd700 1 -- 172.21.15.59:0/1048526775 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567001c040 con 0x55875acda0d0 2023-10-08T12:47:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.686+0000 7f5666ffd700 1 -- 172.21.15.59:0/1048526775 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5670038020 con 0x55875acda0d0 2023-10-08T12:47:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.686+0000 7f5666ffd700 1 -- 172.21.15.59:0/1048526775 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56700038e0 con 0x55875acda0d0 2023-10-08T12:47:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.687+0000 7f569a37bb80 1 -- 172.21.15.59:0/1048526775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 msgr2=0x55875acd6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.687+0000 7f569a37bb80 1 --2- 172.21.15.59:0/1048526775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 0x55875acd6410 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5670005bc0 tx=0x7f5670009cd0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.687+0000 7f569a37bb80 1 -- 172.21.15.59:0/1048526775 shutdown_connections 2023-10-08T12:47:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.687+0000 7f569a37bb80 1 --2- 172.21.15.59:0/1048526775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875ace5880 0x55875acec340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.687+0000 7f569a37bb80 1 --2- 172.21.15.59:0/1048526775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875acda0d0 0x55875acd6410 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.687+0000 7f569a37bb80 1 --2- 172.21.15.59:0/1048526775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875acda9f0 0x55875accfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.687+0000 7f569a37bb80 1 -- 172.21.15.59:0/1048526775 >> 172.21.15.59:0/1048526775 conn(0x55875ac4f2e0 msgr2=0x55875acdbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.687+0000 7f569a37bb80 1 -- 172.21.15.59:0/1048526775 shutdown_connections 2023-10-08T12:47:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.687+0000 7f569a37bb80 1 -- 172.21.15.59:0/1048526775 wait complete. 2023-10-08T12:47:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.687+0000 7f569a37bb80 1 -- start start 2023-10-08T12:47:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.687+0000 7f569a37bb80 1 Processor -- start 2023-10-08T12:47:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875acda0d0 0x55875ad433b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ad438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f569a37bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875ace5880 0x55875aceb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f569a37bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875acebd00 con 0x55875acda0d0 2023-10-08T12:47:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f569a37bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875acebe70 con 0x55875acda9f0 2023-10-08T12:47:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f569a37bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875acec030 con 0x55875ace5880 2023-10-08T12:47:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f569a37bb80 10 client.0 _ll_register_callbacks cb 0x7f5674010b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f567f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ad438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f567f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ad438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51130/0 (socket says 172.21.15.59:51130) 2023-10-08T12:47:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f567f7fe700 1 -- 172.21.15.59:0/366799784 learned_addr learned my addr 172.21.15.59:0/366799784 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f5684f9c700 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875ace5880 0x55875aceb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f567ffff700 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875acda0d0 0x55875ad433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f567f7fe700 1 -- 172.21.15.59:0/366799784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875ace5880 msgr2=0x55875aceb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.688+0000 7f567f7fe700 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875ace5880 0x55875aceb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f567f7fe700 1 -- 172.21.15.59:0/366799784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875acda0d0 msgr2=0x55875ad433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f567f7fe700 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875acda0d0 0x55875ad433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f567f7fe700 1 -- 172.21.15.59:0/366799784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568010dd10 con 0x55875acda9f0 2023-10-08T12:47:55.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f567f7fe700 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ad438f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f56740caa70 tx=0x7f5674074040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b154f38d3b32927e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:55.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f565f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:47:55.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f565f7fe700 1 -- 172.21.15.59:0/366799784 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567409e3f0 con 0x55875acda9f0 2023-10-08T12:47:55.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f565f7fe700 1 -- 172.21.15.59:0/366799784 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f56740a2630 con 0x55875acda9f0 2023-10-08T12:47:55.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f569a37bb80 1 -- 172.21.15.59:0/366799784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f567001d040 con 0x55875acda9f0 2023-10-08T12:47:55.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f565f7fe700 1 -- 172.21.15.59:0/366799784 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5674010880 con 0x55875acda9f0 2023-10-08T12:47:55.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f569a37bb80 10 client.26399 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f569a37bb80 1 -- 172.21.15.59:0/366799784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55875aa7f2d0 con 0x55875acda9f0 2023-10-08T12:47:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.689+0000 7f565f7fe700 1 -- 172.21.15.59:0/366799784 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f567001d040 con 0x55875acda9f0 2023-10-08T12:47:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.690+0000 7f565f7fe700 1 -- 172.21.15.59:0/366799784 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f56740a21a0 con 0x55875acda9f0 2023-10-08T12:47:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.690+0000 7f569a37bb80 10 client.26399 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.690+0000 7f569a37bb80 10 client.26399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.690+0000 7f569a37bb80 20 client.26399 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.690+0000 7f569a37bb80 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55875ad4b3a0 0x55875ad4d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.690+0000 7f569a37bb80 4 client.26399 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:47:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.690+0000 7f569a37bb80 1 -- 172.21.15.59:0/366799784 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55875ac26bb0 con 0x55875ad4b3a0 2023-10-08T12:47:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.690+0000 7f567ffff700 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55875ad4b3a0 0x55875ad4d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.690+0000 7f565f7fe700 10 client.26399 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:55.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.690+0000 7f567ffff700 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55875ad4b3a0 0x55875ad4d7c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cbc3046fb1b9ed5 server_cookie=56177885657685ff in_seq=0 out_seq=0 2023-10-08T12:47:55.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.692+0000 7f565f7fe700 1 -- 172.21.15.59:0/366799784 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55875ac26bb0 con 0x55875ad4b3a0 2023-10-08T12:47:55.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.692+0000 7f565f7fe700 10 client.26399 handle_command_reply: tid=0 2023-10-08T12:47:55.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 1 client.26399 shutdown 2023-10-08T12:47:55.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 1 -- 172.21.15.59:0/366799784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 msgr2=0x55875ad438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ad438f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f56740caa70 tx=0x7f5674074040 comp rx=0 tx=0).stop 2023-10-08T12:47:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 1 -- 172.21.15.59:0/366799784 shutdown_connections 2023-10-08T12:47:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55875ad4b3a0 0x55875ad4d7c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55875ace5880 0x55875aceb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55875acda0d0 0x55875ad433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 1 --2- 172.21.15.59:0/366799784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55875acda9f0 0x55875ad438f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f565f7fe700 0 client.26399 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 1 -- 172.21.15.59:0/366799784 >> 172.21.15.59:0/366799784 conn(0x55875ac4f2e0 msgr2=0x55875acdc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 1 -- 172.21.15.59:0/366799784 shutdown_connections 2023-10-08T12:47:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 1 -- 172.21.15.59:0/366799784 wait complete. 2023-10-08T12:47:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.693+0000 7f569a37bb80 20 client.26399 trim_cache size 0 max 16384 2023-10-08T12:47:55.740 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:47:55.740 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:47:55.740 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "40b91f46-b225-48d1-a5a6-c1af8cd38a76", 2023-10-08T12:47:55.741 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:47:55.741 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:47:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 -- 172.21.15.59:0/2611989441 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56680a15f0 msgr2=0x7f56680a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56680a15f0 0x7f56680a3ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5678009ec0 tx=0x7f567800b040 comp rx=0 tx=0).stop 2023-10-08T12:47:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 -- 172.21.15.59:0/2611989441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680100f50 msgr2=0x7f568019eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680100f50 0x7f568019eeb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f567400e9a0 tx=0x7f567400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 -- 172.21.15.59:0/2611989441 shutdown_connections 2023-10-08T12:47:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f56680a15f0 0x7f56680a3ab0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5680106650 0x7f5680198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5680100590 0x7f568019e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 --2- 172.21.15.59:0/2611989441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680100f50 0x7f568019eeb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 -- 172.21.15.59:0/2611989441 >> 172.21.15.59:0/2611989441 conn(0x7f56800fc060 msgr2=0x7f56800fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 -- 172.21.15.59:0/2611989441 shutdown_connections 2023-10-08T12:47:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.694+0000 7f568579d700 1 -- 172.21.15.59:0/2611989441 wait complete. 2023-10-08T12:47:55.744 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:47:55.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.957+0000 7fa2761ff700 1 -- 172.21.15.59:0/1607294157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa270106750 msgr2=0x7fa270106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.957+0000 7fa2761ff700 1 --2- 172.21.15.59:0/1607294157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa270106750 0x7fa270106b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa260009990 tx=0x7fa260009ca0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.957+0000 7fa2761ff700 1 -- 172.21.15.59:0/1607294157 shutdown_connections 2023-10-08T12:47:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.957+0000 7fa2761ff700 1 --2- 172.21.15.59:0/1607294157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa270101100 0x7fa27010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.957+0000 7fa2761ff700 1 --2- 172.21.15.59:0/1607294157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa270106750 0x7fa270106b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.957+0000 7fa2761ff700 1 --2- 172.21.15.59:0/1607294157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa270100740 0x7fa270100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.957+0000 7fa2761ff700 1 -- 172.21.15.59:0/1607294157 >> 172.21.15.59:0/1607294157 conn(0x7fa2700fc230 msgr2=0x7fa2700fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.957+0000 7fa2761ff700 1 -- 172.21.15.59:0/1607294157 shutdown_connections 2023-10-08T12:47:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.957+0000 7fa2761ff700 1 -- 172.21.15.59:0/1607294157 wait complete. 2023-10-08T12:47:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.958+0000 7fa2761ff700 1 Processor -- start 2023-10-08T12:47:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.958+0000 7fa2761ff700 1 -- start start 2023-10-08T12:47:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa2761ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa270100740 0x7fa27019e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa2761ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa270101100 0x7fa27019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa2761ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa270106750 0x7fa270198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa2761ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2701991a0 con 0x7fa270100740 2023-10-08T12:47:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa2761ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa270199310 con 0x7fa270106750 2023-10-08T12:47:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa2761ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2701994d0 con 0x7fa270101100 2023-10-08T12:47:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa26f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa270100740 0x7fa27019e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa26effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa270101100 0x7fa27019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa26effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa270101100 0x7fa27019eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56094/0 (socket says 172.21.15.59:56094) 2023-10-08T12:47:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa26effd700 1 -- 172.21.15.59:0/2304125545 learned_addr learned my addr 172.21.15.59:0/2304125545 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa26ffff700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa270106750 0x7fa270198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa26effd700 1 -- 172.21.15.59:0/2304125545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa270106750 msgr2=0x7fa270198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa26effd700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa270106750 0x7fa270198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa26effd700 1 -- 172.21.15.59:0/2304125545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa270100740 msgr2=0x7fa27019e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa26effd700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa270100740 0x7fa27019e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa26effd700 1 -- 172.21.15.59:0/2304125545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600095f0 con 0x7fa270101100 2023-10-08T12:47:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.959+0000 7fa26f7fe700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa270100740 0x7fa27019e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.960+0000 7fa26effd700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa270101100 0x7fa27019eef0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa26400e9a0 tx=0x7fa26400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.960+0000 7fa26cff9700 1 -- 172.21.15.59:0/2304125545 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264009790 con 0x7fa270101100 2023-10-08T12:47:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.960+0000 7fa2761ff700 1 -- 172.21.15.59:0/2304125545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2701997b0 con 0x7fa270101100 2023-10-08T12:47:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.960+0000 7fa26cff9700 1 -- 172.21.15.59:0/2304125545 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa264010430 con 0x7fa270101100 2023-10-08T12:47:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.960+0000 7fa26cff9700 1 -- 172.21.15.59:0/2304125545 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264018680 con 0x7fa270101100 2023-10-08T12:47:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.960+0000 7fa2761ff700 1 -- 172.21.15.59:0/2304125545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2701a5a50 con 0x7fa270101100 2023-10-08T12:47:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.963+0000 7fa26cff9700 1 -- 172.21.15.59:0/2304125545 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa2640105a0 con 0x7fa270101100 2023-10-08T12:47:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.964+0000 7fa289b9db80 1 Processor -- start 2023-10-08T12:47:55.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.965+0000 7fa289b9db80 1 -- start start 2023-10-08T12:47:55.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.965+0000 7fa26cff9700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2580a1670 0x7fa2580a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.965+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b0695260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.965+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b06a0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.965+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06a0650 0x5582b06a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.965+0000 7fa26cff9700 1 -- 172.21.15.59:0/2304125545 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa264014070 con 0x7fa270101100 2023-10-08T12:47:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.965+0000 7fa289b9db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b05fe460 con 0x5582b0694e80 2023-10-08T12:47:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.965+0000 7fa289b9db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b05efc20 con 0x5582b06957a0 2023-10-08T12:47:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.965+0000 7fa289b9db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b05ed540 con 0x5582b06a0650 2023-10-08T12:47:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.965+0000 7fa26ffff700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2580a1670 0x7fa2580a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b06a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06a0650 0x5582b06a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b06a0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51158/0 (socket says 172.21.15.59:51158) 2023-10-08T12:47:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26effd700 1 -- 172.21.15.59:0/86686897 learned_addr learned my addr 172.21.15.59:0/86686897 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26f7fe700 1 --2- 172.21.15.59:0/86686897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b0695260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26effd700 1 -- 172.21.15.59:0/86686897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06a0650 msgr2=0x5582b06a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26effd700 1 --2- 172.21.15.59:0/86686897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06a0650 0x5582b06a2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26effd700 1 -- 172.21.15.59:0/86686897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 msgr2=0x5582b0695260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26effd700 1 --2- 172.21.15.59:0/86686897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b0695260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26effd700 1 -- 172.21.15.59:0/86686897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582b0413de0 con 0x5582b06957a0 2023-10-08T12:47:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26effd700 1 --2- 172.21.15.59:0/86686897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b06a0110 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa264099f40 tx=0x7fa264099eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e08bd0ee7461644 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa26ffff700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2580a1670 0x7fa2580a3b30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa268009ec0 tx=0x7fa268016450 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa255ffb700 1 -- 172.21.15.59:0/86686897 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26409e170 con 0x5582b06957a0 2023-10-08T12:47:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa255ffb700 1 -- 172.21.15.59:0/86686897 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa26409e390 con 0x5582b06957a0 2023-10-08T12:47:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.966+0000 7fa255ffb700 1 -- 172.21.15.59:0/86686897 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264099990 con 0x5582b06957a0 2023-10-08T12:47:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.967+0000 7fa289b9db80 1 -- 172.21.15.59:0/86686897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 msgr2=0x5582b06a0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.967+0000 7fa289b9db80 1 --2- 172.21.15.59:0/86686897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b06a0110 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa264099f40 tx=0x7fa264099eb0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.967+0000 7fa289b9db80 1 -- 172.21.15.59:0/86686897 shutdown_connections 2023-10-08T12:47:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.967+0000 7fa289b9db80 1 --2- 172.21.15.59:0/86686897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06a0650 0x5582b06a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.967+0000 7fa289b9db80 1 --2- 172.21.15.59:0/86686897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b0695260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.967+0000 7fa289b9db80 1 --2- 172.21.15.59:0/86686897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b06a0110 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.967+0000 7fa289b9db80 1 -- 172.21.15.59:0/86686897 >> 172.21.15.59:0/86686897 conn(0x5582b060a260 msgr2=0x5582b06912d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.967+0000 7fa289b9db80 1 -- 172.21.15.59:0/86686897 shutdown_connections 2023-10-08T12:47:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.967+0000 7fa289b9db80 1 -- 172.21.15.59:0/86686897 wait complete. 2023-10-08T12:47:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.968+0000 7fa289b9db80 1 -- start start 2023-10-08T12:47:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.968+0000 7fa289b9db80 1 Processor -- start 2023-10-08T12:47:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b06a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b069d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06a0650 0x5582b069dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa289b9db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b05e8e30 con 0x5582b0694e80 2023-10-08T12:47:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa289b9db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b0585710 con 0x5582b06957a0 2023-10-08T12:47:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa289b9db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b05853b0 con 0x5582b06a0650 2023-10-08T12:47:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa289b9db80 10 client.0 _ll_register_callbacks cb 0x5582b03e2800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa26effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b069d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa26effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b069d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51166/0 (socket says 172.21.15.59:51166) 2023-10-08T12:47:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa26effd700 1 -- 172.21.15.59:0/342090182 learned_addr learned my addr 172.21.15.59:0/342090182 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa26ffff700 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06a0650 0x5582b069dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa26f7fe700 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b06a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa26effd700 1 -- 172.21.15.59:0/342090182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06a0650 msgr2=0x5582b069dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa26effd700 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06a0650 0x5582b069dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa26effd700 1 -- 172.21.15.59:0/342090182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 msgr2=0x5582b06a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa26effd700 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b06a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.969+0000 7fa26effd700 1 -- 172.21.15.59:0/342090182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2701a5a50 con 0x5582b06957a0 2023-10-08T12:47:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.970+0000 7fa26effd700 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b069d3a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa26400c2d0 tx=0x7fa2640ca9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53d0bada89f52f3b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.970+0000 7fa24effd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:47:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.970+0000 7fa24effd700 1 -- 172.21.15.59:0/342090182 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2640a25d0 con 0x5582b06957a0 2023-10-08T12:47:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.970+0000 7fa289b9db80 1 -- 172.21.15.59:0/342090182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582b05b0eb0 con 0x5582b06957a0 2023-10-08T12:47:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.970+0000 7fa24effd700 1 -- 172.21.15.59:0/342090182 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa26409a6b0 con 0x5582b06957a0 2023-10-08T12:47:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.970+0000 7fa24effd700 1 -- 172.21.15.59:0/342090182 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2640a2140 con 0x5582b06957a0 2023-10-08T12:47:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.970+0000 7fa289b9db80 10 client.26411 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.970+0000 7fa289b9db80 1 -- 172.21.15.59:0/342090182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5582b03fcc60 con 0x5582b06957a0 2023-10-08T12:47:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.970+0000 7fa24effd700 1 -- 172.21.15.59:0/342090182 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5582b05b0eb0 con 0x5582b06957a0 2023-10-08T12:47:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.971+0000 7fa24effd700 1 -- 172.21.15.59:0/342090182 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa26409f160 con 0x5582b06957a0 2023-10-08T12:47:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.971+0000 7fa289b9db80 10 client.26411 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.971+0000 7fa289b9db80 10 client.26411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.971+0000 7fa289b9db80 20 client.26411 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.971+0000 7fa289b9db80 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5582b06afd90 0x5582b06b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.971+0000 7fa289b9db80 4 client.26411 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:47:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.971+0000 7fa289b9db80 1 -- 172.21.15.59:0/342090182 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582b05e1e10 con 0x5582b06afd90 2023-10-08T12:47:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.971+0000 7fa26f7fe700 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5582b06afd90 0x5582b06b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.971+0000 7fa26f7fe700 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5582b06afd90 0x5582b06b21b0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cb674fcaa9cadd5 server_cookie=b8c9d90bb46cac35 in_seq=0 out_seq=0 2023-10-08T12:47:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.971+0000 7fa24effd700 10 client.26411 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.972+0000 7fa24effd700 1 -- 172.21.15.59:0/342090182 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5582b05e1e10 con 0x5582b06afd90 2023-10-08T12:47:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.972+0000 7fa24effd700 10 client.26411 handle_command_reply: tid=0 2023-10-08T12:47:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.972+0000 7fa289b9db80 1 client.26411 shutdown 2023-10-08T12:47:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.972+0000 7fa289b9db80 1 -- 172.21.15.59:0/342090182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 msgr2=0x5582b069d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.972+0000 7fa289b9db80 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b069d3a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa26400c2d0 tx=0x7fa2640ca9a0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.973+0000 7fa289b9db80 1 -- 172.21.15.59:0/342090182 shutdown_connections 2023-10-08T12:47:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.973+0000 7fa289b9db80 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5582b06afd90 0x5582b06b21b0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.973+0000 7fa289b9db80 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06a0650 0x5582b069dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.973+0000 7fa289b9db80 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b06a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.973+0000 7fa24effd700 0 client.26411 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.973+0000 7fa289b9db80 1 --2- 172.21.15.59:0/342090182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06957a0 0x5582b069d3a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.973+0000 7fa289b9db80 1 -- 172.21.15.59:0/342090182 >> 172.21.15.59:0/342090182 conn(0x5582b060a260 msgr2=0x5582b0690ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.973+0000 7fa289b9db80 1 -- 172.21.15.59:0/342090182 shutdown_connections 2023-10-08T12:47:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.973+0000 7fa289b9db80 1 -- 172.21.15.59:0/342090182 wait complete. 2023-10-08T12:47:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.973+0000 7fa289b9db80 20 client.26411 trim_cache size 0 max 16384 2023-10-08T12:47:55.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.992+0000 7fa289b9db80 1 Processor -- start 2023-10-08T12:47:55.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.992+0000 7fa289b9db80 1 -- start start 2023-10-08T12:47:55.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b0694e80 0x5582b069dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 0x5582b06a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b06a0650 0x5582b06ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:55.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa289b9db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b0469920 con 0x5582b06a0650 2023-10-08T12:47:55.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa289b9db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b0695620 con 0x5582b0694e80 2023-10-08T12:47:55.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa289b9db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b06960d0 con 0x5582b06957a0 2023-10-08T12:47:55.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa26f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b0694e80 0x5582b069dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa26f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b0694e80 0x5582b069dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:51178/0 (socket says 172.21.15.59:51178) 2023-10-08T12:47:55.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa26f7fe700 1 -- 172.21.15.59:0/2935606647 learned_addr learned my addr 172.21.15.59:0/2935606647 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:55.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa26effd700 1 --2- 172.21.15.59:0/2935606647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 0x5582b06a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa26ffff700 1 --2- 172.21.15.59:0/2935606647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b06a0650 0x5582b06ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:55.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa26f7fe700 1 -- 172.21.15.59:0/2935606647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 msgr2=0x5582b06a71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa26f7fe700 1 --2- 172.21.15.59:0/2935606647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 0x5582b06a71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa26f7fe700 1 -- 172.21.15.59:0/2935606647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b06a0650 msgr2=0x5582b06ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:55.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa26f7fe700 1 --2- 172.21.15.59:0/2935606647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b06a0650 0x5582b06ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:55.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.993+0000 7fa26f7fe700 1 -- 172.21.15.59:0/2935606647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582b043a250 con 0x5582b0694e80 2023-10-08T12:47:55.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.994+0000 7fa26f7fe700 1 --2- 172.21.15.59:0/2935606647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b0694e80 0x5582b069dae0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa260009990 tx=0x7fa260005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44736dd2da91c328 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:56.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.994+0000 7fa2567fc700 1 -- 172.21.15.59:0/2935606647 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26001d040 con 0x5582b0694e80 2023-10-08T12:47:56.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.994+0000 7fa2567fc700 1 -- 172.21.15.59:0/2935606647 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa26001e040 con 0x5582b0694e80 2023-10-08T12:47:56.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.994+0000 7fa2567fc700 1 -- 172.21.15.59:0/2935606647 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260005540 con 0x5582b0694e80 2023-10-08T12:47:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.995+0000 7fa289b9db80 1 -- 172.21.15.59:0/2935606647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b0694e80 msgr2=0x5582b069dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.995+0000 7fa289b9db80 1 --2- 172.21.15.59:0/2935606647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b0694e80 0x5582b069dae0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa260009990 tx=0x7fa260005960 comp rx=0 tx=0).stop 2023-10-08T12:47:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.995+0000 7fa289b9db80 1 -- 172.21.15.59:0/2935606647 shutdown_connections 2023-10-08T12:47:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.995+0000 7fa289b9db80 1 --2- 172.21.15.59:0/2935606647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b0694e80 0x5582b069dae0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.995+0000 7fa289b9db80 1 --2- 172.21.15.59:0/2935606647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b06a0650 0x5582b06ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.995+0000 7fa289b9db80 1 --2- 172.21.15.59:0/2935606647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 0x5582b06a71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.995+0000 7fa289b9db80 1 -- 172.21.15.59:0/2935606647 >> 172.21.15.59:0/2935606647 conn(0x5582b060a260 msgr2=0x5582b06904d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:56.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.995+0000 7fa289b9db80 1 -- 172.21.15.59:0/2935606647 shutdown_connections 2023-10-08T12:47:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.995+0000 7fa289b9db80 1 -- 172.21.15.59:0/2935606647 wait complete. 2023-10-08T12:47:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.995+0000 7fa289b9db80 1 -- start start 2023-10-08T12:47:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.995+0000 7fa289b9db80 1 Processor -- start 2023-10-08T12:47:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b06a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 0x5582b06a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa289b9db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06a0650 0x5582b06fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa289b9db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b06fd180 con 0x5582b0694e80 2023-10-08T12:47:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa289b9db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b06fd2f0 con 0x5582b06a0650 2023-10-08T12:47:56.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa289b9db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b06fd4b0 con 0x5582b06957a0 2023-10-08T12:47:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa289b9db80 10 client.0 _ll_register_callbacks cb 0x7fa2680097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa26effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 0x5582b06a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06a0650 0x5582b06fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa26effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 0x5582b06a58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56142/0 (socket says 172.21.15.59:56142) 2023-10-08T12:47:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa26effd700 1 -- 172.21.15.59:0/2265764735 learned_addr learned my addr 172.21.15.59:0/2265764735 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:47:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.996+0000 7fa26f7fe700 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b06a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa26effd700 1 -- 172.21.15.59:0/2265764735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06a0650 msgr2=0x5582b06fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:56.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa26effd700 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06a0650 0x5582b06fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa26effd700 1 -- 172.21.15.59:0/2265764735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 msgr2=0x5582b06a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa26effd700 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b06a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa26effd700 1 -- 172.21.15.59:0/2265764735 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27010df10 con 0x5582b06957a0 2023-10-08T12:47:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa26effd700 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 0x5582b06a58b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa2640caa10 tx=0x7fa264010c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3809fe204feed3ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa24effd700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:47:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa24effd700 1 -- 172.21.15.59:0/2265764735 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2640a25d0 con 0x5582b06957a0 2023-10-08T12:47:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa24effd700 1 -- 172.21.15.59:0/2265764735 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa26409f0d0 con 0x5582b06957a0 2023-10-08T12:47:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa289b9db80 1 -- 172.21.15.59:0/2265764735 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa26409e390 con 0x5582b06957a0 2023-10-08T12:47:56.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa24effd700 1 -- 172.21.15.59:0/2265764735 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa26409f290 con 0x5582b06957a0 2023-10-08T12:47:56.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa289b9db80 10 client.26410 fetch_fsmap learned FSMap version 20 2023-10-08T12:47:56.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.997+0000 7fa289b9db80 1 -- 172.21.15.59:0/2265764735 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5582b04122b0 con 0x5582b06957a0 2023-10-08T12:47:56.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.998+0000 7fa24effd700 1 -- 172.21.15.59:0/2265764735 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2640a6080 con 0x5582b06957a0 2023-10-08T12:47:56.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.998+0000 7fa24effd700 1 -- 172.21.15.59:0/2265764735 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa2640991a0 con 0x5582b06957a0 2023-10-08T12:47:56.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.998+0000 7fa289b9db80 10 client.26410 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:47:56.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.998+0000 7fa289b9db80 10 client.26410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:56.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.998+0000 7fa289b9db80 20 client.26410 populate_metadata read hostname 'smithi059' 2023-10-08T12:47:56.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.998+0000 7fa289b9db80 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5582b07047d0 0x5582b0706bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:56.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.998+0000 7fa289b9db80 4 client.26410 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:47:56.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.998+0000 7fa289b9db80 1 -- 172.21.15.59:0/2265764735 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5582b05e1b30 con 0x5582b07047d0 2023-10-08T12:47:56.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.998+0000 7fa26f7fe700 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5582b07047d0 0x5582b0706bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:56.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.998+0000 7fa26f7fe700 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5582b07047d0 0x5582b0706bc0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f1faf63361ccbe server_cookie=cef8458e5f5f6b7b in_seq=0 out_seq=0 2023-10-08T12:47:56.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:55.998+0000 7fa24effd700 10 client.26410 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:56.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.000+0000 7fa24effd700 1 -- 172.21.15.59:0/2265764735 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5582b05e1b30 con 0x5582b07047d0 2023-10-08T12:47:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.000+0000 7fa24effd700 10 client.26410 handle_command_reply: tid=0 2023-10-08T12:47:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.000+0000 7fa289b9db80 1 client.26410 shutdown 2023-10-08T12:47:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa289b9db80 1 -- 172.21.15.59:0/2265764735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 msgr2=0x5582b06a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa289b9db80 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 0x5582b06a58b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa2640caa10 tx=0x7fa264010c80 comp rx=0 tx=0).stop 2023-10-08T12:47:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa289b9db80 1 -- 172.21.15.59:0/2265764735 shutdown_connections 2023-10-08T12:47:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa289b9db80 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5582b07047d0 0x5582b0706bc0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa289b9db80 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b06a0650 0x5582b06fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa289b9db80 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b0694e80 0x5582b06a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa289b9db80 1 --2- 172.21.15.59:0/2265764735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582b06957a0 0x5582b06a58b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa24effd700 0 client.26410 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:47:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa289b9db80 1 -- 172.21.15.59:0/2265764735 >> 172.21.15.59:0/2265764735 conn(0x5582b060a260 msgr2=0x5582b06986f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa289b9db80 1 -- 172.21.15.59:0/2265764735 shutdown_connections 2023-10-08T12:47:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa289b9db80 1 -- 172.21.15.59:0/2265764735 wait complete. 2023-10-08T12:47:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.001+0000 7fa289b9db80 20 client.26410 trim_cache size 0 max 16384 2023-10-08T12:47:56.009 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:47:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:47:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:47:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: "40b91f46-b225-48d1-a5a6-c1af8cd38a76": { 2023-10-08T12:47:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:47:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "40b91f46-b225-48d1-a5a6-c1af8cd38a76", 2023-10-08T12:47:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:47:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:47:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:47:56.010 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:47:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 -- 172.21.15.59:0/2304125545 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2580a1670 msgr2=0x7fa2580a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2580a1670 0x7fa2580a3b30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa268009ec0 tx=0x7fa268016450 comp rx=0 tx=0).stop 2023-10-08T12:47:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 -- 172.21.15.59:0/2304125545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa270101100 msgr2=0x7fa27019eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa270101100 0x7fa27019eef0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa26400e9a0 tx=0x7fa26400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 -- 172.21.15.59:0/2304125545 shutdown_connections 2023-10-08T12:47:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2580a1670 0x7fa2580a3b30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa270106750 0x7fa270198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa270100740 0x7fa27019e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 --2- 172.21.15.59:0/2304125545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa270101100 0x7fa27019eef0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 -- 172.21.15.59:0/2304125545 >> 172.21.15.59:0/2304125545 conn(0x7fa2700fc230 msgr2=0x7fa27010bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 -- 172.21.15.59:0/2304125545 shutdown_connections 2023-10-08T12:47:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:47:56.002+0000 7fa2761ff700 1 -- 172.21.15.59:0/2304125545 wait complete. 2023-10-08T12:47:56.022 INFO:tasks.cephfs.filesystem:scrub status for tag:40b91f46-b225-48d1-a5a6-c1af8cd38a76 - {'path': '/', 'tag': '40b91f46-b225-48d1-a5a6-c1af8cd38a76', 'options': 'recursive,force'} 2023-10-08T12:47:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:55 smithi059 ceph-mon[98489]: pgmap v516: 97 pgs: 97 active+clean; 455 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 198 op/s 2023-10-08T12:47:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:55 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:47:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:55 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:55 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:47:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:55 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:55 smithi092 ceph-mon[134093]: pgmap v516: 97 pgs: 97 active+clean; 455 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 198 op/s 2023-10-08T12:47:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:55 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:47:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:55 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:55 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:47:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:55 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:56.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:55 smithi173 ceph-mon[135182]: pgmap v516: 97 pgs: 97 active+clean; 455 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 198 op/s 2023-10-08T12:47:56.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:55 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:47:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:55 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:55 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:47:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:55 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:47:56.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 841689 13.59 MB/sec execute 207 sec latency 10.414 ms 2023-10-08T12:47:57.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 844043 13.56 MB/sec execute 208 sec latency 33.627 ms 2023-10-08T12:47:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:57 smithi059 ceph-mon[98489]: pgmap v517: 97 pgs: 97 active+clean; 447 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 216 op/s 2023-10-08T12:47:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:57 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:47:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:57 smithi092 ceph-mon[134093]: pgmap v517: 97 pgs: 97 active+clean; 447 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 216 op/s 2023-10-08T12:47:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:57 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:47:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:57 smithi173 ceph-mon[135182]: pgmap v517: 97 pgs: 97 active+clean; 447 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 216 op/s 2023-10-08T12:47:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:57 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:47:58.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 845805 13.55 MB/sec execute 209 sec latency 89.532 ms 2023-10-08T12:47:59.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 848842 13.58 MB/sec execute 210 sec latency 29.639 ms 2023-10-08T12:48:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:47:59 smithi092 ceph-mon[134093]: pgmap v518: 97 pgs: 97 active+clean; 434 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 259 op/s 2023-10-08T12:48:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:47:59 smithi173 ceph-mon[135182]: pgmap v518: 97 pgs: 97 active+clean; 434 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 259 op/s 2023-10-08T12:48:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:47:59 smithi059 ceph-mon[98489]: pgmap v518: 97 pgs: 97 active+clean; 434 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 259 op/s 2023-10-08T12:48:00.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 851019 13.55 MB/sec execute 211 sec latency 96.584 ms 2023-10-08T12:48:01.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 853120 13.55 MB/sec execute 212 sec latency 25.593 ms 2023-10-08T12:48:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:01 smithi173 ceph-mon[135182]: pgmap v519: 97 pgs: 97 active+clean; 438 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 262 op/s 2023-10-08T12:48:02.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:01 smithi059 ceph-mon[98489]: pgmap v519: 97 pgs: 97 active+clean; 438 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 262 op/s 2023-10-08T12:48:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:01 smithi092 ceph-mon[134093]: pgmap v519: 97 pgs: 97 active+clean; 438 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 262 op/s 2023-10-08T12:48:02.518 INFO:tasks.workunit.client.0.smithi059.stdout: 1 855607 13.56 MB/sec execute 213 sec latency 24.189 ms 2023-10-08T12:48:03.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 857321 13.53 MB/sec execute 214 sec latency 44.239 ms 2023-10-08T12:48:04.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:03 smithi059 ceph-mon[98489]: pgmap v520: 97 pgs: 97 active+clean; 438 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 274 op/s 2023-10-08T12:48:04.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:03 smithi059 ceph-mon[98489]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T12:48:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:03 smithi092 ceph-mon[134093]: pgmap v520: 97 pgs: 97 active+clean; 438 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 274 op/s 2023-10-08T12:48:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:03 smithi092 ceph-mon[134093]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T12:48:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:03 smithi173 ceph-mon[135182]: pgmap v520: 97 pgs: 97 active+clean; 438 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 274 op/s 2023-10-08T12:48:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:03 smithi173 ceph-mon[135182]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T12:48:04.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 859863 13.53 MB/sec execute 215 sec latency 23.316 ms 2023-10-08T12:48:05.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 863024 13.55 MB/sec execute 216 sec latency 6.685 ms 2023-10-08T12:48:06.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:05 smithi059 ceph-mon[98489]: pgmap v522: 97 pgs: 97 active+clean; 442 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 304 op/s 2023-10-08T12:48:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:05 smithi092 ceph-mon[134093]: pgmap v522: 97 pgs: 97 active+clean; 442 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 304 op/s 2023-10-08T12:48:06.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:05 smithi173 ceph-mon[135182]: pgmap v522: 97 pgs: 97 active+clean; 442 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 304 op/s 2023-10-08T12:48:06.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 865351 13.53 MB/sec execute 217 sec latency 48.721 ms 2023-10-08T12:48:07.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 867884 13.54 MB/sec execute 218 sec latency 9.396 ms 2023-10-08T12:48:08.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:07 smithi059 ceph-mon[98489]: pgmap v523: 97 pgs: 97 active+clean; 448 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 321 op/s 2023-10-08T12:48:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:07 smithi092 ceph-mon[134093]: pgmap v523: 97 pgs: 97 active+clean; 448 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 321 op/s 2023-10-08T12:48:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:07 smithi173 ceph-mon[135182]: pgmap v523: 97 pgs: 97 active+clean; 448 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 321 op/s 2023-10-08T12:48:08.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 870270 13.54 MB/sec execute 219 sec latency 59.732 ms 2023-10-08T12:48:09.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 873212 13.55 MB/sec execute 220 sec latency 22.745 ms 2023-10-08T12:48:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:09 smithi092 ceph-mon[134093]: pgmap v524: 97 pgs: 97 active+clean; 450 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 262 op/s 2023-10-08T12:48:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:09 smithi173 ceph-mon[135182]: pgmap v524: 97 pgs: 97 active+clean; 450 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 262 op/s 2023-10-08T12:48:10.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:09 smithi059 ceph-mon[98489]: pgmap v524: 97 pgs: 97 active+clean; 450 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 262 op/s 2023-10-08T12:48:10.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 875882 13.54 MB/sec execute 221 sec latency 7.087 ms 2023-10-08T12:48:11.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 877708 13.54 MB/sec execute 222 sec latency 196.170 ms 2023-10-08T12:48:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:11 smithi059 ceph-mon[98489]: pgmap v525: 97 pgs: 97 active+clean; 456 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 279 op/s 2023-10-08T12:48:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:11 smithi092 ceph-mon[134093]: pgmap v525: 97 pgs: 97 active+clean; 456 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 279 op/s 2023-10-08T12:48:12.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:11 smithi173 ceph-mon[135182]: pgmap v525: 97 pgs: 97 active+clean; 456 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 279 op/s 2023-10-08T12:48:12.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 880783 13.56 MB/sec execute 223 sec latency 20.382 ms 2023-10-08T12:48:13.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 882874 13.53 MB/sec execute 224 sec latency 96.061 ms 2023-10-08T12:48:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:13 smithi059 ceph-mon[98489]: pgmap v526: 97 pgs: 97 active+clean; 460 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 280 op/s 2023-10-08T12:48:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:13 smithi059 ceph-mon[98489]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T12:48:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:13 smithi092 ceph-mon[134093]: pgmap v526: 97 pgs: 97 active+clean; 460 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 280 op/s 2023-10-08T12:48:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:13 smithi092 ceph-mon[134093]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T12:48:14.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:13 smithi173 ceph-mon[135182]: pgmap v526: 97 pgs: 97 active+clean; 460 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 280 op/s 2023-10-08T12:48:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:13 smithi173 ceph-mon[135182]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T12:48:14.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 884996 13.53 MB/sec execute 225 sec latency 26.588 ms 2023-10-08T12:48:15.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 887973 13.55 MB/sec execute 226 sec latency 7.784 ms 2023-10-08T12:48:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:15 smithi059 ceph-mon[98489]: pgmap v528: 97 pgs: 97 active+clean; 467 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 275 op/s 2023-10-08T12:48:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:15 smithi092 ceph-mon[134093]: pgmap v528: 97 pgs: 97 active+clean; 467 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 275 op/s 2023-10-08T12:48:16.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:15 smithi173 ceph-mon[135182]: pgmap v528: 97 pgs: 97 active+clean; 467 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 275 op/s 2023-10-08T12:48:16.519 INFO:tasks.workunit.client.0.smithi059.stdout: 1 891101 13.57 MB/sec execute 227 sec latency 6.957 ms 2023-10-08T12:48:17.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 892669 13.54 MB/sec execute 228 sec latency 105.548 ms 2023-10-08T12:48:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:17 smithi059 ceph-mon[98489]: pgmap v529: 97 pgs: 97 active+clean; 472 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 262 op/s 2023-10-08T12:48:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:17 smithi092 ceph-mon[134093]: pgmap v529: 97 pgs: 97 active+clean; 472 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 262 op/s 2023-10-08T12:48:18.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:17 smithi173 ceph-mon[135182]: pgmap v529: 97 pgs: 97 active+clean; 472 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 262 op/s 2023-10-08T12:48:18.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 895041 13.54 MB/sec execute 229 sec latency 50.275 ms 2023-10-08T12:48:19.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 897442 13.53 MB/sec execute 230 sec latency 101.089 ms 2023-10-08T12:48:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:19 smithi092 ceph-mon[134093]: pgmap v530: 97 pgs: 97 active+clean; 476 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.5 MiB/s wr, 282 op/s 2023-10-08T12:48:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:19 smithi173 ceph-mon[135182]: pgmap v530: 97 pgs: 97 active+clean; 476 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.5 MiB/s wr, 282 op/s 2023-10-08T12:48:20.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:19 smithi059 ceph-mon[98489]: pgmap v530: 97 pgs: 97 active+clean; 476 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.5 MiB/s wr, 282 op/s 2023-10-08T12:48:20.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 899808 13.53 MB/sec execute 231 sec latency 10.951 ms 2023-10-08T12:48:21.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 902481 13.53 MB/sec execute 232 sec latency 11.755 ms 2023-10-08T12:48:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:21 smithi059 ceph-mon[98489]: pgmap v531: 97 pgs: 97 active+clean; 483 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 289 op/s 2023-10-08T12:48:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:21 smithi092 ceph-mon[134093]: pgmap v531: 97 pgs: 97 active+clean; 483 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 289 op/s 2023-10-08T12:48:22.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:21 smithi173 ceph-mon[135182]: pgmap v531: 97 pgs: 97 active+clean; 483 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 289 op/s 2023-10-08T12:48:22.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 905354 13.54 MB/sec execute 233 sec latency 109.052 ms 2023-10-08T12:48:23.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 907637 13.52 MB/sec execute 234 sec latency 77.070 ms 2023-10-08T12:48:24.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:23 smithi059 ceph-mon[98489]: pgmap v532: 97 pgs: 97 active+clean; 487 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.5 MiB/s wr, 296 op/s 2023-10-08T12:48:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:23 smithi092 ceph-mon[134093]: pgmap v532: 97 pgs: 97 active+clean; 487 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.5 MiB/s wr, 296 op/s 2023-10-08T12:48:24.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:23 smithi173 ceph-mon[135182]: pgmap v532: 97 pgs: 97 active+clean; 487 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.5 MiB/s wr, 296 op/s 2023-10-08T12:48:24.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 909639 13.52 MB/sec execute 235 sec latency 97.623 ms 2023-10-08T12:48:25.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 912709 13.54 MB/sec execute 236 sec latency 6.806 ms 2023-10-08T12:48:26.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:48:26.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.239+0000 7fa097dff700 1 -- 172.21.15.59:0/247104813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa090102940 msgr2=0x7fa090102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.239+0000 7fa097dff700 1 --2- 172.21.15.59:0/247104813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa090102940 0x7fa090102dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa080009990 tx=0x7fa080009ca0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.239+0000 7fa097dff700 1 -- 172.21.15.59:0/247104813 shutdown_connections 2023-10-08T12:48:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.239+0000 7fa097dff700 1 --2- 172.21.15.59:0/247104813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa090103300 0x7fa09010f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.239+0000 7fa097dff700 1 --2- 172.21.15.59:0/247104813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa090108950 0x7fa090108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.239+0000 7fa097dff700 1 --2- 172.21.15.59:0/247104813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa090102940 0x7fa090102dc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.239+0000 7fa097dff700 1 -- 172.21.15.59:0/247104813 >> 172.21.15.59:0/247104813 conn(0x7fa0900fe3d0 msgr2=0x7fa0901007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.239+0000 7fa097dff700 1 -- 172.21.15.59:0/247104813 shutdown_connections 2023-10-08T12:48:26.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.239+0000 7fa097dff700 1 -- 172.21.15.59:0/247104813 wait complete. 2023-10-08T12:48:26.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.240+0000 7fa097dff700 1 Processor -- start 2023-10-08T12:48:26.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.240+0000 7fa097dff700 1 -- start start 2023-10-08T12:48:26.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.240+0000 7fa097dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa090102940 0x7fa090198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.240+0000 7fa097dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa090103300 0x7fa090199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.240+0000 7fa097dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa090108950 0x7fa09019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.240+0000 7fa097dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09019dd10 con 0x7fa090102940 2023-10-08T12:48:26.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa097dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09019de80 con 0x7fa090103300 2023-10-08T12:48:26.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa097dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09019e040 con 0x7fa090108950 2023-10-08T12:48:26.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa09539a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa090103300 0x7fa090199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa095b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa090102940 0x7fa090198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa09639c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa090108950 0x7fa09019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa09539a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa090103300 0x7fa090199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50648/0 (socket says 172.21.15.59:50648) 2023-10-08T12:48:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa09539a700 1 -- 172.21.15.59:0/2859584496 learned_addr learned my addr 172.21.15.59:0/2859584496 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa09639c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa090108950 0x7fa09019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56884/0 (socket says 172.21.15.59:56884) 2023-10-08T12:48:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa09539a700 1 -- 172.21.15.59:0/2859584496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa090108950 msgr2=0x7fa09019d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa09539a700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa090108950 0x7fa09019d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa09539a700 1 -- 172.21.15.59:0/2859584496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa090102940 msgr2=0x7fa090198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa09539a700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa090102940 0x7fa090198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa09539a700 1 -- 172.21.15.59:0/2859584496 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0800095f0 con 0x7fa090103300 2023-10-08T12:48:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.241+0000 7fa09539a700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa090103300 0x7fa090199330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa080000c00 tx=0x7fa080005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.242+0000 7fa086ffd700 1 -- 172.21.15.59:0/2859584496 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08001d070 con 0x7fa090103300 2023-10-08T12:48:26.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.242+0000 7fa086ffd700 1 -- 172.21.15.59:0/2859584496 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa080022470 con 0x7fa090103300 2023-10-08T12:48:26.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.242+0000 7fa097dff700 1 -- 172.21.15.59:0/2859584496 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09019e2c0 con 0x7fa090103300 2023-10-08T12:48:26.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.242+0000 7fa086ffd700 1 -- 172.21.15.59:0/2859584496 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080017650 con 0x7fa090103300 2023-10-08T12:48:26.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.242+0000 7fa097dff700 1 -- 172.21.15.59:0/2859584496 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0901a5b60 con 0x7fa090103300 2023-10-08T12:48:26.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.245+0000 7fa086ffd700 1 -- 172.21.15.59:0/2859584496 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa0800225e0 con 0x7fa090103300 2023-10-08T12:48:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.247+0000 7fa086ffd700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa07c0a15f0 0x7fa07c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.247+0000 7fa086ffd700 1 -- 172.21.15.59:0/2859584496 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa0800ce410 con 0x7fa090103300 2023-10-08T12:48:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.247+0000 7fa095b9b700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa07c0a15f0 0x7fa07c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.247+0000 7fa0ab796b80 1 Processor -- start 2023-10-08T12:48:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa0ab796b80 1 -- start start 2023-10-08T12:48:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa095b9b700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa07c0a15f0 0x7fa07c0a3ab0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa08c007b60 tx=0x7fa08c0073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:26.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def0e80 0x558a9def1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 0x558a9defc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9defea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9de5a460 con 0x558a9defc650 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9de4bc20 con 0x558a9def17a0 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9de49540 con 0x558a9def0e80 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa095b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def0e80 0x558a9def1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa095b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def0e80 0x558a9def1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:56888/0 (socket says 172.21.15.59:56888) 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa095b9b700 1 -- 172.21.15.59:0/2956723381 learned_addr learned my addr 172.21.15.59:0/2956723381 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa09539a700 1 --2- 172.21.15.59:0/2956723381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 0x558a9defc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.248+0000 7fa09639c700 1 --2- 172.21.15.59:0/2956723381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9defea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.249+0000 7fa09539a700 1 -- 172.21.15.59:0/2956723381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def0e80 msgr2=0x558a9def1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.249+0000 7fa09539a700 1 --2- 172.21.15.59:0/2956723381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def0e80 0x558a9def1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.249+0000 7fa09539a700 1 -- 172.21.15.59:0/2956723381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 msgr2=0x558a9defea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:26.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.249+0000 7fa09539a700 1 --2- 172.21.15.59:0/2956723381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9defea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.249+0000 7fa09539a700 1 -- 172.21.15.59:0/2956723381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a9dc6fde0 con 0x558a9def17a0 2023-10-08T12:48:26.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.249+0000 7fa095b9b700 1 --2- 172.21.15.59:0/2956723381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def0e80 0x558a9def1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:26.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.249+0000 7fa09539a700 1 --2- 172.21.15.59:0/2956723381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 0x558a9defc110 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa0800cbb20 tx=0x7fa080097830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=533a6477f04bcea8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:26.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.249+0000 7fa07bfff700 1 -- 172.21.15.59:0/2956723381 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08009add0 con 0x558a9def17a0 2023-10-08T12:48:26.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.249+0000 7fa07bfff700 1 -- 172.21.15.59:0/2956723381 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa08009bb70 con 0x558a9def17a0 2023-10-08T12:48:26.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.249+0000 7fa07bfff700 1 -- 172.21.15.59:0/2956723381 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08009b6d0 con 0x558a9def17a0 2023-10-08T12:48:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.250+0000 7fa0ab796b80 1 -- 172.21.15.59:0/2956723381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 msgr2=0x558a9defc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.250+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/2956723381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 0x558a9defc110 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa0800cbb20 tx=0x7fa080097830 comp rx=0 tx=0).stop 2023-10-08T12:48:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.250+0000 7fa0ab796b80 1 -- 172.21.15.59:0/2956723381 shutdown_connections 2023-10-08T12:48:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.250+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/2956723381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9defea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.250+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/2956723381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def0e80 0x558a9def1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.250+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/2956723381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 0x558a9defc110 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.250+0000 7fa0ab796b80 1 -- 172.21.15.59:0/2956723381 >> 172.21.15.59:0/2956723381 conn(0x558a9de66260 msgr2=0x558a9deed2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.250+0000 7fa0ab796b80 1 -- 172.21.15.59:0/2956723381 shutdown_connections 2023-10-08T12:48:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.250+0000 7fa0ab796b80 1 -- 172.21.15.59:0/2956723381 wait complete. 2023-10-08T12:48:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.251+0000 7fa0ab796b80 1 -- start start 2023-10-08T12:48:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.251+0000 7fa0ab796b80 1 Processor -- start 2023-10-08T12:48:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.252+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9def0e80 0x558a9defca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.252+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 0x558a9defcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.252+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9defc650 0x558a9df07ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.252+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9de44e30 con 0x558a9def0e80 2023-10-08T12:48:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.252+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9dde1710 con 0x558a9def17a0 2023-10-08T12:48:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.252+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9dde13b0 con 0x558a9defc650 2023-10-08T12:48:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.252+0000 7fa0ab796b80 10 client.0 _ll_register_callbacks cb 0x558a9dc3e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.252+0000 7fa09539a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 0x558a9defcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.252+0000 7fa095b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9def0e80 0x558a9defca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.252+0000 7fa09539a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 0x558a9defcf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50668/0 (socket says 172.21.15.59:50668) 2023-10-08T12:48:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.252+0000 7fa09539a700 1 -- 172.21.15.59:0/3597630004 learned_addr learned my addr 172.21.15.59:0/3597630004 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa09639c700 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9defc650 0x558a9df07ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa09539a700 1 -- 172.21.15.59:0/3597630004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9defc650 msgr2=0x558a9df07ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa09539a700 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9defc650 0x558a9df07ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa09539a700 1 -- 172.21.15.59:0/3597630004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9def0e80 msgr2=0x558a9defca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa09539a700 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9def0e80 0x558a9defca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa09539a700 1 -- 172.21.15.59:0/3597630004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c010a40 con 0x558a9def17a0 2023-10-08T12:48:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa09539a700 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 0x558a9defcf70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa08000f740 tx=0x7fa080009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54150fb615220974 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa0797fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:48:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa0797fa700 1 -- 172.21.15.59:0/3597630004 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0800b3ea0 con 0x558a9def17a0 2023-10-08T12:48:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3597630004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a9de0ceb0 con 0x558a9def17a0 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa0797fa700 1 -- 172.21.15.59:0/3597630004 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa0800b7030 con 0x558a9def17a0 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa0797fa700 1 -- 172.21.15.59:0/3597630004 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa08009add0 con 0x558a9def17a0 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.253+0000 7fa0ab796b80 10 client.26429 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.254+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3597630004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fa0901a5b60 con 0x558a9def17a0 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.254+0000 7fa0797fa700 1 -- 172.21.15.59:0/3597630004 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558a9de0ceb0 con 0x558a9def17a0 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.254+0000 7fa0797fa700 1 -- 172.21.15.59:0/3597630004 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa0800b2030 con 0x558a9def17a0 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.254+0000 7fa0ab796b80 10 client.26429 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.254+0000 7fa0ab796b80 10 client.26429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.254+0000 7fa0ab796b80 20 client.26429 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.254+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558a9df0b9a0 0x558a9df0ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.254+0000 7fa0ab796b80 4 client.26429 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:48:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.254+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3597630004 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a9de3de10 con 0x558a9df0b9a0 2023-10-08T12:48:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.254+0000 7fa095b9b700 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558a9df0b9a0 0x558a9df0ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.255+0000 7fa095b9b700 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558a9df0b9a0 0x558a9df0ddc0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6fbf398127e9ef2 server_cookie=6805c6a406530a5a in_seq=0 out_seq=0 2023-10-08T12:48:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.255+0000 7fa0797fa700 10 client.26429 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.255+0000 7fa0797fa700 1 -- 172.21.15.59:0/3597630004 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558a9de3de10 con 0x558a9df0b9a0 2023-10-08T12:48:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.255+0000 7fa0797fa700 10 client.26429 handle_command_reply: tid=0 2023-10-08T12:48:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.255+0000 7fa0ab796b80 1 client.26429 shutdown 2023-10-08T12:48:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3597630004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 msgr2=0x558a9defcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 0x558a9defcf70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa08000f740 tx=0x7fa080009ca0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3597630004 shutdown_connections 2023-10-08T12:48:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558a9df0b9a0 0x558a9df0ddc0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9defc650 0x558a9df07ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9def0e80 0x558a9defca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0797fa700 0 client.26429 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3597630004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def17a0 0x558a9defcf70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3597630004 >> 172.21.15.59:0/3597630004 conn(0x558a9de66260 msgr2=0x558a9deece60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3597630004 shutdown_connections 2023-10-08T12:48:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3597630004 wait complete. 2023-10-08T12:48:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.256+0000 7fa0ab796b80 20 client.26429 trim_cache size 0 max 16384 2023-10-08T12:48:26.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:25 smithi059 ceph-mon[98489]: pgmap v533: 97 pgs: 97 active+clean; 492 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 281 op/s 2023-10-08T12:48:26.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.274+0000 7fa0ab796b80 1 Processor -- start 2023-10-08T12:48:26.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.274+0000 7fa0ab796b80 1 -- start start 2023-10-08T12:48:26.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df01930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def17a0 0x558a9def8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9def9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9dcc5920 con 0x558a9defc650 2023-10-08T12:48:26.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9df08980 con 0x558a9def0e80 2023-10-08T12:48:26.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9deedea0 con 0x558a9def17a0 2023-10-08T12:48:26.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa095b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df01930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa09639c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9def9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa09539a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def17a0 0x558a9def8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa095b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df01930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50672/0 (socket says 172.21.15.59:50672) 2023-10-08T12:48:26.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa095b9b700 1 -- 172.21.15.59:0/2242236450 learned_addr learned my addr 172.21.15.59:0/2242236450 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa095b9b700 1 -- 172.21.15.59:0/2242236450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def17a0 msgr2=0x558a9def8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa095b9b700 1 --2- 172.21.15.59:0/2242236450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def17a0 0x558a9def8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa095b9b700 1 -- 172.21.15.59:0/2242236450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 msgr2=0x558a9def9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa095b9b700 1 --2- 172.21.15.59:0/2242236450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9def9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa095b9b700 1 -- 172.21.15.59:0/2242236450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a9df129b0 con 0x558a9def0e80 2023-10-08T12:48:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.275+0000 7fa09539a700 1 --2- 172.21.15.59:0/2242236450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def17a0 0x558a9def8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.276+0000 7fa095b9b700 1 --2- 172.21.15.59:0/2242236450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df01930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x558a9df0e690 tx=0x7fa08c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=530aa534739efa74 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.276+0000 7fa084bff700 1 -- 172.21.15.59:0/2242236450 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c024040 con 0x558a9def0e80 2023-10-08T12:48:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.276+0000 7fa084bff700 1 -- 172.21.15.59:0/2242236450 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa08c015070 con 0x558a9def0e80 2023-10-08T12:48:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.276+0000 7fa084bff700 1 -- 172.21.15.59:0/2242236450 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c003ce0 con 0x558a9def0e80 2023-10-08T12:48:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.277+0000 7fa0ab796b80 1 -- 172.21.15.59:0/2242236450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 msgr2=0x558a9df01930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.277+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/2242236450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df01930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x558a9df0e690 tx=0x7fa08c013000 comp rx=0 tx=0).stop 2023-10-08T12:48:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.277+0000 7fa0ab796b80 1 -- 172.21.15.59:0/2242236450 shutdown_connections 2023-10-08T12:48:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.277+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/2242236450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df01930 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.277+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/2242236450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9def9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.277+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/2242236450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def17a0 0x558a9def8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.277+0000 7fa0ab796b80 1 -- 172.21.15.59:0/2242236450 >> 172.21.15.59:0/2242236450 conn(0x558a9de66260 msgr2=0x558a9defa140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.277+0000 7fa0ab796b80 1 -- 172.21.15.59:0/2242236450 shutdown_connections 2023-10-08T12:48:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.277+0000 7fa0ab796b80 1 -- 172.21.15.59:0/2242236450 wait complete. 2023-10-08T12:48:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.277+0000 7fa0ab796b80 1 -- start start 2023-10-08T12:48:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.278+0000 7fa0ab796b80 1 Processor -- start 2023-10-08T12:48:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.278+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df53a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.278+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def17a0 0x558a9df53fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.278+0000 7fa0ab796b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9df58a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.278+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9df59050 con 0x558a9defc650 2023-10-08T12:48:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.278+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9df591c0 con 0x558a9def0e80 2023-10-08T12:48:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.278+0000 7fa0ab796b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9df59380 con 0x558a9def17a0 2023-10-08T12:48:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.278+0000 7fa0ab796b80 10 client.0 _ll_register_callbacks cb 0x7fa088009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.278+0000 7fa095b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df53a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa095b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df53a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50688/0 (socket says 172.21.15.59:50688) 2023-10-08T12:48:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa095b9b700 1 -- 172.21.15.59:0/3711897287 learned_addr learned my addr 172.21.15.59:0/3711897287 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa09539a700 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def17a0 0x558a9df53fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa09639c700 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9df58a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa095b9b700 1 -- 172.21.15.59:0/3711897287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def17a0 msgr2=0x558a9df53fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa095b9b700 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def17a0 0x558a9df53fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa095b9b700 1 -- 172.21.15.59:0/3711897287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 msgr2=0x558a9df58a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa095b9b700 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9df58a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa095b9b700 1 -- 172.21.15.59:0/3711897287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0901a5b60 con 0x558a9def0e80 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa095b9b700 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df53a60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0059a0 tx=0x7fa08c0038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5877422519536f09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa0797fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.279+0000 7fa0797fa700 1 -- 172.21.15.59:0/3711897287 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c024030 con 0x558a9def0e80 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3711897287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa08009bb70 con 0x558a9def0e80 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0797fa700 1 -- 172.21.15.59:0/3711897287 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa08c017070 con 0x558a9def0e80 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0797fa700 1 -- 172.21.15.59:0/3711897287 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa08c0295b0 con 0x558a9def0e80 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0ab796b80 10 client.26435 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3711897287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fa08c004040 con 0x558a9def0e80 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0797fa700 1 -- 172.21.15.59:0/3711897287 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa08009bb70 con 0x558a9def0e80 2023-10-08T12:48:26.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0797fa700 1 -- 172.21.15.59:0/3711897287 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa08c042050 con 0x558a9def0e80 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0ab796b80 10 client.26435 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0ab796b80 10 client.26435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0ab796b80 20 client.26435 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558a9df60d00 0x558a9df63120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0ab796b80 4 client.26435 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.280+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3711897287 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558a9de3db30 con 0x558a9df60d00 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.281+0000 7fa09539a700 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558a9df60d00 0x558a9df63120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.281+0000 7fa09539a700 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558a9df60d00 0x558a9df63120 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=142bcabebd68ae8e server_cookie=dfc5ad9ad6fdf5e in_seq=0 out_seq=0 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.281+0000 7fa0797fa700 10 client.26435 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0797fa700 1 -- 172.21.15.59:0/3711897287 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558a9de3db30 con 0x558a9df60d00 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0797fa700 10 client.26435 handle_command_reply: tid=0 2023-10-08T12:48:26.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0ab796b80 1 client.26435 shutdown 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3711897287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 msgr2=0x558a9df53a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df53a60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0059a0 tx=0x7fa08c0038a0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3711897287 shutdown_connections 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558a9df60d00 0x558a9df63120 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a9def0e80 0x558a9df53a60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a9defc650 0x558a9df58a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0797fa700 0 client.26435 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0ab796b80 1 --2- 172.21.15.59:0/3711897287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9def17a0 0x558a9df53fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3711897287 >> 172.21.15.59:0/3711897287 conn(0x558a9de66260 msgr2=0x558a9defa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3711897287 shutdown_connections 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.282+0000 7fa0ab796b80 1 -- 172.21.15.59:0/3711897287 wait complete. 2023-10-08T12:48:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa0ab796b80 20 client.26435 trim_cache size 0 max 16384 2023-10-08T12:48:26.289 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:48:26.289 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:48:26.289 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:48:26.289 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:48:26.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 -- 172.21.15.59:0/2859584496 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa07c0a15f0 msgr2=0x7fa07c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa07c0a15f0 0x7fa07c0a3ab0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa08c007b60 tx=0x7fa08c0073d0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 -- 172.21.15.59:0/2859584496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa090103300 msgr2=0x7fa090199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa090103300 0x7fa090199330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa080000c00 tx=0x7fa080005740 comp rx=0 tx=0).stop 2023-10-08T12:48:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 -- 172.21.15.59:0/2859584496 shutdown_connections 2023-10-08T12:48:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa07c0a15f0 0x7fa07c0a3ab0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa090108950 0x7fa09019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa090102940 0x7fa090198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 --2- 172.21.15.59:0/2859584496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa090103300 0x7fa090199330 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 -- 172.21.15.59:0/2859584496 >> 172.21.15.59:0/2859584496 conn(0x7fa0900fe3d0 msgr2=0x7fa0900fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:26.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 -- 172.21.15.59:0/2859584496 shutdown_connections 2023-10-08T12:48:26.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.283+0000 7fa097dff700 1 -- 172.21.15.59:0/2859584496 wait complete. 2023-10-08T12:48:26.303 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:48:26.303 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:48:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:25 smithi092 ceph-mon[134093]: pgmap v533: 97 pgs: 97 active+clean; 492 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 281 op/s 2023-10-08T12:48:26.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:25 smithi173 ceph-mon[135182]: pgmap v533: 97 pgs: 97 active+clean; 492 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 281 op/s 2023-10-08T12:48:26.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.509+0000 7f06317ff700 1 -- 172.21.15.59:0/2565703811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f062c100630 msgr2=0x7f062c100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.509+0000 7f06317ff700 1 --2- 172.21.15.59:0/2565703811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f062c100630 0x7f062c100ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0620009990 tx=0x7f0620009ca0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.509+0000 7f06317ff700 1 -- 172.21.15.59:0/2565703811 shutdown_connections 2023-10-08T12:48:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.509+0000 7f06317ff700 1 --2- 172.21.15.59:0/2565703811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f062c100ff0 0x7f062c10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.509+0000 7f06317ff700 1 --2- 172.21.15.59:0/2565703811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c106640 0x7f062c106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.509+0000 7f06317ff700 1 --2- 172.21.15.59:0/2565703811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f062c100630 0x7f062c100ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.509+0000 7f06317ff700 1 -- 172.21.15.59:0/2565703811 >> 172.21.15.59:0/2565703811 conn(0x7f062c0fc1a0 msgr2=0x7f062c0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.509+0000 7f06317ff700 1 -- 172.21.15.59:0/2565703811 shutdown_connections 2023-10-08T12:48:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.510+0000 7f06317ff700 1 -- 172.21.15.59:0/2565703811 wait complete. 2023-10-08T12:48:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.510+0000 7f06317ff700 1 Processor -- start 2023-10-08T12:48:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f06317ff700 1 -- start start 2023-10-08T12:48:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f06317ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c100630 0x7f062c19c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f06317ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f062c100ff0 0x7f062c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f06317ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f062c106640 0x7f062c196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f06317ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c196f90 con 0x7f062c100630 2023-10-08T12:48:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f06317ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c197100 con 0x7f062c106640 2023-10-08T12:48:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f06317ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c1972c0 con 0x7f062c100ff0 2023-10-08T12:48:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f062affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c100630 0x7f062c19c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f062a7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f062c100ff0 0x7f062c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f062affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c100630 0x7f062c19c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52336/0 (socket says 172.21.15.59:52336) 2023-10-08T12:48:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f062affd700 1 -- 172.21.15.59:0/979297839 learned_addr learned my addr 172.21.15.59:0/979297839 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.511+0000 7f062b7fe700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f062c106640 0x7f062c196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f062affd700 1 -- 172.21.15.59:0/979297839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f062c100ff0 msgr2=0x7f062c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f062affd700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f062c100ff0 0x7f062c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f062affd700 1 -- 172.21.15.59:0/979297839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f062c106640 msgr2=0x7f062c196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f062affd700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f062c106640 0x7f062c196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f062affd700 1 -- 172.21.15.59:0/979297839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c009520 con 0x7f062c100630 2023-10-08T12:48:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f062a7fc700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f062c100ff0 0x7f062c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f062b7fe700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f062c106640 0x7f062c196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f062affd700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c100630 0x7f062c19c800 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f061c00eb30 tx=0x7f061c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f0613fff700 1 -- 172.21.15.59:0/979297839 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c009880 con 0x7f062c100630 2023-10-08T12:48:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f06317ff700 1 -- 172.21.15.59:0/979297839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06200095f0 con 0x7f062c100630 2023-10-08T12:48:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f0613fff700 1 -- 172.21.15.59:0/979297839 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f061c0044e0 con 0x7f062c100630 2023-10-08T12:48:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f0613fff700 1 -- 172.21.15.59:0/979297839 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c003d80 con 0x7f062c100630 2023-10-08T12:48:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.512+0000 7f06317ff700 1 -- 172.21.15.59:0/979297839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c1a3610 con 0x7f062c100630 2023-10-08T12:48:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.513+0000 7f06317ff700 1 -- 172.21.15.59:0/979297839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c108c50 con 0x7f062c100630 2023-10-08T12:48:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.516+0000 7f0613fff700 1 -- 172.21.15.59:0/979297839 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f061c003f20 con 0x7f062c100630 2023-10-08T12:48:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.517+0000 7f0613fff700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06140a15f0 0x7f06140a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.517+0000 7f0613fff700 1 -- 172.21.15.59:0/979297839 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f061c014070 con 0x7f062c100630 2023-10-08T12:48:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.517+0000 7f062a7fc700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06140a15f0 0x7f06140a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.518+0000 7f062a7fc700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06140a15f0 0x7f06140a3ab0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f062c197af0 tx=0x7f062000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:26.539 INFO:tasks.workunit.client.0.smithi059.stdout: 1 915394 13.54 MB/sec execute 237 sec latency 10.630 ms 2023-10-08T12:48:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.522+0000 7f0613fff700 1 -- 172.21.15.59:0/979297839 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f061c0968f0 con 0x7f062c100630 2023-10-08T12:48:26.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.785+0000 7f06317ff700 1 -- 172.21.15.59:0/979297839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f062c101d70 con 0x7f062c100630 2023-10-08T12:48:26.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.786+0000 7f0613fff700 1 -- 172.21.15.59:0/979297839 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f061c099f10 con 0x7f062c100630 2023-10-08T12:48:26.787 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:48:26.787 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:48:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.788+0000 7f06317ff700 1 -- 172.21.15.59:0/979297839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06140a15f0 msgr2=0x7f06140a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.788+0000 7f06317ff700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06140a15f0 0x7f06140a3ab0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f062c197af0 tx=0x7f062000b260 comp rx=0 tx=0).stop 2023-10-08T12:48:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.788+0000 7f06317ff700 1 -- 172.21.15.59:0/979297839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c100630 msgr2=0x7f062c19c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.788+0000 7f06317ff700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c100630 0x7f062c19c800 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f061c00eb30 tx=0x7f061c00ee40 comp rx=0 tx=0).stop 2023-10-08T12:48:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.788+0000 7f06317ff700 1 -- 172.21.15.59:0/979297839 shutdown_connections 2023-10-08T12:48:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.788+0000 7f06317ff700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f06140a15f0 0x7f06140a3ab0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.789+0000 7f06317ff700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f062c106640 0x7f062c196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.789+0000 7f06317ff700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c100630 0x7f062c19c800 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.789+0000 7f06317ff700 1 --2- 172.21.15.59:0/979297839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f062c100ff0 0x7f062c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:26.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.789+0000 7f06317ff700 1 -- 172.21.15.59:0/979297839 >> 172.21.15.59:0/979297839 conn(0x7f062c0fc1a0 msgr2=0x7f062c0fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:26.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.789+0000 7f06317ff700 1 -- 172.21.15.59:0/979297839 shutdown_connections 2023-10-08T12:48:26.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:26.789+0000 7f06317ff700 1 -- 172.21.15.59:0/979297839 wait complete. 2023-10-08T12:48:26.791 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:48:26.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:48:27.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.024+0000 7f36507ff700 1 -- 172.21.15.59:0/2096714614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3648106750 msgr2=0x7f3648106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.024+0000 7f36507ff700 1 --2- 172.21.15.59:0/2096714614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3648106750 0x7f3648106b30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3644009990 tx=0x7f3644009ca0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.024+0000 7f36507ff700 1 -- 172.21.15.59:0/2096714614 shutdown_connections 2023-10-08T12:48:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.024+0000 7f36507ff700 1 --2- 172.21.15.59:0/2096714614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3648101100 0x7f364810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.024+0000 7f36507ff700 1 --2- 172.21.15.59:0/2096714614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3648106750 0x7f3648106b30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.024+0000 7f36507ff700 1 --2- 172.21.15.59:0/2096714614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3648100740 0x7f3648100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.024+0000 7f36507ff700 1 -- 172.21.15.59:0/2096714614 >> 172.21.15.59:0/2096714614 conn(0x7f36480fc230 msgr2=0x7f36480fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.024+0000 7f36507ff700 1 -- 172.21.15.59:0/2096714614 shutdown_connections 2023-10-08T12:48:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.024+0000 7f36507ff700 1 -- 172.21.15.59:0/2096714614 wait complete. 2023-10-08T12:48:27.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.025+0000 7f36507ff700 1 Processor -- start 2023-10-08T12:48:27.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.025+0000 7f36507ff700 1 -- start start 2023-10-08T12:48:27.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f36507ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3648100740 0x7f3648198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f36507ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3648101100 0x7f36481992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f36507ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3648106750 0x7f364819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f36507ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364819dca0 con 0x7f3648100740 2023-10-08T12:48:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f36507ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364819de10 con 0x7f3648101100 2023-10-08T12:48:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f36507ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364819dfd0 con 0x7f3648106750 2023-10-08T12:48:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f364e59b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3648100740 0x7f3648198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f364e59b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3648100740 0x7f3648198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52354/0 (socket says 172.21.15.59:52354) 2023-10-08T12:48:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f364e59b700 1 -- 172.21.15.59:0/3330734652 learned_addr learned my addr 172.21.15.59:0/3330734652 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f364dd9a700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3648101100 0x7f36481992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f364ed9c700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3648106750 0x7f364819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f364dd9a700 1 -- 172.21.15.59:0/3330734652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3648106750 msgr2=0x7f364819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f364dd9a700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3648106750 0x7f364819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f364dd9a700 1 -- 172.21.15.59:0/3330734652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3648100740 msgr2=0x7f3648198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f364dd9a700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3648100740 0x7f3648198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.026+0000 7f364dd9a700 1 -- 172.21.15.59:0/3330734652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36440095f0 con 0x7f3648101100 2023-10-08T12:48:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.027+0000 7f364dd9a700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3648101100 0x7f36481992c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f363800e9f0 tx=0x7f363800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.027+0000 7f363f7fe700 1 -- 172.21.15.59:0/3330734652 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363800eee0 con 0x7f3648101100 2023-10-08T12:48:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.027+0000 7f36507ff700 1 -- 172.21.15.59:0/3330734652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364819e2b0 con 0x7f3648101100 2023-10-08T12:48:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.027+0000 7f363f7fe700 1 -- 172.21.15.59:0/3330734652 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f363800cbd0 con 0x7f3648101100 2023-10-08T12:48:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.027+0000 7f363f7fe700 1 -- 172.21.15.59:0/3330734652 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3638018680 con 0x7f3648101100 2023-10-08T12:48:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.027+0000 7f36507ff700 1 -- 172.21.15.59:0/3330734652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36481a5af0 con 0x7f3648101100 2023-10-08T12:48:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.030+0000 7f363f7fe700 1 -- 172.21.15.59:0/3330734652 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f363800cd40 con 0x7f3648101100 2023-10-08T12:48:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.031+0000 7f366416bb80 1 Processor -- start 2023-10-08T12:48:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f363f7fe700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f36340a1670 0x7f36340a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f366416bb80 1 -- start start 2023-10-08T12:48:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f363f7fe700 1 -- 172.21.15.59:0/3330734652 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3638014070 con 0x7f3648101100 2023-10-08T12:48:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f364ed9c700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f36340a1670 0x7f36340a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f366416bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313ce9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f366416bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313ce97a0 0x557313cf4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f366416bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313cf4650 0x557313cf6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f366416bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313c52460 con 0x557313ce97a0 2023-10-08T12:48:27.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f366416bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313c43c20 con 0x557313ce8e80 2023-10-08T12:48:27.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f366416bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313c41540 con 0x557313cf4650 2023-10-08T12:48:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f364e59b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313ce9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f364dd9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313ce97a0 0x557313cf4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f364e59b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313ce9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50740/0 (socket says 172.21.15.59:50740) 2023-10-08T12:48:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.032+0000 7f364e59b700 1 -- 172.21.15.59:0/3314958214 learned_addr learned my addr 172.21.15.59:0/3314958214 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.033+0000 7f364e59b700 1 -- 172.21.15.59:0/3314958214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313cf4650 msgr2=0x557313cf6a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:48:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.033+0000 7f364e59b700 1 --2- 172.21.15.59:0/3314958214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313cf4650 0x557313cf6a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.033+0000 7f364e59b700 1 -- 172.21.15.59:0/3314958214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313ce97a0 msgr2=0x557313cf4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.033+0000 7f364e59b700 1 --2- 172.21.15.59:0/3314958214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313ce97a0 0x557313cf4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.033+0000 7f364e59b700 1 -- 172.21.15.59:0/3314958214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557313a67de0 con 0x557313ce8e80 2023-10-08T12:48:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.033+0000 7f364ed9c700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f36340a1670 0x7f36340a3b30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f36400093d0 tx=0x7f364000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.033+0000 7f364e59b700 1 --2- 172.21.15.59:0/3314958214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313ce9260 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f364400b670 tx=0x7f364400b6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac3162b30bd1897 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.033+0000 7f363cff9700 1 -- 172.21.15.59:0/3314958214 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364401d070 con 0x557313ce8e80 2023-10-08T12:48:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.033+0000 7f363cff9700 1 -- 172.21.15.59:0/3314958214 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f364401e040 con 0x557313ce8e80 2023-10-08T12:48:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.033+0000 7f363cff9700 1 -- 172.21.15.59:0/3314958214 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644004880 con 0x557313ce8e80 2023-10-08T12:48:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.034+0000 7f366416bb80 1 -- 172.21.15.59:0/3314958214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 msgr2=0x557313ce9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.034+0000 7f366416bb80 1 --2- 172.21.15.59:0/3314958214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313ce9260 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f364400b670 tx=0x7f364400b6a0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.034+0000 7f366416bb80 1 -- 172.21.15.59:0/3314958214 shutdown_connections 2023-10-08T12:48:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.034+0000 7f366416bb80 1 --2- 172.21.15.59:0/3314958214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313ce9260 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.034+0000 7f366416bb80 1 --2- 172.21.15.59:0/3314958214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313cf4650 0x557313cf6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.034+0000 7f366416bb80 1 --2- 172.21.15.59:0/3314958214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313ce97a0 0x557313cf4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.034+0000 7f366416bb80 1 -- 172.21.15.59:0/3314958214 >> 172.21.15.59:0/3314958214 conn(0x557313c5e260 msgr2=0x557313ce52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:27.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.034+0000 7f366416bb80 1 -- 172.21.15.59:0/3314958214 shutdown_connections 2023-10-08T12:48:27.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.034+0000 7f366416bb80 1 -- 172.21.15.59:0/3314958214 wait complete. 2023-10-08T12:48:27.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.035+0000 7f366416bb80 1 -- start start 2023-10-08T12:48:27.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.035+0000 7f366416bb80 1 Processor -- start 2023-10-08T12:48:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f366416bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313ce8e80 0x557313cf4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f366416bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce97a0 0x557313cf1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f366416bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313cf4650 0x557313cf19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f366416bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313c3ce30 con 0x557313ce8e80 2023-10-08T12:48:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f366416bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313bd9710 con 0x557313ce97a0 2023-10-08T12:48:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f366416bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313bd93b0 con 0x557313cf4650 2023-10-08T12:48:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f366416bb80 10 client.0 _ll_register_callbacks cb 0x557313a36800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f364e59b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313ce8e80 0x557313cf4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f364e59b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313ce8e80 0x557313cf4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52360/0 (socket says 172.21.15.59:52360) 2023-10-08T12:48:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f364dd9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce97a0 0x557313cf1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f364e59b700 1 -- 172.21.15.59:0/4185700866 learned_addr learned my addr 172.21.15.59:0/4185700866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f364ed9c700 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313cf4650 0x557313cf19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f364dd9a700 1 -- 172.21.15.59:0/4185700866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313cf4650 msgr2=0x557313cf19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f364dd9a700 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313cf4650 0x557313cf19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f364dd9a700 1 -- 172.21.15.59:0/4185700866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313ce8e80 msgr2=0x557313cf4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f364dd9a700 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313ce8e80 0x557313cf4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.036+0000 7f364dd9a700 1 -- 172.21.15.59:0/4185700866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364810df10 con 0x557313ce97a0 2023-10-08T12:48:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f364dd9a700 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce97a0 0x557313cf1330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f36380ca990 tx=0x7f363809a990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceea75f1ca2452b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f3631ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:48:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f3631ffb700 1 -- 172.21.15.59:0/4185700866 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363809e170 con 0x557313ce97a0 2023-10-08T12:48:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f366416bb80 1 -- 172.21.15.59:0/4185700866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557313c04eb0 con 0x557313ce97a0 2023-10-08T12:48:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f3631ffb700 1 -- 172.21.15.59:0/4185700866 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f363809e370 con 0x557313ce97a0 2023-10-08T12:48:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f3631ffb700 1 -- 172.21.15.59:0/4185700866 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36380a25b0 con 0x557313ce97a0 2023-10-08T12:48:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f366416bb80 10 client.26453 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f366416bb80 1 -- 172.21.15.59:0/4185700866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x557313a50c60 con 0x557313ce97a0 2023-10-08T12:48:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f3631ffb700 1 -- 172.21.15.59:0/4185700866 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557313c04eb0 con 0x557313ce97a0 2023-10-08T12:48:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f3631ffb700 1 -- 172.21.15.59:0/4185700866 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3638099180 con 0x557313ce97a0 2023-10-08T12:48:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f366416bb80 10 client.26453 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f366416bb80 10 client.26453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f366416bb80 20 client.26453 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.037+0000 7f366416bb80 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557313d040d0 0x557313d064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.038+0000 7f366416bb80 4 client.26453 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:48:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.038+0000 7f366416bb80 1 -- 172.21.15.59:0/4185700866 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557313c35e10 con 0x557313d040d0 2023-10-08T12:48:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.038+0000 7f364e59b700 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557313d040d0 0x557313d064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.038+0000 7f364e59b700 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557313d040d0 0x557313d064f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7afc16e68cd353b server_cookie=e45ad092faff3fdd in_seq=0 out_seq=0 2023-10-08T12:48:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.038+0000 7f3631ffb700 10 client.26453 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.040+0000 7f3631ffb700 1 -- 172.21.15.59:0/4185700866 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557313c35e10 con 0x557313d040d0 2023-10-08T12:48:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.040+0000 7f3631ffb700 10 client.26453 handle_command_reply: tid=0 2023-10-08T12:48:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 1 client.26453 shutdown 2023-10-08T12:48:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 1 -- 172.21.15.59:0/4185700866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce97a0 msgr2=0x557313cf1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce97a0 0x557313cf1330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f36380ca990 tx=0x7f363809a990 comp rx=0 tx=0).stop 2023-10-08T12:48:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 1 -- 172.21.15.59:0/4185700866 shutdown_connections 2023-10-08T12:48:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557313d040d0 0x557313d064f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313cf4650 0x557313cf19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313ce8e80 0x557313cf4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f3631ffb700 0 client.26453 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 1 --2- 172.21.15.59:0/4185700866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce97a0 0x557313cf1330 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 1 -- 172.21.15.59:0/4185700866 >> 172.21.15.59:0/4185700866 conn(0x557313c5e260 msgr2=0x557313ce4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 1 -- 172.21.15.59:0/4185700866 shutdown_connections 2023-10-08T12:48:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 1 -- 172.21.15.59:0/4185700866 wait complete. 2023-10-08T12:48:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.041+0000 7f366416bb80 20 client.26453 trim_cache size 0 max 16384 2023-10-08T12:48:27.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.055+0000 7f366416bb80 1 Processor -- start 2023-10-08T12:48:27.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.055+0000 7f366416bb80 1 -- start start 2023-10-08T12:48:27.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.055+0000 7f366416bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cebd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.055+0000 7f366416bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313ce97a0 0x557313cff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.055+0000 7f366416bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313cf4650 0x557313cffe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.055+0000 7f366416bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313abd920 con 0x557313cf4650 2023-10-08T12:48:27.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.055+0000 7f366416bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313d00c90 con 0x557313ce8e80 2023-10-08T12:48:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.055+0000 7f366416bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313ce68b0 con 0x557313ce97a0 2023-10-08T12:48:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.055+0000 7f364e59b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.055+0000 7f364ed9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313cf4650 0x557313cffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f364e59b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cebd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50760/0 (socket says 172.21.15.59:50760) 2023-10-08T12:48:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f364e59b700 1 -- 172.21.15.59:0/1954009082 learned_addr learned my addr 172.21.15.59:0/1954009082 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f364dd9a700 1 --2- 172.21.15.59:0/1954009082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313ce97a0 0x557313cff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f364e59b700 1 -- 172.21.15.59:0/1954009082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313ce97a0 msgr2=0x557313cff8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f364e59b700 1 --2- 172.21.15.59:0/1954009082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313ce97a0 0x557313cff8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f364e59b700 1 -- 172.21.15.59:0/1954009082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313cf4650 msgr2=0x557313cffe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f364e59b700 1 --2- 172.21.15.59:0/1954009082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313cf4650 0x557313cffe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f364e59b700 1 -- 172.21.15.59:0/1954009082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557313a8e250 con 0x557313ce8e80 2023-10-08T12:48:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f364e59b700 1 --2- 172.21.15.59:0/1954009082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cebd70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3644006010 tx=0x7f364401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=977ec52b298ca804 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f363d7fa700 1 -- 172.21.15.59:0/1954009082 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364401d040 con 0x557313ce8e80 2023-10-08T12:48:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f363d7fa700 1 -- 172.21.15.59:0/1954009082 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36440353e0 con 0x557313ce8e80 2023-10-08T12:48:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.056+0000 7f363d7fa700 1 -- 172.21.15.59:0/1954009082 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644035d80 con 0x557313ce8e80 2023-10-08T12:48:27.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.057+0000 7f366416bb80 1 -- 172.21.15.59:0/1954009082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 msgr2=0x557313cebd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:27.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.057+0000 7f366416bb80 1 --2- 172.21.15.59:0/1954009082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cebd70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3644006010 tx=0x7f364401a040 comp rx=0 tx=0).stop 2023-10-08T12:48:27.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.057+0000 7f366416bb80 1 -- 172.21.15.59:0/1954009082 shutdown_connections 2023-10-08T12:48:27.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.057+0000 7f366416bb80 1 --2- 172.21.15.59:0/1954009082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cebd70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.057+0000 7f366416bb80 1 --2- 172.21.15.59:0/1954009082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313cf4650 0x557313cffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.057+0000 7f366416bb80 1 --2- 172.21.15.59:0/1954009082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313ce97a0 0x557313cff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.057+0000 7f366416bb80 1 -- 172.21.15.59:0/1954009082 >> 172.21.15.59:0/1954009082 conn(0x557313c5e260 msgr2=0x557313cefc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:27.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.057+0000 7f366416bb80 1 -- 172.21.15.59:0/1954009082 shutdown_connections 2023-10-08T12:48:27.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.057+0000 7f366416bb80 1 -- 172.21.15.59:0/1954009082 wait complete. 2023-10-08T12:48:27.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.057+0000 7f366416bb80 1 -- start start 2023-10-08T12:48:27.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f366416bb80 1 Processor -- start 2023-10-08T12:48:27.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f366416bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cf9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f366416bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313ce97a0 0x557313cf95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f366416bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313cf4650 0x557313d50ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f366416bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313d51410 con 0x557313cf4650 2023-10-08T12:48:27.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f366416bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313d51550 con 0x557313ce8e80 2023-10-08T12:48:27.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f366416bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557313d51710 con 0x557313ce97a0 2023-10-08T12:48:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f366416bb80 10 client.0 _ll_register_callbacks cb 0x7f363800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f364e59b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cf9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f364e59b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cf9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50762/0 (socket says 172.21.15.59:50762) 2023-10-08T12:48:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f364e59b700 1 -- 172.21.15.59:0/1379868347 learned_addr learned my addr 172.21.15.59:0/1379868347 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.058+0000 7f364ed9c700 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313cf4650 0x557313d50ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f364dd9a700 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313ce97a0 0x557313cf95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f364e59b700 1 -- 172.21.15.59:0/1379868347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313ce97a0 msgr2=0x557313cf95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f364e59b700 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313ce97a0 0x557313cf95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f364e59b700 1 -- 172.21.15.59:0/1379868347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313cf4650 msgr2=0x557313d50ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f364e59b700 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313cf4650 0x557313d50ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f364e59b700 1 -- 172.21.15.59:0/1379868347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557313a67de0 con 0x557313ce8e80 2023-10-08T12:48:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f364dd9a700 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313ce97a0 0x557313cf95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:48:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f364e59b700 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cf9070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3644005320 tx=0x7f36440059d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7339eab8f1dc42ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f3631ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:48:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f3631ffb700 1 -- 172.21.15.59:0/1379868347 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364401d070 con 0x557313ce8e80 2023-10-08T12:48:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f366416bb80 1 -- 172.21.15.59:0/1379868347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f364401e040 con 0x557313ce8e80 2023-10-08T12:48:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.059+0000 7f3631ffb700 1 -- 172.21.15.59:0/1379868347 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3644032040 con 0x557313ce8e80 2023-10-08T12:48:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f3631ffb700 1 -- 172.21.15.59:0/1379868347 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f364400b950 con 0x557313ce8e80 2023-10-08T12:48:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f366416bb80 10 client.26459 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f366416bb80 1 -- 172.21.15.59:0/1379868347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x557313a662b0 con 0x557313ce8e80 2023-10-08T12:48:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f3631ffb700 1 -- 172.21.15.59:0/1379868347 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f364401e040 con 0x557313ce8e80 2023-10-08T12:48:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f3631ffb700 1 -- 172.21.15.59:0/1379868347 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f364403d070 con 0x557313ce8e80 2023-10-08T12:48:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f366416bb80 10 client.26459 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f366416bb80 10 client.26459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f366416bb80 20 client.26459 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f366416bb80 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557313d58b70 0x557313d5af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f366416bb80 4 client.26459 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:48:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f366416bb80 1 -- 172.21.15.59:0/1379868347 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557313c35b30 con 0x557313d58b70 2023-10-08T12:48:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.060+0000 7f364dd9a700 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557313d58b70 0x557313d5af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.061+0000 7f364dd9a700 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557313d58b70 0x557313d5af90 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b8dd6df6bf924b server_cookie=4eb091e919b5bfaa in_seq=0 out_seq=0 2023-10-08T12:48:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.061+0000 7f3631ffb700 10 client.26459 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:27.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.062+0000 7f3631ffb700 1 -- 172.21.15.59:0/1379868347 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557313c35b30 con 0x557313d58b70 2023-10-08T12:48:27.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.062+0000 7f3631ffb700 10 client.26459 handle_command_reply: tid=0 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.062+0000 7f366416bb80 1 client.26459 shutdown 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f366416bb80 1 -- 172.21.15.59:0/1379868347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 msgr2=0x557313cf9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f366416bb80 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cf9070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3644005320 tx=0x7f36440059d0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f366416bb80 1 -- 172.21.15.59:0/1379868347 shutdown_connections 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f366416bb80 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557313d58b70 0x557313d5af90 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f366416bb80 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557313ce8e80 0x557313cf9070 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f366416bb80 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557313cf4650 0x557313d50ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f366416bb80 1 --2- 172.21.15.59:0/1379868347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557313ce97a0 0x557313cf95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f3631ffb700 0 client.26459 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f366416bb80 1 -- 172.21.15.59:0/1379868347 >> 172.21.15.59:0/1379868347 conn(0x557313c5e260 msgr2=0x557313cff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f366416bb80 1 -- 172.21.15.59:0/1379868347 shutdown_connections 2023-10-08T12:48:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f366416bb80 1 -- 172.21.15.59:0/1379868347 wait complete. 2023-10-08T12:48:27.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.063+0000 7f366416bb80 20 client.26459 trim_cache size 0 max 16384 2023-10-08T12:48:27.069 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:48:27.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 -- 172.21.15.59:0/3330734652 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f36340a1670 msgr2=0x7f36340a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f36340a1670 0x7f36340a3b30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f36400093d0 tx=0x7f364000b040 comp rx=0 tx=0).stop 2023-10-08T12:48:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 -- 172.21.15.59:0/3330734652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3648101100 msgr2=0x7f36481992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3648101100 0x7f36481992c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f363800e9f0 tx=0x7f363800ed00 comp rx=0 tx=0).stop 2023-10-08T12:48:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 -- 172.21.15.59:0/3330734652 shutdown_connections 2023-10-08T12:48:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f36340a1670 0x7f36340a3b30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3648106750 0x7f364819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3648100740 0x7f3648198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 --2- 172.21.15.59:0/3330734652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3648101100 0x7f36481992c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 -- 172.21.15.59:0/3330734652 >> 172.21.15.59:0/3330734652 conn(0x7f36480fc230 msgr2=0x7f364810beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 -- 172.21.15.59:0/3330734652 shutdown_connections 2023-10-08T12:48:27.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:27.064+0000 7f36507ff700 1 -- 172.21.15.59:0/3330734652 wait complete. 2023-10-08T12:48:27.080 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:26 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/979297839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:48:27.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:26 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/979297839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:48:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:26 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/979297839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:48:27.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 916809 13.53 MB/sec execute 238 sec latency 97.028 ms 2023-10-08T12:48:28.084 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:48:28.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:48:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:27 smithi059 ceph-mon[98489]: pgmap v534: 97 pgs: 97 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 265 op/s 2023-10-08T12:48:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.300+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1217976297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8e0106740 msgr2=0x7fd8e0106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.300+0000 7fd8e75ff700 1 --2- 172.21.15.59:0/1217976297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8e0106740 0x7fd8e0106b20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc009990 tx=0x7fd8dc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.301+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1217976297 shutdown_connections 2023-10-08T12:48:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.301+0000 7fd8e75ff700 1 --2- 172.21.15.59:0/1217976297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e01010f0 0x7fd8e010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.301+0000 7fd8e75ff700 1 --2- 172.21.15.59:0/1217976297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8e0106740 0x7fd8e0106b20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.301+0000 7fd8e75ff700 1 --2- 172.21.15.59:0/1217976297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8e0100730 0x7fd8e0100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.301+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1217976297 >> 172.21.15.59:0/1217976297 conn(0x7fd8e00fc200 msgr2=0x7fd8e00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.301+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1217976297 shutdown_connections 2023-10-08T12:48:28.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.301+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1217976297 wait complete. 2023-10-08T12:48:28.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.302+0000 7fd8e75ff700 1 Processor -- start 2023-10-08T12:48:28.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.302+0000 7fd8e75ff700 1 -- start start 2023-10-08T12:48:28.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.303+0000 7fd8e75ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e0100730 0x7fd8e019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.303+0000 7fd8e75ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8e01010f0 0x7fd8e019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.303+0000 7fd8e75ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8e0106740 0x7fd8e01969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.303+0000 7fd8e75ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0197020 con 0x7fd8e0100730 2023-10-08T12:48:28.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.303+0000 7fd8e75ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0197190 con 0x7fd8e0106740 2023-10-08T12:48:28.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.303+0000 7fd8e75ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0197350 con 0x7fd8e01010f0 2023-10-08T12:48:28.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.303+0000 7fd8e539b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e0100730 0x7fd8e019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.303+0000 7fd8e5b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8e0106740 0x7fd8e01969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.303+0000 7fd8e539b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e0100730 0x7fd8e019c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52390/0 (socket says 172.21.15.59:52390) 2023-10-08T12:48:28.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.303+0000 7fd8e539b700 1 -- 172.21.15.59:0/1689997796 learned_addr learned my addr 172.21.15.59:0/1689997796 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:28.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.303+0000 7fd8e4b9a700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8e01010f0 0x7fd8e019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8e539b700 1 -- 172.21.15.59:0/1689997796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8e01010f0 msgr2=0x7fd8e019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8e539b700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8e01010f0 0x7fd8e019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8e539b700 1 -- 172.21.15.59:0/1689997796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8e0106740 msgr2=0x7fd8e01969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8e539b700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8e0106740 0x7fd8e01969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8e539b700 1 -- 172.21.15.59:0/1689997796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc0095f0 con 0x7fd8e0100730 2023-10-08T12:48:28.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8e5b9c700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8e0106740 0x7fd8e01969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:28.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8e539b700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e0100730 0x7fd8e019c890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc005910 tx=0x7fd8dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8d67fc700 1 -- 172.21.15.59:0/1689997796 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc01d070 con 0x7fd8e0100730 2023-10-08T12:48:28.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1689997796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e01975d0 con 0x7fd8e0100730 2023-10-08T12:48:28.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8d67fc700 1 -- 172.21.15.59:0/1689997796 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8dc022470 con 0x7fd8e0100730 2023-10-08T12:48:28.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8d67fc700 1 -- 172.21.15.59:0/1689997796 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc017650 con 0x7fd8e0100730 2023-10-08T12:48:28.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.304+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1689997796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e01a3880 con 0x7fd8e0100730 2023-10-08T12:48:28.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.308+0000 7fd8d67fc700 1 -- 172.21.15.59:0/1689997796 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd8dc0225e0 con 0x7fd8e0100730 2023-10-08T12:48:28.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.309+0000 7fd8fb00bb80 1 Processor -- start 2023-10-08T12:48:28.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.309+0000 7fd8fb00bb80 1 -- start start 2023-10-08T12:48:28.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.309+0000 7fd8d67fc700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8cc0a15f0 0x7fd8cc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8d67fc700 1 -- 172.21.15.59:0/1689997796 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fd8dc0ce440 con 0x7fd8e0100730 2023-10-08T12:48:28.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8e5b9c700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8cc0a15f0 0x7fd8cc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3066f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c3115a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c313ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c26b4e0 con 0x56482c311ae0 2023-10-08T12:48:28.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c25cca0 con 0x56482c306310 2023-10-08T12:48:28.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c25a5c0 con 0x56482c306c30 2023-10-08T12:48:28.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8e539b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3066f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8e539b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3066f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50790/0 (socket says 172.21.15.59:50790) 2023-10-08T12:48:28.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8e539b700 1 -- 172.21.15.59:0/2691822935 learned_addr learned my addr 172.21.15.59:0/2691822935 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:28.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8e4b9a700 1 --2- 172.21.15.59:0/2691822935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c3115a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.310+0000 7fd8e5b9c700 1 --2- 172.21.15.59:0/2691822935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c313ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8e4b9a700 1 -- 172.21.15.59:0/2691822935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 msgr2=0x56482c3066f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8e4b9a700 1 --2- 172.21.15.59:0/2691822935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3066f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8e4b9a700 1 -- 172.21.15.59:0/2691822935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 msgr2=0x56482c313ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8e4b9a700 1 --2- 172.21.15.59:0/2691822935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c313ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8e4b9a700 1 -- 172.21.15.59:0/2691822935 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56482c080e60 con 0x56482c306c30 2023-10-08T12:48:28.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8e539b700 1 --2- 172.21.15.59:0/2691822935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:28.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8e5b9c700 1 --2- 172.21.15.59:0/2691822935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c313ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:48:28.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8e5b9c700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8cc0a15f0 0x7fd8cc0a3ab0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8007610 tx=0x7fd8d80079d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8e4b9a700 1 --2- 172.21.15.59:0/2691822935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c3115a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009cb0 tx=0x7fd8d0011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e6ed0a0e0cd0f2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8cb7fe700 1 -- 172.21.15.59:0/2691822935 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0011d20 con 0x56482c306c30 2023-10-08T12:48:28.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8cb7fe700 1 -- 172.21.15.59:0/2691822935 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8d0011e80 con 0x56482c306c30 2023-10-08T12:48:28.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.311+0000 7fd8cb7fe700 1 -- 172.21.15.59:0/2691822935 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0005280 con 0x56482c306c30 2023-10-08T12:48:28.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.312+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/2691822935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 msgr2=0x56482c3115a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.312+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/2691822935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c3115a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009cb0 tx=0x7fd8d0011440 comp rx=0 tx=0).stop 2023-10-08T12:48:28.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.312+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/2691822935 shutdown_connections 2023-10-08T12:48:28.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.312+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/2691822935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.312+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/2691822935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c313ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.312+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/2691822935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c3115a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.312+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/2691822935 >> 172.21.15.59:0/2691822935 conn(0x56482c2772e0 msgr2=0x56482c2fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.312+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/2691822935 shutdown_connections 2023-10-08T12:48:28.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.312+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/2691822935 wait complete. 2023-10-08T12:48:28.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.313+0000 7fd8fb00bb80 1 -- start start 2023-10-08T12:48:28.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.313+0000 7fd8fb00bb80 1 Processor -- start 2023-10-08T12:48:28.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3114f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c30e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c30eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c255eb0 con 0x56482c311ae0 2023-10-08T12:48:28.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c1f2790 con 0x56482c306310 2023-10-08T12:48:28.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c1f2430 con 0x56482c306c30 2023-10-08T12:48:28.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8fb00bb80 10 client.0 _ll_register_callbacks cb 0x56482c04f880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:28.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8e539b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3114f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8e539b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3114f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50798/0 (socket says 172.21.15.59:50798) 2023-10-08T12:48:28.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8e539b700 1 -- 172.21.15.59:0/3299827160 learned_addr learned my addr 172.21.15.59:0/3299827160 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:28.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8e4b9a700 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c30e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8e5b9c700 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c30eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8e539b700 1 -- 172.21.15.59:0/3299827160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 msgr2=0x56482c30e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8e539b700 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c30e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8e539b700 1 -- 172.21.15.59:0/3299827160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 msgr2=0x56482c30eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8e539b700 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c30eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.314+0000 7fd8e539b700 1 -- 172.21.15.59:0/3299827160 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e01a3880 con 0x56482c306310 2023-10-08T12:48:28.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.315+0000 7fd8e539b700 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3114f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00f740 tx=0x7fd8dc009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12bf6a1edea2ded8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.315+0000 7fd8c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:48:28.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.315+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3299827160 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc09ab90 con 0x56482c306310 2023-10-08T12:48:28.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.315+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3299827160 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fd8dc09bba0 con 0x56482c306310 2023-10-08T12:48:28.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.315+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3299827160 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56482c24ee90 con 0x56482c306310 2023-10-08T12:48:28.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.315+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3299827160 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8dc09b4a0 con 0x56482c306310 2023-10-08T12:48:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.315+0000 7fd8fb00bb80 10 client.26471 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.315+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3299827160 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fd8d00098e0 con 0x56482c306310 2023-10-08T12:48:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.315+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3299827160 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56482c24ee90 con 0x56482c306310 2023-10-08T12:48:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.315+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3299827160 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd8dc0a3410 con 0x56482c306310 2023-10-08T12:48:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.316+0000 7fd8fb00bb80 10 client.26471 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.316+0000 7fd8fb00bb80 10 client.26471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.316+0000 7fd8fb00bb80 20 client.26471 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.316+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56482c321330 0x56482c323720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.316+0000 7fd8fb00bb80 4 client.26471 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:48:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.316+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3299827160 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56482c24ebb0 con 0x56482c321330 2023-10-08T12:48:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.316+0000 7fd8e4b9a700 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56482c321330 0x56482c323720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.316+0000 7fd8c8ff9700 10 client.26471 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:28.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.316+0000 7fd8e4b9a700 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56482c321330 0x56482c323720 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be209d4025e8465c server_cookie=27ec56f97ad650 in_seq=0 out_seq=0 2023-10-08T12:48:28.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.317+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3299827160 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56482c24ebb0 con 0x56482c321330 2023-10-08T12:48:28.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.317+0000 7fd8c8ff9700 10 client.26471 handle_command_reply: tid=0 2023-10-08T12:48:28.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.317+0000 7fd8fb00bb80 1 client.26471 shutdown 2023-10-08T12:48:28.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3299827160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 msgr2=0x56482c3114f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3114f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00f740 tx=0x7fd8dc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3299827160 shutdown_connections 2023-10-08T12:48:28.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56482c321330 0x56482c323720 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c3114f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8c8ff9700 0 client.26471 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:28.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c30eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3299827160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c30e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3299827160 >> 172.21.15.59:0/3299827160 conn(0x56482c2772e0 msgr2=0x56482c2fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3299827160 shutdown_connections 2023-10-08T12:48:28.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3299827160 wait complete. 2023-10-08T12:48:28.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.318+0000 7fd8fb00bb80 20 client.26471 trim_cache size 0 max 16384 2023-10-08T12:48:28.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8fb00bb80 1 Processor -- start 2023-10-08T12:48:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8fb00bb80 1 -- start start 2023-10-08T12:48:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c306310 0x56482c318630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c30d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c311ae0 0x56482c30d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c0d69a0 con 0x56482c306310 2023-10-08T12:48:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c30e6a0 con 0x56482c311ae0 2023-10-08T12:48:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c30dbd0 con 0x56482c306c30 2023-10-08T12:48:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8e5b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c311ae0 0x56482c30d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8e539b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c306310 0x56482c318630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8e4b9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c30d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8e5b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c311ae0 0x56482c30d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50814/0 (socket says 172.21.15.59:50814) 2023-10-08T12:48:28.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.337+0000 7fd8e5b9c700 1 -- 172.21.15.59:0/1803403423 learned_addr learned my addr 172.21.15.59:0/1803403423 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:28.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.338+0000 7fd8e5b9c700 1 -- 172.21.15.59:0/1803403423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 msgr2=0x56482c30d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.338+0000 7fd8e5b9c700 1 --2- 172.21.15.59:0/1803403423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c30d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.338+0000 7fd8e5b9c700 1 -- 172.21.15.59:0/1803403423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c306310 msgr2=0x56482c318630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.338+0000 7fd8e5b9c700 1 --2- 172.21.15.59:0/1803403423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c306310 0x56482c318630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.338+0000 7fd8e5b9c700 1 -- 172.21.15.59:0/1803403423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56482c069ce0 con 0x56482c311ae0 2023-10-08T12:48:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.338+0000 7fd8e5b9c700 1 --2- 172.21.15.59:0/1803403423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c311ae0 0x56482c30d690 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8018ac0 tx=0x7fd8d8015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba63702c4327febe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.338+0000 7fd8cbfff700 1 -- 172.21.15.59:0/1803403423 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8003a00 con 0x56482c311ae0 2023-10-08T12:48:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.338+0000 7fd8cbfff700 1 -- 172.21.15.59:0/1803403423 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8d800f040 con 0x56482c311ae0 2023-10-08T12:48:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.338+0000 7fd8cbfff700 1 -- 172.21.15.59:0/1803403423 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80044e0 con 0x56482c311ae0 2023-10-08T12:48:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.339+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/1803403423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c311ae0 msgr2=0x56482c30d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.339+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/1803403423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c311ae0 0x56482c30d690 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8018ac0 tx=0x7fd8d8015000 comp rx=0 tx=0).stop 2023-10-08T12:48:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.339+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/1803403423 shutdown_connections 2023-10-08T12:48:28.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.339+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/1803403423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c311ae0 0x56482c30d690 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.339+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/1803403423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c306310 0x56482c318630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.339+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/1803403423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c30d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.339+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/1803403423 >> 172.21.15.59:0/1803403423 conn(0x56482c2772e0 msgr2=0x56482c309b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.339+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/1803403423 shutdown_connections 2023-10-08T12:48:28.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.339+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/1803403423 wait complete. 2023-10-08T12:48:28.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.340+0000 7fd8fb00bb80 1 -- start start 2023-10-08T12:48:28.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.340+0000 7fd8fb00bb80 1 Processor -- start 2023-10-08T12:48:28.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.340+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c36f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.340+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c36f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.340+0000 7fd8fb00bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c317520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.340+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c317af0 con 0x56482c311ae0 2023-10-08T12:48:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.340+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c317c60 con 0x56482c306310 2023-10-08T12:48:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.340+0000 7fd8fb00bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56482c317e20 con 0x56482c306c30 2023-10-08T12:48:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8fb00bb80 10 client.0 _ll_register_callbacks cb 0x7fd8dc09b270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e539b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c36f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e4b9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c36f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e539b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c36f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50820/0 (socket says 172.21.15.59:50820) 2023-10-08T12:48:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e4b9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c36f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:57026/0 (socket says 172.21.15.59:57026) 2023-10-08T12:48:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e539b700 1 -- 172.21.15.59:0/3319634261 learned_addr learned my addr 172.21.15.59:0/3319634261 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e5b9c700 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c317520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e539b700 1 -- 172.21.15.59:0/3319634261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 msgr2=0x56482c36f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e539b700 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c36f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e539b700 1 -- 172.21.15.59:0/3319634261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 msgr2=0x56482c317520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e539b700 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c317520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e539b700 1 -- 172.21.15.59:0/3319634261 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d80186c0 con 0x56482c306310 2023-10-08T12:48:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e5b9c700 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c317520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:48:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8e539b700 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c36f420 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0997f0 tx=0x7fd8dc0a3520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=760f4c90749bd49d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:48:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3319634261 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc09bba0 con 0x56482c306310 2023-10-08T12:48:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.341+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3319634261 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fd8dc09b4a0 con 0x56482c306310 2023-10-08T12:48:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3319634261 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56482c21df30 con 0x56482c306310 2023-10-08T12:48:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3319634261 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8dc09f5f0 con 0x56482c306310 2023-10-08T12:48:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8fb00bb80 10 client.26477 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3319634261 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56482c0a72d0 con 0x56482c306310 2023-10-08T12:48:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3319634261 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56482c21df30 con 0x56482c306310 2023-10-08T12:48:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3319634261 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd8dc097400 con 0x56482c306310 2023-10-08T12:48:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8fb00bb80 10 client.26477 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8fb00bb80 10 client.26477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8fb00bb80 20 client.26477 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56482c376fb0 0x56482c3793d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8fb00bb80 4 client.26477 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:48:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.342+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3319634261 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56482c0a1ff0 con 0x56482c376fb0 2023-10-08T12:48:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.343+0000 7fd8e4b9a700 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56482c376fb0 0x56482c3793d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.343+0000 7fd8e4b9a700 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56482c376fb0 0x56482c3793d0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecbc4ef5cada386e server_cookie=c6f0f443cea88290 in_seq=0 out_seq=0 2023-10-08T12:48:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.343+0000 7fd8c8ff9700 10 client.26477 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8c8ff9700 1 -- 172.21.15.59:0/3319634261 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56482c0a1ff0 con 0x56482c376fb0 2023-10-08T12:48:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8c8ff9700 10 client.26477 handle_command_reply: tid=0 2023-10-08T12:48:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8fb00bb80 1 client.26477 shutdown 2023-10-08T12:48:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3319634261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 msgr2=0x56482c36f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c36f420 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0997f0 tx=0x7fd8dc0a3520 comp rx=0 tx=0).stop 2023-10-08T12:48:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3319634261 shutdown_connections 2023-10-08T12:48:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56482c376fb0 0x56482c3793d0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56482c306310 0x56482c36f420 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56482c311ae0 0x56482c317520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8fb00bb80 1 --2- 172.21.15.59:0/3319634261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56482c306c30 0x56482c36f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8c8ff9700 0 client.26477 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.344+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3319634261 >> 172.21.15.59:0/3319634261 conn(0x56482c2772e0 msgr2=0x56482c30cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.345+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3319634261 shutdown_connections 2023-10-08T12:48:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.345+0000 7fd8fb00bb80 1 -- 172.21.15.59:0/3319634261 wait complete. 2023-10-08T12:48:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.345+0000 7fd8fb00bb80 20 client.26477 trim_cache size 0 max 16384 2023-10-08T12:48:28.351 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:48:28.352 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:48:28.352 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "e1a2675a-e091-431e-835e-c145b12256f6", 2023-10-08T12:48:28.352 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:48:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:48:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.345+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1689997796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8cc0a15f0 msgr2=0x7fd8cc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.345+0000 7fd8e75ff700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8cc0a15f0 0x7fd8cc0a3ab0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8007610 tx=0x7fd8d80079d0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.345+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1689997796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e0100730 msgr2=0x7fd8e019c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.345+0000 7fd8e75ff700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e0100730 0x7fd8e019c890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc005910 tx=0x7fd8dc004730 comp rx=0 tx=0).stop 2023-10-08T12:48:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.346+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1689997796 shutdown_connections 2023-10-08T12:48:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.346+0000 7fd8e75ff700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8cc0a15f0 0x7fd8cc0a3ab0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.346+0000 7fd8e75ff700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8e0106740 0x7fd8e01969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.346+0000 7fd8e75ff700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e0100730 0x7fd8e019c890 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.346+0000 7fd8e75ff700 1 --2- 172.21.15.59:0/1689997796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8e01010f0 0x7fd8e019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.346+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1689997796 >> 172.21.15.59:0/1689997796 conn(0x7fd8e00fc200 msgr2=0x7fd8e00fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.346+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1689997796 shutdown_connections 2023-10-08T12:48:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.346+0000 7fd8e75ff700 1 -- 172.21.15.59:0/1689997796 wait complete. 2023-10-08T12:48:28.366 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:48:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:27 smithi092 ceph-mon[134093]: pgmap v534: 97 pgs: 97 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 265 op/s 2023-10-08T12:48:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:27 smithi173 ceph-mon[135182]: pgmap v534: 97 pgs: 97 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 265 op/s 2023-10-08T12:48:28.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 919619 13.59 MB/sec execute 239 sec latency 47.031 ms 2023-10-08T12:48:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.616+0000 7f7ec87ff700 1 -- 172.21.15.59:0/2857083648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec01010f0 msgr2=0x7f7ec010d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.616+0000 7f7ec87ff700 1 --2- 172.21.15.59:0/2857083648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec01010f0 0x7f7ec010d600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800b0a0 tx=0x7f7eb800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.616+0000 7f7ec87ff700 1 -- 172.21.15.59:0/2857083648 shutdown_connections 2023-10-08T12:48:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.616+0000 7f7ec87ff700 1 --2- 172.21.15.59:0/2857083648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec01010f0 0x7f7ec010d600 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.617+0000 7f7ec87ff700 1 --2- 172.21.15.59:0/2857083648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0106740 0x7f7ec0106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.617+0000 7f7ec87ff700 1 --2- 172.21.15.59:0/2857083648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec0100730 0x7f7ec0100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.617+0000 7f7ec87ff700 1 -- 172.21.15.59:0/2857083648 >> 172.21.15.59:0/2857083648 conn(0x7f7ec00fc200 msgr2=0x7f7ec00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.617+0000 7f7ec87ff700 1 -- 172.21.15.59:0/2857083648 shutdown_connections 2023-10-08T12:48:28.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.617+0000 7f7ec87ff700 1 -- 172.21.15.59:0/2857083648 wait complete. 2023-10-08T12:48:28.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.618+0000 7f7ec87ff700 1 Processor -- start 2023-10-08T12:48:28.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.618+0000 7f7ec87ff700 1 -- start start 2023-10-08T12:48:28.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec87ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0100730 0x7f7ec0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec87ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec01010f0 0x7f7ec0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec87ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0106740 0x7f7ec0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec87ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec01a4ec0 con 0x7f7ec0106740 2023-10-08T12:48:28.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec87ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec01a5030 con 0x7f7ec0100730 2023-10-08T12:48:28.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec87ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec01a51f0 con 0x7f7ec01010f0 2023-10-08T12:48:28.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec659b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0100730 0x7f7ec0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec659b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0100730 0x7f7ec0072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50830/0 (socket says 172.21.15.59:50830) 2023-10-08T12:48:28.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec659b700 1 -- 172.21.15.59:0/109781658 learned_addr learned my addr 172.21.15.59:0/109781658 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:28.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec5d9a700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec01010f0 0x7f7ec0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0106740 0x7f7ec0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec659b700 1 -- 172.21.15.59:0/109781658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec01010f0 msgr2=0x7f7ec0073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec659b700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec01010f0 0x7f7ec0073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec659b700 1 -- 172.21.15.59:0/109781658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0106740 msgr2=0x7f7ec0073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec659b700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0106740 0x7f7ec0073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec659b700 1 -- 172.21.15.59:0/109781658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb8009d00 con 0x7f7ec0100730 2023-10-08T12:48:28.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.619+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0106740 0x7f7ec0073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:48:28.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.620+0000 7f7ec659b700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0100730 0x7f7ec0072af0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e9a0 tx=0x7f7ebc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.620+0000 7f7eb77fe700 1 -- 172.21.15.59:0/109781658 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc009790 con 0x7f7ec0100730 2023-10-08T12:48:28.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.620+0000 7f7eb77fe700 1 -- 172.21.15.59:0/109781658 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ebc00cbd0 con 0x7f7ec0100730 2023-10-08T12:48:28.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.620+0000 7f7eb77fe700 1 -- 172.21.15.59:0/109781658 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc018680 con 0x7f7ec0100730 2023-10-08T12:48:28.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.620+0000 7f7ec87ff700 1 -- 172.21.15.59:0/109781658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec01a54d0 con 0x7f7ec0100730 2023-10-08T12:48:28.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.620+0000 7f7ec87ff700 1 -- 172.21.15.59:0/109781658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec01a59e0 con 0x7f7ec0100730 2023-10-08T12:48:28.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.623+0000 7f7eb77fe700 1 -- 172.21.15.59:0/109781658 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7ebc00cd40 con 0x7f7ec0100730 2023-10-08T12:48:28.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.624+0000 7f7edc066b80 1 Processor -- start 2023-10-08T12:48:28.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.625+0000 7f7edc066b80 1 -- start start 2023-10-08T12:48:28.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.625+0000 7f7eb77fe700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1670 0x7f7eac0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.625+0000 7f7eb77fe700 1 -- 172.21.15.59:0/109781658 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7ebc014070 con 0x7f7ec0100730 2023-10-08T12:48:28.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.625+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1670 0x7f7eac0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.625+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd13c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.625+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13c7a0 0x55d4dd147110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.625+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd149a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.625+0000 7f7edc066b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dd0a5460 con 0x55d4dd13c7a0 2023-10-08T12:48:28.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.625+0000 7f7edc066b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dd096c20 con 0x55d4dd147650 2023-10-08T12:48:28.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.625+0000 7f7edc066b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dd094540 con 0x55d4dd13be80 2023-10-08T12:48:28.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec659b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd13c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec659b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd13c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:57050/0 (socket says 172.21.15.59:57050) 2023-10-08T12:48:28.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec659b700 1 -- 172.21.15.59:0/2170307950 learned_addr learned my addr 172.21.15.59:0/2170307950 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:28.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/2170307950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec5d9a700 1 --2- 172.21.15.59:0/2170307950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13c7a0 0x55d4dd147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec659b700 1 -- 172.21.15.59:0/2170307950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 msgr2=0x55d4dd149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec659b700 1 --2- 172.21.15.59:0/2170307950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec659b700 1 -- 172.21.15.59:0/2170307950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13c7a0 msgr2=0x55d4dd147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec659b700 1 --2- 172.21.15.59:0/2170307950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13c7a0 0x55d4dd147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1670 0x7f7eac0a3b30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009610 tx=0x7f7eb8007cc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec659b700 1 -- 172.21.15.59:0/2170307950 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4dcebade0 con 0x55d4dd13be80 2023-10-08T12:48:28.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.626+0000 7f7ec659b700 1 --2- 172.21.15.59:0/2170307950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd13c260 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc099f60 tx=0x7f7ebc099bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a65b9fa0fb7251 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.627+0000 7f7eb4ff9700 1 -- 172.21.15.59:0/2170307950 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc09a260 con 0x55d4dd13be80 2023-10-08T12:48:28.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.627+0000 7f7eb4ff9700 1 -- 172.21.15.59:0/2170307950 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ebc09e3b0 con 0x55d4dd13be80 2023-10-08T12:48:28.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.627+0000 7f7eb4ff9700 1 -- 172.21.15.59:0/2170307950 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc09a700 con 0x55d4dd13be80 2023-10-08T12:48:28.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.627+0000 7f7edc066b80 1 -- 172.21.15.59:0/2170307950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 msgr2=0x55d4dd13c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.627+0000 7f7edc066b80 1 --2- 172.21.15.59:0/2170307950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd13c260 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc099f60 tx=0x7f7ebc099bc0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.627+0000 7f7edc066b80 1 -- 172.21.15.59:0/2170307950 shutdown_connections 2023-10-08T12:48:28.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.627+0000 7f7edc066b80 1 --2- 172.21.15.59:0/2170307950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.627+0000 7f7edc066b80 1 --2- 172.21.15.59:0/2170307950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd13c260 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.627+0000 7f7edc066b80 1 --2- 172.21.15.59:0/2170307950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13c7a0 0x55d4dd147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.627+0000 7f7edc066b80 1 -- 172.21.15.59:0/2170307950 >> 172.21.15.59:0/2170307950 conn(0x55d4dd0b1260 msgr2=0x55d4dd1382d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.627+0000 7f7edc066b80 1 -- 172.21.15.59:0/2170307950 shutdown_connections 2023-10-08T12:48:28.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.628+0000 7f7edc066b80 1 -- 172.21.15.59:0/2170307950 wait complete. 2023-10-08T12:48:28.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.628+0000 7f7edc066b80 1 -- start start 2023-10-08T12:48:28.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.629+0000 7f7edc066b80 1 Processor -- start 2023-10-08T12:48:28.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.629+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13be80 0x55d4dd1470a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.629+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13c7a0 0x55d4dd144320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.629+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd144a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.629+0000 7f7edc066b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dd08fe30 con 0x55d4dd13be80 2023-10-08T12:48:28.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.629+0000 7f7edc066b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dd02c710 con 0x55d4dd147650 2023-10-08T12:48:28.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.629+0000 7f7edc066b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dd02c3b0 con 0x55d4dd13c7a0 2023-10-08T12:48:28.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.629+0000 7f7edc066b80 10 client.0 _ll_register_callbacks cb 0x55d4dce89800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:28.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec6d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec5d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13c7a0 0x55d4dd144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec6d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50858/0 (socket says 172.21.15.59:50858) 2023-10-08T12:48:28.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec6d9c700 1 -- 172.21.15.59:0/2670863112 learned_addr learned my addr 172.21.15.59:0/2670863112 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:28.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec659b700 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13be80 0x55d4dd1470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec6d9c700 1 -- 172.21.15.59:0/2670863112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13c7a0 msgr2=0x55d4dd144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13c7a0 0x55d4dd144320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec6d9c700 1 -- 172.21.15.59:0/2670863112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13be80 msgr2=0x55d4dd1470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13be80 0x55d4dd1470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec6d9c700 1 -- 172.21.15.59:0/2670863112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec01a59e0 con 0x55d4dd147650 2023-10-08T12:48:28.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec5d9a700 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13c7a0 0x55d4dd144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:28.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd144a60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800b0a0 tx=0x7f7eb800b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5fcf699ed53d490 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.630+0000 7f7ea9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:48:28.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.631+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/2670863112 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800e040 con 0x55d4dd147650 2023-10-08T12:48:28.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.631+0000 7f7edc066b80 1 -- 172.21.15.59:0/2670863112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4dd057eb0 con 0x55d4dd147650 2023-10-08T12:48:28.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.631+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/2670863112 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7eb801d450 con 0x55d4dd147650 2023-10-08T12:48:28.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.631+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/2670863112 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7eb801d610 con 0x55d4dd147650 2023-10-08T12:48:28.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.631+0000 7f7edc066b80 10 client.26489 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:28.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.631+0000 7f7edc066b80 1 -- 172.21.15.59:0/2670863112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55d4dcea3c60 con 0x55d4dd147650 2023-10-08T12:48:28.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.631+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/2670863112 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d4dd057eb0 con 0x55d4dd147650 2023-10-08T12:48:28.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.631+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/2670863112 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7eb8019050 con 0x55d4dd147650 2023-10-08T12:48:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.632+0000 7f7edc066b80 10 client.26489 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.632+0000 7f7edc066b80 10 client.26489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.632+0000 7f7edc066b80 20 client.26489 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.632+0000 7f7edc066b80 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d4dd15f9d0 0x55d4dd161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.632+0000 7f7edc066b80 4 client.26489 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:48:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.632+0000 7f7edc066b80 1 -- 172.21.15.59:0/2670863112 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4dd088e10 con 0x55d4dd15f9d0 2023-10-08T12:48:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.632+0000 7f7ec659b700 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d4dd15f9d0 0x55d4dd161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.632+0000 7f7ec659b700 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d4dd15f9d0 0x55d4dd161df0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3be1abadca482ae server_cookie=f2d9a78513a746af in_seq=0 out_seq=0 2023-10-08T12:48:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.632+0000 7f7ea9ffb700 10 client.26489 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:28.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.633+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/2670863112 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d4dd088e10 con 0x55d4dd15f9d0 2023-10-08T12:48:28.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.633+0000 7f7ea9ffb700 10 client.26489 handle_command_reply: tid=0 2023-10-08T12:48:28.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.633+0000 7f7edc066b80 1 client.26489 shutdown 2023-10-08T12:48:28.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7edc066b80 1 -- 172.21.15.59:0/2670863112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 msgr2=0x55d4dd144a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7edc066b80 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd144a60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800b0a0 tx=0x7f7eb800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7edc066b80 1 -- 172.21.15.59:0/2670863112 shutdown_connections 2023-10-08T12:48:28.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7edc066b80 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d4dd15f9d0 0x55d4dd161df0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7edc066b80 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd144a60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7edc066b80 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13be80 0x55d4dd1470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7edc066b80 1 --2- 172.21.15.59:0/2670863112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13c7a0 0x55d4dd144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7ea9ffb700 0 client.26489 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:28.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7edc066b80 1 -- 172.21.15.59:0/2670863112 >> 172.21.15.59:0/2670863112 conn(0x55d4dd0b1260 msgr2=0x55d4dd137ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7edc066b80 1 -- 172.21.15.59:0/2670863112 shutdown_connections 2023-10-08T12:48:28.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7edc066b80 1 -- 172.21.15.59:0/2670863112 wait complete. 2023-10-08T12:48:28.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.634+0000 7f7edc066b80 20 client.26489 trim_cache size 0 max 16384 2023-10-08T12:48:28.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.652+0000 7f7edc066b80 1 Processor -- start 2023-10-08T12:48:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.652+0000 7f7edc066b80 1 -- start start 2023-10-08T12:48:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.652+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd156a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13c7a0 0x55d4dd143300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7edc066b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dcf10920 con 0x55d4dd13c7a0 2023-10-08T12:48:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7edc066b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dd139690 con 0x55d4dd147650 2023-10-08T12:48:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7edc066b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dd1452c0 con 0x55d4dd13be80 2023-10-08T12:48:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7ec6d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7ec6d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50864/0 (socket says 172.21.15.59:50864) 2023-10-08T12:48:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7ec5d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13c7a0 0x55d4dd143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7ec6d9c700 1 -- 172.21.15.59:0/1606225829 learned_addr learned my addr 172.21.15.59:0/1606225829 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7ec659b700 1 --2- 172.21.15.59:0/1606225829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7ec6d9c700 1 -- 172.21.15.59:0/1606225829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 msgr2=0x55d4dd156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/1606225829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7ec6d9c700 1 -- 172.21.15.59:0/1606225829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13c7a0 msgr2=0x55d4dd143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/1606225829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13c7a0 0x55d4dd143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.653+0000 7f7ec6d9c700 1 -- 172.21.15.59:0/1606225829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4dcee1250 con 0x55d4dd147650 2023-10-08T12:48:28.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.654+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/1606225829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd146bd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80054f0 tx=0x7f7eb8007fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3bd267edf633555 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.654+0000 7f7eb57fa700 1 -- 172.21.15.59:0/1606225829 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800e070 con 0x55d4dd147650 2023-10-08T12:48:28.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.654+0000 7f7eb57fa700 1 -- 172.21.15.59:0/1606225829 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7eb8005a90 con 0x55d4dd147650 2023-10-08T12:48:28.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.654+0000 7f7eb57fa700 1 -- 172.21.15.59:0/1606225829 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8031a00 con 0x55d4dd147650 2023-10-08T12:48:28.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.654+0000 7f7edc066b80 1 -- 172.21.15.59:0/1606225829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 msgr2=0x55d4dd146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.654+0000 7f7edc066b80 1 --2- 172.21.15.59:0/1606225829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd146bd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80054f0 tx=0x7f7eb8007fb0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.654+0000 7f7edc066b80 1 -- 172.21.15.59:0/1606225829 shutdown_connections 2023-10-08T12:48:28.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.654+0000 7f7edc066b80 1 --2- 172.21.15.59:0/1606225829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd147650 0x55d4dd146bd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.654+0000 7f7edc066b80 1 --2- 172.21.15.59:0/1606225829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.654+0000 7f7edc066b80 1 --2- 172.21.15.59:0/1606225829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd13c7a0 0x55d4dd143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.654+0000 7f7edc066b80 1 -- 172.21.15.59:0/1606225829 >> 172.21.15.59:0/1606225829 conn(0x55d4dd0b1260 msgr2=0x55d4dd142bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.655+0000 7f7edc066b80 1 -- 172.21.15.59:0/1606225829 shutdown_connections 2023-10-08T12:48:28.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.655+0000 7f7edc066b80 1 -- 172.21.15.59:0/1606225829 wait complete. 2023-10-08T12:48:28.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.655+0000 7f7edc066b80 1 -- start start 2023-10-08T12:48:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.655+0000 7f7edc066b80 1 Processor -- start 2023-10-08T12:48:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd156b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd13c7a0 0x55d4dd154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7edc066b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd147650 0x55d4dd155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7edc066b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dd155c40 con 0x55d4dd147650 2023-10-08T12:48:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7edc066b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dd155db0 con 0x55d4dd13c7a0 2023-10-08T12:48:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7edc066b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dd1b3810 con 0x55d4dd13be80 2023-10-08T12:48:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7edc066b80 10 client.0 _ll_register_callbacks cb 0x7f7eb800bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7ec659b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7ec5d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd13c7a0 0x55d4dd154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7ec659b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:57088/0 (socket says 172.21.15.59:57088) 2023-10-08T12:48:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7ec659b700 1 -- 172.21.15.59:0/1038257070 learned_addr learned my addr 172.21.15.59:0/1038257070 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7ec6d9c700 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd147650 0x55d4dd155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7ec659b700 1 -- 172.21.15.59:0/1038257070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd13c7a0 msgr2=0x55d4dd154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7ec659b700 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd13c7a0 0x55d4dd154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7ec659b700 1 -- 172.21.15.59:0/1038257070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd147650 msgr2=0x55d4dd155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7ec659b700 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd147650 0x55d4dd155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.656+0000 7f7ec659b700 1 -- 172.21.15.59:0/1038257070 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4dcea3c60 con 0x55d4dd13be80 2023-10-08T12:48:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7ec659b700 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd156b20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc096760 tx=0x7f7ebc09a030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df6845be6fd81a37 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7ea9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:48:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/1038257070 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc099750 con 0x55d4dd13be80 2023-10-08T12:48:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7edc066b80 1 -- 172.21.15.59:0/1038257070 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ebc09e3b0 con 0x55d4dd13be80 2023-10-08T12:48:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/1038257070 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7ebc0998b0 con 0x55d4dd13be80 2023-10-08T12:48:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/1038257070 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ebc07e3a0 con 0x55d4dd13be80 2023-10-08T12:48:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7edc066b80 10 client.26485 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7edc066b80 1 -- 172.21.15.59:0/1038257070 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55d4dceb92b0 con 0x55d4dd13be80 2023-10-08T12:48:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/1038257070 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ebc09e3b0 con 0x55d4dd13be80 2023-10-08T12:48:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/1038257070 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7ebc0cac50 con 0x55d4dd13be80 2023-10-08T12:48:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7edc066b80 10 client.26485 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7edc066b80 10 client.26485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7edc066b80 20 client.26485 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7edc066b80 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d4dd1b4d50 0x55d4dd1b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7edc066b80 4 client.26485 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:48:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.657+0000 7f7edc066b80 1 -- 172.21.15.59:0/1038257070 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d4dd088b30 con 0x55d4dd1b4d50 2023-10-08T12:48:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.658+0000 7f7ec5d9a700 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d4dd1b4d50 0x55d4dd1b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.658+0000 7f7ec5d9a700 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d4dd1b4d50 0x55d4dd1b7170 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebdcc992a8fbffeb server_cookie=2914b2d1778064b in_seq=0 out_seq=0 2023-10-08T12:48:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.658+0000 7f7ea9ffb700 10 client.26485 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7ea9ffb700 1 -- 172.21.15.59:0/1038257070 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d4dd088b30 con 0x55d4dd1b4d50 2023-10-08T12:48:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7ea9ffb700 10 client.26485 handle_command_reply: tid=0 2023-10-08T12:48:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7edc066b80 1 client.26485 shutdown 2023-10-08T12:48:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7edc066b80 1 -- 172.21.15.59:0/1038257070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 msgr2=0x55d4dd156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7edc066b80 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd156b20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc096760 tx=0x7f7ebc09a030 comp rx=0 tx=0).stop 2023-10-08T12:48:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7edc066b80 1 -- 172.21.15.59:0/1038257070 shutdown_connections 2023-10-08T12:48:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7edc066b80 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d4dd1b4d50 0x55d4dd1b7170 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7edc066b80 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4dd147650 0x55d4dd155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7edc066b80 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d4dd13be80 0x55d4dd156b20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7edc066b80 1 --2- 172.21.15.59:0/1038257070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4dd13c7a0 0x55d4dd154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7ea9ffb700 0 client.26485 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7edc066b80 1 -- 172.21.15.59:0/1038257070 >> 172.21.15.59:0/1038257070 conn(0x55d4dd0b1260 msgr2=0x55d4dd1374d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7edc066b80 1 -- 172.21.15.59:0/1038257070 shutdown_connections 2023-10-08T12:48:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.659+0000 7f7edc066b80 1 -- 172.21.15.59:0/1038257070 wait complete. 2023-10-08T12:48:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7edc066b80 20 client.26485 trim_cache size 0 max 16384 2023-10-08T12:48:28.669 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:48:28.669 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:48:28.670 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:48:28.670 INFO:teuthology.orchestra.run.smithi059.stdout: "e1a2675a-e091-431e-835e-c145b12256f6": { 2023-10-08T12:48:28.670 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:48:28.670 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "e1a2675a-e091-431e-835e-c145b12256f6", 2023-10-08T12:48:28.670 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:48:28.670 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:48:28.670 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:48:28.670 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:48:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 -- 172.21.15.59:0/109781658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1670 msgr2=0x7f7eac0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1670 0x7f7eac0a3b30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009610 tx=0x7f7eb8007cc0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 -- 172.21.15.59:0/109781658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0100730 msgr2=0x7f7ec0072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0100730 0x7f7ec0072af0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e9a0 tx=0x7f7ebc00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 -- 172.21.15.59:0/109781658 shutdown_connections 2023-10-08T12:48:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7eac0a1670 0x7f7eac0a3b30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec0100730 0x7f7ec0072af0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ec0106740 0x7f7ec0073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 --2- 172.21.15.59:0/109781658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ec01010f0 0x7f7ec0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 -- 172.21.15.59:0/109781658 >> 172.21.15.59:0/109781658 conn(0x7f7ec00fc200 msgr2=0x7f7ec00fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 -- 172.21.15.59:0/109781658 shutdown_connections 2023-10-08T12:48:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:28.660+0000 7f7ec87ff700 1 -- 172.21.15.59:0/109781658 wait complete. 2023-10-08T12:48:28.680 INFO:tasks.cephfs.filesystem:scrub status for tag:e1a2675a-e091-431e-835e-c145b12256f6 - {'path': '/', 'tag': 'e1a2675a-e091-431e-835e-c145b12256f6', 'options': 'recursive,force'} 2023-10-08T12:48:29.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 921431 13.57 MB/sec execute 240 sec latency 103.572 ms 2023-10-08T12:48:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:29 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:48:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:29 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:48:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:29 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:48:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:29 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:48:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:29 smithi092 ceph-mon[134093]: pgmap v535: 97 pgs: 97 active+clean; 497 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 263 op/s 2023-10-08T12:48:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:29 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:48:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:29 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:48:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:29 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:48:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:29 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:48:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:29 smithi173 ceph-mon[135182]: pgmap v535: 97 pgs: 97 active+clean; 497 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 263 op/s 2023-10-08T12:48:30.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:29 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:48:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:29 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:48:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:29 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:48:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:29 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:48:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:29 smithi059 ceph-mon[98489]: pgmap v535: 97 pgs: 97 active+clean; 497 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 263 op/s 2023-10-08T12:48:30.520 INFO:tasks.workunit.client.0.smithi059.stdout: 1 924293 13.59 MB/sec execute 241 sec latency 6.834 ms 2023-10-08T12:48:31.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 927467 13.60 MB/sec execute 242 sec latency 7.959 ms 2023-10-08T12:48:32.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:31 smithi059 ceph-mon[98489]: pgmap v536: 97 pgs: 97 active+clean; 478 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 246 op/s 2023-10-08T12:48:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:31 smithi092 ceph-mon[134093]: pgmap v536: 97 pgs: 97 active+clean; 478 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 246 op/s 2023-10-08T12:48:32.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:31 smithi173 ceph-mon[135182]: pgmap v536: 97 pgs: 97 active+clean; 478 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 246 op/s 2023-10-08T12:48:32.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 929893 13.59 MB/sec execute 243 sec latency 25.436 ms 2023-10-08T12:48:33.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:32 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:48:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:32 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:48:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:32 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:48:33.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 931809 13.58 MB/sec execute 244 sec latency 111.456 ms 2023-10-08T12:48:34.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:33 smithi059 ceph-mon[98489]: pgmap v537: 97 pgs: 97 active+clean; 470 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 277 op/s 2023-10-08T12:48:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:33 smithi092 ceph-mon[134093]: pgmap v537: 97 pgs: 97 active+clean; 470 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 277 op/s 2023-10-08T12:48:34.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:33 smithi173 ceph-mon[135182]: pgmap v537: 97 pgs: 97 active+clean; 470 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 277 op/s 2023-10-08T12:48:34.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 934185 13.58 MB/sec execute 245 sec latency 72.802 ms 2023-10-08T12:48:35.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:34 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:48:35.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:34 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:48:35.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:34 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:48:35.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 936100 13.56 MB/sec execute 246 sec latency 18.459 ms 2023-10-08T12:48:36.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: pgmap v538: 97 pgs: 97 active+clean; 472 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2023-10-08T12:48:36.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-08T12:48:36.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi173 to 196.2M 2023-10-08T12:48:36.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-08T12:48:36.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: Unable to set osd_memory_target on smithi173 to 205771776: error parsing value: Value '205771776' is below minimum 939524096 2023-10-08T12:48:36.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:48:36.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:48:36.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:48:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: pgmap v538: 97 pgs: 97 active+clean; 472 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2023-10-08T12:48:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-08T12:48:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi173 to 196.2M 2023-10-08T12:48:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-08T12:48:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: Unable to set osd_memory_target on smithi173 to 205771776: error parsing value: Value '205771776' is below minimum 939524096 2023-10-08T12:48:36.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:48:36.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:48:36.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:48:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: pgmap v538: 97 pgs: 97 active+clean; 472 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2023-10-08T12:48:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi173 to 196.2M 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: Unable to set osd_memory_target on smithi173 to 205771776: error parsing value: Value '205771776' is below minimum 939524096 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:48:36.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:48:36.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 938680 13.57 MB/sec execute 247 sec latency 12.106 ms 2023-10-08T12:48:37.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:36 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi059 to 222.0M 2023-10-08T12:48:37.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:36 smithi059 ceph-mon[98489]: Unable to set osd_memory_target on smithi059 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-08T12:48:37.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:36 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi059 to 222.0M 2023-10-08T12:48:37.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:36 smithi092 ceph-mon[134093]: Unable to set osd_memory_target on smithi059 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-08T12:48:37.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:36 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi059 to 222.0M 2023-10-08T12:48:37.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:36 smithi173 ceph-mon[135182]: Unable to set osd_memory_target on smithi059 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-08T12:48:37.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 941667 13.58 MB/sec execute 248 sec latency 11.595 ms 2023-10-08T12:48:38.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:37 smithi059 ceph-mon[98489]: pgmap v539: 97 pgs: 97 active+clean; 471 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2023-10-08T12:48:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:37 smithi092 ceph-mon[134093]: pgmap v539: 97 pgs: 97 active+clean; 471 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2023-10-08T12:48:38.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:37 smithi173 ceph-mon[135182]: pgmap v539: 97 pgs: 97 active+clean; 471 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2023-10-08T12:48:38.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 943562 13.56 MB/sec execute 249 sec latency 25.546 ms 2023-10-08T12:48:39.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 945474 13.56 MB/sec execute 250 sec latency 128.366 ms 2023-10-08T12:48:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:39 smithi092 ceph-mon[134093]: pgmap v540: 97 pgs: 97 active+clean; 477 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 252 op/s 2023-10-08T12:48:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:39 smithi173 ceph-mon[135182]: pgmap v540: 97 pgs: 97 active+clean; 477 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 252 op/s 2023-10-08T12:48:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:39 smithi059 ceph-mon[98489]: pgmap v540: 97 pgs: 97 active+clean; 477 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 252 op/s 2023-10-08T12:48:40.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 947876 13.55 MB/sec execute 251 sec latency 24.602 ms 2023-10-08T12:48:41.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 950211 13.54 MB/sec execute 252 sec latency 13.574 ms 2023-10-08T12:48:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:41 smithi059 ceph-mon[98489]: pgmap v541: 97 pgs: 97 active+clean; 479 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 241 op/s 2023-10-08T12:48:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:41 smithi092 ceph-mon[134093]: pgmap v541: 97 pgs: 97 active+clean; 479 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 241 op/s 2023-10-08T12:48:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:41 smithi173 ceph-mon[135182]: pgmap v541: 97 pgs: 97 active+clean; 479 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 241 op/s 2023-10-08T12:48:42.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 952702 13.55 MB/sec execute 253 sec latency 11.904 ms 2023-10-08T12:48:43.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 955166 13.54 MB/sec execute 254 sec latency 36.835 ms 2023-10-08T12:48:44.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:43 smithi059 ceph-mon[98489]: pgmap v542: 97 pgs: 97 active+clean; 484 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.0 MiB/s wr, 286 op/s 2023-10-08T12:48:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:43 smithi092 ceph-mon[134093]: pgmap v542: 97 pgs: 97 active+clean; 484 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.0 MiB/s wr, 286 op/s 2023-10-08T12:48:44.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:43 smithi173 ceph-mon[135182]: pgmap v542: 97 pgs: 97 active+clean; 484 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.0 MiB/s wr, 286 op/s 2023-10-08T12:48:44.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 956627 13.52 MB/sec execute 255 sec latency 142.417 ms 2023-10-08T12:48:45.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 959405 13.53 MB/sec execute 256 sec latency 24.196 ms 2023-10-08T12:48:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:45 smithi059 ceph-mon[98489]: pgmap v543: 97 pgs: 97 active+clean; 492 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 215 op/s 2023-10-08T12:48:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:45 smithi092 ceph-mon[134093]: pgmap v543: 97 pgs: 97 active+clean; 492 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 215 op/s 2023-10-08T12:48:46.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:45 smithi173 ceph-mon[135182]: pgmap v543: 97 pgs: 97 active+clean; 492 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 215 op/s 2023-10-08T12:48:46.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 961376 13.51 MB/sec execute 257 sec latency 16.697 ms 2023-10-08T12:48:47.521 INFO:tasks.workunit.client.0.smithi059.stdout: 1 963779 13.51 MB/sec execute 258 sec latency 15.235 ms 2023-10-08T12:48:48.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:47 smithi059 ceph-mon[98489]: pgmap v544: 97 pgs: 97 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 233 op/s 2023-10-08T12:48:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:47 smithi092 ceph-mon[134093]: pgmap v544: 97 pgs: 97 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 233 op/s 2023-10-08T12:48:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:47 smithi173 ceph-mon[135182]: pgmap v544: 97 pgs: 97 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 233 op/s 2023-10-08T12:48:48.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 966494 13.52 MB/sec execute 259 sec latency 31.938 ms 2023-10-08T12:48:49.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 968070 13.50 MB/sec execute 260 sec latency 88.447 ms 2023-10-08T12:48:50.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:49 smithi092 ceph-mon[134093]: pgmap v545: 97 pgs: 97 active+clean; 499 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 241 op/s 2023-10-08T12:48:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:49 smithi173 ceph-mon[135182]: pgmap v545: 97 pgs: 97 active+clean; 499 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 241 op/s 2023-10-08T12:48:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:49 smithi059 ceph-mon[98489]: pgmap v545: 97 pgs: 97 active+clean; 499 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 241 op/s 2023-10-08T12:48:50.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 970364 13.50 MB/sec execute 261 sec latency 57.461 ms 2023-10-08T12:48:51.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 972942 13.49 MB/sec execute 262 sec latency 15.460 ms 2023-10-08T12:48:52.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:51 smithi059 ceph-mon[98489]: pgmap v546: 97 pgs: 97 active+clean; 500 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 225 op/s 2023-10-08T12:48:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:51 smithi092 ceph-mon[134093]: pgmap v546: 97 pgs: 97 active+clean; 500 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 225 op/s 2023-10-08T12:48:52.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:51 smithi173 ceph-mon[135182]: pgmap v546: 97 pgs: 97 active+clean; 500 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 225 op/s 2023-10-08T12:48:52.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 975117 13.49 MB/sec execute 263 sec latency 14.913 ms 2023-10-08T12:48:53.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 977610 13.49 MB/sec execute 264 sec latency 11.512 ms 2023-10-08T12:48:54.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:53 smithi059 ceph-mon[98489]: pgmap v547: 97 pgs: 97 active+clean; 507 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.0 MiB/s wr, 259 op/s 2023-10-08T12:48:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:53 smithi092 ceph-mon[134093]: pgmap v547: 97 pgs: 97 active+clean; 507 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.0 MiB/s wr, 259 op/s 2023-10-08T12:48:54.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:53 smithi173 ceph-mon[135182]: pgmap v547: 97 pgs: 97 active+clean; 507 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.0 MiB/s wr, 259 op/s 2023-10-08T12:48:54.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 979588 13.47 MB/sec execute 265 sec latency 172.078 ms 2023-10-08T12:48:55.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 981151 13.46 MB/sec execute 266 sec latency 191.976 ms 2023-10-08T12:48:56.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:55 smithi059 ceph-mon[98489]: pgmap v548: 97 pgs: 97 active+clean; 512 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 220 op/s 2023-10-08T12:48:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:55 smithi092 ceph-mon[134093]: pgmap v548: 97 pgs: 97 active+clean; 512 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 220 op/s 2023-10-08T12:48:56.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:55 smithi173 ceph-mon[135182]: pgmap v548: 97 pgs: 97 active+clean; 512 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 220 op/s 2023-10-08T12:48:56.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 983827 13.46 MB/sec execute 267 sec latency 15.723 ms 2023-10-08T12:48:57.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 985800 13.45 MB/sec execute 268 sec latency 13.961 ms 2023-10-08T12:48:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:57 smithi059 ceph-mon[98489]: pgmap v549: 97 pgs: 97 active+clean; 517 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 244 op/s 2023-10-08T12:48:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:57 smithi092 ceph-mon[134093]: pgmap v549: 97 pgs: 97 active+clean; 517 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 244 op/s 2023-10-08T12:48:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:57 smithi173 ceph-mon[135182]: pgmap v549: 97 pgs: 97 active+clean; 517 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 244 op/s 2023-10-08T12:48:58.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 988239 13.45 MB/sec execute 269 sec latency 11.877 ms 2023-10-08T12:48:58.681 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:48:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.902+0000 7f9a401ff700 1 -- 172.21.15.59:0/957175383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a38101100 msgr2=0x7f9a3810d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.902+0000 7f9a401ff700 1 --2- 172.21.15.59:0/957175383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a38101100 0x7f9a3810d610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000b0a0 tx=0x7f9a3000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.902+0000 7f9a401ff700 1 -- 172.21.15.59:0/957175383 shutdown_connections 2023-10-08T12:48:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.902+0000 7f9a401ff700 1 --2- 172.21.15.59:0/957175383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a38101100 0x7f9a3810d610 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.902+0000 7f9a401ff700 1 --2- 172.21.15.59:0/957175383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38106750 0x7f9a38106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.902+0000 7f9a401ff700 1 --2- 172.21.15.59:0/957175383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a38100740 0x7f9a38100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.902+0000 7f9a401ff700 1 -- 172.21.15.59:0/957175383 >> 172.21.15.59:0/957175383 conn(0x7f9a380fc230 msgr2=0x7f9a380fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.902+0000 7f9a401ff700 1 -- 172.21.15.59:0/957175383 shutdown_connections 2023-10-08T12:48:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.902+0000 7f9a401ff700 1 -- 172.21.15.59:0/957175383 wait complete. 2023-10-08T12:48:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.903+0000 7f9a401ff700 1 Processor -- start 2023-10-08T12:48:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.903+0000 7f9a401ff700 1 -- start start 2023-10-08T12:48:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a401ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38100740 0x7f9a3819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a401ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a38101100 0x7f9a3819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a401ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a38106750 0x7f9a381969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a401ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a38197180 con 0x7f9a38106750 2023-10-08T12:48:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a401ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a381972f0 con 0x7f9a38101100 2023-10-08T12:48:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a401ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a381974b0 con 0x7f9a38100740 2023-10-08T12:48:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a3df9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38100740 0x7f9a3819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a3d79a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a38101100 0x7f9a3819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a3df9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38100740 0x7f9a3819c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34654/0 (socket says 172.21.15.59:34654) 2023-10-08T12:48:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a3df9b700 1 -- 172.21.15.59:0/194121402 learned_addr learned my addr 172.21.15.59:0/194121402 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a3e79c700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a38106750 0x7f9a381969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a3d79a700 1 -- 172.21.15.59:0/194121402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38100740 msgr2=0x7f9a3819c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38100740 0x7f9a3819c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a3d79a700 1 -- 172.21.15.59:0/194121402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a38106750 msgr2=0x7f9a381969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:58.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a38106750 0x7f9a381969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.904+0000 7f9a3d79a700 1 -- 172.21.15.59:0/194121402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a30009d00 con 0x7f9a38101100 2023-10-08T12:48:58.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.905+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a38101100 0x7f9a3819ce00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800e9f0 tx=0x7f9a2800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:58.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.905+0000 7f9a2effd700 1 -- 172.21.15.59:0/194121402 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2800c9c0 con 0x7f9a38101100 2023-10-08T12:48:58.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.905+0000 7f9a401ff700 1 -- 172.21.15.59:0/194121402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a38197790 con 0x7f9a38101100 2023-10-08T12:48:58.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.905+0000 7f9a2effd700 1 -- 172.21.15.59:0/194121402 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a28010430 con 0x7f9a38101100 2023-10-08T12:48:58.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.905+0000 7f9a2effd700 1 -- 172.21.15.59:0/194121402 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28018680 con 0x7f9a38101100 2023-10-08T12:48:58.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.905+0000 7f9a401ff700 1 -- 172.21.15.59:0/194121402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a381a3890 con 0x7f9a38101100 2023-10-08T12:48:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.908+0000 7f9a2effd700 1 -- 172.21.15.59:0/194121402 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9a28010860 con 0x7f9a38101100 2023-10-08T12:48:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.910+0000 7f9a53af7b80 1 Processor -- start 2023-10-08T12:48:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.910+0000 7f9a2effd700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a240a15f0 0x7f9a240a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.910+0000 7f9a2effd700 1 -- 172.21.15.59:0/194121402 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9a28014070 con 0x7f9a38101100 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.910+0000 7f9a53af7b80 1 -- start start 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.910+0000 7f9a3e79c700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a240a15f0 0x7f9a240a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.910+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873ee80 0x56299873f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.910+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873f7a0 0x56299874e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.910+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299874ea60 0x562998750e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.910+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629986a8460 con 0x56299873ee80 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562998699c20 con 0x56299874ea60 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562998697540 con 0x56299873f7a0 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3df9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873ee80 0x56299873f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3df9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873ee80 0x56299873f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59666/0 (socket says 172.21.15.59:59666) 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3df9b700 1 -- 172.21.15.59:0/1977699186 learned_addr learned my addr 172.21.15.59:0/1977699186 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/1977699186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873f7a0 0x56299874e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3e79c700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a240a15f0 0x7f9a240a3ab0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9a3819d550 tx=0x7f9a30006230 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3e79c700 1 --2- 172.21.15.59:0/1977699186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299874ea60 0x562998750e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3d79a700 1 -- 172.21.15.59:0/1977699186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299874ea60 msgr2=0x562998750e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/1977699186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299874ea60 0x562998750e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3d79a700 1 -- 172.21.15.59:0/1977699186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873ee80 msgr2=0x56299873f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/1977699186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873ee80 0x56299873f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3d79a700 1 -- 172.21.15.59:0/1977699186 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629984bdde0 con 0x56299873f7a0 2023-10-08T12:48:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3e79c700 1 --2- 172.21.15.59:0/1977699186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299874ea60 0x562998750e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:48:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.911+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/1977699186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873f7a0 0x56299874e520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a280ca930 tx=0x7f9a28099c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=140af4d5e6749e12 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.912+0000 7f9a23fff700 1 -- 172.21.15.59:0/1977699186 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2809e120 con 0x56299873f7a0 2023-10-08T12:48:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.912+0000 7f9a23fff700 1 -- 172.21.15.59:0/1977699186 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a2809e340 con 0x56299873f7a0 2023-10-08T12:48:58.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.912+0000 7f9a23fff700 1 -- 172.21.15.59:0/1977699186 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2809a700 con 0x56299873f7a0 2023-10-08T12:48:58.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.912+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1977699186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873f7a0 msgr2=0x56299874e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:58.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.912+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/1977699186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873f7a0 0x56299874e520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a280ca930 tx=0x7f9a28099c20 comp rx=0 tx=0).stop 2023-10-08T12:48:58.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.912+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1977699186 shutdown_connections 2023-10-08T12:48:58.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.912+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/1977699186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299874ea60 0x562998750e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.912+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/1977699186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873ee80 0x56299873f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.912+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/1977699186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873f7a0 0x56299874e520 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.912+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1977699186 >> 172.21.15.59:0/1977699186 conn(0x5629986b4260 msgr2=0x56299873b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:58.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.913+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1977699186 shutdown_connections 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.913+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1977699186 wait complete. 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.913+0000 7f9a53af7b80 1 -- start start 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.913+0000 7f9a53af7b80 1 Processor -- start 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873ee80 0x56299874e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873f7a0 0x56299874b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299874ea60 0x56299874bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562998692e30 con 0x56299873ee80 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299862f710 con 0x56299873f7a0 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299862f3b0 con 0x56299874ea60 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a53af7b80 10 client.0 _ll_register_callbacks cb 0x56299848c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a3d79a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873f7a0 0x56299874b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a3d79a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873f7a0 0x56299874b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49462/0 (socket says 172.21.15.59:49462) 2023-10-08T12:48:58.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a3d79a700 1 -- 172.21.15.59:0/3070565407 learned_addr learned my addr 172.21.15.59:0/3070565407 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:58.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a3df9b700 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873ee80 0x56299874e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a3e79c700 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299874ea60 0x56299874bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a3d79a700 1 -- 172.21.15.59:0/3070565407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299874ea60 msgr2=0x56299874bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.914+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299874ea60 0x56299874bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a3d79a700 1 -- 172.21.15.59:0/3070565407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873ee80 msgr2=0x56299874e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873ee80 0x56299874e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a3d79a700 1 -- 172.21.15.59:0/3070565407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a381a3890 con 0x56299873f7a0 2023-10-08T12:48:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873f7a0 0x56299874b780 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9a280caee0 tx=0x7f9a2800c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b47868e2c87d40ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a217fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:48:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a217fa700 1 -- 172.21.15.59:0/3070565407 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280b8070 con 0x56299873f7a0 2023-10-08T12:48:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a217fa700 1 -- 172.21.15.59:0/3070565407 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9a2809e120 con 0x56299873f7a0 2023-10-08T12:48:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a53af7b80 1 -- 172.21.15.59:0/3070565407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56299865aeb0 con 0x56299873f7a0 2023-10-08T12:48:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a217fa700 1 -- 172.21.15.59:0/3070565407 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a2809a450 con 0x56299873f7a0 2023-10-08T12:48:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a53af7b80 10 client.26507 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a53af7b80 1 -- 172.21.15.59:0/3070565407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5629984a6c60 con 0x56299873f7a0 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.915+0000 7f9a217fa700 1 -- 172.21.15.59:0/3070565407 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56299865aeb0 con 0x56299873f7a0 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.916+0000 7f9a217fa700 1 -- 172.21.15.59:0/3070565407 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9a280b8260 con 0x56299873f7a0 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.916+0000 7f9a53af7b80 10 client.26507 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.916+0000 7f9a53af7b80 10 client.26507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.916+0000 7f9a53af7b80 20 client.26507 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.916+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56299875e0c0 0x5629987604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.916+0000 7f9a53af7b80 4 client.26507 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.916+0000 7f9a53af7b80 1 -- 172.21.15.59:0/3070565407 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56299868be10 con 0x56299875e0c0 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.916+0000 7f9a3df9b700 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56299875e0c0 0x5629987604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.916+0000 7f9a3df9b700 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56299875e0c0 0x5629987604e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=823f22d8f5172d39 server_cookie=1b227323f8e111e4 in_seq=0 out_seq=0 2023-10-08T12:48:58.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.916+0000 7f9a217fa700 10 client.26507 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:58.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a217fa700 1 -- 172.21.15.59:0/3070565407 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56299868be10 con 0x56299875e0c0 2023-10-08T12:48:58.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a217fa700 10 client.26507 handle_command_reply: tid=0 2023-10-08T12:48:58.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a53af7b80 1 client.26507 shutdown 2023-10-08T12:48:58.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a53af7b80 1 -- 172.21.15.59:0/3070565407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873f7a0 msgr2=0x56299874b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:58.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873f7a0 0x56299874b780 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9a280caee0 tx=0x7f9a2800c6e0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a53af7b80 1 -- 172.21.15.59:0/3070565407 shutdown_connections 2023-10-08T12:48:58.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56299875e0c0 0x5629987604e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299874ea60 0x56299874bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873ee80 0x56299874e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/3070565407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873f7a0 0x56299874b780 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a53af7b80 1 -- 172.21.15.59:0/3070565407 >> 172.21.15.59:0/3070565407 conn(0x5629986b4260 msgr2=0x56299873aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.917+0000 7f9a217fa700 0 client.26507 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.918+0000 7f9a53af7b80 1 -- 172.21.15.59:0/3070565407 shutdown_connections 2023-10-08T12:48:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.918+0000 7f9a53af7b80 1 -- 172.21.15.59:0/3070565407 wait complete. 2023-10-08T12:48:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.918+0000 7f9a53af7b80 20 client.26507 trim_cache size 0 max 16384 2023-10-08T12:48:58.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.936+0000 7f9a53af7b80 1 Processor -- start 2023-10-08T12:48:58.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.936+0000 7f9a53af7b80 1 -- start start 2023-10-08T12:48:58.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.936+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629986b4260 0x56299875a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.936+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873ee80 0x562998748a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.936+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873f7a0 0x562998748f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.936+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562998513920 con 0x5629986b4260 2023-10-08T12:48:58.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.936+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562998737ae0 con 0x56299873ee80 2023-10-08T12:48:58.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.936+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562998735570 con 0x56299873f7a0 2023-10-08T12:48:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3df9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629986b4260 0x56299875a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3d79a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873ee80 0x562998748a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3d79a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873ee80 0x562998748a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49472/0 (socket says 172.21.15.59:49472) 2023-10-08T12:48:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3d79a700 1 -- 172.21.15.59:0/356369953 learned_addr learned my addr 172.21.15.59:0/356369953 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3df9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629986b4260 0x56299875a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59686/0 (socket says 172.21.15.59:59686) 2023-10-08T12:48:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3e79c700 1 --2- 172.21.15.59:0/356369953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873f7a0 0x562998748f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3d79a700 1 -- 172.21.15.59:0/356369953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873f7a0 msgr2=0x562998748f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/356369953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873f7a0 0x562998748f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3d79a700 1 -- 172.21.15.59:0/356369953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629986b4260 msgr2=0x56299875a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/356369953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629986b4260 0x56299875a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3d79a700 1 -- 172.21.15.59:0/356369953 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629984e4250 con 0x56299873ee80 2023-10-08T12:48:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3df9b700 1 --2- 172.21.15.59:0/356369953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629986b4260 0x56299875a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.937+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/356369953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873ee80 0x562998748a20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9a28099ef0 tx=0x7f9a28099c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2854ab857c3f91c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.938+0000 7f9a2cff9700 1 -- 172.21.15.59:0/356369953 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280b8040 con 0x56299873ee80 2023-10-08T12:48:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.938+0000 7f9a2cff9700 1 -- 172.21.15.59:0/356369953 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a28096100 con 0x56299873ee80 2023-10-08T12:48:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.938+0000 7f9a2cff9700 1 -- 172.21.15.59:0/356369953 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280b81a0 con 0x56299873ee80 2023-10-08T12:48:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.938+0000 7f9a53af7b80 1 -- 172.21.15.59:0/356369953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873ee80 msgr2=0x562998748a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.938+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/356369953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873ee80 0x562998748a20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9a28099ef0 tx=0x7f9a28099c20 comp rx=0 tx=0).stop 2023-10-08T12:48:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.938+0000 7f9a53af7b80 1 -- 172.21.15.59:0/356369953 shutdown_connections 2023-10-08T12:48:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.938+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/356369953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873f7a0 0x562998748f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.938+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/356369953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629986b4260 0x56299875a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.938+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/356369953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56299873ee80 0x562998748a20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.938+0000 7f9a53af7b80 1 -- 172.21.15.59:0/356369953 >> 172.21.15.59:0/356369953 conn(0x5629987372a0 msgr2=0x562998759ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.938+0000 7f9a53af7b80 1 -- 172.21.15.59:0/356369953 shutdown_connections 2023-10-08T12:48:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.939+0000 7f9a53af7b80 1 -- 172.21.15.59:0/356369953 wait complete. 2023-10-08T12:48:58.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.939+0000 7f9a53af7b80 1 -- start start 2023-10-08T12:48:58.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.939+0000 7f9a53af7b80 1 Processor -- start 2023-10-08T12:48:58.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629986b4260 0x562998755440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873ee80 0x562998753940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a53af7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873f7a0 0x562998753e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562998754450 con 0x56299873f7a0 2023-10-08T12:48:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562998754590 con 0x5629986b4260 2023-10-08T12:48:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a53af7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562998754750 con 0x56299873ee80 2023-10-08T12:48:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a53af7b80 10 client.0 _ll_register_callbacks cb 0x7f9a340095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a3df9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629986b4260 0x562998755440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a3df9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629986b4260 0x562998755440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49486/0 (socket says 172.21.15.59:49486) 2023-10-08T12:48:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a3df9b700 1 -- 172.21.15.59:0/1387238375 learned_addr learned my addr 172.21.15.59:0/1387238375 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873ee80 0x562998753940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a3e79c700 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873f7a0 0x562998753e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a3df9b700 1 -- 172.21.15.59:0/1387238375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873ee80 msgr2=0x562998753940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a3df9b700 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873ee80 0x562998753940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a3df9b700 1 -- 172.21.15.59:0/1387238375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873f7a0 msgr2=0x562998753e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a3df9b700 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873f7a0 0x562998753e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.940+0000 7f9a3df9b700 1 -- 172.21.15.59:0/1387238375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3401d980 con 0x5629986b4260 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.941+0000 7f9a3df9b700 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629986b4260 0x562998755440 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x562998760d80 tx=0x7f9a34009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=853a62efe3837bee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.941+0000 7f9a217fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.941+0000 7f9a217fa700 1 -- 172.21.15.59:0/1387238375 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a34016040 con 0x5629986b4260 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.941+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1387238375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a2809e340 con 0x5629986b4260 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.941+0000 7f9a217fa700 1 -- 172.21.15.59:0/1387238375 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9a34010d00 con 0x5629986b4260 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.941+0000 7f9a217fa700 1 -- 172.21.15.59:0/1387238375 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a34004030 con 0x5629986b4260 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.941+0000 7f9a53af7b80 10 client.26513 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.941+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1387238375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5629984a6c60 con 0x5629986b4260 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.941+0000 7f9a217fa700 1 -- 172.21.15.59:0/1387238375 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a2809e340 con 0x5629986b4260 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.942+0000 7f9a217fa700 1 -- 172.21.15.59:0/1387238375 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9a340253d0 con 0x5629986b4260 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.942+0000 7f9a53af7b80 10 client.26513 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.942+0000 7f9a53af7b80 10 client.26513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.942+0000 7f9a53af7b80 20 client.26513 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.942+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56299874ea60 0x5629987b5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.942+0000 7f9a53af7b80 4 client.26513 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.942+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1387238375 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56299868bb30 con 0x56299874ea60 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.942+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56299874ea60 0x5629987b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.942+0000 7f9a3d79a700 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56299874ea60 0x5629987b5570 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37bb77d10a8151e1 server_cookie=b928662b31f89631 in_seq=0 out_seq=0 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.942+0000 7f9a217fa700 10 client.26513 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a217fa700 1 -- 172.21.15.59:0/1387238375 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56299868bb30 con 0x56299874ea60 2023-10-08T12:48:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a217fa700 10 client.26513 handle_command_reply: tid=0 2023-10-08T12:48:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a53af7b80 1 client.26513 shutdown 2023-10-08T12:48:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1387238375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629986b4260 msgr2=0x562998755440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629986b4260 0x562998755440 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x562998760d80 tx=0x7f9a34009260 comp rx=0 tx=0).stop 2023-10-08T12:48:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1387238375 shutdown_connections 2023-10-08T12:48:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56299874ea60 0x5629987b5570 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5629986b4260 0x562998755440 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56299873f7a0 0x562998753e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a217fa700 0 client.26513 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a53af7b80 1 --2- 172.21.15.59:0/1387238375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56299873ee80 0x562998753940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1387238375 >> 172.21.15.59:0/1387238375 conn(0x5629987372a0 msgr2=0x562998749c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1387238375 shutdown_connections 2023-10-08T12:48:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.943+0000 7f9a53af7b80 1 -- 172.21.15.59:0/1387238375 wait complete. 2023-10-08T12:48:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a53af7b80 20 client.26513 trim_cache size 0 max 16384 2023-10-08T12:48:58.950 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:48:58.950 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:48:58.950 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:48:58.950 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:48:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 -- 172.21.15.59:0/194121402 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a240a15f0 msgr2=0x7f9a240a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a240a15f0 0x7f9a240a3ab0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9a3819d550 tx=0x7f9a30006230 comp rx=0 tx=0).stop 2023-10-08T12:48:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 -- 172.21.15.59:0/194121402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a38101100 msgr2=0x7f9a3819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a38101100 0x7f9a3819ce00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800e9f0 tx=0x7f9a2800ed00 comp rx=0 tx=0).stop 2023-10-08T12:48:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 -- 172.21.15.59:0/194121402 shutdown_connections 2023-10-08T12:48:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a240a15f0 0x7f9a240a3ab0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a38106750 0x7f9a381969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38100740 0x7f9a3819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 --2- 172.21.15.59:0/194121402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a38101100 0x7f9a3819ce00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 -- 172.21.15.59:0/194121402 >> 172.21.15.59:0/194121402 conn(0x7f9a380fc230 msgr2=0x7f9a380fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 -- 172.21.15.59:0/194121402 shutdown_connections 2023-10-08T12:48:58.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:58.944+0000 7f9a401ff700 1 -- 172.21.15.59:0/194121402 wait complete. 2023-10-08T12:48:58.965 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:48:58.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:48:59.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.179+0000 7f0af17ff700 1 -- 172.21.15.59:0/2935188249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec106640 msgr2=0x7f0aec106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.179+0000 7f0af17ff700 1 --2- 172.21.15.59:0/2935188249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec106640 0x7f0aec106a20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009990 tx=0x7f0adc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.179+0000 7f0af17ff700 1 -- 172.21.15.59:0/2935188249 shutdown_connections 2023-10-08T12:48:59.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.179+0000 7f0af17ff700 1 --2- 172.21.15.59:0/2935188249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec106640 0x7f0aec106a20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.179+0000 7f0af17ff700 1 --2- 172.21.15.59:0/2935188249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aec100ff0 0x7f0aec10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.179+0000 7f0af17ff700 1 --2- 172.21.15.59:0/2935188249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec100630 0x7f0aec100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.179+0000 7f0af17ff700 1 -- 172.21.15.59:0/2935188249 >> 172.21.15.59:0/2935188249 conn(0x7f0aec0fc1a0 msgr2=0x7f0aec0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:59.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.179+0000 7f0af17ff700 1 -- 172.21.15.59:0/2935188249 shutdown_connections 2023-10-08T12:48:59.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.179+0000 7f0af17ff700 1 -- 172.21.15.59:0/2935188249 wait complete. 2023-10-08T12:48:59.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.180+0000 7f0af17ff700 1 Processor -- start 2023-10-08T12:48:59.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.180+0000 7f0af17ff700 1 -- start start 2023-10-08T12:48:59.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.181+0000 7f0af17ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aec100630 0x7f0aec072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.181+0000 7f0af17ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec100ff0 0x7f0aec073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.181+0000 7f0af17ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec106640 0x7f0aec073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.181+0000 7f0af17ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec1a4e70 con 0x7f0aec100630 2023-10-08T12:48:59.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.181+0000 7f0af17ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec1a4fe0 con 0x7f0aec106640 2023-10-08T12:48:59.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.181+0000 7f0af17ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec1a51a0 con 0x7f0aec100ff0 2023-10-08T12:48:59.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.181+0000 7f0aeaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aec100630 0x7f0aec072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.181+0000 7f0aea7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec100ff0 0x7f0aec073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.181+0000 7f0aeb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec106640 0x7f0aec073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.181+0000 7f0aea7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec100ff0 0x7f0aec073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34708/0 (socket says 172.21.15.59:34708) 2023-10-08T12:48:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.181+0000 7f0aea7fc700 1 -- 172.21.15.59:0/1167968767 learned_addr learned my addr 172.21.15.59:0/1167968767 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0aeb7fe700 1 -- 172.21.15.59:0/1167968767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec100ff0 msgr2=0x7f0aec073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0aeb7fe700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec100ff0 0x7f0aec073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0aeb7fe700 1 -- 172.21.15.59:0/1167968767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aec100630 msgr2=0x7f0aec072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0aeb7fe700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aec100630 0x7f0aec072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0aeb7fe700 1 -- 172.21.15.59:0/1167968767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0095f0 con 0x7f0aec106640 2023-10-08T12:48:59.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0aea7fc700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec100ff0 0x7f0aec073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:59.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0aeaffd700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aec100630 0x7f0aec072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:59.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0aeb7fe700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec106640 0x7f0aec073570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400efc0 tx=0x7f0ae400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:59.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0ad3fff700 1 -- 172.21.15.59:0/1167968767 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4018070 con 0x7f0aec106640 2023-10-08T12:48:59.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0ad3fff700 1 -- 172.21.15.59:0/1167968767 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ae400f040 con 0x7f0aec106640 2023-10-08T12:48:59.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0ad3fff700 1 -- 172.21.15.59:0/1167968767 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400cd40 con 0x7f0aec106640 2023-10-08T12:48:59.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0af17ff700 1 -- 172.21.15.59:0/1167968767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec1a5420 con 0x7f0aec106640 2023-10-08T12:48:59.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.182+0000 7f0af17ff700 1 -- 172.21.15.59:0/1167968767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec1a58e0 con 0x7f0aec106640 2023-10-08T12:48:59.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.184+0000 7f0af17ff700 1 -- 172.21.15.59:0/1167968767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec108c30 con 0x7f0aec106640 2023-10-08T12:48:59.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.185+0000 7f0ad3fff700 1 -- 172.21.15.59:0/1167968767 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0ae4003a00 con 0x7f0aec106640 2023-10-08T12:48:59.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.187+0000 7f0ad3fff700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0ad40a1670 0x7f0ad40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.187+0000 7f0ad3fff700 1 -- 172.21.15.59:0/1167968767 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f0ae40ccbd0 con 0x7f0aec106640 2023-10-08T12:48:59.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.187+0000 7f0aeaffd700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0ad40a1670 0x7f0ad40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.188+0000 7f0aeaffd700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0ad40a1670 0x7f0ad40a3b30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00b2e0 tx=0x7f0adc005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:59.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.191+0000 7f0ad3fff700 1 -- 172.21.15.59:0/1167968767 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0ae4095f70 con 0x7f0aec106640 2023-10-08T12:48:59.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 990135 13.43 MB/sec execute 270 sec latency 76.558 ms 2023-10-08T12:48:59.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.530+0000 7f0af17ff700 1 -- 172.21.15.59:0/1167968767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0aec074070 con 0x7f0aec106640 2023-10-08T12:48:59.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.531+0000 7f0ad3fff700 1 -- 172.21.15.59:0/1167968767 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f0ae4099590 con 0x7f0aec106640 2023-10-08T12:48:59.532 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:48:59.532 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:48:59.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.533+0000 7f0af17ff700 1 -- 172.21.15.59:0/1167968767 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0ad40a1670 msgr2=0x7f0ad40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.533+0000 7f0af17ff700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0ad40a1670 0x7f0ad40a3b30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00b2e0 tx=0x7f0adc005fd0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.533+0000 7f0af17ff700 1 -- 172.21.15.59:0/1167968767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec106640 msgr2=0x7f0aec073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.533+0000 7f0af17ff700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec106640 0x7f0aec073570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400efc0 tx=0x7f0ae400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.533+0000 7f0af17ff700 1 -- 172.21.15.59:0/1167968767 shutdown_connections 2023-10-08T12:48:59.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.533+0000 7f0af17ff700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0ad40a1670 0x7f0ad40a3b30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.533+0000 7f0af17ff700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec106640 0x7f0aec073570 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.533+0000 7f0af17ff700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aec100630 0x7f0aec072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.533+0000 7f0af17ff700 1 --2- 172.21.15.59:0/1167968767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec100ff0 0x7f0aec073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.533+0000 7f0af17ff700 1 -- 172.21.15.59:0/1167968767 >> 172.21.15.59:0/1167968767 conn(0x7f0aec0fc1a0 msgr2=0x7f0aec0fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:59.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.533+0000 7f0af17ff700 1 -- 172.21.15.59:0/1167968767 shutdown_connections 2023-10-08T12:48:59.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.534+0000 7f0af17ff700 1 -- 172.21.15.59:0/1167968767 wait complete. 2023-10-08T12:48:59.536 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:48:59.555 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:48:59.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.762+0000 7f814efff700 1 -- 172.21.15.59:0/2103057276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8148101100 msgr2=0x7f814810d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.762+0000 7f814efff700 1 --2- 172.21.15.59:0/2103057276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8148101100 0x7f814810d610 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f814000b0a0 tx=0x7f814000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.763+0000 7f814efff700 1 -- 172.21.15.59:0/2103057276 shutdown_connections 2023-10-08T12:48:59.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.763+0000 7f814efff700 1 --2- 172.21.15.59:0/2103057276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8148101100 0x7f814810d610 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.763+0000 7f814efff700 1 --2- 172.21.15.59:0/2103057276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8148106750 0x7f8148106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.763+0000 7f814efff700 1 --2- 172.21.15.59:0/2103057276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8148100740 0x7f8148100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.763+0000 7f814efff700 1 -- 172.21.15.59:0/2103057276 >> 172.21.15.59:0/2103057276 conn(0x7f81480fc230 msgr2=0x7f81480fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:59.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.763+0000 7f814efff700 1 -- 172.21.15.59:0/2103057276 shutdown_connections 2023-10-08T12:48:59.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.763+0000 7f814efff700 1 -- 172.21.15.59:0/2103057276 wait complete. 2023-10-08T12:48:59.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.764+0000 7f814efff700 1 Processor -- start 2023-10-08T12:48:59.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.764+0000 7f814efff700 1 -- start start 2023-10-08T12:48:59.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.765+0000 7f814efff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8148100740 0x7f814819ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.765+0000 7f814efff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8148101100 0x7f814819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.765+0000 7f814efff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8148106750 0x7f8148198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.765+0000 7f814efff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81481992e0 con 0x7f8148100740 2023-10-08T12:48:59.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.765+0000 7f814efff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148199450 con 0x7f8148106750 2023-10-08T12:48:59.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.765+0000 7f814efff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148199610 con 0x7f8148101100 2023-10-08T12:48:59.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.765+0000 7f813ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8148101100 0x7f814819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.765+0000 7f814d59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8148106750 0x7f8148198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.765+0000 7f813ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8148101100 0x7f814819efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34722/0 (socket says 172.21.15.59:34722) 2023-10-08T12:48:59.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.765+0000 7f813ffff700 1 -- 172.21.15.59:0/2920090194 learned_addr learned my addr 172.21.15.59:0/2920090194 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:59.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.765+0000 7f814cd9b700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8148100740 0x7f814819ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f814d59c700 1 -- 172.21.15.59:0/2920090194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8148101100 msgr2=0x7f814819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f814d59c700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8148101100 0x7f814819efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f814d59c700 1 -- 172.21.15.59:0/2920090194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8148100740 msgr2=0x7f814819ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f814d59c700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8148100740 0x7f814819ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f814d59c700 1 -- 172.21.15.59:0/2920090194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8140009d00 con 0x7f8148106750 2023-10-08T12:48:59.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f813ffff700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8148101100 0x7f814819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:59.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f814d59c700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8148106750 0x7f8148198b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f814000b070 tx=0x7f81400077f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:59.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f813dffb700 1 -- 172.21.15.59:0/2920090194 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000e040 con 0x7f8148106750 2023-10-08T12:48:59.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f813dffb700 1 -- 172.21.15.59:0/2920090194 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8140004e60 con 0x7f8148106750 2023-10-08T12:48:59.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f813dffb700 1 -- 172.21.15.59:0/2920090194 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140005040 con 0x7f8148106750 2023-10-08T12:48:59.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f814efff700 1 -- 172.21.15.59:0/2920090194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8148199890 con 0x7f8148106750 2023-10-08T12:48:59.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.766+0000 7f814efff700 1 -- 172.21.15.59:0/2920090194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81481a59f0 con 0x7f8148106750 2023-10-08T12:48:59.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.770+0000 7f813dffb700 1 -- 172.21.15.59:0/2920090194 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f814001d470 con 0x7f8148106750 2023-10-08T12:48:59.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.771+0000 7f8162885b80 1 Processor -- start 2023-10-08T12:48:59.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.771+0000 7f8162885b80 1 -- start start 2023-10-08T12:48:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f8162885b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 0x5622d0657260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f8162885b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 0x5622d0662110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f8162885b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0662650 0x5622d0664a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f8162885b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d05c0460 con 0x5622d0662650 2023-10-08T12:48:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f8162885b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d05b1c20 con 0x5622d06577a0 2023-10-08T12:48:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f8162885b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d05af540 con 0x5622d0656e80 2023-10-08T12:48:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f814cd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 0x5622d0662110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f813ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 0x5622d0657260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f814cd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 0x5622d0662110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49530/0 (socket says 172.21.15.59:49530) 2023-10-08T12:48:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f813ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 0x5622d0657260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34738/0 (socket says 172.21.15.59:34738) 2023-10-08T12:48:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f814cd9b700 1 -- 172.21.15.59:0/2005907434 learned_addr learned my addr 172.21.15.59:0/2005907434 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f813ffff700 1 --2- 172.21.15.59:0/2005907434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0662650 0x5622d0664a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.772+0000 7f813dffb700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81300a1670 0x7f81300a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.773+0000 7f813dffb700 1 -- 172.21.15.59:0/2920090194 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f81400ce490 con 0x7f8148106750 2023-10-08T12:48:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.773+0000 7f814d59c700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81300a1670 0x7f81300a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.773+0000 7f813ffff700 1 -- 172.21.15.59:0/2005907434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 msgr2=0x5622d0662110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.773+0000 7f813ffff700 1 --2- 172.21.15.59:0/2005907434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 0x5622d0662110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.773+0000 7f813ffff700 1 -- 172.21.15.59:0/2005907434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0662650 msgr2=0x5622d0664a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.773+0000 7f813ffff700 1 --2- 172.21.15.59:0/2005907434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0662650 0x5622d0664a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.773+0000 7f813ffff700 1 -- 172.21.15.59:0/2005907434 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622d03d5de0 con 0x5622d0656e80 2023-10-08T12:48:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.773+0000 7f814cd9b700 1 --2- 172.21.15.59:0/2005907434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 0x5622d0662110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.773+0000 7f813ffff700 1 --2- 172.21.15.59:0/2005907434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 0x5622d0657260 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f814819a310 tx=0x7f81380095e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41869e7b54040a5d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.774+0000 7f812effd700 1 -- 172.21.15.59:0/2005907434 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138004230 con 0x5622d0656e80 2023-10-08T12:48:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.774+0000 7f812effd700 1 -- 172.21.15.59:0/2005907434 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8138024030 con 0x5622d0656e80 2023-10-08T12:48:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.774+0000 7f814d59c700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81300a1670 0x7f81300a3b30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f814009b1f0 tx=0x7f81400099e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:59.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.774+0000 7f812effd700 1 -- 172.21.15.59:0/2005907434 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138004b20 con 0x5622d0656e80 2023-10-08T12:48:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.774+0000 7f8162885b80 1 -- 172.21.15.59:0/2005907434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 msgr2=0x5622d0657260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.774+0000 7f8162885b80 1 --2- 172.21.15.59:0/2005907434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 0x5622d0657260 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f814819a310 tx=0x7f81380095e0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.775+0000 7f8162885b80 1 -- 172.21.15.59:0/2005907434 shutdown_connections 2023-10-08T12:48:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.775+0000 7f8162885b80 1 --2- 172.21.15.59:0/2005907434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0662650 0x5622d0664a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.775+0000 7f8162885b80 1 --2- 172.21.15.59:0/2005907434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 0x5622d0657260 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.775+0000 7f8162885b80 1 --2- 172.21.15.59:0/2005907434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 0x5622d0662110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.775+0000 7f8162885b80 1 -- 172.21.15.59:0/2005907434 >> 172.21.15.59:0/2005907434 conn(0x5622d05cc260 msgr2=0x5622d06532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.775+0000 7f8162885b80 1 -- 172.21.15.59:0/2005907434 shutdown_connections 2023-10-08T12:48:59.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.775+0000 7f8162885b80 1 -- 172.21.15.59:0/2005907434 wait complete. 2023-10-08T12:48:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.775+0000 7f8162885b80 1 -- start start 2023-10-08T12:48:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.776+0000 7f8162885b80 1 Processor -- start 2023-10-08T12:48:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.776+0000 7f8162885b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0656e80 0x5622d0662030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.776+0000 7f8162885b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 0x5622d065f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.776+0000 7f8162885b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0662650 0x5622d065f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.776+0000 7f8162885b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d05aae30 con 0x5622d06577a0 2023-10-08T12:48:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.776+0000 7f8162885b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d0547710 con 0x5622d0656e80 2023-10-08T12:48:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.776+0000 7f8162885b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d05473b0 con 0x5622d0662650 2023-10-08T12:48:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.776+0000 7f8162885b80 10 client.0 _ll_register_callbacks cb 0x5622d03a4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.776+0000 7f813ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0656e80 0x5622d0662030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.776+0000 7f813ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0656e80 0x5622d0662030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49534/0 (socket says 172.21.15.59:49534) 2023-10-08T12:48:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.776+0000 7f813ffff700 1 -- 172.21.15.59:0/3113361030 learned_addr learned my addr 172.21.15.59:0/3113361030 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.777+0000 7f814cd9b700 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 0x5622d065f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.777+0000 7f813ffff700 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0662650 0x5622d065f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.777+0000 7f813ffff700 1 -- 172.21.15.59:0/3113361030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0662650 msgr2=0x5622d065f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.777+0000 7f813ffff700 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0662650 0x5622d065f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.777+0000 7f813ffff700 1 -- 172.21.15.59:0/3113361030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 msgr2=0x5622d065f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.777+0000 7f813ffff700 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 0x5622d065f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.777+0000 7f813ffff700 1 -- 172.21.15.59:0/3113361030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8144009960 con 0x5622d0656e80 2023-10-08T12:48:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.777+0000 7f814cd9b700 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 0x5622d065f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.777+0000 7f813ffff700 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0656e80 0x5622d0662030 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f81380096b0 tx=0x7f8138009810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f87e5dee7e9c0378 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.777+0000 7f8127fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:48:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8127fff700 1 -- 172.21.15.59:0/3113361030 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813801e2d0 con 0x5622d0656e80 2023-10-08T12:48:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8127fff700 1 -- 172.21.15.59:0/3113361030 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f8138034060 con 0x5622d0656e80 2023-10-08T12:48:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8162885b80 1 -- 172.21.15.59:0/3113361030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622d0572eb0 con 0x5622d0656e80 2023-10-08T12:48:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8127fff700 1 -- 172.21.15.59:0/3113361030 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f813801e430 con 0x5622d0656e80 2023-10-08T12:48:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8162885b80 10 client.26531 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8162885b80 1 -- 172.21.15.59:0/3113361030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f8138011440 con 0x5622d0656e80 2023-10-08T12:48:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8127fff700 1 -- 172.21.15.59:0/3113361030 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5622d0572eb0 con 0x5622d0656e80 2023-10-08T12:48:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8127fff700 1 -- 172.21.15.59:0/3113361030 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f813802a480 con 0x5622d0656e80 2023-10-08T12:48:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8162885b80 10 client.26531 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8162885b80 10 client.26531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8162885b80 20 client.26531 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8162885b80 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622d0671f90 0x5622d06743b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8162885b80 4 client.26531 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:48:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.778+0000 7f8162885b80 1 -- 172.21.15.59:0/3113361030 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622d05a3e10 con 0x5622d0671f90 2023-10-08T12:48:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.779+0000 7f814cd9b700 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622d0671f90 0x5622d06743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.779+0000 7f814cd9b700 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622d0671f90 0x5622d06743b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=676acf1f8cdeafee server_cookie=ffc306aabacd46ea in_seq=0 out_seq=0 2023-10-08T12:48:59.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.779+0000 7f8127fff700 10 client.26531 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:59.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8127fff700 1 -- 172.21.15.59:0/3113361030 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5622d05a3e10 con 0x5622d0671f90 2023-10-08T12:48:59.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8127fff700 10 client.26531 handle_command_reply: tid=0 2023-10-08T12:48:59.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 1 client.26531 shutdown 2023-10-08T12:48:59.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 1 -- 172.21.15.59:0/3113361030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0656e80 msgr2=0x5622d0662030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0656e80 0x5622d0662030 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f81380096b0 tx=0x7f8138009810 comp rx=0 tx=0).stop 2023-10-08T12:48:59.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 1 -- 172.21.15.59:0/3113361030 shutdown_connections 2023-10-08T12:48:59.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622d0671f90 0x5622d06743b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0656e80 0x5622d0662030 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0662650 0x5622d065f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 1 --2- 172.21.15.59:0/3113361030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 0x5622d065f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8127fff700 0 client.26531 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 1 -- 172.21.15.59:0/3113361030 >> 172.21.15.59:0/3113361030 conn(0x5622d05cc260 msgr2=0x5622d0652ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 1 -- 172.21.15.59:0/3113361030 shutdown_connections 2023-10-08T12:48:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 1 -- 172.21.15.59:0/3113361030 wait complete. 2023-10-08T12:48:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.781+0000 7f8162885b80 20 client.26531 trim_cache size 0 max 16384 2023-10-08T12:48:59.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.795+0000 7f8162885b80 1 Processor -- start 2023-10-08T12:48:59.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.795+0000 7f8162885b80 1 -- start start 2023-10-08T12:48:59.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.795+0000 7f8162885b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0656e80 0x5622d065ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.795+0000 7f8162885b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 0x5622d0669140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.795+0000 7f8162885b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0662650 0x5622d065a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.795+0000 7f8162885b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d042b920 con 0x5622d0656e80 2023-10-08T12:48:59.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.795+0000 7f8162885b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d0657dd0 con 0x5622d06577a0 2023-10-08T12:48:59.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.795+0000 7f8162885b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d065f190 con 0x5622d0662650 2023-10-08T12:48:59.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f813ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0656e80 0x5622d065ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f814cd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 0x5622d0669140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f813ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0656e80 0x5622d065ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59764/0 (socket says 172.21.15.59:59764) 2023-10-08T12:48:59.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f813ffff700 1 -- 172.21.15.59:0/344003745 learned_addr learned my addr 172.21.15.59:0/344003745 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:59.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f813ffff700 1 --2- 172.21.15.59:0/344003745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0662650 0x5622d065a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f813ffff700 1 -- 172.21.15.59:0/344003745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0662650 msgr2=0x5622d065a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:59.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f813ffff700 1 --2- 172.21.15.59:0/344003745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0662650 0x5622d065a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f813ffff700 1 -- 172.21.15.59:0/344003745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 msgr2=0x5622d0669140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:59.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f813ffff700 1 --2- 172.21.15.59:0/344003745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 0x5622d0669140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f813ffff700 1 -- 172.21.15.59:0/344003745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622d03bec60 con 0x5622d0656e80 2023-10-08T12:48:59.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f814cd9b700 1 --2- 172.21.15.59:0/344003745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 0x5622d0669140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.796+0000 7f813ffff700 1 --2- 172.21.15.59:0/344003745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0656e80 0x5622d065ec50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8138009680 tx=0x7f813801e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa458adece56886 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f812f7fe700 1 -- 172.21.15.59:0/344003745 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813802ad70 con 0x5622d0656e80 2023-10-08T12:48:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f812f7fe700 1 -- 172.21.15.59:0/344003745 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8138033020 con 0x5622d0656e80 2023-10-08T12:48:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f812f7fe700 1 -- 172.21.15.59:0/344003745 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813802c760 con 0x5622d0656e80 2023-10-08T12:48:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f8162885b80 1 -- 172.21.15.59:0/344003745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0656e80 msgr2=0x5622d065ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f8162885b80 1 --2- 172.21.15.59:0/344003745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0656e80 0x5622d065ec50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8138009680 tx=0x7f813801e8f0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f8162885b80 1 -- 172.21.15.59:0/344003745 shutdown_connections 2023-10-08T12:48:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f8162885b80 1 --2- 172.21.15.59:0/344003745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0662650 0x5622d065a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f8162885b80 1 --2- 172.21.15.59:0/344003745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d0656e80 0x5622d065ec50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f8162885b80 1 --2- 172.21.15.59:0/344003745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d06577a0 0x5622d0669140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f8162885b80 1 -- 172.21.15.59:0/344003745 >> 172.21.15.59:0/344003745 conn(0x5622d05cc260 msgr2=0x5622d06524d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f8162885b80 1 -- 172.21.15.59:0/344003745 shutdown_connections 2023-10-08T12:48:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.797+0000 7f8162885b80 1 -- 172.21.15.59:0/344003745 wait complete. 2023-10-08T12:48:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.798+0000 7f8162885b80 1 -- start start 2023-10-08T12:48:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.798+0000 7f8162885b80 1 Processor -- start 2023-10-08T12:48:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f8162885b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 0x5622d06670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f8162885b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 0x5622d06675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f8162885b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0662650 0x5622d06c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f8162885b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d06c5300 con 0x5622d06577a0 2023-10-08T12:48:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f8162885b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d06c5440 con 0x5622d0662650 2023-10-08T12:48:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f8162885b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d06c5580 con 0x5622d0656e80 2023-10-08T12:48:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f8162885b80 10 client.0 _ll_register_callbacks cb 0x7f8138011660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f813ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 0x5622d06670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f813ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 0x5622d06670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34756/0 (socket says 172.21.15.59:34756) 2023-10-08T12:48:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f814cd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 0x5622d06675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f813ffff700 1 -- 172.21.15.59:0/911282533 learned_addr learned my addr 172.21.15.59:0/911282533 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:48:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f813ffff700 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0662650 0x5622d06c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f814cd9b700 1 -- 172.21.15.59:0/911282533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 msgr2=0x5622d06670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f814cd9b700 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 0x5622d06670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f814cd9b700 1 -- 172.21.15.59:0/911282533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0662650 msgr2=0x5622d06c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f814cd9b700 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0662650 0x5622d06c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.799+0000 7f814cd9b700 1 -- 172.21.15.59:0/911282533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814401fa60 con 0x5622d06577a0 2023-10-08T12:48:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.800+0000 7f814cd9b700 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 0x5622d06675f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x5622d0674cc0 tx=0x7f8144003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c81b2025b96842e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.800+0000 7f8127fff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:48:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.800+0000 7f8127fff700 1 -- 172.21.15.59:0/911282533 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8144016070 con 0x5622d06577a0 2023-10-08T12:48:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.800+0000 7f8162885b80 1 -- 172.21.15.59:0/911282533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8138024030 con 0x5622d06577a0 2023-10-08T12:48:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.800+0000 7f8127fff700 1 -- 172.21.15.59:0/911282533 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f814401f240 con 0x5622d06577a0 2023-10-08T12:48:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.800+0000 7f8127fff700 1 -- 172.21.15.59:0/911282533 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8144003f20 con 0x5622d06577a0 2023-10-08T12:48:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.800+0000 7f8162885b80 10 client.16527 fetch_fsmap learned FSMap version 20 2023-10-08T12:48:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.800+0000 7f8162885b80 1 -- 172.21.15.59:0/911282533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f8138011440 con 0x5622d06577a0 2023-10-08T12:48:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.800+0000 7f8127fff700 1 -- 172.21.15.59:0/911282533 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8138024030 con 0x5622d06577a0 2023-10-08T12:48:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f8127fff700 1 -- 172.21.15.59:0/911282533 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8144010430 con 0x5622d06577a0 2023-10-08T12:48:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f8162885b80 10 client.16527 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:48:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f8162885b80 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f8162885b80 20 client.16527 populate_metadata read hostname 'smithi059' 2023-10-08T12:48:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f8162885b80 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622d06c6d50 0x5622d06c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f8162885b80 4 client.16527 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:48:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f8162885b80 1 -- 172.21.15.59:0/911282533 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5622d05a3b30 con 0x5622d06c6d50 2023-10-08T12:48:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f813ffff700 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622d06c6d50 0x5622d06c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f813ffff700 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622d06c6d50 0x5622d06c9170 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58fb634edc7d83b5 server_cookie=3cdd040330f1b53e in_seq=0 out_seq=0 2023-10-08T12:48:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f8127fff700 10 client.16527 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f8127fff700 1 -- 172.21.15.59:0/911282533 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5622d05a3b30 con 0x5622d06c6d50 2023-10-08T12:48:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f8127fff700 10 client.16527 handle_command_reply: tid=0 2023-10-08T12:48:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.801+0000 7f8162885b80 1 client.16527 shutdown 2023-10-08T12:48:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8162885b80 1 -- 172.21.15.59:0/911282533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 msgr2=0x5622d06675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8162885b80 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 0x5622d06675f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x5622d0674cc0 tx=0x7f8144003960 comp rx=0 tx=0).stop 2023-10-08T12:48:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8162885b80 1 -- 172.21.15.59:0/911282533 shutdown_connections 2023-10-08T12:48:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8162885b80 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5622d06c6d50 0x5622d06c9170 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8162885b80 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5622d0662650 0x5622d06c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8162885b80 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622d0656e80 0x5622d06670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8127fff700 0 client.16527 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:48:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8162885b80 1 --2- 172.21.15.59:0/911282533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d06577a0 0x5622d06675f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8162885b80 1 -- 172.21.15.59:0/911282533 >> 172.21.15.59:0/911282533 conn(0x5622d05cc260 msgr2=0x5622d065a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8162885b80 1 -- 172.21.15.59:0/911282533 shutdown_connections 2023-10-08T12:48:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8162885b80 1 -- 172.21.15.59:0/911282533 wait complete. 2023-10-08T12:48:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.802+0000 7f8162885b80 20 client.16527 trim_cache size 0 max 16384 2023-10-08T12:48:59.809 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:48:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 -- 172.21.15.59:0/2920090194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81300a1670 msgr2=0x7f81300a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81300a1670 0x7f81300a3b30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f814009b1f0 tx=0x7f81400099e0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 -- 172.21.15.59:0/2920090194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8148106750 msgr2=0x7f8148198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8148106750 0x7f8148198b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f814000b070 tx=0x7f81400077f0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 -- 172.21.15.59:0/2920090194 shutdown_connections 2023-10-08T12:48:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f81300a1670 0x7f81300a3b30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8148106750 0x7f8148198b10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8148100740 0x7f814819ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 --2- 172.21.15.59:0/2920090194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8148101100 0x7f814819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 -- 172.21.15.59:0/2920090194 >> 172.21.15.59:0/2920090194 conn(0x7f81480fc230 msgr2=0x7f814810bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 -- 172.21.15.59:0/2920090194 shutdown_connections 2023-10-08T12:48:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:48:59.803+0000 7f814efff700 1 -- 172.21.15.59:0/2920090194 wait complete. 2023-10-08T12:49:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:59 smithi092 ceph-mon[134093]: pgmap v550: 97 pgs: 97 active+clean; 521 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 233 op/s 2023-10-08T12:49:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:48:59 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1167968767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:49:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:59 smithi173 ceph-mon[135182]: pgmap v550: 97 pgs: 97 active+clean; 521 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 233 op/s 2023-10-08T12:49:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:48:59 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1167968767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:49:00.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:59 smithi059 ceph-mon[98489]: pgmap v550: 97 pgs: 97 active+clean; 521 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 233 op/s 2023-10-08T12:49:00.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:48:59 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1167968767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:49:00.523 INFO:tasks.workunit.client.0.smithi059.stdout: 1 992134 13.43 MB/sec execute 271 sec latency 28.685 ms 2023-10-08T12:49:00.823 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:49:00.824 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:49:01.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.048+0000 7fca879ff700 1 -- 172.21.15.59:0/4278573043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca801010f0 msgr2=0x7fca8010d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.048+0000 7fca879ff700 1 --2- 172.21.15.59:0/4278573043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca801010f0 0x7fca8010d600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fca7800b0a0 tx=0x7fca7800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.048+0000 7fca879ff700 1 -- 172.21.15.59:0/4278573043 shutdown_connections 2023-10-08T12:49:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.048+0000 7fca879ff700 1 --2- 172.21.15.59:0/4278573043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca801010f0 0x7fca8010d600 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.048+0000 7fca879ff700 1 --2- 172.21.15.59:0/4278573043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca80106740 0x7fca80106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.048+0000 7fca879ff700 1 --2- 172.21.15.59:0/4278573043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca80100730 0x7fca80100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.048+0000 7fca879ff700 1 -- 172.21.15.59:0/4278573043 >> 172.21.15.59:0/4278573043 conn(0x7fca800fc200 msgr2=0x7fca800fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.048+0000 7fca879ff700 1 -- 172.21.15.59:0/4278573043 shutdown_connections 2023-10-08T12:49:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.048+0000 7fca879ff700 1 -- 172.21.15.59:0/4278573043 wait complete. 2023-10-08T12:49:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.049+0000 7fca879ff700 1 Processor -- start 2023-10-08T12:49:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.049+0000 7fca879ff700 1 -- start start 2023-10-08T12:49:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.050+0000 7fca879ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca80100730 0x7fca80198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.050+0000 7fca879ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca801010f0 0x7fca801992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.050+0000 7fca879ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca80106740 0x7fca8019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.050+0000 7fca879ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8019cb40 con 0x7fca80100730 2023-10-08T12:49:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.050+0000 7fca879ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8019ccb0 con 0x7fca80106740 2023-10-08T12:49:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.050+0000 7fca879ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8019ce70 con 0x7fca801010f0 2023-10-08T12:49:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.050+0000 7fca8579b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca80100730 0x7fca80198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.050+0000 7fca84f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca801010f0 0x7fca801992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.050+0000 7fca84f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca801010f0 0x7fca801992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41948/0 (socket says 172.21.15.59:41948) 2023-10-08T12:49:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.050+0000 7fca84f9a700 1 -- 172.21.15.59:0/2962110559 learned_addr learned my addr 172.21.15.59:0/2962110559 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.050+0000 7fca85f9c700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca80106740 0x7fca8019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.051+0000 7fca84f9a700 1 -- 172.21.15.59:0/2962110559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca80106740 msgr2=0x7fca8019c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.051+0000 7fca84f9a700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca80106740 0x7fca8019c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.051+0000 7fca84f9a700 1 -- 172.21.15.59:0/2962110559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca80100730 msgr2=0x7fca80198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.051+0000 7fca84f9a700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca80100730 0x7fca80198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.051+0000 7fca84f9a700 1 -- 172.21.15.59:0/2962110559 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78009d00 con 0x7fca801010f0 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.051+0000 7fca85f9c700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca80106740 0x7fca8019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.051+0000 7fca84f9a700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca801010f0 0x7fca801992a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fca7000e9a0 tx=0x7fca7000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.051+0000 7fca767fc700 1 -- 172.21.15.59:0/2962110559 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70009790 con 0x7fca801010f0 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.051+0000 7fca767fc700 1 -- 172.21.15.59:0/2962110559 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca7000cbd0 con 0x7fca801010f0 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.051+0000 7fca879ff700 1 -- 172.21.15.59:0/2962110559 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8019d150 con 0x7fca801010f0 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.051+0000 7fca767fc700 1 -- 172.21.15.59:0/2962110559 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70018680 con 0x7fca801010f0 2023-10-08T12:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.052+0000 7fca879ff700 1 -- 172.21.15.59:0/2962110559 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca801a5ab0 con 0x7fca801010f0 2023-10-08T12:49:01.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.056+0000 7fca767fc700 1 -- 172.21.15.59:0/2962110559 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fca7000cd40 con 0x7fca801010f0 2023-10-08T12:49:01.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.057+0000 7fca9b286b80 1 Processor -- start 2023-10-08T12:49:01.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.058+0000 7fca9b286b80 1 -- start start 2023-10-08T12:49:01.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.058+0000 7fca767fc700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca6c0a15f0 0x7fca6c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.058+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f39f00 0x557f34f3a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.058+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 0x557f34f45190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.058+0000 7fca767fc700 1 -- 172.21.15.59:0/2962110559 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fca70014070 con 0x7fca801010f0 2023-10-08T12:49:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.058+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f456d0 0x557f34f47ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.058+0000 7fca9b286b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34ea34e0 con 0x557f34f3a820 2023-10-08T12:49:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.058+0000 7fca9b286b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34e94ca0 con 0x557f34f456d0 2023-10-08T12:49:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.058+0000 7fca9b286b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34e925c0 con 0x557f34f39f00 2023-10-08T12:49:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.058+0000 7fca85f9c700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca6c0a15f0 0x7fca6c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.058+0000 7fca84f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 0x557f34f45190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca85f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f456d0 0x557f34f47ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca84f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 0x557f34f45190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47466/0 (socket says 172.21.15.59:47466) 2023-10-08T12:49:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca84f9a700 1 -- 172.21.15.59:0/2404538482 learned_addr learned my addr 172.21.15.59:0/2404538482 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca8579b700 1 --2- 172.21.15.59:0/2404538482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f39f00 0x557f34f3a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca84f9a700 1 -- 172.21.15.59:0/2404538482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f39f00 msgr2=0x557f34f3a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca84f9a700 1 --2- 172.21.15.59:0/2404538482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f39f00 0x557f34f3a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca84f9a700 1 -- 172.21.15.59:0/2404538482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f456d0 msgr2=0x557f34f47ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca84f9a700 1 --2- 172.21.15.59:0/2404538482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f456d0 0x557f34f47ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca84f9a700 1 -- 172.21.15.59:0/2404538482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f34cb8e60 con 0x557f34f3a820 2023-10-08T12:49:01.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca84f9a700 1 --2- 172.21.15.59:0/2404538482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 0x557f34f45190 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fca70096e00 tx=0x7fca70099cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7509c5b5d53203d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca85f9c700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca6c0a15f0 0x7fca6c0a3ab0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fca780062a0 tx=0x7fca78007c80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca6b7fe700 1 -- 172.21.15.59:0/2404538482 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7009a390 con 0x557f34f3a820 2023-10-08T12:49:01.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca6b7fe700 1 -- 172.21.15.59:0/2404538482 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca7009e4e0 con 0x557f34f3a820 2023-10-08T12:49:01.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.059+0000 7fca6b7fe700 1 -- 172.21.15.59:0/2404538482 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70099880 con 0x557f34f3a820 2023-10-08T12:49:01.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.060+0000 7fca9b286b80 1 -- 172.21.15.59:0/2404538482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 msgr2=0x557f34f45190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.060+0000 7fca9b286b80 1 --2- 172.21.15.59:0/2404538482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 0x557f34f45190 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fca70096e00 tx=0x7fca70099cf0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.060+0000 7fca9b286b80 1 -- 172.21.15.59:0/2404538482 shutdown_connections 2023-10-08T12:49:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.060+0000 7fca9b286b80 1 --2- 172.21.15.59:0/2404538482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f456d0 0x557f34f47ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.060+0000 7fca9b286b80 1 --2- 172.21.15.59:0/2404538482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f39f00 0x557f34f3a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.060+0000 7fca9b286b80 1 --2- 172.21.15.59:0/2404538482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 0x557f34f45190 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.060+0000 7fca9b286b80 1 -- 172.21.15.59:0/2404538482 >> 172.21.15.59:0/2404538482 conn(0x557f34eaf2e0 msgr2=0x557f34f36350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.060+0000 7fca9b286b80 1 -- 172.21.15.59:0/2404538482 shutdown_connections 2023-10-08T12:49:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.060+0000 7fca9b286b80 1 -- 172.21.15.59:0/2404538482 wait complete. 2023-10-08T12:49:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.061+0000 7fca9b286b80 1 -- start start 2023-10-08T12:49:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.061+0000 7fca9b286b80 1 Processor -- start 2023-10-08T12:49:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 0x557f34f450f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 0x557f34f423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f42a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca9b286b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34e8deb0 con 0x557f34f39f00 2023-10-08T12:49:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca9b286b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34e2a790 con 0x557f34f3a820 2023-10-08T12:49:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca9b286b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34e2a430 con 0x557f34f456d0 2023-10-08T12:49:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca9b286b80 10 client.0 _ll_register_callbacks cb 0x557f34c87880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca8579b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 0x557f34f450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca84f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 0x557f34f423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca85f9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f42a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca8579b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 0x557f34f450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47472/0 (socket says 172.21.15.59:47472) 2023-10-08T12:49:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca8579b700 1 -- 172.21.15.59:0/1811384409 learned_addr learned my addr 172.21.15.59:0/1811384409 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca85f9c700 1 -- 172.21.15.59:0/1811384409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 msgr2=0x557f34f423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca85f9c700 1 --2- 172.21.15.59:0/1811384409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 0x557f34f423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca85f9c700 1 -- 172.21.15.59:0/1811384409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 msgr2=0x557f34f450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca85f9c700 1 --2- 172.21.15.59:0/1811384409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 0x557f34f450f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.062+0000 7fca85f9c700 1 -- 172.21.15.59:0/1811384409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca801a5ab0 con 0x557f34f456d0 2023-10-08T12:49:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.063+0000 7fca85f9c700 1 --2- 172.21.15.59:0/1811384409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f42a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fca7800b780 tx=0x7fca7800b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=799d5931ac222372 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.063+0000 7fca68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:49:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.063+0000 7fca68ff9700 1 -- 172.21.15.59:0/1811384409 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800e070 con 0x557f34f456d0 2023-10-08T12:49:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.063+0000 7fca9b286b80 1 -- 172.21.15.59:0/1811384409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f34e55f30 con 0x557f34f456d0 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.063+0000 7fca68ff9700 1 -- 172.21.15.59:0/1811384409 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fca78020860 con 0x557f34f456d0 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.063+0000 7fca68ff9700 1 -- 172.21.15.59:0/1811384409 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca78020a20 con 0x557f34f456d0 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.063+0000 7fca9b286b80 10 client.26539 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.063+0000 7fca9b286b80 1 -- 172.21.15.59:0/1811384409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x557f34ca1ce0 con 0x557f34f456d0 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.063+0000 7fca68ff9700 1 -- 172.21.15.59:0/1811384409 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca78039020 con 0x557f34f456d0 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.064+0000 7fca68ff9700 1 -- 172.21.15.59:0/1811384409 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fca78019040 con 0x557f34f456d0 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.064+0000 7fca9b286b80 10 client.26539 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.064+0000 7fca9b286b80 10 client.26539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.064+0000 7fca9b286b80 20 client.26539 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.064+0000 7fca9b286b80 1 --2- 172.21.15.59:0/1811384409 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557f34f55140 0x557f34f57530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.064+0000 7fca9b286b80 4 client.26539 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:49:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.064+0000 7fca9b286b80 1 -- 172.21.15.59:0/1811384409 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f34e86e90 con 0x557f34f55140 2023-10-08T12:49:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.064+0000 7fca8579b700 1 --2- 172.21.15.59:0/1811384409 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557f34f55140 0x557f34f57530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.064+0000 7fca8579b700 1 --2- 172.21.15.59:0/1811384409 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557f34f55140 0x557f34f57530 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d43bdfb7fcef9a5 server_cookie=134006ff541719c1 in_seq=0 out_seq=0 2023-10-08T12:49:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.064+0000 7fca68ff9700 10 client.26539 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca68ff9700 1 -- 172.21.15.59:0/1811384409 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557f34e86e90 con 0x557f34f55140 2023-10-08T12:49:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca68ff9700 10 client.26539 handle_command_reply: tid=0 2023-10-08T12:49:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca9b286b80 1 client.26539 shutdown 2023-10-08T12:49:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca9b286b80 1 -- 172.21.15.59:0/1811384409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 msgr2=0x557f34f42a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca9b286b80 1 --2- 172.21.15.59:0/1811384409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f42a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fca7800b780 tx=0x7fca7800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca9b286b80 1 -- 172.21.15.59:0/1811384409 shutdown_connections 2023-10-08T12:49:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca9b286b80 1 --2- 172.21.15.59:0/1811384409 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557f34f55140 0x557f34f57530 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca9b286b80 1 --2- 172.21.15.59:0/1811384409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f42a10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca9b286b80 1 --2- 172.21.15.59:0/1811384409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 0x557f34f450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca68ff9700 0 client.26539 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca9b286b80 1 --2- 172.21.15.59:0/1811384409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 0x557f34f423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.066+0000 7fca9b286b80 1 -- 172.21.15.59:0/1811384409 >> 172.21.15.59:0/1811384409 conn(0x557f34eaf2e0 msgr2=0x557f34f35f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.067+0000 7fca9b286b80 1 -- 172.21.15.59:0/1811384409 shutdown_connections 2023-10-08T12:49:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.067+0000 7fca9b286b80 1 -- 172.21.15.59:0/1811384409 wait complete. 2023-10-08T12:49:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.067+0000 7fca9b286b80 20 client.26539 trim_cache size 0 max 16384 2023-10-08T12:49:01.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.086+0000 7fca9b286b80 1 Processor -- start 2023-10-08T12:49:01.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.086+0000 7fca9b286b80 1 -- start start 2023-10-08T12:49:01.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.086+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 0x557f34f4c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.086+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 0x557f34f35ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.086+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f36220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.086+0000 7fca9b286b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34d0e9a0 con 0x557f34f39f00 2023-10-08T12:49:01.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.086+0000 7fca9b286b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34f30620 con 0x557f34f3a820 2023-10-08T12:49:01.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.086+0000 7fca9b286b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34f36790 con 0x557f34f456d0 2023-10-08T12:49:01.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca8579b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 0x557f34f4c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca84f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 0x557f34f35ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca84f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 0x557f34f35ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33854/0 (socket says 172.21.15.59:33854) 2023-10-08T12:49:01.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca8579b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 0x557f34f4c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47482/0 (socket says 172.21.15.59:47482) 2023-10-08T12:49:01.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca84f9a700 1 -- 172.21.15.59:0/3109283415 learned_addr learned my addr 172.21.15.59:0/3109283415 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:01.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca85f9c700 1 --2- 172.21.15.59:0/3109283415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f36220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca8579b700 1 -- 172.21.15.59:0/3109283415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 msgr2=0x557f34f36220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca8579b700 1 --2- 172.21.15.59:0/3109283415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f36220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca8579b700 1 -- 172.21.15.59:0/3109283415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 msgr2=0x557f34f35ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca8579b700 1 --2- 172.21.15.59:0/3109283415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 0x557f34f35ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca8579b700 1 -- 172.21.15.59:0/3109283415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f34cdf2d0 con 0x557f34f39f00 2023-10-08T12:49:01.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca84f9a700 1 --2- 172.21.15.59:0/3109283415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 0x557f34f35ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:01.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.087+0000 7fca8579b700 1 --2- 172.21.15.59:0/3109283415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 0x557f34f4c220 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x557f34f431a0 tx=0x7fca7c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439ff766e7d84317 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.088+0000 7fca6bfff700 1 -- 172.21.15.59:0/3109283415 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c004400 con 0x557f34f39f00 2023-10-08T12:49:01.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.088+0000 7fca6bfff700 1 -- 172.21.15.59:0/3109283415 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca7c023030 con 0x557f34f39f00 2023-10-08T12:49:01.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.088+0000 7fca6bfff700 1 -- 172.21.15.59:0/3109283415 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c005280 con 0x557f34f39f00 2023-10-08T12:49:01.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.088+0000 7fca9b286b80 1 -- 172.21.15.59:0/3109283415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 msgr2=0x557f34f4c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.088+0000 7fca9b286b80 1 --2- 172.21.15.59:0/3109283415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 0x557f34f4c220 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x557f34f431a0 tx=0x7fca7c0099b0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.089+0000 7fca9b286b80 1 -- 172.21.15.59:0/3109283415 shutdown_connections 2023-10-08T12:49:01.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.089+0000 7fca9b286b80 1 --2- 172.21.15.59:0/3109283415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f36220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.089+0000 7fca9b286b80 1 --2- 172.21.15.59:0/3109283415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f39f00 0x557f34f4c220 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.089+0000 7fca9b286b80 1 --2- 172.21.15.59:0/3109283415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f3a820 0x557f34f35ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.089+0000 7fca9b286b80 1 -- 172.21.15.59:0/3109283415 >> 172.21.15.59:0/3109283415 conn(0x557f34eaf2e0 msgr2=0x557f34f40cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.089+0000 7fca9b286b80 1 -- 172.21.15.59:0/3109283415 shutdown_connections 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.089+0000 7fca9b286b80 1 -- 172.21.15.59:0/3109283415 wait complete. 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.089+0000 7fca9b286b80 1 -- start start 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.089+0000 7fca9b286b80 1 Processor -- start 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f39f00 0x557f34fa34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 0x557f34fa3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca9b286b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f9eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca9b286b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34f9f480 con 0x557f34f3a820 2023-10-08T12:49:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca9b286b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34f9f5c0 con 0x557f34f39f00 2023-10-08T12:49:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca9b286b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f34f9f780 con 0x557f34f456d0 2023-10-08T12:49:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca9b286b80 10 client.0 _ll_register_callbacks cb 0x7fca78004d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca8579b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f39f00 0x557f34fa34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca8579b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f39f00 0x557f34fa34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33870/0 (socket says 172.21.15.59:33870) 2023-10-08T12:49:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca8579b700 1 -- 172.21.15.59:0/17767640 learned_addr learned my addr 172.21.15.59:0/17767640 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca84f9a700 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 0x557f34fa3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca85f9c700 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f9eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca8579b700 1 -- 172.21.15.59:0/17767640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 msgr2=0x557f34f9eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca8579b700 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f9eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca8579b700 1 -- 172.21.15.59:0/17767640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 msgr2=0x557f34fa3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.090+0000 7fca8579b700 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 0x557f34fa3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.091+0000 7fca8579b700 1 -- 172.21.15.59:0/17767640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f34cb8e60 con 0x557f34f39f00 2023-10-08T12:49:01.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.091+0000 7fca8579b700 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f39f00 0x557f34fa34f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0097c0 tx=0x7fca7c004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6e9e3d1cf33bda4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.091+0000 7fca68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:49:01.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.091+0000 7fca68ff9700 1 -- 172.21.15.59:0/17767640 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c004950 con 0x557f34f39f00 2023-10-08T12:49:01.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.091+0000 7fca9b286b80 1 -- 172.21.15.59:0/17767640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca7009e4e0 con 0x557f34f39f00 2023-10-08T12:49:01.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.091+0000 7fca68ff9700 1 -- 172.21.15.59:0/17767640 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fca7c004ab0 con 0x557f34f39f00 2023-10-08T12:49:01.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.091+0000 7fca68ff9700 1 -- 172.21.15.59:0/17767640 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca7c01f110 con 0x557f34f39f00 2023-10-08T12:49:01.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.091+0000 7fca9b286b80 10 client.26555 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:01.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.091+0000 7fca9b286b80 1 -- 172.21.15.59:0/17767640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fca7c009c20 con 0x557f34f39f00 2023-10-08T12:49:01.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.092+0000 7fca68ff9700 1 -- 172.21.15.59:0/17767640 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca7009e4e0 con 0x557f34f39f00 2023-10-08T12:49:01.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.092+0000 7fca68ff9700 1 -- 172.21.15.59:0/17767640 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fca7c003680 con 0x557f34f39f00 2023-10-08T12:49:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.092+0000 7fca9b286b80 10 client.26555 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.092+0000 7fca9b286b80 10 client.26555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.092+0000 7fca9b286b80 20 client.26555 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.092+0000 7fca9b286b80 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557f34fac450 0x557f34fae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.092+0000 7fca9b286b80 4 client.26555 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:49:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.092+0000 7fca9b286b80 1 -- 172.21.15.59:0/17767640 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x557f34e86bb0 con 0x557f34fac450 2023-10-08T12:49:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.092+0000 7fca84f9a700 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557f34fac450 0x557f34fae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.092+0000 7fca84f9a700 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557f34fac450 0x557f34fae870 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d9d48e12bc2e620 server_cookie=acc60bcec94cd39a in_seq=0 out_seq=0 2023-10-08T12:49:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.092+0000 7fca68ff9700 10 client.26555 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.093+0000 7fca68ff9700 1 -- 172.21.15.59:0/17767640 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557f34e86bb0 con 0x557f34fac450 2023-10-08T12:49:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.093+0000 7fca68ff9700 10 client.26555 handle_command_reply: tid=0 2023-10-08T12:49:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.093+0000 7fca9b286b80 1 client.26555 shutdown 2023-10-08T12:49:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca9b286b80 1 -- 172.21.15.59:0/17767640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f39f00 msgr2=0x557f34fa34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca9b286b80 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f39f00 0x557f34fa34f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0097c0 tx=0x7fca7c004f90 comp rx=0 tx=0).stop 2023-10-08T12:49:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca9b286b80 1 -- 172.21.15.59:0/17767640 shutdown_connections 2023-10-08T12:49:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca9b286b80 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557f34fac450 0x557f34fae870 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca9b286b80 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f34f39f00 0x557f34fa34f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca9b286b80 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f34f456d0 0x557f34f9eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca68ff9700 0 client.26555 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:01.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca9b286b80 1 --2- 172.21.15.59:0/17767640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f34f3a820 0x557f34fa3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca9b286b80 1 -- 172.21.15.59:0/17767640 >> 172.21.15.59:0/17767640 conn(0x557f34eaf2e0 msgr2=0x557f34f40c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca9b286b80 1 -- 172.21.15.59:0/17767640 shutdown_connections 2023-10-08T12:49:01.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca9b286b80 1 -- 172.21.15.59:0/17767640 wait complete. 2023-10-08T12:49:01.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.094+0000 7fca9b286b80 20 client.26555 trim_cache size 0 max 16384 2023-10-08T12:49:01.101 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:49:01.101 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:49:01.101 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "70ff2fc3-bf27-46f8-b345-2b3883e68970", 2023-10-08T12:49:01.101 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:49:01.102 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:49:01.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 -- 172.21.15.59:0/2962110559 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca6c0a15f0 msgr2=0x7fca6c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca6c0a15f0 0x7fca6c0a3ab0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fca780062a0 tx=0x7fca78007c80 comp rx=0 tx=0).stop 2023-10-08T12:49:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 -- 172.21.15.59:0/2962110559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca801010f0 msgr2=0x7fca801992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca801010f0 0x7fca801992a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fca7000e9a0 tx=0x7fca7000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 -- 172.21.15.59:0/2962110559 shutdown_connections 2023-10-08T12:49:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca6c0a15f0 0x7fca6c0a3ab0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca80106740 0x7fca8019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca80100730 0x7fca80198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 --2- 172.21.15.59:0/2962110559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca801010f0 0x7fca801992a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 -- 172.21.15.59:0/2962110559 >> 172.21.15.59:0/2962110559 conn(0x7fca800fc200 msgr2=0x7fca80072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 -- 172.21.15.59:0/2962110559 shutdown_connections 2023-10-08T12:49:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.095+0000 7fca879ff700 1 -- 172.21.15.59:0/2962110559 wait complete. 2023-10-08T12:49:01.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:49:01.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.340+0000 7f5785dff700 1 -- 172.21.15.59:0/124417817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5780102860 msgr2=0x7f5780102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.340+0000 7f5785dff700 1 --2- 172.21.15.59:0/124417817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5780102860 0x7f5780102ce0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5774009990 tx=0x7f5774009ca0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.340+0000 7f5785dff700 1 -- 172.21.15.59:0/124417817 shutdown_connections 2023-10-08T12:49:01.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.340+0000 7f5785dff700 1 --2- 172.21.15.59:0/124417817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5780103220 0x7f578010f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.340+0000 7f5785dff700 1 --2- 172.21.15.59:0/124417817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5780108870 0x7f5780108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.340+0000 7f5785dff700 1 --2- 172.21.15.59:0/124417817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5780102860 0x7f5780102ce0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.340+0000 7f5785dff700 1 -- 172.21.15.59:0/124417817 >> 172.21.15.59:0/124417817 conn(0x7f57800fe330 msgr2=0x7f5780100750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.340+0000 7f5785dff700 1 -- 172.21.15.59:0/124417817 shutdown_connections 2023-10-08T12:49:01.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.340+0000 7f5785dff700 1 -- 172.21.15.59:0/124417817 wait complete. 2023-10-08T12:49:01.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.341+0000 7f5785dff700 1 Processor -- start 2023-10-08T12:49:01.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f5785dff700 1 -- start start 2023-10-08T12:49:01.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f5785dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5780102860 0x7f578019e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f5785dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5780103220 0x7f578019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f5785dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5780108870 0x7f5780198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f5785dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5780199170 con 0x7f5780102860 2023-10-08T12:49:01.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f5785dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57801992e0 con 0x7f5780103220 2023-10-08T12:49:01.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f5785dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57801994a0 con 0x7f5780108870 2023-10-08T12:49:01.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f577effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5780103220 0x7f578019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f577f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5780102860 0x7f578019e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f577effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5780103220 0x7f578019ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33902/0 (socket says 172.21.15.59:33902) 2023-10-08T12:49:01.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f577effd700 1 -- 172.21.15.59:0/836292720 learned_addr learned my addr 172.21.15.59:0/836292720 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:01.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.342+0000 7f577ffff700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5780108870 0x7f5780198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.343+0000 7f577effd700 1 -- 172.21.15.59:0/836292720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5780108870 msgr2=0x7f5780198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.343+0000 7f577effd700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5780108870 0x7f5780198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.343+0000 7f577effd700 1 -- 172.21.15.59:0/836292720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5780102860 msgr2=0x7f578019e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.343+0000 7f577effd700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5780102860 0x7f578019e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.343+0000 7f577effd700 1 -- 172.21.15.59:0/836292720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740095f0 con 0x7f5780103220 2023-10-08T12:49:01.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.343+0000 7f577effd700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5780103220 0x7f578019ef20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5774000c00 tx=0x7f5774005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.343+0000 7f577cff9700 1 -- 172.21.15.59:0/836292720 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577401d070 con 0x7f5780103220 2023-10-08T12:49:01.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.343+0000 7f577cff9700 1 -- 172.21.15.59:0/836292720 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5774022470 con 0x7f5780103220 2023-10-08T12:49:01.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.343+0000 7f577cff9700 1 -- 172.21.15.59:0/836292720 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774017650 con 0x7f5780103220 2023-10-08T12:49:01.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.343+0000 7f5785dff700 1 -- 172.21.15.59:0/836292720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5780199720 con 0x7f5780103220 2023-10-08T12:49:01.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.343+0000 7f5785dff700 1 -- 172.21.15.59:0/836292720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57801a59d0 con 0x7f5780103220 2023-10-08T12:49:01.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.347+0000 7f577cff9700 1 -- 172.21.15.59:0/836292720 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f57740225e0 con 0x7f5780103220 2023-10-08T12:49:01.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f57997ecb80 1 Processor -- start 2023-10-08T12:49:01.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f57997ecb80 1 -- start start 2023-10-08T12:49:01.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f577cff9700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57680a15e0 0x7f57680a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c87a0 0x561dfa5d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f577cff9700 1 -- 172.21.15.59:0/836292720 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f57740ce3f0 con 0x7f5780103220 2023-10-08T12:49:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5d3650 0x561dfa5d5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f57997ecb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa531460 con 0x561dfa5d3650 2023-10-08T12:49:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f57997ecb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa522c20 con 0x561dfa5c87a0 2023-10-08T12:49:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f57997ecb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa520540 con 0x561dfa5c7e80 2023-10-08T12:49:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f577f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f577ffff700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57680a15e0 0x7f57680a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.348+0000 7f577f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:42004/0 (socket says 172.21.15.59:42004) 2023-10-08T12:49:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.349+0000 7f577f7fe700 1 -- 172.21.15.59:0/3289074571 learned_addr learned my addr 172.21.15.59:0/3289074571 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:01.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.349+0000 7f577ffff700 1 --2- 172.21.15.59:0/3289074571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5d3650 0x561dfa5d5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.349+0000 7f577effd700 1 --2- 172.21.15.59:0/3289074571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c87a0 0x561dfa5d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.349+0000 7f577f7fe700 1 -- 172.21.15.59:0/3289074571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c87a0 msgr2=0x561dfa5d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.349+0000 7f577f7fe700 1 --2- 172.21.15.59:0/3289074571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c87a0 0x561dfa5d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.349+0000 7f577f7fe700 1 -- 172.21.15.59:0/3289074571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5d3650 msgr2=0x561dfa5d5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.349+0000 7f577f7fe700 1 --2- 172.21.15.59:0/3289074571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5d3650 0x561dfa5d5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.349+0000 7f577f7fe700 1 -- 172.21.15.59:0/3289074571 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dfa346de0 con 0x561dfa5c7e80 2023-10-08T12:49:01.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.349+0000 7f577f7fe700 1 --2- 172.21.15.59:0/3289074571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5c8260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5770009d30 tx=0x7f5770011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ceae8f1311b5a09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.349+0000 7f577ffff700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57680a15e0 0x7f57680a3aa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5778009ec0 tx=0x7f5778009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.350+0000 7f5765ffb700 1 -- 172.21.15.59:0/3289074571 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770004230 con 0x561dfa5c7e80 2023-10-08T12:49:01.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.350+0000 7f5765ffb700 1 -- 172.21.15.59:0/3289074571 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5770004390 con 0x561dfa5c7e80 2023-10-08T12:49:01.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.350+0000 7f5765ffb700 1 -- 172.21.15.59:0/3289074571 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770019840 con 0x561dfa5c7e80 2023-10-08T12:49:01.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.350+0000 7f57997ecb80 1 -- 172.21.15.59:0/3289074571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 msgr2=0x561dfa5c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.350+0000 7f57997ecb80 1 --2- 172.21.15.59:0/3289074571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5c8260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5770009d30 tx=0x7f5770011720 comp rx=0 tx=0).stop 2023-10-08T12:49:01.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.350+0000 7f57997ecb80 1 -- 172.21.15.59:0/3289074571 shutdown_connections 2023-10-08T12:49:01.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.350+0000 7f57997ecb80 1 --2- 172.21.15.59:0/3289074571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5d3650 0x561dfa5d5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.350+0000 7f57997ecb80 1 --2- 172.21.15.59:0/3289074571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5c8260 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.350+0000 7f57997ecb80 1 --2- 172.21.15.59:0/3289074571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c87a0 0x561dfa5d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.350+0000 7f57997ecb80 1 -- 172.21.15.59:0/3289074571 >> 172.21.15.59:0/3289074571 conn(0x561dfa53d260 msgr2=0x561dfa5c42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.351+0000 7f57997ecb80 1 -- 172.21.15.59:0/3289074571 shutdown_connections 2023-10-08T12:49:01.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.351+0000 7f57997ecb80 1 -- 172.21.15.59:0/3289074571 wait complete. 2023-10-08T12:49:01.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.351+0000 7f57997ecb80 1 -- start start 2023-10-08T12:49:01.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.351+0000 7f57997ecb80 1 Processor -- start 2023-10-08T12:49:01.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c7e80 0x561dfa5d3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c87a0 0x561dfa5d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5d3650 0x561dfa5d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f57997ecb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa51be30 con 0x561dfa5c87a0 2023-10-08T12:49:01.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f57997ecb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa4b8710 con 0x561dfa5c7e80 2023-10-08T12:49:01.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f57997ecb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa4b83b0 con 0x561dfa5d3650 2023-10-08T12:49:01.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f57997ecb80 10 client.0 _ll_register_callbacks cb 0x561dfa315800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:01.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f577f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c7e80 0x561dfa5d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f577f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c7e80 0x561dfa5d3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33920/0 (socket says 172.21.15.59:33920) 2023-10-08T12:49:01.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f577f7fe700 1 -- 172.21.15.59:0/4238802052 learned_addr learned my addr 172.21.15.59:0/4238802052 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:01.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f577ffff700 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5d3650 0x561dfa5d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f577effd700 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c87a0 0x561dfa5d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f577f7fe700 1 -- 172.21.15.59:0/4238802052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5d3650 msgr2=0x561dfa5d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f577f7fe700 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5d3650 0x561dfa5d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f577f7fe700 1 -- 172.21.15.59:0/4238802052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c87a0 msgr2=0x561dfa5d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f577f7fe700 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c87a0 0x561dfa5d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.352+0000 7f577f7fe700 1 -- 172.21.15.59:0/4238802052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5770009960 con 0x561dfa5c7e80 2023-10-08T12:49:01.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.353+0000 7f577f7fe700 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c7e80 0x561dfa5d3060 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5770000c00 tx=0x7f57700038b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d965dbc776ec0da7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.353+0000 7f575effd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:49:01.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.353+0000 7f575effd700 1 -- 172.21.15.59:0/4238802052 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770005ce0 con 0x561dfa5c7e80 2023-10-08T12:49:01.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.353+0000 7f57997ecb80 1 -- 172.21.15.59:0/4238802052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561dfa4e3eb0 con 0x561dfa5c7e80 2023-10-08T12:49:01.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.353+0000 7f575effd700 1 -- 172.21.15.59:0/4238802052 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f5770005040 con 0x561dfa5c7e80 2023-10-08T12:49:01.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.353+0000 7f575effd700 1 -- 172.21.15.59:0/4238802052 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5770005200 con 0x561dfa5c7e80 2023-10-08T12:49:01.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.353+0000 7f57997ecb80 10 client.26567 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:01.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.353+0000 7f57997ecb80 1 -- 172.21.15.59:0/4238802052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x561dfa32fc60 con 0x561dfa5c7e80 2023-10-08T12:49:01.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.354+0000 7f575effd700 1 -- 172.21.15.59:0/4238802052 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561dfa4e3eb0 con 0x561dfa5c7e80 2023-10-08T12:49:01.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.354+0000 7f575effd700 1 -- 172.21.15.59:0/4238802052 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5770028020 con 0x561dfa5c7e80 2023-10-08T12:49:01.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.354+0000 7f57997ecb80 10 client.26567 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:01.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.354+0000 7f57997ecb80 10 client.26567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:01.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.354+0000 7f57997ecb80 20 client.26567 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:01.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.354+0000 7f57997ecb80 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561dfa5e2fd0 0x561dfa5e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.354+0000 7f57997ecb80 4 client.26567 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:49:01.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.354+0000 7f57997ecb80 1 -- 172.21.15.59:0/4238802052 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561dfa514e10 con 0x561dfa5e2fd0 2023-10-08T12:49:01.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.354+0000 7f577effd700 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561dfa5e2fd0 0x561dfa5e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.355+0000 7f577effd700 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561dfa5e2fd0 0x561dfa5e53f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34d110be40010c0b server_cookie=a9d768bc52df35bf in_seq=0 out_seq=0 2023-10-08T12:49:01.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.355+0000 7f575effd700 10 client.26567 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:01.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f575effd700 1 -- 172.21.15.59:0/4238802052 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561dfa514e10 con 0x561dfa5e2fd0 2023-10-08T12:49:01.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f575effd700 10 client.26567 handle_command_reply: tid=0 2023-10-08T12:49:01.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f57997ecb80 1 client.26567 shutdown 2023-10-08T12:49:01.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f57997ecb80 1 -- 172.21.15.59:0/4238802052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c7e80 msgr2=0x561dfa5d3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f57997ecb80 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c7e80 0x561dfa5d3060 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5770000c00 tx=0x7f57700038b0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f57997ecb80 1 -- 172.21.15.59:0/4238802052 shutdown_connections 2023-10-08T12:49:01.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f57997ecb80 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561dfa5e2fd0 0x561dfa5e53f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f57997ecb80 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c7e80 0x561dfa5d3060 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f57997ecb80 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5d3650 0x561dfa5d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f57997ecb80 1 --2- 172.21.15.59:0/4238802052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c87a0 0x561dfa5d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f575effd700 0 client.26567 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:01.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f57997ecb80 1 -- 172.21.15.59:0/4238802052 >> 172.21.15.59:0/4238802052 conn(0x561dfa53d260 msgr2=0x561dfa5c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f57997ecb80 1 -- 172.21.15.59:0/4238802052 shutdown_connections 2023-10-08T12:49:01.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.356+0000 7f57997ecb80 1 -- 172.21.15.59:0/4238802052 wait complete. 2023-10-08T12:49:01.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.357+0000 7f57997ecb80 20 client.26567 trim_cache size 0 max 16384 2023-10-08T12:49:01.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.374+0000 7f57997ecb80 1 Processor -- start 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.374+0000 7f57997ecb80 1 -- start start 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c87a0 0x561dfa5da1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5d3650 0x561dfa5cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f57997ecb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa39c920 con 0x561dfa5c87a0 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f57997ecb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa5c90d0 con 0x561dfa5d3650 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f57997ecb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa5c0ae0 con 0x561dfa5c7e80 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f577f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f577ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5d3650 0x561dfa5cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f577f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:42030/0 (socket says 172.21.15.59:42030) 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f577effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c87a0 0x561dfa5da1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f577ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5d3650 0x561dfa5cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33936/0 (socket says 172.21.15.59:33936) 2023-10-08T12:49:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f577f7fe700 1 -- 172.21.15.59:0/2004011852 learned_addr learned my addr 172.21.15.59:0/2004011852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f577f7fe700 1 -- 172.21.15.59:0/2004011852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5d3650 msgr2=0x561dfa5cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f577f7fe700 1 --2- 172.21.15.59:0/2004011852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5d3650 0x561dfa5cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f577f7fe700 1 -- 172.21.15.59:0/2004011852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c87a0 msgr2=0x561dfa5da1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f577f7fe700 1 --2- 172.21.15.59:0/2004011852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c87a0 0x561dfa5da1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.375+0000 7f577f7fe700 1 -- 172.21.15.59:0/2004011852 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dfa36d250 con 0x561dfa5c7e80 2023-10-08T12:49:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.376+0000 7f577f7fe700 1 --2- 172.21.15.59:0/2004011852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5d09b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5770003f40 tx=0x7f5770005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4924c931f7981014 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.376+0000 7f57667fc700 1 -- 172.21.15.59:0/2004011852 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770039070 con 0x561dfa5c7e80 2023-10-08T12:49:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.376+0000 7f57667fc700 1 -- 172.21.15.59:0/2004011852 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5770019e30 con 0x561dfa5c7e80 2023-10-08T12:49:01.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.376+0000 7f57667fc700 1 -- 172.21.15.59:0/2004011852 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770004760 con 0x561dfa5c7e80 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.376+0000 7f57997ecb80 1 -- 172.21.15.59:0/2004011852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 msgr2=0x561dfa5d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.376+0000 7f57997ecb80 1 --2- 172.21.15.59:0/2004011852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5d09b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5770003f40 tx=0x7f5770005a00 comp rx=0 tx=0).stop 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.377+0000 7f57997ecb80 1 -- 172.21.15.59:0/2004011852 shutdown_connections 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.377+0000 7f57997ecb80 1 --2- 172.21.15.59:0/2004011852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5d3650 0x561dfa5cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.377+0000 7f57997ecb80 1 --2- 172.21.15.59:0/2004011852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5c7e80 0x561dfa5d09b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.377+0000 7f57997ecb80 1 --2- 172.21.15.59:0/2004011852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c87a0 0x561dfa5da1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.377+0000 7f57997ecb80 1 -- 172.21.15.59:0/2004011852 >> 172.21.15.59:0/2004011852 conn(0x561dfa53d260 msgr2=0x561dfa5cb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.377+0000 7f57997ecb80 1 -- 172.21.15.59:0/2004011852 shutdown_connections 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.377+0000 7f57997ecb80 1 -- 172.21.15.59:0/2004011852 wait complete. 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.377+0000 7f57997ecb80 1 -- start start 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.377+0000 7f57997ecb80 1 Processor -- start 2023-10-08T12:49:01.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c7e80 0x561dfa5d7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c87a0 0x561dfa5d8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f57997ecb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5d3650 0x561dfa635de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f57997ecb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa636320 con 0x561dfa5c7e80 2023-10-08T12:49:01.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f57997ecb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa636460 con 0x561dfa5c87a0 2023-10-08T12:49:01.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f57997ecb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfa6365d0 con 0x561dfa5d3650 2023-10-08T12:49:01.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f57997ecb80 10 client.0 _ll_register_callbacks cb 0x7f5778009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:01.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f577f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c7e80 0x561dfa5d7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f577effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c87a0 0x561dfa5d8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f577f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c7e80 0x561dfa5d7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47534/0 (socket says 172.21.15.59:47534) 2023-10-08T12:49:01.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f577f7fe700 1 -- 172.21.15.59:0/300167474 learned_addr learned my addr 172.21.15.59:0/300167474 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:01.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f577ffff700 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5d3650 0x561dfa635de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f577effd700 1 -- 172.21.15.59:0/300167474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5d3650 msgr2=0x561dfa635de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.378+0000 7f577effd700 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5d3650 0x561dfa635de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f577effd700 1 -- 172.21.15.59:0/300167474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c7e80 msgr2=0x561dfa5d7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f577effd700 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c7e80 0x561dfa5d7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f577effd700 1 -- 172.21.15.59:0/300167474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561dfa32fc60 con 0x561dfa5c87a0 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f577f7fe700 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c7e80 0x561dfa5d7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f577effd700 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c87a0 0x561dfa5d8520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f57740cbb30 tx=0x7f577401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a4a010017e8ff45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f575effd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f575effd700 1 -- 172.21.15.59:0/300167474 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577409adb0 con 0x561dfa5c87a0 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f57997ecb80 1 -- 172.21.15.59:0/300167474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5770004390 con 0x561dfa5c87a0 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f575effd700 1 -- 172.21.15.59:0/300167474 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f577409bb50 con 0x561dfa5c87a0 2023-10-08T12:49:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f575effd700 1 -- 172.21.15.59:0/300167474 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f577409b450 con 0x561dfa5c87a0 2023-10-08T12:49:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f57997ecb80 10 client.26573 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f57997ecb80 1 -- 172.21.15.59:0/300167474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x561dfa3452b0 con 0x561dfa5c87a0 2023-10-08T12:49:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.379+0000 7f575effd700 1 -- 172.21.15.59:0/300167474 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5770004390 con 0x561dfa5c87a0 2023-10-08T12:49:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.380+0000 7f575effd700 1 -- 172.21.15.59:0/300167474 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f577409f120 con 0x561dfa5c87a0 2023-10-08T12:49:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.380+0000 7f57997ecb80 10 client.26573 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.380+0000 7f57997ecb80 10 client.26573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.380+0000 7f57997ecb80 20 client.26573 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.380+0000 7f57997ecb80 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561dfa637b10 0x561dfa639f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.380+0000 7f57997ecb80 4 client.26573 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:49:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.380+0000 7f57997ecb80 1 -- 172.21.15.59:0/300167474 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561dfa514b30 con 0x561dfa637b10 2023-10-08T12:49:01.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.380+0000 7f577f7fe700 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561dfa637b10 0x561dfa639f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.380+0000 7f577f7fe700 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561dfa637b10 0x561dfa639f30 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef4f6f5a52f54745 server_cookie=538e109f5993c8e9 in_seq=0 out_seq=0 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.380+0000 7f575effd700 10 client.26573 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f575effd700 1 -- 172.21.15.59:0/300167474 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561dfa514b30 con 0x561dfa637b10 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f575effd700 10 client.26573 handle_command_reply: tid=0 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 1 client.26573 shutdown 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 1 -- 172.21.15.59:0/300167474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c87a0 msgr2=0x561dfa5d8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c87a0 0x561dfa5d8520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f57740cbb30 tx=0x7f577401a040 comp rx=0 tx=0).stop 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 1 -- 172.21.15.59:0/300167474 shutdown_connections 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561dfa637b10 0x561dfa639f30 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dfa5d3650 0x561dfa635de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dfa5c7e80 0x561dfa5d7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f575effd700 0 client.26573 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:01.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 1 --2- 172.21.15.59:0/300167474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561dfa5c87a0 0x561dfa5d8520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 1 -- 172.21.15.59:0/300167474 >> 172.21.15.59:0/300167474 conn(0x561dfa53d260 msgr2=0x561dfa5cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 1 -- 172.21.15.59:0/300167474 shutdown_connections 2023-10-08T12:49:01.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 1 -- 172.21.15.59:0/300167474 wait complete. 2023-10-08T12:49:01.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.381+0000 7f57997ecb80 20 client.26573 trim_cache size 0 max 16384 2023-10-08T12:49:01.390 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:49:01.390 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:49:01.390 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:49:01.390 INFO:teuthology.orchestra.run.smithi059.stdout: "70ff2fc3-bf27-46f8-b345-2b3883e68970": { 2023-10-08T12:49:01.391 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:49:01.391 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "70ff2fc3-bf27-46f8-b345-2b3883e68970", 2023-10-08T12:49:01.391 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:49:01.391 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:49:01.391 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:49:01.391 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:49:01.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 -- 172.21.15.59:0/836292720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57680a15e0 msgr2=0x7f57680a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57680a15e0 0x7f57680a3aa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5778009ec0 tx=0x7f5778009920 comp rx=0 tx=0).stop 2023-10-08T12:49:01.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 -- 172.21.15.59:0/836292720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5780103220 msgr2=0x7f578019ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:01.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5780103220 0x7f578019ef20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5774000c00 tx=0x7f5774005740 comp rx=0 tx=0).stop 2023-10-08T12:49:01.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 -- 172.21.15.59:0/836292720 shutdown_connections 2023-10-08T12:49:01.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f57680a15e0 0x7f57680a3aa0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5780108870 0x7f5780198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5780102860 0x7f578019e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 --2- 172.21.15.59:0/836292720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5780103220 0x7f578019ef20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:01.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 -- 172.21.15.59:0/836292720 >> 172.21.15.59:0/836292720 conn(0x7f57800fe330 msgr2=0x7f57800fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:01.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 -- 172.21.15.59:0/836292720 shutdown_connections 2023-10-08T12:49:01.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:01.382+0000 7f5785dff700 1 -- 172.21.15.59:0/836292720 wait complete. 2023-10-08T12:49:01.401 INFO:tasks.cephfs.filesystem:scrub status for tag:70ff2fc3-bf27-46f8-b345-2b3883e68970 - {'path': '/', 'tag': '70ff2fc3-bf27-46f8-b345-2b3883e68970', 'options': 'recursive,force'} 2023-10-08T12:49:01.522 INFO:tasks.workunit.client.0.smithi059.stdout: 1 993710 13.40 MB/sec execute 272 sec latency 27.884 ms 2023-10-08T12:49:02.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:01 smithi059 ceph-mon[98489]: pgmap v551: 97 pgs: 97 active+clean; 535 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.6 MiB/s wr, 259 op/s 2023-10-08T12:49:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:01 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:49:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:01 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:01 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:49:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:01 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:01 smithi092 ceph-mon[134093]: pgmap v551: 97 pgs: 97 active+clean; 535 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.6 MiB/s wr, 259 op/s 2023-10-08T12:49:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:01 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:49:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:01 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:01 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:49:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:01 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:02.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:01 smithi173 ceph-mon[135182]: pgmap v551: 97 pgs: 97 active+clean; 535 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.6 MiB/s wr, 259 op/s 2023-10-08T12:49:02.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:01 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:49:02.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:01 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:02.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:01 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:49:02.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:01 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:02.523 INFO:tasks.workunit.client.0.smithi059.stdout: 1 995929 13.40 MB/sec execute 273 sec latency 15.214 ms 2023-10-08T12:49:03.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:02 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:49:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:02 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:49:03.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:02 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:49:03.523 INFO:tasks.workunit.client.0.smithi059.stdout: 1 998554 13.41 MB/sec execute 274 sec latency 15.707 ms 2023-10-08T12:49:04.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:03 smithi059 ceph-mon[98489]: pgmap v552: 97 pgs: 97 active+clean; 544 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 268 op/s 2023-10-08T12:49:04.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:03 smithi059 ceph-mon[98489]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T12:49:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:03 smithi092 ceph-mon[134093]: pgmap v552: 97 pgs: 97 active+clean; 544 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 268 op/s 2023-10-08T12:49:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:03 smithi092 ceph-mon[134093]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T12:49:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:03 smithi173 ceph-mon[135182]: pgmap v552: 97 pgs: 97 active+clean; 544 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 268 op/s 2023-10-08T12:49:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:03 smithi173 ceph-mon[135182]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T12:49:04.523 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1000027 13.39 MB/sec execute 275 sec latency 134.846 ms 2023-10-08T12:49:05.523 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1002300 13.39 MB/sec execute 276 sec latency 43.000 ms 2023-10-08T12:49:06.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:05 smithi059 ceph-mon[98489]: pgmap v554: 97 pgs: 97 active+clean; 549 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 280 op/s 2023-10-08T12:49:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:05 smithi092 ceph-mon[134093]: pgmap v554: 97 pgs: 97 active+clean; 549 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 280 op/s 2023-10-08T12:49:06.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:05 smithi173 ceph-mon[135182]: pgmap v554: 97 pgs: 97 active+clean; 549 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 280 op/s 2023-10-08T12:49:06.523 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1004332 13.37 MB/sec execute 277 sec latency 71.038 ms 2023-10-08T12:49:07.525 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1006417 13.36 MB/sec execute 278 sec latency 13.509 ms 2023-10-08T12:49:08.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:07 smithi059 ceph-mon[98489]: pgmap v555: 97 pgs: 97 active+clean; 554 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 279 op/s 2023-10-08T12:49:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:07 smithi092 ceph-mon[134093]: pgmap v555: 97 pgs: 97 active+clean; 554 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 279 op/s 2023-10-08T12:49:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:07 smithi173 ceph-mon[135182]: pgmap v555: 97 pgs: 97 active+clean; 554 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 279 op/s 2023-10-08T12:49:08.523 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1009167 13.38 MB/sec execute 279 sec latency 36.776 ms 2023-10-08T12:49:09.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1011049 13.35 MB/sec execute 280 sec latency 15.356 ms 2023-10-08T12:49:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:09 smithi092 ceph-mon[134093]: pgmap v556: 97 pgs: 97 active+clean; 546 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.3 MiB/s wr, 267 op/s 2023-10-08T12:49:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:09 smithi173 ceph-mon[135182]: pgmap v556: 97 pgs: 97 active+clean; 546 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.3 MiB/s wr, 267 op/s 2023-10-08T12:49:10.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:09 smithi059 ceph-mon[98489]: pgmap v556: 97 pgs: 97 active+clean; 546 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.3 MiB/s wr, 267 op/s 2023-10-08T12:49:10.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1013048 13.35 MB/sec execute 281 sec latency 129.805 ms 2023-10-08T12:49:11.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1015712 13.35 MB/sec execute 282 sec latency 23.819 ms 2023-10-08T12:49:12.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:11 smithi059 ceph-mon[98489]: pgmap v557: 97 pgs: 97 active+clean; 539 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.9 MiB/s wr, 230 op/s 2023-10-08T12:49:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:11 smithi092 ceph-mon[134093]: pgmap v557: 97 pgs: 97 active+clean; 539 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.9 MiB/s wr, 230 op/s 2023-10-08T12:49:12.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:11 smithi173 ceph-mon[135182]: pgmap v557: 97 pgs: 97 active+clean; 539 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.9 MiB/s wr, 230 op/s 2023-10-08T12:49:12.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1017434 13.34 MB/sec execute 283 sec latency 105.270 ms 2023-10-08T12:49:13.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1019904 13.35 MB/sec execute 284 sec latency 39.456 ms 2023-10-08T12:49:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:13 smithi059 ceph-mon[98489]: pgmap v558: 97 pgs: 97 active+clean; 521 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 256 op/s 2023-10-08T12:49:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:13 smithi059 ceph-mon[98489]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T12:49:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:13 smithi092 ceph-mon[134093]: pgmap v558: 97 pgs: 97 active+clean; 521 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 256 op/s 2023-10-08T12:49:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:13 smithi092 ceph-mon[134093]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T12:49:14.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:13 smithi173 ceph-mon[135182]: pgmap v558: 97 pgs: 97 active+clean; 521 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 256 op/s 2023-10-08T12:49:14.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:13 smithi173 ceph-mon[135182]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T12:49:14.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1022084 13.33 MB/sec execute 285 sec latency 16.722 ms 2023-10-08T12:49:15.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1023919 13.32 MB/sec execute 286 sec latency 50.769 ms 2023-10-08T12:49:16.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:15 smithi059 ceph-mon[98489]: pgmap v560: 97 pgs: 97 active+clean; 526 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 226 op/s 2023-10-08T12:49:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:15 smithi092 ceph-mon[134093]: pgmap v560: 97 pgs: 97 active+clean; 526 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 226 op/s 2023-10-08T12:49:16.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:15 smithi173 ceph-mon[135182]: pgmap v560: 97 pgs: 97 active+clean; 526 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 226 op/s 2023-10-08T12:49:16.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1026764 13.34 MB/sec execute 287 sec latency 12.587 ms 2023-10-08T12:49:17.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1028549 13.31 MB/sec execute 288 sec latency 18.097 ms 2023-10-08T12:49:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:17 smithi059 ceph-mon[98489]: pgmap v561: 97 pgs: 97 active+clean; 531 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 217 op/s 2023-10-08T12:49:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:17 smithi092 ceph-mon[134093]: pgmap v561: 97 pgs: 97 active+clean; 531 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 217 op/s 2023-10-08T12:49:18.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:17 smithi173 ceph-mon[135182]: pgmap v561: 97 pgs: 97 active+clean; 531 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 217 op/s 2023-10-08T12:49:18.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1030703 13.31 MB/sec execute 289 sec latency 78.820 ms 2023-10-08T12:49:19.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1033235 13.31 MB/sec execute 290 sec latency 15.507 ms 2023-10-08T12:49:20.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:19 smithi092 ceph-mon[134093]: pgmap v562: 97 pgs: 97 active+clean; 534 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 224 op/s 2023-10-08T12:49:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:19 smithi173 ceph-mon[135182]: pgmap v562: 97 pgs: 97 active+clean; 534 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 224 op/s 2023-10-08T12:49:20.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:19 smithi059 ceph-mon[98489]: pgmap v562: 97 pgs: 97 active+clean; 534 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 224 op/s 2023-10-08T12:49:20.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1034965 13.30 MB/sec execute 291 sec latency 98.942 ms 2023-10-08T12:49:21.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1037697 13.31 MB/sec execute 292 sec latency 11.864 ms 2023-10-08T12:49:22.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:21 smithi059 ceph-mon[98489]: pgmap v563: 97 pgs: 97 active+clean; 541 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.0 MiB/s wr, 266 op/s 2023-10-08T12:49:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:21 smithi092 ceph-mon[134093]: pgmap v563: 97 pgs: 97 active+clean; 541 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.0 MiB/s wr, 266 op/s 2023-10-08T12:49:22.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:21 smithi173 ceph-mon[135182]: pgmap v563: 97 pgs: 97 active+clean; 541 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.0 MiB/s wr, 266 op/s 2023-10-08T12:49:22.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1040079 13.30 MB/sec execute 293 sec latency 14.587 ms 2023-10-08T12:49:23.528 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1041909 13.29 MB/sec execute 294 sec latency 82.387 ms 2023-10-08T12:49:24.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:23 smithi059 ceph-mon[98489]: pgmap v564: 97 pgs: 97 active+clean; 550 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 280 op/s 2023-10-08T12:49:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:23 smithi092 ceph-mon[134093]: pgmap v564: 97 pgs: 97 active+clean; 550 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 280 op/s 2023-10-08T12:49:24.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:23 smithi173 ceph-mon[135182]: pgmap v564: 97 pgs: 97 active+clean; 550 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 280 op/s 2023-10-08T12:49:24.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1044638 13.30 MB/sec execute 295 sec latency 16.322 ms 2023-10-08T12:49:25.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1046074 13.28 MB/sec execute 296 sec latency 127.774 ms 2023-10-08T12:49:26.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:25 smithi059 ceph-mon[98489]: pgmap v565: 97 pgs: 97 active+clean; 550 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 235 op/s 2023-10-08T12:49:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:25 smithi092 ceph-mon[134093]: pgmap v565: 97 pgs: 97 active+clean; 550 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 235 op/s 2023-10-08T12:49:26.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:25 smithi173 ceph-mon[135182]: pgmap v565: 97 pgs: 97 active+clean; 550 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 235 op/s 2023-10-08T12:49:26.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1048584 13.28 MB/sec execute 297 sec latency 14.561 ms 2023-10-08T12:49:27.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1051232 13.28 MB/sec execute 298 sec latency 12.856 ms 2023-10-08T12:49:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:27 smithi059 ceph-mon[98489]: pgmap v566: 97 pgs: 97 active+clean; 555 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 245 op/s 2023-10-08T12:49:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:27 smithi092 ceph-mon[134093]: pgmap v566: 97 pgs: 97 active+clean; 555 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 245 op/s 2023-10-08T12:49:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:27 smithi173 ceph-mon[135182]: pgmap v566: 97 pgs: 97 active+clean; 555 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 245 op/s 2023-10-08T12:49:28.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1052644 13.26 MB/sec execute 299 sec latency 155.767 ms 2023-10-08T12:49:29.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1055394 13.27 MB/sec execute 300 sec latency 11.777 ms 2023-10-08T12:49:30.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:29 smithi092 ceph-mon[134093]: pgmap v567: 97 pgs: 97 active+clean; 559 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2023-10-08T12:49:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:29 smithi173 ceph-mon[135182]: pgmap v567: 97 pgs: 97 active+clean; 559 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2023-10-08T12:49:30.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:29 smithi059 ceph-mon[98489]: pgmap v567: 97 pgs: 97 active+clean; 559 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2023-10-08T12:49:30.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1056916 13.25 MB/sec execute 301 sec latency 71.531 ms 2023-10-08T12:49:31.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:49:31.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1059353 13.25 MB/sec execute 302 sec latency 13.891 ms 2023-10-08T12:49:31.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.620+0000 7f3a339ff700 1 -- 172.21.15.59:0/2613742854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c106780 msgr2=0x7f3a2c106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.620+0000 7f3a339ff700 1 --2- 172.21.15.59:0/2613742854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c106780 0x7f3a2c106b60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3a280098f0 tx=0x7f3a28009c00 comp rx=0 tx=0).stop 2023-10-08T12:49:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.620+0000 7f3a339ff700 1 -- 172.21.15.59:0/2613742854 shutdown_connections 2023-10-08T12:49:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.620+0000 7f3a339ff700 1 --2- 172.21.15.59:0/2613742854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a2c0693f0 0x7f3a2c10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.620+0000 7f3a339ff700 1 --2- 172.21.15.59:0/2613742854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c106780 0x7f3a2c106b60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.620+0000 7f3a339ff700 1 --2- 172.21.15.59:0/2613742854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a2c068a30 0x7f3a2c068eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.620+0000 7f3a339ff700 1 -- 172.21.15.59:0/2613742854 >> 172.21.15.59:0/2613742854 conn(0x7f3a2c0767c0 msgr2=0x7f3a2c076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.620+0000 7f3a339ff700 1 -- 172.21.15.59:0/2613742854 shutdown_connections 2023-10-08T12:49:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.620+0000 7f3a339ff700 1 -- 172.21.15.59:0/2613742854 wait complete. 2023-10-08T12:49:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.621+0000 7f3a339ff700 1 Processor -- start 2023-10-08T12:49:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.621+0000 7f3a339ff700 1 -- start start 2023-10-08T12:49:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a339ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c068a30 0x7f3a2c0ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a339ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a2c0693f0 0x7f3a2c0ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a339ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a2c106780 0x7f3a2c100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a339ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c1a5030 con 0x7f3a2c068a30 2023-10-08T12:49:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a339ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c1a51a0 con 0x7f3a2c0693f0 2023-10-08T12:49:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a339ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c1a5360 con 0x7f3a2c106780 2023-10-08T12:49:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a30f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a2c0693f0 0x7f3a2c0ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a3179b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c068a30 0x7f3a2c0ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a30f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a2c0693f0 0x7f3a2c0ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41416/0 (socket says 172.21.15.59:41416) 2023-10-08T12:49:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a30f9a700 1 -- 172.21.15.59:0/2811516531 learned_addr learned my addr 172.21.15.59:0/2811516531 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a31f9c700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a2c106780 0x7f3a2c100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a3179b700 1 -- 172.21.15.59:0/2811516531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a2c106780 msgr2=0x7f3a2c100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a3179b700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a2c106780 0x7f3a2c100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a3179b700 1 -- 172.21.15.59:0/2811516531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a2c0693f0 msgr2=0x7f3a2c0ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a3179b700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a2c0693f0 0x7f3a2c0ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a3179b700 1 -- 172.21.15.59:0/2811516531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c0095f0 con 0x7f3a2c068a30 2023-10-08T12:49:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.622+0000 7f3a3179b700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c068a30 0x7f3a2c0ff6b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009fd0 tx=0x7f3a2800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.623+0000 7f3a227fc700 1 -- 172.21.15.59:0/2811516531 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2801c070 con 0x7f3a2c068a30 2023-10-08T12:49:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.623+0000 7f3a227fc700 1 -- 172.21.15.59:0/2811516531 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a2800baa0 con 0x7f3a2c068a30 2023-10-08T12:49:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.623+0000 7f3a227fc700 1 -- 172.21.15.59:0/2811516531 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a280038e0 con 0x7f3a2c068a30 2023-10-08T12:49:31.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.623+0000 7f3a339ff700 1 -- 172.21.15.59:0/2811516531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a28009520 con 0x7f3a2c068a30 2023-10-08T12:49:31.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.623+0000 7f3a339ff700 1 -- 172.21.15.59:0/2811516531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c1a58b0 con 0x7f3a2c068a30 2023-10-08T12:49:31.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.626+0000 7f3a227fc700 1 -- 172.21.15.59:0/2811516531 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3a28020030 con 0x7f3a2c068a30 2023-10-08T12:49:31.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.627+0000 7f3a473bab80 1 Processor -- start 2023-10-08T12:49:31.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.627+0000 7f3a473bab80 1 -- start start 2023-10-08T12:49:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a227fc700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a180a1670 0x7f3a180a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 0x55ce4b506260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b511110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b513a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a473bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b46f460 con 0x55ce4b511650 2023-10-08T12:49:31.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a473bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b460c20 con 0x55ce4b505e80 2023-10-08T12:49:31.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a473bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b45e540 con 0x55ce4b5067a0 2023-10-08T12:49:31.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a227fc700 1 -- 172.21.15.59:0/2811516531 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3a280cdda0 con 0x7f3a2c068a30 2023-10-08T12:49:31.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a30f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b511110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a30f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b511110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41270/0 (socket says 172.21.15.59:41270) 2023-10-08T12:49:31.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a30f9a700 1 -- 172.21.15.59:0/558470710 learned_addr learned my addr 172.21.15.59:0/558470710 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:31.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a3179b700 1 --2- 172.21.15.59:0/558470710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 0x55ce4b506260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a31f9c700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a180a1670 0x7f3a180a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.628+0000 7f3a31f9c700 1 --2- 172.21.15.59:0/558470710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b513a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a30f9a700 1 -- 172.21.15.59:0/558470710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 msgr2=0x55ce4b506260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:31.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a30f9a700 1 --2- 172.21.15.59:0/558470710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 0x55ce4b506260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a30f9a700 1 -- 172.21.15.59:0/558470710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 msgr2=0x55ce4b513a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:31.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a30f9a700 1 --2- 172.21.15.59:0/558470710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b513a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a30f9a700 1 -- 172.21.15.59:0/558470710 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce4b284de0 con 0x55ce4b5067a0 2023-10-08T12:49:31.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a31f9c700 1 --2- 172.21.15.59:0/558470710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b513a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:49:31.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a3179b700 1 --2- 172.21.15.59:0/558470710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 0x55ce4b506260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:31.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a30f9a700 1 --2- 172.21.15.59:0/558470710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b511110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0114c0 tx=0x7f3a1c0117d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5d42cce02486a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:31.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a31f9c700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a180a1670 0x7f3a180a3b30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009ec0 tx=0x7f3a24009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:31.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a177fe700 1 -- 172.21.15.59:0/558470710 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c004230 con 0x55ce4b5067a0 2023-10-08T12:49:31.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a177fe700 1 -- 172.21.15.59:0/558470710 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a1c004390 con 0x55ce4b5067a0 2023-10-08T12:49:31.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.629+0000 7f3a177fe700 1 -- 172.21.15.59:0/558470710 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0198f0 con 0x55ce4b5067a0 2023-10-08T12:49:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.630+0000 7f3a473bab80 1 -- 172.21.15.59:0/558470710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 msgr2=0x55ce4b511110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.630+0000 7f3a473bab80 1 --2- 172.21.15.59:0/558470710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b511110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0114c0 tx=0x7f3a1c0117d0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.630+0000 7f3a473bab80 1 -- 172.21.15.59:0/558470710 shutdown_connections 2023-10-08T12:49:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.630+0000 7f3a473bab80 1 --2- 172.21.15.59:0/558470710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 0x55ce4b506260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.630+0000 7f3a473bab80 1 --2- 172.21.15.59:0/558470710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b513a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.630+0000 7f3a473bab80 1 --2- 172.21.15.59:0/558470710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b511110 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.630+0000 7f3a473bab80 1 -- 172.21.15.59:0/558470710 >> 172.21.15.59:0/558470710 conn(0x55ce4b47b260 msgr2=0x55ce4b5022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.630+0000 7f3a473bab80 1 -- 172.21.15.59:0/558470710 shutdown_connections 2023-10-08T12:49:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.630+0000 7f3a473bab80 1 -- 172.21.15.59:0/558470710 wait complete. 2023-10-08T12:49:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.631+0000 7f3a473bab80 1 -- start start 2023-10-08T12:49:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.631+0000 7f3a473bab80 1 Processor -- start 2023-10-08T12:49:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b505e80 0x55ce4b511030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b50e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b511650 0x55ce4b50e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a473bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b459e30 con 0x55ce4b505e80 2023-10-08T12:49:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a473bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b3f6710 con 0x55ce4b511650 2023-10-08T12:49:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a473bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b3f63b0 con 0x55ce4b5067a0 2023-10-08T12:49:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a473bab80 10 client.0 _ll_register_callbacks cb 0x55ce4b253800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a30f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b50e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a3179b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b505e80 0x55ce4b511030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a31f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b511650 0x55ce4b50e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a30f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b50e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41284/0 (socket says 172.21.15.59:41284) 2023-10-08T12:49:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.632+0000 7f3a30f9a700 1 -- 172.21.15.59:0/2550275260 learned_addr learned my addr 172.21.15.59:0/2550275260 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a30f9a700 1 -- 172.21.15.59:0/2550275260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b511650 msgr2=0x55ce4b50e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a30f9a700 1 --2- 172.21.15.59:0/2550275260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b511650 0x55ce4b50e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a30f9a700 1 -- 172.21.15.59:0/2550275260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b505e80 msgr2=0x55ce4b511030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a30f9a700 1 --2- 172.21.15.59:0/2550275260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b505e80 0x55ce4b511030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a30f9a700 1 -- 172.21.15.59:0/2550275260 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c1a58b0 con 0x55ce4b5067a0 2023-10-08T12:49:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a30f9a700 1 --2- 172.21.15.59:0/2550275260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b50e2b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009930 tx=0x7f3a1c005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1b55b102c084619 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:49:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a14ff9700 1 -- 172.21.15.59:0/2550275260 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c003c10 con 0x55ce4b5067a0 2023-10-08T12:49:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a473bab80 1 -- 172.21.15.59:0/2550275260 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce4b421eb0 con 0x55ce4b5067a0 2023-10-08T12:49:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a14ff9700 1 -- 172.21.15.59:0/2550275260 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3a1c005040 con 0x55ce4b5067a0 2023-10-08T12:49:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a14ff9700 1 -- 172.21.15.59:0/2550275260 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a1c005200 con 0x55ce4b5067a0 2023-10-08T12:49:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a473bab80 10 client.26575 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.633+0000 7f3a473bab80 1 -- 172.21.15.59:0/2550275260 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f3a1c009cb0 con 0x55ce4b5067a0 2023-10-08T12:49:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.634+0000 7f3a14ff9700 1 -- 172.21.15.59:0/2550275260 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ce4b421eb0 con 0x55ce4b5067a0 2023-10-08T12:49:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.634+0000 7f3a14ff9700 1 -- 172.21.15.59:0/2550275260 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3a1c021040 con 0x55ce4b5067a0 2023-10-08T12:49:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.634+0000 7f3a473bab80 10 client.26575 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.634+0000 7f3a473bab80 10 client.26575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.634+0000 7f3a473bab80 20 client.26575 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.634+0000 7f3a473bab80 1 --2- 172.21.15.59:0/2550275260 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce4b520fa0 0x55ce4b5233c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.634+0000 7f3a473bab80 4 client.26575 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.634+0000 7f3a473bab80 1 -- 172.21.15.59:0/2550275260 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce4b452e10 con 0x55ce4b520fa0 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.634+0000 7f3a3179b700 1 --2- 172.21.15.59:0/2550275260 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce4b520fa0 0x55ce4b5233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.635+0000 7f3a14ff9700 10 client.26575 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.635+0000 7f3a3179b700 1 --2- 172.21.15.59:0/2550275260 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce4b520fa0 0x55ce4b5233c0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8408e73538e5474c server_cookie=b92d8d49d67a8087 in_seq=0 out_seq=0 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.635+0000 7f3a14ff9700 1 -- 172.21.15.59:0/2550275260 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ce4b452e10 con 0x55ce4b520fa0 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.635+0000 7f3a14ff9700 10 client.26575 handle_command_reply: tid=0 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.635+0000 7f3a473bab80 1 client.26575 shutdown 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a473bab80 1 -- 172.21.15.59:0/2550275260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 msgr2=0x55ce4b50e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a473bab80 1 --2- 172.21.15.59:0/2550275260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b50e2b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009930 tx=0x7f3a1c005f10 comp rx=0 tx=0).stop 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a473bab80 1 -- 172.21.15.59:0/2550275260 shutdown_connections 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a473bab80 1 --2- 172.21.15.59:0/2550275260 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce4b520fa0 0x55ce4b5233c0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a473bab80 1 --2- 172.21.15.59:0/2550275260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b511650 0x55ce4b50e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a473bab80 1 --2- 172.21.15.59:0/2550275260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b505e80 0x55ce4b511030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a14ff9700 0 client.26575 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a473bab80 1 --2- 172.21.15.59:0/2550275260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b50e2b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a473bab80 1 -- 172.21.15.59:0/2550275260 >> 172.21.15.59:0/2550275260 conn(0x55ce4b47b260 msgr2=0x55ce4b501ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a473bab80 1 -- 172.21.15.59:0/2550275260 shutdown_connections 2023-10-08T12:49:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a473bab80 1 -- 172.21.15.59:0/2550275260 wait complete. 2023-10-08T12:49:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.636+0000 7f3a473bab80 20 client.26575 trim_cache size 0 max 16384 2023-10-08T12:49:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.656+0000 7f3a473bab80 1 Processor -- start 2023-10-08T12:49:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.656+0000 7f3a473bab80 1 -- start start 2023-10-08T12:49:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.656+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 0x55ce4b50e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.656+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b5181a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.656+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b509610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.656+0000 7f3a473bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b2da920 con 0x55ce4b511650 2023-10-08T12:49:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.656+0000 7f3a473bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b51dc20 con 0x55ce4b505e80 2023-10-08T12:49:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.656+0000 7f3a473bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b4feae0 con 0x55ce4b5067a0 2023-10-08T12:49:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.657+0000 7f3a3179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 0x55ce4b50e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.657+0000 7f3a30f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b5181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.657+0000 7f3a3179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 0x55ce4b50e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41442/0 (socket says 172.21.15.59:41442) 2023-10-08T12:49:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.657+0000 7f3a3179b700 1 -- 172.21.15.59:0/2543140991 learned_addr learned my addr 172.21.15.59:0/2543140991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.657+0000 7f3a31f9c700 1 --2- 172.21.15.59:0/2543140991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b509610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.657+0000 7f3a3179b700 1 -- 172.21.15.59:0/2543140991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 msgr2=0x55ce4b5181a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.657+0000 7f3a3179b700 1 --2- 172.21.15.59:0/2543140991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b5181a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.657+0000 7f3a3179b700 1 -- 172.21.15.59:0/2543140991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 msgr2=0x55ce4b509610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.657+0000 7f3a3179b700 1 --2- 172.21.15.59:0/2543140991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b509610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.657+0000 7f3a3179b700 1 -- 172.21.15.59:0/2543140991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce4b26dc60 con 0x55ce4b505e80 2023-10-08T12:49:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.657+0000 7f3a31f9c700 1 --2- 172.21.15.59:0/2543140991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b509610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:49:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.658+0000 7f3a3179b700 1 --2- 172.21.15.59:0/2543140991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 0x55ce4b50e8a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3a2809ab00 tx=0x7f3a28019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3965e4cc3b8986ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.658+0000 7f3a17fff700 1 -- 172.21.15.59:0/2543140991 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2809d070 con 0x55ce4b505e80 2023-10-08T12:49:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.658+0000 7f3a17fff700 1 -- 172.21.15.59:0/2543140991 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a280052b0 con 0x55ce4b505e80 2023-10-08T12:49:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.658+0000 7f3a17fff700 1 -- 172.21.15.59:0/2543140991 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a280a3100 con 0x55ce4b505e80 2023-10-08T12:49:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.659+0000 7f3a473bab80 1 -- 172.21.15.59:0/2543140991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 msgr2=0x55ce4b50e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.659+0000 7f3a473bab80 1 --2- 172.21.15.59:0/2543140991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 0x55ce4b50e8a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3a2809ab00 tx=0x7f3a28019040 comp rx=0 tx=0).stop 2023-10-08T12:49:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.659+0000 7f3a473bab80 1 -- 172.21.15.59:0/2543140991 shutdown_connections 2023-10-08T12:49:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.659+0000 7f3a473bab80 1 --2- 172.21.15.59:0/2543140991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b505e80 0x55ce4b50e8a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.659+0000 7f3a473bab80 1 --2- 172.21.15.59:0/2543140991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b509610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.659+0000 7f3a473bab80 1 --2- 172.21.15.59:0/2543140991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b5067a0 0x55ce4b5181a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.659+0000 7f3a473bab80 1 -- 172.21.15.59:0/2543140991 >> 172.21.15.59:0/2543140991 conn(0x55ce4b47b260 msgr2=0x55ce4b5014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.659+0000 7f3a473bab80 1 -- 172.21.15.59:0/2543140991 shutdown_connections 2023-10-08T12:49:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.659+0000 7f3a473bab80 1 -- 172.21.15.59:0/2543140991 wait complete. 2023-10-08T12:49:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.659+0000 7f3a473bab80 1 -- start start 2023-10-08T12:49:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.659+0000 7f3a473bab80 1 Processor -- start 2023-10-08T12:49:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b505e80 0x55ce4b517950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b5067a0 0x55ce4b517e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a473bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b515ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a473bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b5164a0 con 0x55ce4b511650 2023-10-08T12:49:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a473bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b516610 con 0x55ce4b5067a0 2023-10-08T12:49:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a473bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce4b5167d0 con 0x55ce4b505e80 2023-10-08T12:49:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a473bab80 10 client.0 _ll_register_callbacks cb 0x7f3a28005780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a30f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b5067a0 0x55ce4b517e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a3179b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b505e80 0x55ce4b517950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a30f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b5067a0 0x55ce4b517e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41448/0 (socket says 172.21.15.59:41448) 2023-10-08T12:49:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a30f9a700 1 -- 172.21.15.59:0/1198019430 learned_addr learned my addr 172.21.15.59:0/1198019430 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a3179b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b505e80 0x55ce4b517950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41312/0 (socket says 172.21.15.59:41312) 2023-10-08T12:49:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.660+0000 7f3a31f9c700 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b515ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a30f9a700 1 -- 172.21.15.59:0/1198019430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b505e80 msgr2=0x55ce4b517950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a30f9a700 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b505e80 0x55ce4b517950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a30f9a700 1 -- 172.21.15.59:0/1198019430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 msgr2=0x55ce4b515ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a30f9a700 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b515ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a30f9a700 1 -- 172.21.15.59:0/1198019430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a28009520 con 0x55ce4b5067a0 2023-10-08T12:49:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a3179b700 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b505e80 0x55ce4b517950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a30f9a700 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b5067a0 0x55ce4b517e90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55ce4b50f8f0 tx=0x7f3a1c0197d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5da0bfc15298d912 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:49:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a14ff9700 1 -- 172.21.15.59:0/1198019430 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c023660 con 0x55ce4b5067a0 2023-10-08T12:49:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a14ff9700 1 -- 172.21.15.59:0/1198019430 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3a1c000e40 con 0x55ce4b5067a0 2023-10-08T12:49:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a473bab80 1 -- 172.21.15.59:0/1198019430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a1c004390 con 0x55ce4b5067a0 2023-10-08T12:49:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a14ff9700 1 -- 172.21.15.59:0/1198019430 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a1c003680 con 0x55ce4b5067a0 2023-10-08T12:49:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a473bab80 10 client.26591 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.661+0000 7f3a473bab80 1 -- 172.21.15.59:0/1198019430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55ce4b2ab250 con 0x55ce4b5067a0 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.662+0000 7f3a14ff9700 1 -- 172.21.15.59:0/1198019430 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a1c004390 con 0x55ce4b5067a0 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.662+0000 7f3a14ff9700 1 -- 172.21.15.59:0/1198019430 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3a1c011840 con 0x55ce4b5067a0 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.662+0000 7f3a473bab80 10 client.26591 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.662+0000 7f3a473bab80 10 client.26591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.662+0000 7f3a473bab80 20 client.26591 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.662+0000 7f3a473bab80 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce4b575c70 0x55ce4b578090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.662+0000 7f3a473bab80 4 client.26591 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.662+0000 7f3a473bab80 1 -- 172.21.15.59:0/1198019430 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ce4b452b30 con 0x55ce4b575c70 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.662+0000 7f3a3179b700 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce4b575c70 0x55ce4b578090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.662+0000 7f3a3179b700 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce4b575c70 0x55ce4b578090 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab054efca6f6c71a server_cookie=ffbaa391edaad6a7 in_seq=0 out_seq=0 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.662+0000 7f3a14ff9700 10 client.26591 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a14ff9700 1 -- 172.21.15.59:0/1198019430 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ce4b452b30 con 0x55ce4b575c70 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a14ff9700 10 client.26591 handle_command_reply: tid=0 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a473bab80 1 client.26591 shutdown 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a473bab80 1 -- 172.21.15.59:0/1198019430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b5067a0 msgr2=0x55ce4b517e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a473bab80 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b5067a0 0x55ce4b517e90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55ce4b50f8f0 tx=0x7f3a1c0197d0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a473bab80 1 -- 172.21.15.59:0/1198019430 shutdown_connections 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a473bab80 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce4b575c70 0x55ce4b578090 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a473bab80 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce4b511650 0x55ce4b515ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a473bab80 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce4b505e80 0x55ce4b517950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a14ff9700 0 client.26591 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a473bab80 1 --2- 172.21.15.59:0/1198019430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce4b5067a0 0x55ce4b517e90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a473bab80 1 -- 172.21.15.59:0/1198019430 >> 172.21.15.59:0/1198019430 conn(0x55ce4b47b260 msgr2=0x55ce4b509610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a473bab80 1 -- 172.21.15.59:0/1198019430 shutdown_connections 2023-10-08T12:49:31.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.663+0000 7f3a473bab80 1 -- 172.21.15.59:0/1198019430 wait complete. 2023-10-08T12:49:31.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.664+0000 7f3a473bab80 20 client.26591 trim_cache size 0 max 16384 2023-10-08T12:49:31.670 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:49:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:49:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:49:31.670 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:49:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.664+0000 7f3a339ff700 1 -- 172.21.15.59:0/2811516531 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a180a1670 msgr2=0x7f3a180a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.664+0000 7f3a339ff700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a180a1670 0x7f3a180a3b30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009ec0 tx=0x7f3a24009920 comp rx=0 tx=0).stop 2023-10-08T12:49:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.664+0000 7f3a339ff700 1 -- 172.21.15.59:0/2811516531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c068a30 msgr2=0x7f3a2c0ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.664+0000 7f3a339ff700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c068a30 0x7f3a2c0ff6b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009fd0 tx=0x7f3a2800fa00 comp rx=0 tx=0).stop 2023-10-08T12:49:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.665+0000 7f3a339ff700 1 -- 172.21.15.59:0/2811516531 shutdown_connections 2023-10-08T12:49:31.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.665+0000 7f3a339ff700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a180a1670 0x7f3a180a3b30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.665+0000 7f3a339ff700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a2c106780 0x7f3a2c100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.665+0000 7f3a339ff700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c068a30 0x7f3a2c0ff6b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.665+0000 7f3a339ff700 1 --2- 172.21.15.59:0/2811516531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a2c0693f0 0x7f3a2c0ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.665+0000 7f3a339ff700 1 -- 172.21.15.59:0/2811516531 >> 172.21.15.59:0/2811516531 conn(0x7f3a2c0767c0 msgr2=0x7f3a2c0fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:31.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.665+0000 7f3a339ff700 1 -- 172.21.15.59:0/2811516531 shutdown_connections 2023-10-08T12:49:31.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.665+0000 7f3a339ff700 1 -- 172.21.15.59:0/2811516531 wait complete. 2023-10-08T12:49:31.685 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:49:31.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:49:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.902+0000 7f515bfff700 1 -- 172.21.15.59:0/1734210705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154103220 msgr2=0x7f515410f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.902+0000 7f515bfff700 1 --2- 172.21.15.59:0/1734210705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154103220 0x7f515410f730 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f514c00b0a0 tx=0x7f514c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.902+0000 7f515bfff700 1 -- 172.21.15.59:0/1734210705 shutdown_connections 2023-10-08T12:49:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.902+0000 7f515bfff700 1 --2- 172.21.15.59:0/1734210705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154103220 0x7f515410f730 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.902+0000 7f515bfff700 1 --2- 172.21.15.59:0/1734210705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5154108870 0x7f5154108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.902+0000 7f515bfff700 1 --2- 172.21.15.59:0/1734210705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5154102860 0x7f5154102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.902+0000 7f515bfff700 1 -- 172.21.15.59:0/1734210705 >> 172.21.15.59:0/1734210705 conn(0x7f51540fe2f0 msgr2=0x7f5154100710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.903+0000 7f515bfff700 1 -- 172.21.15.59:0/1734210705 shutdown_connections 2023-10-08T12:49:31.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.903+0000 7f515bfff700 1 -- 172.21.15.59:0/1734210705 wait complete. 2023-10-08T12:49:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.904+0000 7f515bfff700 1 Processor -- start 2023-10-08T12:49:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.904+0000 7f515bfff700 1 -- start start 2023-10-08T12:49:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.904+0000 7f515bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5154102860 0x7f515410f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.904+0000 7f515bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154103220 0x7f515410c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.904+0000 7f515bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5154108870 0x7f515410ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.904+0000 7f515bfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515410d0d0 con 0x7f5154102860 2023-10-08T12:49:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.904+0000 7f515bfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515410d240 con 0x7f5154103220 2023-10-08T12:49:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.904+0000 7f515bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515410d400 con 0x7f5154108870 2023-10-08T12:49:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.905+0000 7f515959a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154103220 0x7f515410c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.905+0000 7f515959a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154103220 0x7f515410c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41466/0 (socket says 172.21.15.59:41466) 2023-10-08T12:49:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.905+0000 7f515959a700 1 -- 172.21.15.59:0/4234770727 learned_addr learned my addr 172.21.15.59:0/4234770727 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.905+0000 7f5159d9b700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5154102860 0x7f515410f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.905+0000 7f515a59c700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5154108870 0x7f515410ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.905+0000 7f515a59c700 1 -- 172.21.15.59:0/4234770727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154103220 msgr2=0x7f515410c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.905+0000 7f515a59c700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154103220 0x7f515410c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.905+0000 7f515a59c700 1 -- 172.21.15.59:0/4234770727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5154102860 msgr2=0x7f515410f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:31.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.905+0000 7f515a59c700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5154102860 0x7f515410f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:31.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.905+0000 7f515a59c700 1 -- 172.21.15.59:0/4234770727 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c009d00 con 0x7f5154108870 2023-10-08T12:49:31.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.905+0000 7f515959a700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154103220 0x7f515410c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:31.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.906+0000 7f515a59c700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5154108870 0x7f515410ca70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f514c00b0a0 tx=0x7f514c004ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:31.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.906+0000 7f514affd700 1 -- 172.21.15.59:0/4234770727 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c00e040 con 0x7f5154108870 2023-10-08T12:49:31.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.906+0000 7f514affd700 1 -- 172.21.15.59:0/4234770727 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f514c004e50 con 0x7f5154108870 2023-10-08T12:49:31.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.906+0000 7f514affd700 1 -- 172.21.15.59:0/4234770727 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c005040 con 0x7f5154108870 2023-10-08T12:49:31.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.906+0000 7f515bfff700 1 -- 172.21.15.59:0/4234770727 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51541a97d0 con 0x7f5154108870 2023-10-08T12:49:31.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.906+0000 7f515bfff700 1 -- 172.21.15.59:0/4234770727 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51541a9c00 con 0x7f5154108870 2023-10-08T12:49:31.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.907+0000 7f515bfff700 1 -- 172.21.15.59:0/4234770727 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51540763d0 con 0x7f5154108870 2023-10-08T12:49:31.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.910+0000 7f514affd700 1 -- 172.21.15.59:0/4234770727 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f514c01d470 con 0x7f5154108870 2023-10-08T12:49:31.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.911+0000 7f514affd700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51400a1670 0x7f51400a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:31.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.911+0000 7f514affd700 1 -- 172.21.15.59:0/4234770727 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f514c0ce790 con 0x7f5154108870 2023-10-08T12:49:31.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.912+0000 7f5159d9b700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51400a1670 0x7f51400a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:31.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.912+0000 7f5159d9b700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51400a1670 0x7f51400a3b30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5150009be0 tx=0x7f5150009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:31.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:31.913+0000 7f514affd700 1 -- 172.21.15.59:0/4234770727 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f514c097b30 con 0x7f5154108870 2023-10-08T12:49:32.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:31 smithi059 ceph-mon[98489]: pgmap v568: 97 pgs: 97 active+clean; 561 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 248 op/s 2023-10-08T12:49:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.210+0000 7f515bfff700 1 -- 172.21.15.59:0/4234770727 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5154103fa0 con 0x7f5154108870 2023-10-08T12:49:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.211+0000 7f514affd700 1 -- 172.21.15.59:0/4234770727 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f514c09b150 con 0x7f5154108870 2023-10-08T12:49:32.212 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:49:32.212 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:49:32.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.214+0000 7f515bfff700 1 -- 172.21.15.59:0/4234770727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51400a1670 msgr2=0x7f51400a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:32.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.214+0000 7f515bfff700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51400a1670 0x7f51400a3b30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5150009be0 tx=0x7f5150009260 comp rx=0 tx=0).stop 2023-10-08T12:49:32.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.214+0000 7f515bfff700 1 -- 172.21.15.59:0/4234770727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5154108870 msgr2=0x7f515410ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:32.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.214+0000 7f515bfff700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5154108870 0x7f515410ca70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f514c00b0a0 tx=0x7f514c004ca0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.214+0000 7f515bfff700 1 -- 172.21.15.59:0/4234770727 shutdown_connections 2023-10-08T12:49:32.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.214+0000 7f515bfff700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f51400a1670 0x7f51400a3b30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.214+0000 7f515bfff700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5154108870 0x7f515410ca70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.214+0000 7f515bfff700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5154102860 0x7f515410f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.214+0000 7f515bfff700 1 --2- 172.21.15.59:0/4234770727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5154103220 0x7f515410c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.214+0000 7f515bfff700 1 -- 172.21.15.59:0/4234770727 >> 172.21.15.59:0/4234770727 conn(0x7f51540fe2f0 msgr2=0x7f51540feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:32.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.214+0000 7f515bfff700 1 -- 172.21.15.59:0/4234770727 shutdown_connections 2023-10-08T12:49:32.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.215+0000 7f515bfff700 1 -- 172.21.15.59:0/4234770727 wait complete. 2023-10-08T12:49:32.217 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:49:32.245 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:49:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:31 smithi092 ceph-mon[134093]: pgmap v568: 97 pgs: 97 active+clean; 561 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 248 op/s 2023-10-08T12:49:32.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:31 smithi173 ceph-mon[135182]: pgmap v568: 97 pgs: 97 active+clean; 561 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 248 op/s 2023-10-08T12:49:32.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.469+0000 7f1a173ff700 1 -- 172.21.15.59:0/3001416335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a10108950 msgr2=0x7f1a10108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:32.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.469+0000 7f1a173ff700 1 --2- 172.21.15.59:0/3001416335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a10108950 0x7f1a10108d30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009990 tx=0x7f1a0c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.469+0000 7f1a173ff700 1 -- 172.21.15.59:0/3001416335 shutdown_connections 2023-10-08T12:49:32.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.469+0000 7f1a173ff700 1 --2- 172.21.15.59:0/3001416335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a10108950 0x7f1a10108d30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.469+0000 7f1a173ff700 1 --2- 172.21.15.59:0/3001416335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a10103300 0x7f1a1010f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.469+0000 7f1a173ff700 1 --2- 172.21.15.59:0/3001416335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a10102940 0x7f1a10102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.469+0000 7f1a173ff700 1 -- 172.21.15.59:0/3001416335 >> 172.21.15.59:0/3001416335 conn(0x7f1a100fe3d0 msgr2=0x7f1a101007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:32.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.469+0000 7f1a173ff700 1 -- 172.21.15.59:0/3001416335 shutdown_connections 2023-10-08T12:49:32.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.470+0000 7f1a173ff700 1 -- 172.21.15.59:0/3001416335 wait complete. 2023-10-08T12:49:32.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.471+0000 7f1a173ff700 1 Processor -- start 2023-10-08T12:49:32.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.471+0000 7f1a173ff700 1 -- start start 2023-10-08T12:49:32.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.471+0000 7f1a173ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a10102940 0x7f1a10198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.471+0000 7f1a173ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a10103300 0x7f1a101992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.471+0000 7f1a173ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a10108950 0x7f1a1019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.471+0000 7f1a173ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1019dcd0 con 0x7f1a10103300 2023-10-08T12:49:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.471+0000 7f1a173ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1019de40 con 0x7f1a10108950 2023-10-08T12:49:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.471+0000 7f1a173ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1019e000 con 0x7f1a10102940 2023-10-08T12:49:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1519b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a10102940 0x7f1a10198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1599c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a10108950 0x7f1a1019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1519b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a10102940 0x7f1a10198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41358/0 (socket says 172.21.15.59:41358) 2023-10-08T12:49:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1519b700 1 -- 172.21.15.59:0/2824969322 learned_addr learned my addr 172.21.15.59:0/2824969322 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1499a700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a10103300 0x7f1a101992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1599c700 1 -- 172.21.15.59:0/2824969322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a10102940 msgr2=0x7f1a10198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1599c700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a10102940 0x7f1a10198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1599c700 1 -- 172.21.15.59:0/2824969322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a10103300 msgr2=0x7f1a101992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1599c700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a10103300 0x7f1a101992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1599c700 1 -- 172.21.15.59:0/2824969322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c0095f0 con 0x7f1a10108950 2023-10-08T12:49:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1519b700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a10102940 0x7f1a10198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.472+0000 7f1a1599c700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a10108950 0x7f1a1019d690 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800efc0 tx=0x7f1a0800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.473+0000 7f1a067fc700 1 -- 172.21.15.59:0/2824969322 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08018070 con 0x7f1a10108950 2023-10-08T12:49:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.473+0000 7f1a067fc700 1 -- 172.21.15.59:0/2824969322 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a0800f040 con 0x7f1a10108950 2023-10-08T12:49:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.473+0000 7f1a173ff700 1 -- 172.21.15.59:0/2824969322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1019e280 con 0x7f1a10108950 2023-10-08T12:49:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.473+0000 7f1a067fc700 1 -- 172.21.15.59:0/2824969322 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800cd40 con 0x7f1a10108950 2023-10-08T12:49:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.473+0000 7f1a173ff700 1 -- 172.21.15.59:0/2824969322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a101a5b20 con 0x7f1a10108950 2023-10-08T12:49:32.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.477+0000 7f1a067fc700 1 -- 172.21.15.59:0/2824969322 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1a08003a00 con 0x7f1a10108950 2023-10-08T12:49:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.479+0000 7f1a2ad4db80 1 Processor -- start 2023-10-08T12:49:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.479+0000 7f1a067fc700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19fc0a1670 0x7f19fc0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.479+0000 7f1a067fc700 1 -- 172.21.15.59:0/2824969322 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1a080ccbd0 con 0x7f1a10108950 2023-10-08T12:49:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.479+0000 7f1a2ad4db80 1 -- start start 2023-10-08T12:49:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.479+0000 7f1a1499a700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19fc0a1670 0x7f19fc0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.479+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.479+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6dd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.479+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.479+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a63b460 con 0x56194a6d1e80 2023-10-08T12:49:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.479+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a62cc20 con 0x56194a6d27a0 2023-10-08T12:49:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.479+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a62a540 con 0x56194a6dd650 2023-10-08T12:49:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1499a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6dd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1499a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6dd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41498/0 (socket says 172.21.15.59:41498) 2023-10-08T12:49:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1499a700 1 -- 172.21.15.59:0/2372073941 learned_addr learned my addr 172.21.15.59:0/2372073941 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1599c700 1 --2- 172.21.15.59:0/2372073941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1519b700 1 --2- 172.21.15.59:0/2372073941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1599c700 1 -- 172.21.15.59:0/2372073941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 msgr2=0x56194a6dd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1599c700 1 --2- 172.21.15.59:0/2372073941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6dd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1599c700 1 -- 172.21.15.59:0/2372073941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 msgr2=0x56194a6d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1599c700 1 --2- 172.21.15.59:0/2372073941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6d2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1599c700 1 -- 172.21.15.59:0/2372073941 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56194a450de0 con 0x56194a6dd650 2023-10-08T12:49:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1499a700 1 --2- 172.21.15.59:0/2372073941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6dd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.480+0000 7f1a1499a700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19fc0a1670 0x7f19fc0a3b30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1a00014660 tx=0x7f1a00014a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.481+0000 7f1a1599c700 1 --2- 172.21.15.59:0/2372073941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6dfa40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1a080ca2e0 tx=0x7f1a08099a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0d1f0376a9f4da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.481+0000 7f19fb7fe700 1 -- 172.21.15.59:0/2372073941 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08004ad0 con 0x56194a6dd650 2023-10-08T12:49:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.481+0000 7f19fb7fe700 1 -- 172.21.15.59:0/2372073941 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a0801b320 con 0x56194a6dd650 2023-10-08T12:49:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.481+0000 7f19fb7fe700 1 -- 172.21.15.59:0/2372073941 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08099e90 con 0x56194a6dd650 2023-10-08T12:49:32.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.481+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/2372073941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 msgr2=0x56194a6dfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:32.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.481+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/2372073941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6dfa40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1a080ca2e0 tx=0x7f1a08099a00 comp rx=0 tx=0).stop 2023-10-08T12:49:32.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.482+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/2372073941 shutdown_connections 2023-10-08T12:49:32.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.482+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/2372073941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6dfa40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.482+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/2372073941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6d2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.482+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/2372073941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6dd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.482+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/2372073941 >> 172.21.15.59:0/2372073941 conn(0x56194a647260 msgr2=0x56194a6ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.482+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/2372073941 shutdown_connections 2023-10-08T12:49:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.482+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/2372073941 wait complete. 2023-10-08T12:49:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.482+0000 7f1a2ad4db80 1 -- start start 2023-10-08T12:49:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.483+0000 7f1a2ad4db80 1 Processor -- start 2023-10-08T12:49:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.483+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6d1e80 0x56194a6dd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.483+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d27a0 0x56194a6da3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6dd650 0x56194a6dab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a625e30 con 0x56194a6d27a0 2023-10-08T12:49:32.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a5c2710 con 0x56194a6dd650 2023-10-08T12:49:32.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a5c23b0 con 0x56194a6d1e80 2023-10-08T12:49:32.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a2ad4db80 10 client.0 _ll_register_callbacks cb 0x56194a41f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:32.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a1599c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6dd650 0x56194a6dab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a1499a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d27a0 0x56194a6da3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a1599c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6dd650 0x56194a6dab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41500/0 (socket says 172.21.15.59:41500) 2023-10-08T12:49:32.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a1599c700 1 -- 172.21.15.59:0/1599688936 learned_addr learned my addr 172.21.15.59:0/1599688936 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:32.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a1519b700 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6d1e80 0x56194a6dd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a1599c700 1 -- 172.21.15.59:0/1599688936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6d1e80 msgr2=0x56194a6dd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:32.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a1599c700 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6d1e80 0x56194a6dd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a1599c700 1 -- 172.21.15.59:0/1599688936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d27a0 msgr2=0x56194a6da3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:32.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a1599c700 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d27a0 0x56194a6da3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.484+0000 7f1a1599c700 1 -- 172.21.15.59:0/1599688936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a000103d0 con 0x56194a6dd650 2023-10-08T12:49:32.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.485+0000 7f1a1599c700 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6dd650 0x56194a6dab10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1a08099bc0 tx=0x7f1a08004d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b3c2aeca95c0d19 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:32.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.485+0000 7f19f8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:49:32.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.485+0000 7f19f8ff9700 1 -- 172.21.15.59:0/1599688936 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08099c30 con 0x56194a6dd650 2023-10-08T12:49:32.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.485+0000 7f19f8ff9700 1 -- 172.21.15.59:0/1599688936 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1a0809dd80 con 0x56194a6dd650 2023-10-08T12:49:32.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.485+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/1599688936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56194a5edeb0 con 0x56194a6dd650 2023-10-08T12:49:32.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.485+0000 7f19f8ff9700 1 -- 172.21.15.59:0/1599688936 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a0809a330 con 0x56194a6dd650 2023-10-08T12:49:32.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.485+0000 7f1a2ad4db80 10 client.26609 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:32.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.485+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/1599688936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f1a101a5b20 con 0x56194a6dd650 2023-10-08T12:49:32.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.485+0000 7f19f8ff9700 1 -- 172.21.15.59:0/1599688936 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56194a5edeb0 con 0x56194a6dd650 2023-10-08T12:49:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.485+0000 7f19f8ff9700 1 -- 172.21.15.59:0/1599688936 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1a080b21c0 con 0x56194a6dd650 2023-10-08T12:49:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.486+0000 7f1a2ad4db80 10 client.26609 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.486+0000 7f1a2ad4db80 10 client.26609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.486+0000 7f1a2ad4db80 20 client.26609 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.486+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56194a6f5560 0x56194a6f7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.486+0000 7f1a2ad4db80 4 client.26609 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:49:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.486+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/1599688936 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56194a61ee10 con 0x56194a6f5560 2023-10-08T12:49:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.486+0000 7f1a1519b700 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56194a6f5560 0x56194a6f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.486+0000 7f1a1519b700 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56194a6f5560 0x56194a6f7950 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d3666f4c8698170 server_cookie=ada5e64396cbd952 in_seq=0 out_seq=0 2023-10-08T12:49:32.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.486+0000 7f19f8ff9700 10 client.26609 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:32.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f19f8ff9700 1 -- 172.21.15.59:0/1599688936 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56194a61ee10 con 0x56194a6f5560 2023-10-08T12:49:32.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f19f8ff9700 10 client.26609 handle_command_reply: tid=0 2023-10-08T12:49:32.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f1a2ad4db80 1 client.26609 shutdown 2023-10-08T12:49:32.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/1599688936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6dd650 msgr2=0x56194a6dab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:32.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6dd650 0x56194a6dab10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1a08099bc0 tx=0x7f1a08004d30 comp rx=0 tx=0).stop 2023-10-08T12:49:32.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/1599688936 shutdown_connections 2023-10-08T12:49:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56194a6f5560 0x56194a6f7950 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6dd650 0x56194a6dab10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6d1e80 0x56194a6dd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f19f8ff9700 0 client.26609 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/1599688936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d27a0 0x56194a6da3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/1599688936 >> 172.21.15.59:0/1599688936 conn(0x56194a647260 msgr2=0x56194a6cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.488+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/1599688936 shutdown_connections 2023-10-08T12:49:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.489+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/1599688936 wait complete. 2023-10-08T12:49:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.489+0000 7f1a2ad4db80 20 client.26609 trim_cache size 0 max 16384 2023-10-08T12:49:32.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.503+0000 7f1a2ad4db80 1 Processor -- start 2023-10-08T12:49:32.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a2ad4db80 1 -- start start 2023-10-08T12:49:32.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6ec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a4a6920 con 0x56194a6d1e80 2023-10-08T12:49:32.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a6d2b80 con 0x56194a6d27a0 2023-10-08T12:49:32.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a6caae0 con 0x56194a6dd650 2023-10-08T12:49:32.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a1499a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6ec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a1519b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a1499a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6ec9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41508/0 (socket says 172.21.15.59:41508) 2023-10-08T12:49:32.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a1499a700 1 -- 172.21.15.59:0/161578185 learned_addr learned my addr 172.21.15.59:0/161578185 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:32.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.504+0000 7f1a1599c700 1 --2- 172.21.15.59:0/161578185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.505+0000 7f1a1499a700 1 -- 172.21.15.59:0/161578185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 msgr2=0x56194a6cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:32.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.505+0000 7f1a1499a700 1 --2- 172.21.15.59:0/161578185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.505+0000 7f1a1499a700 1 -- 172.21.15.59:0/161578185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 msgr2=0x56194a6d4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:32.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.505+0000 7f1a1499a700 1 --2- 172.21.15.59:0/161578185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6d4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.505+0000 7f1a1499a700 1 -- 172.21.15.59:0/161578185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56194a6fc510 con 0x56194a6d27a0 2023-10-08T12:49:32.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.505+0000 7f1a1499a700 1 --2- 172.21.15.59:0/161578185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6ec9b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1a000142f0 tx=0x7f1a0001d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f37325364b5fa5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:32.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.505+0000 7f19fbfff700 1 -- 172.21.15.59:0/161578185 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00010ea0 con 0x56194a6d27a0 2023-10-08T12:49:32.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.505+0000 7f19fbfff700 1 -- 172.21.15.59:0/161578185 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a0001a070 con 0x56194a6d27a0 2023-10-08T12:49:32.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.505+0000 7f19fbfff700 1 -- 172.21.15.59:0/161578185 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00003e90 con 0x56194a6d27a0 2023-10-08T12:49:32.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.506+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/161578185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 msgr2=0x56194a6ec9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:32.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.506+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/161578185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6ec9b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1a000142f0 tx=0x7f1a0001d000 comp rx=0 tx=0).stop 2023-10-08T12:49:32.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.506+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/161578185 shutdown_connections 2023-10-08T12:49:32.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.506+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/161578185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.506+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/161578185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6d4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.506+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/161578185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6ec9b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.506+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/161578185 >> 172.21.15.59:0/161578185 conn(0x56194a647260 msgr2=0x56194a6d56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:32.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.506+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/161578185 shutdown_connections 2023-10-08T12:49:32.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.507+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/161578185 wait complete. 2023-10-08T12:49:32.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.507+0000 7f1a2ad4db80 1 -- start start 2023-10-08T12:49:32.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.507+0000 7f1a2ad4db80 1 Processor -- start 2023-10-08T12:49:32.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6ec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6eafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a2ad4db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6eb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a6ebc20 con 0x56194a6d1e80 2023-10-08T12:49:32.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a6ebd90 con 0x56194a6d27a0 2023-10-08T12:49:32.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a2ad4db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56194a749300 con 0x56194a6dd650 2023-10-08T12:49:32.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a2ad4db80 10 client.0 _ll_register_callbacks cb 0x7f1a080097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:32.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a1499a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6eafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a1519b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6ec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a1499a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6eafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41518/0 (socket says 172.21.15.59:41518) 2023-10-08T12:49:32.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a1499a700 1 -- 172.21.15.59:0/4205071866 learned_addr learned my addr 172.21.15.59:0/4205071866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:32.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a1599c700 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6eb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a1499a700 1 -- 172.21.15.59:0/4205071866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 msgr2=0x56194a6eb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:32.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a1499a700 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6eb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a1499a700 1 -- 172.21.15.59:0/4205071866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 msgr2=0x56194a6ec9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:32.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a1499a700 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6ec9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.508+0000 7f1a1499a700 1 -- 172.21.15.59:0/4205071866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a00014060 con 0x56194a6d27a0 2023-10-08T12:49:32.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.509+0000 7f1a1499a700 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6eafb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1a00016010 tx=0x7f1a00005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a4ce14bf1856dc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:32.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.509+0000 7f19f8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:49:32.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.509+0000 7f19f8ff9700 1 -- 172.21.15.59:0/4205071866 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00003c70 con 0x56194a6d27a0 2023-10-08T12:49:32.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.509+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/4205071866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a0801b320 con 0x56194a6d27a0 2023-10-08T12:49:32.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.509+0000 7f19f8ff9700 1 -- 172.21.15.59:0/4205071866 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1a00003dd0 con 0x56194a6d27a0 2023-10-08T12:49:32.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.509+0000 7f19f8ff9700 1 -- 172.21.15.59:0/4205071866 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a00003830 con 0x56194a6d27a0 2023-10-08T12:49:32.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.509+0000 7f1a2ad4db80 10 client.26615 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:32.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.509+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/4205071866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56194a439c60 con 0x56194a6d27a0 2023-10-08T12:49:32.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.510+0000 7f19f8ff9700 1 -- 172.21.15.59:0/4205071866 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a0801b320 con 0x56194a6d27a0 2023-10-08T12:49:32.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.510+0000 7f19f8ff9700 1 -- 172.21.15.59:0/4205071866 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1a00033760 con 0x56194a6d27a0 2023-10-08T12:49:32.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.510+0000 7f1a2ad4db80 10 client.26615 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:32.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.510+0000 7f1a2ad4db80 10 client.26615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:32.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.510+0000 7f1a2ad4db80 20 client.26615 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:32.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.510+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56194a74aa50 0x56194a74ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:32.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.510+0000 7f1a2ad4db80 4 client.26615 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:49:32.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.510+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/4205071866 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56194a61eb30 con 0x56194a74aa50 2023-10-08T12:49:32.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.510+0000 7f1a1519b700 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56194a74aa50 0x56194a74ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:32.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.511+0000 7f1a1519b700 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56194a74aa50 0x56194a74ce70 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=473be158bba0bcbf server_cookie=98aa56f9cbc17a68 in_seq=0 out_seq=0 2023-10-08T12:49:32.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.511+0000 7f19f8ff9700 10 client.26615 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:32.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.511+0000 7f19f8ff9700 1 -- 172.21.15.59:0/4205071866 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56194a61eb30 con 0x56194a74aa50 2023-10-08T12:49:32.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.511+0000 7f19f8ff9700 10 client.26615 handle_command_reply: tid=0 2023-10-08T12:49:32.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.511+0000 7f1a2ad4db80 1 client.26615 shutdown 2023-10-08T12:49:32.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.511+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/4205071866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 msgr2=0x56194a6eafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:32.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.511+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6eafb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1a00016010 tx=0x7f1a00005a00 comp rx=0 tx=0).stop 2023-10-08T12:49:32.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.512+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/4205071866 shutdown_connections 2023-10-08T12:49:32.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.512+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56194a74aa50 0x56194a74ce70 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.512+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56194a6dd650 0x56194a6eb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.512+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56194a6d1e80 0x56194a6ec9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.512+0000 7f19f8ff9700 0 client.26615 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:32.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.512+0000 7f1a2ad4db80 1 --2- 172.21.15.59:0/4205071866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56194a6d27a0 0x56194a6eafb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.512+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/4205071866 >> 172.21.15.59:0/4205071866 conn(0x56194a647260 msgr2=0x56194a6d9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:32.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.512+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/4205071866 shutdown_connections 2023-10-08T12:49:32.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.512+0000 7f1a2ad4db80 1 -- 172.21.15.59:0/4205071866 wait complete. 2023-10-08T12:49:32.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.512+0000 7f1a2ad4db80 20 client.26615 trim_cache size 0 max 16384 2023-10-08T12:49:32.519 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:49:32.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.513+0000 7f1a173ff700 1 -- 172.21.15.59:0/2824969322 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19fc0a1670 msgr2=0x7f19fc0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:32.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.513+0000 7f1a173ff700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19fc0a1670 0x7f19fc0a3b30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1a00014660 tx=0x7f1a00014a20 comp rx=0 tx=0).stop 2023-10-08T12:49:32.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.513+0000 7f1a173ff700 1 -- 172.21.15.59:0/2824969322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a10108950 msgr2=0x7f1a1019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:32.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.513+0000 7f1a173ff700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a10108950 0x7f1a1019d690 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800efc0 tx=0x7f1a0800c3a0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.513+0000 7f1a173ff700 1 -- 172.21.15.59:0/2824969322 shutdown_connections 2023-10-08T12:49:32.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.513+0000 7f1a173ff700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19fc0a1670 0x7f19fc0a3b30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.513+0000 7f1a173ff700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a10108950 0x7f1a1019d690 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.513+0000 7f1a173ff700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a10102940 0x7f1a10198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.513+0000 7f1a173ff700 1 --2- 172.21.15.59:0/2824969322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a10103300 0x7f1a101992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:32.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.513+0000 7f1a173ff700 1 -- 172.21.15.59:0/2824969322 >> 172.21.15.59:0/2824969322 conn(0x7f1a100fe3d0 msgr2=0x7f1a100fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:32.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.513+0000 7f1a173ff700 1 -- 172.21.15.59:0/2824969322 shutdown_connections 2023-10-08T12:49:32.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:32.514+0000 7f1a173ff700 1 -- 172.21.15.59:0/2824969322 wait complete. 2023-10-08T12:49:32.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1061956 13.25 MB/sec execute 303 sec latency 20.638 ms 2023-10-08T12:49:33.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:32 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4234770727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:49:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:32 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4234770727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:49:33.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:32 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4234770727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:49:33.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1063815 13.24 MB/sec execute 304 sec latency 21.033 ms 2023-10-08T12:49:33.534 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:49:33.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:49:33.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.755+0000 7f60235ff700 1 -- 172.21.15.59:0/4020949797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c103300 msgr2=0x7f601c10f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:33.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.755+0000 7f60235ff700 1 --2- 172.21.15.59:0/4020949797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c103300 0x7f601c10f810 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f601400b0a0 tx=0x7f601400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.755+0000 7f60235ff700 1 -- 172.21.15.59:0/4020949797 shutdown_connections 2023-10-08T12:49:33.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.755+0000 7f60235ff700 1 --2- 172.21.15.59:0/4020949797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c103300 0x7f601c10f810 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.755+0000 7f60235ff700 1 --2- 172.21.15.59:0/4020949797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f601c108950 0x7f601c108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.755+0000 7f60235ff700 1 --2- 172.21.15.59:0/4020949797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f601c102940 0x7f601c102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.755+0000 7f60235ff700 1 -- 172.21.15.59:0/4020949797 >> 172.21.15.59:0/4020949797 conn(0x7f601c0fe3d0 msgr2=0x7f601c1007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:33.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.755+0000 7f60235ff700 1 -- 172.21.15.59:0/4020949797 shutdown_connections 2023-10-08T12:49:33.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.755+0000 7f60235ff700 1 -- 172.21.15.59:0/4020949797 wait complete. 2023-10-08T12:49:33.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.756+0000 7f60235ff700 1 Processor -- start 2023-10-08T12:49:33.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.756+0000 7f60235ff700 1 -- start start 2023-10-08T12:49:33.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f60235ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f601c102940 0x7f601c19ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f60235ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c103300 0x7f601c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f60235ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f601c108950 0x7f601c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f60235ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c1992e0 con 0x7f601c108950 2023-10-08T12:49:33.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f60235ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c199450 con 0x7f601c103300 2023-10-08T12:49:33.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f60235ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c199610 con 0x7f601c102940 2023-10-08T12:49:33.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f6020b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c103300 0x7f601c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f6021b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f601c108950 0x7f601c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f6020b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c103300 0x7f601c19efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41546/0 (socket says 172.21.15.59:41546) 2023-10-08T12:49:33.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f6020b9a700 1 -- 172.21.15.59:0/2965734634 learned_addr learned my addr 172.21.15.59:0/2965734634 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:33.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f602139b700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f601c102940 0x7f601c19ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f6020b9a700 1 -- 172.21.15.59:0/2965734634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f601c102940 msgr2=0x7f601c19ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:33.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f6020b9a700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f601c102940 0x7f601c19ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f6020b9a700 1 -- 172.21.15.59:0/2965734634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f601c108950 msgr2=0x7f601c198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:33.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f6020b9a700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f601c108950 0x7f601c198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.757+0000 7f6020b9a700 1 -- 172.21.15.59:0/2965734634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014009d00 con 0x7f601c103300 2023-10-08T12:49:33.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.758+0000 7f6020b9a700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c103300 0x7f601c19efb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f600c00e9a0 tx=0x7f600c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:33.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.758+0000 7f60127fc700 1 -- 172.21.15.59:0/2965734634 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c009790 con 0x7f601c103300 2023-10-08T12:49:33.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.758+0000 7f60127fc700 1 -- 172.21.15.59:0/2965734634 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f600c010430 con 0x7f601c103300 2023-10-08T12:49:33.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.758+0000 7f60127fc700 1 -- 172.21.15.59:0/2965734634 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c018680 con 0x7f601c103300 2023-10-08T12:49:33.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.758+0000 7f60235ff700 1 -- 172.21.15.59:0/2965734634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c1998f0 con 0x7f601c103300 2023-10-08T12:49:33.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.758+0000 7f60235ff700 1 -- 172.21.15.59:0/2965734634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c1a59f0 con 0x7f601c103300 2023-10-08T12:49:33.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.762+0000 7f60127fc700 1 -- 172.21.15.59:0/2965734634 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f600c0105a0 con 0x7f601c103300 2023-10-08T12:49:33.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.763+0000 7f60127fc700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f60080a15f0 0x7f60080a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.763+0000 7f60127fc700 1 -- 172.21.15.59:0/2965734634 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f600c014070 con 0x7f601c103300 2023-10-08T12:49:33.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.763+0000 7f6036f79b80 1 Processor -- start 2023-10-08T12:49:33.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.763+0000 7f602139b700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f60080a15f0 0x7f60080a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f6036f79b80 1 -- start start 2023-10-08T12:49:33.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2cf00 0x55a74af2d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af2d820 0x55a74af38190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af386d0 0x55a74af3aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f6036f79b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74ae964e0 con 0x55a74af2d820 2023-10-08T12:49:33.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f6036f79b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74ae87ca0 con 0x55a74af2cf00 2023-10-08T12:49:33.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f6036f79b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74ae855c0 con 0x55a74af386d0 2023-10-08T12:49:33.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f602139b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2cf00 0x55a74af2d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f602139b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2cf00 0x55a74af2d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41552/0 (socket says 172.21.15.59:41552) 2023-10-08T12:49:33.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f6020b9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af2d820 0x55a74af38190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f602139b700 1 -- 172.21.15.59:0/2261910337 learned_addr learned my addr 172.21.15.59:0/2261910337 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:33.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f6021b9c700 1 --2- 172.21.15.59:0/2261910337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af386d0 0x55a74af3aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.764+0000 7f602139b700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f60080a15f0 0x7f60080a3ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6018009be0 tx=0x7f6018009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:33.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.765+0000 7f602139b700 1 -- 172.21.15.59:0/2261910337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af386d0 msgr2=0x55a74af3aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:33.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.765+0000 7f602139b700 1 --2- 172.21.15.59:0/2261910337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af386d0 0x55a74af3aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.765+0000 7f602139b700 1 -- 172.21.15.59:0/2261910337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af2d820 msgr2=0x55a74af38190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:33.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.765+0000 7f602139b700 1 --2- 172.21.15.59:0/2261910337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af2d820 0x55a74af38190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.765+0000 7f602139b700 1 -- 172.21.15.59:0/2261910337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a74acabe60 con 0x55a74af2cf00 2023-10-08T12:49:33.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.765+0000 7f602139b700 1 --2- 172.21.15.59:0/2261910337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2cf00 0x55a74af2d2e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6018011d40 tx=0x7f6018014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7af5a7cf3fe376da server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:33.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.765+0000 7f60077fe700 1 -- 172.21.15.59:0/2261910337 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018011d70 con 0x55a74af2cf00 2023-10-08T12:49:33.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.765+0000 7f60077fe700 1 -- 172.21.15.59:0/2261910337 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6018004020 con 0x55a74af2cf00 2023-10-08T12:49:33.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.765+0000 7f60077fe700 1 -- 172.21.15.59:0/2261910337 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018003b40 con 0x55a74af2cf00 2023-10-08T12:49:33.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.766+0000 7f6036f79b80 1 -- 172.21.15.59:0/2261910337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2cf00 msgr2=0x55a74af2d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:33.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.766+0000 7f6036f79b80 1 --2- 172.21.15.59:0/2261910337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2cf00 0x55a74af2d2e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6018011d40 tx=0x7f6018014000 comp rx=0 tx=0).stop 2023-10-08T12:49:33.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.766+0000 7f6036f79b80 1 -- 172.21.15.59:0/2261910337 shutdown_connections 2023-10-08T12:49:33.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.766+0000 7f6036f79b80 1 --2- 172.21.15.59:0/2261910337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2cf00 0x55a74af2d2e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.766+0000 7f6036f79b80 1 --2- 172.21.15.59:0/2261910337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af386d0 0x55a74af3aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.766+0000 7f6036f79b80 1 --2- 172.21.15.59:0/2261910337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af2d820 0x55a74af38190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.766+0000 7f6036f79b80 1 -- 172.21.15.59:0/2261910337 >> 172.21.15.59:0/2261910337 conn(0x55a74aea22e0 msgr2=0x55a74af29350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:33.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.766+0000 7f6036f79b80 1 -- 172.21.15.59:0/2261910337 shutdown_connections 2023-10-08T12:49:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.766+0000 7f6036f79b80 1 -- 172.21.15.59:0/2261910337 wait complete. 2023-10-08T12:49:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.767+0000 7f6036f79b80 1 -- start start 2023-10-08T12:49:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.767+0000 7f6036f79b80 1 Processor -- start 2023-10-08T12:49:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.767+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af2cf00 0x55a74af38190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.767+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af35480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.767+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af386d0 0x55a74af35bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.767+0000 7f6036f79b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74ae80eb0 con 0x55a74af2cf00 2023-10-08T12:49:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.767+0000 7f6036f79b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74ae1d790 con 0x55a74af2d820 2023-10-08T12:49:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.767+0000 7f6036f79b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74ae1d430 con 0x55a74af386d0 2023-10-08T12:49:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.767+0000 7f6036f79b80 10 client.0 _ll_register_callbacks cb 0x55a74ac7a880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6020b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af35480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f602139b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af2cf00 0x55a74af38190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6020b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af35480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41564/0 (socket says 172.21.15.59:41564) 2023-10-08T12:49:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6020b9a700 1 -- 172.21.15.59:0/3647168595 learned_addr learned my addr 172.21.15.59:0/3647168595 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6021b9c700 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af386d0 0x55a74af35bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6020b9a700 1 -- 172.21.15.59:0/3647168595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af386d0 msgr2=0x55a74af35bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6020b9a700 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af386d0 0x55a74af35bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6020b9a700 1 -- 172.21.15.59:0/3647168595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af2cf00 msgr2=0x55a74af38190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6020b9a700 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af2cf00 0x55a74af38190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6020b9a700 1 -- 172.21.15.59:0/3647168595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6018017070 con 0x55a74af2d820 2023-10-08T12:49:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6020b9a700 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af35480 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f600c0caa70 tx=0x7f600c09a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0b359e15adaac1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6004ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:49:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6004ff9700 1 -- 172.21.15.59:0/3647168595 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c0a2630 con 0x55a74af2d820 2023-10-08T12:49:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6004ff9700 1 -- 172.21.15.59:0/3647168595 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f600c010880 con 0x55a74af2d820 2023-10-08T12:49:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.768+0000 7f6036f79b80 1 -- 172.21.15.59:0/3647168595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a74ae48f30 con 0x55a74af2d820 2023-10-08T12:49:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f6004ff9700 1 -- 172.21.15.59:0/3647168595 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f600c099790 con 0x55a74af2d820 2023-10-08T12:49:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f6036f79b80 10 client.26627 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f6036f79b80 1 -- 172.21.15.59:0/3647168595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55a74ac94ce0 con 0x55a74af2d820 2023-10-08T12:49:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f6004ff9700 1 -- 172.21.15.59:0/3647168595 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a74ae48f30 con 0x55a74af2d820 2023-10-08T12:49:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f6004ff9700 1 -- 172.21.15.59:0/3647168595 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f600c099200 con 0x55a74af2d820 2023-10-08T12:49:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f6036f79b80 10 client.26627 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f6036f79b80 10 client.26627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f6036f79b80 20 client.26627 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f6036f79b80 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a74af482c0 0x55a74af4a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f6036f79b80 4 client.26627 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:49:33.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f6036f79b80 1 -- 172.21.15.59:0/3647168595 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a74ae79e90 con 0x55a74af482c0 2023-10-08T12:49:33.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.769+0000 7f602139b700 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a74af482c0 0x55a74af4a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.770+0000 7f602139b700 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a74af482c0 0x55a74af4a6e0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d47bf32b5946f785 server_cookie=5de24d0870d704db in_seq=0 out_seq=0 2023-10-08T12:49:33.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.770+0000 7f6004ff9700 10 client.26627 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:33.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6004ff9700 1 -- 172.21.15.59:0/3647168595 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a74ae79e90 con 0x55a74af482c0 2023-10-08T12:49:33.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6004ff9700 10 client.26627 handle_command_reply: tid=0 2023-10-08T12:49:33.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6036f79b80 1 client.26627 shutdown 2023-10-08T12:49:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6036f79b80 1 -- 172.21.15.59:0/3647168595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 msgr2=0x55a74af35480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6036f79b80 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af35480 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f600c0caa70 tx=0x7f600c09a2a0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6036f79b80 1 -- 172.21.15.59:0/3647168595 shutdown_connections 2023-10-08T12:49:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6036f79b80 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a74af482c0 0x55a74af4a6e0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6036f79b80 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af386d0 0x55a74af35bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6036f79b80 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af2cf00 0x55a74af38190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6004ff9700 0 client.26627 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6036f79b80 1 --2- 172.21.15.59:0/3647168595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af35480 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6036f79b80 1 -- 172.21.15.59:0/3647168595 >> 172.21.15.59:0/3647168595 conn(0x55a74aea22e0 msgr2=0x55a74af28f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:33.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6036f79b80 1 -- 172.21.15.59:0/3647168595 shutdown_connections 2023-10-08T12:49:33.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.772+0000 7f6036f79b80 1 -- 172.21.15.59:0/3647168595 wait complete. 2023-10-08T12:49:33.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.773+0000 7f6036f79b80 20 client.26627 trim_cache size 0 max 16384 2023-10-08T12:49:33.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.792+0000 7f6036f79b80 1 Processor -- start 2023-10-08T12:49:33.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.792+0000 7f6036f79b80 1 -- start start 2023-10-08T12:49:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.792+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 0x55a74af35420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.792+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af2fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.792+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 0x55a74af3f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.792+0000 7f6036f79b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74ad019a0 con 0x55a74af386d0 2023-10-08T12:49:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.792+0000 7f6036f79b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74af459d0 con 0x55a74af2d820 2023-10-08T12:49:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.792+0000 7f6036f79b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74af47fe0 con 0x55a74af2cf00 2023-10-08T12:49:33.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f6021b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 0x55a74af3f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f6021b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 0x55a74af3f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58702/0 (socket says 172.21.15.59:58702) 2023-10-08T12:49:33.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f6020b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af2fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f6021b9c700 1 -- 172.21.15.59:0/2748218735 learned_addr learned my addr 172.21.15.59:0/2748218735 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:33.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f602139b700 1 --2- 172.21.15.59:0/2748218735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 0x55a74af35420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f6021b9c700 1 -- 172.21.15.59:0/2748218735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 msgr2=0x55a74af35420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:33.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f6021b9c700 1 --2- 172.21.15.59:0/2748218735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 0x55a74af35420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f6021b9c700 1 -- 172.21.15.59:0/2748218735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 msgr2=0x55a74af2fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:33.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f6021b9c700 1 --2- 172.21.15.59:0/2748218735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af2fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f6021b9c700 1 -- 172.21.15.59:0/2748218735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a74acd22d0 con 0x55a74af386d0 2023-10-08T12:49:33.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f6020b9a700 1 --2- 172.21.15.59:0/2748218735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af2fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.793+0000 7f6021b9c700 1 --2- 172.21.15.59:0/2748218735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 0x55a74af3f220 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f60140095c0 tx=0x7f6014007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbb1452337c32a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.794+0000 7f6007fff700 1 -- 172.21.15.59:0/2748218735 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400e040 con 0x55a74af386d0 2023-10-08T12:49:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.794+0000 7f6007fff700 1 -- 172.21.15.59:0/2748218735 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6014003a00 con 0x55a74af386d0 2023-10-08T12:49:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.794+0000 7f6007fff700 1 -- 172.21.15.59:0/2748218735 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014005040 con 0x55a74af386d0 2023-10-08T12:49:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.794+0000 7f6036f79b80 1 -- 172.21.15.59:0/2748218735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 msgr2=0x55a74af3f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.794+0000 7f6036f79b80 1 --2- 172.21.15.59:0/2748218735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 0x55a74af3f220 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f60140095c0 tx=0x7f6014007b80 comp rx=0 tx=0).stop 2023-10-08T12:49:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.795+0000 7f6036f79b80 1 -- 172.21.15.59:0/2748218735 shutdown_connections 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.795+0000 7f6036f79b80 1 --2- 172.21.15.59:0/2748218735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 0x55a74af3f220 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.795+0000 7f6036f79b80 1 --2- 172.21.15.59:0/2748218735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 0x55a74af35420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.795+0000 7f6036f79b80 1 --2- 172.21.15.59:0/2748218735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af2fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.795+0000 7f6036f79b80 1 -- 172.21.15.59:0/2748218735 >> 172.21.15.59:0/2748218735 conn(0x55a74aea22e0 msgr2=0x55a74af34d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.795+0000 7f6036f79b80 1 -- 172.21.15.59:0/2748218735 shutdown_connections 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.795+0000 7f6036f79b80 1 -- 172.21.15.59:0/2748218735 wait complete. 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.795+0000 7f6036f79b80 1 -- start start 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.795+0000 7f6036f79b80 1 Processor -- start 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 0x55a74af92090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af925d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f6036f79b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 0x55a74af92b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f6036f79b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74af9d1f0 con 0x55a74af386d0 2023-10-08T12:49:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f6036f79b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74af9d360 con 0x55a74af2d820 2023-10-08T12:49:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f6036f79b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74af9d520 con 0x55a74af2cf00 2023-10-08T12:49:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f6036f79b80 10 client.0 _ll_register_callbacks cb 0x7f600c099cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f602139b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 0x55a74af92090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f6021b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 0x55a74af92b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f602139b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 0x55a74af92090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41420/0 (socket says 172.21.15.59:41420) 2023-10-08T12:49:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f6021b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 0x55a74af92b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58706/0 (socket says 172.21.15.59:58706) 2023-10-08T12:49:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f602139b700 1 -- 172.21.15.59:0/452884971 learned_addr learned my addr 172.21.15.59:0/452884971 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f6020b9a700 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af925d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f602139b700 1 -- 172.21.15.59:0/452884971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 msgr2=0x55a74af925d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f602139b700 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af925d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f602139b700 1 -- 172.21.15.59:0/452884971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 msgr2=0x55a74af92b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f602139b700 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 0x55a74af92b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.796+0000 7f602139b700 1 -- 172.21.15.59:0/452884971 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a74ac94ce0 con 0x55a74af2cf00 2023-10-08T12:49:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.797+0000 7f602139b700 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 0x55a74af92090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6018011d10 tx=0x7f6018003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=507706592aa8b9dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.797+0000 7f6004ff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:49:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.797+0000 7f6004ff9700 1 -- 172.21.15.59:0/452884971 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601802c040 con 0x55a74af2cf00 2023-10-08T12:49:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.797+0000 7f6036f79b80 1 -- 172.21.15.59:0/452884971 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6018004020 con 0x55a74af2cf00 2023-10-08T12:49:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.797+0000 7f6004ff9700 1 -- 172.21.15.59:0/452884971 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f601800eaa0 con 0x55a74af2cf00 2023-10-08T12:49:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.797+0000 7f6004ff9700 1 -- 172.21.15.59:0/452884971 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f601800ec60 con 0x55a74af2cf00 2023-10-08T12:49:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.797+0000 7f6036f79b80 10 client.26623 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.797+0000 7f6036f79b80 1 -- 172.21.15.59:0/452884971 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f601c110110 con 0x55a74af2cf00 2023-10-08T12:49:33.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.798+0000 7f6004ff9700 1 -- 172.21.15.59:0/452884971 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6018043020 con 0x55a74af2cf00 2023-10-08T12:49:33.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.798+0000 7f6004ff9700 1 -- 172.21.15.59:0/452884971 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6018024030 con 0x55a74af2cf00 2023-10-08T12:49:33.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.798+0000 7f6036f79b80 10 client.26623 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:33.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.798+0000 7f6036f79b80 10 client.26623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:33.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.798+0000 7f6036f79b80 20 client.26623 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:33.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.798+0000 7f6036f79b80 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a74af9ed00 0x55a74afa1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:33.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.798+0000 7f6036f79b80 4 client.26623 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:49:33.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.798+0000 7f6036f79b80 1 -- 172.21.15.59:0/452884971 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a74ae79bb0 con 0x55a74af9ed00 2023-10-08T12:49:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.826+0000 7f6020b9a700 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a74af9ed00 0x55a74afa1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.826+0000 7f6020b9a700 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a74af9ed00 0x55a74afa1120 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d72bed45ad39f70 server_cookie=2a084dfee650b720 in_seq=0 out_seq=0 2023-10-08T12:49:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.826+0000 7f6004ff9700 10 client.26623 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6004ff9700 1 -- 172.21.15.59:0/452884971 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a74ae79bb0 con 0x55a74af9ed00 2023-10-08T12:49:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6004ff9700 10 client.26623 handle_command_reply: tid=0 2023-10-08T12:49:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 1 client.26623 shutdown 2023-10-08T12:49:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 1 -- 172.21.15.59:0/452884971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 msgr2=0x55a74af92090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 0x55a74af92090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6018011d10 tx=0x7f6018003680 comp rx=0 tx=0).stop 2023-10-08T12:49:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 1 -- 172.21.15.59:0/452884971 shutdown_connections 2023-10-08T12:49:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a74af9ed00 0x55a74afa1120 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6004ff9700 0 client.26623 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a74af386d0 0x55a74af92b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a74af2cf00 0x55a74af92090 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 1 --2- 172.21.15.59:0/452884971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a74af2d820 0x55a74af925d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 1 -- 172.21.15.59:0/452884971 >> 172.21.15.59:0/452884971 conn(0x55a74aea22e0 msgr2=0x55a74af33d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 1 -- 172.21.15.59:0/452884971 shutdown_connections 2023-10-08T12:49:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 1 -- 172.21.15.59:0/452884971 wait complete. 2023-10-08T12:49:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.827+0000 7f6036f79b80 20 client.26623 trim_cache size 0 max 16384 2023-10-08T12:49:33.830 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:49:33.830 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:49:33.830 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "bab0730b-4238-4676-bc6f-1656708dcc8b", 2023-10-08T12:49:33.830 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:49:33.830 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:49:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 -- 172.21.15.59:0/2965734634 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f60080a15f0 msgr2=0x7f60080a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f60080a15f0 0x7f60080a3ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6018009be0 tx=0x7f6018009260 comp rx=0 tx=0).stop 2023-10-08T12:49:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 -- 172.21.15.59:0/2965734634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c103300 msgr2=0x7f601c19efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c103300 0x7f601c19efb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f600c00e9a0 tx=0x7f600c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 -- 172.21.15.59:0/2965734634 shutdown_connections 2023-10-08T12:49:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f60080a15f0 0x7f60080a3ab0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f601c108950 0x7f601c198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f601c102940 0x7f601c19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 --2- 172.21.15.59:0/2965734634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c103300 0x7f601c19efb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 -- 172.21.15.59:0/2965734634 >> 172.21.15.59:0/2965734634 conn(0x7f601c0fe3d0 msgr2=0x7f601c0fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 -- 172.21.15.59:0/2965734634 shutdown_connections 2023-10-08T12:49:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:33.828+0000 7f60235ff700 1 -- 172.21.15.59:0/2965734634 wait complete. 2023-10-08T12:49:33.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:49:34.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.075+0000 7fa640fff700 1 -- 172.21.15.59:0/1495525569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa63c100730 msgr2=0x7fa63c100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:34.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.075+0000 7fa640fff700 1 --2- 172.21.15.59:0/1495525569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa63c100730 0x7fa63c100bb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa630009990 tx=0x7fa630009ca0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.075+0000 7fa640fff700 1 -- 172.21.15.59:0/1495525569 shutdown_connections 2023-10-08T12:49:34.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.075+0000 7fa640fff700 1 --2- 172.21.15.59:0/1495525569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa63c1010f0 0x7fa63c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.075+0000 7fa640fff700 1 --2- 172.21.15.59:0/1495525569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa63c106740 0x7fa63c106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.075+0000 7fa640fff700 1 --2- 172.21.15.59:0/1495525569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa63c100730 0x7fa63c100bb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.075+0000 7fa640fff700 1 -- 172.21.15.59:0/1495525569 >> 172.21.15.59:0/1495525569 conn(0x7fa63c0fc200 msgr2=0x7fa63c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:34.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.075+0000 7fa640fff700 1 -- 172.21.15.59:0/1495525569 shutdown_connections 2023-10-08T12:49:34.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.075+0000 7fa640fff700 1 -- 172.21.15.59:0/1495525569 wait complete. 2023-10-08T12:49:34.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.076+0000 7fa640fff700 1 Processor -- start 2023-10-08T12:49:34.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa640fff700 1 -- start start 2023-10-08T12:49:34.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa640fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa63c100730 0x7fa63c19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa640fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa63c1010f0 0x7fa63c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa640fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa63c106740 0x7fa63c1969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa640fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c197040 con 0x7fa63c1010f0 2023-10-08T12:49:34.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa640fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c1971b0 con 0x7fa63c106740 2023-10-08T12:49:34.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa640fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c197370 con 0x7fa63c100730 2023-10-08T12:49:34.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa63a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa63c100730 0x7fa63c19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa63ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa63c106740 0x7fa63c1969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa639d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa63c1010f0 0x7fa63c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa63ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa63c106740 0x7fa63c1969e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41596/0 (socket says 172.21.15.59:41596) 2023-10-08T12:49:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa63a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa63c100730 0x7fa63c19c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41450/0 (socket says 172.21.15.59:41450) 2023-10-08T12:49:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.077+0000 7fa63ad9d700 1 -- 172.21.15.59:0/2466040153 learned_addr learned my addr 172.21.15.59:0/2466040153 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.078+0000 7fa63ad9d700 1 -- 172.21.15.59:0/2466040153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa63c100730 msgr2=0x7fa63c19c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.078+0000 7fa63ad9d700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa63c100730 0x7fa63c19c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.078+0000 7fa63ad9d700 1 -- 172.21.15.59:0/2466040153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa63c1010f0 msgr2=0x7fa63c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.078+0000 7fa63ad9d700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa63c1010f0 0x7fa63c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.078+0000 7fa63ad9d700 1 -- 172.21.15.59:0/2466040153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6300095f0 con 0x7fa63c106740 2023-10-08T12:49:34.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.078+0000 7fa63ad9d700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa63c106740 0x7fa63c1969e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa63400e940 tx=0x7fa63400ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:34.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.078+0000 7fa62b7fe700 1 -- 172.21.15.59:0/2466040153 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6340097b0 con 0x7fa63c106740 2023-10-08T12:49:34.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.078+0000 7fa62b7fe700 1 -- 172.21.15.59:0/2466040153 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa634005020 con 0x7fa63c106740 2023-10-08T12:49:34.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.078+0000 7fa62b7fe700 1 -- 172.21.15.59:0/2466040153 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63400cc40 con 0x7fa63c106740 2023-10-08T12:49:34.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.078+0000 7fa640fff700 1 -- 172.21.15.59:0/2466040153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c197650 con 0x7fa63c106740 2023-10-08T12:49:34.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.079+0000 7fa640fff700 1 -- 172.21.15.59:0/2466040153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c1a38a0 con 0x7fa63c106740 2023-10-08T12:49:34.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.082+0000 7fa62b7fe700 1 -- 172.21.15.59:0/2466040153 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa634005400 con 0x7fa63c106740 2023-10-08T12:49:34.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.084+0000 7fa6549b6b80 1 Processor -- start 2023-10-08T12:49:34.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.084+0000 7fa6549b6b80 1 -- start start 2023-10-08T12:49:34.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.084+0000 7fa62b7fe700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6240a1670 0x7fa6240a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.084+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e981e80 0x56122e982260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.084+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e9827a0 0x56122e98d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.084+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e98d650 0x56122e98fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.084+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e8eb460 con 0x56122e981e80 2023-10-08T12:49:34.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.084+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e8dcc20 con 0x56122e98d650 2023-10-08T12:49:34.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.084+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e8da540 con 0x56122e9827a0 2023-10-08T12:49:34.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.084+0000 7fa62b7fe700 1 -- 172.21.15.59:0/2466040153 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa634014070 con 0x7fa63c106740 2023-10-08T12:49:34.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa63ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e98d650 0x56122e98fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa63ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e98d650 0x56122e98fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41612/0 (socket says 172.21.15.59:41612) 2023-10-08T12:49:34.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa63ad9d700 1 -- 172.21.15.59:0/767815308 learned_addr learned my addr 172.21.15.59:0/767815308 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:34.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa639d9b700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6240a1670 0x7fa6240a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa63a59c700 1 --2- 172.21.15.59:0/767815308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e981e80 0x56122e982260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa639d9b700 1 --2- 172.21.15.59:0/767815308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e9827a0 0x56122e98d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa63ad9d700 1 -- 172.21.15.59:0/767815308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e9827a0 msgr2=0x56122e98d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:34.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa63ad9d700 1 --2- 172.21.15.59:0/767815308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e9827a0 0x56122e98d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa63ad9d700 1 -- 172.21.15.59:0/767815308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e981e80 msgr2=0x56122e982260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:34.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa63ad9d700 1 --2- 172.21.15.59:0/767815308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e981e80 0x56122e982260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa63ad9d700 1 -- 172.21.15.59:0/767815308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56122e700de0 con 0x56122e98d650 2023-10-08T12:49:34.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa63a59c700 1 --2- 172.21.15.59:0/767815308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e981e80 0x56122e982260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:49:34.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa63ad9d700 1 --2- 172.21.15.59:0/767815308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e98d650 0x56122e98fa40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa634009fd0 tx=0x7fa634099ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50f0bfb797b3ab2a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:34.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa628ff9700 1 -- 172.21.15.59:0/767815308 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6340b1020 con 0x56122e98d650 2023-10-08T12:49:34.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.085+0000 7fa628ff9700 1 -- 172.21.15.59:0/767815308 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa63409e170 con 0x56122e98d650 2023-10-08T12:49:34.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.086+0000 7fa628ff9700 1 -- 172.21.15.59:0/767815308 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63409a6f0 con 0x56122e98d650 2023-10-08T12:49:34.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.086+0000 7fa6549b6b80 1 -- 172.21.15.59:0/767815308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e98d650 msgr2=0x56122e98fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:34.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.086+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/767815308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e98d650 0x56122e98fa40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa634009fd0 tx=0x7fa634099ec0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.086+0000 7fa639d9b700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6240a1670 0x7fa6240a3b30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa63c197ba0 tx=0x7fa63000b610 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:34.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.086+0000 7fa6549b6b80 1 -- 172.21.15.59:0/767815308 shutdown_connections 2023-10-08T12:49:34.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.086+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/767815308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e98d650 0x56122e98fa40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.086+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/767815308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e981e80 0x56122e982260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.086+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/767815308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e9827a0 0x56122e98d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.086+0000 7fa6549b6b80 1 -- 172.21.15.59:0/767815308 >> 172.21.15.59:0/767815308 conn(0x56122e8f7260 msgr2=0x56122e97e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:34.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.086+0000 7fa6549b6b80 1 -- 172.21.15.59:0/767815308 shutdown_connections 2023-10-08T12:49:34.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.087+0000 7fa6549b6b80 1 -- 172.21.15.59:0/767815308 wait complete. 2023-10-08T12:49:34.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.087+0000 7fa6549b6b80 1 -- start start 2023-10-08T12:49:34.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.087+0000 7fa6549b6b80 1 Processor -- start 2023-10-08T12:49:34.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e98d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e9827a0 0x56122e98a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e98d650 0x56122e98ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e8d5e30 con 0x56122e98d650 2023-10-08T12:49:34.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e872710 con 0x56122e981e80 2023-10-08T12:49:34.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e8723b0 con 0x56122e9827a0 2023-10-08T12:49:34.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa6549b6b80 10 client.0 _ll_register_callbacks cb 0x56122e6cf800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:34.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa63a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e98d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa63a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e98d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41622/0 (socket says 172.21.15.59:41622) 2023-10-08T12:49:34.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa63a59c700 1 -- 172.21.15.59:0/1977408761 learned_addr learned my addr 172.21.15.59:0/1977408761 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:34.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa639d9b700 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e9827a0 0x56122e98a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.088+0000 7fa63ad9d700 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e98d650 0x56122e98ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.089+0000 7fa63a59c700 1 -- 172.21.15.59:0/1977408761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e9827a0 msgr2=0x56122e98a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:34.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.089+0000 7fa63a59c700 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e9827a0 0x56122e98a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.089+0000 7fa63a59c700 1 -- 172.21.15.59:0/1977408761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e98d650 msgr2=0x56122e98ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:34.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.089+0000 7fa63a59c700 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e98d650 0x56122e98ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.089+0000 7fa63a59c700 1 -- 172.21.15.59:0/1977408761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c1a38a0 con 0x56122e981e80 2023-10-08T12:49:34.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.089+0000 7fa63a59c700 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e98d0f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa62c007c60 tx=0x7fa62c007c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5dea22cff5bb658 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:34.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.089+0000 7fa621ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:49:34.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.089+0000 7fa621ffb700 1 -- 172.21.15.59:0/1977408761 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00e040 con 0x56122e981e80 2023-10-08T12:49:34.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.089+0000 7fa621ffb700 1 -- 172.21.15.59:0/1977408761 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa62c013bb0 con 0x56122e981e80 2023-10-08T12:49:34.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.089+0000 7fa6549b6b80 1 -- 172.21.15.59:0/1977408761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56122e89deb0 con 0x56122e981e80 2023-10-08T12:49:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.089+0000 7fa621ffb700 1 -- 172.21.15.59:0/1977408761 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa62c013d70 con 0x56122e981e80 2023-10-08T12:49:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.090+0000 7fa6549b6b80 10 client.26645 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.090+0000 7fa6549b6b80 1 -- 172.21.15.59:0/1977408761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56122e6e9c60 con 0x56122e981e80 2023-10-08T12:49:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.090+0000 7fa621ffb700 1 -- 172.21.15.59:0/1977408761 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56122e89deb0 con 0x56122e981e80 2023-10-08T12:49:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.090+0000 7fa621ffb700 1 -- 172.21.15.59:0/1977408761 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa62c01e570 con 0x56122e981e80 2023-10-08T12:49:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.090+0000 7fa6549b6b80 10 client.26645 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.090+0000 7fa6549b6b80 10 client.26645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.090+0000 7fa6549b6b80 20 client.26645 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:34.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.090+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56122e99d2d0 0x56122e99f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.090+0000 7fa6549b6b80 4 client.26645 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:49:34.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.090+0000 7fa6549b6b80 1 -- 172.21.15.59:0/1977408761 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56122e8cee10 con 0x56122e99d2d0 2023-10-08T12:49:34.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.091+0000 7fa639d9b700 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56122e99d2d0 0x56122e99f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.091+0000 7fa639d9b700 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56122e99d2d0 0x56122e99f6f0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c63e97ed55fe7ac server_cookie=d734a91b27c561b0 in_seq=0 out_seq=0 2023-10-08T12:49:34.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.091+0000 7fa621ffb700 10 client.26645 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:34.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa621ffb700 1 -- 172.21.15.59:0/1977408761 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56122e8cee10 con 0x56122e99d2d0 2023-10-08T12:49:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa621ffb700 10 client.26645 handle_command_reply: tid=0 2023-10-08T12:49:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 1 client.26645 shutdown 2023-10-08T12:49:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 1 -- 172.21.15.59:0/1977408761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 msgr2=0x56122e98d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e98d0f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa62c007c60 tx=0x7fa62c007c90 comp rx=0 tx=0).stop 2023-10-08T12:49:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 1 -- 172.21.15.59:0/1977408761 shutdown_connections 2023-10-08T12:49:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56122e99d2d0 0x56122e99f6f0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e98d0f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e98d650 0x56122e98ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/1977408761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e9827a0 0x56122e98a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa621ffb700 0 client.26645 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 1 -- 172.21.15.59:0/1977408761 >> 172.21.15.59:0/1977408761 conn(0x56122e8f7260 msgr2=0x56122e97dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 1 -- 172.21.15.59:0/1977408761 shutdown_connections 2023-10-08T12:49:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 1 -- 172.21.15.59:0/1977408761 wait complete. 2023-10-08T12:49:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.093+0000 7fa6549b6b80 20 client.26645 trim_cache size 0 max 16384 2023-10-08T12:49:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.112+0000 7fa6549b6b80 1 Processor -- start 2023-10-08T12:49:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.112+0000 7fa6549b6b80 1 -- start start 2023-10-08T12:49:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.112+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e981e80 0x56122e9941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e9827a0 0x56122e985750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e98d650 0x56122e985c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e756920 con 0x56122e98d650 2023-10-08T12:49:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e97aae0 con 0x56122e9827a0 2023-10-08T12:49:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e9824e0 con 0x56122e981e80 2023-10-08T12:49:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa639d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e9827a0 0x56122e985750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa639d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e9827a0 0x56122e985750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41628/0 (socket says 172.21.15.59:41628) 2023-10-08T12:49:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa639d9b700 1 -- 172.21.15.59:0/929977516 learned_addr learned my addr 172.21.15.59:0/929977516 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa63ad9d700 1 --2- 172.21.15.59:0/929977516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e98d650 0x56122e985c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa63a59c700 1 --2- 172.21.15.59:0/929977516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e981e80 0x56122e9941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa639d9b700 1 -- 172.21.15.59:0/929977516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e981e80 msgr2=0x56122e9941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa639d9b700 1 --2- 172.21.15.59:0/929977516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e981e80 0x56122e9941a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa639d9b700 1 -- 172.21.15.59:0/929977516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e98d650 msgr2=0x56122e985c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:34.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa639d9b700 1 --2- 172.21.15.59:0/929977516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e98d650 0x56122e985c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa639d9b700 1 -- 172.21.15.59:0/929977516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56122e727250 con 0x56122e9827a0 2023-10-08T12:49:34.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa63a59c700 1 --2- 172.21.15.59:0/929977516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e981e80 0x56122e9941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:49:34.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.113+0000 7fa63ad9d700 1 --2- 172.21.15.59:0/929977516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e98d650 0x56122e985c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:49:34.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.114+0000 7fa639d9b700 1 --2- 172.21.15.59:0/929977516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e9827a0 0x56122e985750 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa630009990 tx=0x7fa630009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2434ca04faa39ce2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:34.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.114+0000 7fa6297fa700 1 -- 172.21.15.59:0/929977516 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63002f040 con 0x56122e9827a0 2023-10-08T12:49:34.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.114+0000 7fa6297fa700 1 -- 172.21.15.59:0/929977516 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa63001f050 con 0x56122e9827a0 2023-10-08T12:49:34.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.114+0000 7fa6297fa700 1 -- 172.21.15.59:0/929977516 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63001d030 con 0x56122e9827a0 2023-10-08T12:49:34.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.115+0000 7fa6549b6b80 1 -- 172.21.15.59:0/929977516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e9827a0 msgr2=0x56122e985750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:34.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.115+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/929977516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e9827a0 0x56122e985750 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa630009990 tx=0x7fa630009ca0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.115+0000 7fa6549b6b80 1 -- 172.21.15.59:0/929977516 shutdown_connections 2023-10-08T12:49:34.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.115+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/929977516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e98d650 0x56122e985c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.115+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/929977516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e981e80 0x56122e9941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.115+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/929977516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e9827a0 0x56122e985750 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.115+0000 7fa6549b6b80 1 -- 172.21.15.59:0/929977516 >> 172.21.15.59:0/929977516 conn(0x56122e8f7260 msgr2=0x56122e9988f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.115+0000 7fa6549b6b80 1 -- 172.21.15.59:0/929977516 shutdown_connections 2023-10-08T12:49:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.115+0000 7fa6549b6b80 1 -- 172.21.15.59:0/929977516 wait complete. 2023-10-08T12:49:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.115+0000 7fa6549b6b80 1 -- start start 2023-10-08T12:49:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa6549b6b80 1 Processor -- start 2023-10-08T12:49:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e992760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e9827a0 0x56122e992ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa6549b6b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e98d650 0x56122e9931e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e9f98e0 con 0x56122e9827a0 2023-10-08T12:49:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e9f9a20 con 0x56122e981e80 2023-10-08T12:49:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa6549b6b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122e9f9b60 con 0x56122e98d650 2023-10-08T12:49:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa6549b6b80 10 client.0 _ll_register_callbacks cb 0x7fa62c0075e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa63a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e992760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa639d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e9827a0 0x56122e992ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa63a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e992760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41640/0 (socket says 172.21.15.59:41640) 2023-10-08T12:49:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.116+0000 7fa63a59c700 1 -- 172.21.15.59:0/70528006 learned_addr learned my addr 172.21.15.59:0/70528006 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:49:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.117+0000 7fa63ad9d700 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e98d650 0x56122e9931e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.117+0000 7fa63a59c700 1 -- 172.21.15.59:0/70528006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e98d650 msgr2=0x56122e9931e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.117+0000 7fa63a59c700 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e98d650 0x56122e9931e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.117+0000 7fa63a59c700 1 -- 172.21.15.59:0/70528006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e9827a0 msgr2=0x56122e992ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.117+0000 7fa63a59c700 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e9827a0 0x56122e992ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.117+0000 7fa63a59c700 1 -- 172.21.15.59:0/70528006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa630020040 con 0x56122e981e80 2023-10-08T12:49:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.117+0000 7fa63a59c700 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e992760 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00b010 tx=0x7fa62c01ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7baebd122b44e5f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.117+0000 7fa621ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:49:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.117+0000 7fa621ffb700 1 -- 172.21.15.59:0/70528006 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00e070 con 0x56122e981e80 2023-10-08T12:49:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.117+0000 7fa621ffb700 1 -- 172.21.15.59:0/70528006 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa62c003a00 con 0x56122e981e80 2023-10-08T12:49:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.117+0000 7fa6549b6b80 1 -- 172.21.15.59:0/70528006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa63409e170 con 0x56122e981e80 2023-10-08T12:49:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa621ffb700 1 -- 172.21.15.59:0/70528006 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa62c013590 con 0x56122e981e80 2023-10-08T12:49:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa6549b6b80 10 client.26651 fetch_fsmap learned FSMap version 20 2023-10-08T12:49:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa6549b6b80 1 -- 172.21.15.59:0/70528006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56122e6ff2b0 con 0x56122e981e80 2023-10-08T12:49:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa621ffb700 1 -- 172.21.15.59:0/70528006 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa62c038020 con 0x56122e981e80 2023-10-08T12:49:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa621ffb700 1 -- 172.21.15.59:0/70528006 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa62c034690 con 0x56122e981e80 2023-10-08T12:49:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa6549b6b80 10 client.26651 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:49:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa6549b6b80 10 client.26651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa6549b6b80 20 client.26651 populate_metadata read hostname 'smithi059' 2023-10-08T12:49:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56122e9fb330 0x56122e9fd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa6549b6b80 4 client.26651 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:49:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa6549b6b80 1 -- 172.21.15.59:0/70528006 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56122e8ceb30 con 0x56122e9fb330 2023-10-08T12:49:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.118+0000 7fa639d9b700 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56122e9fb330 0x56122e9fd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa639d9b700 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56122e9fb330 0x56122e9fd750 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db6ce8ee28b0d202 server_cookie=61d014b1c0c089a in_seq=0 out_seq=0 2023-10-08T12:49:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa621ffb700 10 client.26651 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa621ffb700 1 -- 172.21.15.59:0/70528006 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56122e8ceb30 con 0x56122e9fb330 2023-10-08T12:49:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa621ffb700 10 client.26651 handle_command_reply: tid=0 2023-10-08T12:49:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa6549b6b80 1 client.26651 shutdown 2023-10-08T12:49:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa6549b6b80 1 -- 172.21.15.59:0/70528006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 msgr2=0x56122e992760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e992760 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00b010 tx=0x7fa62c01ed20 comp rx=0 tx=0).stop 2023-10-08T12:49:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa6549b6b80 1 -- 172.21.15.59:0/70528006 shutdown_connections 2023-10-08T12:49:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56122e9fb330 0x56122e9fd750 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56122e981e80 0x56122e992760 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56122e98d650 0x56122e9931e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa6549b6b80 1 --2- 172.21.15.59:0/70528006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56122e9827a0 0x56122e992ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa621ffb700 0 client.26651 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:49:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa6549b6b80 1 -- 172.21.15.59:0/70528006 >> 172.21.15.59:0/70528006 conn(0x56122e8f7260 msgr2=0x56122e985750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.119+0000 7fa6549b6b80 1 -- 172.21.15.59:0/70528006 shutdown_connections 2023-10-08T12:49:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa6549b6b80 1 -- 172.21.15.59:0/70528006 wait complete. 2023-10-08T12:49:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa6549b6b80 20 client.26651 trim_cache size 0 max 16384 2023-10-08T12:49:34.129 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:49:34.129 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:49:34.129 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:49:34.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bab0730b-4238-4676-bc6f-1656708dcc8b": { 2023-10-08T12:49:34.129 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:49:34.129 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "bab0730b-4238-4676-bc6f-1656708dcc8b", 2023-10-08T12:49:34.129 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:49:34.129 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:49:34.130 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:49:34.130 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:49:34.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa640fff700 1 -- 172.21.15.59:0/2466040153 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6240a1670 msgr2=0x7fa6240a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:34.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa640fff700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6240a1670 0x7fa6240a3b30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa63c197ba0 tx=0x7fa63000b610 comp rx=0 tx=0).stop 2023-10-08T12:49:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa640fff700 1 -- 172.21.15.59:0/2466040153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa63c106740 msgr2=0x7fa63c1969e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa640fff700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa63c106740 0x7fa63c1969e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa63400e940 tx=0x7fa63400ec50 comp rx=0 tx=0).stop 2023-10-08T12:49:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa640fff700 1 -- 172.21.15.59:0/2466040153 shutdown_connections 2023-10-08T12:49:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa640fff700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6240a1670 0x7fa6240a3b30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa640fff700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa63c106740 0x7fa63c1969e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa640fff700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa63c100730 0x7fa63c19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa640fff700 1 --2- 172.21.15.59:0/2466040153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa63c1010f0 0x7fa63c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa640fff700 1 -- 172.21.15.59:0/2466040153 >> 172.21.15.59:0/2466040153 conn(0x7fa63c0fc200 msgr2=0x7fa63c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.120+0000 7fa640fff700 1 -- 172.21.15.59:0/2466040153 shutdown_connections 2023-10-08T12:49:34.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:49:34.121+0000 7fa640fff700 1 -- 172.21.15.59:0/2466040153 wait complete. 2023-10-08T12:49:34.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:33 smithi059 ceph-mon[98489]: pgmap v569: 97 pgs: 97 active+clean; 569 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 248 op/s 2023-10-08T12:49:34.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:33 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:49:34.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:33 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:34.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:33 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:49:34.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:33 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:34.142 INFO:tasks.cephfs.filesystem:scrub status for tag:bab0730b-4238-4676-bc6f-1656708dcc8b - {'path': '/', 'tag': 'bab0730b-4238-4676-bc6f-1656708dcc8b', 'options': 'recursive,force'} 2023-10-08T12:49:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:33 smithi092 ceph-mon[134093]: pgmap v569: 97 pgs: 97 active+clean; 569 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 248 op/s 2023-10-08T12:49:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:33 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:49:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:33 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:33 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:49:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:33 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:33 smithi173 ceph-mon[135182]: pgmap v569: 97 pgs: 97 active+clean; 569 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 248 op/s 2023-10-08T12:49:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:33 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:49:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:33 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:33 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:49:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:33 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:49:34.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1066104 13.24 MB/sec execute 305 sec latency 34.557 ms 2023-10-08T12:49:35.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1067888 13.22 MB/sec execute 306 sec latency 112.435 ms 2023-10-08T12:49:36.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:35 smithi059 ceph-mon[98489]: pgmap v570: 97 pgs: 97 active+clean; 570 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 198 op/s 2023-10-08T12:49:36.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:35 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:49:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:35 smithi092 ceph-mon[134093]: pgmap v570: 97 pgs: 97 active+clean; 570 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 198 op/s 2023-10-08T12:49:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:35 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:49:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:35 smithi173 ceph-mon[135182]: pgmap v570: 97 pgs: 97 active+clean; 570 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 198 op/s 2023-10-08T12:49:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:35 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:49:36.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1069847 13.22 MB/sec execute 307 sec latency 24.645 ms 2023-10-08T12:49:37.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:49:37.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:49:37.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:36 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:49:37.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:49:37.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:49:37.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:36 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:49:37.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:49:37.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:49:37.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:36 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:49:37.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1072253 13.22 MB/sec execute 308 sec latency 16.587 ms 2023-10-08T12:49:38.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:37 smithi059 ceph-mon[98489]: pgmap v571: 97 pgs: 97 active+clean; 579 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 227 op/s 2023-10-08T12:49:38.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:37 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:49:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:37 smithi092 ceph-mon[134093]: pgmap v571: 97 pgs: 97 active+clean; 579 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 227 op/s 2023-10-08T12:49:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:37 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:49:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:37 smithi173 ceph-mon[135182]: pgmap v571: 97 pgs: 97 active+clean; 579 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 227 op/s 2023-10-08T12:49:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:37 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:49:38.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1074274 13.21 MB/sec execute 309 sec latency 17.293 ms 2023-10-08T12:49:39.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1076696 13.21 MB/sec execute 310 sec latency 63.075 ms 2023-10-08T12:49:40.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:39 smithi092 ceph-mon[134093]: pgmap v572: 97 pgs: 97 active+clean; 579 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-10-08T12:49:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:39 smithi173 ceph-mon[135182]: pgmap v572: 97 pgs: 97 active+clean; 579 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-10-08T12:49:40.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:39 smithi059 ceph-mon[98489]: pgmap v572: 97 pgs: 97 active+clean; 579 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-10-08T12:49:40.529 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1077846 13.19 MB/sec execute 311 sec latency 199.901 ms 2023-10-08T12:49:41.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1080282 13.19 MB/sec execute 312 sec latency 15.552 ms 2023-10-08T12:49:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:41 smithi059 ceph-mon[98489]: pgmap v573: 97 pgs: 97 active+clean; 559 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 219 op/s 2023-10-08T12:49:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:41 smithi092 ceph-mon[134093]: pgmap v573: 97 pgs: 97 active+clean; 559 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 219 op/s 2023-10-08T12:49:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:41 smithi173 ceph-mon[135182]: pgmap v573: 97 pgs: 97 active+clean; 559 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 219 op/s 2023-10-08T12:49:42.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1082789 13.19 MB/sec execute 313 sec latency 15.287 ms 2023-10-08T12:49:43.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1084913 13.18 MB/sec execute 314 sec latency 16.813 ms 2023-10-08T12:49:44.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:43 smithi059 ceph-mon[98489]: pgmap v574: 97 pgs: 97 active+clean; 549 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 247 op/s 2023-10-08T12:49:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:43 smithi092 ceph-mon[134093]: pgmap v574: 97 pgs: 97 active+clean; 549 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 247 op/s 2023-10-08T12:49:44.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:43 smithi173 ceph-mon[135182]: pgmap v574: 97 pgs: 97 active+clean; 549 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 247 op/s 2023-10-08T12:49:44.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1087403 13.19 MB/sec execute 315 sec latency 13.516 ms 2023-10-08T12:49:45.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1089102 13.16 MB/sec execute 316 sec latency 98.460 ms 2023-10-08T12:49:46.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:45 smithi059 ceph-mon[98489]: pgmap v575: 97 pgs: 97 active+clean; 549 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-10-08T12:49:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:45 smithi092 ceph-mon[134093]: pgmap v575: 97 pgs: 97 active+clean; 549 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-10-08T12:49:46.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:45 smithi173 ceph-mon[135182]: pgmap v575: 97 pgs: 97 active+clean; 549 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-10-08T12:49:46.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1091301 13.17 MB/sec execute 317 sec latency 25.545 ms 2023-10-08T12:49:47.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1093287 13.16 MB/sec execute 318 sec latency 263.501 ms 2023-10-08T12:49:48.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:47 smithi059 ceph-mon[98489]: pgmap v576: 97 pgs: 97 active+clean; 550 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 200 op/s 2023-10-08T12:49:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:47 smithi092 ceph-mon[134093]: pgmap v576: 97 pgs: 97 active+clean; 550 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 200 op/s 2023-10-08T12:49:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:47 smithi173 ceph-mon[135182]: pgmap v576: 97 pgs: 97 active+clean; 550 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 200 op/s 2023-10-08T12:49:48.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1095208 13.15 MB/sec execute 319 sec latency 32.523 ms 2023-10-08T12:49:49.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1097886 13.16 MB/sec execute 320 sec latency 12.350 ms 2023-10-08T12:49:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:49 smithi092 ceph-mon[134093]: pgmap v577: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 225 op/s 2023-10-08T12:49:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:49 smithi173 ceph-mon[135182]: pgmap v577: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 225 op/s 2023-10-08T12:49:50.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:49 smithi059 ceph-mon[98489]: pgmap v577: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 225 op/s 2023-10-08T12:49:50.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1099426 13.14 MB/sec execute 321 sec latency 76.050 ms 2023-10-08T12:49:51.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1101714 13.14 MB/sec execute 322 sec latency 80.002 ms 2023-10-08T12:49:52.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:51 smithi059 ceph-mon[98489]: pgmap v578: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 232 op/s 2023-10-08T12:49:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:51 smithi092 ceph-mon[134093]: pgmap v578: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 232 op/s 2023-10-08T12:49:52.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:51 smithi173 ceph-mon[135182]: pgmap v578: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 232 op/s 2023-10-08T12:49:52.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1104338 13.14 MB/sec execute 323 sec latency 13.944 ms 2023-10-08T12:49:53.530 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1106303 13.13 MB/sec execute 324 sec latency 23.131 ms 2023-10-08T12:49:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:53 smithi059 ceph-mon[98489]: pgmap v579: 97 pgs: 97 active+clean; 564 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 234 op/s 2023-10-08T12:49:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:53 smithi092 ceph-mon[134093]: pgmap v579: 97 pgs: 97 active+clean; 564 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 234 op/s 2023-10-08T12:49:54.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:53 smithi173 ceph-mon[135182]: pgmap v579: 97 pgs: 97 active+clean; 564 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 234 op/s 2023-10-08T12:49:54.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1108836 13.13 MB/sec execute 325 sec latency 13.106 ms 2023-10-08T12:49:55.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1111599 13.14 MB/sec execute 326 sec latency 14.658 ms 2023-10-08T12:49:56.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:55 smithi059 ceph-mon[98489]: pgmap v580: 97 pgs: 97 active+clean; 567 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 191 op/s 2023-10-08T12:49:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:55 smithi092 ceph-mon[134093]: pgmap v580: 97 pgs: 97 active+clean; 567 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 191 op/s 2023-10-08T12:49:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:55 smithi173 ceph-mon[135182]: pgmap v580: 97 pgs: 97 active+clean; 567 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 191 op/s 2023-10-08T12:49:56.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1112857 13.12 MB/sec execute 327 sec latency 70.774 ms 2023-10-08T12:49:57.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1115613 13.13 MB/sec execute 328 sec latency 15.745 ms 2023-10-08T12:49:58.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:57 smithi059 ceph-mon[98489]: pgmap v581: 97 pgs: 97 active+clean; 574 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 242 op/s 2023-10-08T12:49:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:57 smithi092 ceph-mon[134093]: pgmap v581: 97 pgs: 97 active+clean; 574 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 242 op/s 2023-10-08T12:49:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:58 smithi173 ceph-mon[135182]: pgmap v581: 97 pgs: 97 active+clean; 574 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 242 op/s 2023-10-08T12:49:58.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1117771 13.11 MB/sec execute 329 sec latency 21.974 ms 2023-10-08T12:49:59.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1120057 13.12 MB/sec execute 330 sec latency 15.532 ms 2023-10-08T12:50:00.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:49:59 smithi092 ceph-mon[134093]: pgmap v582: 97 pgs: 97 active+clean; 580 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 264 op/s 2023-10-08T12:50:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:49:59 smithi173 ceph-mon[135182]: pgmap v582: 97 pgs: 97 active+clean; 580 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 264 op/s 2023-10-08T12:50:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:49:59 smithi059 ceph-mon[98489]: pgmap v582: 97 pgs: 97 active+clean; 580 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 264 op/s 2023-10-08T12:50:00.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1122134 13.11 MB/sec execute 331 sec latency 25.462 ms 2023-10-08T12:50:01.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:00 smithi092 ceph-mon[134093]: overall HEALTH_OK 2023-10-08T12:50:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:00 smithi173 ceph-mon[135182]: overall HEALTH_OK 2023-10-08T12:50:01.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:00 smithi059 ceph-mon[98489]: overall HEALTH_OK 2023-10-08T12:50:01.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1123476 13.09 MB/sec execute 332 sec latency 62.103 ms 2023-10-08T12:50:02.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:01 smithi092 ceph-mon[134093]: pgmap v583: 97 pgs: 97 active+clean; 580 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 214 op/s 2023-10-08T12:50:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:01 smithi173 ceph-mon[135182]: pgmap v583: 97 pgs: 97 active+clean; 580 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 214 op/s 2023-10-08T12:50:02.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:01 smithi059 ceph-mon[98489]: pgmap v583: 97 pgs: 97 active+clean; 580 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 214 op/s 2023-10-08T12:50:02.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1125710 13.09 MB/sec execute 333 sec latency 95.075 ms 2023-10-08T12:50:03.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1127588 13.08 MB/sec execute 334 sec latency 18.231 ms 2023-10-08T12:50:04.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:03 smithi092 ceph-mon[134093]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T12:50:04.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:03 smithi092 ceph-mon[134093]: pgmap v585: 97 pgs: 97 active+clean; 591 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 268 op/s 2023-10-08T12:50:04.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:50:04.207 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:03 smithi059 ceph-mon[98489]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T12:50:04.207 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:03 smithi059 ceph-mon[98489]: pgmap v585: 97 pgs: 97 active+clean; 591 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 268 op/s 2023-10-08T12:50:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:03 smithi173 ceph-mon[135182]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T12:50:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:03 smithi173 ceph-mon[135182]: pgmap v585: 97 pgs: 97 active+clean; 591 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 268 op/s 2023-10-08T12:50:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.367+0000 7fa1e25ff700 1 -- 172.21.15.59:0/3242617134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1dc072b90 msgr2=0x7fa1dc072f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.367+0000 7fa1e25ff700 1 --2- 172.21.15.59:0/3242617134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1dc072b90 0x7fa1dc072f70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009990 tx=0x7fa1cc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.367+0000 7fa1e25ff700 1 -- 172.21.15.59:0/3242617134 shutdown_connections 2023-10-08T12:50:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.367+0000 7fa1e25ff700 1 --2- 172.21.15.59:0/3242617134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1dc111740 0x7fa1dc113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.367+0000 7fa1e25ff700 1 --2- 172.21.15.59:0/3242617134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1dc072b90 0x7fa1dc072f70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.367+0000 7fa1e25ff700 1 --2- 172.21.15.59:0/3242617134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1dc0734b0 0x7fa1dc111200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.367+0000 7fa1e25ff700 1 -- 172.21.15.59:0/3242617134 >> 172.21.15.59:0/3242617134 conn(0x7fa1dc0fc200 msgr2=0x7fa1dc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.367+0000 7fa1e25ff700 1 -- 172.21.15.59:0/3242617134 shutdown_connections 2023-10-08T12:50:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.367+0000 7fa1e25ff700 1 -- 172.21.15.59:0/3242617134 wait complete. 2023-10-08T12:50:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.369+0000 7fa1e25ff700 1 Processor -- start 2023-10-08T12:50:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.369+0000 7fa1e25ff700 1 -- start start 2023-10-08T12:50:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.369+0000 7fa1e25ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1dc072b90 0x7fa1dc19d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.369+0000 7fa1e25ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1dc0734b0 0x7fa1dc19d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1e25ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1dc111740 0x7fa1dc1a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1e25ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc1a2190 con 0x7fa1dc111740 2023-10-08T12:50:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1e25ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc1a2300 con 0x7fa1dc0734b0 2023-10-08T12:50:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1e25ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc1a24c0 con 0x7fa1dc072b90 2023-10-08T12:50:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1dbfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1dc072b90 0x7fa1dc19d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1db7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1dc0734b0 0x7fa1dc19d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1e0b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1dc111740 0x7fa1dc1a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1db7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1dc0734b0 0x7fa1dc19d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35760/0 (socket says 172.21.15.59:35760) 2023-10-08T12:50:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1dbfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1dc072b90 0x7fa1dc19d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:42608/0 (socket says 172.21.15.59:42608) 2023-10-08T12:50:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1db7fe700 1 -- 172.21.15.59:0/2055411158 learned_addr learned my addr 172.21.15.59:0/2055411158 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1db7fe700 1 -- 172.21.15.59:0/2055411158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1dc072b90 msgr2=0x7fa1dc19d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1db7fe700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1dc072b90 0x7fa1dc19d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1db7fe700 1 -- 172.21.15.59:0/2055411158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1dc111740 msgr2=0x7fa1dc1a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1db7fe700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1dc111740 0x7fa1dc1a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1db7fe700 1 -- 172.21.15.59:0/2055411158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc0095f0 con 0x7fa1dc0734b0 2023-10-08T12:50:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1e0b9c700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1dc111740 0x7fa1dc1a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.370+0000 7fa1db7fe700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1dc0734b0 0x7fa1dc19d7b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000e9a0 tx=0x7fa1d000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:04.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.371+0000 7fa1d97fa700 1 -- 172.21.15.59:0/2055411158 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0009790 con 0x7fa1dc0734b0 2023-10-08T12:50:04.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.371+0000 7fa1d97fa700 1 -- 172.21.15.59:0/2055411158 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1d0010430 con 0x7fa1dc0734b0 2023-10-08T12:50:04.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.371+0000 7fa1e25ff700 1 -- 172.21.15.59:0/2055411158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc1a27a0 con 0x7fa1dc0734b0 2023-10-08T12:50:04.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.371+0000 7fa1d97fa700 1 -- 172.21.15.59:0/2055411158 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0018680 con 0x7fa1dc0734b0 2023-10-08T12:50:04.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.371+0000 7fa1e25ff700 1 -- 172.21.15.59:0/2055411158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc1a9fe0 con 0x7fa1dc0734b0 2023-10-08T12:50:04.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.374+0000 7fa1d97fa700 1 -- 172.21.15.59:0/2055411158 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa1d00105a0 con 0x7fa1dc0734b0 2023-10-08T12:50:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.375+0000 7fa1d97fa700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1c40a1670 0x7fa1c40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.376+0000 7fa1d97fa700 1 -- 172.21.15.59:0/2055411158 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fa1d0014070 con 0x7fa1dc0734b0 2023-10-08T12:50:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.376+0000 7fa1dbfff700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1c40a1670 0x7fa1c40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.376+0000 7fa1f5e29b80 1 Processor -- start 2023-10-08T12:50:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.376+0000 7fa1f5e29b80 1 -- start start 2023-10-08T12:50:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1dbfff700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1c40a1670 0x7fa1c40a3b30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc006010 tx=0x7fa1cc00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 0x55bbd8b89260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b897a0 0x55bbd8b94110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b94650 0x55bbd8b96a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd8af2460 con 0x55bbd8b94650 2023-10-08T12:50:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd8ae3c20 con 0x55bbd8b88e80 2023-10-08T12:50:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd8ae1540 con 0x55bbd8b897a0 2023-10-08T12:50:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1e0b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b94650 0x55bbd8b96a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1dbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 0x55bbd8b89260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1db7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b897a0 0x55bbd8b94110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1e0b9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b94650 0x55bbd8b96a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37228/0 (socket says 172.21.15.59:37228) 2023-10-08T12:50:04.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1e0b9c700 1 -- 172.21.15.59:0/636334201 learned_addr learned my addr 172.21.15.59:0/636334201 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1e0b9c700 1 -- 172.21.15.59:0/636334201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b897a0 msgr2=0x55bbd8b94110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1e0b9c700 1 --2- 172.21.15.59:0/636334201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b897a0 0x55bbd8b94110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1e0b9c700 1 -- 172.21.15.59:0/636334201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 msgr2=0x55bbd8b89260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1e0b9c700 1 --2- 172.21.15.59:0/636334201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 0x55bbd8b89260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1e0b9c700 1 -- 172.21.15.59:0/636334201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbd8907de0 con 0x55bbd8b94650 2023-10-08T12:50:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.377+0000 7fa1dbfff700 1 --2- 172.21.15.59:0/636334201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 0x55bbd8b89260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.378+0000 7fa1e0b9c700 1 --2- 172.21.15.59:0/636334201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b94650 0x55bbd8b96a40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4007680 tx=0x7fa1d4007990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4ad1ae76ef53cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.378+0000 7fa1c27fc700 1 -- 172.21.15.59:0/636334201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4015850 con 0x55bbd8b94650 2023-10-08T12:50:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.378+0000 7fa1c27fc700 1 -- 172.21.15.59:0/636334201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1d400f040 con 0x55bbd8b94650 2023-10-08T12:50:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.378+0000 7fa1c27fc700 1 -- 172.21.15.59:0/636334201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4014d90 con 0x55bbd8b94650 2023-10-08T12:50:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.379+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/636334201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b94650 msgr2=0x55bbd8b96a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.379+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/636334201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b94650 0x55bbd8b96a40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4007680 tx=0x7fa1d4007990 comp rx=0 tx=0).stop 2023-10-08T12:50:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.379+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/636334201 shutdown_connections 2023-10-08T12:50:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.379+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/636334201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 0x55bbd8b89260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.379+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/636334201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b94650 0x55bbd8b96a40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.379+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/636334201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b897a0 0x55bbd8b94110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.379+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/636334201 >> 172.21.15.59:0/636334201 conn(0x55bbd8afe260 msgr2=0x55bbd8b852d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.379+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/636334201 shutdown_connections 2023-10-08T12:50:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.379+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/636334201 wait complete. 2023-10-08T12:50:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.379+0000 7fa1f5e29b80 1 -- start start 2023-10-08T12:50:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.380+0000 7fa1f5e29b80 1 Processor -- start 2023-10-08T12:50:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.380+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b88e80 0x55bbd8b94010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.380+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b897a0 0x55bbd8b91300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.380+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b94650 0x55bbd8b91980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.380+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd8adce30 con 0x55bbd8b897a0 2023-10-08T12:50:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.380+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd8a79710 con 0x55bbd8b94650 2023-10-08T12:50:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.380+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd8a793b0 con 0x55bbd8b88e80 2023-10-08T12:50:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1f5e29b80 10 client.0 _ll_register_callbacks cb 0x55bbd88d6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1e0b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b94650 0x55bbd8b91980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1e0b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b94650 0x55bbd8b91980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35784/0 (socket says 172.21.15.59:35784) 2023-10-08T12:50:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1e0b9c700 1 -- 172.21.15.59:0/985938500 learned_addr learned my addr 172.21.15.59:0/985938500 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1db7fe700 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b897a0 0x55bbd8b91300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1dbfff700 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b88e80 0x55bbd8b94010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1e0b9c700 1 -- 172.21.15.59:0/985938500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b88e80 msgr2=0x55bbd8b94010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1e0b9c700 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b88e80 0x55bbd8b94010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1e0b9c700 1 -- 172.21.15.59:0/985938500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b897a0 msgr2=0x55bbd8b91300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1e0b9c700 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b897a0 0x55bbd8b91300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1e0b9c700 1 -- 172.21.15.59:0/985938500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc1144e0 con 0x55bbd8b94650 2023-10-08T12:50:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1e0b9c700 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b94650 0x55bbd8b91980 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009470 tx=0x7fa1d40095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=556a239200e35c6a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.381+0000 7fa1bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.382+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/985938500 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4014ee0 con 0x55bbd8b94650 2023-10-08T12:50:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.382+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/985938500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbd8aa4eb0 con 0x55bbd8b94650 2023-10-08T12:50:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.382+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/985938500 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fa1d4015650 con 0x55bbd8b94650 2023-10-08T12:50:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.382+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/985938500 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1d4015810 con 0x55bbd8b94650 2023-10-08T12:50:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.382+0000 7fa1f5e29b80 10 client.26663 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.382+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/985938500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fa1d4009dd0 con 0x55bbd8b94650 2023-10-08T12:50:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.382+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/985938500 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bbd8aa4eb0 con 0x55bbd8b94650 2023-10-08T12:50:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.383+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/985938500 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa1d4031aa0 con 0x55bbd8b94650 2023-10-08T12:50:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.383+0000 7fa1f5e29b80 10 client.26663 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.383+0000 7fa1f5e29b80 10 client.26663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.383+0000 7fa1f5e29b80 20 client.26663 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.383+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bbd8ba4060 0x55bbd8ba6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.383+0000 7fa1f5e29b80 4 client.26663 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.383+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/985938500 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbd8ad5e10 con 0x55bbd8ba4060 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.383+0000 7fa1dbfff700 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bbd8ba4060 0x55bbd8ba6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.383+0000 7fa1dbfff700 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bbd8ba4060 0x55bbd8ba6480 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=349e268ca371c362 server_cookie=ad0bd9ac15d2ae69 in_seq=0 out_seq=0 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.383+0000 7fa1bb7fe700 10 client.26663 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/985938500 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bbd8ad5e10 con 0x55bbd8ba4060 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1bb7fe700 10 client.26663 handle_command_reply: tid=0 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1f5e29b80 1 client.26663 shutdown 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/985938500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b94650 msgr2=0x55bbd8b91980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b94650 0x55bbd8b91980 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009470 tx=0x7fa1d40095e0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/985938500 shutdown_connections 2023-10-08T12:50:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bbd8ba4060 0x55bbd8ba6480 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b94650 0x55bbd8b91980 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b88e80 0x55bbd8b94010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/985938500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b897a0 0x55bbd8b91300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1bb7fe700 0 client.26663 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.384+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/985938500 >> 172.21.15.59:0/985938500 conn(0x55bbd8afe260 msgr2=0x55bbd8b84ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.385+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/985938500 shutdown_connections 2023-10-08T12:50:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.385+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/985938500 wait complete. 2023-10-08T12:50:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.385+0000 7fa1f5e29b80 20 client.26663 trim_cache size 0 max 16384 2023-10-08T12:50:04.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.402+0000 7fa1f5e29b80 1 Processor -- start 2023-10-08T12:50:04.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.402+0000 7fa1f5e29b80 1 -- start start 2023-10-08T12:50:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.402+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b88e80 0x55bbd8b8bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.402+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b897a0 0x55bbd8b9f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b94650 0x55bbd8b9fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd895d920 con 0x55bbd8b88e80 2023-10-08T12:50:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd8b89b80 con 0x55bbd8b897a0 2023-10-08T12:50:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd8b92250 con 0x55bbd8b94650 2023-10-08T12:50:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1db7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b897a0 0x55bbd8b9f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1dbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b88e80 0x55bbd8b8bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1db7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b897a0 0x55bbd8b9f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35792/0 (socket says 172.21.15.59:35792) 2023-10-08T12:50:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1db7fe700 1 -- 172.21.15.59:0/3946567139 learned_addr learned my addr 172.21.15.59:0/3946567139 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1e0b9c700 1 --2- 172.21.15.59:0/3946567139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b94650 0x55bbd8b9fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1db7fe700 1 -- 172.21.15.59:0/3946567139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b94650 msgr2=0x55bbd8b9fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1db7fe700 1 --2- 172.21.15.59:0/3946567139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b94650 0x55bbd8b9fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1db7fe700 1 -- 172.21.15.59:0/3946567139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b88e80 msgr2=0x55bbd8b8bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1db7fe700 1 --2- 172.21.15.59:0/3946567139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b88e80 0x55bbd8b8bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1db7fe700 1 -- 172.21.15.59:0/3946567139 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbd88f0c60 con 0x55bbd8b897a0 2023-10-08T12:50:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1dbfff700 1 --2- 172.21.15.59:0/3946567139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b88e80 0x55bbd8b8bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.403+0000 7fa1db7fe700 1 --2- 172.21.15.59:0/3946567139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b897a0 0x55bbd8b9f8f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0096c80 tx=0x7fa1d001a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaf8bf2c35bd8348 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1c2ffd700 1 -- 172.21.15.59:0/3946567139 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00b1030 con 0x55bbd8b897a0 2023-10-08T12:50:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1c2ffd700 1 -- 172.21.15.59:0/3946567139 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1d00cd040 con 0x55bbd8b897a0 2023-10-08T12:50:04.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1c2ffd700 1 -- 172.21.15.59:0/3946567139 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d009a470 con 0x55bbd8b897a0 2023-10-08T12:50:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/3946567139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b897a0 msgr2=0x55bbd8b9f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/3946567139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b897a0 0x55bbd8b9f8f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0096c80 tx=0x7fa1d001a040 comp rx=0 tx=0).stop 2023-10-08T12:50:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/3946567139 shutdown_connections 2023-10-08T12:50:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/3946567139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b94650 0x55bbd8b9fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/3946567139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b88e80 0x55bbd8b8bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/3946567139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b897a0 0x55bbd8b9f8f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/3946567139 >> 172.21.15.59:0/3946567139 conn(0x55bbd8afe260 msgr2=0x55bbd8b8fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/3946567139 shutdown_connections 2023-10-08T12:50:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.404+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/3946567139 wait complete. 2023-10-08T12:50:04.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.405+0000 7fa1f5e29b80 1 -- start start 2023-10-08T12:50:04.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.405+0000 7fa1f5e29b80 1 Processor -- start 2023-10-08T12:50:04.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 0x55bbd8b992e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b897a0 0x55bbd8b99820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1f5e29b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b94650 0x55bbd8bf0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd8bf13c0 con 0x55bbd8b897a0 2023-10-08T12:50:04.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd8bf1530 con 0x55bbd8b88e80 2023-10-08T12:50:04.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1f5e29b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbd8bf16f0 con 0x55bbd8b94650 2023-10-08T12:50:04.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1f5e29b80 10 client.0 _ll_register_callbacks cb 0x7fa1cc005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:04.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1dbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 0x55bbd8b992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1dbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 0x55bbd8b992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35798/0 (socket says 172.21.15.59:35798) 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1dbfff700 1 -- 172.21.15.59:0/2779586133 learned_addr learned my addr 172.21.15.59:0/2779586133 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1e0b9c700 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b94650 0x55bbd8bf0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1db7fe700 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b897a0 0x55bbd8b99820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1dbfff700 1 -- 172.21.15.59:0/2779586133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b94650 msgr2=0x55bbd8bf0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1dbfff700 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b94650 0x55bbd8bf0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1dbfff700 1 -- 172.21.15.59:0/2779586133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b897a0 msgr2=0x55bbd8b99820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1dbfff700 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b897a0 0x55bbd8b99820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1dbfff700 1 -- 172.21.15.59:0/2779586133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1cc036b00 con 0x55bbd8b88e80 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.406+0000 7fa1e0b9c700 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b94650 0x55bbd8bf0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.407+0000 7fa1dbfff700 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 0x55bbd8b992e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009990 tx=0x7fa1cc009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fd773eab49a8e4f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.407+0000 7fa1bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.407+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/2779586133 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0360b0 con 0x55bbd8b88e80 2023-10-08T12:50:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.407+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/2779586133 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fa1cc036210 con 0x55bbd8b88e80 2023-10-08T12:50:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.407+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/2779586133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa1d400f040 con 0x55bbd8b88e80 2023-10-08T12:50:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.407+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/2779586133 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1cc0363d0 con 0x55bbd8b88e80 2023-10-08T12:50:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.407+0000 7fa1f5e29b80 10 client.26669 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.407+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/2779586133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fa1dc1a9fe0 con 0x55bbd8b88e80 2023-10-08T12:50:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.407+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/2779586133 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1d400f040 con 0x55bbd8b88e80 2023-10-08T12:50:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.408+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/2779586133 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa1cc004500 con 0x55bbd8b88e80 2023-10-08T12:50:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.408+0000 7fa1f5e29b80 10 client.26669 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.408+0000 7fa1f5e29b80 10 client.26669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.408+0000 7fa1f5e29b80 20 client.26669 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.408+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bbd8bf9060 0x55bbd8bfb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.408+0000 7fa1f5e29b80 4 client.26669 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:50:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.408+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/2779586133 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bbd8ad5b30 con 0x55bbd8bf9060 2023-10-08T12:50:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.408+0000 7fa1db7fe700 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bbd8bf9060 0x55bbd8bfb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.408+0000 7fa1db7fe700 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bbd8bf9060 0x55bbd8bfb480 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb87706e83b1d8fd server_cookie=c4defa0d026c4930 in_seq=0 out_seq=0 2023-10-08T12:50:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.408+0000 7fa1bb7fe700 10 client.26669 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1bb7fe700 1 -- 172.21.15.59:0/2779586133 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7fa1d007b050 con 0x55bbd8bf9060 2023-10-08T12:50:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1bb7fe700 10 client.26669 handle_command_reply: tid=0 2023-10-08T12:50:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1f5e29b80 1 client.26669 shutdown 2023-10-08T12:50:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/2779586133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 msgr2=0x55bbd8b992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 0x55bbd8b992e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009990 tx=0x7fa1cc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/2779586133 shutdown_connections 2023-10-08T12:50:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bbd8bf9060 0x55bbd8bfb480 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbd8b88e80 0x55bbd8b992e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbd8b94650 0x55bbd8bf0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1f5e29b80 1 --2- 172.21.15.59:0/2779586133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bbd8b897a0 0x55bbd8b99820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1bb7fe700 0 client.26669 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/2779586133 >> 172.21.15.59:0/2779586133 conn(0x55bbd8afe260 msgr2=0x55bbd8b90840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/2779586133 shutdown_connections 2023-10-08T12:50:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.409+0000 7fa1f5e29b80 1 -- 172.21.15.59:0/2779586133 wait complete. 2023-10-08T12:50:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1f5e29b80 20 client.26669 trim_cache size 0 max 16384 2023-10-08T12:50:04.416 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:50:04.416 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:50:04.416 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:50:04.416 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:50:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 -- 172.21.15.59:0/2055411158 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1c40a1670 msgr2=0x7fa1c40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1c40a1670 0x7fa1c40a3b30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc006010 tx=0x7fa1cc00b260 comp rx=0 tx=0).stop 2023-10-08T12:50:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 -- 172.21.15.59:0/2055411158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1dc0734b0 msgr2=0x7fa1dc19d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1dc0734b0 0x7fa1dc19d7b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000e9a0 tx=0x7fa1d000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 -- 172.21.15.59:0/2055411158 shutdown_connections 2023-10-08T12:50:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa1c40a1670 0x7fa1c40a3b30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1dc111740 0x7fa1dc1a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1dc072b90 0x7fa1dc19d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 --2- 172.21.15.59:0/2055411158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1dc0734b0 0x7fa1dc19d7b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 -- 172.21.15.59:0/2055411158 >> 172.21.15.59:0/2055411158 conn(0x7fa1dc0fc200 msgr2=0x7fa1dc0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 -- 172.21.15.59:0/2055411158 shutdown_connections 2023-10-08T12:50:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.410+0000 7fa1e25ff700 1 -- 172.21.15.59:0/2055411158 wait complete. 2023-10-08T12:50:04.428 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:50:04.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:50:04.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1129985 13.08 MB/sec execute 335 sec latency 16.074 ms 2023-10-08T12:50:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.642+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2998897803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaec1017f0 msgr2=0x7fbaec101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.642+0000 7fbaf39ff700 1 --2- 172.21.15.59:0/2998897803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaec1017f0 0x7fbaec101bd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009990 tx=0x7fbae8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.642+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2998897803 shutdown_connections 2023-10-08T12:50:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.642+0000 7fbaf39ff700 1 --2- 172.21.15.59:0/2998897803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaec10ac10 0x7fbaec10d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.642+0000 7fbaf39ff700 1 --2- 172.21.15.59:0/2998897803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaec1017f0 0x7fbaec101bd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.642+0000 7fbaf39ff700 1 --2- 172.21.15.59:0/2998897803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaec102110 0x7fbaec10a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.642+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2998897803 >> 172.21.15.59:0/2998897803 conn(0x7fbaec0fb030 msgr2=0x7fbaec0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.642+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2998897803 shutdown_connections 2023-10-08T12:50:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.642+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2998897803 wait complete. 2023-10-08T12:50:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.643+0000 7fbaf39ff700 1 Processor -- start 2023-10-08T12:50:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.643+0000 7fbaf39ff700 1 -- start start 2023-10-08T12:50:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.643+0000 7fbaf39ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaec1017f0 0x7fbaec0ff440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.643+0000 7fbaf39ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaec102110 0x7fbaec0ff980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf39ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaec10ac10 0x7fbaec0ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf39ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec1a4ef0 con 0x7fbaec102110 2023-10-08T12:50:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf39ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec1a5060 con 0x7fbaec1017f0 2023-10-08T12:50:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf39ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec1a5220 con 0x7fbaec10ac10 2023-10-08T12:50:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaec1017f0 0x7fbaec0ff440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf0f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaec102110 0x7fbaec0ff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaec1017f0 0x7fbaec0ff440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35826/0 (socket says 172.21.15.59:35826) 2023-10-08T12:50:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf179b700 1 -- 172.21.15.59:0/2268522312 learned_addr learned my addr 172.21.15.59:0/2268522312 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf1f9c700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaec10ac10 0x7fbaec0ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf179b700 1 -- 172.21.15.59:0/2268522312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaec10ac10 msgr2=0x7fbaec0ffec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf179b700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaec10ac10 0x7fbaec0ffec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf179b700 1 -- 172.21.15.59:0/2268522312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaec102110 msgr2=0x7fbaec0ff980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf179b700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaec102110 0x7fbaec0ff980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf179b700 1 -- 172.21.15.59:0/2268522312 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae4009c40 con 0x7fbaec1017f0 2023-10-08T12:50:04.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf0f9a700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaec102110 0x7fbaec0ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:04.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.644+0000 7fbaf179b700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaec1017f0 0x7fbaec0ff440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbae800b2e0 tx=0x7fbae8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:04.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.645+0000 7fbae27fc700 1 -- 172.21.15.59:0/2268522312 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae801d070 con 0x7fbaec1017f0 2023-10-08T12:50:04.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.645+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2268522312 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae80095f0 con 0x7fbaec1017f0 2023-10-08T12:50:04.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.645+0000 7fbae27fc700 1 -- 172.21.15.59:0/2268522312 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbae8021410 con 0x7fbaec1017f0 2023-10-08T12:50:04.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.645+0000 7fbae27fc700 1 -- 172.21.15.59:0/2268522312 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8017650 con 0x7fbaec1017f0 2023-10-08T12:50:04.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.645+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2268522312 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec1a5810 con 0x7fbaec1017f0 2023-10-08T12:50:04.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.646+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2268522312 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaec105d40 con 0x7fbaec1017f0 2023-10-08T12:50:04.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.648+0000 7fbae27fc700 1 -- 172.21.15.59:0/2268522312 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbae8021810 con 0x7fbaec1017f0 2023-10-08T12:50:04.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.649+0000 7fbae27fc700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbad80a1670 0x7fbad80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:04.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.649+0000 7fbae27fc700 1 -- 172.21.15.59:0/2268522312 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fbae80ce530 con 0x7fbaec1017f0 2023-10-08T12:50:04.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.650+0000 7fbaf0f9a700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbad80a1670 0x7fbad80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:04.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.650+0000 7fbaf0f9a700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbad80a1670 0x7fbad80a3b30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbaec100b70 tx=0x7fbadc00b360 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:04.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.652+0000 7fbae27fc700 1 -- 172.21.15.59:0/2268522312 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbae80978a0 con 0x7fbaec1017f0 2023-10-08T12:50:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.925+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2268522312 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbaec068110 con 0x7fbaec1017f0 2023-10-08T12:50:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.925+0000 7fbae27fc700 1 -- 172.21.15.59:0/2268522312 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fbae8097030 con 0x7fbaec1017f0 2023-10-08T12:50:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:50:04.926 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:50:04.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2268522312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbad80a1670 msgr2=0x7fbad80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbad80a1670 0x7fbad80a3b30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbaec100b70 tx=0x7fbadc00b360 comp rx=0 tx=0).stop 2023-10-08T12:50:04.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2268522312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaec1017f0 msgr2=0x7fbaec0ff440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:04.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaec1017f0 0x7fbaec0ff440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbae800b2e0 tx=0x7fbae8004730 comp rx=0 tx=0).stop 2023-10-08T12:50:04.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2268522312 shutdown_connections 2023-10-08T12:50:04.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbad80a1670 0x7fbad80a3b30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaec1017f0 0x7fbaec0ff440 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaec10ac10 0x7fbaec0ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 --2- 172.21.15.59:0/2268522312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaec102110 0x7fbaec0ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:04.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2268522312 >> 172.21.15.59:0/2268522312 conn(0x7fbaec0fb030 msgr2=0x7fbaec0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:04.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2268522312 shutdown_connections 2023-10-08T12:50:04.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:04.928+0000 7fbaf39ff700 1 -- 172.21.15.59:0/2268522312 wait complete. 2023-10-08T12:50:04.930 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:50:04.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:50:05.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.156+0000 7f30a29ff700 1 -- 172.21.15.59:0/1270938319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f309c067ce0 msgr2=0x7f309c0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:05.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.156+0000 7f30a29ff700 1 --2- 172.21.15.59:0/1270938319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f309c067ce0 0x7f309c0680c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f308c0098f0 tx=0x7f308c009c00 comp rx=0 tx=0).stop 2023-10-08T12:50:05.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.156+0000 7f30a29ff700 1 -- 172.21.15.59:0/1270938319 shutdown_connections 2023-10-08T12:50:05.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.156+0000 7f30a29ff700 1 --2- 172.21.15.59:0/1270938319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f309c067ce0 0x7f309c0680c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.156+0000 7f30a29ff700 1 --2- 172.21.15.59:0/1270938319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f309c105b80 0x7f309c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.156+0000 7f30a29ff700 1 --2- 172.21.15.59:0/1270938319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f309c1051c0 0x7f309c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.156+0000 7f30a29ff700 1 -- 172.21.15.59:0/1270938319 >> 172.21.15.59:0/1270938319 conn(0x7f309c076780 msgr2=0x7f309c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:05.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.156+0000 7f30a29ff700 1 -- 172.21.15.59:0/1270938319 shutdown_connections 2023-10-08T12:50:05.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.156+0000 7f30a29ff700 1 -- 172.21.15.59:0/1270938319 wait complete. 2023-10-08T12:50:05.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.157+0000 7f30a29ff700 1 Processor -- start 2023-10-08T12:50:05.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f30a29ff700 1 -- start start 2023-10-08T12:50:05.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f30a29ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f309c067ce0 0x7f309c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f30a29ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f309c1051c0 0x7f309c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f30a29ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f309c105b80 0x7f309c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f30a29ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c19dd30 con 0x7f309c1051c0 2023-10-08T12:50:05.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f30a29ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c19dea0 con 0x7f309c067ce0 2023-10-08T12:50:05.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f30a29ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c19e060 con 0x7f309c105b80 2023-10-08T12:50:05.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f3093fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f309c1051c0 0x7f309c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f30a0f9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f309c105b80 0x7f309c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f309bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f309c067ce0 0x7f309c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f309bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f309c067ce0 0x7f309c198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35832/0 (socket says 172.21.15.59:35832) 2023-10-08T12:50:05.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f30a0f9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f309c105b80 0x7f309c19d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:42698/0 (socket says 172.21.15.59:42698) 2023-10-08T12:50:05.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f309bfff700 1 -- 172.21.15.59:0/3299811673 learned_addr learned my addr 172.21.15.59:0/3299811673 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:05.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.158+0000 7f3093fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f309c1051c0 0x7f309c1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37306/0 (socket says 172.21.15.59:37306) 2023-10-08T12:50:05.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.159+0000 7f30a0f9c700 1 -- 172.21.15.59:0/3299811673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f309c067ce0 msgr2=0x7f309c198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:05.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.159+0000 7f30a0f9c700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f309c067ce0 0x7f309c198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.159+0000 7f30a0f9c700 1 -- 172.21.15.59:0/3299811673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f309c1051c0 msgr2=0x7f309c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:05.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.159+0000 7f30a0f9c700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f309c1051c0 0x7f309c1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.159+0000 7f30a0f9c700 1 -- 172.21.15.59:0/3299811673 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30840095f0 con 0x7f309c105b80 2023-10-08T12:50:05.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.159+0000 7f30a0f9c700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f309c105b80 0x7f309c19d6f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f309400efc0 tx=0x7f309400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:05.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.159+0000 7f3099ffb700 1 -- 172.21.15.59:0/3299811673 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094018070 con 0x7f309c105b80 2023-10-08T12:50:05.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.159+0000 7f3099ffb700 1 -- 172.21.15.59:0/3299811673 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f309400f040 con 0x7f309c105b80 2023-10-08T12:50:05.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.159+0000 7f3099ffb700 1 -- 172.21.15.59:0/3299811673 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309400cd40 con 0x7f309c105b80 2023-10-08T12:50:05.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.159+0000 7f30a29ff700 1 -- 172.21.15.59:0/3299811673 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308c009520 con 0x7f309c105b80 2023-10-08T12:50:05.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.159+0000 7f30a29ff700 1 -- 172.21.15.59:0/3299811673 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c1a59a0 con 0x7f309c105b80 2023-10-08T12:50:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.163+0000 7f3099ffb700 1 -- 172.21.15.59:0/3299811673 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3094003a00 con 0x7f309c105b80 2023-10-08T12:50:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.164+0000 7f30b6273b80 1 Processor -- start 2023-10-08T12:50:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.164+0000 7f30b6273b80 1 -- start start 2023-10-08T12:50:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.164+0000 7f3099ffb700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30880a1670 0x7f30880a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.164+0000 7f3099ffb700 1 -- 172.21.15.59:0/3299811673 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f30940ccc00 con 0x7f309c105b80 2023-10-08T12:50:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f3093fff700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30880a1670 0x7f30880a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae3280e80 0x556ae3281260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae328c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae328ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30b6273b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae31ea460 con 0x556ae3280e80 2023-10-08T12:50:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30b6273b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae31dbc20 con 0x556ae32817a0 2023-10-08T12:50:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30b6273b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae31d9540 con 0x556ae328c650 2023-10-08T12:50:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30a0f9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae328ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f309bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae3280e80 0x556ae3281260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30a0f9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae328ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:42706/0 (socket says 172.21.15.59:42706) 2023-10-08T12:50:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f3093fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae328c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30a0f9c700 1 -- 172.21.15.59:0/3007858281 learned_addr learned my addr 172.21.15.59:0/3007858281 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f3093fff700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30880a1670 0x7f30880a3b30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f309c19a400 tx=0x7f3084009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30a0f9c700 1 -- 172.21.15.59:0/3007858281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 msgr2=0x556ae328c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30a0f9c700 1 --2- 172.21.15.59:0/3007858281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae328c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30a0f9c700 1 -- 172.21.15.59:0/3007858281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae3280e80 msgr2=0x556ae3281260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30a0f9c700 1 --2- 172.21.15.59:0/3007858281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae3280e80 0x556ae3281260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.165+0000 7f30a0f9c700 1 -- 172.21.15.59:0/3007858281 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ae2fffde0 con 0x556ae328c650 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.166+0000 7f30a0f9c700 1 --2- 172.21.15.59:0/3007858281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae328ea40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f30940966a0 tx=0x7f3094099a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d210c1f74c25132 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.166+0000 7f30927fc700 1 -- 172.21.15.59:0/3007858281 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094004ad0 con 0x556ae328c650 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.166+0000 7f30927fc700 1 -- 172.21.15.59:0/3007858281 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f309401b320 con 0x556ae328c650 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.166+0000 7f30927fc700 1 -- 172.21.15.59:0/3007858281 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094099e90 con 0x556ae328c650 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.167+0000 7f30b6273b80 1 -- 172.21.15.59:0/3007858281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 msgr2=0x556ae328ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.167+0000 7f30b6273b80 1 --2- 172.21.15.59:0/3007858281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae328ea40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f30940966a0 tx=0x7f3094099a00 comp rx=0 tx=0).stop 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.167+0000 7f30b6273b80 1 -- 172.21.15.59:0/3007858281 shutdown_connections 2023-10-08T12:50:05.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.167+0000 7f30b6273b80 1 --2- 172.21.15.59:0/3007858281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae328ea40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.167+0000 7f30b6273b80 1 --2- 172.21.15.59:0/3007858281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae3280e80 0x556ae3281260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.167+0000 7f30b6273b80 1 --2- 172.21.15.59:0/3007858281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae328c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.167+0000 7f30b6273b80 1 -- 172.21.15.59:0/3007858281 >> 172.21.15.59:0/3007858281 conn(0x556ae31f6260 msgr2=0x556ae327d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:05.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.167+0000 7f30b6273b80 1 -- 172.21.15.59:0/3007858281 shutdown_connections 2023-10-08T12:50:05.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.167+0000 7f30b6273b80 1 -- 172.21.15.59:0/3007858281 wait complete. 2023-10-08T12:50:05.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.167+0000 7f30b6273b80 1 -- start start 2023-10-08T12:50:05.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.168+0000 7f30b6273b80 1 Processor -- start 2023-10-08T12:50:05.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.168+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae3280e80 0x556ae328c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.168+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3289370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.168+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae328c650 0x556ae3289ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.168+0000 7f30b6273b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae31d4e30 con 0x556ae328c650 2023-10-08T12:50:05.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.168+0000 7f30b6273b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae3171710 con 0x556ae32817a0 2023-10-08T12:50:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.168+0000 7f30b6273b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae31713b0 con 0x556ae3280e80 2023-10-08T12:50:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.168+0000 7f30b6273b80 10 client.0 _ll_register_callbacks cb 0x556ae2fce800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f3093fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3289370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f309bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae3280e80 0x556ae328c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f3093fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3289370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35848/0 (socket says 172.21.15.59:35848) 2023-10-08T12:50:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f3093fff700 1 -- 172.21.15.59:0/44652948 learned_addr learned my addr 172.21.15.59:0/44652948 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f30a0f9c700 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae328c650 0x556ae3289ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f3093fff700 1 -- 172.21.15.59:0/44652948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae3280e80 msgr2=0x556ae328c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f3093fff700 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae3280e80 0x556ae328c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f3093fff700 1 -- 172.21.15.59:0/44652948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae328c650 msgr2=0x556ae3289ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f3093fff700 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae328c650 0x556ae3289ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f3093fff700 1 -- 172.21.15.59:0/44652948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c1a59a0 con 0x556ae32817a0 2023-10-08T12:50:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f3093fff700 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3289370 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3084004620 tx=0x7f30840047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b268b2762598bc4d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f307b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.169+0000 7f307b7fe700 1 -- 172.21.15.59:0/44652948 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308401c610 con 0x556ae32817a0 2023-10-08T12:50:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f307b7fe700 1 -- 172.21.15.59:0/44652948 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f308401c770 con 0x556ae32817a0 2023-10-08T12:50:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f30b6273b80 1 -- 172.21.15.59:0/44652948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ae319ceb0 con 0x556ae32817a0 2023-10-08T12:50:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f307b7fe700 1 -- 172.21.15.59:0/44652948 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f308401c970 con 0x556ae32817a0 2023-10-08T12:50:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f30b6273b80 10 client.26687 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f30b6273b80 1 -- 172.21.15.59:0/44652948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x556ae2fe8c60 con 0x556ae32817a0 2023-10-08T12:50:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f307b7fe700 1 -- 172.21.15.59:0/44652948 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3084032020 con 0x556ae32817a0 2023-10-08T12:50:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f307b7fe700 1 -- 172.21.15.59:0/44652948 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3084025ad0 con 0x556ae32817a0 2023-10-08T12:50:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f30b6273b80 10 client.26687 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f30b6273b80 10 client.26687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f30b6273b80 20 client.26687 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f30b6273b80 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556ae329c270 0x556ae329e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f30b6273b80 4 client.26687 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:50:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.170+0000 7f30b6273b80 1 -- 172.21.15.59:0/44652948 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ae31cde10 con 0x556ae329c270 2023-10-08T12:50:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.171+0000 7f309bfff700 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556ae329c270 0x556ae329e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.171+0000 7f309bfff700 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556ae329c270 0x556ae329e690 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9018791a2d0daedd server_cookie=88a5cd6f580f86cb in_seq=0 out_seq=0 2023-10-08T12:50:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.171+0000 7f307b7fe700 10 client.26687 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f307b7fe700 1 -- 172.21.15.59:0/44652948 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556ae31cde10 con 0x556ae329c270 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f307b7fe700 10 client.26687 handle_command_reply: tid=0 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f30b6273b80 1 client.26687 shutdown 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f30b6273b80 1 -- 172.21.15.59:0/44652948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 msgr2=0x556ae3289370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f30b6273b80 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3289370 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3084004620 tx=0x7f30840047c0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f30b6273b80 1 -- 172.21.15.59:0/44652948 shutdown_connections 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f30b6273b80 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556ae329c270 0x556ae329e690 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f30b6273b80 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae328c650 0x556ae3289ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f30b6273b80 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae3280e80 0x556ae328c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f30b6273b80 1 --2- 172.21.15.59:0/44652948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3289370 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f30b6273b80 1 -- 172.21.15.59:0/44652948 >> 172.21.15.59:0/44652948 conn(0x556ae31f6260 msgr2=0x556ae327cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.172+0000 7f307b7fe700 0 client.26687 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.173+0000 7f30b6273b80 1 -- 172.21.15.59:0/44652948 shutdown_connections 2023-10-08T12:50:05.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.173+0000 7f30b6273b80 1 -- 172.21.15.59:0/44652948 wait complete. 2023-10-08T12:50:05.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.173+0000 7f30b6273b80 20 client.26687 trim_cache size 0 max 16384 2023-10-08T12:50:05.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.186+0000 7f30b6273b80 1 Processor -- start 2023-10-08T12:50:05.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.186+0000 7f30b6273b80 1 -- start start 2023-10-08T12:50:05.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae3280e80 0x556ae32931a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae32817a0 0x556ae32846b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae3284bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f30b6273b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae3055920 con 0x556ae32817a0 2023-10-08T12:50:05.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f30b6273b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae3282110 con 0x556ae3280e80 2023-10-08T12:50:05.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f30b6273b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae3279b30 con 0x556ae328c650 2023-10-08T12:50:05.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f3093fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae32817a0 0x556ae32846b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f309bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae3280e80 0x556ae32931a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f309bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae3280e80 0x556ae32931a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35850/0 (socket says 172.21.15.59:35850) 2023-10-08T12:50:05.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f309bfff700 1 -- 172.21.15.59:0/773201847 learned_addr learned my addr 172.21.15.59:0/773201847 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:05.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f30a0f9c700 1 --2- 172.21.15.59:0/773201847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae3284bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f3093fff700 1 -- 172.21.15.59:0/773201847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 msgr2=0x556ae3284bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f3093fff700 1 --2- 172.21.15.59:0/773201847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae3284bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f3093fff700 1 -- 172.21.15.59:0/773201847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae3280e80 msgr2=0x556ae32931a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f3093fff700 1 --2- 172.21.15.59:0/773201847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae3280e80 0x556ae32931a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f3093fff700 1 -- 172.21.15.59:0/773201847 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ae3026250 con 0x556ae32817a0 2023-10-08T12:50:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.187+0000 7f309bfff700 1 --2- 172.21.15.59:0/773201847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae3280e80 0x556ae32931a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.188+0000 7f3093fff700 1 --2- 172.21.15.59:0/773201847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae32817a0 0x556ae32846b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3084005fd0 tx=0x7f3084011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b3c82f196ab435 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:05.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.188+0000 7f3092ffd700 1 -- 172.21.15.59:0/773201847 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084004650 con 0x556ae32817a0 2023-10-08T12:50:05.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.188+0000 7f3092ffd700 1 -- 172.21.15.59:0/773201847 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3084032070 con 0x556ae32817a0 2023-10-08T12:50:05.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.188+0000 7f3092ffd700 1 -- 172.21.15.59:0/773201847 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084025410 con 0x556ae32817a0 2023-10-08T12:50:05.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.189+0000 7f30b6273b80 1 -- 172.21.15.59:0/773201847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae32817a0 msgr2=0x556ae32846b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:05.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.189+0000 7f30b6273b80 1 --2- 172.21.15.59:0/773201847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae32817a0 0x556ae32846b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3084005fd0 tx=0x7f3084011bb0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.189+0000 7f30b6273b80 1 -- 172.21.15.59:0/773201847 shutdown_connections 2023-10-08T12:50:05.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.189+0000 7f30b6273b80 1 --2- 172.21.15.59:0/773201847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae3280e80 0x556ae32931a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.189+0000 7f30b6273b80 1 --2- 172.21.15.59:0/773201847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae3284bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.189+0000 7f30b6273b80 1 --2- 172.21.15.59:0/773201847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae32817a0 0x556ae32846b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.189+0000 7f30b6273b80 1 -- 172.21.15.59:0/773201847 >> 172.21.15.59:0/773201847 conn(0x556ae31f6260 msgr2=0x556ae32978f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:05.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.189+0000 7f30b6273b80 1 -- 172.21.15.59:0/773201847 shutdown_connections 2023-10-08T12:50:05.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.189+0000 7f30b6273b80 1 -- 172.21.15.59:0/773201847 wait complete. 2023-10-08T12:50:05.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.189+0000 7f30b6273b80 1 -- start start 2023-10-08T12:50:05.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.189+0000 7f30b6273b80 1 Processor -- start 2023-10-08T12:50:05.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae3280e80 0x556ae3293190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3291780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f30b6273b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae3291cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f30b6273b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae32923b0 con 0x556ae3280e80 2023-10-08T12:50:05.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f30b6273b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae3292520 con 0x556ae32817a0 2023-10-08T12:50:05.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f30b6273b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae32f0070 con 0x556ae328c650 2023-10-08T12:50:05.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f30b6273b80 10 client.0 _ll_register_callbacks cb 0x7f30840043e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:05.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f3093fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3291780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f309bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae3280e80 0x556ae3293190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f3093fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3291780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35864/0 (socket says 172.21.15.59:35864) 2023-10-08T12:50:05.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f3093fff700 1 -- 172.21.15.59:0/2556789428 learned_addr learned my addr 172.21.15.59:0/2556789428 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:05.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.190+0000 7f30a0f9c700 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae3291cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f3093fff700 1 -- 172.21.15.59:0/2556789428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 msgr2=0x556ae3291cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:05.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f3093fff700 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae3291cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f3093fff700 1 -- 172.21.15.59:0/2556789428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae3280e80 msgr2=0x556ae3293190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:05.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f3093fff700 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae3280e80 0x556ae3293190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f3093fff700 1 -- 172.21.15.59:0/2556789428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c10dec0 con 0x556ae32817a0 2023-10-08T12:50:05.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f309bfff700 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae3280e80 0x556ae3293190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:05.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f30a0f9c700 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae3291cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:05.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f3093fff700 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3291780 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3084025f50 tx=0x7f308400f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a5b000b8f5538b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f307b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f307b7fe700 1 -- 172.21.15.59:0/2556789428 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084005c40 con 0x556ae32817a0 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f30b6273b80 1 -- 172.21.15.59:0/2556789428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f309401b320 con 0x556ae32817a0 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f307b7fe700 1 -- 172.21.15.59:0/2556789428 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f3084033080 con 0x556ae32817a0 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f307b7fe700 1 -- 172.21.15.59:0/2556789428 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3084011e00 con 0x556ae32817a0 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f30b6273b80 10 client.26693 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.191+0000 7f30b6273b80 1 -- 172.21.15.59:0/2556789428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x556ae2fe8c60 con 0x556ae32817a0 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.192+0000 7f307b7fe700 1 -- 172.21.15.59:0/2556789428 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f309401b320 con 0x556ae32817a0 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.192+0000 7f307b7fe700 1 -- 172.21.15.59:0/2556789428 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3084004650 con 0x556ae32817a0 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.192+0000 7f30b6273b80 10 client.26693 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.192+0000 7f30b6273b80 10 client.26693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:05.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.192+0000 7f30b6273b80 20 client.26693 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:05.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.192+0000 7f30b6273b80 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556ae32f1400 0x556ae32f3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:05.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.192+0000 7f30b6273b80 4 client.26693 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:50:05.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.192+0000 7f30b6273b80 1 -- 172.21.15.59:0/2556789428 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556ae31cdb30 con 0x556ae32f1400 2023-10-08T12:50:05.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.192+0000 7f309bfff700 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556ae32f1400 0x556ae32f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:05.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f309bfff700 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556ae32f1400 0x556ae32f3820 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb980339a39b817 server_cookie=eeae03b00a33e7d6 in_seq=0 out_seq=0 2023-10-08T12:50:05.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f307b7fe700 10 client.26693 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:05.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f307b7fe700 1 -- 172.21.15.59:0/2556789428 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556ae31cdb30 con 0x556ae32f1400 2023-10-08T12:50:05.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f307b7fe700 10 client.26693 handle_command_reply: tid=0 2023-10-08T12:50:05.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f30b6273b80 1 client.26693 shutdown 2023-10-08T12:50:05.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f30b6273b80 1 -- 172.21.15.59:0/2556789428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 msgr2=0x556ae3291780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:05.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f30b6273b80 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3291780 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3084025f50 tx=0x7f308400f690 comp rx=0 tx=0).stop 2023-10-08T12:50:05.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f30b6273b80 1 -- 172.21.15.59:0/2556789428 shutdown_connections 2023-10-08T12:50:05.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f30b6273b80 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556ae32f1400 0x556ae32f3820 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f30b6273b80 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ae328c650 0x556ae3291cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f307b7fe700 0 client.26693 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:05.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f30b6273b80 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ae3280e80 0x556ae3293190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f30b6273b80 1 --2- 172.21.15.59:0/2556789428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae32817a0 0x556ae3291780 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f30b6273b80 1 -- 172.21.15.59:0/2556789428 >> 172.21.15.59:0/2556789428 conn(0x556ae31f6260 msgr2=0x556ae32846b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:05.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f30b6273b80 1 -- 172.21.15.59:0/2556789428 shutdown_connections 2023-10-08T12:50:05.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.193+0000 7f30b6273b80 1 -- 172.21.15.59:0/2556789428 wait complete. 2023-10-08T12:50:05.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30b6273b80 20 client.26693 trim_cache size 0 max 16384 2023-10-08T12:50:05.204 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:50:05.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 -- 172.21.15.59:0/3299811673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30880a1670 msgr2=0x7f30880a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:05.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30880a1670 0x7f30880a3b30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f309c19a400 tx=0x7f3084009310 comp rx=0 tx=0).stop 2023-10-08T12:50:05.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 -- 172.21.15.59:0/3299811673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f309c105b80 msgr2=0x7f309c19d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:05.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f309c105b80 0x7f309c19d6f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f309400efc0 tx=0x7f309400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 -- 172.21.15.59:0/3299811673 shutdown_connections 2023-10-08T12:50:05.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30880a1670 0x7f30880a3b30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f309c067ce0 0x7f309c198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f309c105b80 0x7f309c19d6f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 --2- 172.21.15.59:0/3299811673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f309c1051c0 0x7f309c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:05.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 -- 172.21.15.59:0/3299811673 >> 172.21.15.59:0/3299811673 conn(0x7f309c076780 msgr2=0x7f309c100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:05.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 -- 172.21.15.59:0/3299811673 shutdown_connections 2023-10-08T12:50:05.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:05.194+0000 7f30a29ff700 1 -- 172.21.15.59:0/3299811673 wait complete. 2023-10-08T12:50:05.211 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:04 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2268522312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:50:05.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:04 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2268522312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:50:05.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:04 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2268522312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:50:05.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1132164 13.07 MB/sec execute 336 sec latency 26.433 ms 2023-10-08T12:50:06.214 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:50:06.215 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:50:06.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:05 smithi059 ceph-mon[98489]: pgmap v586: 97 pgs: 97 active+clean; 591 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.7 MiB/s wr, 271 op/s 2023-10-08T12:50:06.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:05 smithi092 ceph-mon[134093]: pgmap v586: 97 pgs: 97 active+clean; 591 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.7 MiB/s wr, 271 op/s 2023-10-08T12:50:06.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.452+0000 7fc676fff700 1 -- 172.21.15.59:0/856512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc670067ce0 msgr2=0x7fc6700680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.452+0000 7fc676fff700 1 --2- 172.21.15.59:0/856512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc670067ce0 0x7fc6700680c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc6640099c0 tx=0x7fc664009cd0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.452+0000 7fc676fff700 1 -- 172.21.15.59:0/856512 shutdown_connections 2023-10-08T12:50:06.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.452+0000 7fc676fff700 1 --2- 172.21.15.59:0/856512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc670105b80 0x7fc67010d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.452+0000 7fc676fff700 1 --2- 172.21.15.59:0/856512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc670067ce0 0x7fc6700680c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.452+0000 7fc676fff700 1 --2- 172.21.15.59:0/856512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6701051c0 0x7fc670105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.452+0000 7fc676fff700 1 -- 172.21.15.59:0/856512 >> 172.21.15.59:0/856512 conn(0x7fc670076780 msgr2=0x7fc670076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.452+0000 7fc676fff700 1 -- 172.21.15.59:0/856512 shutdown_connections 2023-10-08T12:50:06.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.452+0000 7fc676fff700 1 -- 172.21.15.59:0/856512 wait complete. 2023-10-08T12:50:06.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.453+0000 7fc676fff700 1 Processor -- start 2023-10-08T12:50:06.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.453+0000 7fc676fff700 1 -- start start 2023-10-08T12:50:06.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc676fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc670067ce0 0x7fc670198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc676fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6701051c0 0x7fc670199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc676fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc670105b80 0x7fc67019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc676fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67019dd50 con 0x7fc670067ce0 2023-10-08T12:50:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc676fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67019dec0 con 0x7fc670105b80 2023-10-08T12:50:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc676fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67019e080 con 0x7fc6701051c0 2023-10-08T12:50:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc674d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc670067ce0 0x7fc670198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc67559c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc670105b80 0x7fc67019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc66ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6701051c0 0x7fc670199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc674d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc670067ce0 0x7fc670198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37372/0 (socket says 172.21.15.59:37372) 2023-10-08T12:50:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc674d9b700 1 -- 172.21.15.59:0/2586382069 learned_addr learned my addr 172.21.15.59:0/2586382069 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc66ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6701051c0 0x7fc670199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:42750/0 (socket says 172.21.15.59:42750) 2023-10-08T12:50:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc674d9b700 1 -- 172.21.15.59:0/2586382069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6701051c0 msgr2=0x7fc670199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc674d9b700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6701051c0 0x7fc670199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc674d9b700 1 -- 172.21.15.59:0/2586382069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc670105b80 msgr2=0x7fc67019d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc674d9b700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc670105b80 0x7fc67019d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc674d9b700 1 -- 172.21.15.59:0/2586382069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640095f0 con 0x7fc670067ce0 2023-10-08T12:50:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.454+0000 7fc67559c700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc670105b80 0x7fc67019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.455+0000 7fc674d9b700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc670067ce0 0x7fc670198e30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc66400b580 tx=0x7fc66400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.455+0000 7fc66dffb700 1 -- 172.21.15.59:0/2586382069 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66401c070 con 0x7fc670067ce0 2023-10-08T12:50:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.455+0000 7fc676fff700 1 -- 172.21.15.59:0/2586382069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67019e300 con 0x7fc670067ce0 2023-10-08T12:50:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.455+0000 7fc66dffb700 1 -- 172.21.15.59:0/2586382069 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc66400fd80 con 0x7fc670067ce0 2023-10-08T12:50:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.455+0000 7fc66dffb700 1 -- 172.21.15.59:0/2586382069 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664022c40 con 0x7fc670067ce0 2023-10-08T12:50:06.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.455+0000 7fc676fff700 1 -- 172.21.15.59:0/2586382069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6701a5ba0 con 0x7fc670067ce0 2023-10-08T12:50:06.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.459+0000 7fc66dffb700 1 -- 172.21.15.59:0/2586382069 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc664020070 con 0x7fc670067ce0 2023-10-08T12:50:06.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.460+0000 7fc68a9d5b80 1 Processor -- start 2023-10-08T12:50:06.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.460+0000 7fc68a9d5b80 1 -- start start 2023-10-08T12:50:06.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.460+0000 7fc66dffb700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6600a1670 0x7fc6600a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.460+0000 7fc66dffb700 1 -- 172.21.15.59:0/2586382069 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fc6640cdc60 con 0x7fc670067ce0 2023-10-08T12:50:06.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.460+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955803f00 0x55c9558042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.460+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955804820 0x55c95580f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.460+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95580f6d0 0x55c955811ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.460+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95576d4e0 con 0x55c955803f00 2023-10-08T12:50:06.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.460+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95575eca0 con 0x55c95580f6d0 2023-10-08T12:50:06.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.460+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95575c5c0 con 0x55c955804820 2023-10-08T12:50:06.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.460+0000 7fc67559c700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6600a1670 0x7fc6600a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.461+0000 7fc674d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955803f00 0x55c9558042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.461+0000 7fc674d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955803f00 0x55c9558042e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37382/0 (socket says 172.21.15.59:37382) 2023-10-08T12:50:06.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.461+0000 7fc66ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955804820 0x55c95580f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.461+0000 7fc674d9b700 1 -- 172.21.15.59:0/884705017 learned_addr learned my addr 172.21.15.59:0/884705017 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:06.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.461+0000 7fc67559c700 1 --2- 172.21.15.59:0/884705017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95580f6d0 0x55c955811ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.461+0000 7fc66ffff700 1 -- 172.21.15.59:0/884705017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95580f6d0 msgr2=0x55c955811ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.461+0000 7fc66ffff700 1 --2- 172.21.15.59:0/884705017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95580f6d0 0x55c955811ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.461+0000 7fc66ffff700 1 -- 172.21.15.59:0/884705017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955803f00 msgr2=0x55c9558042e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.461+0000 7fc66ffff700 1 --2- 172.21.15.59:0/884705017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955803f00 0x55c9558042e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.461+0000 7fc66ffff700 1 -- 172.21.15.59:0/884705017 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c955582e60 con 0x55c955804820 2023-10-08T12:50:06.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.461+0000 7fc67559c700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6600a1670 0x7fc6600a3b30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc668009550 tx=0x7fc668007e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.462+0000 7fc66ffff700 1 --2- 172.21.15.59:0/884705017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955804820 0x55c95580f190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009cb0 tx=0x7fc65c011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8aa188a2bbd6645 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.462+0000 7fc65affd700 1 -- 172.21.15.59:0/884705017 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c011c60 con 0x55c955804820 2023-10-08T12:50:06.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.462+0000 7fc65affd700 1 -- 172.21.15.59:0/884705017 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc65c004510 con 0x55c955804820 2023-10-08T12:50:06.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.462+0000 7fc65affd700 1 -- 172.21.15.59:0/884705017 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0193e0 con 0x55c955804820 2023-10-08T12:50:06.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.463+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/884705017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955804820 msgr2=0x55c95580f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.463+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/884705017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955804820 0x55c95580f190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009cb0 tx=0x7fc65c011440 comp rx=0 tx=0).stop 2023-10-08T12:50:06.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.463+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/884705017 shutdown_connections 2023-10-08T12:50:06.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.463+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/884705017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95580f6d0 0x55c955811ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.463+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/884705017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955803f00 0x55c9558042e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.463+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/884705017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955804820 0x55c95580f190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.463+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/884705017 >> 172.21.15.59:0/884705017 conn(0x55c9557792e0 msgr2=0x55c955800350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.463+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/884705017 shutdown_connections 2023-10-08T12:50:06.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.463+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/884705017 wait complete. 2023-10-08T12:50:06.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.463+0000 7fc68a9d5b80 1 -- start start 2023-10-08T12:50:06.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc68a9d5b80 1 Processor -- start 2023-10-08T12:50:06.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c95580f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c95580c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c95580f6d0 0x55c95580ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c955757eb0 con 0x55c955804820 2023-10-08T12:50:06.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9556f4790 con 0x55c955803f00 2023-10-08T12:50:06.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9556f4430 con 0x55c95580f6d0 2023-10-08T12:50:06.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc68a9d5b80 10 client.0 _ll_register_callbacks cb 0x55c955551880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:06.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc674d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c95580f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc674d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c95580f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35906/0 (socket says 172.21.15.59:35906) 2023-10-08T12:50:06.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc674d9b700 1 -- 172.21.15.59:0/228038731 learned_addr learned my addr 172.21.15.59:0/228038731 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:06.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc67559c700 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c95580f6d0 0x55c95580ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.464+0000 7fc66ffff700 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c95580c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc674d9b700 1 -- 172.21.15.59:0/228038731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c95580f6d0 msgr2=0x55c95580ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc674d9b700 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c95580f6d0 0x55c95580ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc674d9b700 1 -- 172.21.15.59:0/228038731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 msgr2=0x55c95580c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc674d9b700 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c95580c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc674d9b700 1 -- 172.21.15.59:0/228038731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c0098e0 con 0x55c955803f00 2023-10-08T12:50:06.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc674d9b700 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c95580f020 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc664000c00 tx=0x7fc66409a880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13b5dcd94295793e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc64ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:06.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc64ffff700 1 -- 172.21.15.59:0/228038731 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66409a380 con 0x55c955803f00 2023-10-08T12:50:06.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/228038731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c95571ff30 con 0x55c955803f00 2023-10-08T12:50:06.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc64ffff700 1 -- 172.21.15.59:0/228038731 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fc66409b390 con 0x55c955803f00 2023-10-08T12:50:06.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc64ffff700 1 -- 172.21.15.59:0/228038731 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc66409ac90 con 0x55c955803f00 2023-10-08T12:50:06.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc68a9d5b80 10 client.26705 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:06.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.465+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/228038731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c95556bce0 con 0x55c955803f00 2023-10-08T12:50:06.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.466+0000 7fc64ffff700 1 -- 172.21.15.59:0/228038731 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c95571ff30 con 0x55c955803f00 2023-10-08T12:50:06.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.466+0000 7fc64ffff700 1 -- 172.21.15.59:0/228038731 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc6640b3220 con 0x55c955803f00 2023-10-08T12:50:06.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.466+0000 7fc68a9d5b80 10 client.26705 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:06.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.466+0000 7fc68a9d5b80 10 client.26705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:06.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.466+0000 7fc68a9d5b80 20 client.26705 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:06.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.466+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c95581edb0 0x55c9558211a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.466+0000 7fc68a9d5b80 4 client.26705 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:50:06.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.466+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/228038731 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c955750e90 con 0x55c95581edb0 2023-10-08T12:50:06.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.466+0000 7fc66ffff700 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c95581edb0 0x55c9558211a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:05 smithi173 ceph-mon[135182]: pgmap v586: 97 pgs: 97 active+clean; 591 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.7 MiB/s wr, 271 op/s 2023-10-08T12:50:06.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.467+0000 7fc64ffff700 10 client.26705 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:06.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.467+0000 7fc66ffff700 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c95581edb0 0x55c9558211a0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2fa35cdc5debc53 server_cookie=e71698b3dcafbd8f in_seq=0 out_seq=0 2023-10-08T12:50:06.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.467+0000 7fc64ffff700 1 -- 172.21.15.59:0/228038731 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c955750e90 con 0x55c95581edb0 2023-10-08T12:50:06.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.467+0000 7fc64ffff700 10 client.26705 handle_command_reply: tid=0 2023-10-08T12:50:06.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 1 client.26705 shutdown 2023-10-08T12:50:06.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/228038731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 msgr2=0x55c95580f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c95580f020 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc664000c00 tx=0x7fc66409a880 comp rx=0 tx=0).stop 2023-10-08T12:50:06.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/228038731 shutdown_connections 2023-10-08T12:50:06.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c95581edb0 0x55c9558211a0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c95580f020 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c95580f6d0 0x55c95580ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc64ffff700 0 client.26705 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:06.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/228038731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c95580c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/228038731 >> 172.21.15.59:0/228038731 conn(0x55c9557792e0 msgr2=0x55c9557fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/228038731 shutdown_connections 2023-10-08T12:50:06.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/228038731 wait complete. 2023-10-08T12:50:06.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.468+0000 7fc68a9d5b80 20 client.26705 trim_cache size 0 max 16384 2023-10-08T12:50:06.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.488+0000 7fc68a9d5b80 1 Processor -- start 2023-10-08T12:50:06.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc68a9d5b80 1 -- start start 2023-10-08T12:50:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c955816220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c955807770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c95580f6d0 0x55c955807cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9555d89a0 con 0x55c955804820 2023-10-08T12:50:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c955804c30 con 0x55c955803f00 2023-10-08T12:50:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9558051a0 con 0x55c95580f6d0 2023-10-08T12:50:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc674d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c955816220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc66ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c955807770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc674d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c955816220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35918/0 (socket says 172.21.15.59:35918) 2023-10-08T12:50:06.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc674d9b700 1 -- 172.21.15.59:0/2693262945 learned_addr learned my addr 172.21.15.59:0/2693262945 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:06.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.489+0000 7fc67559c700 1 --2- 172.21.15.59:0/2693262945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c95580f6d0 0x55c955807cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.490+0000 7fc674d9b700 1 -- 172.21.15.59:0/2693262945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c95580f6d0 msgr2=0x55c955807cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.490+0000 7fc674d9b700 1 --2- 172.21.15.59:0/2693262945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c95580f6d0 0x55c955807cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.490+0000 7fc674d9b700 1 -- 172.21.15.59:0/2693262945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 msgr2=0x55c955807770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.490+0000 7fc674d9b700 1 --2- 172.21.15.59:0/2693262945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c955807770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.490+0000 7fc674d9b700 1 -- 172.21.15.59:0/2693262945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9555a92d0 con 0x55c955803f00 2023-10-08T12:50:06.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.490+0000 7fc66ffff700 1 --2- 172.21.15.59:0/2693262945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c955807770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:06.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.490+0000 7fc674d9b700 1 --2- 172.21.15.59:0/2693262945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c955816220 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc66409a990 tx=0x7fc6640a2e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb983f8f428beda9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.490+0000 7fc65b7fe700 1 -- 172.21.15.59:0/2693262945 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640a2b00 con 0x55c955803f00 2023-10-08T12:50:06.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.490+0000 7fc65b7fe700 1 -- 172.21.15.59:0/2693262945 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6640cbac0 con 0x55c955803f00 2023-10-08T12:50:06.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.490+0000 7fc65b7fe700 1 -- 172.21.15.59:0/2693262945 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66409ede0 con 0x55c955803f00 2023-10-08T12:50:06.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.491+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/2693262945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 msgr2=0x55c955816220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.491+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/2693262945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c955816220 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc66409a990 tx=0x7fc6640a2e60 comp rx=0 tx=0).stop 2023-10-08T12:50:06.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.491+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/2693262945 shutdown_connections 2023-10-08T12:50:06.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.491+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/2693262945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c955803f00 0x55c955816220 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.491+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/2693262945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c95580f6d0 0x55c955807cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.491+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/2693262945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c955807770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.491+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/2693262945 >> 172.21.15.59:0/2693262945 conn(0x55c9557792e0 msgr2=0x55c95580b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.491+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/2693262945 shutdown_connections 2023-10-08T12:50:06.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.491+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/2693262945 wait complete. 2023-10-08T12:50:06.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.491+0000 7fc68a9d5b80 1 -- start start 2023-10-08T12:50:06.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc68a9d5b80 1 Processor -- start 2023-10-08T12:50:06.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955803f00 0x55c9558149f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c955814f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc68a9d5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95580f6d0 0x55c955815470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c955872b90 con 0x55c955804820 2023-10-08T12:50:06.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c955872cd0 con 0x55c95580f6d0 2023-10-08T12:50:06.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc68a9d5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c955872e90 con 0x55c955803f00 2023-10-08T12:50:06.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc68a9d5b80 10 client.0 _ll_register_callbacks cb 0x7fc664009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:06.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc674d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955803f00 0x55c9558149f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc66ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c955814f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc674d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955803f00 0x55c9558149f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:42770/0 (socket says 172.21.15.59:42770) 2023-10-08T12:50:06.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc674d9b700 1 -- 172.21.15.59:0/1721118834 learned_addr learned my addr 172.21.15.59:0/1721118834 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:06.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.492+0000 7fc67559c700 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95580f6d0 0x55c955815470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc674d9b700 1 -- 172.21.15.59:0/1721118834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95580f6d0 msgr2=0x55c955815470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc674d9b700 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95580f6d0 0x55c955815470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc674d9b700 1 -- 172.21.15.59:0/1721118834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 msgr2=0x55c955814f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc674d9b700 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c955814f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc674d9b700 1 -- 172.21.15.59:0/1721118834 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c01e040 con 0x55c955803f00 2023-10-08T12:50:06.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc67559c700 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95580f6d0 0x55c955815470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:50:06.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc674d9b700 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955803f00 0x55c9558149f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc664009fd0 tx=0x7fc664097050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f21e8a4b9dbcb69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc64ffff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:50:06.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc64ffff700 1 -- 172.21.15.59:0/1721118834 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640a2b00 con 0x55c955803f00 2023-10-08T12:50:06.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc64ffff700 1 -- 172.21.15.59:0/1721118834 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fc66409ac90 con 0x55c955803f00 2023-10-08T12:50:06.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/1721118834 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc65c004510 con 0x55c955803f00 2023-10-08T12:50:06.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc64ffff700 1 -- 172.21.15.59:0/1721118834 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6640a2c90 con 0x55c955803f00 2023-10-08T12:50:06.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc68a9d5b80 10 client.26701 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:06.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.493+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/1721118834 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c95556bce0 con 0x55c955803f00 2023-10-08T12:50:06.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.494+0000 7fc64ffff700 1 -- 172.21.15.59:0/1721118834 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc65c004510 con 0x55c955803f00 2023-10-08T12:50:06.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.494+0000 7fc64ffff700 1 -- 172.21.15.59:0/1721118834 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc664096b10 con 0x55c955803f00 2023-10-08T12:50:06.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.494+0000 7fc68a9d5b80 10 client.26701 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:06.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.494+0000 7fc68a9d5b80 10 client.26701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:06.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.494+0000 7fc68a9d5b80 20 client.26701 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:06.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.494+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c9558741c0 0x55c9558765b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.494+0000 7fc68a9d5b80 4 client.26701 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:50:06.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.494+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/1721118834 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c955750bb0 con 0x55c9558741c0 2023-10-08T12:50:06.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.494+0000 7fc66ffff700 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c9558741c0 0x55c9558765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.495+0000 7fc66ffff700 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c9558741c0 0x55c9558765b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ea18b2064e636be server_cookie=b9f4db8e0d2700d in_seq=0 out_seq=0 2023-10-08T12:50:06.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.495+0000 7fc64ffff700 10 client.26701 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:06.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc64ffff700 1 -- 172.21.15.59:0/1721118834 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c955750bb0 con 0x55c9558741c0 2023-10-08T12:50:06.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc64ffff700 10 client.26701 handle_command_reply: tid=0 2023-10-08T12:50:06.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 1 client.26701 shutdown 2023-10-08T12:50:06.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/1721118834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955803f00 msgr2=0x55c9558149f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955803f00 0x55c9558149f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc664009fd0 tx=0x7fc664097050 comp rx=0 tx=0).stop 2023-10-08T12:50:06.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/1721118834 shutdown_connections 2023-10-08T12:50:06.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c9558741c0 0x55c9558765b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c95580f6d0 0x55c955815470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c955803f00 0x55c9558149f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc64ffff700 0 client.26701 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:06.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 1 --2- 172.21.15.59:0/1721118834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c955804820 0x55c955814f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/1721118834 >> 172.21.15.59:0/1721118834 conn(0x55c9557792e0 msgr2=0x55c955807770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/1721118834 shutdown_connections 2023-10-08T12:50:06.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 1 -- 172.21.15.59:0/1721118834 wait complete. 2023-10-08T12:50:06.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.496+0000 7fc68a9d5b80 20 client.26701 trim_cache size 0 max 16384 2023-10-08T12:50:06.505 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:50:06.505 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:50:06.505 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "74f12f6f-9441-4887-b330-9b6851cd2684", 2023-10-08T12:50:06.505 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:50:06.505 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:50:06.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 -- 172.21.15.59:0/2586382069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6600a1670 msgr2=0x7fc6600a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6600a1670 0x7fc6600a3b30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc668009550 tx=0x7fc668007e30 comp rx=0 tx=0).stop 2023-10-08T12:50:06.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 -- 172.21.15.59:0/2586382069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc670067ce0 msgr2=0x7fc670198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc670067ce0 0x7fc670198e30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc66400b580 tx=0x7fc66400f690 comp rx=0 tx=0).stop 2023-10-08T12:50:06.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 -- 172.21.15.59:0/2586382069 shutdown_connections 2023-10-08T12:50:06.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6600a1670 0x7fc6600a3b30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc670105b80 0x7fc67019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc670067ce0 0x7fc670198e30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 --2- 172.21.15.59:0/2586382069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6701051c0 0x7fc670199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 -- 172.21.15.59:0/2586382069 >> 172.21.15.59:0/2586382069 conn(0x7fc670076780 msgr2=0x7fc67010be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 -- 172.21.15.59:0/2586382069 shutdown_connections 2023-10-08T12:50:06.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.497+0000 7fc676fff700 1 -- 172.21.15.59:0/2586382069 wait complete. 2023-10-08T12:50:06.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:50:06.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1133833 13.06 MB/sec execute 337 sec latency 65.510 ms 2023-10-08T12:50:06.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.740+0000 7fd265dff700 1 -- 172.21.15.59:0/3603413535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2601010f0 msgr2=0x7fd26010d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.740+0000 7fd265dff700 1 --2- 172.21.15.59:0/3603413535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2601010f0 0x7fd26010d600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd258009f90 tx=0x7fd25800b330 comp rx=0 tx=0).stop 2023-10-08T12:50:06.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.740+0000 7fd265dff700 1 -- 172.21.15.59:0/3603413535 shutdown_connections 2023-10-08T12:50:06.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.740+0000 7fd265dff700 1 --2- 172.21.15.59:0/3603413535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd260106740 0x7fd260106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.740+0000 7fd265dff700 1 --2- 172.21.15.59:0/3603413535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2601010f0 0x7fd26010d600 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.740+0000 7fd265dff700 1 --2- 172.21.15.59:0/3603413535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd260100730 0x7fd260100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.740+0000 7fd265dff700 1 -- 172.21.15.59:0/3603413535 >> 172.21.15.59:0/3603413535 conn(0x7fd2600fc200 msgr2=0x7fd2600fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.740+0000 7fd265dff700 1 -- 172.21.15.59:0/3603413535 shutdown_connections 2023-10-08T12:50:06.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.740+0000 7fd265dff700 1 -- 172.21.15.59:0/3603413535 wait complete. 2023-10-08T12:50:06.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.741+0000 7fd265dff700 1 Processor -- start 2023-10-08T12:50:06.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.741+0000 7fd265dff700 1 -- start start 2023-10-08T12:50:06.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.741+0000 7fd265dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd260100730 0x7fd260198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.741+0000 7fd265dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2601010f0 0x7fd260199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.741+0000 7fd265dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd260106740 0x7fd26019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.741+0000 7fd265dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26019dcd0 con 0x7fd260106740 2023-10-08T12:50:06.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.741+0000 7fd265dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26019de40 con 0x7fd2601010f0 2023-10-08T12:50:06.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.741+0000 7fd265dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26019e000 con 0x7fd260100730 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.742+0000 7fd25effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2601010f0 0x7fd260199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.742+0000 7fd25effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2601010f0 0x7fd260199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35932/0 (socket says 172.21.15.59:35932) 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.742+0000 7fd25effd700 1 -- 172.21.15.59:0/3300991892 learned_addr learned my addr 172.21.15.59:0/3300991892 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.742+0000 7fd25ffff700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd260106740 0x7fd26019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.742+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd260100730 0x7fd260198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.742+0000 7fd25effd700 1 -- 172.21.15.59:0/3300991892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd260100730 msgr2=0x7fd260198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.742+0000 7fd25effd700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd260100730 0x7fd260198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.742+0000 7fd25effd700 1 -- 172.21.15.59:0/3300991892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd260106740 msgr2=0x7fd26019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.742+0000 7fd25effd700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd260106740 0x7fd26019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.742+0000 7fd25effd700 1 -- 172.21.15.59:0/3300991892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258009c40 con 0x7fd2601010f0 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.742+0000 7fd25effd700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2601010f0 0x7fd260199340 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd25400e9a0 tx=0x7fd25400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.743+0000 7fd25cff9700 1 -- 172.21.15.59:0/3300991892 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254009790 con 0x7fd2601010f0 2023-10-08T12:50:06.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.743+0000 7fd25cff9700 1 -- 172.21.15.59:0/3300991892 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd25400ce80 con 0x7fd2601010f0 2023-10-08T12:50:06.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.743+0000 7fd265dff700 1 -- 172.21.15.59:0/3300991892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26019e2e0 con 0x7fd2601010f0 2023-10-08T12:50:06.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.743+0000 7fd25cff9700 1 -- 172.21.15.59:0/3300991892 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254018680 con 0x7fd2601010f0 2023-10-08T12:50:06.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.743+0000 7fd265dff700 1 -- 172.21.15.59:0/3300991892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2601a5b20 con 0x7fd2601010f0 2023-10-08T12:50:06.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.746+0000 7fd25cff9700 1 -- 172.21.15.59:0/3300991892 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd254010430 con 0x7fd2601010f0 2023-10-08T12:50:06.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.747+0000 7fd279644b80 1 Processor -- start 2023-10-08T12:50:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.747+0000 7fd279644b80 1 -- start start 2023-10-08T12:50:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd279644b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 0x559bc45ec260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd279644b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd279644b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45f9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd279644b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc4555460 con 0x559bc45f7650 2023-10-08T12:50:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd279644b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc4546c20 con 0x559bc45ec7a0 2023-10-08T12:50:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd279644b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc4544540 con 0x559bc45ebe80 2023-10-08T12:50:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 0x559bc45ec260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 0x559bc45ec260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:42792/0 (socket says 172.21.15.59:42792) 2023-10-08T12:50:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35934/0 (socket says 172.21.15.59:35934) 2023-10-08T12:50:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25ffff700 1 -- 172.21.15.59:0/3873984562 learned_addr learned my addr 172.21.15.59:0/3873984562 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25cff9700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2480a1630 0x7fd2480a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25effd700 1 --2- 172.21.15.59:0/3873984562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45f9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25f7fe700 1 -- 172.21.15.59:0/3873984562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 msgr2=0x559bc45ec260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/3873984562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 0x559bc45ec260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25f7fe700 1 -- 172.21.15.59:0/3873984562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 msgr2=0x559bc45f9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/3873984562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45f9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25f7fe700 1 -- 172.21.15.59:0/3873984562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bc436ade0 con 0x559bc45ec7a0 2023-10-08T12:50:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.748+0000 7fd25cff9700 1 -- 172.21.15.59:0/3300991892 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fd254014070 con 0x7fd2601010f0 2023-10-08T12:50:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.749+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/3873984562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f7110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd250009cf0 tx=0x7fd2500058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8ea91531c2ed992 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.749+0000 7fd25ffff700 1 --2- 172.21.15.59:0/3873984562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 0x559bc45ec260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:50:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.749+0000 7fd25effd700 1 --2- 172.21.15.59:0/3873984562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45f9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:50:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.749+0000 7fd25ffff700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2480a1630 0x7fd2480a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.749+0000 7fd245ffb700 1 -- 172.21.15.59:0/3873984562 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250011d90 con 0x559bc45ec7a0 2023-10-08T12:50:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.749+0000 7fd245ffb700 1 -- 172.21.15.59:0/3873984562 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd250004510 con 0x559bc45ec7a0 2023-10-08T12:50:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.749+0000 7fd245ffb700 1 -- 172.21.15.59:0/3873984562 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250005280 con 0x559bc45ec7a0 2023-10-08T12:50:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.750+0000 7fd279644b80 1 -- 172.21.15.59:0/3873984562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 msgr2=0x559bc45f7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.750+0000 7fd279644b80 1 --2- 172.21.15.59:0/3873984562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f7110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd250009cf0 tx=0x7fd2500058e0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.750+0000 7fd25ffff700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2480a1630 0x7fd2480a3af0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd258009550 tx=0x7fd258009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.750+0000 7fd279644b80 1 -- 172.21.15.59:0/3873984562 shutdown_connections 2023-10-08T12:50:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.750+0000 7fd279644b80 1 --2- 172.21.15.59:0/3873984562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45f9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.750+0000 7fd279644b80 1 --2- 172.21.15.59:0/3873984562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 0x559bc45ec260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.750+0000 7fd279644b80 1 --2- 172.21.15.59:0/3873984562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f7110 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.750+0000 7fd279644b80 1 -- 172.21.15.59:0/3873984562 >> 172.21.15.59:0/3873984562 conn(0x559bc4561260 msgr2=0x559bc45e82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.750+0000 7fd279644b80 1 -- 172.21.15.59:0/3873984562 shutdown_connections 2023-10-08T12:50:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.750+0000 7fd279644b80 1 -- 172.21.15.59:0/3873984562 wait complete. 2023-10-08T12:50:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.751+0000 7fd279644b80 1 -- start start 2023-10-08T12:50:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.751+0000 7fd279644b80 1 Processor -- start 2023-10-08T12:50:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.751+0000 7fd279644b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45ebe80 0x559bc45f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.751+0000 7fd279644b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.751+0000 7fd279644b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45f7650 0x559bc45f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.751+0000 7fd279644b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc453fe30 con 0x559bc45ebe80 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.751+0000 7fd279644b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc44dc710 con 0x559bc45ec7a0 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.751+0000 7fd279644b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc44dc3b0 con 0x559bc45f7650 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.751+0000 7fd279644b80 10 client.0 _ll_register_callbacks cb 0x559bc4339800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd25effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd25effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35940/0 (socket says 172.21.15.59:35940) 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd25effd700 1 -- 172.21.15.59:0/4041089007 learned_addr learned my addr 172.21.15.59:0/4041089007 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd25ffff700 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45f7650 0x559bc45f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45ebe80 0x559bc45f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd25effd700 1 -- 172.21.15.59:0/4041089007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45f7650 msgr2=0x559bc45f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd25effd700 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45f7650 0x559bc45f48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd25effd700 1 -- 172.21.15.59:0/4041089007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45ebe80 msgr2=0x559bc45f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd25effd700 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45ebe80 0x559bc45f6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd25effd700 1 -- 172.21.15.59:0/4041089007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd250009920 con 0x559bc45ec7a0 2023-10-08T12:50:06.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd25effd700 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f42f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd25400c5b0 tx=0x7fd25409aa40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3c1c4caddba2d61 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.752+0000 7fd23effd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:06.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd23effd700 1 -- 172.21.15.59:0/4041089007 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540caeb0 con 0x559bc45ec7a0 2023-10-08T12:50:06.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd23effd700 1 -- 172.21.15.59:0/4041089007 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fd2540a2650 con 0x559bc45ec7a0 2023-10-08T12:50:06.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd279644b80 1 -- 172.21.15.59:0/4041089007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559bc4507eb0 con 0x559bc45ec7a0 2023-10-08T12:50:06.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd23effd700 1 -- 172.21.15.59:0/4041089007 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2540cf110 con 0x559bc45ec7a0 2023-10-08T12:50:06.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd279644b80 10 client.26723 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:06.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd279644b80 1 -- 172.21.15.59:0/4041089007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x559bc4353c60 con 0x559bc45ec7a0 2023-10-08T12:50:06.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd23effd700 1 -- 172.21.15.59:0/4041089007 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559bc4507eb0 con 0x559bc45ec7a0 2023-10-08T12:50:06.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd23effd700 1 -- 172.21.15.59:0/4041089007 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd2540997b0 con 0x559bc45ec7a0 2023-10-08T12:50:06.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd279644b80 10 client.26723 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:06.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd279644b80 10 client.26723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:06.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd279644b80 20 client.26723 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:06.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd279644b80 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559bc4606fb0 0x559bc46093d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd279644b80 4 client.26723 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:50:06.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.753+0000 7fd279644b80 1 -- 172.21.15.59:0/4041089007 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559bc4538e10 con 0x559bc4606fb0 2023-10-08T12:50:06.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.754+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559bc4606fb0 0x559bc46093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.754+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559bc4606fb0 0x559bc46093d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b148ef07918191a server_cookie=8aa42bf715f67427 in_seq=0 out_seq=0 2023-10-08T12:50:06.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.754+0000 7fd23effd700 10 client.26723 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:06.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.755+0000 7fd23effd700 1 -- 172.21.15.59:0/4041089007 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559bc4538e10 con 0x559bc4606fb0 2023-10-08T12:50:06.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.755+0000 7fd23effd700 10 client.26723 handle_command_reply: tid=0 2023-10-08T12:50:06.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 1 client.26723 shutdown 2023-10-08T12:50:06.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 1 -- 172.21.15.59:0/4041089007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 msgr2=0x559bc45f42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f42f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd25400c5b0 tx=0x7fd25409aa40 comp rx=0 tx=0).stop 2023-10-08T12:50:06.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 1 -- 172.21.15.59:0/4041089007 shutdown_connections 2023-10-08T12:50:06.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559bc4606fb0 0x559bc46093d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45f7650 0x559bc45f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45ebe80 0x559bc45f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd23effd700 0 client.26723 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:06.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 1 --2- 172.21.15.59:0/4041089007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45f42f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 1 -- 172.21.15.59:0/4041089007 >> 172.21.15.59:0/4041089007 conn(0x559bc4561260 msgr2=0x559bc45e7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 1 -- 172.21.15.59:0/4041089007 shutdown_connections 2023-10-08T12:50:06.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 1 -- 172.21.15.59:0/4041089007 wait complete. 2023-10-08T12:50:06.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.756+0000 7fd279644b80 20 client.26723 trim_cache size 0 max 16384 2023-10-08T12:50:06.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.775+0000 7fd279644b80 1 Processor -- start 2023-10-08T12:50:06.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.775+0000 7fd279644b80 1 -- start start 2023-10-08T12:50:06.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd279644b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 0x559bc45f4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd279644b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45fe1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd279644b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd279644b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc43c0920 con 0x559bc45f7650 2023-10-08T12:50:06.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd279644b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc45eff60 con 0x559bc45ec7a0 2023-10-08T12:50:06.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd279644b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc45ecb80 con 0x559bc45ebe80 2023-10-08T12:50:06.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45fe1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 0x559bc45f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45fe1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35956/0 (socket says 172.21.15.59:35956) 2023-10-08T12:50:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25effd700 1 -- 172.21.15.59:0/4050639329 learned_addr learned my addr 172.21.15.59:0/4050639329 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25ffff700 1 --2- 172.21.15.59:0/4050639329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25f7fe700 1 -- 172.21.15.59:0/4050639329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 msgr2=0x559bc45fe1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/4050639329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45fe1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25f7fe700 1 -- 172.21.15.59:0/4050639329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 msgr2=0x559bc45f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/4050639329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45f6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25f7fe700 1 -- 172.21.15.59:0/4050639329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bc4391250 con 0x559bc45ebe80 2023-10-08T12:50:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25effd700 1 --2- 172.21.15.59:0/4050639329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45fe1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.776+0000 7fd25ffff700 1 --2- 172.21.15.59:0/4050639329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:50:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.777+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/4050639329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 0x559bc45f4840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd250009cc0 tx=0x7fd250005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17ccb494a196147 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.777+0000 7fd2467fc700 1 -- 172.21.15.59:0/4050639329 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250029070 con 0x559bc45ebe80 2023-10-08T12:50:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.777+0000 7fd2467fc700 1 -- 172.21.15.59:0/4050639329 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd25002d070 con 0x559bc45ebe80 2023-10-08T12:50:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.777+0000 7fd2467fc700 1 -- 172.21.15.59:0/4050639329 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250005150 con 0x559bc45ebe80 2023-10-08T12:50:06.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.778+0000 7fd279644b80 1 -- 172.21.15.59:0/4050639329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 msgr2=0x559bc45f4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.778+0000 7fd279644b80 1 --2- 172.21.15.59:0/4050639329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 0x559bc45f4840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd250009cc0 tx=0x7fd250005fb0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.778+0000 7fd279644b80 1 -- 172.21.15.59:0/4050639329 shutdown_connections 2023-10-08T12:50:06.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.778+0000 7fd279644b80 1 --2- 172.21.15.59:0/4050639329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.778+0000 7fd279644b80 1 --2- 172.21.15.59:0/4050639329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ebe80 0x559bc45f4840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.778+0000 7fd279644b80 1 --2- 172.21.15.59:0/4050639329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ec7a0 0x559bc45fe1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.778+0000 7fd279644b80 1 -- 172.21.15.59:0/4050639329 >> 172.21.15.59:0/4050639329 conn(0x559bc4561260 msgr2=0x559bc45e74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.778+0000 7fd279644b80 1 -- 172.21.15.59:0/4050639329 shutdown_connections 2023-10-08T12:50:06.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.778+0000 7fd279644b80 1 -- 172.21.15.59:0/4050639329 wait complete. 2023-10-08T12:50:06.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.778+0000 7fd279644b80 1 -- start start 2023-10-08T12:50:06.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd279644b80 1 Processor -- start 2023-10-08T12:50:06.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd279644b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ebe80 0x559bc45fde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd279644b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ec7a0 0x559bc45fe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd279644b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45fc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd279644b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc45fcb20 con 0x559bc45f7650 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd279644b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc45fcc90 con 0x559bc45ebe80 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd279644b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc45fce50 con 0x559bc45ec7a0 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd279644b80 10 client.0 _ll_register_callbacks cb 0x7fd254099ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd25f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ebe80 0x559bc45fde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd25effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ec7a0 0x559bc45fe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd25ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd25effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ec7a0 0x559bc45fe350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:42812/0 (socket says 172.21.15.59:42812) 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd25effd700 1 -- 172.21.15.59:0/419259779 learned_addr learned my addr 172.21.15.59:0/419259779 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.779+0000 7fd25f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ebe80 0x559bc45fde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:35970/0 (socket says 172.21.15.59:35970) 2023-10-08T12:50:06.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd25effd700 1 -- 172.21.15.59:0/419259779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ebe80 msgr2=0x559bc45fde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd25effd700 1 --2- 172.21.15.59:0/419259779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ebe80 0x559bc45fde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd25effd700 1 -- 172.21.15.59:0/419259779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 msgr2=0x559bc45fc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd25effd700 1 --2- 172.21.15.59:0/419259779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45fc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd25effd700 1 -- 172.21.15.59:0/419259779 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559bc4353c60 con 0x559bc45ec7a0 2023-10-08T12:50:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd25effd700 1 --2- 172.21.15.59:0/419259779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ec7a0 0x559bc45fe350 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd25400c5b0 tx=0x7fd254010a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c02132b2068d1305 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd23effd700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:50:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd23effd700 1 -- 172.21.15.59:0/419259779 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25409a720 con 0x559bc45ec7a0 2023-10-08T12:50:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd23effd700 1 -- 172.21.15.59:0/419259779 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fd2540a2650 con 0x559bc45ec7a0 2023-10-08T12:50:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd279644b80 1 -- 172.21.15.59:0/419259779 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd250004510 con 0x559bc45ec7a0 2023-10-08T12:50:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd23effd700 1 -- 172.21.15.59:0/419259779 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2540a21c0 con 0x559bc45ec7a0 2023-10-08T12:50:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd279644b80 10 client.26719 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:06.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.780+0000 7fd279644b80 1 -- 172.21.15.59:0/419259779 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fd25001d040 con 0x559bc45ec7a0 2023-10-08T12:50:06.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.781+0000 7fd23effd700 1 -- 172.21.15.59:0/419259779 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd250004510 con 0x559bc45ec7a0 2023-10-08T12:50:06.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.781+0000 7fd23effd700 1 -- 172.21.15.59:0/419259779 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd254099220 con 0x559bc45ec7a0 2023-10-08T12:50:06.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.781+0000 7fd279644b80 10 client.26719 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:06.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.781+0000 7fd279644b80 10 client.26719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:06.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.781+0000 7fd279644b80 20 client.26719 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:06.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.781+0000 7fd279644b80 1 --2- 172.21.15.59:0/419259779 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559bc465bf50 0x559bc465e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:06.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.781+0000 7fd279644b80 4 client.26719 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:50:06.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.781+0000 7fd279644b80 1 -- 172.21.15.59:0/419259779 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559bc4538b30 con 0x559bc465bf50 2023-10-08T12:50:06.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.781+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/419259779 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559bc465bf50 0x559bc465e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:06.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd25f7fe700 1 --2- 172.21.15.59:0/419259779 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559bc465bf50 0x559bc465e370 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=297483d09b227997 server_cookie=19df7aecd682740 in_seq=0 out_seq=0 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd23effd700 10 client.26719 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd23effd700 1 -- 172.21.15.59:0/419259779 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559bc4538b30 con 0x559bc465bf50 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd23effd700 10 client.26719 handle_command_reply: tid=0 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 1 client.26719 shutdown 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 1 -- 172.21.15.59:0/419259779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ec7a0 msgr2=0x559bc45fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 1 --2- 172.21.15.59:0/419259779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ec7a0 0x559bc45fe350 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd25400c5b0 tx=0x7fd254010a80 comp rx=0 tx=0).stop 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 1 -- 172.21.15.59:0/419259779 shutdown_connections 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 1 --2- 172.21.15.59:0/419259779 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559bc465bf50 0x559bc465e370 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 1 --2- 172.21.15.59:0/419259779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bc45ebe80 0x559bc45fde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 1 --2- 172.21.15.59:0/419259779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559bc45f7650 0x559bc45fc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 1 --2- 172.21.15.59:0/419259779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559bc45ec7a0 0x559bc45fe350 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd23effd700 0 client.26719 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:06.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 1 -- 172.21.15.59:0/419259779 >> 172.21.15.59:0/419259779 conn(0x559bc4561260 msgr2=0x559bc46028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 1 -- 172.21.15.59:0/419259779 shutdown_connections 2023-10-08T12:50:06.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 1 -- 172.21.15.59:0/419259779 wait complete. 2023-10-08T12:50:06.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.782+0000 7fd279644b80 20 client.26719 trim_cache size 0 max 16384 2023-10-08T12:50:06.788 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:50:06.788 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:50:06.788 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:50:06.788 INFO:teuthology.orchestra.run.smithi059.stdout: "74f12f6f-9441-4887-b330-9b6851cd2684": { 2023-10-08T12:50:06.789 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:50:06.789 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "74f12f6f-9441-4887-b330-9b6851cd2684", 2023-10-08T12:50:06.789 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:50:06.789 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:50:06.789 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:50:06.789 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:50:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 -- 172.21.15.59:0/3300991892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2480a1630 msgr2=0x7fd2480a3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2480a1630 0x7fd2480a3af0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd258009550 tx=0x7fd258009920 comp rx=0 tx=0).stop 2023-10-08T12:50:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 -- 172.21.15.59:0/3300991892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2601010f0 msgr2=0x7fd260199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2601010f0 0x7fd260199340 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd25400e9a0 tx=0x7fd25400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 -- 172.21.15.59:0/3300991892 shutdown_connections 2023-10-08T12:50:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd2480a1630 0x7fd2480a3af0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd260106740 0x7fd26019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd260100730 0x7fd260198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 --2- 172.21.15.59:0/3300991892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2601010f0 0x7fd260199340 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 -- 172.21.15.59:0/3300991892 >> 172.21.15.59:0/3300991892 conn(0x7fd2600fc200 msgr2=0x7fd2600fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:06.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 -- 172.21.15.59:0/3300991892 shutdown_connections 2023-10-08T12:50:06.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:06.783+0000 7fd265dff700 1 -- 172.21.15.59:0/3300991892 wait complete. 2023-10-08T12:50:06.801 INFO:tasks.cephfs.filesystem:scrub status for tag:74f12f6f-9441-4887-b330-9b6851cd2684 - {'path': '/', 'tag': '74f12f6f-9441-4887-b330-9b6851cd2684', 'options': 'recursive,force'} 2023-10-08T12:50:07.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:07 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:50:07.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:07 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:07.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:07 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:50:07.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:07 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:07.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:07 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:50:07.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:07 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:07.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:07 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:50:07.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:07 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:07 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:50:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:07 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:07 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:50:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:07 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:07.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1136293 13.06 MB/sec execute 338 sec latency 25.921 ms 2023-10-08T12:50:08.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:08 smithi059 ceph-mon[98489]: pgmap v587: 97 pgs: 97 active+clean; 594 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 256 op/s 2023-10-08T12:50:08.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:08 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:50:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:08 smithi092 ceph-mon[134093]: pgmap v587: 97 pgs: 97 active+clean; 594 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 256 op/s 2023-10-08T12:50:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:08 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:50:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:08 smithi173 ceph-mon[135182]: pgmap v587: 97 pgs: 97 active+clean; 594 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 256 op/s 2023-10-08T12:50:08.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:08 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:50:08.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1138212 13.06 MB/sec execute 339 sec latency 13.057 ms 2023-10-08T12:50:09.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1140613 13.06 MB/sec execute 340 sec latency 17.533 ms 2023-10-08T12:50:10.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:09 smithi092 ceph-mon[134093]: pgmap v588: 97 pgs: 97 active+clean; 601 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 268 op/s 2023-10-08T12:50:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:09 smithi173 ceph-mon[135182]: pgmap v588: 97 pgs: 97 active+clean; 601 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 268 op/s 2023-10-08T12:50:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:09 smithi059 ceph-mon[98489]: pgmap v588: 97 pgs: 97 active+clean; 601 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 268 op/s 2023-10-08T12:50:10.531 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1142561 13.04 MB/sec execute 341 sec latency 49.572 ms 2023-10-08T12:50:11.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1144278 13.04 MB/sec execute 342 sec latency 58.738 ms 2023-10-08T12:50:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:11 smithi059 ceph-mon[98489]: pgmap v589: 97 pgs: 97 active+clean; 602 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 272 op/s 2023-10-08T12:50:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:11 smithi092 ceph-mon[134093]: pgmap v589: 97 pgs: 97 active+clean; 602 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 272 op/s 2023-10-08T12:50:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:11 smithi173 ceph-mon[135182]: pgmap v589: 97 pgs: 97 active+clean; 602 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 272 op/s 2023-10-08T12:50:12.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1146521 13.03 MB/sec execute 343 sec latency 75.764 ms 2023-10-08T12:50:13.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1148677 13.03 MB/sec execute 344 sec latency 27.734 ms 2023-10-08T12:50:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:14 smithi059 ceph-mon[98489]: pgmap v590: 97 pgs: 97 active+clean; 608 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 234 op/s 2023-10-08T12:50:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:14 smithi059 ceph-mon[98489]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T12:50:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:14 smithi092 ceph-mon[134093]: pgmap v590: 97 pgs: 97 active+clean; 608 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 234 op/s 2023-10-08T12:50:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:14 smithi092 ceph-mon[134093]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T12:50:14.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:14 smithi173 ceph-mon[135182]: pgmap v590: 97 pgs: 97 active+clean; 608 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 234 op/s 2023-10-08T12:50:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:14 smithi173 ceph-mon[135182]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T12:50:14.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1151181 13.04 MB/sec execute 345 sec latency 16.422 ms 2023-10-08T12:50:15.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1153304 13.02 MB/sec execute 346 sec latency 23.837 ms 2023-10-08T12:50:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:16 smithi059 ceph-mon[98489]: pgmap v592: 97 pgs: 97 active+clean; 613 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 243 op/s 2023-10-08T12:50:16.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:16 smithi092 ceph-mon[134093]: pgmap v592: 97 pgs: 97 active+clean; 613 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 243 op/s 2023-10-08T12:50:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:16 smithi173 ceph-mon[135182]: pgmap v592: 97 pgs: 97 active+clean; 613 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 243 op/s 2023-10-08T12:50:16.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1155046 13.02 MB/sec execute 347 sec latency 53.846 ms 2023-10-08T12:50:17.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1157261 13.01 MB/sec execute 348 sec latency 101.517 ms 2023-10-08T12:50:18.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:18 smithi059 ceph-mon[98489]: pgmap v593: 97 pgs: 97 active+clean; 602 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 245 op/s 2023-10-08T12:50:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:18 smithi092 ceph-mon[134093]: pgmap v593: 97 pgs: 97 active+clean; 602 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 245 op/s 2023-10-08T12:50:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:18 smithi173 ceph-mon[135182]: pgmap v593: 97 pgs: 97 active+clean; 602 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 245 op/s 2023-10-08T12:50:18.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1158515 13.00 MB/sec execute 349 sec latency 241.217 ms 2023-10-08T12:50:19.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1161148 13.00 MB/sec execute 350 sec latency 15.706 ms 2023-10-08T12:50:20.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:19 smithi092 ceph-mon[134093]: pgmap v594: 97 pgs: 97 active+clean; 575 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 220 op/s 2023-10-08T12:50:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:19 smithi173 ceph-mon[135182]: pgmap v594: 97 pgs: 97 active+clean; 575 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 220 op/s 2023-10-08T12:50:20.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:19 smithi059 ceph-mon[98489]: pgmap v594: 97 pgs: 97 active+clean; 575 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 220 op/s 2023-10-08T12:50:20.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1163160 12.99 MB/sec execute 351 sec latency 15.653 ms 2023-10-08T12:50:21.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1165409 13.00 MB/sec execute 352 sec latency 91.333 ms 2023-10-08T12:50:22.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:22 smithi059 ceph-mon[98489]: pgmap v595: 97 pgs: 97 active+clean; 582 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 253 op/s 2023-10-08T12:50:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:22 smithi092 ceph-mon[134093]: pgmap v595: 97 pgs: 97 active+clean; 582 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 253 op/s 2023-10-08T12:50:22.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:22 smithi173 ceph-mon[135182]: pgmap v595: 97 pgs: 97 active+clean; 582 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 253 op/s 2023-10-08T12:50:22.532 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1167783 12.99 MB/sec execute 353 sec latency 20.363 ms 2023-10-08T12:50:23.533 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1169731 12.98 MB/sec execute 354 sec latency 15.291 ms 2023-10-08T12:50:24.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:24 smithi059 ceph-mon[98489]: pgmap v596: 97 pgs: 97 active+clean; 585 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.8 MiB/s wr, 244 op/s 2023-10-08T12:50:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:24 smithi092 ceph-mon[134093]: pgmap v596: 97 pgs: 97 active+clean; 585 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.8 MiB/s wr, 244 op/s 2023-10-08T12:50:24.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:24 smithi173 ceph-mon[135182]: pgmap v596: 97 pgs: 97 active+clean; 585 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.8 MiB/s wr, 244 op/s 2023-10-08T12:50:24.533 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1172227 12.99 MB/sec execute 355 sec latency 107.140 ms 2023-10-08T12:50:25.533 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1174309 12.97 MB/sec execute 356 sec latency 11.887 ms 2023-10-08T12:50:26.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:26 smithi059 ceph-mon[98489]: pgmap v597: 97 pgs: 97 active+clean; 589 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 249 op/s 2023-10-08T12:50:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:26 smithi092 ceph-mon[134093]: pgmap v597: 97 pgs: 97 active+clean; 589 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 249 op/s 2023-10-08T12:50:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:26 smithi173 ceph-mon[135182]: pgmap v597: 97 pgs: 97 active+clean; 589 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 249 op/s 2023-10-08T12:50:26.533 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1176214 12.97 MB/sec execute 357 sec latency 64.295 ms 2023-10-08T12:50:27.533 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1178557 12.97 MB/sec execute 358 sec latency 18.433 ms 2023-10-08T12:50:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:28 smithi059 ceph-mon[98489]: pgmap v598: 97 pgs: 97 active+clean; 590 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 222 op/s 2023-10-08T12:50:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:28 smithi092 ceph-mon[134093]: pgmap v598: 97 pgs: 97 active+clean; 590 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 222 op/s 2023-10-08T12:50:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:28 smithi173 ceph-mon[135182]: pgmap v598: 97 pgs: 97 active+clean; 590 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 222 op/s 2023-10-08T12:50:28.533 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1180432 12.96 MB/sec execute 359 sec latency 13.677 ms 2023-10-08T12:50:29.533 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1182823 12.97 MB/sec execute 360 sec latency 94.659 ms 2023-10-08T12:50:30.128 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:29 smithi092 ceph-mon[134093]: pgmap v599: 97 pgs: 97 active+clean; 597 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 216 op/s 2023-10-08T12:50:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:29 smithi173 ceph-mon[135182]: pgmap v599: 97 pgs: 97 active+clean; 597 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 216 op/s 2023-10-08T12:50:30.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:29 smithi059 ceph-mon[98489]: pgmap v599: 97 pgs: 97 active+clean; 597 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 216 op/s 2023-10-08T12:50:30.533 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1184640 12.95 MB/sec execute 361 sec latency 27.392 ms 2023-10-08T12:50:31.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1186892 12.95 MB/sec execute 362 sec latency 111.195 ms 2023-10-08T12:50:32.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:32 smithi059 ceph-mon[98489]: pgmap v600: 97 pgs: 97 active+clean; 598 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 215 op/s 2023-10-08T12:50:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:32 smithi092 ceph-mon[134093]: pgmap v600: 97 pgs: 97 active+clean; 598 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 215 op/s 2023-10-08T12:50:32.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:32 smithi173 ceph-mon[135182]: pgmap v600: 97 pgs: 97 active+clean; 598 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 215 op/s 2023-10-08T12:50:32.533 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1189563 12.96 MB/sec execute 363 sec latency 23.870 ms 2023-10-08T12:50:33.533 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1191488 12.95 MB/sec execute 364 sec latency 21.032 ms 2023-10-08T12:50:34.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:34 smithi059 ceph-mon[98489]: pgmap v601: 97 pgs: 97 active+clean; 604 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 213 op/s 2023-10-08T12:50:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:34 smithi092 ceph-mon[134093]: pgmap v601: 97 pgs: 97 active+clean; 604 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 213 op/s 2023-10-08T12:50:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:34 smithi173 ceph-mon[135182]: pgmap v601: 97 pgs: 97 active+clean; 604 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 213 op/s 2023-10-08T12:50:34.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1193673 12.95 MB/sec execute 365 sec latency 79.140 ms 2023-10-08T12:50:35.533 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1195581 12.93 MB/sec execute 366 sec latency 21.742 ms 2023-10-08T12:50:36.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:36 smithi059 ceph-mon[98489]: pgmap v602: 97 pgs: 97 active+clean; 610 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 216 op/s 2023-10-08T12:50:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:36 smithi092 ceph-mon[134093]: pgmap v602: 97 pgs: 97 active+clean; 610 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 216 op/s 2023-10-08T12:50:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:36 smithi173 ceph-mon[135182]: pgmap v602: 97 pgs: 97 active+clean; 610 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 216 op/s 2023-10-08T12:50:36.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1197672 12.93 MB/sec execute 367 sec latency 14.627 ms 2023-10-08T12:50:36.802 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:50:37.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.016+0000 7fdb4ebff700 1 -- 172.21.15.59:0/116128462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48100740 msgr2=0x7fdb48100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.016+0000 7fdb4ebff700 1 --2- 172.21.15.59:0/116128462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48100740 0x7fdb48100bc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009990 tx=0x7fdb38009ca0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.016+0000 7fdb4ebff700 1 -- 172.21.15.59:0/116128462 shutdown_connections 2023-10-08T12:50:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.016+0000 7fdb4ebff700 1 --2- 172.21.15.59:0/116128462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb48101100 0x7fdb4810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.016+0000 7fdb4ebff700 1 --2- 172.21.15.59:0/116128462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb48106750 0x7fdb48106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.016+0000 7fdb4ebff700 1 --2- 172.21.15.59:0/116128462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48100740 0x7fdb48100bc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.016+0000 7fdb4ebff700 1 -- 172.21.15.59:0/116128462 >> 172.21.15.59:0/116128462 conn(0x7fdb480fc230 msgr2=0x7fdb480fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.016+0000 7fdb4ebff700 1 -- 172.21.15.59:0/116128462 shutdown_connections 2023-10-08T12:50:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.016+0000 7fdb4ebff700 1 -- 172.21.15.59:0/116128462 wait complete. 2023-10-08T12:50:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.017+0000 7fdb4ebff700 1 Processor -- start 2023-10-08T12:50:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.017+0000 7fdb4ebff700 1 -- start start 2023-10-08T12:50:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.018+0000 7fdb4ebff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48100740 0x7fdb48198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.018+0000 7fdb4ebff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb48101100 0x7fdb48199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.018+0000 7fdb4ebff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb48106750 0x7fdb4819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.018+0000 7fdb4ebff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4819dcf0 con 0x7fdb48106750 2023-10-08T12:50:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.018+0000 7fdb4ebff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4819de60 con 0x7fdb48100740 2023-10-08T12:50:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.018+0000 7fdb4ebff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4819e020 con 0x7fdb48101100 2023-10-08T12:50:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.018+0000 7fdb4c99b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48100740 0x7fdb48198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.018+0000 7fdb4c99b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48100740 0x7fdb48198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52948/0 (socket says 172.21.15.59:52948) 2023-10-08T12:50:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.018+0000 7fdb4c99b700 1 -- 172.21.15.59:0/263398508 learned_addr learned my addr 172.21.15.59:0/263398508 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.018+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb48106750 0x7fdb4819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb3ffff700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb48101100 0x7fdb48199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb4c99b700 1 -- 172.21.15.59:0/263398508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb48101100 msgr2=0x7fdb48199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb4c99b700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb48101100 0x7fdb48199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb4c99b700 1 -- 172.21.15.59:0/263398508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb48106750 msgr2=0x7fdb4819d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb4c99b700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb48106750 0x7fdb4819d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb4c99b700 1 -- 172.21.15.59:0/263398508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb380095f0 con 0x7fdb48100740 2023-10-08T12:50:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb4c99b700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48100740 0x7fdb48198dd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400e9a0 tx=0x7fdb4400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb3dffb700 1 -- 172.21.15.59:0/263398508 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44009790 con 0x7fdb48100740 2023-10-08T12:50:37.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb3dffb700 1 -- 172.21.15.59:0/263398508 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb4400cbd0 con 0x7fdb48100740 2023-10-08T12:50:37.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb4ebff700 1 -- 172.21.15.59:0/263398508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4819e300 con 0x7fdb48100740 2023-10-08T12:50:37.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb3dffb700 1 -- 172.21.15.59:0/263398508 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44018680 con 0x7fdb48100740 2023-10-08T12:50:37.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.019+0000 7fdb4ebff700 1 -- 172.21.15.59:0/263398508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb481a5b40 con 0x7fdb48100740 2023-10-08T12:50:37.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.023+0000 7fdb3dffb700 1 -- 172.21.15.59:0/263398508 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fdb4400cd40 con 0x7fdb48100740 2023-10-08T12:50:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.025+0000 7fdb3dffb700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdb300a1670 0x7fdb300a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.025+0000 7fdb3dffb700 1 -- 172.21.15.59:0/263398508 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fdb44014070 con 0x7fdb48100740 2023-10-08T12:50:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.025+0000 7fdb3ffff700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdb300a1670 0x7fdb300a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.026+0000 7fdb3ffff700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdb300a1670 0x7fdb300a3b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800b2e0 tx=0x7fdb38005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.026+0000 7fdb625acb80 1 Processor -- start 2023-10-08T12:50:37.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.027+0000 7fdb625acb80 1 -- start start 2023-10-08T12:50:37.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.027+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb02fe80 0x5605eb030260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.027+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb03b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.027+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb03b650 0x5605eb03da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.027+0000 7fdb625acb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eaf99460 con 0x5605eb03b650 2023-10-08T12:50:37.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.027+0000 7fdb625acb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eaf8ac20 con 0x5605eb02fe80 2023-10-08T12:50:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.027+0000 7fdb625acb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eaf88540 con 0x5605eb0307a0 2023-10-08T12:50:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb4c99b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb02fe80 0x5605eb030260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb03b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb4c99b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb02fe80 0x5605eb030260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52958/0 (socket says 172.21.15.59:52958) 2023-10-08T12:50:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb4c99b700 1 -- 172.21.15.59:0/2397614248 learned_addr learned my addr 172.21.15.59:0/2397614248 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/2397614248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb03b650 0x5605eb03da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb4c99b700 1 -- 172.21.15.59:0/2397614248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 msgr2=0x5605eb03b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb4c99b700 1 --2- 172.21.15.59:0/2397614248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb03b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb4c99b700 1 -- 172.21.15.59:0/2397614248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb03b650 msgr2=0x5605eb03da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb4c99b700 1 --2- 172.21.15.59:0/2397614248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb03b650 0x5605eb03da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb4c99b700 1 -- 172.21.15.59:0/2397614248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605eadaede0 con 0x5605eb02fe80 2023-10-08T12:50:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb4c99b700 1 --2- 172.21.15.59:0/2397614248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb02fe80 0x5605eb030260 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c5b0 tx=0x7fdb44099bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db371f0412d17481 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb2effd700 1 -- 172.21.15.59:0/2397614248 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440b1020 con 0x5605eb02fe80 2023-10-08T12:50:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb2effd700 1 -- 172.21.15.59:0/2397614248 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb4409e3a0 con 0x5605eb02fe80 2023-10-08T12:50:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.028+0000 7fdb2effd700 1 -- 172.21.15.59:0/2397614248 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440999a0 con 0x5605eb02fe80 2023-10-08T12:50:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.029+0000 7fdb625acb80 1 -- 172.21.15.59:0/2397614248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb02fe80 msgr2=0x5605eb030260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.029+0000 7fdb625acb80 1 --2- 172.21.15.59:0/2397614248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb02fe80 0x5605eb030260 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c5b0 tx=0x7fdb44099bb0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.029+0000 7fdb625acb80 1 -- 172.21.15.59:0/2397614248 shutdown_connections 2023-10-08T12:50:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.029+0000 7fdb625acb80 1 --2- 172.21.15.59:0/2397614248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb02fe80 0x5605eb030260 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.029+0000 7fdb625acb80 1 --2- 172.21.15.59:0/2397614248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb03b650 0x5605eb03da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.029+0000 7fdb625acb80 1 --2- 172.21.15.59:0/2397614248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb03b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.029+0000 7fdb625acb80 1 -- 172.21.15.59:0/2397614248 >> 172.21.15.59:0/2397614248 conn(0x5605eafa5260 msgr2=0x5605eb02c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.029+0000 7fdb625acb80 1 -- 172.21.15.59:0/2397614248 shutdown_connections 2023-10-08T12:50:37.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.029+0000 7fdb625acb80 1 -- 172.21.15.59:0/2397614248 wait complete. 2023-10-08T12:50:37.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.030+0000 7fdb625acb80 1 -- start start 2023-10-08T12:50:37.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.030+0000 7fdb625acb80 1 Processor -- start 2023-10-08T12:50:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb02fe80 0x5605eb03b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 0x5605eb038b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb625acb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eaf83e30 con 0x5605eb02fe80 2023-10-08T12:50:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb625acb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eaf20710 con 0x5605eb03b650 2023-10-08T12:50:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb625acb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eaf203b0 con 0x5605eb0307a0 2023-10-08T12:50:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb625acb80 10 client.0 _ll_register_callbacks cb 0x5605ead7d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0383c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:47146/0 (socket says 172.21.15.59:47146) 2023-10-08T12:50:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb3ffff700 1 -- 172.21.15.59:0/634596482 learned_addr learned my addr 172.21.15.59:0/634596482 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 0x5605eb038b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.031+0000 7fdb4c99b700 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb02fe80 0x5605eb03b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.032+0000 7fdb4d19c700 1 -- 172.21.15.59:0/634596482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 msgr2=0x5605eb0383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.032+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.032+0000 7fdb4d19c700 1 -- 172.21.15.59:0/634596482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb02fe80 msgr2=0x5605eb03b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.032+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb02fe80 0x5605eb03b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.032+0000 7fdb4d19c700 1 -- 172.21.15.59:0/634596482 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb481a5b40 con 0x5605eb03b650 2023-10-08T12:50:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.032+0000 7fdb3ffff700 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.032+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 0x5605eb038b00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdb40007b20 tx=0x7fdb40007b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=696fe2ef3b799a7b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.032+0000 7fdb27fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.032+0000 7fdb27fff700 1 -- 172.21.15.59:0/634596482 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4000e040 con 0x5605eb03b650 2023-10-08T12:50:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.032+0000 7fdb625acb80 1 -- 172.21.15.59:0/634596482 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5605eaf4beb0 con 0x5605eb03b650 2023-10-08T12:50:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.032+0000 7fdb27fff700 1 -- 172.21.15.59:0/634596482 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fdb40016640 con 0x5605eb03b650 2023-10-08T12:50:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.033+0000 7fdb27fff700 1 -- 172.21.15.59:0/634596482 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb40016800 con 0x5605eb03b650 2023-10-08T12:50:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.033+0000 7fdb625acb80 10 client.26741 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.033+0000 7fdb625acb80 1 -- 172.21.15.59:0/634596482 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5605ead97c60 con 0x5605eb03b650 2023-10-08T12:50:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.033+0000 7fdb27fff700 1 -- 172.21.15.59:0/634596482 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5605eaf4beb0 con 0x5605eb03b650 2023-10-08T12:50:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.033+0000 7fdb27fff700 1 -- 172.21.15.59:0/634596482 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdb40028bf0 con 0x5605eb03b650 2023-10-08T12:50:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.033+0000 7fdb625acb80 10 client.26741 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.033+0000 7fdb625acb80 10 client.26741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.033+0000 7fdb625acb80 20 client.26741 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.033+0000 7fdb625acb80 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5605eb04b1f0 0x5605eb04d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.033+0000 7fdb625acb80 4 client.26741 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:50:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.033+0000 7fdb625acb80 1 -- 172.21.15.59:0/634596482 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5605eaf7ce10 con 0x5605eb04b1f0 2023-10-08T12:50:37.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.034+0000 7fdb4c99b700 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5605eb04b1f0 0x5605eb04d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.034+0000 7fdb27fff700 10 client.26741 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.034+0000 7fdb4c99b700 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5605eb04b1f0 0x5605eb04d610 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ea6667ee28efb94 server_cookie=30a253201f761c6f in_seq=0 out_seq=0 2023-10-08T12:50:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb27fff700 1 -- 172.21.15.59:0/634596482 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5605eaf7ce10 con 0x5605eb04b1f0 2023-10-08T12:50:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb27fff700 10 client.26741 handle_command_reply: tid=0 2023-10-08T12:50:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb625acb80 1 client.26741 shutdown 2023-10-08T12:50:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb625acb80 1 -- 172.21.15.59:0/634596482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 msgr2=0x5605eb038b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb625acb80 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 0x5605eb038b00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdb40007b20 tx=0x7fdb40007b50 comp rx=0 tx=0).stop 2023-10-08T12:50:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb625acb80 1 -- 172.21.15.59:0/634596482 shutdown_connections 2023-10-08T12:50:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb625acb80 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5605eb04b1f0 0x5605eb04d610 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb625acb80 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 0x5605eb038b00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb625acb80 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb02fe80 0x5605eb03b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb27fff700 0 client.26741 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb625acb80 1 --2- 172.21.15.59:0/634596482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb625acb80 1 -- 172.21.15.59:0/634596482 >> 172.21.15.59:0/634596482 conn(0x5605eafa5260 msgr2=0x5605eb02bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb625acb80 1 -- 172.21.15.59:0/634596482 shutdown_connections 2023-10-08T12:50:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.035+0000 7fdb625acb80 1 -- 172.21.15.59:0/634596482 wait complete. 2023-10-08T12:50:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.036+0000 7fdb625acb80 20 client.26741 trim_cache size 0 max 16384 2023-10-08T12:50:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.053+0000 7fdb625acb80 1 Processor -- start 2023-10-08T12:50:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.053+0000 7fdb625acb80 1 -- start start 2023-10-08T12:50:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb02fe80 0x5605eb042140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0336f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 0x5605eb033c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb625acb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eae04920 con 0x5605eb02fe80 2023-10-08T12:50:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb625acb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eb042680 con 0x5605eb03b650 2023-10-08T12:50:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb625acb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eb047520 con 0x5605eb0307a0 2023-10-08T12:50:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0336f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:47150/0 (socket says 172.21.15.59:47150) 2023-10-08T12:50:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb3ffff700 1 -- 172.21.15.59:0/955623159 learned_addr learned my addr 172.21.15.59:0/955623159 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/955623159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 0x5605eb033c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb4c99b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb02fe80 0x5605eb042140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb4d19c700 1 -- 172.21.15.59:0/955623159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 msgr2=0x5605eb0336f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/955623159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0336f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb4d19c700 1 -- 172.21.15.59:0/955623159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb02fe80 msgr2=0x5605eb042140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/955623159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb02fe80 0x5605eb042140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb4d19c700 1 -- 172.21.15.59:0/955623159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605eadd5250 con 0x5605eb03b650 2023-10-08T12:50:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.054+0000 7fdb3ffff700 1 --2- 172.21.15.59:0/955623159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0336f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.055+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/955623159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 0x5605eb033c30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000b010 tx=0x7fdb40009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b698fff99339731c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.055+0000 7fdb2f7fe700 1 -- 172.21.15.59:0/955623159 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4000e040 con 0x5605eb03b650 2023-10-08T12:50:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.055+0000 7fdb2f7fe700 1 -- 172.21.15.59:0/955623159 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb4000f040 con 0x5605eb03b650 2023-10-08T12:50:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.055+0000 7fdb2f7fe700 1 -- 172.21.15.59:0/955623159 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400168a0 con 0x5605eb03b650 2023-10-08T12:50:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.056+0000 7fdb625acb80 1 -- 172.21.15.59:0/955623159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 msgr2=0x5605eb033c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.056+0000 7fdb625acb80 1 --2- 172.21.15.59:0/955623159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 0x5605eb033c30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000b010 tx=0x7fdb40009b80 comp rx=0 tx=0).stop 2023-10-08T12:50:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.056+0000 7fdb625acb80 1 -- 172.21.15.59:0/955623159 shutdown_connections 2023-10-08T12:50:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.056+0000 7fdb625acb80 1 --2- 172.21.15.59:0/955623159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb03b650 0x5605eb033c30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.056+0000 7fdb625acb80 1 --2- 172.21.15.59:0/955623159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb02fe80 0x5605eb042140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.056+0000 7fdb625acb80 1 --2- 172.21.15.59:0/955623159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb0307a0 0x5605eb0336f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.056+0000 7fdb625acb80 1 -- 172.21.15.59:0/955623159 >> 172.21.15.59:0/955623159 conn(0x5605eafa5260 msgr2=0x5605eb02b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.056+0000 7fdb625acb80 1 -- 172.21.15.59:0/955623159 shutdown_connections 2023-10-08T12:50:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.056+0000 7fdb625acb80 1 -- 172.21.15.59:0/955623159 wait complete. 2023-10-08T12:50:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.056+0000 7fdb625acb80 1 -- start start 2023-10-08T12:50:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb625acb80 1 Processor -- start 2023-10-08T12:50:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb02fe80 0x5605eb041f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb0307a0 0x5605eb040460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb625acb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb03b650 0x5605eb0409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb625acb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eb041060 con 0x5605eb03b650 2023-10-08T12:50:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb625acb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eb0411d0 con 0x5605eb0307a0 2023-10-08T12:50:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb625acb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605eb09eff0 con 0x5605eb02fe80 2023-10-08T12:50:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb625acb80 10 client.0 _ll_register_callbacks cb 0x7fdb400093f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb0307a0 0x5605eb040460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb0307a0 0x5605eb040460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52996/0 (socket says 172.21.15.59:52996) 2023-10-08T12:50:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb3ffff700 1 -- 172.21.15.59:0/804782290 learned_addr learned my addr 172.21.15.59:0/804782290 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.057+0000 7fdb4c99b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb02fe80 0x5605eb041f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb03b650 0x5605eb0409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb3ffff700 1 -- 172.21.15.59:0/804782290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb02fe80 msgr2=0x5605eb041f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb3ffff700 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb02fe80 0x5605eb041f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb3ffff700 1 -- 172.21.15.59:0/804782290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb03b650 msgr2=0x5605eb0409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb3ffff700 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb03b650 0x5605eb0409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb3ffff700 1 -- 172.21.15.59:0/804782290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4810df10 con 0x5605eb0307a0 2023-10-08T12:50:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb4d19c700 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb03b650 0x5605eb0409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:50:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb3ffff700 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb0307a0 0x5605eb040460 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdb38004780 tx=0x7fdb38009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46547acf8f7053d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb27fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb27fff700 1 -- 172.21.15.59:0/804782290 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3802d030 con 0x5605eb0307a0 2023-10-08T12:50:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb625acb80 1 -- 172.21.15.59:0/804782290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb4409e3a0 con 0x5605eb0307a0 2023-10-08T12:50:37.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.058+0000 7fdb27fff700 1 -- 172.21.15.59:0/804782290 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fdb38034680 con 0x5605eb0307a0 2023-10-08T12:50:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb27fff700 1 -- 172.21.15.59:0/804782290 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb38004e80 con 0x5605eb0307a0 2023-10-08T12:50:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb625acb80 10 client.26747 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb625acb80 1 -- 172.21.15.59:0/804782290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5605ead97c60 con 0x5605eb0307a0 2023-10-08T12:50:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb27fff700 1 -- 172.21.15.59:0/804782290 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb4409e3a0 con 0x5605eb0307a0 2023-10-08T12:50:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb27fff700 1 -- 172.21.15.59:0/804782290 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdb3800f800 con 0x5605eb0307a0 2023-10-08T12:50:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb625acb80 10 client.26747 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb625acb80 10 client.26747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb625acb80 20 client.26747 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb625acb80 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5605eb0a0810 0x5605eb0a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb625acb80 4 client.26747 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:50:37.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb625acb80 1 -- 172.21.15.59:0/804782290 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5605eaf7cb30 con 0x5605eb0a0810 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.059+0000 7fdb4c99b700 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5605eb0a0810 0x5605eb0a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.060+0000 7fdb4c99b700 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5605eb0a0810 0x5605eb0a2c30 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=797794954d9b388e server_cookie=bac92b0bef306241 in_seq=0 out_seq=0 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.060+0000 7fdb27fff700 10 client.26747 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.060+0000 7fdb27fff700 1 -- 172.21.15.59:0/804782290 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5605eaf7cb30 con 0x5605eb0a0810 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.060+0000 7fdb27fff700 10 client.26747 handle_command_reply: tid=0 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.060+0000 7fdb625acb80 1 client.26747 shutdown 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb625acb80 1 -- 172.21.15.59:0/804782290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb0307a0 msgr2=0x5605eb040460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb625acb80 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb0307a0 0x5605eb040460 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdb38004780 tx=0x7fdb38009ca0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb625acb80 1 -- 172.21.15.59:0/804782290 shutdown_connections 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb625acb80 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5605eb0a0810 0x5605eb0a2c30 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb625acb80 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605eb03b650 0x5605eb0409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb625acb80 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5605eb02fe80 0x5605eb041f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb625acb80 1 --2- 172.21.15.59:0/804782290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605eb0307a0 0x5605eb040460 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb625acb80 1 -- 172.21.15.59:0/804782290 >> 172.21.15.59:0/804782290 conn(0x5605eafa5260 msgr2=0x5605eb0336f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb27fff700 0 client.26747 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb625acb80 1 -- 172.21.15.59:0/804782290 shutdown_connections 2023-10-08T12:50:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb625acb80 1 -- 172.21.15.59:0/804782290 wait complete. 2023-10-08T12:50:37.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.061+0000 7fdb625acb80 20 client.26747 trim_cache size 0 max 16384 2023-10-08T12:50:37.072 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:50:37.072 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:50:37.073 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:50:37.073 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:50:37.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 -- 172.21.15.59:0/263398508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdb300a1670 msgr2=0x7fdb300a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdb300a1670 0x7fdb300a3b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800b2e0 tx=0x7fdb38005fd0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 -- 172.21.15.59:0/263398508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48100740 msgr2=0x7fdb48198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48100740 0x7fdb48198dd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400e9a0 tx=0x7fdb4400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 -- 172.21.15.59:0/263398508 shutdown_connections 2023-10-08T12:50:37.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdb300a1670 0x7fdb300a3b30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48100740 0x7fdb48198dd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb48106750 0x7fdb4819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 --2- 172.21.15.59:0/263398508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb48101100 0x7fdb48199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 -- 172.21.15.59:0/263398508 >> 172.21.15.59:0/263398508 conn(0x7fdb480fc230 msgr2=0x7fdb480fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 -- 172.21.15.59:0/263398508 shutdown_connections 2023-10-08T12:50:37.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.062+0000 7fdb4ebff700 1 -- 172.21.15.59:0/263398508 wait complete. 2023-10-08T12:50:37.083 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:50:37.083 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:50:37.149 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:37 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:50:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.300+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/726190595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb8102110 msgr2=0x7f9cb810a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.300+0000 7f9cbf5ff700 1 --2- 172.21.15.59:0/726190595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb8102110 0x7f9cb810a5f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009990 tx=0x7f9ca8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.300+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/726190595 shutdown_connections 2023-10-08T12:50:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.300+0000 7f9cbf5ff700 1 --2- 172.21.15.59:0/726190595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb810ac10 0x7f9cb810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.300+0000 7f9cbf5ff700 1 --2- 172.21.15.59:0/726190595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cb81017f0 0x7f9cb8101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.300+0000 7f9cbf5ff700 1 --2- 172.21.15.59:0/726190595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb8102110 0x7f9cb810a5f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.300+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/726190595 >> 172.21.15.59:0/726190595 conn(0x7f9cb80fb030 msgr2=0x7f9cb80fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.300+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/726190595 shutdown_connections 2023-10-08T12:50:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.300+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/726190595 wait complete. 2023-10-08T12:50:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.301+0000 7f9cbf5ff700 1 Processor -- start 2023-10-08T12:50:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.301+0000 7f9cbf5ff700 1 -- start start 2023-10-08T12:50:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.302+0000 7f9cbf5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb81017f0 0x7f9cb8198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.302+0000 7f9cbf5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8102110 0x7f9cb8199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.302+0000 7f9cbf5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cb810ac10 0x7f9cb819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.302+0000 7f9cbf5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb819dd60 con 0x7f9cb8102110 2023-10-08T12:50:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.302+0000 7f9cbf5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb819ded0 con 0x7f9cb81017f0 2023-10-08T12:50:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.302+0000 7f9cbf5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb819e090 con 0x7f9cb810ac10 2023-10-08T12:50:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.302+0000 7f9cbd39b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb81017f0 0x7f9cb8198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.302+0000 7f9cbd39b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb81017f0 0x7f9cb8198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53002/0 (socket says 172.21.15.59:53002) 2023-10-08T12:50:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.302+0000 7f9cbd39b700 1 -- 172.21.15.59:0/1571853394 learned_addr learned my addr 172.21.15.59:0/1571853394 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.302+0000 7f9cbcb9a700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8102110 0x7f9cb8199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.302+0000 7f9cbdb9c700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cb810ac10 0x7f9cb819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.303+0000 7f9cbd39b700 1 -- 172.21.15.59:0/1571853394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cb810ac10 msgr2=0x7f9cb819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.303+0000 7f9cbd39b700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cb810ac10 0x7f9cb819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.303+0000 7f9cbd39b700 1 -- 172.21.15.59:0/1571853394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8102110 msgr2=0x7f9cb8199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.303+0000 7f9cbd39b700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8102110 0x7f9cb8199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.303+0000 7f9cbd39b700 1 -- 172.21.15.59:0/1571853394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4009520 con 0x7f9cb81017f0 2023-10-08T12:50:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.303+0000 7f9cbd39b700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb81017f0 0x7f9cb8198e40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400eb30 tx=0x7f9cb400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.303+0000 7f9cae7fc700 1 -- 172.21.15.59:0/1571853394 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4009880 con 0x7f9cb81017f0 2023-10-08T12:50:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.303+0000 7f9cae7fc700 1 -- 172.21.15.59:0/1571853394 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cb40044e0 con 0x7f9cb81017f0 2023-10-08T12:50:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.303+0000 7f9cae7fc700 1 -- 172.21.15.59:0/1571853394 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4003d80 con 0x7f9cb81017f0 2023-10-08T12:50:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.303+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/1571853394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca80095f0 con 0x7f9cb81017f0 2023-10-08T12:50:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.303+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/1571853394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb81a59d0 con 0x7f9cb81017f0 2023-10-08T12:50:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.304+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/1571853394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb8068110 con 0x7f9cb81017f0 2023-10-08T12:50:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.308+0000 7f9cae7fc700 1 -- 172.21.15.59:0/1571853394 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9cb4003f20 con 0x7f9cb81017f0 2023-10-08T12:50:37.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.310+0000 7f9cae7fc700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ca40a15f0 0x7f9ca40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.310+0000 7f9cae7fc700 1 -- 172.21.15.59:0/1571853394 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9cb4014070 con 0x7f9cb81017f0 2023-10-08T12:50:37.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.310+0000 7f9cbcb9a700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ca40a15f0 0x7f9ca40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.310+0000 7f9cae7fc700 1 -- 172.21.15.59:0/1571853394 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9cb4096990 con 0x7f9cb81017f0 2023-10-08T12:50:37.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.311+0000 7f9cbcb9a700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ca40a15f0 0x7f9ca40a3ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9cb819a390 tx=0x7f9ca800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:37 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:50:37.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:37 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:50:37.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1199385 12.92 MB/sec execute 368 sec latency 81.441 ms 2023-10-08T12:50:37.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.620+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/1571853394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cb8067450 con 0x7f9cb81017f0 2023-10-08T12:50:37.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.621+0000 7f9cae7fc700 1 -- 172.21.15.59:0/1571853394 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f9cb4099fb0 con 0x7f9cb81017f0 2023-10-08T12:50:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:50:37.622 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:50:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/1571853394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ca40a15f0 msgr2=0x7f9ca40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ca40a15f0 0x7f9ca40a3ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9cb819a390 tx=0x7f9ca800b260 comp rx=0 tx=0).stop 2023-10-08T12:50:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/1571853394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb81017f0 msgr2=0x7f9cb8198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb81017f0 0x7f9cb8198e40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400eb30 tx=0x7f9cb400ee40 comp rx=0 tx=0).stop 2023-10-08T12:50:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/1571853394 shutdown_connections 2023-10-08T12:50:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ca40a15f0 0x7f9ca40a3ab0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb81017f0 0x7f9cb8198e40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cb810ac10 0x7f9cb819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 --2- 172.21.15.59:0/1571853394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8102110 0x7f9cb8199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/1571853394 >> 172.21.15.59:0/1571853394 conn(0x7f9cb80fb030 msgr2=0x7f9cb8100500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/1571853394 shutdown_connections 2023-10-08T12:50:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.624+0000 7f9cbf5ff700 1 -- 172.21.15.59:0/1571853394 wait complete. 2023-10-08T12:50:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:50:37.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:50:37.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.869+0000 7f3b1edff700 1 -- 172.21.15.59:0/2392860665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b181010f0 msgr2=0x7f3b1810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.869+0000 7f3b1edff700 1 --2- 172.21.15.59:0/2392860665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b181010f0 0x7f3b1810d600 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000b0a0 tx=0x7f3b1000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.869+0000 7f3b1edff700 1 -- 172.21.15.59:0/2392860665 shutdown_connections 2023-10-08T12:50:37.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.869+0000 7f3b1edff700 1 --2- 172.21.15.59:0/2392860665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b181010f0 0x7f3b1810d600 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.869+0000 7f3b1edff700 1 --2- 172.21.15.59:0/2392860665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b18106740 0x7f3b18106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.869+0000 7f3b1edff700 1 --2- 172.21.15.59:0/2392860665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18100730 0x7f3b18100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.869+0000 7f3b1edff700 1 -- 172.21.15.59:0/2392860665 >> 172.21.15.59:0/2392860665 conn(0x7f3b180fc200 msgr2=0x7f3b180fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.869+0000 7f3b1edff700 1 -- 172.21.15.59:0/2392860665 shutdown_connections 2023-10-08T12:50:37.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.869+0000 7f3b1edff700 1 -- 172.21.15.59:0/2392860665 wait complete. 2023-10-08T12:50:37.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.870+0000 7f3b1edff700 1 Processor -- start 2023-10-08T12:50:37.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b1edff700 1 -- start start 2023-10-08T12:50:37.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b1edff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b18100730 0x7f3b1819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b1edff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b181010f0 0x7f3b1819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b1edff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18106740 0x7f3b18196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b1edff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18196fe0 con 0x7f3b18106740 2023-10-08T12:50:37.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b1edff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18197150 con 0x7f3b18100730 2023-10-08T12:50:37.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b1edff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18197310 con 0x7f3b181010f0 2023-10-08T12:50:37.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b1cb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b18100730 0x7f3b1819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b1cb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b18100730 0x7f3b1819c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53022/0 (socket says 172.21.15.59:53022) 2023-10-08T12:50:37.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/871866361 learned_addr learned my addr 172.21.15.59:0/871866361 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:37.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b0ffff700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b181010f0 0x7f3b1819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.871+0000 7f3b1d39c700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18106740 0x7f3b18196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.872+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/871866361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b181010f0 msgr2=0x7f3b1819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.872+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b181010f0 0x7f3b1819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.872+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/871866361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18106740 msgr2=0x7f3b18196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.872+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18106740 0x7f3b18196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.872+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/871866361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b10009d00 con 0x7f3b18100730 2023-10-08T12:50:37.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.872+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b18100730 0x7f3b1819c850 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400e9a0 tx=0x7f3b1400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.878+0000 7f3b0dffb700 1 -- 172.21.15.59:0/871866361 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14009790 con 0x7f3b18100730 2023-10-08T12:50:37.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.878+0000 7f3b0dffb700 1 -- 172.21.15.59:0/871866361 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b14010430 con 0x7f3b18100730 2023-10-08T12:50:37.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.878+0000 7f3b0dffb700 1 -- 172.21.15.59:0/871866361 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14018680 con 0x7f3b18100730 2023-10-08T12:50:37.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.878+0000 7f3b1edff700 1 -- 172.21.15.59:0/871866361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b181975f0 con 0x7f3b18100730 2023-10-08T12:50:37.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.878+0000 7f3b1edff700 1 -- 172.21.15.59:0/871866361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b181a3840 con 0x7f3b18100730 2023-10-08T12:50:37.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.885+0000 7f3b326bab80 1 Processor -- start 2023-10-08T12:50:37.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.889+0000 7f3b0dffb700 1 -- 172.21.15.59:0/871866361 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3b140105a0 con 0x7f3b18100730 2023-10-08T12:50:37.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.892+0000 7f3b326bab80 1 -- start start 2023-10-08T12:50:37.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.893+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b782297ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.893+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782288e90 0x55b782289310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.893+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782289850 0x55b78229e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.893+0000 7f3b326bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7821f1460 con 0x55b782288e90 2023-10-08T12:50:37.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.893+0000 7f3b326bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7821e2c20 con 0x55b782289850 2023-10-08T12:50:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.893+0000 7f3b326bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7821e0540 con 0x55b7822976e0 2023-10-08T12:50:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.893+0000 7f3b1d39c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b782297ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.893+0000 7f3b1d39c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b782297ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:47208/0 (socket says 172.21.15.59:47208) 2023-10-08T12:50:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.893+0000 7f3b1d39c700 1 -- 172.21.15.59:0/786474917 learned_addr learned my addr 172.21.15.59:0/786474917 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.894+0000 7f3b0ffff700 1 --2- 172.21.15.59:0/786474917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782289850 0x55b78229e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.894+0000 7f3b0dffb700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b000a17c0 0x7f3b000a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.894+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/786474917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782288e90 0x55b782289310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.894+0000 7f3b0dffb700 1 -- 172.21.15.59:0/871866361 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3b14014070 con 0x7f3b18100730 2023-10-08T12:50:37.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.895+0000 7f3b1d39c700 1 -- 172.21.15.59:0/786474917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782289850 msgr2=0x55b78229e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.895+0000 7f3b1d39c700 1 --2- 172.21.15.59:0/786474917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782289850 0x55b78229e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.895+0000 7f3b1d39c700 1 -- 172.21.15.59:0/786474917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782288e90 msgr2=0x55b782289310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.895+0000 7f3b1d39c700 1 --2- 172.21.15.59:0/786474917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782288e90 0x55b782289310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.895+0000 7f3b1d39c700 1 -- 172.21.15.59:0/786474917 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b782006de0 con 0x55b7822976e0 2023-10-08T12:50:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.895+0000 7f3b0ffff700 1 --2- 172.21.15.59:0/786474917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782289850 0x55b78229e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:50:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.895+0000 7f3b1d39c700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b000a17c0 0x7f3b000a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.896+0000 7f3b1d39c700 1 --2- 172.21.15.59:0/786474917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b782297ac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3b10015000 tx=0x7f3b10009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb0be63288402555 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.896+0000 7f3afeffd700 1 -- 172.21.15.59:0/786474917 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000e040 con 0x55b7822976e0 2023-10-08T12:50:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.896+0000 7f3afeffd700 1 -- 172.21.15.59:0/786474917 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b100079a0 con 0x55b7822976e0 2023-10-08T12:50:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.896+0000 7f3afeffd700 1 -- 172.21.15.59:0/786474917 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1001ea00 con 0x55b7822976e0 2023-10-08T12:50:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.897+0000 7f3b326bab80 1 -- 172.21.15.59:0/786474917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 msgr2=0x55b782297ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.897+0000 7f3b326bab80 1 --2- 172.21.15.59:0/786474917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b782297ac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3b10015000 tx=0x7f3b10009520 comp rx=0 tx=0).stop 2023-10-08T12:50:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.898+0000 7f3b326bab80 1 -- 172.21.15.59:0/786474917 shutdown_connections 2023-10-08T12:50:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.898+0000 7f3b326bab80 1 --2- 172.21.15.59:0/786474917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782289850 0x55b78229e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.898+0000 7f3b326bab80 1 --2- 172.21.15.59:0/786474917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b782297ac0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.898+0000 7f3b326bab80 1 --2- 172.21.15.59:0/786474917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782288e90 0x55b782289310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.898+0000 7f3b326bab80 1 -- 172.21.15.59:0/786474917 >> 172.21.15.59:0/786474917 conn(0x55b7821fd260 msgr2=0x55b782284180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.898+0000 7f3b1d39c700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b000a17c0 0x7f3b000a3c80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3b1002a000 tx=0x7f3b10027000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.898+0000 7f3b326bab80 1 -- 172.21.15.59:0/786474917 shutdown_connections 2023-10-08T12:50:37.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.899+0000 7f3b326bab80 1 -- 172.21.15.59:0/786474917 wait complete. 2023-10-08T12:50:37.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.899+0000 7f3b326bab80 1 -- start start 2023-10-08T12:50:37.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.900+0000 7f3b326bab80 1 Processor -- start 2023-10-08T12:50:37.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.904+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b782288e90 0x55b78229b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.904+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b78229bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.904+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7822976e0 0x55b78229c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.904+0000 7f3b326bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7821dbe30 con 0x55b782289850 2023-10-08T12:50:37.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.904+0000 7f3b326bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b782178710 con 0x55b7822976e0 2023-10-08T12:50:37.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.904+0000 7f3b326bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7821783b0 con 0x55b782288e90 2023-10-08T12:50:37.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.904+0000 7f3b326bab80 10 client.0 _ll_register_callbacks cb 0x55b781fd5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:37.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.905+0000 7f3b0ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b78229bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.906+0000 7f3b0ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b78229bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41420/0 (socket says 172.21.15.59:41420) 2023-10-08T12:50:37.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.906+0000 7f3b0ffff700 1 -- 172.21.15.59:0/3935363699 learned_addr learned my addr 172.21.15.59:0/3935363699 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:37.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.906+0000 7f3b0ffff700 1 -- 172.21.15.59:0/3935363699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b782288e90 msgr2=0x55b78229b820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:50:37.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.906+0000 7f3b0ffff700 1 --2- 172.21.15.59:0/3935363699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b782288e90 0x55b78229b820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.906+0000 7f3b0ffff700 1 -- 172.21.15.59:0/3935363699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7822976e0 msgr2=0x55b78229c2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:50:37.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.906+0000 7f3b0ffff700 1 --2- 172.21.15.59:0/3935363699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7822976e0 0x55b78229c2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.906+0000 7f3b0ffff700 1 -- 172.21.15.59:0/3935363699 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1810df00 con 0x55b782289850 2023-10-08T12:50:37.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.907+0000 7f3b0ffff700 1 --2- 172.21.15.59:0/3935363699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b78229bd60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3b080116f0 tx=0x7f3b08011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ff7857207265f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.908+0000 7f3af7fff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:50:37.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.909+0000 7f3af7fff700 1 -- 172.21.15.59:0/3935363699 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08016070 con 0x55b782289850 2023-10-08T12:50:37.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.909+0000 7f3af7fff700 1 -- 172.21.15.59:0/3935363699 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3b08004020 con 0x55b782289850 2023-10-08T12:50:37.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.909+0000 7f3b326bab80 1 -- 172.21.15.59:0/3935363699 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7821a3eb0 con 0x55b782289850 2023-10-08T12:50:37.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.910+0000 7f3af7fff700 1 -- 172.21.15.59:0/3935363699 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b080041e0 con 0x55b782289850 2023-10-08T12:50:37.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.910+0000 7f3b326bab80 10 client.16752 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:37.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.910+0000 7f3b326bab80 1 -- 172.21.15.59:0/3935363699 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b781fefc60 con 0x55b782289850 2023-10-08T12:50:37.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.911+0000 7f3af7fff700 1 -- 172.21.15.59:0/3935363699 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b7821a3eb0 con 0x55b782289850 2023-10-08T12:50:37.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.911+0000 7f3af7fff700 1 -- 172.21.15.59:0/3935363699 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b08003960 con 0x55b782289850 2023-10-08T12:50:37.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.911+0000 7f3b326bab80 10 client.16752 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:37.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.911+0000 7f3b326bab80 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:37.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.912+0000 7f3b326bab80 20 client.16752 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:37.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.912+0000 7f3b326bab80 1 --2- 172.21.15.59:0/3935363699 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b7822abb60 0x55b7822adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.912+0000 7f3b326bab80 4 client.16752 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:50:37.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.912+0000 7f3b326bab80 1 -- 172.21.15.59:0/3935363699 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7821d4e10 con 0x55b7822abb60 2023-10-08T12:50:37.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.914+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/3935363699 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b7822abb60 0x55b7822adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.915+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/3935363699 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b7822abb60 0x55b7822adf80 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60eb677079fbe208 server_cookie=130728b329e5b1e9 in_seq=0 out_seq=0 2023-10-08T12:50:37.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.915+0000 7f3af7fff700 10 client.16752 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:37.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.916+0000 7f3af7fff700 1 -- 172.21.15.59:0/3935363699 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b7821d4e10 con 0x55b7822abb60 2023-10-08T12:50:37.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.916+0000 7f3af7fff700 10 client.16752 handle_command_reply: tid=0 2023-10-08T12:50:37.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.916+0000 7f3b326bab80 1 client.16752 shutdown 2023-10-08T12:50:37.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.916+0000 7f3b326bab80 1 -- 172.21.15.59:0/3935363699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 msgr2=0x55b78229bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.916+0000 7f3b326bab80 1 --2- 172.21.15.59:0/3935363699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b78229bd60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3b080116f0 tx=0x7f3b08011ab0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.917+0000 7f3b326bab80 1 -- 172.21.15.59:0/3935363699 shutdown_connections 2023-10-08T12:50:37.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.917+0000 7f3b326bab80 1 --2- 172.21.15.59:0/3935363699 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b7822abb60 0x55b7822adf80 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.917+0000 7f3b326bab80 1 --2- 172.21.15.59:0/3935363699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7822976e0 0x55b78229c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.917+0000 7f3b326bab80 1 --2- 172.21.15.59:0/3935363699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b782288e90 0x55b78229b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.917+0000 7f3b326bab80 1 --2- 172.21.15.59:0/3935363699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b78229bd60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.917+0000 7f3b326bab80 1 -- 172.21.15.59:0/3935363699 >> 172.21.15.59:0/3935363699 conn(0x55b7821fd260 msgr2=0x55b782283d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.917+0000 7f3af7fff700 0 client.16752 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:37.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.917+0000 7f3b326bab80 1 -- 172.21.15.59:0/3935363699 shutdown_connections 2023-10-08T12:50:37.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.917+0000 7f3b326bab80 1 -- 172.21.15.59:0/3935363699 wait complete. 2023-10-08T12:50:37.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.917+0000 7f3b326bab80 20 client.16752 trim_cache size 0 max 16384 2023-10-08T12:50:37.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.935+0000 7f3b326bab80 1 Processor -- start 2023-10-08T12:50:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.935+0000 7f3b326bab80 1 -- start start 2023-10-08T12:50:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.935+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b782299360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.935+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b7822a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.935+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b7822a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.935+0000 7f3b326bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b78205c920 con 0x55b782289850 2023-10-08T12:50:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.935+0000 7f3b326bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7822972f0 con 0x55b782288e90 2023-10-08T12:50:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.935+0000 7f3b326bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b782280ae0 con 0x55b7822976e0 2023-10-08T12:50:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.935+0000 7f3b1cb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b782299360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3b0ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b7822a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3b1cb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b782299360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53046/0 (socket says 172.21.15.59:53046) 2023-10-08T12:50:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3b0ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b7822a2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41432/0 (socket says 172.21.15.59:41432) 2023-10-08T12:50:37.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3b1d39c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b7822a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/3586875151 learned_addr learned my addr 172.21.15.59:0/3586875151 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:37.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/3586875151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 msgr2=0x55b7822a71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/3586875151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b7822a71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/3586875151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 msgr2=0x55b7822a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/3586875151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b7822a2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/3586875151 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b78202d250 con 0x55b782288e90 2023-10-08T12:50:37.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/3586875151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b782299360 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3b1409a0c0 tx=0x7f3b14096470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5e801becdf90c96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.936+0000 7f3aff7fe700 1 -- 172.21.15.59:0/3586875151 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1409a830 con 0x55b782288e90 2023-10-08T12:50:37.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.937+0000 7f3aff7fe700 1 -- 172.21.15.59:0/3586875151 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b1409a130 con 0x55b782288e90 2023-10-08T12:50:37.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.937+0000 7f3aff7fe700 1 -- 172.21.15.59:0/3586875151 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1409a5f0 con 0x55b782288e90 2023-10-08T12:50:37.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.937+0000 7f3b326bab80 1 -- 172.21.15.59:0/3586875151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 msgr2=0x55b782299360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.937+0000 7f3b326bab80 1 --2- 172.21.15.59:0/3586875151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b782299360 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3b1409a0c0 tx=0x7f3b14096470 comp rx=0 tx=0).stop 2023-10-08T12:50:37.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.937+0000 7f3b326bab80 1 -- 172.21.15.59:0/3586875151 shutdown_connections 2023-10-08T12:50:37.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.937+0000 7f3b326bab80 1 --2- 172.21.15.59:0/3586875151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b782299360 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.937+0000 7f3b326bab80 1 --2- 172.21.15.59:0/3586875151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b7822a71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.937+0000 7f3b326bab80 1 --2- 172.21.15.59:0/3586875151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b7822a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.937+0000 7f3b326bab80 1 -- 172.21.15.59:0/3586875151 >> 172.21.15.59:0/3586875151 conn(0x55b7821fd260 msgr2=0x55b7822959b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.938+0000 7f3b326bab80 1 -- 172.21.15.59:0/3586875151 shutdown_connections 2023-10-08T12:50:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.938+0000 7f3b326bab80 1 -- 172.21.15.59:0/3586875151 wait complete. 2023-10-08T12:50:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.938+0000 7f3b326bab80 1 -- start start 2023-10-08T12:50:37.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.938+0000 7f3b326bab80 1 Processor -- start 2023-10-08T12:50:37.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b7822f8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b7822f94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b326bab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b7822f3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b326bab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7822f3f40 con 0x55b782289850 2023-10-08T12:50:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b326bab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7822f40b0 con 0x55b782288e90 2023-10-08T12:50:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b326bab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7822f4270 con 0x55b7822976e0 2023-10-08T12:50:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b326bab80 10 client.0 _ll_register_callbacks cb 0x7f3b08009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b1cb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b7822f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b1d39c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b7822f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b1cb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b7822f8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53056/0 (socket says 172.21.15.59:53056) 2023-10-08T12:50:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/1740822467 learned_addr learned my addr 172.21.15.59:0/1740822467 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b0ffff700 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b7822f94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/1740822467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 msgr2=0x55b7822f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b7822f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/1740822467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 msgr2=0x55b7822f94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b7822f94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b1cb9b700 1 -- 172.21.15.59:0/1740822467 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b181a3840 con 0x55b782288e90 2023-10-08T12:50:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b1d39c700 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b7822f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:50:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.939+0000 7f3b0ffff700 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b7822f94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3b1cb9b700 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b7822f8f90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3b140cd0d0 tx=0x7f3b140964e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d35a21583728c63 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3af7fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3af7fff700 1 -- 172.21.15.59:0/1740822467 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1409a830 con 0x55b782288e90 2023-10-08T12:50:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3af7fff700 1 -- 172.21.15.59:0/1740822467 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3b14099620 con 0x55b782288e90 2023-10-08T12:50:37.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3b326bab80 1 -- 172.21.15.59:0/1740822467 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b100079a0 con 0x55b782288e90 2023-10-08T12:50:37.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3af7fff700 1 -- 172.21.15.59:0/1740822467 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b140997e0 con 0x55b782288e90 2023-10-08T12:50:37.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3b326bab80 10 client.26768 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:37.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3b326bab80 1 -- 172.21.15.59:0/1740822467 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b7820052b0 con 0x55b782288e90 2023-10-08T12:50:37.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3af7fff700 1 -- 172.21.15.59:0/1740822467 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b100079a0 con 0x55b782288e90 2023-10-08T12:50:37.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3af7fff700 1 -- 172.21.15.59:0/1740822467 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b140a8020 con 0x55b782288e90 2023-10-08T12:50:37.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3b326bab80 10 client.26768 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:37.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3b326bab80 10 client.26768 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:37.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.940+0000 7f3b326bab80 20 client.26768 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:37.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.941+0000 7f3b326bab80 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b7823009c0 0x55b782302de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:37.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.941+0000 7f3b326bab80 4 client.26768 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:50:37.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.941+0000 7f3b326bab80 1 -- 172.21.15.59:0/1740822467 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b7821d4b30 con 0x55b7823009c0 2023-10-08T12:50:37.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.941+0000 7f3b0ffff700 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b7823009c0 0x55b782302de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:37.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.941+0000 7f3b0ffff700 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b7823009c0 0x55b782302de0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dfebdad46b35f8b server_cookie=271b469b43046537 in_seq=0 out_seq=0 2023-10-08T12:50:37.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.941+0000 7f3af7fff700 10 client.26768 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:37.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3af7fff700 1 -- 172.21.15.59:0/1740822467 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b7821d4b30 con 0x55b7823009c0 2023-10-08T12:50:37.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3af7fff700 10 client.26768 handle_command_reply: tid=0 2023-10-08T12:50:37.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 1 client.26768 shutdown 2023-10-08T12:50:37.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 1 -- 172.21.15.59:0/1740822467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 msgr2=0x55b7822f8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b7822f8f90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3b140cd0d0 tx=0x7f3b140964e0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 1 -- 172.21.15.59:0/1740822467 shutdown_connections 2023-10-08T12:50:37.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b7823009c0 0x55b782302de0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b782288e90 0x55b7822f8f90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b7822976e0 0x55b7822f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 1 --2- 172.21.15.59:0/1740822467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b782289850 0x55b7822f94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 1 -- 172.21.15.59:0/1740822467 >> 172.21.15.59:0/1740822467 conn(0x55b7821fd260 msgr2=0x55b7822a71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3af7fff700 0 client.26768 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 1 -- 172.21.15.59:0/1740822467 shutdown_connections 2023-10-08T12:50:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 1 -- 172.21.15.59:0/1740822467 wait complete. 2023-10-08T12:50:37.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.942+0000 7f3b326bab80 20 client.26768 trim_cache size 0 max 16384 2023-10-08T12:50:37.949 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:50:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 -- 172.21.15.59:0/871866361 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b000a17c0 msgr2=0x7f3b000a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b000a17c0 0x7f3b000a3c80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3b1002a000 tx=0x7f3b10027000 comp rx=0 tx=0).stop 2023-10-08T12:50:37.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 -- 172.21.15.59:0/871866361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b18100730 msgr2=0x7f3b1819c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b18100730 0x7f3b1819c850 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400e9a0 tx=0x7f3b1400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 -- 172.21.15.59:0/871866361 shutdown_connections 2023-10-08T12:50:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3b000a17c0 0x7f3b000a3c80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b18100730 0x7f3b1819c850 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18106740 0x7f3b18196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 --2- 172.21.15.59:0/871866361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b181010f0 0x7f3b1819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 -- 172.21.15.59:0/871866361 >> 172.21.15.59:0/871866361 conn(0x7f3b180fc200 msgr2=0x7f3b180fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 -- 172.21.15.59:0/871866361 shutdown_connections 2023-10-08T12:50:37.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:37.943+0000 7f3b1edff700 1 -- 172.21.15.59:0/871866361 wait complete. 2023-10-08T12:50:38.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:38 smithi059 ceph-mon[98489]: pgmap v603: 97 pgs: 97 active+clean; 611 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 211 op/s 2023-10-08T12:50:38.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:38 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1571853394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:50:38.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:38 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:50:38.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:38 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:50:38.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:38 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:50:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:38 smithi092 ceph-mon[134093]: pgmap v603: 97 pgs: 97 active+clean; 611 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 211 op/s 2023-10-08T12:50:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:38 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1571853394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:50:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:38 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:50:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:38 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:50:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:38 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:50:38.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:38 smithi173 ceph-mon[135182]: pgmap v603: 97 pgs: 97 active+clean; 611 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 211 op/s 2023-10-08T12:50:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:38 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1571853394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:50:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:38 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:50:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:38 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:50:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:38 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:50:38.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1201278 12.92 MB/sec execute 369 sec latency 39.047 ms 2023-10-08T12:50:38.963 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:50:38.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:50:39.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.192+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/3588391497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2f81051c0 msgr2=0x7fe2f8105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.192+0000 7fe2fd5ff700 1 --2- 172.21.15.59:0/3588391497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2f81051c0 0x7fe2f8105640 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009990 tx=0x7fe2ec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.192+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/3588391497 shutdown_connections 2023-10-08T12:50:39.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.192+0000 7fe2fd5ff700 1 --2- 172.21.15.59:0/3588391497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f8105b80 0x7fe2f810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.192+0000 7fe2fd5ff700 1 --2- 172.21.15.59:0/3588391497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f8067ce0 0x7fe2f80680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.192+0000 7fe2fd5ff700 1 --2- 172.21.15.59:0/3588391497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2f81051c0 0x7fe2f8105640 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.192+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/3588391497 >> 172.21.15.59:0/3588391497 conn(0x7fe2f8076780 msgr2=0x7fe2f8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.192+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/3588391497 shutdown_connections 2023-10-08T12:50:39.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.192+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/3588391497 wait complete. 2023-10-08T12:50:39.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.193+0000 7fe2fd5ff700 1 Processor -- start 2023-10-08T12:50:39.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.194+0000 7fe2fd5ff700 1 -- start start 2023-10-08T12:50:39.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.194+0000 7fe2fd5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f8067ce0 0x7fe2f80ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.194+0000 7fe2fd5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2f81051c0 0x7fe2f80ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.194+0000 7fe2fd5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f8105b80 0x7fe2f8100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.194+0000 7fe2fd5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f81a5010 con 0x7fe2f8105b80 2023-10-08T12:50:39.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.194+0000 7fe2fd5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f81a5180 con 0x7fe2f81051c0 2023-10-08T12:50:39.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.194+0000 7fe2fd5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f81a5340 con 0x7fe2f8067ce0 2023-10-08T12:50:39.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.194+0000 7fe2f6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f8067ce0 0x7fe2f80ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.194+0000 7fe2f6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f8067ce0 0x7fe2f80ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:47230/0 (socket says 172.21.15.59:47230) 2023-10-08T12:50:39.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.194+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/398011923 learned_addr learned my addr 172.21.15.59:0/398011923 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:39.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.194+0000 7fe2f67fc700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2f81051c0 0x7fe2f80ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.195+0000 7fe2f77fe700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f8105b80 0x7fe2f8100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.195+0000 7fe2f67fc700 1 -- 172.21.15.59:0/398011923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f8067ce0 msgr2=0x7fe2f80ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.195+0000 7fe2f67fc700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f8067ce0 0x7fe2f80ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.195+0000 7fe2f67fc700 1 -- 172.21.15.59:0/398011923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f8105b80 msgr2=0x7fe2f8100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.195+0000 7fe2f67fc700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f8105b80 0x7fe2f8100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.195+0000 7fe2f67fc700 1 -- 172.21.15.59:0/398011923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec0095f0 con 0x7fe2f81051c0 2023-10-08T12:50:39.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.195+0000 7fe2f77fe700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f8105b80 0x7fe2f8100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:50:39.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.195+0000 7fe2f67fc700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2f81051c0 0x7fe2f80ffbf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec000c00 tx=0x7fe2ec004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.196+0000 7fe2dffff700 1 -- 172.21.15.59:0/398011923 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec01d070 con 0x7fe2f81051c0 2023-10-08T12:50:39.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.196+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/398011923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f81a55c0 con 0x7fe2f81051c0 2023-10-08T12:50:39.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.196+0000 7fe2dffff700 1 -- 172.21.15.59:0/398011923 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2ec021410 con 0x7fe2f81051c0 2023-10-08T12:50:39.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.196+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/398011923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f81a5a40 con 0x7fe2f81051c0 2023-10-08T12:50:39.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.196+0000 7fe2dffff700 1 -- 172.21.15.59:0/398011923 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec017650 con 0x7fe2f81051c0 2023-10-08T12:50:39.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.199+0000 7fe2dffff700 1 -- 172.21.15.59:0/398011923 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe2ec0177b0 con 0x7fe2f81051c0 2023-10-08T12:50:39.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.201+0000 7fe310f41b80 1 Processor -- start 2023-10-08T12:50:39.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.201+0000 7fe2dffff700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2e00a15f0 0x7fe2e00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.201+0000 7fe310f41b80 1 -- start start 2023-10-08T12:50:39.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.201+0000 7fe2dffff700 1 -- 172.21.15.59:0/398011923 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe2ec0ce260 con 0x7fe2f81051c0 2023-10-08T12:50:39.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.202+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa342e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.202+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa3f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.202+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa41ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.202+0000 7fe310f41b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9f99d4e0 con 0x555e9fa34820 2023-10-08T12:50:39.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.202+0000 7fe310f41b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9f98eca0 con 0x555e9fa33f00 2023-10-08T12:50:39.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.202+0000 7fe310f41b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9f98c5c0 con 0x555e9fa3f6d0 2023-10-08T12:50:39.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.202+0000 7fe2f6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.202+0000 7fe2f6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa342e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53086/0 (socket says 172.21.15.59:53086) 2023-10-08T12:50:39.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.202+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/722481265 learned_addr learned my addr 172.21.15.59:0/722481265 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:39.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.202+0000 7fe2f77fe700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2e00a15f0 0x7fe2e00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.202+0000 7fe2f77fe700 1 --2- 172.21.15.59:0/722481265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa41ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.203+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/722481265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 msgr2=0x555e9fa41ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.203+0000 7fe2f6ffd700 1 --2- 172.21.15.59:0/722481265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa41ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.203+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/722481265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 msgr2=0x555e9fa3f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.203+0000 7fe2f6ffd700 1 --2- 172.21.15.59:0/722481265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa3f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.203+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/722481265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e9f7b2e60 con 0x555e9fa33f00 2023-10-08T12:50:39.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.203+0000 7fe2f6ffd700 1 --2- 172.21.15.59:0/722481265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa342e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009e80 tx=0x7fe2e8011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ab64cfb02170e9b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.203+0000 7fe2dd7fa700 1 -- 172.21.15.59:0/722481265 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8004a30 con 0x555e9fa33f00 2023-10-08T12:50:39.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.203+0000 7fe2dd7fa700 1 -- 172.21.15.59:0/722481265 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2e80054e0 con 0x555e9fa33f00 2023-10-08T12:50:39.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.203+0000 7fe2dd7fa700 1 -- 172.21.15.59:0/722481265 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8019910 con 0x555e9fa33f00 2023-10-08T12:50:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.204+0000 7fe310f41b80 1 -- 172.21.15.59:0/722481265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 msgr2=0x555e9fa342e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.204+0000 7fe2f77fe700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2e00a15f0 0x7fe2e00a3ab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009fd0 tx=0x7fe2f0009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.204+0000 7fe310f41b80 1 --2- 172.21.15.59:0/722481265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa342e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009e80 tx=0x7fe2e8011720 comp rx=0 tx=0).stop 2023-10-08T12:50:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.204+0000 7fe310f41b80 1 -- 172.21.15.59:0/722481265 shutdown_connections 2023-10-08T12:50:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.204+0000 7fe310f41b80 1 --2- 172.21.15.59:0/722481265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa342e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.204+0000 7fe310f41b80 1 --2- 172.21.15.59:0/722481265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa41ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.204+0000 7fe310f41b80 1 --2- 172.21.15.59:0/722481265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa3f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.204+0000 7fe310f41b80 1 -- 172.21.15.59:0/722481265 >> 172.21.15.59:0/722481265 conn(0x555e9f9a92e0 msgr2=0x555e9fa30350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.204+0000 7fe310f41b80 1 -- 172.21.15.59:0/722481265 shutdown_connections 2023-10-08T12:50:39.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.204+0000 7fe310f41b80 1 -- 172.21.15.59:0/722481265 wait complete. 2023-10-08T12:50:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.205+0000 7fe310f41b80 1 -- start start 2023-10-08T12:50:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.205+0000 7fe310f41b80 1 Processor -- start 2023-10-08T12:50:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa3f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa3c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa3cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe310f41b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9f987eb0 con 0x555e9fa34820 2023-10-08T12:50:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe310f41b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9f924790 con 0x555e9fa33f00 2023-10-08T12:50:39.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe310f41b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9f924430 con 0x555e9fa3f6d0 2023-10-08T12:50:39.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe310f41b80 10 client.0 _ll_register_callbacks cb 0x555e9f781880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:39.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe2f6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa3f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe2f6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa3f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53088/0 (socket says 172.21.15.59:53088) 2023-10-08T12:50:39.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe2f67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa3c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/3240530368 learned_addr learned my addr 172.21.15.59:0/3240530368 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:39.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.206+0000 7fe2f77fe700 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa3cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.207+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/3240530368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 msgr2=0x555e9fa3cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.207+0000 7fe2f6ffd700 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa3cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.207+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/3240530368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 msgr2=0x555e9fa3c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.207+0000 7fe2f6ffd700 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa3c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.207+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/3240530368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e8009a80 con 0x555e9fa33f00 2023-10-08T12:50:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.207+0000 7fe2f6ffd700 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa3f110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800a010 tx=0x7fe2e80050c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55b100fad8ac180d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.207+0000 7fe2daff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.207+0000 7fe2daff5700 1 -- 172.21.15.59:0/3240530368 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8004240 con 0x555e9fa33f00 2023-10-08T12:50:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.207+0000 7fe2daff5700 1 -- 172.21.15.59:0/3240530368 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe2e8005650 con 0x555e9fa33f00 2023-10-08T12:50:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe310f41b80 1 -- 172.21.15.59:0/3240530368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e9f94ff30 con 0x555e9fa33f00 2023-10-08T12:50:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe2daff5700 1 -- 172.21.15.59:0/3240530368 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2e8005ce0 con 0x555e9fa33f00 2023-10-08T12:50:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe310f41b80 10 client.26780 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe310f41b80 1 -- 172.21.15.59:0/3240530368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x555e9f79bce0 con 0x555e9fa33f00 2023-10-08T12:50:39.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe2daff5700 1 -- 172.21.15.59:0/3240530368 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555e9f94ff30 con 0x555e9fa33f00 2023-10-08T12:50:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe2daff5700 1 -- 172.21.15.59:0/3240530368 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe2e8021040 con 0x555e9fa33f00 2023-10-08T12:50:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe310f41b80 10 client.26780 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe310f41b80 10 client.26780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe310f41b80 20 client.26780 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe310f41b80 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e9fa4f0b0 0x555e9fa514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe310f41b80 4 client.26780 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:50:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.208+0000 7fe310f41b80 1 -- 172.21.15.59:0/3240530368 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e9f980e90 con 0x555e9fa4f0b0 2023-10-08T12:50:39.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.209+0000 7fe2f67fc700 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e9fa4f0b0 0x555e9fa514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.209+0000 7fe2f67fc700 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e9fa4f0b0 0x555e9fa514a0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=655c7ef621b64553 server_cookie=10a03cfe4d882fc6 in_seq=0 out_seq=0 2023-10-08T12:50:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.209+0000 7fe2daff5700 10 client.26780 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe2daff5700 1 -- 172.21.15.59:0/3240530368 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555e9f980e90 con 0x555e9fa4f0b0 2023-10-08T12:50:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe2daff5700 10 client.26780 handle_command_reply: tid=0 2023-10-08T12:50:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe310f41b80 1 client.26780 shutdown 2023-10-08T12:50:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe310f41b80 1 -- 172.21.15.59:0/3240530368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 msgr2=0x555e9fa3f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe310f41b80 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa3f110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800a010 tx=0x7fe2e80050c0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe310f41b80 1 -- 172.21.15.59:0/3240530368 shutdown_connections 2023-10-08T12:50:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe310f41b80 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e9fa4f0b0 0x555e9fa514a0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe310f41b80 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa3f110 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe310f41b80 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa3cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe310f41b80 1 --2- 172.21.15.59:0/3240530368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa3c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe310f41b80 1 -- 172.21.15.59:0/3240530368 >> 172.21.15.59:0/3240530368 conn(0x555e9f9a92e0 msgr2=0x555e9fa2ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.210+0000 7fe2daff5700 0 client.26780 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:39.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.211+0000 7fe310f41b80 1 -- 172.21.15.59:0/3240530368 shutdown_connections 2023-10-08T12:50:39.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.211+0000 7fe310f41b80 1 -- 172.21.15.59:0/3240530368 wait complete. 2023-10-08T12:50:39.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.211+0000 7fe310f41b80 20 client.26780 trim_cache size 0 max 16384 2023-10-08T12:50:39.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.231+0000 7fe310f41b80 1 Processor -- start 2023-10-08T12:50:39.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.231+0000 7fe310f41b80 1 -- start start 2023-10-08T12:50:39.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.232+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa33f00 0x555e9fa37830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.232+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa3bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.232+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa3f6d0 0x555e9fa3c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.232+0000 7fe310f41b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9f8089a0 con 0x555e9fa34820 2023-10-08T12:50:39.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.232+0000 7fe310f41b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9fa2cb60 con 0x555e9fa3f6d0 2023-10-08T12:50:39.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.232+0000 7fe310f41b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9fa3d9d0 con 0x555e9fa33f00 2023-10-08T12:50:39.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.232+0000 7fe2f6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa33f00 0x555e9fa37830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.232+0000 7fe2f77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa3f6d0 0x555e9fa3c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.232+0000 7fe2f6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa33f00 0x555e9fa37830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:47260/0 (socket says 172.21.15.59:47260) 2023-10-08T12:50:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.232+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/2253054981 learned_addr learned my addr 172.21.15.59:0/2253054981 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.232+0000 7fe2f67fc700 1 --2- 172.21.15.59:0/2253054981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa3bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.233+0000 7fe2f77fe700 1 -- 172.21.15.59:0/2253054981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa33f00 msgr2=0x555e9fa37830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.233+0000 7fe2f77fe700 1 --2- 172.21.15.59:0/2253054981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa33f00 0x555e9fa37830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.233+0000 7fe2f77fe700 1 -- 172.21.15.59:0/2253054981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 msgr2=0x555e9fa3bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.233+0000 7fe2f77fe700 1 --2- 172.21.15.59:0/2253054981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa3bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.233+0000 7fe2f77fe700 1 -- 172.21.15.59:0/2253054981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e9f7d92d0 con 0x555e9fa3f6d0 2023-10-08T12:50:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.233+0000 7fe2f6ffd700 1 --2- 172.21.15.59:0/2253054981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa33f00 0x555e9fa37830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.233+0000 7fe2f77fe700 1 --2- 172.21.15.59:0/2253054981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa3f6d0 0x555e9fa3c270 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009550 tx=0x7fe2f0010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7224db39dad995b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.233+0000 7fe2ddffb700 1 -- 172.21.15.59:0/2253054981 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0021040 con 0x555e9fa3f6d0 2023-10-08T12:50:39.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.233+0000 7fe2ddffb700 1 -- 172.21.15.59:0/2253054981 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2f001bd70 con 0x555e9fa3f6d0 2023-10-08T12:50:39.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.233+0000 7fe2ddffb700 1 -- 172.21.15.59:0/2253054981 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0010070 con 0x555e9fa3f6d0 2023-10-08T12:50:39.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.234+0000 7fe310f41b80 1 -- 172.21.15.59:0/2253054981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa3f6d0 msgr2=0x555e9fa3c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.234+0000 7fe310f41b80 1 --2- 172.21.15.59:0/2253054981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa3f6d0 0x555e9fa3c270 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009550 tx=0x7fe2f0010000 comp rx=0 tx=0).stop 2023-10-08T12:50:39.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.234+0000 7fe310f41b80 1 -- 172.21.15.59:0/2253054981 shutdown_connections 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.234+0000 7fe310f41b80 1 --2- 172.21.15.59:0/2253054981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa3f6d0 0x555e9fa3c270 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.234+0000 7fe310f41b80 1 --2- 172.21.15.59:0/2253054981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa33f00 0x555e9fa37830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.234+0000 7fe310f41b80 1 --2- 172.21.15.59:0/2253054981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa3bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.234+0000 7fe310f41b80 1 -- 172.21.15.59:0/2253054981 >> 172.21.15.59:0/2253054981 conn(0x555e9f9a92e0 msgr2=0x555e9fa3ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.234+0000 7fe310f41b80 1 -- 172.21.15.59:0/2253054981 shutdown_connections 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.234+0000 7fe310f41b80 1 -- 172.21.15.59:0/2253054981 wait complete. 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.234+0000 7fe310f41b80 1 -- start start 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe310f41b80 1 Processor -- start 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa44b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa450b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe310f41b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe310f41b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9faa2ed0 con 0x555e9fa34820 2023-10-08T12:50:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe310f41b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9faa3040 con 0x555e9fa33f00 2023-10-08T12:50:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe310f41b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e9faa3200 con 0x555e9fa3f6d0 2023-10-08T12:50:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe310f41b80 10 client.0 _ll_register_callbacks cb 0x7fe2e8009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe2f6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa44b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe2f6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa44b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53108/0 (socket says 172.21.15.59:53108) 2023-10-08T12:50:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/2808903322 learned_addr learned my addr 172.21.15.59:0/2808903322 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.235+0000 7fe2f67fc700 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2f77fe700 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/2808903322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 msgr2=0x555e9fa455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2f6ffd700 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/2808903322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 msgr2=0x555e9fa450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2f6ffd700 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2f6ffd700 1 -- 172.21.15.59:0/2808903322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e9f79bce0 con 0x555e9fa33f00 2023-10-08T12:50:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2f77fe700 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:50:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2f6ffd700 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa44b70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e8005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d49b12a2cf75c13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2daff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2daff5700 1 -- 172.21.15.59:0/2808903322 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8005130 con 0x555e9fa33f00 2023-10-08T12:50:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe310f41b80 1 -- 172.21.15.59:0/2808903322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe2e80054e0 con 0x555e9fa33f00 2023-10-08T12:50:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2daff5700 1 -- 172.21.15.59:0/2808903322 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe2e8000e40 con 0x555e9fa33f00 2023-10-08T12:50:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.236+0000 7fe2daff5700 1 -- 172.21.15.59:0/2808903322 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2e8004bc0 con 0x555e9fa33f00 2023-10-08T12:50:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.237+0000 7fe310f41b80 10 client.26786 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.237+0000 7fe310f41b80 1 -- 172.21.15.59:0/2808903322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fe2f0007d10 con 0x555e9fa33f00 2023-10-08T12:50:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.237+0000 7fe2daff5700 1 -- 172.21.15.59:0/2808903322 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2e80054e0 con 0x555e9fa33f00 2023-10-08T12:50:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.237+0000 7fe2daff5700 1 -- 172.21.15.59:0/2808903322 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe2e8011840 con 0x555e9fa33f00 2023-10-08T12:50:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.237+0000 7fe310f41b80 10 client.26786 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.237+0000 7fe310f41b80 10 client.26786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.237+0000 7fe310f41b80 20 client.26786 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.237+0000 7fe310f41b80 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e9faa4680 0x555e9faa6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.237+0000 7fe310f41b80 4 client.26786 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:50:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.237+0000 7fe310f41b80 1 -- 172.21.15.59:0/2808903322 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555e9f980bb0 con 0x555e9faa4680 2023-10-08T12:50:39.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.237+0000 7fe2f67fc700 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e9faa4680 0x555e9faa6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.238+0000 7fe2f67fc700 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e9faa4680 0x555e9faa6aa0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=884112daaf7799f7 server_cookie=87a8116cb781e58e in_seq=0 out_seq=0 2023-10-08T12:50:39.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.238+0000 7fe2daff5700 10 client.26786 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:39.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.238+0000 7fe2daff5700 1 -- 172.21.15.59:0/2808903322 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555e9f980bb0 con 0x555e9faa4680 2023-10-08T12:50:39.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.238+0000 7fe2daff5700 10 client.26786 handle_command_reply: tid=0 2023-10-08T12:50:39.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.238+0000 7fe310f41b80 1 client.26786 shutdown 2023-10-08T12:50:39.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.239+0000 7fe310f41b80 1 -- 172.21.15.59:0/2808903322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 msgr2=0x555e9fa44b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.239+0000 7fe310f41b80 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa44b70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e8005a00 comp rx=0 tx=0).stop 2023-10-08T12:50:39.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.239+0000 7fe310f41b80 1 -- 172.21.15.59:0/2808903322 shutdown_connections 2023-10-08T12:50:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.239+0000 7fe310f41b80 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e9faa4680 0x555e9faa6aa0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.239+0000 7fe310f41b80 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e9fa33f00 0x555e9fa44b70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.239+0000 7fe2daff5700 0 client.26786 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.239+0000 7fe310f41b80 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e9fa3f6d0 0x555e9fa455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.239+0000 7fe310f41b80 1 --2- 172.21.15.59:0/2808903322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e9fa34820 0x555e9fa450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.239+0000 7fe310f41b80 1 -- 172.21.15.59:0/2808903322 >> 172.21.15.59:0/2808903322 conn(0x555e9f9a92e0 msgr2=0x555e9fa37830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.239+0000 7fe310f41b80 1 -- 172.21.15.59:0/2808903322 shutdown_connections 2023-10-08T12:50:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.240+0000 7fe310f41b80 1 -- 172.21.15.59:0/2808903322 wait complete. 2023-10-08T12:50:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.240+0000 7fe310f41b80 20 client.26786 trim_cache size 0 max 16384 2023-10-08T12:50:39.246 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:50:39.246 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:50:39.246 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "9876384b-e37d-46e4-b3f3-6f5c76cc5c0c", 2023-10-08T12:50:39.246 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:50:39.246 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:50:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.240+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/398011923 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2e00a15f0 msgr2=0x7fe2e00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.240+0000 7fe2fd5ff700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2e00a15f0 0x7fe2e00a3ab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009fd0 tx=0x7fe2f0009920 comp rx=0 tx=0).stop 2023-10-08T12:50:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.240+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/398011923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2f81051c0 msgr2=0x7fe2f80ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.240+0000 7fe2fd5ff700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2f81051c0 0x7fe2f80ffbf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec000c00 tx=0x7fe2ec004730 comp rx=0 tx=0).stop 2023-10-08T12:50:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.241+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/398011923 shutdown_connections 2023-10-08T12:50:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.241+0000 7fe2fd5ff700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe2e00a15f0 0x7fe2e00a3ab0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.241+0000 7fe2fd5ff700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f8105b80 0x7fe2f8100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.241+0000 7fe2fd5ff700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f8067ce0 0x7fe2f80ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.241+0000 7fe2fd5ff700 1 --2- 172.21.15.59:0/398011923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2f81051c0 0x7fe2f80ffbf0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.241+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/398011923 >> 172.21.15.59:0/398011923 conn(0x7fe2f8076780 msgr2=0x7fe2f80fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.241+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/398011923 shutdown_connections 2023-10-08T12:50:39.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.241+0000 7fe2fd5ff700 1 -- 172.21.15.59:0/398011923 wait complete. 2023-10-08T12:50:39.263 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:50:39.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.497+0000 7f300ddff700 1 -- 172.21.15.59:0/1425994866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3008067ce0 msgr2=0x7f30080680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.497+0000 7f300ddff700 1 --2- 172.21.15.59:0/1425994866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3008067ce0 0x7f30080680c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80099c0 tx=0x7f2ff8009cd0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.498+0000 7f300ddff700 1 -- 172.21.15.59:0/1425994866 shutdown_connections 2023-10-08T12:50:39.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.498+0000 7f300ddff700 1 --2- 172.21.15.59:0/1425994866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3008105b80 0x7f300810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.498+0000 7f300ddff700 1 --2- 172.21.15.59:0/1425994866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3008067ce0 0x7f30080680c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.498+0000 7f300ddff700 1 --2- 172.21.15.59:0/1425994866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30081051c0 0x7f3008105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.498+0000 7f300ddff700 1 -- 172.21.15.59:0/1425994866 >> 172.21.15.59:0/1425994866 conn(0x7f3008076780 msgr2=0x7f3008076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.498+0000 7f300ddff700 1 -- 172.21.15.59:0/1425994866 shutdown_connections 2023-10-08T12:50:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.498+0000 7f300ddff700 1 -- 172.21.15.59:0/1425994866 wait complete. 2023-10-08T12:50:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.499+0000 7f300ddff700 1 Processor -- start 2023-10-08T12:50:39.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f300ddff700 1 -- start start 2023-10-08T12:50:39.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f300ddff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3008067ce0 0x7f3008198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f300ddff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30081051c0 0x7f30081992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f300ddff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3008105b80 0x7f300819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f300ddff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300819dcc0 con 0x7f3008105b80 2023-10-08T12:50:39.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f300ddff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300819de30 con 0x7f30081051c0 2023-10-08T12:50:39.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f300ddff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300819dff0 con 0x7f3008067ce0 2023-10-08T12:50:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f2ffffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30081051c0 0x7f30081992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f3007fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3008105b80 0x7f300819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f2ffffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30081051c0 0x7f30081992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53114/0 (socket says 172.21.15.59:53114) 2023-10-08T12:50:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f2ffffff700 1 -- 172.21.15.59:0/1800264323 learned_addr learned my addr 172.21.15.59:0/1800264323 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.500+0000 7f30077fe700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3008067ce0 0x7f3008198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.501+0000 7f2ffffff700 1 -- 172.21.15.59:0/1800264323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3008067ce0 msgr2=0x7f3008198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.501+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3008067ce0 0x7f3008198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.501+0000 7f2ffffff700 1 -- 172.21.15.59:0/1800264323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3008105b80 msgr2=0x7f300819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.501+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3008105b80 0x7f300819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.501+0000 7f2ffffff700 1 -- 172.21.15.59:0/1800264323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000009c40 con 0x7f30081051c0 2023-10-08T12:50:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.501+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30081051c0 0x7f30081992e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000e9a0 tx=0x7f2ff000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.501+0000 7f30057fa700 1 -- 172.21.15.59:0/1800264323 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0009790 con 0x7f30081051c0 2023-10-08T12:50:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.501+0000 7f30057fa700 1 -- 172.21.15.59:0/1800264323 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ff000ce80 con 0x7f30081051c0 2023-10-08T12:50:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.501+0000 7f30057fa700 1 -- 172.21.15.59:0/1800264323 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0018680 con 0x7f30081051c0 2023-10-08T12:50:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.501+0000 7f300ddff700 1 -- 172.21.15.59:0/1800264323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff80095f0 con 0x7f30081051c0 2023-10-08T12:50:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.502+0000 7f300ddff700 1 -- 172.21.15.59:0/1800264323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30081a5930 con 0x7f30081051c0 2023-10-08T12:50:39.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.505+0000 7f30057fa700 1 -- 172.21.15.59:0/1800264323 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2ff0010430 con 0x7f30081051c0 2023-10-08T12:50:39.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.507+0000 7f3021761b80 1 Processor -- start 2023-10-08T12:50:39.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.507+0000 7f3021761b80 1 -- start start 2023-10-08T12:50:39.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3021761b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf07d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3021761b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07d7a0 0x557caf090920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3021761b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf093250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3021761b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caefe6460 con 0x557caf07d7a0 2023-10-08T12:50:39.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3021761b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caefd7c20 con 0x557caf07ce80 2023-10-08T12:50:39.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3021761b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caefd5540 con 0x557caf090e60 2023-10-08T12:50:39.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3007fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf07d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3007fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf07d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53122/0 (socket says 172.21.15.59:53122) 2023-10-08T12:50:39.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3007fff700 1 -- 172.21.15.59:0/3588654041 learned_addr learned my addr 172.21.15.59:0/3588654041 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:39.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f30077fe700 1 --2- 172.21.15.59:0/3588654041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07d7a0 0x557caf090920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f2ffffff700 1 --2- 172.21.15.59:0/3588654041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf093250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3007fff700 1 -- 172.21.15.59:0/3588654041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 msgr2=0x557caf093250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f30057fa700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ff40a16f0 0x7f2ff40a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3007fff700 1 --2- 172.21.15.59:0/3588654041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf093250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3007fff700 1 -- 172.21.15.59:0/3588654041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07d7a0 msgr2=0x557caf090920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3007fff700 1 --2- 172.21.15.59:0/3588654041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07d7a0 0x557caf090920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.508+0000 7f3007fff700 1 -- 172.21.15.59:0/3588654041 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557caedfbde0 con 0x557caf07ce80 2023-10-08T12:50:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.509+0000 7f30057fa700 1 -- 172.21.15.59:0/1800264323 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f2ff0014070 con 0x7f30081051c0 2023-10-08T12:50:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.509+0000 7f3007fff700 1 --2- 172.21.15.59:0/3588654041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf07d260 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f300000e760 tx=0x7f3000009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e339a4432dbb7f94 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.509+0000 7f3007fff700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ff40a16f0 0x7f2ff40a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.509+0000 7f2ffdffb700 1 -- 172.21.15.59:0/3588654041 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300000e040 con 0x557caf07ce80 2023-10-08T12:50:39.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.509+0000 7f2ffdffb700 1 -- 172.21.15.59:0/3588654041 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f300000f040 con 0x557caf07ce80 2023-10-08T12:50:39.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.509+0000 7f2ffdffb700 1 -- 172.21.15.59:0/3588654041 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300001ec40 con 0x557caf07ce80 2023-10-08T12:50:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.510+0000 7f3007fff700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ff40a16f0 0x7f2ff40a3bb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f300001b000 tx=0x7f300001ee80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.510+0000 7f3021761b80 1 -- 172.21.15.59:0/3588654041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 msgr2=0x557caf07d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.510+0000 7f3021761b80 1 --2- 172.21.15.59:0/3588654041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf07d260 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f300000e760 tx=0x7f3000009920 comp rx=0 tx=0).stop 2023-10-08T12:50:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.510+0000 7f3021761b80 1 -- 172.21.15.59:0/3588654041 shutdown_connections 2023-10-08T12:50:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.510+0000 7f3021761b80 1 --2- 172.21.15.59:0/3588654041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf07d260 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.510+0000 7f3021761b80 1 --2- 172.21.15.59:0/3588654041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf093250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.510+0000 7f3021761b80 1 --2- 172.21.15.59:0/3588654041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07d7a0 0x557caf090920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.510+0000 7f3021761b80 1 -- 172.21.15.59:0/3588654041 >> 172.21.15.59:0/3588654041 conn(0x557caeff2260 msgr2=0x557caf0792d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.510+0000 7f3021761b80 1 -- 172.21.15.59:0/3588654041 shutdown_connections 2023-10-08T12:50:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.510+0000 7f3021761b80 1 -- 172.21.15.59:0/3588654041 wait complete. 2023-10-08T12:50:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.511+0000 7f3021761b80 1 -- start start 2023-10-08T12:50:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.511+0000 7f3021761b80 1 Processor -- start 2023-10-08T12:50:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f3021761b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf0908b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f3021761b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07d7a0 0x557caf08db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f3021761b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf08e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f3021761b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caefd0e30 con 0x557caf07d7a0 2023-10-08T12:50:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f3021761b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caef6d710 con 0x557caf07ce80 2023-10-08T12:50:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f3021761b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caef6d3b0 con 0x557caf090e60 2023-10-08T12:50:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f3021761b80 10 client.0 _ll_register_callbacks cb 0x557caedca800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f30077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf0908b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f30077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf0908b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53128/0 (socket says 172.21.15.59:53128) 2023-10-08T12:50:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f30077fe700 1 -- 172.21.15.59:0/1876668125 learned_addr learned my addr 172.21.15.59:0/1876668125 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07d7a0 0x557caf08db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f3007fff700 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf08e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f30077fe700 1 -- 172.21.15.59:0/1876668125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 msgr2=0x557caf08e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f30077fe700 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf08e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f30077fe700 1 -- 172.21.15.59:0/1876668125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07d7a0 msgr2=0x557caf08db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f30077fe700 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07d7a0 0x557caf08db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f30077fe700 1 -- 172.21.15.59:0/1876668125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300000e410 con 0x557caf07ce80 2023-10-08T12:50:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.512+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07d7a0 0x557caf08db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:50:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.513+0000 7f30077fe700 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf0908b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800b580 tx=0x7f2ff800bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09e4766ac4d6d32 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.513+0000 7f2fe6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.513+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1876668125 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff801c040 con 0x557caf07ce80 2023-10-08T12:50:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.513+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1876668125 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f2ff80055a0 con 0x557caf07ce80 2023-10-08T12:50:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.513+0000 7f3021761b80 1 -- 172.21.15.59:0/1876668125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557caef98eb0 con 0x557caf07ce80 2023-10-08T12:50:39.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.513+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1876668125 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ff8003680 con 0x557caf07ce80 2023-10-08T12:50:39.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.513+0000 7f3021761b80 10 client.26798 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:39.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.513+0000 7f3021761b80 1 -- 172.21.15.59:0/1876668125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x557caede4c60 con 0x557caf07ce80 2023-10-08T12:50:39.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.513+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1876668125 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557caef98eb0 con 0x557caf07ce80 2023-10-08T12:50:39.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.514+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1876668125 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2ff800f7d0 con 0x557caf07ce80 2023-10-08T12:50:39.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.514+0000 7f3021761b80 10 client.26798 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:39.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.514+0000 7f3021761b80 10 client.26798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:39.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.514+0000 7f3021761b80 20 client.26798 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.514+0000 7f3021761b80 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557caf0a0a60 0x557caf0a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.514+0000 7f3021761b80 4 client.26798 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:50:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.514+0000 7f3021761b80 1 -- 172.21.15.59:0/1876668125 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557caefc9e10 con 0x557caf0a0a60 2023-10-08T12:50:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.514+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557caf0a0a60 0x557caf0a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.515+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557caf0a0a60 0x557caf0a2e80 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98a86a854f338339 server_cookie=c6bebe770e9d4fc0 in_seq=0 out_seq=0 2023-10-08T12:50:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.515+0000 7f2fe6ffd700 10 client.26798 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.515+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1876668125 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557caefc9e10 con 0x557caf0a0a60 2023-10-08T12:50:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.515+0000 7f2fe6ffd700 10 client.26798 handle_command_reply: tid=0 2023-10-08T12:50:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f3021761b80 1 client.26798 shutdown 2023-10-08T12:50:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f3021761b80 1 -- 172.21.15.59:0/1876668125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 msgr2=0x557caf0908b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f3021761b80 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf0908b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800b580 tx=0x7f2ff800bee0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f3021761b80 1 -- 172.21.15.59:0/1876668125 shutdown_connections 2023-10-08T12:50:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f3021761b80 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557caf0a0a60 0x557caf0a2e80 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f3021761b80 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf0908b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f3021761b80 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf08e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f3021761b80 1 --2- 172.21.15.59:0/1876668125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07d7a0 0x557caf08db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f3021761b80 1 -- 172.21.15.59:0/1876668125 >> 172.21.15.59:0/1876668125 conn(0x557caeff2260 msgr2=0x557caf078ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f2fe6ffd700 0 client.26798 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f3021761b80 1 -- 172.21.15.59:0/1876668125 shutdown_connections 2023-10-08T12:50:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.516+0000 7f3021761b80 1 -- 172.21.15.59:0/1876668125 wait complete. 2023-10-08T12:50:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.517+0000 7f3021761b80 20 client.26798 trim_cache size 0 max 16384 2023-10-08T12:50:39.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1203679 12.92 MB/sec execute 370 sec latency 19.447 ms 2023-10-08T12:50:39.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.537+0000 7f3021761b80 1 Processor -- start 2023-10-08T12:50:39.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.537+0000 7f3021761b80 1 -- start start 2023-10-08T12:50:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.537+0000 7f3021761b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07ce80 0x557caf08dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.537+0000 7f3021761b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07d7a0 0x557caf0979b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.537+0000 7f3021761b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf0903e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.537+0000 7f3021761b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caee51920 con 0x557caf07ce80 2023-10-08T12:50:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.537+0000 7f3021761b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caf0a0840 con 0x557caf07d7a0 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.537+0000 7f3021761b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caf073570 con 0x557caf090e60 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.537+0000 7f2ffffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07d7a0 0x557caf0979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.537+0000 7f30077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07ce80 0x557caf08dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.537+0000 7f2ffffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07d7a0 0x557caf0979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53136/0 (socket says 172.21.15.59:53136) 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.538+0000 7f2ffffff700 1 -- 172.21.15.59:0/1645734406 learned_addr learned my addr 172.21.15.59:0/1645734406 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.538+0000 7f3007fff700 1 --2- 172.21.15.59:0/1645734406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf0903e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.538+0000 7f2ffffff700 1 -- 172.21.15.59:0/1645734406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 msgr2=0x557caf0903e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.538+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1645734406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf0903e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.538+0000 7f2ffffff700 1 -- 172.21.15.59:0/1645734406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07ce80 msgr2=0x557caf08dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.538+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1645734406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07ce80 0x557caf08dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.538+0000 7f2ffffff700 1 -- 172.21.15.59:0/1645734406 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557caee22250 con 0x557caf07d7a0 2023-10-08T12:50:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.538+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1645734406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07d7a0 0x557caf0979b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0096ce0 tx=0x7f2ff0010b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeee927ea5f2a6e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.538+0000 7f2ffe7fc700 1 -- 172.21.15.59:0/1645734406 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00cc040 con 0x557caf07d7a0 2023-10-08T12:50:39.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.538+0000 7f2ffe7fc700 1 -- 172.21.15.59:0/1645734406 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ff009a970 con 0x557caf07d7a0 2023-10-08T12:50:39.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.538+0000 7f2ffe7fc700 1 -- 172.21.15.59:0/1645734406 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0098730 con 0x557caf07d7a0 2023-10-08T12:50:39.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.539+0000 7f3021761b80 1 -- 172.21.15.59:0/1645734406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07d7a0 msgr2=0x557caf0979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.539+0000 7f3021761b80 1 --2- 172.21.15.59:0/1645734406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07d7a0 0x557caf0979b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0096ce0 tx=0x7f2ff0010b10 comp rx=0 tx=0).stop 2023-10-08T12:50:39.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.539+0000 7f3021761b80 1 -- 172.21.15.59:0/1645734406 shutdown_connections 2023-10-08T12:50:39.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.539+0000 7f3021761b80 1 --2- 172.21.15.59:0/1645734406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf090e60 0x557caf0903e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.539+0000 7f3021761b80 1 --2- 172.21.15.59:0/1645734406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf07ce80 0x557caf08dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.539+0000 7f3021761b80 1 --2- 172.21.15.59:0/1645734406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07d7a0 0x557caf0979b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.539+0000 7f3021761b80 1 -- 172.21.15.59:0/1645734406 >> 172.21.15.59:0/1645734406 conn(0x557caeff2260 msgr2=0x557caf08d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.539+0000 7f3021761b80 1 -- 172.21.15.59:0/1645734406 shutdown_connections 2023-10-08T12:50:39.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.539+0000 7f3021761b80 1 -- 172.21.15.59:0/1645734406 wait complete. 2023-10-08T12:50:39.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.540+0000 7f3021761b80 1 -- start start 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.540+0000 7f3021761b80 1 Processor -- start 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.540+0000 7f3021761b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf097990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.540+0000 7f3021761b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf07d7a0 0x557caf095fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f3021761b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf090e60 0x557caf0966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f3021761b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caf096db0 con 0x557caf090e60 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f3021761b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caf0f48e0 con 0x557caf07ce80 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f3021761b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557caf0f4a20 con 0x557caf07d7a0 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f3021761b80 10 client.0 _ll_register_callbacks cb 0x7f2ff800baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f30077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf097990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f3007fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf090e60 0x557caf0966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f30077fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf097990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53142/0 (socket says 172.21.15.59:53142) 2023-10-08T12:50:39.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f30077fe700 1 -- 172.21.15.59:0/1249558428 learned_addr learned my addr 172.21.15.59:0/1249558428 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:50:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf07d7a0 0x557caf095fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f30077fe700 1 -- 172.21.15.59:0/1249558428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf07d7a0 msgr2=0x557caf095fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f30077fe700 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf07d7a0 0x557caf095fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f30077fe700 1 -- 172.21.15.59:0/1249558428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf090e60 msgr2=0x557caf0966a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f30077fe700 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf090e60 0x557caf0966a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f30077fe700 1 -- 172.21.15.59:0/1249558428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30081a5930 con 0x557caf07ce80 2023-10-08T12:50:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.541+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf07d7a0 0x557caf095fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:50:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.542+0000 7f30077fe700 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf097990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8005ff0 tx=0x7f2ff80234d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb13fd85ee88cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.542+0000 7f2fe6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:50:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.542+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1249558428 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff801c040 con 0x557caf07ce80 2023-10-08T12:50:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.542+0000 7f3021761b80 1 -- 172.21.15.59:0/1249558428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f300000f040 con 0x557caf07ce80 2023-10-08T12:50:39.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.542+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1249558428 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f2ff800f460 con 0x557caf07ce80 2023-10-08T12:50:39.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.542+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1249558428 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ff800f620 con 0x557caf07ce80 2023-10-08T12:50:39.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.542+0000 7f3021761b80 10 client.26804 fetch_fsmap learned FSMap version 20 2023-10-08T12:50:39.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.542+0000 7f3021761b80 1 -- 172.21.15.59:0/1249558428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x557caedfa2b0 con 0x557caf07ce80 2023-10-08T12:50:39.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.542+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1249558428 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f300000f040 con 0x557caf07ce80 2023-10-08T12:50:39.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.542+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1249558428 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2ff80235d0 con 0x557caf07ce80 2023-10-08T12:50:39.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.543+0000 7f3021761b80 10 client.26804 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:50:39.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.543+0000 7f3021761b80 10 client.26804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:39.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.543+0000 7f3021761b80 20 client.26804 populate_metadata read hostname 'smithi059' 2023-10-08T12:50:39.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.543+0000 7f3021761b80 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557caf0f5d10 0x557caf0f8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:39.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.543+0000 7f3021761b80 4 client.26804 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:50:39.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.543+0000 7f3021761b80 1 -- 172.21.15.59:0/1249558428 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557caefc9b30 con 0x557caf0f5d10 2023-10-08T12:50:39.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.543+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557caf0f5d10 0x557caf0f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:39.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.543+0000 7f2ffffff700 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557caf0f5d10 0x557caf0f8130 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad6138825e07dc42 server_cookie=e07b0708d82d1a5a in_seq=0 out_seq=0 2023-10-08T12:50:39.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.543+0000 7f2fe6ffd700 10 client.26804 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:39.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f2fe6ffd700 1 -- 172.21.15.59:0/1249558428 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557caefc9b30 con 0x557caf0f5d10 2023-10-08T12:50:39.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f2fe6ffd700 10 client.26804 handle_command_reply: tid=0 2023-10-08T12:50:39.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f3021761b80 1 client.26804 shutdown 2023-10-08T12:50:39.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f3021761b80 1 -- 172.21.15.59:0/1249558428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 msgr2=0x557caf097990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f3021761b80 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf097990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8005ff0 tx=0x7f2ff80234d0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f3021761b80 1 -- 172.21.15.59:0/1249558428 shutdown_connections 2023-10-08T12:50:39.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f3021761b80 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557caf0f5d10 0x557caf0f8130 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f3021761b80 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557caf07ce80 0x557caf097990 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f3021761b80 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557caf090e60 0x557caf0966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f2fe6ffd700 0 client.26804 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:50:39.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f3021761b80 1 --2- 172.21.15.59:0/1249558428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557caf07d7a0 0x557caf095fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f3021761b80 1 -- 172.21.15.59:0/1249558428 >> 172.21.15.59:0/1249558428 conn(0x557caeff2260 msgr2=0x557caf07f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f3021761b80 1 -- 172.21.15.59:0/1249558428 shutdown_connections 2023-10-08T12:50:39.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.545+0000 7f3021761b80 1 -- 172.21.15.59:0/1249558428 wait complete. 2023-10-08T12:50:39.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f3021761b80 20 client.26804 trim_cache size 0 max 16384 2023-10-08T12:50:39.550 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:50:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:50:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:50:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "9876384b-e37d-46e4-b3f3-6f5c76cc5c0c": { 2023-10-08T12:50:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:50:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "9876384b-e37d-46e4-b3f3-6f5c76cc5c0c", 2023-10-08T12:50:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:50:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:50:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:50:39.551 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:50:39.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 -- 172.21.15.59:0/1800264323 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ff40a16f0 msgr2=0x7f2ff40a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ff40a16f0 0x7f2ff40a3bb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f300001b000 tx=0x7f300001ee80 comp rx=0 tx=0).stop 2023-10-08T12:50:39.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 -- 172.21.15.59:0/1800264323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30081051c0 msgr2=0x7f30081992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:39.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30081051c0 0x7f30081992e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000e9a0 tx=0x7f2ff000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 -- 172.21.15.59:0/1800264323 shutdown_connections 2023-10-08T12:50:39.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f2ff40a16f0 0x7f2ff40a3bb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3008105b80 0x7f300819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3008067ce0 0x7f3008198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 --2- 172.21.15.59:0/1800264323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30081051c0 0x7f30081992e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:39.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 -- 172.21.15.59:0/1800264323 >> 172.21.15.59:0/1800264323 conn(0x7f3008076780 msgr2=0x7f300810be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:39.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 -- 172.21.15.59:0/1800264323 shutdown_connections 2023-10-08T12:50:39.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:50:39.546+0000 7f300ddff700 1 -- 172.21.15.59:0/1800264323 wait complete. 2023-10-08T12:50:39.569 INFO:tasks.cephfs.filesystem:scrub status for tag:9876384b-e37d-46e4-b3f3-6f5c76cc5c0c - {'path': '/', 'tag': '9876384b-e37d-46e4-b3f3-6f5c76cc5c0c', 'options': 'recursive,force'} 2023-10-08T12:50:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:39 smithi173 ceph-mon[135182]: pgmap v604: 97 pgs: 97 active+clean; 621 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.8 MiB/s wr, 247 op/s 2023-10-08T12:50:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:39 smithi059 ceph-mon[98489]: pgmap v604: 97 pgs: 97 active+clean; 621 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.8 MiB/s wr, 247 op/s 2023-10-08T12:50:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:39 smithi092 ceph-mon[134093]: pgmap v604: 97 pgs: 97 active+clean; 621 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.8 MiB/s wr, 247 op/s 2023-10-08T12:50:40.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1205252 12.90 MB/sec execute 371 sec latency 95.447 ms 2023-10-08T12:50:41.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:40 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:50:41.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:40 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:41.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:40 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:50:41.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:40 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:41.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:40 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:50:41.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:40 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:41.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:40 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:50:41.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:40 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:41.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:40 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:50:41.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:40 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:41.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:40 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:50:41.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:40 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:50:41.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1207920 12.91 MB/sec execute 372 sec latency 13.023 ms 2023-10-08T12:50:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:41 smithi173 ceph-mon[135182]: pgmap v605: 97 pgs: 97 active+clean; 593 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2023-10-08T12:50:42.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:41 smithi059 ceph-mon[98489]: pgmap v605: 97 pgs: 97 active+clean; 593 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2023-10-08T12:50:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:41 smithi092 ceph-mon[134093]: pgmap v605: 97 pgs: 97 active+clean; 593 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2023-10-08T12:50:42.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1209704 12.89 MB/sec execute 373 sec latency 67.567 ms 2023-10-08T12:50:43.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:42 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:50:43.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:42 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:50:43.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:42 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:50:43.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1211924 12.90 MB/sec execute 374 sec latency 15.020 ms 2023-10-08T12:50:44.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:43 smithi173 ceph-mon[135182]: pgmap v606: 97 pgs: 97 active+clean; 574 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2023-10-08T12:50:44.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:43 smithi059 ceph-mon[98489]: pgmap v606: 97 pgs: 97 active+clean; 574 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2023-10-08T12:50:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:43 smithi092 ceph-mon[134093]: pgmap v606: 97 pgs: 97 active+clean; 574 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2023-10-08T12:50:44.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1214813 12.91 MB/sec execute 375 sec latency 12.894 ms 2023-10-08T12:50:45.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1216846 12.89 MB/sec execute 376 sec latency 14.607 ms 2023-10-08T12:50:46.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:46 smithi059 ceph-mon[98489]: pgmap v607: 97 pgs: 97 active+clean; 584 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 256 op/s 2023-10-08T12:50:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:46 smithi092 ceph-mon[134093]: pgmap v607: 97 pgs: 97 active+clean; 584 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 256 op/s 2023-10-08T12:50:46.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:46 smithi173 ceph-mon[135182]: pgmap v607: 97 pgs: 97 active+clean; 584 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 256 op/s 2023-10-08T12:50:46.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1218634 12.89 MB/sec execute 377 sec latency 85.513 ms 2023-10-08T12:50:47.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1220594 12.88 MB/sec execute 378 sec latency 81.796 ms 2023-10-08T12:50:48.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:48 smithi059 ceph-mon[98489]: pgmap v608: 97 pgs: 97 active+clean; 585 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 230 op/s 2023-10-08T12:50:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:48 smithi092 ceph-mon[134093]: pgmap v608: 97 pgs: 97 active+clean; 585 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 230 op/s 2023-10-08T12:50:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:48 smithi173 ceph-mon[135182]: pgmap v608: 97 pgs: 97 active+clean; 585 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 230 op/s 2023-10-08T12:50:48.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1222857 12.88 MB/sec execute 379 sec latency 13.132 ms 2023-10-08T12:50:49.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1225561 12.89 MB/sec execute 380 sec latency 14.993 ms 2023-10-08T12:50:50.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:49 smithi092 ceph-mon[134093]: pgmap v609: 97 pgs: 97 active+clean; 590 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 238 op/s 2023-10-08T12:50:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:49 smithi173 ceph-mon[135182]: pgmap v609: 97 pgs: 97 active+clean; 590 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 238 op/s 2023-10-08T12:50:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:49 smithi059 ceph-mon[98489]: pgmap v609: 97 pgs: 97 active+clean; 590 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 238 op/s 2023-10-08T12:50:50.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1227442 12.87 MB/sec execute 381 sec latency 43.502 ms 2023-10-08T12:50:51.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1229517 12.88 MB/sec execute 382 sec latency 74.430 ms 2023-10-08T12:50:52.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:52 smithi059 ceph-mon[98489]: pgmap v610: 97 pgs: 97 active+clean; 590 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 225 op/s 2023-10-08T12:50:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:52 smithi092 ceph-mon[134093]: pgmap v610: 97 pgs: 97 active+clean; 590 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 225 op/s 2023-10-08T12:50:52.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:52 smithi173 ceph-mon[135182]: pgmap v610: 97 pgs: 97 active+clean; 590 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 225 op/s 2023-10-08T12:50:52.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1231328 12.86 MB/sec execute 383 sec latency 111.773 ms 2023-10-08T12:50:53.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1233613 12.86 MB/sec execute 384 sec latency 16.901 ms 2023-10-08T12:50:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:54 smithi059 ceph-mon[98489]: pgmap v611: 97 pgs: 97 active+clean; 598 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 246 op/s 2023-10-08T12:50:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:54 smithi092 ceph-mon[134093]: pgmap v611: 97 pgs: 97 active+clean; 598 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 246 op/s 2023-10-08T12:50:54.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:54 smithi173 ceph-mon[135182]: pgmap v611: 97 pgs: 97 active+clean; 598 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 246 op/s 2023-10-08T12:50:54.534 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1236226 12.87 MB/sec execute 385 sec latency 13.771 ms 2023-10-08T12:50:55.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1238194 12.86 MB/sec execute 386 sec latency 31.853 ms 2023-10-08T12:50:56.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:56 smithi059 ceph-mon[98489]: pgmap v612: 97 pgs: 97 active+clean; 598 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 230 op/s 2023-10-08T12:50:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:56 smithi092 ceph-mon[134093]: pgmap v612: 97 pgs: 97 active+clean; 598 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 230 op/s 2023-10-08T12:50:56.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:56 smithi173 ceph-mon[135182]: pgmap v612: 97 pgs: 97 active+clean; 598 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 230 op/s 2023-10-08T12:50:56.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1240283 12.86 MB/sec execute 387 sec latency 19.914 ms 2023-10-08T12:50:57.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1241973 12.84 MB/sec execute 388 sec latency 136.046 ms 2023-10-08T12:50:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:58 smithi092 ceph-mon[134093]: pgmap v613: 97 pgs: 97 active+clean; 599 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 187 op/s 2023-10-08T12:50:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:58 smithi173 ceph-mon[135182]: pgmap v613: 97 pgs: 97 active+clean; 599 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 187 op/s 2023-10-08T12:50:58.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:58 smithi059 ceph-mon[98489]: pgmap v613: 97 pgs: 97 active+clean; 599 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 187 op/s 2023-10-08T12:50:58.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1243939 12.84 MB/sec execute 389 sec latency 18.954 ms 2023-10-08T12:50:59.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1246710 12.85 MB/sec execute 390 sec latency 22.445 ms 2023-10-08T12:51:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:50:59 smithi173 ceph-mon[135182]: pgmap v614: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.6 MiB/s wr, 231 op/s 2023-10-08T12:51:00.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:50:59 smithi059 ceph-mon[98489]: pgmap v614: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.6 MiB/s wr, 231 op/s 2023-10-08T12:51:00.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:50:59 smithi092 ceph-mon[134093]: pgmap v614: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.6 MiB/s wr, 231 op/s 2023-10-08T12:51:00.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1248434 12.84 MB/sec execute 391 sec latency 17.684 ms 2023-10-08T12:51:01.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1250091 12.84 MB/sec execute 392 sec latency 86.957 ms 2023-10-08T12:51:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:02 smithi059 ceph-mon[98489]: pgmap v615: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 219 op/s 2023-10-08T12:51:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:02 smithi092 ceph-mon[134093]: pgmap v615: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 219 op/s 2023-10-08T12:51:02.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:02 smithi173 ceph-mon[135182]: pgmap v615: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 219 op/s 2023-10-08T12:51:02.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1251541 12.82 MB/sec execute 393 sec latency 81.203 ms 2023-10-08T12:51:03.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1253982 12.82 MB/sec execute 394 sec latency 53.457 ms 2023-10-08T12:51:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:04 smithi092 ceph-mon[134093]: pgmap v616: 97 pgs: 97 active+clean; 617 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 247 op/s 2023-10-08T12:51:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:04 smithi092 ceph-mon[134093]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T12:51:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:04 smithi173 ceph-mon[135182]: pgmap v616: 97 pgs: 97 active+clean; 617 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 247 op/s 2023-10-08T12:51:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:04 smithi173 ceph-mon[135182]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T12:51:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:04 smithi059 ceph-mon[98489]: pgmap v616: 97 pgs: 97 active+clean; 617 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 247 op/s 2023-10-08T12:51:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:04 smithi059 ceph-mon[98489]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T12:51:04.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1255757 12.81 MB/sec execute 395 sec latency 109.830 ms 2023-10-08T12:51:05.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1257987 12.81 MB/sec execute 396 sec latency 18.397 ms 2023-10-08T12:51:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:06 smithi092 ceph-mon[134093]: pgmap v618: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 237 op/s 2023-10-08T12:51:06.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:06 smithi173 ceph-mon[135182]: pgmap v618: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 237 op/s 2023-10-08T12:51:06.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:06 smithi059 ceph-mon[98489]: pgmap v618: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 237 op/s 2023-10-08T12:51:06.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1260815 12.82 MB/sec execute 397 sec latency 18.394 ms 2023-10-08T12:51:07.536 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1262274 12.80 MB/sec execute 398 sec latency 56.257 ms 2023-10-08T12:51:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:08 smithi092 ceph-mon[134093]: pgmap v619: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.0 MiB/s wr, 292 op/s 2023-10-08T12:51:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:08 smithi173 ceph-mon[135182]: pgmap v619: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.0 MiB/s wr, 292 op/s 2023-10-08T12:51:08.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:08 smithi059 ceph-mon[98489]: pgmap v619: 97 pgs: 97 active+clean; 610 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.0 MiB/s wr, 292 op/s 2023-10-08T12:51:08.535 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1263964 12.79 MB/sec execute 399 sec latency 332.518 ms 2023-10-08T12:51:09.536 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1265957 12.79 MB/sec execute 400 sec latency 11.438 ms 2023-10-08T12:51:09.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:51:10.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.056+0000 7f305a1ff700 1 -- 172.21.15.59:0/3459642960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3054100a70 msgr2=0x7f305410cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.056+0000 7f305a1ff700 1 --2- 172.21.15.59:0/3459642960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3054100a70 0x7f305410cc50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3048009990 tx=0x7f3048009ca0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.056+0000 7f305a1ff700 1 -- 172.21.15.59:0/3459642960 shutdown_connections 2023-10-08T12:51:10.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.056+0000 7f305a1ff700 1 --2- 172.21.15.59:0/3459642960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f305410d190 0x7f305410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.056+0000 7f305a1ff700 1 --2- 172.21.15.59:0/3459642960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3054100150 0x7f3054100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.056+0000 7f305a1ff700 1 --2- 172.21.15.59:0/3459642960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3054100a70 0x7f305410cc50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.056+0000 7f305a1ff700 1 -- 172.21.15.59:0/3459642960 >> 172.21.15.59:0/3459642960 conn(0x7f3054076780 msgr2=0x7f3054076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.056+0000 7f305a1ff700 1 -- 172.21.15.59:0/3459642960 shutdown_connections 2023-10-08T12:51:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.056+0000 7f305a1ff700 1 -- 172.21.15.59:0/3459642960 wait complete. 2023-10-08T12:51:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.057+0000 7f305a1ff700 1 Processor -- start 2023-10-08T12:51:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.057+0000 7f305a1ff700 1 -- start start 2023-10-08T12:51:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f305a1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3054100150 0x7f3054198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f305a1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3054100a70 0x7f3054199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f305a1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305410d190 0x7f305419d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f305a1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305419de20 con 0x7f3054100a70 2023-10-08T12:51:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f305a1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305419df90 con 0x7f305410d190 2023-10-08T12:51:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f305a1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305419e150 con 0x7f3054100150 2023-10-08T12:51:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f30537fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3054100150 0x7f3054198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f3053fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305410d190 0x7f305419d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f30537fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3054100150 0x7f3054198f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:37756/0 (socket says 172.21.15.59:37756) 2023-10-08T12:51:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f3053fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305410d190 0x7f305419d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44412/0 (socket says 172.21.15.59:44412) 2023-10-08T12:51:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f30537fe700 1 -- 172.21.15.59:0/389427254 learned_addr learned my addr 172.21.15.59:0/389427254 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.058+0000 7f3052ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3054100a70 0x7f3054199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f30537fe700 1 -- 172.21.15.59:0/389427254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305410d190 msgr2=0x7f305419d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f30537fe700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305410d190 0x7f305419d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f30537fe700 1 -- 172.21.15.59:0/389427254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3054100a70 msgr2=0x7f3054199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f30537fe700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3054100a70 0x7f3054199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f30537fe700 1 -- 172.21.15.59:0/389427254 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30480095f0 con 0x7f3054100150 2023-10-08T12:51:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f3052ffd700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3054100a70 0x7f3054199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f3053fff700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305410d190 0x7f305419d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f30537fe700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3054100150 0x7f3054198f50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f304400e9a0 tx=0x7f304400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f3050ff9700 1 -- 172.21.15.59:0/389427254 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044009790 con 0x7f3054100150 2023-10-08T12:51:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f305a1ff700 1 -- 172.21.15.59:0/389427254 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305419e430 con 0x7f3054100150 2023-10-08T12:51:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f3050ff9700 1 -- 172.21.15.59:0/389427254 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3044010430 con 0x7f3054100150 2023-10-08T12:51:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f3050ff9700 1 -- 172.21.15.59:0/389427254 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044018680 con 0x7f3054100150 2023-10-08T12:51:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.059+0000 7f305a1ff700 1 -- 172.21.15.59:0/389427254 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30541a5c70 con 0x7f3054100150 2023-10-08T12:51:10.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.063+0000 7f3050ff9700 1 -- 172.21.15.59:0/389427254 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f30440105a0 con 0x7f3054100150 2023-10-08T12:51:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.064+0000 7f3050ff9700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f303c0a1670 0x7f303c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.064+0000 7f306da82b80 1 Processor -- start 2023-10-08T12:51:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.065+0000 7f3050ff9700 1 -- 172.21.15.59:0/389427254 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f3044014070 con 0x7f3054100150 2023-10-08T12:51:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.065+0000 7f306da82b80 1 -- start start 2023-10-08T12:51:10.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.065+0000 7f3052ffd700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f303c0a1670 0x7f303c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.065+0000 7f306da82b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718690 0x557a38718a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.065+0000 7f306da82b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38718fb0 0x557a38723920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f306da82b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38723e60 0x557a38726250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f306da82b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a38679460 con 0x557a38718690 2023-10-08T12:51:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f306da82b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3866ac20 con 0x557a38718fb0 2023-10-08T12:51:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f306da82b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a38668540 con 0x557a38723e60 2023-10-08T12:51:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f3053fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38723e60 0x557a38726250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f30537fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718690 0x557a38718a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f3053fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38723e60 0x557a38726250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:37762/0 (socket says 172.21.15.59:37762) 2023-10-08T12:51:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f3053fff700 1 -- 172.21.15.59:0/1597103764 learned_addr learned my addr 172.21.15.59:0/1597103764 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f3052ffd700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f303c0a1670 0x7f303c0a3b30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f305419a450 tx=0x7f304800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f3052ffd700 1 --2- 172.21.15.59:0/1597103764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38718fb0 0x557a38723920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f3053fff700 1 -- 172.21.15.59:0/1597103764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38718fb0 msgr2=0x557a38723920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f3053fff700 1 --2- 172.21.15.59:0/1597103764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38718fb0 0x557a38723920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f3053fff700 1 -- 172.21.15.59:0/1597103764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718690 msgr2=0x557a38718a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f3053fff700 1 --2- 172.21.15.59:0/1597103764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718690 0x557a38718a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f3053fff700 1 -- 172.21.15.59:0/1597103764 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a3848ede0 con 0x557a38723e60 2023-10-08T12:51:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.066+0000 7f30537fe700 1 --2- 172.21.15.59:0/1597103764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718690 0x557a38718a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.067+0000 7f3053fff700 1 --2- 172.21.15.59:0/1597103764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38723e60 0x557a38726250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f304c0076f0 tx=0x7f304c007a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a42b86da3a993e9a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.067+0000 7f3039ffb700 1 -- 172.21.15.59:0/1597103764 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c004bb0 con 0x557a38723e60 2023-10-08T12:51:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.067+0000 7f3039ffb700 1 -- 172.21.15.59:0/1597103764 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f304c00f040 con 0x557a38723e60 2023-10-08T12:51:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.067+0000 7f3039ffb700 1 -- 172.21.15.59:0/1597103764 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c005400 con 0x557a38723e60 2023-10-08T12:51:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.068+0000 7f306da82b80 1 -- 172.21.15.59:0/1597103764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38723e60 msgr2=0x557a38726250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.068+0000 7f306da82b80 1 --2- 172.21.15.59:0/1597103764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38723e60 0x557a38726250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f304c0076f0 tx=0x7f304c007a00 comp rx=0 tx=0).stop 2023-10-08T12:51:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.068+0000 7f306da82b80 1 -- 172.21.15.59:0/1597103764 shutdown_connections 2023-10-08T12:51:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.068+0000 7f306da82b80 1 --2- 172.21.15.59:0/1597103764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38723e60 0x557a38726250 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.068+0000 7f306da82b80 1 --2- 172.21.15.59:0/1597103764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718690 0x557a38718a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.068+0000 7f306da82b80 1 --2- 172.21.15.59:0/1597103764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38718fb0 0x557a38723920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.068+0000 7f306da82b80 1 -- 172.21.15.59:0/1597103764 >> 172.21.15.59:0/1597103764 conn(0x557a38685260 msgr2=0x557a3870c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.068+0000 7f306da82b80 1 -- 172.21.15.59:0/1597103764 shutdown_connections 2023-10-08T12:51:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.068+0000 7f306da82b80 1 -- 172.21.15.59:0/1597103764 wait complete. 2023-10-08T12:51:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.069+0000 7f306da82b80 1 -- start start 2023-10-08T12:51:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.069+0000 7f306da82b80 1 Processor -- start 2023-10-08T12:51:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.069+0000 7f306da82b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a387237a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.069+0000 7f306da82b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718fb0 0x557a38720a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.069+0000 7f306da82b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38723e60 0x557a38721050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.069+0000 7f306da82b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a38663e30 con 0x557a38718fb0 2023-10-08T12:51:10.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.069+0000 7f306da82b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a38600710 con 0x557a38723e60 2023-10-08T12:51:10.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.069+0000 7f306da82b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a386003b0 con 0x557a38718690 2023-10-08T12:51:10.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.069+0000 7f306da82b80 10 client.0 _ll_register_callbacks cb 0x557a3845d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f30537fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a387237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f30537fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a387237a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:37774/0 (socket says 172.21.15.59:37774) 2023-10-08T12:51:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f3053fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38723e60 0x557a38721050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f30537fe700 1 -- 172.21.15.59:0/1379733291 learned_addr learned my addr 172.21.15.59:0/1379733291 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f3052ffd700 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718fb0 0x557a38720a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f30537fe700 1 -- 172.21.15.59:0/1379733291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38723e60 msgr2=0x557a38721050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f30537fe700 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38723e60 0x557a38721050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f30537fe700 1 -- 172.21.15.59:0/1379733291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718fb0 msgr2=0x557a38720a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f30537fe700 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718fb0 0x557a38720a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f30537fe700 1 -- 172.21.15.59:0/1379733291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30541a5c70 con 0x557a38718690 2023-10-08T12:51:10.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f3053fff700 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38723e60 0x557a38721050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:10.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f30537fe700 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a387237a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3044096c80 tx=0x7f304409a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e07198ab01f9193 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f3032ffd700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:51:10.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.070+0000 7f3032ffd700 1 -- 172.21.15.59:0/1379733291 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044099900 con 0x557a38718690 2023-10-08T12:51:10.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f3032ffd700 1 -- 172.21.15.59:0/1379733291 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f304409e360 con 0x557a38718690 2023-10-08T12:51:10.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f306da82b80 1 -- 172.21.15.59:0/1379733291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a3862beb0 con 0x557a38718690 2023-10-08T12:51:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f3032ffd700 1 -- 172.21.15.59:0/1379733291 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f304409e150 con 0x557a38718690 2023-10-08T12:51:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f306da82b80 10 client.26806 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f306da82b80 1 -- 172.21.15.59:0/1379733291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f304c009e20 con 0x557a38718690 2023-10-08T12:51:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f3032ffd700 1 -- 172.21.15.59:0/1379733291 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557a3862beb0 con 0x557a38718690 2023-10-08T12:51:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f3032ffd700 1 -- 172.21.15.59:0/1379733291 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3044099170 con 0x557a38718690 2023-10-08T12:51:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f306da82b80 10 client.26806 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f306da82b80 10 client.26806 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f306da82b80 20 client.26806 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f306da82b80 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557a38733950 0x557a38735d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f306da82b80 4 client.26806 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:51:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.071+0000 7f306da82b80 1 -- 172.21.15.59:0/1379733291 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a3865ce10 con 0x557a38733950 2023-10-08T12:51:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.072+0000 7f3052ffd700 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557a38733950 0x557a38735d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.072+0000 7f3052ffd700 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557a38733950 0x557a38735d70 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee752442df7eb30 server_cookie=65a6c72cba2308e0 in_seq=0 out_seq=0 2023-10-08T12:51:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.072+0000 7f3032ffd700 10 client.26806 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.073+0000 7f3032ffd700 1 -- 172.21.15.59:0/1379733291 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557a3865ce10 con 0x557a38733950 2023-10-08T12:51:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.073+0000 7f3032ffd700 10 client.26806 handle_command_reply: tid=0 2023-10-08T12:51:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.073+0000 7f306da82b80 1 client.26806 shutdown 2023-10-08T12:51:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.073+0000 7f306da82b80 1 -- 172.21.15.59:0/1379733291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 msgr2=0x557a387237a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.073+0000 7f306da82b80 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a387237a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3044096c80 tx=0x7f304409a210 comp rx=0 tx=0).stop 2023-10-08T12:51:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.074+0000 7f306da82b80 1 -- 172.21.15.59:0/1379733291 shutdown_connections 2023-10-08T12:51:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.074+0000 7f306da82b80 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557a38733950 0x557a38735d70 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.074+0000 7f306da82b80 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38723e60 0x557a38721050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.074+0000 7f306da82b80 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a387237a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.074+0000 7f306da82b80 1 --2- 172.21.15.59:0/1379733291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718fb0 0x557a38720a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.074+0000 7f306da82b80 1 -- 172.21.15.59:0/1379733291 >> 172.21.15.59:0/1379733291 conn(0x557a38685260 msgr2=0x557a3870bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.074+0000 7f3032ffd700 0 client.26806 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.074+0000 7f306da82b80 1 -- 172.21.15.59:0/1379733291 shutdown_connections 2023-10-08T12:51:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.074+0000 7f306da82b80 1 -- 172.21.15.59:0/1379733291 wait complete. 2023-10-08T12:51:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.074+0000 7f306da82b80 20 client.26806 trim_cache size 0 max 16384 2023-10-08T12:51:10.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.093+0000 7f306da82b80 1 Processor -- start 2023-10-08T12:51:10.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.093+0000 7f306da82b80 1 -- start start 2023-10-08T12:51:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f306da82b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38718690 0x557a3872aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f306da82b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718fb0 0x557a3871f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f306da82b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38723e60 0x557a3871f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f306da82b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a384e4920 con 0x557a38723e60 2023-10-08T12:51:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f306da82b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3871fde0 con 0x557a38718690 2023-10-08T12:51:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f306da82b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3872af90 con 0x557a38718fb0 2023-10-08T12:51:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f3052ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718fb0 0x557a3871f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f30537fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38718690 0x557a3872aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f3052ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718fb0 0x557a3871f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:37778/0 (socket says 172.21.15.59:37778) 2023-10-08T12:51:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f3052ffd700 1 -- 172.21.15.59:0/1039378201 learned_addr learned my addr 172.21.15.59:0/1039378201 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f3053fff700 1 --2- 172.21.15.59:0/1039378201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38723e60 0x557a3871f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f3052ffd700 1 -- 172.21.15.59:0/1039378201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38718690 msgr2=0x557a3872aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f3052ffd700 1 --2- 172.21.15.59:0/1039378201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38718690 0x557a3872aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f3052ffd700 1 -- 172.21.15.59:0/1039378201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38723e60 msgr2=0x557a3871f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f3052ffd700 1 --2- 172.21.15.59:0/1039378201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38723e60 0x557a3871f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f3052ffd700 1 -- 172.21.15.59:0/1039378201 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a38477c60 con 0x557a38718fb0 2023-10-08T12:51:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.094+0000 7f3053fff700 1 --2- 172.21.15.59:0/1039378201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38723e60 0x557a3871f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:51:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.095+0000 7f3052ffd700 1 --2- 172.21.15.59:0/1039378201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718fb0 0x557a3871f360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3048005b40 tx=0x7f3048020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7b2b65e2cfe2e80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.095+0000 7f303a7fc700 1 -- 172.21.15.59:0/1039378201 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048034c80 con 0x557a38718fb0 2023-10-08T12:51:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.095+0000 7f303a7fc700 1 -- 172.21.15.59:0/1039378201 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f304801e040 con 0x557a38718fb0 2023-10-08T12:51:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.095+0000 7f303a7fc700 1 -- 172.21.15.59:0/1039378201 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048004cb0 con 0x557a38718fb0 2023-10-08T12:51:10.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.096+0000 7f306da82b80 1 -- 172.21.15.59:0/1039378201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718fb0 msgr2=0x557a3871f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.096+0000 7f306da82b80 1 --2- 172.21.15.59:0/1039378201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718fb0 0x557a3871f360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3048005b40 tx=0x7f3048020000 comp rx=0 tx=0).stop 2023-10-08T12:51:10.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.096+0000 7f306da82b80 1 -- 172.21.15.59:0/1039378201 shutdown_connections 2023-10-08T12:51:10.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.096+0000 7f306da82b80 1 --2- 172.21.15.59:0/1039378201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38718690 0x557a3872aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.096+0000 7f306da82b80 1 --2- 172.21.15.59:0/1039378201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38723e60 0x557a3871f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.096+0000 7f306da82b80 1 --2- 172.21.15.59:0/1039378201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718fb0 0x557a3871f360 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.096+0000 7f306da82b80 1 -- 172.21.15.59:0/1039378201 >> 172.21.15.59:0/1039378201 conn(0x557a38685260 msgr2=0x557a3871bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.096+0000 7f306da82b80 1 -- 172.21.15.59:0/1039378201 shutdown_connections 2023-10-08T12:51:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.096+0000 7f306da82b80 1 -- 172.21.15.59:0/1039378201 wait complete. 2023-10-08T12:51:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.097+0000 7f306da82b80 1 -- start start 2023-10-08T12:51:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.097+0000 7f306da82b80 1 Processor -- start 2023-10-08T12:51:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f306da82b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a38729250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f306da82b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718fb0 0x557a38729790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f306da82b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38723e60 0x557a38729cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f306da82b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a387878c0 con 0x557a38718fb0 2023-10-08T12:51:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f306da82b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a38787a30 con 0x557a38723e60 2023-10-08T12:51:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f306da82b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a38787bf0 con 0x557a38718690 2023-10-08T12:51:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f306da82b80 10 client.0 _ll_register_callbacks cb 0x7f304409a910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f30537fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a38729250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f30537fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a38729250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:37780/0 (socket says 172.21.15.59:37780) 2023-10-08T12:51:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f30537fe700 1 -- 172.21.15.59:0/2490784155 learned_addr learned my addr 172.21.15.59:0/2490784155 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f3053fff700 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38723e60 0x557a38729cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.098+0000 7f3052ffd700 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718fb0 0x557a38729790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f30537fe700 1 -- 172.21.15.59:0/2490784155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38723e60 msgr2=0x557a38729cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f30537fe700 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38723e60 0x557a38729cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f30537fe700 1 -- 172.21.15.59:0/2490784155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718fb0 msgr2=0x557a38729790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f30537fe700 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718fb0 0x557a38729790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f30537fe700 1 -- 172.21.15.59:0/2490784155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3054110180 con 0x557a38718690 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f30537fe700 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a38729250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3044099ce0 tx=0x7f304409a390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9db4e43ba7171aa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f3032ffd700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f3032ffd700 1 -- 172.21.15.59:0/2490784155 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304409e360 con 0x557a38718690 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f3032ffd700 1 -- 172.21.15.59:0/2490784155 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f30440a25a0 con 0x557a38718690 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f306da82b80 1 -- 172.21.15.59:0/2490784155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f304c00f040 con 0x557a38718690 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f3032ffd700 1 -- 172.21.15.59:0/2490784155 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30440b82a0 con 0x557a38718690 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f306da82b80 10 client.26812 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.099+0000 7f306da82b80 1 -- 172.21.15.59:0/2490784155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x557a384b5250 con 0x557a38718690 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.100+0000 7f3032ffd700 1 -- 172.21.15.59:0/2490784155 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f304c00f040 con 0x557a38718690 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.100+0000 7f3032ffd700 1 -- 172.21.15.59:0/2490784155 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f304409f0a0 con 0x557a38718690 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.100+0000 7f306da82b80 10 client.26812 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.100+0000 7f306da82b80 10 client.26812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:10.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.100+0000 7f306da82b80 20 client.26812 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:10.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.100+0000 7f306da82b80 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557a387890e0 0x557a3878b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.100+0000 7f306da82b80 4 client.26812 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:51:10.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.100+0000 7f306da82b80 1 -- 172.21.15.59:0/2490784155 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557a3865cb30 con 0x557a387890e0 2023-10-08T12:51:10.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.100+0000 7f3052ffd700 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557a387890e0 0x557a3878b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.101+0000 7f3052ffd700 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557a387890e0 0x557a3878b500 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8878e4dd50119669 server_cookie=e93ad43c059fceb7 in_seq=0 out_seq=0 2023-10-08T12:51:10.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.101+0000 7f3032ffd700 10 client.26812 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:10.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.101+0000 7f3032ffd700 1 -- 172.21.15.59:0/2490784155 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557a3865cb30 con 0x557a387890e0 2023-10-08T12:51:10.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.101+0000 7f3032ffd700 10 client.26812 handle_command_reply: tid=0 2023-10-08T12:51:10.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.101+0000 7f306da82b80 1 client.26812 shutdown 2023-10-08T12:51:10.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f306da82b80 1 -- 172.21.15.59:0/2490784155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 msgr2=0x557a38729250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f306da82b80 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a38729250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3044099ce0 tx=0x7f304409a390 comp rx=0 tx=0).stop 2023-10-08T12:51:10.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f306da82b80 1 -- 172.21.15.59:0/2490784155 shutdown_connections 2023-10-08T12:51:10.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f306da82b80 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557a387890e0 0x557a3878b500 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f306da82b80 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a38723e60 0x557a38729cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f306da82b80 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a38718690 0x557a38729250 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f306da82b80 1 --2- 172.21.15.59:0/2490784155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a38718fb0 0x557a38729790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f3032ffd700 0 client.26812 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:10.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f306da82b80 1 -- 172.21.15.59:0/2490784155 >> 172.21.15.59:0/2490784155 conn(0x557a38685260 msgr2=0x557a3871f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f306da82b80 1 -- 172.21.15.59:0/2490784155 shutdown_connections 2023-10-08T12:51:10.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f306da82b80 1 -- 172.21.15.59:0/2490784155 wait complete. 2023-10-08T12:51:10.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.102+0000 7f306da82b80 20 client.26812 trim_cache size 0 max 16384 2023-10-08T12:51:10.108 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:51:10.108 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:51:10.108 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:51:10.108 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:51:10.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.103+0000 7f305a1ff700 1 -- 172.21.15.59:0/389427254 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f303c0a1670 msgr2=0x7f303c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.103+0000 7f305a1ff700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f303c0a1670 0x7f303c0a3b30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f305419a450 tx=0x7f304800b260 comp rx=0 tx=0).stop 2023-10-08T12:51:10.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.103+0000 7f305a1ff700 1 -- 172.21.15.59:0/389427254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3054100150 msgr2=0x7f3054198f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.103+0000 7f305a1ff700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3054100150 0x7f3054198f50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f304400e9a0 tx=0x7f304400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.103+0000 7f305a1ff700 1 -- 172.21.15.59:0/389427254 shutdown_connections 2023-10-08T12:51:10.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.103+0000 7f305a1ff700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f303c0a1670 0x7f303c0a3b30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.103+0000 7f305a1ff700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305410d190 0x7f305419d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.103+0000 7f305a1ff700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3054100150 0x7f3054198f50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.103+0000 7f305a1ff700 1 --2- 172.21.15.59:0/389427254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3054100a70 0x7f3054199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.103+0000 7f305a1ff700 1 -- 172.21.15.59:0/389427254 >> 172.21.15.59:0/389427254 conn(0x7f3054076780 msgr2=0x7f305410e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.104+0000 7f305a1ff700 1 -- 172.21.15.59:0/389427254 shutdown_connections 2023-10-08T12:51:10.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.104+0000 7f305a1ff700 1 -- 172.21.15.59:0/389427254 wait complete. 2023-10-08T12:51:10.124 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:51:10.125 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:51:10.192 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:09 smithi059 ceph-mon[98489]: pgmap v620: 97 pgs: 97 active+clean; 606 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 232 op/s 2023-10-08T12:51:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:09 smithi173 ceph-mon[135182]: pgmap v620: 97 pgs: 97 active+clean; 606 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 232 op/s 2023-10-08T12:51:10.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.355+0000 7f11e3dff700 1 -- 172.21.15.59:0/3268152744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11dc100ff0 msgr2=0x7f11dc10d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.355+0000 7f11e3dff700 1 --2- 172.21.15.59:0/3268152744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11dc100ff0 0x7f11dc10d500 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f11d400b0a0 tx=0x7f11d400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.355+0000 7f11e3dff700 1 -- 172.21.15.59:0/3268152744 shutdown_connections 2023-10-08T12:51:10.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.355+0000 7f11e3dff700 1 --2- 172.21.15.59:0/3268152744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11dc100ff0 0x7f11dc10d500 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.355+0000 7f11e3dff700 1 --2- 172.21.15.59:0/3268152744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11dc106640 0x7f11dc106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.355+0000 7f11e3dff700 1 --2- 172.21.15.59:0/3268152744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc100630 0x7f11dc100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.355+0000 7f11e3dff700 1 -- 172.21.15.59:0/3268152744 >> 172.21.15.59:0/3268152744 conn(0x7f11dc0fc1a0 msgr2=0x7f11dc0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.355+0000 7f11e3dff700 1 -- 172.21.15.59:0/3268152744 shutdown_connections 2023-10-08T12:51:10.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.355+0000 7f11e3dff700 1 -- 172.21.15.59:0/3268152744 wait complete. 2023-10-08T12:51:10.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.356+0000 7f11e3dff700 1 Processor -- start 2023-10-08T12:51:10.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.356+0000 7f11e3dff700 1 -- start start 2023-10-08T12:51:10.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e3dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11dc100630 0x7f11dc19e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e3dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc100ff0 0x7f11dc19ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e3dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11dc106640 0x7f11dc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e3dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc1990d0 con 0x7f11dc100ff0 2023-10-08T12:51:10.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e3dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc199240 con 0x7f11dc106640 2023-10-08T12:51:10.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e3dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc199400 con 0x7f11dc100630 2023-10-08T12:51:10.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e1b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11dc100630 0x7f11dc19e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e1b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11dc100630 0x7f11dc19e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:37790/0 (socket says 172.21.15.59:37790) 2023-10-08T12:51:10.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e1b9b700 1 -- 172.21.15.59:0/3294728331 learned_addr learned my addr 172.21.15.59:0/3294728331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:10.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e139a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc100ff0 0x7f11dc19ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e239c700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11dc106640 0x7f11dc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e1b9b700 1 -- 172.21.15.59:0/3294728331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11dc106640 msgr2=0x7f11dc198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e1b9b700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11dc106640 0x7f11dc198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e1b9b700 1 -- 172.21.15.59:0/3294728331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc100ff0 msgr2=0x7f11dc19ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e1b9b700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc100ff0 0x7f11dc19ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.357+0000 7f11e1b9b700 1 -- 172.21.15.59:0/3294728331 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d4009d00 con 0x7f11dc100630 2023-10-08T12:51:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.358+0000 7f11e1b9b700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11dc100630 0x7f11dc19e940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11d800e9a0 tx=0x7f11d800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.358+0000 7f11d2ffd700 1 -- 172.21.15.59:0/3294728331 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8009790 con 0x7f11dc100630 2023-10-08T12:51:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.358+0000 7f11e3dff700 1 -- 172.21.15.59:0/3294728331 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc1996e0 con 0x7f11dc100630 2023-10-08T12:51:10.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.358+0000 7f11d2ffd700 1 -- 172.21.15.59:0/3294728331 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11d8010430 con 0x7f11dc100630 2023-10-08T12:51:10.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.358+0000 7f11d2ffd700 1 -- 172.21.15.59:0/3294728331 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8018680 con 0x7f11dc100630 2023-10-08T12:51:10.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.358+0000 7f11e3dff700 1 -- 172.21.15.59:0/3294728331 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc1a5930 con 0x7f11dc100630 2023-10-08T12:51:10.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.359+0000 7f11e3dff700 1 -- 172.21.15.59:0/3294728331 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc101d70 con 0x7f11dc100630 2023-10-08T12:51:10.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.362+0000 7f11d2ffd700 1 -- 172.21.15.59:0/3294728331 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f11d80105a0 con 0x7f11dc100630 2023-10-08T12:51:10.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.364+0000 7f11d2ffd700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c80a15f0 0x7f11c80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.364+0000 7f11d2ffd700 1 -- 172.21.15.59:0/3294728331 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f11d8014070 con 0x7f11dc100630 2023-10-08T12:51:10.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.364+0000 7f11e139a700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c80a15f0 0x7f11c80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.365+0000 7f11e139a700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c80a15f0 0x7f11c80a3ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f11dc199c30 tx=0x7f11cc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.365+0000 7f11d2ffd700 1 -- 172.21.15.59:0/3294728331 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f11d80964d0 con 0x7f11dc100630 2023-10-08T12:51:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:09 smithi092 ceph-mon[134093]: pgmap v620: 97 pgs: 97 active+clean; 606 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 232 op/s 2023-10-08T12:51:10.536 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1268106 12.79 MB/sec execute 401 sec latency 87.893 ms 2023-10-08T12:51:10.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.666+0000 7f11e3dff700 1 -- 172.21.15.59:0/3294728331 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11dc067450 con 0x7f11dc100630 2023-10-08T12:51:10.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.667+0000 7f11d2ffd700 1 -- 172.21.15.59:0/3294728331 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f11d8099af0 con 0x7f11dc100630 2023-10-08T12:51:10.668 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:51:10.668 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:51:10.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 -- 172.21.15.59:0/3294728331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c80a15f0 msgr2=0x7f11c80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c80a15f0 0x7f11c80a3ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f11dc199c30 tx=0x7f11cc009260 comp rx=0 tx=0).stop 2023-10-08T12:51:10.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 -- 172.21.15.59:0/3294728331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11dc100630 msgr2=0x7f11dc19e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11dc100630 0x7f11dc19e940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11d800e9a0 tx=0x7f11d800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 -- 172.21.15.59:0/3294728331 shutdown_connections 2023-10-08T12:51:10.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c80a15f0 0x7f11c80a3ab0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11dc106640 0x7f11dc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11dc100630 0x7f11dc19e940 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 --2- 172.21.15.59:0/3294728331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc100ff0 0x7f11dc19ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 -- 172.21.15.59:0/3294728331 >> 172.21.15.59:0/3294728331 conn(0x7f11dc0fc1a0 msgr2=0x7f11dc0fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 -- 172.21.15.59:0/3294728331 shutdown_connections 2023-10-08T12:51:10.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.669+0000 7f11e3dff700 1 -- 172.21.15.59:0/3294728331 wait complete. 2023-10-08T12:51:10.672 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:51:10.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:51:10.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.921+0000 7fa7231ff700 1 -- 172.21.15.59:0/591128765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa71c101100 msgr2=0x7fa71c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.921+0000 7fa7231ff700 1 --2- 172.21.15.59:0/591128765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa71c101100 0x7fa71c10d610 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa71400b0a0 tx=0x7fa71400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.921+0000 7fa7231ff700 1 -- 172.21.15.59:0/591128765 shutdown_connections 2023-10-08T12:51:10.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.921+0000 7fa7231ff700 1 --2- 172.21.15.59:0/591128765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa71c101100 0x7fa71c10d610 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.921+0000 7fa7231ff700 1 --2- 172.21.15.59:0/591128765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa71c106750 0x7fa71c106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.921+0000 7fa7231ff700 1 --2- 172.21.15.59:0/591128765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa71c100740 0x7fa71c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.921+0000 7fa7231ff700 1 -- 172.21.15.59:0/591128765 >> 172.21.15.59:0/591128765 conn(0x7fa71c0fc230 msgr2=0x7fa71c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.922+0000 7fa7231ff700 1 -- 172.21.15.59:0/591128765 shutdown_connections 2023-10-08T12:51:10.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.922+0000 7fa7231ff700 1 -- 172.21.15.59:0/591128765 wait complete. 2023-10-08T12:51:10.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.923+0000 7fa7231ff700 1 Processor -- start 2023-10-08T12:51:10.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.923+0000 7fa7231ff700 1 -- start start 2023-10-08T12:51:10.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.923+0000 7fa7231ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa71c100740 0x7fa71c19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.923+0000 7fa7231ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa71c101100 0x7fa71c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.923+0000 7fa7231ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa71c106750 0x7fa71c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.923+0000 7fa7231ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c1991f0 con 0x7fa71c101100 2023-10-08T12:51:10.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.923+0000 7fa7231ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c199360 con 0x7fa71c100740 2023-10-08T12:51:10.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.923+0000 7fa7231ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c199520 con 0x7fa71c106750 2023-10-08T12:51:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa713fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa71c101100 0x7fa71c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa713fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa71c101100 0x7fa71c19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50432/0 (socket says 172.21.15.59:50432) 2023-10-08T12:51:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa72179c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa71c106750 0x7fa71c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa713fff700 1 -- 172.21.15.59:0/3012801776 learned_addr learned my addr 172.21.15.59:0/3012801776 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa720f9b700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa71c100740 0x7fa71c19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa72179c700 1 -- 172.21.15.59:0/3012801776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa71c100740 msgr2=0x7fa71c19ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa72179c700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa71c100740 0x7fa71c19ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa72179c700 1 -- 172.21.15.59:0/3012801776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa71c101100 msgr2=0x7fa71c19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa72179c700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa71c101100 0x7fa71c19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa72179c700 1 -- 172.21.15.59:0/3012801776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa714009d00 con 0x7fa71c106750 2023-10-08T12:51:10.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa713fff700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa71c101100 0x7fa71c19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:10.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.924+0000 7fa72179c700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa71c106750 0x7fa71c198b90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa71400b070 tx=0x7fa7140077f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.925+0000 7fa711ffb700 1 -- 172.21.15.59:0/3012801776 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71400e040 con 0x7fa71c106750 2023-10-08T12:51:10.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.925+0000 7fa711ffb700 1 -- 172.21.15.59:0/3012801776 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa714004e60 con 0x7fa71c106750 2023-10-08T12:51:10.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.925+0000 7fa711ffb700 1 -- 172.21.15.59:0/3012801776 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714005040 con 0x7fa71c106750 2023-10-08T12:51:10.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.925+0000 7fa7231ff700 1 -- 172.21.15.59:0/3012801776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c1997a0 con 0x7fa71c106750 2023-10-08T12:51:10.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.925+0000 7fa7231ff700 1 -- 172.21.15.59:0/3012801776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c1a5a50 con 0x7fa71c106750 2023-10-08T12:51:10.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.930+0000 7fa711ffb700 1 -- 172.21.15.59:0/3012801776 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa71401d470 con 0x7fa71c106750 2023-10-08T12:51:10.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.932+0000 7fa736ab1b80 1 Processor -- start 2023-10-08T12:51:10.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.932+0000 7fa736ab1b80 1 -- start start 2023-10-08T12:51:10.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.933+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0631fe80 0x557c06320260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.933+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 0x557c0632b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.933+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c0632b650 0x557c0632da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.933+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c06289460 con 0x557c063207a0 2023-10-08T12:51:10.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.933+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c0627ac20 con 0x557c0631fe80 2023-10-08T12:51:10.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.933+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c06278540 con 0x557c0632b650 2023-10-08T12:51:10.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.933+0000 7fa711ffb700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa7040a16f0 0x7fa7040a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.933+0000 7fa711ffb700 1 -- 172.21.15.59:0/3012801776 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fa7140ce4c0 con 0x7fa71c106750 2023-10-08T12:51:10.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.933+0000 7fa713fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0631fe80 0x557c06320260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.933+0000 7fa713fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0631fe80 0x557c06320260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57770/0 (socket says 172.21.15.59:57770) 2023-10-08T12:51:10.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.933+0000 7fa713fff700 1 -- 172.21.15.59:0/2636322703 learned_addr learned my addr 172.21.15.59:0/2636322703 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:10.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.934+0000 7fa713fff700 1 --2- 172.21.15.59:0/2636322703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c0632b650 0x557c0632da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.934+0000 7fa72179c700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa7040a16f0 0x7fa7040a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.934+0000 7fa720f9b700 1 --2- 172.21.15.59:0/2636322703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 0x557c0632b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.934+0000 7fa713fff700 1 -- 172.21.15.59:0/2636322703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c0632b650 msgr2=0x557c0632da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.934+0000 7fa713fff700 1 --2- 172.21.15.59:0/2636322703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c0632b650 0x557c0632da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.934+0000 7fa713fff700 1 -- 172.21.15.59:0/2636322703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 msgr2=0x557c0632b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.934+0000 7fa713fff700 1 --2- 172.21.15.59:0/2636322703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 0x557c0632b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.934+0000 7fa713fff700 1 -- 172.21.15.59:0/2636322703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c0609ede0 con 0x557c0631fe80 2023-10-08T12:51:10.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.934+0000 7fa720f9b700 1 --2- 172.21.15.59:0/2636322703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 0x557c0632b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:51:10.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.934+0000 7fa713fff700 1 --2- 172.21.15.59:0/2636322703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0631fe80 0x557c06320260 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa70c011d60 tx=0x7fa70c009cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3592138dbc3c0b4c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.935+0000 7fa702ffd700 1 -- 172.21.15.59:0/2636322703 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c00f9b0 con 0x557c0631fe80 2023-10-08T12:51:10.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.935+0000 7fa702ffd700 1 -- 172.21.15.59:0/2636322703 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa70c01f440 con 0x557c0631fe80 2023-10-08T12:51:10.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.935+0000 7fa702ffd700 1 -- 172.21.15.59:0/2636322703 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c00e610 con 0x557c0631fe80 2023-10-08T12:51:10.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.935+0000 7fa72179c700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa7040a16f0 0x7fa7040a3bb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa71409b1f0 tx=0x7fa7140099e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.936+0000 7fa736ab1b80 1 -- 172.21.15.59:0/2636322703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0631fe80 msgr2=0x557c06320260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.936+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/2636322703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0631fe80 0x557c06320260 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa70c011d60 tx=0x7fa70c009cf0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.936+0000 7fa736ab1b80 1 -- 172.21.15.59:0/2636322703 shutdown_connections 2023-10-08T12:51:10.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.936+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/2636322703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0631fe80 0x557c06320260 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.936+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/2636322703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c0632b650 0x557c0632da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.936+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/2636322703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 0x557c0632b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.936+0000 7fa736ab1b80 1 -- 172.21.15.59:0/2636322703 >> 172.21.15.59:0/2636322703 conn(0x557c06295260 msgr2=0x557c0631c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.936+0000 7fa736ab1b80 1 -- 172.21.15.59:0/2636322703 shutdown_connections 2023-10-08T12:51:10.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.936+0000 7fa736ab1b80 1 -- 172.21.15.59:0/2636322703 wait complete. 2023-10-08T12:51:10.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.937+0000 7fa736ab1b80 1 -- start start 2023-10-08T12:51:10.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.937+0000 7fa736ab1b80 1 Processor -- start 2023-10-08T12:51:10.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.938+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c0631fe80 0x557c063284a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.938+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 0x557c063289e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.938+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c06328f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.938+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c06273e30 con 0x557c0631fe80 2023-10-08T12:51:10.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.938+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c06210710 con 0x557c0632b650 2023-10-08T12:51:10.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.938+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c062103b0 con 0x557c063207a0 2023-10-08T12:51:10.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.938+0000 7fa736ab1b80 10 client.0 _ll_register_callbacks cb 0x557c0606d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:10.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.939+0000 7fa713fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c06328f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.939+0000 7fa713fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c06328f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57780/0 (socket says 172.21.15.59:57780) 2023-10-08T12:51:10.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.939+0000 7fa713fff700 1 -- 172.21.15.59:0/1834686917 learned_addr learned my addr 172.21.15.59:0/1834686917 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:10.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.939+0000 7fa720f9b700 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 0x557c063289e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.939+0000 7fa713fff700 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c0631fe80 0x557c063284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.940+0000 7fa713fff700 1 -- 172.21.15.59:0/1834686917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 msgr2=0x557c063289e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.940+0000 7fa713fff700 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 0x557c063289e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.940+0000 7fa713fff700 1 -- 172.21.15.59:0/1834686917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c0631fe80 msgr2=0x557c063284a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.940+0000 7fa713fff700 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c0631fe80 0x557c063284a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.940+0000 7fa713fff700 1 -- 172.21.15.59:0/1834686917 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c019040 con 0x557c0632b650 2023-10-08T12:51:10.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.940+0000 7fa713fff700 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c06328f20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009e70 tx=0x7fa70c01fd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef06ca77119532b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.940+0000 7fa6fbfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:51:10.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.940+0000 7fa6fbfff700 1 -- 172.21.15.59:0/1834686917 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c00fae0 con 0x557c0632b650 2023-10-08T12:51:10.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.940+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1834686917 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c0623beb0 con 0x557c0632b650 2023-10-08T12:51:10.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.940+0000 7fa6fbfff700 1 -- 172.21.15.59:0/1834686917 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fa70c00fc40 con 0x557c0632b650 2023-10-08T12:51:10.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa6fbfff700 1 -- 172.21.15.59:0/1834686917 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa70c00fe00 con 0x557c0632b650 2023-10-08T12:51:10.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa736ab1b80 10 client.26840 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:10.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1834686917 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x557c06087c60 con 0x557c0632b650 2023-10-08T12:51:10.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa6fbfff700 1 -- 172.21.15.59:0/1834686917 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557c0623beb0 con 0x557c0632b650 2023-10-08T12:51:10.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa6fbfff700 1 -- 172.21.15.59:0/1834686917 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa70c003c10 con 0x557c0632b650 2023-10-08T12:51:10.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa736ab1b80 10 client.26840 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:10.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa736ab1b80 10 client.26840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:10.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa736ab1b80 20 client.26840 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:10.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557c063437b0 0x557c06345bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa736ab1b80 4 client.26840 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:51:10.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1834686917 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c0626ce10 con 0x557c063437b0 2023-10-08T12:51:10.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.941+0000 7fa720f9b700 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557c063437b0 0x557c06345bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.942+0000 7fa720f9b700 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557c063437b0 0x557c06345bd0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a7284983ef4ba5d server_cookie=348739c461a6f97b in_seq=0 out_seq=0 2023-10-08T12:51:10.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.942+0000 7fa6fbfff700 10 client.26840 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:10.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.943+0000 7fa6fbfff700 1 -- 172.21.15.59:0/1834686917 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557c0626ce10 con 0x557c063437b0 2023-10-08T12:51:10.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.943+0000 7fa6fbfff700 10 client.26840 handle_command_reply: tid=0 2023-10-08T12:51:10.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.943+0000 7fa736ab1b80 1 client.26840 shutdown 2023-10-08T12:51:10.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1834686917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 msgr2=0x557c06328f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c06328f20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009e70 tx=0x7fa70c01fd00 comp rx=0 tx=0).stop 2023-10-08T12:51:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1834686917 shutdown_connections 2023-10-08T12:51:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557c063437b0 0x557c06345bd0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c06328f20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c0631fe80 0x557c063284a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa6fbfff700 0 client.26840 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/1834686917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 0x557c063289e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1834686917 >> 172.21.15.59:0/1834686917 conn(0x557c06295260 msgr2=0x557c0631bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1834686917 shutdown_connections 2023-10-08T12:51:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1834686917 wait complete. 2023-10-08T12:51:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.944+0000 7fa736ab1b80 20 client.26840 trim_cache size 0 max 16384 2023-10-08T12:51:10.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.958+0000 7fa736ab1b80 1 Processor -- start 2023-10-08T12:51:10.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa736ab1b80 1 -- start start 2023-10-08T12:51:10.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c0631fe80 0x557c06322d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 0x557c06328d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c0631bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c060f4920 con 0x557c063207a0 2023-10-08T12:51:10.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c0632b470 con 0x557c0632b650 2023-10-08T12:51:10.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c06326a10 con 0x557c0631fe80 2023-10-08T12:51:10.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa720f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 0x557c06328d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa713fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c0631fe80 0x557c06322d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa720f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 0x557c06328d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50468/0 (socket says 172.21.15.59:50468) 2023-10-08T12:51:10.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa720f9b700 1 -- 172.21.15.59:0/1626847561 learned_addr learned my addr 172.21.15.59:0/1626847561 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:10.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.959+0000 7fa713fff700 1 --2- 172.21.15.59:0/1626847561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c0631bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.960+0000 7fa720f9b700 1 -- 172.21.15.59:0/1626847561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c0631fe80 msgr2=0x557c06322d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.960+0000 7fa720f9b700 1 --2- 172.21.15.59:0/1626847561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c0631fe80 0x557c06322d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.960+0000 7fa720f9b700 1 -- 172.21.15.59:0/1626847561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 msgr2=0x557c0631bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.960+0000 7fa720f9b700 1 --2- 172.21.15.59:0/1626847561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c0631bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.960+0000 7fa720f9b700 1 -- 172.21.15.59:0/1626847561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c060c5250 con 0x557c063207a0 2023-10-08T12:51:10.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.960+0000 7fa713fff700 1 --2- 172.21.15.59:0/1626847561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c0631fe80 0x557c06322d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:10.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.960+0000 7fa720f9b700 1 --2- 172.21.15.59:0/1626847561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 0x557c06328d40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa718000c00 tx=0x7fa718004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc2591759c72232 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.960+0000 7fa7037fe700 1 -- 172.21.15.59:0/1626847561 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718017040 con 0x557c063207a0 2023-10-08T12:51:10.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.960+0000 7fa7037fe700 1 -- 172.21.15.59:0/1626847561 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa718020070 con 0x557c063207a0 2023-10-08T12:51:10.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.960+0000 7fa7037fe700 1 -- 172.21.15.59:0/1626847561 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718011440 con 0x557c063207a0 2023-10-08T12:51:10.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.961+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1626847561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 msgr2=0x557c06328d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.961+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/1626847561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 0x557c06328d40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa718000c00 tx=0x7fa718004320 comp rx=0 tx=0).stop 2023-10-08T12:51:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.961+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1626847561 shutdown_connections 2023-10-08T12:51:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.961+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/1626847561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c0631bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.961+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/1626847561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c0631fe80 0x557c06322d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.961+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/1626847561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c063207a0 0x557c06328d40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.961+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1626847561 >> 172.21.15.59:0/1626847561 conn(0x557c06295260 msgr2=0x557c063237b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.961+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1626847561 shutdown_connections 2023-10-08T12:51:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.961+0000 7fa736ab1b80 1 -- 172.21.15.59:0/1626847561 wait complete. 2023-10-08T12:51:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.962+0000 7fa736ab1b80 1 -- start start 2023-10-08T12:51:10.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.962+0000 7fa736ab1b80 1 Processor -- start 2023-10-08T12:51:10.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.962+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c0631fe80 0x557c06338c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 0x557c06339180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa736ab1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c063965e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c06396b20 con 0x557c0631fe80 2023-10-08T12:51:10.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c06396c60 con 0x557c0632b650 2023-10-08T12:51:10.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa736ab1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c06396df0 con 0x557c063207a0 2023-10-08T12:51:10.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa736ab1b80 10 client.0 _ll_register_callbacks cb 0x7fa70c01f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:10.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa720f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 0x557c06339180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa720f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 0x557c06339180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51132/0 (socket says 172.21.15.59:51132) 2023-10-08T12:51:10.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa720f9b700 1 -- 172.21.15.59:0/4252873034 learned_addr learned my addr 172.21.15.59:0/4252873034 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:10.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa713fff700 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c0631fe80 0x557c06338c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa713fff700 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c063965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa720f9b700 1 -- 172.21.15.59:0/4252873034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 msgr2=0x557c063965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa720f9b700 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c063965e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa720f9b700 1 -- 172.21.15.59:0/4252873034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c0631fe80 msgr2=0x557c06338c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:10.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa720f9b700 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c0631fe80 0x557c06338c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.963+0000 7fa720f9b700 1 -- 172.21.15.59:0/4252873034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c06087c60 con 0x557c063207a0 2023-10-08T12:51:10.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.964+0000 7fa720f9b700 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 0x557c06339180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa71801c5e0 tx=0x7fa71801c610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8f29a8cdb3a42c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:10.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.964+0000 7fa6fbfff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:51:10.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.964+0000 7fa6fbfff700 1 -- 172.21.15.59:0/4252873034 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718017070 con 0x557c063207a0 2023-10-08T12:51:10.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.964+0000 7fa736ab1b80 1 -- 172.21.15.59:0/4252873034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa70c01f440 con 0x557c063207a0 2023-10-08T12:51:10.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.964+0000 7fa6fbfff700 1 -- 172.21.15.59:0/4252873034 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fa718003940 con 0x557c063207a0 2023-10-08T12:51:10.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.964+0000 7fa6fbfff700 1 -- 172.21.15.59:0/4252873034 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa718003b40 con 0x557c063207a0 2023-10-08T12:51:10.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.964+0000 7fa736ab1b80 10 client.26836 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:10.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.964+0000 7fa736ab1b80 1 -- 172.21.15.59:0/4252873034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fa718009bc0 con 0x557c063207a0 2023-10-08T12:51:10.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.965+0000 7fa6fbfff700 1 -- 172.21.15.59:0/4252873034 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa70c01f440 con 0x557c063207a0 2023-10-08T12:51:10.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.965+0000 7fa6fbfff700 1 -- 172.21.15.59:0/4252873034 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa718025420 con 0x557c063207a0 2023-10-08T12:51:10.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.965+0000 7fa736ab1b80 10 client.26836 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:10.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.965+0000 7fa736ab1b80 10 client.26836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:10.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.965+0000 7fa736ab1b80 20 client.26836 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:10.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.965+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557c063985e0 0x557c0639aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:10.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.965+0000 7fa736ab1b80 4 client.26836 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:51:10.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.965+0000 7fa736ab1b80 1 -- 172.21.15.59:0/4252873034 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557c0626cb30 con 0x557c063985e0 2023-10-08T12:51:10.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.966+0000 7fa713fff700 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557c063985e0 0x557c0639aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:10.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.966+0000 7fa713fff700 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557c063985e0 0x557c0639aa00 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a322e1e001b6daa server_cookie=254ff60033ffc592 in_seq=0 out_seq=0 2023-10-08T12:51:10.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.966+0000 7fa6fbfff700 10 client.26836 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:10.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa6fbfff700 1 -- 172.21.15.59:0/4252873034 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557c0626cb30 con 0x557c063985e0 2023-10-08T12:51:10.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa6fbfff700 10 client.26836 handle_command_reply: tid=0 2023-10-08T12:51:10.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 1 client.26836 shutdown 2023-10-08T12:51:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 1 -- 172.21.15.59:0/4252873034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 msgr2=0x557c06339180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 0x557c06339180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa71801c5e0 tx=0x7fa71801c610 comp rx=0 tx=0).stop 2023-10-08T12:51:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 1 -- 172.21.15.59:0/4252873034 shutdown_connections 2023-10-08T12:51:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x557c063985e0 0x557c0639aa00 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c0632b650 0x557c063965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c0631fe80 0x557c06338c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa6fbfff700 0 client.26836 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 1 --2- 172.21.15.59:0/4252873034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557c063207a0 0x557c06339180 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 1 -- 172.21.15.59:0/4252873034 >> 172.21.15.59:0/4252873034 conn(0x557c06295260 msgr2=0x557c0631bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 1 -- 172.21.15.59:0/4252873034 shutdown_connections 2023-10-08T12:51:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 1 -- 172.21.15.59:0/4252873034 wait complete. 2023-10-08T12:51:10.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.967+0000 7fa736ab1b80 20 client.26836 trim_cache size 0 max 16384 2023-10-08T12:51:10.974 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:51:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 -- 172.21.15.59:0/3012801776 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa7040a16f0 msgr2=0x7fa7040a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa7040a16f0 0x7fa7040a3bb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa71409b1f0 tx=0x7fa7140099e0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 -- 172.21.15.59:0/3012801776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa71c106750 msgr2=0x7fa71c198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa71c106750 0x7fa71c198b90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa71400b070 tx=0x7fa7140077f0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 -- 172.21.15.59:0/3012801776 shutdown_connections 2023-10-08T12:51:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa7040a16f0 0x7fa7040a3bb0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa71c100740 0x7fa71c19ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa71c106750 0x7fa71c198b90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 --2- 172.21.15.59:0/3012801776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa71c101100 0x7fa71c19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 -- 172.21.15.59:0/3012801776 >> 172.21.15.59:0/3012801776 conn(0x7fa71c0fc230 msgr2=0x7fa71c0fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 -- 172.21.15.59:0/3012801776 shutdown_connections 2023-10-08T12:51:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:10.968+0000 7fa7231ff700 1 -- 172.21.15.59:0/3012801776 wait complete. 2023-10-08T12:51:10.990 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:10 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3294728331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:51:11.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:10 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3294728331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:51:11.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:10 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3294728331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:51:11.536 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1269736 12.77 MB/sec execute 402 sec latency 17.111 ms 2023-10-08T12:51:11.993 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:51:11.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:51:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:11 smithi173 ceph-mon[135182]: pgmap v621: 97 pgs: 97 active+clean; 592 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.0 MiB/s wr, 284 op/s 2023-10-08T12:51:12.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.230+0000 7f8f4cbff700 1 -- 172.21.15.59:0/798434785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f481010f0 msgr2=0x7f8f4810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.230+0000 7f8f4cbff700 1 --2- 172.21.15.59:0/798434785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f481010f0 0x7f8f4810d600 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000b0a0 tx=0x7f8f4000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.231+0000 7f8f4cbff700 1 -- 172.21.15.59:0/798434785 shutdown_connections 2023-10-08T12:51:12.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.231+0000 7f8f4cbff700 1 --2- 172.21.15.59:0/798434785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f481010f0 0x7f8f4810d600 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.231+0000 7f8f4cbff700 1 --2- 172.21.15.59:0/798434785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48106740 0x7f8f48106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.231+0000 7f8f4cbff700 1 --2- 172.21.15.59:0/798434785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f48100730 0x7f8f48100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.231+0000 7f8f4cbff700 1 -- 172.21.15.59:0/798434785 >> 172.21.15.59:0/798434785 conn(0x7f8f480fc200 msgr2=0x7f8f480fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.231+0000 7f8f4cbff700 1 -- 172.21.15.59:0/798434785 shutdown_connections 2023-10-08T12:51:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.231+0000 7f8f4cbff700 1 -- 172.21.15.59:0/798434785 wait complete. 2023-10-08T12:51:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.232+0000 7f8f4cbff700 1 Processor -- start 2023-10-08T12:51:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.232+0000 7f8f4cbff700 1 -- start start 2023-10-08T12:51:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.232+0000 7f8f4cbff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48100730 0x7f8f4819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.232+0000 7f8f4cbff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f481010f0 0x7f8f4819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.232+0000 7f8f4cbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f48106740 0x7f8f48198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.232+0000 7f8f4cbff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48199330 con 0x7f8f48100730 2023-10-08T12:51:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.232+0000 7f8f4cbff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f481994a0 con 0x7f8f481010f0 2023-10-08T12:51:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.232+0000 7f8f4cbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48199660 con 0x7f8f48106740 2023-10-08T12:51:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.233+0000 7f8f4659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48100730 0x7f8f4819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.233+0000 7f8f45d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f481010f0 0x7f8f4819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.233+0000 7f8f4659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48100730 0x7f8f4819eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50504/0 (socket says 172.21.15.59:50504) 2023-10-08T12:51:12.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.233+0000 7f8f4659c700 1 -- 172.21.15.59:0/3136263377 learned_addr learned my addr 172.21.15.59:0/3136263377 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:12.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.233+0000 7f8f46d9d700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f48106740 0x7f8f48198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.233+0000 7f8f4659c700 1 -- 172.21.15.59:0/3136263377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f48106740 msgr2=0x7f8f48198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.233+0000 7f8f4659c700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f48106740 0x7f8f48198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.233+0000 7f8f4659c700 1 -- 172.21.15.59:0/3136263377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f481010f0 msgr2=0x7f8f4819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.233+0000 7f8f4659c700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f481010f0 0x7f8f4819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.233+0000 7f8f4659c700 1 -- 172.21.15.59:0/3136263377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f38009520 con 0x7f8f48100730 2023-10-08T12:51:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.233+0000 7f8f4659c700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48100730 0x7f8f4819eac0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800eb30 tx=0x7f8f3800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.234+0000 7f8f377fe700 1 -- 172.21.15.59:0/3136263377 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38009880 con 0x7f8f48100730 2023-10-08T12:51:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.234+0000 7f8f4cbff700 1 -- 172.21.15.59:0/3136263377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f40009d00 con 0x7f8f48100730 2023-10-08T12:51:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.234+0000 7f8f377fe700 1 -- 172.21.15.59:0/3136263377 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f380044e0 con 0x7f8f48100730 2023-10-08T12:51:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.234+0000 7f8f377fe700 1 -- 172.21.15.59:0/3136263377 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38003d80 con 0x7f8f48100730 2023-10-08T12:51:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.234+0000 7f8f4cbff700 1 -- 172.21.15.59:0/3136263377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f481a5a40 con 0x7f8f48100730 2023-10-08T12:51:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.238+0000 7f8f377fe700 1 -- 172.21.15.59:0/3136263377 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8f38003f20 con 0x7f8f48100730 2023-10-08T12:51:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.239+0000 7f8f6055ab80 1 Processor -- start 2023-10-08T12:51:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.239+0000 7f8f6055ab80 1 -- start start 2023-10-08T12:51:12.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.239+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cc7f00 0x55cb15cc82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.239+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.239+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cd36d0 0x55cb15cd5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.239+0000 7f8f377fe700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f300a1670 0x7f8f300a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.239+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15c314e0 con 0x55cb15cc7f00 2023-10-08T12:51:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.239+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15c22ca0 con 0x55cb15cd36d0 2023-10-08T12:51:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.239+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15c205c0 con 0x55cb15cc8820 2023-10-08T12:51:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f377fe700 1 -- 172.21.15.59:0/3136263377 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f8f38014070 con 0x7f8f48100730 2023-10-08T12:51:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f45d9b700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f300a1670 0x7f8f300a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f46d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cc7f00 0x55cb15cc82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f4659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f46d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cc7f00 0x55cb15cc82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50508/0 (socket says 172.21.15.59:50508) 2023-10-08T12:51:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f4659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51154/0 (socket says 172.21.15.59:51154) 2023-10-08T12:51:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f46d9d700 1 -- 172.21.15.59:0/3482840452 learned_addr learned my addr 172.21.15.59:0/3482840452 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f46d9d700 1 --2- 172.21.15.59:0/3482840452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cd36d0 0x55cb15cd5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f4659c700 1 -- 172.21.15.59:0/3482840452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cd36d0 msgr2=0x55cb15cd5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f4659c700 1 --2- 172.21.15.59:0/3482840452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cd36d0 0x55cb15cd5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f4659c700 1 -- 172.21.15.59:0/3482840452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cc7f00 msgr2=0x55cb15cc82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f4659c700 1 --2- 172.21.15.59:0/3482840452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cc7f00 0x55cb15cc82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f4659c700 1 -- 172.21.15.59:0/3482840452 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb15a46e60 con 0x55cb15cc8820 2023-10-08T12:51:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f46d9d700 1 --2- 172.21.15.59:0/3482840452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cd36d0 0x55cb15cd5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:51:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.240+0000 7f8f45d9b700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f300a1670 0x7f8f300a3b30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8f4819a2d0 tx=0x7f8f3c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.241+0000 7f8f4659c700 1 --2- 172.21.15.59:0/3482840452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd3190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8f380cac70 tx=0x7f8f3809a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395b30283e016357 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.241+0000 7f8f34ff9700 1 -- 172.21.15.59:0/3482840452 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800cbd0 con 0x55cb15cc8820 2023-10-08T12:51:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.241+0000 7f8f34ff9700 1 -- 172.21.15.59:0/3482840452 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f3809ac30 con 0x55cb15cc8820 2023-10-08T12:51:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.241+0000 7f8f34ff9700 1 -- 172.21.15.59:0/3482840452 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800cdd0 con 0x55cb15cc8820 2023-10-08T12:51:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.242+0000 7f8f6055ab80 1 -- 172.21.15.59:0/3482840452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 msgr2=0x55cb15cd3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.242+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/3482840452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd3190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8f380cac70 tx=0x7f8f3809a1a0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.242+0000 7f8f6055ab80 1 -- 172.21.15.59:0/3482840452 shutdown_connections 2023-10-08T12:51:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.242+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/3482840452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cd36d0 0x55cb15cd5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.242+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/3482840452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cc7f00 0x55cb15cc82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.242+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/3482840452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd3190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.242+0000 7f8f6055ab80 1 -- 172.21.15.59:0/3482840452 >> 172.21.15.59:0/3482840452 conn(0x55cb15c3d2e0 msgr2=0x55cb15cc4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.242+0000 7f8f6055ab80 1 -- 172.21.15.59:0/3482840452 shutdown_connections 2023-10-08T12:51:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.242+0000 7f8f6055ab80 1 -- 172.21.15.59:0/3482840452 wait complete. 2023-10-08T12:51:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.243+0000 7f8f6055ab80 1 -- start start 2023-10-08T12:51:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.243+0000 7f8f6055ab80 1 Processor -- start 2023-10-08T12:51:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.243+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.243+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.244+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cd36d0 0x55cb15cd0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.244+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15c1beb0 con 0x55cb15cd36d0 2023-10-08T12:51:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.244+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15bb8790 con 0x55cb15cc7f00 2023-10-08T12:51:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.244+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15bb8430 con 0x55cb15cc8820 2023-10-08T12:51:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.244+0000 7f8f6055ab80 10 client.0 _ll_register_callbacks cb 0x55cb15a15880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.244+0000 7f8f4659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.244+0000 7f8f46d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cd36d0 0x55cb15cd0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.244+0000 7f8f4659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57842/0 (socket says 172.21.15.59:57842) 2023-10-08T12:51:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.244+0000 7f8f4659c700 1 -- 172.21.15.59:0/1778807553 learned_addr learned my addr 172.21.15.59:0/1778807553 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.244+0000 7f8f45d9b700 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f4659c700 1 -- 172.21.15.59:0/1778807553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 msgr2=0x55cb15cd0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f4659c700 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f4659c700 1 -- 172.21.15.59:0/1778807553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cd36d0 msgr2=0x55cb15cd0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f4659c700 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cd36d0 0x55cb15cd0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f4659c700 1 -- 172.21.15.59:0/1778807553 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f481a5a40 con 0x55cb15cc7f00 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f45d9b700 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f4659c700 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd3190 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800eb00 tx=0x7f8f3809ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edc8fc3d152fe6ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f2dffb700 1 -- 172.21.15.59:0/1778807553 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f380cb130 con 0x55cb15cc7f00 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f2dffb700 1 -- 172.21.15.59:0/1778807553 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f8f3809a530 con 0x55cb15cc7f00 2023-10-08T12:51:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1778807553 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb15be3f30 con 0x55cb15cc7f00 2023-10-08T12:51:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f2dffb700 1 -- 172.21.15.59:0/1778807553 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f3800cdd0 con 0x55cb15cc7f00 2023-10-08T12:51:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f6055ab80 10 client.26858 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.245+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1778807553 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55cb15a2fce0 con 0x55cb15cc7f00 2023-10-08T12:51:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.246+0000 7f8f2dffb700 1 -- 172.21.15.59:0/1778807553 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cb15be3f30 con 0x55cb15cc7f00 2023-10-08T12:51:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.246+0000 7f8f2dffb700 1 -- 172.21.15.59:0/1778807553 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8f38099a20 con 0x55cb15cc7f00 2023-10-08T12:51:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.246+0000 7f8f6055ab80 10 client.26858 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.246+0000 7f8f6055ab80 10 client.26858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.246+0000 7f8f6055ab80 20 client.26858 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.246+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cb15ce2f90 0x55cb15ce5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.246+0000 7f8f6055ab80 4 client.26858 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:51:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.246+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1778807553 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb15c14e90 con 0x55cb15ce2f90 2023-10-08T12:51:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.246+0000 7f8f45d9b700 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cb15ce2f90 0x55cb15ce5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.247+0000 7f8f45d9b700 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cb15ce2f90 0x55cb15ce5380 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cd755efe73b0363 server_cookie=49879c4aa62e9f0e in_seq=0 out_seq=0 2023-10-08T12:51:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.247+0000 7f8f2dffb700 10 client.26858 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f2dffb700 1 -- 172.21.15.59:0/1778807553 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cb15c14e90 con 0x55cb15ce2f90 2023-10-08T12:51:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f2dffb700 10 client.26858 handle_command_reply: tid=0 2023-10-08T12:51:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 1 client.26858 shutdown 2023-10-08T12:51:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1778807553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 msgr2=0x55cb15cd3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd3190 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800eb00 tx=0x7f8f3809ada0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1778807553 shutdown_connections 2023-10-08T12:51:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cb15ce2f90 0x55cb15ce5380 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd3190 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cd36d0 0x55cb15cd0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f2dffb700 0 client.26858 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/1778807553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1778807553 >> 172.21.15.59:0/1778807553 conn(0x55cb15c3d2e0 msgr2=0x55cb15cc3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1778807553 shutdown_connections 2023-10-08T12:51:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1778807553 wait complete. 2023-10-08T12:51:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.248+0000 7f8f6055ab80 20 client.26858 trim_cache size 0 max 16384 2023-10-08T12:51:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:11 smithi059 ceph-mon[98489]: pgmap v621: 97 pgs: 97 active+clean; 592 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.0 MiB/s wr, 284 op/s 2023-10-08T12:51:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.269+0000 7f8f6055ab80 1 Processor -- start 2023-10-08T12:51:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.269+0000 7f8f6055ab80 1 -- start start 2023-10-08T12:51:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cc4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cc8820 0x55cb15cda220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cd36d0 0x55cb15ccadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15a9c9a0 con 0x55cb15cc8820 2023-10-08T12:51:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15cda760 con 0x55cb15cc7f00 2023-10-08T12:51:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15cc8c00 con 0x55cb15cd36d0 2023-10-08T12:51:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f4659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cc4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f4659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cc4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57852/0 (socket says 172.21.15.59:57852) 2023-10-08T12:51:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f4659c700 1 -- 172.21.15.59:0/1350872728 learned_addr learned my addr 172.21.15.59:0/1350872728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f45d9b700 1 --2- 172.21.15.59:0/1350872728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cc8820 0x55cb15cda220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f46d9d700 1 --2- 172.21.15.59:0/1350872728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cd36d0 0x55cb15ccadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f4659c700 1 -- 172.21.15.59:0/1350872728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cd36d0 msgr2=0x55cb15ccadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f4659c700 1 --2- 172.21.15.59:0/1350872728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cd36d0 0x55cb15ccadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f4659c700 1 -- 172.21.15.59:0/1350872728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cc8820 msgr2=0x55cb15cda220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f4659c700 1 --2- 172.21.15.59:0/1350872728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cc8820 0x55cb15cda220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.270+0000 7f8f4659c700 1 -- 172.21.15.59:0/1350872728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb15a6d2d0 con 0x55cb15cc7f00 2023-10-08T12:51:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.271+0000 7f8f4659c700 1 --2- 172.21.15.59:0/1350872728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cc4500 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8f38098880 tx=0x7f8f38003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f7567f80c265462 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.271+0000 7f8f357fa700 1 -- 172.21.15.59:0/1350872728 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800cc50 con 0x55cb15cc7f00 2023-10-08T12:51:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.271+0000 7f8f357fa700 1 -- 172.21.15.59:0/1350872728 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f3809a790 con 0x55cb15cc7f00 2023-10-08T12:51:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.271+0000 7f8f357fa700 1 -- 172.21.15.59:0/1350872728 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f380a25c0 con 0x55cb15cc7f00 2023-10-08T12:51:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.271+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1350872728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 msgr2=0x55cb15cc4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.271+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/1350872728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cc4500 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8f38098880 tx=0x7f8f38003820 comp rx=0 tx=0).stop 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.271+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1350872728 shutdown_connections 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.271+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/1350872728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cc4500 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.271+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/1350872728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cd36d0 0x55cb15ccadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.272+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/1350872728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cc8820 0x55cb15cda220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.272+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1350872728 >> 172.21.15.59:0/1350872728 conn(0x55cb15c3d2e0 msgr2=0x55cb15cc3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.272+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1350872728 shutdown_connections 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.272+0000 7f8f6055ab80 1 -- 172.21.15.59:0/1350872728 wait complete. 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.272+0000 7f8f6055ab80 1 -- start start 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.272+0000 7f8f6055ab80 1 Processor -- start 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f6055ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cd36d0 0x55cb15d36d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15cd9d50 con 0x55cb15cd36d0 2023-10-08T12:51:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15d37270 con 0x55cb15cc7f00 2023-10-08T12:51:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f6055ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb15d37430 con 0x55cb15cc8820 2023-10-08T12:51:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f6055ab80 10 client.0 _ll_register_callbacks cb 0x7f8f38005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f4659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f4659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57854/0 (socket says 172.21.15.59:57854) 2023-10-08T12:51:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f4659c700 1 -- 172.21.15.59:0/802542226 learned_addr learned my addr 172.21.15.59:0/802542226 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f46d9d700 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cd36d0 0x55cb15d36d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f45d9b700 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f4659c700 1 -- 172.21.15.59:0/802542226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 msgr2=0x55cb15cd95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f4659c700 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f4659c700 1 -- 172.21.15.59:0/802542226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cd36d0 msgr2=0x55cb15d36d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f4659c700 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cd36d0 0x55cb15d36d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f4659c700 1 -- 172.21.15.59:0/802542226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb15a2fce0 con 0x55cb15cc7f00 2023-10-08T12:51:12.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f46d9d700 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cd36d0 0x55cb15d36d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:12.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.273+0000 7f8f45d9b700 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:12.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f4659c700 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd90a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8f38096fa0 tx=0x7f8f3800bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f93c4ef3e7dddc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:51:12.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f2dffb700 1 -- 172.21.15.59:0/802542226 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3809a530 con 0x55cb15cc7f00 2023-10-08T12:51:12.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f2dffb700 1 -- 172.21.15.59:0/802542226 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f8f3800cdd0 con 0x55cb15cc7f00 2023-10-08T12:51:12.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f6055ab80 1 -- 172.21.15.59:0/802542226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f3809ac30 con 0x55cb15cc7f00 2023-10-08T12:51:12.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f2dffb700 1 -- 172.21.15.59:0/802542226 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f3800cbd0 con 0x55cb15cc7f00 2023-10-08T12:51:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f6055ab80 10 client.26864 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f6055ab80 1 -- 172.21.15.59:0/802542226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55cb15a45330 con 0x55cb15cc7f00 2023-10-08T12:51:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f2dffb700 1 -- 172.21.15.59:0/802542226 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f3809ac30 con 0x55cb15cc7f00 2023-10-08T12:51:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f2dffb700 1 -- 172.21.15.59:0/802542226 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8f380a2ba0 con 0x55cb15cc7f00 2023-10-08T12:51:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f6055ab80 10 client.26864 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.274+0000 7f8f6055ab80 10 client.26864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.275+0000 7f8f6055ab80 20 client.26864 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.275+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cb15d38760 0x55cb15d3ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.275+0000 7f8f6055ab80 4 client.26864 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:51:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.275+0000 7f8f6055ab80 1 -- 172.21.15.59:0/802542226 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55cb15c14bb0 con 0x55cb15d38760 2023-10-08T12:51:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.275+0000 7f8f45d9b700 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cb15d38760 0x55cb15d3ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.275+0000 7f8f45d9b700 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cb15d38760 0x55cb15d3ab50 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7f1f5c3dcb6ce78 server_cookie=d3359b37fbefef53 in_seq=0 out_seq=0 2023-10-08T12:51:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.275+0000 7f8f2dffb700 10 client.26864 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.276+0000 7f8f2dffb700 1 -- 172.21.15.59:0/802542226 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55cb15c14bb0 con 0x55cb15d38760 2023-10-08T12:51:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.276+0000 7f8f2dffb700 10 client.26864 handle_command_reply: tid=0 2023-10-08T12:51:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.276+0000 7f8f6055ab80 1 client.26864 shutdown 2023-10-08T12:51:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.276+0000 7f8f6055ab80 1 -- 172.21.15.59:0/802542226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 msgr2=0x55cb15cd90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.276+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd90a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8f38096fa0 tx=0x7f8f3800bf60 comp rx=0 tx=0).stop 2023-10-08T12:51:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.277+0000 7f8f6055ab80 1 -- 172.21.15.59:0/802542226 shutdown_connections 2023-10-08T12:51:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.277+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cb15d38760 0x55cb15d3ab50 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.277+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb15cc7f00 0x55cb15cd90a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.277+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb15cd36d0 0x55cb15d36d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.277+0000 7f8f6055ab80 1 --2- 172.21.15.59:0/802542226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb15cc8820 0x55cb15cd95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.277+0000 7f8f6055ab80 1 -- 172.21.15.59:0/802542226 >> 172.21.15.59:0/802542226 conn(0x55cb15c3d2e0 msgr2=0x55cb15cc9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.277+0000 7f8f2dffb700 0 client.26864 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.277+0000 7f8f6055ab80 1 -- 172.21.15.59:0/802542226 shutdown_connections 2023-10-08T12:51:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.277+0000 7f8f6055ab80 1 -- 172.21.15.59:0/802542226 wait complete. 2023-10-08T12:51:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.277+0000 7f8f6055ab80 20 client.26864 trim_cache size 0 max 16384 2023-10-08T12:51:12.283 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:51:12.283 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:51:12.283 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "b5f15b72-dab8-45c5-977c-fe3d07ca9fec", 2023-10-08T12:51:12.284 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:51:12.284 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:51:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.278+0000 7f8f4cbff700 1 -- 172.21.15.59:0/3136263377 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f300a1670 msgr2=0x7f8f300a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.278+0000 7f8f4cbff700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f300a1670 0x7f8f300a3b30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8f4819a2d0 tx=0x7f8f3c009260 comp rx=0 tx=0).stop 2023-10-08T12:51:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.278+0000 7f8f4cbff700 1 -- 172.21.15.59:0/3136263377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48100730 msgr2=0x7f8f4819eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.278+0000 7f8f4cbff700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48100730 0x7f8f4819eac0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800eb30 tx=0x7f8f3800ee40 comp rx=0 tx=0).stop 2023-10-08T12:51:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.278+0000 7f8f4cbff700 1 -- 172.21.15.59:0/3136263377 shutdown_connections 2023-10-08T12:51:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.278+0000 7f8f4cbff700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8f300a1670 0x7f8f300a3b30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.278+0000 7f8f4cbff700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f48106740 0x7f8f48198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.278+0000 7f8f4cbff700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48100730 0x7f8f4819eac0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.278+0000 7f8f4cbff700 1 --2- 172.21.15.59:0/3136263377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f481010f0 0x7f8f4819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.278+0000 7f8f4cbff700 1 -- 172.21.15.59:0/3136263377 >> 172.21.15.59:0/3136263377 conn(0x7f8f480fc200 msgr2=0x7f8f4810ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.279+0000 7f8f4cbff700 1 -- 172.21.15.59:0/3136263377 shutdown_connections 2023-10-08T12:51:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.279+0000 7f8f4cbff700 1 -- 172.21.15.59:0/3136263377 wait complete. 2023-10-08T12:51:12.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:51:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:11 smithi092 ceph-mon[134093]: pgmap v621: 97 pgs: 97 active+clean; 592 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.0 MiB/s wr, 284 op/s 2023-10-08T12:51:12.536 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1271759 12.77 MB/sec execute 403 sec latency 57.407 ms 2023-10-08T12:51:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.548+0000 7f18dedff700 1 -- 172.21.15.59:0/1025621868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18d810cf70 msgr2=0x7f18d810f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.548+0000 7f18dedff700 1 --2- 172.21.15.59:0/1025621868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18d810cf70 0x7f18d810f3e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009f90 tx=0x7f18d000b330 comp rx=0 tx=0).stop 2023-10-08T12:51:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.548+0000 7f18dedff700 1 -- 172.21.15.59:0/1025621868 shutdown_connections 2023-10-08T12:51:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.548+0000 7f18dedff700 1 --2- 172.21.15.59:0/1025621868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18d810cf70 0x7f18d810f3e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.548+0000 7f18dedff700 1 --2- 172.21.15.59:0/1025621868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d8072c20 0x7f18d8073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.548+0000 7f18dedff700 1 --2- 172.21.15.59:0/1025621868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d8073540 0x7f18d810ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.548+0000 7f18dedff700 1 -- 172.21.15.59:0/1025621868 >> 172.21.15.59:0/1025621868 conn(0x7f18d80fc200 msgr2=0x7f18d80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.548+0000 7f18dedff700 1 -- 172.21.15.59:0/1025621868 shutdown_connections 2023-10-08T12:51:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.548+0000 7f18dedff700 1 -- 172.21.15.59:0/1025621868 wait complete. 2023-10-08T12:51:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.549+0000 7f18dedff700 1 Processor -- start 2023-10-08T12:51:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.549+0000 7f18dedff700 1 -- start start 2023-10-08T12:51:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.549+0000 7f18dedff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d8072c20 0x7f18d8198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.549+0000 7f18dedff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d8073540 0x7f18d8199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.549+0000 7f18dedff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18d810cf70 0x7f18d819d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.549+0000 7f18dedff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d819df00 con 0x7f18d8072c20 2023-10-08T12:51:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.549+0000 7f18dedff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d819e070 con 0x7f18d810cf70 2023-10-08T12:51:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.549+0000 7f18dedff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d819e230 con 0x7f18d8073540 2023-10-08T12:51:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18dcb9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d8072c20 0x7f18d8198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18dd39c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18d810cf70 0x7f18d819d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18dd39c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18d810cf70 0x7f18d819d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57872/0 (socket says 172.21.15.59:57872) 2023-10-08T12:51:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18dd39c700 1 -- 172.21.15.59:0/3144686197 learned_addr learned my addr 172.21.15.59:0/3144686197 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18cffff700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d8073540 0x7f18d8199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18dcb9b700 1 -- 172.21.15.59:0/3144686197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d8073540 msgr2=0x7f18d8199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d8073540 0x7f18d8199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18dcb9b700 1 -- 172.21.15.59:0/3144686197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18d810cf70 msgr2=0x7f18d819d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18d810cf70 0x7f18d819d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18dcb9b700 1 -- 172.21.15.59:0/3144686197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0009c40 con 0x7f18d8072c20 2023-10-08T12:51:12.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18cffff700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d8073540 0x7f18d8199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:51:12.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.550+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d8072c20 0x7f18d8198fe0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f18d400e9c0 tx=0x7f18d400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.551+0000 7f18cdffb700 1 -- 172.21.15.59:0/3144686197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d400c9c0 con 0x7f18d8072c20 2023-10-08T12:51:12.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.551+0000 7f18dedff700 1 -- 172.21.15.59:0/3144686197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d819e510 con 0x7f18d8072c20 2023-10-08T12:51:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.551+0000 7f18cdffb700 1 -- 172.21.15.59:0/3144686197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18d4010430 con 0x7f18d8072c20 2023-10-08T12:51:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.551+0000 7f18cdffb700 1 -- 172.21.15.59:0/3144686197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4018680 con 0x7f18d8072c20 2023-10-08T12:51:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.551+0000 7f18dedff700 1 -- 172.21.15.59:0/3144686197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d81a5d50 con 0x7f18d8072c20 2023-10-08T12:51:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.554+0000 7f18cdffb700 1 -- 172.21.15.59:0/3144686197 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f18d4010860 con 0x7f18d8072c20 2023-10-08T12:51:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.555+0000 7f18f2703b80 1 Processor -- start 2023-10-08T12:51:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18f2703b80 1 -- start start 2023-10-08T12:51:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18cdffb700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f18c00a15f0 0x7f18c00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afd7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 0x559d3afe2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afe2650 0x559d3afe4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18f2703b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3af40460 con 0x559d3afd77a0 2023-10-08T12:51:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18f2703b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3af31c20 con 0x559d3afe2650 2023-10-08T12:51:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18f2703b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3af2f540 con 0x559d3afd6e80 2023-10-08T12:51:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18cdffb700 1 -- 172.21.15.59:0/3144686197 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f18d4014070 con 0x7f18d8072c20 2023-10-08T12:51:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18dd39c700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f18c00a15f0 0x7f18c00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18dcb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afd7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18dcb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afd7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51212/0 (socket says 172.21.15.59:51212) 2023-10-08T12:51:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18dcb9b700 1 -- 172.21.15.59:0/446001991 learned_addr learned my addr 172.21.15.59:0/446001991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18dd39c700 1 --2- 172.21.15.59:0/446001991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afe2650 0x559d3afe4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.556+0000 7f18cffff700 1 --2- 172.21.15.59:0/446001991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 0x559d3afe2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.557+0000 7f18dcb9b700 1 -- 172.21.15.59:0/446001991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afe2650 msgr2=0x559d3afe4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.557+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/446001991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afe2650 0x559d3afe4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.557+0000 7f18dcb9b700 1 -- 172.21.15.59:0/446001991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 msgr2=0x559d3afe2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.557+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/446001991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 0x559d3afe2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.557+0000 7f18dcb9b700 1 -- 172.21.15.59:0/446001991 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d3ad55de0 con 0x559d3afd6e80 2023-10-08T12:51:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.558+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/446001991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afd7260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f18d400c5b0 tx=0x7f18d4099db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1577e09e8cbfdee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.562+0000 7f18beffd700 1 -- 172.21.15.59:0/446001991 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40071c0 con 0x559d3afd6e80 2023-10-08T12:51:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.562+0000 7f18beffd700 1 -- 172.21.15.59:0/446001991 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18d401c1c0 con 0x559d3afd6e80 2023-10-08T12:51:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.562+0000 7f18beffd700 1 -- 172.21.15.59:0/446001991 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d409e2f0 con 0x559d3afd6e80 2023-10-08T12:51:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.562+0000 7f18dd39c700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f18c00a15f0 0x7f18c00a3ab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009730 tx=0x7f18d00096c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.565+0000 7f18f2703b80 1 -- 172.21.15.59:0/446001991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 msgr2=0x559d3afd7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.565+0000 7f18f2703b80 1 --2- 172.21.15.59:0/446001991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afd7260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f18d400c5b0 tx=0x7f18d4099db0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.567+0000 7f18f2703b80 1 -- 172.21.15.59:0/446001991 shutdown_connections 2023-10-08T12:51:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.567+0000 7f18f2703b80 1 --2- 172.21.15.59:0/446001991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afe2650 0x559d3afe4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.567+0000 7f18f2703b80 1 --2- 172.21.15.59:0/446001991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afd7260 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.567+0000 7f18f2703b80 1 --2- 172.21.15.59:0/446001991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 0x559d3afe2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.567+0000 7f18f2703b80 1 -- 172.21.15.59:0/446001991 >> 172.21.15.59:0/446001991 conn(0x559d3af4c260 msgr2=0x559d3afd32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.567+0000 7f18f2703b80 1 -- 172.21.15.59:0/446001991 shutdown_connections 2023-10-08T12:51:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.568+0000 7f18f2703b80 1 -- 172.21.15.59:0/446001991 wait complete. 2023-10-08T12:51:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.568+0000 7f18f2703b80 1 -- start start 2023-10-08T12:51:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.569+0000 7f18f2703b80 1 Processor -- start 2023-10-08T12:51:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.570+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd6e80 0x559d3afe2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.570+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afdf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.570+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afe2650 0x559d3afdf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.570+0000 7f18f2703b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3af2ae30 con 0x559d3afd6e80 2023-10-08T12:51:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.570+0000 7f18f2703b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3aec7710 con 0x559d3afd77a0 2023-10-08T12:51:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.570+0000 7f18f2703b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3aec73b0 con 0x559d3afe2650 2023-10-08T12:51:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.570+0000 7f18f2703b80 10 client.0 _ll_register_callbacks cb 0x559d3ad24800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.571+0000 7f18cffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afdf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.571+0000 7f18cffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afdf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57886/0 (socket says 172.21.15.59:57886) 2023-10-08T12:51:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.571+0000 7f18cffff700 1 -- 172.21.15.59:0/2762334251 learned_addr learned my addr 172.21.15.59:0/2762334251 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.571+0000 7f18dd39c700 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afe2650 0x559d3afdf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.571+0000 7f18cffff700 1 -- 172.21.15.59:0/2762334251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afe2650 msgr2=0x559d3afdf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.571+0000 7f18cffff700 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afe2650 0x559d3afdf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.571+0000 7f18cffff700 1 -- 172.21.15.59:0/2762334251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd6e80 msgr2=0x559d3afe2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.571+0000 7f18cffff700 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd6e80 0x559d3afe2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.571+0000 7f18cffff700 1 -- 172.21.15.59:0/2762334251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d81a5d50 con 0x559d3afd77a0 2023-10-08T12:51:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.572+0000 7f18cffff700 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afdf350 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f18c8012730 tx=0x7f18c8012a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74e7f23bfc027981 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.572+0000 7f18b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:51:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.573+0000 7f18b7fff700 1 -- 172.21.15.59:0/2762334251 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8009830 con 0x559d3afd77a0 2023-10-08T12:51:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.573+0000 7f18b7fff700 1 -- 172.21.15.59:0/2762334251 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f18c8010750 con 0x559d3afd77a0 2023-10-08T12:51:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.573+0000 7f18f2703b80 1 -- 172.21.15.59:0/2762334251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d3aef2eb0 con 0x559d3afd77a0 2023-10-08T12:51:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.573+0000 7f18b7fff700 1 -- 172.21.15.59:0/2762334251 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18c8010950 con 0x559d3afd77a0 2023-10-08T12:51:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.574+0000 7f18f2703b80 10 client.26876 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.574+0000 7f18f2703b80 1 -- 172.21.15.59:0/2762334251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x559d3ad3ec60 con 0x559d3afd77a0 2023-10-08T12:51:12.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.577+0000 7f18b7fff700 1 -- 172.21.15.59:0/2762334251 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559d3aef2eb0 con 0x559d3afd77a0 2023-10-08T12:51:12.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.577+0000 7f18b7fff700 1 -- 172.21.15.59:0/2762334251 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f18c8024070 con 0x559d3afd77a0 2023-10-08T12:51:12.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.577+0000 7f18f2703b80 10 client.26876 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:12.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.577+0000 7f18f2703b80 10 client.26876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:12.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.577+0000 7f18f2703b80 20 client.26876 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:12.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.577+0000 7f18f2703b80 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d3b0032d0 0x559d3b0056f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.577+0000 7f18f2703b80 4 client.26876 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:51:12.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.577+0000 7f18f2703b80 1 -- 172.21.15.59:0/2762334251 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d3af23e10 con 0x559d3b0032d0 2023-10-08T12:51:12.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.578+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d3b0032d0 0x559d3b0056f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.580+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d3b0032d0 0x559d3b0056f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=316a8ef04ff31902 server_cookie=c4efdaf7aa654c8a in_seq=0 out_seq=0 2023-10-08T12:51:12.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.580+0000 7f18b7fff700 10 client.26876 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:12.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.583+0000 7f18b7fff700 1 -- 172.21.15.59:0/2762334251 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559d3af23e10 con 0x559d3b0032d0 2023-10-08T12:51:12.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.583+0000 7f18b7fff700 10 client.26876 handle_command_reply: tid=0 2023-10-08T12:51:12.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.583+0000 7f18f2703b80 1 client.26876 shutdown 2023-10-08T12:51:12.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.584+0000 7f18f2703b80 1 -- 172.21.15.59:0/2762334251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 msgr2=0x559d3afdf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.584+0000 7f18f2703b80 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afdf350 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f18c8012730 tx=0x7f18c8012a40 comp rx=0 tx=0).stop 2023-10-08T12:51:12.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.585+0000 7f18f2703b80 1 -- 172.21.15.59:0/2762334251 shutdown_connections 2023-10-08T12:51:12.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.585+0000 7f18f2703b80 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d3b0032d0 0x559d3b0056f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.585+0000 7f18f2703b80 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afe2650 0x559d3afdf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.585+0000 7f18f2703b80 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd6e80 0x559d3afe2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.585+0000 7f18f2703b80 1 --2- 172.21.15.59:0/2762334251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afdf350 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.585+0000 7f18f2703b80 1 -- 172.21.15.59:0/2762334251 >> 172.21.15.59:0/2762334251 conn(0x559d3af4c260 msgr2=0x559d3afd2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.585+0000 7f18b7fff700 0 client.26876 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.585+0000 7f18f2703b80 1 -- 172.21.15.59:0/2762334251 shutdown_connections 2023-10-08T12:51:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.586+0000 7f18f2703b80 1 -- 172.21.15.59:0/2762334251 wait complete. 2023-10-08T12:51:12.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.588+0000 7f18f2703b80 20 client.26876 trim_cache size 0 max 16384 2023-10-08T12:51:12.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.616+0000 7f18f2703b80 1 Processor -- start 2023-10-08T12:51:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.616+0000 7f18f2703b80 1 -- start start 2023-10-08T12:51:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.616+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afe9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afda6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afe2650 0x559d3afdabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18f2703b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3adab920 con 0x559d3afe2650 2023-10-08T12:51:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18f2703b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3afd8970 con 0x559d3afd77a0 2023-10-08T12:51:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18f2703b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3afe96d0 con 0x559d3afd6e80 2023-10-08T12:51:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18cffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afda6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18cffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afda6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57896/0 (socket says 172.21.15.59:57896) 2023-10-08T12:51:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18cffff700 1 -- 172.21.15.59:0/437225209 learned_addr learned my addr 172.21.15.59:0/437225209 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/437225209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afe9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18dd39c700 1 --2- 172.21.15.59:0/437225209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afe2650 0x559d3afdabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18cffff700 1 -- 172.21.15.59:0/437225209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 msgr2=0x559d3afe9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18cffff700 1 --2- 172.21.15.59:0/437225209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afe9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18cffff700 1 -- 172.21.15.59:0/437225209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afe2650 msgr2=0x559d3afdabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18cffff700 1 --2- 172.21.15.59:0/437225209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afe2650 0x559d3afdabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.617+0000 7f18cffff700 1 -- 172.21.15.59:0/437225209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d3ad7c250 con 0x559d3afd77a0 2023-10-08T12:51:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.618+0000 7f18cffff700 1 --2- 172.21.15.59:0/437225209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afda6b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f18c8000c00 tx=0x7f18c80059e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b68e797d2d5d1f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.618+0000 7f18bf7fe700 1 -- 172.21.15.59:0/437225209 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8025610 con 0x559d3afd77a0 2023-10-08T12:51:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.618+0000 7f18bf7fe700 1 -- 172.21.15.59:0/437225209 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18c8005570 con 0x559d3afd77a0 2023-10-08T12:51:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.618+0000 7f18bf7fe700 1 -- 172.21.15.59:0/437225209 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c80038e0 con 0x559d3afd77a0 2023-10-08T12:51:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.619+0000 7f18f2703b80 1 -- 172.21.15.59:0/437225209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 msgr2=0x559d3afda6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.619+0000 7f18f2703b80 1 --2- 172.21.15.59:0/437225209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afda6b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f18c8000c00 tx=0x7f18c80059e0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.619+0000 7f18f2703b80 1 -- 172.21.15.59:0/437225209 shutdown_connections 2023-10-08T12:51:12.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.619+0000 7f18f2703b80 1 --2- 172.21.15.59:0/437225209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afe2650 0x559d3afdabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.619+0000 7f18f2703b80 1 --2- 172.21.15.59:0/437225209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afe9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.619+0000 7f18f2703b80 1 --2- 172.21.15.59:0/437225209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afd77a0 0x559d3afda6b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.619+0000 7f18f2703b80 1 -- 172.21.15.59:0/437225209 >> 172.21.15.59:0/437225209 conn(0x559d3af4c260 msgr2=0x559d3afed8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.619+0000 7f18f2703b80 1 -- 172.21.15.59:0/437225209 shutdown_connections 2023-10-08T12:51:12.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.619+0000 7f18f2703b80 1 -- 172.21.15.59:0/437225209 wait complete. 2023-10-08T12:51:12.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.619+0000 7f18f2703b80 1 -- start start 2023-10-08T12:51:12.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.619+0000 7f18f2703b80 1 Processor -- start 2023-10-08T12:51:12.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afdcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 0x559d3afdd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18f2703b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afe2650 0x559d3afdb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18f2703b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3afdbd90 con 0x559d3afd77a0 2023-10-08T12:51:12.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18f2703b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3afdbf00 con 0x559d3afe2650 2023-10-08T12:51:12.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18f2703b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d3afdc0c0 con 0x559d3afd6e80 2023-10-08T12:51:12.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18f2703b80 10 client.0 _ll_register_callbacks cb 0x7f18c8009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:12.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 0x559d3afdd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18dcb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afdcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 0x559d3afdd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50592/0 (socket says 172.21.15.59:50592) 2023-10-08T12:51:12.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18cffff700 1 -- 172.21.15.59:0/1398913316 learned_addr learned my addr 172.21.15.59:0/1398913316 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:12.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.620+0000 7f18dd39c700 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afe2650 0x559d3afdb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.621+0000 7f18dcb9b700 1 -- 172.21.15.59:0/1398913316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afe2650 msgr2=0x559d3afdb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.621+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afe2650 0x559d3afdb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.621+0000 7f18dcb9b700 1 -- 172.21.15.59:0/1398913316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 msgr2=0x559d3afdd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.621+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 0x559d3afdd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.621+0000 7f18dcb9b700 1 -- 172.21.15.59:0/1398913316 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d3ad3ec60 con 0x559d3afd6e80 2023-10-08T12:51:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.621+0000 7f18cffff700 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 0x559d3afdd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.621+0000 7f18dcb9b700 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afdcac0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x559d3afd7cf0 tx=0x7f18d401c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7744860e8a947ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.621+0000 7f18b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:51:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.621+0000 7f18b7fff700 1 -- 172.21.15.59:0/1398913316 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40a2530 con 0x559d3afd6e80 2023-10-08T12:51:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.621+0000 7f18b7fff700 1 -- 172.21.15.59:0/1398913316 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f18d409e2f0 con 0x559d3afd6e80 2023-10-08T12:51:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.621+0000 7f18f2703b80 1 -- 172.21.15.59:0/1398913316 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18d401c1c0 con 0x559d3afd6e80 2023-10-08T12:51:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18b7fff700 1 -- 172.21.15.59:0/1398913316 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18d409a1a0 con 0x559d3afd6e80 2023-10-08T12:51:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18f2703b80 10 client.26872 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18f2703b80 1 -- 172.21.15.59:0/1398913316 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x559d3ad542b0 con 0x559d3afd6e80 2023-10-08T12:51:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18b7fff700 1 -- 172.21.15.59:0/1398913316 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18d401c1c0 con 0x559d3afd6e80 2023-10-08T12:51:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18b7fff700 1 -- 172.21.15.59:0/1398913316 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f18d401c5a0 con 0x559d3afd6e80 2023-10-08T12:51:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18f2703b80 10 client.26872 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18f2703b80 10 client.26872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18f2703b80 20 client.26872 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18f2703b80 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d3b060a10 0x559d3b062e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18f2703b80 4 client.26872 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:51:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18f2703b80 1 -- 172.21.15.59:0/1398913316 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559d3af23b30 con 0x559d3b060a10 2023-10-08T12:51:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.622+0000 7f18cffff700 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d3b060a10 0x559d3b062e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18cffff700 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d3b060a10 0x559d3b062e30 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dc925730a5054b0 server_cookie=e5c0431b4bedf49b in_seq=0 out_seq=0 2023-10-08T12:51:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18b7fff700 10 client.26872 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18b7fff700 1 -- 172.21.15.59:0/1398913316 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559d3af23b30 con 0x559d3b060a10 2023-10-08T12:51:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18b7fff700 10 client.26872 handle_command_reply: tid=0 2023-10-08T12:51:12.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18f2703b80 1 client.26872 shutdown 2023-10-08T12:51:12.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18f2703b80 1 -- 172.21.15.59:0/1398913316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 msgr2=0x559d3afdcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18f2703b80 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afdcac0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x559d3afd7cf0 tx=0x7f18d401c500 comp rx=0 tx=0).stop 2023-10-08T12:51:12.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18f2703b80 1 -- 172.21.15.59:0/1398913316 shutdown_connections 2023-10-08T12:51:12.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18f2703b80 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559d3b060a10 0x559d3b062e30 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18f2703b80 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d3afe2650 0x559d3afdb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18f2703b80 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559d3afd6e80 0x559d3afdcac0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18b7fff700 0 client.26872 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:12.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18f2703b80 1 --2- 172.21.15.59:0/1398913316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d3afd77a0 0x559d3afdd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.623+0000 7f18f2703b80 1 -- 172.21.15.59:0/1398913316 >> 172.21.15.59:0/1398913316 conn(0x559d3af4c260 msgr2=0x559d3afda6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.624+0000 7f18f2703b80 1 -- 172.21.15.59:0/1398913316 shutdown_connections 2023-10-08T12:51:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.624+0000 7f18f2703b80 1 -- 172.21.15.59:0/1398913316 wait complete. 2023-10-08T12:51:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.624+0000 7f18f2703b80 20 client.26872 trim_cache size 0 max 16384 2023-10-08T12:51:12.632 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:51:12.632 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:51:12.632 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:51:12.633 INFO:teuthology.orchestra.run.smithi059.stdout: "b5f15b72-dab8-45c5-977c-fe3d07ca9fec": { 2023-10-08T12:51:12.633 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:51:12.633 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "b5f15b72-dab8-45c5-977c-fe3d07ca9fec", 2023-10-08T12:51:12.633 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:51:12.633 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:51:12.633 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:51:12.633 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:51:12.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.624+0000 7f18dedff700 1 -- 172.21.15.59:0/3144686197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f18c00a15f0 msgr2=0x7f18c00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.624+0000 7f18dedff700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f18c00a15f0 0x7f18c00a3ab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009730 tx=0x7f18d00096c0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.624+0000 7f18dedff700 1 -- 172.21.15.59:0/3144686197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d8072c20 msgr2=0x7f18d8198fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:12.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.624+0000 7f18dedff700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d8072c20 0x7f18d8198fe0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f18d400e9c0 tx=0x7f18d400ecd0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.625+0000 7f18dedff700 1 -- 172.21.15.59:0/3144686197 shutdown_connections 2023-10-08T12:51:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.625+0000 7f18dedff700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f18c00a15f0 0x7f18c00a3ab0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.625+0000 7f18dedff700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18d810cf70 0x7f18d819d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.625+0000 7f18dedff700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d8072c20 0x7f18d8198fe0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.625+0000 7f18dedff700 1 --2- 172.21.15.59:0/3144686197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d8073540 0x7f18d8199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.625+0000 7f18dedff700 1 -- 172.21.15.59:0/3144686197 >> 172.21.15.59:0/3144686197 conn(0x7f18d80fc200 msgr2=0x7f18d80fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.625+0000 7f18dedff700 1 -- 172.21.15.59:0/3144686197 shutdown_connections 2023-10-08T12:51:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:12.625+0000 7f18dedff700 1 -- 172.21.15.59:0/3144686197 wait complete. 2023-10-08T12:51:12.645 INFO:tasks.cephfs.filesystem:scrub status for tag:b5f15b72-dab8-45c5-977c-fe3d07ca9fec - {'path': '/', 'tag': 'b5f15b72-dab8-45c5-977c-fe3d07ca9fec', 'options': 'recursive,force'} 2023-10-08T12:51:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:12 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:51:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:12 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:12 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:51:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:12 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:13.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:12 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:51:13.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:12 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:51:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:12 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:12 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:51:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:12 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:12 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:51:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:12 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:51:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:12 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:12 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:51:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:12 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:12 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:51:13.536 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1273681 12.76 MB/sec execute 404 sec latency 52.298 ms 2023-10-08T12:51:14.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:13 smithi173 ceph-mon[135182]: pgmap v622: 97 pgs: 97 active+clean; 564 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 221 op/s 2023-10-08T12:51:14.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:13 smithi173 ceph-mon[135182]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T12:51:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:13 smithi059 ceph-mon[98489]: pgmap v622: 97 pgs: 97 active+clean; 564 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 221 op/s 2023-10-08T12:51:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:13 smithi059 ceph-mon[98489]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T12:51:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:13 smithi092 ceph-mon[134093]: pgmap v622: 97 pgs: 97 active+clean; 564 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 221 op/s 2023-10-08T12:51:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:13 smithi092 ceph-mon[134093]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T12:51:14.536 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1275916 12.76 MB/sec execute 405 sec latency 11.575 ms 2023-10-08T12:51:15.536 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1278728 12.77 MB/sec execute 406 sec latency 12.524 ms 2023-10-08T12:51:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:16 smithi059 ceph-mon[98489]: pgmap v624: 97 pgs: 97 active+clean; 565 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 210 op/s 2023-10-08T12:51:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:16 smithi092 ceph-mon[134093]: pgmap v624: 97 pgs: 97 active+clean; 565 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 210 op/s 2023-10-08T12:51:16.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:16 smithi173 ceph-mon[135182]: pgmap v624: 97 pgs: 97 active+clean; 565 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 210 op/s 2023-10-08T12:51:16.538 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1280679 12.76 MB/sec execute 407 sec latency 18.438 ms 2023-10-08T12:51:17.540 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1282765 12.76 MB/sec execute 408 sec latency 41.695 ms 2023-10-08T12:51:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:18 smithi092 ceph-mon[134093]: pgmap v625: 97 pgs: 97 active+clean; 576 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 216 op/s 2023-10-08T12:51:18.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:18 smithi173 ceph-mon[135182]: pgmap v625: 97 pgs: 97 active+clean; 576 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 216 op/s 2023-10-08T12:51:18.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:18 smithi059 ceph-mon[98489]: pgmap v625: 97 pgs: 97 active+clean; 576 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 216 op/s 2023-10-08T12:51:18.540 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1285014 12.76 MB/sec execute 409 sec latency 83.312 ms 2023-10-08T12:51:19.540 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1287024 12.76 MB/sec execute 410 sec latency 25.963 ms 2023-10-08T12:51:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:19 smithi173 ceph-mon[135182]: pgmap v626: 97 pgs: 97 active+clean; 579 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.0 MiB/s wr, 237 op/s 2023-10-08T12:51:20.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:19 smithi059 ceph-mon[98489]: pgmap v626: 97 pgs: 97 active+clean; 579 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.0 MiB/s wr, 237 op/s 2023-10-08T12:51:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:19 smithi092 ceph-mon[134093]: pgmap v626: 97 pgs: 97 active+clean; 579 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.0 MiB/s wr, 237 op/s 2023-10-08T12:51:20.540 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1289504 12.76 MB/sec execute 411 sec latency 26.393 ms 2023-10-08T12:51:21.540 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1291678 12.75 MB/sec execute 412 sec latency 18.082 ms 2023-10-08T12:51:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:22 smithi092 ceph-mon[134093]: pgmap v627: 97 pgs: 97 active+clean; 587 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.8 MiB/s wr, 228 op/s 2023-10-08T12:51:22.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:22 smithi173 ceph-mon[135182]: pgmap v627: 97 pgs: 97 active+clean; 587 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.8 MiB/s wr, 228 op/s 2023-10-08T12:51:22.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:22 smithi059 ceph-mon[98489]: pgmap v627: 97 pgs: 97 active+clean; 587 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.8 MiB/s wr, 228 op/s 2023-10-08T12:51:22.540 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1293924 12.75 MB/sec execute 413 sec latency 16.312 ms 2023-10-08T12:51:23.540 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1296490 12.76 MB/sec execute 414 sec latency 103.427 ms 2023-10-08T12:51:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:24 smithi092 ceph-mon[134093]: pgmap v628: 97 pgs: 97 active+clean; 594 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 262 op/s 2023-10-08T12:51:24.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:24 smithi173 ceph-mon[135182]: pgmap v628: 97 pgs: 97 active+clean; 594 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 262 op/s 2023-10-08T12:51:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:24 smithi059 ceph-mon[98489]: pgmap v628: 97 pgs: 97 active+clean; 594 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 262 op/s 2023-10-08T12:51:24.540 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1298167 12.74 MB/sec execute 415 sec latency 28.520 ms 2023-10-08T12:51:25.540 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1300509 12.74 MB/sec execute 416 sec latency 17.730 ms 2023-10-08T12:51:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:26 smithi092 ceph-mon[134093]: pgmap v629: 97 pgs: 97 active+clean; 594 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 246 op/s 2023-10-08T12:51:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:26 smithi173 ceph-mon[135182]: pgmap v629: 97 pgs: 97 active+clean; 594 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 246 op/s 2023-10-08T12:51:26.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:26 smithi059 ceph-mon[98489]: pgmap v629: 97 pgs: 97 active+clean; 594 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 246 op/s 2023-10-08T12:51:26.540 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1302990 12.74 MB/sec execute 417 sec latency 17.680 ms 2023-10-08T12:51:27.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1304894 12.74 MB/sec execute 418 sec latency 12.374 ms 2023-10-08T12:51:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:28 smithi092 ceph-mon[134093]: pgmap v630: 97 pgs: 97 active+clean; 598 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.0 MiB/s wr, 255 op/s 2023-10-08T12:51:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:28 smithi173 ceph-mon[135182]: pgmap v630: 97 pgs: 97 active+clean; 598 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.0 MiB/s wr, 255 op/s 2023-10-08T12:51:28.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:28 smithi059 ceph-mon[98489]: pgmap v630: 97 pgs: 97 active+clean; 598 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.0 MiB/s wr, 255 op/s 2023-10-08T12:51:28.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1307194 12.74 MB/sec execute 419 sec latency 118.282 ms 2023-10-08T12:51:29.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1309304 12.73 MB/sec execute 420 sec latency 16.669 ms 2023-10-08T12:51:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:29 smithi173 ceph-mon[135182]: pgmap v631: 97 pgs: 97 active+clean; 600 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 211 op/s 2023-10-08T12:51:30.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:29 smithi059 ceph-mon[98489]: pgmap v631: 97 pgs: 97 active+clean; 600 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 211 op/s 2023-10-08T12:51:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:29 smithi092 ceph-mon[134093]: pgmap v631: 97 pgs: 97 active+clean; 600 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 211 op/s 2023-10-08T12:51:30.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1310763 12.73 MB/sec execute 421 sec latency 367.591 ms 2023-10-08T12:51:31.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1312857 12.71 MB/sec execute 422 sec latency 17.699 ms 2023-10-08T12:51:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:32 smithi092 ceph-mon[134093]: pgmap v632: 97 pgs: 97 active+clean; 608 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 231 op/s 2023-10-08T12:51:32.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:32 smithi173 ceph-mon[135182]: pgmap v632: 97 pgs: 97 active+clean; 608 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 231 op/s 2023-10-08T12:51:32.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:32 smithi059 ceph-mon[98489]: pgmap v632: 97 pgs: 97 active+clean; 608 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 231 op/s 2023-10-08T12:51:32.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1314921 12.71 MB/sec execute 423 sec latency 13.241 ms 2023-10-08T12:51:33.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1317164 12.71 MB/sec execute 424 sec latency 101.171 ms 2023-10-08T12:51:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:34 smithi092 ceph-mon[134093]: pgmap v633: 97 pgs: 97 active+clean; 609 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 211 op/s 2023-10-08T12:51:34.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:34 smithi173 ceph-mon[135182]: pgmap v633: 97 pgs: 97 active+clean; 609 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 211 op/s 2023-10-08T12:51:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:34 smithi059 ceph-mon[98489]: pgmap v633: 97 pgs: 97 active+clean; 609 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 211 op/s 2023-10-08T12:51:34.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1318981 12.71 MB/sec execute 425 sec latency 75.621 ms 2023-10-08T12:51:35.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1321351 12.71 MB/sec execute 426 sec latency 80.898 ms 2023-10-08T12:51:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:36 smithi092 ceph-mon[134093]: pgmap v634: 97 pgs: 97 active+clean; 613 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 194 op/s 2023-10-08T12:51:36.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:36 smithi173 ceph-mon[135182]: pgmap v634: 97 pgs: 97 active+clean; 613 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 194 op/s 2023-10-08T12:51:36.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:36 smithi059 ceph-mon[98489]: pgmap v634: 97 pgs: 97 active+clean; 613 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 194 op/s 2023-10-08T12:51:36.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1323348 12.70 MB/sec execute 427 sec latency 42.918 ms 2023-10-08T12:51:37.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1325550 12.70 MB/sec execute 428 sec latency 14.166 ms 2023-10-08T12:51:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:38 smithi092 ceph-mon[134093]: pgmap v635: 97 pgs: 97 active+clean; 618 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.4 MiB/s wr, 209 op/s 2023-10-08T12:51:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:38 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:51:38.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:38 smithi173 ceph-mon[135182]: pgmap v635: 97 pgs: 97 active+clean; 618 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.4 MiB/s wr, 209 op/s 2023-10-08T12:51:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:38 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:51:38.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:38 smithi059 ceph-mon[98489]: pgmap v635: 97 pgs: 97 active+clean; 618 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.4 MiB/s wr, 209 op/s 2023-10-08T12:51:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:38 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:51:38.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1327630 12.70 MB/sec execute 429 sec latency 44.757 ms 2023-10-08T12:51:39.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1329397 12.69 MB/sec execute 430 sec latency 24.982 ms 2023-10-08T12:51:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:39 smithi173 ceph-mon[135182]: pgmap v636: 97 pgs: 97 active+clean; 622 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.0 MiB/s wr, 236 op/s 2023-10-08T12:51:40.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:39 smithi059 ceph-mon[98489]: pgmap v636: 97 pgs: 97 active+clean; 622 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.0 MiB/s wr, 236 op/s 2023-10-08T12:51:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:39 smithi092 ceph-mon[134093]: pgmap v636: 97 pgs: 97 active+clean; 622 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.0 MiB/s wr, 236 op/s 2023-10-08T12:51:40.541 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1331966 12.70 MB/sec execute 431 sec latency 26.748 ms 2023-10-08T12:51:41.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1333869 12.68 MB/sec execute 432 sec latency 19.081 ms 2023-10-08T12:51:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:41 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:41 smithi173 ceph-mon[135182]: pgmap v637: 97 pgs: 97 active+clean; 606 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 231 op/s 2023-10-08T12:51:42.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:42.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:41 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:42.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:41 smithi059 ceph-mon[98489]: pgmap v637: 97 pgs: 97 active+clean; 606 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 231 op/s 2023-10-08T12:51:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:41 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:42.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:41 smithi092 ceph-mon[134093]: pgmap v637: 97 pgs: 97 active+clean; 606 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 231 op/s 2023-10-08T12:51:42.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1336009 12.69 MB/sec execute 433 sec latency 23.584 ms 2023-10-08T12:51:42.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:51:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.866+0000 7f40439ff700 1 -- 172.21.15.59:0/456669976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f403c106750 msgr2=0x7f403c106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.866+0000 7f40439ff700 1 --2- 172.21.15.59:0/456669976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f403c106750 0x7f403c106b30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4038009990 tx=0x7f4038009ca0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.866+0000 7f40439ff700 1 -- 172.21.15.59:0/456669976 shutdown_connections 2023-10-08T12:51:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.866+0000 7f40439ff700 1 --2- 172.21.15.59:0/456669976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f403c106750 0x7f403c106b30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.866+0000 7f40439ff700 1 --2- 172.21.15.59:0/456669976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403c101100 0x7f403c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.866+0000 7f40439ff700 1 --2- 172.21.15.59:0/456669976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f403c100740 0x7f403c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.866+0000 7f40439ff700 1 -- 172.21.15.59:0/456669976 >> 172.21.15.59:0/456669976 conn(0x7f403c0fc230 msgr2=0x7f403c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.866+0000 7f40439ff700 1 -- 172.21.15.59:0/456669976 shutdown_connections 2023-10-08T12:51:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.866+0000 7f40439ff700 1 -- 172.21.15.59:0/456669976 wait complete. 2023-10-08T12:51:42.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.867+0000 7f40439ff700 1 Processor -- start 2023-10-08T12:51:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f40439ff700 1 -- start start 2023-10-08T12:51:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f40439ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f403c100740 0x7f403c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f40439ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403c101100 0x7f403c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f40439ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f403c106750 0x7f403c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f40439ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c19dcb0 con 0x7f403c106750 2023-10-08T12:51:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f40439ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c19de20 con 0x7f403c100740 2023-10-08T12:51:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f40439ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c19dfe0 con 0x7f403c101100 2023-10-08T12:51:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f404179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f403c100740 0x7f403c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f404179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f403c100740 0x7f403c198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58448/0 (socket says 172.21.15.59:58448) 2023-10-08T12:51:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f404179b700 1 -- 172.21.15.59:0/3953662246 learned_addr learned my addr 172.21.15.59:0/3953662246 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f4040f9a700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403c101100 0x7f403c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.868+0000 7f4041f9c700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f403c106750 0x7f403c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f404179b700 1 -- 172.21.15.59:0/3953662246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403c101100 msgr2=0x7f403c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f404179b700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403c101100 0x7f403c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f404179b700 1 -- 172.21.15.59:0/3953662246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f403c106750 msgr2=0x7f403c19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f404179b700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f403c106750 0x7f403c19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f404179b700 1 -- 172.21.15.59:0/3953662246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40380095f0 con 0x7f403c100740 2023-10-08T12:51:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f4041f9c700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f403c106750 0x7f403c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:51:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f404179b700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f403c100740 0x7f403c198d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4038005740 tx=0x7f4038005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f40327fc700 1 -- 172.21.15.59:0/3953662246 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403801d070 con 0x7f403c100740 2023-10-08T12:51:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f40327fc700 1 -- 172.21.15.59:0/3953662246 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4038022470 con 0x7f403c100740 2023-10-08T12:51:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f40327fc700 1 -- 172.21.15.59:0/3953662246 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4038017650 con 0x7f403c100740 2023-10-08T12:51:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f40439ff700 1 -- 172.21.15.59:0/3953662246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c19e260 con 0x7f403c100740 2023-10-08T12:51:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.869+0000 7f40439ff700 1 -- 172.21.15.59:0/3953662246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403c1a5b00 con 0x7f403c100740 2023-10-08T12:51:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.873+0000 7f40327fc700 1 -- 172.21.15.59:0/3953662246 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f40380225e0 con 0x7f403c100740 2023-10-08T12:51:42.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.874+0000 7f405727bb80 1 Processor -- start 2023-10-08T12:51:42.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f405727bb80 1 -- start start 2023-10-08T12:51:42.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f405727bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f08260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f405727bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 0x5607b9f13110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f40327fc700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40280a15f0 0x7f40280a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f405727bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f13650 0x5607b9f15a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f405727bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9e71460 con 0x5607b9f13650 2023-10-08T12:51:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f405727bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9e62c20 con 0x5607b9f07e80 2023-10-08T12:51:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f405727bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9e60540 con 0x5607b9f087a0 2023-10-08T12:51:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f40327fc700 1 -- 172.21.15.59:0/3953662246 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f40380ce4b0 con 0x7f403c100740 2023-10-08T12:51:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f4041f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f08260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f4040f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 0x5607b9f13110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f4041f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f08260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58454/0 (socket says 172.21.15.59:58454) 2023-10-08T12:51:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.875+0000 7f4041f9c700 1 -- 172.21.15.59:0/3508047828 learned_addr learned my addr 172.21.15.59:0/3508047828 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.876+0000 7f4041f9c700 1 --2- 172.21.15.59:0/3508047828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f13650 0x5607b9f15a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.876+0000 7f404179b700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40280a15f0 0x7f40280a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.876+0000 7f4040f9a700 1 -- 172.21.15.59:0/3508047828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 msgr2=0x5607b9f08260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.876+0000 7f4040f9a700 1 --2- 172.21.15.59:0/3508047828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f08260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.876+0000 7f4040f9a700 1 -- 172.21.15.59:0/3508047828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f13650 msgr2=0x5607b9f15a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.876+0000 7f4040f9a700 1 --2- 172.21.15.59:0/3508047828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f13650 0x5607b9f15a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.876+0000 7f4040f9a700 1 -- 172.21.15.59:0/3508047828 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607b9c86de0 con 0x5607b9f087a0 2023-10-08T12:51:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.876+0000 7f4040f9a700 1 --2- 172.21.15.59:0/3508047828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 0x5607b9f13110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f402c009cb0 tx=0x7f402c011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d239acff4836287c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.876+0000 7f404179b700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40280a15f0 0x7f40280a3ab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f40380a3400 tx=0x7f4038009ca0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.877+0000 7f40277fe700 1 -- 172.21.15.59:0/3508047828 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c011d20 con 0x5607b9f087a0 2023-10-08T12:51:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.877+0000 7f40277fe700 1 -- 172.21.15.59:0/3508047828 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f402c011e80 con 0x5607b9f087a0 2023-10-08T12:51:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.877+0000 7f40277fe700 1 -- 172.21.15.59:0/3508047828 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c005280 con 0x5607b9f087a0 2023-10-08T12:51:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.877+0000 7f405727bb80 1 -- 172.21.15.59:0/3508047828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 msgr2=0x5607b9f13110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.877+0000 7f405727bb80 1 --2- 172.21.15.59:0/3508047828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 0x5607b9f13110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f402c009cb0 tx=0x7f402c011440 comp rx=0 tx=0).stop 2023-10-08T12:51:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.877+0000 7f405727bb80 1 -- 172.21.15.59:0/3508047828 shutdown_connections 2023-10-08T12:51:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.877+0000 7f405727bb80 1 --2- 172.21.15.59:0/3508047828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f08260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.877+0000 7f405727bb80 1 --2- 172.21.15.59:0/3508047828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f13650 0x5607b9f15a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.877+0000 7f405727bb80 1 --2- 172.21.15.59:0/3508047828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 0x5607b9f13110 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.877+0000 7f405727bb80 1 -- 172.21.15.59:0/3508047828 >> 172.21.15.59:0/3508047828 conn(0x5607b9e7d260 msgr2=0x5607b9f042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.878+0000 7f405727bb80 1 -- 172.21.15.59:0/3508047828 shutdown_connections 2023-10-08T12:51:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.878+0000 7f405727bb80 1 -- 172.21.15.59:0/3508047828 wait complete. 2023-10-08T12:51:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.878+0000 7f405727bb80 1 -- start start 2023-10-08T12:51:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.878+0000 7f405727bb80 1 Processor -- start 2023-10-08T12:51:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f405727bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f13050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f405727bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f087a0 0x5607b9f10320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f405727bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f13650 0x5607b9f10930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f405727bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9e5be30 con 0x5607b9f087a0 2023-10-08T12:51:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f405727bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9df8710 con 0x5607b9f07e80 2023-10-08T12:51:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f405727bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9df83b0 con 0x5607b9f13650 2023-10-08T12:51:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f405727bb80 10 client.0 _ll_register_callbacks cb 0x5607b9c55800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f4041f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f13050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f4041f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f13050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58466/0 (socket says 172.21.15.59:58466) 2023-10-08T12:51:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f4041f9c700 1 -- 172.21.15.59:0/610449370 learned_addr learned my addr 172.21.15.59:0/610449370 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f4040f9a700 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f087a0 0x5607b9f10320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.879+0000 7f4041f9c700 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f13650 0x5607b9f10930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.880+0000 7f4041f9c700 1 -- 172.21.15.59:0/610449370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f13650 msgr2=0x5607b9f10930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.880+0000 7f4041f9c700 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f13650 0x5607b9f10930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.880+0000 7f4041f9c700 1 -- 172.21.15.59:0/610449370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f087a0 msgr2=0x5607b9f10320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.880+0000 7f4041f9c700 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f087a0 0x5607b9f10320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.880+0000 7f4041f9c700 1 -- 172.21.15.59:0/610449370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c0098e0 con 0x5607b9f07e80 2023-10-08T12:51:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.880+0000 7f4041f9c700 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f13050 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f403401af20 tx=0x7f4034004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0fa88425c282d73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.880+0000 7f4024ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:51:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.880+0000 7f4024ff9700 1 -- 172.21.15.59:0/610449370 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400e040 con 0x5607b9f07e80 2023-10-08T12:51:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.880+0000 7f405727bb80 1 -- 172.21.15.59:0/610449370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607b9e54e10 con 0x5607b9f07e80 2023-10-08T12:51:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.880+0000 7f4024ff9700 1 -- 172.21.15.59:0/610449370 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4034004db0 con 0x5607b9f07e80 2023-10-08T12:51:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f4024ff9700 1 -- 172.21.15.59:0/610449370 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4034012e90 con 0x5607b9f07e80 2023-10-08T12:51:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f405727bb80 10 client.26894 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f405727bb80 1 -- 172.21.15.59:0/610449370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5607b9c6fc60 con 0x5607b9f07e80 2023-10-08T12:51:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f4024ff9700 1 -- 172.21.15.59:0/610449370 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5607b9e54e10 con 0x5607b9f07e80 2023-10-08T12:51:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f4024ff9700 1 -- 172.21.15.59:0/610449370 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4034017a90 con 0x5607b9f07e80 2023-10-08T12:51:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f405727bb80 10 client.26894 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f405727bb80 10 client.26894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f405727bb80 20 client.26894 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f405727bb80 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607b9f230e0 0x5607b9f25500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f405727bb80 4 client.26894 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:51:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f405727bb80 1 -- 172.21.15.59:0/610449370 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607b9e54b30 con 0x5607b9f230e0 2023-10-08T12:51:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.881+0000 7f4040f9a700 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607b9f230e0 0x5607b9f25500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.882+0000 7f4040f9a700 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607b9f230e0 0x5607b9f25500 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b30c3eca85ae8ae2 server_cookie=86e81e01c675c6db in_seq=0 out_seq=0 2023-10-08T12:51:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.882+0000 7f4024ff9700 10 client.26894 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f4024ff9700 1 -- 172.21.15.59:0/610449370 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5607b9e54b30 con 0x5607b9f230e0 2023-10-08T12:51:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f4024ff9700 10 client.26894 handle_command_reply: tid=0 2023-10-08T12:51:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f405727bb80 1 client.26894 shutdown 2023-10-08T12:51:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f405727bb80 1 -- 172.21.15.59:0/610449370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 msgr2=0x5607b9f13050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f405727bb80 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f13050 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f403401af20 tx=0x7f4034004b40 comp rx=0 tx=0).stop 2023-10-08T12:51:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f405727bb80 1 -- 172.21.15.59:0/610449370 shutdown_connections 2023-10-08T12:51:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f405727bb80 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607b9f230e0 0x5607b9f25500 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f405727bb80 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f13050 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f405727bb80 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f13650 0x5607b9f10930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f4024ff9700 0 client.26894 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f405727bb80 1 --2- 172.21.15.59:0/610449370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f087a0 0x5607b9f10320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f405727bb80 1 -- 172.21.15.59:0/610449370 >> 172.21.15.59:0/610449370 conn(0x5607b9e7d260 msgr2=0x5607b9f03ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f405727bb80 1 -- 172.21.15.59:0/610449370 shutdown_connections 2023-10-08T12:51:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.883+0000 7f405727bb80 1 -- 172.21.15.59:0/610449370 wait complete. 2023-10-08T12:51:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.884+0000 7f405727bb80 20 client.26894 trim_cache size 0 max 16384 2023-10-08T12:51:42.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.903+0000 7f405727bb80 1 Processor -- start 2023-10-08T12:51:42.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.903+0000 7f405727bb80 1 -- start start 2023-10-08T12:51:42.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.903+0000 7f405727bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f07e80 0x5607b9f1a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.903+0000 7f405727bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 0x5607b9f034d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.903+0000 7f405727bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f13650 0x5607b9f0b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.903+0000 7f405727bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9cdc920 con 0x5607b9f07e80 2023-10-08T12:51:42.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.903+0000 7f405727bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9f00ae0 con 0x5607b9f13650 2023-10-08T12:51:42.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.903+0000 7f405727bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9f10f10 con 0x5607b9f087a0 2023-10-08T12:51:42.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4041f9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f07e80 0x5607b9f1a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4040f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 0x5607b9f034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4041f9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f07e80 0x5607b9f1a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39484/0 (socket says 172.21.15.59:39484) 2023-10-08T12:51:42.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4041f9c700 1 -- 172.21.15.59:0/840513093 learned_addr learned my addr 172.21.15.59:0/840513093 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:42.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4040f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 0x5607b9f034d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58614/0 (socket says 172.21.15.59:58614) 2023-10-08T12:51:42.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4041f9c700 1 --2- 172.21.15.59:0/840513093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f13650 0x5607b9f0b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4041f9c700 1 -- 172.21.15.59:0/840513093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 msgr2=0x5607b9f034d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:42.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4041f9c700 1 --2- 172.21.15.59:0/840513093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 0x5607b9f034d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4041f9c700 1 -- 172.21.15.59:0/840513093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f13650 msgr2=0x5607b9f0b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:42.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4041f9c700 1 --2- 172.21.15.59:0/840513093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f13650 0x5607b9f0b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4041f9c700 1 -- 172.21.15.59:0/840513093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607b9cad250 con 0x5607b9f07e80 2023-10-08T12:51:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.904+0000 7f4041f9c700 1 --2- 172.21.15.59:0/840513093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f07e80 0x5607b9f1a1a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4034004280 tx=0x7f40340124f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e18ec0dd401c359 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.905+0000 7f4027fff700 1 -- 172.21.15.59:0/840513093 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400e040 con 0x5607b9f07e80 2023-10-08T12:51:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.905+0000 7f4027fff700 1 -- 172.21.15.59:0/840513093 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4034020030 con 0x5607b9f07e80 2023-10-08T12:51:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.905+0000 7f4027fff700 1 -- 172.21.15.59:0/840513093 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034009070 con 0x5607b9f07e80 2023-10-08T12:51:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.905+0000 7f405727bb80 1 -- 172.21.15.59:0/840513093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f07e80 msgr2=0x5607b9f1a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.905+0000 7f405727bb80 1 --2- 172.21.15.59:0/840513093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f07e80 0x5607b9f1a1a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4034004280 tx=0x7f40340124f0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.905+0000 7f405727bb80 1 -- 172.21.15.59:0/840513093 shutdown_connections 2023-10-08T12:51:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.905+0000 7f405727bb80 1 --2- 172.21.15.59:0/840513093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f13650 0x5607b9f0b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.905+0000 7f405727bb80 1 --2- 172.21.15.59:0/840513093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f07e80 0x5607b9f1a1a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.905+0000 7f405727bb80 1 --2- 172.21.15.59:0/840513093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f087a0 0x5607b9f034d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.905+0000 7f405727bb80 1 -- 172.21.15.59:0/840513093 >> 172.21.15.59:0/840513093 conn(0x5607b9e7d260 msgr2=0x5607b9efff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.906+0000 7f405727bb80 1 -- 172.21.15.59:0/840513093 shutdown_connections 2023-10-08T12:51:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.906+0000 7f405727bb80 1 -- 172.21.15.59:0/840513093 wait complete. 2023-10-08T12:51:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.906+0000 7f405727bb80 1 -- start start 2023-10-08T12:51:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.906+0000 7f405727bb80 1 Processor -- start 2023-10-08T12:51:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f405727bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f18ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f405727bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f087a0 0x5607b9f190e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f405727bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f13650 0x5607b9f19620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f405727bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9f77030 con 0x5607b9f087a0 2023-10-08T12:51:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f405727bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9f771a0 con 0x5607b9f07e80 2023-10-08T12:51:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f405727bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b9f77360 con 0x5607b9f13650 2023-10-08T12:51:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f405727bb80 10 client.0 _ll_register_callbacks cb 0x7f403401a7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f4041f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f18ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f4040f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f087a0 0x5607b9f190e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f4041f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f18ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58474/0 (socket says 172.21.15.59:58474) 2023-10-08T12:51:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f4041f9c700 1 -- 172.21.15.59:0/1958026191 learned_addr learned my addr 172.21.15.59:0/1958026191 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f4041f9c700 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f13650 0x5607b9f19620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f4040f9a700 1 -- 172.21.15.59:0/1958026191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f13650 msgr2=0x5607b9f19620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f4040f9a700 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f13650 0x5607b9f19620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f4040f9a700 1 -- 172.21.15.59:0/1958026191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 msgr2=0x5607b9f18ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f4040f9a700 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f18ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f4040f9a700 1 -- 172.21.15.59:0/1958026191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607b9c6fc60 con 0x5607b9f087a0 2023-10-08T12:51:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.907+0000 7f4041f9c700 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f18ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.908+0000 7f4040f9a700 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f087a0 0x5607b9f190e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f402c009c80 tx=0x7f402c005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92603f16101ce00c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.908+0000 7f4024ff9700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:51:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.908+0000 7f4024ff9700 1 -- 172.21.15.59:0/1958026191 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c029040 con 0x5607b9f087a0 2023-10-08T12:51:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.908+0000 7f405727bb80 1 -- 172.21.15.59:0/1958026191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607b9e23eb0 con 0x5607b9f087a0 2023-10-08T12:51:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.908+0000 7f4024ff9700 1 -- 172.21.15.59:0/1958026191 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f402c013c80 con 0x5607b9f087a0 2023-10-08T12:51:42.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.908+0000 7f4024ff9700 1 -- 172.21.15.59:0/1958026191 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f402c013e40 con 0x5607b9f087a0 2023-10-08T12:51:42.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.908+0000 7f405727bb80 10 client.16878 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:42.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.908+0000 7f405727bb80 1 -- 172.21.15.59:0/1958026191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5607b9c852b0 con 0x5607b9f087a0 2023-10-08T12:51:42.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.909+0000 7f4024ff9700 1 -- 172.21.15.59:0/1958026191 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f402c03b020 con 0x5607b9f087a0 2023-10-08T12:51:42.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.909+0000 7f4024ff9700 1 -- 172.21.15.59:0/1958026191 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f402c004040 con 0x5607b9f087a0 2023-10-08T12:51:42.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.909+0000 7f405727bb80 10 client.16878 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.909+0000 7f405727bb80 10 client.16878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.909+0000 7f405727bb80 20 client.16878 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.909+0000 7f405727bb80 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607b9f78b30 0x5607b9f7af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.909+0000 7f405727bb80 4 client.16878 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.909+0000 7f405727bb80 1 -- 172.21.15.59:0/1958026191 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5607b9ca7f70 con 0x5607b9f78b30 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.909+0000 7f4041f9c700 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607b9f78b30 0x5607b9f7af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f4024ff9700 10 client.16878 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f4041f9c700 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607b9f78b30 0x5607b9f7af50 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a0035779f6c3903 server_cookie=4a6f7ac6900e63d4 in_seq=0 out_seq=0 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f4024ff9700 1 -- 172.21.15.59:0/1958026191 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5607b9ca7f70 con 0x5607b9f78b30 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f4024ff9700 10 client.16878 handle_command_reply: tid=0 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f405727bb80 1 client.16878 shutdown 2023-10-08T12:51:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f405727bb80 1 -- 172.21.15.59:0/1958026191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f087a0 msgr2=0x5607b9f190e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f405727bb80 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f087a0 0x5607b9f190e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f402c009c80 tx=0x7f402c005d00 comp rx=0 tx=0).stop 2023-10-08T12:51:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f405727bb80 1 -- 172.21.15.59:0/1958026191 shutdown_connections 2023-10-08T12:51:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f405727bb80 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607b9f78b30 0x5607b9f7af50 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f405727bb80 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607b9f07e80 0x5607b9f18ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f405727bb80 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607b9f13650 0x5607b9f19620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f405727bb80 1 --2- 172.21.15.59:0/1958026191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607b9f087a0 0x5607b9f190e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f4024ff9700 0 client.16878 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.910+0000 7f405727bb80 1 -- 172.21.15.59:0/1958026191 >> 172.21.15.59:0/1958026191 conn(0x5607b9e7d260 msgr2=0x5607b9f0b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f405727bb80 1 -- 172.21.15.59:0/1958026191 shutdown_connections 2023-10-08T12:51:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f405727bb80 1 -- 172.21.15.59:0/1958026191 wait complete. 2023-10-08T12:51:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f405727bb80 20 client.16878 trim_cache size 0 max 16384 2023-10-08T12:51:42.917 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:51:42.917 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:51:42.917 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:51:42.917 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:51:42.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f40439ff700 1 -- 172.21.15.59:0/3953662246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40280a15f0 msgr2=0x7f40280a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:42.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f40439ff700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40280a15f0 0x7f40280a3ab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f40380a3400 tx=0x7f4038009ca0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f40439ff700 1 -- 172.21.15.59:0/3953662246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f403c100740 msgr2=0x7f403c198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:42.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f40439ff700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f403c100740 0x7f403c198d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4038005740 tx=0x7f4038005770 comp rx=0 tx=0).stop 2023-10-08T12:51:42.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f40439ff700 1 -- 172.21.15.59:0/3953662246 shutdown_connections 2023-10-08T12:51:42.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f40439ff700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f40280a15f0 0x7f40280a3ab0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f40439ff700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f403c100740 0x7f403c198d90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f40439ff700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f403c106750 0x7f403c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f40439ff700 1 --2- 172.21.15.59:0/3953662246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403c101100 0x7f403c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:42.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.911+0000 7f40439ff700 1 -- 172.21.15.59:0/3953662246 >> 172.21.15.59:0/3953662246 conn(0x7f403c0fc230 msgr2=0x7f403c10bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:42.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.912+0000 7f40439ff700 1 -- 172.21.15.59:0/3953662246 shutdown_connections 2023-10-08T12:51:42.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:42.912+0000 7f40439ff700 1 -- 172.21.15.59:0/3953662246 wait complete. 2023-10-08T12:51:42.931 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:51:42.932 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:51:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:42 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:42 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:42.994 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:42 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:42.994 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:42 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:43.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:42 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:43.129 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:42 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.165+0000 7fd5e5fff700 1 -- 172.21.15.59:0/3919004927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5e0100630 msgr2=0x7fd5e0100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.165+0000 7fd5e5fff700 1 --2- 172.21.15.59:0/3919004927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5e0100630 0x7fd5e0100ab0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40098f0 tx=0x7fd5d4009c00 comp rx=0 tx=0).stop 2023-10-08T12:51:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.166+0000 7fd5e5fff700 1 -- 172.21.15.59:0/3919004927 shutdown_connections 2023-10-08T12:51:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.166+0000 7fd5e5fff700 1 --2- 172.21.15.59:0/3919004927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e0100ff0 0x7fd5e010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.166+0000 7fd5e5fff700 1 --2- 172.21.15.59:0/3919004927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0106640 0x7fd5e0106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.166+0000 7fd5e5fff700 1 --2- 172.21.15.59:0/3919004927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5e0100630 0x7fd5e0100ab0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.166+0000 7fd5e5fff700 1 -- 172.21.15.59:0/3919004927 >> 172.21.15.59:0/3919004927 conn(0x7fd5e00fc1a0 msgr2=0x7fd5e00fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.166+0000 7fd5e5fff700 1 -- 172.21.15.59:0/3919004927 shutdown_connections 2023-10-08T12:51:43.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.166+0000 7fd5e5fff700 1 -- 172.21.15.59:0/3919004927 wait complete. 2023-10-08T12:51:43.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.167+0000 7fd5e5fff700 1 Processor -- start 2023-10-08T12:51:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.167+0000 7fd5e5fff700 1 -- start start 2023-10-08T12:51:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.167+0000 7fd5e5fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5e0100630 0x7fd5e0198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.167+0000 7fd5e5fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0100ff0 0x7fd5e01992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.167+0000 7fd5e5fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e0106640 0x7fd5e019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.167+0000 7fd5e5fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e019dca0 con 0x7fd5e0100630 2023-10-08T12:51:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.167+0000 7fd5e5fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e019de10 con 0x7fd5e0106640 2023-10-08T12:51:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.167+0000 7fd5e5fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e019dfd0 con 0x7fd5e0100ff0 2023-10-08T12:51:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.167+0000 7fd5df7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5e0100630 0x7fd5e0198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.167+0000 7fd5df7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5e0100630 0x7fd5e0198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39526/0 (socket says 172.21.15.59:39526) 2023-10-08T12:51:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.167+0000 7fd5df7fe700 1 -- 172.21.15.59:0/2755096339 learned_addr learned my addr 172.21.15.59:0/2755096339 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5dffff700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e0106640 0x7fd5e019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5deffd700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0100ff0 0x7fd5e01992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5df7fe700 1 -- 172.21.15.59:0/2755096339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0100ff0 msgr2=0x7fd5e01992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5df7fe700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0100ff0 0x7fd5e01992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5df7fe700 1 -- 172.21.15.59:0/2755096339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e0106640 msgr2=0x7fd5e019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5df7fe700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e0106640 0x7fd5e019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5df7fe700 1 -- 172.21.15.59:0/2755096339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d4009520 con 0x7fd5e0100630 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5df7fe700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5e0100630 0x7fd5e0198d80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000e9a0 tx=0x7fd5d000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5dcff9700 1 -- 172.21.15.59:0/2755096339 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0009790 con 0x7fd5e0100630 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5dcff9700 1 -- 172.21.15.59:0/2755096339 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5d0010430 con 0x7fd5e0100630 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5e5fff700 1 -- 172.21.15.59:0/2755096339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e019e2b0 con 0x7fd5e0100630 2023-10-08T12:51:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.168+0000 7fd5dcff9700 1 -- 172.21.15.59:0/2755096339 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0018680 con 0x7fd5e0100630 2023-10-08T12:51:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.169+0000 7fd5e5fff700 1 -- 172.21.15.59:0/2755096339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e01a5af0 con 0x7fd5e0100630 2023-10-08T12:51:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.170+0000 7fd5e5fff700 1 -- 172.21.15.59:0/2755096339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e0101d70 con 0x7fd5e0100630 2023-10-08T12:51:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.172+0000 7fd5dcff9700 1 -- 172.21.15.59:0/2755096339 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd5d00105a0 con 0x7fd5e0100630 2023-10-08T12:51:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.173+0000 7fd5dcff9700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5c80a15f0 0x7fd5c80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.173+0000 7fd5dcff9700 1 -- 172.21.15.59:0/2755096339 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fd5d0014070 con 0x7fd5e0100630 2023-10-08T12:51:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.173+0000 7fd5deffd700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5c80a15f0 0x7fd5c80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.174+0000 7fd5deffd700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5c80a15f0 0x7fd5c80a3ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40098c0 tx=0x7fd5d4019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.176+0000 7fd5dcff9700 1 -- 172.21.15.59:0/2755096339 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd5d0096750 con 0x7fd5e0100630 2023-10-08T12:51:43.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.446+0000 7fd5e5fff700 1 -- 172.21.15.59:0/2755096339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5e0067450 con 0x7fd5e0100630 2023-10-08T12:51:43.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.446+0000 7fd5dcff9700 1 -- 172.21.15.59:0/2755096339 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fd5d0026090 con 0x7fd5e0100630 2023-10-08T12:51:43.448 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:51:43.448 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:51:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 -- 172.21.15.59:0/2755096339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5c80a15f0 msgr2=0x7fd5c80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5c80a15f0 0x7fd5c80a3ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40098c0 tx=0x7fd5d4019040 comp rx=0 tx=0).stop 2023-10-08T12:51:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 -- 172.21.15.59:0/2755096339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5e0100630 msgr2=0x7fd5e0198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5e0100630 0x7fd5e0198d80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000e9a0 tx=0x7fd5d000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 -- 172.21.15.59:0/2755096339 shutdown_connections 2023-10-08T12:51:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd5c80a15f0 0x7fd5c80a3ab0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e0106640 0x7fd5e019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5e0100630 0x7fd5e0198d80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 --2- 172.21.15.59:0/2755096339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e0100ff0 0x7fd5e01992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 -- 172.21.15.59:0/2755096339 >> 172.21.15.59:0/2755096339 conn(0x7fd5e00fc1a0 msgr2=0x7fd5e010bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 -- 172.21.15.59:0/2755096339 shutdown_connections 2023-10-08T12:51:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.449+0000 7fd5e5fff700 1 -- 172.21.15.59:0/2755096339 wait complete. 2023-10-08T12:51:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:51:43.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:51:43.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1338283 12.68 MB/sec execute 434 sec latency 95.781 ms 2023-10-08T12:51:43.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.702+0000 7fbd8fbff700 1 -- 172.21.15.59:0/1007804385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd88100150 msgr2=0x7fbd88100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.702+0000 7fbd8fbff700 1 --2- 172.21.15.59:0/1007804385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd88100150 0x7fbd88100530 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009990 tx=0x7fbd84009ca0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.703+0000 7fbd8fbff700 1 -- 172.21.15.59:0/1007804385 shutdown_connections 2023-10-08T12:51:43.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.703+0000 7fbd8fbff700 1 --2- 172.21.15.59:0/1007804385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd88100150 0x7fbd88100530 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.703+0000 7fbd8fbff700 1 --2- 172.21.15.59:0/1007804385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd8810d190 0x7fbd8810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.703+0000 7fbd8fbff700 1 --2- 172.21.15.59:0/1007804385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd88100a70 0x7fbd8810cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.703+0000 7fbd8fbff700 1 -- 172.21.15.59:0/1007804385 >> 172.21.15.59:0/1007804385 conn(0x7fbd88076780 msgr2=0x7fbd88076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.704+0000 7fbd8fbff700 1 -- 172.21.15.59:0/1007804385 shutdown_connections 2023-10-08T12:51:43.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.704+0000 7fbd8fbff700 1 -- 172.21.15.59:0/1007804385 wait complete. 2023-10-08T12:51:43.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.705+0000 7fbd8fbff700 1 Processor -- start 2023-10-08T12:51:43.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.706+0000 7fbd8fbff700 1 -- start start 2023-10-08T12:51:43.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.706+0000 7fbd8fbff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd88100150 0x7fbd881019d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.706+0000 7fbd8fbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd88100a70 0x7fbd88101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.706+0000 7fbd8fbff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd8810d190 0x7fbd88106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.706+0000 7fbd8fbff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd88107580 con 0x7fbd88100150 2023-10-08T12:51:43.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.706+0000 7fbd8fbff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd881076f0 con 0x7fbd8810d190 2023-10-08T12:51:43.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.706+0000 7fbd8fbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd881078b0 con 0x7fbd88100a70 2023-10-08T12:51:43.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.707+0000 7fbd8d99b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd88100150 0x7fbd881019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.707+0000 7fbd8d99b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd88100150 0x7fbd881019d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39544/0 (socket says 172.21.15.59:39544) 2023-10-08T12:51:43.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.707+0000 7fbd8d99b700 1 -- 172.21.15.59:0/2832422556 learned_addr learned my addr 172.21.15.59:0/2832422556 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:43.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.709+0000 7fbd8d19a700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd88100a70 0x7fbd88101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.710+0000 7fbd8d99b700 1 -- 172.21.15.59:0/2832422556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd88100a70 msgr2=0x7fbd88101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.710+0000 7fbd8d99b700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd88100a70 0x7fbd88101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.710+0000 7fbd8d99b700 1 -- 172.21.15.59:0/2832422556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd8810d190 msgr2=0x7fbd88106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.710+0000 7fbd8d99b700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd8810d190 0x7fbd88106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.710+0000 7fbd8d99b700 1 -- 172.21.15.59:0/2832422556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd840095f0 con 0x7fbd88100150 2023-10-08T12:51:43.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.710+0000 7fbd8d19a700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd88100a70 0x7fbd88101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:43.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.710+0000 7fbd8d99b700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd88100150 0x7fbd881019d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbd84000c00 tx=0x7fbd84005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.714+0000 7fbd7effd700 1 -- 172.21.15.59:0/2832422556 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8401d070 con 0x7fbd88100150 2023-10-08T12:51:43.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.714+0000 7fbd7effd700 1 -- 172.21.15.59:0/2832422556 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd84022470 con 0x7fbd88100150 2023-10-08T12:51:43.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.714+0000 7fbd7effd700 1 -- 172.21.15.59:0/2832422556 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84017650 con 0x7fbd88100150 2023-10-08T12:51:43.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.719+0000 7fbd8fbff700 1 -- 172.21.15.59:0/2832422556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd88107b30 con 0x7fbd88100150 2023-10-08T12:51:43.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.720+0000 7fbd8fbff700 1 -- 172.21.15.59:0/2832422556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8810c1b0 con 0x7fbd88100150 2023-10-08T12:51:43.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.727+0000 7fbda3585b80 1 Processor -- start 2023-10-08T12:51:43.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.727+0000 7fbda3585b80 1 -- start start 2023-10-08T12:51:43.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.728+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64a4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.728+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.728+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.728+0000 7fbda3585b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab640d460 con 0x560ab64a47a0 2023-10-08T12:51:43.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.728+0000 7fbda3585b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab63fec20 con 0x560ab64c0660 2023-10-08T12:51:43.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.728+0000 7fbda3585b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab63fc540 con 0x560ab64a3e80 2023-10-08T12:51:43.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.730+0000 7fbd8e19c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.730+0000 7fbd7effd700 1 -- 172.21.15.59:0/2832422556 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbd8400fb00 con 0x7fbd88100150 2023-10-08T12:51:43.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.731+0000 7fbd8d99b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.731+0000 7fbd8d19a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.731+0000 7fbd8d19a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58520/0 (socket says 172.21.15.59:58520) 2023-10-08T12:51:43.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.731+0000 7fbd8d19a700 1 -- 172.21.15.59:0/49825290 learned_addr learned my addr 172.21.15.59:0/49825290 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:43.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.731+0000 7fbd8d19a700 1 -- 172.21.15.59:0/49825290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 msgr2=0x560ab64a4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.731+0000 7fbd8d19a700 1 --2- 172.21.15.59:0/49825290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64a4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.731+0000 7fbd8d19a700 1 -- 172.21.15.59:0/49825290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 msgr2=0x560ab64c0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.731+0000 7fbd8d19a700 1 --2- 172.21.15.59:0/49825290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.731+0000 7fbd8d19a700 1 -- 172.21.15.59:0/49825290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ab6222de0 con 0x560ab64c0660 2023-10-08T12:51:43.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.732+0000 7fbd8d19a700 1 --2- 172.21.15.59:0/49825290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c2a50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbd78010500 tx=0x7fbd78010810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0abc45857227b6f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.733+0000 7fbd7effd700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbd740a17c0 0x7fbd740a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.733+0000 7fbd7effd700 1 -- 172.21.15.59:0/2832422556 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fbd840ce350 con 0x7fbd88100150 2023-10-08T12:51:43.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.733+0000 7fbd8e19c700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbd740a17c0 0x7fbd740a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.734+0000 7fbd8e19c700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbd740a17c0 0x7fbd740a3c80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbd881017c0 tx=0x7fbd8000d040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.734+0000 7fbd73fff700 1 -- 172.21.15.59:0/49825290 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78004220 con 0x560ab64c0660 2023-10-08T12:51:43.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.734+0000 7fbd73fff700 1 -- 172.21.15.59:0/49825290 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd78015070 con 0x560ab64c0660 2023-10-08T12:51:43.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.734+0000 7fbd73fff700 1 -- 172.21.15.59:0/49825290 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd780116a0 con 0x560ab64c0660 2023-10-08T12:51:43.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.735+0000 7fbda3585b80 1 -- 172.21.15.59:0/49825290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 msgr2=0x560ab64c2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.735+0000 7fbda3585b80 1 --2- 172.21.15.59:0/49825290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c2a50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbd78010500 tx=0x7fbd78010810 comp rx=0 tx=0).stop 2023-10-08T12:51:43.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.735+0000 7fbda3585b80 1 -- 172.21.15.59:0/49825290 shutdown_connections 2023-10-08T12:51:43.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.735+0000 7fbda3585b80 1 --2- 172.21.15.59:0/49825290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c2a50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.735+0000 7fbda3585b80 1 --2- 172.21.15.59:0/49825290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.735+0000 7fbda3585b80 1 --2- 172.21.15.59:0/49825290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.735+0000 7fbda3585b80 1 -- 172.21.15.59:0/49825290 >> 172.21.15.59:0/49825290 conn(0x560ab6419260 msgr2=0x560ab64a02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.735+0000 7fbda3585b80 1 -- 172.21.15.59:0/49825290 shutdown_connections 2023-10-08T12:51:43.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.735+0000 7fbda3585b80 1 -- 172.21.15.59:0/49825290 wait complete. 2023-10-08T12:51:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.736+0000 7fbda3585b80 1 -- start start 2023-10-08T12:51:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.736+0000 7fbda3585b80 1 Processor -- start 2023-10-08T12:51:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a3e80 0x560ab64c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64a47a0 0x560ab64bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64c0660 0x560ab64bdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbda3585b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab63f7e30 con 0x560ab64a3e80 2023-10-08T12:51:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbda3585b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab6394710 con 0x560ab64a47a0 2023-10-08T12:51:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbda3585b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab63943b0 con 0x560ab64c0660 2023-10-08T12:51:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbda3585b80 10 client.0 _ll_register_callbacks cb 0x560ab61f1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbd8d19a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64a47a0 0x560ab64bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbd8d19a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64a47a0 0x560ab64bd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58528/0 (socket says 172.21.15.59:58528) 2023-10-08T12:51:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbd8d19a700 1 -- 172.21.15.59:0/3276811713 learned_addr learned my addr 172.21.15.59:0/3276811713 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbd8e19c700 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64c0660 0x560ab64bdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbd8d99b700 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a3e80 0x560ab64c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbd8d19a700 1 -- 172.21.15.59:0/3276811713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64c0660 msgr2=0x560ab64bdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbd8d19a700 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64c0660 0x560ab64bdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbd8d19a700 1 -- 172.21.15.59:0/3276811713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a3e80 msgr2=0x560ab64c00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.737+0000 7fbd8d19a700 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a3e80 0x560ab64c00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.738+0000 7fbd8d19a700 1 -- 172.21.15.59:0/3276811713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7800bd10 con 0x560ab64a47a0 2023-10-08T12:51:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.738+0000 7fbd8d19a700 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64a47a0 0x560ab64bd400 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800bcb0 tx=0x7fbd78010fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afb2f7095e2806a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.738+0000 7fbd717fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:51:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.738+0000 7fbd717fa700 1 -- 172.21.15.59:0/3276811713 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78020070 con 0x560ab64a47a0 2023-10-08T12:51:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.738+0000 7fbda3585b80 1 -- 172.21.15.59:0/3276811713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ab63bfeb0 con 0x560ab64a47a0 2023-10-08T12:51:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.738+0000 7fbd717fa700 1 -- 172.21.15.59:0/3276811713 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fbd78017070 con 0x560ab64a47a0 2023-10-08T12:51:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.738+0000 7fbd717fa700 1 -- 172.21.15.59:0/3276811713 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd78003a60 con 0x560ab64a47a0 2023-10-08T12:51:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.738+0000 7fbda3585b80 10 client.26915 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.738+0000 7fbda3585b80 1 -- 172.21.15.59:0/3276811713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x560ab620bc60 con 0x560ab64a47a0 2023-10-08T12:51:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.739+0000 7fbd717fa700 1 -- 172.21.15.59:0/3276811713 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560ab63bfeb0 con 0x560ab64a47a0 2023-10-08T12:51:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.739+0000 7fbd717fa700 1 -- 172.21.15.59:0/3276811713 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd78004750 con 0x560ab64a47a0 2023-10-08T12:51:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.739+0000 7fbda3585b80 10 client.26915 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.739+0000 7fbda3585b80 10 client.26915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.739+0000 7fbda3585b80 20 client.26915 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.739+0000 7fbda3585b80 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560ab64d00d0 0x560ab64d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.739+0000 7fbda3585b80 4 client.26915 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:51:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.739+0000 7fbda3585b80 1 -- 172.21.15.59:0/3276811713 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ab63f0e10 con 0x560ab64d00d0 2023-10-08T12:51:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.739+0000 7fbd8d99b700 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560ab64d00d0 0x560ab64d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.740+0000 7fbd8d99b700 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560ab64d00d0 0x560ab64d24f0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a27999b330f110f server_cookie=2c8fb5ef6ba4d6bd in_seq=0 out_seq=0 2023-10-08T12:51:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.740+0000 7fbd717fa700 10 client.26915 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.741+0000 7fbd717fa700 1 -- 172.21.15.59:0/3276811713 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560ab63f0e10 con 0x560ab64d00d0 2023-10-08T12:51:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.741+0000 7fbd717fa700 10 client.26915 handle_command_reply: tid=0 2023-10-08T12:51:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.741+0000 7fbda3585b80 1 client.26915 shutdown 2023-10-08T12:51:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.741+0000 7fbda3585b80 1 -- 172.21.15.59:0/3276811713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64a47a0 msgr2=0x560ab64bd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.741+0000 7fbda3585b80 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64a47a0 0x560ab64bd400 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800bcb0 tx=0x7fbd78010fd0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.742+0000 7fbda3585b80 1 -- 172.21.15.59:0/3276811713 shutdown_connections 2023-10-08T12:51:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.742+0000 7fbda3585b80 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560ab64d00d0 0x560ab64d24f0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.742+0000 7fbda3585b80 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64c0660 0x560ab64bdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.742+0000 7fbda3585b80 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a3e80 0x560ab64c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.742+0000 7fbd717fa700 0 client.26915 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.742+0000 7fbda3585b80 1 --2- 172.21.15.59:0/3276811713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64a47a0 0x560ab64bd400 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.742+0000 7fbda3585b80 1 -- 172.21.15.59:0/3276811713 >> 172.21.15.59:0/3276811713 conn(0x560ab6419260 msgr2=0x560ab649fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.742+0000 7fbda3585b80 1 -- 172.21.15.59:0/3276811713 shutdown_connections 2023-10-08T12:51:43.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.742+0000 7fbda3585b80 1 -- 172.21.15.59:0/3276811713 wait complete. 2023-10-08T12:51:43.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.742+0000 7fbda3585b80 20 client.26915 trim_cache size 0 max 16384 2023-10-08T12:51:43.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.755+0000 7fbda3585b80 1 Processor -- start 2023-10-08T12:51:43.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbda3585b80 1 -- start start 2023-10-08T12:51:43.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab649bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbda3585b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab6278920 con 0x560ab64a47a0 2023-10-08T12:51:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbda3585b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab64b8350 con 0x560ab64c0660 2023-10-08T12:51:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbda3585b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab64bd7d0 con 0x560ab64a3e80 2023-10-08T12:51:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbd8e19c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab649bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbd8d19a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbd8d99b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbd8e19c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab649bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58536/0 (socket says 172.21.15.59:58536) 2023-10-08T12:51:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbd8d19a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39562/0 (socket says 172.21.15.59:39562) 2023-10-08T12:51:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.756+0000 7fbd8e19c700 1 -- 172.21.15.59:0/1851485685 learned_addr learned my addr 172.21.15.59:0/1851485685 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.757+0000 7fbd8e19c700 1 -- 172.21.15.59:0/1851485685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 msgr2=0x560ab64c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.757+0000 7fbd8e19c700 1 --2- 172.21.15.59:0/1851485685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.757+0000 7fbd8e19c700 1 -- 172.21.15.59:0/1851485685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 msgr2=0x560ab64c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.757+0000 7fbd8e19c700 1 --2- 172.21.15.59:0/1851485685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.757+0000 7fbd8e19c700 1 -- 172.21.15.59:0/1851485685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ab6249250 con 0x560ab64c0660 2023-10-08T12:51:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.757+0000 7fbd8e19c700 1 --2- 172.21.15.59:0/1851485685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab649bf30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbd80017540 tx=0x7fbd80013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8195ecf92dc5019 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.757+0000 7fbd7cbff700 1 -- 172.21.15.59:0/1851485685 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd800233f0 con 0x560ab64c0660 2023-10-08T12:51:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.757+0000 7fbd7cbff700 1 -- 172.21.15.59:0/1851485685 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd80011040 con 0x560ab64c0660 2023-10-08T12:51:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.757+0000 7fbd7cbff700 1 -- 172.21.15.59:0/1851485685 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80015900 con 0x560ab64c0660 2023-10-08T12:51:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.758+0000 7fbda3585b80 1 -- 172.21.15.59:0/1851485685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 msgr2=0x560ab649bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.758+0000 7fbda3585b80 1 --2- 172.21.15.59:0/1851485685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab649bf30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbd80017540 tx=0x7fbd80013000 comp rx=0 tx=0).stop 2023-10-08T12:51:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.758+0000 7fbda3585b80 1 -- 172.21.15.59:0/1851485685 shutdown_connections 2023-10-08T12:51:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.758+0000 7fbda3585b80 1 --2- 172.21.15.59:0/1851485685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab649bf30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.758+0000 7fbda3585b80 1 --2- 172.21.15.59:0/1851485685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.758+0000 7fbda3585b80 1 --2- 172.21.15.59:0/1851485685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.758+0000 7fbda3585b80 1 -- 172.21.15.59:0/1851485685 >> 172.21.15.59:0/1851485685 conn(0x560ab6419260 msgr2=0x560ab649f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.758+0000 7fbda3585b80 1 -- 172.21.15.59:0/1851485685 shutdown_connections 2023-10-08T12:51:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.758+0000 7fbda3585b80 1 -- 172.21.15.59:0/1851485685 wait complete. 2023-10-08T12:51:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.758+0000 7fbda3585b80 1 -- start start 2023-10-08T12:51:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.759+0000 7fbda3585b80 1 Processor -- start 2023-10-08T12:51:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.759+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.759+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.759+0000 7fbda3585b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.759+0000 7fbda3585b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab64c6040 con 0x560ab64a47a0 2023-10-08T12:51:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.759+0000 7fbda3585b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab64c61b0 con 0x560ab64c0660 2023-10-08T12:51:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.759+0000 7fbda3585b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ab6523f50 con 0x560ab64a3e80 2023-10-08T12:51:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.759+0000 7fbda3585b80 10 client.0 _ll_register_callbacks cb 0x7fbd840d1c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.759+0000 7fbd8e19c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8e19c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58538/0 (socket says 172.21.15.59:58538) 2023-10-08T12:51:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8e19c700 1 -- 172.21.15.59:0/2191045065 learned_addr learned my addr 172.21.15.59:0/2191045065 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8d99b700 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8d19a700 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8e19c700 1 -- 172.21.15.59:0/2191045065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 msgr2=0x560ab64c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8e19c700 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8e19c700 1 -- 172.21.15.59:0/2191045065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 msgr2=0x560ab64c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8e19c700 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8e19c700 1 -- 172.21.15.59:0/2191045065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd80007e90 con 0x560ab64c0660 2023-10-08T12:51:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8d19a700 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:51:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8d99b700 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd8e19c700 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c5960 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbd800094f0 tx=0x7fbd80023a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee55bd75c4bfab12 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd717fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:51:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.760+0000 7fbd717fa700 1 -- 172.21.15.59:0/2191045065 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80015910 con 0x560ab64c0660 2023-10-08T12:51:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbd717fa700 1 -- 172.21.15.59:0/2191045065 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fbd80023c60 con 0x560ab64c0660 2023-10-08T12:51:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbda3585b80 1 -- 172.21.15.59:0/2191045065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd78015070 con 0x560ab64c0660 2023-10-08T12:51:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbd717fa700 1 -- 172.21.15.59:0/2191045065 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd80023e50 con 0x560ab64c0660 2023-10-08T12:51:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbda3585b80 10 client.26921 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbda3585b80 1 -- 172.21.15.59:0/2191045065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x560ab62212b0 con 0x560ab64c0660 2023-10-08T12:51:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbd717fa700 1 -- 172.21.15.59:0/2191045065 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd78015070 con 0x560ab64c0660 2023-10-08T12:51:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbd717fa700 1 -- 172.21.15.59:0/2191045065 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd80022070 con 0x560ab64c0660 2023-10-08T12:51:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbda3585b80 10 client.26921 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbda3585b80 10 client.26921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbda3585b80 20 client.26921 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbda3585b80 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560ab6525580 0x560ab65279a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbda3585b80 4 client.26921 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:51:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.761+0000 7fbda3585b80 1 -- 172.21.15.59:0/2191045065 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560ab63f0b30 con 0x560ab6525580 2023-10-08T12:51:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.762+0000 7fbd8d99b700 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560ab6525580 0x560ab65279a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.762+0000 7fbd8d99b700 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560ab6525580 0x560ab65279a0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d3de6c420fdaf3 server_cookie=f4a608ec2e9366f3 in_seq=0 out_seq=0 2023-10-08T12:51:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.762+0000 7fbd717fa700 10 client.26921 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbd717fa700 1 -- 172.21.15.59:0/2191045065 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560ab63f0b30 con 0x560ab6525580 2023-10-08T12:51:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbd717fa700 10 client.26921 handle_command_reply: tid=0 2023-10-08T12:51:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 1 client.26921 shutdown 2023-10-08T12:51:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 1 -- 172.21.15.59:0/2191045065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 msgr2=0x560ab64c5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c5960 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbd800094f0 tx=0x7fbd80023a70 comp rx=0 tx=0).stop 2023-10-08T12:51:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 1 -- 172.21.15.59:0/2191045065 shutdown_connections 2023-10-08T12:51:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560ab6525580 0x560ab65279a0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ab64c0660 0x560ab64c5960 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560ab64a3e80 0x560ab64c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 1 --2- 172.21.15.59:0/2191045065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560ab64a47a0 0x560ab64c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 1 -- 172.21.15.59:0/2191045065 >> 172.21.15.59:0/2191045065 conn(0x560ab6419260 msgr2=0x560ab649bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbd717fa700 0 client.26921 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:43.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 1 -- 172.21.15.59:0/2191045065 shutdown_connections 2023-10-08T12:51:43.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 1 -- 172.21.15.59:0/2191045065 wait complete. 2023-10-08T12:51:43.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.763+0000 7fbda3585b80 20 client.26921 trim_cache size 0 max 16384 2023-10-08T12:51:43.769 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:51:43.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 -- 172.21.15.59:0/2832422556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbd740a17c0 msgr2=0x7fbd740a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbd740a17c0 0x7fbd740a3c80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbd881017c0 tx=0x7fbd8000d040 comp rx=0 tx=0).stop 2023-10-08T12:51:43.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 -- 172.21.15.59:0/2832422556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd88100150 msgr2=0x7fbd881019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd88100150 0x7fbd881019d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbd84000c00 tx=0x7fbd84005740 comp rx=0 tx=0).stop 2023-10-08T12:51:43.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 -- 172.21.15.59:0/2832422556 shutdown_connections 2023-10-08T12:51:43.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbd740a17c0 0x7fbd740a3c80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd8810d190 0x7fbd88106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd88100150 0x7fbd881019d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 --2- 172.21.15.59:0/2832422556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd88100a70 0x7fbd88101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 -- 172.21.15.59:0/2832422556 >> 172.21.15.59:0/2832422556 conn(0x7fbd88076780 msgr2=0x7fbd8810e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 -- 172.21.15.59:0/2832422556 shutdown_connections 2023-10-08T12:51:43.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:43.764+0000 7fbd8fbff700 1 -- 172.21.15.59:0/2832422556 wait complete. 2023-10-08T12:51:44.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:43 smithi059 ceph-mon[98489]: pgmap v638: 97 pgs: 97 active+clean; 578 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.9 MiB/s wr, 234 op/s 2023-10-08T12:51:44.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:43 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2755096339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:51:44.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:43 smithi092 ceph-mon[134093]: pgmap v638: 97 pgs: 97 active+clean; 578 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.9 MiB/s wr, 234 op/s 2023-10-08T12:51:44.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:43 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2755096339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:51:44.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:43 smithi173 ceph-mon[135182]: pgmap v638: 97 pgs: 97 active+clean; 578 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.9 MiB/s wr, 234 op/s 2023-10-08T12:51:44.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:43 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2755096339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:51:44.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1340239 12.68 MB/sec execute 435 sec latency 26.416 ms 2023-10-08T12:51:44.784 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:51:44.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:51:45.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:44.999+0000 7ff1ebfff700 1 -- 172.21.15.59:0/3060516146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1e40734c0 msgr2=0x7ff1e410cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:44.999+0000 7ff1ebfff700 1 --2- 172.21.15.59:0/3060516146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1e40734c0 0x7ff1e410cac0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009990 tx=0x7ff1d4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:44.999+0000 7ff1ebfff700 1 -- 172.21.15.59:0/3060516146 shutdown_connections 2023-10-08T12:51:45.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:44.999+0000 7ff1ebfff700 1 --2- 172.21.15.59:0/3060516146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e410d000 0x7ff1e410f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:44.999+0000 7ff1ebfff700 1 --2- 172.21.15.59:0/3060516146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e4072ba0 0x7ff1e4072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:44.999+0000 7ff1ebfff700 1 --2- 172.21.15.59:0/3060516146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1e40734c0 0x7ff1e410cac0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:44.999+0000 7ff1ebfff700 1 -- 172.21.15.59:0/3060516146 >> 172.21.15.59:0/3060516146 conn(0x7ff1e40fc230 msgr2=0x7ff1e40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:44.999+0000 7ff1ebfff700 1 -- 172.21.15.59:0/3060516146 shutdown_connections 2023-10-08T12:51:45.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:44.999+0000 7ff1ebfff700 1 -- 172.21.15.59:0/3060516146 wait complete. 2023-10-08T12:51:45.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1ebfff700 1 Processor -- start 2023-10-08T12:51:45.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1ebfff700 1 -- start start 2023-10-08T12:51:45.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1ebfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e4072ba0 0x7ff1e4198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1ebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1e40734c0 0x7ff1e41993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1ebfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e410d000 0x7ff1e419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1ebfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e419dd80 con 0x7ff1e410d000 2023-10-08T12:51:45.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1ebfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e419def0 con 0x7ff1e40734c0 2023-10-08T12:51:45.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1ebfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e419e0b0 con 0x7ff1e4072ba0 2023-10-08T12:51:45.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1e9d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e4072ba0 0x7ff1e4198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1e9d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e4072ba0 0x7ff1e4198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58700/0 (socket says 172.21.15.59:58700) 2023-10-08T12:51:45.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1e9d9b700 1 -- 172.21.15.59:0/579332708 learned_addr learned my addr 172.21.15.59:0/579332708 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:45.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.001+0000 7ff1ea59c700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e410d000 0x7ff1e419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1e959a700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1e40734c0 0x7ff1e41993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1e9d9b700 1 -- 172.21.15.59:0/579332708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1e40734c0 msgr2=0x7ff1e41993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1e40734c0 0x7ff1e41993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1e9d9b700 1 -- 172.21.15.59:0/579332708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e410d000 msgr2=0x7ff1e419d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e410d000 0x7ff1e419d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1e9d9b700 1 -- 172.21.15.59:0/579332708 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e0009520 con 0x7ff1e4072ba0 2023-10-08T12:51:45.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1e959a700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1e40734c0 0x7ff1e41993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:51:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e4072ba0 0x7ff1e4198e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000eb30 tx=0x7ff1e000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1daffd700 1 -- 172.21.15.59:0/579332708 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0009880 con 0x7ff1e4072ba0 2023-10-08T12:51:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1daffd700 1 -- 172.21.15.59:0/579332708 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1e00044e0 con 0x7ff1e4072ba0 2023-10-08T12:51:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1daffd700 1 -- 172.21.15.59:0/579332708 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0003e90 con 0x7ff1e4072ba0 2023-10-08T12:51:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.002+0000 7ff1ebfff700 1 -- 172.21.15.59:0/579332708 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d40095f0 con 0x7ff1e4072ba0 2023-10-08T12:51:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.003+0000 7ff1ebfff700 1 -- 172.21.15.59:0/579332708 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e41a59f0 con 0x7ff1e4072ba0 2023-10-08T12:51:45.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.006+0000 7ff1daffd700 1 -- 172.21.15.59:0/579332708 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff1e0004000 con 0x7ff1e4072ba0 2023-10-08T12:51:45.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.007+0000 7ff1ff890b80 1 Processor -- start 2023-10-08T12:51:45.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.007+0000 7ff1ff890b80 1 -- start start 2023-10-08T12:51:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.007+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 0x558168cac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 0x558168cb7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cb9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168c154e0 con 0x558168cb76d0 2023-10-08T12:51:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168c06ca0 con 0x558168cabf00 2023-10-08T12:51:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168c045c0 con 0x558168cac820 2023-10-08T12:51:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1daffd700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff1d00a15f0 0x7ff1d00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1e9d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 0x558168cb7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1ea59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 0x558168cac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1ea59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 0x558168cac2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58566/0 (socket says 172.21.15.59:58566) 2023-10-08T12:51:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1e959a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cb9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1ea59c700 1 -- 172.21.15.59:0/1804718574 learned_addr learned my addr 172.21.15.59:0/1804718574 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1daffd700 1 -- 172.21.15.59:0/579332708 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7ff1e0014070 con 0x7ff1e4072ba0 2023-10-08T12:51:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1ea59c700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff1d00a15f0 0x7ff1d00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1e9d9b700 1 -- 172.21.15.59:0/1804718574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 msgr2=0x558168cac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/1804718574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 0x558168cac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1e9d9b700 1 -- 172.21.15.59:0/1804718574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 msgr2=0x558168cb9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/1804718574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cb9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1e9d9b700 1 -- 172.21.15.59:0/1804718574 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558168a2ae60 con 0x558168cac820 2023-10-08T12:51:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.008+0000 7ff1e959a700 1 --2- 172.21.15.59:0/1804718574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cb9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.009+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/1804718574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 0x558168cb7190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00cacd0 tx=0x7ff1e006c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e4b25ea5621aeaa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.009+0000 7ff1ea59c700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff1d00a15f0 0x7ff1d00a3ab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc009fd0 tx=0x7ff1dc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.009+0000 7ff1cffff700 1 -- 172.21.15.59:0/1804718574 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00600d0 con 0x558168cac820 2023-10-08T12:51:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.009+0000 7ff1cffff700 1 -- 172.21.15.59:0/1804718574 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1e009ac90 con 0x558168cac820 2023-10-08T12:51:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.009+0000 7ff1cffff700 1 -- 172.21.15.59:0/1804718574 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0098930 con 0x558168cac820 2023-10-08T12:51:45.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.010+0000 7ff1ff890b80 1 -- 172.21.15.59:0/1804718574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 msgr2=0x558168cb7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.010+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/1804718574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 0x558168cb7190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00cacd0 tx=0x7ff1e006c450 comp rx=0 tx=0).stop 2023-10-08T12:51:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.010+0000 7ff1ff890b80 1 -- 172.21.15.59:0/1804718574 shutdown_connections 2023-10-08T12:51:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.010+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/1804718574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 0x558168cac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.010+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/1804718574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cb9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.010+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/1804718574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 0x558168cb7190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.010+0000 7ff1ff890b80 1 -- 172.21.15.59:0/1804718574 >> 172.21.15.59:0/1804718574 conn(0x558168c212e0 msgr2=0x558168ca8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.010+0000 7ff1ff890b80 1 -- 172.21.15.59:0/1804718574 shutdown_connections 2023-10-08T12:51:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.010+0000 7ff1ff890b80 1 -- 172.21.15.59:0/1804718574 wait complete. 2023-10-08T12:51:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.010+0000 7ff1ff890b80 1 -- start start 2023-10-08T12:51:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1ff890b80 1 Processor -- start 2023-10-08T12:51:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cabf00 0x558168cb7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 0x558168cb44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cb4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168bffeb0 con 0x558168cb76d0 2023-10-08T12:51:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168b9c790 con 0x558168cac820 2023-10-08T12:51:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168b9c430 con 0x558168cabf00 2023-10-08T12:51:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1ff890b80 10 client.0 _ll_register_callbacks cb 0x5581689f9880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1e9d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cabf00 0x558168cb7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1e9d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cabf00 0x558168cb7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58710/0 (socket says 172.21.15.59:58710) 2023-10-08T12:51:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1e9d9b700 1 -- 172.21.15.59:0/525169460 learned_addr learned my addr 172.21.15.59:0/525169460 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1ea59c700 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cb4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.011+0000 7ff1e959a700 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 0x558168cb44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1e9d9b700 1 -- 172.21.15.59:0/525169460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 msgr2=0x558168cb44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 0x558168cb44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1e9d9b700 1 -- 172.21.15.59:0/525169460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 msgr2=0x558168cb4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cb4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1e9d9b700 1 -- 172.21.15.59:0/525169460 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e41100b0 con 0x558168cabf00 2023-10-08T12:51:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cabf00 0x558168cb7160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff1e009a290 tx=0x7ff1e009a020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0b5cb775bae5d9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:51:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/525169460 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e009a590 con 0x558168cabf00 2023-10-08T12:51:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1ff890b80 1 -- 172.21.15.59:0/525169460 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558168bc7f30 con 0x558168cabf00 2023-10-08T12:51:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/525169460 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7ff1e009e6e0 con 0x558168cabf00 2023-10-08T12:51:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/525169460 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1e000cc90 con 0x558168cabf00 2023-10-08T12:51:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1ff890b80 10 client.26926 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.012+0000 7ff1ff890b80 1 -- 172.21.15.59:0/525169460 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7ff1e41a59f0 con 0x558168cabf00 2023-10-08T12:51:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.013+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/525169460 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558168bc7f30 con 0x558168cabf00 2023-10-08T12:51:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.013+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/525169460 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff1e0099ba0 con 0x558168cabf00 2023-10-08T12:51:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.013+0000 7ff1ff890b80 10 client.26926 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.013+0000 7ff1ff890b80 10 client.26926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.013+0000 7ff1ff890b80 20 client.26926 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.013+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558168cc6eb0 0x558168cc92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.013+0000 7ff1ff890b80 4 client.26926 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:51:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.013+0000 7ff1ff890b80 1 -- 172.21.15.59:0/525169460 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558168bf8e90 con 0x558168cc6eb0 2023-10-08T12:51:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.013+0000 7ff1e959a700 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558168cc6eb0 0x558168cc92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.014+0000 7ff1e959a700 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558168cc6eb0 0x558168cc92a0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6da61f0c33e9d62f server_cookie=cc99c390d3891d46 in_seq=0 out_seq=0 2023-10-08T12:51:45.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.014+0000 7ff1cd7fa700 10 client.26926 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/525169460 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558168bf8e90 con 0x558168cc6eb0 2023-10-08T12:51:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1cd7fa700 10 client.26926 handle_command_reply: tid=0 2023-10-08T12:51:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 1 client.26926 shutdown 2023-10-08T12:51:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 1 -- 172.21.15.59:0/525169460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cabf00 msgr2=0x558168cb7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cabf00 0x558168cb7160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff1e009a290 tx=0x7ff1e009a020 comp rx=0 tx=0).stop 2023-10-08T12:51:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 1 -- 172.21.15.59:0/525169460 shutdown_connections 2023-10-08T12:51:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558168cc6eb0 0x558168cc92a0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cb4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cabf00 0x558168cb7160 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/525169460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 0x558168cb44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1cd7fa700 0 client.26926 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 1 -- 172.21.15.59:0/525169460 >> 172.21.15.59:0/525169460 conn(0x558168c212e0 msgr2=0x558168ca7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 1 -- 172.21.15.59:0/525169460 shutdown_connections 2023-10-08T12:51:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 1 -- 172.21.15.59:0/525169460 wait complete. 2023-10-08T12:51:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.016+0000 7ff1ff890b80 20 client.26926 trim_cache size 0 max 16384 2023-10-08T12:51:45.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.034+0000 7ff1ff890b80 1 Processor -- start 2023-10-08T12:51:45.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.034+0000 7ff1ff890b80 1 -- start start 2023-10-08T12:51:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.034+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cabf00 0x558168ca8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 0x558168cbe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cb76d0 0x558168cb3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168a809a0 con 0x558168cabf00 2023-10-08T12:51:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168ca4b90 con 0x558168cac820 2023-10-08T12:51:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168ca2670 con 0x558168cb76d0 2023-10-08T12:51:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1e959a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 0x558168cbe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1ea59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cb76d0 0x558168cb3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1e959a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 0x558168cbe160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58578/0 (socket says 172.21.15.59:58578) 2023-10-08T12:51:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1ea59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cb76d0 0x558168cb3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58722/0 (socket says 172.21.15.59:58722) 2023-10-08T12:51:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1e959a700 1 -- 172.21.15.59:0/3398469270 learned_addr learned my addr 172.21.15.59:0/3398469270 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/3398469270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cabf00 0x558168ca8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1e959a700 1 -- 172.21.15.59:0/3398469270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cb76d0 msgr2=0x558168cb3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1e959a700 1 --2- 172.21.15.59:0/3398469270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cb76d0 0x558168cb3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1e959a700 1 -- 172.21.15.59:0/3398469270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cabf00 msgr2=0x558168ca8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1e959a700 1 --2- 172.21.15.59:0/3398469270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cabf00 0x558168ca8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.035+0000 7ff1e959a700 1 -- 172.21.15.59:0/3398469270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558168ccde90 con 0x558168cac820 2023-10-08T12:51:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.036+0000 7ff1e959a700 1 --2- 172.21.15.59:0/3398469270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 0x558168cbe160 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009990 tx=0x7ff1d4005ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9352a37f5f8fe404 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.036+0000 7ff1d8ff9700 1 -- 172.21.15.59:0/3398469270 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d400b750 con 0x558168cac820 2023-10-08T12:51:45.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.036+0000 7ff1d8ff9700 1 -- 172.21.15.59:0/3398469270 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1d401e040 con 0x558168cac820 2023-10-08T12:51:45.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.036+0000 7ff1d8ff9700 1 -- 172.21.15.59:0/3398469270 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4004a10 con 0x558168cac820 2023-10-08T12:51:45.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.036+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3398469270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 msgr2=0x558168cbe160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.036+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/3398469270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 0x558168cbe160 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009990 tx=0x7ff1d4005ab0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.037+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3398469270 shutdown_connections 2023-10-08T12:51:45.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.037+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/3398469270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cb76d0 0x558168cb3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.037+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/3398469270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cabf00 0x558168ca8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.037+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/3398469270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cac820 0x558168cbe160 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.037+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3398469270 >> 172.21.15.59:0/3398469270 conn(0x558168c212e0 msgr2=0x558168ca7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.037+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3398469270 shutdown_connections 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.037+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3398469270 wait complete. 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.037+0000 7ff1ff890b80 1 -- start start 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.037+0000 7ff1ff890b80 1 Processor -- start 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 0x558168cbc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 0x558168cbcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1ff890b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cbd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168d1ac80 con 0x558168cb76d0 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168d1adc0 con 0x558168cabf00 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1ff890b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558168d1af80 con 0x558168cac820 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1ff890b80 10 client.0 _ll_register_callbacks cb 0x7ff1e0005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1e959a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 0x558168cbcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1e9d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 0x558168cbc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1e959a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 0x558168cbcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58734/0 (socket says 172.21.15.59:58734) 2023-10-08T12:51:45.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1e959a700 1 -- 172.21.15.59:0/3566982158 learned_addr learned my addr 172.21.15.59:0/3566982158 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:45.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1ea59c700 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cbd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1e959a700 1 -- 172.21.15.59:0/3566982158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 msgr2=0x558168cbc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1e959a700 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 0x558168cbc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1e959a700 1 -- 172.21.15.59:0/3566982158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 msgr2=0x558168cbd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1e959a700 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cbd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1e959a700 1 -- 172.21.15.59:0/3566982158 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d4005320 con 0x558168cac820 2023-10-08T12:51:45.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1ea59c700 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cbd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:51:45.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.038+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 0x558168cbc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:45.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.039+0000 7ff1e959a700 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 0x558168cbcd80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4006010 tx=0x7ff1d4005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12143cb594ebc7d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.039+0000 7ff1cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:51:45.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.039+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/3566982158 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d400bb60 con 0x558168cac820 2023-10-08T12:51:45.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.039+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3566982158 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1e009ac90 con 0x558168cac820 2023-10-08T12:51:45.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.039+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/3566982158 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7ff1d400bcc0 con 0x558168cac820 2023-10-08T12:51:45.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.039+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/3566982158 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1d4004500 con 0x558168cac820 2023-10-08T12:51:45.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.039+0000 7ff1ff890b80 10 client.26932 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:45.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.039+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3566982158 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x558168a13ce0 con 0x558168cac820 2023-10-08T12:51:45.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.039+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/3566982158 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1d403f020 con 0x558168cac820 2023-10-08T12:51:45.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.040+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/3566982158 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff1d400f5d0 con 0x558168cac820 2023-10-08T12:51:45.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.040+0000 7ff1ff890b80 10 client.26932 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:45.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.040+0000 7ff1ff890b80 10 client.26932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:45.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.040+0000 7ff1ff890b80 20 client.26932 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:45.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.040+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558168d1c480 0x558168d1e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.040+0000 7ff1ff890b80 4 client.26932 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:51:45.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.040+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3566982158 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558168bf8bb0 con 0x558168d1c480 2023-10-08T12:51:45.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.040+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558168d1c480 0x558168d1e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.040+0000 7ff1e9d9b700 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558168d1c480 0x558168d1e8a0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e447fa18d41333 server_cookie=e8927cefb04a6c6d in_seq=0 out_seq=0 2023-10-08T12:51:45.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.040+0000 7ff1cd7fa700 10 client.26932 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:45.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.041+0000 7ff1cd7fa700 1 -- 172.21.15.59:0/3566982158 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558168bf8bb0 con 0x558168d1c480 2023-10-08T12:51:45.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.041+0000 7ff1cd7fa700 10 client.26932 handle_command_reply: tid=0 2023-10-08T12:51:45.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.041+0000 7ff1ff890b80 1 client.26932 shutdown 2023-10-08T12:51:45.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.041+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3566982158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 msgr2=0x558168cbcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.041+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 0x558168cbcd80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4006010 tx=0x7ff1d4005f10 comp rx=0 tx=0).stop 2023-10-08T12:51:45.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.041+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3566982158 shutdown_connections 2023-10-08T12:51:45.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.041+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558168d1c480 0x558168d1e8a0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.041+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558168cabf00 0x558168cbc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.041+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558168cb76d0 0x558168cbd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.041+0000 7ff1cd7fa700 0 client.26932 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:45.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.041+0000 7ff1ff890b80 1 --2- 172.21.15.59:0/3566982158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558168cac820 0x558168cbcd80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3566982158 >> 172.21.15.59:0/3566982158 conn(0x558168c212e0 msgr2=0x558168cb5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3566982158 shutdown_connections 2023-10-08T12:51:45.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ff890b80 1 -- 172.21.15.59:0/3566982158 wait complete. 2023-10-08T12:51:45.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ff890b80 20 client.26932 trim_cache size 0 max 16384 2023-10-08T12:51:45.049 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:51:45.049 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:51:45.049 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "4b813de8-42dd-43a2-acbd-03c4036b94de", 2023-10-08T12:51:45.049 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:51:45.049 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:51:45.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ebfff700 1 -- 172.21.15.59:0/579332708 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff1d00a15f0 msgr2=0x7ff1d00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ebfff700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff1d00a15f0 0x7ff1d00a3ab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc009fd0 tx=0x7ff1dc00b040 comp rx=0 tx=0).stop 2023-10-08T12:51:45.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ebfff700 1 -- 172.21.15.59:0/579332708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e4072ba0 msgr2=0x7ff1e4198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ebfff700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e4072ba0 0x7ff1e4198e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000eb30 tx=0x7ff1e000ee40 comp rx=0 tx=0).stop 2023-10-08T12:51:45.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ebfff700 1 -- 172.21.15.59:0/579332708 shutdown_connections 2023-10-08T12:51:45.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ebfff700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff1d00a15f0 0x7ff1d00a3ab0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ebfff700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e410d000 0x7ff1e419d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ebfff700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e4072ba0 0x7ff1e4198e60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ebfff700 1 --2- 172.21.15.59:0/579332708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1e40734c0 0x7ff1e41993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.042+0000 7ff1ebfff700 1 -- 172.21.15.59:0/579332708 >> 172.21.15.59:0/579332708 conn(0x7ff1e40fc230 msgr2=0x7ff1e40fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.043+0000 7ff1ebfff700 1 -- 172.21.15.59:0/579332708 shutdown_connections 2023-10-08T12:51:45.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.043+0000 7ff1ebfff700 1 -- 172.21.15.59:0/579332708 wait complete. 2023-10-08T12:51:45.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:51:45.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.275+0000 7f71cedff700 1 -- 172.21.15.59:0/4276643108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c8100730 msgr2=0x7f71c8100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.275+0000 7f71cedff700 1 --2- 172.21.15.59:0/4276643108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c8100730 0x7f71c8100bb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009990 tx=0x7f71b8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.275+0000 7f71cedff700 1 -- 172.21.15.59:0/4276643108 shutdown_connections 2023-10-08T12:51:45.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.275+0000 7f71cedff700 1 --2- 172.21.15.59:0/4276643108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c81010f0 0x7f71c810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.275+0000 7f71cedff700 1 --2- 172.21.15.59:0/4276643108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c8106740 0x7f71c8106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.275+0000 7f71cedff700 1 --2- 172.21.15.59:0/4276643108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c8100730 0x7f71c8100bb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.275+0000 7f71cedff700 1 -- 172.21.15.59:0/4276643108 >> 172.21.15.59:0/4276643108 conn(0x7f71c80fc200 msgr2=0x7f71c80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.275+0000 7f71cedff700 1 -- 172.21.15.59:0/4276643108 shutdown_connections 2023-10-08T12:51:45.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.275+0000 7f71cedff700 1 -- 172.21.15.59:0/4276643108 wait complete. 2023-10-08T12:51:45.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.276+0000 7f71cedff700 1 Processor -- start 2023-10-08T12:51:45.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.276+0000 7f71cedff700 1 -- start start 2023-10-08T12:51:45.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.276+0000 7f71cedff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c8100730 0x7f71c8198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.276+0000 7f71cedff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c81010f0 0x7f71c8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.276+0000 7f71cedff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8106740 0x7f71c819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.276+0000 7f71cedff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c819dce0 con 0x7f71c8100730 2023-10-08T12:51:45.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.276+0000 7f71cedff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c819de50 con 0x7f71c81010f0 2023-10-08T12:51:45.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.276+0000 7f71cedff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c819e010 con 0x7f71c8106740 2023-10-08T12:51:45.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.277+0000 7f71bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c81010f0 0x7f71c8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.277+0000 7f71ccb9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c8100730 0x7f71c8198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.277+0000 7f71bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c81010f0 0x7f71c8199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58600/0 (socket says 172.21.15.59:58600) 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.277+0000 7f71bffff700 1 -- 172.21.15.59:0/3148735910 learned_addr learned my addr 172.21.15.59:0/3148735910 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.277+0000 7f71cd39c700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8106740 0x7f71c819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.277+0000 7f71bffff700 1 -- 172.21.15.59:0/3148735910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8106740 msgr2=0x7f71c819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.277+0000 7f71bffff700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8106740 0x7f71c819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.277+0000 7f71bffff700 1 -- 172.21.15.59:0/3148735910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c8100730 msgr2=0x7f71c8198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.277+0000 7f71bffff700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c8100730 0x7f71c8198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.277+0000 7f71bffff700 1 -- 172.21.15.59:0/3148735910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4009520 con 0x7f71c81010f0 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.277+0000 7f71bffff700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c81010f0 0x7f71c8199300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f71b8000c00 tx=0x7f71b8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.278+0000 7f71bdffb700 1 -- 172.21.15.59:0/3148735910 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b801d070 con 0x7f71c81010f0 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.278+0000 7f71bdffb700 1 -- 172.21.15.59:0/3148735910 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71b8022470 con 0x7f71c81010f0 2023-10-08T12:51:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.278+0000 7f71cedff700 1 -- 172.21.15.59:0/3148735910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b80095f0 con 0x7f71c81010f0 2023-10-08T12:51:45.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.278+0000 7f71bdffb700 1 -- 172.21.15.59:0/3148735910 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b8017650 con 0x7f71c81010f0 2023-10-08T12:51:45.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.278+0000 7f71cedff700 1 -- 172.21.15.59:0/3148735910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c81a5950 con 0x7f71c81010f0 2023-10-08T12:51:45.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.281+0000 7f71bdffb700 1 -- 172.21.15.59:0/3148735910 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f71b80225e0 con 0x7f71c81010f0 2023-10-08T12:51:45.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.283+0000 7f71e278eb80 1 Processor -- start 2023-10-08T12:51:45.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.283+0000 7f71e278eb80 1 -- start start 2023-10-08T12:51:45.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.283+0000 7f71bdffb700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f71b00a1670 0x7f71b00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.283+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a1e80 0x55b1523a2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.283+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a27a0 0x55b1523ad110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.283+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523ad650 0x55b1523afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.283+0000 7f71e278eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b15230b460 con 0x55b1523a27a0 2023-10-08T12:51:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.283+0000 7f71e278eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1522fcc20 con 0x55b1523ad650 2023-10-08T12:51:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.283+0000 7f71e278eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1522fa540 con 0x55b1523a1e80 2023-10-08T12:51:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71bdffb700 1 -- 172.21.15.59:0/3148735910 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f71b80ce2c0 con 0x7f71c81010f0 2023-10-08T12:51:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71ccb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a1e80 0x55b1523a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71cd39c700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f71b00a1670 0x7f71b00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71ccb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a1e80 0x55b1523a2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58766/0 (socket says 172.21.15.59:58766) 2023-10-08T12:51:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71ccb9b700 1 -- 172.21.15.59:0/4174002489 learned_addr learned my addr 172.21.15.59:0/4174002489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71bffff700 1 --2- 172.21.15.59:0/4174002489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a27a0 0x55b1523ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71cd39c700 1 --2- 172.21.15.59:0/4174002489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523ad650 0x55b1523afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71ccb9b700 1 -- 172.21.15.59:0/4174002489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523ad650 msgr2=0x55b1523afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71ccb9b700 1 --2- 172.21.15.59:0/4174002489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523ad650 0x55b1523afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71ccb9b700 1 -- 172.21.15.59:0/4174002489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a27a0 msgr2=0x55b1523ad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71ccb9b700 1 --2- 172.21.15.59:0/4174002489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a27a0 0x55b1523ad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71ccb9b700 1 -- 172.21.15.59:0/4174002489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b152120de0 con 0x55b1523a1e80 2023-10-08T12:51:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71bffff700 1 --2- 172.21.15.59:0/4174002489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a27a0 0x55b1523ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:51:45.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.284+0000 7f71ccb9b700 1 --2- 172.21.15.59:0/4174002489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a1e80 0x55b1523a2260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f71c4009ec0 tx=0x7f71c4011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2976824520eba4c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.285+0000 7f71cd39c700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f71b00a1670 0x7f71b00a3b30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009ec0 tx=0x7f71c0009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.285+0000 7f71aeffd700 1 -- 172.21.15.59:0/4174002489 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400e670 con 0x55b1523a1e80 2023-10-08T12:51:45.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.285+0000 7f71aeffd700 1 -- 172.21.15.59:0/4174002489 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71c400ec90 con 0x55b1523a1e80 2023-10-08T12:51:45.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.285+0000 7f71aeffd700 1 -- 172.21.15.59:0/4174002489 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4019c90 con 0x55b1523a1e80 2023-10-08T12:51:45.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.285+0000 7f71e278eb80 1 -- 172.21.15.59:0/4174002489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a1e80 msgr2=0x55b1523a2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.285+0000 7f71e278eb80 1 --2- 172.21.15.59:0/4174002489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a1e80 0x55b1523a2260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f71c4009ec0 tx=0x7f71c4011720 comp rx=0 tx=0).stop 2023-10-08T12:51:45.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.286+0000 7f71e278eb80 1 -- 172.21.15.59:0/4174002489 shutdown_connections 2023-10-08T12:51:45.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.286+0000 7f71e278eb80 1 --2- 172.21.15.59:0/4174002489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523ad650 0x55b1523afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.286+0000 7f71e278eb80 1 --2- 172.21.15.59:0/4174002489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a1e80 0x55b1523a2260 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.286+0000 7f71e278eb80 1 --2- 172.21.15.59:0/4174002489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a27a0 0x55b1523ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.286+0000 7f71e278eb80 1 -- 172.21.15.59:0/4174002489 >> 172.21.15.59:0/4174002489 conn(0x55b152317260 msgr2=0x55b15239e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.286+0000 7f71e278eb80 1 -- 172.21.15.59:0/4174002489 shutdown_connections 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.286+0000 7f71e278eb80 1 -- 172.21.15.59:0/4174002489 wait complete. 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.286+0000 7f71e278eb80 1 -- start start 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.287+0000 7f71e278eb80 1 Processor -- start 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.287+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a1e80 0x55b1523acf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.287+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 0x55b1523aa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.287+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 0x55b1523aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.287+0000 7f71e278eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1522f5e30 con 0x55b1523a1e80 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.287+0000 7f71e278eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b152292710 con 0x55b1523a27a0 2023-10-08T12:51:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.287+0000 7f71e278eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1522923b0 con 0x55b1523ad650 2023-10-08T12:51:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71e278eb80 10 client.0 _ll_register_callbacks cb 0x55b1520ef800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 0x55b1523aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71ccb9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a1e80 0x55b1523acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 0x55b1523aa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:58608/0 (socket says 172.21.15.59:58608) 2023-10-08T12:51:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71bffff700 1 -- 172.21.15.59:0/3218805384 learned_addr learned my addr 172.21.15.59:0/3218805384 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71cd39c700 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 0x55b1523aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71bffff700 1 -- 172.21.15.59:0/3218805384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 msgr2=0x55b1523aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71bffff700 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 0x55b1523aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71bffff700 1 -- 172.21.15.59:0/3218805384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a1e80 msgr2=0x55b1523acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71bffff700 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a1e80 0x55b1523acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71bffff700 1 -- 172.21.15.59:0/3218805384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c4009af0 con 0x55b1523a27a0 2023-10-08T12:51:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71bffff700 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 0x55b1523aa250 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f71b8006010 tx=0x7f71b80565b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d61cdcd5a95cc3fa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.288+0000 7f71a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:51:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71a7fff700 1 -- 172.21.15.59:0/3218805384 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b809b8a0 con 0x55b1523a27a0 2023-10-08T12:51:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71e278eb80 1 -- 172.21.15.59:0/3218805384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1522bdeb0 con 0x55b1523a27a0 2023-10-08T12:51:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71a7fff700 1 -- 172.21.15.59:0/3218805384 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f71b80b0030 con 0x55b1523a27a0 2023-10-08T12:51:45.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71a7fff700 1 -- 172.21.15.59:0/3218805384 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71b809af80 con 0x55b1523a27a0 2023-10-08T12:51:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71e278eb80 10 client.26951 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71e278eb80 1 -- 172.21.15.59:0/3218805384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b152109c60 con 0x55b1523a27a0 2023-10-08T12:51:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71a7fff700 1 -- 172.21.15.59:0/3218805384 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b1522bdeb0 con 0x55b1523a27a0 2023-10-08T12:51:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71a7fff700 1 -- 172.21.15.59:0/3218805384 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f71b809a930 con 0x55b1523a27a0 2023-10-08T12:51:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71e278eb80 10 client.26951 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71e278eb80 10 client.26951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71e278eb80 20 client.26951 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71e278eb80 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b1523bcd20 0x55b1523bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71e278eb80 4 client.26951 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:51:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.289+0000 7f71e278eb80 1 -- 172.21.15.59:0/3218805384 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1522eee10 con 0x55b1523bcd20 2023-10-08T12:51:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.290+0000 7f71ccb9b700 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b1523bcd20 0x55b1523bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.290+0000 7f71a7fff700 10 client.26951 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.290+0000 7f71ccb9b700 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b1523bcd20 0x55b1523bf140 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e3d87979a2e15bd server_cookie=32ff20e24b942095 in_seq=0 out_seq=0 2023-10-08T12:51:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71a7fff700 1 -- 172.21.15.59:0/3218805384 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b1522eee10 con 0x55b1523bcd20 2023-10-08T12:51:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71a7fff700 10 client.26951 handle_command_reply: tid=0 2023-10-08T12:51:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71e278eb80 1 client.26951 shutdown 2023-10-08T12:51:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71e278eb80 1 -- 172.21.15.59:0/3218805384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 msgr2=0x55b1523aa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71e278eb80 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 0x55b1523aa250 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f71b8006010 tx=0x7f71b80565b0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71e278eb80 1 -- 172.21.15.59:0/3218805384 shutdown_connections 2023-10-08T12:51:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71e278eb80 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b1523bcd20 0x55b1523bf140 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71e278eb80 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 0x55b1523aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71e278eb80 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a1e80 0x55b1523acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71e278eb80 1 --2- 172.21.15.59:0/3218805384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 0x55b1523aa250 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71a7fff700 0 client.26951 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.291+0000 7f71e278eb80 1 -- 172.21.15.59:0/3218805384 >> 172.21.15.59:0/3218805384 conn(0x55b152317260 msgr2=0x55b15239dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.292+0000 7f71e278eb80 1 -- 172.21.15.59:0/3218805384 shutdown_connections 2023-10-08T12:51:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.292+0000 7f71e278eb80 1 -- 172.21.15.59:0/3218805384 wait complete. 2023-10-08T12:51:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.292+0000 7f71e278eb80 20 client.26951 trim_cache size 0 max 16384 2023-10-08T12:51:45.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.310+0000 7f71e278eb80 1 Processor -- start 2023-10-08T12:51:45.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71e278eb80 1 -- start start 2023-10-08T12:51:45.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a1e80 0x55b1523bf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a27a0 0x55b1523b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523ad650 0x55b1523acc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71e278eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b152176920 con 0x55b1523ad650 2023-10-08T12:51:45.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71e278eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1523aa040 con 0x55b1523a1e80 2023-10-08T12:51:45.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71e278eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1523b4750 con 0x55b1523a27a0 2023-10-08T12:51:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71ccb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a1e80 0x55b1523bf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71bffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a27a0 0x55b1523b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71cd39c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523ad650 0x55b1523acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71bffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a27a0 0x55b1523b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58788/0 (socket says 172.21.15.59:58788) 2023-10-08T12:51:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.311+0000 7f71bffff700 1 -- 172.21.15.59:0/4233099144 learned_addr learned my addr 172.21.15.59:0/4233099144 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.312+0000 7f71bffff700 1 -- 172.21.15.59:0/4233099144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a1e80 msgr2=0x55b1523bf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.312+0000 7f71bffff700 1 --2- 172.21.15.59:0/4233099144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a1e80 0x55b1523bf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.312+0000 7f71bffff700 1 -- 172.21.15.59:0/4233099144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523ad650 msgr2=0x55b1523acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.312+0000 7f71bffff700 1 --2- 172.21.15.59:0/4233099144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523ad650 0x55b1523acc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.312+0000 7f71bffff700 1 -- 172.21.15.59:0/4233099144 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b152147250 con 0x55b1523a27a0 2023-10-08T12:51:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.312+0000 7f71cd39c700 1 --2- 172.21.15.59:0/4233099144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523ad650 0x55b1523acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.312+0000 7f71bffff700 1 --2- 172.21.15.59:0/4233099144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a27a0 0x55b1523b4210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f71b800f740 tx=0x7f71b8009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aa2d0b923dfaf82 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.312+0000 7f71af7fe700 1 -- 172.21.15.59:0/4233099144 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b809af80 con 0x55b1523a27a0 2023-10-08T12:51:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.312+0000 7f71af7fe700 1 -- 172.21.15.59:0/4233099144 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71b8097780 con 0x55b1523a27a0 2023-10-08T12:51:45.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.312+0000 7f71af7fe700 1 -- 172.21.15.59:0/4233099144 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b809b900 con 0x55b1523a27a0 2023-10-08T12:51:45.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.313+0000 7f71e278eb80 1 -- 172.21.15.59:0/4233099144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a27a0 msgr2=0x55b1523b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.313+0000 7f71e278eb80 1 --2- 172.21.15.59:0/4233099144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a27a0 0x55b1523b4210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f71b800f740 tx=0x7f71b8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.313+0000 7f71e278eb80 1 -- 172.21.15.59:0/4233099144 shutdown_connections 2023-10-08T12:51:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.313+0000 7f71e278eb80 1 --2- 172.21.15.59:0/4233099144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a1e80 0x55b1523bf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.313+0000 7f71e278eb80 1 --2- 172.21.15.59:0/4233099144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523ad650 0x55b1523acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.313+0000 7f71e278eb80 1 --2- 172.21.15.59:0/4233099144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523a27a0 0x55b1523b4210 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.313+0000 7f71e278eb80 1 -- 172.21.15.59:0/4233099144 >> 172.21.15.59:0/4233099144 conn(0x55b152317260 msgr2=0x55b15239d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.313+0000 7f71e278eb80 1 -- 172.21.15.59:0/4233099144 shutdown_connections 2023-10-08T12:51:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.313+0000 7f71e278eb80 1 -- 172.21.15.59:0/4233099144 wait complete. 2023-10-08T12:51:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.313+0000 7f71e278eb80 1 -- start start 2023-10-08T12:51:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71e278eb80 1 Processor -- start 2023-10-08T12:51:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a1e80 0x55b1523b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 0x55b1523b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71e278eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 0x55b1523b2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71e278eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1523b4760 con 0x55b1523a1e80 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71e278eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1523b2da0 con 0x55b1523a27a0 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71e278eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1523b2f60 con 0x55b1523ad650 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71e278eb80 10 client.0 _ll_register_callbacks cb 0x7f71b800b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71cd39c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 0x55b1523b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71cd39c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 0x55b1523b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58794/0 (socket says 172.21.15.59:58794) 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71cd39c700 1 -- 172.21.15.59:0/636518677 learned_addr learned my addr 172.21.15.59:0/636518677 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71ccb9b700 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a1e80 0x55b1523b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.314+0000 7f71bffff700 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 0x55b1523b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71cd39c700 1 -- 172.21.15.59:0/636518677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 msgr2=0x55b1523b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71cd39c700 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 0x55b1523b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71cd39c700 1 -- 172.21.15.59:0/636518677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a1e80 msgr2=0x55b1523b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71cd39c700 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a1e80 0x55b1523b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71cd39c700 1 -- 172.21.15.59:0/636518677 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c00090f0 con 0x55b1523ad650 2023-10-08T12:51:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71cd39c700 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 0x55b1523b2860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f71c0018c70 tx=0x7f71c000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f94931110347b3c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:51:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71a7fff700 1 -- 172.21.15.59:0/636518677 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c000e040 con 0x55b1523ad650 2023-10-08T12:51:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71e278eb80 1 -- 172.21.15.59:0/636518677 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71c400ec90 con 0x55b1523ad650 2023-10-08T12:51:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71a7fff700 1 -- 172.21.15.59:0/636518677 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f71c0003a00 con 0x55b1523ad650 2023-10-08T12:51:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71a7fff700 1 -- 172.21.15.59:0/636518677 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71c0003c00 con 0x55b1523ad650 2023-10-08T12:51:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71e278eb80 10 client.26950 fetch_fsmap learned FSMap version 20 2023-10-08T12:51:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.315+0000 7f71e278eb80 1 -- 172.21.15.59:0/636518677 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b152109c60 con 0x55b1523ad650 2023-10-08T12:51:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.316+0000 7f71a7fff700 1 -- 172.21.15.59:0/636518677 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71c400ec90 con 0x55b1523ad650 2023-10-08T12:51:45.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.316+0000 7f71a7fff700 1 -- 172.21.15.59:0/636518677 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f71c00043b0 con 0x55b1523ad650 2023-10-08T12:51:45.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.316+0000 7f71e278eb80 10 client.26950 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:51:45.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.316+0000 7f71e278eb80 10 client.26950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:45.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.316+0000 7f71e278eb80 20 client.26950 populate_metadata read hostname 'smithi059' 2023-10-08T12:51:45.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.316+0000 7f71e278eb80 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b152412030 0x55b152414450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:45.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.316+0000 7f71e278eb80 4 client.26950 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:51:45.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.316+0000 7f71e278eb80 1 -- 172.21.15.59:0/636518677 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b1522eeb30 con 0x55b152412030 2023-10-08T12:51:45.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.316+0000 7f71ccb9b700 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b152412030 0x55b152414450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:45.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.317+0000 7f71ccb9b700 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b152412030 0x55b152414450 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44b0705fa482a729 server_cookie=1d84c11ff733932e in_seq=0 out_seq=0 2023-10-08T12:51:45.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.317+0000 7f71a7fff700 10 client.26950 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:45.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71a7fff700 1 -- 172.21.15.59:0/636518677 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b1522eeb30 con 0x55b152412030 2023-10-08T12:51:45.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71a7fff700 10 client.26950 handle_command_reply: tid=0 2023-10-08T12:51:45.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71e278eb80 1 client.26950 shutdown 2023-10-08T12:51:45.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71e278eb80 1 -- 172.21.15.59:0/636518677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 msgr2=0x55b1523b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71e278eb80 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 0x55b1523b2860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f71c0018c70 tx=0x7f71c000b040 comp rx=0 tx=0).stop 2023-10-08T12:51:45.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71e278eb80 1 -- 172.21.15.59:0/636518677 shutdown_connections 2023-10-08T12:51:45.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71e278eb80 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b152412030 0x55b152414450 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71e278eb80 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1523ad650 0x55b1523b2860 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71e278eb80 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1523a1e80 0x55b1523b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71e278eb80 1 --2- 172.21.15.59:0/636518677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1523a27a0 0x55b1523b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71a7fff700 0 client.26950 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:51:45.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71e278eb80 1 -- 172.21.15.59:0/636518677 >> 172.21.15.59:0/636518677 conn(0x55b152317260 msgr2=0x55b1523a55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71e278eb80 1 -- 172.21.15.59:0/636518677 shutdown_connections 2023-10-08T12:51:45.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.318+0000 7f71e278eb80 1 -- 172.21.15.59:0/636518677 wait complete. 2023-10-08T12:51:45.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71e278eb80 20 client.26950 trim_cache size 0 max 16384 2023-10-08T12:51:45.324 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:51:45.324 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:51:45.324 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:51:45.324 INFO:teuthology.orchestra.run.smithi059.stdout: "4b813de8-42dd-43a2-acbd-03c4036b94de": { 2023-10-08T12:51:45.324 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:51:45.324 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "4b813de8-42dd-43a2-acbd-03c4036b94de", 2023-10-08T12:51:45.324 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:51:45.324 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:51:45.325 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:51:45.325 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:51:45.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 -- 172.21.15.59:0/3148735910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f71b00a1670 msgr2=0x7f71b00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f71b00a1670 0x7f71b00a3b30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009ec0 tx=0x7f71c0009920 comp rx=0 tx=0).stop 2023-10-08T12:51:45.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 -- 172.21.15.59:0/3148735910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c81010f0 msgr2=0x7f71c8199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:45.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c81010f0 0x7f71c8199300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f71b8000c00 tx=0x7f71b8005740 comp rx=0 tx=0).stop 2023-10-08T12:51:45.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 -- 172.21.15.59:0/3148735910 shutdown_connections 2023-10-08T12:51:45.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f71b00a1670 0x7f71b00a3b30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8106740 0x7f71c819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c8100730 0x7f71c8198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 --2- 172.21.15.59:0/3148735910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c81010f0 0x7f71c8199300 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:45.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 -- 172.21.15.59:0/3148735910 >> 172.21.15.59:0/3148735910 conn(0x7f71c80fc200 msgr2=0x7f71c80fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:45.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 -- 172.21.15.59:0/3148735910 shutdown_connections 2023-10-08T12:51:45.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:51:45.319+0000 7f71cedff700 1 -- 172.21.15.59:0/3148735910 wait complete. 2023-10-08T12:51:45.338 INFO:tasks.cephfs.filesystem:scrub status for tag:4b813de8-42dd-43a2-acbd-03c4036b94de - {'path': '/', 'tag': '4b813de8-42dd-43a2-acbd-03c4036b94de', 'options': 'recursive,force'} 2023-10-08T12:51:45.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1342593 12.68 MB/sec execute 436 sec latency 16.979 ms 2023-10-08T12:51:46.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:46 smithi092 ceph-mon[134093]: pgmap v639: 97 pgs: 97 active+clean; 578 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.5 MiB/s wr, 209 op/s 2023-10-08T12:51:46.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:46 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:51:46.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:46 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:46.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:46 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:51:46.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:46 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:46.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:46 smithi173 ceph-mon[135182]: pgmap v639: 97 pgs: 97 active+clean; 578 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.5 MiB/s wr, 209 op/s 2023-10-08T12:51:46.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:46 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:51:46.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:46 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:46.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:46 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:51:46.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:46 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:46.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:46 smithi059 ceph-mon[98489]: pgmap v639: 97 pgs: 97 active+clean; 578 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.5 MiB/s wr, 209 op/s 2023-10-08T12:51:46.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:46 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:51:46.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:46 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:46.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:46 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:51:46.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:46 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:51:46.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1344251 12.67 MB/sec execute 437 sec latency 18.725 ms 2023-10-08T12:51:47.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:47 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:47.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:47 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:47.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:47 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:51:47.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:47 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:51:47.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:47 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:47.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:47 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:47.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:47 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:47.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:47 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:51:47.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:47 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:51:47.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:47 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:47.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:47 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:47.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:47 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:47.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:47 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:51:47.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:47 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:51:47.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:47 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:51:47.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1346592 12.67 MB/sec execute 438 sec latency 39.827 ms 2023-10-08T12:51:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:48 smithi092 ceph-mon[134093]: pgmap v640: 97 pgs: 97 active+clean; 583 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 215 op/s 2023-10-08T12:51:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:48 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:51:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:48 smithi173 ceph-mon[135182]: pgmap v640: 97 pgs: 97 active+clean; 583 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 215 op/s 2023-10-08T12:51:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:48 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:51:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:48 smithi059 ceph-mon[98489]: pgmap v640: 97 pgs: 97 active+clean; 583 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 215 op/s 2023-10-08T12:51:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:48 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:51:48.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1348704 12.67 MB/sec execute 439 sec latency 87.545 ms 2023-10-08T12:51:49.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1350704 12.66 MB/sec execute 440 sec latency 28.266 ms 2023-10-08T12:51:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:49 smithi173 ceph-mon[135182]: pgmap v641: 97 pgs: 97 active+clean; 590 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 239 op/s 2023-10-08T12:51:50.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:49 smithi059 ceph-mon[98489]: pgmap v641: 97 pgs: 97 active+clean; 590 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 239 op/s 2023-10-08T12:51:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:49 smithi092 ceph-mon[134093]: pgmap v641: 97 pgs: 97 active+clean; 590 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 239 op/s 2023-10-08T12:51:50.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1353361 12.67 MB/sec execute 441 sec latency 13.344 ms 2023-10-08T12:51:51.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1355426 12.66 MB/sec execute 442 sec latency 21.457 ms 2023-10-08T12:51:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:52 smithi092 ceph-mon[134093]: pgmap v642: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 226 op/s 2023-10-08T12:51:52.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:52 smithi173 ceph-mon[135182]: pgmap v642: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 226 op/s 2023-10-08T12:51:52.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:52 smithi059 ceph-mon[98489]: pgmap v642: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 226 op/s 2023-10-08T12:51:52.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1356914 12.66 MB/sec execute 443 sec latency 245.925 ms 2023-10-08T12:51:53.542 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1358635 12.64 MB/sec execute 444 sec latency 97.604 ms 2023-10-08T12:51:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:54 smithi092 ceph-mon[134093]: pgmap v643: 97 pgs: 97 active+clean; 607 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-10-08T12:51:54.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:54 smithi173 ceph-mon[135182]: pgmap v643: 97 pgs: 97 active+clean; 607 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-10-08T12:51:54.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:54 smithi059 ceph-mon[98489]: pgmap v643: 97 pgs: 97 active+clean; 607 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-10-08T12:51:54.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1360825 12.64 MB/sec execute 445 sec latency 44.406 ms 2023-10-08T12:51:55.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1363730 12.65 MB/sec execute 446 sec latency 12.240 ms 2023-10-08T12:51:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:56 smithi092 ceph-mon[134093]: pgmap v644: 97 pgs: 97 active+clean; 607 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 216 op/s 2023-10-08T12:51:56.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:56 smithi173 ceph-mon[135182]: pgmap v644: 97 pgs: 97 active+clean; 607 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 216 op/s 2023-10-08T12:51:56.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:56 smithi059 ceph-mon[98489]: pgmap v644: 97 pgs: 97 active+clean; 607 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 216 op/s 2023-10-08T12:51:56.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1365524 12.64 MB/sec execute 447 sec latency 17.646 ms 2023-10-08T12:51:57.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1367690 12.64 MB/sec execute 448 sec latency 81.080 ms 2023-10-08T12:51:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:58 smithi092 ceph-mon[134093]: pgmap v645: 97 pgs: 97 active+clean; 608 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 232 op/s 2023-10-08T12:51:58.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:58 smithi173 ceph-mon[135182]: pgmap v645: 97 pgs: 97 active+clean; 608 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 232 op/s 2023-10-08T12:51:58.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:58 smithi059 ceph-mon[98489]: pgmap v645: 97 pgs: 97 active+clean; 608 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 232 op/s 2023-10-08T12:51:58.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1369651 12.63 MB/sec execute 449 sec latency 44.889 ms 2023-10-08T12:51:59.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1371609 12.63 MB/sec execute 450 sec latency 45.581 ms 2023-10-08T12:52:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:51:59 smithi173 ceph-mon[135182]: pgmap v646: 97 pgs: 97 active+clean; 612 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 246 op/s 2023-10-08T12:52:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:51:59 smithi059 ceph-mon[98489]: pgmap v646: 97 pgs: 97 active+clean; 612 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 246 op/s 2023-10-08T12:52:00.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:51:59 smithi092 ceph-mon[134093]: pgmap v646: 97 pgs: 97 active+clean; 612 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 246 op/s 2023-10-08T12:52:00.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1373965 12.63 MB/sec execute 451 sec latency 29.047 ms 2023-10-08T12:52:01.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1375032 12.62 MB/sec execute 452 sec latency 70.225 ms 2023-10-08T12:52:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:02 smithi092 ceph-mon[134093]: pgmap v647: 97 pgs: 97 active+clean; 588 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 236 op/s 2023-10-08T12:52:02.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:02 smithi173 ceph-mon[135182]: pgmap v647: 97 pgs: 97 active+clean; 588 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 236 op/s 2023-10-08T12:52:02.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:02 smithi059 ceph-mon[98489]: pgmap v647: 97 pgs: 97 active+clean; 588 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 236 op/s 2023-10-08T12:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1376694 12.65 MB/sec execute 453 sec latency 58.809 ms 2023-10-08T12:52:03.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1378869 12.65 MB/sec execute 454 sec latency 142.795 ms 2023-10-08T12:52:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:04 smithi092 ceph-mon[134093]: pgmap v648: 97 pgs: 97 active+clean; 565 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 235 op/s 2023-10-08T12:52:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:04 smithi092 ceph-mon[134093]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T12:52:04.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:04 smithi173 ceph-mon[135182]: pgmap v648: 97 pgs: 97 active+clean; 565 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 235 op/s 2023-10-08T12:52:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:04 smithi173 ceph-mon[135182]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T12:52:04.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:04 smithi059 ceph-mon[98489]: pgmap v648: 97 pgs: 97 active+clean; 565 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 235 op/s 2023-10-08T12:52:04.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:04 smithi059 ceph-mon[98489]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T12:52:04.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1380286 12.63 MB/sec execute 455 sec latency 68.827 ms 2023-10-08T12:52:05.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1382664 12.64 MB/sec execute 456 sec latency 32.057 ms 2023-10-08T12:52:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:06 smithi092 ceph-mon[134093]: pgmap v650: 97 pgs: 97 active+clean; 566 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 232 op/s 2023-10-08T12:52:06.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:06 smithi173 ceph-mon[135182]: pgmap v650: 97 pgs: 97 active+clean; 566 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 232 op/s 2023-10-08T12:52:06.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:06 smithi059 ceph-mon[98489]: pgmap v650: 97 pgs: 97 active+clean; 566 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 232 op/s 2023-10-08T12:52:06.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1385146 12.64 MB/sec execute 457 sec latency 13.363 ms 2023-10-08T12:52:07.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1387290 12.63 MB/sec execute 458 sec latency 14.044 ms 2023-10-08T12:52:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:08 smithi092 ceph-mon[134093]: pgmap v651: 97 pgs: 97 active+clean; 574 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 270 op/s 2023-10-08T12:52:08.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:08 smithi173 ceph-mon[135182]: pgmap v651: 97 pgs: 97 active+clean; 574 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 270 op/s 2023-10-08T12:52:08.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:08 smithi059 ceph-mon[98489]: pgmap v651: 97 pgs: 97 active+clean; 574 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 270 op/s 2023-10-08T12:52:08.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1389642 12.64 MB/sec execute 459 sec latency 30.175 ms 2023-10-08T12:52:09.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1391206 12.62 MB/sec execute 460 sec latency 101.344 ms 2023-10-08T12:52:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:09 smithi173 ceph-mon[135182]: pgmap v652: 97 pgs: 97 active+clean; 580 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 245 op/s 2023-10-08T12:52:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:09 smithi059 ceph-mon[98489]: pgmap v652: 97 pgs: 97 active+clean; 580 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 245 op/s 2023-10-08T12:52:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:09 smithi092 ceph-mon[134093]: pgmap v652: 97 pgs: 97 active+clean; 580 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 245 op/s 2023-10-08T12:52:10.543 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1393452 12.62 MB/sec execute 461 sec latency 28.340 ms 2023-10-08T12:52:11.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1396021 12.63 MB/sec execute 462 sec latency 17.042 ms 2023-10-08T12:52:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:12 smithi092 ceph-mon[134093]: pgmap v653: 97 pgs: 97 active+clean; 592 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.6 MiB/s wr, 271 op/s 2023-10-08T12:52:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:12 smithi173 ceph-mon[135182]: pgmap v653: 97 pgs: 97 active+clean; 592 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.6 MiB/s wr, 271 op/s 2023-10-08T12:52:12.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:12 smithi059 ceph-mon[98489]: pgmap v653: 97 pgs: 97 active+clean; 592 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.6 MiB/s wr, 271 op/s 2023-10-08T12:52:12.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1398005 12.62 MB/sec execute 463 sec latency 16.317 ms 2023-10-08T12:52:13.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1400384 12.62 MB/sec execute 464 sec latency 28.091 ms 2023-10-08T12:52:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:14 smithi092 ceph-mon[134093]: pgmap v654: 97 pgs: 97 active+clean; 593 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 244 op/s 2023-10-08T12:52:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:14 smithi092 ceph-mon[134093]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T12:52:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:14 smithi173 ceph-mon[135182]: pgmap v654: 97 pgs: 97 active+clean; 593 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 244 op/s 2023-10-08T12:52:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:14 smithi173 ceph-mon[135182]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T12:52:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:14 smithi059 ceph-mon[98489]: pgmap v654: 97 pgs: 97 active+clean; 593 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 244 op/s 2023-10-08T12:52:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:14 smithi059 ceph-mon[98489]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T12:52:14.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1402107 12.61 MB/sec execute 465 sec latency 113.993 ms 2023-10-08T12:52:15.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:52:15.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1404149 12.61 MB/sec execute 466 sec latency 26.258 ms 2023-10-08T12:52:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.553+0000 7f9d279ff700 1 -- 172.21.15.59:0/1925815560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d20073540 msgr2=0x7f9d2010ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.553+0000 7f9d279ff700 1 --2- 172.21.15.59:0/1925815560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d20073540 0x7f9d2010ca40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9d100098f0 tx=0x7f9d10009c00 comp rx=0 tx=0).stop 2023-10-08T12:52:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.553+0000 7f9d279ff700 1 -- 172.21.15.59:0/1925815560 shutdown_connections 2023-10-08T12:52:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.553+0000 7f9d279ff700 1 --2- 172.21.15.59:0/1925815560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d2010cf80 0x7f9d2010f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.553+0000 7f9d279ff700 1 --2- 172.21.15.59:0/1925815560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d20072c20 0x7f9d20073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.553+0000 7f9d279ff700 1 --2- 172.21.15.59:0/1925815560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d20073540 0x7f9d2010ca40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.553+0000 7f9d279ff700 1 -- 172.21.15.59:0/1925815560 >> 172.21.15.59:0/1925815560 conn(0x7f9d200fc230 msgr2=0x7f9d200fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:15.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.553+0000 7f9d279ff700 1 -- 172.21.15.59:0/1925815560 shutdown_connections 2023-10-08T12:52:15.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.553+0000 7f9d279ff700 1 -- 172.21.15.59:0/1925815560 wait complete. 2023-10-08T12:52:15.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.554+0000 7f9d279ff700 1 Processor -- start 2023-10-08T12:52:15.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.554+0000 7f9d279ff700 1 -- start start 2023-10-08T12:52:15.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.554+0000 7f9d279ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d20072c20 0x7f9d20198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.554+0000 7f9d279ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d20073540 0x7f9d201993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.554+0000 7f9d279ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d2010cf80 0x7f9d2019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.554+0000 7f9d279ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2019ddc0 con 0x7f9d2010cf80 2023-10-08T12:52:15.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.554+0000 7f9d279ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2019df30 con 0x7f9d20073540 2023-10-08T12:52:15.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.554+0000 7f9d279ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2019e0f0 con 0x7f9d20072c20 2023-10-08T12:52:15.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.554+0000 7f9d2579b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d20072c20 0x7f9d20198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.555+0000 7f9d2579b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d20072c20 0x7f9d20198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58430/0 (socket says 172.21.15.59:58430) 2023-10-08T12:52:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.555+0000 7f9d2579b700 1 -- 172.21.15.59:0/361585597 learned_addr learned my addr 172.21.15.59:0/361585597 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.555+0000 7f9d24f9a700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d20073540 0x7f9d201993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.555+0000 7f9d25f9c700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d2010cf80 0x7f9d2019d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.555+0000 7f9d2579b700 1 -- 172.21.15.59:0/361585597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d20073540 msgr2=0x7f9d201993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.555+0000 7f9d2579b700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d20073540 0x7f9d201993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.555+0000 7f9d2579b700 1 -- 172.21.15.59:0/361585597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d2010cf80 msgr2=0x7f9d2019d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.555+0000 7f9d2579b700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d2010cf80 0x7f9d2019d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.555+0000 7f9d2579b700 1 -- 172.21.15.59:0/361585597 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c009520 con 0x7f9d20072c20 2023-10-08T12:52:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.555+0000 7f9d25f9c700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d2010cf80 0x7f9d2019d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.555+0000 7f9d2579b700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d20072c20 0x7f9d20198ea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00eb30 tx=0x7f9d1c00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.556+0000 7f9d167fc700 1 -- 172.21.15.59:0/361585597 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c009880 con 0x7f9d20072c20 2023-10-08T12:52:15.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.556+0000 7f9d279ff700 1 -- 172.21.15.59:0/361585597 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d10009520 con 0x7f9d20072c20 2023-10-08T12:52:15.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.556+0000 7f9d167fc700 1 -- 172.21.15.59:0/361585597 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d1c0044e0 con 0x7f9d20072c20 2023-10-08T12:52:15.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.556+0000 7f9d167fc700 1 -- 172.21.15.59:0/361585597 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c003e90 con 0x7f9d20072c20 2023-10-08T12:52:15.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.556+0000 7f9d279ff700 1 -- 172.21.15.59:0/361585597 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d201a5a30 con 0x7f9d20072c20 2023-10-08T12:52:15.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.560+0000 7f9d167fc700 1 -- 172.21.15.59:0/361585597 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9d1c004000 con 0x7f9d20072c20 2023-10-08T12:52:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.561+0000 7f9d3b239b80 1 Processor -- start 2023-10-08T12:52:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.561+0000 7f9d167fc700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9d0c0a15f0 0x7f9d0c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.561+0000 7f9d3b239b80 1 -- start start 2023-10-08T12:52:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.561+0000 7f9d167fc700 1 -- 172.21.15.59:0/361585597 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9d1c014070 con 0x7f9d20072c20 2023-10-08T12:52:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.561+0000 7f9d25f9c700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9d0c0a15f0 0x7f9d0c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114fa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114fa7a0 0x564511505110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564511505650 0x564511507a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564511463460 con 0x5645114fa7a0 2023-10-08T12:52:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564511454c20 con 0x5645114f9e80 2023-10-08T12:52:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564511452540 con 0x564511505650 2023-10-08T12:52:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d2579b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114fa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d2579b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114fa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:56958/0 (socket says 172.21.15.59:56958) 2023-10-08T12:52:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d2579b700 1 -- 172.21.15.59:0/3328611393 learned_addr learned my addr 172.21.15.59:0/3328611393 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d24f9a700 1 --2- 172.21.15.59:0/3328611393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114fa7a0 0x564511505110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d25f9c700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9d0c0a15f0 0x7f9d0c0a3ab0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9d180093a0 tx=0x7f9d1800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d25f9c700 1 --2- 172.21.15.59:0/3328611393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564511505650 0x564511507a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d2579b700 1 -- 172.21.15.59:0/3328611393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564511505650 msgr2=0x564511507a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d2579b700 1 --2- 172.21.15.59:0/3328611393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564511505650 0x564511507a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d2579b700 1 -- 172.21.15.59:0/3328611393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114fa7a0 msgr2=0x564511505110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:15.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d2579b700 1 --2- 172.21.15.59:0/3328611393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114fa7a0 0x564511505110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.562+0000 7f9d2579b700 1 -- 172.21.15.59:0/3328611393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564511278de0 con 0x5645114f9e80 2023-10-08T12:52:15.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.563+0000 7f9d2579b700 1 --2- 172.21.15.59:0/3328611393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114fa260 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00eb00 tx=0x7f9d1c0969c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be791ec209c33c4b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:15.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.563+0000 7f9d0b7fe700 1 -- 172.21.15.59:0/3328611393 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c016330 con 0x5645114f9e80 2023-10-08T12:52:15.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.563+0000 7f9d0b7fe700 1 -- 172.21.15.59:0/3328611393 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d1c09ac80 con 0x5645114f9e80 2023-10-08T12:52:15.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.563+0000 7f9d0b7fe700 1 -- 172.21.15.59:0/3328611393 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c096c90 con 0x5645114f9e80 2023-10-08T12:52:15.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.564+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3328611393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 msgr2=0x5645114fa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.564+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/3328611393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114fa260 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00eb00 tx=0x7f9d1c0969c0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.564+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3328611393 shutdown_connections 2023-10-08T12:52:15.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.564+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/3328611393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114fa260 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.564+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/3328611393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564511505650 0x564511507a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.564+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/3328611393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114fa7a0 0x564511505110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.564+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3328611393 >> 172.21.15.59:0/3328611393 conn(0x56451146f260 msgr2=0x5645114f62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.564+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3328611393 shutdown_connections 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.564+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3328611393 wait complete. 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.564+0000 7f9d3b239b80 1 -- start start 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.565+0000 7f9d3b239b80 1 Processor -- start 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.565+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114f9e80 0x5645115050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114fa7a0 0x5645115023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564511505650 0x564511502aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56451144de30 con 0x5645114f9e80 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645113ea710 con 0x564511505650 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645113ea3b0 con 0x5645114fa7a0 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d3b239b80 10 client.0 _ll_register_callbacks cb 0x564511247800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d24f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114fa7a0 0x5645115023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d25f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564511505650 0x564511502aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d24f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114fa7a0 0x5645115023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58448/0 (socket says 172.21.15.59:58448) 2023-10-08T12:52:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d24f9a700 1 -- 172.21.15.59:0/3775630215 learned_addr learned my addr 172.21.15.59:0/3775630215 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d2579b700 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114f9e80 0x5645115050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d25f9c700 1 -- 172.21.15.59:0/3775630215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114fa7a0 msgr2=0x5645115023b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d25f9c700 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114fa7a0 0x5645115023b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d25f9c700 1 -- 172.21.15.59:0/3775630215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114f9e80 msgr2=0x5645115050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d25f9c700 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114f9e80 0x5645115050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.566+0000 7f9d25f9c700 1 -- 172.21.15.59:0/3775630215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d201a5a30 con 0x564511505650 2023-10-08T12:52:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.567+0000 7f9d25f9c700 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564511505650 0x564511502aa0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9d18006280 tx=0x7f9d18004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a40273a6aa0b02d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.567+0000 7f9d08ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.567+0000 7f9d08ff9700 1 -- 172.21.15.59:0/3775630215 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800e050 con 0x564511505650 2023-10-08T12:52:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.567+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3775630215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564511415eb0 con 0x564511505650 2023-10-08T12:52:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.567+0000 7f9d08ff9700 1 -- 172.21.15.59:0/3775630215 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9d18015e10 con 0x564511505650 2023-10-08T12:52:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.567+0000 7f9d08ff9700 1 -- 172.21.15.59:0/3775630215 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d18009b80 con 0x564511505650 2023-10-08T12:52:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.567+0000 7f9d3b239b80 10 client.26969 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.567+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3775630215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x564511261c60 con 0x564511505650 2023-10-08T12:52:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.568+0000 7f9d08ff9700 1 -- 172.21.15.59:0/3775630215 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564511415eb0 con 0x564511505650 2023-10-08T12:52:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.568+0000 7f9d08ff9700 1 -- 172.21.15.59:0/3775630215 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9d1802a4d0 con 0x564511505650 2023-10-08T12:52:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.568+0000 7f9d3b239b80 10 client.26969 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.568+0000 7f9d3b239b80 10 client.26969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.568+0000 7f9d3b239b80 20 client.26969 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:15.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.568+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564511515290 0x5645115176b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.568+0000 7f9d3b239b80 4 client.26969 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:15.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.568+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3775630215 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564511446e10 con 0x564511515290 2023-10-08T12:52:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.568+0000 7f9d2579b700 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564511515290 0x5645115176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.569+0000 7f9d2579b700 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564511515290 0x5645115176b0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f62037a9a1cfa218 server_cookie=8bd2f708df675e92 in_seq=0 out_seq=0 2023-10-08T12:52:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.569+0000 7f9d08ff9700 10 client.26969 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.569+0000 7f9d08ff9700 1 -- 172.21.15.59:0/3775630215 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564511446e10 con 0x564511515290 2023-10-08T12:52:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.569+0000 7f9d08ff9700 10 client.26969 handle_command_reply: tid=0 2023-10-08T12:52:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.569+0000 7f9d3b239b80 1 client.26969 shutdown 2023-10-08T12:52:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3775630215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564511505650 msgr2=0x564511502aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564511505650 0x564511502aa0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9d18006280 tx=0x7f9d18004ad0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3775630215 shutdown_connections 2023-10-08T12:52:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564511515290 0x5645115176b0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564511505650 0x564511502aa0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114f9e80 0x5645115050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/3775630215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114fa7a0 0x5645115023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d08ff9700 0 client.26969 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3775630215 >> 172.21.15.59:0/3775630215 conn(0x56451146f260 msgr2=0x5645114f5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3775630215 shutdown_connections 2023-10-08T12:52:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d3b239b80 1 -- 172.21.15.59:0/3775630215 wait complete. 2023-10-08T12:52:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.570+0000 7f9d3b239b80 20 client.26969 trim_cache size 0 max 16384 2023-10-08T12:52:15.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.588+0000 7f9d3b239b80 1 Processor -- start 2023-10-08T12:52:15.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d3b239b80 1 -- start start 2023-10-08T12:52:15.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114f6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114fa7a0 0x5645114fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564511505650 0x56451150c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645112ce920 con 0x5645114fa7a0 2023-10-08T12:52:15.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645114f05a0 con 0x5645114f9e80 2023-10-08T12:52:15.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56451150c710 con 0x564511505650 2023-10-08T12:52:15.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d2579b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d2579b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114f6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:56968/0 (socket says 172.21.15.59:56968) 2023-10-08T12:52:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d2579b700 1 -- 172.21.15.59:0/1729025673 learned_addr learned my addr 172.21.15.59:0/1729025673 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d24f9a700 1 --2- 172.21.15.59:0/1729025673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114fa7a0 0x5645114fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.589+0000 7f9d25f9c700 1 --2- 172.21.15.59:0/1729025673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564511505650 0x56451150c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.590+0000 7f9d2579b700 1 -- 172.21.15.59:0/1729025673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564511505650 msgr2=0x56451150c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.590+0000 7f9d2579b700 1 --2- 172.21.15.59:0/1729025673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564511505650 0x56451150c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.590+0000 7f9d2579b700 1 -- 172.21.15.59:0/1729025673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114fa7a0 msgr2=0x5645114fcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.590+0000 7f9d2579b700 1 --2- 172.21.15.59:0/1729025673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114fa7a0 0x5645114fcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.590+0000 7f9d2579b700 1 -- 172.21.15.59:0/1729025673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56451129f250 con 0x5645114f9e80 2023-10-08T12:52:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.590+0000 7f9d25f9c700 1 --2- 172.21.15.59:0/1729025673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564511505650 0x56451150c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.590+0000 7f9d2579b700 1 --2- 172.21.15.59:0/1729025673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114f6480 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c09a280 tx=0x7f9d1c09a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e094c11189cf7c0f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:15.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.590+0000 7f9d0bfff700 1 -- 172.21.15.59:0/1729025673 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c00cd10 con 0x5645114f9e80 2023-10-08T12:52:15.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.590+0000 7f9d0bfff700 1 -- 172.21.15.59:0/1729025673 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d1c09e6d0 con 0x5645114f9e80 2023-10-08T12:52:15.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.590+0000 7f9d0bfff700 1 -- 172.21.15.59:0/1729025673 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c09a7e0 con 0x5645114f9e80 2023-10-08T12:52:15.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.591+0000 7f9d3b239b80 1 -- 172.21.15.59:0/1729025673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 msgr2=0x5645114f6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.591+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/1729025673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114f6480 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c09a280 tx=0x7f9d1c09a480 comp rx=0 tx=0).stop 2023-10-08T12:52:15.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.591+0000 7f9d3b239b80 1 -- 172.21.15.59:0/1729025673 shutdown_connections 2023-10-08T12:52:15.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.591+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/1729025673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114f9e80 0x5645114f6480 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.591+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/1729025673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564511505650 0x56451150c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.591+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/1729025673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645114fa7a0 0x5645114fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.591+0000 7f9d3b239b80 1 -- 172.21.15.59:0/1729025673 >> 172.21.15.59:0/1729025673 conn(0x56451146f260 msgr2=0x5645114f5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:15.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.591+0000 7f9d3b239b80 1 -- 172.21.15.59:0/1729025673 shutdown_connections 2023-10-08T12:52:15.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.591+0000 7f9d3b239b80 1 -- 172.21.15.59:0/1729025673 wait complete. 2023-10-08T12:52:15.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.591+0000 7f9d3b239b80 1 -- start start 2023-10-08T12:52:15.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d3b239b80 1 Processor -- start 2023-10-08T12:52:15.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114f9e80 0x56451150bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114fa7a0 0x56451150c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d3b239b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564511505650 0x56451150a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56451150a8d0 con 0x564511505650 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56451150aa40 con 0x5645114fa7a0 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d3b239b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56451150ac00 con 0x5645114f9e80 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d3b239b80 10 client.0 _ll_register_callbacks cb 0x7f9d180157e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d2579b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114f9e80 0x56451150bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d24f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114fa7a0 0x56451150c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d2579b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114f9e80 0x56451150bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58472/0 (socket says 172.21.15.59:58472) 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d2579b700 1 -- 172.21.15.59:0/2618724287 learned_addr learned my addr 172.21.15.59:0/2618724287 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.592+0000 7f9d25f9c700 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564511505650 0x56451150a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d2579b700 1 -- 172.21.15.59:0/2618724287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114fa7a0 msgr2=0x56451150c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d2579b700 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114fa7a0 0x56451150c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d2579b700 1 -- 172.21.15.59:0/2618724287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564511505650 msgr2=0x56451150a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:15.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d2579b700 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564511505650 0x56451150a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d2579b700 1 -- 172.21.15.59:0/2618724287 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564511278de0 con 0x5645114f9e80 2023-10-08T12:52:15.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d2579b700 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114f9e80 0x56451150bbd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c09ae30 tx=0x7f9d1c0850d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc5b0103c3d6c9ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:15.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d08ff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:52:15.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d08ff9700 1 -- 172.21.15.59:0/2618724287 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0a2910 con 0x5645114f9e80 2023-10-08T12:52:15.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d08ff9700 1 -- 172.21.15.59:0/2618724287 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9d1c096c90 con 0x5645114f9e80 2023-10-08T12:52:15.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d3b239b80 1 -- 172.21.15.59:0/2618724287 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d1c09ac80 con 0x5645114f9e80 2023-10-08T12:52:15.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d08ff9700 1 -- 172.21.15.59:0/2618724287 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d1c096e50 con 0x5645114f9e80 2023-10-08T12:52:15.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d3b239b80 10 client.26968 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:15.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.593+0000 7f9d3b239b80 1 -- 172.21.15.59:0/2618724287 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5645112772b0 con 0x5645114f9e80 2023-10-08T12:52:15.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.594+0000 7f9d08ff9700 1 -- 172.21.15.59:0/2618724287 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d1c09ac80 con 0x5645114f9e80 2023-10-08T12:52:15.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.594+0000 7f9d08ff9700 1 -- 172.21.15.59:0/2618724287 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9d1c081050 con 0x5645114f9e80 2023-10-08T12:52:15.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.594+0000 7f9d3b239b80 10 client.26968 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:15.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.594+0000 7f9d3b239b80 10 client.26968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:15.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.594+0000 7f9d3b239b80 20 client.26968 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:15.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.594+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564511569fa0 0x56451156c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.594+0000 7f9d3b239b80 4 client.26968 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:52:15.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.594+0000 7f9d3b239b80 1 -- 172.21.15.59:0/2618724287 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564511446b30 con 0x564511569fa0 2023-10-08T12:52:15.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.594+0000 7f9d24f9a700 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564511569fa0 0x56451156c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.595+0000 7f9d24f9a700 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564511569fa0 0x56451156c390 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a3287f5ce3046c3 server_cookie=37662d4eccb941f6 in_seq=0 out_seq=0 2023-10-08T12:52:15.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.595+0000 7f9d08ff9700 10 client.26968 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:15.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d08ff9700 1 -- 172.21.15.59:0/2618724287 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564511446b30 con 0x564511569fa0 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d08ff9700 10 client.26968 handle_command_reply: tid=0 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d3b239b80 1 client.26968 shutdown 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d3b239b80 1 -- 172.21.15.59:0/2618724287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114f9e80 msgr2=0x56451150bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114f9e80 0x56451150bbd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c09ae30 tx=0x7f9d1c0850d0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d3b239b80 1 -- 172.21.15.59:0/2618724287 shutdown_connections 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564511569fa0 0x56451156c390 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564511505650 0x56451150a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645114f9e80 0x56451150bbd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d08ff9700 0 client.26968 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d3b239b80 1 --2- 172.21.15.59:0/2618724287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645114fa7a0 0x56451150c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d3b239b80 1 -- 172.21.15.59:0/2618724287 >> 172.21.15.59:0/2618724287 conn(0x56451146f260 msgr2=0x564511501c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:15.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.596+0000 7f9d3b239b80 1 -- 172.21.15.59:0/2618724287 shutdown_connections 2023-10-08T12:52:15.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d3b239b80 1 -- 172.21.15.59:0/2618724287 wait complete. 2023-10-08T12:52:15.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d3b239b80 20 client.26968 trim_cache size 0 max 16384 2023-10-08T12:52:15.602 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:52:15.602 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:52:15.602 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:52:15.602 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:52:15.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 -- 172.21.15.59:0/361585597 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9d0c0a15f0 msgr2=0x7f9d0c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9d0c0a15f0 0x7f9d0c0a3ab0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9d180093a0 tx=0x7f9d1800b040 comp rx=0 tx=0).stop 2023-10-08T12:52:15.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 -- 172.21.15.59:0/361585597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d20072c20 msgr2=0x7f9d20198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d20072c20 0x7f9d20198ea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00eb30 tx=0x7f9d1c00ee40 comp rx=0 tx=0).stop 2023-10-08T12:52:15.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 -- 172.21.15.59:0/361585597 shutdown_connections 2023-10-08T12:52:15.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9d0c0a15f0 0x7f9d0c0a3ab0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d2010cf80 0x7f9d2019d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d20072c20 0x7f9d20198ea0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 --2- 172.21.15.59:0/361585597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d20073540 0x7f9d201993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 -- 172.21.15.59:0/361585597 >> 172.21.15.59:0/361585597 conn(0x7f9d200fc230 msgr2=0x7f9d200fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:15.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 -- 172.21.15.59:0/361585597 shutdown_connections 2023-10-08T12:52:15.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.597+0000 7f9d279ff700 1 -- 172.21.15.59:0/361585597 wait complete. 2023-10-08T12:52:15.616 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:52:15.617 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:52:15.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.829+0000 7f53c4dff700 1 -- 172.21.15.59:0/3506983820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53c010ce70 msgr2=0x7f53c010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.829+0000 7f53c4dff700 1 --2- 172.21.15.59:0/3506983820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53c010ce70 0x7f53c010f2e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f53b800b0a0 tx=0x7f53b800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.829+0000 7f53c4dff700 1 -- 172.21.15.59:0/3506983820 shutdown_connections 2023-10-08T12:52:15.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.829+0000 7f53c4dff700 1 --2- 172.21.15.59:0/3506983820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53c010ce70 0x7f53c010f2e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.829+0000 7f53c4dff700 1 --2- 172.21.15.59:0/3506983820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53c0072c20 0x7f53c0073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.829+0000 7f53c4dff700 1 --2- 172.21.15.59:0/3506983820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c0073540 0x7f53c010c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.829+0000 7f53c4dff700 1 -- 172.21.15.59:0/3506983820 >> 172.21.15.59:0/3506983820 conn(0x7f53c00fc140 msgr2=0x7f53c00fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:15.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.829+0000 7f53c4dff700 1 -- 172.21.15.59:0/3506983820 shutdown_connections 2023-10-08T12:52:15.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.829+0000 7f53c4dff700 1 -- 172.21.15.59:0/3506983820 wait complete. 2023-10-08T12:52:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.830+0000 7f53c4dff700 1 Processor -- start 2023-10-08T12:52:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.830+0000 7f53c4dff700 1 -- start start 2023-10-08T12:52:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.830+0000 7f53c4dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53c0072c20 0x7f53c0198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.830+0000 7f53c4dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53c0073540 0x7f53c0199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.830+0000 7f53c4dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c010ce70 0x7f53c019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.830+0000 7f53c4dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c019dd20 con 0x7f53c010ce70 2023-10-08T12:52:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.830+0000 7f53c4dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c019de90 con 0x7f53c0072c20 2023-10-08T12:52:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.830+0000 7f53c4dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c019e050 con 0x7f53c0073540 2023-10-08T12:52:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.831+0000 7f53be59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53c0072c20 0x7f53c0198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.831+0000 7f53bdd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53c0073540 0x7f53c0199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.831+0000 7f53be59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53c0072c20 0x7f53c0198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57000/0 (socket says 172.21.15.59:57000) 2023-10-08T12:52:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.831+0000 7f53be59c700 1 -- 172.21.15.59:0/4149389102 learned_addr learned my addr 172.21.15.59:0/4149389102 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.831+0000 7f53bed9d700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c010ce70 0x7f53c019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.831+0000 7f53be59c700 1 -- 172.21.15.59:0/4149389102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53c0073540 msgr2=0x7f53c0199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.831+0000 7f53be59c700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53c0073540 0x7f53c0199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.831+0000 7f53be59c700 1 -- 172.21.15.59:0/4149389102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c010ce70 msgr2=0x7f53c019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.831+0000 7f53be59c700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c010ce70 0x7f53c019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.831+0000 7f53be59c700 1 -- 172.21.15.59:0/4149389102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4009520 con 0x7f53c0072c20 2023-10-08T12:52:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.831+0000 7f53be59c700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53c0072c20 0x7f53c0198e00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f53b000e9a0 tx=0x7f53b000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.832+0000 7f53af7fe700 1 -- 172.21.15.59:0/4149389102 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0009790 con 0x7f53c0072c20 2023-10-08T12:52:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.832+0000 7f53af7fe700 1 -- 172.21.15.59:0/4149389102 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53b0010430 con 0x7f53c0072c20 2023-10-08T12:52:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.832+0000 7f53c4dff700 1 -- 172.21.15.59:0/4149389102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b8009d00 con 0x7f53c0072c20 2023-10-08T12:52:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.832+0000 7f53af7fe700 1 -- 172.21.15.59:0/4149389102 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0018680 con 0x7f53c0072c20 2023-10-08T12:52:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.832+0000 7f53c4dff700 1 -- 172.21.15.59:0/4149389102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c019e520 con 0x7f53c0072c20 2023-10-08T12:52:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.833+0000 7f53c4dff700 1 -- 172.21.15.59:0/4149389102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c0108080 con 0x7f53c0072c20 2023-10-08T12:52:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.835+0000 7f53af7fe700 1 -- 172.21.15.59:0/4149389102 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f53b00105a0 con 0x7f53c0072c20 2023-10-08T12:52:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.836+0000 7f53af7fe700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f53a80a1670 0x7f53a80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.836+0000 7f53af7fe700 1 -- 172.21.15.59:0/4149389102 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f53b0014070 con 0x7f53c0072c20 2023-10-08T12:52:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.837+0000 7f53bdd9b700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f53a80a1670 0x7f53a80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.837+0000 7f53bdd9b700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f53a80a1670 0x7f53a80a3b30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f53c019a350 tx=0x7f53b4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:15.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:15.841+0000 7f53af7fe700 1 -- 172.21.15.59:0/4149389102 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f53b00965d0 con 0x7f53c0072c20 2023-10-08T12:52:16.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.108+0000 7f53c4dff700 1 -- 172.21.15.59:0/4149389102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53c00742d0 con 0x7f53c0072c20 2023-10-08T12:52:16.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.109+0000 7f53af7fe700 1 -- 172.21.15.59:0/4149389102 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f53b0099bf0 con 0x7f53c0072c20 2023-10-08T12:52:16.110 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:52:16.110 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:52:16.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 -- 172.21.15.59:0/4149389102 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f53a80a1670 msgr2=0x7f53a80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:16.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f53a80a1670 0x7f53a80a3b30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f53c019a350 tx=0x7f53b4009260 comp rx=0 tx=0).stop 2023-10-08T12:52:16.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 -- 172.21.15.59:0/4149389102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53c0072c20 msgr2=0x7f53c0198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:16.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53c0072c20 0x7f53c0198e00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f53b000e9a0 tx=0x7f53b000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 -- 172.21.15.59:0/4149389102 shutdown_connections 2023-10-08T12:52:16.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f53a80a1670 0x7f53a80a3b30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53c0072c20 0x7f53c0198e00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53c010ce70 0x7f53c019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 --2- 172.21.15.59:0/4149389102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53c0073540 0x7f53c0199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 -- 172.21.15.59:0/4149389102 >> 172.21.15.59:0/4149389102 conn(0x7f53c00fc140 msgr2=0x7f53c00fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:16.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 -- 172.21.15.59:0/4149389102 shutdown_connections 2023-10-08T12:52:16.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.112+0000 7f53c4dff700 1 -- 172.21.15.59:0/4149389102 wait complete. 2023-10-08T12:52:16.115 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:52:16.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:52:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.347+0000 7fe0217ff700 1 -- 172.21.15.59:0/1010529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe01c100740 msgr2=0x7fe01c100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.347+0000 7fe0217ff700 1 --2- 172.21.15.59:0/1010529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe01c100740 0x7fe01c100bc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe0100098f0 tx=0x7fe010009c00 comp rx=0 tx=0).stop 2023-10-08T12:52:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.348+0000 7fe0217ff700 1 -- 172.21.15.59:0/1010529 shutdown_connections 2023-10-08T12:52:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.348+0000 7fe0217ff700 1 --2- 172.21.15.59:0/1010529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c101100 0x7fe01c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.348+0000 7fe0217ff700 1 --2- 172.21.15.59:0/1010529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c106750 0x7fe01c106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.348+0000 7fe0217ff700 1 --2- 172.21.15.59:0/1010529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe01c100740 0x7fe01c100bc0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.348+0000 7fe0217ff700 1 -- 172.21.15.59:0/1010529 >> 172.21.15.59:0/1010529 conn(0x7fe01c0fc230 msgr2=0x7fe01c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.348+0000 7fe0217ff700 1 -- 172.21.15.59:0/1010529 shutdown_connections 2023-10-08T12:52:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.348+0000 7fe0217ff700 1 -- 172.21.15.59:0/1010529 wait complete. 2023-10-08T12:52:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.349+0000 7fe0217ff700 1 Processor -- start 2023-10-08T12:52:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.349+0000 7fe0217ff700 1 -- start start 2023-10-08T12:52:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.349+0000 7fe0217ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe01c100740 0x7fe01c19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.349+0000 7fe0217ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c101100 0x7fe01c19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.349+0000 7fe0217ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c106750 0x7fe01c196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.349+0000 7fe0217ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c197090 con 0x7fe01c106750 2023-10-08T12:52:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.349+0000 7fe0217ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c197200 con 0x7fe01c100740 2023-10-08T12:52:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.349+0000 7fe0217ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c1973c0 con 0x7fe01c101100 2023-10-08T12:52:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.349+0000 7fe01affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe01c100740 0x7fe01c19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.349+0000 7fe01b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c106750 0x7fe01c196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe01affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe01c100740 0x7fe01c19c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57028/0 (socket says 172.21.15.59:57028) 2023-10-08T12:52:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe01affd700 1 -- 172.21.15.59:0/3247334394 learned_addr learned my addr 172.21.15.59:0/3247334394 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe01a7fc700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c101100 0x7fe01c19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe01affd700 1 -- 172.21.15.59:0/3247334394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c101100 msgr2=0x7fe01c19ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe01affd700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c101100 0x7fe01c19ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe01affd700 1 -- 172.21.15.59:0/3247334394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c106750 msgr2=0x7fe01c196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe01affd700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c106750 0x7fe01c196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe01affd700 1 -- 172.21.15.59:0/3247334394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe014009c40 con 0x7fe01c100740 2023-10-08T12:52:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe01a7fc700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c101100 0x7fe01c19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe01affd700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe01c100740 0x7fe01c19c900 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00e9c0 tx=0x7fe00c00ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe003fff700 1 -- 172.21.15.59:0/3247334394 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00cbd0 con 0x7fe01c100740 2023-10-08T12:52:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe003fff700 1 -- 172.21.15.59:0/3247334394 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe00c00eea0 con 0x7fe01c100740 2023-10-08T12:52:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe0217ff700 1 -- 172.21.15.59:0/3247334394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe010009520 con 0x7fe01c100740 2023-10-08T12:52:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.350+0000 7fe003fff700 1 -- 172.21.15.59:0/3247334394 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c005550 con 0x7fe01c100740 2023-10-08T12:52:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.351+0000 7fe0217ff700 1 -- 172.21.15.59:0/3247334394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c197890 con 0x7fe01c100740 2023-10-08T12:52:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.354+0000 7fe003fff700 1 -- 172.21.15.59:0/3247334394 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe00c004750 con 0x7fe01c100740 2023-10-08T12:52:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.355+0000 7fe0351a7b80 1 Processor -- start 2023-10-08T12:52:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.355+0000 7fe0351a7b80 1 -- start start 2023-10-08T12:52:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.355+0000 7fe003fff700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe0040a1670 0x7fe0040a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.355+0000 7fe003fff700 1 -- 172.21.15.59:0/3247334394 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe00c014070 con 0x7fe01c100740 2023-10-08T12:52:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecae80 0x55dcfaecb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01b7fe700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe0040a1670 0x7fe0040a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaed6650 0x55dcfaed8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfae34460 con 0x55dcfaed6650 2023-10-08T12:52:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfae25c20 con 0x55dcfaecae80 2023-10-08T12:52:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfae23540 con 0x55dcfaecb7a0 2023-10-08T12:52:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecae80 0x55dcfaecb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecae80 0x55dcfaecb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57042/0 (socket says 172.21.15.59:57042) 2023-10-08T12:52:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01affd700 1 -- 172.21.15.59:0/3645456410 learned_addr learned my addr 172.21.15.59:0/3645456410 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01b7fe700 1 --2- 172.21.15.59:0/3645456410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaed6650 0x55dcfaed8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01a7fc700 1 --2- 172.21.15.59:0/3645456410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01affd700 1 -- 172.21.15.59:0/3645456410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecb7a0 msgr2=0x55dcfaed6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01affd700 1 --2- 172.21.15.59:0/3645456410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01affd700 1 -- 172.21.15.59:0/3645456410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaed6650 msgr2=0x55dcfaed8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:16.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01affd700 1 --2- 172.21.15.59:0/3645456410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaed6650 0x55dcfaed8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01affd700 1 -- 172.21.15.59:0/3645456410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcfac49de0 con 0x55dcfaecae80 2023-10-08T12:52:16.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.356+0000 7fe01a7fc700 1 --2- 172.21.15.59:0/3645456410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:16.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.357+0000 7fe01affd700 1 --2- 172.21.15.59:0/3645456410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecae80 0x55dcfaecb260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe00c09a120 tx=0x7fe00c099c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6483a2b06a4ec638 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:16.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.357+0000 7fe01b7fe700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe0040a1670 0x7fe0040a3b30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe014009fd0 tx=0x7fe0140115a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:16.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.357+0000 7fe0017fa700 1 -- 172.21.15.59:0/3645456410 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c09a190 con 0x55dcfaecae80 2023-10-08T12:52:16.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.357+0000 7fe0017fa700 1 -- 172.21.15.59:0/3645456410 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe00c09e2e0 con 0x55dcfaecae80 2023-10-08T12:52:16.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.357+0000 7fe0017fa700 1 -- 172.21.15.59:0/3645456410 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c016590 con 0x55dcfaecae80 2023-10-08T12:52:16.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.357+0000 7fe0351a7b80 1 -- 172.21.15.59:0/3645456410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecae80 msgr2=0x55dcfaecb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:16.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.357+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/3645456410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecae80 0x55dcfaecb260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe00c09a120 tx=0x7fe00c099c20 comp rx=0 tx=0).stop 2023-10-08T12:52:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.358+0000 7fe0351a7b80 1 -- 172.21.15.59:0/3645456410 shutdown_connections 2023-10-08T12:52:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.358+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/3645456410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecae80 0x55dcfaecb260 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.358+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/3645456410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaed6650 0x55dcfaed8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.358+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/3645456410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.358+0000 7fe0351a7b80 1 -- 172.21.15.59:0/3645456410 >> 172.21.15.59:0/3645456410 conn(0x55dcfae40260 msgr2=0x55dcfaec72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.358+0000 7fe0351a7b80 1 -- 172.21.15.59:0/3645456410 shutdown_connections 2023-10-08T12:52:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.358+0000 7fe0351a7b80 1 -- 172.21.15.59:0/3645456410 wait complete. 2023-10-08T12:52:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.358+0000 7fe0351a7b80 1 -- start start 2023-10-08T12:52:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.358+0000 7fe0351a7b80 1 Processor -- start 2023-10-08T12:52:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecae80 0x55dcfaed3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaed6650 0x55dcfaed3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfae1ee30 con 0x55dcfaecae80 2023-10-08T12:52:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfadbb710 con 0x55dcfaecb7a0 2023-10-08T12:52:16.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfadbb3b0 con 0x55dcfaed6650 2023-10-08T12:52:16.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe0351a7b80 10 client.0 _ll_register_callbacks cb 0x55dcfac18800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:16.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe01a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe01affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecae80 0x55dcfaed3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe01a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57056/0 (socket says 172.21.15.59:57056) 2023-10-08T12:52:16.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe01a7fc700 1 -- 172.21.15.59:0/1534996634 learned_addr learned my addr 172.21.15.59:0/1534996634 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:16.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.359+0000 7fe01b7fe700 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaed6650 0x55dcfaed3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.360+0000 7fe01a7fc700 1 -- 172.21.15.59:0/1534996634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaed6650 msgr2=0x55dcfaed3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:16.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.360+0000 7fe01a7fc700 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaed6650 0x55dcfaed3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.360+0000 7fe01a7fc700 1 -- 172.21.15.59:0/1534996634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecae80 msgr2=0x55dcfaed3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:16.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.360+0000 7fe01a7fc700 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecae80 0x55dcfaed3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.360+0000 7fe01a7fc700 1 -- 172.21.15.59:0/1534996634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c197890 con 0x55dcfaecb7a0 2023-10-08T12:52:16.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.360+0000 7fe01affd700 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecae80 0x55dcfaed3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:16.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.360+0000 7fe01a7fc700 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed3a60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe0100098f0 tx=0x7fe01000f710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4747ef39ea37247b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:16.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.360+0000 7fdffeff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:16.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.360+0000 7fdffeff5700 1 -- 172.21.15.59:0/1534996634 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01001c040 con 0x55dcfaecb7a0 2023-10-08T12:52:16.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.360+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1534996634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcfade6eb0 con 0x55dcfaecb7a0 2023-10-08T12:52:16.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.360+0000 7fdffeff5700 1 -- 172.21.15.59:0/1534996634 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe01000f900 con 0x55dcfaecb7a0 2023-10-08T12:52:16.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.361+0000 7fdffeff5700 1 -- 172.21.15.59:0/1534996634 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe01000b970 con 0x55dcfaecb7a0 2023-10-08T12:52:16.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.361+0000 7fe0351a7b80 10 client.26993 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:16.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.361+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1534996634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55dcfac32c60 con 0x55dcfaecb7a0 2023-10-08T12:52:16.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.361+0000 7fdffeff5700 1 -- 172.21.15.59:0/1534996634 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe01002f020 con 0x55dcfaecb7a0 2023-10-08T12:52:16.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.361+0000 7fdffeff5700 1 -- 172.21.15.59:0/1534996634 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe010029070 con 0x55dcfaecb7a0 2023-10-08T12:52:16.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.361+0000 7fe0351a7b80 10 client.26993 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:16.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.361+0000 7fe0351a7b80 10 client.26993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:16.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.361+0000 7fe0351a7b80 20 client.26993 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:16.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.361+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dcfaee6250 0x55dcfaee8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.361+0000 7fe0351a7b80 4 client.26993 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:16.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.361+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1534996634 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dcfae17e10 con 0x55dcfaee6250 2023-10-08T12:52:16.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.362+0000 7fe01affd700 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dcfaee6250 0x55dcfaee8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.362+0000 7fe01affd700 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dcfaee6250 0x55dcfaee8670 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb9449fdbabd7d16 server_cookie=b61aff36f469b2e2 in_seq=0 out_seq=0 2023-10-08T12:52:16.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.362+0000 7fdffeff5700 10 client.26993 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:16.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fdffeff5700 1 -- 172.21.15.59:0/1534996634 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dcfae17e10 con 0x55dcfaee6250 2023-10-08T12:52:16.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fdffeff5700 10 client.26993 handle_command_reply: tid=0 2023-10-08T12:52:16.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 1 client.26993 shutdown 2023-10-08T12:52:16.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1534996634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 msgr2=0x55dcfaed3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:16.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed3a60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe0100098f0 tx=0x7fe01000f710 comp rx=0 tx=0).stop 2023-10-08T12:52:16.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1534996634 shutdown_connections 2023-10-08T12:52:16.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dcfaee6250 0x55dcfaee8670 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaed6650 0x55dcfaed3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecae80 0x55dcfaed3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1534996634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed3a60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1534996634 >> 172.21.15.59:0/1534996634 conn(0x55dcfae40260 msgr2=0x55dcfaec6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:16.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fdffeff5700 0 client.26993 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:16.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1534996634 shutdown_connections 2023-10-08T12:52:16.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1534996634 wait complete. 2023-10-08T12:52:16.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.363+0000 7fe0351a7b80 20 client.26993 trim_cache size 0 max 16384 2023-10-08T12:52:16.376 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:16 smithi092 ceph-mon[134093]: pgmap v656: 97 pgs: 97 active+clean; 593 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 232 op/s 2023-10-08T12:52:16.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe0351a7b80 1 Processor -- start 2023-10-08T12:52:16.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe0351a7b80 1 -- start start 2023-10-08T12:52:16.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 0x55dcfaee2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaed6650 0x55dcfaed3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfac9f920 con 0x55dcfaed6650 2023-10-08T12:52:16.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfaecc970 con 0x55dcfaecb7a0 2023-10-08T12:52:16.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfaed3320 con 0x55dcfaecae80 2023-10-08T12:52:16.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe01affd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 0x55dcfaee2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe01a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe01affd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 0x55dcfaee2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58536/0 (socket says 172.21.15.59:58536) 2023-10-08T12:52:16.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe01a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57058/0 (socket says 172.21.15.59:57058) 2023-10-08T12:52:16.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe01b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaed6650 0x55dcfaed3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.377+0000 7fe01affd700 1 -- 172.21.15.59:0/1911696283 learned_addr learned my addr 172.21.15.59:0/1911696283 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:16.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.378+0000 7fe01affd700 1 -- 172.21.15.59:0/1911696283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 msgr2=0x55dcfaed2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:16.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.378+0000 7fe01affd700 1 --2- 172.21.15.59:0/1911696283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.378+0000 7fe01affd700 1 -- 172.21.15.59:0/1911696283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaed6650 msgr2=0x55dcfaed3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:16.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.378+0000 7fe01affd700 1 --2- 172.21.15.59:0/1911696283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaed6650 0x55dcfaed3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.378+0000 7fe01affd700 1 -- 172.21.15.59:0/1911696283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcfac70250 con 0x55dcfaecae80 2023-10-08T12:52:16.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.378+0000 7fe01affd700 1 --2- 172.21.15.59:0/1911696283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 0x55dcfaee2180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0cae80 tx=0x7fe00c009550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81824a0a9b8f16ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:16.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.378+0000 7fe001ffb700 1 -- 172.21.15.59:0/1911696283 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0b8040 con 0x55dcfaecae80 2023-10-08T12:52:16.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.378+0000 7fe001ffb700 1 -- 172.21.15.59:0/1911696283 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe00c09a210 con 0x55dcfaecae80 2023-10-08T12:52:16.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.378+0000 7fe001ffb700 1 -- 172.21.15.59:0/1911696283 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c09a3f0 con 0x55dcfaecae80 2023-10-08T12:52:16.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.379+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1911696283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 msgr2=0x55dcfaee2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:16.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.379+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1911696283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 0x55dcfaee2180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0cae80 tx=0x7fe00c009550 comp rx=0 tx=0).stop 2023-10-08T12:52:16.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.379+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1911696283 shutdown_connections 2023-10-08T12:52:16.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.379+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1911696283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaed6650 0x55dcfaed3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.379+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1911696283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 0x55dcfaee2180 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.379+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1911696283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaecb7a0 0x55dcfaed2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.379+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1911696283 >> 172.21.15.59:0/1911696283 conn(0x55dcfae40260 msgr2=0x55dcfaed3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:16.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.379+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1911696283 shutdown_connections 2023-10-08T12:52:16.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.379+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1911696283 wait complete. 2023-10-08T12:52:16.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.379+0000 7fe0351a7b80 1 -- start start 2023-10-08T12:52:16.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe0351a7b80 1 Processor -- start 2023-10-08T12:52:16.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 0x55dcfaedcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecb7a0 0x55dcfaedd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe0351a7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaed6650 0x55dcfaedb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfaedb790 con 0x55dcfaecb7a0 2023-10-08T12:52:16.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfaedb900 con 0x55dcfaed6650 2023-10-08T12:52:16.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe0351a7b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcfaedbac0 con 0x55dcfaecae80 2023-10-08T12:52:16.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe0351a7b80 10 client.0 _ll_register_callbacks cb 0x7fe0140097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:16.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe01affd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 0x55dcfaedcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe01b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaed6650 0x55dcfaedb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe01a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecb7a0 0x55dcfaedd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe01affd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 0x55dcfaedcb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58546/0 (socket says 172.21.15.59:58546) 2023-10-08T12:52:16.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.380+0000 7fe01affd700 1 -- 172.21.15.59:0/1263679144 learned_addr learned my addr 172.21.15.59:0/1263679144 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:16.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.381+0000 7fe01b7fe700 1 -- 172.21.15.59:0/1263679144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 msgr2=0x55dcfaedcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:16.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.381+0000 7fe01b7fe700 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 0x55dcfaedcb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.381+0000 7fe01b7fe700 1 -- 172.21.15.59:0/1263679144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecb7a0 msgr2=0x55dcfaedd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:16.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.381+0000 7fe01b7fe700 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecb7a0 0x55dcfaedd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.381+0000 7fe01b7fe700 1 -- 172.21.15.59:0/1263679144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcfac49de0 con 0x55dcfaed6650 2023-10-08T12:52:16.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.381+0000 7fe01a7fc700 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecb7a0 0x55dcfaedd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.381+0000 7fe01b7fe700 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaed6650 0x55dcfaedb180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55dcfaecdee0 tx=0x7fe014004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=545bbd4dd464ffad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.381+0000 7fdffeff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.381+0000 7fdffeff5700 1 -- 172.21.15.59:0/1263679144 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01400e040 con 0x55dcfaed6650 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.381+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1263679144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe00c09e2e0 con 0x55dcfaed6650 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.381+0000 7fdffeff5700 1 -- 172.21.15.59:0/1263679144 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe0140093a0 con 0x55dcfaed6650 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.382+0000 7fdffeff5700 1 -- 172.21.15.59:0/1263679144 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe014004490 con 0x55dcfaed6650 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.382+0000 7fe0351a7b80 10 client.26999 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.382+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1263679144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55dcfac482b0 con 0x55dcfaed6650 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.382+0000 7fdffeff5700 1 -- 172.21.15.59:0/1263679144 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe00c09e2e0 con 0x55dcfaed6650 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.382+0000 7fdffeff5700 1 -- 172.21.15.59:0/1263679144 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe01402d020 con 0x55dcfaed6650 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.382+0000 7fe0351a7b80 10 client.26999 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:16.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.382+0000 7fe0351a7b80 10 client.26999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:16.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.382+0000 7fe0351a7b80 20 client.26999 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:16.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.382+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dcfaf3b2b0 0x55dcfaf3d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:16.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.382+0000 7fe0351a7b80 4 client.26999 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:52:16.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.382+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1263679144 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dcfae17b30 con 0x55dcfaf3b2b0 2023-10-08T12:52:16.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.383+0000 7fe01affd700 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dcfaf3b2b0 0x55dcfaf3d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:16.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.383+0000 7fe01affd700 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dcfaf3b2b0 0x55dcfaf3d6a0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41893698a89b1b67 server_cookie=dd248ceb20b0b1e7 in_seq=0 out_seq=0 2023-10-08T12:52:16.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.383+0000 7fdffeff5700 10 client.26999 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:16.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.383+0000 7fdffeff5700 1 -- 172.21.15.59:0/1263679144 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dcfae17b30 con 0x55dcfaf3b2b0 2023-10-08T12:52:16.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.383+0000 7fdffeff5700 10 client.26999 handle_command_reply: tid=0 2023-10-08T12:52:16.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.383+0000 7fe0351a7b80 1 client.26999 shutdown 2023-10-08T12:52:16.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.383+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1263679144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaed6650 msgr2=0x55dcfaedb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:16.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.383+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaed6650 0x55dcfaedb180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55dcfaecdee0 tx=0x7fe014004b40 comp rx=0 tx=0).stop 2023-10-08T12:52:16.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1263679144 shutdown_connections 2023-10-08T12:52:16.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dcfaf3b2b0 0x55dcfaf3d6a0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dcfaed6650 0x55dcfaedb180 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fdffeff5700 0 client.26999 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:16.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcfaecae80 0x55dcfaedcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0351a7b80 1 --2- 172.21.15.59:0/1263679144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcfaecb7a0 0x55dcfaedd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1263679144 >> 172.21.15.59:0/1263679144 conn(0x55dcfae40260 msgr2=0x55dcfaee1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:16.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1263679144 shutdown_connections 2023-10-08T12:52:16.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0351a7b80 1 -- 172.21.15.59:0/1263679144 wait complete. 2023-10-08T12:52:16.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0351a7b80 20 client.26999 trim_cache size 0 max 16384 2023-10-08T12:52:16.391 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:52:16.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0217ff700 1 -- 172.21.15.59:0/3247334394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe0040a1670 msgr2=0x7fe0040a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:16.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0217ff700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe0040a1670 0x7fe0040a3b30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe014009fd0 tx=0x7fe0140115a0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0217ff700 1 -- 172.21.15.59:0/3247334394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe01c100740 msgr2=0x7fe01c19c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:16.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.384+0000 7fe0217ff700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe01c100740 0x7fe01c19c900 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00e9c0 tx=0x7fe00c00ed80 comp rx=0 tx=0).stop 2023-10-08T12:52:16.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.385+0000 7fe0217ff700 1 -- 172.21.15.59:0/3247334394 shutdown_connections 2023-10-08T12:52:16.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.385+0000 7fe0217ff700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe0040a1670 0x7fe0040a3b30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.385+0000 7fe0217ff700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe01c100740 0x7fe01c19c900 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.385+0000 7fe0217ff700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c106750 0x7fe01c196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.385+0000 7fe0217ff700 1 --2- 172.21.15.59:0/3247334394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c101100 0x7fe01c19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:16.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.385+0000 7fe0217ff700 1 -- 172.21.15.59:0/3247334394 >> 172.21.15.59:0/3247334394 conn(0x7fe01c0fc230 msgr2=0x7fe01c0fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:16.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.385+0000 7fe0217ff700 1 -- 172.21.15.59:0/3247334394 shutdown_connections 2023-10-08T12:52:16.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:16.385+0000 7fe0217ff700 1 -- 172.21.15.59:0/3247334394 wait complete. 2023-10-08T12:52:16.401 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:16 smithi059 ceph-mon[98489]: pgmap v656: 97 pgs: 97 active+clean; 593 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 232 op/s 2023-10-08T12:52:16.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:16 smithi173 ceph-mon[135182]: pgmap v656: 97 pgs: 97 active+clean; 593 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 232 op/s 2023-10-08T12:52:16.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1406947 12.62 MB/sec execute 467 sec latency 14.035 ms 2023-10-08T12:52:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:17 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4149389102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:17.404 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:52:17.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:52:17.467 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:17 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4149389102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:17.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:17 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4149389102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:17.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1408691 12.61 MB/sec execute 468 sec latency 22.351 ms 2023-10-08T12:52:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.619+0000 7ff9103ff700 1 -- 172.21.15.59:0/3849214627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff908072c20 msgr2=0x7ff908073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.619+0000 7ff9103ff700 1 --2- 172.21.15.59:0/3849214627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff908072c20 0x7ff908073000 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff904009990 tx=0x7ff904009ca0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.619+0000 7ff9103ff700 1 -- 172.21.15.59:0/3849214627 shutdown_connections 2023-10-08T12:52:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.619+0000 7ff9103ff700 1 --2- 172.21.15.59:0/3849214627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff908072c20 0x7ff908073000 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.619+0000 7ff9103ff700 1 --2- 172.21.15.59:0/3849214627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90810cf70 0x7ff90810f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.619+0000 7ff9103ff700 1 --2- 172.21.15.59:0/3849214627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff908073540 0x7ff90810ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.619+0000 7ff9103ff700 1 -- 172.21.15.59:0/3849214627 >> 172.21.15.59:0/3849214627 conn(0x7ff9080fc200 msgr2=0x7ff9080fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.619+0000 7ff9103ff700 1 -- 172.21.15.59:0/3849214627 shutdown_connections 2023-10-08T12:52:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.619+0000 7ff9103ff700 1 -- 172.21.15.59:0/3849214627 wait complete. 2023-10-08T12:52:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.620+0000 7ff9103ff700 1 Processor -- start 2023-10-08T12:52:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.620+0000 7ff9103ff700 1 -- start start 2023-10-08T12:52:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.620+0000 7ff9103ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff908072c20 0x7ff908198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.620+0000 7ff9103ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff908073540 0x7ff9081993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.620+0000 7ff9103ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff90810cf70 0x7ff90819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.620+0000 7ff9103ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90819dd90 con 0x7ff908073540 2023-10-08T12:52:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.620+0000 7ff9103ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90819df00 con 0x7ff90810cf70 2023-10-08T12:52:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.620+0000 7ff9103ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90819e0c0 con 0x7ff908072c20 2023-10-08T12:52:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.621+0000 7ff90e19b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff908072c20 0x7ff908198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.621+0000 7ff90e19b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff908072c20 0x7ff908198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58558/0 (socket says 172.21.15.59:58558) 2023-10-08T12:52:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.621+0000 7ff90e19b700 1 -- 172.21.15.59:0/2979262205 learned_addr learned my addr 172.21.15.59:0/2979262205 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.621+0000 7ff90d99a700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff908073540 0x7ff9081993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.621+0000 7ff90e99c700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff90810cf70 0x7ff90819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.621+0000 7ff90e19b700 1 -- 172.21.15.59:0/2979262205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff90810cf70 msgr2=0x7ff90819d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.621+0000 7ff90e19b700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff90810cf70 0x7ff90819d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.621+0000 7ff90e19b700 1 -- 172.21.15.59:0/2979262205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff908073540 msgr2=0x7ff9081993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.621+0000 7ff90e19b700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff908073540 0x7ff9081993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.621+0000 7ff90e19b700 1 -- 172.21.15.59:0/2979262205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9040095f0 con 0x7ff908072c20 2023-10-08T12:52:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.621+0000 7ff90e19b700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff908072c20 0x7ff908198e70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff904005910 tx=0x7ff904004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.622+0000 7ff8ff7fe700 1 -- 172.21.15.59:0/2979262205 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90401d070 con 0x7ff908072c20 2023-10-08T12:52:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.622+0000 7ff9103ff700 1 -- 172.21.15.59:0/2979262205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90819e340 con 0x7ff908072c20 2023-10-08T12:52:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.622+0000 7ff8ff7fe700 1 -- 172.21.15.59:0/2979262205 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff904022470 con 0x7ff908072c20 2023-10-08T12:52:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.622+0000 7ff8ff7fe700 1 -- 172.21.15.59:0/2979262205 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff904017650 con 0x7ff908072c20 2023-10-08T12:52:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.622+0000 7ff9103ff700 1 -- 172.21.15.59:0/2979262205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9081a5be0 con 0x7ff908072c20 2023-10-08T12:52:17.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.626+0000 7ff8ff7fe700 1 -- 172.21.15.59:0/2979262205 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff9040225e0 con 0x7ff908072c20 2023-10-08T12:52:17.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.627+0000 7ff8ff7fe700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8f40a1670 0x7ff8f40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.627+0000 7ff923d51b80 1 Processor -- start 2023-10-08T12:52:17.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.627+0000 7ff8ff7fe700 1 -- 172.21.15.59:0/2979262205 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7ff9040ce2e0 con 0x7ff908072c20 2023-10-08T12:52:17.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.627+0000 7ff90d99a700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8f40a1670 0x7ff8f40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff923d51b80 1 -- start start 2023-10-08T12:52:17.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff45242e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 0x55cff452f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 0x55cff4531ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff923d51b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff448d4e0 con 0x55cff4523f00 2023-10-08T12:52:17.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff923d51b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff447eca0 con 0x55cff4524820 2023-10-08T12:52:17.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff923d51b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff447c5c0 con 0x55cff452f6d0 2023-10-08T12:52:17.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff90e99c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 0x55cff4531ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff90e19b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff45242e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff90d99a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 0x55cff452f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff90e99c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 0x55cff4531ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58570/0 (socket says 172.21.15.59:58570) 2023-10-08T12:52:17.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.628+0000 7ff90e99c700 1 -- 172.21.15.59:0/1132959141 learned_addr learned my addr 172.21.15.59:0/1132959141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:17.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.629+0000 7ff90d99a700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8f40a1670 0x7ff8f40a3b30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff90819a3c0 tx=0x7ff8f8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.629+0000 7ff90e99c700 1 -- 172.21.15.59:0/1132959141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 msgr2=0x55cff452f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.629+0000 7ff90e99c700 1 --2- 172.21.15.59:0/1132959141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 0x55cff452f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.629+0000 7ff90e99c700 1 -- 172.21.15.59:0/1132959141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 msgr2=0x55cff45242e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.629+0000 7ff90e99c700 1 --2- 172.21.15.59:0/1132959141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff45242e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.629+0000 7ff90e99c700 1 -- 172.21.15.59:0/1132959141 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cff42a2e60 con 0x55cff452f6d0 2023-10-08T12:52:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.629+0000 7ff90e19b700 1 --2- 172.21.15.59:0/1132959141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff45242e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.629+0000 7ff90e99c700 1 --2- 172.21.15.59:0/1132959141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 0x55cff4531ac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff9000116b0 tx=0x7ff900009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74337c176f63a4bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.629+0000 7ff8fcbfe700 1 -- 172.21.15.59:0/1132959141 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90000e040 con 0x55cff452f6d0 2023-10-08T12:52:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.629+0000 7ff8fcbfe700 1 -- 172.21.15.59:0/1132959141 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff90000f040 con 0x55cff452f6d0 2023-10-08T12:52:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.629+0000 7ff8fcbfe700 1 -- 172.21.15.59:0/1132959141 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900004830 con 0x55cff452f6d0 2023-10-08T12:52:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.630+0000 7ff923d51b80 1 -- 172.21.15.59:0/1132959141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 msgr2=0x55cff4531ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.630+0000 7ff923d51b80 1 --2- 172.21.15.59:0/1132959141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 0x55cff4531ac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff9000116b0 tx=0x7ff900009920 comp rx=0 tx=0).stop 2023-10-08T12:52:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.630+0000 7ff923d51b80 1 -- 172.21.15.59:0/1132959141 shutdown_connections 2023-10-08T12:52:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.630+0000 7ff923d51b80 1 --2- 172.21.15.59:0/1132959141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 0x55cff4531ac0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.630+0000 7ff923d51b80 1 --2- 172.21.15.59:0/1132959141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff45242e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.630+0000 7ff923d51b80 1 --2- 172.21.15.59:0/1132959141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 0x55cff452f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.630+0000 7ff923d51b80 1 -- 172.21.15.59:0/1132959141 >> 172.21.15.59:0/1132959141 conn(0x55cff44992e0 msgr2=0x55cff4520350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.630+0000 7ff923d51b80 1 -- 172.21.15.59:0/1132959141 shutdown_connections 2023-10-08T12:52:17.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.630+0000 7ff923d51b80 1 -- 172.21.15.59:0/1132959141 wait complete. 2023-10-08T12:52:17.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.631+0000 7ff923d51b80 1 -- start start 2023-10-08T12:52:17.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.631+0000 7ff923d51b80 1 Processor -- start 2023-10-08T12:52:17.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.631+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff4523f00 0x55cff452f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.631+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4524820 0x55cff452c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.631+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff452f6d0 0x55cff452ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.631+0000 7ff923d51b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff4477eb0 con 0x55cff4524820 2023-10-08T12:52:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.631+0000 7ff923d51b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff4414790 con 0x55cff452f6d0 2023-10-08T12:52:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.631+0000 7ff923d51b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff4414430 con 0x55cff4523f00 2023-10-08T12:52:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.632+0000 7ff923d51b80 10 client.0 _ll_register_callbacks cb 0x55cff4271880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.632+0000 7ff90e99c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff452f6d0 0x55cff452ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.632+0000 7ff90d99a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4524820 0x55cff452c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.632+0000 7ff90d99a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4524820 0x55cff452c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60318/0 (socket says 172.21.15.59:60318) 2023-10-08T12:52:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.632+0000 7ff90e19b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff4523f00 0x55cff452f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.632+0000 7ff90d99a700 1 -- 172.21.15.59:0/934226790 learned_addr learned my addr 172.21.15.59:0/934226790 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.632+0000 7ff90d99a700 1 -- 172.21.15.59:0/934226790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff4523f00 msgr2=0x55cff452f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.632+0000 7ff90d99a700 1 --2- 172.21.15.59:0/934226790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff4523f00 0x55cff452f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.632+0000 7ff90d99a700 1 -- 172.21.15.59:0/934226790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff452f6d0 msgr2=0x55cff452ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.632+0000 7ff90d99a700 1 --2- 172.21.15.59:0/934226790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff452f6d0 0x55cff452ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.632+0000 7ff90d99a700 1 -- 172.21.15.59:0/934226790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9081a5be0 con 0x55cff4524820 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.633+0000 7ff90d99a700 1 --2- 172.21.15.59:0/934226790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4524820 0x55cff452c420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff8f801c680 tx=0x7ff8f80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8f245f74ffbfe1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.633+0000 7ff8f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.633+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/934226790 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8029070 con 0x55cff4524820 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.633+0000 7ff923d51b80 1 -- 172.21.15.59:0/934226790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cff443ff30 con 0x55cff4524820 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.633+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/934226790 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7ff8f8004830 con 0x55cff4524820 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.633+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/934226790 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8f80049f0 con 0x55cff4524820 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.633+0000 7ff923d51b80 10 client.16992 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.633+0000 7ff923d51b80 1 -- 172.21.15.59:0/934226790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7ff900011330 con 0x55cff4524820 2023-10-08T12:52:17.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.633+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/934226790 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cff443ff30 con 0x55cff4524820 2023-10-08T12:52:17.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.634+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/934226790 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff8f802c020 con 0x55cff4524820 2023-10-08T12:52:17.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.634+0000 7ff923d51b80 10 client.16992 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:17.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.634+0000 7ff923d51b80 10 client.16992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:17.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.634+0000 7ff923d51b80 20 client.16992 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:17.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.634+0000 7ff923d51b80 1 --2- 172.21.15.59:0/934226790 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cff453f250 0x55cff4541670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.634+0000 7ff923d51b80 4 client.16992 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:17.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.634+0000 7ff923d51b80 1 -- 172.21.15.59:0/934226790 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cff4470e90 con 0x55cff453f250 2023-10-08T12:52:17.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.634+0000 7ff90e19b700 1 --2- 172.21.15.59:0/934226790 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cff453f250 0x55cff4541670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.634+0000 7ff90e19b700 1 --2- 172.21.15.59:0/934226790 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cff453f250 0x55cff4541670 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad44737d9ce559b2 server_cookie=d9b14c6ca75f4e4c in_seq=0 out_seq=0 2023-10-08T12:52:17.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.634+0000 7ff8f1ffb700 10 client.16992 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:17.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.635+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/934226790 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x7ff9040b3e90 con 0x55cff453f250 2023-10-08T12:52:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.635+0000 7ff8f1ffb700 10 client.16992 handle_command_reply: tid=0 2023-10-08T12:52:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.635+0000 7ff923d51b80 1 client.16992 shutdown 2023-10-08T12:52:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff923d51b80 1 -- 172.21.15.59:0/934226790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4524820 msgr2=0x55cff452c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff923d51b80 1 --2- 172.21.15.59:0/934226790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4524820 0x55cff452c420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff8f801c680 tx=0x7ff8f80047c0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff923d51b80 1 -- 172.21.15.59:0/934226790 shutdown_connections 2023-10-08T12:52:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff923d51b80 1 --2- 172.21.15.59:0/934226790 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cff453f250 0x55cff4541670 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff923d51b80 1 --2- 172.21.15.59:0/934226790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff452f6d0 0x55cff452ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff923d51b80 1 --2- 172.21.15.59:0/934226790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff4523f00 0x55cff452f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff8f1ffb700 0 client.16992 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff923d51b80 1 --2- 172.21.15.59:0/934226790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4524820 0x55cff452c420 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff923d51b80 1 -- 172.21.15.59:0/934226790 >> 172.21.15.59:0/934226790 conn(0x55cff44992e0 msgr2=0x55cff451ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff923d51b80 1 -- 172.21.15.59:0/934226790 shutdown_connections 2023-10-08T12:52:17.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff923d51b80 1 -- 172.21.15.59:0/934226790 wait complete. 2023-10-08T12:52:17.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.636+0000 7ff923d51b80 20 client.16992 trim_cache size 0 max 16384 2023-10-08T12:52:17.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.654+0000 7ff923d51b80 1 Processor -- start 2023-10-08T12:52:17.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.654+0000 7ff923d51b80 1 -- start start 2023-10-08T12:52:17.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4536220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff4524820 0x55cff451fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff452f6d0 0x55cff4520270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff923d51b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff42f89a0 con 0x55cff4523f00 2023-10-08T12:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff923d51b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff45207e0 con 0x55cff452f6d0 2023-10-08T12:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff923d51b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff451a5f0 con 0x55cff4524820 2023-10-08T12:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff90e19b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4536220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff90e19b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4536220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60324/0 (socket says 172.21.15.59:60324) 2023-10-08T12:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff90e19b700 1 -- 172.21.15.59:0/798744506 learned_addr learned my addr 172.21.15.59:0/798744506 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff90e99c700 1 --2- 172.21.15.59:0/798744506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff452f6d0 0x55cff4520270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff90d99a700 1 --2- 172.21.15.59:0/798744506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff4524820 0x55cff451fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff90d99a700 1 -- 172.21.15.59:0/798744506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff452f6d0 msgr2=0x55cff4520270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff90d99a700 1 --2- 172.21.15.59:0/798744506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff452f6d0 0x55cff4520270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff90d99a700 1 -- 172.21.15.59:0/798744506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 msgr2=0x55cff4536220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff90d99a700 1 --2- 172.21.15.59:0/798744506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4536220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff90d99a700 1 -- 172.21.15.59:0/798744506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cff45462a0 con 0x55cff4524820 2023-10-08T12:52:17.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.655+0000 7ff90e19b700 1 --2- 172.21.15.59:0/798744506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4536220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.656+0000 7ff90d99a700 1 --2- 172.21.15.59:0/798744506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff4524820 0x55cff451fd30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff8f802e5a0 tx=0x7ff8f8011b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1259adadb1cc5120 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.656+0000 7ff8fd3ff700 1 -- 172.21.15.59:0/798744506 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8029040 con 0x55cff4524820 2023-10-08T12:52:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.656+0000 7ff8fd3ff700 1 -- 172.21.15.59:0/798744506 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8f802e710 con 0x55cff4524820 2023-10-08T12:52:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.656+0000 7ff8fd3ff700 1 -- 172.21.15.59:0/798744506 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8004830 con 0x55cff4524820 2023-10-08T12:52:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.656+0000 7ff923d51b80 1 -- 172.21.15.59:0/798744506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff4524820 msgr2=0x55cff451fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.656+0000 7ff923d51b80 1 --2- 172.21.15.59:0/798744506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff4524820 0x55cff451fd30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff8f802e5a0 tx=0x7ff8f8011b60 comp rx=0 tx=0).stop 2023-10-08T12:52:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.657+0000 7ff923d51b80 1 -- 172.21.15.59:0/798744506 shutdown_connections 2023-10-08T12:52:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.657+0000 7ff923d51b80 1 --2- 172.21.15.59:0/798744506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff452f6d0 0x55cff4520270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.657+0000 7ff923d51b80 1 --2- 172.21.15.59:0/798744506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4536220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.657+0000 7ff923d51b80 1 --2- 172.21.15.59:0/798744506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff4524820 0x55cff451fd30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.657+0000 7ff923d51b80 1 -- 172.21.15.59:0/798744506 >> 172.21.15.59:0/798744506 conn(0x55cff44992e0 msgr2=0x55cff4527730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.657+0000 7ff923d51b80 1 -- 172.21.15.59:0/798744506 shutdown_connections 2023-10-08T12:52:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.657+0000 7ff923d51b80 1 -- 172.21.15.59:0/798744506 wait complete. 2023-10-08T12:52:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.657+0000 7ff923d51b80 1 -- start start 2023-10-08T12:52:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.657+0000 7ff923d51b80 1 Processor -- start 2023-10-08T12:52:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4535050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 0x55cff4535590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff923d51b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 0x55cff4593090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff923d51b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff4535c50 con 0x55cff4523f00 2023-10-08T12:52:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff923d51b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff45935d0 con 0x55cff4524820 2023-10-08T12:52:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff923d51b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff4593710 con 0x55cff452f6d0 2023-10-08T12:52:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff923d51b80 10 client.0 _ll_register_callbacks cb 0x7ff8f801c490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff90e19b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4535050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff90d99a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 0x55cff4535590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff90e19b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4535050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60334/0 (socket says 172.21.15.59:60334) 2023-10-08T12:52:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff90e19b700 1 -- 172.21.15.59:0/2687767833 learned_addr learned my addr 172.21.15.59:0/2687767833 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff90d99a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 0x55cff4535590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57100/0 (socket says 172.21.15.59:57100) 2023-10-08T12:52:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.658+0000 7ff90e99c700 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 0x55cff4593090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.659+0000 7ff90d99a700 1 -- 172.21.15.59:0/2687767833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 msgr2=0x55cff4593090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.659+0000 7ff90d99a700 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 0x55cff4593090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.659+0000 7ff90d99a700 1 -- 172.21.15.59:0/2687767833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 msgr2=0x55cff4535050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.659+0000 7ff90d99a700 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4535050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.659+0000 7ff90d99a700 1 -- 172.21.15.59:0/2687767833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90819e340 con 0x55cff4524820 2023-10-08T12:52:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.659+0000 7ff90e19b700 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4535050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.659+0000 7ff90d99a700 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 0x55cff4535590 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55cff4525170 tx=0x7ff8f8004250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d20e75791e4e47ee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.659+0000 7ff8f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.659+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/2687767833 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8029040 con 0x55cff4524820 2023-10-08T12:52:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.659+0000 7ff923d51b80 1 -- 172.21.15.59:0/2687767833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff90000f040 con 0x55cff4524820 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.659+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/2687767833 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7ff8f8005250 con 0x55cff4524820 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/2687767833 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8f802fef0 con 0x55cff4524820 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff923d51b80 10 client.27017 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff923d51b80 1 -- 172.21.15.59:0/2687767833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7ff900011330 con 0x55cff4524820 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/2687767833 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff90000f040 con 0x55cff4524820 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/2687767833 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff8f801c6b0 con 0x55cff4524820 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff923d51b80 10 client.27017 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff923d51b80 10 client.27017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff923d51b80 20 client.27017 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff923d51b80 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cff4594c40 0x55cff4597030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff923d51b80 4 client.27017 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:52:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff923d51b80 1 -- 172.21.15.59:0/2687767833 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55cff4470bb0 con 0x55cff4594c40 2023-10-08T12:52:17.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.660+0000 7ff90e19b700 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cff4594c40 0x55cff4597030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.661+0000 7ff8f1ffb700 10 client.27017 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.661+0000 7ff90e19b700 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cff4594c40 0x55cff4597030 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84beaee8f2a21e0f server_cookie=277b0e7861fa427b in_seq=0 out_seq=0 2023-10-08T12:52:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff8f1ffb700 1 -- 172.21.15.59:0/2687767833 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55cff4470bb0 con 0x55cff4594c40 2023-10-08T12:52:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff8f1ffb700 10 client.27017 handle_command_reply: tid=0 2023-10-08T12:52:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 1 client.27017 shutdown 2023-10-08T12:52:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 1 -- 172.21.15.59:0/2687767833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 msgr2=0x55cff4535590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 0x55cff4535590 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55cff4525170 tx=0x7ff8f8004250 comp rx=0 tx=0).stop 2023-10-08T12:52:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 1 -- 172.21.15.59:0/2687767833 shutdown_connections 2023-10-08T12:52:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55cff4594c40 0x55cff4597030 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cff452f6d0 0x55cff4593090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff4523f00 0x55cff4535050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 1 --2- 172.21.15.59:0/2687767833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cff4524820 0x55cff4535590 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff8f1ffb700 0 client.27017 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 1 -- 172.21.15.59:0/2687767833 >> 172.21.15.59:0/2687767833 conn(0x55cff44992e0 msgr2=0x55cff451fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 1 -- 172.21.15.59:0/2687767833 shutdown_connections 2023-10-08T12:52:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 1 -- 172.21.15.59:0/2687767833 wait complete. 2023-10-08T12:52:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.663+0000 7ff923d51b80 20 client.27017 trim_cache size 0 max 16384 2023-10-08T12:52:17.668 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:52:17.669 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:52:17.669 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "a00d5066-0b31-4794-87a4-3e8fb6abc0dc", 2023-10-08T12:52:17.669 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:52:17.669 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:52:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 -- 172.21.15.59:0/2979262205 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8f40a1670 msgr2=0x7ff8f40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8f40a1670 0x7ff8f40a3b30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff90819a3c0 tx=0x7ff8f8009260 comp rx=0 tx=0).stop 2023-10-08T12:52:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 -- 172.21.15.59:0/2979262205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff908072c20 msgr2=0x7ff908198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff908072c20 0x7ff908198e70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff904005910 tx=0x7ff904004730 comp rx=0 tx=0).stop 2023-10-08T12:52:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 -- 172.21.15.59:0/2979262205 shutdown_connections 2023-10-08T12:52:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8f40a1670 0x7ff8f40a3b30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff90810cf70 0x7ff90819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff908072c20 0x7ff908198e70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 --2- 172.21.15.59:0/2979262205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff908073540 0x7ff9081993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 -- 172.21.15.59:0/2979262205 >> 172.21.15.59:0/2979262205 conn(0x7ff9080fc200 msgr2=0x7ff9080fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 -- 172.21.15.59:0/2979262205 shutdown_connections 2023-10-08T12:52:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.664+0000 7ff9103ff700 1 -- 172.21.15.59:0/2979262205 wait complete. 2023-10-08T12:52:17.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:52:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.895+0000 7fae6c7ff700 1 -- 172.21.15.59:0/3166210882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae64100730 msgr2=0x7fae64100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.895+0000 7fae6c7ff700 1 --2- 172.21.15.59:0/3166210882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae64100730 0x7fae64100bb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fae54009990 tx=0x7fae54009ca0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.895+0000 7fae6c7ff700 1 -- 172.21.15.59:0/3166210882 shutdown_connections 2023-10-08T12:52:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.895+0000 7fae6c7ff700 1 --2- 172.21.15.59:0/3166210882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae641010f0 0x7fae6410d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.895+0000 7fae6c7ff700 1 --2- 172.21.15.59:0/3166210882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae64106740 0x7fae64106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.895+0000 7fae6c7ff700 1 --2- 172.21.15.59:0/3166210882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae64100730 0x7fae64100bb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.895+0000 7fae6c7ff700 1 -- 172.21.15.59:0/3166210882 >> 172.21.15.59:0/3166210882 conn(0x7fae640fc200 msgr2=0x7fae640fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.895+0000 7fae6c7ff700 1 -- 172.21.15.59:0/3166210882 shutdown_connections 2023-10-08T12:52:17.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.895+0000 7fae6c7ff700 1 -- 172.21.15.59:0/3166210882 wait complete. 2023-10-08T12:52:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.896+0000 7fae6c7ff700 1 Processor -- start 2023-10-08T12:52:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.896+0000 7fae6c7ff700 1 -- start start 2023-10-08T12:52:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6c7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae64100730 0x7fae64072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6c7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae641010f0 0x7fae64073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6c7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae64106740 0x7fae64073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6c7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae641a4f70 con 0x7fae641010f0 2023-10-08T12:52:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6c7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae641a50e0 con 0x7fae64106740 2023-10-08T12:52:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6c7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae641a52a0 con 0x7fae64100730 2023-10-08T12:52:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae69d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae641010f0 0x7fae64073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6ad9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae64106740 0x7fae64073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae69d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae641010f0 0x7fae64073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60352/0 (socket says 172.21.15.59:60352) 2023-10-08T12:52:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae69d9a700 1 -- 172.21.15.59:0/2356645115 learned_addr learned my addr 172.21.15.59:0/2356645115 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6a59b700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae64100730 0x7fae64072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6ad9c700 1 -- 172.21.15.59:0/2356645115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae64100730 msgr2=0x7fae64072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6ad9c700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae64100730 0x7fae64072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6ad9c700 1 -- 172.21.15.59:0/2356645115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae641010f0 msgr2=0x7fae64073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6ad9c700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae641010f0 0x7fae64073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.897+0000 7fae6ad9c700 1 -- 172.21.15.59:0/2356645115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60009520 con 0x7fae64106740 2023-10-08T12:52:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.898+0000 7fae6ad9c700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae64106740 0x7fae64073570 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00efc0 tx=0x7fae5c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.898+0000 7fae5b7fe700 1 -- 172.21.15.59:0/2356645115 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c018070 con 0x7fae64106740 2023-10-08T12:52:17.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.898+0000 7fae5b7fe700 1 -- 172.21.15.59:0/2356645115 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae5c00f040 con 0x7fae64106740 2023-10-08T12:52:17.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.898+0000 7fae5b7fe700 1 -- 172.21.15.59:0/2356645115 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00cd40 con 0x7fae64106740 2023-10-08T12:52:17.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.898+0000 7fae6c7ff700 1 -- 172.21.15.59:0/2356645115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae540095f0 con 0x7fae64106740 2023-10-08T12:52:17.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.898+0000 7fae6c7ff700 1 -- 172.21.15.59:0/2356645115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae641a5850 con 0x7fae64106740 2023-10-08T12:52:17.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.902+0000 7fae5b7fe700 1 -- 172.21.15.59:0/2356645115 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fae5c003a00 con 0x7fae64106740 2023-10-08T12:52:17.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae8017ab80 1 Processor -- start 2023-10-08T12:52:17.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae8017ab80 1 -- start start 2023-10-08T12:52:17.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f0e80 0x56443e1f1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 0x56443e1fc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1fc650 0x56443e1fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae8017ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e15a460 con 0x56443e1f0e80 2023-10-08T12:52:17.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae8017ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e14bc20 con 0x56443e1fc650 2023-10-08T12:52:17.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae8017ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e149540 con 0x56443e1f17a0 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae69d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f0e80 0x56443e1f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae69d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f0e80 0x56443e1f1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60354/0 (socket says 172.21.15.59:60354) 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae5b7fe700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae500a1670 0x7fae500a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae69d9a700 1 -- 172.21.15.59:0/684101602 learned_addr learned my addr 172.21.15.59:0/684101602 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.903+0000 7fae6a59b700 1 --2- 172.21.15.59:0/684101602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 0x56443e1fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae69d9a700 1 --2- 172.21.15.59:0/684101602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1fc650 0x56443e1fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae5b7fe700 1 -- 172.21.15.59:0/2356645115 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fae5c0ccc60 con 0x7fae64106740 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae6ad9c700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae500a1670 0x7fae500a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae6a59b700 1 -- 172.21.15.59:0/684101602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1fc650 msgr2=0x56443e1fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae6a59b700 1 --2- 172.21.15.59:0/684101602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1fc650 0x56443e1fea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae6a59b700 1 -- 172.21.15.59:0/684101602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f0e80 msgr2=0x56443e1f1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae6a59b700 1 --2- 172.21.15.59:0/684101602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f0e80 0x56443e1f1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae6a59b700 1 -- 172.21.15.59:0/684101602 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56443df6fde0 con 0x56443e1f17a0 2023-10-08T12:52:17.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae6a59b700 1 --2- 172.21.15.59:0/684101602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 0x56443e1fc110 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fae60009e70 tx=0x7fae60011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0e5fdab134d3b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae58ff9700 1 -- 172.21.15.59:0/684101602 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000e670 con 0x56443e1f17a0 2023-10-08T12:52:17.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae6ad9c700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae500a1670 0x7fae500a3b30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0ca400 tx=0x7fae5c009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae58ff9700 1 -- 172.21.15.59:0/684101602 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae6000ec90 con 0x56443e1f17a0 2023-10-08T12:52:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.904+0000 7fae58ff9700 1 -- 172.21.15.59:0/684101602 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60019bf0 con 0x56443e1f17a0 2023-10-08T12:52:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.905+0000 7fae8017ab80 1 -- 172.21.15.59:0/684101602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 msgr2=0x56443e1fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.905+0000 7fae8017ab80 1 --2- 172.21.15.59:0/684101602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 0x56443e1fc110 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fae60009e70 tx=0x7fae60011720 comp rx=0 tx=0).stop 2023-10-08T12:52:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.905+0000 7fae8017ab80 1 -- 172.21.15.59:0/684101602 shutdown_connections 2023-10-08T12:52:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.905+0000 7fae8017ab80 1 --2- 172.21.15.59:0/684101602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1fc650 0x56443e1fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.905+0000 7fae8017ab80 1 --2- 172.21.15.59:0/684101602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f0e80 0x56443e1f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.905+0000 7fae8017ab80 1 --2- 172.21.15.59:0/684101602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 0x56443e1fc110 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.905+0000 7fae8017ab80 1 -- 172.21.15.59:0/684101602 >> 172.21.15.59:0/684101602 conn(0x56443e166260 msgr2=0x56443e1ed2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.905+0000 7fae8017ab80 1 -- 172.21.15.59:0/684101602 shutdown_connections 2023-10-08T12:52:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.905+0000 7fae8017ab80 1 -- 172.21.15.59:0/684101602 wait complete. 2023-10-08T12:52:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.906+0000 7fae8017ab80 1 -- start start 2023-10-08T12:52:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.906+0000 7fae8017ab80 1 Processor -- start 2023-10-08T12:52:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f0e80 0x56443e1fbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 0x56443e1f9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1fc650 0x56443e1f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae8017ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e144e30 con 0x56443e1f0e80 2023-10-08T12:52:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae8017ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e0e1710 con 0x56443e1fc650 2023-10-08T12:52:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae8017ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e0e13b0 con 0x56443e1f17a0 2023-10-08T12:52:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae8017ab80 10 client.0 _ll_register_callbacks cb 0x56443df3e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae69d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f0e80 0x56443e1fbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae6a59b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 0x56443e1f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae6a59b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 0x56443e1f9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58628/0 (socket says 172.21.15.59:58628) 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae6a59b700 1 -- 172.21.15.59:0/1273244111 learned_addr learned my addr 172.21.15.59:0/1273244111 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae69d9a700 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1fc650 0x56443e1f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae6a59b700 1 -- 172.21.15.59:0/1273244111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1fc650 msgr2=0x56443e1f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae6a59b700 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1fc650 0x56443e1f99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae6a59b700 1 -- 172.21.15.59:0/1273244111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f0e80 msgr2=0x56443e1fbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae6a59b700 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f0e80 0x56443e1fbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae6a59b700 1 -- 172.21.15.59:0/1273244111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae60009a70 con 0x56443e1f17a0 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.907+0000 7fae69d9a700 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1fc650 0x56443e1f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.908+0000 7fae6a59b700 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 0x56443e1f9380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fae6001c040 tx=0x7fae60019ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f65d36d26a035f31 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.908+0000 7fae4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.908+0000 7fae4dffb700 1 -- 172.21.15.59:0/1273244111 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000e880 con 0x56443e1f17a0 2023-10-08T12:52:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.908+0000 7fae8017ab80 1 -- 172.21.15.59:0/1273244111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56443e10ceb0 con 0x56443e1f17a0 2023-10-08T12:52:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.908+0000 7fae4dffb700 1 -- 172.21.15.59:0/1273244111 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fae6000e9e0 con 0x56443e1f17a0 2023-10-08T12:52:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.908+0000 7fae4dffb700 1 -- 172.21.15.59:0/1273244111 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae60005050 con 0x56443e1f17a0 2023-10-08T12:52:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.908+0000 7fae8017ab80 10 client.27022 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.908+0000 7fae8017ab80 1 -- 172.21.15.59:0/1273244111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56443df58c60 con 0x56443e1f17a0 2023-10-08T12:52:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.908+0000 7fae4dffb700 1 -- 172.21.15.59:0/1273244111 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56443e10ceb0 con 0x56443e1f17a0 2023-10-08T12:52:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.909+0000 7fae4dffb700 1 -- 172.21.15.59:0/1273244111 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fae60022430 con 0x56443e1f17a0 2023-10-08T12:52:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.909+0000 7fae8017ab80 10 client.27022 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.909+0000 7fae8017ab80 10 client.27022 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.909+0000 7fae8017ab80 20 client.27022 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.909+0000 7fae8017ab80 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56443e20c0d0 0x56443e20e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.909+0000 7fae8017ab80 4 client.27022 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.909+0000 7fae8017ab80 1 -- 172.21.15.59:0/1273244111 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56443e13de10 con 0x56443e20c0d0 2023-10-08T12:52:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.909+0000 7fae69d9a700 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56443e20c0d0 0x56443e20e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.909+0000 7fae69d9a700 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56443e20c0d0 0x56443e20e4f0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b563843a5b70efa9 server_cookie=ea89b08ec129b767 in_seq=0 out_seq=0 2023-10-08T12:52:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.909+0000 7fae4dffb700 10 client.27022 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.910+0000 7fae4dffb700 1 -- 172.21.15.59:0/1273244111 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56443e13de10 con 0x56443e20c0d0 2023-10-08T12:52:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.910+0000 7fae4dffb700 10 client.27022 handle_command_reply: tid=0 2023-10-08T12:52:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.910+0000 7fae8017ab80 1 client.27022 shutdown 2023-10-08T12:52:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.910+0000 7fae8017ab80 1 -- 172.21.15.59:0/1273244111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 msgr2=0x56443e1f9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.910+0000 7fae8017ab80 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 0x56443e1f9380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fae6001c040 tx=0x7fae60019ac0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.910+0000 7fae8017ab80 1 -- 172.21.15.59:0/1273244111 shutdown_connections 2023-10-08T12:52:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.911+0000 7fae8017ab80 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56443e20c0d0 0x56443e20e4f0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.911+0000 7fae8017ab80 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1fc650 0x56443e1f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.911+0000 7fae8017ab80 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f0e80 0x56443e1fbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.911+0000 7fae8017ab80 1 --2- 172.21.15.59:0/1273244111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f17a0 0x56443e1f9380 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.911+0000 7fae8017ab80 1 -- 172.21.15.59:0/1273244111 >> 172.21.15.59:0/1273244111 conn(0x56443e166260 msgr2=0x56443e1ecec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.911+0000 7fae4dffb700 0 client.27022 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:17.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.911+0000 7fae8017ab80 1 -- 172.21.15.59:0/1273244111 shutdown_connections 2023-10-08T12:52:17.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.911+0000 7fae8017ab80 1 -- 172.21.15.59:0/1273244111 wait complete. 2023-10-08T12:52:17.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.911+0000 7fae8017ab80 20 client.27022 trim_cache size 0 max 16384 2023-10-08T12:52:17.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.928+0000 7fae8017ab80 1 Processor -- start 2023-10-08T12:52:17.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.928+0000 7fae8017ab80 1 -- start start 2023-10-08T12:52:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e166260 0x56443e2031a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f0e80 0x56443e1f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f17a0 0x56443e1f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae8017ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443dfc5920 con 0x56443e1f17a0 2023-10-08T12:52:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae8017ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e1f1620 con 0x56443e166260 2023-10-08T12:52:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae8017ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e208c80 con 0x56443e1f0e80 2023-10-08T12:52:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae69d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e166260 0x56443e2031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae6a59b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f0e80 0x56443e1f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae69d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f17a0 0x56443e1f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae6a59b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f0e80 0x56443e1f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58636/0 (socket says 172.21.15.59:58636) 2023-10-08T12:52:17.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae6a59b700 1 -- 172.21.15.59:0/362990090 learned_addr learned my addr 172.21.15.59:0/362990090 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae6a59b700 1 -- 172.21.15.59:0/362990090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e166260 msgr2=0x56443e2031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae6a59b700 1 --2- 172.21.15.59:0/362990090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e166260 0x56443e2031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae6a59b700 1 -- 172.21.15.59:0/362990090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f17a0 msgr2=0x56443e1f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae6a59b700 1 --2- 172.21.15.59:0/362990090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f17a0 0x56443e1f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae6a59b700 1 -- 172.21.15.59:0/362990090 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56443df96250 con 0x56443e1f0e80 2023-10-08T12:52:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.929+0000 7fae69d9a700 1 --2- 172.21.15.59:0/362990090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e166260 0x56443e2031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.930+0000 7fae6a59b700 1 --2- 172.21.15.59:0/362990090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f0e80 0x56443e1f46b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fae600227c0 tx=0x7fae60009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8885e301fa0d5ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.930+0000 7fae597fa700 1 -- 172.21.15.59:0/362990090 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60011b20 con 0x56443e1f0e80 2023-10-08T12:52:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.930+0000 7fae597fa700 1 -- 172.21.15.59:0/362990090 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae60019b30 con 0x56443e1f0e80 2023-10-08T12:52:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.930+0000 7fae597fa700 1 -- 172.21.15.59:0/362990090 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae600054a0 con 0x56443e1f0e80 2023-10-08T12:52:17.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.930+0000 7fae8017ab80 1 -- 172.21.15.59:0/362990090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f0e80 msgr2=0x56443e1f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.930+0000 7fae8017ab80 1 --2- 172.21.15.59:0/362990090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f0e80 0x56443e1f46b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fae600227c0 tx=0x7fae60009800 comp rx=0 tx=0).stop 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.930+0000 7fae8017ab80 1 -- 172.21.15.59:0/362990090 shutdown_connections 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.930+0000 7fae8017ab80 1 --2- 172.21.15.59:0/362990090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e166260 0x56443e2031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.930+0000 7fae8017ab80 1 --2- 172.21.15.59:0/362990090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f17a0 0x56443e1f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.930+0000 7fae8017ab80 1 --2- 172.21.15.59:0/362990090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e1f0e80 0x56443e1f46b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.930+0000 7fae8017ab80 1 -- 172.21.15.59:0/362990090 >> 172.21.15.59:0/362990090 conn(0x56443e1e92a0 msgr2=0x56443e1f88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.931+0000 7fae8017ab80 1 -- 172.21.15.59:0/362990090 shutdown_connections 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.931+0000 7fae8017ab80 1 -- 172.21.15.59:0/362990090 wait complete. 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.931+0000 7fae8017ab80 1 -- start start 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.931+0000 7fae8017ab80 1 Processor -- start 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e166260 0x56443e202b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1f0e80 0x56443e2030d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae8017ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f17a0 0x56443e201240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae8017ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e2017d0 con 0x56443e1f17a0 2023-10-08T12:52:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae8017ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e201940 con 0x56443e1f0e80 2023-10-08T12:52:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae8017ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e201b00 con 0x56443e166260 2023-10-08T12:52:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae8017ab80 10 client.0 _ll_register_callbacks cb 0x7fae60005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae6a59b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1f0e80 0x56443e2030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae6a59b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1f0e80 0x56443e2030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57162/0 (socket says 172.21.15.59:57162) 2023-10-08T12:52:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae6a59b700 1 -- 172.21.15.59:0/755916157 learned_addr learned my addr 172.21.15.59:0/755916157 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae69d9a700 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e166260 0x56443e202b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.932+0000 7fae69d9a700 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f17a0 0x56443e201240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.933+0000 7fae6a59b700 1 -- 172.21.15.59:0/755916157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e166260 msgr2=0x56443e202b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.933+0000 7fae6a59b700 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e166260 0x56443e202b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.933+0000 7fae6a59b700 1 -- 172.21.15.59:0/755916157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f17a0 msgr2=0x56443e201240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.933+0000 7fae6a59b700 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f17a0 0x56443e201240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.933+0000 7fae6a59b700 1 -- 172.21.15.59:0/755916157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae54038040 con 0x56443e1f0e80 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.933+0000 7fae69d9a700 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f17a0 0x56443e201240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.933+0000 7fae6a59b700 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1f0e80 0x56443e2030d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fae60011760 tx=0x7fae60011b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=901a644828f4342b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.933+0000 7fae4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.933+0000 7fae4dffb700 1 -- 172.21.15.59:0/755916157 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000e880 con 0x56443e1f0e80 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.933+0000 7fae8017ab80 1 -- 172.21.15.59:0/755916157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56443e13db30 con 0x56443e1f0e80 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.933+0000 7fae4dffb700 1 -- 172.21.15.59:0/755916157 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fae60000e40 con 0x56443e1f0e80 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae4dffb700 1 -- 172.21.15.59:0/755916157 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae60019ac0 con 0x56443e1f0e80 2023-10-08T12:52:17.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae8017ab80 10 client.27035 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:17.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae8017ab80 1 -- 172.21.15.59:0/755916157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56443df58c60 con 0x56443e1f0e80 2023-10-08T12:52:17.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae4dffb700 1 -- 172.21.15.59:0/755916157 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56443e13db30 con 0x56443e1f0e80 2023-10-08T12:52:17.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae4dffb700 1 -- 172.21.15.59:0/755916157 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fae600038c0 con 0x56443e1f0e80 2023-10-08T12:52:17.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae8017ab80 10 client.27035 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:17.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae8017ab80 10 client.27035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae8017ab80 20 client.27035 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae8017ab80 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56443e1fc650 0x56443e262df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae8017ab80 4 client.27035 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:52:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae8017ab80 1 -- 172.21.15.59:0/755916157 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56443df90f70 con 0x56443e1fc650 2023-10-08T12:52:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.934+0000 7fae69d9a700 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56443e1fc650 0x56443e262df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae69d9a700 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56443e1fc650 0x56443e262df0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51a481c347f5e75b server_cookie=3a0bb842c6ae4b35 in_seq=0 out_seq=0 2023-10-08T12:52:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae4dffb700 10 client.27035 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae4dffb700 1 -- 172.21.15.59:0/755916157 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56443df90f70 con 0x56443e1fc650 2023-10-08T12:52:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae4dffb700 10 client.27035 handle_command_reply: tid=0 2023-10-08T12:52:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae8017ab80 1 client.27035 shutdown 2023-10-08T12:52:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae8017ab80 1 -- 172.21.15.59:0/755916157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1f0e80 msgr2=0x56443e2030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae8017ab80 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1f0e80 0x56443e2030d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fae60011760 tx=0x7fae60011b20 comp rx=0 tx=0).stop 2023-10-08T12:52:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae8017ab80 1 -- 172.21.15.59:0/755916157 shutdown_connections 2023-10-08T12:52:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae8017ab80 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56443e1fc650 0x56443e262df0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae8017ab80 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56443e1f17a0 0x56443e201240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae4dffb700 0 client.27035 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae8017ab80 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56443e166260 0x56443e202b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae8017ab80 1 --2- 172.21.15.59:0/755916157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56443e1f0e80 0x56443e2030d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae8017ab80 1 -- 172.21.15.59:0/755916157 >> 172.21.15.59:0/755916157 conn(0x56443e1e92a0 msgr2=0x56443e1f46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae8017ab80 1 -- 172.21.15.59:0/755916157 shutdown_connections 2023-10-08T12:52:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.935+0000 7fae8017ab80 1 -- 172.21.15.59:0/755916157 wait complete. 2023-10-08T12:52:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae8017ab80 20 client.27035 trim_cache size 0 max 16384 2023-10-08T12:52:17.944 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:52:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:52:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:52:17.944 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:52:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 -- 172.21.15.59:0/2356645115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae500a1670 msgr2=0x7fae500a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae500a1670 0x7fae500a3b30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0ca400 tx=0x7fae5c009040 comp rx=0 tx=0).stop 2023-10-08T12:52:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 -- 172.21.15.59:0/2356645115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae64106740 msgr2=0x7fae64073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae64106740 0x7fae64073570 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00efc0 tx=0x7fae5c00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 -- 172.21.15.59:0/2356645115 shutdown_connections 2023-10-08T12:52:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae500a1670 0x7fae500a3b30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae64106740 0x7fae64073570 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae64100730 0x7fae64072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 --2- 172.21.15.59:0/2356645115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae641010f0 0x7fae64073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 -- 172.21.15.59:0/2356645115 >> 172.21.15.59:0/2356645115 conn(0x7fae640fc200 msgr2=0x7fae640fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 -- 172.21.15.59:0/2356645115 shutdown_connections 2023-10-08T12:52:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:17.936+0000 7fae6c7ff700 1 -- 172.21.15.59:0/2356645115 wait complete. 2023-10-08T12:52:17.955 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:52:17.955 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:52:18.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.166+0000 7fd875bff700 1 -- 172.21.15.59:0/836241757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd870073540 msgr2=0x7fd87010c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.166+0000 7fd875bff700 1 --2- 172.21.15.59:0/836241757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd870073540 0x7fd87010c930 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd864009990 tx=0x7fd864009ca0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.166+0000 7fd875bff700 1 -- 172.21.15.59:0/836241757 shutdown_connections 2023-10-08T12:52:18.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.166+0000 7fd875bff700 1 --2- 172.21.15.59:0/836241757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870072c20 0x7fd870073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.166+0000 7fd875bff700 1 --2- 172.21.15.59:0/836241757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87010ce70 0x7fd87010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.166+0000 7fd875bff700 1 --2- 172.21.15.59:0/836241757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd870073540 0x7fd87010c930 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.166+0000 7fd875bff700 1 -- 172.21.15.59:0/836241757 >> 172.21.15.59:0/836241757 conn(0x7fd8700fc1a0 msgr2=0x7fd8700fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:18.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.166+0000 7fd875bff700 1 -- 172.21.15.59:0/836241757 shutdown_connections 2023-10-08T12:52:18.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.166+0000 7fd875bff700 1 -- 172.21.15.59:0/836241757 wait complete. 2023-10-08T12:52:18.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.167+0000 7fd875bff700 1 Processor -- start 2023-10-08T12:52:18.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.167+0000 7fd875bff700 1 -- start start 2023-10-08T12:52:18.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.168+0000 7fd875bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd870072c20 0x7fd870198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.168+0000 7fd875bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870073540 0x7fd8701992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.168+0000 7fd875bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87010ce70 0x7fd87019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.168+0000 7fd875bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87019dc90 con 0x7fd870072c20 2023-10-08T12:52:18.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.168+0000 7fd875bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87019de00 con 0x7fd870073540 2023-10-08T12:52:18.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.168+0000 7fd875bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87019dfc0 con 0x7fd87010ce70 2023-10-08T12:52:18.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.168+0000 7fd86f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd870072c20 0x7fd870198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.168+0000 7fd86f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd870072c20 0x7fd870198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60408/0 (socket says 172.21.15.59:60408) 2023-10-08T12:52:18.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.168+0000 7fd86f7fe700 1 -- 172.21.15.59:0/768619078 learned_addr learned my addr 172.21.15.59:0/768619078 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:18.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.168+0000 7fd86ffff700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87010ce70 0x7fd87019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.168+0000 7fd86effd700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870073540 0x7fd8701992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.169+0000 7fd86f7fe700 1 -- 172.21.15.59:0/768619078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87010ce70 msgr2=0x7fd87019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.169+0000 7fd86f7fe700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87010ce70 0x7fd87019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.169+0000 7fd86f7fe700 1 -- 172.21.15.59:0/768619078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870073540 msgr2=0x7fd8701992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.169+0000 7fd86f7fe700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870073540 0x7fd8701992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.169+0000 7fd86f7fe700 1 -- 172.21.15.59:0/768619078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8640095f0 con 0x7fd870072c20 2023-10-08T12:52:18.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.169+0000 7fd86ffff700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87010ce70 0x7fd87019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.169+0000 7fd86f7fe700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd870072c20 0x7fd870198d70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd86000e9a0 tx=0x7fd86000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.169+0000 7fd86cff9700 1 -- 172.21.15.59:0/768619078 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860009790 con 0x7fd870072c20 2023-10-08T12:52:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.169+0000 7fd86cff9700 1 -- 172.21.15.59:0/768619078 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd860010430 con 0x7fd870072c20 2023-10-08T12:52:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.169+0000 7fd86cff9700 1 -- 172.21.15.59:0/768619078 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860018680 con 0x7fd870072c20 2023-10-08T12:52:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.170+0000 7fd875bff700 1 -- 172.21.15.59:0/768619078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87019e2a0 con 0x7fd870072c20 2023-10-08T12:52:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.170+0000 7fd875bff700 1 -- 172.21.15.59:0/768619078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8701a5ae0 con 0x7fd870072c20 2023-10-08T12:52:18.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.171+0000 7fd875bff700 1 -- 172.21.15.59:0/768619078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd870108080 con 0x7fd870072c20 2023-10-08T12:52:18.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.173+0000 7fd86cff9700 1 -- 172.21.15.59:0/768619078 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd8600105a0 con 0x7fd870072c20 2023-10-08T12:52:18.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.174+0000 7fd86cff9700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8580a1670 0x7fd8580a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.174+0000 7fd86cff9700 1 -- 172.21.15.59:0/768619078 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fd860014070 con 0x7fd870072c20 2023-10-08T12:52:18.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.174+0000 7fd86effd700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8580a1670 0x7fd8580a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.175+0000 7fd86effd700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8580a1670 0x7fd8580a3b30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd87019a2c0 tx=0x7fd86400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:18.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.179+0000 7fd86cff9700 1 -- 172.21.15.59:0/768619078 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd860096580 con 0x7fd870072c20 2023-10-08T12:52:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:18 smithi092 ceph-mon[134093]: pgmap v657: 97 pgs: 97 active+clean; 602 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 224 op/s 2023-10-08T12:52:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:18 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:52:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:18 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:18 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:52:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:18 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:18 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:52:18.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.448+0000 7fd875bff700 1 -- 172.21.15.59:0/768619078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd87019a110 con 0x7fd870072c20 2023-10-08T12:52:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.448+0000 7fd86cff9700 1 -- 172.21.15.59:0/768619078 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fd860099ba0 con 0x7fd870072c20 2023-10-08T12:52:18.450 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:52:18.450 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:52:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 -- 172.21.15.59:0/768619078 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8580a1670 msgr2=0x7fd8580a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8580a1670 0x7fd8580a3b30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd87019a2c0 tx=0x7fd86400b260 comp rx=0 tx=0).stop 2023-10-08T12:52:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 -- 172.21.15.59:0/768619078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd870072c20 msgr2=0x7fd870198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd870072c20 0x7fd870198d70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd86000e9a0 tx=0x7fd86000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 -- 172.21.15.59:0/768619078 shutdown_connections 2023-10-08T12:52:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd8580a1670 0x7fd8580a3b30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd87010ce70 0x7fd87019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd870072c20 0x7fd870198d70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 --2- 172.21.15.59:0/768619078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870073540 0x7fd8701992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 -- 172.21.15.59:0/768619078 >> 172.21.15.59:0/768619078 conn(0x7fd8700fc1a0 msgr2=0x7fd8700fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 -- 172.21.15.59:0/768619078 shutdown_connections 2023-10-08T12:52:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.451+0000 7fd875bff700 1 -- 172.21.15.59:0/768619078 wait complete. 2023-10-08T12:52:18.454 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:52:18.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:18 smithi173 ceph-mon[135182]: pgmap v657: 97 pgs: 97 active+clean; 602 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 224 op/s 2023-10-08T12:52:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:18 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:52:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:18 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:18 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:52:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:18 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:18 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:52:18.468 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:18 smithi059 ceph-mon[98489]: pgmap v657: 97 pgs: 97 active+clean; 602 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 224 op/s 2023-10-08T12:52:18.468 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:18 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:52:18.469 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:18 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:18.469 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:18 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:52:18.469 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:18 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:18.469 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:18 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:52:18.471 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:52:18.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1410978 12.61 MB/sec execute 469 sec latency 20.027 ms 2023-10-08T12:52:18.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.679+0000 7f88dedff700 1 -- 172.21.15.59:0/259830750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d810cf70 msgr2=0x7f88d810f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.679+0000 7f88dedff700 1 --2- 172.21.15.59:0/259830750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d810cf70 0x7f88d810f3e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f88d000b0a0 tx=0x7f88d000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.679+0000 7f88dedff700 1 -- 172.21.15.59:0/259830750 shutdown_connections 2023-10-08T12:52:18.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.679+0000 7f88dedff700 1 --2- 172.21.15.59:0/259830750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d810cf70 0x7f88d810f3e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.679+0000 7f88dedff700 1 --2- 172.21.15.59:0/259830750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88d8072c20 0x7f88d8073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.679+0000 7f88dedff700 1 --2- 172.21.15.59:0/259830750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d8073540 0x7f88d810ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.679+0000 7f88dedff700 1 -- 172.21.15.59:0/259830750 >> 172.21.15.59:0/259830750 conn(0x7f88d80fc200 msgr2=0x7f88d80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:18.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.679+0000 7f88dedff700 1 -- 172.21.15.59:0/259830750 shutdown_connections 2023-10-08T12:52:18.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.679+0000 7f88dedff700 1 -- 172.21.15.59:0/259830750 wait complete. 2023-10-08T12:52:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.680+0000 7f88dedff700 1 Processor -- start 2023-10-08T12:52:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88dedff700 1 -- start start 2023-10-08T12:52:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88dedff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d8072c20 0x7f88d8198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88dedff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88d8073540 0x7f88d81994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88dedff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d810cf70 0x7f88d819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88dedff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d819de70 con 0x7f88d810cf70 2023-10-08T12:52:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88dedff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d819dfe0 con 0x7f88d8072c20 2023-10-08T12:52:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88dedff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d819e1a0 con 0x7f88d8073540 2023-10-08T12:52:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88dcb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d8072c20 0x7f88d8198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88dcb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d8072c20 0x7f88d8198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57202/0 (socket says 172.21.15.59:57202) 2023-10-08T12:52:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2177277648 learned_addr learned my addr 172.21.15.59:0/2177277648 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88d7fff700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88d8073540 0x7f88d81994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.681+0000 7f88dd39c700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d810cf70 0x7f88d819d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2177277648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88d8073540 msgr2=0x7f88d81994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88d8073540 0x7f88d81994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2177277648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d810cf70 msgr2=0x7f88d819d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d810cf70 0x7f88d819d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2177277648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d0009d00 con 0x7f88d8072c20 2023-10-08T12:52:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88d7fff700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88d8073540 0x7f88d81994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d8072c20 0x7f88d8198fa0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00e9a0 tx=0x7f88cc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88d5ffb700 1 -- 172.21.15.59:0/2177277648 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc009790 con 0x7f88d8072c20 2023-10-08T12:52:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88d5ffb700 1 -- 172.21.15.59:0/2177277648 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88cc010430 con 0x7f88d8072c20 2023-10-08T12:52:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88dedff700 1 -- 172.21.15.59:0/2177277648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d819e480 con 0x7f88d8072c20 2023-10-08T12:52:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88d5ffb700 1 -- 172.21.15.59:0/2177277648 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc018680 con 0x7f88d8072c20 2023-10-08T12:52:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.682+0000 7f88dedff700 1 -- 172.21.15.59:0/2177277648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d81a5cc0 con 0x7f88d8072c20 2023-10-08T12:52:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.686+0000 7f88d5ffb700 1 -- 172.21.15.59:0/2177277648 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f88cc0105a0 con 0x7f88d8072c20 2023-10-08T12:52:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.688+0000 7f88f27cab80 1 Processor -- start 2023-10-08T12:52:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.688+0000 7f88d5ffb700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f88c80a15f0 0x7f88c80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.688+0000 7f88f27cab80 1 -- start start 2023-10-08T12:52:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.688+0000 7f88d5ffb700 1 -- 172.21.15.59:0/2177277648 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f88cc014070 con 0x7f88d8072c20 2023-10-08T12:52:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88d7fff700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f88c80a15f0 0x7f88c80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a99e80 0x55e892a9a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a9a7a0 0x55e892aa5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 0x55e892aa7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88f27cab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e892a03460 con 0x55e892aa5650 2023-10-08T12:52:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88f27cab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8929f4c20 con 0x55e892a99e80 2023-10-08T12:52:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88f27cab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8929f2540 con 0x55e892a9a7a0 2023-10-08T12:52:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88dcb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a99e80 0x55e892a9a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88d7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a9a7a0 0x55e892aa5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88dcb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a99e80 0x55e892a9a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57214/0 (socket says 172.21.15.59:57214) 2023-10-08T12:52:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2510406802 learned_addr learned my addr 172.21.15.59:0/2510406802 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88dd39c700 1 --2- 172.21.15.59:0/2510406802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 0x55e892aa7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2510406802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a9a7a0 msgr2=0x55e892aa5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/2510406802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a9a7a0 0x55e892aa5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2510406802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 msgr2=0x55e892aa7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/2510406802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 0x55e892aa7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2510406802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e892818de0 con 0x55e892a99e80 2023-10-08T12:52:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.689+0000 7f88dd39c700 1 --2- 172.21.15.59:0/2510406802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 0x55e892aa7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.690+0000 7f88d7fff700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f88c80a15f0 0x7f88c80a3ab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f88d819a4a0 tx=0x7f88c4011c50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.690+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/2510406802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a99e80 0x55e892a9a260 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c2d0 tx=0x7f88cc099cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5dd47330d69199a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.690+0000 7f88c2ffd700 1 -- 172.21.15.59:0/2510406802 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0b1070 con 0x55e892a99e80 2023-10-08T12:52:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.690+0000 7f88c2ffd700 1 -- 172.21.15.59:0/2510406802 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88cc0a2630 con 0x55e892a99e80 2023-10-08T12:52:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.690+0000 7f88c2ffd700 1 -- 172.21.15.59:0/2510406802 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc09a500 con 0x55e892a99e80 2023-10-08T12:52:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.691+0000 7f88f27cab80 1 -- 172.21.15.59:0/2510406802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a99e80 msgr2=0x55e892a9a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.691+0000 7f88f27cab80 1 --2- 172.21.15.59:0/2510406802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a99e80 0x55e892a9a260 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c2d0 tx=0x7f88cc099cd0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.691+0000 7f88f27cab80 1 -- 172.21.15.59:0/2510406802 shutdown_connections 2023-10-08T12:52:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.691+0000 7f88f27cab80 1 --2- 172.21.15.59:0/2510406802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a99e80 0x55e892a9a260 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.691+0000 7f88f27cab80 1 --2- 172.21.15.59:0/2510406802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 0x55e892aa7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.691+0000 7f88f27cab80 1 --2- 172.21.15.59:0/2510406802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a9a7a0 0x55e892aa5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.691+0000 7f88f27cab80 1 -- 172.21.15.59:0/2510406802 >> 172.21.15.59:0/2510406802 conn(0x55e892a0f260 msgr2=0x55e892a962d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.691+0000 7f88f27cab80 1 -- 172.21.15.59:0/2510406802 shutdown_connections 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.691+0000 7f88f27cab80 1 -- 172.21.15.59:0/2510406802 wait complete. 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.691+0000 7f88f27cab80 1 -- start start 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88f27cab80 1 Processor -- start 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892a9a7a0 0x55e892aa29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 0x55e892aa2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88f27cab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8929ede30 con 0x55e892a9a7a0 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88f27cab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89298a710 con 0x55e892aa5650 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88f27cab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89298a3b0 con 0x55e892a99e80 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88f27cab80 10 client.0 _ll_register_callbacks cb 0x55e8927e7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88dcb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88dcb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58708/0 (socket says 172.21.15.59:58708) 2023-10-08T12:52:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2430378442 learned_addr learned my addr 172.21.15.59:0/2430378442 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88dd39c700 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 0x55e892aa2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.692+0000 7f88d7fff700 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892a9a7a0 0x55e892aa29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2430378442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 msgr2=0x55e892aa2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 0x55e892aa2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2430378442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892a9a7a0 msgr2=0x55e892aa29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892a9a7a0 0x55e892aa29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88dcb9b700 1 -- 172.21.15.59:0/2430378442 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d81a5cc0 con 0x55e892a99e80 2023-10-08T12:52:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2480 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0967a0 tx=0x7f88cc010b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf54fbf76b83e134 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88b7fff700 1 -- 172.21.15.59:0/2430378442 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0b1030 con 0x55e892a99e80 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88f27cab80 1 -- 172.21.15.59:0/2430378442 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8929b5eb0 con 0x55e892a99e80 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88b7fff700 1 -- 172.21.15.59:0/2430378442 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f88cc0b2070 con 0x55e892a99e80 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88b7fff700 1 -- 172.21.15.59:0/2430378442 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88cc09a500 con 0x55e892a99e80 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88f27cab80 10 client.27046 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.693+0000 7f88f27cab80 1 -- 172.21.15.59:0/2430378442 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e892801c60 con 0x55e892a99e80 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.694+0000 7f88b7fff700 1 -- 172.21.15.59:0/2430378442 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e8929b5eb0 con 0x55e892a99e80 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.694+0000 7f88b7fff700 1 -- 172.21.15.59:0/2430378442 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f88cc099200 con 0x55e892a99e80 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.694+0000 7f88f27cab80 10 client.27046 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.694+0000 7f88f27cab80 10 client.27046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.694+0000 7f88f27cab80 20 client.27046 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.694+0000 7f88f27cab80 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e892ab4d60 0x55e892ab7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.694+0000 7f88f27cab80 4 client.27046 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.694+0000 7f88f27cab80 1 -- 172.21.15.59:0/2430378442 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8929e6e10 con 0x55e892ab4d60 2023-10-08T12:52:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.694+0000 7f88d7fff700 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e892ab4d60 0x55e892ab7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.695+0000 7f88b7fff700 10 client.27046 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.695+0000 7f88d7fff700 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e892ab4d60 0x55e892ab7180 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95c749b0465303b3 server_cookie=b834f6f559b1cd9b in_seq=0 out_seq=0 2023-10-08T12:52:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88b7fff700 1 -- 172.21.15.59:0/2430378442 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e8929e6e10 con 0x55e892ab4d60 2023-10-08T12:52:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88b7fff700 10 client.27046 handle_command_reply: tid=0 2023-10-08T12:52:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88f27cab80 1 client.27046 shutdown 2023-10-08T12:52:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88f27cab80 1 -- 172.21.15.59:0/2430378442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 msgr2=0x55e892aa2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88f27cab80 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2480 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0967a0 tx=0x7f88cc010b80 comp rx=0 tx=0).stop 2023-10-08T12:52:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88f27cab80 1 -- 172.21.15.59:0/2430378442 shutdown_connections 2023-10-08T12:52:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88f27cab80 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e892ab4d60 0x55e892ab7180 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88f27cab80 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 0x55e892aa2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88f27cab80 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2480 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88b7fff700 0 client.27046 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88f27cab80 1 --2- 172.21.15.59:0/2430378442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892a9a7a0 0x55e892aa29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88f27cab80 1 -- 172.21.15.59:0/2430378442 >> 172.21.15.59:0/2430378442 conn(0x55e892a0f260 msgr2=0x55e892a95ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88f27cab80 1 -- 172.21.15.59:0/2430378442 shutdown_connections 2023-10-08T12:52:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.696+0000 7f88f27cab80 1 -- 172.21.15.59:0/2430378442 wait complete. 2023-10-08T12:52:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.697+0000 7f88f27cab80 20 client.27046 trim_cache size 0 max 16384 2023-10-08T12:52:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.712+0000 7f88f27cab80 1 Processor -- start 2023-10-08T12:52:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88f27cab80 1 -- start start 2023-10-08T12:52:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a9a7a0 0x55e892aa1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 0x55e892a9f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88f27cab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89286e920 con 0x55e892aa5650 2023-10-08T12:52:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88f27cab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e892a92ae0 con 0x55e892a9a7a0 2023-10-08T12:52:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88f27cab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e892a97660 con 0x55e892a99e80 2023-10-08T12:52:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88dcb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88d7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a9a7a0 0x55e892aa1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88dd39c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 0x55e892a9f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88dcb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58712/0 (socket says 172.21.15.59:58712) 2023-10-08T12:52:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.713+0000 7f88dcb9b700 1 -- 172.21.15.59:0/3079568049 learned_addr learned my addr 172.21.15.59:0/3079568049 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.714+0000 7f88d7fff700 1 -- 172.21.15.59:0/3079568049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 msgr2=0x55e892aa2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.714+0000 7f88d7fff700 1 --2- 172.21.15.59:0/3079568049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.714+0000 7f88d7fff700 1 -- 172.21.15.59:0/3079568049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 msgr2=0x55e892a9f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.714+0000 7f88d7fff700 1 --2- 172.21.15.59:0/3079568049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 0x55e892a9f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.714+0000 7f88d7fff700 1 -- 172.21.15.59:0/3079568049 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e89283f250 con 0x55e892a9a7a0 2023-10-08T12:52:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.714+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/3079568049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.714+0000 7f88dd39c700 1 --2- 172.21.15.59:0/3079568049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 0x55e892a9f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.714+0000 7f88d7fff700 1 --2- 172.21.15.59:0/3079568049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a9a7a0 0x55e892aa1460 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x55e892ab7a50 tx=0x7f88c401f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3787a18274dd826 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.714+0000 7f88c37fe700 1 -- 172.21.15.59:0/3079568049 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4026070 con 0x55e892a9a7a0 2023-10-08T12:52:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.714+0000 7f88c37fe700 1 -- 172.21.15.59:0/3079568049 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88c4004540 con 0x55e892a9a7a0 2023-10-08T12:52:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.714+0000 7f88c37fe700 1 -- 172.21.15.59:0/3079568049 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c40039e0 con 0x55e892a9a7a0 2023-10-08T12:52:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.715+0000 7f88f27cab80 1 -- 172.21.15.59:0/3079568049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a9a7a0 msgr2=0x55e892aa1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.715+0000 7f88f27cab80 1 --2- 172.21.15.59:0/3079568049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a9a7a0 0x55e892aa1460 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x55e892ab7a50 tx=0x7f88c401f000 comp rx=0 tx=0).stop 2023-10-08T12:52:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.715+0000 7f88f27cab80 1 -- 172.21.15.59:0/3079568049 shutdown_connections 2023-10-08T12:52:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.715+0000 7f88f27cab80 1 --2- 172.21.15.59:0/3079568049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892aa5650 0x55e892a9f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.715+0000 7f88f27cab80 1 --2- 172.21.15.59:0/3079568049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a99e80 0x55e892aa2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.715+0000 7f88f27cab80 1 --2- 172.21.15.59:0/3079568049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892a9a7a0 0x55e892aa1460 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.715+0000 7f88f27cab80 1 -- 172.21.15.59:0/3079568049 >> 172.21.15.59:0/3079568049 conn(0x55e892a0f260 msgr2=0x55e892aa0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.715+0000 7f88f27cab80 1 -- 172.21.15.59:0/3079568049 shutdown_connections 2023-10-08T12:52:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.715+0000 7f88f27cab80 1 -- 172.21.15.59:0/3079568049 wait complete. 2023-10-08T12:52:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.716+0000 7f88f27cab80 1 -- start start 2023-10-08T12:52:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.716+0000 7f88f27cab80 1 Processor -- start 2023-10-08T12:52:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.716+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892a99e80 0x55e892aac010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.716+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a9a7a0 0x55e892aaa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.716+0000 7f88f27cab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 0x55e892aaa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.716+0000 7f88f27cab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e892aaaed0 con 0x55e892a99e80 2023-10-08T12:52:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.716+0000 7f88f27cab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e892aab040 con 0x55e892aa5650 2023-10-08T12:52:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.716+0000 7f88f27cab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e892aab200 con 0x55e892a9a7a0 2023-10-08T12:52:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.716+0000 7f88f27cab80 10 client.0 _ll_register_callbacks cb 0x55e8927e7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88dd39c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 0x55e892aaa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88dd39c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 0x55e892aaa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57242/0 (socket says 172.21.15.59:57242) 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88dcb9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892a99e80 0x55e892aac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88dd39c700 1 -- 172.21.15.59:0/3429397430 learned_addr learned my addr 172.21.15.59:0/3429397430 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88d7fff700 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a9a7a0 0x55e892aaa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88dd39c700 1 -- 172.21.15.59:0/3429397430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a9a7a0 msgr2=0x55e892aaa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88dd39c700 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a9a7a0 0x55e892aaa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88dd39c700 1 -- 172.21.15.59:0/3429397430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892a99e80 msgr2=0x55e892aac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88dd39c700 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892a99e80 0x55e892aac010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88dd39c700 1 -- 172.21.15.59:0/3429397430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc064070 con 0x55e892aa5650 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892a99e80 0x55e892aac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88dd39c700 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 0x55e892aaa940 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f88d0015000 tx=0x7f88d000bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfd5e6bb28ea1aca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.717+0000 7f88b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.718+0000 7f88b7fff700 1 -- 172.21.15.59:0/3429397430 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d000e040 con 0x55e892aa5650 2023-10-08T12:52:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.718+0000 7f88f27cab80 1 -- 172.21.15.59:0/3429397430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f88cc0a2630 con 0x55e892aa5650 2023-10-08T12:52:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.718+0000 7f88b7fff700 1 -- 172.21.15.59:0/3429397430 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f88d0003e10 con 0x55e892aa5650 2023-10-08T12:52:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.718+0000 7f88b7fff700 1 -- 172.21.15.59:0/3429397430 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88d00074e0 con 0x55e892aa5650 2023-10-08T12:52:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.718+0000 7f88f27cab80 10 client.27059 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.718+0000 7f88f27cab80 1 -- 172.21.15.59:0/3429397430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f88d81100a0 con 0x55e892aa5650 2023-10-08T12:52:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.718+0000 7f88b7fff700 1 -- 172.21.15.59:0/3429397430 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88cc0a2630 con 0x55e892aa5650 2023-10-08T12:52:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.719+0000 7f88b7fff700 1 -- 172.21.15.59:0/3429397430 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f88d0019070 con 0x55e892aa5650 2023-10-08T12:52:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.719+0000 7f88f27cab80 10 client.27059 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.719+0000 7f88f27cab80 10 client.27059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.719+0000 7f88f27cab80 20 client.27059 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.719+0000 7f88f27cab80 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e892b0a1f0 0x55e892b0c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.719+0000 7f88f27cab80 4 client.27059 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.719+0000 7f88f27cab80 1 -- 172.21.15.59:0/3429397430 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e8929e6b30 con 0x55e892b0a1f0 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.719+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e892b0a1f0 0x55e892b0c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.719+0000 7f88dcb9b700 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e892b0a1f0 0x55e892b0c610 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6035318b07bc1e1c server_cookie=625f892f52d261bc in_seq=0 out_seq=0 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.719+0000 7f88b7fff700 10 client.27059 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88b7fff700 1 -- 172.21.15.59:0/3429397430 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e8929e6b30 con 0x55e892b0a1f0 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88b7fff700 10 client.27059 handle_command_reply: tid=0 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 1 client.27059 shutdown 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 1 -- 172.21.15.59:0/3429397430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 msgr2=0x55e892aaa940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 0x55e892aaa940 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f88d0015000 tx=0x7f88d000bcc0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 1 -- 172.21.15.59:0/3429397430 shutdown_connections 2023-10-08T12:52:18.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e892b0a1f0 0x55e892b0c610 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e892aa5650 0x55e892aaa940 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e892a99e80 0x55e892aac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 1 --2- 172.21.15.59:0/3429397430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e892a9a7a0 0x55e892aaa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88b7fff700 0 client.27059 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:18.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 1 -- 172.21.15.59:0/3429397430 >> 172.21.15.59:0/3429397430 conn(0x55e892a0f260 msgr2=0x55e892aa44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:18.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 1 -- 172.21.15.59:0/3429397430 shutdown_connections 2023-10-08T12:52:18.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 1 -- 172.21.15.59:0/3429397430 wait complete. 2023-10-08T12:52:18.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.720+0000 7f88f27cab80 20 client.27059 trim_cache size 0 max 16384 2023-10-08T12:52:18.726 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:52:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 -- 172.21.15.59:0/2177277648 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f88c80a15f0 msgr2=0x7f88c80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f88c80a15f0 0x7f88c80a3ab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f88d819a4a0 tx=0x7f88c4011c50 comp rx=0 tx=0).stop 2023-10-08T12:52:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 -- 172.21.15.59:0/2177277648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d8072c20 msgr2=0x7f88d8198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d8072c20 0x7f88d8198fa0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00e9a0 tx=0x7f88cc00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 -- 172.21.15.59:0/2177277648 shutdown_connections 2023-10-08T12:52:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f88c80a15f0 0x7f88c80a3ab0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d8072c20 0x7f88d8198fa0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d810cf70 0x7f88d819d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 --2- 172.21.15.59:0/2177277648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88d8073540 0x7f88d81994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 -- 172.21.15.59:0/2177277648 >> 172.21.15.59:0/2177277648 conn(0x7f88d80fc200 msgr2=0x7f88d80fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 -- 172.21.15.59:0/2177277648 shutdown_connections 2023-10-08T12:52:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:18.721+0000 7f88dedff700 1 -- 172.21.15.59:0/2177277648 wait complete. 2023-10-08T12:52:19.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:19 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/768619078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:19.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:19 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/768619078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:19.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:19 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/768619078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:19.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1412401 12.60 MB/sec execute 470 sec latency 86.554 ms 2023-10-08T12:52:19.751 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:52:19.751 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:52:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.001+0000 7f11de7ff700 1 -- 172.21.15.59:0/2731204471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11d81010f0 msgr2=0x7f11d810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.001+0000 7f11de7ff700 1 --2- 172.21.15.59:0/2731204471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11d81010f0 0x7f11d810d600 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f11d000b0a0 tx=0x7f11d000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.001+0000 7f11de7ff700 1 -- 172.21.15.59:0/2731204471 shutdown_connections 2023-10-08T12:52:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.001+0000 7f11de7ff700 1 --2- 172.21.15.59:0/2731204471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11d81010f0 0x7f11d810d600 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.001+0000 7f11de7ff700 1 --2- 172.21.15.59:0/2731204471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d8106740 0x7f11d8106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.001+0000 7f11de7ff700 1 --2- 172.21.15.59:0/2731204471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11d8100730 0x7f11d8100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.001+0000 7f11de7ff700 1 -- 172.21.15.59:0/2731204471 >> 172.21.15.59:0/2731204471 conn(0x7f11d80fc200 msgr2=0x7f11d80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.001+0000 7f11de7ff700 1 -- 172.21.15.59:0/2731204471 shutdown_connections 2023-10-08T12:52:20.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.001+0000 7f11de7ff700 1 -- 172.21.15.59:0/2731204471 wait complete. 2023-10-08T12:52:20.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.002+0000 7f11de7ff700 1 Processor -- start 2023-10-08T12:52:20.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.003+0000 7f11de7ff700 1 -- start start 2023-10-08T12:52:20.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.003+0000 7f11de7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11d8100730 0x7f11d8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.003+0000 7f11de7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d81010f0 0x7f11d8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.003+0000 7f11de7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11d8106740 0x7f11d8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.003+0000 7f11de7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d81a4f40 con 0x7f11d81010f0 2023-10-08T12:52:20.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.003+0000 7f11de7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d81a50b0 con 0x7f11d8100730 2023-10-08T12:52:20.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.003+0000 7f11de7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d81a5270 con 0x7f11d8106740 2023-10-08T12:52:20.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.003+0000 7f11d7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11d8100730 0x7f11d8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.003+0000 7f11d7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11d8100730 0x7f11d8072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57252/0 (socket says 172.21.15.59:57252) 2023-10-08T12:52:20.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.003+0000 7f11d7fff700 1 -- 172.21.15.59:0/4249465867 learned_addr learned my addr 172.21.15.59:0/4249465867 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:20.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.003+0000 7f11d77fe700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d81010f0 0x7f11d8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11dcd9c700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11d8106740 0x7f11d8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11d7fff700 1 -- 172.21.15.59:0/4249465867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11d8106740 msgr2=0x7f11d8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11d7fff700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11d8106740 0x7f11d8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11d7fff700 1 -- 172.21.15.59:0/4249465867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d81010f0 msgr2=0x7f11d8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11d7fff700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d81010f0 0x7f11d8073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11d7fff700 1 -- 172.21.15.59:0/4249465867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d0009d00 con 0x7f11d8100730 2023-10-08T12:52:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11d7fff700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11d8100730 0x7f11d8072af0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f11c800e9a0 tx=0x7f11c800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11d57fa700 1 -- 172.21.15.59:0/4249465867 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8009790 con 0x7f11d8100730 2023-10-08T12:52:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11d57fa700 1 -- 172.21.15.59:0/4249465867 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11c800cbd0 con 0x7f11d8100730 2023-10-08T12:52:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11de7ff700 1 -- 172.21.15.59:0/4249465867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d81a5550 con 0x7f11d8100730 2023-10-08T12:52:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11d57fa700 1 -- 172.21.15.59:0/4249465867 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8018680 con 0x7f11d8100730 2023-10-08T12:52:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.004+0000 7f11de7ff700 1 -- 172.21.15.59:0/4249465867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d81a5a60 con 0x7f11d8100730 2023-10-08T12:52:20.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.008+0000 7f11d57fa700 1 -- 172.21.15.59:0/4249465867 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f11c800cd40 con 0x7f11d8100730 2023-10-08T12:52:20.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.010+0000 7f11d57fa700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c00a15f0 0x7f11c00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.010+0000 7f11d57fa700 1 -- 172.21.15.59:0/4249465867 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f11c8014070 con 0x7f11d8100730 2023-10-08T12:52:20.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.010+0000 7f11d77fe700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c00a15f0 0x7f11c00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.010+0000 7f11f2128b80 1 Processor -- start 2023-10-08T12:52:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.010+0000 7f11f2128b80 1 -- start start 2023-10-08T12:52:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c370569f00 0x55c37056a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11d77fe700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c00a15f0 0x7f11c00a3ab0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f11d8074220 tx=0x7f11cc0073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c37056a820 0x55c370575190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3705756d0 0x55c370577ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11f2128b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3704d34e0 con 0x55c3705756d0 2023-10-08T12:52:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11f2128b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3704c4ca0 con 0x55c370569f00 2023-10-08T12:52:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11f2128b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3704c25c0 con 0x55c37056a820 2023-10-08T12:52:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11d7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c370569f00 0x55c37056a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11d7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c370569f00 0x55c37056a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57260/0 (socket says 172.21.15.59:57260) 2023-10-08T12:52:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11d7fff700 1 -- 172.21.15.59:0/3086101114 learned_addr learned my addr 172.21.15.59:0/3086101114 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11dcd9c700 1 --2- 172.21.15.59:0/3086101114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3705756d0 0x55c370577ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11d77fe700 1 --2- 172.21.15.59:0/3086101114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c37056a820 0x55c370575190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11d7fff700 1 -- 172.21.15.59:0/3086101114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c37056a820 msgr2=0x55c370575190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11d7fff700 1 --2- 172.21.15.59:0/3086101114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c37056a820 0x55c370575190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11d7fff700 1 -- 172.21.15.59:0/3086101114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3705756d0 msgr2=0x55c370577ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11d7fff700 1 --2- 172.21.15.59:0/3086101114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3705756d0 0x55c370577ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11d7fff700 1 -- 172.21.15.59:0/3086101114 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3702e8e60 con 0x55c370569f00 2023-10-08T12:52:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.011+0000 7f11dcd9c700 1 --2- 172.21.15.59:0/3086101114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3705756d0 0x55c370577ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.012+0000 7f11d7fff700 1 --2- 172.21.15.59:0/3086101114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c370569f00 0x55c37056a2e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f11c809a000 tx=0x7f11c8099c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3a159ba5d90d2cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.012+0000 7f11be7fc700 1 -- 172.21.15.59:0/3086101114 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c809a300 con 0x55c370569f00 2023-10-08T12:52:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.012+0000 7f11be7fc700 1 -- 172.21.15.59:0/3086101114 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11c80b0070 con 0x55c370569f00 2023-10-08T12:52:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.012+0000 7f11be7fc700 1 -- 172.21.15.59:0/3086101114 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c80997f0 con 0x55c370569f00 2023-10-08T12:52:20.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.013+0000 7f11f2128b80 1 -- 172.21.15.59:0/3086101114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c370569f00 msgr2=0x55c37056a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.013+0000 7f11f2128b80 1 --2- 172.21.15.59:0/3086101114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c370569f00 0x55c37056a2e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f11c809a000 tx=0x7f11c8099c60 comp rx=0 tx=0).stop 2023-10-08T12:52:20.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.013+0000 7f11f2128b80 1 -- 172.21.15.59:0/3086101114 shutdown_connections 2023-10-08T12:52:20.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.013+0000 7f11f2128b80 1 --2- 172.21.15.59:0/3086101114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c370569f00 0x55c37056a2e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.013+0000 7f11f2128b80 1 --2- 172.21.15.59:0/3086101114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3705756d0 0x55c370577ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.013+0000 7f11f2128b80 1 --2- 172.21.15.59:0/3086101114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c37056a820 0x55c370575190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.013+0000 7f11f2128b80 1 -- 172.21.15.59:0/3086101114 >> 172.21.15.59:0/3086101114 conn(0x55c3704df2e0 msgr2=0x55c370566350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.013+0000 7f11f2128b80 1 -- 172.21.15.59:0/3086101114 shutdown_connections 2023-10-08T12:52:20.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.013+0000 7f11f2128b80 1 -- 172.21.15.59:0/3086101114 wait complete. 2023-10-08T12:52:20.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.013+0000 7f11f2128b80 1 -- start start 2023-10-08T12:52:20.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.014+0000 7f11f2128b80 1 Processor -- start 2023-10-08T12:52:20.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.014+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c370575170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.014+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c370572500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3705756d0 0x55c370572c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11f2128b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3704bdeb0 con 0x55c370569f00 2023-10-08T12:52:20.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11f2128b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c37045a790 con 0x55c37056a820 2023-10-08T12:52:20.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11f2128b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c37045a430 con 0x55c3705756d0 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11f2128b80 10 client.0 _ll_register_callbacks cb 0x55c3702b7880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c370572500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c370572500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57274/0 (socket says 172.21.15.59:57274) 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11d77fe700 1 -- 172.21.15.59:0/2703171735 learned_addr learned my addr 172.21.15.59:0/2703171735 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11d7fff700 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c370575170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11dcd9c700 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3705756d0 0x55c370572c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11d77fe700 1 -- 172.21.15.59:0/2703171735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3705756d0 msgr2=0x55c370572c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11d77fe700 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3705756d0 0x55c370572c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11d77fe700 1 -- 172.21.15.59:0/2703171735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 msgr2=0x55c370575170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11d77fe700 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c370575170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11d77fe700 1 -- 172.21.15.59:0/2703171735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d81a5a60 con 0x55c37056a820 2023-10-08T12:52:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.015+0000 7f11dcd9c700 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3705756d0 0x55c370572c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.016+0000 7f11d77fe700 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c370572500 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f11cc004660 tx=0x7f11cc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1e9005508884ad7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.016+0000 7f11b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.016+0000 7f11b77fe700 1 -- 172.21.15.59:0/2703171735 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc003880 con 0x55c37056a820 2023-10-08T12:52:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.016+0000 7f11f2128b80 1 -- 172.21.15.59:0/2703171735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c370485f30 con 0x55c37056a820 2023-10-08T12:52:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.016+0000 7f11b77fe700 1 -- 172.21.15.59:0/2703171735 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f11cc017070 con 0x55c37056a820 2023-10-08T12:52:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.016+0000 7f11b77fe700 1 -- 172.21.15.59:0/2703171735 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11cc0039e0 con 0x55c37056a820 2023-10-08T12:52:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.016+0000 7f11f2128b80 10 client.27071 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.016+0000 7f11f2128b80 1 -- 172.21.15.59:0/2703171735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c3702d1ce0 con 0x55c37056a820 2023-10-08T12:52:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.016+0000 7f11b77fe700 1 -- 172.21.15.59:0/2703171735 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c370485f30 con 0x55c37056a820 2023-10-08T12:52:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.017+0000 7f11b77fe700 1 -- 172.21.15.59:0/2703171735 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f11cc020410 con 0x55c37056a820 2023-10-08T12:52:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.017+0000 7f11f2128b80 10 client.27071 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.017+0000 7f11f2128b80 10 client.27071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.017+0000 7f11f2128b80 20 client.27071 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.017+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c370585270 0x55c370587690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.017+0000 7f11f2128b80 4 client.27071 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.017+0000 7f11f2128b80 1 -- 172.21.15.59:0/2703171735 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3704b6e90 con 0x55c370585270 2023-10-08T12:52:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.017+0000 7f11d7fff700 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c370585270 0x55c370587690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.017+0000 7f11d7fff700 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c370585270 0x55c370587690 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2c1f74a0d9fb1a7 server_cookie=7fdfdd4484f2105c in_seq=0 out_seq=0 2023-10-08T12:52:20.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.017+0000 7f11b77fe700 10 client.27071 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:20.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.018+0000 7f11b77fe700 1 -- 172.21.15.59:0/2703171735 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c3704b6e90 con 0x55c370585270 2023-10-08T12:52:20.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.018+0000 7f11b77fe700 10 client.27071 handle_command_reply: tid=0 2023-10-08T12:52:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.018+0000 7f11f2128b80 1 client.27071 shutdown 2023-10-08T12:52:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.018+0000 7f11f2128b80 1 -- 172.21.15.59:0/2703171735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 msgr2=0x55c370572500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.018+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c370572500 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f11cc004660 tx=0x7f11cc0047c0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.019+0000 7f11f2128b80 1 -- 172.21.15.59:0/2703171735 shutdown_connections 2023-10-08T12:52:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.019+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c370585270 0x55c370587690 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.019+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3705756d0 0x55c370572c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.019+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c370575170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.019+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2703171735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c370572500 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.019+0000 7f11f2128b80 1 -- 172.21.15.59:0/2703171735 >> 172.21.15.59:0/2703171735 conn(0x55c3704df2e0 msgr2=0x55c370565f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.019+0000 7f11b77fe700 0 client.27071 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:20.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.019+0000 7f11f2128b80 1 -- 172.21.15.59:0/2703171735 shutdown_connections 2023-10-08T12:52:20.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.019+0000 7f11f2128b80 1 -- 172.21.15.59:0/2703171735 wait complete. 2023-10-08T12:52:20.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.019+0000 7f11f2128b80 20 client.27071 trim_cache size 0 max 16384 2023-10-08T12:52:20.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11f2128b80 1 Processor -- start 2023-10-08T12:52:20.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11f2128b80 1 -- start start 2023-10-08T12:52:20.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c3705657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c37056a820 0x55c37057c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3705756d0 0x55c370571dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11f2128b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c37033e9a0 con 0x55c370569f00 2023-10-08T12:52:20.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11f2128b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3705679e0 con 0x55c3705756d0 2023-10-08T12:52:20.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11f2128b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c370573ab0 con 0x55c37056a820 2023-10-08T12:52:20.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11dcd9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3705756d0 0x55c370571dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11d7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c3705657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11dcd9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3705756d0 0x55c370571dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57290/0 (socket says 172.21.15.59:57290) 2023-10-08T12:52:20.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.039+0000 7f11dcd9c700 1 -- 172.21.15.59:0/3090448335 learned_addr learned my addr 172.21.15.59:0/3090448335 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:20.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.040+0000 7f11d77fe700 1 --2- 172.21.15.59:0/3090448335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c37056a820 0x55c37057c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.040+0000 7f11d77fe700 1 -- 172.21.15.59:0/3090448335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3705756d0 msgr2=0x55c370571dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.040+0000 7f11d77fe700 1 --2- 172.21.15.59:0/3090448335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3705756d0 0x55c370571dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.040+0000 7f11d77fe700 1 -- 172.21.15.59:0/3090448335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 msgr2=0x55c3705657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.040+0000 7f11d77fe700 1 --2- 172.21.15.59:0/3090448335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c3705657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.040+0000 7f11d77fe700 1 -- 172.21.15.59:0/3090448335 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c37058c2c0 con 0x55c37056a820 2023-10-08T12:52:20.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.040+0000 7f11dcd9c700 1 --2- 172.21.15.59:0/3090448335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3705756d0 0x55c370571dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.040+0000 7f11d77fe700 1 --2- 172.21.15.59:0/3090448335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c37056a820 0x55c37057c220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55c370573a30 tx=0x7f11cc0071e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49ddb3434cd26cbb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.040+0000 7f11beffd700 1 -- 172.21.15.59:0/3090448335 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc007830 con 0x55c37056a820 2023-10-08T12:52:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.041+0000 7f11beffd700 1 -- 172.21.15.59:0/3090448335 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11cc020990 con 0x55c37056a820 2023-10-08T12:52:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.041+0000 7f11beffd700 1 -- 172.21.15.59:0/3090448335 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc0296a0 con 0x55c37056a820 2023-10-08T12:52:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.041+0000 7f11f2128b80 1 -- 172.21.15.59:0/3090448335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c37056a820 msgr2=0x55c37057c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.041+0000 7f11f2128b80 1 --2- 172.21.15.59:0/3090448335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c37056a820 0x55c37057c220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55c370573a30 tx=0x7f11cc0071e0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.042+0000 7f11f2128b80 1 -- 172.21.15.59:0/3090448335 shutdown_connections 2023-10-08T12:52:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.042+0000 7f11f2128b80 1 --2- 172.21.15.59:0/3090448335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3705756d0 0x55c370571dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.042+0000 7f11f2128b80 1 --2- 172.21.15.59:0/3090448335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c3705657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.042+0000 7f11f2128b80 1 --2- 172.21.15.59:0/3090448335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c37056a820 0x55c37057c220 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.042+0000 7f11f2128b80 1 -- 172.21.15.59:0/3090448335 >> 172.21.15.59:0/3090448335 conn(0x55c3704df2e0 msgr2=0x55c37056d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.042+0000 7f11f2128b80 1 -- 172.21.15.59:0/3090448335 shutdown_connections 2023-10-08T12:52:20.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.042+0000 7f11f2128b80 1 -- 172.21.15.59:0/3090448335 wait complete. 2023-10-08T12:52:20.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.042+0000 7f11f2128b80 1 -- start start 2023-10-08T12:52:20.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.042+0000 7f11f2128b80 1 Processor -- start 2023-10-08T12:52:20.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c37057b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c37057b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11f2128b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3705756d0 0x55c3705d30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11f2128b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3705d3630 con 0x55c370569f00 2023-10-08T12:52:20.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11f2128b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3705d37a0 con 0x55c37056a820 2023-10-08T12:52:20.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11f2128b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3705d3960 con 0x55c3705756d0 2023-10-08T12:52:20.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11f2128b80 10 client.0 _ll_register_callbacks cb 0x7f11cc004210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:20.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c37057b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11d7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c37057b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c37057b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57300/0 (socket says 172.21.15.59:57300) 2023-10-08T12:52:20.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11dcd9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3705756d0 0x55c3705d30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.043+0000 7f11d77fe700 1 -- 172.21.15.59:0/2886747921 learned_addr learned my addr 172.21.15.59:0/2886747921 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:20.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.044+0000 7f11d77fe700 1 -- 172.21.15.59:0/2886747921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3705756d0 msgr2=0x55c3705d30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.044+0000 7f11d77fe700 1 --2- 172.21.15.59:0/2886747921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3705756d0 0x55c3705d30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.044+0000 7f11d77fe700 1 -- 172.21.15.59:0/2886747921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 msgr2=0x55c37057b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.044+0000 7f11d77fe700 1 --2- 172.21.15.59:0/2886747921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c37057b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.044+0000 7f11d77fe700 1 -- 172.21.15.59:0/2886747921 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d810df00 con 0x55c37056a820 2023-10-08T12:52:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.044+0000 7f11d77fe700 1 --2- 172.21.15.59:0/2886747921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c37057b7e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f11cc004630 tx=0x7f11cc0206c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2236c48deaa1024 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.044+0000 7f11b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.045+0000 7f11b77fe700 1 -- 172.21.15.59:0/2886747921 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc003a90 con 0x55c37056a820 2023-10-08T12:52:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.045+0000 7f11b77fe700 1 -- 172.21.15.59:0/2886747921 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f11cc017070 con 0x55c37056a820 2023-10-08T12:52:20.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.045+0000 7f11f2128b80 1 -- 172.21.15.59:0/2886747921 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11c80b0070 con 0x55c37056a820 2023-10-08T12:52:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11b77fe700 1 -- 172.21.15.59:0/2886747921 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11cc020b00 con 0x55c37056a820 2023-10-08T12:52:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11f2128b80 10 client.27077 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11f2128b80 1 -- 172.21.15.59:0/2886747921 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c3702d1ce0 con 0x55c37056a820 2023-10-08T12:52:20.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11b77fe700 1 -- 172.21.15.59:0/2886747921 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11c80b0070 con 0x55c37056a820 2023-10-08T12:52:20.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11b77fe700 1 -- 172.21.15.59:0/2886747921 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f11cc03c070 con 0x55c37056a820 2023-10-08T12:52:20.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11f2128b80 10 client.27077 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:20.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11f2128b80 10 client.27077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:20.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11f2128b80 20 client.27077 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:20.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2886747921 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c3705dad40 0x55c3705dd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11f2128b80 4 client.27077 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:52:20.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11f2128b80 1 -- 172.21.15.59:0/2886747921 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c3704b6bb0 con 0x55c3705dad40 2023-10-08T12:52:20.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.047+0000 7f11d7fff700 1 --2- 172.21.15.59:0/2886747921 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c3705dad40 0x55c3705dd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.048+0000 7f11d7fff700 1 --2- 172.21.15.59:0/2886747921 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c3705dad40 0x55c3705dd160 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=637490f8e5e2bf97 server_cookie=ac2a804883f0ec3f in_seq=0 out_seq=0 2023-10-08T12:52:20.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.048+0000 7f11b77fe700 10 client.27077 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:20.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.049+0000 7f11b77fe700 1 -- 172.21.15.59:0/2886747921 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c3704b6bb0 con 0x55c3705dad40 2023-10-08T12:52:20.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.049+0000 7f11b77fe700 10 client.27077 handle_command_reply: tid=0 2023-10-08T12:52:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.049+0000 7f11f2128b80 1 client.27077 shutdown 2023-10-08T12:52:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.049+0000 7f11f2128b80 1 -- 172.21.15.59:0/2886747921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 msgr2=0x55c37057b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.049+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2886747921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c37057b7e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f11cc004630 tx=0x7f11cc0206c0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.050+0000 7f11f2128b80 1 -- 172.21.15.59:0/2886747921 shutdown_connections 2023-10-08T12:52:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.050+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2886747921 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c3705dad40 0x55c3705dd160 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.050+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2886747921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3705756d0 0x55c3705d30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.050+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2886747921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c370569f00 0x55c37057b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.050+0000 7f11f2128b80 1 --2- 172.21.15.59:0/2886747921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c37056a820 0x55c37057b7e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.050+0000 7f11b77fe700 0 client.27077 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.050+0000 7f11f2128b80 1 -- 172.21.15.59:0/2886747921 >> 172.21.15.59:0/2886747921 conn(0x55c3704df2e0 msgr2=0x55c370571dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.050+0000 7f11f2128b80 1 -- 172.21.15.59:0/2886747921 shutdown_connections 2023-10-08T12:52:20.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.050+0000 7f11f2128b80 1 -- 172.21.15.59:0/2886747921 wait complete. 2023-10-08T12:52:20.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.050+0000 7f11f2128b80 20 client.27077 trim_cache size 0 max 16384 2023-10-08T12:52:20.053 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:52:20.053 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:52:20.053 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "fc05e775-f3ef-4809-82d7-7c35872ccbc4", 2023-10-08T12:52:20.053 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:52:20.053 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:52:20.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 -- 172.21.15.59:0/4249465867 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c00a15f0 msgr2=0x7f11c00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c00a15f0 0x7f11c00a3ab0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f11d8074220 tx=0x7f11cc0073d0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 -- 172.21.15.59:0/4249465867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11d8100730 msgr2=0x7f11d8072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11d8100730 0x7f11d8072af0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f11c800e9a0 tx=0x7f11c800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 -- 172.21.15.59:0/4249465867 shutdown_connections 2023-10-08T12:52:20.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11c00a15f0 0x7f11c00a3ab0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11d8100730 0x7f11d8072af0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11d8106740 0x7f11d8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 --2- 172.21.15.59:0/4249465867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d81010f0 0x7f11d8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 -- 172.21.15.59:0/4249465867 >> 172.21.15.59:0/4249465867 conn(0x7f11d80fc200 msgr2=0x7f11d80fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 -- 172.21.15.59:0/4249465867 shutdown_connections 2023-10-08T12:52:20.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.051+0000 7f11de7ff700 1 -- 172.21.15.59:0/4249465867 wait complete. 2023-10-08T12:52:20.073 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:52:20.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:20 smithi059 ceph-mon[98489]: pgmap v658: 97 pgs: 97 active+clean; 611 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 251 op/s 2023-10-08T12:52:20.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.301+0000 7f1b043ff700 1 -- 172.21.15.59:0/3715534284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1afc1051c0 msgr2=0x7f1afc105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.301+0000 7f1b043ff700 1 --2- 172.21.15.59:0/3715534284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1afc1051c0 0x7f1afc105640 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009920 tx=0x7f1aec009c30 comp rx=0 tx=0).stop 2023-10-08T12:52:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.301+0000 7f1b043ff700 1 -- 172.21.15.59:0/3715534284 shutdown_connections 2023-10-08T12:52:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.301+0000 7f1b043ff700 1 --2- 172.21.15.59:0/3715534284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1afc105b80 0x7f1afc10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.301+0000 7f1b043ff700 1 --2- 172.21.15.59:0/3715534284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1afc067ce0 0x7f1afc0680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.301+0000 7f1b043ff700 1 --2- 172.21.15.59:0/3715534284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1afc1051c0 0x7f1afc105640 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.301+0000 7f1b043ff700 1 -- 172.21.15.59:0/3715534284 >> 172.21.15.59:0/3715534284 conn(0x7f1afc076780 msgr2=0x7f1afc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.301+0000 7f1b043ff700 1 -- 172.21.15.59:0/3715534284 shutdown_connections 2023-10-08T12:52:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.301+0000 7f1b043ff700 1 -- 172.21.15.59:0/3715534284 wait complete. 2023-10-08T12:52:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.302+0000 7f1b043ff700 1 Processor -- start 2023-10-08T12:52:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.302+0000 7f1b043ff700 1 -- start start 2023-10-08T12:52:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.302+0000 7f1b043ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1afc067ce0 0x7f1afc0ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.302+0000 7f1b043ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1afc1051c0 0x7f1afc0ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.302+0000 7f1b043ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1afc105b80 0x7f1afc100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.302+0000 7f1b043ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc1a5070 con 0x7f1afc1051c0 2023-10-08T12:52:20.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.302+0000 7f1b043ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc1a51e0 con 0x7f1afc105b80 2023-10-08T12:52:20.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.302+0000 7f1b043ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc1a53a0 con 0x7f1afc067ce0 2023-10-08T12:52:20.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.303+0000 7f1b0299c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1afc105b80 0x7f1afc100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.303+0000 7f1b0299c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1afc105b80 0x7f1afc100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57320/0 (socket says 172.21.15.59:57320) 2023-10-08T12:52:20.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.303+0000 7f1b0299c700 1 -- 172.21.15.59:0/2044617762 learned_addr learned my addr 172.21.15.59:0/2044617762 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:20.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.303+0000 7f1b0199a700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1afc1051c0 0x7f1afc0ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.303+0000 7f1b0219b700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1afc067ce0 0x7f1afc0ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.303+0000 7f1b0299c700 1 -- 172.21.15.59:0/2044617762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1afc067ce0 msgr2=0x7f1afc0ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.303+0000 7f1b0299c700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1afc067ce0 0x7f1afc0ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.303+0000 7f1b0299c700 1 -- 172.21.15.59:0/2044617762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1afc1051c0 msgr2=0x7f1afc0ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.303+0000 7f1b0299c700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1afc1051c0 0x7f1afc0ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.303+0000 7f1b0299c700 1 -- 172.21.15.59:0/2044617762 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec009520 con 0x7f1afc105b80 2023-10-08T12:52:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.303+0000 7f1b0299c700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1afc105b80 0x7f1afc100130 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1af400ef30 tx=0x7f1af400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.304+0000 7f1af37fe700 1 -- 172.21.15.59:0/2044617762 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4018070 con 0x7f1afc105b80 2023-10-08T12:52:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.304+0000 7f1af37fe700 1 -- 172.21.15.59:0/2044617762 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1af400f040 con 0x7f1afc105b80 2023-10-08T12:52:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.304+0000 7f1b043ff700 1 -- 172.21.15.59:0/2044617762 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc1a5620 con 0x7f1afc105b80 2023-10-08T12:52:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.304+0000 7f1af37fe700 1 -- 172.21.15.59:0/2044617762 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af400ccf0 con 0x7f1afc105b80 2023-10-08T12:52:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.304+0000 7f1b043ff700 1 -- 172.21.15.59:0/2044617762 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc1a5ae0 con 0x7f1afc105b80 2023-10-08T12:52:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.307+0000 7f1af37fe700 1 -- 172.21.15.59:0/2044617762 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1af4003a00 con 0x7f1afc105b80 2023-10-08T12:52:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.308+0000 7f1af37fe700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ae80a15f0 0x7f1ae80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.309+0000 7f1af37fe700 1 -- 172.21.15.59:0/2044617762 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1af40ccbc0 con 0x7f1afc105b80 2023-10-08T12:52:20.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.309+0000 7f1b0219b700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ae80a15f0 0x7f1ae80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.309+0000 7f1b17dfeb80 1 Processor -- start 2023-10-08T12:52:20.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.309+0000 7f1b17dfeb80 1 -- start start 2023-10-08T12:52:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97140e80 0x561c97141260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c9714c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b0219b700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ae80a15f0 0x7f1ae80a3ab0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1af8005fd0 tx=0x7f1af8009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c9714c650 0x561c9714ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c970aa460 con 0x561c9714c650 2023-10-08T12:52:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9709bc20 con 0x561c971417a0 2023-10-08T12:52:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97099540 con 0x561c97140e80 2023-10-08T12:52:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b0199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c9714c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b0199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c9714c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57328/0 (socket says 172.21.15.59:57328) 2023-10-08T12:52:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b0199a700 1 -- 172.21.15.59:0/149694776 learned_addr learned my addr 172.21.15.59:0/149694776 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b0299c700 1 --2- 172.21.15.59:0/149694776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c9714c650 0x561c9714ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b0219b700 1 --2- 172.21.15.59:0/149694776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97140e80 0x561c97141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b0199a700 1 -- 172.21.15.59:0/149694776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97140e80 msgr2=0x561c97141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b0199a700 1 --2- 172.21.15.59:0/149694776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97140e80 0x561c97141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b0199a700 1 -- 172.21.15.59:0/149694776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c9714c650 msgr2=0x561c9714ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b0199a700 1 --2- 172.21.15.59:0/149694776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c9714c650 0x561c9714ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.310+0000 7f1b0199a700 1 -- 172.21.15.59:0/149694776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c96ebfde0 con 0x561c971417a0 2023-10-08T12:52:20.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.311+0000 7f1b0199a700 1 --2- 172.21.15.59:0/149694776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c9714c110 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1aec016000 tx=0x7f1aec005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfae7b68d199ccdf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.311+0000 7f1af0bfe700 1 -- 172.21.15.59:0/149694776 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00fd10 con 0x561c971417a0 2023-10-08T12:52:20.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.311+0000 7f1af0bfe700 1 -- 172.21.15.59:0/149694776 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1aec01d040 con 0x561c971417a0 2023-10-08T12:52:20.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.311+0000 7f1af0bfe700 1 -- 172.21.15.59:0/149694776 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00bbc0 con 0x561c971417a0 2023-10-08T12:52:20.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.312+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/149694776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 msgr2=0x561c9714c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.312+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/149694776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c9714c110 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1aec016000 tx=0x7f1aec005dc0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.312+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/149694776 shutdown_connections 2023-10-08T12:52:20.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.312+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/149694776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c9714c650 0x561c9714ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.312+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/149694776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97140e80 0x561c97141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.312+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/149694776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c9714c110 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.312+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/149694776 >> 172.21.15.59:0/149694776 conn(0x561c970b6260 msgr2=0x561c9713d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.312+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/149694776 shutdown_connections 2023-10-08T12:52:20.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.312+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/149694776 wait complete. 2023-10-08T12:52:20.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.312+0000 7f1b17dfeb80 1 -- start start 2023-10-08T12:52:20.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.313+0000 7f1b17dfeb80 1 Processor -- start 2023-10-08T12:52:20.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.313+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97140e80 0x561c9714bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.313+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c971417a0 0x561c971492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.313+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 0x561c971498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.313+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97094e30 con 0x561c97140e80 2023-10-08T12:52:20.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.313+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97031710 con 0x561c9714c650 2023-10-08T12:52:20.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.313+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c970313b0 con 0x561c971417a0 2023-10-08T12:52:20.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.313+0000 7f1b17dfeb80 10 client.0 _ll_register_callbacks cb 0x561c96e8e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0299c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 0x561c971498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0299c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 0x561c971498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57338/0 (socket says 172.21.15.59:57338) 2023-10-08T12:52:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0299c700 1 -- 172.21.15.59:0/2011936880 learned_addr learned my addr 172.21.15.59:0/2011936880 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0199a700 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c971417a0 0x561c971492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0219b700 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97140e80 0x561c9714bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0199a700 1 -- 172.21.15.59:0/2011936880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 msgr2=0x561c971498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0199a700 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 0x561c971498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0199a700 1 -- 172.21.15.59:0/2011936880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97140e80 msgr2=0x561c9714bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0199a700 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97140e80 0x561c9714bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0199a700 1 -- 172.21.15.59:0/2011936880 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc10dec0 con 0x561c971417a0 2023-10-08T12:52:20.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0219b700 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97140e80 0x561c9714bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:52:20.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.314+0000 7f1b0199a700 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c971417a0 0x561c971492b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009c70 tx=0x7f1aec00bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bd82e712c41df86 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.315+0000 7f1ae5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:52:20.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.315+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/2011936880 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00f870 con 0x561c971417a0 2023-10-08T12:52:20.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.315+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2011936880 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c9705ceb0 con 0x561c971417a0 2023-10-08T12:52:20.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.315+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/2011936880 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1aec005040 con 0x561c971417a0 2023-10-08T12:52:20.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.315+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/2011936880 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aec0058e0 con 0x561c971417a0 2023-10-08T12:52:20.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.315+0000 7f1b17dfeb80 10 client.27082 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:20.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.315+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2011936880 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x561c96ea8c60 con 0x561c971417a0 2023-10-08T12:52:20.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.316+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/2011936880 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561c9705ceb0 con 0x561c971417a0 2023-10-08T12:52:20.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.316+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/2011936880 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1aec015020 con 0x561c971417a0 2023-10-08T12:52:20.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.316+0000 7f1b17dfeb80 10 client.27082 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:20.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.316+0000 7f1b17dfeb80 10 client.27082 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:20.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.316+0000 7f1b17dfeb80 20 client.27082 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:20.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.316+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c9715bba0 0x561c9715dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.316+0000 7f1b17dfeb80 4 client.27082 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:20.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.316+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2011936880 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c9708de10 con 0x561c9715bba0 2023-10-08T12:52:20.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.316+0000 7f1b0219b700 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c9715bba0 0x561c9715dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.317+0000 7f1b0219b700 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c9715bba0 0x561c9715dfc0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b7c07de69e28641 server_cookie=6700945012118106 in_seq=0 out_seq=0 2023-10-08T12:52:20.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.317+0000 7f1ae5ffb700 10 client.27082 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:20.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/2011936880 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561c9708de10 con 0x561c9715bba0 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1ae5ffb700 10 client.27082 handle_command_reply: tid=0 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1b17dfeb80 1 client.27082 shutdown 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2011936880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c971417a0 msgr2=0x561c971492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c971417a0 0x561c971492b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009c70 tx=0x7f1aec00bad0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2011936880 shutdown_connections 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c9715bba0 0x561c9715dfc0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 0x561c971498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1ae5ffb700 0 client.27082 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97140e80 0x561c9714bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/2011936880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c971417a0 0x561c971492b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2011936880 >> 172.21.15.59:0/2011936880 conn(0x561c970b6260 msgr2=0x561c9713cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2011936880 shutdown_connections 2023-10-08T12:52:20.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.318+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2011936880 wait complete. 2023-10-08T12:52:20.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.319+0000 7f1b17dfeb80 20 client.27082 trim_cache size 0 max 16384 2023-10-08T12:52:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.337+0000 7f1b17dfeb80 1 Processor -- start 2023-10-08T12:52:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b17dfeb80 1 -- start start 2023-10-08T12:52:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97140e80 0x561c97149800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c97157890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c9714c650 0x561c97157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c96f15920 con 0x561c97140e80 2023-10-08T12:52:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97137570 con 0x561c971417a0 2023-10-08T12:52:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97147800 con 0x561c9714c650 2023-10-08T12:52:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b0199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c97157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b0199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c97157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57344/0 (socket says 172.21.15.59:57344) 2023-10-08T12:52:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b0199a700 1 -- 172.21.15.59:0/2012748944 learned_addr learned my addr 172.21.15.59:0/2012748944 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b0219b700 1 --2- 172.21.15.59:0/2012748944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97140e80 0x561c97149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.338+0000 7f1b0299c700 1 --2- 172.21.15.59:0/2012748944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c9714c650 0x561c97157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.339+0000 7f1b0199a700 1 -- 172.21.15.59:0/2012748944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c9714c650 msgr2=0x561c97157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.339+0000 7f1b0199a700 1 --2- 172.21.15.59:0/2012748944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c9714c650 0x561c97157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.339+0000 7f1b0199a700 1 -- 172.21.15.59:0/2012748944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97140e80 msgr2=0x561c97149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.339+0000 7f1b0199a700 1 --2- 172.21.15.59:0/2012748944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97140e80 0x561c97149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.339+0000 7f1b0199a700 1 -- 172.21.15.59:0/2012748944 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c96ee6250 con 0x561c971417a0 2023-10-08T12:52:20.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.339+0000 7f1b0199a700 1 --2- 172.21.15.59:0/2012748944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c97157890 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1aec005c50 tx=0x7f1aec00ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed3624ebc68ef407 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.339+0000 7f1af13ff700 1 -- 172.21.15.59:0/2012748944 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec003880 con 0x561c971417a0 2023-10-08T12:52:20.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.339+0000 7f1af13ff700 1 -- 172.21.15.59:0/2012748944 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1aec00bbf0 con 0x561c971417a0 2023-10-08T12:52:20.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.339+0000 7f1af13ff700 1 -- 172.21.15.59:0/2012748944 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec02a480 con 0x561c971417a0 2023-10-08T12:52:20.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.340+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2012748944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 msgr2=0x561c97157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.340+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/2012748944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c97157890 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1aec005c50 tx=0x7f1aec00ba30 comp rx=0 tx=0).stop 2023-10-08T12:52:20.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.340+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2012748944 shutdown_connections 2023-10-08T12:52:20.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.340+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/2012748944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c9714c650 0x561c97157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.340+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/2012748944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c97140e80 0x561c97149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.340+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/2012748944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c971417a0 0x561c97157890 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.340+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2012748944 >> 172.21.15.59:0/2012748944 conn(0x561c970b6260 msgr2=0x561c97147b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.340+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2012748944 shutdown_connections 2023-10-08T12:52:20.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.340+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/2012748944 wait complete. 2023-10-08T12:52:20.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.341+0000 7f1b17dfeb80 1 -- start start 2023-10-08T12:52:20.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.341+0000 7f1b17dfeb80 1 Processor -- start 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.341+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97140e80 0x561c97153100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.341+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c971417a0 0x561c971515a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.341+0000 7f1b17dfeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 0x561c97151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.341+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c971521c0 con 0x561c971417a0 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.341+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c97152300 con 0x561c9714c650 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.341+0000 7f1b17dfeb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c971afa00 con 0x561c97140e80 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.341+0000 7f1b17dfeb80 10 client.0 _ll_register_callbacks cb 0x7f1af4009370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0199a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c971417a0 0x561c971515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0299c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 0x561c97151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0299c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 0x561c97151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57356/0 (socket says 172.21.15.59:57356) 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0199a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c971417a0 0x561c971515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60568/0 (socket says 172.21.15.59:60568) 2023-10-08T12:52:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0299c700 1 -- 172.21.15.59:0/4183228579 learned_addr learned my addr 172.21.15.59:0/4183228579 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0219b700 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97140e80 0x561c97153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0299c700 1 -- 172.21.15.59:0/4183228579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97140e80 msgr2=0x561c97153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0299c700 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97140e80 0x561c97153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0299c700 1 -- 172.21.15.59:0/4183228579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c971417a0 msgr2=0x561c971515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0299c700 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c971417a0 0x561c971515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0299c700 1 -- 172.21.15.59:0/4183228579 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c96ea8c60 con 0x561c9714c650 2023-10-08T12:52:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b0299c700 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 0x561c97151ae0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1af4099920 tx=0x7f1af4099670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd2c2205e42e4aae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1ae5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/4183228579 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af401b320 con 0x561c9714c650 2023-10-08T12:52:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/4183228579 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1aec01d040 con 0x561c9714c650 2023-10-08T12:52:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.342+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/4183228579 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1af409a320 con 0x561c9714c650 2023-10-08T12:52:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/4183228579 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1af4099c20 con 0x561c9714c650 2023-10-08T12:52:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1b17dfeb80 10 client.27095 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/4183228579 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x561c96ebe2b0 con 0x561c9714c650 2023-10-08T12:52:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/4183228579 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1af4065030 con 0x561c9714c650 2023-10-08T12:52:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/4183228579 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1af4099110 con 0x561c9714c650 2023-10-08T12:52:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1b17dfeb80 10 client.27095 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1b17dfeb80 10 client.27095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1b17dfeb80 20 client.27095 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c971b1000 0x561c971b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1b17dfeb80 4 client.27095 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:52:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/4183228579 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561c9708db30 con 0x561c971b1000 2023-10-08T12:52:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.343+0000 7f1b0219b700 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c971b1000 0x561c971b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.344+0000 7f1ae5ffb700 10 client.27095 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.344+0000 7f1b0219b700 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c971b1000 0x561c971b3420 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff329aa9a9c98b0c server_cookie=37f2e516f771ba56 in_seq=0 out_seq=0 2023-10-08T12:52:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1ae5ffb700 1 -- 172.21.15.59:0/4183228579 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561c9708db30 con 0x561c971b1000 2023-10-08T12:52:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1ae5ffb700 10 client.27095 handle_command_reply: tid=0 2023-10-08T12:52:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1b17dfeb80 1 client.27095 shutdown 2023-10-08T12:52:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/4183228579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 msgr2=0x561c97151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 0x561c97151ae0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1af4099920 tx=0x7f1af4099670 comp rx=0 tx=0).stop 2023-10-08T12:52:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/4183228579 shutdown_connections 2023-10-08T12:52:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x561c971b1000 0x561c971b3420 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c9714c650 0x561c97151ae0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561c97140e80 0x561c97153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1ae5ffb700 0 client.27095 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1b17dfeb80 1 --2- 172.21.15.59:0/4183228579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c971417a0 0x561c971515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.345+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/4183228579 >> 172.21.15.59:0/4183228579 conn(0x561c970b6260 msgr2=0x561c9714ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/4183228579 shutdown_connections 2023-10-08T12:52:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b17dfeb80 1 -- 172.21.15.59:0/4183228579 wait complete. 2023-10-08T12:52:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b17dfeb80 20 client.27095 trim_cache size 0 max 16384 2023-10-08T12:52:20.352 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:52:20.352 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:52:20.352 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:52:20.352 INFO:teuthology.orchestra.run.smithi059.stdout: "fc05e775-f3ef-4809-82d7-7c35872ccbc4": { 2023-10-08T12:52:20.352 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:52:20.352 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "fc05e775-f3ef-4809-82d7-7c35872ccbc4", 2023-10-08T12:52:20.352 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:52:20.352 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:52:20.352 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:52:20.352 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:52:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b043ff700 1 -- 172.21.15.59:0/2044617762 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ae80a15f0 msgr2=0x7f1ae80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b043ff700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ae80a15f0 0x7f1ae80a3ab0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1af8005fd0 tx=0x7f1af8009310 comp rx=0 tx=0).stop 2023-10-08T12:52:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b043ff700 1 -- 172.21.15.59:0/2044617762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1afc105b80 msgr2=0x7f1afc100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b043ff700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1afc105b80 0x7f1afc100130 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1af400ef30 tx=0x7f1af400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b043ff700 1 -- 172.21.15.59:0/2044617762 shutdown_connections 2023-10-08T12:52:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b043ff700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1ae80a15f0 0x7f1ae80a3ab0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b043ff700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1afc105b80 0x7f1afc100130 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b043ff700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1afc067ce0 0x7f1afc0ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b043ff700 1 --2- 172.21.15.59:0/2044617762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1afc1051c0 0x7f1afc0ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.346+0000 7f1b043ff700 1 -- 172.21.15.59:0/2044617762 >> 172.21.15.59:0/2044617762 conn(0x7f1afc076780 msgr2=0x7f1afc0fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.347+0000 7f1b043ff700 1 -- 172.21.15.59:0/2044617762 shutdown_connections 2023-10-08T12:52:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:20.347+0000 7f1b043ff700 1 -- 172.21.15.59:0/2044617762 wait complete. 2023-10-08T12:52:20.366 INFO:tasks.cephfs.filesystem:scrub status for tag:fc05e775-f3ef-4809-82d7-7c35872ccbc4 - {'path': '/', 'tag': 'fc05e775-f3ef-4809-82d7-7c35872ccbc4', 'options': 'recursive,force'} 2023-10-08T12:52:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:20 smithi092 ceph-mon[134093]: pgmap v658: 97 pgs: 97 active+clean; 611 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 251 op/s 2023-10-08T12:52:20.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:20 smithi173 ceph-mon[135182]: pgmap v658: 97 pgs: 97 active+clean; 611 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 251 op/s 2023-10-08T12:52:20.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1414533 12.60 MB/sec execute 471 sec latency 24.662 ms 2023-10-08T12:52:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:21 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:52:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:21 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:21 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:52:21.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:21 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:21.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:21 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:52:21.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:21 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:21.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:21 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:52:21.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:21 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:21.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:21 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:52:21.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:21 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:21.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:21 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:52:21.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:21 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:21.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1416866 12.60 MB/sec execute 472 sec latency 16.019 ms 2023-10-08T12:52:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:22 smithi092 ceph-mon[134093]: pgmap v659: 97 pgs: 97 active+clean; 612 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 206 op/s 2023-10-08T12:52:22.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:22 smithi173 ceph-mon[135182]: pgmap v659: 97 pgs: 97 active+clean; 612 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 206 op/s 2023-10-08T12:52:22.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:22 smithi059 ceph-mon[98489]: pgmap v659: 97 pgs: 97 active+clean; 612 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 206 op/s 2023-10-08T12:52:22.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1418816 12.59 MB/sec execute 473 sec latency 26.010 ms 2023-10-08T12:52:23.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:23 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:52:23.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:23 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:52:23.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:23 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:52:23.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1421412 12.60 MB/sec execute 474 sec latency 26.330 ms 2023-10-08T12:52:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:24 smithi092 ceph-mon[134093]: pgmap v660: 97 pgs: 97 active+clean; 619 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 221 op/s 2023-10-08T12:52:24.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:24 smithi173 ceph-mon[135182]: pgmap v660: 97 pgs: 97 active+clean; 619 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 221 op/s 2023-10-08T12:52:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:24 smithi059 ceph-mon[98489]: pgmap v660: 97 pgs: 97 active+clean; 619 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 221 op/s 2023-10-08T12:52:24.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1422847 12.58 MB/sec execute 475 sec latency 69.295 ms 2023-10-08T12:52:25.544 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1425267 12.59 MB/sec execute 476 sec latency 22.523 ms 2023-10-08T12:52:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:26 smithi092 ceph-mon[134093]: pgmap v661: 97 pgs: 97 active+clean; 603 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 226 op/s 2023-10-08T12:52:26.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:26 smithi173 ceph-mon[135182]: pgmap v661: 97 pgs: 97 active+clean; 603 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 226 op/s 2023-10-08T12:52:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:26 smithi059 ceph-mon[98489]: pgmap v661: 97 pgs: 97 active+clean; 603 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 226 op/s 2023-10-08T12:52:26.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1427742 12.59 MB/sec execute 477 sec latency 14.326 ms 2023-10-08T12:52:27.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1429555 12.58 MB/sec execute 478 sec latency 80.905 ms 2023-10-08T12:52:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:28 smithi092 ceph-mon[134093]: pgmap v662: 97 pgs: 97 active+clean; 594 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 247 op/s 2023-10-08T12:52:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:28 smithi173 ceph-mon[135182]: pgmap v662: 97 pgs: 97 active+clean; 594 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 247 op/s 2023-10-08T12:52:28.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:28 smithi059 ceph-mon[98489]: pgmap v662: 97 pgs: 97 active+clean; 594 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 247 op/s 2023-10-08T12:52:28.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1432099 12.59 MB/sec execute 479 sec latency 25.473 ms 2023-10-08T12:52:29.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1433638 12.57 MB/sec execute 480 sec latency 107.780 ms 2023-10-08T12:52:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:29 smithi173 ceph-mon[135182]: pgmap v663: 97 pgs: 97 active+clean; 570 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 246 op/s 2023-10-08T12:52:30.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:29 smithi059 ceph-mon[98489]: pgmap v663: 97 pgs: 97 active+clean; 570 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 246 op/s 2023-10-08T12:52:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:29 smithi092 ceph-mon[134093]: pgmap v663: 97 pgs: 97 active+clean; 570 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 246 op/s 2023-10-08T12:52:30.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1435917 12.58 MB/sec execute 481 sec latency 21.442 ms 2023-10-08T12:52:31.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1437562 12.56 MB/sec execute 482 sec latency 233.635 ms 2023-10-08T12:52:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:32 smithi092 ceph-mon[134093]: pgmap v664: 97 pgs: 97 active+clean; 570 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 212 op/s 2023-10-08T12:52:32.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:32 smithi173 ceph-mon[135182]: pgmap v664: 97 pgs: 97 active+clean; 570 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 212 op/s 2023-10-08T12:52:32.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:32 smithi059 ceph-mon[98489]: pgmap v664: 97 pgs: 97 active+clean; 570 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 212 op/s 2023-10-08T12:52:32.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1439704 12.56 MB/sec execute 483 sec latency 14.713 ms 2023-10-08T12:52:33.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1442521 12.57 MB/sec execute 484 sec latency 16.149 ms 2023-10-08T12:52:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:34 smithi092 ceph-mon[134093]: pgmap v665: 97 pgs: 97 active+clean; 581 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.6 MiB/s wr, 251 op/s 2023-10-08T12:52:34.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:34 smithi173 ceph-mon[135182]: pgmap v665: 97 pgs: 97 active+clean; 581 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.6 MiB/s wr, 251 op/s 2023-10-08T12:52:34.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:34 smithi059 ceph-mon[98489]: pgmap v665: 97 pgs: 97 active+clean; 581 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.6 MiB/s wr, 251 op/s 2023-10-08T12:52:34.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1443887 12.56 MB/sec execute 485 sec latency 105.067 ms 2023-10-08T12:52:35.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1446249 12.56 MB/sec execute 486 sec latency 38.159 ms 2023-10-08T12:52:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:36 smithi092 ceph-mon[134093]: pgmap v666: 97 pgs: 97 active+clean; 591 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 235 op/s 2023-10-08T12:52:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:36 smithi173 ceph-mon[135182]: pgmap v666: 97 pgs: 97 active+clean; 591 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 235 op/s 2023-10-08T12:52:36.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:36 smithi059 ceph-mon[98489]: pgmap v666: 97 pgs: 97 active+clean; 591 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 235 op/s 2023-10-08T12:52:36.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1447975 12.55 MB/sec execute 487 sec latency 26.600 ms 2023-10-08T12:52:37.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1450360 12.55 MB/sec execute 488 sec latency 17.466 ms 2023-10-08T12:52:38.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:38 smithi092 ceph-mon[134093]: pgmap v667: 97 pgs: 97 active+clean; 600 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 229 op/s 2023-10-08T12:52:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:38 smithi173 ceph-mon[135182]: pgmap v667: 97 pgs: 97 active+clean; 600 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 229 op/s 2023-10-08T12:52:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:38 smithi059 ceph-mon[98489]: pgmap v667: 97 pgs: 97 active+clean; 600 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 229 op/s 2023-10-08T12:52:38.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1452932 12.56 MB/sec execute 489 sec latency 44.769 ms 2023-10-08T12:52:39.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1454606 12.55 MB/sec execute 490 sec latency 80.037 ms 2023-10-08T12:52:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:39 smithi173 ceph-mon[135182]: pgmap v668: 97 pgs: 97 active+clean; 611 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 211 op/s 2023-10-08T12:52:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:39 smithi059 ceph-mon[98489]: pgmap v668: 97 pgs: 97 active+clean; 611 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 211 op/s 2023-10-08T12:52:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:39 smithi092 ceph-mon[134093]: pgmap v668: 97 pgs: 97 active+clean; 611 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 211 op/s 2023-10-08T12:52:40.545 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1456986 12.55 MB/sec execute 491 sec latency 92.060 ms 2023-10-08T12:52:41.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1459153 12.54 MB/sec execute 492 sec latency 12.704 ms 2023-10-08T12:52:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:42 smithi092 ceph-mon[134093]: pgmap v669: 97 pgs: 97 active+clean; 615 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.8 MiB/s wr, 196 op/s 2023-10-08T12:52:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:42 smithi173 ceph-mon[135182]: pgmap v669: 97 pgs: 97 active+clean; 615 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.8 MiB/s wr, 196 op/s 2023-10-08T12:52:42.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:42 smithi059 ceph-mon[98489]: pgmap v669: 97 pgs: 97 active+clean; 615 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.8 MiB/s wr, 196 op/s 2023-10-08T12:52:42.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1461198 12.54 MB/sec execute 493 sec latency 20.475 ms 2023-10-08T12:52:43.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1463966 12.55 MB/sec execute 494 sec latency 16.211 ms 2023-10-08T12:52:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:44 smithi092 ceph-mon[134093]: pgmap v670: 97 pgs: 97 active+clean; 626 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.9 MiB/s wr, 243 op/s 2023-10-08T12:52:44.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:44 smithi173 ceph-mon[135182]: pgmap v670: 97 pgs: 97 active+clean; 626 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.9 MiB/s wr, 243 op/s 2023-10-08T12:52:44.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:44 smithi059 ceph-mon[98489]: pgmap v670: 97 pgs: 97 active+clean; 626 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.9 MiB/s wr, 243 op/s 2023-10-08T12:52:44.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1465648 12.54 MB/sec execute 495 sec latency 16.163 ms 2023-10-08T12:52:45.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1467714 12.54 MB/sec execute 496 sec latency 86.407 ms 2023-10-08T12:52:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:46 smithi092 ceph-mon[134093]: pgmap v671: 97 pgs: 97 active+clean; 630 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 210 op/s 2023-10-08T12:52:46.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:46 smithi173 ceph-mon[135182]: pgmap v671: 97 pgs: 97 active+clean; 630 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 210 op/s 2023-10-08T12:52:46.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:46 smithi059 ceph-mon[98489]: pgmap v671: 97 pgs: 97 active+clean; 630 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 210 op/s 2023-10-08T12:52:46.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1470179 12.54 MB/sec execute 497 sec latency 15.723 ms 2023-10-08T12:52:47.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:47 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:52:47.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:47 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:52:47.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:47 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:52:47.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1471607 12.53 MB/sec execute 498 sec latency 153.707 ms 2023-10-08T12:52:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:48 smithi092 ceph-mon[134093]: pgmap v672: 97 pgs: 97 active+clean; 633 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 210 op/s 2023-10-08T12:52:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:48 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:48 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:48 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:48 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:48 smithi173 ceph-mon[135182]: pgmap v672: 97 pgs: 97 active+clean; 633 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 210 op/s 2023-10-08T12:52:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:48 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:48 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:48 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:48 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:48 smithi059 ceph-mon[98489]: pgmap v672: 97 pgs: 97 active+clean; 633 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 210 op/s 2023-10-08T12:52:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:48 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:48 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:48 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:48 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:48.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1473627 12.53 MB/sec execute 499 sec latency 29.848 ms 2023-10-08T12:52:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:52:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:52:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:49.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:52:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:52:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:49.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:52:49.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:52:49.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:52:49.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1475614 12.52 MB/sec execute 500 sec latency 16.529 ms 2023-10-08T12:52:50.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:52:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:50 smithi092 ceph-mon[134093]: pgmap v673: 97 pgs: 97 active+clean; 641 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 228 op/s 2023-10-08T12:52:50.431 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:50 smithi059 ceph-mon[98489]: pgmap v673: 97 pgs: 97 active+clean; 641 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 228 op/s 2023-10-08T12:52:50.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:50 smithi173 ceph-mon[135182]: pgmap v673: 97 pgs: 97 active+clean; 641 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 228 op/s 2023-10-08T12:52:50.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1477901 12.53 MB/sec execute 501 sec latency 62.741 ms 2023-10-08T12:52:50.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.586+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1766921710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58102940 msgr2=0x7f5f58102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.586+0000 7f5f5f1ff700 1 --2- 172.21.15.59:0/1766921710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58102940 0x7f5f58102dc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009990 tx=0x7f5f44009ca0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.586+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1766921710 shutdown_connections 2023-10-08T12:52:50.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.586+0000 7f5f5f1ff700 1 --2- 172.21.15.59:0/1766921710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f58103300 0x7f5f5810f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.586+0000 7f5f5f1ff700 1 --2- 172.21.15.59:0/1766921710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f58108950 0x7f5f58108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.586+0000 7f5f5f1ff700 1 --2- 172.21.15.59:0/1766921710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58102940 0x7f5f58102dc0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.586+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1766921710 >> 172.21.15.59:0/1766921710 conn(0x7f5f580fe3d0 msgr2=0x7f5f581007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:50.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.586+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1766921710 shutdown_connections 2023-10-08T12:52:50.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.586+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1766921710 wait complete. 2023-10-08T12:52:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.587+0000 7f5f5f1ff700 1 Processor -- start 2023-10-08T12:52:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.587+0000 7f5f5f1ff700 1 -- start start 2023-10-08T12:52:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5f1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f58102940 0x7f5f58198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5f1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f58103300 0x7f5f58199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5f1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58108950 0x7f5f5819d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5f1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5819dd20 con 0x7f5f58103300 2023-10-08T12:52:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5f1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5819de90 con 0x7f5f58108950 2023-10-08T12:52:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5f1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5819e050 con 0x7f5f58102940 2023-10-08T12:52:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5d79c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58108950 0x7f5f5819d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5d79c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58108950 0x7f5f5819d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57558/0 (socket says 172.21.15.59:57558) 2023-10-08T12:52:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5d79c700 1 -- 172.21.15.59:0/1382698658 learned_addr learned my addr 172.21.15.59:0/1382698658 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f57fff700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f58103300 0x7f5f58199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f58102940 0x7f5f58198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5d79c700 1 -- 172.21.15.59:0/1382698658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f58102940 msgr2=0x7f5f58198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5d79c700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f58102940 0x7f5f58198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5d79c700 1 -- 172.21.15.59:0/1382698658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f58103300 msgr2=0x7f5f58199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5d79c700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f58103300 0x7f5f58199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f5d79c700 1 -- 172.21.15.59:0/1382698658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440095f0 con 0x7f5f58108950 2023-10-08T12:52:50.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.588+0000 7f5f57fff700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f58103300 0x7f5f58199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:50.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.589+0000 7f5f5d79c700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58108950 0x7f5f5819d6e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000ef30 tx=0x7f5f5000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:50.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.589+0000 7f5f55ffb700 1 -- 172.21.15.59:0/1382698658 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50018070 con 0x7f5f58108950 2023-10-08T12:52:50.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.589+0000 7f5f55ffb700 1 -- 172.21.15.59:0/1382698658 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f5000f040 con 0x7f5f58108950 2023-10-08T12:52:50.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.589+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1382698658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5819e2d0 con 0x7f5f58108950 2023-10-08T12:52:50.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.589+0000 7f5f55ffb700 1 -- 172.21.15.59:0/1382698658 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000cdb0 con 0x7f5f58108950 2023-10-08T12:52:50.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.589+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1382698658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f581a5b70 con 0x7f5f58108950 2023-10-08T12:52:50.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.593+0000 7f5f55ffb700 1 -- 172.21.15.59:0/1382698658 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5f50003a00 con 0x7f5f58108950 2023-10-08T12:52:50.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.594+0000 7f5f72a48b80 1 Processor -- start 2023-10-08T12:52:50.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.594+0000 7f5f72a48b80 1 -- start start 2023-10-08T12:52:50.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.594+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e365e80 0x555e0e366260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.594+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e3667a0 0x555e0e371110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e371650 0x555e0e373a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e2cf460 con 0x555e0e3667a0 2023-10-08T12:52:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e2c0c20 con 0x555e0e371650 2023-10-08T12:52:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e2be540 con 0x555e0e365e80 2023-10-08T12:52:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f57fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e365e80 0x555e0e366260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f5cf9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e3667a0 0x555e0e371110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f57fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e365e80 0x555e0e366260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:43874/0 (socket says 172.21.15.59:43874) 2023-10-08T12:52:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f5cf9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e3667a0 0x555e0e371110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60856/0 (socket says 172.21.15.59:60856) 2023-10-08T12:52:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f57fff700 1 -- 172.21.15.59:0/569015018 learned_addr learned my addr 172.21.15.59:0/569015018 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f55ffb700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5f480a15f0 0x7f5f480a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f57fff700 1 --2- 172.21.15.59:0/569015018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e371650 0x555e0e373a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f55ffb700 1 -- 172.21.15.59:0/1382698658 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f5f500ccd10 con 0x7f5f58108950 2023-10-08T12:52:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/569015018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e365e80 msgr2=0x555e0e366260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/569015018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e365e80 0x555e0e366260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/569015018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e371650 msgr2=0x555e0e373a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/569015018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e371650 0x555e0e373a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f5d79c700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5f480a15f0 0x7f5f480a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/569015018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e0e0e4de0 con 0x555e0e3667a0 2023-10-08T12:52:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.595+0000 7f5f57fff700 1 --2- 172.21.15.59:0/569015018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e371650 0x555e0e373a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.596+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/569015018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e3667a0 0x555e0e371110 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009cb0 tx=0x7f5f4c0058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641d03dbc95e1ee2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.596+0000 7f5f5d79c700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5f480a15f0 0x7f5f480a3ab0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009c10 tx=0x7f5f50009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.596+0000 7f5f42ffd700 1 -- 172.21.15.59:0/569015018 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c011ce0 con 0x555e0e3667a0 2023-10-08T12:52:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.596+0000 7f5f42ffd700 1 -- 172.21.15.59:0/569015018 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f4c011e40 con 0x555e0e3667a0 2023-10-08T12:52:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.596+0000 7f5f42ffd700 1 -- 172.21.15.59:0/569015018 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c005280 con 0x555e0e3667a0 2023-10-08T12:52:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.597+0000 7f5f72a48b80 1 -- 172.21.15.59:0/569015018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e3667a0 msgr2=0x555e0e371110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.597+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/569015018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e3667a0 0x555e0e371110 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009cb0 tx=0x7f5f4c0058e0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.597+0000 7f5f72a48b80 1 -- 172.21.15.59:0/569015018 shutdown_connections 2023-10-08T12:52:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.597+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/569015018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e371650 0x555e0e373a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.597+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/569015018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e365e80 0x555e0e366260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.597+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/569015018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e3667a0 0x555e0e371110 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.597+0000 7f5f72a48b80 1 -- 172.21.15.59:0/569015018 >> 172.21.15.59:0/569015018 conn(0x555e0e2db260 msgr2=0x555e0e3622d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.597+0000 7f5f72a48b80 1 -- 172.21.15.59:0/569015018 shutdown_connections 2023-10-08T12:52:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.597+0000 7f5f72a48b80 1 -- 172.21.15.59:0/569015018 wait complete. 2023-10-08T12:52:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.598+0000 7f5f72a48b80 1 -- start start 2023-10-08T12:52:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.598+0000 7f5f72a48b80 1 Processor -- start 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.598+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e365e80 0x555e0e3710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.598+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 0x555e0e36e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.598+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e371650 0x555e0e36eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.598+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e2b9e30 con 0x555e0e371650 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e256710 con 0x555e0e365e80 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e2563b0 con 0x555e0e3667a0 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f72a48b80 10 client.0 _ll_register_callbacks cb 0x555e0e0b3800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f57fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e365e80 0x555e0e3710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f5cf9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 0x555e0e36e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f57fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e365e80 0x555e0e3710c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57576/0 (socket says 172.21.15.59:57576) 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f57fff700 1 -- 172.21.15.59:0/2645004115 learned_addr learned my addr 172.21.15.59:0/2645004115 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f57fff700 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e371650 0x555e0e36eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/2645004115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e365e80 msgr2=0x555e0e3710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:50.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e365e80 0x555e0e3710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/2645004115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e371650 msgr2=0x555e0e36eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:50.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e371650 0x555e0e36eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.599+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/2645004115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c0098e0 con 0x555e0e3667a0 2023-10-08T12:52:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.600+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 0x555e0e36e400 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c000c00 tx=0x7f5f4c005d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a94e3e85faa37a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.600+0000 7f5f37fff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:52:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.600+0000 7f5f37fff700 1 -- 172.21.15.59:0/2645004115 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c004a60 con 0x555e0e3667a0 2023-10-08T12:52:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.600+0000 7f5f72a48b80 1 -- 172.21.15.59:0/2645004115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e0e281eb0 con 0x555e0e3667a0 2023-10-08T12:52:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.600+0000 7f5f37fff700 1 -- 172.21.15.59:0/2645004115 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f5f4c004050 con 0x555e0e3667a0 2023-10-08T12:52:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.600+0000 7f5f37fff700 1 -- 172.21.15.59:0/2645004115 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f4c004210 con 0x555e0e3667a0 2023-10-08T12:52:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.600+0000 7f5f72a48b80 10 client.27100 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.600+0000 7f5f72a48b80 1 -- 172.21.15.59:0/2645004115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x555e0e0cdc60 con 0x555e0e3667a0 2023-10-08T12:52:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.600+0000 7f5f37fff700 1 -- 172.21.15.59:0/2645004115 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555e0e281eb0 con 0x555e0e3667a0 2023-10-08T12:52:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.601+0000 7f5f37fff700 1 -- 172.21.15.59:0/2645004115 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5f4c029060 con 0x555e0e3667a0 2023-10-08T12:52:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.601+0000 7f5f72a48b80 10 client.27100 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.601+0000 7f5f72a48b80 10 client.27100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.601+0000 7f5f72a48b80 20 client.27100 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.601+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e0e3810f0 0x555e0e383510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.601+0000 7f5f72a48b80 4 client.27100 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.601+0000 7f5f72a48b80 1 -- 172.21.15.59:0/2645004115 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e0e2b2e10 con 0x555e0e3810f0 2023-10-08T12:52:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.601+0000 7f5f57fff700 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e0e3810f0 0x555e0e383510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.601+0000 7f5f57fff700 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e0e3810f0 0x555e0e383510 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebeaea68e7df417b server_cookie=62834313a5460b6e in_seq=0 out_seq=0 2023-10-08T12:52:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.601+0000 7f5f37fff700 10 client.27100 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.602+0000 7f5f37fff700 1 -- 172.21.15.59:0/2645004115 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555e0e2b2e10 con 0x555e0e3810f0 2023-10-08T12:52:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.602+0000 7f5f37fff700 10 client.27100 handle_command_reply: tid=0 2023-10-08T12:52:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.602+0000 7f5f72a48b80 1 client.27100 shutdown 2023-10-08T12:52:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f72a48b80 1 -- 172.21.15.59:0/2645004115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 msgr2=0x555e0e36e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 0x555e0e36e400 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c000c00 tx=0x7f5f4c005d70 comp rx=0 tx=0).stop 2023-10-08T12:52:50.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f72a48b80 1 -- 172.21.15.59:0/2645004115 shutdown_connections 2023-10-08T12:52:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e0e3810f0 0x555e0e383510 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e365e80 0x555e0e3710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e371650 0x555e0e36eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f37fff700 0 client.27100 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/2645004115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 0x555e0e36e400 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f72a48b80 1 -- 172.21.15.59:0/2645004115 >> 172.21.15.59:0/2645004115 conn(0x555e0e2db260 msgr2=0x555e0e361ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f72a48b80 1 -- 172.21.15.59:0/2645004115 shutdown_connections 2023-10-08T12:52:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f72a48b80 1 -- 172.21.15.59:0/2645004115 wait complete. 2023-10-08T12:52:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.603+0000 7f5f72a48b80 20 client.27100 trim_cache size 0 max 16384 2023-10-08T12:52:50.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f72a48b80 1 Processor -- start 2023-10-08T12:52:50.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f72a48b80 1 -- start start 2023-10-08T12:52:50.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 0x555e0e368d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e3667a0 0x555e0e3781a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e371650 0x555e0e36dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e13a920 con 0x555e0e365e80 2023-10-08T12:52:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e281eb0 con 0x555e0e3667a0 2023-10-08T12:52:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e36fa00 con 0x555e0e371650 2023-10-08T12:52:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f5cf9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e3667a0 0x555e0e3781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f5cf9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e3667a0 0x555e0e3781a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57580/0 (socket says 172.21.15.59:57580) 2023-10-08T12:52:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/547496133 learned_addr learned my addr 172.21.15.59:0/547496133 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.622+0000 7f5f57fff700 1 --2- 172.21.15.59:0/547496133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 0x555e0e368d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.623+0000 7f5f57fff700 1 --2- 172.21.15.59:0/547496133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e371650 0x555e0e36dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.623+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/547496133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e371650 msgr2=0x555e0e36dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.623+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/547496133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e371650 0x555e0e36dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.623+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/547496133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 msgr2=0x555e0e368d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.623+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/547496133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 0x555e0e368d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.623+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/547496133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e0e10b250 con 0x555e0e3667a0 2023-10-08T12:52:50.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.623+0000 7f5f57fff700 1 --2- 172.21.15.59:0/547496133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 0x555e0e368d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:50.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.623+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/547496133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e3667a0 0x555e0e3781a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c003b30 tx=0x7f5f4c0092e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27ae764bbef78053 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:50.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.623+0000 7f5f437fe700 1 -- 172.21.15.59:0/547496133 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c004a60 con 0x555e0e3667a0 2023-10-08T12:52:50.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.623+0000 7f5f437fe700 1 -- 172.21.15.59:0/547496133 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f4c003680 con 0x555e0e3667a0 2023-10-08T12:52:50.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.623+0000 7f5f437fe700 1 -- 172.21.15.59:0/547496133 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c004260 con 0x555e0e3667a0 2023-10-08T12:52:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.624+0000 7f5f72a48b80 1 -- 172.21.15.59:0/547496133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e3667a0 msgr2=0x555e0e3781a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.624+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/547496133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e3667a0 0x555e0e3781a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c003b30 tx=0x7f5f4c0092e0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.624+0000 7f5f72a48b80 1 -- 172.21.15.59:0/547496133 shutdown_connections 2023-10-08T12:52:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.624+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/547496133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e371650 0x555e0e36dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.624+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/547496133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 0x555e0e368d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.624+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/547496133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e3667a0 0x555e0e3781a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.624+0000 7f5f72a48b80 1 -- 172.21.15.59:0/547496133 >> 172.21.15.59:0/547496133 conn(0x555e0e2db260 msgr2=0x555e0e361d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.624+0000 7f5f72a48b80 1 -- 172.21.15.59:0/547496133 shutdown_connections 2023-10-08T12:52:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.624+0000 7f5f72a48b80 1 -- 172.21.15.59:0/547496133 wait complete. 2023-10-08T12:52:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.625+0000 7f5f72a48b80 1 -- start start 2023-10-08T12:52:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.625+0000 7f5f72a48b80 1 Processor -- start 2023-10-08T12:52:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.625+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 0x555e0e3780f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.625+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 0x555e0e376570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.625+0000 7f5f72a48b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e371650 0x555e0e376ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.625+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e3770b0 con 0x555e0e365e80 2023-10-08T12:52:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.625+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e377220 con 0x555e0e371650 2023-10-08T12:52:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.625+0000 7f5f72a48b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0e3773e0 con 0x555e0e3667a0 2023-10-08T12:52:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.625+0000 7f5f72a48b80 10 client.0 _ll_register_callbacks cb 0x7f5f4c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f57fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 0x555e0e3780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f5cf9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 0x555e0e376570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f57fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 0x555e0e3780f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60870/0 (socket says 172.21.15.59:60870) 2023-10-08T12:52:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f57fff700 1 -- 172.21.15.59:0/425144122 learned_addr learned my addr 172.21.15.59:0/425144122 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f57fff700 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e371650 0x555e0e376ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/425144122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e371650 msgr2=0x555e0e376ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e371650 0x555e0e376ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/425144122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 msgr2=0x555e0e3780f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 0x555e0e3780f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f5cf9b700 1 -- 172.21.15.59:0/425144122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e0e0cdc60 con 0x555e0e3667a0 2023-10-08T12:52:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f5cf9b700 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 0x555e0e376570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c003940 tx=0x7f5f4c003880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd84da9dc449e1db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f37fff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:52:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.626+0000 7f5f37fff700 1 -- 172.21.15.59:0/425144122 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c0051c0 con 0x555e0e3667a0 2023-10-08T12:52:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f72a48b80 1 -- 172.21.15.59:0/425144122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f4c011e40 con 0x555e0e3667a0 2023-10-08T12:52:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f37fff700 1 -- 172.21.15.59:0/425144122 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f5f4c000e40 con 0x555e0e3667a0 2023-10-08T12:52:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f37fff700 1 -- 172.21.15.59:0/425144122 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f4c005320 con 0x555e0e3667a0 2023-10-08T12:52:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f72a48b80 10 client.27106 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f72a48b80 1 -- 172.21.15.59:0/425144122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x555e0e0e32b0 con 0x555e0e3667a0 2023-10-08T12:52:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f37fff700 1 -- 172.21.15.59:0/425144122 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f4c011e40 con 0x555e0e3667a0 2023-10-08T12:52:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f37fff700 1 -- 172.21.15.59:0/425144122 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5f4c029070 con 0x555e0e3667a0 2023-10-08T12:52:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f72a48b80 10 client.27106 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f72a48b80 10 client.27106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f72a48b80 20 client.27106 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e0e3d60d0 0x555e0e3d84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f72a48b80 4 client.27106 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:52:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f72a48b80 1 -- 172.21.15.59:0/425144122 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555e0e2b2b30 con 0x555e0e3d60d0 2023-10-08T12:52:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.627+0000 7f5f57fff700 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e0e3d60d0 0x555e0e3d84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f57fff700 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e0e3d60d0 0x555e0e3d84f0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e36844d517609ff8 server_cookie=ff4eca439e4b1bad in_seq=0 out_seq=0 2023-10-08T12:52:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f37fff700 10 client.27106 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f37fff700 1 -- 172.21.15.59:0/425144122 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555e0e2b2b30 con 0x555e0e3d60d0 2023-10-08T12:52:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f37fff700 10 client.27106 handle_command_reply: tid=0 2023-10-08T12:52:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f72a48b80 1 client.27106 shutdown 2023-10-08T12:52:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f72a48b80 1 -- 172.21.15.59:0/425144122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 msgr2=0x555e0e376570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 0x555e0e376570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c003940 tx=0x7f5f4c003880 comp rx=0 tx=0).stop 2023-10-08T12:52:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f72a48b80 1 -- 172.21.15.59:0/425144122 shutdown_connections 2023-10-08T12:52:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555e0e3d60d0 0x555e0e3d84f0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555e0e371650 0x555e0e376ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555e0e365e80 0x555e0e3780f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f37fff700 0 client.27106 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f72a48b80 1 --2- 172.21.15.59:0/425144122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e0e3667a0 0x555e0e376570 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.628+0000 7f5f72a48b80 1 -- 172.21.15.59:0/425144122 >> 172.21.15.59:0/425144122 conn(0x555e0e2db260 msgr2=0x555e0e37c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f72a48b80 1 -- 172.21.15.59:0/425144122 shutdown_connections 2023-10-08T12:52:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f72a48b80 1 -- 172.21.15.59:0/425144122 wait complete. 2023-10-08T12:52:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f72a48b80 20 client.27106 trim_cache size 0 max 16384 2023-10-08T12:52:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:52:50.635 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:52:50.635 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:52:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:52:50.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1382698658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5f480a15f0 msgr2=0x7f5f480a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f5f1ff700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5f480a15f0 0x7f5f480a3ab0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009c10 tx=0x7f5f50009040 comp rx=0 tx=0).stop 2023-10-08T12:52:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1382698658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58108950 msgr2=0x7f5f5819d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f5f1ff700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58108950 0x7f5f5819d6e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000ef30 tx=0x7f5f5000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1382698658 shutdown_connections 2023-10-08T12:52:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f5f1ff700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f5f480a15f0 0x7f5f480a3ab0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f5f1ff700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58108950 0x7f5f5819d6e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f5f1ff700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f58102940 0x7f5f58198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f5f1ff700 1 --2- 172.21.15.59:0/1382698658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f58103300 0x7f5f58199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.629+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1382698658 >> 172.21.15.59:0/1382698658 conn(0x7f5f580fe3d0 msgr2=0x7f5f580fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.630+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1382698658 shutdown_connections 2023-10-08T12:52:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.630+0000 7f5f5f1ff700 1 -- 172.21.15.59:0/1382698658 wait complete. 2023-10-08T12:52:50.649 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:52:50.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:52:50.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.868+0000 7f6f1559d700 1 -- 172.21.15.59:0/1571291729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f101031c0 msgr2=0x7f6f1010f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.868+0000 7f6f1559d700 1 --2- 172.21.15.59:0/1571291729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f101031c0 0x7f6f1010f6d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009f90 tx=0x7f6f0800b330 comp rx=0 tx=0).stop 2023-10-08T12:52:50.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.868+0000 7f6f1559d700 1 -- 172.21.15.59:0/1571291729 shutdown_connections 2023-10-08T12:52:50.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.868+0000 7f6f1559d700 1 --2- 172.21.15.59:0/1571291729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f101031c0 0x7f6f1010f6d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.868+0000 7f6f1559d700 1 --2- 172.21.15.59:0/1571291729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f10108810 0x7f6f10108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.868+0000 7f6f1559d700 1 --2- 172.21.15.59:0/1571291729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f10102800 0x7f6f10102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.868+0000 7f6f1559d700 1 -- 172.21.15.59:0/1571291729 >> 172.21.15.59:0/1571291729 conn(0x7f6f100fe2d0 msgr2=0x7f6f101006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:50.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.869+0000 7f6f1559d700 1 -- 172.21.15.59:0/1571291729 shutdown_connections 2023-10-08T12:52:50.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.869+0000 7f6f1559d700 1 -- 172.21.15.59:0/1571291729 wait complete. 2023-10-08T12:52:50.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.869+0000 7f6f1559d700 1 Processor -- start 2023-10-08T12:52:50.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.870+0000 7f6f1559d700 1 -- start start 2023-10-08T12:52:50.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.870+0000 7f6f1559d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f10102800 0x7f6f1019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.870+0000 7f6f1559d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f101031c0 0x7f6f1019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.870+0000 7f6f1559d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f10108810 0x7f6f10198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.870+0000 7f6f1559d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f10199200 con 0x7f6f10108810 2023-10-08T12:52:50.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.870+0000 7f6f1559d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f10199370 con 0x7f6f10102800 2023-10-08T12:52:50.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.870+0000 7f6f1559d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f10199530 con 0x7f6f101031c0 2023-10-08T12:52:50.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f10102800 0x7f6f1019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f101031c0 0x7f6f1019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f10102800 0x7f6f1019e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50386/0 (socket says 172.21.15.59:50386) 2023-10-08T12:52:50.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0ffff700 1 -- 172.21.15.59:0/4051485330 learned_addr learned my addr 172.21.15.59:0/4051485330 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:50.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f101031c0 0x7f6f1019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60428/0 (socket says 172.21.15.59:60428) 2023-10-08T12:52:50.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f14d9c700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f10108810 0x7f6f10198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0ffff700 1 -- 172.21.15.59:0/4051485330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f101031c0 msgr2=0x7f6f1019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0ffff700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f101031c0 0x7f6f1019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0ffff700 1 -- 172.21.15.59:0/4051485330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f10108810 msgr2=0x7f6f10198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:50.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0ffff700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f10108810 0x7f6f10198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:50.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0ffff700 1 -- 172.21.15.59:0/4051485330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f08009c40 con 0x7f6f10102800 2023-10-08T12:52:50.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0f7fe700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f101031c0 0x7f6f1019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:50.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0ffff700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f10102800 0x7f6f1019e990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000e9c0 tx=0x7f6f0000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:50.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.871+0000 7f6f0d7fa700 1 -- 172.21.15.59:0/4051485330 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00004a30 con 0x7f6f10102800 2023-10-08T12:52:50.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.872+0000 7f6f0d7fa700 1 -- 172.21.15.59:0/4051485330 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f0000cc80 con 0x7f6f10102800 2023-10-08T12:52:50.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.872+0000 7f6f1559d700 1 -- 172.21.15.59:0/4051485330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f10199810 con 0x7f6f10102800 2023-10-08T12:52:50.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.872+0000 7f6f0d7fa700 1 -- 172.21.15.59:0/4051485330 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f000054e0 con 0x7f6f10102800 2023-10-08T12:52:50.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.872+0000 7f6f1559d700 1 -- 172.21.15.59:0/4051485330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f101a5960 con 0x7f6f10102800 2023-10-08T12:52:50.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.873+0000 7f6f1559d700 1 -- 172.21.15.59:0/4051485330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1010ad90 con 0x7f6f10102800 2023-10-08T12:52:50.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.875+0000 7f6f0d7fa700 1 -- 172.21.15.59:0/4051485330 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6f00004b90 con 0x7f6f10102800 2023-10-08T12:52:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.876+0000 7f6f0d7fa700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6ef80a1670 0x7f6ef80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.876+0000 7f6f0d7fa700 1 -- 172.21.15.59:0/4051485330 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f6f00014070 con 0x7f6f10102800 2023-10-08T12:52:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.876+0000 7f6f0f7fe700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6ef80a1670 0x7f6ef80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:50.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.877+0000 7f6f0f7fe700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6ef80a1670 0x7f6ef80a3b30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6f1019a1a0 tx=0x7f6f04009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:50.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:50.879+0000 7f6f0d7fa700 1 -- 172.21.15.59:0/4051485330 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6f000963b0 con 0x7f6f10102800 2023-10-08T12:52:51.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.156+0000 7f6f1559d700 1 -- 172.21.15.59:0/4051485330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f10103f40 con 0x7f6f10102800 2023-10-08T12:52:51.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.157+0000 7f6f0d7fa700 1 -- 172.21.15.59:0/4051485330 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f6f000999d0 con 0x7f6f10102800 2023-10-08T12:52:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:52:51.158 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:52:51.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.160+0000 7f6f1559d700 1 -- 172.21.15.59:0/4051485330 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6ef80a1670 msgr2=0x7f6ef80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:51.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.160+0000 7f6f1559d700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6ef80a1670 0x7f6ef80a3b30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6f1019a1a0 tx=0x7f6f04009260 comp rx=0 tx=0).stop 2023-10-08T12:52:51.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.160+0000 7f6f1559d700 1 -- 172.21.15.59:0/4051485330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f10102800 msgr2=0x7f6f1019e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:51.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.160+0000 7f6f1559d700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f10102800 0x7f6f1019e990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000e9c0 tx=0x7f6f0000ecd0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.160+0000 7f6f1559d700 1 -- 172.21.15.59:0/4051485330 shutdown_connections 2023-10-08T12:52:51.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.160+0000 7f6f1559d700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6ef80a1670 0x7f6ef80a3b30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.160+0000 7f6f1559d700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f10102800 0x7f6f1019e990 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.160+0000 7f6f1559d700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f10108810 0x7f6f10198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.160+0000 7f6f1559d700 1 --2- 172.21.15.59:0/4051485330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f101031c0 0x7f6f1019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.160+0000 7f6f1559d700 1 -- 172.21.15.59:0/4051485330 >> 172.21.15.59:0/4051485330 conn(0x7f6f100fe2d0 msgr2=0x7f6f100fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:51.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.161+0000 7f6f1559d700 1 -- 172.21.15.59:0/4051485330 shutdown_connections 2023-10-08T12:52:51.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.161+0000 7f6f1559d700 1 -- 172.21.15.59:0/4051485330 wait complete. 2023-10-08T12:52:51.162 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:52:51.182 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:52:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.395+0000 7f7d147ff700 1 -- 172.21.15.59:0/3964230208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d0c106750 msgr2=0x7f7d0c106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.395+0000 7f7d147ff700 1 --2- 172.21.15.59:0/3964230208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d0c106750 0x7f7d0c106b30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009990 tx=0x7f7d08009ca0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.396+0000 7f7d147ff700 1 -- 172.21.15.59:0/3964230208 shutdown_connections 2023-10-08T12:52:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.396+0000 7f7d147ff700 1 --2- 172.21.15.59:0/3964230208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d0c106750 0x7f7d0c106b30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.396+0000 7f7d147ff700 1 --2- 172.21.15.59:0/3964230208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d0c101100 0x7f7d0c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.396+0000 7f7d147ff700 1 --2- 172.21.15.59:0/3964230208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c100740 0x7f7d0c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.396+0000 7f7d147ff700 1 -- 172.21.15.59:0/3964230208 >> 172.21.15.59:0/3964230208 conn(0x7f7d0c0fc230 msgr2=0x7f7d0c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.396+0000 7f7d147ff700 1 -- 172.21.15.59:0/3964230208 shutdown_connections 2023-10-08T12:52:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.396+0000 7f7d147ff700 1 -- 172.21.15.59:0/3964230208 wait complete. 2023-10-08T12:52:51.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.397+0000 7f7d147ff700 1 Processor -- start 2023-10-08T12:52:51.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.397+0000 7f7d147ff700 1 -- start start 2023-10-08T12:52:51.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.397+0000 7f7d147ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c100740 0x7f7d0c107620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.397+0000 7f7d147ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d0c101100 0x7f7d0c107b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.397+0000 7f7d147ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d0c106750 0x7f7d0c1080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.397+0000 7f7d147ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1a9360 con 0x7f7d0c100740 2023-10-08T12:52:51.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.397+0000 7f7d147ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1a94a0 con 0x7f7d0c101100 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.397+0000 7f7d147ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1a9630 con 0x7f7d0c106750 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d11d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d0c101100 0x7f7d0c107b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d11d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d0c101100 0x7f7d0c107b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50412/0 (socket says 172.21.15.59:50412) 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d11d9a700 1 -- 172.21.15.59:0/509047591 learned_addr learned my addr 172.21.15.59:0/509047591 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d1259b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c100740 0x7f7d0c107620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d12d9c700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d0c106750 0x7f7d0c1080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d11d9a700 1 -- 172.21.15.59:0/509047591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d0c106750 msgr2=0x7f7d0c1080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d11d9a700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d0c106750 0x7f7d0c1080a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d11d9a700 1 -- 172.21.15.59:0/509047591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c100740 msgr2=0x7f7d0c107620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d11d9a700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c100740 0x7f7d0c107620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d11d9a700 1 -- 172.21.15.59:0/509047591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d080095f0 con 0x7f7d0c101100 2023-10-08T12:52:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d11d9a700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d0c101100 0x7f7d0c107b60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00e9a0 tx=0x7f7cfc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:51.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.398+0000 7f7d037fe700 1 -- 172.21.15.59:0/509047591 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc009790 con 0x7f7d0c101100 2023-10-08T12:52:51.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.399+0000 7f7d037fe700 1 -- 172.21.15.59:0/509047591 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cfc010430 con 0x7f7d0c101100 2023-10-08T12:52:51.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.399+0000 7f7d147ff700 1 -- 172.21.15.59:0/509047591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c1a9910 con 0x7f7d0c101100 2023-10-08T12:52:51.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.399+0000 7f7d037fe700 1 -- 172.21.15.59:0/509047591 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc018680 con 0x7f7d0c101100 2023-10-08T12:52:51.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.399+0000 7f7d147ff700 1 -- 172.21.15.59:0/509047591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c1a9e20 con 0x7f7d0c101100 2023-10-08T12:52:51.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.402+0000 7f7d037fe700 1 -- 172.21.15.59:0/509047591 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7cfc0105a0 con 0x7f7d0c101100 2023-10-08T12:52:51.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.403+0000 7f7d037fe700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7cf80a15f0 0x7f7cf80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.404+0000 7f7d281eab80 1 Processor -- start 2023-10-08T12:52:51.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.404+0000 7f7d037fe700 1 -- 172.21.15.59:0/509047591 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7cfc014070 con 0x7f7d0c101100 2023-10-08T12:52:51.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.404+0000 7f7d1259b700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7cf80a15f0 0x7f7cf80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.404+0000 7f7d281eab80 1 -- start start 2023-10-08T12:52:51.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.404+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a797260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.404+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a7a2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.404+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a7a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.404+0000 7f7d281eab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a700460 con 0x55d92a7977a0 2023-10-08T12:52:51.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.404+0000 7f7d281eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a6f1c20 con 0x55d92a7a2650 2023-10-08T12:52:51.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.404+0000 7f7d281eab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a6ef540 con 0x55d92a796e80 2023-10-08T12:52:51.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d12d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a7a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d11d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a7a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d12d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a7a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50422/0 (socket says 172.21.15.59:50422) 2023-10-08T12:52:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d12d9c700 1 -- 172.21.15.59:0/3802347590 learned_addr learned my addr 172.21.15.59:0/3802347590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d1259b700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7cf80a15f0 0x7f7cf80a3ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800b2e0 tx=0x7f7d08005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d1259b700 1 --2- 172.21.15.59:0/3802347590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a797260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d12d9c700 1 -- 172.21.15.59:0/3802347590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 msgr2=0x55d92a797260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d12d9c700 1 --2- 172.21.15.59:0/3802347590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a797260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d12d9c700 1 -- 172.21.15.59:0/3802347590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 msgr2=0x55d92a7a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d12d9c700 1 --2- 172.21.15.59:0/3802347590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a7a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d12d9c700 1 -- 172.21.15.59:0/3802347590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d92a515de0 con 0x55d92a7a2650 2023-10-08T12:52:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d1259b700 1 --2- 172.21.15.59:0/3802347590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a797260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:52:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.405+0000 7f7d12d9c700 1 --2- 172.21.15.59:0/3802347590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a7a4a40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7d040116b0 tx=0x7f7d04009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bd063fc0d69778 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:51.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.406+0000 7f7d00ff9700 1 -- 172.21.15.59:0/3802347590 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400e040 con 0x55d92a7a2650 2023-10-08T12:52:51.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.406+0000 7f7d00ff9700 1 -- 172.21.15.59:0/3802347590 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d0400f040 con 0x55d92a7a2650 2023-10-08T12:52:51.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.406+0000 7f7d00ff9700 1 -- 172.21.15.59:0/3802347590 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04004890 con 0x55d92a7a2650 2023-10-08T12:52:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.406+0000 7f7d281eab80 1 -- 172.21.15.59:0/3802347590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 msgr2=0x55d92a7a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.406+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3802347590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a7a4a40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7d040116b0 tx=0x7f7d04009920 comp rx=0 tx=0).stop 2023-10-08T12:52:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.406+0000 7f7d281eab80 1 -- 172.21.15.59:0/3802347590 shutdown_connections 2023-10-08T12:52:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.406+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3802347590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a7a4a40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.406+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3802347590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a797260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.406+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3802347590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a7a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.406+0000 7f7d281eab80 1 -- 172.21.15.59:0/3802347590 >> 172.21.15.59:0/3802347590 conn(0x55d92a70c260 msgr2=0x55d92a7932d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.407+0000 7f7d281eab80 1 -- 172.21.15.59:0/3802347590 shutdown_connections 2023-10-08T12:52:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.407+0000 7f7d281eab80 1 -- 172.21.15.59:0/3802347590 wait complete. 2023-10-08T12:52:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.407+0000 7f7d281eab80 1 -- start start 2023-10-08T12:52:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.407+0000 7f7d281eab80 1 Processor -- start 2023-10-08T12:52:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a7a2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a79f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a79f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d281eab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a6eae30 con 0x55d92a7977a0 2023-10-08T12:52:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d281eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a687710 con 0x55d92a7a2650 2023-10-08T12:52:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d281eab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a6873b0 con 0x55d92a796e80 2023-10-08T12:52:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d281eab80 10 client.0 _ll_register_callbacks cb 0x55d92a4e4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d1259b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a7a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d12d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a79f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d11d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a79f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d12d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a79f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50428/0 (socket says 172.21.15.59:50428) 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.408+0000 7f7d12d9c700 1 -- 172.21.15.59:0/3377223271 learned_addr learned my addr 172.21.15.59:0/3377223271 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7d12d9c700 1 -- 172.21.15.59:0/3377223271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 msgr2=0x55d92a7a2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7d12d9c700 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a7a2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7d12d9c700 1 -- 172.21.15.59:0/3377223271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 msgr2=0x55d92a79f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7d12d9c700 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a79f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7d12d9c700 1 -- 172.21.15.59:0/3377223271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d04011330 con 0x55d92a7a2650 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7d11d9a700 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a79f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7d12d9c700 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a79f940 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009b20 tx=0x7f7d040095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3269332867973a37 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7cf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3377223271 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400e070 con 0x55d92a7a2650 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3377223271 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7d04004140 con 0x55d92a7a2650 2023-10-08T12:52:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7d281eab80 1 -- 172.21.15.59:0/3377223271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d92a6b2eb0 con 0x55d92a7a2650 2023-10-08T12:52:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3377223271 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d04003c10 con 0x55d92a7a2650 2023-10-08T12:52:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7d281eab80 10 client.27131 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.409+0000 7f7d281eab80 1 -- 172.21.15.59:0/3377223271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55d92a4fec60 con 0x55d92a7a2650 2023-10-08T12:52:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.410+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3377223271 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d92a6b2eb0 con 0x55d92a7a2650 2023-10-08T12:52:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.410+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3377223271 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7d0401e470 con 0x55d92a7a2650 2023-10-08T12:52:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.410+0000 7f7d281eab80 10 client.27131 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.410+0000 7f7d281eab80 10 client.27131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.410+0000 7f7d281eab80 20 client.27131 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.410+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d92a7b1f90 0x55d92a7b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.410+0000 7f7d281eab80 4 client.27131 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.410+0000 7f7d281eab80 1 -- 172.21.15.59:0/3377223271 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d92a6e3e10 con 0x55d92a7b1f90 2023-10-08T12:52:51.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.410+0000 7f7d1259b700 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d92a7b1f90 0x55d92a7b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.411+0000 7f7d1259b700 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d92a7b1f90 0x55d92a7b4380 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82ee364bbea6a62b server_cookie=526cd6dd856b116 in_seq=0 out_seq=0 2023-10-08T12:52:51.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.411+0000 7f7cf5ffb700 10 client.27131 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.412+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3377223271 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d92a6e3e10 con 0x55d92a7b1f90 2023-10-08T12:52:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.412+0000 7f7cf5ffb700 10 client.27131 handle_command_reply: tid=0 2023-10-08T12:52:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.412+0000 7f7d281eab80 1 client.27131 shutdown 2023-10-08T12:52:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.412+0000 7f7d281eab80 1 -- 172.21.15.59:0/3377223271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 msgr2=0x55d92a79f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.412+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a79f940 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009b20 tx=0x7f7d040095e0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.413+0000 7f7d281eab80 1 -- 172.21.15.59:0/3377223271 shutdown_connections 2023-10-08T12:52:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.413+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d92a7b1f90 0x55d92a7b4380 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.413+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7a2650 0x55d92a79f940 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.413+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a7a2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.413+0000 7f7cf5ffb700 0 client.27131 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:51.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.413+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3377223271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a79f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.413+0000 7f7d281eab80 1 -- 172.21.15.59:0/3377223271 >> 172.21.15.59:0/3377223271 conn(0x55d92a70c260 msgr2=0x55d92a792ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:51.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.413+0000 7f7d281eab80 1 -- 172.21.15.59:0/3377223271 shutdown_connections 2023-10-08T12:52:51.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.413+0000 7f7d281eab80 1 -- 172.21.15.59:0/3377223271 wait complete. 2023-10-08T12:52:51.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.413+0000 7f7d281eab80 20 client.27131 trim_cache size 0 max 16384 2023-10-08T12:52:51.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.427+0000 7f7d281eab80 1 Processor -- start 2023-10-08T12:52:51.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.427+0000 7f7d281eab80 1 -- start start 2023-10-08T12:52:51.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.427+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a7a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.427+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7977a0 0x55d92a7a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.427+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7a2650 0x55d92a79dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.427+0000 7f7d281eab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a56b920 con 0x55d92a7a2650 2023-10-08T12:52:51.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.427+0000 7f7d281eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a7a9750 con 0x55d92a7977a0 2023-10-08T12:52:51.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.427+0000 7f7d281eab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a797b80 con 0x55d92a796e80 2023-10-08T12:52:51.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d11d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7977a0 0x55d92a7a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d1259b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a7a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d12d9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7a2650 0x55d92a79dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d1259b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a7a9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60476/0 (socket says 172.21.15.59:60476) 2023-10-08T12:52:51.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d1259b700 1 -- 172.21.15.59:0/1688132023 learned_addr learned my addr 172.21.15.59:0/1688132023 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:51.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d1259b700 1 -- 172.21.15.59:0/1688132023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7977a0 msgr2=0x55d92a7a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:51.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d1259b700 1 --2- 172.21.15.59:0/1688132023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7977a0 0x55d92a7a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d1259b700 1 -- 172.21.15.59:0/1688132023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7a2650 msgr2=0x55d92a79dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:51.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d1259b700 1 --2- 172.21.15.59:0/1688132023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7a2650 0x55d92a79dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d1259b700 1 -- 172.21.15.59:0/1688132023 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d92a53c250 con 0x55d92a796e80 2023-10-08T12:52:51.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d12d9c700 1 --2- 172.21.15.59:0/1688132023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7a2650 0x55d92a79dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:51.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d11d9a700 1 --2- 172.21.15.59:0/1688132023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7977a0 0x55d92a7a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:51.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.428+0000 7f7d1259b700 1 --2- 172.21.15.59:0/1688132023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a7a9210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7d08005f50 tx=0x7f7d08020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaded286ea27b314 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.429+0000 7f7d017fa700 1 -- 172.21.15.59:0/1688132023 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d080055d0 con 0x55d92a796e80 2023-10-08T12:52:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.429+0000 7f7d017fa700 1 -- 172.21.15.59:0/1688132023 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d0802a040 con 0x55d92a796e80 2023-10-08T12:52:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.429+0000 7f7d017fa700 1 -- 172.21.15.59:0/1688132023 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08004830 con 0x55d92a796e80 2023-10-08T12:52:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.429+0000 7f7d281eab80 1 -- 172.21.15.59:0/1688132023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 msgr2=0x55d92a7a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.429+0000 7f7d281eab80 1 --2- 172.21.15.59:0/1688132023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a7a9210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7d08005f50 tx=0x7f7d08020000 comp rx=0 tx=0).stop 2023-10-08T12:52:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.429+0000 7f7d281eab80 1 -- 172.21.15.59:0/1688132023 shutdown_connections 2023-10-08T12:52:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.429+0000 7f7d281eab80 1 --2- 172.21.15.59:0/1688132023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7a2650 0x55d92a79dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.429+0000 7f7d281eab80 1 --2- 172.21.15.59:0/1688132023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a796e80 0x55d92a7a9210 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.429+0000 7f7d281eab80 1 --2- 172.21.15.59:0/1688132023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a7977a0 0x55d92a7a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.429+0000 7f7d281eab80 1 -- 172.21.15.59:0/1688132023 >> 172.21.15.59:0/1688132023 conn(0x55d92a70c260 msgr2=0x55d92a7924d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.430+0000 7f7d281eab80 1 -- 172.21.15.59:0/1688132023 shutdown_connections 2023-10-08T12:52:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.430+0000 7f7d281eab80 1 -- 172.21.15.59:0/1688132023 wait complete. 2023-10-08T12:52:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.430+0000 7f7d281eab80 1 -- start start 2023-10-08T12:52:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.430+0000 7f7d281eab80 1 Processor -- start 2023-10-08T12:52:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a796e80 0x55d92a7a73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a7a7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d281eab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a7a2650 0x55d92a804d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d281eab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a7a8030 con 0x55d92a7977a0 2023-10-08T12:52:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d281eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a8052d0 con 0x55d92a796e80 2023-10-08T12:52:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d281eab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d92a805410 con 0x55d92a7a2650 2023-10-08T12:52:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d281eab80 10 client.0 _ll_register_callbacks cb 0x7f7cfc096690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d1259b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a796e80 0x55d92a7a73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d1259b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a796e80 0x55d92a7a73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50442/0 (socket says 172.21.15.59:50442) 2023-10-08T12:52:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d1259b700 1 -- 172.21.15.59:0/3415819760 learned_addr learned my addr 172.21.15.59:0/3415819760 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d11d9a700 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a7a7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d12d9c700 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a7a2650 0x55d92a804d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d1259b700 1 -- 172.21.15.59:0/3415819760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a7a2650 msgr2=0x55d92a804d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d1259b700 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a7a2650 0x55d92a804d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d1259b700 1 -- 172.21.15.59:0/3415819760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 msgr2=0x55d92a7a7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d1259b700 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a7a7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.431+0000 7f7d1259b700 1 -- 172.21.15.59:0/3415819760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c1a9e20 con 0x55d92a796e80 2023-10-08T12:52:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.432+0000 7f7d11d9a700 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a7a7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.432+0000 7f7d1259b700 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a796e80 0x55d92a7a73e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7d080098e0 tx=0x7f7d08005480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d59a3617a85d718 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.432+0000 7f7cf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.432+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3415819760 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d080324b0 con 0x55d92a796e80 2023-10-08T12:52:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.432+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3415819760 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7d08032c10 con 0x55d92a796e80 2023-10-08T12:52:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.432+0000 7f7d281eab80 1 -- 172.21.15.59:0/3415819760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d0400f040 con 0x55d92a796e80 2023-10-08T12:52:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.432+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3415819760 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d08032dd0 con 0x55d92a796e80 2023-10-08T12:52:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.432+0000 7f7d281eab80 10 client.27137 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.432+0000 7f7d281eab80 1 -- 172.21.15.59:0/3415819760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55d92a4fec60 con 0x55d92a796e80 2023-10-08T12:52:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.433+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3415819760 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d0400f040 con 0x55d92a796e80 2023-10-08T12:52:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.433+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3415819760 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7d0800f580 con 0x55d92a796e80 2023-10-08T12:52:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.433+0000 7f7d281eab80 10 client.27137 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.433+0000 7f7d281eab80 10 client.27137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.433+0000 7f7d281eab80 20 client.27137 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.433+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d92a806700 0x55d92a808af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.433+0000 7f7d281eab80 4 client.27137 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:52:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.433+0000 7f7d281eab80 1 -- 172.21.15.59:0/3415819760 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d92a6e3b30 con 0x55d92a806700 2023-10-08T12:52:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.433+0000 7f7d11d9a700 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d92a806700 0x55d92a808af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:51.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.433+0000 7f7d11d9a700 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d92a806700 0x55d92a808af0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aadd3158143307e4 server_cookie=675a9138b87f9617 in_seq=0 out_seq=0 2023-10-08T12:52:51.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.433+0000 7f7cf5ffb700 10 client.27137 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:51.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7cf5ffb700 1 -- 172.21.15.59:0/3415819760 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d92a6e3b30 con 0x55d92a806700 2023-10-08T12:52:51.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7cf5ffb700 10 client.27137 handle_command_reply: tid=0 2023-10-08T12:52:51.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7d281eab80 1 client.27137 shutdown 2023-10-08T12:52:51.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7d281eab80 1 -- 172.21.15.59:0/3415819760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a796e80 msgr2=0x55d92a7a73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:51.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a796e80 0x55d92a7a73e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7d080098e0 tx=0x7f7d08005480 comp rx=0 tx=0).stop 2023-10-08T12:52:51.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7d281eab80 1 -- 172.21.15.59:0/3415819760 shutdown_connections 2023-10-08T12:52:51.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55d92a806700 0x55d92a808af0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d92a796e80 0x55d92a7a73e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d92a7a2650 0x55d92a804d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7cf5ffb700 0 client.27137 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:51.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7d281eab80 1 --2- 172.21.15.59:0/3415819760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d92a7977a0 0x55d92a7a7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7d281eab80 1 -- 172.21.15.59:0/3415819760 >> 172.21.15.59:0/3415819760 conn(0x55d92a70c260 msgr2=0x55d92a792cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:51.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.434+0000 7f7d281eab80 1 -- 172.21.15.59:0/3415819760 shutdown_connections 2023-10-08T12:52:51.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d281eab80 1 -- 172.21.15.59:0/3415819760 wait complete. 2023-10-08T12:52:51.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d281eab80 20 client.27137 trim_cache size 0 max 16384 2023-10-08T12:52:51.440 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:52:51.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d147ff700 1 -- 172.21.15.59:0/509047591 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7cf80a15f0 msgr2=0x7f7cf80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:51.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d147ff700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7cf80a15f0 0x7f7cf80a3ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800b2e0 tx=0x7f7d08005fd0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d147ff700 1 -- 172.21.15.59:0/509047591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d0c101100 msgr2=0x7f7d0c107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:51.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d147ff700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d0c101100 0x7f7d0c107b60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00e9a0 tx=0x7f7cfc00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d147ff700 1 -- 172.21.15.59:0/509047591 shutdown_connections 2023-10-08T12:52:51.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d147ff700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7cf80a15f0 0x7f7cf80a3ab0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d147ff700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d0c106750 0x7f7d0c1080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d147ff700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c100740 0x7f7d0c107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d147ff700 1 --2- 172.21.15.59:0/509047591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d0c101100 0x7f7d0c107b60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:51.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.435+0000 7f7d147ff700 1 -- 172.21.15.59:0/509047591 >> 172.21.15.59:0/509047591 conn(0x7f7d0c0fc230 msgr2=0x7f7d0c0fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:51.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.436+0000 7f7d147ff700 1 -- 172.21.15.59:0/509047591 shutdown_connections 2023-10-08T12:52:51.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:51.436+0000 7f7d147ff700 1 -- 172.21.15.59:0/509047591 wait complete. 2023-10-08T12:52:51.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1479601 12.52 MB/sec execute 502 sec latency 19.209 ms 2023-10-08T12:52:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:52 smithi092 ceph-mon[134093]: pgmap v674: 97 pgs: 97 active+clean; 642 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 221 op/s 2023-10-08T12:52:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:52 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4051485330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:52.455 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:52:52.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:52:52.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:52 smithi173 ceph-mon[135182]: pgmap v674: 97 pgs: 97 active+clean; 642 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 221 op/s 2023-10-08T12:52:52.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:52 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4051485330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:52.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:52 smithi059 ceph-mon[98489]: pgmap v674: 97 pgs: 97 active+clean; 642 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 221 op/s 2023-10-08T12:52:52.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:52 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4051485330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:52.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1482041 12.52 MB/sec execute 503 sec latency 11.875 ms 2023-10-08T12:52:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.677+0000 7f0f6dfff700 1 -- 172.21.15.59:0/1919341865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f68072bc0 msgr2=0x7f0f68072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.677+0000 7f0f6dfff700 1 --2- 172.21.15.59:0/1919341865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f68072bc0 0x7f0f68072fa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800b0a0 tx=0x7f0f5800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.677+0000 7f0f6dfff700 1 -- 172.21.15.59:0/1919341865 shutdown_connections 2023-10-08T12:52:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.677+0000 7f0f6dfff700 1 --2- 172.21.15.59:0/1919341865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f68072bc0 0x7f0f68072fa0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.677+0000 7f0f6dfff700 1 --2- 172.21.15.59:0/1919341865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f6810cfe0 0x7f0f6810f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.677+0000 7f0f6dfff700 1 --2- 172.21.15.59:0/1919341865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f680734e0 0x7f0f6810caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.678+0000 7f0f6dfff700 1 -- 172.21.15.59:0/1919341865 >> 172.21.15.59:0/1919341865 conn(0x7f0f680fc230 msgr2=0x7f0f680fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:52.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.678+0000 7f0f6dfff700 1 -- 172.21.15.59:0/1919341865 shutdown_connections 2023-10-08T12:52:52.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.678+0000 7f0f6dfff700 1 -- 172.21.15.59:0/1919341865 wait complete. 2023-10-08T12:52:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.679+0000 7f0f6dfff700 1 Processor -- start 2023-10-08T12:52:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.679+0000 7f0f6dfff700 1 -- start start 2023-10-08T12:52:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.679+0000 7f0f6dfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f68072bc0 0x7f0f68198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.679+0000 7f0f6dfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f680734e0 0x7f0f681994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.679+0000 7f0f6dfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6810cfe0 0x7f0f6819d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.679+0000 7f0f6dfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6819dec0 con 0x7f0f680734e0 2023-10-08T12:52:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.679+0000 7f0f6dfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6819e030 con 0x7f0f6810cfe0 2023-10-08T12:52:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.679+0000 7f0f6dfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6819e1f0 con 0x7f0f68072bc0 2023-10-08T12:52:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f67fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6810cfe0 0x7f0f6819d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f66ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f680734e0 0x7f0f681994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f67fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6810cfe0 0x7f0f6819d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50458/0 (socket says 172.21.15.59:50458) 2023-10-08T12:52:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f67fff700 1 -- 172.21.15.59:0/2231074458 learned_addr learned my addr 172.21.15.59:0/2231074458 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f677fe700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f68072bc0 0x7f0f68198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f67fff700 1 -- 172.21.15.59:0/2231074458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f68072bc0 msgr2=0x7f0f68198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f67fff700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f68072bc0 0x7f0f68198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f67fff700 1 -- 172.21.15.59:0/2231074458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f680734e0 msgr2=0x7f0f681994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f67fff700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f680734e0 0x7f0f681994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f67fff700 1 -- 172.21.15.59:0/2231074458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f58009d00 con 0x7f0f6810cfe0 2023-10-08T12:52:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f677fe700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f68072bc0 0x7f0f68198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.680+0000 7f0f67fff700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6810cfe0 0x7f0f6819d880 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000e970 tx=0x7f0f6000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.681+0000 7f0f64ff9700 1 -- 172.21.15.59:0/2231074458 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60009750 con 0x7f0f6810cfe0 2023-10-08T12:52:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.681+0000 7f0f64ff9700 1 -- 172.21.15.59:0/2231074458 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f60005020 con 0x7f0f6810cfe0 2023-10-08T12:52:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.681+0000 7f0f64ff9700 1 -- 172.21.15.59:0/2231074458 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000cbf0 con 0x7f0f6810cfe0 2023-10-08T12:52:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.681+0000 7f0f6dfff700 1 -- 172.21.15.59:0/2231074458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6819e4d0 con 0x7f0f6810cfe0 2023-10-08T12:52:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.681+0000 7f0f6dfff700 1 -- 172.21.15.59:0/2231074458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f681a5d10 con 0x7f0f6810cfe0 2023-10-08T12:52:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.685+0000 7f0f64ff9700 1 -- 172.21.15.59:0/2231074458 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0f60005470 con 0x7f0f6810cfe0 2023-10-08T12:52:52.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.686+0000 7f0f81898b80 1 Processor -- start 2023-10-08T12:52:52.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.687+0000 7f0f81898b80 1 -- start start 2023-10-08T12:52:52.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.687+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130940f00 0x5651309412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.687+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130941820 0x56513094c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.687+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56513094c6d0 0x56513094eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.687+0000 7f0f81898b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651308aa4e0 con 0x565130941820 2023-10-08T12:52:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.687+0000 7f0f81898b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56513089bca0 con 0x56513094c6d0 2023-10-08T12:52:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.687+0000 7f0f81898b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651308995c0 con 0x565130940f00 2023-10-08T12:52:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.687+0000 7f0f64ff9700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f500a1670 0x7f0f500a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f66ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56513094c6d0 0x56513094eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f677fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130941820 0x56513094c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f66ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56513094c6d0 0x56513094eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50464/0 (socket says 172.21.15.59:50464) 2023-10-08T12:52:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f66ffd700 1 -- 172.21.15.59:0/88535112 learned_addr learned my addr 172.21.15.59:0/88535112 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f64ff9700 1 -- 172.21.15.59:0/2231074458 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f0f60014070 con 0x7f0f6810cfe0 2023-10-08T12:52:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/88535112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130940f00 0x5651309412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f67fff700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f500a1670 0x7f0f500a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f677fe700 1 -- 172.21.15.59:0/88535112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130940f00 msgr2=0x5651309412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f677fe700 1 --2- 172.21.15.59:0/88535112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130940f00 0x5651309412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f677fe700 1 -- 172.21.15.59:0/88535112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56513094c6d0 msgr2=0x56513094eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f677fe700 1 --2- 172.21.15.59:0/88535112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56513094c6d0 0x56513094eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.688+0000 7f0f677fe700 1 -- 172.21.15.59:0/88535112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651306bfe60 con 0x565130941820 2023-10-08T12:52:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.689+0000 7f0f67fff700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f500a1670 0x7f0f500a3b30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0f60099eb0 tx=0x7f0f60004750 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.689+0000 7f0f677fe700 1 --2- 172.21.15.59:0/88535112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130941820 0x56513094c190 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0f580062a0 tx=0x7f0f58009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50912b93937c122 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.689+0000 7f0f4dffb700 1 -- 172.21.15.59:0/88535112 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800e040 con 0x565130941820 2023-10-08T12:52:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.689+0000 7f0f4dffb700 1 -- 172.21.15.59:0/88535112 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f58008ef0 con 0x565130941820 2023-10-08T12:52:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.689+0000 7f0f4dffb700 1 -- 172.21.15.59:0/88535112 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f580079a0 con 0x565130941820 2023-10-08T12:52:52.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.690+0000 7f0f81898b80 1 -- 172.21.15.59:0/88535112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130941820 msgr2=0x56513094c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:52.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.690+0000 7f0f81898b80 1 --2- 172.21.15.59:0/88535112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130941820 0x56513094c190 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0f580062a0 tx=0x7f0f58009c00 comp rx=0 tx=0).stop 2023-10-08T12:52:52.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.690+0000 7f0f81898b80 1 -- 172.21.15.59:0/88535112 shutdown_connections 2023-10-08T12:52:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.690+0000 7f0f81898b80 1 --2- 172.21.15.59:0/88535112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56513094c6d0 0x56513094eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.690+0000 7f0f81898b80 1 --2- 172.21.15.59:0/88535112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130940f00 0x5651309412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.690+0000 7f0f81898b80 1 --2- 172.21.15.59:0/88535112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130941820 0x56513094c190 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.690+0000 7f0f81898b80 1 -- 172.21.15.59:0/88535112 >> 172.21.15.59:0/88535112 conn(0x5651308b62e0 msgr2=0x56513093d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.690+0000 7f0f81898b80 1 -- 172.21.15.59:0/88535112 shutdown_connections 2023-10-08T12:52:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.690+0000 7f0f81898b80 1 -- 172.21.15.59:0/88535112 wait complete. 2023-10-08T12:52:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.691+0000 7f0f81898b80 1 -- start start 2023-10-08T12:52:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.691+0000 7f0f81898b80 1 Processor -- start 2023-10-08T12:52:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 0x56513094c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 0x5651309493f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56513094c6d0 0x565130949b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f81898b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x565130894eb0 con 0x565130940f00 2023-10-08T12:52:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f81898b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x565130831790 con 0x56513094c6d0 2023-10-08T12:52:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f81898b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x565130831430 con 0x565130941820 2023-10-08T12:52:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f81898b80 10 client.0 _ll_register_callbacks cb 0x56513068e880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f677fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 0x5651309493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f66ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 0x56513094c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f66ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 0x56513094c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46556/0 (socket says 172.21.15.59:46556) 2023-10-08T12:52:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f66ffd700 1 -- 172.21.15.59:0/2207367216 learned_addr learned my addr 172.21.15.59:0/2207367216 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.692+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56513094c6d0 0x565130949b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.693+0000 7f0f677fe700 1 -- 172.21.15.59:0/2207367216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56513094c6d0 msgr2=0x565130949b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.693+0000 7f0f677fe700 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56513094c6d0 0x565130949b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.693+0000 7f0f677fe700 1 -- 172.21.15.59:0/2207367216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 msgr2=0x56513094c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.693+0000 7f0f677fe700 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 0x56513094c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.693+0000 7f0f677fe700 1 -- 172.21.15.59:0/2207367216 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f68110120 con 0x565130941820 2023-10-08T12:52:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.693+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 0x56513094c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.693+0000 7f0f677fe700 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 0x5651309493f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800b780 tx=0x7f0f580061a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e29427854f24784 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.693+0000 7f0f46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:52:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.693+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2207367216 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800e070 con 0x565130941820 2023-10-08T12:52:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.693+0000 7f0f81898b80 1 -- 172.21.15.59:0/2207367216 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56513088de90 con 0x565130941820 2023-10-08T12:52:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.693+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2207367216 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f0f58003a00 con 0x565130941820 2023-10-08T12:52:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.694+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2207367216 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f58003bc0 con 0x565130941820 2023-10-08T12:52:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.694+0000 7f0f81898b80 10 client.27139 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.694+0000 7f0f81898b80 1 -- 172.21.15.59:0/2207367216 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5651306a8ce0 con 0x565130941820 2023-10-08T12:52:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.694+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2207367216 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56513088de90 con 0x565130941820 2023-10-08T12:52:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.694+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2207367216 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0f5800b0d0 con 0x565130941820 2023-10-08T12:52:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.694+0000 7f0f81898b80 10 client.27139 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.694+0000 7f0f81898b80 10 client.27139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.694+0000 7f0f81898b80 20 client.27139 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.694+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56513095bec0 0x56513095e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.694+0000 7f0f81898b80 4 client.27139 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.694+0000 7f0f81898b80 1 -- 172.21.15.59:0/2207367216 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56513088dbb0 con 0x56513095bec0 2023-10-08T12:52:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.695+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56513095bec0 0x56513095e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.695+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56513095bec0 0x56513095e2e0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c62709a9c13de33d server_cookie=e92a2eee7c395dbf in_seq=0 out_seq=0 2023-10-08T12:52:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.695+0000 7f0f46ffd700 10 client.27139 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2207367216 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56513088dbb0 con 0x56513095bec0 2023-10-08T12:52:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f46ffd700 10 client.27139 handle_command_reply: tid=0 2023-10-08T12:52:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f81898b80 1 client.27139 shutdown 2023-10-08T12:52:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f81898b80 1 -- 172.21.15.59:0/2207367216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 msgr2=0x5651309493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 0x5651309493f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800b780 tx=0x7f0f580061a0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f81898b80 1 -- 172.21.15.59:0/2207367216 shutdown_connections 2023-10-08T12:52:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56513095bec0 0x56513095e2e0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56513094c6d0 0x565130949b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 0x56513094c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2207367216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 0x5651309493f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f46ffd700 0 client.27139 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f81898b80 1 -- 172.21.15.59:0/2207367216 >> 172.21.15.59:0/2207367216 conn(0x5651308b62e0 msgr2=0x56513093cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f81898b80 1 -- 172.21.15.59:0/2207367216 shutdown_connections 2023-10-08T12:52:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.696+0000 7f0f81898b80 1 -- 172.21.15.59:0/2207367216 wait complete. 2023-10-08T12:52:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.697+0000 7f0f81898b80 20 client.27139 trim_cache size 0 max 16384 2023-10-08T12:52:52.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.715+0000 7f0f81898b80 1 Processor -- start 2023-10-08T12:52:52.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.715+0000 7f0f81898b80 1 -- start start 2023-10-08T12:52:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.715+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130940f00 0x56513093d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 0x565130943dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56513094c6d0 0x5651309531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f81898b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651307159a0 con 0x56513094c6d0 2023-10-08T12:52:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f81898b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651309416a0 con 0x565130940f00 2023-10-08T12:52:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f81898b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56513094a360 con 0x565130941820 2023-10-08T12:52:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f66ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130940f00 0x56513093d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f677fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 0x565130943dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f677fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 0x565130943dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60524/0 (socket says 172.21.15.59:60524) 2023-10-08T12:52:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f677fe700 1 -- 172.21.15.59:0/245572643 learned_addr learned my addr 172.21.15.59:0/245572643 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f66ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130940f00 0x56513093d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50486/0 (socket says 172.21.15.59:50486) 2023-10-08T12:52:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/245572643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56513094c6d0 0x5651309531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f677fe700 1 -- 172.21.15.59:0/245572643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130940f00 msgr2=0x56513093d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f677fe700 1 --2- 172.21.15.59:0/245572643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130940f00 0x56513093d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f677fe700 1 -- 172.21.15.59:0/245572643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56513094c6d0 msgr2=0x5651309531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f677fe700 1 --2- 172.21.15.59:0/245572643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56513094c6d0 0x5651309531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f677fe700 1 -- 172.21.15.59:0/245572643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565130962ed0 con 0x565130941820 2023-10-08T12:52:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.716+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/245572643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56513094c6d0 0x5651309531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.717+0000 7f0f677fe700 1 --2- 172.21.15.59:0/245572643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 0x565130943dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0f5801cde0 tx=0x7f0f580265d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c55521d99afd7dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.717+0000 7f0f4e7fc700 1 -- 172.21.15.59:0/245572643 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800e070 con 0x565130941820 2023-10-08T12:52:52.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.717+0000 7f0f4e7fc700 1 -- 172.21.15.59:0/245572643 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f5802a070 con 0x565130941820 2023-10-08T12:52:52.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.717+0000 7f0f4e7fc700 1 -- 172.21.15.59:0/245572643 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58026ca0 con 0x565130941820 2023-10-08T12:52:52.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.717+0000 7f0f81898b80 1 -- 172.21.15.59:0/245572643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 msgr2=0x565130943dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:52.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.717+0000 7f0f81898b80 1 --2- 172.21.15.59:0/245572643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 0x565130943dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0f5801cde0 tx=0x7f0f580265d0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.718+0000 7f0f81898b80 1 -- 172.21.15.59:0/245572643 shutdown_connections 2023-10-08T12:52:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.718+0000 7f0f81898b80 1 --2- 172.21.15.59:0/245572643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130940f00 0x56513093d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.718+0000 7f0f81898b80 1 --2- 172.21.15.59:0/245572643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56513094c6d0 0x5651309531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.718+0000 7f0f81898b80 1 --2- 172.21.15.59:0/245572643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565130941820 0x565130943dd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.718+0000 7f0f81898b80 1 -- 172.21.15.59:0/245572643 >> 172.21.15.59:0/245572643 conn(0x5651308b62e0 msgr2=0x56513093cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.718+0000 7f0f81898b80 1 -- 172.21.15.59:0/245572643 shutdown_connections 2023-10-08T12:52:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.718+0000 7f0f81898b80 1 -- 172.21.15.59:0/245572643 wait complete. 2023-10-08T12:52:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.718+0000 7f0f81898b80 1 -- start start 2023-10-08T12:52:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.719+0000 7f0f81898b80 1 Processor -- start 2023-10-08T12:52:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.719+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 0x5651309513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.719+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130941820 0x565130951920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.719+0000 7f0f81898b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56513094c6d0 0x5651309a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.719+0000 7f0f81898b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651309a81b0 con 0x565130940f00 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.719+0000 7f0f81898b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651309a8320 con 0x565130941820 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.719+0000 7f0f81898b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651309a84e0 con 0x56513094c6d0 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.719+0000 7f0f81898b80 10 client.0 _ll_register_callbacks cb 0x7f0f5c009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.719+0000 7f0f677fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130941820 0x565130951920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.719+0000 7f0f677fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130941820 0x565130951920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50498/0 (socket says 172.21.15.59:50498) 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.719+0000 7f0f677fe700 1 -- 172.21.15.59:0/2702123403 learned_addr learned my addr 172.21.15.59:0/2702123403 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.720+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 0x5651309513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.720+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56513094c6d0 0x5651309a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.720+0000 7f0f677fe700 1 -- 172.21.15.59:0/2702123403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56513094c6d0 msgr2=0x5651309a7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:52.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.720+0000 7f0f677fe700 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56513094c6d0 0x5651309a7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.720+0000 7f0f677fe700 1 -- 172.21.15.59:0/2702123403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 msgr2=0x5651309513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:52.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.720+0000 7f0f677fe700 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 0x5651309513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.720+0000 7f0f677fe700 1 -- 172.21.15.59:0/2702123403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651306a8ce0 con 0x565130941820 2023-10-08T12:52:52.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.720+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56513094c6d0 0x5651309a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:52.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.720+0000 7f0f677fe700 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130941820 0x565130951920 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0f5801df30 tx=0x7f0f58009c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=653ada46e0b6dbf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:52.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.720+0000 7f0f46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:52.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.720+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2702123403 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800e040 con 0x565130941820 2023-10-08T12:52:52.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2702123403 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f0f58003c00 con 0x565130941820 2023-10-08T12:52:52.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f81898b80 1 -- 172.21.15.59:0/2702123403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56513085cf30 con 0x565130941820 2023-10-08T12:52:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2702123403 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f58003dc0 con 0x565130941820 2023-10-08T12:52:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f81898b80 10 client.27155 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f81898b80 1 -- 172.21.15.59:0/2702123403 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x565130939570 con 0x565130941820 2023-10-08T12:52:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2702123403 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f5804a020 con 0x565130941820 2023-10-08T12:52:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2702123403 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0f5801c5d0 con 0x565130941820 2023-10-08T12:52:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f81898b80 10 client.27155 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f81898b80 10 client.27155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f81898b80 20 client.27155 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5651309b0ac0 0x5651309b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f81898b80 4 client.27155 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:52:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.721+0000 7f0f81898b80 1 -- 172.21.15.59:0/2702123403 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5651306e0ff0 con 0x5651309b0ac0 2023-10-08T12:52:52.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.722+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5651309b0ac0 0x5651309b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.722+0000 7f0f66ffd700 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5651309b0ac0 0x5651309b2ee0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c6a483f99b2014d server_cookie=fce7f52fcd88456e in_seq=0 out_seq=0 2023-10-08T12:52:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.722+0000 7f0f46ffd700 10 client.27155 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f46ffd700 1 -- 172.21.15.59:0/2702123403 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5651306e0ff0 con 0x5651309b0ac0 2023-10-08T12:52:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f46ffd700 10 client.27155 handle_command_reply: tid=0 2023-10-08T12:52:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f81898b80 1 client.27155 shutdown 2023-10-08T12:52:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f81898b80 1 -- 172.21.15.59:0/2702123403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130941820 msgr2=0x565130951920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130941820 0x565130951920 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0f5801df30 tx=0x7f0f58009c10 comp rx=0 tx=0).stop 2023-10-08T12:52:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f81898b80 1 -- 172.21.15.59:0/2702123403 shutdown_connections 2023-10-08T12:52:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5651309b0ac0 0x5651309b2ee0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56513094c6d0 0x5651309a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565130940f00 0x5651309513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f46ffd700 0 client.27155 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f81898b80 1 --2- 172.21.15.59:0/2702123403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x565130941820 0x565130951920 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.724+0000 7f0f81898b80 1 -- 172.21.15.59:0/2702123403 >> 172.21.15.59:0/2702123403 conn(0x5651308b62e0 msgr2=0x565130948c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.725+0000 7f0f81898b80 1 -- 172.21.15.59:0/2702123403 shutdown_connections 2023-10-08T12:52:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.725+0000 7f0f81898b80 1 -- 172.21.15.59:0/2702123403 wait complete. 2023-10-08T12:52:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.725+0000 7f0f81898b80 20 client.27155 trim_cache size 0 max 16384 2023-10-08T12:52:52.728 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:52:52.728 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:52:52.729 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "d5efeec8-873e-4986-8227-3bdec06a050c", 2023-10-08T12:52:52.729 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:52:52.729 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:52:52.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.725+0000 7f0f6dfff700 1 -- 172.21.15.59:0/2231074458 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f500a1670 msgr2=0x7f0f500a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:52.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.725+0000 7f0f6dfff700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f500a1670 0x7f0f500a3b30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0f60099eb0 tx=0x7f0f60004750 comp rx=0 tx=0).stop 2023-10-08T12:52:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.725+0000 7f0f6dfff700 1 -- 172.21.15.59:0/2231074458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6810cfe0 msgr2=0x7f0f6819d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.725+0000 7f0f6dfff700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6810cfe0 0x7f0f6819d880 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000e970 tx=0x7f0f6000ec80 comp rx=0 tx=0).stop 2023-10-08T12:52:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.726+0000 7f0f6dfff700 1 -- 172.21.15.59:0/2231074458 shutdown_connections 2023-10-08T12:52:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.726+0000 7f0f6dfff700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f0f500a1670 0x7f0f500a3b30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.726+0000 7f0f6dfff700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6810cfe0 0x7f0f6819d880 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.726+0000 7f0f6dfff700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f68072bc0 0x7f0f68198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.726+0000 7f0f6dfff700 1 --2- 172.21.15.59:0/2231074458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f680734e0 0x7f0f681994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:52.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.726+0000 7f0f6dfff700 1 -- 172.21.15.59:0/2231074458 >> 172.21.15.59:0/2231074458 conn(0x7f0f680fc230 msgr2=0x7f0f680fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:52.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.726+0000 7f0f6dfff700 1 -- 172.21.15.59:0/2231074458 shutdown_connections 2023-10-08T12:52:52.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:52.726+0000 7f0f6dfff700 1 -- 172.21.15.59:0/2231074458 wait complete. 2023-10-08T12:52:52.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:52:53.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.003+0000 7fc8c47ff700 1 -- 172.21.15.59:0/132735792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8bc072c20 msgr2=0x7fc8bc073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.003+0000 7fc8c47ff700 1 --2- 172.21.15.59:0/132735792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8bc072c20 0x7fc8bc073000 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009990 tx=0x7fc8b8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.003+0000 7fc8c47ff700 1 -- 172.21.15.59:0/132735792 shutdown_connections 2023-10-08T12:52:53.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.003+0000 7fc8c47ff700 1 --2- 172.21.15.59:0/132735792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8bc10cf70 0x7fc8bc10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.003+0000 7fc8c47ff700 1 --2- 172.21.15.59:0/132735792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8bc072c20 0x7fc8bc073000 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.003+0000 7fc8c47ff700 1 --2- 172.21.15.59:0/132735792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc073540 0x7fc8bc10ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.003+0000 7fc8c47ff700 1 -- 172.21.15.59:0/132735792 >> 172.21.15.59:0/132735792 conn(0x7fc8bc0fc200 msgr2=0x7fc8bc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.003+0000 7fc8c47ff700 1 -- 172.21.15.59:0/132735792 shutdown_connections 2023-10-08T12:52:53.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.003+0000 7fc8c47ff700 1 -- 172.21.15.59:0/132735792 wait complete. 2023-10-08T12:52:53.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.004+0000 7fc8c47ff700 1 Processor -- start 2023-10-08T12:52:53.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.004+0000 7fc8c47ff700 1 -- start start 2023-10-08T12:52:53.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.004+0000 7fc8c47ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8bc072c20 0x7fc8bc198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.004+0000 7fc8c47ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc073540 0x7fc8bc199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.004+0000 7fc8c47ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8bc10cf70 0x7fc8bc19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.004+0000 7fc8c47ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc19dd50 con 0x7fc8bc10cf70 2023-10-08T12:52:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.004+0000 7fc8c47ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc19dec0 con 0x7fc8bc073540 2023-10-08T12:52:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.004+0000 7fc8c47ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc19e080 con 0x7fc8bc072c20 2023-10-08T12:52:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.005+0000 7fc8c1d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc073540 0x7fc8bc199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.005+0000 7fc8c1d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc073540 0x7fc8bc199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50526/0 (socket says 172.21.15.59:50526) 2023-10-08T12:52:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.005+0000 7fc8c1d9a700 1 -- 172.21.15.59:0/649610379 learned_addr learned my addr 172.21.15.59:0/649610379 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.005+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8bc10cf70 0x7fc8bc19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.005+0000 7fc8c259b700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8bc072c20 0x7fc8bc198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.005+0000 7fc8c1d9a700 1 -- 172.21.15.59:0/649610379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8bc072c20 msgr2=0x7fc8bc198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.005+0000 7fc8c1d9a700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8bc072c20 0x7fc8bc198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.005+0000 7fc8c1d9a700 1 -- 172.21.15.59:0/649610379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8bc10cf70 msgr2=0x7fc8bc19d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.005+0000 7fc8c1d9a700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8bc10cf70 0x7fc8bc19d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.005+0000 7fc8c1d9a700 1 -- 172.21.15.59:0/649610379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b80095f0 con 0x7fc8bc073540 2023-10-08T12:52:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.005+0000 7fc8c1d9a700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc073540 0x7fc8bc199370 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00e9a0 tx=0x7fc8ac00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.006+0000 7fc8b37fe700 1 -- 172.21.15.59:0/649610379 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac009790 con 0x7fc8bc073540 2023-10-08T12:52:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.006+0000 7fc8b37fe700 1 -- 172.21.15.59:0/649610379 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8ac010430 con 0x7fc8bc073540 2023-10-08T12:52:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.006+0000 7fc8c47ff700 1 -- 172.21.15.59:0/649610379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc19e360 con 0x7fc8bc073540 2023-10-08T12:52:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.006+0000 7fc8b37fe700 1 -- 172.21.15.59:0/649610379 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac018680 con 0x7fc8bc073540 2023-10-08T12:52:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.006+0000 7fc8c47ff700 1 -- 172.21.15.59:0/649610379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc1a5ba0 con 0x7fc8bc073540 2023-10-08T12:52:53.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.009+0000 7fc8b37fe700 1 -- 172.21.15.59:0/649610379 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc8ac0105a0 con 0x7fc8bc073540 2023-10-08T12:52:53.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.010+0000 7fc8d809db80 1 Processor -- start 2023-10-08T12:52:53.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.010+0000 7fc8d809db80 1 -- start start 2023-10-08T12:52:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8b37fe700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8a80a15f0 0x7fc8a80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c44260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 0x55ce04c4f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04c51a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8d809db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04bad460 con 0x55ce04c43e80 2023-10-08T12:52:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8d809db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04b9ec20 con 0x55ce04c4f650 2023-10-08T12:52:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8d809db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04b9c540 con 0x55ce04c447a0 2023-10-08T12:52:53.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8b37fe700 1 -- 172.21.15.59:0/649610379 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fc8ac014070 con 0x7fc8bc073540 2023-10-08T12:52:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8c259b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c44260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8c1d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 0x55ce04c4f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8c1d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 0x55ce04c4f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60558/0 (socket says 172.21.15.59:60558) 2023-10-08T12:52:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8c2d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04c51a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8c1d9a700 1 -- 172.21.15.59:0/3686636191 learned_addr learned my addr 172.21.15.59:0/3686636191 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8c259b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c44260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46614/0 (socket says 172.21.15.59:46614) 2023-10-08T12:52:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.011+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8a80a15f0 0x7fc8a80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.012+0000 7fc8c1d9a700 1 -- 172.21.15.59:0/3686636191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 msgr2=0x55ce04c51a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.012+0000 7fc8c1d9a700 1 --2- 172.21.15.59:0/3686636191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04c51a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.012+0000 7fc8c1d9a700 1 -- 172.21.15.59:0/3686636191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 msgr2=0x55ce04c44260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.012+0000 7fc8c1d9a700 1 --2- 172.21.15.59:0/3686636191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c44260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.012+0000 7fc8c1d9a700 1 -- 172.21.15.59:0/3686636191 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce049c2de0 con 0x55ce04c447a0 2023-10-08T12:52:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.012+0000 7fc8c1d9a700 1 --2- 172.21.15.59:0/3686636191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 0x55ce04c4f110 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac099fa0 tx=0x7fc8ac099f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7612818219a0b6ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.012+0000 7fc8b0ff9700 1 -- 172.21.15.59:0/3686636191 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0b1070 con 0x55ce04c447a0 2023-10-08T12:52:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.012+0000 7fc8b0ff9700 1 -- 172.21.15.59:0/3686636191 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8ac09e3f0 con 0x55ce04c447a0 2023-10-08T12:52:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.012+0000 7fc8b0ff9700 1 -- 172.21.15.59:0/3686636191 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac09a500 con 0x55ce04c447a0 2023-10-08T12:52:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.013+0000 7fc8d809db80 1 -- 172.21.15.59:0/3686636191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 msgr2=0x55ce04c4f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.013+0000 7fc8d809db80 1 --2- 172.21.15.59:0/3686636191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 0x55ce04c4f110 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac099fa0 tx=0x7fc8ac099f10 comp rx=0 tx=0).stop 2023-10-08T12:52:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.013+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8a80a15f0 0x7fc8a80a3ab0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009550 tx=0x7fc8b400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.013+0000 7fc8d809db80 1 -- 172.21.15.59:0/3686636191 shutdown_connections 2023-10-08T12:52:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.013+0000 7fc8d809db80 1 --2- 172.21.15.59:0/3686636191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04c51a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.013+0000 7fc8d809db80 1 --2- 172.21.15.59:0/3686636191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c44260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.013+0000 7fc8d809db80 1 --2- 172.21.15.59:0/3686636191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 0x55ce04c4f110 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.013+0000 7fc8d809db80 1 -- 172.21.15.59:0/3686636191 >> 172.21.15.59:0/3686636191 conn(0x55ce04bb9260 msgr2=0x55ce04c402d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.014+0000 7fc8d809db80 1 -- 172.21.15.59:0/3686636191 shutdown_connections 2023-10-08T12:52:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.014+0000 7fc8d809db80 1 -- 172.21.15.59:0/3686636191 wait complete. 2023-10-08T12:52:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.014+0000 7fc8d809db80 1 -- start start 2023-10-08T12:52:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.014+0000 7fc8d809db80 1 Processor -- start 2023-10-08T12:52:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c4f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c447a0 0x55ce04c4c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c4f650 0x55ce04c4cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8d809db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04b97e30 con 0x55ce04c43e80 2023-10-08T12:52:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8d809db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04b34710 con 0x55ce04c447a0 2023-10-08T12:52:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8d809db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04b343b0 con 0x55ce04c4f650 2023-10-08T12:52:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8d809db80 10 client.0 _ll_register_callbacks cb 0x55ce04991800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8c259b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c4f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8c259b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c4f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46620/0 (socket says 172.21.15.59:46620) 2023-10-08T12:52:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8c2d9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c4f650 0x55ce04c4cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8c1d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c447a0 0x55ce04c4c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.015+0000 7fc8c259b700 1 -- 172.21.15.59:0/1250576845 learned_addr learned my addr 172.21.15.59:0/1250576845 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.016+0000 7fc8c2d9c700 1 -- 172.21.15.59:0/1250576845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c447a0 msgr2=0x55ce04c4c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.016+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/1250576845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c447a0 0x55ce04c4c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.016+0000 7fc8c2d9c700 1 -- 172.21.15.59:0/1250576845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 msgr2=0x55ce04c4f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.016+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/1250576845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c4f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.016+0000 7fc8c2d9c700 1 -- 172.21.15.59:0/1250576845 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc1a5ba0 con 0x55ce04c4f650 2023-10-08T12:52:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.016+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/1250576845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c4f650 0x55ce04c4cb30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009fd0 tx=0x7fc8b4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b59a5af47ebbe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.016+0000 7fc8a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:52:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.016+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/1250576845 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4020070 con 0x55ce04c4f650 2023-10-08T12:52:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.016+0000 7fc8d809db80 1 -- 172.21.15.59:0/1250576845 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce04b5feb0 con 0x55ce04c4f650 2023-10-08T12:52:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.016+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/1250576845 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fc8b4008020 con 0x55ce04c4f650 2023-10-08T12:52:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.017+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/1250576845 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8b400e040 con 0x55ce04c4f650 2023-10-08T12:52:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.017+0000 7fc8d809db80 10 client.27157 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.017+0000 7fc8d809db80 1 -- 172.21.15.59:0/1250576845 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55ce049abc60 con 0x55ce04c4f650 2023-10-08T12:52:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.017+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/1250576845 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ce04b5feb0 con 0x55ce04c4f650 2023-10-08T12:52:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.017+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/1250576845 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc8b401ab10 con 0x55ce04c4f650 2023-10-08T12:52:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.017+0000 7fc8d809db80 10 client.27157 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.017+0000 7fc8d809db80 10 client.27157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.017+0000 7fc8d809db80 20 client.27157 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.017+0000 7fc8d809db80 1 --2- 172.21.15.59:0/1250576845 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce04c5f200 0x55ce04c61620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.017+0000 7fc8d809db80 4 client.27157 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:53.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.017+0000 7fc8d809db80 1 -- 172.21.15.59:0/1250576845 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce04b90e10 con 0x55ce04c5f200 2023-10-08T12:52:53.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.018+0000 7fc8c259b700 1 --2- 172.21.15.59:0/1250576845 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce04c5f200 0x55ce04c61620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.018+0000 7fc8c259b700 1 --2- 172.21.15.59:0/1250576845 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce04c5f200 0x55ce04c61620 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50bdfd720f9df25f server_cookie=51b62d6557e56a41 in_seq=0 out_seq=0 2023-10-08T12:52:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.018+0000 7fc8a5ffb700 10 client.27157 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/1250576845 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ce04b90e10 con 0x55ce04c5f200 2023-10-08T12:52:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8a5ffb700 10 client.27157 handle_command_reply: tid=0 2023-10-08T12:52:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8d809db80 1 client.27157 shutdown 2023-10-08T12:52:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8d809db80 1 -- 172.21.15.59:0/1250576845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c4f650 msgr2=0x55ce04c4cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8d809db80 1 --2- 172.21.15.59:0/1250576845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c4f650 0x55ce04c4cb30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009fd0 tx=0x7fc8b4004b40 comp rx=0 tx=0).stop 2023-10-08T12:52:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8d809db80 1 -- 172.21.15.59:0/1250576845 shutdown_connections 2023-10-08T12:52:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8d809db80 1 --2- 172.21.15.59:0/1250576845 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce04c5f200 0x55ce04c61620 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8d809db80 1 --2- 172.21.15.59:0/1250576845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c4f650 0x55ce04c4cb30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8a5ffb700 0 client.27157 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8d809db80 1 --2- 172.21.15.59:0/1250576845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c4f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8d809db80 1 --2- 172.21.15.59:0/1250576845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c447a0 0x55ce04c4c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8d809db80 1 -- 172.21.15.59:0/1250576845 >> 172.21.15.59:0/1250576845 conn(0x55ce04bb9260 msgr2=0x55ce04c3fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8d809db80 1 -- 172.21.15.59:0/1250576845 shutdown_connections 2023-10-08T12:52:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.020+0000 7fc8d809db80 1 -- 172.21.15.59:0/1250576845 wait complete. 2023-10-08T12:52:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.021+0000 7fc8d809db80 20 client.27157 trim_cache size 0 max 16384 2023-10-08T12:52:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8d809db80 1 Processor -- start 2023-10-08T12:52:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8d809db80 1 -- start start 2023-10-08T12:52:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 0x55ce04c46450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04c46990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8d809db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04a18920 con 0x55ce04c43e80 2023-10-08T12:52:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8d809db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04c47220 con 0x55ce04c4f650 2023-10-08T12:52:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8d809db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04c566e0 con 0x55ce04c447a0 2023-10-08T12:52:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8c2d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04c46990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8c2d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04c46990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50552/0 (socket says 172.21.15.59:50552) 2023-10-08T12:52:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8c2d9c700 1 -- 172.21.15.59:0/2973540047 learned_addr learned my addr 172.21.15.59:0/2973540047 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8c1d9a700 1 --2- 172.21.15.59:0/2973540047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 0x55ce04c46450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.040+0000 7fc8c259b700 1 --2- 172.21.15.59:0/2973540047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.041+0000 7fc8c2d9c700 1 -- 172.21.15.59:0/2973540047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 msgr2=0x55ce04c46450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.041+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/2973540047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 0x55ce04c46450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.041+0000 7fc8c2d9c700 1 -- 172.21.15.59:0/2973540047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 msgr2=0x55ce04c561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.041+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/2973540047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.041+0000 7fc8c2d9c700 1 -- 172.21.15.59:0/2973540047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce049e9250 con 0x55ce04c4f650 2023-10-08T12:52:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.041+0000 7fc8c259b700 1 --2- 172.21.15.59:0/2973540047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.041+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/2973540047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04c46990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4000f80 tx=0x7fc8b4004080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32b4a38f97ea6d4a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.041+0000 7fc8b17fa700 1 -- 172.21.15.59:0/2973540047 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4020040 con 0x55ce04c4f650 2023-10-08T12:52:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.041+0000 7fc8b17fa700 1 -- 172.21.15.59:0/2973540047 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8b400f040 con 0x55ce04c4f650 2023-10-08T12:52:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.041+0000 7fc8b17fa700 1 -- 172.21.15.59:0/2973540047 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400e040 con 0x55ce04c4f650 2023-10-08T12:52:53.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.042+0000 7fc8d809db80 1 -- 172.21.15.59:0/2973540047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 msgr2=0x55ce04c46990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.042+0000 7fc8d809db80 1 --2- 172.21.15.59:0/2973540047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04c46990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4000f80 tx=0x7fc8b4004080 comp rx=0 tx=0).stop 2023-10-08T12:52:53.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.042+0000 7fc8d809db80 1 -- 172.21.15.59:0/2973540047 shutdown_connections 2023-10-08T12:52:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.042+0000 7fc8d809db80 1 --2- 172.21.15.59:0/2973540047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04c46990 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.042+0000 7fc8d809db80 1 --2- 172.21.15.59:0/2973540047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c43e80 0x55ce04c561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.042+0000 7fc8d809db80 1 --2- 172.21.15.59:0/2973540047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c447a0 0x55ce04c46450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.042+0000 7fc8d809db80 1 -- 172.21.15.59:0/2973540047 >> 172.21.15.59:0/2973540047 conn(0x55ce04bb9260 msgr2=0x55ce04c45d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.042+0000 7fc8d809db80 1 -- 172.21.15.59:0/2973540047 shutdown_connections 2023-10-08T12:52:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.042+0000 7fc8d809db80 1 -- 172.21.15.59:0/2973540047 wait complete. 2023-10-08T12:52:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.043+0000 7fc8d809db80 1 -- start start 2023-10-08T12:52:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.043+0000 7fc8d809db80 1 Processor -- start 2023-10-08T12:52:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.043+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c43e80 0x55ce04c55400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.043+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c447a0 0x55ce04c55940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.043+0000 7fc8d809db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04cac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.043+0000 7fc8d809db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04cac790 con 0x55ce04c447a0 2023-10-08T12:52:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.043+0000 7fc8d809db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04cac900 con 0x55ce04c4f650 2023-10-08T12:52:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.043+0000 7fc8d809db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce04cacac0 con 0x55ce04c43e80 2023-10-08T12:52:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.043+0000 7fc8d809db80 10 client.0 _ll_register_callbacks cb 0x7fc8b40085b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8c2d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04cac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8c1d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c447a0 0x55ce04c55940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8c2d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04cac1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50566/0 (socket says 172.21.15.59:50566) 2023-10-08T12:52:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8c2d9c700 1 -- 172.21.15.59:0/4260676269 learned_addr learned my addr 172.21.15.59:0/4260676269 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8c259b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c43e80 0x55ce04c55400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8c2d9c700 1 -- 172.21.15.59:0/4260676269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c43e80 msgr2=0x55ce04c55400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/4260676269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c43e80 0x55ce04c55400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8c2d9c700 1 -- 172.21.15.59:0/4260676269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c447a0 msgr2=0x55ce04c55940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/4260676269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c447a0 0x55ce04c55940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8c2d9c700 1 -- 172.21.15.59:0/4260676269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce049abc60 con 0x55ce04c4f650 2023-10-08T12:52:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8c2d9c700 1 --2- 172.21.15.59:0/4260676269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04cac1e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4004000 tx=0x7fc8b401bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee610c7291a654c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.044+0000 7fc8a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/4260676269 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4020040 con 0x55ce04c4f650 2023-10-08T12:52:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/4260676269 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fc8b401a940 con 0x55ce04c4f650 2023-10-08T12:52:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8d809db80 1 -- 172.21.15.59:0/4260676269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8ac09e3f0 con 0x55ce04c4f650 2023-10-08T12:52:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/4260676269 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8b4006000 con 0x55ce04c4f650 2023-10-08T12:52:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8d809db80 10 client.27173 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8d809db80 1 -- 172.21.15.59:0/4260676269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55ce049c12b0 con 0x55ce04c4f650 2023-10-08T12:52:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/4260676269 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8ac09e3f0 con 0x55ce04c4f650 2023-10-08T12:52:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/4260676269 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc8b4004490 con 0x55ce04c4f650 2023-10-08T12:52:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8d809db80 10 client.27173 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8d809db80 10 client.27173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8d809db80 20 client.27173 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8d809db80 1 --2- 172.21.15.59:0/4260676269 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce04cb5200 0x55ce04cb75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8d809db80 4 client.27173 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:52:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.045+0000 7fc8d809db80 1 -- 172.21.15.59:0/4260676269 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ce04b90b30 con 0x55ce04cb5200 2023-10-08T12:52:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.046+0000 7fc8c259b700 1 --2- 172.21.15.59:0/4260676269 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce04cb5200 0x55ce04cb75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.046+0000 7fc8a5ffb700 10 client.27173 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.046+0000 7fc8c259b700 1 --2- 172.21.15.59:0/4260676269 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce04cb5200 0x55ce04cb75f0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1fead8fc672a5fd server_cookie=eca8698e96b63394 in_seq=0 out_seq=0 2023-10-08T12:52:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.046+0000 7fc8a5ffb700 1 -- 172.21.15.59:0/4260676269 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ce04b90b30 con 0x55ce04cb5200 2023-10-08T12:52:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.046+0000 7fc8a5ffb700 10 client.27173 handle_command_reply: tid=0 2023-10-08T12:52:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.046+0000 7fc8d809db80 1 client.27173 shutdown 2023-10-08T12:52:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.046+0000 7fc8d809db80 1 -- 172.21.15.59:0/4260676269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 msgr2=0x55ce04cac1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.046+0000 7fc8d809db80 1 --2- 172.21.15.59:0/4260676269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04cac1e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4004000 tx=0x7fc8b401bf00 comp rx=0 tx=0).stop 2023-10-08T12:52:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8d809db80 1 -- 172.21.15.59:0/4260676269 shutdown_connections 2023-10-08T12:52:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8d809db80 1 --2- 172.21.15.59:0/4260676269 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ce04cb5200 0x55ce04cb75f0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8d809db80 1 --2- 172.21.15.59:0/4260676269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce04c4f650 0x55ce04cac1e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8d809db80 1 --2- 172.21.15.59:0/4260676269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce04c43e80 0x55ce04c55400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8a5ffb700 0 client.27173 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8d809db80 1 --2- 172.21.15.59:0/4260676269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce04c447a0 0x55ce04c55940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8d809db80 1 -- 172.21.15.59:0/4260676269 >> 172.21.15.59:0/4260676269 conn(0x55ce04bb9260 msgr2=0x55ce04c465d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8d809db80 1 -- 172.21.15.59:0/4260676269 shutdown_connections 2023-10-08T12:52:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8d809db80 1 -- 172.21.15.59:0/4260676269 wait complete. 2023-10-08T12:52:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8d809db80 20 client.27173 trim_cache size 0 max 16384 2023-10-08T12:52:53.053 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:52:53.053 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:52:53.053 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:52:53.054 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:52:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8c47ff700 1 -- 172.21.15.59:0/649610379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8a80a15f0 msgr2=0x7fc8a80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8c47ff700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8a80a15f0 0x7fc8a80a3ab0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009550 tx=0x7fc8b400b040 comp rx=0 tx=0).stop 2023-10-08T12:52:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8c47ff700 1 -- 172.21.15.59:0/649610379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc073540 msgr2=0x7fc8bc199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.047+0000 7fc8c47ff700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc073540 0x7fc8bc199370 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00e9a0 tx=0x7fc8ac00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.048+0000 7fc8c47ff700 1 -- 172.21.15.59:0/649610379 shutdown_connections 2023-10-08T12:52:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.048+0000 7fc8c47ff700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8a80a15f0 0x7fc8a80a3ab0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.048+0000 7fc8c47ff700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8bc10cf70 0x7fc8bc19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.048+0000 7fc8c47ff700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8bc072c20 0x7fc8bc198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.048+0000 7fc8c47ff700 1 --2- 172.21.15.59:0/649610379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc073540 0x7fc8bc199370 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.048+0000 7fc8c47ff700 1 -- 172.21.15.59:0/649610379 >> 172.21.15.59:0/649610379 conn(0x7fc8bc0fc200 msgr2=0x7fc8bc0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.048+0000 7fc8c47ff700 1 -- 172.21.15.59:0/649610379 shutdown_connections 2023-10-08T12:52:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.048+0000 7fc8c47ff700 1 -- 172.21.15.59:0/649610379 wait complete. 2023-10-08T12:52:53.068 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:52:53.068 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:52:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.285+0000 7f9cf6dff700 1 -- 172.21.15.59:0/1717982106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0100ff0 msgr2=0x7f9cf010d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.285+0000 7f9cf6dff700 1 --2- 172.21.15.59:0/1717982106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0100ff0 0x7f9cf010d500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80098f0 tx=0x7f9ce8009c00 comp rx=0 tx=0).stop 2023-10-08T12:52:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.285+0000 7f9cf6dff700 1 -- 172.21.15.59:0/1717982106 shutdown_connections 2023-10-08T12:52:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.285+0000 7f9cf6dff700 1 --2- 172.21.15.59:0/1717982106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf0106640 0x7f9cf0106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.285+0000 7f9cf6dff700 1 --2- 172.21.15.59:0/1717982106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0100ff0 0x7f9cf010d500 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.285+0000 7f9cf6dff700 1 --2- 172.21.15.59:0/1717982106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf0100630 0x7f9cf0100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.285+0000 7f9cf6dff700 1 -- 172.21.15.59:0/1717982106 >> 172.21.15.59:0/1717982106 conn(0x7f9cf00fc140 msgr2=0x7f9cf00fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.285+0000 7f9cf6dff700 1 -- 172.21.15.59:0/1717982106 shutdown_connections 2023-10-08T12:52:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.285+0000 7f9cf6dff700 1 -- 172.21.15.59:0/1717982106 wait complete. 2023-10-08T12:52:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.286+0000 7f9cf6dff700 1 Processor -- start 2023-10-08T12:52:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.286+0000 7f9cf6dff700 1 -- start start 2023-10-08T12:52:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9cf6dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0100630 0x7f9cf019e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9cf6dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf0100ff0 0x7f9cf019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9cf6dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf0106640 0x7f9cf0198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9cf6dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf01995b0 con 0x7f9cf0106640 2023-10-08T12:52:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9cf6dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf0199720 con 0x7f9cf0100ff0 2023-10-08T12:52:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9cf6dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf01998e0 con 0x7f9cf0100630 2023-10-08T12:52:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9ceffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf0100ff0 0x7f9cf019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9cf4b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0100630 0x7f9cf019e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9ceffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf0100ff0 0x7f9cf019eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50594/0 (socket says 172.21.15.59:50594) 2023-10-08T12:52:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9ceffff700 1 -- 172.21.15.59:0/2996495389 learned_addr learned my addr 172.21.15.59:0/2996495389 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9cf4b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0100630 0x7f9cf019e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60610/0 (socket says 172.21.15.59:60610) 2023-10-08T12:52:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.287+0000 7f9cf539c700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf0106640 0x7f9cf0198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cf4b9b700 1 -- 172.21.15.59:0/2996495389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf0100ff0 msgr2=0x7f9cf019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cf4b9b700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf0100ff0 0x7f9cf019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cf4b9b700 1 -- 172.21.15.59:0/2996495389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf0106640 msgr2=0x7f9cf0198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cf4b9b700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf0106640 0x7f9cf0198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cf4b9b700 1 -- 172.21.15.59:0/2996495389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce8009520 con 0x7f9cf0100630 2023-10-08T12:52:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cf539c700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf0106640 0x7f9cf0198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cf4b9b700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0100630 0x7f9cf019e9b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400ef10 tx=0x7f9ce400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cedffb700 1 -- 172.21.15.59:0/2996495389 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce400c9c0 con 0x7f9cf0100630 2023-10-08T12:52:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cedffb700 1 -- 172.21.15.59:0/2996495389 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ce400f040 con 0x7f9cf0100630 2023-10-08T12:52:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cf6dff700 1 -- 172.21.15.59:0/2996495389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf0199b60 con 0x7f9cf0100630 2023-10-08T12:52:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cedffb700 1 -- 172.21.15.59:0/2996495389 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4014480 con 0x7f9cf0100630 2023-10-08T12:52:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.288+0000 7f9cf6dff700 1 -- 172.21.15.59:0/2996495389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf01a59a0 con 0x7f9cf0100630 2023-10-08T12:52:53.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.289+0000 7f9cf6dff700 1 -- 172.21.15.59:0/2996495389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf0101d70 con 0x7f9cf0100630 2023-10-08T12:52:53.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.291+0000 7f9cedffb700 1 -- 172.21.15.59:0/2996495389 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9ce400cb20 con 0x7f9cf0100630 2023-10-08T12:52:53.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.293+0000 7f9cedffb700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ce00a1670 0x7f9ce00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.293+0000 7f9cedffb700 1 -- 172.21.15.59:0/2996495389 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9ce40cd2c0 con 0x7f9cf0100630 2023-10-08T12:52:53.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.293+0000 7f9ceffff700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ce00a1670 0x7f9ce00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.294+0000 7f9ceffff700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ce00a1670 0x7f9ce00a3b30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9cf010d780 tx=0x7f9cdc009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.297+0000 7f9cedffb700 1 -- 172.21.15.59:0/2996495389 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9ce40965d0 con 0x7f9cf0100630 2023-10-08T12:52:53.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:53 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:52:53.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:53 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:53.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:53 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:52:53.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:53 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:53.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:53 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:52:53.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:53 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:52:53.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:53 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:53.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:53 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:52:53.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:53 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:53.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:53 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:52:53.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:53 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:52:53.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:53 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:53.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:53 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:52:53.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:53 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:53.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:53 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:52:53.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1483818 12.51 MB/sec execute 504 sec latency 101.810 ms 2023-10-08T12:52:53.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.581+0000 7f9cf6dff700 1 -- 172.21.15.59:0/2996495389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cf0067450 con 0x7f9cf0100630 2023-10-08T12:52:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.582+0000 7f9cedffb700 1 -- 172.21.15.59:0/2996495389 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f9ce4099bf0 con 0x7f9cf0100630 2023-10-08T12:52:53.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:52:53.582 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:52:53.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 -- 172.21.15.59:0/2996495389 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ce00a1670 msgr2=0x7f9ce00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ce00a1670 0x7f9ce00a3b30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9cf010d780 tx=0x7f9cdc009310 comp rx=0 tx=0).stop 2023-10-08T12:52:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 -- 172.21.15.59:0/2996495389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0100630 msgr2=0x7f9cf019e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0100630 0x7f9cf019e9b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400ef10 tx=0x7f9ce400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 -- 172.21.15.59:0/2996495389 shutdown_connections 2023-10-08T12:52:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9ce00a1670 0x7f9ce00a3b30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf0106640 0x7f9cf0198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0100630 0x7f9cf019e9b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 --2- 172.21.15.59:0/2996495389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf0100ff0 0x7f9cf019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 -- 172.21.15.59:0/2996495389 >> 172.21.15.59:0/2996495389 conn(0x7f9cf00fc140 msgr2=0x7f9cf00fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 -- 172.21.15.59:0/2996495389 shutdown_connections 2023-10-08T12:52:53.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.584+0000 7f9cf6dff700 1 -- 172.21.15.59:0/2996495389 wait complete. 2023-10-08T12:52:53.586 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:52:53.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:52:53.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.822+0000 7f6e6abff700 1 -- 172.21.15.59:0/2107595999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e640734c0 msgr2=0x7f6e6410cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.822+0000 7f6e6abff700 1 --2- 172.21.15.59:0/2107595999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e640734c0 0x7f6e6410cac0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009990 tx=0x7f6e54009ca0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.822+0000 7f6e6abff700 1 -- 172.21.15.59:0/2107595999 shutdown_connections 2023-10-08T12:52:53.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.822+0000 7f6e6abff700 1 --2- 172.21.15.59:0/2107595999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6410d000 0x7f6e6410f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.822+0000 7f6e6abff700 1 --2- 172.21.15.59:0/2107595999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e64072ba0 0x7f6e64072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.822+0000 7f6e6abff700 1 --2- 172.21.15.59:0/2107595999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e640734c0 0x7f6e6410cac0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.822+0000 7f6e6abff700 1 -- 172.21.15.59:0/2107595999 >> 172.21.15.59:0/2107595999 conn(0x7f6e640fc230 msgr2=0x7f6e640fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.822+0000 7f6e6abff700 1 -- 172.21.15.59:0/2107595999 shutdown_connections 2023-10-08T12:52:53.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.822+0000 7f6e6abff700 1 -- 172.21.15.59:0/2107595999 wait complete. 2023-10-08T12:52:53.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.824+0000 7f6e6abff700 1 Processor -- start 2023-10-08T12:52:53.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.824+0000 7f6e6abff700 1 -- start start 2023-10-08T12:52:53.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.824+0000 7f6e6abff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e64072ba0 0x7f6e64198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.824+0000 7f6e6abff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e640734c0 0x7f6e64199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e6abff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6410d000 0x7f6e6419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e6abff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6419dd40 con 0x7f6e6410d000 2023-10-08T12:52:53.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e6abff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6419deb0 con 0x7f6e640734c0 2023-10-08T12:52:53.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e6abff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6419e070 con 0x7f6e64072ba0 2023-10-08T12:52:53.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e5bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e640734c0 0x7f6e64199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e6899b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e64072ba0 0x7f6e64198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e5bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e640734c0 0x7f6e64199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50610/0 (socket says 172.21.15.59:50610) 2023-10-08T12:52:53.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e6919c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6410d000 0x7f6e6419d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e5bfff700 1 -- 172.21.15.59:0/746735892 learned_addr learned my addr 172.21.15.59:0/746735892 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:53.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e5bfff700 1 -- 172.21.15.59:0/746735892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e64072ba0 msgr2=0x7f6e64198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e64072ba0 0x7f6e64198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e5bfff700 1 -- 172.21.15.59:0/746735892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6410d000 msgr2=0x7f6e6419d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6410d000 0x7f6e6419d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e5bfff700 1 -- 172.21.15.59:0/746735892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e540095f0 con 0x7f6e640734c0 2023-10-08T12:52:53.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e6899b700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e64072ba0 0x7f6e64198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:53.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e6919c700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6410d000 0x7f6e6419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:53.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.825+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e640734c0 0x7f6e64199360 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6e54000c00 tx=0x7f6e54005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.826+0000 7f6e59ffb700 1 -- 172.21.15.59:0/746735892 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5401d070 con 0x7f6e640734c0 2023-10-08T12:52:53.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.826+0000 7f6e59ffb700 1 -- 172.21.15.59:0/746735892 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e54022470 con 0x7f6e640734c0 2023-10-08T12:52:53.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.826+0000 7f6e59ffb700 1 -- 172.21.15.59:0/746735892 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54017650 con 0x7f6e640734c0 2023-10-08T12:52:53.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.826+0000 7f6e6abff700 1 -- 172.21.15.59:0/746735892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6419e2f0 con 0x7f6e640734c0 2023-10-08T12:52:53.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.826+0000 7f6e6abff700 1 -- 172.21.15.59:0/746735892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6419e570 con 0x7f6e640734c0 2023-10-08T12:52:53.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.830+0000 7f6e59ffb700 1 -- 172.21.15.59:0/746735892 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6e540225e0 con 0x7f6e640734c0 2023-10-08T12:52:53.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.831+0000 7f6e7e433b80 1 Processor -- start 2023-10-08T12:52:53.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.831+0000 7f6e7e433b80 1 -- start start 2023-10-08T12:52:53.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.831+0000 7f6e59ffb700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6e4c0a1670 0x7f6e4c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.831+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478ba2e80 0x559478ba3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.831+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba37a0 0x559478bae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478bae650 0x559478bb0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e59ffb700 1 -- 172.21.15.59:0/746735892 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f6e540ce230 con 0x7f6e640734c0 2023-10-08T12:52:53.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478b0c460 con 0x559478ba2e80 2023-10-08T12:52:53.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478afdc20 con 0x559478bae650 2023-10-08T12:52:53.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478afb540 con 0x559478ba37a0 2023-10-08T12:52:53.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e6919c700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6e4c0a1670 0x7f6e4c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e6899b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478ba2e80 0x559478ba3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e6919c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478bae650 0x559478bb0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e6899b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478ba2e80 0x559478ba3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46682/0 (socket says 172.21.15.59:46682) 2023-10-08T12:52:53.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e6899b700 1 -- 172.21.15.59:0/931848473 learned_addr learned my addr 172.21.15.59:0/931848473 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:53.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/931848473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba37a0 0x559478bae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e6899b700 1 -- 172.21.15.59:0/931848473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba37a0 msgr2=0x559478bae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e6899b700 1 --2- 172.21.15.59:0/931848473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba37a0 0x559478bae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e6899b700 1 -- 172.21.15.59:0/931848473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478bae650 msgr2=0x559478bb0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e6899b700 1 --2- 172.21.15.59:0/931848473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478bae650 0x559478bb0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.832+0000 7f6e6899b700 1 -- 172.21.15.59:0/931848473 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559478921de0 con 0x559478ba2e80 2023-10-08T12:52:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.833+0000 7f6e6919c700 1 --2- 172.21.15.59:0/931848473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478bae650 0x559478bb0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.833+0000 7f6e6919c700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6e4c0a1670 0x7f6e4c0a3b30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009710 tx=0x7f6e5c007580 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.833+0000 7f6e6899b700 1 --2- 172.21.15.59:0/931848473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478ba2e80 0x559478ba3260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6e600115f0 tx=0x7f6e60011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3be5030582200c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.834+0000 7f6e4affd700 1 -- 172.21.15.59:0/931848473 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60019630 con 0x559478ba2e80 2023-10-08T12:52:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.834+0000 7f6e4affd700 1 -- 172.21.15.59:0/931848473 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e60019c50 con 0x559478ba2e80 2023-10-08T12:52:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.834+0000 7f6e4affd700 1 -- 172.21.15.59:0/931848473 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000ec80 con 0x559478ba2e80 2023-10-08T12:52:53.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.835+0000 7f6e7e433b80 1 -- 172.21.15.59:0/931848473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478ba2e80 msgr2=0x559478ba3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.835+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/931848473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478ba2e80 0x559478ba3260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6e600115f0 tx=0x7f6e60011900 comp rx=0 tx=0).stop 2023-10-08T12:52:53.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.835+0000 7f6e7e433b80 1 -- 172.21.15.59:0/931848473 shutdown_connections 2023-10-08T12:52:53.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.835+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/931848473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478bae650 0x559478bb0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.835+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/931848473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478ba2e80 0x559478ba3260 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.835+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/931848473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba37a0 0x559478bae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.835+0000 7f6e7e433b80 1 -- 172.21.15.59:0/931848473 >> 172.21.15.59:0/931848473 conn(0x559478b18260 msgr2=0x559478b9f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.835+0000 7f6e7e433b80 1 -- 172.21.15.59:0/931848473 shutdown_connections 2023-10-08T12:52:53.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.836+0000 7f6e7e433b80 1 -- 172.21.15.59:0/931848473 wait complete. 2023-10-08T12:52:53.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.836+0000 7f6e7e433b80 1 -- start start 2023-10-08T12:52:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.837+0000 7f6e7e433b80 1 Processor -- start 2023-10-08T12:52:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.837+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.837+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bab320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.837+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478baba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.837+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478af6e30 con 0x559478bae650 2023-10-08T12:52:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.837+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478a93710 con 0x559478ba37a0 2023-10-08T12:52:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.837+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478a933b0 con 0x559478ba2e80 2023-10-08T12:52:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.837+0000 7f6e7e433b80 10 client.0 _ll_register_callbacks cb 0x5594788f0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e5bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e6899b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e5bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bab320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50632/0 (socket says 172.21.15.59:50632) 2023-10-08T12:52:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e5bfff700 1 -- 172.21.15.59:0/2457758074 learned_addr learned my addr 172.21.15.59:0/2457758074 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e6899b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60630/0 (socket says 172.21.15.59:60630) 2023-10-08T12:52:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e6919c700 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478baba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e5bfff700 1 -- 172.21.15.59:0/2457758074 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 msgr2=0x559478bae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e5bfff700 1 -- 172.21.15.59:0/2457758074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 msgr2=0x559478baba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478baba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e5bfff700 1 -- 172.21.15.59:0/2457758074 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c011040 con 0x559478ba37a0 2023-10-08T12:52:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e6919c700 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478baba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bab320 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6e54097d00 tx=0x7f6e5409ac60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87423380797ffaee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.838+0000 7f6e43fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e43fff700 1 -- 172.21.15.59:0/2457758074 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540ce070 con 0x559478ba37a0 2023-10-08T12:52:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e43fff700 1 -- 172.21.15.59:0/2457758074 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f6e5409b290 con 0x559478ba37a0 2023-10-08T12:52:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2457758074 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559478abeeb0 con 0x559478ba37a0 2023-10-08T12:52:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e43fff700 1 -- 172.21.15.59:0/2457758074 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e54095ea0 con 0x559478ba37a0 2023-10-08T12:52:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e7e433b80 10 client.27191 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2457758074 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f6e60009dd0 con 0x559478ba37a0 2023-10-08T12:52:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e43fff700 1 -- 172.21.15.59:0/2457758074 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559478abeeb0 con 0x559478ba37a0 2023-10-08T12:52:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e43fff700 1 -- 172.21.15.59:0/2457758074 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e5409a780 con 0x559478ba37a0 2023-10-08T12:52:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e7e433b80 10 client.27191 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e7e433b80 10 client.27191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e7e433b80 20 client.27191 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559478bbdf10 0x559478bc0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e7e433b80 4 client.27191 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.839+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2457758074 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559478aefe10 con 0x559478bbdf10 2023-10-08T12:52:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.840+0000 7f6e6899b700 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559478bbdf10 0x559478bc0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.840+0000 7f6e6899b700 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559478bbdf10 0x559478bc0330 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69e2e619b75744ba server_cookie=6d4ed5fb704b4591 in_seq=0 out_seq=0 2023-10-08T12:52:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.840+0000 7f6e43fff700 10 client.27191 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:53.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.841+0000 7f6e43fff700 1 -- 172.21.15.59:0/2457758074 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559478aefe10 con 0x559478bbdf10 2023-10-08T12:52:53.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.841+0000 7f6e43fff700 10 client.27191 handle_command_reply: tid=0 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.841+0000 7f6e7e433b80 1 client.27191 shutdown 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2457758074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 msgr2=0x559478bab320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bab320 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6e54097d00 tx=0x7f6e5409ac60 comp rx=0 tx=0).stop 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2457758074 shutdown_connections 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559478bbdf10 0x559478bc0330 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478baba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/2457758074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bab320 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2457758074 >> 172.21.15.59:0/2457758074 conn(0x559478b18260 msgr2=0x559478b9eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e43fff700 0 client.27191 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2457758074 shutdown_connections 2023-10-08T12:52:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2457758074 wait complete. 2023-10-08T12:52:53.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.842+0000 7f6e7e433b80 20 client.27191 trim_cache size 0 max 16384 2023-10-08T12:52:53.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.856+0000 7f6e7e433b80 1 Processor -- start 2023-10-08T12:52:53.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.856+0000 7f6e7e433b80 1 -- start start 2023-10-08T12:52:53.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bb51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478b9e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478977920 con 0x559478bae650 2023-10-08T12:52:53.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478bac990 con 0x559478ba37a0 2023-10-08T12:52:53.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478ba49c0 con 0x559478ba2e80 2023-10-08T12:52:53.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e5bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bb51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e6919c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478b9e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e6899b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e6919c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478b9e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46708/0 (socket says 172.21.15.59:46708) 2023-10-08T12:52:53.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e6919c700 1 -- 172.21.15.59:0/2395299720 learned_addr learned my addr 172.21.15.59:0/2395299720 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:53.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.857+0000 7f6e6899b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60640/0 (socket says 172.21.15.59:60640) 2023-10-08T12:52:53.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.858+0000 7f6e5bfff700 1 -- 172.21.15.59:0/2395299720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 msgr2=0x559478bab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.858+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/2395299720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.858+0000 7f6e5bfff700 1 -- 172.21.15.59:0/2395299720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 msgr2=0x559478b9e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.858+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/2395299720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478b9e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.858+0000 7f6e5bfff700 1 -- 172.21.15.59:0/2395299720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55947890ac60 con 0x559478ba37a0 2023-10-08T12:52:53.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.858+0000 7f6e6899b700 1 --2- 172.21.15.59:0/2395299720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:53.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.858+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/2395299720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bb51a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6e5409af90 tx=0x7f6e54005860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2b46bf03b66ada4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.858+0000 7f6e4b7fe700 1 -- 172.21.15.59:0/2395299720 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54095ea0 con 0x559478ba37a0 2023-10-08T12:52:53.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.858+0000 7f6e4b7fe700 1 -- 172.21.15.59:0/2395299720 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e5409b290 con 0x559478ba37a0 2023-10-08T12:52:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.858+0000 7f6e4b7fe700 1 -- 172.21.15.59:0/2395299720 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540ce040 con 0x559478ba37a0 2023-10-08T12:52:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.859+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2395299720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 msgr2=0x559478bb51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.859+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/2395299720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bb51a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6e5409af90 tx=0x7f6e54005860 comp rx=0 tx=0).stop 2023-10-08T12:52:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.859+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2395299720 shutdown_connections 2023-10-08T12:52:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.859+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/2395299720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478b9e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.859+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/2395299720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.859+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/2395299720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bb51a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.859+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2395299720 >> 172.21.15.59:0/2395299720 conn(0x559478b18260 msgr2=0x559478b9af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.859+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2395299720 shutdown_connections 2023-10-08T12:52:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.859+0000 7f6e7e433b80 1 -- 172.21.15.59:0/2395299720 wait complete. 2023-10-08T12:52:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.859+0000 7f6e7e433b80 1 -- start start 2023-10-08T12:52:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.860+0000 7f6e7e433b80 1 Processor -- start 2023-10-08T12:52:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.860+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bb2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.860+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bb3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.860+0000 7f6e7e433b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478bb3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.860+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478c10ec0 con 0x559478bae650 2023-10-08T12:52:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.860+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478c11030 con 0x559478ba37a0 2023-10-08T12:52:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.860+0000 7f6e7e433b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559478c111f0 con 0x559478ba2e80 2023-10-08T12:52:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.860+0000 7f6e7e433b80 10 client.0 _ll_register_callbacks cb 0x7f6e5409b060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.860+0000 7f6e5bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bb3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.860+0000 7f6e5bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bb3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50638/0 (socket says 172.21.15.59:50638) 2023-10-08T12:52:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.860+0000 7f6e5bfff700 1 -- 172.21.15.59:0/896481886 learned_addr learned my addr 172.21.15.59:0/896481886 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:53.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e6919c700 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478bb3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e6899b700 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bb2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e5bfff700 1 -- 172.21.15.59:0/896481886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 msgr2=0x559478bb2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bb2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e5bfff700 1 -- 172.21.15.59:0/896481886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 msgr2=0x559478bb3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:53.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478bb3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e5bfff700 1 -- 172.21.15.59:0/896481886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559478921de0 con 0x559478ba37a0 2023-10-08T12:52:53.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e6919c700 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478bb3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:53.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e5bfff700 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bb3120 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6e540098e0 tx=0x7f6e5409abf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10c72702c28822bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e43fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e43fff700 1 -- 172.21.15.59:0/896481886 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54095ea0 con 0x559478ba37a0 2023-10-08T12:52:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e7e433b80 1 -- 172.21.15.59:0/896481886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e60019c50 con 0x559478ba37a0 2023-10-08T12:52:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.861+0000 7f6e43fff700 1 -- 172.21.15.59:0/896481886 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f6e5409f3e0 con 0x559478ba37a0 2023-10-08T12:52:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e43fff700 1 -- 172.21.15.59:0/896481886 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e540ce040 con 0x559478ba37a0 2023-10-08T12:52:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e7e433b80 10 client.27197 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e7e433b80 1 -- 172.21.15.59:0/896481886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f6e60009dd0 con 0x559478ba37a0 2023-10-08T12:52:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e43fff700 1 -- 172.21.15.59:0/896481886 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e60019c50 con 0x559478ba37a0 2023-10-08T12:52:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e43fff700 1 -- 172.21.15.59:0/896481886 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e5409a1f0 con 0x559478ba37a0 2023-10-08T12:52:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e7e433b80 10 client.27197 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e7e433b80 10 client.27197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e7e433b80 20 client.27197 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559478c12510 0x559478c14900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e7e433b80 4 client.27197 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e7e433b80 1 -- 172.21.15.59:0/896481886 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559478aefb30 con 0x559478c12510 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.862+0000 7f6e6899b700 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559478c12510 0x559478c14900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e6899b700 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559478c12510 0x559478c14900 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b22fbc57ef49e24 server_cookie=6ac4071b2c4e9490 in_seq=0 out_seq=0 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e43fff700 10 client.27197 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e43fff700 1 -- 172.21.15.59:0/896481886 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559478aefb30 con 0x559478c12510 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e43fff700 10 client.27197 handle_command_reply: tid=0 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e7e433b80 1 client.27197 shutdown 2023-10-08T12:52:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e7e433b80 1 -- 172.21.15.59:0/896481886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 msgr2=0x559478bb3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bb3120 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6e540098e0 tx=0x7f6e5409abf0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e7e433b80 1 -- 172.21.15.59:0/896481886 shutdown_connections 2023-10-08T12:52:53.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x559478c12510 0x559478c14900 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559478bae650 0x559478bb3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e43fff700 0 client.27197 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:53.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559478ba2e80 0x559478bb2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e7e433b80 1 --2- 172.21.15.59:0/896481886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559478ba37a0 0x559478bb3120 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e7e433b80 1 -- 172.21.15.59:0/896481886 >> 172.21.15.59:0/896481886 conn(0x559478b18260 msgr2=0x559478b9e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e7e433b80 1 -- 172.21.15.59:0/896481886 shutdown_connections 2023-10-08T12:52:53.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.863+0000 7f6e7e433b80 1 -- 172.21.15.59:0/896481886 wait complete. 2023-10-08T12:52:53.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e7e433b80 20 client.27197 trim_cache size 0 max 16384 2023-10-08T12:52:53.870 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:52:53.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 -- 172.21.15.59:0/746735892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6e4c0a1670 msgr2=0x7f6e4c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6e4c0a1670 0x7f6e4c0a3b30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009710 tx=0x7f6e5c007580 comp rx=0 tx=0).stop 2023-10-08T12:52:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 -- 172.21.15.59:0/746735892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e640734c0 msgr2=0x7f6e64199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e640734c0 0x7f6e64199360 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6e54000c00 tx=0x7f6e54005740 comp rx=0 tx=0).stop 2023-10-08T12:52:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 -- 172.21.15.59:0/746735892 shutdown_connections 2023-10-08T12:52:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6e4c0a1670 0x7f6e4c0a3b30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6410d000 0x7f6e6419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e64072ba0 0x7f6e64198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 --2- 172.21.15.59:0/746735892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e640734c0 0x7f6e64199360 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 -- 172.21.15.59:0/746735892 >> 172.21.15.59:0/746735892 conn(0x7f6e640fc230 msgr2=0x7f6e640fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:53.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 -- 172.21.15.59:0/746735892 shutdown_connections 2023-10-08T12:52:53.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:53.864+0000 7f6e6abff700 1 -- 172.21.15.59:0/746735892 wait complete. 2023-10-08T12:52:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:54 smithi059 ceph-mon[98489]: pgmap v675: 97 pgs: 97 active+clean; 653 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 259 op/s 2023-10-08T12:52:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:54 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2996495389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:54 smithi092 ceph-mon[134093]: pgmap v675: 97 pgs: 97 active+clean; 653 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 259 op/s 2023-10-08T12:52:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:54 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2996495389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:54.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:54 smithi173 ceph-mon[135182]: pgmap v675: 97 pgs: 97 active+clean; 653 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 259 op/s 2023-10-08T12:52:54.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:54 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2996495389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:52:54.546 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1485842 12.51 MB/sec execute 505 sec latency 13.537 ms 2023-10-08T12:52:54.883 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:52:54.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:52:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.103+0000 7f09697ff700 1 -- 172.21.15.59:0/3179437938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0964100740 msgr2=0x7f0964100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.103+0000 7f09697ff700 1 --2- 172.21.15.59:0/3179437938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0964100740 0x7f0964100bc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0958009990 tx=0x7f0958009ca0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.103+0000 7f09697ff700 1 -- 172.21.15.59:0/3179437938 shutdown_connections 2023-10-08T12:52:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.103+0000 7f09697ff700 1 --2- 172.21.15.59:0/3179437938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0964101100 0x7f096410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.103+0000 7f09697ff700 1 --2- 172.21.15.59:0/3179437938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0964106750 0x7f0964106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.103+0000 7f09697ff700 1 --2- 172.21.15.59:0/3179437938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0964100740 0x7f0964100bc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.103+0000 7f09697ff700 1 -- 172.21.15.59:0/3179437938 >> 172.21.15.59:0/3179437938 conn(0x7f09640fc230 msgr2=0x7f09640fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.104+0000 7f09697ff700 1 -- 172.21.15.59:0/3179437938 shutdown_connections 2023-10-08T12:52:55.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.104+0000 7f09697ff700 1 -- 172.21.15.59:0/3179437938 wait complete. 2023-10-08T12:52:55.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f09697ff700 1 Processor -- start 2023-10-08T12:52:55.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f09697ff700 1 -- start start 2023-10-08T12:52:55.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f09697ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0964100740 0x7f0964072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f09697ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0964101100 0x7f0964073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f09697ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0964106750 0x7f0964073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f09697ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09641a4f30 con 0x7f0964106750 2023-10-08T12:52:55.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f09697ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09641a50a0 con 0x7f0964100740 2023-10-08T12:52:55.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f09697ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09641a5260 con 0x7f0964101100 2023-10-08T12:52:55.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f0962ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0964100740 0x7f0964072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f0962ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0964100740 0x7f0964072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50670/0 (socket says 172.21.15.59:50670) 2023-10-08T12:52:55.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f09627fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0964101100 0x7f0964073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f0962ffd700 1 -- 172.21.15.59:0/2641283635 learned_addr learned my addr 172.21.15.59:0/2641283635 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:55.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.105+0000 7f09637fe700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0964106750 0x7f0964073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.106+0000 7f0962ffd700 1 -- 172.21.15.59:0/2641283635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0964101100 msgr2=0x7f0964073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.106+0000 7f0962ffd700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0964101100 0x7f0964073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.106+0000 7f0962ffd700 1 -- 172.21.15.59:0/2641283635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0964106750 msgr2=0x7f0964073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.106+0000 7f0962ffd700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0964106750 0x7f0964073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.106+0000 7f0962ffd700 1 -- 172.21.15.59:0/2641283635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580095f0 con 0x7f0964100740 2023-10-08T12:52:55.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.106+0000 7f09627fc700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0964101100 0x7f0964073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:55.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.106+0000 7f0962ffd700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0964100740 0x7f0964072af0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f095400d980 tx=0x7f095400dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.106+0000 7f094bfff700 1 -- 172.21.15.59:0/2641283635 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954004220 con 0x7f0964100740 2023-10-08T12:52:55.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.106+0000 7f09697ff700 1 -- 172.21.15.59:0/2641283635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09641a5540 con 0x7f0964100740 2023-10-08T12:52:55.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.106+0000 7f094bfff700 1 -- 172.21.15.59:0/2641283635 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0954007640 con 0x7f0964100740 2023-10-08T12:52:55.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.107+0000 7f094bfff700 1 -- 172.21.15.59:0/2641283635 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954005690 con 0x7f0964100740 2023-10-08T12:52:55.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.107+0000 7f09697ff700 1 -- 172.21.15.59:0/2641283635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09641a5aa0 con 0x7f0964100740 2023-10-08T12:52:55.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.111+0000 7f094bfff700 1 -- 172.21.15.59:0/2641283635 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0954004750 con 0x7f0964100740 2023-10-08T12:52:55.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.111+0000 7f097d16ab80 1 Processor -- start 2023-10-08T12:52:55.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f097d16ab80 1 -- start start 2023-10-08T12:52:55.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a58f00 0x558313a592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 0x558313a64190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a646d0 0x558313a66ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f097d16ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583139c24e0 con 0x558313a646d0 2023-10-08T12:52:55.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f097d16ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583139b3ca0 con 0x558313a58f00 2023-10-08T12:52:55.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f097d16ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583139b15c0 con 0x558313a59820 2023-10-08T12:52:55.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f09637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a58f00 0x558313a592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f0962ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 0x558313a64190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f09627fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a646d0 0x558313a66ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f09637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a58f00 0x558313a592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50680/0 (socket says 172.21.15.59:50680) 2023-10-08T12:52:55.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.112+0000 7f09637fe700 1 -- 172.21.15.59:0/922248243 learned_addr learned my addr 172.21.15.59:0/922248243 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:55.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.113+0000 7f094bfff700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f094c0a1670 0x7f094c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.113+0000 7f09637fe700 1 -- 172.21.15.59:0/922248243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 msgr2=0x558313a64190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.113+0000 7f09637fe700 1 --2- 172.21.15.59:0/922248243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 0x558313a64190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.113+0000 7f09637fe700 1 -- 172.21.15.59:0/922248243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a646d0 msgr2=0x558313a66ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.113+0000 7f09637fe700 1 --2- 172.21.15.59:0/922248243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a646d0 0x558313a66ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.113+0000 7f09637fe700 1 -- 172.21.15.59:0/922248243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583137d7e60 con 0x558313a58f00 2023-10-08T12:52:55.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.113+0000 7f094bfff700 1 -- 172.21.15.59:0/2641283635 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f09540ccdb0 con 0x7f0964100740 2023-10-08T12:52:55.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.113+0000 7f09637fe700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f094c0a1670 0x7f094c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.113+0000 7f09637fe700 1 --2- 172.21.15.59:0/922248243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a58f00 0x558313a592e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f095c0116b0 tx=0x7f095c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3166c63fdf28c479 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.113+0000 7f09497fa700 1 -- 172.21.15.59:0/922248243 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c00e040 con 0x558313a58f00 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.114+0000 7f09497fa700 1 -- 172.21.15.59:0/922248243 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f095c00f040 con 0x558313a58f00 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.114+0000 7f09497fa700 1 -- 172.21.15.59:0/922248243 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c015830 con 0x558313a58f00 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.114+0000 7f097d16ab80 1 -- 172.21.15.59:0/922248243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a58f00 msgr2=0x558313a592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.114+0000 7f09637fe700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f094c0a1670 0x7f094c0a3b30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f095c020000 tx=0x7f095c023000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.114+0000 7f097d16ab80 1 --2- 172.21.15.59:0/922248243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a58f00 0x558313a592e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f095c0116b0 tx=0x7f095c009920 comp rx=0 tx=0).stop 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.114+0000 7f097d16ab80 1 -- 172.21.15.59:0/922248243 shutdown_connections 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.114+0000 7f097d16ab80 1 --2- 172.21.15.59:0/922248243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a58f00 0x558313a592e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.114+0000 7f097d16ab80 1 --2- 172.21.15.59:0/922248243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a646d0 0x558313a66ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.114+0000 7f097d16ab80 1 --2- 172.21.15.59:0/922248243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 0x558313a64190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.114+0000 7f097d16ab80 1 -- 172.21.15.59:0/922248243 >> 172.21.15.59:0/922248243 conn(0x5583139ce2e0 msgr2=0x558313a55350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.115+0000 7f097d16ab80 1 -- 172.21.15.59:0/922248243 shutdown_connections 2023-10-08T12:52:55.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.115+0000 7f097d16ab80 1 -- 172.21.15.59:0/922248243 wait complete. 2023-10-08T12:52:55.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.115+0000 7f097d16ab80 1 -- start start 2023-10-08T12:52:55.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.116+0000 7f097d16ab80 1 Processor -- start 2023-10-08T12:52:55.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.116+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 0x558313a64110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.116+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 0x558313a614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.116+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a646d0 0x558313a61be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.116+0000 7f097d16ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583139aceb0 con 0x558313a58f00 2023-10-08T12:52:55.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.116+0000 7f097d16ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313949790 con 0x558313a59820 2023-10-08T12:52:55.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.116+0000 7f097d16ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313949430 con 0x558313a646d0 2023-10-08T12:52:55.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.116+0000 7f097d16ab80 10 client.0 _ll_register_callbacks cb 0x5583137a6880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:55.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f0962ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 0x558313a64110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f09627fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 0x558313a614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f0962ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 0x558313a64110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46758/0 (socket says 172.21.15.59:46758) 2023-10-08T12:52:55.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f0962ffd700 1 -- 172.21.15.59:0/514891588 learned_addr learned my addr 172.21.15.59:0/514891588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:55.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f09637fe700 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a646d0 0x558313a61be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f09627fc700 1 -- 172.21.15.59:0/514891588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a646d0 msgr2=0x558313a61be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f09627fc700 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a646d0 0x558313a61be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f09627fc700 1 -- 172.21.15.59:0/514891588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 msgr2=0x558313a64110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f09627fc700 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 0x558313a64110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f09627fc700 1 -- 172.21.15.59:0/514891588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095c011330 con 0x558313a59820 2023-10-08T12:52:55.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f0962ffd700 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 0x558313a64110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:55.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.117+0000 7f09637fe700 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a646d0 0x558313a61be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:55.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.118+0000 7f09627fc700 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 0x558313a614a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0958006010 tx=0x7f0958005250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64607a406273c5b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.118+0000 7f0946ff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:52:55.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.118+0000 7f0946ff5700 1 -- 172.21.15.59:0/514891588 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095801d070 con 0x558313a59820 2023-10-08T12:52:55.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.118+0000 7f097d16ab80 1 -- 172.21.15.59:0/514891588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558313974f30 con 0x558313a59820 2023-10-08T12:52:55.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.118+0000 7f0946ff5700 1 -- 172.21.15.59:0/514891588 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f0958004910 con 0x558313a59820 2023-10-08T12:52:55.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.118+0000 7f0946ff5700 1 -- 172.21.15.59:0/514891588 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0958004ad0 con 0x558313a59820 2023-10-08T12:52:55.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.118+0000 7f097d16ab80 10 client.27209 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:55.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.118+0000 7f097d16ab80 1 -- 172.21.15.59:0/514891588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5583137c0ce0 con 0x558313a59820 2023-10-08T12:52:55.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.118+0000 7f0946ff5700 1 -- 172.21.15.59:0/514891588 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558313974f30 con 0x558313a59820 2023-10-08T12:52:55.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.119+0000 7f0946ff5700 1 -- 172.21.15.59:0/514891588 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f095800fc20 con 0x558313a59820 2023-10-08T12:52:55.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.119+0000 7f097d16ab80 10 client.27209 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:55.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.119+0000 7f097d16ab80 10 client.27209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:55.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.119+0000 7f097d16ab80 20 client.27209 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:55.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.119+0000 7f097d16ab80 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558313a742c0 0x558313a766e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.119+0000 7f097d16ab80 4 client.27209 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:55.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.119+0000 7f097d16ab80 1 -- 172.21.15.59:0/514891588 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5583139a5e90 con 0x558313a742c0 2023-10-08T12:52:55.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.119+0000 7f0962ffd700 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558313a742c0 0x558313a766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.119+0000 7f0962ffd700 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558313a742c0 0x558313a766e0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d8b4369adc2d5ba server_cookie=2bb493c589d177b8 in_seq=0 out_seq=0 2023-10-08T12:52:55.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.119+0000 7f0946ff5700 10 client.27209 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:55.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f0946ff5700 1 -- 172.21.15.59:0/514891588 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5583139a5e90 con 0x558313a742c0 2023-10-08T12:52:55.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f0946ff5700 10 client.27209 handle_command_reply: tid=0 2023-10-08T12:52:55.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f097d16ab80 1 client.27209 shutdown 2023-10-08T12:52:55.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f097d16ab80 1 -- 172.21.15.59:0/514891588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 msgr2=0x558313a614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f097d16ab80 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 0x558313a614a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0958006010 tx=0x7f0958005250 comp rx=0 tx=0).stop 2023-10-08T12:52:55.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f097d16ab80 1 -- 172.21.15.59:0/514891588 shutdown_connections 2023-10-08T12:52:55.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f097d16ab80 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558313a742c0 0x558313a766e0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f097d16ab80 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a646d0 0x558313a61be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f097d16ab80 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 0x558313a64110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f0946ff5700 0 client.27209 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:55.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f097d16ab80 1 --2- 172.21.15.59:0/514891588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 0x558313a614a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.120+0000 7f097d16ab80 1 -- 172.21.15.59:0/514891588 >> 172.21.15.59:0/514891588 conn(0x5583139ce2e0 msgr2=0x558313a54f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.121+0000 7f097d16ab80 1 -- 172.21.15.59:0/514891588 shutdown_connections 2023-10-08T12:52:55.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.121+0000 7f097d16ab80 1 -- 172.21.15.59:0/514891588 wait complete. 2023-10-08T12:52:55.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.121+0000 7f097d16ab80 20 client.27209 trim_cache size 0 max 16384 2023-10-08T12:52:55.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.140+0000 7f097d16ab80 1 Processor -- start 2023-10-08T12:52:55.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f097d16ab80 1 -- start start 2023-10-08T12:52:55.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a58f00 0x558313a6b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 0x558313a60d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a646d0 0x558313a61270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f097d16ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55831382d9a0 con 0x558313a646d0 2023-10-08T12:52:55.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f097d16ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313a66f60 con 0x558313a59820 2023-10-08T12:52:55.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f097d16ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583139a5e90 con 0x558313a58f00 2023-10-08T12:52:55.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f0962ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a58f00 0x558313a6b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f09627fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 0x558313a60d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f0962ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a58f00 0x558313a6b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60690/0 (socket says 172.21.15.59:60690) 2023-10-08T12:52:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f0962ffd700 1 -- 172.21.15.59:0/3629674899 learned_addr learned my addr 172.21.15.59:0/3629674899 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f09637fe700 1 --2- 172.21.15.59:0/3629674899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a646d0 0x558313a61270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.141+0000 7f09627fc700 1 -- 172.21.15.59:0/3629674899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a58f00 msgr2=0x558313a6b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.142+0000 7f09627fc700 1 --2- 172.21.15.59:0/3629674899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a58f00 0x558313a6b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.142+0000 7f09627fc700 1 -- 172.21.15.59:0/3629674899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a646d0 msgr2=0x558313a61270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.142+0000 7f09627fc700 1 --2- 172.21.15.59:0/3629674899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a646d0 0x558313a61270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.142+0000 7f09627fc700 1 -- 172.21.15.59:0/3629674899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558313a54820 con 0x558313a59820 2023-10-08T12:52:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.142+0000 7f0962ffd700 1 --2- 172.21.15.59:0/3629674899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a58f00 0x558313a6b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:55.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.142+0000 7f09627fc700 1 --2- 172.21.15.59:0/3629674899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 0x558313a60d30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f09580098e0 tx=0x7f0958024710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a6930975682a55 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.142+0000 7f0949ffb700 1 -- 172.21.15.59:0/3629674899 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095801d070 con 0x558313a59820 2023-10-08T12:52:55.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.142+0000 7f0949ffb700 1 -- 172.21.15.59:0/3629674899 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f095801e040 con 0x558313a59820 2023-10-08T12:52:55.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.142+0000 7f0949ffb700 1 -- 172.21.15.59:0/3629674899 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0958017990 con 0x558313a59820 2023-10-08T12:52:55.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.143+0000 7f097d16ab80 1 -- 172.21.15.59:0/3629674899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 msgr2=0x558313a60d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.143+0000 7f097d16ab80 1 --2- 172.21.15.59:0/3629674899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 0x558313a60d30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f09580098e0 tx=0x7f0958024710 comp rx=0 tx=0).stop 2023-10-08T12:52:55.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.143+0000 7f097d16ab80 1 -- 172.21.15.59:0/3629674899 shutdown_connections 2023-10-08T12:52:55.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.143+0000 7f097d16ab80 1 --2- 172.21.15.59:0/3629674899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a646d0 0x558313a61270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.143+0000 7f097d16ab80 1 --2- 172.21.15.59:0/3629674899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a58f00 0x558313a6b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.143+0000 7f097d16ab80 1 --2- 172.21.15.59:0/3629674899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a59820 0x558313a60d30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.143+0000 7f097d16ab80 1 -- 172.21.15.59:0/3629674899 >> 172.21.15.59:0/3629674899 conn(0x5583139ce2e0 msgr2=0x558313a5c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.143+0000 7f097d16ab80 1 -- 172.21.15.59:0/3629674899 shutdown_connections 2023-10-08T12:52:55.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.143+0000 7f097d16ab80 1 -- 172.21.15.59:0/3629674899 wait complete. 2023-10-08T12:52:55.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.143+0000 7f097d16ab80 1 -- start start 2023-10-08T12:52:55.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.144+0000 7f097d16ab80 1 Processor -- start 2023-10-08T12:52:55.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.144+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 0x558313a6b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.144+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 0x558313a69820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.144+0000 7f097d16ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a646d0 0x558313a69d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.144+0000 7f097d16ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313a6a440 con 0x558313a58f00 2023-10-08T12:52:55.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.144+0000 7f097d16ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313a6a5b0 con 0x558313a646d0 2023-10-08T12:52:55.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.144+0000 7f097d16ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313ac8120 con 0x558313a59820 2023-10-08T12:52:55.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.144+0000 7f097d16ab80 10 client.0 _ll_register_callbacks cb 0x7f095800be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:55.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f09627fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 0x558313a69820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f09627fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 0x558313a69820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60694/0 (socket says 172.21.15.59:60694) 2023-10-08T12:52:55.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f09627fc700 1 -- 172.21.15.59:0/2074611939 learned_addr learned my addr 172.21.15.59:0/2074611939 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f0962ffd700 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 0x558313a6b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f09637fe700 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a646d0 0x558313a69d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f09627fc700 1 -- 172.21.15.59:0/2074611939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a646d0 msgr2=0x558313a69d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f09627fc700 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a646d0 0x558313a69d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f09627fc700 1 -- 172.21.15.59:0/2074611939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 msgr2=0x558313a6b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f09627fc700 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 0x558313a6b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f09627fc700 1 -- 172.21.15.59:0/2074611939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09540ce040 con 0x558313a59820 2023-10-08T12:52:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f0962ffd700 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 0x558313a6b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f09637fe700 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a646d0 0x558313a69d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f09627fc700 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 0x558313a69820 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0958024470 tx=0x7f0958005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54f21fcaf4436f69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.145+0000 7f0946ff5700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:52:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f0946ff5700 1 -- 172.21.15.59:0/2074611939 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095801d030 con 0x558313a59820 2023-10-08T12:52:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f097d16ab80 1 -- 172.21.15.59:0/2074611939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f095c00f040 con 0x558313a59820 2023-10-08T12:52:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f0946ff5700 1 -- 172.21.15.59:0/2074611939 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f0958000e40 con 0x558313a59820 2023-10-08T12:52:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f0946ff5700 1 -- 172.21.15.59:0/2074611939 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0958025d20 con 0x558313a59820 2023-10-08T12:52:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f097d16ab80 10 client.27205 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f097d16ab80 1 -- 172.21.15.59:0/2074611939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5583137c0ce0 con 0x558313a59820 2023-10-08T12:52:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f0946ff5700 1 -- 172.21.15.59:0/2074611939 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f095c00f040 con 0x558313a59820 2023-10-08T12:52:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f0946ff5700 1 -- 172.21.15.59:0/2074611939 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f09580176a0 con 0x558313a59820 2023-10-08T12:52:55.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f097d16ab80 10 client.27205 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f097d16ab80 10 client.27205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f097d16ab80 20 client.27205 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f097d16ab80 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558313ac9440 0x558313acb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f097d16ab80 4 client.27205 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:52:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.146+0000 7f097d16ab80 1 -- 172.21.15.59:0/2074611939 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5583139a5bb0 con 0x558313ac9440 2023-10-08T12:52:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.147+0000 7f0962ffd700 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558313ac9440 0x558313acb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.147+0000 7f0962ffd700 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558313ac9440 0x558313acb830 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bc38a5af653e39e server_cookie=1346474708ca44f2 in_seq=0 out_seq=0 2023-10-08T12:52:55.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.147+0000 7f0946ff5700 10 client.27205 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f0946ff5700 1 -- 172.21.15.59:0/2074611939 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5583139a5bb0 con 0x558313ac9440 2023-10-08T12:52:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f0946ff5700 10 client.27205 handle_command_reply: tid=0 2023-10-08T12:52:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f097d16ab80 1 client.27205 shutdown 2023-10-08T12:52:55.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f097d16ab80 1 -- 172.21.15.59:0/2074611939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 msgr2=0x558313a69820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f097d16ab80 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 0x558313a69820 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0958024470 tx=0x7f0958005bc0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f097d16ab80 1 -- 172.21.15.59:0/2074611939 shutdown_connections 2023-10-08T12:52:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f097d16ab80 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x558313ac9440 0x558313acb830 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f097d16ab80 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558313a646d0 0x558313a69d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f097d16ab80 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558313a58f00 0x558313a6b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f097d16ab80 1 --2- 172.21.15.59:0/2074611939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558313a59820 0x558313a69820 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f0946ff5700 0 client.27205 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.149+0000 7f097d16ab80 1 -- 172.21.15.59:0/2074611939 >> 172.21.15.59:0/2074611939 conn(0x5583139ce2e0 msgr2=0x558313a54c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.150+0000 7f097d16ab80 1 -- 172.21.15.59:0/2074611939 shutdown_connections 2023-10-08T12:52:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.150+0000 7f097d16ab80 1 -- 172.21.15.59:0/2074611939 wait complete. 2023-10-08T12:52:55.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.150+0000 7f097d16ab80 20 client.27205 trim_cache size 0 max 16384 2023-10-08T12:52:55.155 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:52:55.155 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:52:55.155 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "58cae970-f5f0-468a-98c8-8aa18c351564", 2023-10-08T12:52:55.155 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:52:55.155 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:52:55.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.150+0000 7f09697ff700 1 -- 172.21.15.59:0/2641283635 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f094c0a1670 msgr2=0x7f094c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.151+0000 7f09697ff700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f094c0a1670 0x7f094c0a3b30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f095c020000 tx=0x7f095c023000 comp rx=0 tx=0).stop 2023-10-08T12:52:55.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.151+0000 7f09697ff700 1 -- 172.21.15.59:0/2641283635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0964100740 msgr2=0x7f0964072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.151+0000 7f09697ff700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0964100740 0x7f0964072af0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f095400d980 tx=0x7f095400dc90 comp rx=0 tx=0).stop 2023-10-08T12:52:55.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.151+0000 7f09697ff700 1 -- 172.21.15.59:0/2641283635 shutdown_connections 2023-10-08T12:52:55.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.151+0000 7f09697ff700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f094c0a1670 0x7f094c0a3b30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.151+0000 7f09697ff700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0964100740 0x7f0964072af0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.151+0000 7f09697ff700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0964106750 0x7f0964073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.151+0000 7f09697ff700 1 --2- 172.21.15.59:0/2641283635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0964101100 0x7f0964073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.151+0000 7f09697ff700 1 -- 172.21.15.59:0/2641283635 >> 172.21.15.59:0/2641283635 conn(0x7f09640fc230 msgr2=0x7f09640fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.151+0000 7f09697ff700 1 -- 172.21.15.59:0/2641283635 shutdown_connections 2023-10-08T12:52:55.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.151+0000 7f09697ff700 1 -- 172.21.15.59:0/2641283635 wait complete. 2023-10-08T12:52:55.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:52:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.385+0000 7f1950dff700 1 -- 172.21.15.59:0/269441962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c1051c0 msgr2=0x7f194c105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.385+0000 7f1950dff700 1 --2- 172.21.15.59:0/269441962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c1051c0 0x7f194c105640 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1940009990 tx=0x7f1940009ca0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.386+0000 7f1950dff700 1 -- 172.21.15.59:0/269441962 shutdown_connections 2023-10-08T12:52:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.386+0000 7f1950dff700 1 --2- 172.21.15.59:0/269441962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194c105b80 0x7f194c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.386+0000 7f1950dff700 1 --2- 172.21.15.59:0/269441962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f194c067ce0 0x7f194c0680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.386+0000 7f1950dff700 1 --2- 172.21.15.59:0/269441962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c1051c0 0x7f194c105640 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.386+0000 7f1950dff700 1 -- 172.21.15.59:0/269441962 >> 172.21.15.59:0/269441962 conn(0x7f194c076780 msgr2=0x7f194c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.386+0000 7f1950dff700 1 -- 172.21.15.59:0/269441962 shutdown_connections 2023-10-08T12:52:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.386+0000 7f1950dff700 1 -- 172.21.15.59:0/269441962 wait complete. 2023-10-08T12:52:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.387+0000 7f1950dff700 1 Processor -- start 2023-10-08T12:52:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.387+0000 7f1950dff700 1 -- start start 2023-10-08T12:52:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.387+0000 7f1950dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194c067ce0 0x7f194c198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.387+0000 7f1950dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c1051c0 0x7f194c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.387+0000 7f1950dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f194c105b80 0x7f194c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.387+0000 7f1950dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c19dd40 con 0x7f194c067ce0 2023-10-08T12:52:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.387+0000 7f1950dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c19deb0 con 0x7f194c1051c0 2023-10-08T12:52:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.387+0000 7f1950dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c19e070 con 0x7f194c105b80 2023-10-08T12:52:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.388+0000 7f194a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194c067ce0 0x7f194c198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.388+0000 7f194a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194c067ce0 0x7f194c198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46784/0 (socket says 172.21.15.59:46784) 2023-10-08T12:52:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.388+0000 7f194a59c700 1 -- 172.21.15.59:0/3670960101 learned_addr learned my addr 172.21.15.59:0/3670960101 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.388+0000 7f1949d9b700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c1051c0 0x7f194c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.388+0000 7f194ad9d700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f194c105b80 0x7f194c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.388+0000 7f194a59c700 1 -- 172.21.15.59:0/3670960101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f194c105b80 msgr2=0x7f194c19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.388+0000 7f194a59c700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f194c105b80 0x7f194c19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.388+0000 7f194a59c700 1 -- 172.21.15.59:0/3670960101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c1051c0 msgr2=0x7f194c199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.388+0000 7f194a59c700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c1051c0 0x7f194c199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.388+0000 7f194a59c700 1 -- 172.21.15.59:0/3670960101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19400095f0 con 0x7f194c067ce0 2023-10-08T12:52:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.388+0000 7f194a59c700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194c067ce0 0x7f194c198e20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f193c00e9a0 tx=0x7f193c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.389+0000 7f193b7fe700 1 -- 172.21.15.59:0/3670960101 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c009790 con 0x7f194c067ce0 2023-10-08T12:52:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.389+0000 7f193b7fe700 1 -- 172.21.15.59:0/3670960101 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f193c00cbd0 con 0x7f194c067ce0 2023-10-08T12:52:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.389+0000 7f193b7fe700 1 -- 172.21.15.59:0/3670960101 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c018680 con 0x7f194c067ce0 2023-10-08T12:52:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.389+0000 7f1950dff700 1 -- 172.21.15.59:0/3670960101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c19e350 con 0x7f194c067ce0 2023-10-08T12:52:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.389+0000 7f1950dff700 1 -- 172.21.15.59:0/3670960101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c1a5b90 con 0x7f194c067ce0 2023-10-08T12:52:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.392+0000 7f193b7fe700 1 -- 172.21.15.59:0/3670960101 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f193c00cd40 con 0x7f194c067ce0 2023-10-08T12:52:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.393+0000 7f193b7fe700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19340a1670 0x7f19340a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.394+0000 7f196471cb80 1 Processor -- start 2023-10-08T12:52:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.394+0000 7f193b7fe700 1 -- 172.21.15.59:0/3670960101 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f193c014070 con 0x7f194c067ce0 2023-10-08T12:52:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.394+0000 7f1949d9b700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19340a1670 0x7f19340a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.394+0000 7f196471cb80 1 -- start start 2023-10-08T12:52:55.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.394+0000 7f196471cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.394+0000 7f196471cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda27a0 0x5588dfdad110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.394+0000 7f196471cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfdad650 0x5588dfdafa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.394+0000 7f196471cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfd0b460 con 0x5588dfda27a0 2023-10-08T12:52:55.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.394+0000 7f196471cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfcfcc20 con 0x5588dfda1e80 2023-10-08T12:52:55.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.394+0000 7f196471cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfcfa540 con 0x5588dfdad650 2023-10-08T12:52:55.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f194a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f194a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50732/0 (socket says 172.21.15.59:50732) 2023-10-08T12:52:55.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f194a59c700 1 -- 172.21.15.59:0/1879415923 learned_addr learned my addr 172.21.15.59:0/1879415923 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:55.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f1949d9b700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19340a1670 0x7f19340a3b30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f194000b2e0 tx=0x7f1940005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f1949d9b700 1 --2- 172.21.15.59:0/1879415923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda27a0 0x5588dfdad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f194ad9d700 1 --2- 172.21.15.59:0/1879415923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfdad650 0x5588dfdafa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f194a59c700 1 -- 172.21.15.59:0/1879415923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfdad650 msgr2=0x5588dfdafa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f194a59c700 1 --2- 172.21.15.59:0/1879415923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfdad650 0x5588dfdafa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f194a59c700 1 -- 172.21.15.59:0/1879415923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda27a0 msgr2=0x5588dfdad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f194a59c700 1 --2- 172.21.15.59:0/1879415923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda27a0 0x5588dfdad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f194a59c700 1 -- 172.21.15.59:0/1879415923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588dfb20de0 con 0x5588dfda1e80 2023-10-08T12:52:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f194a59c700 1 --2- 172.21.15.59:0/1879415923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f193c099ff0 tx=0x7f193c099c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a9985ae3fc94ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.395+0000 7f1938ff9700 1 -- 172.21.15.59:0/1879415923 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c09a2f0 con 0x5588dfda1e80 2023-10-08T12:52:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.396+0000 7f1938ff9700 1 -- 172.21.15.59:0/1879415923 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f193c09e440 con 0x5588dfda1e80 2023-10-08T12:52:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.396+0000 7f1938ff9700 1 -- 172.21.15.59:0/1879415923 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c099a40 con 0x5588dfda1e80 2023-10-08T12:52:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.396+0000 7f196471cb80 1 -- 172.21.15.59:0/1879415923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda1e80 msgr2=0x5588dfda2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.396+0000 7f196471cb80 1 --2- 172.21.15.59:0/1879415923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f193c099ff0 tx=0x7f193c099c50 comp rx=0 tx=0).stop 2023-10-08T12:52:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.396+0000 7f196471cb80 1 -- 172.21.15.59:0/1879415923 shutdown_connections 2023-10-08T12:52:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.396+0000 7f196471cb80 1 --2- 172.21.15.59:0/1879415923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.396+0000 7f196471cb80 1 --2- 172.21.15.59:0/1879415923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfdad650 0x5588dfdafa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.396+0000 7f196471cb80 1 --2- 172.21.15.59:0/1879415923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda27a0 0x5588dfdad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.396+0000 7f196471cb80 1 -- 172.21.15.59:0/1879415923 >> 172.21.15.59:0/1879415923 conn(0x5588dfd17260 msgr2=0x5588dfd9e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.396+0000 7f196471cb80 1 -- 172.21.15.59:0/1879415923 shutdown_connections 2023-10-08T12:52:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.396+0000 7f196471cb80 1 -- 172.21.15.59:0/1879415923 wait complete. 2023-10-08T12:52:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.397+0000 7f196471cb80 1 -- start start 2023-10-08T12:52:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.397+0000 7f196471cb80 1 Processor -- start 2023-10-08T12:52:55.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f196471cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfdaa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f196471cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda27a0 0x5588dfdaa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f196471cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfdad650 0x5588dfdaae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f196471cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfcf5e30 con 0x5588dfdad650 2023-10-08T12:52:55.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f196471cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfc92710 con 0x5588dfda27a0 2023-10-08T12:52:55.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f196471cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfc923b0 con 0x5588dfda1e80 2023-10-08T12:52:55.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f196471cb80 10 client.0 _ll_register_callbacks cb 0x5588dfaef800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:55.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f194a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfdaa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f194a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfdaa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60734/0 (socket says 172.21.15.59:60734) 2023-10-08T12:52:55.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f194a59c700 1 -- 172.21.15.59:0/3276373111 learned_addr learned my addr 172.21.15.59:0/3276373111 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:55.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f194ad9d700 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfdad650 0x5588dfdaae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f1949d9b700 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda27a0 0x5588dfdaa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f194a59c700 1 -- 172.21.15.59:0/3276373111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda27a0 msgr2=0x5588dfdaa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f194a59c700 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda27a0 0x5588dfdaa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f194a59c700 1 -- 172.21.15.59:0/3276373111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfdad650 msgr2=0x5588dfdaae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f194a59c700 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfdad650 0x5588dfdaae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f194a59c700 1 -- 172.21.15.59:0/3276373111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c1a5b90 con 0x5588dfda1e80 2023-10-08T12:52:55.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.398+0000 7f194ad9d700 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfdad650 0x5588dfdaae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:55.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.399+0000 7f194a59c700 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfdaa3e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f193c00c5b0 tx=0x7f193c09a370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fb4789ae3e48cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.399+0000 7f1931ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:52:55.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.399+0000 7f1931ffb700 1 -- 172.21.15.59:0/3276373111 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c09a750 con 0x5588dfda1e80 2023-10-08T12:52:55.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.399+0000 7f196471cb80 1 -- 172.21.15.59:0/3276373111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588dfcbdeb0 con 0x5588dfda1e80 2023-10-08T12:52:55.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.399+0000 7f1931ffb700 1 -- 172.21.15.59:0/3276373111 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f193c0a21f0 con 0x5588dfda1e80 2023-10-08T12:52:55.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.399+0000 7f1931ffb700 1 -- 172.21.15.59:0/3276373111 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f193c0a23b0 con 0x5588dfda1e80 2023-10-08T12:52:55.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.399+0000 7f196471cb80 10 client.27217 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:55.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.399+0000 7f196471cb80 1 -- 172.21.15.59:0/3276373111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5588dfb09c60 con 0x5588dfda1e80 2023-10-08T12:52:55.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.399+0000 7f1931ffb700 1 -- 172.21.15.59:0/3276373111 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5588dfcbdeb0 con 0x5588dfda1e80 2023-10-08T12:52:55.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.400+0000 7f1931ffb700 1 -- 172.21.15.59:0/3276373111 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f193c099410 con 0x5588dfda1e80 2023-10-08T12:52:55.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.400+0000 7f196471cb80 10 client.27217 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:55.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.400+0000 7f196471cb80 10 client.27217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:55.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.400+0000 7f196471cb80 20 client.27217 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:55.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.400+0000 7f196471cb80 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5588dfdbd000 0x5588dfdbf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.400+0000 7f196471cb80 4 client.27217 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:55.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.400+0000 7f196471cb80 1 -- 172.21.15.59:0/3276373111 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588dfceee10 con 0x5588dfdbd000 2023-10-08T12:52:55.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.400+0000 7f1949d9b700 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5588dfdbd000 0x5588dfdbf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.400+0000 7f1949d9b700 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5588dfdbd000 0x5588dfdbf3f0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2268b54d070b75da server_cookie=a123538d27fa003c in_seq=0 out_seq=0 2023-10-08T12:52:55.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.400+0000 7f1931ffb700 10 client.27217 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:55.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f1931ffb700 1 -- 172.21.15.59:0/3276373111 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5588dfceee10 con 0x5588dfdbd000 2023-10-08T12:52:55.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f1931ffb700 10 client.27217 handle_command_reply: tid=0 2023-10-08T12:52:55.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 1 client.27217 shutdown 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 1 -- 172.21.15.59:0/3276373111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 msgr2=0x5588dfdaa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfdaa3e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f193c00c5b0 tx=0x7f193c09a370 comp rx=0 tx=0).stop 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 1 -- 172.21.15.59:0/3276373111 shutdown_connections 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5588dfdbd000 0x5588dfdbf3f0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfdad650 0x5588dfdaae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfdaa3e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 1 --2- 172.21.15.59:0/3276373111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda27a0 0x5588dfdaa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f1931ffb700 0 client.27217 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 1 -- 172.21.15.59:0/3276373111 >> 172.21.15.59:0/3276373111 conn(0x5588dfd17260 msgr2=0x5588dfd9dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 1 -- 172.21.15.59:0/3276373111 shutdown_connections 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 1 -- 172.21.15.59:0/3276373111 wait complete. 2023-10-08T12:52:55.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.402+0000 7f196471cb80 20 client.27217 trim_cache size 0 max 16384 2023-10-08T12:52:55.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.420+0000 7f196471cb80 1 Processor -- start 2023-10-08T12:52:55.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.420+0000 7f196471cb80 1 -- start start 2023-10-08T12:52:55.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.420+0000 7f196471cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.420+0000 7f196471cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda27a0 0x5588dfdb41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.420+0000 7f196471cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfdad650 0x5588dfdb88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.420+0000 7f196471cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfb76920 con 0x5588dfda1e80 2023-10-08T12:52:55.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.420+0000 7f196471cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfdbcdd0 con 0x5588dfda27a0 2023-10-08T12:52:55.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.420+0000 7f196471cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfdb46e0 con 0x5588dfdad650 2023-10-08T12:52:55.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f194a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f1949d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda27a0 0x5588dfdb41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f194a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46814/0 (socket says 172.21.15.59:46814) 2023-10-08T12:52:55.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f194a59c700 1 -- 172.21.15.59:0/3938954307 learned_addr learned my addr 172.21.15.59:0/3938954307 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:55.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f194ad9d700 1 --2- 172.21.15.59:0/3938954307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfdad650 0x5588dfdb88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f194a59c700 1 -- 172.21.15.59:0/3938954307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfdad650 msgr2=0x5588dfdb88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f194a59c700 1 --2- 172.21.15.59:0/3938954307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfdad650 0x5588dfdb88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f194a59c700 1 -- 172.21.15.59:0/3938954307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda27a0 msgr2=0x5588dfdb41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f194a59c700 1 --2- 172.21.15.59:0/3938954307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda27a0 0x5588dfdb41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f194a59c700 1 -- 172.21.15.59:0/3938954307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588dfb47250 con 0x5588dfda1e80 2023-10-08T12:52:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f194ad9d700 1 --2- 172.21.15.59:0/3938954307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfdad650 0x5588dfdb88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:52:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f1949d9b700 1 --2- 172.21.15.59:0/3938954307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda27a0 0x5588dfdb41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f194a59c700 1 --2- 172.21.15.59:0/3938954307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f193c09a4b0 tx=0x7f193c0988a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e257ee4d6c600390 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.421+0000 7f19397fa700 1 -- 172.21.15.59:0/3938954307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c0a23f0 con 0x5588dfda1e80 2023-10-08T12:52:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.422+0000 7f19397fa700 1 -- 172.21.15.59:0/3938954307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f193c0a2680 con 0x5588dfda1e80 2023-10-08T12:52:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.422+0000 7f19397fa700 1 -- 172.21.15.59:0/3938954307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c099500 con 0x5588dfda1e80 2023-10-08T12:52:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.422+0000 7f196471cb80 1 -- 172.21.15.59:0/3938954307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda1e80 msgr2=0x5588dfda2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.422+0000 7f196471cb80 1 --2- 172.21.15.59:0/3938954307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f193c09a4b0 tx=0x7f193c0988a0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.422+0000 7f196471cb80 1 -- 172.21.15.59:0/3938954307 shutdown_connections 2023-10-08T12:52:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.422+0000 7f196471cb80 1 --2- 172.21.15.59:0/3938954307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfdad650 0x5588dfdb88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.422+0000 7f196471cb80 1 --2- 172.21.15.59:0/3938954307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda1e80 0x5588dfda2260 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.422+0000 7f196471cb80 1 --2- 172.21.15.59:0/3938954307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfda27a0 0x5588dfdb41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.422+0000 7f196471cb80 1 -- 172.21.15.59:0/3938954307 >> 172.21.15.59:0/3938954307 conn(0x5588dfd17260 msgr2=0x5588dfd9d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.422+0000 7f196471cb80 1 -- 172.21.15.59:0/3938954307 shutdown_connections 2023-10-08T12:52:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.422+0000 7f196471cb80 1 -- 172.21.15.59:0/3938954307 wait complete. 2023-10-08T12:52:55.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.423+0000 7f196471cb80 1 -- start start 2023-10-08T12:52:55.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.423+0000 7f196471cb80 1 Processor -- start 2023-10-08T12:52:55.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f196471cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfe04f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f196471cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda27a0 0x5588dfe05480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f196471cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfdad650 0x5588dfe0fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f196471cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfe10310 con 0x5588dfda27a0 2023-10-08T12:52:55.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f196471cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfe10450 con 0x5588dfdad650 2023-10-08T12:52:55.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f196471cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588dfe10590 con 0x5588dfda1e80 2023-10-08T12:52:55.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f196471cb80 10 client.0 _ll_register_callbacks cb 0x7f193c099e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:55.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f194a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfe04f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f194a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfe04f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60754/0 (socket says 172.21.15.59:60754) 2023-10-08T12:52:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f194a59c700 1 -- 172.21.15.59:0/2592885173 learned_addr learned my addr 172.21.15.59:0/2592885173 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:52:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f1949d9b700 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda27a0 0x5588dfe05480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f194ad9d700 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfdad650 0x5588dfe0fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f194a59c700 1 -- 172.21.15.59:0/2592885173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfdad650 msgr2=0x5588dfe0fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f194a59c700 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfdad650 0x5588dfe0fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f194a59c700 1 -- 172.21.15.59:0/2592885173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda27a0 msgr2=0x5588dfe05480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f194a59c700 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda27a0 0x5588dfe05480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.424+0000 7f194a59c700 1 -- 172.21.15.59:0/2592885173 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c10dec0 con 0x5588dfda1e80 2023-10-08T12:52:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f194a59c700 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfe04f40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f193c000c00 tx=0x7f193c099c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab13f372295a71a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f1931ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:52:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f1931ffb700 1 -- 172.21.15.59:0/2592885173 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c096630 con 0x5588dfda1e80 2023-10-08T12:52:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f196471cb80 1 -- 172.21.15.59:0/2592885173 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f193c09e440 con 0x5588dfda1e80 2023-10-08T12:52:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f1931ffb700 1 -- 172.21.15.59:0/2592885173 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f193c0b82c0 con 0x5588dfda1e80 2023-10-08T12:52:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f1931ffb700 1 -- 172.21.15.59:0/2592885173 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f193c0b8480 con 0x5588dfda1e80 2023-10-08T12:52:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f196471cb80 10 client.27223 fetch_fsmap learned FSMap version 20 2023-10-08T12:52:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f196471cb80 1 -- 172.21.15.59:0/2592885173 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5588dfb09c60 con 0x5588dfda1e80 2023-10-08T12:52:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f1931ffb700 1 -- 172.21.15.59:0/2592885173 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f193c09e440 con 0x5588dfda1e80 2023-10-08T12:52:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f1931ffb700 1 -- 172.21.15.59:0/2592885173 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f193c0831f0 con 0x5588dfda1e80 2023-10-08T12:52:55.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f196471cb80 10 client.27223 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:52:55.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f196471cb80 10 client.27223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:55.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f196471cb80 20 client.27223 populate_metadata read hostname 'smithi059' 2023-10-08T12:52:55.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.425+0000 7f196471cb80 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5588dfe11930 0x5588dfe13d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:55.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.426+0000 7f196471cb80 4 client.27223 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:52:55.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.426+0000 7f196471cb80 1 -- 172.21.15.59:0/2592885173 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5588dfceeb30 con 0x5588dfe11930 2023-10-08T12:52:55.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.426+0000 7f1949d9b700 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5588dfe11930 0x5588dfe13d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:55.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.426+0000 7f1949d9b700 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5588dfe11930 0x5588dfe13d50 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f1a7eb60c8065d0 server_cookie=6d47718ea5c47707 in_seq=0 out_seq=0 2023-10-08T12:52:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.426+0000 7f1931ffb700 10 client.27223 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f1931ffb700 1 -- 172.21.15.59:0/2592885173 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5588dfceeb30 con 0x5588dfe11930 2023-10-08T12:52:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f1931ffb700 10 client.27223 handle_command_reply: tid=0 2023-10-08T12:52:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f196471cb80 1 client.27223 shutdown 2023-10-08T12:52:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f196471cb80 1 -- 172.21.15.59:0/2592885173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 msgr2=0x5588dfe04f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f196471cb80 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfe04f40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f193c000c00 tx=0x7f193c099c50 comp rx=0 tx=0).stop 2023-10-08T12:52:55.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f196471cb80 1 -- 172.21.15.59:0/2592885173 shutdown_connections 2023-10-08T12:52:55.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f196471cb80 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5588dfe11930 0x5588dfe13d50 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f196471cb80 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588dfdad650 0x5588dfe0fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f196471cb80 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588dfda1e80 0x5588dfe04f40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f196471cb80 1 --2- 172.21.15.59:0/2592885173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588dfda27a0 0x5588dfe05480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f1931ffb700 0 client.27223 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:52:55.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.428+0000 7f196471cb80 1 -- 172.21.15.59:0/2592885173 >> 172.21.15.59:0/2592885173 conn(0x5588dfd17260 msgr2=0x5588dfda5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.429+0000 7f196471cb80 1 -- 172.21.15.59:0/2592885173 shutdown_connections 2023-10-08T12:52:55.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.429+0000 7f196471cb80 1 -- 172.21.15.59:0/2592885173 wait complete. 2023-10-08T12:52:55.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.429+0000 7f196471cb80 20 client.27223 trim_cache size 0 max 16384 2023-10-08T12:52:55.437 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:52:55.437 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:52:55.437 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:52:55.437 INFO:teuthology.orchestra.run.smithi059.stdout: "58cae970-f5f0-468a-98c8-8aa18c351564": { 2023-10-08T12:52:55.437 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:52:55.437 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "58cae970-f5f0-468a-98c8-8aa18c351564", 2023-10-08T12:52:55.437 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:52:55.437 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:52:55.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:52:55.438 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:52:55.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.429+0000 7f1950dff700 1 -- 172.21.15.59:0/3670960101 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19340a1670 msgr2=0x7f19340a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.429+0000 7f1950dff700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19340a1670 0x7f19340a3b30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f194000b2e0 tx=0x7f1940005960 comp rx=0 tx=0).stop 2023-10-08T12:52:55.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.429+0000 7f1950dff700 1 -- 172.21.15.59:0/3670960101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194c067ce0 msgr2=0x7f194c198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:55.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.429+0000 7f1950dff700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194c067ce0 0x7f194c198e20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f193c00e9a0 tx=0x7f193c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.429+0000 7f1950dff700 1 -- 172.21.15.59:0/3670960101 shutdown_connections 2023-10-08T12:52:55.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.430+0000 7f1950dff700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19340a1670 0x7f19340a3b30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.430+0000 7f1950dff700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f194c105b80 0x7f194c19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.430+0000 7f1950dff700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194c067ce0 0x7f194c198e20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.430+0000 7f1950dff700 1 --2- 172.21.15.59:0/3670960101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f194c1051c0 0x7f194c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:55.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.430+0000 7f1950dff700 1 -- 172.21.15.59:0/3670960101 >> 172.21.15.59:0/3670960101 conn(0x7f194c076780 msgr2=0x7f194c10be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:55.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.430+0000 7f1950dff700 1 -- 172.21.15.59:0/3670960101 shutdown_connections 2023-10-08T12:52:55.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:52:55.430+0000 7f1950dff700 1 -- 172.21.15.59:0/3670960101 wait complete. 2023-10-08T12:52:55.448 INFO:tasks.cephfs.filesystem:scrub status for tag:58cae970-f5f0-468a-98c8-8aa18c351564 - {'path': '/', 'tag': '58cae970-f5f0-468a-98c8-8aa18c351564', 'options': 'recursive,force'} 2023-10-08T12:52:55.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1488040 12.51 MB/sec execute 506 sec latency 89.597 ms 2023-10-08T12:52:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:56 smithi092 ceph-mon[134093]: pgmap v676: 97 pgs: 97 active+clean; 630 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 205 op/s 2023-10-08T12:52:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:56 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:52:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:56 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:56 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:52:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:56 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:56.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:56 smithi173 ceph-mon[135182]: pgmap v676: 97 pgs: 97 active+clean; 630 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 205 op/s 2023-10-08T12:52:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:56 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:52:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:56 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:56 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:52:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:56 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:56.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:56 smithi059 ceph-mon[98489]: pgmap v676: 97 pgs: 97 active+clean; 630 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 205 op/s 2023-10-08T12:52:56.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:56 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:52:56.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:56 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:56.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:56 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:52:56.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:56 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:52:56.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1489960 12.51 MB/sec execute 507 sec latency 25.530 ms 2023-10-08T12:52:57.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1492375 12.51 MB/sec execute 508 sec latency 16.096 ms 2023-10-08T12:52:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:58 smithi092 ceph-mon[134093]: pgmap v677: 97 pgs: 97 active+clean; 613 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.0 MiB/s wr, 226 op/s 2023-10-08T12:52:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:58 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:52:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:58 smithi173 ceph-mon[135182]: pgmap v677: 97 pgs: 97 active+clean; 613 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.0 MiB/s wr, 226 op/s 2023-10-08T12:52:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:58 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:52:58.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:58 smithi059 ceph-mon[98489]: pgmap v677: 97 pgs: 97 active+clean; 613 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.0 MiB/s wr, 226 op/s 2023-10-08T12:52:58.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:58 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:52:58.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1494012 12.50 MB/sec execute 509 sec latency 91.436 ms 2023-10-08T12:52:59.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1496349 12.50 MB/sec execute 510 sec latency 24.232 ms 2023-10-08T12:53:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:52:59 smithi173 ceph-mon[135182]: pgmap v678: 97 pgs: 97 active+clean; 593 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-10-08T12:53:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:52:59 smithi059 ceph-mon[98489]: pgmap v678: 97 pgs: 97 active+clean; 593 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-10-08T12:53:00.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:52:59 smithi092 ceph-mon[134093]: pgmap v678: 97 pgs: 97 active+clean; 593 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-10-08T12:53:00.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1497950 12.49 MB/sec execute 511 sec latency 60.679 ms 2023-10-08T12:53:01.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1499592 12.49 MB/sec execute 512 sec latency 31.239 ms 2023-10-08T12:53:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:02 smithi092 ceph-mon[134093]: pgmap v679: 97 pgs: 97 active+clean; 600 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 221 op/s 2023-10-08T12:53:02.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:02 smithi173 ceph-mon[135182]: pgmap v679: 97 pgs: 97 active+clean; 600 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 221 op/s 2023-10-08T12:53:02.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:02 smithi059 ceph-mon[98489]: pgmap v679: 97 pgs: 97 active+clean; 600 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 221 op/s 2023-10-08T12:53:02.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1501588 12.48 MB/sec execute 513 sec latency 45.024 ms 2023-10-08T12:53:03.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1503370 12.48 MB/sec execute 514 sec latency 165.406 ms 2023-10-08T12:53:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:04 smithi092 ceph-mon[134093]: pgmap v680: 97 pgs: 97 active+clean; 610 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.6 MiB/s wr, 266 op/s 2023-10-08T12:53:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:04 smithi092 ceph-mon[134093]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T12:53:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:04 smithi173 ceph-mon[135182]: pgmap v680: 97 pgs: 97 active+clean; 610 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.6 MiB/s wr, 266 op/s 2023-10-08T12:53:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:04 smithi173 ceph-mon[135182]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T12:53:04.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:04 smithi059 ceph-mon[98489]: pgmap v680: 97 pgs: 97 active+clean; 610 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.6 MiB/s wr, 266 op/s 2023-10-08T12:53:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:04 smithi059 ceph-mon[98489]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T12:53:04.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1505927 12.48 MB/sec execute 515 sec latency 34.722 ms 2023-10-08T12:53:05.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1507377 12.47 MB/sec execute 516 sec latency 50.630 ms 2023-10-08T12:53:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:06 smithi092 ceph-mon[134093]: pgmap v682: 97 pgs: 97 active+clean; 610 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 264 op/s 2023-10-08T12:53:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:06 smithi173 ceph-mon[135182]: pgmap v682: 97 pgs: 97 active+clean; 610 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 264 op/s 2023-10-08T12:53:06.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:06 smithi059 ceph-mon[98489]: pgmap v682: 97 pgs: 97 active+clean; 610 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 264 op/s 2023-10-08T12:53:06.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1509925 12.47 MB/sec execute 517 sec latency 62.916 ms 2023-10-08T12:53:07.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1511461 12.46 MB/sec execute 518 sec latency 17.006 ms 2023-10-08T12:53:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:08 smithi092 ceph-mon[134093]: pgmap v683: 97 pgs: 97 active+clean; 613 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 241 op/s 2023-10-08T12:53:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:08 smithi173 ceph-mon[135182]: pgmap v683: 97 pgs: 97 active+clean; 613 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 241 op/s 2023-10-08T12:53:08.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:08 smithi059 ceph-mon[98489]: pgmap v683: 97 pgs: 97 active+clean; 613 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 241 op/s 2023-10-08T12:53:08.547 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1513768 12.47 MB/sec execute 519 sec latency 18.183 ms 2023-10-08T12:53:09.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1515897 12.46 MB/sec execute 520 sec latency 14.396 ms 2023-10-08T12:53:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:09 smithi173 ceph-mon[135182]: pgmap v684: 97 pgs: 97 active+clean; 617 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 263 op/s 2023-10-08T12:53:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:09 smithi059 ceph-mon[98489]: pgmap v684: 97 pgs: 97 active+clean; 617 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 263 op/s 2023-10-08T12:53:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:09 smithi092 ceph-mon[134093]: pgmap v684: 97 pgs: 97 active+clean; 617 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 263 op/s 2023-10-08T12:53:10.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1517607 12.45 MB/sec execute 521 sec latency 94.044 ms 2023-10-08T12:53:11.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1519951 12.45 MB/sec execute 522 sec latency 44.094 ms 2023-10-08T12:53:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:12 smithi092 ceph-mon[134093]: pgmap v685: 97 pgs: 97 active+clean; 627 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 264 op/s 2023-10-08T12:53:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:12 smithi173 ceph-mon[135182]: pgmap v685: 97 pgs: 97 active+clean; 627 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 264 op/s 2023-10-08T12:53:12.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:12 smithi059 ceph-mon[98489]: pgmap v685: 97 pgs: 97 active+clean; 627 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 264 op/s 2023-10-08T12:53:12.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1522021 12.45 MB/sec execute 523 sec latency 16.283 ms 2023-10-08T12:53:13.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1524495 12.46 MB/sec execute 524 sec latency 19.835 ms 2023-10-08T12:53:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:14 smithi092 ceph-mon[134093]: pgmap v686: 97 pgs: 97 active+clean; 631 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 223 op/s 2023-10-08T12:53:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:14 smithi092 ceph-mon[134093]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T12:53:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:14 smithi173 ceph-mon[135182]: pgmap v686: 97 pgs: 97 active+clean; 631 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 223 op/s 2023-10-08T12:53:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:14 smithi173 ceph-mon[135182]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T12:53:14.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:14 smithi059 ceph-mon[98489]: pgmap v686: 97 pgs: 97 active+clean; 631 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 223 op/s 2023-10-08T12:53:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:14 smithi059 ceph-mon[98489]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T12:53:14.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1526591 12.45 MB/sec execute 525 sec latency 39.910 ms 2023-10-08T12:53:15.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1527971 12.45 MB/sec execute 526 sec latency 210.231 ms 2023-10-08T12:53:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:16 smithi092 ceph-mon[134093]: pgmap v688: 97 pgs: 97 active+clean; 634 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 210 op/s 2023-10-08T12:53:16.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:16 smithi173 ceph-mon[135182]: pgmap v688: 97 pgs: 97 active+clean; 634 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 210 op/s 2023-10-08T12:53:16.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:16 smithi059 ceph-mon[98489]: pgmap v688: 97 pgs: 97 active+clean; 634 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 210 op/s 2023-10-08T12:53:16.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1530049 12.44 MB/sec execute 527 sec latency 27.916 ms 2023-10-08T12:53:17.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1532183 12.44 MB/sec execute 528 sec latency 40.049 ms 2023-10-08T12:53:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:18 smithi092 ceph-mon[134093]: pgmap v689: 97 pgs: 97 active+clean; 644 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.3 MiB/s wr, 229 op/s 2023-10-08T12:53:18.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:18 smithi173 ceph-mon[135182]: pgmap v689: 97 pgs: 97 active+clean; 644 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.3 MiB/s wr, 229 op/s 2023-10-08T12:53:18.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:18 smithi059 ceph-mon[98489]: pgmap v689: 97 pgs: 97 active+clean; 644 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.3 MiB/s wr, 229 op/s 2023-10-08T12:53:18.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1534783 12.44 MB/sec execute 529 sec latency 41.478 ms 2023-10-08T12:53:19.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1536631 12.43 MB/sec execute 530 sec latency 29.304 ms 2023-10-08T12:53:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:19 smithi173 ceph-mon[135182]: pgmap v690: 97 pgs: 97 active+clean; 643 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.5 MiB/s wr, 230 op/s 2023-10-08T12:53:20.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:19 smithi059 ceph-mon[98489]: pgmap v690: 97 pgs: 97 active+clean; 643 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.5 MiB/s wr, 230 op/s 2023-10-08T12:53:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:19 smithi092 ceph-mon[134093]: pgmap v690: 97 pgs: 97 active+clean; 643 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.5 MiB/s wr, 230 op/s 2023-10-08T12:53:20.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1538585 12.44 MB/sec execute 531 sec latency 84.095 ms 2023-10-08T12:53:21.549 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1540511 12.43 MB/sec execute 532 sec latency 26.422 ms 2023-10-08T12:53:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:22 smithi092 ceph-mon[134093]: pgmap v691: 97 pgs: 97 active+clean; 626 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.2 MiB/s wr, 227 op/s 2023-10-08T12:53:22.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:22 smithi173 ceph-mon[135182]: pgmap v691: 97 pgs: 97 active+clean; 626 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.2 MiB/s wr, 227 op/s 2023-10-08T12:53:22.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:22 smithi059 ceph-mon[98489]: pgmap v691: 97 pgs: 97 active+clean; 626 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.2 MiB/s wr, 227 op/s 2023-10-08T12:53:22.548 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1542565 12.43 MB/sec execute 533 sec latency 20.232 ms 2023-10-08T12:53:23.549 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1545150 12.43 MB/sec execute 534 sec latency 23.943 ms 2023-10-08T12:53:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:24 smithi092 ceph-mon[134093]: pgmap v692: 97 pgs: 97 active+clean; 582 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.5 MiB/s wr, 228 op/s 2023-10-08T12:53:24.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:24 smithi173 ceph-mon[135182]: pgmap v692: 97 pgs: 97 active+clean; 582 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.5 MiB/s wr, 228 op/s 2023-10-08T12:53:24.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:24 smithi059 ceph-mon[98489]: pgmap v692: 97 pgs: 97 active+clean; 582 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.5 MiB/s wr, 228 op/s 2023-10-08T12:53:24.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1546964 12.42 MB/sec execute 535 sec latency 29.055 ms 2023-10-08T12:53:25.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:53:25.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1549243 12.43 MB/sec execute 536 sec latency 67.541 ms 2023-10-08T12:53:25.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.704+0000 7fa4c3dff700 1 -- 172.21.15.59:0/693485408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4bc100740 msgr2=0x7fa4bc100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:25.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.704+0000 7fa4c3dff700 1 --2- 172.21.15.59:0/693485408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4bc100740 0x7fa4bc100bc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009990 tx=0x7fa4ac009ca0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.704+0000 7fa4c3dff700 1 -- 172.21.15.59:0/693485408 shutdown_connections 2023-10-08T12:53:25.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.704+0000 7fa4c3dff700 1 --2- 172.21.15.59:0/693485408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4bc101100 0x7fa4bc10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.704+0000 7fa4c3dff700 1 --2- 172.21.15.59:0/693485408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc106750 0x7fa4bc106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.704+0000 7fa4c3dff700 1 --2- 172.21.15.59:0/693485408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4bc100740 0x7fa4bc100bc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.704+0000 7fa4c3dff700 1 -- 172.21.15.59:0/693485408 >> 172.21.15.59:0/693485408 conn(0x7fa4bc0fc230 msgr2=0x7fa4bc0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:25.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.704+0000 7fa4c3dff700 1 -- 172.21.15.59:0/693485408 shutdown_connections 2023-10-08T12:53:25.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.704+0000 7fa4c3dff700 1 -- 172.21.15.59:0/693485408 wait complete. 2023-10-08T12:53:25.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.705+0000 7fa4c3dff700 1 Processor -- start 2023-10-08T12:53:25.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c3dff700 1 -- start start 2023-10-08T12:53:25.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c3dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4bc100740 0x7fa4bc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c3dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4bc101100 0x7fa4bc073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c3dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc106750 0x7fa4bc073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c3dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc1a4f70 con 0x7fa4bc106750 2023-10-08T12:53:25.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c3dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc1a50e0 con 0x7fa4bc101100 2023-10-08T12:53:25.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c3dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc1a52a0 con 0x7fa4bc100740 2023-10-08T12:53:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c139a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4bc101100 0x7fa4bc073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c139a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4bc101100 0x7fa4bc073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52838/0 (socket says 172.21.15.59:52838) 2023-10-08T12:53:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c139a700 1 -- 172.21.15.59:0/2019228546 learned_addr learned my addr 172.21.15.59:0/2019228546 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c239c700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc106750 0x7fa4bc073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.706+0000 7fa4c1b9b700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4bc100740 0x7fa4bc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.707+0000 7fa4c139a700 1 -- 172.21.15.59:0/2019228546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4bc100740 msgr2=0x7fa4bc072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.707+0000 7fa4c139a700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4bc100740 0x7fa4bc072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.707+0000 7fa4c139a700 1 -- 172.21.15.59:0/2019228546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc106750 msgr2=0x7fa4bc073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.707+0000 7fa4c139a700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc106750 0x7fa4bc073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.707+0000 7fa4c139a700 1 -- 172.21.15.59:0/2019228546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0095f0 con 0x7fa4bc101100 2023-10-08T12:53:25.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.707+0000 7fa4c139a700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4bc101100 0x7fa4bc073030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac005910 tx=0x7fa4ac004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:25.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.707+0000 7fa4b2ffd700 1 -- 172.21.15.59:0/2019228546 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac01d070 con 0x7fa4bc101100 2023-10-08T12:53:25.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.707+0000 7fa4b2ffd700 1 -- 172.21.15.59:0/2019228546 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4ac022470 con 0x7fa4bc101100 2023-10-08T12:53:25.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.707+0000 7fa4c3dff700 1 -- 172.21.15.59:0/2019228546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc1a5520 con 0x7fa4bc101100 2023-10-08T12:53:25.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.707+0000 7fa4b2ffd700 1 -- 172.21.15.59:0/2019228546 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac017650 con 0x7fa4bc101100 2023-10-08T12:53:25.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.707+0000 7fa4c3dff700 1 -- 172.21.15.59:0/2019228546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc1a5a00 con 0x7fa4bc101100 2023-10-08T12:53:25.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.711+0000 7fa4b2ffd700 1 -- 172.21.15.59:0/2019228546 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa4ac0225e0 con 0x7fa4bc101100 2023-10-08T12:53:25.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.712+0000 7fa4d762bb80 1 Processor -- start 2023-10-08T12:53:25.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.713+0000 7fa4d762bb80 1 -- start start 2023-10-08T12:53:25.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.713+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 0x5607850c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.713+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.713+0000 7fa4b2ffd700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4a80a15f0 0x7fa4a80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.713+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850d0e60 0x5607850d3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.713+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560785026460 con 0x5607850d0e60 2023-10-08T12:53:25.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.713+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560785017c20 con 0x5607850c5690 2023-10-08T12:53:25.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.713+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560785015540 con 0x5607850c5fb0 2023-10-08T12:53:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4b2ffd700 1 -- 172.21.15.59:0/2019228546 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa4ac0ce440 con 0x7fa4bc101100 2023-10-08T12:53:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c139a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c139a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58478/0 (socket says 172.21.15.59:58478) 2023-10-08T12:53:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c139a700 1 -- 172.21.15.59:0/365997345 learned_addr learned my addr 172.21.15.59:0/365997345 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c239c700 1 --2- 172.21.15.59:0/365997345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 0x5607850c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c239c700 1 --2- 172.21.15.59:0/365997345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850d0e60 0x5607850d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c1b9b700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4a80a15f0 0x7fa4a80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c139a700 1 -- 172.21.15.59:0/365997345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 msgr2=0x5607850c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c139a700 1 --2- 172.21.15.59:0/365997345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 0x5607850c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c139a700 1 -- 172.21.15.59:0/365997345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850d0e60 msgr2=0x5607850d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:25.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c139a700 1 --2- 172.21.15.59:0/365997345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850d0e60 0x5607850d3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c139a700 1 -- 172.21.15.59:0/365997345 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560784e3bde0 con 0x5607850c5fb0 2023-10-08T12:53:25.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c239c700 1 --2- 172.21.15.59:0/365997345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850d0e60 0x5607850d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:53:25.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.714+0000 7fa4c139a700 1 --2- 172.21.15.59:0/365997345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d0920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac000c00 tx=0x7fa4ac009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7449ff277b312f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:25.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.715+0000 7fa4c1b9b700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4a80a15f0 0x7fa4a80a3ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009bd0 tx=0x7fa4b8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:25.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.715+0000 7fa4a7fff700 1 -- 172.21.15.59:0/365997345 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac0cc000 con 0x5607850c5fb0 2023-10-08T12:53:25.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.715+0000 7fa4a7fff700 1 -- 172.21.15.59:0/365997345 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4ac099cf0 con 0x5607850c5fb0 2023-10-08T12:53:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.715+0000 7fa4a7fff700 1 -- 172.21.15.59:0/365997345 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac09b960 con 0x5607850c5fb0 2023-10-08T12:53:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.715+0000 7fa4d762bb80 1 -- 172.21.15.59:0/365997345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 msgr2=0x5607850d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.715+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/365997345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d0920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac000c00 tx=0x7fa4ac009310 comp rx=0 tx=0).stop 2023-10-08T12:53:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.715+0000 7fa4d762bb80 1 -- 172.21.15.59:0/365997345 shutdown_connections 2023-10-08T12:53:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.715+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/365997345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 0x5607850c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.715+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/365997345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850d0e60 0x5607850d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.715+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/365997345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d0920 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.715+0000 7fa4d762bb80 1 -- 172.21.15.59:0/365997345 >> 172.21.15.59:0/365997345 conn(0x560785032260 msgr2=0x5607850b92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.716+0000 7fa4d762bb80 1 -- 172.21.15.59:0/365997345 shutdown_connections 2023-10-08T12:53:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.716+0000 7fa4d762bb80 1 -- 172.21.15.59:0/365997345 wait complete. 2023-10-08T12:53:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.716+0000 7fa4d762bb80 1 -- start start 2023-10-08T12:53:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.716+0000 7fa4d762bb80 1 Processor -- start 2023-10-08T12:53:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5690 0x5607850d1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 0x5607850d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560785010e30 con 0x5607850c5690 2023-10-08T12:53:25.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560784fad710 con 0x5607850d0e60 2023-10-08T12:53:25.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560784fad3b0 con 0x5607850c5fb0 2023-10-08T12:53:25.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4d762bb80 10 client.0 _ll_register_callbacks cb 0x560784e0a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:25.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4c1b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5690 0x5607850d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4c139a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4c239c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 0x5607850d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4c139a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58490/0 (socket says 172.21.15.59:58490) 2023-10-08T12:53:25.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4c139a700 1 -- 172.21.15.59:0/28400739 learned_addr learned my addr 172.21.15.59:0/28400739 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:25.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4c139a700 1 -- 172.21.15.59:0/28400739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 msgr2=0x5607850d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:25.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4c139a700 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 0x5607850d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4c139a700 1 -- 172.21.15.59:0/28400739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5690 msgr2=0x5607850d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:25.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4c139a700 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5690 0x5607850d1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4c139a700 1 -- 172.21.15.59:0/28400739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc1a5a00 con 0x5607850c5fb0 2023-10-08T12:53:25.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.717+0000 7fa4c239c700 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 0x5607850d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:25.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.718+0000 7fa4c139a700 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d1780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac09a400 tx=0x7fa4ac0cbaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e58e5e58b5724caf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:25.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.718+0000 7fa4a57fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:53:25.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.718+0000 7fa4a57fa700 1 -- 172.21.15.59:0/28400739 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac09bba0 con 0x5607850c5fb0 2023-10-08T12:53:25.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.718+0000 7fa4d762bb80 1 -- 172.21.15.59:0/28400739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560784fd8eb0 con 0x5607850c5fb0 2023-10-08T12:53:25.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.718+0000 7fa4a57fa700 1 -- 172.21.15.59:0/28400739 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa4ac09b4a0 con 0x5607850c5fb0 2023-10-08T12:53:25.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.718+0000 7fa4a57fa700 1 -- 172.21.15.59:0/28400739 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4ac09f5f0 con 0x5607850c5fb0 2023-10-08T12:53:25.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.718+0000 7fa4d762bb80 10 client.27235 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:25.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.718+0000 7fa4d762bb80 1 -- 172.21.15.59:0/28400739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x560784e24c60 con 0x5607850c5fb0 2023-10-08T12:53:25.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.718+0000 7fa4a57fa700 1 -- 172.21.15.59:0/28400739 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560784fd8eb0 con 0x5607850c5fb0 2023-10-08T12:53:25.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.719+0000 7fa4a57fa700 1 -- 172.21.15.59:0/28400739 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa4ac09b700 con 0x5607850c5fb0 2023-10-08T12:53:25.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.719+0000 7fa4d762bb80 10 client.27235 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:25.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.719+0000 7fa4d762bb80 10 client.27235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:25.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.719+0000 7fa4d762bb80 20 client.27235 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:25.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.719+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607850e0110 0x5607850e2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.719+0000 7fa4d762bb80 4 client.27235 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:53:25.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.719+0000 7fa4d762bb80 1 -- 172.21.15.59:0/28400739 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560785009e10 con 0x5607850e0110 2023-10-08T12:53:25.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.719+0000 7fa4c1b9b700 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607850e0110 0x5607850e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.720+0000 7fa4c1b9b700 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607850e0110 0x5607850e2530 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=787ea1f7217e3be3 server_cookie=831614c7b1066a2c in_seq=0 out_seq=0 2023-10-08T12:53:25.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.720+0000 7fa4a57fa700 10 client.27235 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:25.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.720+0000 7fa4a57fa700 1 -- 172.21.15.59:0/28400739 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560785009e10 con 0x5607850e0110 2023-10-08T12:53:25.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.720+0000 7fa4a57fa700 10 client.27235 handle_command_reply: tid=0 2023-10-08T12:53:25.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.720+0000 7fa4d762bb80 1 client.27235 shutdown 2023-10-08T12:53:25.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.720+0000 7fa4d762bb80 1 -- 172.21.15.59:0/28400739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 msgr2=0x5607850d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:25.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.720+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d1780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac09a400 tx=0x7fa4ac0cbaf0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.721+0000 7fa4d762bb80 1 -- 172.21.15.59:0/28400739 shutdown_connections 2023-10-08T12:53:25.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.721+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5607850e0110 0x5607850e2530 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.721+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 0x5607850d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.721+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5690 0x5607850d1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.721+0000 7fa4a57fa700 0 client.27235 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:25.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.721+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/28400739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x5607850d1780 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.721+0000 7fa4d762bb80 1 -- 172.21.15.59:0/28400739 >> 172.21.15.59:0/28400739 conn(0x560785032260 msgr2=0x5607850b8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:25.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.721+0000 7fa4d762bb80 1 -- 172.21.15.59:0/28400739 shutdown_connections 2023-10-08T12:53:25.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.721+0000 7fa4d762bb80 1 -- 172.21.15.59:0/28400739 wait complete. 2023-10-08T12:53:25.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.721+0000 7fa4d762bb80 20 client.27235 trim_cache size 0 max 16384 2023-10-08T12:53:25.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.740+0000 7fa4d762bb80 1 Processor -- start 2023-10-08T12:53:25.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.740+0000 7fa4d762bb80 1 -- start start 2023-10-08T12:53:25.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.740+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5690 0x5607850d5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.740+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5fb0 0x5607850b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.740+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 0x5607850cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.740+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560784e91920 con 0x5607850c5fb0 2023-10-08T12:53:25.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.740+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560784fd8eb0 con 0x5607850d0e60 2023-10-08T12:53:25.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.740+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607850d05b0 con 0x5607850c5690 2023-10-08T12:53:25.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.740+0000 7fa4c139a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5fb0 0x5607850b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c239c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 0x5607850cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c139a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5fb0 0x5607850b8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56358/0 (socket says 172.21.15.59:56358) 2023-10-08T12:53:25.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c239c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 0x5607850cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52858/0 (socket says 172.21.15.59:52858) 2023-10-08T12:53:25.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c139a700 1 -- 172.21.15.59:0/3789547226 learned_addr learned my addr 172.21.15.59:0/3789547226 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:25.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c1b9b700 1 --2- 172.21.15.59:0/3789547226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5690 0x5607850d5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c239c700 1 -- 172.21.15.59:0/3789547226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5690 msgr2=0x5607850d5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:25.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c239c700 1 --2- 172.21.15.59:0/3789547226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5690 0x5607850d5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c239c700 1 -- 172.21.15.59:0/3789547226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5fb0 msgr2=0x5607850b8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:25.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c239c700 1 --2- 172.21.15.59:0/3789547226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5fb0 0x5607850b8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c239c700 1 -- 172.21.15.59:0/3789547226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560784e62250 con 0x5607850d0e60 2023-10-08T12:53:25.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c139a700 1 --2- 172.21.15.59:0/3789547226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5fb0 0x5607850b8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:25.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4c239c700 1 --2- 172.21.15.59:0/3789547226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 0x5607850cb380 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x5607850d0e30 tx=0x7fa4b4004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ce169ec125ebe45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:25.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.741+0000 7fa4b0bff700 1 -- 172.21.15.59:0/3789547226 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400e030 con 0x5607850d0e60 2023-10-08T12:53:25.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.742+0000 7fa4b0bff700 1 -- 172.21.15.59:0/3789547226 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4b4007e90 con 0x5607850d0e60 2023-10-08T12:53:25.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.742+0000 7fa4b0bff700 1 -- 172.21.15.59:0/3789547226 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4018b30 con 0x5607850d0e60 2023-10-08T12:53:25.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.742+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3789547226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 msgr2=0x5607850cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:25.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.742+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/3789547226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 0x5607850cb380 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x5607850d0e30 tx=0x7fa4b4004b40 comp rx=0 tx=0).stop 2023-10-08T12:53:25.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.742+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3789547226 shutdown_connections 2023-10-08T12:53:25.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.742+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/3789547226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850d0e60 0x5607850cb380 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.742+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/3789547226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5690 0x5607850d5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.742+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/3789547226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850c5fb0 0x5607850b8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.742+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3789547226 >> 172.21.15.59:0/3789547226 conn(0x560785032260 msgr2=0x5607850b84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:25.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.742+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3789547226 shutdown_connections 2023-10-08T12:53:25.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.742+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3789547226 wait complete. 2023-10-08T12:53:25.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.743+0000 7fa4d762bb80 1 -- start start 2023-10-08T12:53:25.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.743+0000 7fa4d762bb80 1 Processor -- start 2023-10-08T12:53:25.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.743+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 0x56078512c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.743+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x56078512c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.743+0000 7fa4d762bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850d0e60 0x560785127e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560785128570 con 0x5607850d0e60 2023-10-08T12:53:25.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607851286e0 con 0x5607850c5690 2023-10-08T12:53:25.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4d762bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607851288a0 con 0x5607850c5fb0 2023-10-08T12:53:25.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4d762bb80 10 client.0 _ll_register_callbacks cb 0x560784e0a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:25.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4c1b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 0x56078512c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4c1b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 0x56078512c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52866/0 (socket says 172.21.15.59:52866) 2023-10-08T12:53:25.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4c1b9b700 1 -- 172.21.15.59:0/3452639455 learned_addr learned my addr 172.21.15.59:0/3452639455 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:25.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4c239c700 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850d0e60 0x560785127e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4c139a700 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x56078512c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4c1b9b700 1 -- 172.21.15.59:0/3452639455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 msgr2=0x56078512c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:25.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4c1b9b700 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x56078512c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4c1b9b700 1 -- 172.21.15.59:0/3452639455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850d0e60 msgr2=0x560785127e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:25.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4c1b9b700 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850d0e60 0x560785127e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4c1b9b700 1 -- 172.21.15.59:0/3452639455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560784e24c60 con 0x5607850c5690 2023-10-08T12:53:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4c1b9b700 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 0x56078512c2e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x5607850e2e00 tx=0x7fa4b8013070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c96a450b9a205ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.744+0000 7fa4a57fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:53:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4a57fa700 1 -- 172.21.15.59:0/3452639455 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8025c70 con 0x5607850c5690 2023-10-08T12:53:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3452639455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4ac099cf0 con 0x5607850c5690 2023-10-08T12:53:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4a57fa700 1 -- 172.21.15.59:0/3452639455 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa4b8017070 con 0x5607850c5690 2023-10-08T12:53:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4a57fa700 1 -- 172.21.15.59:0/3452639455 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4b8025dd0 con 0x5607850c5690 2023-10-08T12:53:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4d762bb80 10 client.27251 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3452639455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fa4b4009200 con 0x5607850c5690 2023-10-08T12:53:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4a57fa700 1 -- 172.21.15.59:0/3452639455 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4ac099cf0 con 0x5607850c5690 2023-10-08T12:53:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4a57fa700 1 -- 172.21.15.59:0/3452639455 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa4b80384c0 con 0x5607850c5690 2023-10-08T12:53:25.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4d762bb80 10 client.27251 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:25.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4d762bb80 10 client.27251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:25.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4d762bb80 20 client.27251 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:25.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560785135210 0x560785137630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:25.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4d762bb80 4 client.27251 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:53:25.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.745+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3452639455 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560785009b30 con 0x560785135210 2023-10-08T12:53:25.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.746+0000 7fa4c139a700 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560785135210 0x560785137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:25.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.746+0000 7fa4c139a700 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560785135210 0x560785137630 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f2793fc822bc091 server_cookie=13d9ae412117f7cd in_seq=0 out_seq=0 2023-10-08T12:53:25.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.746+0000 7fa4a57fa700 10 client.27251 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:25.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.746+0000 7fa4a57fa700 1 -- 172.21.15.59:0/3452639455 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560785009b30 con 0x560785135210 2023-10-08T12:53:25.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.746+0000 7fa4a57fa700 10 client.27251 handle_command_reply: tid=0 2023-10-08T12:53:25.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.746+0000 7fa4d762bb80 1 client.27251 shutdown 2023-10-08T12:53:25.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.747+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3452639455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 msgr2=0x56078512c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:25.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.747+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 0x56078512c2e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x5607850e2e00 tx=0x7fa4b8013070 comp rx=0 tx=0).stop 2023-10-08T12:53:25.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.747+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3452639455 shutdown_connections 2023-10-08T12:53:25.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.747+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560785135210 0x560785137630 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.747+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607850c5690 0x56078512c2e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.747+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5607850d0e60 0x560785127e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.747+0000 7fa4d762bb80 1 --2- 172.21.15.59:0/3452639455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607850c5fb0 0x56078512c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.747+0000 7fa4a57fa700 0 client.27251 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:25.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.747+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3452639455 >> 172.21.15.59:0/3452639455 conn(0x560785032260 msgr2=0x5607850b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:25.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.747+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3452639455 shutdown_connections 2023-10-08T12:53:25.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.747+0000 7fa4d762bb80 1 -- 172.21.15.59:0/3452639455 wait complete. 2023-10-08T12:53:25.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4d762bb80 20 client.27251 trim_cache size 0 max 16384 2023-10-08T12:53:25.755 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:53:25.756 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:53:25.756 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:53:25.756 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:53:25.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 -- 172.21.15.59:0/2019228546 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4a80a15f0 msgr2=0x7fa4a80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:25.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4a80a15f0 0x7fa4a80a3ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009bd0 tx=0x7fa4b8009260 comp rx=0 tx=0).stop 2023-10-08T12:53:25.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 -- 172.21.15.59:0/2019228546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4bc101100 msgr2=0x7fa4bc073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:25.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4bc101100 0x7fa4bc073030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac005910 tx=0x7fa4ac004730 comp rx=0 tx=0).stop 2023-10-08T12:53:25.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 -- 172.21.15.59:0/2019228546 shutdown_connections 2023-10-08T12:53:25.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4a80a15f0 0x7fa4a80a3ab0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc106750 0x7fa4bc073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4bc100740 0x7fa4bc072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 --2- 172.21.15.59:0/2019228546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4bc101100 0x7fa4bc073030 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:25.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 -- 172.21.15.59:0/2019228546 >> 172.21.15.59:0/2019228546 conn(0x7fa4bc0fc230 msgr2=0x7fa4bc0fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:25.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 -- 172.21.15.59:0/2019228546 shutdown_connections 2023-10-08T12:53:25.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:25.748+0000 7fa4c3dff700 1 -- 172.21.15.59:0/2019228546 wait complete. 2023-10-08T12:53:25.769 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:53:25.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:53:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.021+0000 7f7b451ff700 1 -- 172.21.15.59:0/29554746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40107870 msgr2=0x7f7b4010b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.021+0000 7f7b451ff700 1 --2- 172.21.15.59:0/29554746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40107870 0x7f7b4010b8b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7b280098f0 tx=0x7f7b28009c00 comp rx=0 tx=0).stop 2023-10-08T12:53:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.021+0000 7f7b451ff700 1 -- 172.21.15.59:0/29554746 shutdown_connections 2023-10-08T12:53:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.021+0000 7f7b451ff700 1 --2- 172.21.15.59:0/29554746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4010bfe0 0x7f7b40113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.021+0000 7f7b451ff700 1 --2- 172.21.15.59:0/29554746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b40106ec0 0x7f7b401072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.021+0000 7f7b451ff700 1 --2- 172.21.15.59:0/29554746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40107870 0x7f7b4010b8b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.021+0000 7f7b451ff700 1 -- 172.21.15.59:0/29554746 >> 172.21.15.59:0/29554746 conn(0x7f7b400763e0 msgr2=0x7f7b40078800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.022+0000 7f7b451ff700 1 -- 172.21.15.59:0/29554746 shutdown_connections 2023-10-08T12:53:26.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.022+0000 7f7b451ff700 1 -- 172.21.15.59:0/29554746 wait complete. 2023-10-08T12:53:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.024+0000 7f7b451ff700 1 Processor -- start 2023-10-08T12:53:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.024+0000 7f7b451ff700 1 -- start start 2023-10-08T12:53:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.025+0000 7f7b451ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40106ec0 0x7f7b40071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.025+0000 7f7b451ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4010bfe0 0x7f7b4006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.025+0000 7f7b451ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006b560 0x7f7b4006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.025+0000 7f7b451ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b40072800 con 0x7f7b4006b560 2023-10-08T12:53:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.025+0000 7f7b451ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4006fae0 con 0x7f7b4010bfe0 2023-10-08T12:53:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.025+0000 7f7b451ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4006fca0 con 0x7f7b40106ec0 2023-10-08T12:53:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.026+0000 7f7b3f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006b560 0x7f7b4006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.026+0000 7f7b3f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006b560 0x7f7b4006b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56392/0 (socket says 172.21.15.59:56392) 2023-10-08T12:53:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.026+0000 7f7b3f59e700 1 -- 172.21.15.59:0/4123376999 learned_addr learned my addr 172.21.15.59:0/4123376999 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.027+0000 7f7b3e59c700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4010bfe0 0x7f7b4006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.027+0000 7f7b3f59e700 1 -- 172.21.15.59:0/4123376999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40106ec0 msgr2=0x7f7b40071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.027+0000 7f7b3f59e700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40106ec0 0x7f7b40071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.027+0000 7f7b3f59e700 1 -- 172.21.15.59:0/4123376999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4010bfe0 msgr2=0x7f7b4006b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.027+0000 7f7b3f59e700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4010bfe0 0x7f7b4006b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.027+0000 7f7b3f59e700 1 -- 172.21.15.59:0/4123376999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b28009520 con 0x7f7b4006b560 2023-10-08T12:53:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.027+0000 7f7b3e59c700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4010bfe0 0x7f7b4006b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:53:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.028+0000 7f7b3f59e700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006b560 0x7f7b4006b9e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000b550 tx=0x7f7b3000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.029+0000 7f7b37fff700 1 -- 172.21.15.59:0/4123376999 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30011830 con 0x7f7b4006b560 2023-10-08T12:53:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.029+0000 7f7b37fff700 1 -- 172.21.15.59:0/4123376999 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b30011e50 con 0x7f7b4006b560 2023-10-08T12:53:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.029+0000 7f7b37fff700 1 -- 172.21.15.59:0/4123376999 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30010e70 con 0x7f7b4006b560 2023-10-08T12:53:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.029+0000 7f7b451ff700 1 -- 172.21.15.59:0/4123376999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4006ff80 con 0x7f7b4006b560 2023-10-08T12:53:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.030+0000 7f7b451ff700 1 -- 172.21.15.59:0/4123376999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b40070440 con 0x7f7b4006b560 2023-10-08T12:53:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.037+0000 7f7b451ff700 1 -- 172.21.15.59:0/4123376999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b200052f0 con 0x7f7b4006b560 2023-10-08T12:53:26.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.040+0000 7f7b37fff700 1 -- 172.21.15.59:0/4123376999 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7b30011990 con 0x7f7b4006b560 2023-10-08T12:53:26.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.042+0000 7f7b37fff700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b2c0a1800 0x7f7b2c0a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.042+0000 7f7b37fff700 1 -- 172.21.15.59:0/4123376999 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7b300cc920 con 0x7f7b4006b560 2023-10-08T12:53:26.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.044+0000 7f7b3ed9d700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b2c0a1800 0x7f7b2c0a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.049+0000 7f7b3ed9d700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b2c0a1800 0x7f7b2c0a3cc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7b380062a0 tx=0x7f7b380061f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:26.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.050+0000 7f7b37fff700 1 -- 172.21.15.59:0/4123376999 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7b30095d40 con 0x7f7b4006b560 2023-10-08T12:53:26.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:26 smithi059 ceph-mon[98489]: pgmap v693: 97 pgs: 97 active+clean; 590 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.8 MiB/s wr, 253 op/s 2023-10-08T12:53:26.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.336+0000 7f7b451ff700 1 -- 172.21.15.59:0/4123376999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b200055a0 con 0x7f7b4006b560 2023-10-08T12:53:26.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.337+0000 7f7b37fff700 1 -- 172.21.15.59:0/4123376999 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f7b30015090 con 0x7f7b4006b560 2023-10-08T12:53:26.338 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:53:26.338 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:53:26.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 -- 172.21.15.59:0/4123376999 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b2c0a1800 msgr2=0x7f7b2c0a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b2c0a1800 0x7f7b2c0a3cc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7b380062a0 tx=0x7f7b380061f0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 -- 172.21.15.59:0/4123376999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006b560 msgr2=0x7f7b4006b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006b560 0x7f7b4006b9e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000b550 tx=0x7f7b3000b910 comp rx=0 tx=0).stop 2023-10-08T12:53:26.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 -- 172.21.15.59:0/4123376999 shutdown_connections 2023-10-08T12:53:26.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b2c0a1800 0x7f7b2c0a3cc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006b560 0x7f7b4006b9e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40106ec0 0x7f7b40071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 --2- 172.21.15.59:0/4123376999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4010bfe0 0x7f7b4006b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 -- 172.21.15.59:0/4123376999 >> 172.21.15.59:0/4123376999 conn(0x7f7b400763e0 msgr2=0x7f7b40077890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:26.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 -- 172.21.15.59:0/4123376999 shutdown_connections 2023-10-08T12:53:26.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.340+0000 7f7b451ff700 1 -- 172.21.15.59:0/4123376999 wait complete. 2023-10-08T12:53:26.342 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:53:26.360 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:53:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:26 smithi092 ceph-mon[134093]: pgmap v693: 97 pgs: 97 active+clean; 590 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.8 MiB/s wr, 253 op/s 2023-10-08T12:53:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:26 smithi173 ceph-mon[135182]: pgmap v693: 97 pgs: 97 active+clean; 590 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.8 MiB/s wr, 253 op/s 2023-10-08T12:53:26.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1550715 12.41 MB/sec execute 537 sec latency 118.669 ms 2023-10-08T12:53:26.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.582+0000 7f44433ff700 1 -- 172.21.15.59:0/2590915232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443c073540 msgr2=0x7f443c10ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.582+0000 7f44433ff700 1 --2- 172.21.15.59:0/2590915232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443c073540 0x7f443c10ca30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f442c009990 tx=0x7f442c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.582+0000 7f44433ff700 1 -- 172.21.15.59:0/2590915232 shutdown_connections 2023-10-08T12:53:26.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.582+0000 7f44433ff700 1 --2- 172.21.15.59:0/2590915232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443c10cf70 0x7f443c10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.582+0000 7f44433ff700 1 --2- 172.21.15.59:0/2590915232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f443c072c20 0x7f443c073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.582+0000 7f44433ff700 1 --2- 172.21.15.59:0/2590915232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443c073540 0x7f443c10ca30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.582+0000 7f44433ff700 1 -- 172.21.15.59:0/2590915232 >> 172.21.15.59:0/2590915232 conn(0x7f443c0fc200 msgr2=0x7f443c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:26.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.583+0000 7f44433ff700 1 -- 172.21.15.59:0/2590915232 shutdown_connections 2023-10-08T12:53:26.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.583+0000 7f44433ff700 1 -- 172.21.15.59:0/2590915232 wait complete. 2023-10-08T12:53:26.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.584+0000 7f44433ff700 1 Processor -- start 2023-10-08T12:53:26.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.584+0000 7f44433ff700 1 -- start start 2023-10-08T12:53:26.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f44433ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443c072c20 0x7f443c198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f44433ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443c073540 0x7f443c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f44433ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f443c10cf70 0x7f443c19d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f44433ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c19ddb0 con 0x7f443c073540 2023-10-08T12:53:26.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f44433ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c19df20 con 0x7f443c072c20 2023-10-08T12:53:26.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f44433ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c19e0e0 con 0x7f443c10cf70 2023-10-08T12:53:26.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f444119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443c072c20 0x7f443c198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f444199c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f443c10cf70 0x7f443c19d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f444119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443c072c20 0x7f443c198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52908/0 (socket says 172.21.15.59:52908) 2023-10-08T12:53:26.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f444119b700 1 -- 172.21.15.59:0/834433339 learned_addr learned my addr 172.21.15.59:0/834433339 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:26.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f444099a700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443c073540 0x7f443c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f444199c700 1 -- 172.21.15.59:0/834433339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443c072c20 msgr2=0x7f443c198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f444199c700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443c072c20 0x7f443c198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f444199c700 1 -- 172.21.15.59:0/834433339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443c073540 msgr2=0x7f443c1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f444199c700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443c073540 0x7f443c1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.585+0000 7f444199c700 1 -- 172.21.15.59:0/834433339 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c0095f0 con 0x7f443c10cf70 2023-10-08T12:53:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.586+0000 7f444119b700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443c072c20 0x7f443c198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.586+0000 7f444199c700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f443c10cf70 0x7f443c19d770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f443400efc0 tx=0x7f443400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.586+0000 7f44327fc700 1 -- 172.21.15.59:0/834433339 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434018070 con 0x7f443c10cf70 2023-10-08T12:53:26.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.586+0000 7f44327fc700 1 -- 172.21.15.59:0/834433339 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f443400f040 con 0x7f443c10cf70 2023-10-08T12:53:26.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.586+0000 7f44433ff700 1 -- 172.21.15.59:0/834433339 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c19e360 con 0x7f443c10cf70 2023-10-08T12:53:26.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.586+0000 7f44327fc700 1 -- 172.21.15.59:0/834433339 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443400cd40 con 0x7f443c10cf70 2023-10-08T12:53:26.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.586+0000 7f44433ff700 1 -- 172.21.15.59:0/834433339 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c1a5c00 con 0x7f443c10cf70 2023-10-08T12:53:26.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.589+0000 7f44327fc700 1 -- 172.21.15.59:0/834433339 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f4434003a00 con 0x7f443c10cf70 2023-10-08T12:53:26.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.591+0000 7f4456d57b80 1 Processor -- start 2023-10-08T12:53:26.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.591+0000 7f4456d57b80 1 -- start start 2023-10-08T12:53:26.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.591+0000 7f44327fc700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44280a15f0 0x7f44280a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.591+0000 7f44327fc700 1 -- 172.21.15.59:0/834433339 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f44340ccc50 con 0x7f443c10cf70 2023-10-08T12:53:26.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.591+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f4de80 0x55f500f4e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.591+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f59110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.591+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f5ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.591+0000 7f4456d57b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500eb7460 con 0x55f500f4de80 2023-10-08T12:53:26.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.591+0000 7f4456d57b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500ea8c20 con 0x55f500f59650 2023-10-08T12:53:26.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.591+0000 7f4456d57b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500ea6540 con 0x55f500f4e7a0 2023-10-08T12:53:26.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.591+0000 7f444099a700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44280a15f0 0x7f44280a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444119b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f4de80 0x55f500f4e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444199c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f5ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444199c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f5ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52914/0 (socket says 172.21.15.59:52914) 2023-10-08T12:53:26.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444099a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f59110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444199c700 1 -- 172.21.15.59:0/3356949746 learned_addr learned my addr 172.21.15.59:0/3356949746 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:26.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444199c700 1 -- 172.21.15.59:0/3356949746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 msgr2=0x55f500f59110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:26.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444199c700 1 --2- 172.21.15.59:0/3356949746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f59110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444199c700 1 -- 172.21.15.59:0/3356949746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f4de80 msgr2=0x55f500f4e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:26.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444199c700 1 --2- 172.21.15.59:0/3356949746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f4de80 0x55f500f4e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444199c700 1 -- 172.21.15.59:0/3356949746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f500cccde0 con 0x55f500f59650 2023-10-08T12:53:26.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444099a700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44280a15f0 0x7f44280a3ab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f443c19a3e0 tx=0x7f442c005320 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:26.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f444199c700 1 --2- 172.21.15.59:0/3356949746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f5ba40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4434096720 tx=0x7f44340960f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71cb8ef00efdde58 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:26.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.592+0000 7f44277fe700 1 -- 172.21.15.59:0/3356949746 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434004ad0 con 0x55f500f59650 2023-10-08T12:53:26.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.593+0000 7f44277fe700 1 -- 172.21.15.59:0/3356949746 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f443401b320 con 0x55f500f59650 2023-10-08T12:53:26.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.593+0000 7f44277fe700 1 -- 172.21.15.59:0/3356949746 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434099f10 con 0x55f500f59650 2023-10-08T12:53:26.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.593+0000 7f4456d57b80 1 -- 172.21.15.59:0/3356949746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 msgr2=0x55f500f5ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.593+0000 7f4456d57b80 1 --2- 172.21.15.59:0/3356949746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f5ba40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4434096720 tx=0x7f44340960f0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.593+0000 7f4456d57b80 1 -- 172.21.15.59:0/3356949746 shutdown_connections 2023-10-08T12:53:26.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.593+0000 7f4456d57b80 1 --2- 172.21.15.59:0/3356949746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f5ba40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.593+0000 7f4456d57b80 1 --2- 172.21.15.59:0/3356949746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f4de80 0x55f500f4e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.593+0000 7f4456d57b80 1 --2- 172.21.15.59:0/3356949746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f59110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.593+0000 7f4456d57b80 1 -- 172.21.15.59:0/3356949746 >> 172.21.15.59:0/3356949746 conn(0x55f500ec3260 msgr2=0x55f500f4a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:26.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.594+0000 7f4456d57b80 1 -- 172.21.15.59:0/3356949746 shutdown_connections 2023-10-08T12:53:26.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.594+0000 7f4456d57b80 1 -- 172.21.15.59:0/3356949746 wait complete. 2023-10-08T12:53:26.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.594+0000 7f4456d57b80 1 -- start start 2023-10-08T12:53:26.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.594+0000 7f4456d57b80 1 Processor -- start 2023-10-08T12:53:26.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f56410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f56950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f59650 0x55f500f56e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f4456d57b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500ea1e30 con 0x55f500f59650 2023-10-08T12:53:26.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f4456d57b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500e3e710 con 0x55f500f4de80 2023-10-08T12:53:26.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f4456d57b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500e3e3b0 con 0x55f500f4e7a0 2023-10-08T12:53:26.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f4456d57b80 10 client.0 _ll_register_callbacks cb 0x55f500c9b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:26.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f444119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f56410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f444119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f56410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52920/0 (socket says 172.21.15.59:52920) 2023-10-08T12:53:26.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f444119b700 1 -- 172.21.15.59:0/278373373 learned_addr learned my addr 172.21.15.59:0/278373373 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:26.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f444099a700 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f56950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.595+0000 7f444199c700 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f59650 0x55f500f56e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f444119b700 1 -- 172.21.15.59:0/278373373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 msgr2=0x55f500f56950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:26.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f444119b700 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f56950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f444119b700 1 -- 172.21.15.59:0/278373373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f59650 msgr2=0x55f500f56e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:26.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f444119b700 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f59650 0x55f500f56e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f444119b700 1 -- 172.21.15.59:0/278373373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c1a5c00 con 0x55f500f4de80 2023-10-08T12:53:26.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f444199c700 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f59650 0x55f500f56e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:53:26.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f444119b700 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f56410 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4438012cd0 tx=0x7f443800f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac12fa6773a2161d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:26.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f4424ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:53:26.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f4424ff9700 1 -- 172.21.15.59:0/278373373 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438017070 con 0x55f500f4de80 2023-10-08T12:53:26.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f4424ff9700 1 -- 172.21.15.59:0/278373373 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f443800fa70 con 0x55f500f4de80 2023-10-08T12:53:26.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f4456d57b80 1 -- 172.21.15.59:0/278373373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f500e69eb0 con 0x55f500f4de80 2023-10-08T12:53:26.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f4424ff9700 1 -- 172.21.15.59:0/278373373 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f443800fc30 con 0x55f500f4de80 2023-10-08T12:53:26.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f4456d57b80 10 client.27263 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:26.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.596+0000 7f4456d57b80 1 -- 172.21.15.59:0/278373373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55f500cb5c60 con 0x55f500f4de80 2023-10-08T12:53:26.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.597+0000 7f4424ff9700 1 -- 172.21.15.59:0/278373373 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f500e69eb0 con 0x55f500f4de80 2023-10-08T12:53:26.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.597+0000 7f4424ff9700 1 -- 172.21.15.59:0/278373373 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4438003ad0 con 0x55f500f4de80 2023-10-08T12:53:26.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.597+0000 7f4456d57b80 10 client.27263 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:26.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.597+0000 7f4456d57b80 10 client.27263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:26.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.597+0000 7f4456d57b80 20 client.27263 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:26.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.597+0000 7f4456d57b80 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f500f691d0 0x55f500f6b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.597+0000 7f4456d57b80 4 client.27263 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:53:26.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.597+0000 7f4456d57b80 1 -- 172.21.15.59:0/278373373 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f500e9ae10 con 0x55f500f691d0 2023-10-08T12:53:26.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.597+0000 7f444099a700 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f500f691d0 0x55f500f6b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.598+0000 7f444099a700 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f500f691d0 0x55f500f6b5f0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f7b7767c7cd2b32 server_cookie=46af63b82ebe5e2 in_seq=0 out_seq=0 2023-10-08T12:53:26.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.598+0000 7f4424ff9700 10 client.27263 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:26.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.598+0000 7f4424ff9700 1 -- 172.21.15.59:0/278373373 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f500e9ae10 con 0x55f500f691d0 2023-10-08T12:53:26.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4424ff9700 10 client.27263 handle_command_reply: tid=0 2023-10-08T12:53:26.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 1 client.27263 shutdown 2023-10-08T12:53:26.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 1 -- 172.21.15.59:0/278373373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 msgr2=0x55f500f56410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f56410 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4438012cd0 tx=0x7f443800f3c0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 1 -- 172.21.15.59:0/278373373 shutdown_connections 2023-10-08T12:53:26.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f500f691d0 0x55f500f6b5f0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f56410 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f59650 0x55f500f56e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4424ff9700 0 client.27263 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:26.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 1 --2- 172.21.15.59:0/278373373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f56950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 1 -- 172.21.15.59:0/278373373 >> 172.21.15.59:0/278373373 conn(0x55f500ec3260 msgr2=0x55f500f49ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:26.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 1 -- 172.21.15.59:0/278373373 shutdown_connections 2023-10-08T12:53:26.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 1 -- 172.21.15.59:0/278373373 wait complete. 2023-10-08T12:53:26.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.599+0000 7f4456d57b80 20 client.27263 trim_cache size 0 max 16384 2023-10-08T12:53:26.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.615+0000 7f4456d57b80 1 Processor -- start 2023-10-08T12:53:26.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.615+0000 7f4456d57b80 1 -- start start 2023-10-08T12:53:26.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.615+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f4de80 0x55f500f55d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.615+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f51750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.615+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f51c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.615+0000 7f4456d57b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500d22920 con 0x55f500f4de80 2023-10-08T12:53:26.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.615+0000 7f4456d57b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500f50db0 con 0x55f500f59650 2023-10-08T12:53:26.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.615+0000 7f4456d57b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500f4f0d0 con 0x55f500f4e7a0 2023-10-08T12:53:26.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.615+0000 7f444199c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f51c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444099a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f51750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444199c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f51c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52934/0 (socket says 172.21.15.59:52934) 2023-10-08T12:53:26.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444199c700 1 -- 172.21.15.59:0/849835022 learned_addr learned my addr 172.21.15.59:0/849835022 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:26.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444119b700 1 --2- 172.21.15.59:0/849835022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f4de80 0x55f500f55d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444199c700 1 -- 172.21.15.59:0/849835022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 msgr2=0x55f500f51750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:26.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444199c700 1 --2- 172.21.15.59:0/849835022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f51750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444199c700 1 -- 172.21.15.59:0/849835022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f4de80 msgr2=0x55f500f55d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:26.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444199c700 1 --2- 172.21.15.59:0/849835022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f4de80 0x55f500f55d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444199c700 1 -- 172.21.15.59:0/849835022 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f500cf3250 con 0x55f500f59650 2023-10-08T12:53:26.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444099a700 1 --2- 172.21.15.59:0/849835022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f51750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:26.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444119b700 1 --2- 172.21.15.59:0/849835022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f4de80 0x55f500f55d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:53:26.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f444199c700 1 --2- 172.21.15.59:0/849835022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f51c90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4434098000 tx=0x7f4434009420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f32b3e2eeb55d227 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:26.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f4427fff700 1 -- 172.21.15.59:0/849835022 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443409a3b0 con 0x55f500f59650 2023-10-08T12:53:26.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f4427fff700 1 -- 172.21.15.59:0/849835022 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f443409de00 con 0x55f500f59650 2023-10-08T12:53:26.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.616+0000 7f4427fff700 1 -- 172.21.15.59:0/849835022 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44340b2270 con 0x55f500f59650 2023-10-08T12:53:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.617+0000 7f4456d57b80 1 -- 172.21.15.59:0/849835022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 msgr2=0x55f500f51c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.617+0000 7f4456d57b80 1 --2- 172.21.15.59:0/849835022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f51c90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4434098000 tx=0x7f4434009420 comp rx=0 tx=0).stop 2023-10-08T12:53:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.617+0000 7f4456d57b80 1 -- 172.21.15.59:0/849835022 shutdown_connections 2023-10-08T12:53:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.617+0000 7f4456d57b80 1 --2- 172.21.15.59:0/849835022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f59650 0x55f500f51c90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.617+0000 7f4456d57b80 1 --2- 172.21.15.59:0/849835022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f4de80 0x55f500f55d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.617+0000 7f4456d57b80 1 --2- 172.21.15.59:0/849835022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f51750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.617+0000 7f4456d57b80 1 -- 172.21.15.59:0/849835022 >> 172.21.15.59:0/849835022 conn(0x55f500ec3260 msgr2=0x55f500f648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.617+0000 7f4456d57b80 1 -- 172.21.15.59:0/849835022 shutdown_connections 2023-10-08T12:53:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.618+0000 7f4456d57b80 1 -- 172.21.15.59:0/849835022 wait complete. 2023-10-08T12:53:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.618+0000 7f4456d57b80 1 -- start start 2023-10-08T12:53:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.618+0000 7f4456d57b80 1 Processor -- start 2023-10-08T12:53:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f5ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f5e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f4456d57b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f59650 0x55f500f5eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f4456d57b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500f5f030 con 0x55f500f59650 2023-10-08T12:53:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f4456d57b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500f5f1a0 con 0x55f500f4de80 2023-10-08T12:53:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f4456d57b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f500f5f360 con 0x55f500f4e7a0 2023-10-08T12:53:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f4456d57b80 10 client.0 _ll_register_callbacks cb 0x7f44380127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f444119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f5ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f444119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f5ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52948/0 (socket says 172.21.15.59:52948) 2023-10-08T12:53:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f444119b700 1 -- 172.21.15.59:0/594537979 learned_addr learned my addr 172.21.15.59:0/594537979 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f444099a700 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f5e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f444199c700 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f59650 0x55f500f5eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f444119b700 1 -- 172.21.15.59:0/594537979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 msgr2=0x55f500f5e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f444119b700 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f5e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f444119b700 1 -- 172.21.15.59:0/594537979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f59650 msgr2=0x55f500f5eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f444119b700 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f59650 0x55f500f5eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.619+0000 7f444119b700 1 -- 172.21.15.59:0/594537979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c02e040 con 0x55f500f4de80 2023-10-08T12:53:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.620+0000 7f444119b700 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f5ff30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4438012cd0 tx=0x7f44380128a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e458cc3d7235d5c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.620+0000 7f4424ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:53:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.620+0000 7f4424ff9700 1 -- 172.21.15.59:0/594537979 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438017040 con 0x55f500f4de80 2023-10-08T12:53:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.620+0000 7f4456d57b80 1 -- 172.21.15.59:0/594537979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f443401b320 con 0x55f500f4de80 2023-10-08T12:53:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.620+0000 7f4424ff9700 1 -- 172.21.15.59:0/594537979 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4438003890 con 0x55f500f4de80 2023-10-08T12:53:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.620+0000 7f4424ff9700 1 -- 172.21.15.59:0/594537979 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4438026480 con 0x55f500f4de80 2023-10-08T12:53:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.620+0000 7f4456d57b80 10 client.27269 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.620+0000 7f4456d57b80 1 -- 172.21.15.59:0/594537979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55f500cccde0 con 0x55f500f4de80 2023-10-08T12:53:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.620+0000 7f4424ff9700 1 -- 172.21.15.59:0/594537979 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f443401b320 con 0x55f500f4de80 2023-10-08T12:53:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.621+0000 7f4424ff9700 1 -- 172.21.15.59:0/594537979 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f443802e070 con 0x55f500f4de80 2023-10-08T12:53:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.621+0000 7f4456d57b80 10 client.27269 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.621+0000 7f4456d57b80 10 client.27269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.621+0000 7f4456d57b80 20 client.27269 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.621+0000 7f4456d57b80 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f500fbe480 0x55f500fc08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.621+0000 7f4456d57b80 4 client.27269 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:53:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.621+0000 7f4456d57b80 1 -- 172.21.15.59:0/594537979 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f500e9ab30 con 0x55f500fbe480 2023-10-08T12:53:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.621+0000 7f444099a700 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f500fbe480 0x55f500fc08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.621+0000 7f444099a700 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f500fbe480 0x55f500fc08a0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7e93804011748b server_cookie=c82c78891e8c506b in_seq=0 out_seq=0 2023-10-08T12:53:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.621+0000 7f4424ff9700 10 client.27269 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.621+0000 7f4424ff9700 1 -- 172.21.15.59:0/594537979 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f500e9ab30 con 0x55f500fbe480 2023-10-08T12:53:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4424ff9700 10 client.27269 handle_command_reply: tid=0 2023-10-08T12:53:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 1 client.27269 shutdown 2023-10-08T12:53:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 1 -- 172.21.15.59:0/594537979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 msgr2=0x55f500f5ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f5ff30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4438012cd0 tx=0x7f44380128a0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 1 -- 172.21.15.59:0/594537979 shutdown_connections 2023-10-08T12:53:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f500fbe480 0x55f500fc08a0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f500f4de80 0x55f500f5ff30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f500f59650 0x55f500f5eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4424ff9700 0 client.27269 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 1 --2- 172.21.15.59:0/594537979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f500f4e7a0 0x55f500f5e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 1 -- 172.21.15.59:0/594537979 >> 172.21.15.59:0/594537979 conn(0x55f500ec3260 msgr2=0x55f500f51750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 1 -- 172.21.15.59:0/594537979 shutdown_connections 2023-10-08T12:53:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 1 -- 172.21.15.59:0/594537979 wait complete. 2023-10-08T12:53:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.622+0000 7f4456d57b80 20 client.27269 trim_cache size 0 max 16384 2023-10-08T12:53:26.629 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:53:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 -- 172.21.15.59:0/834433339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44280a15f0 msgr2=0x7f44280a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44280a15f0 0x7f44280a3ab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f443c19a3e0 tx=0x7f442c005320 comp rx=0 tx=0).stop 2023-10-08T12:53:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 -- 172.21.15.59:0/834433339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f443c10cf70 msgr2=0x7f443c19d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f443c10cf70 0x7f443c19d770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f443400efc0 tx=0x7f443400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 -- 172.21.15.59:0/834433339 shutdown_connections 2023-10-08T12:53:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f44280a15f0 0x7f44280a3ab0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f443c072c20 0x7f443c198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f443c10cf70 0x7f443c19d770 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 --2- 172.21.15.59:0/834433339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443c073540 0x7f443c1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:26.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 -- 172.21.15.59:0/834433339 >> 172.21.15.59:0/834433339 conn(0x7f443c0fc200 msgr2=0x7f443c0fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:26.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 -- 172.21.15.59:0/834433339 shutdown_connections 2023-10-08T12:53:26.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:26.623+0000 7f44433ff700 1 -- 172.21.15.59:0/834433339 wait complete. 2023-10-08T12:53:27.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:27 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4123376999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:53:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:27 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4123376999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:53:27.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:27 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4123376999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:53:27.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1553120 12.42 MB/sec execute 538 sec latency 13.584 ms 2023-10-08T12:53:27.644 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:53:27.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:53:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.869+0000 7f30dafff700 1 -- 172.21.15.59:0/3436874847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d41056b0 msgr2=0x7f30d4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.869+0000 7f30dafff700 1 --2- 172.21.15.59:0/3436874847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d41056b0 0x7f30d4105a90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f30c8009990 tx=0x7f30c8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.870+0000 7f30dafff700 1 -- 172.21.15.59:0/3436874847 shutdown_connections 2023-10-08T12:53:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.870+0000 7f30dafff700 1 --2- 172.21.15.59:0/3436874847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d41056b0 0x7f30d4105a90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.870+0000 7f30dafff700 1 --2- 172.21.15.59:0/3436874847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d40fffe0 0x7f30d410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.870+0000 7f30dafff700 1 --2- 172.21.15.59:0/3436874847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d40ff620 0x7f30d40ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.870+0000 7f30dafff700 1 -- 172.21.15.59:0/3436874847 >> 172.21.15.59:0/3436874847 conn(0x7f30d4076780 msgr2=0x7f30d4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.870+0000 7f30dafff700 1 -- 172.21.15.59:0/3436874847 shutdown_connections 2023-10-08T12:53:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.870+0000 7f30dafff700 1 -- 172.21.15.59:0/3436874847 wait complete. 2023-10-08T12:53:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.871+0000 7f30dafff700 1 Processor -- start 2023-10-08T12:53:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.871+0000 7f30dafff700 1 -- start start 2023-10-08T12:53:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.872+0000 7f30dafff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d40ff620 0x7f30d41012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.872+0000 7f30dafff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d40fffe0 0x7f30d41017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.872+0000 7f30dafff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d41056b0 0x7f30d4101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.872+0000 7f30dafff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d4103280 con 0x7f30d40fffe0 2023-10-08T12:53:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.872+0000 7f30dafff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d41a9500 con 0x7f30d40ff620 2023-10-08T12:53:27.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.872+0000 7f30dafff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d41a96c0 con 0x7f30d41056b0 2023-10-08T12:53:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.872+0000 7f30d8d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d40ff620 0x7f30d41012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.872+0000 7f30d8d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d40ff620 0x7f30d41012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52970/0 (socket says 172.21.15.59:52970) 2023-10-08T12:53:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.872+0000 7f30d8d9b700 1 -- 172.21.15.59:0/374424338 learned_addr learned my addr 172.21.15.59:0/374424338 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.872+0000 7f30d3fff700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d40fffe0 0x7f30d41017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.872+0000 7f30d959c700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d41056b0 0x7f30d4101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.873+0000 7f30d8d9b700 1 -- 172.21.15.59:0/374424338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d41056b0 msgr2=0x7f30d4101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.873+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d41056b0 0x7f30d4101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.873+0000 7f30d8d9b700 1 -- 172.21.15.59:0/374424338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d40fffe0 msgr2=0x7f30d41017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.873+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d40fffe0 0x7f30d41017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.873+0000 7f30d8d9b700 1 -- 172.21.15.59:0/374424338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c0009520 con 0x7f30d40ff620 2023-10-08T12:53:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.873+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d40ff620 0x7f30d41012b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f30c8000c00 tx=0x7f30c8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.873+0000 7f30d1ffb700 1 -- 172.21.15.59:0/374424338 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c801d070 con 0x7f30d40ff620 2023-10-08T12:53:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.873+0000 7f30d1ffb700 1 -- 172.21.15.59:0/374424338 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30c8022470 con 0x7f30d40ff620 2023-10-08T12:53:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.873+0000 7f30dafff700 1 -- 172.21.15.59:0/374424338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c80095f0 con 0x7f30d40ff620 2023-10-08T12:53:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.873+0000 7f30d1ffb700 1 -- 172.21.15.59:0/374424338 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8017650 con 0x7f30d40ff620 2023-10-08T12:53:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.874+0000 7f30dafff700 1 -- 172.21.15.59:0/374424338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d41a9ce0 con 0x7f30d40ff620 2023-10-08T12:53:27.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.877+0000 7f30d1ffb700 1 -- 172.21.15.59:0/374424338 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f30c800fad0 con 0x7f30d40ff620 2023-10-08T12:53:27.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.878+0000 7f30ee927b80 1 Processor -- start 2023-10-08T12:53:27.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30ee927b80 1 -- start start 2023-10-08T12:53:27.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b051ff00 0x5624b05202e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b0520820 0x5624b052b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 0x5624b052dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30ee927b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b04894e0 con 0x5624b051ff00 2023-10-08T12:53:27.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30ee927b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b047aca0 con 0x5624b0520820 2023-10-08T12:53:27.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30ee927b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b04785c0 con 0x5624b052b6d0 2023-10-08T12:53:27.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30d1ffb700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30c40a1670 0x7f30c40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30d3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 0x5624b052dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30d3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 0x5624b052dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58618/0 (socket says 172.21.15.59:58618) 2023-10-08T12:53:27.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30d3fff700 1 -- 172.21.15.59:0/1667045097 learned_addr learned my addr 172.21.15.59:0/1667045097 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:27.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30d1ffb700 1 -- 172.21.15.59:0/374424338 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f30c80ce340 con 0x7f30d40ff620 2023-10-08T12:53:27.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.879+0000 7f30d959c700 1 --2- 172.21.15.59:0/1667045097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b051ff00 0x5624b05202e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.880+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/1667045097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b0520820 0x5624b052b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.880+0000 7f30d959c700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30c40a1670 0x7f30c40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.880+0000 7f30d3fff700 1 -- 172.21.15.59:0/1667045097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b0520820 msgr2=0x5624b052b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:27.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.880+0000 7f30d3fff700 1 --2- 172.21.15.59:0/1667045097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b0520820 0x5624b052b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.880+0000 7f30d3fff700 1 -- 172.21.15.59:0/1667045097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b051ff00 msgr2=0x5624b05202e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:27.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.880+0000 7f30d3fff700 1 --2- 172.21.15.59:0/1667045097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b051ff00 0x5624b05202e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.880+0000 7f30d3fff700 1 -- 172.21.15.59:0/1667045097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624b029ee60 con 0x5624b052b6d0 2023-10-08T12:53:27.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.880+0000 7f30d3fff700 1 --2- 172.21.15.59:0/1667045097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 0x5624b052dac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009e70 tx=0x7f30c0011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f208f81d8d929b6e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:27.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.880+0000 7f30beffd700 1 -- 172.21.15.59:0/1667045097 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0004310 con 0x5624b052b6d0 2023-10-08T12:53:27.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.880+0000 7f30beffd700 1 -- 172.21.15.59:0/1667045097 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30c0004470 con 0x5624b052b6d0 2023-10-08T12:53:27.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.880+0000 7f30beffd700 1 -- 172.21.15.59:0/1667045097 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0003680 con 0x5624b052b6d0 2023-10-08T12:53:27.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.881+0000 7f30ee927b80 1 -- 172.21.15.59:0/1667045097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 msgr2=0x5624b052dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:27.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.881+0000 7f30d959c700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30c40a1670 0x7f30c40a3b30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009fd0 tx=0x7f30cc009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:27.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.881+0000 7f30ee927b80 1 --2- 172.21.15.59:0/1667045097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 0x5624b052dac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009e70 tx=0x7f30c0011720 comp rx=0 tx=0).stop 2023-10-08T12:53:27.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.881+0000 7f30ee927b80 1 -- 172.21.15.59:0/1667045097 shutdown_connections 2023-10-08T12:53:27.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.881+0000 7f30ee927b80 1 --2- 172.21.15.59:0/1667045097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 0x5624b052dac0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.881+0000 7f30ee927b80 1 --2- 172.21.15.59:0/1667045097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b051ff00 0x5624b05202e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.881+0000 7f30ee927b80 1 --2- 172.21.15.59:0/1667045097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b0520820 0x5624b052b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.881+0000 7f30ee927b80 1 -- 172.21.15.59:0/1667045097 >> 172.21.15.59:0/1667045097 conn(0x5624b04952e0 msgr2=0x5624b051c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:27.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.881+0000 7f30ee927b80 1 -- 172.21.15.59:0/1667045097 shutdown_connections 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.881+0000 7f30ee927b80 1 -- 172.21.15.59:0/1667045097 wait complete. 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.882+0000 7f30ee927b80 1 -- start start 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.882+0000 7f30ee927b80 1 Processor -- start 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.882+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b052b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b0520820 0x5624b0528340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 0x5624b0528900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30ee927b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b0473eb0 con 0x5624b0520820 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30ee927b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b0410790 con 0x5624b051ff00 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30ee927b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b0410430 con 0x5624b052b6d0 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30ee927b80 10 client.0 _ll_register_callbacks cb 0x5624b026d880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30d8d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b052b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30d3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b0520820 0x5624b0528340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30d8d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b052b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:52990/0 (socket says 172.21.15.59:52990) 2023-10-08T12:53:27.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30d8d9b700 1 -- 172.21.15.59:0/2836131995 learned_addr learned my addr 172.21.15.59:0/2836131995 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:27.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30d959c700 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 0x5624b0528900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30d8d9b700 1 -- 172.21.15.59:0/2836131995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 msgr2=0x5624b0528900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:27.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 0x5624b0528900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30d8d9b700 1 -- 172.21.15.59:0/2836131995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b0520820 msgr2=0x5624b0528340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:27.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b0520820 0x5624b0528340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.883+0000 7f30d8d9b700 1 -- 172.21.15.59:0/2836131995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c0009a70 con 0x5624b051ff00 2023-10-08T12:53:27.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b052b070 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f30c809b330 tx=0x7f30c809b170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c6ad539e1feaf91 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:27.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:53:27.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30b3fff700 1 -- 172.21.15.59:0/2836131995 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c809ad00 con 0x5624b051ff00 2023-10-08T12:53:27.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30ee927b80 1 -- 172.21.15.59:0/2836131995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624b043bf30 con 0x5624b051ff00 2023-10-08T12:53:27.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30b3fff700 1 -- 172.21.15.59:0/2836131995 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f30c809baa0 con 0x5624b051ff00 2023-10-08T12:53:27.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30b3fff700 1 -- 172.21.15.59:0/2836131995 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30c809b3a0 con 0x5624b051ff00 2023-10-08T12:53:27.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30ee927b80 10 client.27281 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:27.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30ee927b80 1 -- 172.21.15.59:0/2836131995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5624b0287ce0 con 0x5624b051ff00 2023-10-08T12:53:27.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30b3fff700 1 -- 172.21.15.59:0/2836131995 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5624b043bf30 con 0x5624b051ff00 2023-10-08T12:53:27.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30b3fff700 1 -- 172.21.15.59:0/2836131995 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f30c809f100 con 0x5624b051ff00 2023-10-08T12:53:27.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30ee927b80 10 client.27281 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:27.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30ee927b80 10 client.27281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:27.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30ee927b80 20 client.27281 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:27.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5624b053add0 0x5624b053d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30ee927b80 4 client.27281 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:53:27.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.884+0000 7f30ee927b80 1 -- 172.21.15.59:0/2836131995 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624b046ce90 con 0x5624b053add0 2023-10-08T12:53:27.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.885+0000 7f30d3fff700 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5624b053add0 0x5624b053d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.885+0000 7f30d3fff700 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5624b053add0 0x5624b053d1c0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=942095b87e0b1451 server_cookie=137430ac947eacf8 in_seq=0 out_seq=0 2023-10-08T12:53:27.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.885+0000 7f30b3fff700 10 client.27281 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:27.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30b3fff700 1 -- 172.21.15.59:0/2836131995 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5624b046ce90 con 0x5624b053add0 2023-10-08T12:53:27.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30b3fff700 10 client.27281 handle_command_reply: tid=0 2023-10-08T12:53:27.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 1 client.27281 shutdown 2023-10-08T12:53:27.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 1 -- 172.21.15.59:0/2836131995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 msgr2=0x5624b052b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:27.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b052b070 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f30c809b330 tx=0x7f30c809b170 comp rx=0 tx=0).stop 2023-10-08T12:53:27.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 1 -- 172.21.15.59:0/2836131995 shutdown_connections 2023-10-08T12:53:27.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5624b053add0 0x5624b053d1c0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b052b070 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b052b6d0 0x5624b0528900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30b3fff700 0 client.27281 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:27.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2836131995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b0520820 0x5624b0528340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 1 -- 172.21.15.59:0/2836131995 >> 172.21.15.59:0/2836131995 conn(0x5624b04952e0 msgr2=0x5624b051bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:27.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 1 -- 172.21.15.59:0/2836131995 shutdown_connections 2023-10-08T12:53:27.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 1 -- 172.21.15.59:0/2836131995 wait complete. 2023-10-08T12:53:27.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.886+0000 7f30ee927b80 20 client.27281 trim_cache size 0 max 16384 2023-10-08T12:53:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.905+0000 7f30ee927b80 1 Processor -- start 2023-10-08T12:53:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.905+0000 7f30ee927b80 1 -- start start 2023-10-08T12:53:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b0532260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b0520820 0x5624b0527bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b052b6d0 0x5624b0528110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30ee927b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b02f49a0 con 0x5624b052b6d0 2023-10-08T12:53:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30ee927b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b0521180 con 0x5624b051ff00 2023-10-08T12:53:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30ee927b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b0516670 con 0x5624b0520820 2023-10-08T12:53:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30d8d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b0532260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30d3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b0520820 0x5624b0527bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30d8d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b0532260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53006/0 (socket says 172.21.15.59:53006) 2023-10-08T12:53:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30d8d9b700 1 -- 172.21.15.59:0/3441989810 learned_addr learned my addr 172.21.15.59:0/3441989810 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30d959c700 1 --2- 172.21.15.59:0/3441989810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b052b6d0 0x5624b0528110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30d8d9b700 1 -- 172.21.15.59:0/3441989810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b0520820 msgr2=0x5624b0527bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/3441989810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b0520820 0x5624b0527bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30d8d9b700 1 -- 172.21.15.59:0/3441989810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b052b6d0 msgr2=0x5624b0528110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/3441989810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b052b6d0 0x5624b0528110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30d8d9b700 1 -- 172.21.15.59:0/3441989810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624b0541d80 con 0x5624b051ff00 2023-10-08T12:53:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.906+0000 7f30d3fff700 1 --2- 172.21.15.59:0/3441989810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b0520820 0x5624b0527bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.907+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/3441989810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b0532260 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f30c8005cb0 tx=0x7f30c8099950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b1dbf26af6aa427 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.907+0000 7f30bf7fe700 1 -- 172.21.15.59:0/3441989810 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c809ad00 con 0x5624b051ff00 2023-10-08T12:53:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.907+0000 7f30bf7fe700 1 -- 172.21.15.59:0/3441989810 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30c809baa0 con 0x5624b051ff00 2023-10-08T12:53:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.907+0000 7f30bf7fe700 1 -- 172.21.15.59:0/3441989810 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c809f100 con 0x5624b051ff00 2023-10-08T12:53:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.907+0000 7f30ee927b80 1 -- 172.21.15.59:0/3441989810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 msgr2=0x5624b0532260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.907+0000 7f30ee927b80 1 --2- 172.21.15.59:0/3441989810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b0532260 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f30c8005cb0 tx=0x7f30c8099950 comp rx=0 tx=0).stop 2023-10-08T12:53:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.907+0000 7f30ee927b80 1 -- 172.21.15.59:0/3441989810 shutdown_connections 2023-10-08T12:53:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.907+0000 7f30ee927b80 1 --2- 172.21.15.59:0/3441989810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b051ff00 0x5624b0532260 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.907+0000 7f30ee927b80 1 --2- 172.21.15.59:0/3441989810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b052b6d0 0x5624b0528110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.908+0000 7f30ee927b80 1 --2- 172.21.15.59:0/3441989810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b0520820 0x5624b0527bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.908+0000 7f30ee927b80 1 -- 172.21.15.59:0/3441989810 >> 172.21.15.59:0/3441989810 conn(0x5624b04952e0 msgr2=0x5624b0526c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.908+0000 7f30ee927b80 1 -- 172.21.15.59:0/3441989810 shutdown_connections 2023-10-08T12:53:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.908+0000 7f30ee927b80 1 -- 172.21.15.59:0/3441989810 wait complete. 2023-10-08T12:53:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.908+0000 7f30ee927b80 1 -- start start 2023-10-08T12:53:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.908+0000 7f30ee927b80 1 Processor -- start 2023-10-08T12:53:27.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b051ff00 0x5624b0531430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b0520820 0x5624b0531970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30ee927b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b052b6d0 0x5624b0587b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30ee927b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b0588070 con 0x5624b0520820 2023-10-08T12:53:27.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30ee927b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b05881e0 con 0x5624b052b6d0 2023-10-08T12:53:27.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30ee927b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b05883a0 con 0x5624b051ff00 2023-10-08T12:53:27.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30ee927b80 10 client.0 _ll_register_callbacks cb 0x7f30c80057b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:27.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d959c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b052b6d0 0x5624b0587b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b0520820 0x5624b0531970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d959c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b052b6d0 0x5624b0587b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53018/0 (socket says 172.21.15.59:53018) 2023-10-08T12:53:27.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d8d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b051ff00 0x5624b0531430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d959c700 1 -- 172.21.15.59:0/2764640488 learned_addr learned my addr 172.21.15.59:0/2764640488 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d8d9b700 1 -- 172.21.15.59:0/2764640488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b052b6d0 msgr2=0x5624b0587b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b052b6d0 0x5624b0587b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d8d9b700 1 -- 172.21.15.59:0/2764640488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b0520820 msgr2=0x5624b0531970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b0520820 0x5624b0531970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d8d9b700 1 -- 172.21.15.59:0/2764640488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c001d040 con 0x5624b051ff00 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d959c700 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b052b6d0 0x5624b0587b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.909+0000 7f30d3fff700 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b0520820 0x5624b0531970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30d8d9b700 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b051ff00 0x5624b0531430 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f30c809b0a0 tx=0x7f30c80a36c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a62cac0ae50c21a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30b3fff700 1 -- 172.21.15.59:0/2764640488 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c809ad00 con 0x5624b051ff00 2023-10-08T12:53:27.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30b3fff700 1 -- 172.21.15.59:0/2764640488 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f30c80b1020 con 0x5624b051ff00 2023-10-08T12:53:27.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30ee927b80 1 -- 172.21.15.59:0/2764640488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30c0004470 con 0x5624b051ff00 2023-10-08T12:53:27.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30b3fff700 1 -- 172.21.15.59:0/2764640488 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30c809b170 con 0x5624b051ff00 2023-10-08T12:53:27.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30ee927b80 10 client.27280 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:27.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30ee927b80 1 -- 172.21.15.59:0/2764640488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5624b0287ce0 con 0x5624b051ff00 2023-10-08T12:53:27.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30b3fff700 1 -- 172.21.15.59:0/2764640488 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30c0004470 con 0x5624b051ff00 2023-10-08T12:53:27.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30b3fff700 1 -- 172.21.15.59:0/2764640488 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f30c809b690 con 0x5624b051ff00 2023-10-08T12:53:27.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30ee927b80 10 client.27280 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:27.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30ee927b80 10 client.27280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:27.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30ee927b80 20 client.27280 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:27.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5624b05908e0 0x5624b0592cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:27.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30ee927b80 4 client.27280 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:53:27.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.910+0000 7f30ee927b80 1 -- 172.21.15.59:0/2764640488 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5624b046cbb0 con 0x5624b05908e0 2023-10-08T12:53:27.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.911+0000 7f30d3fff700 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5624b05908e0 0x5624b0592cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:27.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.911+0000 7f30d3fff700 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5624b05908e0 0x5624b0592cd0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae1805579db0118f server_cookie=c88f8d82eeec4f15 in_seq=0 out_seq=0 2023-10-08T12:53:27.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.911+0000 7f30b3fff700 10 client.27280 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:27.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.913+0000 7f30b3fff700 1 -- 172.21.15.59:0/2764640488 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5624b046cbb0 con 0x5624b05908e0 2023-10-08T12:53:27.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.913+0000 7f30b3fff700 10 client.27280 handle_command_reply: tid=0 2023-10-08T12:53:27.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.913+0000 7f30ee927b80 1 client.27280 shutdown 2023-10-08T12:53:27.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.913+0000 7f30ee927b80 1 -- 172.21.15.59:0/2764640488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b051ff00 msgr2=0x5624b0531430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:27.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.913+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b051ff00 0x5624b0531430 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f30c809b0a0 tx=0x7f30c80a36c0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.914+0000 7f30ee927b80 1 -- 172.21.15.59:0/2764640488 shutdown_connections 2023-10-08T12:53:27.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.914+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5624b05908e0 0x5624b0592cd0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.914+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624b052b6d0 0x5624b0587b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.914+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624b051ff00 0x5624b0531430 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.914+0000 7f30b3fff700 0 client.27280 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:27.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.914+0000 7f30ee927b80 1 --2- 172.21.15.59:0/2764640488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624b0520820 0x5624b0531970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.914+0000 7f30ee927b80 1 -- 172.21.15.59:0/2764640488 >> 172.21.15.59:0/2764640488 conn(0x5624b04952e0 msgr2=0x5624b05369b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:27.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.914+0000 7f30ee927b80 1 -- 172.21.15.59:0/2764640488 shutdown_connections 2023-10-08T12:53:27.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.914+0000 7f30ee927b80 1 -- 172.21.15.59:0/2764640488 wait complete. 2023-10-08T12:53:27.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.914+0000 7f30ee927b80 20 client.27280 trim_cache size 0 max 16384 2023-10-08T12:53:27.919 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:53:27.920 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:53:27.920 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "50212f38-4264-4712-b7b5-c742b9df31e6", 2023-10-08T12:53:27.920 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:53:27.920 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:53:27.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 -- 172.21.15.59:0/374424338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30c40a1670 msgr2=0x7f30c40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:27.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30c40a1670 0x7f30c40a3b30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009fd0 tx=0x7f30cc009920 comp rx=0 tx=0).stop 2023-10-08T12:53:27.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 -- 172.21.15.59:0/374424338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d40ff620 msgr2=0x7f30d41012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:27.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d40ff620 0x7f30d41012b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f30c8000c00 tx=0x7f30c8005740 comp rx=0 tx=0).stop 2023-10-08T12:53:27.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 -- 172.21.15.59:0/374424338 shutdown_connections 2023-10-08T12:53:27.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f30c40a1670 0x7f30c40a3b30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d40ff620 0x7f30d41012b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d41056b0 0x7f30d4101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 --2- 172.21.15.59:0/374424338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d40fffe0 0x7f30d41017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:27.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 -- 172.21.15.59:0/374424338 >> 172.21.15.59:0/374424338 conn(0x7f30d4076780 msgr2=0x7f30d40fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:27.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 -- 172.21.15.59:0/374424338 shutdown_connections 2023-10-08T12:53:27.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:27.915+0000 7f30dafff700 1 -- 172.21.15.59:0/374424338 wait complete. 2023-10-08T12:53:27.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:53:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.147+0000 7f3a94dff700 1 -- 172.21.15.59:0/9384188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a90106740 msgr2=0x7f3a90106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.147+0000 7f3a94dff700 1 --2- 172.21.15.59:0/9384188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a90106740 0x7f3a90106b20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009990 tx=0x7f3a80009ca0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.147+0000 7f3a94dff700 1 -- 172.21.15.59:0/9384188 shutdown_connections 2023-10-08T12:53:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.147+0000 7f3a94dff700 1 --2- 172.21.15.59:0/9384188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a90106740 0x7f3a90106b20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.147+0000 7f3a94dff700 1 --2- 172.21.15.59:0/9384188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a901010f0 0x7f3a9010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.147+0000 7f3a94dff700 1 --2- 172.21.15.59:0/9384188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a90100730 0x7f3a90100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.147+0000 7f3a94dff700 1 -- 172.21.15.59:0/9384188 >> 172.21.15.59:0/9384188 conn(0x7f3a900fc200 msgr2=0x7f3a900fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.147+0000 7f3a94dff700 1 -- 172.21.15.59:0/9384188 shutdown_connections 2023-10-08T12:53:28.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.147+0000 7f3a94dff700 1 -- 172.21.15.59:0/9384188 wait complete. 2023-10-08T12:53:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.148+0000 7f3a94dff700 1 Processor -- start 2023-10-08T12:53:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a94dff700 1 -- start start 2023-10-08T12:53:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a94dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a90100730 0x7f3a90198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a94dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a901010f0 0x7f3a90199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a94dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a90106740 0x7f3a9019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a94dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9019dd20 con 0x7f3a90106740 2023-10-08T12:53:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a94dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9019de90 con 0x7f3a901010f0 2023-10-08T12:53:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a94dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9019e050 con 0x7f3a90100730 2023-10-08T12:53:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a8dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a901010f0 0x7f3a90199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a8dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a901010f0 0x7f3a90199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53044/0 (socket says 172.21.15.59:53044) 2023-10-08T12:53:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/3525466886 learned_addr learned my addr 172.21.15.59:0/3525466886 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a8e59c700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a90100730 0x7f3a90198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.149+0000 7f3a8ed9d700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a90106740 0x7f3a9019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/3525466886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a90100730 msgr2=0x7f3a90198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a90100730 0x7f3a90198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/3525466886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a90106740 msgr2=0x7f3a9019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a90106740 0x7f3a9019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/3525466886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a800095f0 con 0x7f3a901010f0 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a8ed9d700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a90106740 0x7f3a9019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a901010f0 0x7f3a90199340 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400e9a0 tx=0x7f3a8400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a7f7fe700 1 -- 172.21.15.59:0/3525466886 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84009790 con 0x7f3a901010f0 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a7f7fe700 1 -- 172.21.15.59:0/3525466886 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a8400cbd0 con 0x7f3a901010f0 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a7f7fe700 1 -- 172.21.15.59:0/3525466886 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84018680 con 0x7f3a901010f0 2023-10-08T12:53:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a94dff700 1 -- 172.21.15.59:0/3525466886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9019e330 con 0x7f3a901010f0 2023-10-08T12:53:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.150+0000 7f3a94dff700 1 -- 172.21.15.59:0/3525466886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a901a5b70 con 0x7f3a901010f0 2023-10-08T12:53:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.154+0000 7f3a7f7fe700 1 -- 172.21.15.59:0/3525466886 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3a8400cd40 con 0x7f3a901010f0 2023-10-08T12:53:28.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.155+0000 7f3a7f7fe700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a780a15f0 0x7f3a780a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.155+0000 7f3aa868fb80 1 Processor -- start 2023-10-08T12:53:28.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.155+0000 7f3a7f7fe700 1 -- 172.21.15.59:0/3525466886 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3a84014070 con 0x7f3a901010f0 2023-10-08T12:53:28.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.156+0000 7f3a8e59c700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a780a15f0 0x7f3a780a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.156+0000 7f3aa868fb80 1 -- start start 2023-10-08T12:53:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.156+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c965260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.156+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 0x55e33c970110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.156+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c970650 0x55e33c972a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.156+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c8ce460 con 0x55e33c970650 2023-10-08T12:53:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.156+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c8bfc20 con 0x55e33c964e80 2023-10-08T12:53:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.156+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c8bd540 con 0x55e33c9657a0 2023-10-08T12:53:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8dd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 0x55e33c970110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8e59c700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a780a15f0 0x7f3a780a3ab0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3a80000c00 tx=0x7f3a8000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c965260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8dd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 0x55e33c970110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58664/0 (socket says 172.21.15.59:58664) 2023-10-08T12:53:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/3846740115 learned_addr learned my addr 172.21.15.59:0/3846740115 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8ed9d700 1 --2- 172.21.15.59:0/3846740115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c970650 0x55e33c972a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/3846740115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 msgr2=0x55e33c965260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/3846740115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c965260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/3846740115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c970650 msgr2=0x55e33c972a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/3846740115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c970650 0x55e33c972a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/3846740115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e33c6e3de0 con 0x55e33c9657a0 2023-10-08T12:53:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8ed9d700 1 --2- 172.21.15.59:0/3846740115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c970650 0x55e33c972a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:53:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/3846740115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 0x55e33c970110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a8409a090 tx=0x7f3a84099cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd5735c45bbbe7b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a7cff9700 1 -- 172.21.15.59:0/3846740115 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8409a390 con 0x55e33c9657a0 2023-10-08T12:53:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a7cff9700 1 -- 172.21.15.59:0/3846740115 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a8409e4e0 con 0x55e33c9657a0 2023-10-08T12:53:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.157+0000 7f3a7cff9700 1 -- 172.21.15.59:0/3846740115 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84099880 con 0x55e33c9657a0 2023-10-08T12:53:28.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.158+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3846740115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 msgr2=0x55e33c970110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:28.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.158+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/3846740115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 0x55e33c970110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a8409a090 tx=0x7f3a84099cf0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.158+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3846740115 shutdown_connections 2023-10-08T12:53:28.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.158+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/3846740115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c965260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.158+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/3846740115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c970650 0x55e33c972a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.158+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/3846740115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 0x55e33c970110 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.158+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3846740115 >> 172.21.15.59:0/3846740115 conn(0x55e33c8da260 msgr2=0x55e33c9612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.159+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3846740115 shutdown_connections 2023-10-08T12:53:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.159+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3846740115 wait complete. 2023-10-08T12:53:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.160+0000 7f3aa868fb80 1 -- start start 2023-10-08T12:53:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.160+0000 7f3aa868fb80 1 Processor -- start 2023-10-08T12:53:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.160+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c9700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c9657a0 0x55e33c96d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c970650 0x55e33c96dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c8b8e30 con 0x55e33c9657a0 2023-10-08T12:53:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c855710 con 0x55e33c964e80 2023-10-08T12:53:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c8553b0 con 0x55e33c970650 2023-10-08T12:53:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3aa868fb80 10 client.0 _ll_register_callbacks cb 0x55e33c6b2800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3a8e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c9700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3a8e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c9700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53054/0 (socket says 172.21.15.59:53054) 2023-10-08T12:53:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3a8e59c700 1 -- 172.21.15.59:0/3663385728 learned_addr learned my addr 172.21.15.59:0/3663385728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3a8ed9d700 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c970650 0x55e33c96dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c9657a0 0x55e33c96d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.161+0000 7f3a8e59c700 1 -- 172.21.15.59:0/3663385728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c970650 msgr2=0x55e33c96dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.162+0000 7f3a8e59c700 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c970650 0x55e33c96dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.162+0000 7f3a8e59c700 1 -- 172.21.15.59:0/3663385728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c9657a0 msgr2=0x55e33c96d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.162+0000 7f3a8e59c700 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c9657a0 0x55e33c96d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.162+0000 7f3a8e59c700 1 -- 172.21.15.59:0/3663385728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a901a5b70 con 0x55e33c964e80 2023-10-08T12:53:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.162+0000 7f3a8ed9d700 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c970650 0x55e33c96dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.162+0000 7f3a8e59c700 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c9700a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000be00 tx=0x7f3a80009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=676b492ecb77a544 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.162+0000 7f3a75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:53:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.162+0000 7f3a75ffb700 1 -- 172.21.15.59:0/3663385728 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80004c70 con 0x55e33c964e80 2023-10-08T12:53:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.162+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3663385728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e33c880eb0 con 0x55e33c964e80 2023-10-08T12:53:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.162+0000 7f3a75ffb700 1 -- 172.21.15.59:0/3663385728 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3a80004dd0 con 0x55e33c964e80 2023-10-08T12:53:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.162+0000 7f3a75ffb700 1 -- 172.21.15.59:0/3663385728 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a8003a460 con 0x55e33c964e80 2023-10-08T12:53:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.163+0000 7f3aa868fb80 10 client.27299 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.163+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3663385728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e33c6ccc60 con 0x55e33c964e80 2023-10-08T12:53:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.163+0000 7f3a75ffb700 1 -- 172.21.15.59:0/3663385728 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e33c880eb0 con 0x55e33c964e80 2023-10-08T12:53:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.163+0000 7f3a75ffb700 1 -- 172.21.15.59:0/3663385728 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3a8002f070 con 0x55e33c964e80 2023-10-08T12:53:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.163+0000 7f3aa868fb80 10 client.27299 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.163+0000 7f3aa868fb80 10 client.27299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.163+0000 7f3aa868fb80 20 client.27299 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.163+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e33c980280 0x55e33c9826a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.163+0000 7f3aa868fb80 4 client.27299 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:53:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.163+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3663385728 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e33c8b1e10 con 0x55e33c980280 2023-10-08T12:53:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.163+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e33c980280 0x55e33c9826a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.164+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e33c980280 0x55e33c9826a0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca16f918ac1eea5d server_cookie=98f440b933bc0a8f in_seq=0 out_seq=0 2023-10-08T12:53:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.164+0000 7f3a75ffb700 10 client.27299 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:28.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.166+0000 7f3a75ffb700 1 -- 172.21.15.59:0/3663385728 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e33c8b1e10 con 0x55e33c980280 2023-10-08T12:53:28.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.166+0000 7f3a75ffb700 10 client.27299 handle_command_reply: tid=0 2023-10-08T12:53:28.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.166+0000 7f3aa868fb80 1 client.27299 shutdown 2023-10-08T12:53:28.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.166+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3663385728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 msgr2=0x55e33c9700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:28.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.166+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c9700a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000be00 tx=0x7f3a80009ca0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.166+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3663385728 shutdown_connections 2023-10-08T12:53:28.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.166+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e33c980280 0x55e33c9826a0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.166+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c9700a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.166+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c970650 0x55e33c96dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.166+0000 7f3a75ffb700 0 client.27299 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:28.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.167+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/3663385728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c9657a0 0x55e33c96d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.167+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3663385728 >> 172.21.15.59:0/3663385728 conn(0x55e33c8da260 msgr2=0x55e33c960ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:28.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.167+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3663385728 shutdown_connections 2023-10-08T12:53:28.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.167+0000 7f3aa868fb80 1 -- 172.21.15.59:0/3663385728 wait complete. 2023-10-08T12:53:28.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.167+0000 7f3aa868fb80 20 client.27299 trim_cache size 0 max 16384 2023-10-08T12:53:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.186+0000 7f3aa868fb80 1 Processor -- start 2023-10-08T12:53:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.186+0000 7f3aa868fb80 1 -- start start 2023-10-08T12:53:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.186+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c964e80 0x55e33c9771a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.186+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c9657a0 0x55e33c97b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.186+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c970650 0x55e33c96c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.186+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c739920 con 0x55e33c964e80 2023-10-08T12:53:28.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.186+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c97d930 con 0x55e33c9657a0 2023-10-08T12:53:28.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.186+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c95b570 con 0x55e33c970650 2023-10-08T12:53:28.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c9657a0 0x55e33c97b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c964e80 0x55e33c9771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c9657a0 0x55e33c97b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53056/0 (socket says 172.21.15.59:53056) 2023-10-08T12:53:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/135958033 learned_addr learned my addr 172.21.15.59:0/135958033 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8ed9d700 1 --2- 172.21.15.59:0/135958033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c970650 0x55e33c96c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/135958033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c970650 msgr2=0x55e33c96c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/135958033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c970650 0x55e33c96c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/135958033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c964e80 msgr2=0x55e33c9771a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/135958033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c964e80 0x55e33c9771a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8dd9b700 1 -- 172.21.15.59:0/135958033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e33c70a250 con 0x55e33c9657a0 2023-10-08T12:53:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8e59c700 1 --2- 172.21.15.59:0/135958033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c964e80 0x55e33c9771a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/135958033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c9657a0 0x55e33c97b8f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009340 tx=0x7f3a840092d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b21c1011d87f99b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a7d7fa700 1 -- 172.21.15.59:0/135958033 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8409a390 con 0x55e33c9657a0 2023-10-08T12:53:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.187+0000 7f3a7d7fa700 1 -- 172.21.15.59:0/135958033 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a8409e170 con 0x55e33c9657a0 2023-10-08T12:53:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.188+0000 7f3a7d7fa700 1 -- 172.21.15.59:0/135958033 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84099ae0 con 0x55e33c9657a0 2023-10-08T12:53:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.188+0000 7f3aa868fb80 1 -- 172.21.15.59:0/135958033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c9657a0 msgr2=0x55e33c97b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.188+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/135958033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c9657a0 0x55e33c97b8f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009340 tx=0x7f3a840092d0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.188+0000 7f3aa868fb80 1 -- 172.21.15.59:0/135958033 shutdown_connections 2023-10-08T12:53:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.188+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/135958033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c970650 0x55e33c96c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.188+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/135958033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c964e80 0x55e33c9771a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.188+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/135958033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c9657a0 0x55e33c97b8f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.188+0000 7f3aa868fb80 1 -- 172.21.15.59:0/135958033 >> 172.21.15.59:0/135958033 conn(0x55e33c8da260 msgr2=0x55e33c9604d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.188+0000 7f3aa868fb80 1 -- 172.21.15.59:0/135958033 shutdown_connections 2023-10-08T12:53:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.188+0000 7f3aa868fb80 1 -- 172.21.15.59:0/135958033 wait complete. 2023-10-08T12:53:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.189+0000 7f3aa868fb80 1 -- start start 2023-10-08T12:53:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.189+0000 7f3aa868fb80 1 Processor -- start 2023-10-08T12:53:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.189+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c976fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 0x55e33c975590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3aa868fb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c970650 0x55e33c975ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c976190 con 0x55e33c970650 2023-10-08T12:53:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c976300 con 0x55e33c964e80 2023-10-08T12:53:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3aa868fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33c9d40c0 con 0x55e33c9657a0 2023-10-08T12:53:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3aa868fb80 10 client.0 _ll_register_callbacks cb 0x7f3a800057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a8e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c976fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a8e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c976fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53066/0 (socket says 172.21.15.59:53066) 2023-10-08T12:53:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a8e59c700 1 -- 172.21.15.59:0/1185285030 learned_addr learned my addr 172.21.15.59:0/1185285030 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a8ed9d700 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c970650 0x55e33c975ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 0x55e33c975590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a8e59c700 1 -- 172.21.15.59:0/1185285030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 msgr2=0x55e33c975590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a8e59c700 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 0x55e33c975590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a8e59c700 1 -- 172.21.15.59:0/1185285030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c970650 msgr2=0x55e33c975ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a8e59c700 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c970650 0x55e33c975ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a8e59c700 1 -- 172.21.15.59:0/1185285030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e33c6ccc60 con 0x55e33c964e80 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a8e59c700 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c976fd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009990 tx=0x7f3a80024d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e07e0d456557409 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.190+0000 7f3a75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3a75ffb700 1 -- 172.21.15.59:0/1185285030 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80004ed0 con 0x55e33c964e80 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3aa868fb80 1 -- 172.21.15.59:0/1185285030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a8409e4e0 con 0x55e33c964e80 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3a75ffb700 1 -- 172.21.15.59:0/1185285030 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3a8003a460 con 0x55e33c964e80 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3a75ffb700 1 -- 172.21.15.59:0/1185285030 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a8003a620 con 0x55e33c964e80 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3aa868fb80 10 client.27305 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3aa868fb80 1 -- 172.21.15.59:0/1185285030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e33c6e3de0 con 0x55e33c964e80 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3a75ffb700 1 -- 172.21.15.59:0/1185285030 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a8409e4e0 con 0x55e33c964e80 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3a75ffb700 1 -- 172.21.15.59:0/1185285030 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3a80004500 con 0x55e33c964e80 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3aa868fb80 10 client.27305 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3aa868fb80 10 client.27305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3aa868fb80 20 client.27305 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e33c9d53b0 0x55e33c9d77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3aa868fb80 4 client.27305 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:53:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.191+0000 7f3aa868fb80 1 -- 172.21.15.59:0/1185285030 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e33c8b1b30 con 0x55e33c9d53b0 2023-10-08T12:53:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e33c9d53b0 0x55e33c9d77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3a8dd9b700 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e33c9d53b0 0x55e33c9d77d0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24d2bedcfc96ebf4 server_cookie=5d378880dce8de81 in_seq=0 out_seq=0 2023-10-08T12:53:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3a75ffb700 10 client.27305 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3a75ffb700 1 -- 172.21.15.59:0/1185285030 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e33c8b1b30 con 0x55e33c9d53b0 2023-10-08T12:53:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3a75ffb700 10 client.27305 handle_command_reply: tid=0 2023-10-08T12:53:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3aa868fb80 1 client.27305 shutdown 2023-10-08T12:53:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3aa868fb80 1 -- 172.21.15.59:0/1185285030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 msgr2=0x55e33c976fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c976fd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009990 tx=0x7f3a80024d90 comp rx=0 tx=0).stop 2023-10-08T12:53:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3aa868fb80 1 -- 172.21.15.59:0/1185285030 shutdown_connections 2023-10-08T12:53:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e33c9d53b0 0x55e33c9d77d0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33c964e80 0x55e33c976fd0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e33c970650 0x55e33c975ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3aa868fb80 1 --2- 172.21.15.59:0/1185285030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e33c9657a0 0x55e33c975590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3aa868fb80 1 -- 172.21.15.59:0/1185285030 >> 172.21.15.59:0/1185285030 conn(0x55e33c8da260 msgr2=0x55e33c97b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.192+0000 7f3a75ffb700 0 client.27305 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3aa868fb80 1 -- 172.21.15.59:0/1185285030 shutdown_connections 2023-10-08T12:53:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3aa868fb80 1 -- 172.21.15.59:0/1185285030 wait complete. 2023-10-08T12:53:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3aa868fb80 20 client.27305 trim_cache size 0 max 16384 2023-10-08T12:53:28.200 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:53:28.200 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:53:28.200 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:53:28.200 INFO:teuthology.orchestra.run.smithi059.stdout: "50212f38-4264-4712-b7b5-c742b9df31e6": { 2023-10-08T12:53:28.200 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:53:28.200 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "50212f38-4264-4712-b7b5-c742b9df31e6", 2023-10-08T12:53:28.200 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:53:28.200 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:53:28.200 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:53:28.201 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:53:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3a94dff700 1 -- 172.21.15.59:0/3525466886 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a780a15f0 msgr2=0x7f3a780a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3a94dff700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a780a15f0 0x7f3a780a3ab0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3a80000c00 tx=0x7f3a8000b260 comp rx=0 tx=0).stop 2023-10-08T12:53:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3a94dff700 1 -- 172.21.15.59:0/3525466886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a901010f0 msgr2=0x7f3a90199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3a94dff700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a901010f0 0x7f3a90199340 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400e9a0 tx=0x7f3a8400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3a94dff700 1 -- 172.21.15.59:0/3525466886 shutdown_connections 2023-10-08T12:53:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3a94dff700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3a780a15f0 0x7f3a780a3ab0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3a94dff700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a90106740 0x7f3a9019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3a94dff700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a90100730 0x7f3a90198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3a94dff700 1 --2- 172.21.15.59:0/3525466886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a901010f0 0x7f3a90199340 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.193+0000 7f3a94dff700 1 -- 172.21.15.59:0/3525466886 >> 172.21.15.59:0/3525466886 conn(0x7f3a900fc200 msgr2=0x7f3a9010be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.194+0000 7f3a94dff700 1 -- 172.21.15.59:0/3525466886 shutdown_connections 2023-10-08T12:53:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:28.194+0000 7f3a94dff700 1 -- 172.21.15.59:0/3525466886 wait complete. 2023-10-08T12:53:28.213 INFO:tasks.cephfs.filesystem:scrub status for tag:50212f38-4264-4712-b7b5-c742b9df31e6 - {'path': '/', 'tag': '50212f38-4264-4712-b7b5-c742b9df31e6', 'options': 'recursive,force'} 2023-10-08T12:53:28.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:28 smithi059 ceph-mon[98489]: pgmap v694: 97 pgs: 97 active+clean; 594 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.3 MiB/s wr, 233 op/s 2023-10-08T12:53:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:28 smithi092 ceph-mon[134093]: pgmap v694: 97 pgs: 97 active+clean; 594 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.3 MiB/s wr, 233 op/s 2023-10-08T12:53:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:28 smithi173 ceph-mon[135182]: pgmap v694: 97 pgs: 97 active+clean; 594 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.3 MiB/s wr, 233 op/s 2023-10-08T12:53:28.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1555570 12.42 MB/sec execute 539 sec latency 43.285 ms 2023-10-08T12:53:29.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1557566 12.42 MB/sec execute 540 sec latency 13.059 ms 2023-10-08T12:53:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:29 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:53:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:29 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:53:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:29 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:53:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:29 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:53:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:29 smithi173 ceph-mon[135182]: pgmap v695: 97 pgs: 97 active+clean; 600 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 221 op/s 2023-10-08T12:53:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:29 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:53:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:29 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:53:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:29 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:53:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:29 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:53:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:29 smithi059 ceph-mon[98489]: pgmap v695: 97 pgs: 97 active+clean; 600 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 221 op/s 2023-10-08T12:53:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:29 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:53:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:29 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:53:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:29 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:53:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:29 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:53:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:29 smithi092 ceph-mon[134093]: pgmap v695: 97 pgs: 97 active+clean; 600 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 221 op/s 2023-10-08T12:53:30.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1559922 12.42 MB/sec execute 541 sec latency 22.360 ms 2023-10-08T12:53:31.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1561856 12.41 MB/sec execute 542 sec latency 56.140 ms 2023-10-08T12:53:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:32 smithi092 ceph-mon[134093]: pgmap v696: 97 pgs: 97 active+clean; 604 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 220 op/s 2023-10-08T12:53:32.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:32 smithi173 ceph-mon[135182]: pgmap v696: 97 pgs: 97 active+clean; 604 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 220 op/s 2023-10-08T12:53:32.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:32 smithi059 ceph-mon[98489]: pgmap v696: 97 pgs: 97 active+clean; 604 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 220 op/s 2023-10-08T12:53:32.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1564096 12.41 MB/sec execute 543 sec latency 15.223 ms 2023-10-08T12:53:33.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:33 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:53:33.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:33 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:53:33.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:33 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:53:33.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1566817 12.42 MB/sec execute 544 sec latency 15.320 ms 2023-10-08T12:53:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:34 smithi092 ceph-mon[134093]: pgmap v697: 97 pgs: 97 active+clean; 614 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.2 MiB/s wr, 237 op/s 2023-10-08T12:53:34.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:34 smithi173 ceph-mon[135182]: pgmap v697: 97 pgs: 97 active+clean; 614 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.2 MiB/s wr, 237 op/s 2023-10-08T12:53:34.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:34 smithi059 ceph-mon[98489]: pgmap v697: 97 pgs: 97 active+clean; 614 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.2 MiB/s wr, 237 op/s 2023-10-08T12:53:34.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1568720 12.41 MB/sec execute 545 sec latency 12.761 ms 2023-10-08T12:53:35.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1570863 12.41 MB/sec execute 546 sec latency 23.003 ms 2023-10-08T12:53:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:36 smithi092 ceph-mon[134093]: pgmap v698: 97 pgs: 97 active+clean; 614 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.5 MiB/s wr, 212 op/s 2023-10-08T12:53:36.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:36 smithi173 ceph-mon[135182]: pgmap v698: 97 pgs: 97 active+clean; 614 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.5 MiB/s wr, 212 op/s 2023-10-08T12:53:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:36 smithi059 ceph-mon[98489]: pgmap v698: 97 pgs: 97 active+clean; 614 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.5 MiB/s wr, 212 op/s 2023-10-08T12:53:36.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1572904 12.41 MB/sec execute 547 sec latency 47.631 ms 2023-10-08T12:53:37.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1574493 12.40 MB/sec execute 548 sec latency 183.564 ms 2023-10-08T12:53:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:38 smithi092 ceph-mon[134093]: pgmap v699: 97 pgs: 97 active+clean; 618 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 198 op/s 2023-10-08T12:53:38.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:38 smithi173 ceph-mon[135182]: pgmap v699: 97 pgs: 97 active+clean; 618 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 198 op/s 2023-10-08T12:53:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:38 smithi059 ceph-mon[98489]: pgmap v699: 97 pgs: 97 active+clean; 618 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 198 op/s 2023-10-08T12:53:38.550 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1577278 12.41 MB/sec execute 549 sec latency 23.673 ms 2023-10-08T12:53:39.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1578982 12.40 MB/sec execute 550 sec latency 15.327 ms 2023-10-08T12:53:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:39 smithi173 ceph-mon[135182]: pgmap v700: 97 pgs: 97 active+clean; 633 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 231 op/s 2023-10-08T12:53:40.306 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:39 smithi059 ceph-mon[98489]: pgmap v700: 97 pgs: 97 active+clean; 633 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 231 op/s 2023-10-08T12:53:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:39 smithi092 ceph-mon[134093]: pgmap v700: 97 pgs: 97 active+clean; 633 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 231 op/s 2023-10-08T12:53:40.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1581355 12.40 MB/sec execute 551 sec latency 12.811 ms 2023-10-08T12:53:41.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1583201 12.39 MB/sec execute 552 sec latency 127.816 ms 2023-10-08T12:53:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:42 smithi092 ceph-mon[134093]: pgmap v701: 97 pgs: 97 active+clean; 636 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 228 op/s 2023-10-08T12:53:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:42 smithi173 ceph-mon[135182]: pgmap v701: 97 pgs: 97 active+clean; 636 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 228 op/s 2023-10-08T12:53:42.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:42 smithi059 ceph-mon[98489]: pgmap v701: 97 pgs: 97 active+clean; 636 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 228 op/s 2023-10-08T12:53:42.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1585223 12.39 MB/sec execute 553 sec latency 18.861 ms 2023-10-08T12:53:43.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1587926 12.40 MB/sec execute 554 sec latency 13.115 ms 2023-10-08T12:53:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:44 smithi092 ceph-mon[134093]: pgmap v702: 97 pgs: 97 active+clean; 647 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 252 op/s 2023-10-08T12:53:44.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:44 smithi173 ceph-mon[135182]: pgmap v702: 97 pgs: 97 active+clean; 647 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 252 op/s 2023-10-08T12:53:44.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:44 smithi059 ceph-mon[98489]: pgmap v702: 97 pgs: 97 active+clean; 647 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 252 op/s 2023-10-08T12:53:44.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1589556 12.39 MB/sec execute 555 sec latency 20.142 ms 2023-10-08T12:53:45.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1591916 12.39 MB/sec execute 556 sec latency 47.828 ms 2023-10-08T12:53:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:46 smithi092 ceph-mon[134093]: pgmap v703: 97 pgs: 97 active+clean; 647 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 204 op/s 2023-10-08T12:53:46.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:46 smithi173 ceph-mon[135182]: pgmap v703: 97 pgs: 97 active+clean; 647 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 204 op/s 2023-10-08T12:53:46.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:46 smithi059 ceph-mon[98489]: pgmap v703: 97 pgs: 97 active+clean; 647 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 204 op/s 2023-10-08T12:53:46.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1593850 12.38 MB/sec execute 557 sec latency 113.758 ms 2023-10-08T12:53:47.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1595782 12.38 MB/sec execute 558 sec latency 30.050 ms 2023-10-08T12:53:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:48 smithi092 ceph-mon[134093]: pgmap v704: 97 pgs: 97 active+clean; 656 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.5 MiB/s wr, 229 op/s 2023-10-08T12:53:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:48 smithi173 ceph-mon[135182]: pgmap v704: 97 pgs: 97 active+clean; 656 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.5 MiB/s wr, 229 op/s 2023-10-08T12:53:48.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:48 smithi059 ceph-mon[98489]: pgmap v704: 97 pgs: 97 active+clean; 656 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.5 MiB/s wr, 229 op/s 2023-10-08T12:53:48.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1598291 12.39 MB/sec execute 559 sec latency 38.381 ms 2023-10-08T12:53:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:53:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:53:49.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:53:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:53:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:53:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:53:49.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:53:49.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:53:49.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:53:49.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1599777 12.38 MB/sec execute 560 sec latency 42.761 ms 2023-10-08T12:53:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:50 smithi092 ceph-mon[134093]: pgmap v705: 97 pgs: 97 active+clean; 648 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 228 op/s 2023-10-08T12:53:52.666 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:50 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:53:52.667 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:50 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:53:52.667 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:50 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:53:52.668 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:50 smithi059 ceph-mon[98489]: pgmap v705: 97 pgs: 97 active+clean; 648 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 228 op/s 2023-10-08T12:53:52.670 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:50 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:53:52.671 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:50 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:53:52.671 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:50 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:53:52.671 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:52 smithi092 ceph-mon[134093]: pgmap v706: 97 pgs: 97 active+clean; 634 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.7 MiB/s wr, 217 op/s 2023-10-08T12:53:52.672 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:50 smithi173 ceph-mon[135182]: pgmap v705: 97 pgs: 97 active+clean; 648 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 228 op/s 2023-10-08T12:53:52.672 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:50 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:53:52.672 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:50 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:53:52.672 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:50 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:53:52.672 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:52 smithi173 ceph-mon[135182]: pgmap v706: 97 pgs: 97 active+clean; 634 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.7 MiB/s wr, 217 op/s 2023-10-08T12:53:52.672 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1602323 12.38 MB/sec execute 561 sec latency 16.791 ms 2023-10-08T12:53:52.672 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1603792 12.37 MB/sec execute 562 sec latency 53.572 ms 2023-10-08T12:53:52.673 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:52 smithi059 ceph-mon[98489]: pgmap v706: 97 pgs: 97 active+clean; 634 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.7 MiB/s wr, 217 op/s 2023-10-08T12:53:52.673 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1606103 12.37 MB/sec execute 563 sec latency 41.193 ms 2023-10-08T12:53:53.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1608195 12.37 MB/sec execute 564 sec latency 47.692 ms 2023-10-08T12:53:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:54 smithi092 ceph-mon[134093]: pgmap v707: 97 pgs: 97 active+clean; 582 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 219 op/s 2023-10-08T12:53:54.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:54 smithi173 ceph-mon[135182]: pgmap v707: 97 pgs: 97 active+clean; 582 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 219 op/s 2023-10-08T12:53:54.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:54 smithi059 ceph-mon[98489]: pgmap v707: 97 pgs: 97 active+clean; 582 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 219 op/s 2023-10-08T12:53:54.551 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1610053 12.37 MB/sec execute 565 sec latency 92.940 ms 2023-10-08T12:53:55.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1612707 12.37 MB/sec execute 566 sec latency 15.059 ms 2023-10-08T12:53:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:56 smithi092 ceph-mon[134093]: pgmap v708: 97 pgs: 97 active+clean; 582 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 176 op/s 2023-10-08T12:53:56.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:56 smithi173 ceph-mon[135182]: pgmap v708: 97 pgs: 97 active+clean; 582 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 176 op/s 2023-10-08T12:53:56.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:56 smithi059 ceph-mon[98489]: pgmap v708: 97 pgs: 97 active+clean; 582 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 176 op/s 2023-10-08T12:53:56.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1614234 12.36 MB/sec execute 567 sec latency 63.923 ms 2023-10-08T12:53:57.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1616591 12.37 MB/sec execute 568 sec latency 32.968 ms 2023-10-08T12:53:58.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:53:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:58 smithi092 ceph-mon[134093]: pgmap v709: 97 pgs: 97 active+clean; 591 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.5 MiB/s wr, 215 op/s 2023-10-08T12:53:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.438+0000 7f206a3ff700 1 -- 172.21.15.59:0/3926776917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2064106740 msgr2=0x7f2064106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.438+0000 7f206a3ff700 1 --2- 172.21.15.59:0/3926776917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2064106740 0x7f2064106b20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2054009990 tx=0x7f2054009ca0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.438+0000 7f206a3ff700 1 -- 172.21.15.59:0/3926776917 shutdown_connections 2023-10-08T12:53:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.438+0000 7f206a3ff700 1 --2- 172.21.15.59:0/3926776917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20641010f0 0x7f206410d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.438+0000 7f206a3ff700 1 --2- 172.21.15.59:0/3926776917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2064106740 0x7f2064106b20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.438+0000 7f206a3ff700 1 --2- 172.21.15.59:0/3926776917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2064100730 0x7f2064100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.438+0000 7f206a3ff700 1 -- 172.21.15.59:0/3926776917 >> 172.21.15.59:0/3926776917 conn(0x7f20640fc200 msgr2=0x7f20640fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.438+0000 7f206a3ff700 1 -- 172.21.15.59:0/3926776917 shutdown_connections 2023-10-08T12:53:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.438+0000 7f206a3ff700 1 -- 172.21.15.59:0/3926776917 wait complete. 2023-10-08T12:53:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.439+0000 7f206a3ff700 1 Processor -- start 2023-10-08T12:53:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.439+0000 7f206a3ff700 1 -- start start 2023-10-08T12:53:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f206a3ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2064100730 0x7f2064198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f206a3ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20641010f0 0x7f2064199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f206a3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2064106740 0x7f206419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f206a3ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206419dce0 con 0x7f20641010f0 2023-10-08T12:53:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f206a3ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206419de50 con 0x7f2064100730 2023-10-08T12:53:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f206a3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206419e010 con 0x7f2064106740 2023-10-08T12:53:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f2063fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2064100730 0x7f2064198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f2063fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2064100730 0x7f2064198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:32798/0 (socket says 172.21.15.59:32798) 2023-10-08T12:53:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f2063fff700 1 -- 172.21.15.59:0/2627928182 learned_addr learned my addr 172.21.15.59:0/2627928182 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f206899c700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2064106740 0x7f206419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f20637fe700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20641010f0 0x7f2064199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f2063fff700 1 -- 172.21.15.59:0/2627928182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2064106740 msgr2=0x7f206419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f2063fff700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2064106740 0x7f206419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f2063fff700 1 -- 172.21.15.59:0/2627928182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20641010f0 msgr2=0x7f2064199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.440+0000 7f2063fff700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20641010f0 0x7f2064199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.441+0000 7f2063fff700 1 -- 172.21.15.59:0/2627928182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c009c40 con 0x7f2064100730 2023-10-08T12:53:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.441+0000 7f2063fff700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2064100730 0x7f2064198dc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2054005910 tx=0x7f2054004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.441+0000 7f20617fa700 1 -- 172.21.15.59:0/2627928182 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205401d070 con 0x7f2064100730 2023-10-08T12:53:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.441+0000 7f20617fa700 1 -- 172.21.15.59:0/2627928182 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2054022470 con 0x7f2064100730 2023-10-08T12:53:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.441+0000 7f206a3ff700 1 -- 172.21.15.59:0/2627928182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20540095f0 con 0x7f2064100730 2023-10-08T12:53:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.441+0000 7f20617fa700 1 -- 172.21.15.59:0/2627928182 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2054017650 con 0x7f2064100730 2023-10-08T12:53:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.441+0000 7f206a3ff700 1 -- 172.21.15.59:0/2627928182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20641a5950 con 0x7f2064100730 2023-10-08T12:53:58.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.446+0000 7f20617fa700 1 -- 172.21.15.59:0/2627928182 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f20540225e0 con 0x7f2064100730 2023-10-08T12:53:58.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.447+0000 7f20617fa700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f204c0a15f0 0x7f204c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.447+0000 7f207dd1ab80 1 Processor -- start 2023-10-08T12:53:58.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.448+0000 7f20617fa700 1 -- 172.21.15.59:0/2627928182 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f20540ce210 con 0x7f2064100730 2023-10-08T12:53:58.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.448+0000 7f207dd1ab80 1 -- start start 2023-10-08T12:53:58.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.448+0000 7f20637fe700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f204c0a15f0 0x7f204c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.448+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d7e3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.448+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d7ee110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.448+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7ee650 0x55791d7f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.448+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d74c460 con 0x55791d7ee650 2023-10-08T12:53:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.448+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d73dc20 con 0x55791d7e2e80 2023-10-08T12:53:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.448+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d73b540 con 0x55791d7e37a0 2023-10-08T12:53:58.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f20637fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d7ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f2063fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d7e3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f20637fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d7ee110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:43102/0 (socket says 172.21.15.59:43102) 2023-10-08T12:53:58.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f20637fe700 1 -- 172.21.15.59:0/2377103712 learned_addr learned my addr 172.21.15.59:0/2377103712 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:58.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f206899c700 1 --2- 172.21.15.59:0/2377103712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7ee650 0x55791d7f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f2063fff700 1 -- 172.21.15.59:0/2377103712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 msgr2=0x55791d7ee110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f2063fff700 1 --2- 172.21.15.59:0/2377103712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d7ee110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f20637fe700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f204c0a15f0 0x7f204c0a3ab0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f206419a310 tx=0x7f2058009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f2063fff700 1 -- 172.21.15.59:0/2377103712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7ee650 msgr2=0x55791d7f0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f2063fff700 1 --2- 172.21.15.59:0/2377103712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7ee650 0x55791d7f0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f2063fff700 1 -- 172.21.15.59:0/2377103712 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55791d561de0 con 0x55791d7e2e80 2023-10-08T12:53:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.449+0000 7f2063fff700 1 --2- 172.21.15.59:0/2377103712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d7e3260 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f20540cb920 tx=0x7f205409b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1515271e6b224198 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.450+0000 7f204a7fc700 1 -- 172.21.15.59:0/2377103712 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205409abd0 con 0x55791d7e2e80 2023-10-08T12:53:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.450+0000 7f204a7fc700 1 -- 172.21.15.59:0/2377103712 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f205409b970 con 0x55791d7e2e80 2023-10-08T12:53:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.450+0000 7f204a7fc700 1 -- 172.21.15.59:0/2377103712 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205409b4d0 con 0x55791d7e2e80 2023-10-08T12:53:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.450+0000 7f207dd1ab80 1 -- 172.21.15.59:0/2377103712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 msgr2=0x55791d7e3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.450+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/2377103712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d7e3260 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f20540cb920 tx=0x7f205409b040 comp rx=0 tx=0).stop 2023-10-08T12:53:58.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.451+0000 7f207dd1ab80 1 -- 172.21.15.59:0/2377103712 shutdown_connections 2023-10-08T12:53:58.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.451+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/2377103712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d7e3260 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.451+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/2377103712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7ee650 0x55791d7f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.451+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/2377103712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d7ee110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.451+0000 7f207dd1ab80 1 -- 172.21.15.59:0/2377103712 >> 172.21.15.59:0/2377103712 conn(0x55791d758260 msgr2=0x55791d7df2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:58.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.451+0000 7f207dd1ab80 1 -- 172.21.15.59:0/2377103712 shutdown_connections 2023-10-08T12:53:58.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.451+0000 7f207dd1ab80 1 -- 172.21.15.59:0/2377103712 wait complete. 2023-10-08T12:53:58.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.451+0000 7f207dd1ab80 1 -- start start 2023-10-08T12:53:58.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.451+0000 7f207dd1ab80 1 Processor -- start 2023-10-08T12:53:58.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d7eea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d7eef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7ee650 0x55791d7f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d736e30 con 0x55791d7ee650 2023-10-08T12:53:58.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d6d3710 con 0x55791d7e2e80 2023-10-08T12:53:58.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d6d33b0 con 0x55791d7e37a0 2023-10-08T12:53:58.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f207dd1ab80 10 client.0 _ll_register_callbacks cb 0x55791d530800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:58.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f20637fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d7eef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f2063fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d7eea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f206899c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7ee650 0x55791d7f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f20637fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d7eef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:43112/0 (socket says 172.21.15.59:43112) 2023-10-08T12:53:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.452+0000 7f20637fe700 1 -- 172.21.15.59:0/3475261973 learned_addr learned my addr 172.21.15.59:0/3475261973 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.453+0000 7f20637fe700 1 -- 172.21.15.59:0/3475261973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 msgr2=0x55791d7eea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.453+0000 7f20637fe700 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d7eea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.453+0000 7f20637fe700 1 -- 172.21.15.59:0/3475261973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7ee650 msgr2=0x55791d7f9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.453+0000 7f20637fe700 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7ee650 0x55791d7f9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.453+0000 7f20637fe700 1 -- 172.21.15.59:0/3475261973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20641a5950 con 0x55791d7e37a0 2023-10-08T12:53:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.453+0000 7f2063fff700 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d7eea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.453+0000 7f20637fe700 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d7eef70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2058004210 tx=0x7f20580047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa2bdabfa19ff599 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.453+0000 7f20437fe700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:53:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.453+0000 7f20437fe700 1 -- 172.21.15.59:0/3475261973 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058003d20 con 0x55791d7e37a0 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.453+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3475261973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55791d6feeb0 con 0x55791d7e37a0 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.453+0000 7f20437fe700 1 -- 172.21.15.59:0/3475261973 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f2058025410 con 0x55791d7e37a0 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.454+0000 7f20437fe700 1 -- 172.21.15.59:0/3475261973 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2058003e80 con 0x55791d7e37a0 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.454+0000 7f207dd1ab80 10 client.27310 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.454+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3475261973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55791d54ac60 con 0x55791d7e37a0 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.454+0000 7f20437fe700 1 -- 172.21.15.59:0/3475261973 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55791d6feeb0 con 0x55791d7e37a0 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.454+0000 7f20437fe700 1 -- 172.21.15.59:0/3475261973 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f205801c490 con 0x55791d7e37a0 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.454+0000 7f207dd1ab80 10 client.27310 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.454+0000 7f207dd1ab80 10 client.27310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.454+0000 7f207dd1ab80 20 client.27310 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.454+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55791d7fdfd0 0x55791d8003f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.454+0000 7f207dd1ab80 4 client.27310 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:53:58.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.454+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3475261973 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55791d72fe10 con 0x55791d7fdfd0 2023-10-08T12:53:58.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.455+0000 7f2063fff700 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55791d7fdfd0 0x55791d8003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.455+0000 7f2063fff700 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55791d7fdfd0 0x55791d8003f0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f2eb7cacb8f5980 server_cookie=cfdf24acc64886b9 in_seq=0 out_seq=0 2023-10-08T12:53:58.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.455+0000 7f20437fe700 10 client.27310 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.456+0000 7f20437fe700 1 -- 172.21.15.59:0/3475261973 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55791d72fe10 con 0x55791d7fdfd0 2023-10-08T12:53:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.456+0000 7f20437fe700 10 client.27310 handle_command_reply: tid=0 2023-10-08T12:53:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.456+0000 7f207dd1ab80 1 client.27310 shutdown 2023-10-08T12:53:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.456+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3475261973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 msgr2=0x55791d7eef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.456+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d7eef70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2058004210 tx=0x7f20580047c0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.456+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3475261973 shutdown_connections 2023-10-08T12:53:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.456+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55791d7fdfd0 0x55791d8003f0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.457+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d7eea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.457+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7ee650 0x55791d7f9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.457+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/3475261973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d7eef70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.457+0000 7f20437fe700 0 client.27310 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.457+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3475261973 >> 172.21.15.59:0/3475261973 conn(0x55791d758260 msgr2=0x55791d7deec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.457+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3475261973 shutdown_connections 2023-10-08T12:53:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.457+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3475261973 wait complete. 2023-10-08T12:53:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.457+0000 7f207dd1ab80 20 client.27310 trim_cache size 0 max 16384 2023-10-08T12:53:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:58 smithi173 ceph-mon[135182]: pgmap v709: 97 pgs: 97 active+clean; 591 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.5 MiB/s wr, 215 op/s 2023-10-08T12:53:58.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.477+0000 7f207dd1ab80 1 Processor -- start 2023-10-08T12:53:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.477+0000 7f207dd1ab80 1 -- start start 2023-10-08T12:53:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.477+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d8003c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.477+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e37a0 0x55791d7f3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.477+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7ee650 0x55791d7ec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.477+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d5b7920 con 0x55791d7e37a0 2023-10-08T12:53:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.477+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d7fa950 con 0x55791d7e2e80 2023-10-08T12:53:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.477+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d7fa2b0 con 0x55791d7ee650 2023-10-08T12:53:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f2063fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d8003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f2063fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d8003c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:32826/0 (socket says 172.21.15.59:32826) 2023-10-08T12:53:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f2063fff700 1 -- 172.21.15.59:0/3289031434 learned_addr learned my addr 172.21.15.59:0/3289031434 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:58.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f20637fe700 1 --2- 172.21.15.59:0/3289031434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e37a0 0x55791d7f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f206899c700 1 --2- 172.21.15.59:0/3289031434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7ee650 0x55791d7ec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f2063fff700 1 -- 172.21.15.59:0/3289031434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7ee650 msgr2=0x55791d7ec0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:58.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f2063fff700 1 --2- 172.21.15.59:0/3289031434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7ee650 0x55791d7ec0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f2063fff700 1 -- 172.21.15.59:0/3289031434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e37a0 msgr2=0x55791d7f3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:58.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f2063fff700 1 --2- 172.21.15.59:0/3289031434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e37a0 0x55791d7f3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f2063fff700 1 -- 172.21.15.59:0/3289031434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55791d588250 con 0x55791d7e2e80 2023-10-08T12:53:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f2063fff700 1 --2- 172.21.15.59:0/3289031434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d8003c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2054004800 tx=0x7f205401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1289fdd7f905808 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.478+0000 7f204affd700 1 -- 172.21.15.59:0/3289031434 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205407b070 con 0x55791d7e2e80 2023-10-08T12:53:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.479+0000 7f204affd700 1 -- 172.21.15.59:0/3289031434 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f205409f3c0 con 0x55791d7e2e80 2023-10-08T12:53:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.479+0000 7f204affd700 1 -- 172.21.15.59:0/3289031434 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205407f730 con 0x55791d7e2e80 2023-10-08T12:53:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.479+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3289031434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 msgr2=0x55791d8003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.479+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/3289031434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d8003c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2054004800 tx=0x7f205401a040 comp rx=0 tx=0).stop 2023-10-08T12:53:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.479+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3289031434 shutdown_connections 2023-10-08T12:53:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.479+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/3289031434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7e2e80 0x55791d8003c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.479+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/3289031434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7ee650 0x55791d7ec0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.479+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/3289031434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e37a0 0x55791d7f3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.479+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3289031434 >> 172.21.15.59:0/3289031434 conn(0x55791d758260 msgr2=0x55791d7ecd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.479+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3289031434 shutdown_connections 2023-10-08T12:53:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.480+0000 7f207dd1ab80 1 -- 172.21.15.59:0/3289031434 wait complete. 2023-10-08T12:53:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.480+0000 7f207dd1ab80 1 -- start start 2023-10-08T12:53:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.480+0000 7f207dd1ab80 1 Processor -- start 2023-10-08T12:53:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e2e80 0x55791d845f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d8464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f207dd1ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7ee650 0x55791d84af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d84b470 con 0x55791d7e2e80 2023-10-08T12:53:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d84b5e0 con 0x55791d7ee650 2023-10-08T12:53:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f207dd1ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791d84b7a0 con 0x55791d7e37a0 2023-10-08T12:53:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f207dd1ab80 10 client.0 _ll_register_callbacks cb 0x55791d530800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f2063fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e2e80 0x55791d845f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f206899c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7ee650 0x55791d84af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f2063fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e2e80 0x55791d845f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54504/0 (socket says 172.21.15.59:54504) 2023-10-08T12:53:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f2063fff700 1 -- 172.21.15.59:0/1270939841 learned_addr learned my addr 172.21.15.59:0/1270939841 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f20637fe700 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d8464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f206899c700 1 -- 172.21.15.59:0/1270939841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 msgr2=0x55791d8464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f206899c700 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d8464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f206899c700 1 -- 172.21.15.59:0/1270939841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e2e80 msgr2=0x55791d845f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f206899c700 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e2e80 0x55791d845f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f206899c700 1 -- 172.21.15.59:0/1270939841 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55791d561de0 con 0x55791d7ee650 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.481+0000 7f2063fff700 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e2e80 0x55791d845f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.482+0000 7f206899c700 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7ee650 0x55791d84af30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f205c009fd0 tx=0x7f205c004630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71de370b20684739 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.482+0000 7f20437fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.482+0000 7f20437fe700 1 -- 172.21.15.59:0/1270939841 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c01c070 con 0x55791d7ee650 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.482+0000 7f207dd1ab80 1 -- 172.21.15.59:0/1270939841 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f205409b970 con 0x55791d7ee650 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.482+0000 7f20437fe700 1 -- 172.21.15.59:0/1270939841 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f205c007710 con 0x55791d7ee650 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.482+0000 7f20437fe700 1 -- 172.21.15.59:0/1270939841 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f205c00e040 con 0x55791d7ee650 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.482+0000 7f207dd1ab80 10 client.27323 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.482+0000 7f207dd1ab80 1 -- 172.21.15.59:0/1270939841 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55791d5602b0 con 0x55791d7ee650 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.482+0000 7f20437fe700 1 -- 172.21.15.59:0/1270939841 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f205409b970 con 0x55791d7ee650 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.482+0000 7f20437fe700 1 -- 172.21.15.59:0/1270939841 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f205c02aa00 con 0x55791d7ee650 2023-10-08T12:53:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f207dd1ab80 10 client.27323 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f207dd1ab80 10 client.27323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f207dd1ab80 20 client.27323 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55791d852f90 0x55791d8553b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f207dd1ab80 4 client.27323 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:53:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f207dd1ab80 1 -- 172.21.15.59:0/1270939841 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55791d72fb30 con 0x55791d852f90 2023-10-08T12:53:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f2063fff700 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55791d852f90 0x55791d8553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f2063fff700 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55791d852f90 0x55791d8553b0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c80404655f6c51d9 server_cookie=f91d581c06959dc2 in_seq=0 out_seq=0 2023-10-08T12:53:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f20437fe700 10 client.27323 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f20437fe700 1 -- 172.21.15.59:0/1270939841 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55791d72fb30 con 0x55791d852f90 2023-10-08T12:53:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f20437fe700 10 client.27323 handle_command_reply: tid=0 2023-10-08T12:53:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.483+0000 7f207dd1ab80 1 client.27323 shutdown 2023-10-08T12:53:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f207dd1ab80 1 -- 172.21.15.59:0/1270939841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7ee650 msgr2=0x55791d84af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7ee650 0x55791d84af30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f205c009fd0 tx=0x7f205c004630 comp rx=0 tx=0).stop 2023-10-08T12:53:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f207dd1ab80 1 -- 172.21.15.59:0/1270939841 shutdown_connections 2023-10-08T12:53:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55791d852f90 0x55791d8553b0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55791d7ee650 0x55791d84af30 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55791d7e2e80 0x55791d845f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f20437fe700 0 client.27323 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f207dd1ab80 1 --2- 172.21.15.59:0/1270939841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55791d7e37a0 0x55791d8464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f207dd1ab80 1 -- 172.21.15.59:0/1270939841 >> 172.21.15.59:0/1270939841 conn(0x55791d758260 msgr2=0x55791d7ebce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f207dd1ab80 1 -- 172.21.15.59:0/1270939841 shutdown_connections 2023-10-08T12:53:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f207dd1ab80 1 -- 172.21.15.59:0/1270939841 wait complete. 2023-10-08T12:53:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.484+0000 7f207dd1ab80 20 client.27323 trim_cache size 0 max 16384 2023-10-08T12:53:58.491 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:53:58.491 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:53:58.491 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:53:58.491 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:53:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 -- 172.21.15.59:0/2627928182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f204c0a15f0 msgr2=0x7f204c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f204c0a15f0 0x7f204c0a3ab0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f206419a310 tx=0x7f2058009260 comp rx=0 tx=0).stop 2023-10-08T12:53:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 -- 172.21.15.59:0/2627928182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2064100730 msgr2=0x7f2064198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2064100730 0x7f2064198dc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2054005910 tx=0x7f2054004730 comp rx=0 tx=0).stop 2023-10-08T12:53:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 -- 172.21.15.59:0/2627928182 shutdown_connections 2023-10-08T12:53:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f204c0a15f0 0x7f204c0a3ab0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2064100730 0x7f2064198dc0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2064106740 0x7f206419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 --2- 172.21.15.59:0/2627928182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20641010f0 0x7f2064199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 -- 172.21.15.59:0/2627928182 >> 172.21.15.59:0/2627928182 conn(0x7f20640fc200 msgr2=0x7f20640fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:58.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 -- 172.21.15.59:0/2627928182 shutdown_connections 2023-10-08T12:53:58.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.485+0000 7f206a3ff700 1 -- 172.21.15.59:0/2627928182 wait complete. 2023-10-08T12:53:58.502 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:58 smithi059 ceph-mon[98489]: pgmap v709: 97 pgs: 97 active+clean; 591 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.5 MiB/s wr, 215 op/s 2023-10-08T12:53:58.505 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:53:58.505 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:53:58.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1618607 12.36 MB/sec execute 569 sec latency 20.840 ms 2023-10-08T12:53:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.733+0000 7f5515f9d700 1 -- 172.21.15.59:0/623169445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5510100fc0 msgr2=0x7f551010d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.733+0000 7f5515f9d700 1 --2- 172.21.15.59:0/623169445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5510100fc0 0x7f551010d4d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f550800b0a0 tx=0x7f550800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.733+0000 7f5515f9d700 1 -- 172.21.15.59:0/623169445 shutdown_connections 2023-10-08T12:53:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.733+0000 7f5515f9d700 1 --2- 172.21.15.59:0/623169445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5510100fc0 0x7f551010d4d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.733+0000 7f5515f9d700 1 --2- 172.21.15.59:0/623169445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55101066a0 0x7f5510106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.733+0000 7f5515f9d700 1 --2- 172.21.15.59:0/623169445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5510100600 0x7f5510100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.733+0000 7f5515f9d700 1 -- 172.21.15.59:0/623169445 >> 172.21.15.59:0/623169445 conn(0x7f55100fc130 msgr2=0x7f55100fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.733+0000 7f5515f9d700 1 -- 172.21.15.59:0/623169445 shutdown_connections 2023-10-08T12:53:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.733+0000 7f5515f9d700 1 -- 172.21.15.59:0/623169445 wait complete. 2023-10-08T12:53:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.734+0000 7f5515f9d700 1 Processor -- start 2023-10-08T12:53:58.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.735+0000 7f5515f9d700 1 -- start start 2023-10-08T12:53:58.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.735+0000 7f5515f9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5510100600 0x7f551019e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.735+0000 7f5515f9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5510100fc0 0x7f551019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.735+0000 7f5515f9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55101066a0 0x7f5510198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.735+0000 7f5515f9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5510199170 con 0x7f55101066a0 2023-10-08T12:53:58.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.735+0000 7f5515f9d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101992e0 con 0x7f5510100600 2023-10-08T12:53:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.735+0000 7f5515f9d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101994a0 con 0x7f5510100fc0 2023-10-08T12:53:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f5514f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5510100600 0x7f551019e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f550ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5510100fc0 0x7f551019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f5514f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5510100600 0x7f551019e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:32854/0 (socket says 172.21.15.59:32854) 2023-10-08T12:53:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f5514f9b700 1 -- 172.21.15.59:0/3731667537 learned_addr learned my addr 172.21.15.59:0/3731667537 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f551579c700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55101066a0 0x7f5510198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f5514f9b700 1 -- 172.21.15.59:0/3731667537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5510100fc0 msgr2=0x7f551019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f5514f9b700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5510100fc0 0x7f551019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f5514f9b700 1 -- 172.21.15.59:0/3731667537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55101066a0 msgr2=0x7f5510198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f5514f9b700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55101066a0 0x7f5510198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f5514f9b700 1 -- 172.21.15.59:0/3731667537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5508009d00 con 0x7f5510100600 2023-10-08T12:53:58.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f550ffff700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5510100fc0 0x7f551019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:58.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f5514f9b700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5510100600 0x7f551019e9e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f550400e970 tx=0x7f550400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:58.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.736+0000 7f550dffb700 1 -- 172.21.15.59:0/3731667537 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504009790 con 0x7f5510100600 2023-10-08T12:53:58.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.737+0000 7f550dffb700 1 -- 172.21.15.59:0/3731667537 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f550400eec0 con 0x7f5510100600 2023-10-08T12:53:58.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.737+0000 7f550dffb700 1 -- 172.21.15.59:0/3731667537 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504003cf0 con 0x7f5510100600 2023-10-08T12:53:58.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.737+0000 7f5515f9d700 1 -- 172.21.15.59:0/3731667537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5510199780 con 0x7f5510100600 2023-10-08T12:53:58.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.737+0000 7f5515f9d700 1 -- 172.21.15.59:0/3731667537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55101a59d0 con 0x7f5510100600 2023-10-08T12:53:58.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.738+0000 7f5515f9d700 1 -- 172.21.15.59:0/3731667537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5510101d40 con 0x7f5510100600 2023-10-08T12:53:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.740+0000 7f550dffb700 1 -- 172.21.15.59:0/3731667537 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f550400ccd0 con 0x7f5510100600 2023-10-08T12:53:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.741+0000 7f550dffb700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55000a1670 0x7f55000a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.741+0000 7f550dffb700 1 -- 172.21.15.59:0/3731667537 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f5504014070 con 0x7f5510100600 2023-10-08T12:53:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.742+0000 7f550ffff700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55000a1670 0x7f55000a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.742+0000 7f550ffff700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55000a1670 0x7f55000a3b30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5510199cd0 tx=0x7f54fc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:58.745+0000 7f550dffb700 1 -- 172.21.15.59:0/3731667537 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5504096580 con 0x7f5510100600 2023-10-08T12:53:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.013+0000 7f5515f9d700 1 -- 172.21.15.59:0/3731667537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55100673e0 con 0x7f5510100600 2023-10-08T12:53:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.014+0000 7f550dffb700 1 -- 172.21.15.59:0/3731667537 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f5504099ba0 con 0x7f5510100600 2023-10-08T12:53:59.016 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:53:59.016 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.017+0000 7f5515f9d700 1 -- 172.21.15.59:0/3731667537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55000a1670 msgr2=0x7f55000a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.017+0000 7f5515f9d700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55000a1670 0x7f55000a3b30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5510199cd0 tx=0x7f54fc009260 comp rx=0 tx=0).stop 2023-10-08T12:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.017+0000 7f5515f9d700 1 -- 172.21.15.59:0/3731667537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5510100600 msgr2=0x7f551019e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.017+0000 7f5515f9d700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5510100600 0x7f551019e9e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f550400e970 tx=0x7f550400ec80 comp rx=0 tx=0).stop 2023-10-08T12:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.017+0000 7f5515f9d700 1 -- 172.21.15.59:0/3731667537 shutdown_connections 2023-10-08T12:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.017+0000 7f5515f9d700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55000a1670 0x7f55000a3b30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.017+0000 7f5515f9d700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5510100600 0x7f551019e9e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.017+0000 7f5515f9d700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55101066a0 0x7f5510198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.017+0000 7f5515f9d700 1 --2- 172.21.15.59:0/3731667537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5510100fc0 0x7f551019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.017+0000 7f5515f9d700 1 -- 172.21.15.59:0/3731667537 >> 172.21.15.59:0/3731667537 conn(0x7f55100fc130 msgr2=0x7f551010b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.018+0000 7f5515f9d700 1 -- 172.21.15.59:0/3731667537 shutdown_connections 2023-10-08T12:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.018+0000 7f5515f9d700 1 -- 172.21.15.59:0/3731667537 wait complete. 2023-10-08T12:53:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:53:59.037 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:53:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.261+0000 7f845b5ff700 1 -- 172.21.15.59:0/2829710214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8454100730 msgr2=0x7f8454100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.261+0000 7f845b5ff700 1 --2- 172.21.15.59:0/2829710214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8454100730 0x7f8454100bb0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8444009990 tx=0x7f8444009ca0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.262+0000 7f845b5ff700 1 -- 172.21.15.59:0/2829710214 shutdown_connections 2023-10-08T12:53:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.262+0000 7f845b5ff700 1 --2- 172.21.15.59:0/2829710214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84541010f0 0x7f845410d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.262+0000 7f845b5ff700 1 --2- 172.21.15.59:0/2829710214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8454106740 0x7f8454106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.262+0000 7f845b5ff700 1 --2- 172.21.15.59:0/2829710214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8454100730 0x7f8454100bb0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.262+0000 7f845b5ff700 1 -- 172.21.15.59:0/2829710214 >> 172.21.15.59:0/2829710214 conn(0x7f84540fc200 msgr2=0x7f84540fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.262+0000 7f845b5ff700 1 -- 172.21.15.59:0/2829710214 shutdown_connections 2023-10-08T12:53:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.262+0000 7f845b5ff700 1 -- 172.21.15.59:0/2829710214 wait complete. 2023-10-08T12:53:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.263+0000 7f845b5ff700 1 Processor -- start 2023-10-08T12:53:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.263+0000 7f845b5ff700 1 -- start start 2023-10-08T12:53:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.263+0000 7f845b5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8454100730 0x7f8454198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.263+0000 7f845b5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84541010f0 0x7f8454199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.263+0000 7f845b5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8454106740 0x7f845419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.263+0000 7f845b5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845419dce0 con 0x7f84541010f0 2023-10-08T12:53:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.263+0000 7f845b5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845419de50 con 0x7f8454100730 2023-10-08T12:53:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.263+0000 7f845b5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845419e010 con 0x7f8454106740 2023-10-08T12:53:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f845939b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8454100730 0x7f8454198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f8458b9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84541010f0 0x7f8454199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f845939b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8454100730 0x7f8454198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:32880/0 (socket says 172.21.15.59:32880) 2023-10-08T12:53:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f845939b700 1 -- 172.21.15.59:0/4178198170 learned_addr learned my addr 172.21.15.59:0/4178198170 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f8459b9c700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8454106740 0x7f845419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f845939b700 1 -- 172.21.15.59:0/4178198170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8454106740 msgr2=0x7f845419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f845939b700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8454106740 0x7f845419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f845939b700 1 -- 172.21.15.59:0/4178198170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84541010f0 msgr2=0x7f8454199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f845939b700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84541010f0 0x7f8454199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f845939b700 1 -- 172.21.15.59:0/4178198170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84440095f0 con 0x7f8454100730 2023-10-08T12:53:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f8458b9a700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84541010f0 0x7f8454199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.264+0000 7f845939b700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8454100730 0x7f8454198dc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f845000e9a0 tx=0x7f845000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.265+0000 7f844a7fc700 1 -- 172.21.15.59:0/4178198170 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450009790 con 0x7f8454100730 2023-10-08T12:53:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.265+0000 7f844a7fc700 1 -- 172.21.15.59:0/4178198170 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8450010430 con 0x7f8454100730 2023-10-08T12:53:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.265+0000 7f844a7fc700 1 -- 172.21.15.59:0/4178198170 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450018680 con 0x7f8454100730 2023-10-08T12:53:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.265+0000 7f845b5ff700 1 -- 172.21.15.59:0/4178198170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845419e2f0 con 0x7f8454100730 2023-10-08T12:53:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.265+0000 7f845b5ff700 1 -- 172.21.15.59:0/4178198170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84541a5b30 con 0x7f8454100730 2023-10-08T12:53:59.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.268+0000 7f844a7fc700 1 -- 172.21.15.59:0/4178198170 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f84500105a0 con 0x7f8454100730 2023-10-08T12:53:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.269+0000 7f846ef94b80 1 Processor -- start 2023-10-08T12:53:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.269+0000 7f846ef94b80 1 -- start start 2023-10-08T12:53:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.269+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0b67a0 0x5648ee0c1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0c1650 0x5648ee0c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f846ef94b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ee01f460 con 0x5648ee0c1650 2023-10-08T12:53:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f846ef94b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ee010c20 con 0x5648ee0b67a0 2023-10-08T12:53:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f846ef94b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ee00e540 con 0x5648ee0b5e80 2023-10-08T12:53:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f845939b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0b67a0 0x5648ee0c1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f845939b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0b67a0 0x5648ee0c1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:32882/0 (socket says 172.21.15.59:32882) 2023-10-08T12:53:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f845939b700 1 -- 172.21.15.59:0/2247960557 learned_addr learned my addr 172.21.15.59:0/2247960557 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f844a7fc700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84400a15f0 0x7f84400a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f8459b9c700 1 --2- 172.21.15.59:0/2247960557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f8458b9a700 1 --2- 172.21.15.59:0/2247960557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0c1650 0x5648ee0c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f844a7fc700 1 -- 172.21.15.59:0/4178198170 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f8450014070 con 0x7f8454100730 2023-10-08T12:53:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f845939b700 1 -- 172.21.15.59:0/2247960557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 msgr2=0x5648ee0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f845939b700 1 --2- 172.21.15.59:0/2247960557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f8459b9c700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84400a15f0 0x7f84400a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f845939b700 1 -- 172.21.15.59:0/2247960557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0c1650 msgr2=0x5648ee0c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f845939b700 1 --2- 172.21.15.59:0/2247960557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0c1650 0x5648ee0c3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.270+0000 7f845939b700 1 -- 172.21.15.59:0/2247960557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648ede34de0 con 0x5648ee0b67a0 2023-10-08T12:53:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.271+0000 7f845939b700 1 --2- 172.21.15.59:0/2247960557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0b67a0 0x5648ee0c1110 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8450096cb0 tx=0x7f8450095f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3707c4b3e1e7b3c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.271+0000 7f843f7fe700 1 -- 172.21.15.59:0/2247960557 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450099ba0 con 0x5648ee0b67a0 2023-10-08T12:53:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.271+0000 7f843f7fe700 1 -- 172.21.15.59:0/2247960557 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f845009a940 con 0x5648ee0b67a0 2023-10-08T12:53:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.271+0000 7f843f7fe700 1 -- 172.21.15.59:0/2247960557 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450010880 con 0x5648ee0b67a0 2023-10-08T12:53:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.272+0000 7f846ef94b80 1 -- 172.21.15.59:0/2247960557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0b67a0 msgr2=0x5648ee0c1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.272+0000 7f8459b9c700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84400a15f0 0x7f84400a3ab0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f844c009ec0 tx=0x7f844c004b40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.272+0000 7f846ef94b80 1 --2- 172.21.15.59:0/2247960557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0b67a0 0x5648ee0c1110 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8450096cb0 tx=0x7f8450095f60 comp rx=0 tx=0).stop 2023-10-08T12:53:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.272+0000 7f846ef94b80 1 -- 172.21.15.59:0/2247960557 shutdown_connections 2023-10-08T12:53:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.272+0000 7f846ef94b80 1 --2- 172.21.15.59:0/2247960557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0c1650 0x5648ee0c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.272+0000 7f846ef94b80 1 --2- 172.21.15.59:0/2247960557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.272+0000 7f846ef94b80 1 --2- 172.21.15.59:0/2247960557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0b67a0 0x5648ee0c1110 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.272+0000 7f846ef94b80 1 -- 172.21.15.59:0/2247960557 >> 172.21.15.59:0/2247960557 conn(0x5648ee02b260 msgr2=0x5648ee0b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.272+0000 7f846ef94b80 1 -- 172.21.15.59:0/2247960557 shutdown_connections 2023-10-08T12:53:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.272+0000 7f846ef94b80 1 -- 172.21.15.59:0/2247960557 wait complete. 2023-10-08T12:53:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.272+0000 7f846ef94b80 1 -- start start 2023-10-08T12:53:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f846ef94b80 1 Processor -- start 2023-10-08T12:53:59.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b67a0 0x5648ee0be310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f846ef94b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ee009e30 con 0x5648ee0b67a0 2023-10-08T12:53:59.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f846ef94b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648edfa6710 con 0x5648ee0c1650 2023-10-08T12:53:59.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f846ef94b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648edfa63b0 con 0x5648ee0b5e80 2023-10-08T12:53:59.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f846ef94b80 10 client.0 _ll_register_callbacks cb 0x5648ede03800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:59.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f8458b9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b67a0 0x5648ee0be310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f845939b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f8459b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f845939b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0c0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:43190/0 (socket says 172.21.15.59:43190) 2023-10-08T12:53:59.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.274+0000 7f845939b700 1 -- 172.21.15.59:0/4147413845 learned_addr learned my addr 172.21.15.59:0/4147413845 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:59.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.273+0000 7f8458b9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b67a0 0x5648ee0be310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54558/0 (socket says 172.21.15.59:54558) 2023-10-08T12:53:59.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.274+0000 7f845939b700 1 -- 172.21.15.59:0/4147413845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 msgr2=0x5648ee0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:59.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.274+0000 7f845939b700 1 --2- 172.21.15.59:0/4147413845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.274+0000 7f845939b700 1 -- 172.21.15.59:0/4147413845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b67a0 msgr2=0x5648ee0be310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:59.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.274+0000 7f845939b700 1 --2- 172.21.15.59:0/4147413845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b67a0 0x5648ee0be310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.274+0000 7f845939b700 1 -- 172.21.15.59:0/4147413845 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84541a5b30 con 0x5648ee0b5e80 2023-10-08T12:53:59.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.274+0000 7f845939b700 1 --2- 172.21.15.59:0/4147413845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0c0fd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8450000c00 tx=0x7f8450096c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fde74d96c1a6be5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:59.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.274+0000 7f843cff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:53:59.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.274+0000 7f843cff9700 1 -- 172.21.15.59:0/4147413845 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450099ba0 con 0x5648ee0b5e80 2023-10-08T12:53:59.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.274+0000 7f843cff9700 1 -- 172.21.15.59:0/4147413845 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f845009a240 con 0x5648ee0b5e80 2023-10-08T12:53:59.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.274+0000 7f846ef94b80 1 -- 172.21.15.59:0/4147413845 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648edfd1eb0 con 0x5648ee0b5e80 2023-10-08T12:53:59.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f843cff9700 1 -- 172.21.15.59:0/4147413845 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84500a25d0 con 0x5648ee0b5e80 2023-10-08T12:53:59.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f846ef94b80 10 client.27334 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:59.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f846ef94b80 1 -- 172.21.15.59:0/4147413845 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5648ede1dc60 con 0x5648ee0b5e80 2023-10-08T12:53:59.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f843cff9700 1 -- 172.21.15.59:0/4147413845 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84500b8020 con 0x5648ee0b5e80 2023-10-08T12:53:59.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f843cff9700 1 -- 172.21.15.59:0/4147413845 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f84500a2140 con 0x5648ee0b5e80 2023-10-08T12:53:59.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f846ef94b80 10 client.27334 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:59.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f846ef94b80 10 client.27334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:59.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f846ef94b80 20 client.27334 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:59.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f846ef94b80 1 --2- 172.21.15.59:0/4147413845 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5648ee0d0e90 0x5648ee0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f846ef94b80 4 client.27334 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:53:59.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f846ef94b80 1 -- 172.21.15.59:0/4147413845 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648ee002e10 con 0x5648ee0d0e90 2023-10-08T12:53:59.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.275+0000 7f8458b9a700 1 --2- 172.21.15.59:0/4147413845 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5648ee0d0e90 0x5648ee0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.276+0000 7f8458b9a700 1 --2- 172.21.15.59:0/4147413845 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5648ee0d0e90 0x5648ee0d3280 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d55d888c8a0cd79 server_cookie=6d4430d67ab599d4 in_seq=0 out_seq=0 2023-10-08T12:53:59.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.276+0000 7f843cff9700 10 client.27334 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:59.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f843cff9700 1 -- 172.21.15.59:0/4147413845 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5648ee002e10 con 0x5648ee0d0e90 2023-10-08T12:53:59.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f843cff9700 10 client.27334 handle_command_reply: tid=0 2023-10-08T12:53:59.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f846ef94b80 1 client.27334 shutdown 2023-10-08T12:53:59.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f846ef94b80 1 -- 172.21.15.59:0/4147413845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 msgr2=0x5648ee0c0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:59.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f846ef94b80 1 --2- 172.21.15.59:0/4147413845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0c0fd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8450000c00 tx=0x7f8450096c00 comp rx=0 tx=0).stop 2023-10-08T12:53:59.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f846ef94b80 1 -- 172.21.15.59:0/4147413845 shutdown_connections 2023-10-08T12:53:59.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f846ef94b80 1 --2- 172.21.15.59:0/4147413845 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5648ee0d0e90 0x5648ee0d3280 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f846ef94b80 1 --2- 172.21.15.59:0/4147413845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f846ef94b80 1 --2- 172.21.15.59:0/4147413845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0c0fd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f846ef94b80 1 --2- 172.21.15.59:0/4147413845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b67a0 0x5648ee0be310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f843cff9700 0 client.27334 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:59.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.277+0000 7f846ef94b80 1 -- 172.21.15.59:0/4147413845 >> 172.21.15.59:0/4147413845 conn(0x5648ee02b260 msgr2=0x5648ee0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:59.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.278+0000 7f846ef94b80 1 -- 172.21.15.59:0/4147413845 shutdown_connections 2023-10-08T12:53:59.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.278+0000 7f846ef94b80 1 -- 172.21.15.59:0/4147413845 wait complete. 2023-10-08T12:53:59.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.278+0000 7f846ef94b80 20 client.27334 trim_cache size 0 max 16384 2023-10-08T12:53:59.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.291+0000 7f846ef94b80 1 Processor -- start 2023-10-08T12:53:59.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.291+0000 7f846ef94b80 1 -- start start 2023-10-08T12:53:59.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0b8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b67a0 0x5648ee0bdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0be000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f846ef94b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ede8a920 con 0x5648ee0b67a0 2023-10-08T12:53:59.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f846ef94b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ee0c3a40 con 0x5648ee0c1650 2023-10-08T12:53:59.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f846ef94b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ee0c3c00 con 0x5648ee0b5e80 2023-10-08T12:53:59.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f845939b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0b8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f845939b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0b8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:43196/0 (socket says 172.21.15.59:43196) 2023-10-08T12:53:59.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f845939b700 1 -- 172.21.15.59:0/737649260 learned_addr learned my addr 172.21.15.59:0/737649260 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:59.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f8459b9c700 1 --2- 172.21.15.59:0/737649260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f8458b9a700 1 --2- 172.21.15.59:0/737649260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b67a0 0x5648ee0bdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f845939b700 1 -- 172.21.15.59:0/737649260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 msgr2=0x5648ee0be000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:59.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f845939b700 1 --2- 172.21.15.59:0/737649260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0be000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f845939b700 1 -- 172.21.15.59:0/737649260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b67a0 msgr2=0x5648ee0bdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:59.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f845939b700 1 --2- 172.21.15.59:0/737649260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b67a0 0x5648ee0bdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.292+0000 7f845939b700 1 -- 172.21.15.59:0/737649260 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648ede5b250 con 0x5648ee0b5e80 2023-10-08T12:53:59.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f845939b700 1 --2- 172.21.15.59:0/737649260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0b8db0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8450010c30 tx=0x7f8450096310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5f026f65b5ee31a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:59.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f843ffff700 1 -- 172.21.15.59:0/737649260 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450099ba0 con 0x5648ee0b5e80 2023-10-08T12:53:59.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f843ffff700 1 -- 172.21.15.59:0/737649260 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84500b8040 con 0x5648ee0b5e80 2023-10-08T12:53:59.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f843ffff700 1 -- 172.21.15.59:0/737649260 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500a22d0 con 0x5648ee0b5e80 2023-10-08T12:53:59.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f846ef94b80 1 -- 172.21.15.59:0/737649260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 msgr2=0x5648ee0b8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:59.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f846ef94b80 1 --2- 172.21.15.59:0/737649260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0b8db0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8450010c30 tx=0x7f8450096310 comp rx=0 tx=0).stop 2023-10-08T12:53:59.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f846ef94b80 1 -- 172.21.15.59:0/737649260 shutdown_connections 2023-10-08T12:53:59.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f846ef94b80 1 --2- 172.21.15.59:0/737649260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0be000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f846ef94b80 1 --2- 172.21.15.59:0/737649260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b5e80 0x5648ee0b8db0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f846ef94b80 1 --2- 172.21.15.59:0/737649260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b67a0 0x5648ee0bdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f846ef94b80 1 -- 172.21.15.59:0/737649260 >> 172.21.15.59:0/737649260 conn(0x5648ee02b260 msgr2=0x5648ee0b9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:59.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.293+0000 7f846ef94b80 1 -- 172.21.15.59:0/737649260 shutdown_connections 2023-10-08T12:53:59.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.294+0000 7f846ef94b80 1 -- 172.21.15.59:0/737649260 wait complete. 2023-10-08T12:53:59.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.294+0000 7f846ef94b80 1 -- start start 2023-10-08T12:53:59.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.294+0000 7f846ef94b80 1 Processor -- start 2023-10-08T12:53:59.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b5e80 0x5648ee0c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b67a0 0x5648ee0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f846ef94b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0c6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f846ef94b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ee0c6970 con 0x5648ee0b5e80 2023-10-08T12:53:59.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f846ef94b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ee0c6ae0 con 0x5648ee0c1650 2023-10-08T12:53:59.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f846ef94b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ee0c6ca0 con 0x5648ee0b67a0 2023-10-08T12:53:59.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f846ef94b80 10 client.0 _ll_register_callbacks cb 0x7f8450005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:59.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f845939b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b5e80 0x5648ee0c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f845939b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b5e80 0x5648ee0c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54576/0 (socket says 172.21.15.59:54576) 2023-10-08T12:53:59.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f845939b700 1 -- 172.21.15.59:0/3384191509 learned_addr learned my addr 172.21.15.59:0/3384191509 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:53:59.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f8458b9a700 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b67a0 0x5648ee0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.295+0000 7f8459b9c700 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f845939b700 1 -- 172.21.15.59:0/3384191509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b67a0 msgr2=0x5648ee0c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:59.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f845939b700 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b67a0 0x5648ee0c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f845939b700 1 -- 172.21.15.59:0/3384191509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 msgr2=0x5648ee0c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:59.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f845939b700 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f845939b700 1 -- 172.21.15.59:0/3384191509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648ede1dc60 con 0x5648ee0b5e80 2023-10-08T12:53:59.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f845939b700 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b5e80 0x5648ee0c7da0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8450009230 tx=0x7f8450095f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30e784349bc64ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:59.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f843cff9700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:53:59.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f843cff9700 1 -- 172.21.15.59:0/3384191509 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500a25d0 con 0x5648ee0b5e80 2023-10-08T12:53:59.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f843cff9700 1 -- 172.21.15.59:0/3384191509 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f845009e170 con 0x5648ee0b5e80 2023-10-08T12:53:59.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f846ef94b80 1 -- 172.21.15.59:0/3384191509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f845009a940 con 0x5648ee0b5e80 2023-10-08T12:53:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f843cff9700 1 -- 172.21.15.59:0/3384191509 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84500991f0 con 0x5648ee0b5e80 2023-10-08T12:53:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f846ef94b80 10 client.17331 fetch_fsmap learned FSMap version 20 2023-10-08T12:53:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.296+0000 7f846ef94b80 1 -- 172.21.15.59:0/3384191509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5648ede332b0 con 0x5648ee0b5e80 2023-10-08T12:53:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.297+0000 7f843cff9700 1 -- 172.21.15.59:0/3384191509 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f845009a940 con 0x5648ee0b5e80 2023-10-08T12:53:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.297+0000 7f843cff9700 1 -- 172.21.15.59:0/3384191509 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f845000ca10 con 0x5648ee0b5e80 2023-10-08T12:53:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.297+0000 7f846ef94b80 10 client.17331 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:53:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.297+0000 7f846ef94b80 10 client.17331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.297+0000 7f846ef94b80 20 client.17331 populate_metadata read hostname 'smithi059' 2023-10-08T12:53:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.297+0000 7f846ef94b80 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5648ee125ac0 0x5648ee127eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.297+0000 7f846ef94b80 4 client.17331 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:53:59.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.297+0000 7f846ef94b80 1 -- 172.21.15.59:0/3384191509 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5648ee002b30 con 0x5648ee125ac0 2023-10-08T12:53:59.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.297+0000 7f8458b9a700 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5648ee125ac0 0x5648ee127eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:59.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f8458b9a700 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5648ee125ac0 0x5648ee127eb0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b51f934603802b36 server_cookie=d4e239e54d0b69e in_seq=0 out_seq=0 2023-10-08T12:53:59.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f843cff9700 10 client.17331 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:59.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f843cff9700 1 -- 172.21.15.59:0/3384191509 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5648ee002b30 con 0x5648ee125ac0 2023-10-08T12:53:59.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f843cff9700 10 client.17331 handle_command_reply: tid=0 2023-10-08T12:53:59.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f846ef94b80 1 client.17331 shutdown 2023-10-08T12:53:59.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f846ef94b80 1 -- 172.21.15.59:0/3384191509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b5e80 msgr2=0x5648ee0c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:59.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f846ef94b80 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b5e80 0x5648ee0c7da0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8450009230 tx=0x7f8450095f60 comp rx=0 tx=0).stop 2023-10-08T12:53:59.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f846ef94b80 1 -- 172.21.15.59:0/3384191509 shutdown_connections 2023-10-08T12:53:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f846ef94b80 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5648ee125ac0 0x5648ee127eb0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f846ef94b80 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee0c1650 0x5648ee0c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f846ef94b80 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648ee0b5e80 0x5648ee0c7da0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f843cff9700 0 client.17331 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:53:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f846ef94b80 1 --2- 172.21.15.59:0/3384191509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ee0b67a0 0x5648ee0c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f846ef94b80 1 -- 172.21.15.59:0/3384191509 >> 172.21.15.59:0/3384191509 conn(0x5648ee02b260 msgr2=0x5648ee0cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.298+0000 7f846ef94b80 1 -- 172.21.15.59:0/3384191509 shutdown_connections 2023-10-08T12:53:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f846ef94b80 1 -- 172.21.15.59:0/3384191509 wait complete. 2023-10-08T12:53:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f846ef94b80 20 client.17331 trim_cache size 0 max 16384 2023-10-08T12:53:59.306 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:53:59.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f845b5ff700 1 -- 172.21.15.59:0/4178198170 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84400a15f0 msgr2=0x7f84400a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f845b5ff700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84400a15f0 0x7f84400a3ab0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f844c009ec0 tx=0x7f844c004b40 comp rx=0 tx=0).stop 2023-10-08T12:53:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f845b5ff700 1 -- 172.21.15.59:0/4178198170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8454100730 msgr2=0x7f8454198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f845b5ff700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8454100730 0x7f8454198dc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f845000e9a0 tx=0x7f845000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f845b5ff700 1 -- 172.21.15.59:0/4178198170 shutdown_connections 2023-10-08T12:53:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f845b5ff700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f84400a15f0 0x7f84400a3ab0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f845b5ff700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8454100730 0x7f8454198dc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f845b5ff700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8454106740 0x7f845419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f845b5ff700 1 --2- 172.21.15.59:0/4178198170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84541010f0 0x7f8454199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f845b5ff700 1 -- 172.21.15.59:0/4178198170 >> 172.21.15.59:0/4178198170 conn(0x7f84540fc200 msgr2=0x7f84540fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.299+0000 7f845b5ff700 1 -- 172.21.15.59:0/4178198170 shutdown_connections 2023-10-08T12:53:59.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:53:59.300+0000 7f845b5ff700 1 -- 172.21.15.59:0/4178198170 wait complete. 2023-10-08T12:53:59.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1619966 12.35 MB/sec execute 570 sec latency 398.220 ms 2023-10-08T12:54:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:59 smithi173 ceph-mon[135182]: pgmap v710: 97 pgs: 97 active+clean; 602 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 230 op/s 2023-10-08T12:54:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:53:59 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3731667537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:54:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:59 smithi059 ceph-mon[98489]: pgmap v710: 97 pgs: 97 active+clean; 602 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 230 op/s 2023-10-08T12:54:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:53:59 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3731667537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:54:00.319 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:54:00.319 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:54:00.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:59 smithi092 ceph-mon[134093]: pgmap v710: 97 pgs: 97 active+clean; 602 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 230 op/s 2023-10-08T12:54:00.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:53:59 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3731667537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:54:00.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1621513 12.34 MB/sec execute 571 sec latency 26.253 ms 2023-10-08T12:54:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.563+0000 7fc6c09ff700 1 -- 172.21.15.59:0/1109443657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6bc106740 msgr2=0x7fc6bc106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.563+0000 7fc6c09ff700 1 --2- 172.21.15.59:0/1109443657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6bc106740 0x7fc6bc106b20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009990 tx=0x7fc6ac009ca0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.563+0000 7fc6c09ff700 1 -- 172.21.15.59:0/1109443657 shutdown_connections 2023-10-08T12:54:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.563+0000 7fc6c09ff700 1 --2- 172.21.15.59:0/1109443657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6bc1010f0 0x7fc6bc10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.563+0000 7fc6c09ff700 1 --2- 172.21.15.59:0/1109443657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6bc106740 0x7fc6bc106b20 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.563+0000 7fc6c09ff700 1 --2- 172.21.15.59:0/1109443657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6bc100730 0x7fc6bc100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.563+0000 7fc6c09ff700 1 -- 172.21.15.59:0/1109443657 >> 172.21.15.59:0/1109443657 conn(0x7fc6bc0fc200 msgr2=0x7fc6bc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.563+0000 7fc6c09ff700 1 -- 172.21.15.59:0/1109443657 shutdown_connections 2023-10-08T12:54:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.564+0000 7fc6c09ff700 1 -- 172.21.15.59:0/1109443657 wait complete. 2023-10-08T12:54:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.565+0000 7fc6c09ff700 1 Processor -- start 2023-10-08T12:54:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.565+0000 7fc6c09ff700 1 -- start start 2023-10-08T12:54:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6c09ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6bc100730 0x7fc6bc19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6c09ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6bc1010f0 0x7fc6bc19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6c09ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6bc106740 0x7fc6bc196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6c09ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc197060 con 0x7fc6bc106740 2023-10-08T12:54:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6c09ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc1971d0 con 0x7fc6bc100730 2023-10-08T12:54:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6c09ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc197390 con 0x7fc6bc1010f0 2023-10-08T12:54:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6bc100730 0x7fc6bc19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6bc100730 0x7fc6bc19c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:32948/0 (socket says 172.21.15.59:32948) 2023-10-08T12:54:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6ba59c700 1 -- 172.21.15.59:0/3026747434 learned_addr learned my addr 172.21.15.59:0/3026747434 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6b9d9b700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6bc1010f0 0x7fc6bc19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6bad9d700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6bc106740 0x7fc6bc196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6ba59c700 1 -- 172.21.15.59:0/3026747434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6bc1010f0 msgr2=0x7fc6bc19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6bc1010f0 0x7fc6bc19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6ba59c700 1 -- 172.21.15.59:0/3026747434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6bc106740 msgr2=0x7fc6bc196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6bc106740 0x7fc6bc196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.566+0000 7fc6ba59c700 1 -- 172.21.15.59:0/3026747434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0009520 con 0x7fc6bc100730 2023-10-08T12:54:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.567+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6bc100730 0x7fc6bc19c8d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac005910 tx=0x7fc6ac004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.567+0000 7fc6ab7fe700 1 -- 172.21.15.59:0/3026747434 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac01d070 con 0x7fc6bc100730 2023-10-08T12:54:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.567+0000 7fc6ab7fe700 1 -- 172.21.15.59:0/3026747434 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6ac022470 con 0x7fc6bc100730 2023-10-08T12:54:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.567+0000 7fc6c09ff700 1 -- 172.21.15.59:0/3026747434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac0095f0 con 0x7fc6bc100730 2023-10-08T12:54:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.567+0000 7fc6ab7fe700 1 -- 172.21.15.59:0/3026747434 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac017650 con 0x7fc6bc100730 2023-10-08T12:54:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.567+0000 7fc6c09ff700 1 -- 172.21.15.59:0/3026747434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc1a36e0 con 0x7fc6bc100730 2023-10-08T12:54:00.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.570+0000 7fc6ab7fe700 1 -- 172.21.15.59:0/3026747434 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc6ac0225e0 con 0x7fc6bc100730 2023-10-08T12:54:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.572+0000 7fc6ab7fe700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6a40a1670 0x7fc6a40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.572+0000 7fc6d4254b80 1 Processor -- start 2023-10-08T12:54:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.572+0000 7fc6ab7fe700 1 -- 172.21.15.59:0/3026747434 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fc6ac0ce3c0 con 0x7fc6bc100730 2023-10-08T12:54:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.572+0000 7fc6b9d9b700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6a40a1670 0x7fc6a40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.572+0000 7fc6d4254b80 1 -- start start 2023-10-08T12:54:00.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.572+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 0x55681a9ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9ac820 0x55681a9bb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9bbae0 0x55681a9bded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681a9154e0 con 0x55681a9abf00 2023-10-08T12:54:00.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681a906ca0 con 0x55681a9bbae0 2023-10-08T12:54:00.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681a9045c0 con 0x55681a9ac820 2023-10-08T12:54:00.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 0x55681a9ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6bad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9bbae0 0x55681a9bded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6bad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9bbae0 0x55681a9bded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:32956/0 (socket says 172.21.15.59:32956) 2023-10-08T12:54:00.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6bad9d700 1 -- 172.21.15.59:0/1139333321 learned_addr learned my addr 172.21.15.59:0/1139333321 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:00.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6b9d9b700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6a40a1670 0x7fc6a40a3b30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc197bc0 tx=0x7fc6b0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6b9d9b700 1 --2- 172.21.15.59:0/1139333321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9ac820 0x55681a9bb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6bad9d700 1 -- 172.21.15.59:0/1139333321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9ac820 msgr2=0x55681a9bb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6bad9d700 1 --2- 172.21.15.59:0/1139333321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9ac820 0x55681a9bb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6bad9d700 1 -- 172.21.15.59:0/1139333321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 msgr2=0x55681a9ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6bad9d700 1 --2- 172.21.15.59:0/1139333321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 0x55681a9ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6bad9d700 1 -- 172.21.15.59:0/1139333321 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55681a72ae60 con 0x55681a9bbae0 2023-10-08T12:54:00.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.573+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/1139333321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 0x55681a9ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:00.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.574+0000 7fc6bad9d700 1 --2- 172.21.15.59:0/1139333321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9bbae0 0x55681a9bded0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4003fd0 tx=0x7fc6b4009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=521f4224bbe36888 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.574+0000 7fc6a8ff9700 1 -- 172.21.15.59:0/1139333321 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4019070 con 0x55681a9bbae0 2023-10-08T12:54:00.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.574+0000 7fc6a8ff9700 1 -- 172.21.15.59:0/1139333321 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6b400f040 con 0x55681a9bbae0 2023-10-08T12:54:00.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.574+0000 7fc6a8ff9700 1 -- 172.21.15.59:0/1139333321 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4007af0 con 0x55681a9bbae0 2023-10-08T12:54:00.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.575+0000 7fc6d4254b80 1 -- 172.21.15.59:0/1139333321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9bbae0 msgr2=0x55681a9bded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.575+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/1139333321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9bbae0 0x55681a9bded0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4003fd0 tx=0x7fc6b4009ba0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.575+0000 7fc6d4254b80 1 -- 172.21.15.59:0/1139333321 shutdown_connections 2023-10-08T12:54:00.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.575+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/1139333321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9bbae0 0x55681a9bded0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.575+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/1139333321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 0x55681a9ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.575+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/1139333321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9ac820 0x55681a9bb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.575+0000 7fc6d4254b80 1 -- 172.21.15.59:0/1139333321 >> 172.21.15.59:0/1139333321 conn(0x55681a9212e0 msgr2=0x55681a9a8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.575+0000 7fc6d4254b80 1 -- 172.21.15.59:0/1139333321 shutdown_connections 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.575+0000 7fc6d4254b80 1 -- 172.21.15.59:0/1139333321 wait complete. 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.575+0000 7fc6d4254b80 1 -- start start 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.576+0000 7fc6d4254b80 1 Processor -- start 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.576+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 0x55681a9bb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.576+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9ac820 0x55681a9b8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.576+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9bbae0 0x55681a9b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.576+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681a8ffeb0 con 0x55681a9abf00 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.576+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681a89c790 con 0x55681a9ac820 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.576+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681a89c430 con 0x55681a9bbae0 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.576+0000 7fc6d4254b80 10 client.0 _ll_register_callbacks cb 0x55681a6f9880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:00.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6b9d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9ac820 0x55681a9b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 0x55681a9bb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6b9d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9ac820 0x55681a9b8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:32964/0 (socket says 172.21.15.59:32964) 2023-10-08T12:54:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6b9d9b700 1 -- 172.21.15.59:0/743323331 learned_addr learned my addr 172.21.15.59:0/743323331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6bad9d700 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9bbae0 0x55681a9b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6ba59c700 1 -- 172.21.15.59:0/743323331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9bbae0 msgr2=0x55681a9b8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9bbae0 0x55681a9b8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6ba59c700 1 -- 172.21.15.59:0/743323331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9ac820 msgr2=0x55681a9b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9ac820 0x55681a9b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6ba59c700 1 -- 172.21.15.59:0/743323331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc1a36e0 con 0x55681a9abf00 2023-10-08T12:54:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6b9d9b700 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9ac820 0x55681a9b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 0x55681a9bb550 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0cbb00 tx=0x7fc6ac097890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42e3f21ffb00ff6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.577+0000 7fc6a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/743323331 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac09b420 con 0x55681a9abf00 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/743323331 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fc6ac09f570 con 0x55681a9abf00 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6d4254b80 1 -- 172.21.15.59:0/743323331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55681a8c7f30 con 0x55681a9abf00 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/743323331 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6ac0a3720 con 0x55681a9abf00 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6d4254b80 10 client.17343 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6d4254b80 1 -- 172.21.15.59:0/743323331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fc6b4003bd0 con 0x55681a9abf00 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/743323331 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6ac081080 con 0x55681a9abf00 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/743323331 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc6ac0a3290 con 0x55681a9abf00 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6d4254b80 10 client.17343 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6d4254b80 10 client.17343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:00.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6d4254b80 20 client.17343 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:00.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55681a9cb350 0x55681a9cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6d4254b80 4 client.17343 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:54:00.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.578+0000 7fc6d4254b80 1 -- 172.21.15.59:0/743323331 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55681a8f8e90 con 0x55681a9cb350 2023-10-08T12:54:00.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.579+0000 7fc6b9d9b700 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55681a9cb350 0x55681a9cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.579+0000 7fc6b9d9b700 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55681a9cb350 0x55681a9cd740 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=420aa514098e3e1f server_cookie=71aa6da411605a3e in_seq=0 out_seq=0 2023-10-08T12:54:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.579+0000 7fc6a1ffb700 10 client.17343 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/743323331 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55681a8f8e90 con 0x55681a9cb350 2023-10-08T12:54:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6a1ffb700 10 client.17343 handle_command_reply: tid=0 2023-10-08T12:54:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6d4254b80 1 client.17343 shutdown 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6d4254b80 1 -- 172.21.15.59:0/743323331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 msgr2=0x55681a9bb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 0x55681a9bb550 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0cbb00 tx=0x7fc6ac097890 comp rx=0 tx=0).stop 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6d4254b80 1 -- 172.21.15.59:0/743323331 shutdown_connections 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55681a9cb350 0x55681a9cd740 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9bbae0 0x55681a9b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9abf00 0x55681a9bb550 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/743323331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9ac820 0x55681a9b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6d4254b80 1 -- 172.21.15.59:0/743323331 >> 172.21.15.59:0/743323331 conn(0x55681a9212e0 msgr2=0x55681a9a7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6a1ffb700 0 client.17343 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6d4254b80 1 -- 172.21.15.59:0/743323331 shutdown_connections 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.580+0000 7fc6d4254b80 1 -- 172.21.15.59:0/743323331 wait complete. 2023-10-08T12:54:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.581+0000 7fc6d4254b80 20 client.17343 trim_cache size 0 max 16384 2023-10-08T12:54:00.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.599+0000 7fc6d4254b80 1 Processor -- start 2023-10-08T12:54:00.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.599+0000 7fc6d4254b80 1 -- start start 2023-10-08T12:54:00.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.599+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9212e0 0x55681a9a8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9abf00 0x55681a9c2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9ac820 0x55681a9b8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681a7809a0 con 0x55681a9ac820 2023-10-08T12:54:00.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681a9cb170 con 0x55681a9abf00 2023-10-08T12:54:00.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681a9b9e70 con 0x55681a9212e0 2023-10-08T12:54:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9212e0 0x55681a9a8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6b9d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9abf00 0x55681a9c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9212e0 0x55681a9a8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:43256/0 (socket says 172.21.15.59:43256) 2023-10-08T12:54:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6ba59c700 1 -- 172.21.15.59:0/1511145131 learned_addr learned my addr 172.21.15.59:0/1511145131 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6bad9d700 1 --2- 172.21.15.59:0/1511145131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9ac820 0x55681a9b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6ba59c700 1 -- 172.21.15.59:0/1511145131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9abf00 msgr2=0x55681a9c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/1511145131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9abf00 0x55681a9c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6ba59c700 1 -- 172.21.15.59:0/1511145131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9ac820 msgr2=0x55681a9b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/1511145131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9ac820 0x55681a9b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.600+0000 7fc6ba59c700 1 -- 172.21.15.59:0/1511145131 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55681a713ce0 con 0x55681a9212e0 2023-10-08T12:54:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.601+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/1511145131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9212e0 0x55681a9a8500 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac000c00 tx=0x7fc6ac0cbbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d34807176e767c81 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.601+0000 7fc6a97fa700 1 -- 172.21.15.59:0/1511145131 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac09f0d0 con 0x55681a9212e0 2023-10-08T12:54:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.601+0000 7fc6a97fa700 1 -- 172.21.15.59:0/1511145131 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55681a8c7f30 con 0x55681a9212e0 2023-10-08T12:54:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.601+0000 7fc6a97fa700 1 -- 172.21.15.59:0/1511145131 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac09b420 con 0x55681a9212e0 2023-10-08T12:54:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.602+0000 7fc6d4254b80 1 -- 172.21.15.59:0/1511145131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9212e0 msgr2=0x55681a9a8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.602+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/1511145131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9212e0 0x55681a9a8500 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac000c00 tx=0x7fc6ac0cbbe0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.602+0000 7fc6d4254b80 1 -- 172.21.15.59:0/1511145131 shutdown_connections 2023-10-08T12:54:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.602+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/1511145131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9ac820 0x55681a9b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.602+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/1511145131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9212e0 0x55681a9a8500 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.602+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/1511145131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9abf00 0x55681a9c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.602+0000 7fc6d4254b80 1 -- 172.21.15.59:0/1511145131 >> 172.21.15.59:0/1511145131 conn(0x55681a9a4320 msgr2=0x55681a9a7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.602+0000 7fc6d4254b80 1 -- 172.21.15.59:0/1511145131 shutdown_connections 2023-10-08T12:54:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.602+0000 7fc6d4254b80 1 -- 172.21.15.59:0/1511145131 wait complete. 2023-10-08T12:54:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.602+0000 7fc6d4254b80 1 -- start start 2023-10-08T12:54:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.603+0000 7fc6d4254b80 1 Processor -- start 2023-10-08T12:54:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.603+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9212e0 0x55681a9c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.603+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9abf00 0x55681a9c1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.603+0000 7fc6d4254b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9ac820 0x55681a9c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.603+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681aa1f120 con 0x55681a9212e0 2023-10-08T12:54:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.603+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681aa1f260 con 0x55681a9abf00 2023-10-08T12:54:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.603+0000 7fc6d4254b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681aa1f3a0 con 0x55681a9ac820 2023-10-08T12:54:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.603+0000 7fc6d4254b80 10 client.0 _ll_register_callbacks cb 0x55681a6f9880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9212e0 0x55681a9c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9212e0 0x55681a9c0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54632/0 (socket says 172.21.15.59:54632) 2023-10-08T12:54:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6b9d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9abf00 0x55681a9c1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6ba59c700 1 -- 172.21.15.59:0/699853603 learned_addr learned my addr 172.21.15.59:0/699853603 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6bad9d700 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9ac820 0x55681a9c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6b9d9b700 1 -- 172.21.15.59:0/699853603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9ac820 msgr2=0x55681a9c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6b9d9b700 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9ac820 0x55681a9c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6b9d9b700 1 -- 172.21.15.59:0/699853603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9212e0 msgr2=0x55681a9c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6b9d9b700 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9212e0 0x55681a9c0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6b9d9b700 1 -- 172.21.15.59:0/699853603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b4003bd0 con 0x55681a9abf00 2023-10-08T12:54:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9212e0 0x55681a9c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.604+0000 7fc6bad9d700 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9ac820 0x55681a9c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.605+0000 7fc6b9d9b700 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9abf00 0x55681a9c1280 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac099770 tx=0x7fc6b00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78ed0d1c423da76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.605+0000 7fc6a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:54:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.605+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/699853603 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0022040 con 0x55681a9abf00 2023-10-08T12:54:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.605+0000 7fc6d4254b80 1 -- 172.21.15.59:0/699853603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc6b400f040 con 0x55681a9abf00 2023-10-08T12:54:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.605+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/699853603 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fc6b002b250 con 0x55681a9abf00 2023-10-08T12:54:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.605+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/699853603 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6b002b430 con 0x55681a9abf00 2023-10-08T12:54:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.605+0000 7fc6d4254b80 10 client.27365 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.605+0000 7fc6d4254b80 1 -- 172.21.15.59:0/699853603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55681a7512d0 con 0x55681a9abf00 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.605+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/699853603 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6b400f040 con 0x55681a9abf00 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.605+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/699853603 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc6b0003a20 con 0x55681a9abf00 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.606+0000 7fc6d4254b80 10 client.27365 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.606+0000 7fc6d4254b80 10 client.27365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.606+0000 7fc6d4254b80 20 client.27365 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.606+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55681a9bbae0 0x55681aa22be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.606+0000 7fc6d4254b80 4 client.27365 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.606+0000 7fc6d4254b80 1 -- 172.21.15.59:0/699853603 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55681a8f8bb0 con 0x55681a9bbae0 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.606+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55681a9bbae0 0x55681aa22be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.606+0000 7fc6ba59c700 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55681a9bbae0 0x55681aa22be0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd41e54cad6622b4 server_cookie=405ae47e9d3410ad in_seq=0 out_seq=0 2023-10-08T12:54:00.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.606+0000 7fc6a1ffb700 10 client.27365 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6a1ffb700 1 -- 172.21.15.59:0/699853603 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55681a8f8bb0 con 0x55681a9bbae0 2023-10-08T12:54:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6a1ffb700 10 client.27365 handle_command_reply: tid=0 2023-10-08T12:54:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 1 client.27365 shutdown 2023-10-08T12:54:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 1 -- 172.21.15.59:0/699853603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9abf00 msgr2=0x55681a9c1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9abf00 0x55681a9c1280 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac099770 tx=0x7fc6b00047c0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 1 -- 172.21.15.59:0/699853603 shutdown_connections 2023-10-08T12:54:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55681a9bbae0 0x55681aa22be0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55681a9ac820 0x55681a9c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55681a9212e0 0x55681a9c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6a1ffb700 0 client.27365 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 1 --2- 172.21.15.59:0/699853603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55681a9abf00 0x55681a9c1280 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 1 -- 172.21.15.59:0/699853603 >> 172.21.15.59:0/699853603 conn(0x55681a9a4320 msgr2=0x55681a9b8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 1 -- 172.21.15.59:0/699853603 shutdown_connections 2023-10-08T12:54:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 1 -- 172.21.15.59:0/699853603 wait complete. 2023-10-08T12:54:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.608+0000 7fc6d4254b80 20 client.27365 trim_cache size 0 max 16384 2023-10-08T12:54:00.613 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:54:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:54:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "85056612-f8f7-4f7a-a084-4b031e98be3e", 2023-10-08T12:54:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:54:00.613 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:54:00.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 -- 172.21.15.59:0/3026747434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6a40a1670 msgr2=0x7fc6a40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6a40a1670 0x7fc6a40a3b30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc197bc0 tx=0x7fc6b0009260 comp rx=0 tx=0).stop 2023-10-08T12:54:00.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 -- 172.21.15.59:0/3026747434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6bc100730 msgr2=0x7fc6bc19c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6bc100730 0x7fc6bc19c8d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac005910 tx=0x7fc6ac004730 comp rx=0 tx=0).stop 2023-10-08T12:54:00.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 -- 172.21.15.59:0/3026747434 shutdown_connections 2023-10-08T12:54:00.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6a40a1670 0x7fc6a40a3b30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6bc100730 0x7fc6bc19c8d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6bc106740 0x7fc6bc196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 --2- 172.21.15.59:0/3026747434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6bc1010f0 0x7fc6bc19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 -- 172.21.15.59:0/3026747434 >> 172.21.15.59:0/3026747434 conn(0x7fc6bc0fc200 msgr2=0x7fc6bc0fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 -- 172.21.15.59:0/3026747434 shutdown_connections 2023-10-08T12:54:00.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.609+0000 7fc6c09ff700 1 -- 172.21.15.59:0/3026747434 wait complete. 2023-10-08T12:54:00.630 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:54:00.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.849+0000 7f4c1efff700 1 -- 172.21.15.59:0/2285933030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c18100660 msgr2=0x7f4c18100ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.849+0000 7f4c1efff700 1 --2- 172.21.15.59:0/2285933030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c18100660 0x7f4c18100ae0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4c040098f0 tx=0x7f4c04009c00 comp rx=0 tx=0).stop 2023-10-08T12:54:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.849+0000 7f4c1efff700 1 -- 172.21.15.59:0/2285933030 shutdown_connections 2023-10-08T12:54:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.849+0000 7f4c1efff700 1 --2- 172.21.15.59:0/2285933030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c18106670 0x7f4c18106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.849+0000 7f4c1efff700 1 --2- 172.21.15.59:0/2285933030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c18101020 0x7f4c1810d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.849+0000 7f4c1efff700 1 --2- 172.21.15.59:0/2285933030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c18100660 0x7f4c18100ae0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.849+0000 7f4c1efff700 1 -- 172.21.15.59:0/2285933030 >> 172.21.15.59:0/2285933030 conn(0x7f4c180fc150 msgr2=0x7f4c180fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.849+0000 7f4c1efff700 1 -- 172.21.15.59:0/2285933030 shutdown_connections 2023-10-08T12:54:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.849+0000 7f4c1efff700 1 -- 172.21.15.59:0/2285933030 wait complete. 2023-10-08T12:54:00.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.850+0000 7f4c1efff700 1 Processor -- start 2023-10-08T12:54:00.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c1efff700 1 -- start start 2023-10-08T12:54:00.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c1efff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c18100660 0x7f4c1819ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c1efff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c18101020 0x7f4c1819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c1efff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c18106670 0x7f4c18198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c1efff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c181991e0 con 0x7f4c18100660 2023-10-08T12:54:00.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c1efff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18199350 con 0x7f4c18106670 2023-10-08T12:54:00.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c1efff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18199510 con 0x7f4c18101020 2023-10-08T12:54:00.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c18101020 0x7f4c1819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c18101020 0x7f4c1819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41770/0 (socket says 172.21.15.59:41770) 2023-10-08T12:54:00.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c1cd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c18100660 0x7f4c1819ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c17fff700 1 -- 172.21.15.59:0/2396133532 learned_addr learned my addr 172.21.15.59:0/2396133532 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:00.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.851+0000 7f4c1d59c700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c18106670 0x7f4c18198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.852+0000 7f4c17fff700 1 -- 172.21.15.59:0/2396133532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c18106670 msgr2=0x7f4c18198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.852+0000 7f4c17fff700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c18106670 0x7f4c18198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.852+0000 7f4c17fff700 1 -- 172.21.15.59:0/2396133532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c18100660 msgr2=0x7f4c1819ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.852+0000 7f4c17fff700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c18100660 0x7f4c1819ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.852+0000 7f4c17fff700 1 -- 172.21.15.59:0/2396133532 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c04009520 con 0x7f4c18101020 2023-10-08T12:54:00.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.852+0000 7f4c17fff700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c18101020 0x7f4c1819ef40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4c04005950 tx=0x7f4c0400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.852+0000 7f4c15ffb700 1 -- 172.21.15.59:0/2396133532 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0401c070 con 0x7f4c18101020 2023-10-08T12:54:00.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.852+0000 7f4c1efff700 1 -- 172.21.15.59:0/2396133532 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c18199790 con 0x7f4c18101020 2023-10-08T12:54:00.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.852+0000 7f4c15ffb700 1 -- 172.21.15.59:0/2396133532 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c0400baa0 con 0x7f4c18101020 2023-10-08T12:54:00.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.852+0000 7f4c15ffb700 1 -- 172.21.15.59:0/2396133532 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040038e0 con 0x7f4c18101020 2023-10-08T12:54:00.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.852+0000 7f4c1efff700 1 -- 172.21.15.59:0/2396133532 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c181a59f0 con 0x7f4c18101020 2023-10-08T12:54:00.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.856+0000 7f4c15ffb700 1 -- 172.21.15.59:0/2396133532 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f4c04020030 con 0x7f4c18101020 2023-10-08T12:54:00.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.857+0000 7f4c32823b80 1 Processor -- start 2023-10-08T12:54:00.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.857+0000 7f4c15ffb700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c080a15e0 0x7f4c080a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.857+0000 7f4c15ffb700 1 -- 172.21.15.59:0/2396133532 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4c040cde20 con 0x7f4c18101020 2023-10-08T12:54:00.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.857+0000 7f4c32823b80 1 -- start start 2023-10-08T12:54:00.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.857+0000 7f4c1d59c700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c080a15e0 0x7f4c080a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e76e80 0x555954e77260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 0x555954e82110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e82650 0x555954e84a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c32823b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954de0460 con 0x555954e76e80 2023-10-08T12:54:00.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c32823b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954dd1c20 con 0x555954e777a0 2023-10-08T12:54:00.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c32823b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954dcf540 con 0x555954e82650 2023-10-08T12:54:00.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c1cd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e76e80 0x555954e77260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c1cd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e76e80 0x555954e77260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57996/0 (socket says 172.21.15.59:57996) 2023-10-08T12:54:00.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c1cd9b700 1 -- 172.21.15.59:0/2214400398 learned_addr learned my addr 172.21.15.59:0/2214400398 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:00.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c1d59c700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c080a15e0 0x7f4c080a3aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000f540 tx=0x7f4c1000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c1d59c700 1 --2- 172.21.15.59:0/2214400398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e82650 0x555954e84a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.858+0000 7f4c17fff700 1 --2- 172.21.15.59:0/2214400398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 0x555954e82110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.859+0000 7f4c1d59c700 1 -- 172.21.15.59:0/2214400398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 msgr2=0x555954e82110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.859+0000 7f4c1d59c700 1 --2- 172.21.15.59:0/2214400398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 0x555954e82110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.859+0000 7f4c1d59c700 1 -- 172.21.15.59:0/2214400398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e76e80 msgr2=0x555954e77260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.859+0000 7f4c1d59c700 1 --2- 172.21.15.59:0/2214400398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e76e80 0x555954e77260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.859+0000 7f4c1d59c700 1 -- 172.21.15.59:0/2214400398 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555954bf5de0 con 0x555954e82650 2023-10-08T12:54:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.859+0000 7f4c1cd9b700 1 --2- 172.21.15.59:0/2214400398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e76e80 0x555954e77260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.859+0000 7f4c17fff700 1 --2- 172.21.15.59:0/2214400398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 0x555954e82110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.859+0000 7f4c1d59c700 1 --2- 172.21.15.59:0/2214400398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e82650 0x555954e84a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000fc90 tx=0x7f4c10014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe19085bc287555f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.859+0000 7f4c02ffd700 1 -- 172.21.15.59:0/2214400398 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000e040 con 0x555954e82650 2023-10-08T12:54:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.859+0000 7f4c02ffd700 1 -- 172.21.15.59:0/2214400398 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c1000f040 con 0x555954e82650 2023-10-08T12:54:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.859+0000 7f4c02ffd700 1 -- 172.21.15.59:0/2214400398 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100219b0 con 0x555954e82650 2023-10-08T12:54:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.860+0000 7f4c32823b80 1 -- 172.21.15.59:0/2214400398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e82650 msgr2=0x555954e84a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.860+0000 7f4c32823b80 1 --2- 172.21.15.59:0/2214400398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e82650 0x555954e84a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000fc90 tx=0x7f4c10014000 comp rx=0 tx=0).stop 2023-10-08T12:54:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.860+0000 7f4c32823b80 1 -- 172.21.15.59:0/2214400398 shutdown_connections 2023-10-08T12:54:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.860+0000 7f4c32823b80 1 --2- 172.21.15.59:0/2214400398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e82650 0x555954e84a40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.860+0000 7f4c32823b80 1 --2- 172.21.15.59:0/2214400398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e76e80 0x555954e77260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.860+0000 7f4c32823b80 1 --2- 172.21.15.59:0/2214400398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 0x555954e82110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.860+0000 7f4c32823b80 1 -- 172.21.15.59:0/2214400398 >> 172.21.15.59:0/2214400398 conn(0x555954dec260 msgr2=0x555954e732d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.860+0000 7f4c32823b80 1 -- 172.21.15.59:0/2214400398 shutdown_connections 2023-10-08T12:54:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.860+0000 7f4c32823b80 1 -- 172.21.15.59:0/2214400398 wait complete. 2023-10-08T12:54:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.861+0000 7f4c32823b80 1 -- start start 2023-10-08T12:54:00.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.861+0000 7f4c32823b80 1 Processor -- start 2023-10-08T12:54:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.861+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e76e80 0x555954e82030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.862+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 0x555954e7f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.862+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e82650 0x555954e7fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.862+0000 7f4c32823b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954dcae30 con 0x555954e82650 2023-10-08T12:54:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.862+0000 7f4c32823b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954d67710 con 0x555954e777a0 2023-10-08T12:54:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.862+0000 7f4c32823b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954d673b0 con 0x555954e76e80 2023-10-08T12:54:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.862+0000 7f4c32823b80 10 client.0 _ll_register_callbacks cb 0x555954bc4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.862+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 0x555954e7f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.862+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 0x555954e7f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41410/0 (socket says 172.21.15.59:41410) 2023-10-08T12:54:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.862+0000 7f4c17fff700 1 -- 172.21.15.59:0/4006173651 learned_addr learned my addr 172.21.15.59:0/4006173651 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.862+0000 7f4c1cd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e76e80 0x555954e82030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.862+0000 7f4c1d59c700 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e82650 0x555954e7fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4c17fff700 1 -- 172.21.15.59:0/4006173651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e76e80 msgr2=0x555954e82030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4c17fff700 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e76e80 0x555954e82030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4c17fff700 1 -- 172.21.15.59:0/4006173651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e82650 msgr2=0x555954e7fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4c17fff700 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e82650 0x555954e7fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4c17fff700 1 -- 172.21.15.59:0/4006173651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c009960 con 0x555954e777a0 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4c17fff700 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 0x555954e7f420 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4c040098c0 tx=0x7f4c04009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f6efe5dc241be32 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4bf7fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4bf7fff700 1 -- 172.21.15.59:0/4006173651 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0409ae80 con 0x555954e777a0 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4bf7fff700 1 -- 172.21.15.59:0/4006173651 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4c0409efd0 con 0x555954e777a0 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4c32823b80 1 -- 172.21.15.59:0/4006173651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555954d92eb0 con 0x555954e777a0 2023-10-08T12:54:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4bf7fff700 1 -- 172.21.15.59:0/4006173651 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c040a3180 con 0x555954e777a0 2023-10-08T12:54:00.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4c32823b80 10 client.27377 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:00.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4c32823b80 1 -- 172.21.15.59:0/4006173651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f4c181a59f0 con 0x555954e777a0 2023-10-08T12:54:00.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.863+0000 7f4bf7fff700 1 -- 172.21.15.59:0/4006173651 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555954d92eb0 con 0x555954e777a0 2023-10-08T12:54:00.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.864+0000 7f4bf7fff700 1 -- 172.21.15.59:0/4006173651 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4c040050d0 con 0x555954e777a0 2023-10-08T12:54:00.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.864+0000 7f4c32823b80 10 client.27377 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:00.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.864+0000 7f4c32823b80 10 client.27377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:00.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.864+0000 7f4c32823b80 20 client.27377 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:00.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.864+0000 7f4c32823b80 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555954e91c20 0x555954e94010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.864+0000 7f4c32823b80 4 client.27377 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:54:00.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.864+0000 7f4c32823b80 1 -- 172.21.15.59:0/4006173651 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555954dc3e10 con 0x555954e91c20 2023-10-08T12:54:00.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.864+0000 7f4c1cd9b700 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555954e91c20 0x555954e94010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.864+0000 7f4c1cd9b700 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555954e91c20 0x555954e94010 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa17065b92ec7b9d server_cookie=170e0b2659c445ee in_seq=0 out_seq=0 2023-10-08T12:54:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.864+0000 7f4bf7fff700 10 client.27377 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4bf7fff700 1 -- 172.21.15.59:0/4006173651 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555954dc3e10 con 0x555954e91c20 2023-10-08T12:54:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4bf7fff700 10 client.27377 handle_command_reply: tid=0 2023-10-08T12:54:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4c32823b80 1 client.27377 shutdown 2023-10-08T12:54:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4c32823b80 1 -- 172.21.15.59:0/4006173651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 msgr2=0x555954e7f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4c32823b80 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 0x555954e7f420 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4c040098c0 tx=0x7f4c04009260 comp rx=0 tx=0).stop 2023-10-08T12:54:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4c32823b80 1 -- 172.21.15.59:0/4006173651 shutdown_connections 2023-10-08T12:54:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4c32823b80 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555954e91c20 0x555954e94010 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4c32823b80 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e82650 0x555954e7fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4c32823b80 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e76e80 0x555954e82030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4c32823b80 1 --2- 172.21.15.59:0/4006173651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e777a0 0x555954e7f420 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4c32823b80 1 -- 172.21.15.59:0/4006173651 >> 172.21.15.59:0/4006173651 conn(0x555954dec260 msgr2=0x555954e72ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4bf7fff700 0 client.27377 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:00.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4c32823b80 1 -- 172.21.15.59:0/4006173651 shutdown_connections 2023-10-08T12:54:00.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.865+0000 7f4c32823b80 1 -- 172.21.15.59:0/4006173651 wait complete. 2023-10-08T12:54:00.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.866+0000 7f4c32823b80 20 client.27377 trim_cache size 0 max 16384 2023-10-08T12:54:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.884+0000 7f4c32823b80 1 Processor -- start 2023-10-08T12:54:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.884+0000 7f4c32823b80 1 -- start start 2023-10-08T12:54:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.884+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 0x555954e891e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.884+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e777a0 0x555954e81c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.884+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e82650 0x555954e7a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.884+0000 7f4c32823b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954c4b920 con 0x555954e777a0 2023-10-08T12:54:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.884+0000 7f4c32823b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954e807a0 con 0x555954e76e80 2023-10-08T12:54:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.884+0000 7f4c32823b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954e74870 con 0x555954e82650 2023-10-08T12:54:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e777a0 0x555954e81c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c1cd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 0x555954e891e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c1d59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e82650 0x555954e7a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e777a0 0x555954e81c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58024/0 (socket says 172.21.15.59:58024) 2023-10-08T12:54:00.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c1cd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 0x555954e891e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:41420/0 (socket says 172.21.15.59:41420) 2023-10-08T12:54:00.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c17fff700 1 -- 172.21.15.59:0/2289843852 learned_addr learned my addr 172.21.15.59:0/2289843852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:00.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c17fff700 1 -- 172.21.15.59:0/2289843852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e82650 msgr2=0x555954e7a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c17fff700 1 --2- 172.21.15.59:0/2289843852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e82650 0x555954e7a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c17fff700 1 -- 172.21.15.59:0/2289843852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 msgr2=0x555954e891e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c17fff700 1 --2- 172.21.15.59:0/2289843852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 0x555954e891e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c17fff700 1 -- 172.21.15.59:0/2289843852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c10017440 con 0x555954e777a0 2023-10-08T12:54:00.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c1cd9b700 1 --2- 172.21.15.59:0/2289843852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 0x555954e891e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:00.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.885+0000 7f4c17fff700 1 --2- 172.21.15.59:0/2289843852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e777a0 0x555954e81c50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4c0409ae10 tx=0x7f4c04099430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3607e7c3acce49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c037fe700 1 -- 172.21.15.59:0/2289843852 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0409a7e0 con 0x555954e777a0 2023-10-08T12:54:00.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c037fe700 1 -- 172.21.15.59:0/2289843852 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c0409efd0 con 0x555954e777a0 2023-10-08T12:54:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c037fe700 1 -- 172.21.15.59:0/2289843852 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04097590 con 0x555954e777a0 2023-10-08T12:54:00.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c32823b80 1 -- 172.21.15.59:0/2289843852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e777a0 msgr2=0x555954e81c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c32823b80 1 --2- 172.21.15.59:0/2289843852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e777a0 0x555954e81c50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4c0409ae10 tx=0x7f4c04099430 comp rx=0 tx=0).stop 2023-10-08T12:54:00.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c32823b80 1 -- 172.21.15.59:0/2289843852 shutdown_connections 2023-10-08T12:54:00.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c32823b80 1 --2- 172.21.15.59:0/2289843852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 0x555954e891e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c32823b80 1 --2- 172.21.15.59:0/2289843852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e82650 0x555954e7a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c32823b80 1 --2- 172.21.15.59:0/2289843852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e777a0 0x555954e81c50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c32823b80 1 -- 172.21.15.59:0/2289843852 >> 172.21.15.59:0/2289843852 conn(0x555954dec260 msgr2=0x555954e724d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c32823b80 1 -- 172.21.15.59:0/2289843852 shutdown_connections 2023-10-08T12:54:00.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.886+0000 7f4c32823b80 1 -- 172.21.15.59:0/2289843852 wait complete. 2023-10-08T12:54:00.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.887+0000 7f4c32823b80 1 -- start start 2023-10-08T12:54:00.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.887+0000 7f4c32823b80 1 Processor -- start 2023-10-08T12:54:00.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.887+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 0x555954e893d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e777a0 0x555954e877c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c32823b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e82650 0x555954e87f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c32823b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954e88610 con 0x555954e82650 2023-10-08T12:54:00.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c32823b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954ee5a30 con 0x555954e76e80 2023-10-08T12:54:00.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c32823b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555954ee5b70 con 0x555954e777a0 2023-10-08T12:54:00.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c32823b80 10 client.0 _ll_register_callbacks cb 0x7f4c0409ad20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:00.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e777a0 0x555954e877c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c1d59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e82650 0x555954e87f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e777a0 0x555954e877c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:41798/0 (socket says 172.21.15.59:41798) 2023-10-08T12:54:00.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c17fff700 1 -- 172.21.15.59:0/547860523 learned_addr learned my addr 172.21.15.59:0/547860523 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:00.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c1cd9b700 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 0x555954e893d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c17fff700 1 -- 172.21.15.59:0/547860523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 msgr2=0x555954e893d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c17fff700 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 0x555954e893d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c17fff700 1 -- 172.21.15.59:0/547860523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e82650 msgr2=0x555954e87f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c17fff700 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e82650 0x555954e87f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c17fff700 1 -- 172.21.15.59:0/547860523 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c0041c0 con 0x555954e777a0 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c1cd9b700 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 0x555954e893d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.888+0000 7f4c1d59c700 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e82650 0x555954e87f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4c17fff700 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e777a0 0x555954e877c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c04005e90 tx=0x7f4c0400bd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=831672bee136f892 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4bf7fff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4bf7fff700 1 -- 172.21.15.59:0/547860523 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040215c0 con 0x555954e777a0 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4c32823b80 1 -- 172.21.15.59:0/547860523 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c1000f040 con 0x555954e777a0 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4bf7fff700 1 -- 172.21.15.59:0/547860523 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4c0409ae80 con 0x555954e777a0 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4bf7fff700 1 -- 172.21.15.59:0/547860523 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c0409a7e0 con 0x555954e777a0 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4c32823b80 10 client.27376 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:00.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4c32823b80 1 -- 172.21.15.59:0/547860523 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f4c181a59f0 con 0x555954e777a0 2023-10-08T12:54:00.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4bf7fff700 1 -- 172.21.15.59:0/547860523 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c1000f040 con 0x555954e777a0 2023-10-08T12:54:00.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4bf7fff700 1 -- 172.21.15.59:0/547860523 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4c04082050 con 0x555954e777a0 2023-10-08T12:54:00.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4c32823b80 10 client.27376 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:00.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4c32823b80 10 client.27376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:00.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4c32823b80 20 client.27376 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:00.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4c32823b80 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555954ee6ec0 0x555954ee92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:00.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4c32823b80 4 client.27376 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:54:00.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.889+0000 7f4c32823b80 1 -- 172.21.15.59:0/547860523 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555954dc3b30 con 0x555954ee6ec0 2023-10-08T12:54:00.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.890+0000 7f4c1cd9b700 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555954ee6ec0 0x555954ee92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:00.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.890+0000 7f4c1cd9b700 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555954ee6ec0 0x555954ee92e0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3e2f38062516e6 server_cookie=e4b2459b552a2c86 in_seq=0 out_seq=0 2023-10-08T12:54:00.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.890+0000 7f4bf7fff700 10 client.27376 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.890+0000 7f4bf7fff700 1 -- 172.21.15.59:0/547860523 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555954dc3b30 con 0x555954ee6ec0 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.890+0000 7f4bf7fff700 10 client.27376 handle_command_reply: tid=0 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.890+0000 7f4c32823b80 1 client.27376 shutdown 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.890+0000 7f4c32823b80 1 -- 172.21.15.59:0/547860523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e777a0 msgr2=0x555954e877c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.890+0000 7f4c32823b80 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e777a0 0x555954e877c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c04005e90 tx=0x7f4c0400bd10 comp rx=0 tx=0).stop 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c32823b80 1 -- 172.21.15.59:0/547860523 shutdown_connections 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c32823b80 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555954ee6ec0 0x555954ee92e0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c32823b80 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555954e76e80 0x555954e893d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c32823b80 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555954e82650 0x555954e87f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4bf7fff700 0 client.27376 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c32823b80 1 --2- 172.21.15.59:0/547860523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555954e777a0 0x555954e877c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c32823b80 1 -- 172.21.15.59:0/547860523 >> 172.21.15.59:0/547860523 conn(0x555954dec260 msgr2=0x555954e81c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c32823b80 1 -- 172.21.15.59:0/547860523 shutdown_connections 2023-10-08T12:54:00.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c32823b80 1 -- 172.21.15.59:0/547860523 wait complete. 2023-10-08T12:54:00.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c32823b80 20 client.27376 trim_cache size 0 max 16384 2023-10-08T12:54:00.898 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:54:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:54:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:54:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: "85056612-f8f7-4f7a-a084-4b031e98be3e": { 2023-10-08T12:54:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:54:00.899 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "85056612-f8f7-4f7a-a084-4b031e98be3e", 2023-10-08T12:54:00.899 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:54:00.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:54:00.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:54:00.899 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:54:00.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c1efff700 1 -- 172.21.15.59:0/2396133532 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c080a15e0 msgr2=0x7f4c080a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c1efff700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c080a15e0 0x7f4c080a3aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000f540 tx=0x7f4c1000b040 comp rx=0 tx=0).stop 2023-10-08T12:54:00.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c1efff700 1 -- 172.21.15.59:0/2396133532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c18101020 msgr2=0x7f4c1819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:00.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c1efff700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c18101020 0x7f4c1819ef40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4c04005950 tx=0x7f4c0400fa00 comp rx=0 tx=0).stop 2023-10-08T12:54:00.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c1efff700 1 -- 172.21.15.59:0/2396133532 shutdown_connections 2023-10-08T12:54:00.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c1efff700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4c080a15e0 0x7f4c080a3aa0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c1efff700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c18106670 0x7f4c18198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c1efff700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c18100660 0x7f4c1819ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c1efff700 1 --2- 172.21.15.59:0/2396133532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c18101020 0x7f4c1819ef40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:00.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.891+0000 7f4c1efff700 1 -- 172.21.15.59:0/2396133532 >> 172.21.15.59:0/2396133532 conn(0x7f4c180fc150 msgr2=0x7f4c180fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:00.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.892+0000 7f4c1efff700 1 -- 172.21.15.59:0/2396133532 shutdown_connections 2023-10-08T12:54:00.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:00.892+0000 7f4c1efff700 1 -- 172.21.15.59:0/2396133532 wait complete. 2023-10-08T12:54:00.910 INFO:tasks.cephfs.filesystem:scrub status for tag:85056612-f8f7-4f7a-a084-4b031e98be3e - {'path': '/', 'tag': '85056612-f8f7-4f7a-a084-4b031e98be3e', 'options': 'recursive,force'} 2023-10-08T12:54:01.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:00 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:54:01.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:00 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:01.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:00 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:54:01.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:00 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:00 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:54:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:00 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:00 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:54:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:00 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:01.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:00 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:54:01.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:00 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:01.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:00 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:54:01.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:00 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:01.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1622743 12.34 MB/sec execute 572 sec latency 54.700 ms 2023-10-08T12:54:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:01 smithi173 ceph-mon[135182]: pgmap v711: 97 pgs: 97 active+clean; 611 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.1 MiB/s wr, 231 op/s 2023-10-08T12:54:02.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:01 smithi059 ceph-mon[98489]: pgmap v711: 97 pgs: 97 active+clean; 611 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.1 MiB/s wr, 231 op/s 2023-10-08T12:54:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:01 smithi092 ceph-mon[134093]: pgmap v711: 97 pgs: 97 active+clean; 611 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.1 MiB/s wr, 231 op/s 2023-10-08T12:54:02.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1624582 12.33 MB/sec execute 573 sec latency 29.206 ms 2023-10-08T12:54:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:02 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:54:03.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:02 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:54:03.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:02 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:54:03.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1627162 12.34 MB/sec execute 574 sec latency 34.859 ms 2023-10-08T12:54:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:03 smithi173 ceph-mon[135182]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T12:54:04.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:03 smithi173 ceph-mon[135182]: pgmap v713: 97 pgs: 97 active+clean; 611 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 232 op/s 2023-10-08T12:54:04.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:03 smithi059 ceph-mon[98489]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T12:54:04.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:03 smithi059 ceph-mon[98489]: pgmap v713: 97 pgs: 97 active+clean; 611 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 232 op/s 2023-10-08T12:54:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:03 smithi092 ceph-mon[134093]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T12:54:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:03 smithi092 ceph-mon[134093]: pgmap v713: 97 pgs: 97 active+clean; 611 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 232 op/s 2023-10-08T12:54:04.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1628552 12.32 MB/sec execute 575 sec latency 66.882 ms 2023-10-08T12:54:05.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1630828 12.33 MB/sec execute 576 sec latency 14.134 ms 2023-10-08T12:54:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:06 smithi092 ceph-mon[134093]: pgmap v714: 97 pgs: 97 active+clean; 608 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.7 MiB/s wr, 275 op/s 2023-10-08T12:54:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:06 smithi173 ceph-mon[135182]: pgmap v714: 97 pgs: 97 active+clean; 608 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.7 MiB/s wr, 275 op/s 2023-10-08T12:54:06.517 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:06 smithi059 ceph-mon[98489]: pgmap v714: 97 pgs: 97 active+clean; 608 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.7 MiB/s wr, 275 op/s 2023-10-08T12:54:06.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1632657 12.32 MB/sec execute 577 sec latency 51.689 ms 2023-10-08T12:54:07.552 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1634541 12.32 MB/sec execute 578 sec latency 68.428 ms 2023-10-08T12:54:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:08 smithi092 ceph-mon[134093]: pgmap v715: 97 pgs: 97 active+clean; 607 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 273 op/s 2023-10-08T12:54:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:08 smithi173 ceph-mon[135182]: pgmap v715: 97 pgs: 97 active+clean; 607 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 273 op/s 2023-10-08T12:54:08.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:08 smithi059 ceph-mon[98489]: pgmap v715: 97 pgs: 97 active+clean; 607 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 273 op/s 2023-10-08T12:54:08.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1636879 12.32 MB/sec execute 579 sec latency 14.057 ms 2023-10-08T12:54:09.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1638481 12.31 MB/sec execute 580 sec latency 71.455 ms 2023-10-08T12:54:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:09 smithi173 ceph-mon[135182]: pgmap v716: 97 pgs: 97 active+clean; 605 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 240 op/s 2023-10-08T12:54:10.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:09 smithi059 ceph-mon[98489]: pgmap v716: 97 pgs: 97 active+clean; 605 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 240 op/s 2023-10-08T12:54:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:09 smithi092 ceph-mon[134093]: pgmap v716: 97 pgs: 97 active+clean; 605 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 240 op/s 2023-10-08T12:54:10.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1641305 12.32 MB/sec execute 581 sec latency 15.689 ms 2023-10-08T12:54:11.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1642986 12.31 MB/sec execute 582 sec latency 14.814 ms 2023-10-08T12:54:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:12 smithi092 ceph-mon[134093]: pgmap v717: 97 pgs: 97 active+clean; 608 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 236 op/s 2023-10-08T12:54:12.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:12 smithi173 ceph-mon[135182]: pgmap v717: 97 pgs: 97 active+clean; 608 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 236 op/s 2023-10-08T12:54:12.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:12 smithi059 ceph-mon[98489]: pgmap v717: 97 pgs: 97 active+clean; 608 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 236 op/s 2023-10-08T12:54:12.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1644922 12.31 MB/sec execute 583 sec latency 51.367 ms 2023-10-08T12:54:13.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1646943 12.30 MB/sec execute 584 sec latency 19.646 ms 2023-10-08T12:54:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:14 smithi092 ceph-mon[134093]: pgmap v718: 97 pgs: 97 active+clean; 623 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.8 MiB/s wr, 268 op/s 2023-10-08T12:54:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:14 smithi092 ceph-mon[134093]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T12:54:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:14 smithi173 ceph-mon[135182]: pgmap v718: 97 pgs: 97 active+clean; 623 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.8 MiB/s wr, 268 op/s 2023-10-08T12:54:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:14 smithi173 ceph-mon[135182]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T12:54:14.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:14 smithi059 ceph-mon[98489]: pgmap v718: 97 pgs: 97 active+clean; 623 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.8 MiB/s wr, 268 op/s 2023-10-08T12:54:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:14 smithi059 ceph-mon[98489]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T12:54:14.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1648795 12.30 MB/sec execute 585 sec latency 13.457 ms 2023-10-08T12:54:15.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1650785 12.29 MB/sec execute 586 sec latency 141.244 ms 2023-10-08T12:54:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:16 smithi092 ceph-mon[134093]: pgmap v720: 97 pgs: 97 active+clean; 623 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.2 MiB/s wr, 227 op/s 2023-10-08T12:54:16.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:16 smithi173 ceph-mon[135182]: pgmap v720: 97 pgs: 97 active+clean; 623 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.2 MiB/s wr, 227 op/s 2023-10-08T12:54:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:16 smithi059 ceph-mon[98489]: pgmap v720: 97 pgs: 97 active+clean; 623 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.2 MiB/s wr, 227 op/s 2023-10-08T12:54:16.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1652484 12.29 MB/sec execute 587 sec latency 145.089 ms 2023-10-08T12:54:17.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1654483 12.29 MB/sec execute 588 sec latency 51.806 ms 2023-10-08T12:54:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:18 smithi092 ceph-mon[134093]: pgmap v721: 97 pgs: 97 active+clean; 624 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 191 op/s 2023-10-08T12:54:18.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:18 smithi173 ceph-mon[135182]: pgmap v721: 97 pgs: 97 active+clean; 624 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 191 op/s 2023-10-08T12:54:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:18 smithi059 ceph-mon[98489]: pgmap v721: 97 pgs: 97 active+clean; 624 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 191 op/s 2023-10-08T12:54:18.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1656187 12.28 MB/sec execute 589 sec latency 25.649 ms 2023-10-08T12:54:19.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1658895 12.29 MB/sec execute 590 sec latency 12.487 ms 2023-10-08T12:54:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:19 smithi173 ceph-mon[135182]: pgmap v722: 97 pgs: 97 active+clean; 637 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.3 MiB/s wr, 231 op/s 2023-10-08T12:54:20.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:19 smithi059 ceph-mon[98489]: pgmap v722: 97 pgs: 97 active+clean; 637 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.3 MiB/s wr, 231 op/s 2023-10-08T12:54:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:19 smithi092 ceph-mon[134093]: pgmap v722: 97 pgs: 97 active+clean; 637 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.3 MiB/s wr, 231 op/s 2023-10-08T12:54:20.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1660475 12.28 MB/sec execute 591 sec latency 13.782 ms 2023-10-08T12:54:21.554 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1662440 12.28 MB/sec execute 592 sec latency 182.120 ms 2023-10-08T12:54:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:22 smithi092 ceph-mon[134093]: pgmap v723: 97 pgs: 97 active+clean; 637 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 218 op/s 2023-10-08T12:54:22.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:22 smithi173 ceph-mon[135182]: pgmap v723: 97 pgs: 97 active+clean; 637 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 218 op/s 2023-10-08T12:54:22.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:22 smithi059 ceph-mon[98489]: pgmap v723: 97 pgs: 97 active+clean; 637 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 218 op/s 2023-10-08T12:54:22.553 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1663816 12.27 MB/sec execute 593 sec latency 81.833 ms 2023-10-08T12:54:23.554 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1666152 12.28 MB/sec execute 594 sec latency 17.405 ms 2023-10-08T12:54:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:24 smithi092 ceph-mon[134093]: pgmap v724: 97 pgs: 97 active+clean; 644 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 193 op/s 2023-10-08T12:54:24.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:24 smithi173 ceph-mon[135182]: pgmap v724: 97 pgs: 97 active+clean; 644 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 193 op/s 2023-10-08T12:54:24.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:24 smithi059 ceph-mon[98489]: pgmap v724: 97 pgs: 97 active+clean; 644 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 193 op/s 2023-10-08T12:54:24.554 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1667822 12.26 MB/sec execute 595 sec latency 17.738 ms 2023-10-08T12:54:25.554 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1669885 12.27 MB/sec execute 596 sec latency 13.634 ms 2023-10-08T12:54:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:26 smithi092 ceph-mon[134093]: pgmap v725: 97 pgs: 97 active+clean; 639 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.8 MiB/s wr, 200 op/s 2023-10-08T12:54:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:26 smithi173 ceph-mon[135182]: pgmap v725: 97 pgs: 97 active+clean; 639 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.8 MiB/s wr, 200 op/s 2023-10-08T12:54:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:26 smithi059 ceph-mon[98489]: pgmap v725: 97 pgs: 97 active+clean; 639 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.8 MiB/s wr, 200 op/s 2023-10-08T12:54:26.554 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1671894 12.26 MB/sec execute 597 sec latency 75.884 ms 2023-10-08T12:54:27.554 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1673440 12.26 MB/sec execute 598 sec latency 83.989 ms 2023-10-08T12:54:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:28 smithi092 ceph-mon[134093]: pgmap v726: 97 pgs: 97 active+clean; 599 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.1 MiB/s wr, 213 op/s 2023-10-08T12:54:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:28 smithi173 ceph-mon[135182]: pgmap v726: 97 pgs: 97 active+clean; 599 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.1 MiB/s wr, 213 op/s 2023-10-08T12:54:28.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:28 smithi059 ceph-mon[98489]: pgmap v726: 97 pgs: 97 active+clean; 599 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.1 MiB/s wr, 213 op/s 2023-10-08T12:54:28.554 INFO:tasks.workunit.client.0.smithi059.stdout: 1 1675455 12.25 MB/sec execute 599 sec latency 19.487 ms 2023-10-08T12:54:29.554 INFO:tasks.workunit.client.0.smithi059.stdout: 1 cleanup 600 sec 2023-10-08T12:54:29.830 INFO:tasks.workunit.client.0.smithi059.stdout: 0 cleanup 600 sec 2023-10-08T12:54:29.830 INFO:tasks.workunit.client.0.smithi059.stdout: 2023-10-08T12:54:29.830 INFO:tasks.workunit.client.0.smithi059.stdout: Operation Count AvgLat MaxLat 2023-10-08T12:54:29.830 INFO:tasks.workunit.client.0.smithi059.stdout: ---------------------------------------- 2023-10-08T12:54:29.830 INFO:tasks.workunit.client.0.smithi059.stdout: NTCreateX 234044 0.947 480.734 2023-10-08T12:54:29.830 INFO:tasks.workunit.client.0.smithi059.stdout: Close 171912 0.004 0.249 2023-10-08T12:54:29.830 INFO:tasks.workunit.client.0.smithi059.stdout: Rename 9909 4.199 105.055 2023-10-08T12:54:29.831 INFO:tasks.workunit.client.0.smithi059.stdout: Unlink 47263 1.741 332.499 2023-10-08T12:54:29.831 INFO:tasks.workunit.client.0.smithi059.stdout: Deltree 6 77.908 96.226 2023-10-08T12:54:29.831 INFO:tasks.workunit.client.0.smithi059.stdout: Mkdir 3 0.015 0.016 2023-10-08T12:54:29.831 INFO:tasks.workunit.client.0.smithi059.stdout: Qpathinfo 212118 0.749 398.208 2023-10-08T12:54:29.831 INFO:tasks.workunit.client.0.smithi059.stdout: Qfileinfo 37174 0.002 0.153 2023-10-08T12:54:29.831 INFO:tasks.workunit.client.0.smithi059.stdout: Qfsinfo 38897 0.197 11.105 2023-10-08T12:54:29.831 INFO:tasks.workunit.client.0.smithi059.stdout: Sfileinfo 19062 0.024 5.705 2023-10-08T12:54:29.831 INFO:tasks.workunit.client.0.smithi059.stdout: Find 82010 0.180 127.762 2023-10-08T12:54:29.831 INFO:tasks.workunit.client.0.smithi059.stdout: WriteX 116694 0.061 39.058 2023-10-08T12:54:29.831 INFO:tasks.workunit.client.0.smithi059.stdout: ReadX 366828 0.007 49.197 2023-10-08T12:54:29.831 INFO:tasks.workunit.client.0.smithi059.stdout: LockX 762 0.790 90.198 2023-10-08T12:54:29.832 INFO:tasks.workunit.client.0.smithi059.stdout: UnlockX 762 0.710 103.813 2023-10-08T12:54:29.832 INFO:tasks.workunit.client.0.smithi059.stdout: Flush 16401 3.428 185.047 2023-10-08T12:54:29.832 INFO:tasks.workunit.client.0.smithi059.stdout: 2023-10-08T12:54:29.832 INFO:tasks.workunit.client.0.smithi059.stdout:Throughput 12.2491 MB/sec 1 clients 1 procs max_latency=480.746 ms 2023-10-08T12:54:29.832 INFO:tasks.workunit.client.0.smithi059.stderr:+ dbench 10 2023-10-08T12:54:29.832 INFO:tasks.workunit.client.0.smithi059.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-10-08T12:54:29.832 INFO:tasks.workunit.client.0.smithi059.stdout: 2023-10-08T12:54:29.833 INFO:tasks.workunit.client.0.smithi059.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-10-08T12:54:29.835 INFO:tasks.workunit.client.0.smithi059.stdout:9 of 10 processes prepared for launch 0 sec 2023-10-08T12:54:29.935 INFO:tasks.workunit.client.0.smithi059.stdout:10 of 10 processes prepared for launch 0 sec 2023-10-08T12:54:29.935 INFO:tasks.workunit.client.0.smithi059.stdout:releasing clients 2023-10-08T12:54:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:29 smithi173 ceph-mon[135182]: pgmap v727: 97 pgs: 97 active+clean; 575 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.6 MiB/s wr, 231 op/s 2023-10-08T12:54:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:29 smithi059 ceph-mon[98489]: pgmap v727: 97 pgs: 97 active+clean; 575 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.6 MiB/s wr, 231 op/s 2023-10-08T12:54:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:29 smithi092 ceph-mon[134093]: pgmap v727: 97 pgs: 97 active+clean; 575 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.6 MiB/s wr, 231 op/s 2023-10-08T12:54:30.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:54:30.935 INFO:tasks.workunit.client.0.smithi059.stdout: 10 391 139.29 MB/sec warmup 1 sec latency 129.627 ms 2023-10-08T12:54:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.171+0000 7f34301ff700 1 -- 172.21.15.59:0/4173054538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428106750 msgr2=0x7f3428106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.172+0000 7f34301ff700 1 --2- 172.21.15.59:0/4173054538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428106750 0x7f3428106b30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3424009990 tx=0x7f3424009ca0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.172+0000 7f34301ff700 1 -- 172.21.15.59:0/4173054538 shutdown_connections 2023-10-08T12:54:31.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.172+0000 7f34301ff700 1 --2- 172.21.15.59:0/4173054538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3428101100 0x7f342810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.172+0000 7f34301ff700 1 --2- 172.21.15.59:0/4173054538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428106750 0x7f3428106b30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.172+0000 7f34301ff700 1 --2- 172.21.15.59:0/4173054538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3428100740 0x7f3428100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.172+0000 7f34301ff700 1 -- 172.21.15.59:0/4173054538 >> 172.21.15.59:0/4173054538 conn(0x7f34280fc230 msgr2=0x7f34280fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:31.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.172+0000 7f34301ff700 1 -- 172.21.15.59:0/4173054538 shutdown_connections 2023-10-08T12:54:31.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.172+0000 7f34301ff700 1 -- 172.21.15.59:0/4173054538 wait complete. 2023-10-08T12:54:31.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.174+0000 7f34301ff700 1 Processor -- start 2023-10-08T12:54:31.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.174+0000 7f34301ff700 1 -- start start 2023-10-08T12:54:31.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.174+0000 7f34301ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3428100740 0x7f3428198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.174+0000 7f34301ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428101100 0x7f34281992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f34301ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3428106750 0x7f342819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f34301ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342819dcd0 con 0x7f3428101100 2023-10-08T12:54:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f34301ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342819de40 con 0x7f3428106750 2023-10-08T12:54:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f34301ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342819e000 con 0x7f3428100740 2023-10-08T12:54:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f342df9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3428100740 0x7f3428198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f342df9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3428100740 0x7f3428198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34916/0 (socket says 172.21.15.59:34916) 2023-10-08T12:54:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f342df9b700 1 -- 172.21.15.59:0/1504342884 learned_addr learned my addr 172.21.15.59:0/1504342884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f342e79c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3428106750 0x7f342819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f342d79a700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428101100 0x7f34281992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f342df9b700 1 -- 172.21.15.59:0/1504342884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3428106750 msgr2=0x7f342819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f342df9b700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3428106750 0x7f342819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f342df9b700 1 -- 172.21.15.59:0/1504342884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428101100 msgr2=0x7f34281992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f342df9b700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428101100 0x7f34281992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f342df9b700 1 -- 172.21.15.59:0/1504342884 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34240095f0 con 0x7f3428100740 2023-10-08T12:54:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.175+0000 7f342d79a700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428101100 0x7f34281992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:54:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.176+0000 7f342df9b700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3428100740 0x7f3428198db0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f34240098e0 tx=0x7f3424005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:31.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.176+0000 7f341effd700 1 -- 172.21.15.59:0/1504342884 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342401d070 con 0x7f3428100740 2023-10-08T12:54:31.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.176+0000 7f34301ff700 1 -- 172.21.15.59:0/1504342884 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342819e280 con 0x7f3428100740 2023-10-08T12:54:31.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.177+0000 7f341effd700 1 -- 172.21.15.59:0/1504342884 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3424021410 con 0x7f3428100740 2023-10-08T12:54:31.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.177+0000 7f341effd700 1 -- 172.21.15.59:0/1504342884 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424017650 con 0x7f3428100740 2023-10-08T12:54:31.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.177+0000 7f34301ff700 1 -- 172.21.15.59:0/1504342884 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34281a5b20 con 0x7f3428100740 2023-10-08T12:54:31.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.181+0000 7f341effd700 1 -- 172.21.15.59:0/1504342884 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f34240177b0 con 0x7f3428100740 2023-10-08T12:54:31.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.183+0000 7f3443c18b80 1 Processor -- start 2023-10-08T12:54:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.183+0000 7f3443c18b80 1 -- start start 2023-10-08T12:54:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.184+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7507e80 0x5609c7508260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.184+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c7513110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.184+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 0x5609c7515a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.184+0000 7f3443c18b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c7471460 con 0x5609c7507e80 2023-10-08T12:54:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.184+0000 7f3443c18b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c7462c20 con 0x5609c7513650 2023-10-08T12:54:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.184+0000 7f3443c18b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c7460540 con 0x5609c75087a0 2023-10-08T12:54:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342d79a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 0x5609c7515a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342d79a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 0x5609c7515a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49430/0 (socket says 172.21.15.59:49430) 2023-10-08T12:54:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342d79a700 1 -- 172.21.15.59:0/3658988088 learned_addr learned my addr 172.21.15.59:0/3658988088 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f341effd700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f34140a16b0 0x7f34140a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342df9b700 1 --2- 172.21.15.59:0/3658988088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c7513110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342e79c700 1 --2- 172.21.15.59:0/3658988088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7507e80 0x5609c7508260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342d79a700 1 -- 172.21.15.59:0/3658988088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 msgr2=0x5609c7513110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342d79a700 1 --2- 172.21.15.59:0/3658988088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c7513110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342d79a700 1 -- 172.21.15.59:0/3658988088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7507e80 msgr2=0x5609c7508260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342d79a700 1 --2- 172.21.15.59:0/3658988088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7507e80 0x5609c7508260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342d79a700 1 -- 172.21.15.59:0/3658988088 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609c7286de0 con 0x5609c7513650 2023-10-08T12:54:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342e79c700 1 --2- 172.21.15.59:0/3658988088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7507e80 0x5609c7508260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:54:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f341effd700 1 -- 172.21.15.59:0/1504342884 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f34240ce300 con 0x7f3428100740 2023-10-08T12:54:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.185+0000 7f342d79a700 1 --2- 172.21.15.59:0/3658988088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 0x5609c7515a40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3418009db0 tx=0x7f34180116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=638fcc2f5d0ec0f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.186+0000 7f3413fff700 1 -- 172.21.15.59:0/3658988088 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418011e20 con 0x5609c7513650 2023-10-08T12:54:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.186+0000 7f3413fff700 1 -- 172.21.15.59:0/3658988088 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3418012910 con 0x5609c7513650 2023-10-08T12:54:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.186+0000 7f3413fff700 1 -- 172.21.15.59:0/3658988088 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341800f840 con 0x5609c7513650 2023-10-08T12:54:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.186+0000 7f342e79c700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f34140a16b0 0x7f34140a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.186+0000 7f3443c18b80 1 -- 172.21.15.59:0/3658988088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 msgr2=0x5609c7515a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.186+0000 7f3443c18b80 1 --2- 172.21.15.59:0/3658988088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 0x5609c7515a40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3418009db0 tx=0x7f34180116c0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.187+0000 7f3443c18b80 1 -- 172.21.15.59:0/3658988088 shutdown_connections 2023-10-08T12:54:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.187+0000 7f3443c18b80 1 --2- 172.21.15.59:0/3658988088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 0x5609c7515a40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.187+0000 7f3443c18b80 1 --2- 172.21.15.59:0/3658988088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7507e80 0x5609c7508260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.187+0000 7f3443c18b80 1 --2- 172.21.15.59:0/3658988088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c7513110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.187+0000 7f3443c18b80 1 -- 172.21.15.59:0/3658988088 >> 172.21.15.59:0/3658988088 conn(0x5609c747d260 msgr2=0x5609c75042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.187+0000 7f342e79c700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f34140a16b0 0x7f34140a3b70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3420009ec0 tx=0x7f3420004ad0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.187+0000 7f3443c18b80 1 -- 172.21.15.59:0/3658988088 shutdown_connections 2023-10-08T12:54:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.187+0000 7f3443c18b80 1 -- 172.21.15.59:0/3658988088 wait complete. 2023-10-08T12:54:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.188+0000 7f3443c18b80 1 -- start start 2023-10-08T12:54:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.188+0000 7f3443c18b80 1 Processor -- start 2023-10-08T12:54:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.189+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c7507e80 0x5609c7512f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.189+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c75087a0 0x5609c7510270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.189+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 0x5609c7510830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.189+0000 7f3443c18b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c745be30 con 0x5609c75087a0 2023-10-08T12:54:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.189+0000 7f3443c18b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c73f8710 con 0x5609c7513650 2023-10-08T12:54:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.189+0000 7f3443c18b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c73f83b0 con 0x5609c7507e80 2023-10-08T12:54:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f3443c18b80 10 client.0 _ll_register_callbacks cb 0x5609c7255800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f342df9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c7507e80 0x5609c7512f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f342df9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c7507e80 0x5609c7512f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34948/0 (socket says 172.21.15.59:34948) 2023-10-08T12:54:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f342df9b700 1 -- 172.21.15.59:0/1781058616 learned_addr learned my addr 172.21.15.59:0/1781058616 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f342d79a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c75087a0 0x5609c7510270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f342e79c700 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 0x5609c7510830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f342df9b700 1 -- 172.21.15.59:0/1781058616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 msgr2=0x5609c7510830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f342df9b700 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 0x5609c7510830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f342df9b700 1 -- 172.21.15.59:0/1781058616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c75087a0 msgr2=0x5609c7510270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f342df9b700 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c75087a0 0x5609c7510270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f342df9b700 1 -- 172.21.15.59:0/1781058616 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34180099b0 con 0x5609c7507e80 2023-10-08T12:54:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f342df9b700 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c7507e80 0x5609c7512f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f342409b2f0 tx=0x7f3424097430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ca465ec27af43f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.190+0000 7f34117fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:54:31.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.191+0000 7f34117fa700 1 -- 172.21.15.59:0/1781058616 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342409aea0 con 0x5609c7507e80 2023-10-08T12:54:31.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.191+0000 7f34117fa700 1 -- 172.21.15.59:0/1781058616 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f34240cd070 con 0x5609c7507e80 2023-10-08T12:54:31.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.191+0000 7f3443c18b80 1 -- 172.21.15.59:0/1781058616 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609c7423eb0 con 0x5609c7507e80 2023-10-08T12:54:31.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.191+0000 7f34117fa700 1 -- 172.21.15.59:0/1781058616 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f342409acc0 con 0x5609c7507e80 2023-10-08T12:54:31.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.191+0000 7f3443c18b80 10 client.27388 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:31.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.191+0000 7f3443c18b80 1 -- 172.21.15.59:0/1781058616 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5609c726fc60 con 0x5609c7507e80 2023-10-08T12:54:31.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.191+0000 7f34117fa700 1 -- 172.21.15.59:0/1781058616 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5609c7423eb0 con 0x5609c7507e80 2023-10-08T12:54:31.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.191+0000 7f34117fa700 1 -- 172.21.15.59:0/1781058616 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f342409f150 con 0x5609c7507e80 2023-10-08T12:54:31.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.191+0000 7f3443c18b80 10 client.27388 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:31.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.191+0000 7f3443c18b80 10 client.27388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:31.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.192+0000 7f3443c18b80 20 client.27388 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:31.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.192+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5609c7522d60 0x5609c7525150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.192+0000 7f3443c18b80 4 client.27388 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:54:31.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.192+0000 7f3443c18b80 1 -- 172.21.15.59:0/1781058616 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609c7454e10 con 0x5609c7522d60 2023-10-08T12:54:31.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.192+0000 7f342d79a700 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5609c7522d60 0x5609c7525150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.192+0000 7f342d79a700 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5609c7522d60 0x5609c7525150 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52f7740c9bec11d server_cookie=46e3af8b00a7b87 in_seq=0 out_seq=0 2023-10-08T12:54:31.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.192+0000 7f34117fa700 10 client.27388 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:31.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f34117fa700 1 -- 172.21.15.59:0/1781058616 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5609c7454e10 con 0x5609c7522d60 2023-10-08T12:54:31.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f34117fa700 10 client.27388 handle_command_reply: tid=0 2023-10-08T12:54:31.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f3443c18b80 1 client.27388 shutdown 2023-10-08T12:54:31.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f3443c18b80 1 -- 172.21.15.59:0/1781058616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c7507e80 msgr2=0x5609c7512f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c7507e80 0x5609c7512f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f342409b2f0 tx=0x7f3424097430 comp rx=0 tx=0).stop 2023-10-08T12:54:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f3443c18b80 1 -- 172.21.15.59:0/1781058616 shutdown_connections 2023-10-08T12:54:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5609c7522d60 0x5609c7525150 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7513650 0x5609c7510830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c7507e80 0x5609c7512f80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1781058616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c75087a0 0x5609c7510270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f3443c18b80 1 -- 172.21.15.59:0/1781058616 >> 172.21.15.59:0/1781058616 conn(0x5609c747d260 msgr2=0x5609c7503ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.195+0000 7f34117fa700 0 client.27388 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.196+0000 7f3443c18b80 1 -- 172.21.15.59:0/1781058616 shutdown_connections 2023-10-08T12:54:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.196+0000 7f3443c18b80 1 -- 172.21.15.59:0/1781058616 wait complete. 2023-10-08T12:54:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.196+0000 7f3443c18b80 20 client.27388 trim_cache size 0 max 16384 2023-10-08T12:54:31.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.216+0000 7f3443c18b80 1 Processor -- start 2023-10-08T12:54:31.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.216+0000 7f3443c18b80 1 -- start start 2023-10-08T12:54:31.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.216+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c751a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.216+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c7512c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.216+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 0x5609c750eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.216+0000 7f3443c18b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c72dc920 con 0x5609c7513650 2023-10-08T12:54:31.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.216+0000 7f3443c18b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c7522b40 con 0x5609c7507e80 2023-10-08T12:54:31.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.216+0000 7f3443c18b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c751a720 con 0x5609c75087a0 2023-10-08T12:54:31.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342d79a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c7512c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342df9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c751a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342d79a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c7512c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34960/0 (socket says 172.21.15.59:34960) 2023-10-08T12:54:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342d79a700 1 -- 172.21.15.59:0/266511310 learned_addr learned my addr 172.21.15.59:0/266511310 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342df9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c751a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49446/0 (socket says 172.21.15.59:49446) 2023-10-08T12:54:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342e79c700 1 --2- 172.21.15.59:0/266511310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 0x5609c750eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342df9b700 1 -- 172.21.15.59:0/266511310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 msgr2=0x5609c7512c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342df9b700 1 --2- 172.21.15.59:0/266511310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c7512c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342df9b700 1 -- 172.21.15.59:0/266511310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 msgr2=0x5609c750eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342df9b700 1 --2- 172.21.15.59:0/266511310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 0x5609c750eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342df9b700 1 -- 172.21.15.59:0/266511310 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609c72ad250 con 0x5609c7507e80 2023-10-08T12:54:31.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342d79a700 1 --2- 172.21.15.59:0/266511310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c7512c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:31.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342e79c700 1 --2- 172.21.15.59:0/266511310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 0x5609c750eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:54:31.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f342df9b700 1 --2- 172.21.15.59:0/266511310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c751a1e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f34240a3130 tx=0x7f34240a3660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4221cbc1e90a34dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:31.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.217+0000 7f341cff9700 1 -- 172.21.15.59:0/266511310 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342409acc0 con 0x5609c7507e80 2023-10-08T12:54:31.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.218+0000 7f341cff9700 1 -- 172.21.15.59:0/266511310 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f342409aea0 con 0x5609c7507e80 2023-10-08T12:54:31.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.218+0000 7f341cff9700 1 -- 172.21.15.59:0/266511310 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342409f150 con 0x5609c7507e80 2023-10-08T12:54:31.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.218+0000 7f3443c18b80 1 -- 172.21.15.59:0/266511310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 msgr2=0x5609c751a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.218+0000 7f3443c18b80 1 --2- 172.21.15.59:0/266511310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c751a1e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f34240a3130 tx=0x7f34240a3660 comp rx=0 tx=0).stop 2023-10-08T12:54:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.219+0000 7f3443c18b80 1 -- 172.21.15.59:0/266511310 shutdown_connections 2023-10-08T12:54:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.219+0000 7f3443c18b80 1 --2- 172.21.15.59:0/266511310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c751a1e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.219+0000 7f3443c18b80 1 --2- 172.21.15.59:0/266511310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 0x5609c750eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.219+0000 7f3443c18b80 1 --2- 172.21.15.59:0/266511310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c7512c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.219+0000 7f3443c18b80 1 -- 172.21.15.59:0/266511310 >> 172.21.15.59:0/266511310 conn(0x5609c747d260 msgr2=0x5609c7529a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.219+0000 7f3443c18b80 1 -- 172.21.15.59:0/266511310 shutdown_connections 2023-10-08T12:54:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.219+0000 7f3443c18b80 1 -- 172.21.15.59:0/266511310 wait complete. 2023-10-08T12:54:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.220+0000 7f3443c18b80 1 -- start start 2023-10-08T12:54:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.220+0000 7f3443c18b80 1 Processor -- start 2023-10-08T12:54:31.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.220+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c750db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.220+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c750c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f3443c18b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 0x5609c750ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f3443c18b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c750cf80 con 0x5609c7513650 2023-10-08T12:54:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f3443c18b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c750d0f0 con 0x5609c7507e80 2023-10-08T12:54:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f3443c18b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609c750d2b0 con 0x5609c75087a0 2023-10-08T12:54:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f3443c18b80 10 client.0 _ll_register_callbacks cb 0x5609c7255800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:31.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342df9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c750db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342df9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c750db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49450/0 (socket says 172.21.15.59:49450) 2023-10-08T12:54:31.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342df9b700 1 -- 172.21.15.59:0/1514227575 learned_addr learned my addr 172.21.15.59:0/1514227575 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:31.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342e79c700 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 0x5609c750ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342d79a700 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c750c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342df9b700 1 -- 172.21.15.59:0/1514227575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 msgr2=0x5609c750c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:31.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342df9b700 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c750c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342df9b700 1 -- 172.21.15.59:0/1514227575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 msgr2=0x5609c750ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342df9b700 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 0x5609c750ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342df9b700 1 -- 172.21.15.59:0/1514227575 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609c7286de0 con 0x5609c7507e80 2023-10-08T12:54:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342d79a700 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c750c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:54:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342e79c700 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 0x5609c750ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:54:31.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f342df9b700 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c750db50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f34240cbb20 tx=0x7f34240a3570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68fb9aea19023992 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:31.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.221+0000 7f34117fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:54:31.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.222+0000 7f34117fa700 1 -- 172.21.15.59:0/1514227575 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342409acc0 con 0x5609c7507e80 2023-10-08T12:54:31.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.222+0000 7f34117fa700 1 -- 172.21.15.59:0/1514227575 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f34240cd070 con 0x5609c7507e80 2023-10-08T12:54:31.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.222+0000 7f3443c18b80 1 -- 172.21.15.59:0/1514227575 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3418012910 con 0x5609c7507e80 2023-10-08T12:54:31.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.222+0000 7f34117fa700 1 -- 172.21.15.59:0/1514227575 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f342409ba60 con 0x5609c7507e80 2023-10-08T12:54:31.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.222+0000 7f3443c18b80 10 client.27401 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:31.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.222+0000 7f3443c18b80 1 -- 172.21.15.59:0/1514227575 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5609c726fc60 con 0x5609c7507e80 2023-10-08T12:54:31.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.222+0000 7f34117fa700 1 -- 172.21.15.59:0/1514227575 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3418012910 con 0x5609c7507e80 2023-10-08T12:54:31.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.222+0000 7f34117fa700 1 -- 172.21.15.59:0/1514227575 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f34240a1260 con 0x5609c7507e80 2023-10-08T12:54:31.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.222+0000 7f3443c18b80 10 client.27401 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:31.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.222+0000 7f3443c18b80 10 client.27401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:31.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.222+0000 7f3443c18b80 20 client.27401 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.223+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5609c7577a20 0x5609c7579e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.223+0000 7f3443c18b80 4 client.27401 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:54:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.223+0000 7f3443c18b80 1 -- 172.21.15.59:0/1514227575 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5609c7454b30 con 0x5609c7577a20 2023-10-08T12:54:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.223+0000 7f342d79a700 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5609c7577a20 0x5609c7579e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.223+0000 7f342d79a700 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5609c7577a20 0x5609c7579e10 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e14b2ded983f8862 server_cookie=1c6750de943fdc40 in_seq=0 out_seq=0 2023-10-08T12:54:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.223+0000 7f34117fa700 10 client.27401 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f34117fa700 1 -- 172.21.15.59:0/1514227575 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5609c7454b30 con 0x5609c7577a20 2023-10-08T12:54:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f34117fa700 10 client.27401 handle_command_reply: tid=0 2023-10-08T12:54:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 1 client.27401 shutdown 2023-10-08T12:54:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 1 -- 172.21.15.59:0/1514227575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 msgr2=0x5609c750db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c750db50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f34240cbb20 tx=0x7f34240a3570 comp rx=0 tx=0).stop 2023-10-08T12:54:31.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 1 -- 172.21.15.59:0/1514227575 shutdown_connections 2023-10-08T12:54:31.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5609c7577a20 0x5609c7579e10 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609c7507e80 0x5609c750db50 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609c7513650 0x5609c750ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 1 --2- 172.21.15.59:0/1514227575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5609c75087a0 0x5609c750c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f34117fa700 0 client.27401 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:31.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 1 -- 172.21.15.59:0/1514227575 >> 172.21.15.59:0/1514227575 conn(0x5609c747d260 msgr2=0x5609c7512c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:31.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 1 -- 172.21.15.59:0/1514227575 shutdown_connections 2023-10-08T12:54:31.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 1 -- 172.21.15.59:0/1514227575 wait complete. 2023-10-08T12:54:31.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.226+0000 7f3443c18b80 20 client.27401 trim_cache size 0 max 16384 2023-10-08T12:54:31.234 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:54:31.234 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:54:31.234 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:54:31.235 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:54:31.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.227+0000 7f34301ff700 1 -- 172.21.15.59:0/1504342884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f34140a16b0 msgr2=0x7f34140a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.227+0000 7f34301ff700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f34140a16b0 0x7f34140a3b70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3420009ec0 tx=0x7f3420004ad0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.227+0000 7f34301ff700 1 -- 172.21.15.59:0/1504342884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3428100740 msgr2=0x7f3428198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.227+0000 7f34301ff700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3428100740 0x7f3428198db0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f34240098e0 tx=0x7f3424005740 comp rx=0 tx=0).stop 2023-10-08T12:54:31.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.227+0000 7f34301ff700 1 -- 172.21.15.59:0/1504342884 shutdown_connections 2023-10-08T12:54:31.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.227+0000 7f34301ff700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f34140a16b0 0x7f34140a3b70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.227+0000 7f34301ff700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3428106750 0x7f342819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.227+0000 7f34301ff700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3428100740 0x7f3428198db0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.227+0000 7f34301ff700 1 --2- 172.21.15.59:0/1504342884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428101100 0x7f34281992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.227+0000 7f34301ff700 1 -- 172.21.15.59:0/1504342884 >> 172.21.15.59:0/1504342884 conn(0x7f34280fc230 msgr2=0x7f34280fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:31.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.227+0000 7f34301ff700 1 -- 172.21.15.59:0/1504342884 shutdown_connections 2023-10-08T12:54:31.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.228+0000 7f34301ff700 1 -- 172.21.15.59:0/1504342884 wait complete. 2023-10-08T12:54:31.248 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:54:31.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:54:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.578+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/3189112765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d410d2d0 msgr2=0x7fc6d410f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.578+0000 7fc6dc5ff700 1 --2- 172.21.15.59:0/3189112765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d410d2d0 0x7fc6d410f6c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009990 tx=0x7fc6cc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.579+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/3189112765 shutdown_connections 2023-10-08T12:54:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.579+0000 7fc6dc5ff700 1 --2- 172.21.15.59:0/3189112765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d4101750 0x7fc6d40feb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.579+0000 7fc6dc5ff700 1 --2- 172.21.15.59:0/3189112765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d410d2d0 0x7fc6d410f6c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.579+0000 7fc6dc5ff700 1 --2- 172.21.15.59:0/3189112765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d40ff090 0x7fc6d40ff510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.579+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/3189112765 >> 172.21.15.59:0/3189112765 conn(0x7fc6d4075a90 msgr2=0x7fc6d40fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:31.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.580+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/3189112765 shutdown_connections 2023-10-08T12:54:31.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.580+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/3189112765 wait complete. 2023-10-08T12:54:31.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.582+0000 7fc6dc5ff700 1 Processor -- start 2023-10-08T12:54:31.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.582+0000 7fc6dc5ff700 1 -- start start 2023-10-08T12:54:31.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.582+0000 7fc6dc5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d40ff090 0x7fc6d4071e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.582+0000 7fc6dc5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d4101750 0x7fc6d4072370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.582+0000 7fc6dc5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d410d2d0 0x7fc6d406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.582+0000 7fc6dc5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40701d0 con 0x7fc6d410d2d0 2023-10-08T12:54:31.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.582+0000 7fc6dc5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4070340 con 0x7fc6d40ff090 2023-10-08T12:54:31.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.582+0000 7fc6dc5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4070500 con 0x7fc6d4101750 2023-10-08T12:54:31.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.583+0000 7fc6da39b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d40ff090 0x7fc6d4071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.583+0000 7fc6da39b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d40ff090 0x7fc6d4071e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49468/0 (socket says 172.21.15.59:49468) 2023-10-08T12:54:31.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.583+0000 7fc6da39b700 1 -- 172.21.15.59:0/2249064615 learned_addr learned my addr 172.21.15.59:0/2249064615 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.583+0000 7fc6d9b9a700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d4101750 0x7fc6d4072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.583+0000 7fc6da39b700 1 -- 172.21.15.59:0/2249064615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d4101750 msgr2=0x7fc6d4072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.583+0000 7fc6da39b700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d4101750 0x7fc6d4072370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.583+0000 7fc6da39b700 1 -- 172.21.15.59:0/2249064615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d410d2d0 msgr2=0x7fc6d406fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.583+0000 7fc6da39b700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d410d2d0 0x7fc6d406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.583+0000 7fc6da39b700 1 -- 172.21.15.59:0/2249064615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d0009c40 con 0x7fc6d40ff090 2023-10-08T12:54:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.584+0000 7fc6da39b700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d40ff090 0x7fc6d4071e30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c370 tx=0x7fc6d000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.584+0000 7fc6cb7fe700 1 -- 172.21.15.59:0/2249064615 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0017070 con 0x7fc6d40ff090 2023-10-08T12:54:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.584+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/2249064615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc0095f0 con 0x7fc6d40ff090 2023-10-08T12:54:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.584+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/2249064615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d406b160 con 0x7fc6d40ff090 2023-10-08T12:54:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.584+0000 7fc6cb7fe700 1 -- 172.21.15.59:0/2249064615 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6d000f040 con 0x7fc6d40ff090 2023-10-08T12:54:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.584+0000 7fc6cb7fe700 1 -- 172.21.15.59:0/2249064615 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d000e050 con 0x7fc6d40ff090 2023-10-08T12:54:31.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.586+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/2249064615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b80052f0 con 0x7fc6d40ff090 2023-10-08T12:54:31.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.589+0000 7fc6cb7fe700 1 -- 172.21.15.59:0/2249064615 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc6d00090d0 con 0x7fc6d40ff090 2023-10-08T12:54:31.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.591+0000 7fc6cb7fe700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6c00a16b0 0x7fc6c00a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:31.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.592+0000 7fc6cb7fe700 1 -- 172.21.15.59:0/2249064615 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fc6d00cca10 con 0x7fc6d40ff090 2023-10-08T12:54:31.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.592+0000 7fc6d9b9a700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6c00a16b0 0x7fc6c00a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:31.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.593+0000 7fc6d9b9a700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6c00a16b0 0x7fc6c00a3b70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4006fd0 tx=0x7fc6c4008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:31.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.595+0000 7fc6cb7fe700 1 -- 172.21.15.59:0/2249064615 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc6d0095d20 con 0x7fc6d40ff090 2023-10-08T12:54:31.935 INFO:tasks.workunit.client.0.smithi059.stdout: 10 863 104.14 MB/sec warmup 2 sec latency 133.270 ms 2023-10-08T12:54:31.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.957+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/2249064615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6b80055a0 con 0x7fc6d40ff090 2023-10-08T12:54:31.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.958+0000 7fc6cb7fe700 1 -- 172.21.15.59:0/2249064615 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fc6d0009380 con 0x7fc6d40ff090 2023-10-08T12:54:31.958 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:54:31.959 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:54:31.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.961+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/2249064615 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6c00a16b0 msgr2=0x7fc6c00a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.961+0000 7fc6dc5ff700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6c00a16b0 0x7fc6c00a3b70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4006fd0 tx=0x7fc6c4008040 comp rx=0 tx=0).stop 2023-10-08T12:54:31.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.961+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/2249064615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d40ff090 msgr2=0x7fc6d4071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:31.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.961+0000 7fc6dc5ff700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d40ff090 0x7fc6d4071e30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c370 tx=0x7fc6d000c730 comp rx=0 tx=0).stop 2023-10-08T12:54:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.961+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/2249064615 shutdown_connections 2023-10-08T12:54:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.961+0000 7fc6dc5ff700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc6c00a16b0 0x7fc6c00a3b70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.961+0000 7fc6dc5ff700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6d40ff090 0x7fc6d4071e30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.961+0000 7fc6dc5ff700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d410d2d0 0x7fc6d406fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.961+0000 7fc6dc5ff700 1 --2- 172.21.15.59:0/2249064615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d4101750 0x7fc6d4072370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:31.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.961+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/2249064615 >> 172.21.15.59:0/2249064615 conn(0x7fc6d4075a90 msgr2=0x7fc6d410e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:31.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.962+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/2249064615 shutdown_connections 2023-10-08T12:54:31.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:31.962+0000 7fc6dc5ff700 1 -- 172.21.15.59:0/2249064615 wait complete. 2023-10-08T12:54:31.963 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:54:31.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:54:32.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:32 smithi059 ceph-mon[98489]: pgmap v728: 97 pgs: 97 active+clean; 583 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 218 op/s 2023-10-08T12:54:32.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:32 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2249064615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:54:32.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.268+0000 7f9262dff700 1 -- 172.21.15.59:0/857074007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c106750 msgr2=0x7f925c106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:32.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.268+0000 7f9262dff700 1 --2- 172.21.15.59:0/857074007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c106750 0x7f925c106b30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9258009990 tx=0x7f9258009ca0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.268+0000 7f9262dff700 1 -- 172.21.15.59:0/857074007 shutdown_connections 2023-10-08T12:54:32.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.268+0000 7f9262dff700 1 --2- 172.21.15.59:0/857074007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c106750 0x7f925c106b30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.268+0000 7f9262dff700 1 --2- 172.21.15.59:0/857074007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f925c101100 0x7f925c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.268+0000 7f9262dff700 1 --2- 172.21.15.59:0/857074007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f925c100740 0x7f925c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.268+0000 7f9262dff700 1 -- 172.21.15.59:0/857074007 >> 172.21.15.59:0/857074007 conn(0x7f925c0fc230 msgr2=0x7f925c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:32.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.268+0000 7f9262dff700 1 -- 172.21.15.59:0/857074007 shutdown_connections 2023-10-08T12:54:32.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.268+0000 7f9262dff700 1 -- 172.21.15.59:0/857074007 wait complete. 2023-10-08T12:54:32.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.269+0000 7f9262dff700 1 Processor -- start 2023-10-08T12:54:32.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.269+0000 7f9262dff700 1 -- start start 2023-10-08T12:54:32.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.269+0000 7f9262dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c100740 0x7f925c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.269+0000 7f9262dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f925c101100 0x7f925c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.269+0000 7f9262dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f925c106750 0x7f925c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9262dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c19dca0 con 0x7f925c106750 2023-10-08T12:54:32.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9262dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c19de10 con 0x7f925c100740 2023-10-08T12:54:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9262dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c19dfd0 con 0x7f925c101100 2023-10-08T12:54:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9260b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c100740 0x7f925c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9260b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c100740 0x7f925c198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49498/0 (socket says 172.21.15.59:49498) 2023-10-08T12:54:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9260b9b700 1 -- 172.21.15.59:0/1343785001 learned_addr learned my addr 172.21.15.59:0/1343785001 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f926139c700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f925c106750 0x7f925c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9253fff700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f925c101100 0x7f925c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9260b9b700 1 -- 172.21.15.59:0/1343785001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f925c101100 msgr2=0x7f925c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9260b9b700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f925c101100 0x7f925c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9260b9b700 1 -- 172.21.15.59:0/1343785001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f925c106750 msgr2=0x7f925c19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9260b9b700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f925c106750 0x7f925c19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9260b9b700 1 -- 172.21.15.59:0/1343785001 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580095f0 con 0x7f925c100740 2023-10-08T12:54:32.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.270+0000 7f9260b9b700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c100740 0x7f925c198d80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9258000c00 tx=0x7f9258005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:32.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.271+0000 7f9251ffb700 1 -- 172.21.15.59:0/1343785001 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925801d070 con 0x7f925c100740 2023-10-08T12:54:32.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.271+0000 7f9251ffb700 1 -- 172.21.15.59:0/1343785001 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9258022470 con 0x7f925c100740 2023-10-08T12:54:32.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.271+0000 7f9262dff700 1 -- 172.21.15.59:0/1343785001 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c19e250 con 0x7f925c100740 2023-10-08T12:54:32.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.271+0000 7f9251ffb700 1 -- 172.21.15.59:0/1343785001 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9258017650 con 0x7f925c100740 2023-10-08T12:54:32.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.271+0000 7f9262dff700 1 -- 172.21.15.59:0/1343785001 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c1a5af0 con 0x7f925c100740 2023-10-08T12:54:32.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.274+0000 7f9251ffb700 1 -- 172.21.15.59:0/1343785001 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f92580225e0 con 0x7f925c100740 2023-10-08T12:54:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.275+0000 7f9276801b80 1 Processor -- start 2023-10-08T12:54:32.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.275+0000 7f9276801b80 1 -- start start 2023-10-08T12:54:32.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f9276801b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26ef260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f9276801b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26ef7a0 0x55e7e26fa110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f9276801b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26fa650 0x55e7e26fca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f9276801b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e2658460 con 0x55e7e26ef7a0 2023-10-08T12:54:32.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f9276801b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e2649c20 con 0x55e7e26fa650 2023-10-08T12:54:32.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f9276801b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e2647540 con 0x55e7e26eee80 2023-10-08T12:54:32.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f9251ffb700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92440a15f0 0x7f92440a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f926139c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f9251ffb700 1 -- 172.21.15.59:0/1343785001 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f92580ce440 con 0x7f925c100740 2023-10-08T12:54:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f926139c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26ef260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:35008/0 (socket says 172.21.15.59:35008) 2023-10-08T12:54:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f926139c700 1 -- 172.21.15.59:0/983187843 learned_addr learned my addr 172.21.15.59:0/983187843 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f926139c700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92440a15f0 0x7f92440a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f9260b9b700 1 --2- 172.21.15.59:0/983187843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26ef7a0 0x55e7e26fa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f9253fff700 1 --2- 172.21.15.59:0/983187843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26fa650 0x55e7e26fca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.276+0000 7f926139c700 1 -- 172.21.15.59:0/983187843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26fa650 msgr2=0x55e7e26fca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.277+0000 7f926139c700 1 --2- 172.21.15.59:0/983187843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26fa650 0x55e7e26fca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.277+0000 7f926139c700 1 -- 172.21.15.59:0/983187843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26ef7a0 msgr2=0x55e7e26fa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.277+0000 7f926139c700 1 --2- 172.21.15.59:0/983187843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26ef7a0 0x55e7e26fa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.277+0000 7f926139c700 1 -- 172.21.15.59:0/983187843 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7e246dde0 con 0x55e7e26eee80 2023-10-08T12:54:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.277+0000 7f9253fff700 1 --2- 172.21.15.59:0/983187843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26fa650 0x55e7e26fca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:54:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.277+0000 7f926139c700 1 --2- 172.21.15.59:0/983187843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26ef260 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9254008af0 tx=0x7f9254008e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0f4a10895214cc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.277+0000 7f926139c700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92440a15f0 0x7f92440a3ab0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9254011000 tx=0x7f925401d000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.277+0000 7f9242ffd700 1 -- 172.21.15.59:0/983187843 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925400e070 con 0x55e7e26eee80 2023-10-08T12:54:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.277+0000 7f9242ffd700 1 -- 172.21.15.59:0/983187843 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f925400f040 con 0x55e7e26eee80 2023-10-08T12:54:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.277+0000 7f9242ffd700 1 -- 172.21.15.59:0/983187843 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9254024920 con 0x55e7e26eee80 2023-10-08T12:54:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.278+0000 7f9276801b80 1 -- 172.21.15.59:0/983187843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 msgr2=0x55e7e26ef260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.278+0000 7f9276801b80 1 --2- 172.21.15.59:0/983187843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26ef260 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9254008af0 tx=0x7f9254008e00 comp rx=0 tx=0).stop 2023-10-08T12:54:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.278+0000 7f9276801b80 1 -- 172.21.15.59:0/983187843 shutdown_connections 2023-10-08T12:54:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.278+0000 7f9276801b80 1 --2- 172.21.15.59:0/983187843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26fa650 0x55e7e26fca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.278+0000 7f9276801b80 1 --2- 172.21.15.59:0/983187843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26ef260 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.278+0000 7f9276801b80 1 --2- 172.21.15.59:0/983187843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26ef7a0 0x55e7e26fa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.278+0000 7f9276801b80 1 -- 172.21.15.59:0/983187843 >> 172.21.15.59:0/983187843 conn(0x55e7e2664260 msgr2=0x55e7e26eb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.278+0000 7f9276801b80 1 -- 172.21.15.59:0/983187843 shutdown_connections 2023-10-08T12:54:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.278+0000 7f9276801b80 1 -- 172.21.15.59:0/983187843 wait complete. 2023-10-08T12:54:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.279+0000 7f9276801b80 1 -- start start 2023-10-08T12:54:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.279+0000 7f9276801b80 1 Processor -- start 2023-10-08T12:54:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9276801b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26fa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9276801b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e26f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9276801b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e26f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9276801b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e2642e30 con 0x55e7e26fa650 2023-10-08T12:54:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9276801b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e25df710 con 0x55e7e26ef7a0 2023-10-08T12:54:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9276801b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e25df3b0 con 0x55e7e26eee80 2023-10-08T12:54:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9276801b80 10 client.0 _ll_register_callbacks cb 0x55e7e243c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9260b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26fa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e26f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9260b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26fa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:35024/0 (socket says 172.21.15.59:35024) 2023-10-08T12:54:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9260b9b700 1 -- 172.21.15.59:0/2384196770 learned_addr learned my addr 172.21.15.59:0/2384196770 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f926139c700 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e26f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9260b9b700 1 -- 172.21.15.59:0/2384196770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 msgr2=0x55e7e26f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9260b9b700 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e26f73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9260b9b700 1 -- 172.21.15.59:0/2384196770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 msgr2=0x55e7e26f7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9260b9b700 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e26f7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.280+0000 7f9260b9b700 1 -- 172.21.15.59:0/2384196770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92540086d0 con 0x55e7e26eee80 2023-10-08T12:54:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.281+0000 7f9260b9b700 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26fa060 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f925800f740 tx=0x7f92580cc0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1506bff5082e330a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.281+0000 7f923bfff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:54:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.281+0000 7f923bfff700 1 -- 172.21.15.59:0/2384196770 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925809b900 con 0x55e7e26eee80 2023-10-08T12:54:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.281+0000 7f9276801b80 1 -- 172.21.15.59:0/2384196770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7e260aeb0 con 0x55e7e26eee80 2023-10-08T12:54:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.281+0000 7f923bfff700 1 -- 172.21.15.59:0/2384196770 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f925809bba0 con 0x55e7e26eee80 2023-10-08T12:54:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.281+0000 7f923bfff700 1 -- 172.21.15.59:0/2384196770 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f925809ae00 con 0x55e7e26eee80 2023-10-08T12:54:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.281+0000 7f9276801b80 10 client.27412 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.281+0000 7f9276801b80 1 -- 172.21.15.59:0/2384196770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e7e2456c60 con 0x55e7e26eee80 2023-10-08T12:54:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.281+0000 7f923bfff700 1 -- 172.21.15.59:0/2384196770 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e7e260aeb0 con 0x55e7e26eee80 2023-10-08T12:54:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.282+0000 7f923bfff700 1 -- 172.21.15.59:0/2384196770 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f925809a990 con 0x55e7e26eee80 2023-10-08T12:54:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.282+0000 7f9276801b80 10 client.27412 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.282+0000 7f9276801b80 10 client.27412 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.282+0000 7f9276801b80 20 client.27412 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.282+0000 7f9276801b80 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7e2709d00 0x55e7e270c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.282+0000 7f9276801b80 4 client.27412 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:54:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.282+0000 7f9276801b80 1 -- 172.21.15.59:0/2384196770 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7e263be10 con 0x55e7e2709d00 2023-10-08T12:54:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.282+0000 7f9253fff700 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7e2709d00 0x55e7e270c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.282+0000 7f9253fff700 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7e2709d00 0x55e7e270c120 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8045dc64d3fb71ab server_cookie=af304135d5543c80 in_seq=0 out_seq=0 2023-10-08T12:54:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.282+0000 7f923bfff700 10 client.27412 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.283+0000 7f923bfff700 1 -- 172.21.15.59:0/2384196770 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e7e263be10 con 0x55e7e2709d00 2023-10-08T12:54:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.283+0000 7f923bfff700 10 client.27412 handle_command_reply: tid=0 2023-10-08T12:54:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.283+0000 7f9276801b80 1 client.27412 shutdown 2023-10-08T12:54:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f9276801b80 1 -- 172.21.15.59:0/2384196770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 msgr2=0x55e7e26fa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f9276801b80 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26fa060 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f925800f740 tx=0x7f92580cc0e0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f9276801b80 1 -- 172.21.15.59:0/2384196770 shutdown_connections 2023-10-08T12:54:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f9276801b80 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7e2709d00 0x55e7e270c120 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f9276801b80 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e26f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f923bfff700 0 client.27412 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f9276801b80 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26fa060 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f9276801b80 1 --2- 172.21.15.59:0/2384196770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e26f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f9276801b80 1 -- 172.21.15.59:0/2384196770 >> 172.21.15.59:0/2384196770 conn(0x55e7e2664260 msgr2=0x55e7e26eaec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f9276801b80 1 -- 172.21.15.59:0/2384196770 shutdown_connections 2023-10-08T12:54:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f9276801b80 1 -- 172.21.15.59:0/2384196770 wait complete. 2023-10-08T12:54:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.284+0000 7f9276801b80 20 client.27412 trim_cache size 0 max 16384 2023-10-08T12:54:32.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.297+0000 7f9276801b80 1 Processor -- start 2023-10-08T12:54:32.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.297+0000 7f9276801b80 1 -- start start 2023-10-08T12:54:32.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9276801b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26fca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9276801b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e2701140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9276801b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e26f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9276801b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e24c3920 con 0x55e7e26fa650 2023-10-08T12:54:32.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9276801b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e26efd80 con 0x55e7e26ef7a0 2023-10-08T12:54:32.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9276801b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e26ef620 con 0x55e7e26eee80 2023-10-08T12:54:32.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e2701140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9260b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26fca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e2701140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49530/0 (socket says 172.21.15.59:49530) 2023-10-08T12:54:32.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9253fff700 1 -- 172.21.15.59:0/34691122 learned_addr learned my addr 172.21.15.59:0/34691122 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:32.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f926139c700 1 --2- 172.21.15.59:0/34691122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e26f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9260b9b700 1 -- 172.21.15.59:0/34691122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 msgr2=0x55e7e2701140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:32.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9260b9b700 1 --2- 172.21.15.59:0/34691122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e2701140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9260b9b700 1 -- 172.21.15.59:0/34691122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 msgr2=0x55e7e26f68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:32.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.298+0000 7f9260b9b700 1 --2- 172.21.15.59:0/34691122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e26f68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.299+0000 7f9260b9b700 1 -- 172.21.15.59:0/34691122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7e2494250 con 0x55e7e26eee80 2023-10-08T12:54:32.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.299+0000 7f9253fff700 1 --2- 172.21.15.59:0/34691122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e2701140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:32.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.299+0000 7f9260b9b700 1 --2- 172.21.15.59:0/34691122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26fca40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f925809ad90 tx=0x7f9258005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=211129f0576c9497 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:32.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.299+0000 7f92437fe700 1 -- 172.21.15.59:0/34691122 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925809ae00 con 0x55e7e26eee80 2023-10-08T12:54:32.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.299+0000 7f92437fe700 1 -- 172.21.15.59:0/34691122 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f925809bba0 con 0x55e7e26eee80 2023-10-08T12:54:32.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.299+0000 7f92437fe700 1 -- 172.21.15.59:0/34691122 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925809f680 con 0x55e7e26eee80 2023-10-08T12:54:32.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.300+0000 7f9276801b80 1 -- 172.21.15.59:0/34691122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 msgr2=0x55e7e26fca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:32.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.300+0000 7f9276801b80 1 --2- 172.21.15.59:0/34691122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26fca40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f925809ad90 tx=0x7f9258005fd0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.300+0000 7f9276801b80 1 -- 172.21.15.59:0/34691122 shutdown_connections 2023-10-08T12:54:32.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.300+0000 7f9276801b80 1 --2- 172.21.15.59:0/34691122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e26f68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.300+0000 7f9276801b80 1 --2- 172.21.15.59:0/34691122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e26fca40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.300+0000 7f9276801b80 1 --2- 172.21.15.59:0/34691122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e2701140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.300+0000 7f9276801b80 1 -- 172.21.15.59:0/34691122 >> 172.21.15.59:0/34691122 conn(0x55e7e2664260 msgr2=0x55e7e26ea4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:32.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.300+0000 7f9276801b80 1 -- 172.21.15.59:0/34691122 shutdown_connections 2023-10-08T12:54:32.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.300+0000 7f9276801b80 1 -- 172.21.15.59:0/34691122 wait complete. 2023-10-08T12:54:32.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.300+0000 7f9276801b80 1 -- start start 2023-10-08T12:54:32.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9276801b80 1 Processor -- start 2023-10-08T12:54:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9276801b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e27002f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9276801b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e2700830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9276801b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e275cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9276801b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e2700ff0 con 0x55e7e26fa650 2023-10-08T12:54:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9276801b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e2701160 con 0x55e7e26ef7a0 2023-10-08T12:54:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9276801b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e275d0a0 con 0x55e7e26eee80 2023-10-08T12:54:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9276801b80 10 client.0 _ll_register_callbacks cb 0x7f9258097100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9260b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e27002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e2700830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9260b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e27002f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:35044/0 (socket says 172.21.15.59:35044) 2023-10-08T12:54:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.301+0000 7f9260b9b700 1 -- 172.21.15.59:0/3469623423 learned_addr learned my addr 172.21.15.59:0/3469623423 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:32.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f926139c700 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e275cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f9260b9b700 1 -- 172.21.15.59:0/3469623423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 msgr2=0x55e7e2700830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:32.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f9260b9b700 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e2700830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f9260b9b700 1 -- 172.21.15.59:0/3469623423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 msgr2=0x55e7e275cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:32.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f9260b9b700 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e275cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f9260b9b700 1 -- 172.21.15.59:0/3469623423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7e2456c60 con 0x55e7e26eee80 2023-10-08T12:54:32.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f9253fff700 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e2700830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:54:32.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f9260b9b700 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e27002f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f92580979a0 tx=0x7f925809b0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d20384c101f68ab3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:32.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f923bfff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:54:32.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f923bfff700 1 -- 172.21.15.59:0/3469623423 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925809b900 con 0x55e7e26eee80 2023-10-08T12:54:32.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f923bfff700 1 -- 172.21.15.59:0/3469623423 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f92580b7020 con 0x55e7e26eee80 2023-10-08T12:54:32.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.302+0000 7f9276801b80 1 -- 172.21.15.59:0/3469623423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f925400f040 con 0x55e7e26eee80 2023-10-08T12:54:32.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f923bfff700 1 -- 172.21.15.59:0/3469623423 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92580a37a0 con 0x55e7e26eee80 2023-10-08T12:54:32.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f9276801b80 10 client.27418 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:32.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f9276801b80 1 -- 172.21.15.59:0/3469623423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e7e246c2b0 con 0x55e7e26eee80 2023-10-08T12:54:32.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f923bfff700 1 -- 172.21.15.59:0/3469623423 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f925400f040 con 0x55e7e26eee80 2023-10-08T12:54:32.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f923bfff700 1 -- 172.21.15.59:0/3469623423 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f92580a13a0 con 0x55e7e26eee80 2023-10-08T12:54:32.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f9276801b80 10 client.27418 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:32.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f9276801b80 10 client.27418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:32.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f9276801b80 20 client.27418 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:32.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f9276801b80 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7e275e390 0x55e7e2760780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:32.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f9276801b80 4 client.27418 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:54:32.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f9276801b80 1 -- 172.21.15.59:0/3469623423 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e7e263bb30 con 0x55e7e275e390 2023-10-08T12:54:32.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.303+0000 7f9253fff700 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7e275e390 0x55e7e2760780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:32.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.304+0000 7f9253fff700 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7e275e390 0x55e7e2760780 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dacae7f6135d6006 server_cookie=508fd6a2e46acd5a in_seq=0 out_seq=0 2023-10-08T12:54:32.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.304+0000 7f923bfff700 10 client.27418 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:32.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f923bfff700 1 -- 172.21.15.59:0/3469623423 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e7e263bb30 con 0x55e7e275e390 2023-10-08T12:54:32.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f923bfff700 10 client.27418 handle_command_reply: tid=0 2023-10-08T12:54:32.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f9276801b80 1 client.27418 shutdown 2023-10-08T12:54:32.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f9276801b80 1 -- 172.21.15.59:0/3469623423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 msgr2=0x55e7e27002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:32.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f9276801b80 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e27002f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f92580979a0 tx=0x7f925809b0a0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f9276801b80 1 -- 172.21.15.59:0/3469623423 shutdown_connections 2023-10-08T12:54:32.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f9276801b80 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7e275e390 0x55e7e2760780 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f9276801b80 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e26fa650 0x55e7e275cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f9276801b80 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7e26eee80 0x55e7e27002f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f9276801b80 1 --2- 172.21.15.59:0/3469623423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e26ef7a0 0x55e7e2700830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f9276801b80 1 -- 172.21.15.59:0/3469623423 >> 172.21.15.59:0/3469623423 conn(0x55e7e2664260 msgr2=0x55e7e26f26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:32.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f923bfff700 0 client.27418 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:32.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.309+0000 7f9276801b80 1 -- 172.21.15.59:0/3469623423 shutdown_connections 2023-10-08T12:54:32.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9276801b80 1 -- 172.21.15.59:0/3469623423 wait complete. 2023-10-08T12:54:32.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9276801b80 20 client.27418 trim_cache size 0 max 16384 2023-10-08T12:54:32.312 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:54:32.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9262dff700 1 -- 172.21.15.59:0/1343785001 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92440a15f0 msgr2=0x7f92440a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:32.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9262dff700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92440a15f0 0x7f92440a3ab0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9254011000 tx=0x7f925401d000 comp rx=0 tx=0).stop 2023-10-08T12:54:32.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9262dff700 1 -- 172.21.15.59:0/1343785001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c100740 msgr2=0x7f925c198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:32.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9262dff700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c100740 0x7f925c198d80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9258000c00 tx=0x7f9258005740 comp rx=0 tx=0).stop 2023-10-08T12:54:32.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9262dff700 1 -- 172.21.15.59:0/1343785001 shutdown_connections 2023-10-08T12:54:32.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9262dff700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f92440a15f0 0x7f92440a3ab0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9262dff700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f925c100740 0x7f925c198d80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9262dff700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f925c106750 0x7f925c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9262dff700 1 --2- 172.21.15.59:0/1343785001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f925c101100 0x7f925c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:32.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.310+0000 7f9262dff700 1 -- 172.21.15.59:0/1343785001 >> 172.21.15.59:0/1343785001 conn(0x7f925c0fc230 msgr2=0x7f925c10beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:32.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.311+0000 7f9262dff700 1 -- 172.21.15.59:0/1343785001 shutdown_connections 2023-10-08T12:54:32.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:32.311+0000 7f9262dff700 1 -- 172.21.15.59:0/1343785001 wait complete. 2023-10-08T12:54:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:32 smithi092 ceph-mon[134093]: pgmap v728: 97 pgs: 97 active+clean; 583 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 218 op/s 2023-10-08T12:54:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:32 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2249064615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:54:32.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:32 smithi173 ceph-mon[135182]: pgmap v728: 97 pgs: 97 active+clean; 583 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 218 op/s 2023-10-08T12:54:32.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:32 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2249064615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:54:32.935 INFO:tasks.workunit.client.0.smithi059.stdout: 10 1367 82.83 MB/sec warmup 3 sec latency 243.182 ms 2023-10-08T12:54:33.331 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:54:33.332 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:54:33.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.580+0000 7fdc86f9d700 1 -- 172.21.15.59:0/2154575688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc80105500 msgr2=0x7fdc801058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.580+0000 7fdc86f9d700 1 --2- 172.21.15.59:0/2154575688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc80105500 0x7fdc801058e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009990 tx=0x7fdc7c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.581+0000 7fdc86f9d700 1 -- 172.21.15.59:0/2154575688 shutdown_connections 2023-10-08T12:54:33.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.581+0000 7fdc86f9d700 1 --2- 172.21.15.59:0/2154575688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc80105500 0x7fdc801058e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.581+0000 7fdc86f9d700 1 --2- 172.21.15.59:0/2154575688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc800ffe20 0x7fdc8010c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.581+0000 7fdc86f9d700 1 --2- 172.21.15.59:0/2154575688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc800ff460 0x7fdc800ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.581+0000 7fdc86f9d700 1 -- 172.21.15.59:0/2154575688 >> 172.21.15.59:0/2154575688 conn(0x7fdc800faf50 msgr2=0x7fdc800fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.581+0000 7fdc86f9d700 1 -- 172.21.15.59:0/2154575688 shutdown_connections 2023-10-08T12:54:33.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.581+0000 7fdc86f9d700 1 -- 172.21.15.59:0/2154575688 wait complete. 2023-10-08T12:54:33.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.582+0000 7fdc86f9d700 1 Processor -- start 2023-10-08T12:54:33.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.582+0000 7fdc86f9d700 1 -- start start 2023-10-08T12:54:33.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc86f9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc800ff460 0x7fdc8019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc86f9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc800ffe20 0x7fdc8019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc86f9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc80105500 0x7fdc80198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc86f9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc801990b0 con 0x7fdc800ffe20 2023-10-08T12:54:33.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc86f9d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc80199220 con 0x7fdc80105500 2023-10-08T12:54:33.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc86f9d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc801993e0 con 0x7fdc800ff460 2023-10-08T12:54:33.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc85f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc800ff460 0x7fdc8019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc85f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc800ff460 0x7fdc8019e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:35058/0 (socket says 172.21.15.59:35058) 2023-10-08T12:54:33.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc85f9b700 1 -- 172.21.15.59:0/3512398774 learned_addr learned my addr 172.21.15.59:0/3512398774 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:33.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc8679c700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc80105500 0x7fdc80198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc8579a700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc800ffe20 0x7fdc8019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc85f9b700 1 -- 172.21.15.59:0/3512398774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc80105500 msgr2=0x7fdc80198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc85f9b700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc80105500 0x7fdc80198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc85f9b700 1 -- 172.21.15.59:0/3512398774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc800ffe20 msgr2=0x7fdc8019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc85f9b700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc800ffe20 0x7fdc8019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc85f9b700 1 -- 172.21.15.59:0/3512398774 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c0095f0 con 0x7fdc800ff460 2023-10-08T12:54:33.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.583+0000 7fdc8679c700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc80105500 0x7fdc80198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:33.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.584+0000 7fdc85f9b700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc800ff460 0x7fdc8019e920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c005910 tx=0x7fdc7c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.584+0000 7fdc76ffd700 1 -- 172.21.15.59:0/3512398774 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c01d070 con 0x7fdc800ff460 2023-10-08T12:54:33.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.584+0000 7fdc76ffd700 1 -- 172.21.15.59:0/3512398774 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc7c022470 con 0x7fdc800ff460 2023-10-08T12:54:33.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.584+0000 7fdc76ffd700 1 -- 172.21.15.59:0/3512398774 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c017650 con 0x7fdc800ff460 2023-10-08T12:54:33.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.584+0000 7fdc86f9d700 1 -- 172.21.15.59:0/3512398774 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc80199660 con 0x7fdc800ff460 2023-10-08T12:54:33.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.584+0000 7fdc86f9d700 1 -- 172.21.15.59:0/3512398774 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc801a5910 con 0x7fdc800ff460 2023-10-08T12:54:33.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.588+0000 7fdc76ffd700 1 -- 172.21.15.59:0/3512398774 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fdc7c0225e0 con 0x7fdc800ff460 2023-10-08T12:54:33.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.590+0000 7fdc76ffd700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdc6c0a15f0 0x7fdc6c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.590+0000 7fdc9bb39b80 1 Processor -- start 2023-10-08T12:54:33.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.590+0000 7fdc76ffd700 1 -- 172.21.15.59:0/3512398774 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fdc7c0ce330 con 0x7fdc800ff460 2023-10-08T12:54:33.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.590+0000 7fdc8579a700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdc6c0a15f0 0x7fdc6c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.591+0000 7fdc9bb39b80 1 -- start start 2023-10-08T12:54:33.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.591+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 0x55574500e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.591+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e9f0 0x555745019340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.591+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574501bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.591+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555744f774e0 con 0x55574500e9f0 2023-10-08T12:54:33.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.591+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555744f68ca0 con 0x555745019880 2023-10-08T12:54:33.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.591+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555744f665c0 con 0x55574500e0d0 2023-10-08T12:54:33.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.592+0000 7fdc85f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 0x55574500e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.592+0000 7fdc85f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 0x55574500e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:35070/0 (socket says 172.21.15.59:35070) 2023-10-08T12:54:33.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.592+0000 7fdc85f9b700 1 -- 172.21.15.59:0/1627936684 learned_addr learned my addr 172.21.15.59:0/1627936684 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:33.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.592+0000 7fdc8579a700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdc6c0a15f0 0x7fdc6c0a3ab0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdc80199c10 tx=0x7fdc70009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.592+0000 7fdc8579a700 1 --2- 172.21.15.59:0/1627936684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e9f0 0x555745019340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.592+0000 7fdc85f9b700 1 -- 172.21.15.59:0/1627936684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 msgr2=0x55574501bc70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:54:33.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.592+0000 7fdc85f9b700 1 --2- 172.21.15.59:0/1627936684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574501bc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.592+0000 7fdc85f9b700 1 -- 172.21.15.59:0/1627936684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e9f0 msgr2=0x555745019340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.592+0000 7fdc85f9b700 1 --2- 172.21.15.59:0/1627936684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e9f0 0x555745019340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.592+0000 7fdc85f9b700 1 -- 172.21.15.59:0/1627936684 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555744d8ce60 con 0x55574500e0d0 2023-10-08T12:54:33.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.592+0000 7fdc85f9b700 1 --2- 172.21.15.59:0/1627936684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 0x55574500e4b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0a3280 tx=0x7fdc7c022f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6af3f40b4067e221 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.593+0000 7fdc6bfff700 1 -- 172.21.15.59:0/1627936684 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c09b4b0 con 0x55574500e0d0 2023-10-08T12:54:33.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.593+0000 7fdc6bfff700 1 -- 172.21.15.59:0/1627936684 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc7c09f600 con 0x55574500e0d0 2023-10-08T12:54:33.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.593+0000 7fdc6bfff700 1 -- 172.21.15.59:0/1627936684 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c09a9a0 con 0x55574500e0d0 2023-10-08T12:54:33.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.594+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/1627936684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 msgr2=0x55574500e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.594+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/1627936684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 0x55574500e4b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0a3280 tx=0x7fdc7c022f90 comp rx=0 tx=0).stop 2023-10-08T12:54:33.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.594+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/1627936684 shutdown_connections 2023-10-08T12:54:33.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.594+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/1627936684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574501bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.594+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/1627936684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 0x55574500e4b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.594+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/1627936684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e9f0 0x555745019340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.594+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/1627936684 >> 172.21.15.59:0/1627936684 conn(0x555744f832e0 msgr2=0x55574500a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.594+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/1627936684 shutdown_connections 2023-10-08T12:54:33.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.594+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/1627936684 wait complete. 2023-10-08T12:54:33.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.595+0000 7fdc9bb39b80 1 -- start start 2023-10-08T12:54:33.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.595+0000 7fdc9bb39b80 1 Processor -- start 2023-10-08T12:54:33.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 0x555745022470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e9f0 0x5557450229b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574502d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555744f61eb0 con 0x55574500e0d0 2023-10-08T12:54:33.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555744efe790 con 0x555745019880 2023-10-08T12:54:33.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555744efe430 con 0x55574500e9f0 2023-10-08T12:54:33.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc9bb39b80 10 client.0 _ll_register_callbacks cb 0x555744d5b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:33.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc85f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 0x555745022470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc8679c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574502d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc8679c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574502d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49556/0 (socket says 172.21.15.59:49556) 2023-10-08T12:54:33.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc8679c700 1 -- 172.21.15.59:0/4200838568 learned_addr learned my addr 172.21.15.59:0/4200838568 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:33.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc85f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 0x555745022470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59572/0 (socket says 172.21.15.59:59572) 2023-10-08T12:54:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.596+0000 7fdc8579a700 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e9f0 0x5557450229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.597+0000 7fdc8679c700 1 -- 172.21.15.59:0/4200838568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e9f0 msgr2=0x5557450229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.597+0000 7fdc8679c700 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e9f0 0x5557450229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.597+0000 7fdc8679c700 1 -- 172.21.15.59:0/4200838568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 msgr2=0x555745022470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.597+0000 7fdc8679c700 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 0x555745022470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.597+0000 7fdc8679c700 1 -- 172.21.15.59:0/4200838568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc801a5910 con 0x555745019880 2023-10-08T12:54:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.597+0000 7fdc8679c700 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574502d4f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdc78004630 tx=0x7fdc78004940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d0e36a10c11832d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.597+0000 7fdc697fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:54:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.597+0000 7fdc697fa700 1 -- 172.21.15.59:0/4200838568 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7800e990 con 0x555745019880 2023-10-08T12:54:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.597+0000 7fdc697fa700 1 -- 172.21.15.59:0/4200838568 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fdc7800eaf0 con 0x555745019880 2023-10-08T12:54:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.597+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/4200838568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555744f29f30 con 0x555745019880 2023-10-08T12:54:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.598+0000 7fdc697fa700 1 -- 172.21.15.59:0/4200838568 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc7800ecb0 con 0x555745019880 2023-10-08T12:54:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.598+0000 7fdc9bb39b80 10 client.27431 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.598+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/4200838568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x555744d75ce0 con 0x555745019880 2023-10-08T12:54:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.598+0000 7fdc697fa700 1 -- 172.21.15.59:0/4200838568 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555744f29f30 con 0x555745019880 2023-10-08T12:54:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.598+0000 7fdc697fa700 1 -- 172.21.15.59:0/4200838568 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdc780154e0 con 0x555745019880 2023-10-08T12:54:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.598+0000 7fdc9bb39b80 10 client.27431 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.598+0000 7fdc9bb39b80 10 client.27431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.598+0000 7fdc9bb39b80 20 client.27431 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.598+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5557450319f0 0x555745033e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.598+0000 7fdc9bb39b80 4 client.27431 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:54:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.598+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/4200838568 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555744f5ae90 con 0x5557450319f0 2023-10-08T12:54:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.599+0000 7fdc85f9b700 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5557450319f0 0x555745033e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.599+0000 7fdc85f9b700 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5557450319f0 0x555745033e10 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d34f67a3b7004aa6 server_cookie=556fdecaf159a5ea in_seq=0 out_seq=0 2023-10-08T12:54:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.599+0000 7fdc697fa700 10 client.27431 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.601+0000 7fdc697fa700 1 -- 172.21.15.59:0/4200838568 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555744f5ae90 con 0x5557450319f0 2023-10-08T12:54:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.601+0000 7fdc697fa700 10 client.27431 handle_command_reply: tid=0 2023-10-08T12:54:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.601+0000 7fdc9bb39b80 1 client.27431 shutdown 2023-10-08T12:54:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.601+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/4200838568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 msgr2=0x55574502d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.601+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574502d4f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdc78004630 tx=0x7fdc78004940 comp rx=0 tx=0).stop 2023-10-08T12:54:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.602+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/4200838568 shutdown_connections 2023-10-08T12:54:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.602+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5557450319f0 0x555745033e10 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.602+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574502d4f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.602+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 0x555745022470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.602+0000 7fdc697fa700 0 client.27431 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.602+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/4200838568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e9f0 0x5557450229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.602+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/4200838568 >> 172.21.15.59:0/4200838568 conn(0x555744f832e0 msgr2=0x555745010170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.602+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/4200838568 shutdown_connections 2023-10-08T12:54:33.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.602+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/4200838568 wait complete. 2023-10-08T12:54:33.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.602+0000 7fdc9bb39b80 20 client.27431 trim_cache size 0 max 16384 2023-10-08T12:54:33.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.623+0000 7fdc9bb39b80 1 Processor -- start 2023-10-08T12:54:33.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.623+0000 7fdc9bb39b80 1 -- start start 2023-10-08T12:54:33.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 0x55574500a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e9f0 0x555745027370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x555745003420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555744de29a0 con 0x55574500e9f0 2023-10-08T12:54:33.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574502e3c0 con 0x555745019880 2023-10-08T12:54:33.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574502dd20 con 0x55574500e0d0 2023-10-08T12:54:33.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc8679c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x555745003420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc8579a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e9f0 0x555745027370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc8679c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x555745003420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49558/0 (socket says 172.21.15.59:49558) 2023-10-08T12:54:33.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc85f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 0x55574500a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc8679c700 1 -- 172.21.15.59:0/1279252000 learned_addr learned my addr 172.21.15.59:0/1279252000 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:33.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc8679c700 1 -- 172.21.15.59:0/1279252000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 msgr2=0x55574500a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc8679c700 1 --2- 172.21.15.59:0/1279252000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 0x55574500a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc8679c700 1 -- 172.21.15.59:0/1279252000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e9f0 msgr2=0x555745027370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc8679c700 1 --2- 172.21.15.59:0/1279252000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e9f0 0x555745027370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.624+0000 7fdc8679c700 1 -- 172.21.15.59:0/1279252000 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555744db32d0 con 0x555745019880 2023-10-08T12:54:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.625+0000 7fdc8679c700 1 --2- 172.21.15.59:0/1279252000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x555745003420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdc780158c0 tx=0x7fdc7800e810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a245edf0b10dc1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.625+0000 7fdc74ff9700 1 -- 172.21.15.59:0/1279252000 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78015450 con 0x555745019880 2023-10-08T12:54:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.625+0000 7fdc74ff9700 1 -- 172.21.15.59:0/1279252000 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc7800f040 con 0x555745019880 2023-10-08T12:54:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.625+0000 7fdc74ff9700 1 -- 172.21.15.59:0/1279252000 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7800ec60 con 0x555745019880 2023-10-08T12:54:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.626+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/1279252000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 msgr2=0x555745003420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.626+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/1279252000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x555745003420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdc780158c0 tx=0x7fdc7800e810 comp rx=0 tx=0).stop 2023-10-08T12:54:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.626+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/1279252000 shutdown_connections 2023-10-08T12:54:33.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.626+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/1279252000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x555745003420 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.626+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/1279252000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e0d0 0x55574500a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.626+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/1279252000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e9f0 0x555745027370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.626+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/1279252000 >> 172.21.15.59:0/1279252000 conn(0x555744f832e0 msgr2=0x555745009d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.626+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/1279252000 shutdown_connections 2023-10-08T12:54:33.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.626+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/1279252000 wait complete. 2023-10-08T12:54:33.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.627+0000 7fdc9bb39b80 1 -- start start 2023-10-08T12:54:33.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.627+0000 7fdc9bb39b80 1 Processor -- start 2023-10-08T12:54:33.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.627+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 0x5557450800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.627+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e9f0 0x5557450805e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.627+0000 7fdc9bb39b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574507a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.627+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574507aa90 con 0x55574500e0d0 2023-10-08T12:54:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.627+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574507ac00 con 0x555745019880 2023-10-08T12:54:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.627+0000 7fdc9bb39b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574507adc0 con 0x55574500e9f0 2023-10-08T12:54:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.627+0000 7fdc9bb39b80 10 client.0 _ll_register_callbacks cb 0x7fdc78003f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc85f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 0x5557450800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc8679c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574507a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc85f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 0x5557450800a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59588/0 (socket says 172.21.15.59:59588) 2023-10-08T12:54:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc85f9b700 1 -- 172.21.15.59:0/252179014 learned_addr learned my addr 172.21.15.59:0/252179014 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:33.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc8579a700 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e9f0 0x5557450805e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc8679c700 1 -- 172.21.15.59:0/252179014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e9f0 msgr2=0x5557450805e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc8679c700 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e9f0 0x5557450805e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc8679c700 1 -- 172.21.15.59:0/252179014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 msgr2=0x5557450800a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc8679c700 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 0x5557450800a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc8679c700 1 -- 172.21.15.59:0/252179014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555744d75ce0 con 0x555745019880 2023-10-08T12:54:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc85f9b700 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 0x5557450800a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc8679c700 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574507a4b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdc78004630 tx=0x7fdc78004e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf0626d35da844c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc697fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:54:33.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc697fa700 1 -- 172.21.15.59:0/252179014 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78015c60 con 0x555745019880 2023-10-08T12:54:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/252179014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc7c09f600 con 0x555745019880 2023-10-08T12:54:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.628+0000 7fdc697fa700 1 -- 172.21.15.59:0/252179014 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fdc78015dc0 con 0x555745019880 2023-10-08T12:54:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.629+0000 7fdc697fa700 1 -- 172.21.15.59:0/252179014 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc78004ae0 con 0x555745019880 2023-10-08T12:54:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.629+0000 7fdc9bb39b80 10 client.27437 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.629+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/252179014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x555744d8b330 con 0x555745019880 2023-10-08T12:54:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.629+0000 7fdc697fa700 1 -- 172.21.15.59:0/252179014 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc7c09f600 con 0x555745019880 2023-10-08T12:54:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.629+0000 7fdc697fa700 1 -- 172.21.15.59:0/252179014 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdc7802f070 con 0x555745019880 2023-10-08T12:54:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.629+0000 7fdc9bb39b80 10 client.27437 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.629+0000 7fdc9bb39b80 10 client.27437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:33.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.629+0000 7fdc9bb39b80 20 client.27437 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:33.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.629+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555745087b50 0x555745089f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.629+0000 7fdc9bb39b80 4 client.27437 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:54:33.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.629+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/252179014 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555744f5abb0 con 0x555745087b50 2023-10-08T12:54:33.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.630+0000 7fdc85f9b700 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555745087b50 0x555745089f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.630+0000 7fdc85f9b700 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555745087b50 0x555745089f40 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f4197953987c3d7 server_cookie=ba9f18295b5d051d in_seq=0 out_seq=0 2023-10-08T12:54:33.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.630+0000 7fdc697fa700 10 client.27437 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:33.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc697fa700 1 -- 172.21.15.59:0/252179014 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555744f5abb0 con 0x555745087b50 2023-10-08T12:54:33.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc697fa700 10 client.27437 handle_command_reply: tid=0 2023-10-08T12:54:33.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 1 client.27437 shutdown 2023-10-08T12:54:33.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/252179014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 msgr2=0x55574507a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574507a4b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdc78004630 tx=0x7fdc78004e20 comp rx=0 tx=0).stop 2023-10-08T12:54:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/252179014 shutdown_connections 2023-10-08T12:54:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555745087b50 0x555745089f40 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555745019880 0x55574507a4b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55574500e0d0 0x5557450800a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 1 --2- 172.21.15.59:0/252179014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55574500e9f0 0x5557450805e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc697fa700 0 client.27437 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/252179014 >> 172.21.15.59:0/252179014 conn(0x555744f832e0 msgr2=0x555745003420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/252179014 shutdown_connections 2023-10-08T12:54:33.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 1 -- 172.21.15.59:0/252179014 wait complete. 2023-10-08T12:54:33.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.636+0000 7fdc9bb39b80 20 client.27437 trim_cache size 0 max 16384 2023-10-08T12:54:33.639 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:54:33.640 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:54:33.640 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "4c999fe2-5e43-4a80-8b5c-3c8a3dc60e6a", 2023-10-08T12:54:33.640 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:54:33.640 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 -- 172.21.15.59:0/3512398774 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdc6c0a15f0 msgr2=0x7fdc6c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdc6c0a15f0 0x7fdc6c0a3ab0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdc80199c10 tx=0x7fdc70009260 comp rx=0 tx=0).stop 2023-10-08T12:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 -- 172.21.15.59:0/3512398774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc800ff460 msgr2=0x7fdc8019e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc800ff460 0x7fdc8019e920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c005910 tx=0x7fdc7c004730 comp rx=0 tx=0).stop 2023-10-08T12:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 -- 172.21.15.59:0/3512398774 shutdown_connections 2023-10-08T12:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdc6c0a15f0 0x7fdc6c0a3ab0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc80105500 0x7fdc80198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc800ff460 0x7fdc8019e920 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 --2- 172.21.15.59:0/3512398774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc800ffe20 0x7fdc8019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 -- 172.21.15.59:0/3512398774 >> 172.21.15.59:0/3512398774 conn(0x7fdc800faf50 msgr2=0x7fdc8010ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 -- 172.21.15.59:0/3512398774 shutdown_connections 2023-10-08T12:54:33.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.637+0000 7fdc86f9d700 1 -- 172.21.15.59:0/3512398774 wait complete. 2023-10-08T12:54:33.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:54:33.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.880+0000 7fca45fff700 1 -- 172.21.15.59:0/2423530580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106740 msgr2=0x7fca40106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.880+0000 7fca45fff700 1 --2- 172.21.15.59:0/2423530580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106740 0x7fca40106b20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fca30009990 tx=0x7fca30009ca0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.880+0000 7fca45fff700 1 -- 172.21.15.59:0/2423530580 shutdown_connections 2023-10-08T12:54:33.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.880+0000 7fca45fff700 1 --2- 172.21.15.59:0/2423530580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca401010f0 0x7fca4010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.880+0000 7fca45fff700 1 --2- 172.21.15.59:0/2423530580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106740 0x7fca40106b20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.880+0000 7fca45fff700 1 --2- 172.21.15.59:0/2423530580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca40100730 0x7fca40100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.880+0000 7fca45fff700 1 -- 172.21.15.59:0/2423530580 >> 172.21.15.59:0/2423530580 conn(0x7fca400fc200 msgr2=0x7fca400fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.880+0000 7fca45fff700 1 -- 172.21.15.59:0/2423530580 shutdown_connections 2023-10-08T12:54:33.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.880+0000 7fca45fff700 1 -- 172.21.15.59:0/2423530580 wait complete. 2023-10-08T12:54:33.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.881+0000 7fca45fff700 1 Processor -- start 2023-10-08T12:54:33.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.881+0000 7fca45fff700 1 -- start start 2023-10-08T12:54:33.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca45fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40100730 0x7fca40198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca45fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca401010f0 0x7fca40199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca45fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40106740 0x7fca4019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca45fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4019dce0 con 0x7fca40100730 2023-10-08T12:54:33.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca45fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4019de50 con 0x7fca401010f0 2023-10-08T12:54:33.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca45fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4019e010 con 0x7fca40106740 2023-10-08T12:54:33.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40100730 0x7fca40198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca401010f0 0x7fca40199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca401010f0 0x7fca40199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49586/0 (socket says 172.21.15.59:49586) 2023-10-08T12:54:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3effd700 1 -- 172.21.15.59:0/1584635206 learned_addr learned my addr 172.21.15.59:0/1584635206 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3ffff700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40106740 0x7fca4019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3effd700 1 -- 172.21.15.59:0/1584635206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40106740 msgr2=0x7fca4019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3effd700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40106740 0x7fca4019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3effd700 1 -- 172.21.15.59:0/1584635206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40100730 msgr2=0x7fca40198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3effd700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40100730 0x7fca40198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3effd700 1 -- 172.21.15.59:0/1584635206 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300095f0 con 0x7fca401010f0 2023-10-08T12:54:33.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3f7fe700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40100730 0x7fca40198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.882+0000 7fca3ffff700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40106740 0x7fca4019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:54:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.883+0000 7fca3effd700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca401010f0 0x7fca40199350 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fca3400e9a0 tx=0x7fca3400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.883+0000 7fca3cff9700 1 -- 172.21.15.59:0/1584635206 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34009790 con 0x7fca401010f0 2023-10-08T12:54:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.883+0000 7fca45fff700 1 -- 172.21.15.59:0/1584635206 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4019e2f0 con 0x7fca401010f0 2023-10-08T12:54:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.883+0000 7fca3cff9700 1 -- 172.21.15.59:0/1584635206 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca3400cbd0 con 0x7fca401010f0 2023-10-08T12:54:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.883+0000 7fca3cff9700 1 -- 172.21.15.59:0/1584635206 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34018680 con 0x7fca401010f0 2023-10-08T12:54:33.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.883+0000 7fca45fff700 1 -- 172.21.15.59:0/1584635206 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca401a5b30 con 0x7fca401010f0 2023-10-08T12:54:33.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.887+0000 7fca3cff9700 1 -- 172.21.15.59:0/1584635206 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fca3400cd40 con 0x7fca401010f0 2023-10-08T12:54:33.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.888+0000 7fca5989cb80 1 Processor -- start 2023-10-08T12:54:33.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.888+0000 7fca5989cb80 1 -- start start 2023-10-08T12:54:33.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.888+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d305260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.888+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d3057a0 0x55796d310110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d312a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca5989cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d26e460 con 0x55796d3057a0 2023-10-08T12:54:33.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca5989cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d25fc20 con 0x55796d310650 2023-10-08T12:54:33.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca5989cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d25d540 con 0x55796d304e80 2023-10-08T12:54:33.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca3effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d312a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca3effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d312a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49602/0 (socket says 172.21.15.59:49602) 2023-10-08T12:54:33.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca3effd700 1 -- 172.21.15.59:0/122590038 learned_addr learned my addr 172.21.15.59:0/122590038 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:33.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca3f7fe700 1 --2- 172.21.15.59:0/122590038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d3057a0 0x55796d310110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca3ffff700 1 --2- 172.21.15.59:0/122590038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d305260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca3effd700 1 -- 172.21.15.59:0/122590038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 msgr2=0x55796d305260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca3effd700 1 --2- 172.21.15.59:0/122590038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d305260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca3effd700 1 -- 172.21.15.59:0/122590038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d3057a0 msgr2=0x55796d310110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.889+0000 7fca3effd700 1 --2- 172.21.15.59:0/122590038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d3057a0 0x55796d310110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.890+0000 7fca3effd700 1 -- 172.21.15.59:0/122590038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55796d083de0 con 0x55796d310650 2023-10-08T12:54:33.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.890+0000 7fca3effd700 1 --2- 172.21.15.59:0/122590038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d312a40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fca340d5260 tx=0x7fca340d0f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19894eeea55240a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.890+0000 7fca3cff9700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca280a15f0 0x7fca280a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.890+0000 7fca25ffb700 1 -- 172.21.15.59:0/122590038 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca340966d0 con 0x55796d310650 2023-10-08T12:54:33.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.890+0000 7fca25ffb700 1 -- 172.21.15.59:0/122590038 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca34095fa0 con 0x55796d310650 2023-10-08T12:54:33.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.890+0000 7fca25ffb700 1 -- 172.21.15.59:0/122590038 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca340c5c30 con 0x55796d310650 2023-10-08T12:54:33.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.890+0000 7fca3cff9700 1 -- 172.21.15.59:0/1584635206 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fca34014070 con 0x7fca401010f0 2023-10-08T12:54:33.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.891+0000 7fca3ffff700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca280a15f0 0x7fca280a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.891+0000 7fca5989cb80 1 -- 172.21.15.59:0/122590038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 msgr2=0x55796d312a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.891+0000 7fca5989cb80 1 --2- 172.21.15.59:0/122590038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d312a40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fca340d5260 tx=0x7fca340d0f90 comp rx=0 tx=0).stop 2023-10-08T12:54:33.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.891+0000 7fca3ffff700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca280a15f0 0x7fca280a3ab0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fca38009fd0 tx=0x7fca38009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.891+0000 7fca5989cb80 1 -- 172.21.15.59:0/122590038 shutdown_connections 2023-10-08T12:54:33.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.891+0000 7fca5989cb80 1 --2- 172.21.15.59:0/122590038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d312a40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.891+0000 7fca5989cb80 1 --2- 172.21.15.59:0/122590038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d305260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.891+0000 7fca5989cb80 1 --2- 172.21.15.59:0/122590038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d3057a0 0x55796d310110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.891+0000 7fca5989cb80 1 -- 172.21.15.59:0/122590038 >> 172.21.15.59:0/122590038 conn(0x55796d27a260 msgr2=0x55796d3012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.891+0000 7fca5989cb80 1 -- 172.21.15.59:0/122590038 shutdown_connections 2023-10-08T12:54:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.891+0000 7fca5989cb80 1 -- 172.21.15.59:0/122590038 wait complete. 2023-10-08T12:54:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.892+0000 7fca5989cb80 1 -- start start 2023-10-08T12:54:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.892+0000 7fca5989cb80 1 Processor -- start 2023-10-08T12:54:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d310060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d3057a0 0x55796d30d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca5989cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d258e30 con 0x55796d3057a0 2023-10-08T12:54:33.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca5989cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d1f5710 con 0x55796d310650 2023-10-08T12:54:33.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca5989cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d1f53b0 con 0x55796d304e80 2023-10-08T12:54:33.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca5989cb80 10 client.0 _ll_register_callbacks cb 0x55796d052800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:33.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca3ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca3f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d310060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca3ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49612/0 (socket says 172.21.15.59:49612) 2023-10-08T12:54:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca3ffff700 1 -- 172.21.15.59:0/3017828803 learned_addr learned my addr 172.21.15.59:0/3017828803 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca3effd700 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d3057a0 0x55796d30d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca3ffff700 1 -- 172.21.15.59:0/3017828803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 msgr2=0x55796d310060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca3ffff700 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d310060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca3ffff700 1 -- 172.21.15.59:0/3017828803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d3057a0 msgr2=0x55796d30d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca3ffff700 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d3057a0 0x55796d30d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca3ffff700 1 -- 172.21.15.59:0/3017828803 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca401a5b30 con 0x55796d310650 2023-10-08T12:54:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.893+0000 7fca3f7fe700 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d310060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.894+0000 7fca3ffff700 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30d9f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fca38018040 tx=0x7fca3800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc0c67dbf4bf0bcc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.894+0000 7fca1effd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:54:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.894+0000 7fca1effd700 1 -- 172.21.15.59:0/3017828803 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800e050 con 0x55796d310650 2023-10-08T12:54:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.894+0000 7fca5989cb80 1 -- 172.21.15.59:0/3017828803 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55796d220eb0 con 0x55796d310650 2023-10-08T12:54:33.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.894+0000 7fca1effd700 1 -- 172.21.15.59:0/3017828803 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fca3801d050 con 0x55796d310650 2023-10-08T12:54:33.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.894+0000 7fca1effd700 1 -- 172.21.15.59:0/3017828803 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca38016e00 con 0x55796d310650 2023-10-08T12:54:33.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.894+0000 7fca5989cb80 10 client.27449 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:33.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.894+0000 7fca5989cb80 1 -- 172.21.15.59:0/3017828803 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55796d06cc60 con 0x55796d310650 2023-10-08T12:54:33.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.895+0000 7fca1effd700 1 -- 172.21.15.59:0/3017828803 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55796d220eb0 con 0x55796d310650 2023-10-08T12:54:33.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.895+0000 7fca1effd700 1 -- 172.21.15.59:0/3017828803 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fca38004240 con 0x55796d310650 2023-10-08T12:54:33.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.895+0000 7fca5989cb80 10 client.27449 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.895+0000 7fca5989cb80 10 client.27449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.895+0000 7fca5989cb80 20 client.27449 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.895+0000 7fca5989cb80 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55796d320230 0x55796d322650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.895+0000 7fca5989cb80 4 client.27449 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:54:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.895+0000 7fca5989cb80 1 -- 172.21.15.59:0/3017828803 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55796d251e10 con 0x55796d320230 2023-10-08T12:54:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.895+0000 7fca3f7fe700 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55796d320230 0x55796d322650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.896+0000 7fca3f7fe700 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55796d320230 0x55796d322650 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ad4720617c3bd8f server_cookie=baa3ae25b570959f in_seq=0 out_seq=0 2023-10-08T12:54:33.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.896+0000 7fca1effd700 10 client.27449 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:33.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.900+0000 7fca1effd700 1 -- 172.21.15.59:0/3017828803 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55796d251e10 con 0x55796d320230 2023-10-08T12:54:33.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.900+0000 7fca1effd700 10 client.27449 handle_command_reply: tid=0 2023-10-08T12:54:33.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.900+0000 7fca5989cb80 1 client.27449 shutdown 2023-10-08T12:54:33.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.900+0000 7fca5989cb80 1 -- 172.21.15.59:0/3017828803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 msgr2=0x55796d30d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.900+0000 7fca5989cb80 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30d9f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fca38018040 tx=0x7fca3800b040 comp rx=0 tx=0).stop 2023-10-08T12:54:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.901+0000 7fca5989cb80 1 -- 172.21.15.59:0/3017828803 shutdown_connections 2023-10-08T12:54:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.901+0000 7fca5989cb80 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55796d320230 0x55796d322650 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.901+0000 7fca5989cb80 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30d9f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.901+0000 7fca5989cb80 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d310060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.901+0000 7fca5989cb80 1 --2- 172.21.15.59:0/3017828803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d3057a0 0x55796d30d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.901+0000 7fca1effd700 0 client.27449 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:33.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.901+0000 7fca5989cb80 1 -- 172.21.15.59:0/3017828803 >> 172.21.15.59:0/3017828803 conn(0x55796d27a260 msgr2=0x55796d300ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.901+0000 7fca5989cb80 1 -- 172.21.15.59:0/3017828803 shutdown_connections 2023-10-08T12:54:33.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.901+0000 7fca5989cb80 1 -- 172.21.15.59:0/3017828803 wait complete. 2023-10-08T12:54:33.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.901+0000 7fca5989cb80 20 client.27449 trim_cache size 0 max 16384 2023-10-08T12:54:33.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.920+0000 7fca5989cb80 1 Processor -- start 2023-10-08T12:54:33.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.920+0000 7fca5989cb80 1 -- start start 2023-10-08T12:54:33.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.920+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d304e80 0x55796d3171a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.920+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d3057a0 0x55796d30bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.920+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.920+0000 7fca5989cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d0d9920 con 0x55796d304e80 2023-10-08T12:54:33.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.920+0000 7fca5989cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d300b50 con 0x55796d310650 2023-10-08T12:54:33.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.920+0000 7fca5989cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d251e40 con 0x55796d3057a0 2023-10-08T12:54:33.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.920+0000 7fca3ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.921+0000 7fca3ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49614/0 (socket says 172.21.15.59:49614) 2023-10-08T12:54:33.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.921+0000 7fca3f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d304e80 0x55796d3171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.921+0000 7fca3ffff700 1 -- 172.21.15.59:0/1629686143 learned_addr learned my addr 172.21.15.59:0/1629686143 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:33.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.921+0000 7fca3f7fe700 1 -- 172.21.15.59:0/1629686143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d3057a0 msgr2=0x55796d30bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.921+0000 7fca3f7fe700 1 --2- 172.21.15.59:0/1629686143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d3057a0 0x55796d30bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.921+0000 7fca3f7fe700 1 -- 172.21.15.59:0/1629686143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 msgr2=0x55796d30c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.921+0000 7fca3f7fe700 1 --2- 172.21.15.59:0/1629686143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.921+0000 7fca3f7fe700 1 -- 172.21.15.59:0/1629686143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55796d0aa250 con 0x55796d304e80 2023-10-08T12:54:33.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.921+0000 7fca3ffff700 1 --2- 172.21.15.59:0/1629686143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:33.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.921+0000 7fca3f7fe700 1 --2- 172.21.15.59:0/1629686143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d304e80 0x55796d3171a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fca3000b2e0 tx=0x7fca30005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ab851d96b5f98f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.922+0000 7fca267fc700 1 -- 172.21.15.59:0/1629686143 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3001d040 con 0x55796d304e80 2023-10-08T12:54:33.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.922+0000 7fca267fc700 1 -- 172.21.15.59:0/1629686143 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca3001e040 con 0x55796d304e80 2023-10-08T12:54:33.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.922+0000 7fca267fc700 1 -- 172.21.15.59:0/1629686143 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca300056c0 con 0x55796d304e80 2023-10-08T12:54:33.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.923+0000 7fca5989cb80 1 -- 172.21.15.59:0/1629686143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d304e80 msgr2=0x55796d3171a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.923+0000 7fca5989cb80 1 --2- 172.21.15.59:0/1629686143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d304e80 0x55796d3171a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fca3000b2e0 tx=0x7fca30005fd0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.923+0000 7fca5989cb80 1 -- 172.21.15.59:0/1629686143 shutdown_connections 2023-10-08T12:54:33.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.923+0000 7fca5989cb80 1 --2- 172.21.15.59:0/1629686143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d310650 0x55796d30c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.923+0000 7fca5989cb80 1 --2- 172.21.15.59:0/1629686143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d304e80 0x55796d3171a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.923+0000 7fca5989cb80 1 --2- 172.21.15.59:0/1629686143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d3057a0 0x55796d30bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.923+0000 7fca5989cb80 1 -- 172.21.15.59:0/1629686143 >> 172.21.15.59:0/1629686143 conn(0x55796d27a260 msgr2=0x55796d30fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.923+0000 7fca5989cb80 1 -- 172.21.15.59:0/1629686143 shutdown_connections 2023-10-08T12:54:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.923+0000 7fca5989cb80 1 -- 172.21.15.59:0/1629686143 wait complete. 2023-10-08T12:54:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.924+0000 7fca5989cb80 1 -- start start 2023-10-08T12:54:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.924+0000 7fca5989cb80 1 Processor -- start 2023-10-08T12:54:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d317140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d3057a0 0x55796d315530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca5989cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d310650 0x55796d315a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca5989cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d316130 con 0x55796d310650 2023-10-08T12:54:33.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca5989cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d3162a0 con 0x55796d3057a0 2023-10-08T12:54:33.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca5989cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796d374070 con 0x55796d304e80 2023-10-08T12:54:33.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca5989cb80 10 client.0 _ll_register_callbacks cb 0x7fca380167d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:33.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca3ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d310650 0x55796d315a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca3effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d3057a0 0x55796d315530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca3effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d3057a0 0x55796d315530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49616/0 (socket says 172.21.15.59:49616) 2023-10-08T12:54:33.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca3effd700 1 -- 172.21.15.59:0/1866289442 learned_addr learned my addr 172.21.15.59:0/1866289442 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:54:33.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca3ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d310650 0x55796d315a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59660/0 (socket says 172.21.15.59:59660) 2023-10-08T12:54:33.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca3f7fe700 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d317140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca3effd700 1 -- 172.21.15.59:0/1866289442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 msgr2=0x55796d317140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca3effd700 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d317140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca3effd700 1 -- 172.21.15.59:0/1866289442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d310650 msgr2=0x55796d315a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca3effd700 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d310650 0x55796d315a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.925+0000 7fca3effd700 1 -- 172.21.15.59:0/1866289442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55796d06cc60 con 0x55796d3057a0 2023-10-08T12:54:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.926+0000 7fca3effd700 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d3057a0 0x55796d315530 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fca34096e00 tx=0x7fca340cd4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=133ac6fca2d299d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.926+0000 7fca1effd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:54:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.926+0000 7fca1effd700 1 -- 172.21.15.59:0/1866289442 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca340d07a0 con 0x55796d3057a0 2023-10-08T12:54:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca1effd700 1 -- 172.21.15.59:0/1866289442 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fca3409aa90 con 0x55796d3057a0 2023-10-08T12:54:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca5989cb80 1 -- 172.21.15.59:0/1866289442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca34095fa0 con 0x55796d3057a0 2023-10-08T12:54:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca1effd700 1 -- 172.21.15.59:0/1866289442 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca340966d0 con 0x55796d3057a0 2023-10-08T12:54:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca5989cb80 10 client.27455 fetch_fsmap learned FSMap version 20 2023-10-08T12:54:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca5989cb80 1 -- 172.21.15.59:0/1866289442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fca4010df00 con 0x55796d3057a0 2023-10-08T12:54:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca1effd700 1 -- 172.21.15.59:0/1866289442 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca34095fa0 con 0x55796d3057a0 2023-10-08T12:54:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca1effd700 1 -- 172.21.15.59:0/1866289442 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fca3409e150 con 0x55796d3057a0 2023-10-08T12:54:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca5989cb80 10 client.27455 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:54:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca5989cb80 10 client.27455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca5989cb80 20 client.27455 populate_metadata read hostname 'smithi059' 2023-10-08T12:54:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca5989cb80 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55796d375460 0x55796d377880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca5989cb80 4 client.27455 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:54:33.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.927+0000 7fca5989cb80 1 -- 172.21.15.59:0/1866289442 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55796d251b30 con 0x55796d375460 2023-10-08T12:54:33.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.928+0000 7fca3f7fe700 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55796d375460 0x55796d377880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:33.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.928+0000 7fca3f7fe700 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55796d375460 0x55796d377880 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=982c9b1550433c5a server_cookie=7acf6e422563acf1 in_seq=0 out_seq=0 2023-10-08T12:54:33.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.928+0000 7fca1effd700 10 client.27455 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.931+0000 7fca1effd700 1 -- 172.21.15.59:0/1866289442 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55796d251b30 con 0x55796d375460 2023-10-08T12:54:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.931+0000 7fca1effd700 10 client.27455 handle_command_reply: tid=0 2023-10-08T12:54:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.931+0000 7fca5989cb80 1 client.27455 shutdown 2023-10-08T12:54:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.931+0000 7fca5989cb80 1 -- 172.21.15.59:0/1866289442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d3057a0 msgr2=0x55796d315530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.931+0000 7fca5989cb80 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d3057a0 0x55796d315530 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fca34096e00 tx=0x7fca340cd4b0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca5989cb80 1 -- 172.21.15.59:0/1866289442 shutdown_connections 2023-10-08T12:54:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca5989cb80 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55796d375460 0x55796d377880 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca5989cb80 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796d310650 0x55796d315a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca5989cb80 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55796d304e80 0x55796d317140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca1effd700 0 client.27455 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:54:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca5989cb80 1 --2- 172.21.15.59:0/1866289442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796d3057a0 0x55796d315530 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca5989cb80 1 -- 172.21.15.59:0/1866289442 >> 172.21.15.59:0/1866289442 conn(0x55796d27a260 msgr2=0x55796d30bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca5989cb80 1 -- 172.21.15.59:0/1866289442 shutdown_connections 2023-10-08T12:54:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca5989cb80 1 -- 172.21.15.59:0/1866289442 wait complete. 2023-10-08T12:54:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca5989cb80 20 client.27455 trim_cache size 0 max 16384 2023-10-08T12:54:33.938 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:54:33.938 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "scrub active (445 inodes in the stack)", 2023-10-08T12:54:33.938 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:54:33.938 INFO:teuthology.orchestra.run.smithi059.stdout: "4c999fe2-5e43-4a80-8b5c-3c8a3dc60e6a": { 2023-10-08T12:54:33.938 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:54:33.938 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "4c999fe2-5e43-4a80-8b5c-3c8a3dc60e6a", 2023-10-08T12:54:33.938 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:54:33.938 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:54:33.939 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:54:33.939 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:54:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca45fff700 1 -- 172.21.15.59:0/1584635206 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca280a15f0 msgr2=0x7fca280a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca45fff700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca280a15f0 0x7fca280a3ab0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fca38009fd0 tx=0x7fca38009040 comp rx=0 tx=0).stop 2023-10-08T12:54:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca45fff700 1 -- 172.21.15.59:0/1584635206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca401010f0 msgr2=0x7fca40199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.932+0000 7fca45fff700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca401010f0 0x7fca40199350 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fca3400e9a0 tx=0x7fca3400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.933+0000 7fca45fff700 1 -- 172.21.15.59:0/1584635206 shutdown_connections 2023-10-08T12:54:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.933+0000 7fca45fff700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fca280a15f0 0x7fca280a3ab0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.933+0000 7fca45fff700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40106740 0x7fca4019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.933+0000 7fca45fff700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40100730 0x7fca40198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.933+0000 7fca45fff700 1 --2- 172.21.15.59:0/1584635206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca401010f0 0x7fca40199350 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.933+0000 7fca45fff700 1 -- 172.21.15.59:0/1584635206 >> 172.21.15.59:0/1584635206 conn(0x7fca400fc200 msgr2=0x7fca400fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.933+0000 7fca45fff700 1 -- 172.21.15.59:0/1584635206 shutdown_connections 2023-10-08T12:54:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:54:33.933+0000 7fca45fff700 1 -- 172.21.15.59:0/1584635206 wait complete. 2023-10-08T12:54:33.941 INFO:tasks.workunit.client.0.smithi059.stdout: 10 2191 66.91 MB/sec warmup 4 sec latency 196.989 ms 2023-10-08T12:54:33.953 INFO:tasks.cephfs.filesystem:scrub status for tag:4c999fe2-5e43-4a80-8b5c-3c8a3dc60e6a - {'path': '/', 'tag': '4c999fe2-5e43-4a80-8b5c-3c8a3dc60e6a', 'options': 'recursive,force'} 2023-10-08T12:54:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:34 smithi092 ceph-mon[134093]: pgmap v729: 97 pgs: 97 active+clean; 586 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.3 MiB/s wr, 220 op/s 2023-10-08T12:54:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:34 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:54:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:34 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:34 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:54:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:34 smithi173 ceph-mon[135182]: pgmap v729: 97 pgs: 97 active+clean; 586 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.3 MiB/s wr, 220 op/s 2023-10-08T12:54:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:34 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:54:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:34 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:34 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:54:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:34 smithi059 ceph-mon[98489]: pgmap v729: 97 pgs: 97 active+clean; 586 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.3 MiB/s wr, 220 op/s 2023-10-08T12:54:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:34 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:54:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:34 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:34 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:54:34.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 2657 63.24 MB/sec warmup 5 sec latency 136.768 ms 2023-10-08T12:54:35.935 INFO:tasks.workunit.client.0.smithi059.stdout: 10 3222 58.98 MB/sec warmup 6 sec latency 79.083 ms 2023-10-08T12:54:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:36 smithi092 ceph-mon[134093]: pgmap v730: 97 pgs: 97 active+clean; 588 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 184 op/s 2023-10-08T12:54:36.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:36 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:36.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:36 smithi173 ceph-mon[135182]: pgmap v730: 97 pgs: 97 active+clean; 588 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 184 op/s 2023-10-08T12:54:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:36 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:36.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:36 smithi059 ceph-mon[98489]: pgmap v730: 97 pgs: 97 active+clean; 588 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 184 op/s 2023-10-08T12:54:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:36 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:54:36.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 3589 54.85 MB/sec warmup 7 sec latency 147.832 ms 2023-10-08T12:54:37.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 3726 48.35 MB/sec warmup 8 sec latency 241.198 ms 2023-10-08T12:54:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:38 smithi092 ceph-mon[134093]: pgmap v731: 97 pgs: 97 active+clean; 602 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 286 op/s 2023-10-08T12:54:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:38 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:54:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:38 smithi173 ceph-mon[135182]: pgmap v731: 97 pgs: 97 active+clean; 602 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 286 op/s 2023-10-08T12:54:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:38 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:54:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:38 smithi059 ceph-mon[98489]: pgmap v731: 97 pgs: 97 active+clean; 602 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 286 op/s 2023-10-08T12:54:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:38 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:54:38.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 3945 43.12 MB/sec warmup 9 sec latency 201.192 ms 2023-10-08T12:54:39.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 4327 39.73 MB/sec warmup 10 sec latency 219.659 ms 2023-10-08T12:54:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:39 smithi173 ceph-mon[135182]: pgmap v732: 97 pgs: 97 active+clean; 609 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 284 op/s 2023-10-08T12:54:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:39 smithi059 ceph-mon[98489]: pgmap v732: 97 pgs: 97 active+clean; 609 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 284 op/s 2023-10-08T12:54:40.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:39 smithi092 ceph-mon[134093]: pgmap v732: 97 pgs: 97 active+clean; 609 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 284 op/s 2023-10-08T12:54:40.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 4981 39.73 MB/sec warmup 11 sec latency 152.865 ms 2023-10-08T12:54:41.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 5795 38.97 MB/sec warmup 12 sec latency 37.077 ms 2023-10-08T12:54:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:42 smithi092 ceph-mon[134093]: pgmap v733: 97 pgs: 97 active+clean; 611 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 271 op/s 2023-10-08T12:54:42.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:42 smithi173 ceph-mon[135182]: pgmap v733: 97 pgs: 97 active+clean; 611 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 271 op/s 2023-10-08T12:54:42.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:42 smithi059 ceph-mon[98489]: pgmap v733: 97 pgs: 97 active+clean; 611 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 271 op/s 2023-10-08T12:54:42.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 6364 40.19 MB/sec warmup 13 sec latency 150.806 ms 2023-10-08T12:54:43.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 6865 40.05 MB/sec warmup 14 sec latency 162.392 ms 2023-10-08T12:54:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:44 smithi092 ceph-mon[134093]: pgmap v734: 97 pgs: 97 active+clean; 624 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 325 op/s 2023-10-08T12:54:44.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:44 smithi173 ceph-mon[135182]: pgmap v734: 97 pgs: 97 active+clean; 624 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 325 op/s 2023-10-08T12:54:44.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:44 smithi059 ceph-mon[98489]: pgmap v734: 97 pgs: 97 active+clean; 624 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 325 op/s 2023-10-08T12:54:44.938 INFO:tasks.workunit.client.0.smithi059.stdout: 10 7078 38.04 MB/sec warmup 15 sec latency 165.668 ms 2023-10-08T12:54:45.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 7241 35.80 MB/sec warmup 16 sec latency 92.803 ms 2023-10-08T12:54:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:46 smithi092 ceph-mon[134093]: pgmap v735: 97 pgs: 97 active+clean; 629 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.9 MiB/s wr, 341 op/s 2023-10-08T12:54:46.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:46 smithi173 ceph-mon[135182]: pgmap v735: 97 pgs: 97 active+clean; 629 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.9 MiB/s wr, 341 op/s 2023-10-08T12:54:46.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:46 smithi059 ceph-mon[98489]: pgmap v735: 97 pgs: 97 active+clean; 629 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.9 MiB/s wr, 341 op/s 2023-10-08T12:54:46.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 7540 34.01 MB/sec warmup 17 sec latency 195.053 ms 2023-10-08T12:54:47.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 7917 33.20 MB/sec warmup 18 sec latency 186.902 ms 2023-10-08T12:54:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:48 smithi092 ceph-mon[134093]: pgmap v736: 97 pgs: 97 active+clean; 630 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 354 op/s 2023-10-08T12:54:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:48 smithi173 ceph-mon[135182]: pgmap v736: 97 pgs: 97 active+clean; 630 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 354 op/s 2023-10-08T12:54:48.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:48 smithi059 ceph-mon[98489]: pgmap v736: 97 pgs: 97 active+clean; 630 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 354 op/s 2023-10-08T12:54:48.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 8424 32.78 MB/sec warmup 19 sec latency 215.359 ms 2023-10-08T12:54:49.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 9182 32.70 MB/sec warmup 20 sec latency 156.588 ms 2023-10-08T12:54:50.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:49 smithi173 ceph-mon[135182]: pgmap v737: 97 pgs: 97 active+clean; 639 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 269 op/s 2023-10-08T12:54:50.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:49 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:54:50.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:49 smithi059 ceph-mon[98489]: pgmap v737: 97 pgs: 97 active+clean; 639 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 269 op/s 2023-10-08T12:54:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:49 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:54:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:49 smithi092 ceph-mon[134093]: pgmap v737: 97 pgs: 97 active+clean; 639 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 269 op/s 2023-10-08T12:54:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:49 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:54:50.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 9766 33.63 MB/sec warmup 21 sec latency 156.944 ms 2023-10-08T12:54:51.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:50 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:54:51.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:50 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:54:51.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:50 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:54:51.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:50 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:54:51.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:50 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:54:51.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:50 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:54:51.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:50 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:54:51.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:50 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:54:51.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:50 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:54:51.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 10248 33.71 MB/sec warmup 22 sec latency 151.502 ms 2023-10-08T12:54:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:51 smithi173 ceph-mon[135182]: pgmap v738: 97 pgs: 97 active+clean; 645 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 288 op/s 2023-10-08T12:54:52.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:51 smithi059 ceph-mon[98489]: pgmap v738: 97 pgs: 97 active+clean; 645 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 288 op/s 2023-10-08T12:54:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:51 smithi092 ceph-mon[134093]: pgmap v738: 97 pgs: 97 active+clean; 645 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 288 op/s 2023-10-08T12:54:52.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 10466 32.57 MB/sec warmup 23 sec latency 179.119 ms 2023-10-08T12:54:53.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 10662 31.36 MB/sec warmup 24 sec latency 167.517 ms 2023-10-08T12:54:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:54 smithi092 ceph-mon[134093]: pgmap v739: 97 pgs: 97 active+clean; 653 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.9 MiB/s wr, 324 op/s 2023-10-08T12:54:54.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:54 smithi173 ceph-mon[135182]: pgmap v739: 97 pgs: 97 active+clean; 653 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.9 MiB/s wr, 324 op/s 2023-10-08T12:54:54.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:54 smithi059 ceph-mon[98489]: pgmap v739: 97 pgs: 97 active+clean; 653 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.9 MiB/s wr, 324 op/s 2023-10-08T12:54:54.936 INFO:tasks.workunit.client.0.smithi059.stdout: 10 10942 30.45 MB/sec warmup 25 sec latency 159.927 ms 2023-10-08T12:54:55.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 11465 30.41 MB/sec warmup 26 sec latency 136.316 ms 2023-10-08T12:54:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:56 smithi092 ceph-mon[134093]: pgmap v740: 97 pgs: 97 active+clean; 645 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 274 op/s 2023-10-08T12:54:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:56 smithi173 ceph-mon[135182]: pgmap v740: 97 pgs: 97 active+clean; 645 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 274 op/s 2023-10-08T12:54:56.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:56 smithi059 ceph-mon[98489]: pgmap v740: 97 pgs: 97 active+clean; 645 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 274 op/s 2023-10-08T12:54:56.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 12235 30.38 MB/sec warmup 27 sec latency 184.965 ms 2023-10-08T12:54:57.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 12630 30.02 MB/sec warmup 28 sec latency 304.540 ms 2023-10-08T12:54:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:58 smithi092 ceph-mon[134093]: pgmap v741: 97 pgs: 97 active+clean; 617 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 261 op/s 2023-10-08T12:54:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:58 smithi173 ceph-mon[135182]: pgmap v741: 97 pgs: 97 active+clean; 617 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 261 op/s 2023-10-08T12:54:58.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:58 smithi059 ceph-mon[98489]: pgmap v741: 97 pgs: 97 active+clean; 617 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 261 op/s 2023-10-08T12:54:58.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 13086 30.34 MB/sec warmup 29 sec latency 413.150 ms 2023-10-08T12:54:59.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 13627 30.72 MB/sec warmup 30 sec latency 43.422 ms 2023-10-08T12:55:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:54:59 smithi173 ceph-mon[135182]: pgmap v742: 97 pgs: 97 active+clean; 587 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 300 op/s 2023-10-08T12:55:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:54:59 smithi059 ceph-mon[98489]: pgmap v742: 97 pgs: 97 active+clean; 587 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 300 op/s 2023-10-08T12:55:00.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:54:59 smithi092 ceph-mon[134093]: pgmap v742: 97 pgs: 97 active+clean; 587 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 300 op/s 2023-10-08T12:55:00.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 13859 30.13 MB/sec warmup 31 sec latency 138.486 ms 2023-10-08T12:55:01.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 14067 29.33 MB/sec warmup 32 sec latency 144.238 ms 2023-10-08T12:55:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:02 smithi092 ceph-mon[134093]: pgmap v743: 97 pgs: 97 active+clean; 624 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.8 MiB/s wr, 334 op/s 2023-10-08T12:55:02.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:02 smithi173 ceph-mon[135182]: pgmap v743: 97 pgs: 97 active+clean; 624 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.8 MiB/s wr, 334 op/s 2023-10-08T12:55:02.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:02 smithi059 ceph-mon[98489]: pgmap v743: 97 pgs: 97 active+clean; 624 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.8 MiB/s wr, 334 op/s 2023-10-08T12:55:02.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 14313 28.67 MB/sec warmup 33 sec latency 213.829 ms 2023-10-08T12:55:03.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 14331 27.90 MB/sec warmup 34 sec latency 860.515 ms 2023-10-08T12:55:03.954 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:55:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.168+0000 7ff8483ff700 1 -- 172.21.15.59:0/2127882410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840106740 msgr2=0x7ff840106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.168+0000 7ff8483ff700 1 --2- 172.21.15.59:0/2127882410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840106740 0x7ff840106b20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009990 tx=0x7ff83c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.168+0000 7ff8483ff700 1 -- 172.21.15.59:0/2127882410 shutdown_connections 2023-10-08T12:55:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.168+0000 7ff8483ff700 1 --2- 172.21.15.59:0/2127882410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840106740 0x7ff840106b20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.168+0000 7ff8483ff700 1 --2- 172.21.15.59:0/2127882410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8401010f0 0x7ff84010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.168+0000 7ff8483ff700 1 --2- 172.21.15.59:0/2127882410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff840100730 0x7ff840100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.168+0000 7ff8483ff700 1 -- 172.21.15.59:0/2127882410 >> 172.21.15.59:0/2127882410 conn(0x7ff8400fc200 msgr2=0x7ff8400fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:04.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.169+0000 7ff8483ff700 1 -- 172.21.15.59:0/2127882410 shutdown_connections 2023-10-08T12:55:04.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.169+0000 7ff8483ff700 1 -- 172.21.15.59:0/2127882410 wait complete. 2023-10-08T12:55:04.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.170+0000 7ff8483ff700 1 Processor -- start 2023-10-08T12:55:04.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.170+0000 7ff8483ff700 1 -- start start 2023-10-08T12:55:04.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.170+0000 7ff8483ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff840100730 0x7ff84019c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.170+0000 7ff8483ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8401010f0 0x7ff84019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.170+0000 7ff8483ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840106740 0x7ff840196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.170+0000 7ff8483ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff840197060 con 0x7ff840100730 2023-10-08T12:55:04.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.170+0000 7ff8483ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401971d0 con 0x7ff840106740 2023-10-08T12:55:04.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.170+0000 7ff8483ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff840197390 con 0x7ff8401010f0 2023-10-08T12:55:04.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.170+0000 7ff84619b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff840100730 0x7ff84019c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.170+0000 7ff84619b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff840100730 0x7ff84019c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42500/0 (socket says 172.21.15.59:42500) 2023-10-08T12:55:04.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff84619b700 1 -- 172.21.15.59:0/3835355181 learned_addr learned my addr 172.21.15.59:0/3835355181 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:04.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff84699c700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840106740 0x7ff840196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff84599a700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8401010f0 0x7ff84019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff84619b700 1 -- 172.21.15.59:0/3835355181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8401010f0 msgr2=0x7ff84019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff84619b700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8401010f0 0x7ff84019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff84619b700 1 -- 172.21.15.59:0/3835355181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840106740 msgr2=0x7ff840196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff84619b700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840106740 0x7ff840196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff84619b700 1 -- 172.21.15.59:0/3835355181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff838009c40 con 0x7ff840100730 2023-10-08T12:55:04.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff84699c700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840106740 0x7ff840196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:04.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff84619b700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff840100730 0x7ff84019c8d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff83c005910 tx=0x7ff83c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:04.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff8377fe700 1 -- 172.21.15.59:0/3835355181 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c01d070 con 0x7ff840100730 2023-10-08T12:55:04.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff8377fe700 1 -- 172.21.15.59:0/3835355181 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff83c022470 con 0x7ff840100730 2023-10-08T12:55:04.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff8483ff700 1 -- 172.21.15.59:0/3835355181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c0095f0 con 0x7ff840100730 2023-10-08T12:55:04.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.171+0000 7ff8377fe700 1 -- 172.21.15.59:0/3835355181 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c017650 con 0x7ff840100730 2023-10-08T12:55:04.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.172+0000 7ff8483ff700 1 -- 172.21.15.59:0/3835355181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8401a36e0 con 0x7ff840100730 2023-10-08T12:55:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.176+0000 7ff8377fe700 1 -- 172.21.15.59:0/3835355181 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff83c0225e0 con 0x7ff840100730 2023-10-08T12:55:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.177+0000 7ff85bd8bb80 1 Processor -- start 2023-10-08T12:55:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.177+0000 7ff85bd8bb80 1 -- start start 2023-10-08T12:55:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.177+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0d6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.177+0000 7ff8377fe700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff82c0a15f0 0x7ff82c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.177+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d67a0 0x55b47a0e1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.177+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.177+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47a03f460 con 0x55b47a0d67a0 2023-10-08T12:55:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.177+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47a030c20 con 0x55b47a0d5e80 2023-10-08T12:55:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.177+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47a02e540 con 0x55b47a0e1650 2023-10-08T12:55:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff8377fe700 1 -- 172.21.15.59:0/3835355181 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7ff83c0ce1e0 con 0x7ff840100730 2023-10-08T12:55:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84699c700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff82c0a15f0 0x7ff82c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84619b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0d6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84619b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0d6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50118/0 (socket says 172.21.15.59:50118) 2023-10-08T12:55:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84619b700 1 -- 172.21.15.59:0/2780529280 learned_addr learned my addr 172.21.15.59:0/2780529280 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84599a700 1 --2- 172.21.15.59:0/2780529280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d67a0 0x55b47a0e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84699c700 1 --2- 172.21.15.59:0/2780529280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84619b700 1 -- 172.21.15.59:0/2780529280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 msgr2=0x55b47a0e3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84619b700 1 --2- 172.21.15.59:0/2780529280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84619b700 1 -- 172.21.15.59:0/2780529280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d67a0 msgr2=0x55b47a0e1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84619b700 1 --2- 172.21.15.59:0/2780529280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d67a0 0x55b47a0e1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84619b700 1 -- 172.21.15.59:0/2780529280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b479e54de0 con 0x55b47a0d5e80 2023-10-08T12:55:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84699c700 1 --2- 172.21.15.59:0/2780529280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:55:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84599a700 1 --2- 172.21.15.59:0/2780529280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d67a0 0x55b47a0e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84619b700 1 --2- 172.21.15.59:0/2780529280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0d6260 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff83c000c00 tx=0x7ff83c0975b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d537719c012d164a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.178+0000 7ff84699c700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff82c0a15f0 0x7ff82c0a3ab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff838009fd0 tx=0x7ff838009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff834bfe700 1 -- 172.21.15.59:0/2780529280 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c09abd0 con 0x55b47a0d5e80 2023-10-08T12:55:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff834bfe700 1 -- 172.21.15.59:0/2780529280 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff83c09c3a0 con 0x55b47a0d5e80 2023-10-08T12:55:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff834bfe700 1 -- 172.21.15.59:0/2780529280 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c09c630 con 0x55b47a0d5e80 2023-10-08T12:55:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/2780529280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 msgr2=0x55b47a0d6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/2780529280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0d6260 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff83c000c00 tx=0x7ff83c0975b0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/2780529280 shutdown_connections 2023-10-08T12:55:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/2780529280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0d6260 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/2780529280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/2780529280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d67a0 0x55b47a0e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/2780529280 >> 172.21.15.59:0/2780529280 conn(0x55b47a04b260 msgr2=0x55b47a0d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/2780529280 shutdown_connections 2023-10-08T12:55:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.179+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/2780529280 wait complete. 2023-10-08T12:55:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.180+0000 7ff85bd8bb80 1 -- start start 2023-10-08T12:55:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.180+0000 7ff85bd8bb80 1 Processor -- start 2023-10-08T12:55:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.181+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.181+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d67a0 0x55b47a0e1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.181+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.181+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47a029e30 con 0x55b47a0d67a0 2023-10-08T12:55:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.181+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b479fc6710 con 0x55b47a0d5e80 2023-10-08T12:55:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.181+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b479fc63b0 con 0x55b47a0e1650 2023-10-08T12:55:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.181+0000 7ff85bd8bb80 10 client.0 _ll_register_callbacks cb 0x55b479e23800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.181+0000 7ff84619b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.181+0000 7ff84619b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50120/0 (socket says 172.21.15.59:50120) 2023-10-08T12:55:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.181+0000 7ff84619b700 1 -- 172.21.15.59:0/376808684 learned_addr learned my addr 172.21.15.59:0/376808684 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:04.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.181+0000 7ff84599a700 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d67a0 0x55b47a0e1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.182+0000 7ff84699c700 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.182+0000 7ff84619b700 1 -- 172.21.15.59:0/376808684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 msgr2=0x55b47a0e24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:04.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.182+0000 7ff84619b700 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.182+0000 7ff84619b700 1 -- 172.21.15.59:0/376808684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d67a0 msgr2=0x55b47a0e1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:04.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.182+0000 7ff84619b700 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d67a0 0x55b47a0e1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.182+0000 7ff84619b700 1 -- 172.21.15.59:0/376808684 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8401a36e0 con 0x55b47a0d5e80 2023-10-08T12:55:04.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.182+0000 7ff84619b700 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e1a30 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff83c097770 tx=0x7ff83c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be896ba6e5d263e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.182+0000 7ff829ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.182+0000 7ff829ffb700 1 -- 172.21.15.59:0/376808684 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c09b270 con 0x55b47a0d5e80 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.182+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/376808684 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b479ff1eb0 con 0x55b47a0d5e80 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.182+0000 7ff829ffb700 1 -- 172.21.15.59:0/376808684 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7ff83c09b970 con 0x55b47a0d5e80 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff829ffb700 1 -- 172.21.15.59:0/376808684 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff83c09f3c0 con 0x55b47a0d5e80 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff85bd8bb80 10 client.27467 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/376808684 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b479e3dc60 con 0x55b47a0d5e80 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff829ffb700 1 -- 172.21.15.59:0/376808684 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff83c0b7080 con 0x55b47a0d5e80 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff829ffb700 1 -- 172.21.15.59:0/376808684 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff83c09a7f0 con 0x55b47a0d5e80 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff85bd8bb80 10 client.27467 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff85bd8bb80 10 client.27467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:04.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff85bd8bb80 20 client.27467 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b47a0f0890 0x55b47a0f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff85bd8bb80 4 client.27467 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:55:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/376808684 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b47a022e10 con 0x55b47a0f0890 2023-10-08T12:55:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.183+0000 7ff84599a700 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b47a0f0890 0x55b47a0f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.184+0000 7ff84599a700 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b47a0f0890 0x55b47a0f2c80 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4574c6eb558d0ec5 server_cookie=c809a191c079863c in_seq=0 out_seq=0 2023-10-08T12:55:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.184+0000 7ff829ffb700 10 client.27467 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:04.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.186+0000 7ff829ffb700 1 -- 172.21.15.59:0/376808684 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b47a022e10 con 0x55b47a0f0890 2023-10-08T12:55:04.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.186+0000 7ff829ffb700 10 client.27467 handle_command_reply: tid=0 2023-10-08T12:55:04.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.186+0000 7ff85bd8bb80 1 client.27467 shutdown 2023-10-08T12:55:04.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/376808684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 msgr2=0x55b47a0e1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e1a30 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff83c097770 tx=0x7ff83c009310 comp rx=0 tx=0).stop 2023-10-08T12:55:04.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/376808684 shutdown_connections 2023-10-08T12:55:04.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b47a0f0890 0x55b47a0f2c80 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e1a30 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff829ffb700 0 client.27467 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:04.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/376808684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d67a0 0x55b47a0e1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/376808684 >> 172.21.15.59:0/376808684 conn(0x55b47a04b260 msgr2=0x55b47a0d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/376808684 shutdown_connections 2023-10-08T12:55:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/376808684 wait complete. 2023-10-08T12:55:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.187+0000 7ff85bd8bb80 20 client.27467 trim_cache size 0 max 16384 2023-10-08T12:55:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.206+0000 7ff85bd8bb80 1 Processor -- start 2023-10-08T12:55:04.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.206+0000 7ff85bd8bb80 1 -- start start 2023-10-08T12:55:04.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.206+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.206+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0d67a0 0x55b47a0daf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.206+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0e1650 0x55b47a0dba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.206+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b479eaa920 con 0x55b47a0e1650 2023-10-08T12:55:04.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.206+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47a0ecb50 con 0x55b47a0d5e80 2023-10-08T12:55:04.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.206+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47a0ed900 con 0x55b47a0d67a0 2023-10-08T12:55:04.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.206+0000 7ff84619b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84619b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50132/0 (socket says 172.21.15.59:50132) 2023-10-08T12:55:04.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84619b700 1 -- 172.21.15.59:0/3628909142 learned_addr learned my addr 172.21.15.59:0/3628909142 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:04.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84699c700 1 --2- 172.21.15.59:0/3628909142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0e1650 0x55b47a0dba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84599a700 1 --2- 172.21.15.59:0/3628909142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0d67a0 0x55b47a0daf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84619b700 1 -- 172.21.15.59:0/3628909142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0d67a0 msgr2=0x55b47a0daf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:04.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84619b700 1 --2- 172.21.15.59:0/3628909142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0d67a0 0x55b47a0daf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84619b700 1 -- 172.21.15.59:0/3628909142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0e1650 msgr2=0x55b47a0dba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:04.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84619b700 1 --2- 172.21.15.59:0/3628909142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0e1650 0x55b47a0dba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84619b700 1 -- 172.21.15.59:0/3628909142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b479e7b250 con 0x55b47a0d5e80 2023-10-08T12:55:04.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84599a700 1 --2- 172.21.15.59:0/3628909142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0d67a0 0x55b47a0daf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:04.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84699c700 1 --2- 172.21.15.59:0/3628909142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0e1650 0x55b47a0dba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:04.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff84619b700 1 --2- 172.21.15.59:0/3628909142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e6a70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff83c000c00 tx=0x7ff83c099820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4c5ff3c32dad5ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:04.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff8353ff700 1 -- 172.21.15.59:0/3628909142 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c09b970 con 0x55b47a0d5e80 2023-10-08T12:55:04.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff8353ff700 1 -- 172.21.15.59:0/3628909142 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b479ff1eb0 con 0x55b47a0d5e80 2023-10-08T12:55:04.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.207+0000 7ff8353ff700 1 -- 172.21.15.59:0/3628909142 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0229f0 con 0x55b47a0d5e80 2023-10-08T12:55:04.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.208+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/3628909142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 msgr2=0x55b47a0e6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.208+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/3628909142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e6a70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff83c000c00 tx=0x7ff83c099820 comp rx=0 tx=0).stop 2023-10-08T12:55:04.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.208+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/3628909142 shutdown_connections 2023-10-08T12:55:04.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.208+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/3628909142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d5e80 0x55b47a0e6a70 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.208+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/3628909142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0e1650 0x55b47a0dba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.208+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/3628909142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0d67a0 0x55b47a0daf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.208+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/3628909142 >> 172.21.15.59:0/3628909142 conn(0x55b47a04b260 msgr2=0x55b47a0e0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.208+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/3628909142 shutdown_connections 2023-10-08T12:55:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.208+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/3628909142 wait complete. 2023-10-08T12:55:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.209+0000 7ff85bd8bb80 1 -- start start 2023-10-08T12:55:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.209+0000 7ff85bd8bb80 1 Processor -- start 2023-10-08T12:55:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d5e80 0x55b47a0e5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d67a0 0x55b47a0e56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff85bd8bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47a148a70 con 0x55b47a0d5e80 2023-10-08T12:55:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47a148bb0 con 0x55b47a0d67a0 2023-10-08T12:55:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff85bd8bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47a148cf0 con 0x55b47a0e1650 2023-10-08T12:55:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff85bd8bb80 10 client.0 _ll_register_callbacks cb 0x7ff83c096e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff84599a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d67a0 0x55b47a0e56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff84619b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d5e80 0x55b47a0e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff84599a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d67a0 0x55b47a0e56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50142/0 (socket says 172.21.15.59:50142) 2023-10-08T12:55:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff84599a700 1 -- 172.21.15.59:0/837835848 learned_addr learned my addr 172.21.15.59:0/837835848 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff84699c700 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff84599a700 1 -- 172.21.15.59:0/837835848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 msgr2=0x55b47a0e5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff84599a700 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff84599a700 1 -- 172.21.15.59:0/837835848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d5e80 msgr2=0x55b47a0e5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff84599a700 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d5e80 0x55b47a0e5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.210+0000 7ff84599a700 1 -- 172.21.15.59:0/837835848 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b479e3dc60 con 0x55b47a0d67a0 2023-10-08T12:55:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.211+0000 7ff84599a700 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d67a0 0x55b47a0e56c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff830004790 tx=0x7ff83001fcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=440372236c68337a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.211+0000 7ff829ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:55:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.211+0000 7ff829ffb700 1 -- 172.21.15.59:0/837835848 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830017040 con 0x55b47a0d67a0 2023-10-08T12:55:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.211+0000 7ff829ffb700 1 -- 172.21.15.59:0/837835848 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7ff830004260 con 0x55b47a0d67a0 2023-10-08T12:55:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.211+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/837835848 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff83c09c3a0 con 0x55b47a0d67a0 2023-10-08T12:55:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.211+0000 7ff829ffb700 1 -- 172.21.15.59:0/837835848 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff830004420 con 0x55b47a0d67a0 2023-10-08T12:55:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.211+0000 7ff85bd8bb80 10 client.27473 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.211+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/837835848 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55b479e532b0 con 0x55b47a0d67a0 2023-10-08T12:55:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.211+0000 7ff829ffb700 1 -- 172.21.15.59:0/837835848 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff83c09c3a0 con 0x55b47a0d67a0 2023-10-08T12:55:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.212+0000 7ff829ffb700 1 -- 172.21.15.59:0/837835848 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff830010810 con 0x55b47a0d67a0 2023-10-08T12:55:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.212+0000 7ff85bd8bb80 10 client.27473 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.212+0000 7ff85bd8bb80 10 client.27473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.212+0000 7ff85bd8bb80 20 client.27473 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.212+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b47a14a600 0x55b47a14ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.212+0000 7ff85bd8bb80 4 client.27473 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:55:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.212+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/837835848 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b47a022b30 con 0x55b47a14a600 2023-10-08T12:55:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.212+0000 7ff84619b700 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b47a14a600 0x55b47a14ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.212+0000 7ff84619b700 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b47a14a600 0x55b47a14ca20 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a326ac90737e87d0 server_cookie=5276dba728c34e75 in_seq=0 out_seq=0 2023-10-08T12:55:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.212+0000 7ff829ffb700 10 client.27473 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff829ffb700 1 -- 172.21.15.59:0/837835848 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b47a022b30 con 0x55b47a14a600 2023-10-08T12:55:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff829ffb700 10 client.27473 handle_command_reply: tid=0 2023-10-08T12:55:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff85bd8bb80 1 client.27473 shutdown 2023-10-08T12:55:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/837835848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d67a0 msgr2=0x55b47a0e56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d67a0 0x55b47a0e56c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff830004790 tx=0x7ff83001fcd0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/837835848 shutdown_connections 2023-10-08T12:55:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55b47a14a600 0x55b47a14ca20 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b47a0e1650 0x55b47a0e5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b47a0d5e80 0x55b47a0e5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff85bd8bb80 1 --2- 172.21.15.59:0/837835848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b47a0d67a0 0x55b47a0e56c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff829ffb700 0 client.27473 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/837835848 >> 172.21.15.59:0/837835848 conn(0x55b47a04b260 msgr2=0x55b47a0daec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.214+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/837835848 shutdown_connections 2023-10-08T12:55:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff85bd8bb80 1 -- 172.21.15.59:0/837835848 wait complete. 2023-10-08T12:55:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff85bd8bb80 20 client.27473 trim_cache size 0 max 16384 2023-10-08T12:55:04.225 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:55:04.225 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:55:04.225 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:55:04.225 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:55:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff8483ff700 1 -- 172.21.15.59:0/3835355181 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff82c0a15f0 msgr2=0x7ff82c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff8483ff700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff82c0a15f0 0x7ff82c0a3ab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff838009fd0 tx=0x7ff838009920 comp rx=0 tx=0).stop 2023-10-08T12:55:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff8483ff700 1 -- 172.21.15.59:0/3835355181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff840100730 msgr2=0x7ff84019c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff8483ff700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff840100730 0x7ff84019c8d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff83c005910 tx=0x7ff83c004730 comp rx=0 tx=0).stop 2023-10-08T12:55:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff8483ff700 1 -- 172.21.15.59:0/3835355181 shutdown_connections 2023-10-08T12:55:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff8483ff700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff82c0a15f0 0x7ff82c0a3ab0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff8483ff700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840106740 0x7ff840196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff8483ff700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff840100730 0x7ff84019c8d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff8483ff700 1 --2- 172.21.15.59:0/3835355181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8401010f0 0x7ff84019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.215+0000 7ff8483ff700 1 -- 172.21.15.59:0/3835355181 >> 172.21.15.59:0/3835355181 conn(0x7ff8400fc200 msgr2=0x7ff8400fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:04.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.216+0000 7ff8483ff700 1 -- 172.21.15.59:0/3835355181 shutdown_connections 2023-10-08T12:55:04.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.216+0000 7ff8483ff700 1 -- 172.21.15.59:0/3835355181 wait complete. 2023-10-08T12:55:04.235 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:55:04.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:55:04.297 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:04 smithi059 ceph-mon[98489]: pgmap v744: 97 pgs: 97 active+clean; 654 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 368 op/s 2023-10-08T12:55:04.297 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:04 smithi059 ceph-mon[98489]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T12:55:04.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:04 smithi092 ceph-mon[134093]: pgmap v744: 97 pgs: 97 active+clean; 654 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 368 op/s 2023-10-08T12:55:04.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:04 smithi092 ceph-mon[134093]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T12:55:04.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.461+0000 7fc9183ff700 1 -- 172.21.15.59:0/952129657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc910100ff0 msgr2=0x7fc91010d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.461+0000 7fc9183ff700 1 --2- 172.21.15.59:0/952129657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc910100ff0 0x7fc91010d500 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc908009f90 tx=0x7fc90800b330 comp rx=0 tx=0).stop 2023-10-08T12:55:04.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.461+0000 7fc9183ff700 1 -- 172.21.15.59:0/952129657 shutdown_connections 2023-10-08T12:55:04.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.461+0000 7fc9183ff700 1 --2- 172.21.15.59:0/952129657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc910106640 0x7fc910106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.461+0000 7fc9183ff700 1 --2- 172.21.15.59:0/952129657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc910100ff0 0x7fc91010d500 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.461+0000 7fc9183ff700 1 --2- 172.21.15.59:0/952129657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc910100630 0x7fc910100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.461+0000 7fc9183ff700 1 -- 172.21.15.59:0/952129657 >> 172.21.15.59:0/952129657 conn(0x7fc9100fc140 msgr2=0x7fc9100fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.461+0000 7fc9183ff700 1 -- 172.21.15.59:0/952129657 shutdown_connections 2023-10-08T12:55:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.461+0000 7fc9183ff700 1 -- 172.21.15.59:0/952129657 wait complete. 2023-10-08T12:55:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.462+0000 7fc9183ff700 1 Processor -- start 2023-10-08T12:55:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc9183ff700 1 -- start start 2023-10-08T12:55:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc9183ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc910100630 0x7fc91019e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc9183ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc910100ff0 0x7fc91019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc9183ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc910106640 0x7fc910198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc9183ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc910199150 con 0x7fc910106640 2023-10-08T12:55:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc9183ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9101992c0 con 0x7fc910100ff0 2023-10-08T12:55:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc9183ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc910199480 con 0x7fc910100630 2023-10-08T12:55:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc91619b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc910100630 0x7fc91019e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc91599a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc910100ff0 0x7fc91019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc91619b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc910100630 0x7fc91019e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:55684/0 (socket says 172.21.15.59:55684) 2023-10-08T12:55:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc91619b700 1 -- 172.21.15.59:0/1584243423 learned_addr learned my addr 172.21.15.59:0/1584243423 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc91599a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc910100ff0 0x7fc91019eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50158/0 (socket says 172.21.15.59:50158) 2023-10-08T12:55:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.463+0000 7fc91699c700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc910106640 0x7fc910198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc91599a700 1 -- 172.21.15.59:0/1584243423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc910100630 msgr2=0x7fc91019e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc91599a700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc910100630 0x7fc91019e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc91599a700 1 -- 172.21.15.59:0/1584243423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc910106640 msgr2=0x7fc910198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc91599a700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc910106640 0x7fc910198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc91599a700 1 -- 172.21.15.59:0/1584243423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900009520 con 0x7fc910100ff0 2023-10-08T12:55:04.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc91699c700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc910106640 0x7fc910198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:04.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc91599a700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc910100ff0 0x7fc91019eeb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc90000e9f0 tx=0x7fc90000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:04.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc9077fe700 1 -- 172.21.15.59:0/1584243423 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000cb70 con 0x7fc910100ff0 2023-10-08T12:55:04.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc9183ff700 1 -- 172.21.15.59:0/1584243423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc908009c40 con 0x7fc910100ff0 2023-10-08T12:55:04.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc9077fe700 1 -- 172.21.15.59:0/1584243423 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9000044e0 con 0x7fc910100ff0 2023-10-08T12:55:04.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc9077fe700 1 -- 172.21.15.59:0/1584243423 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900003d00 con 0x7fc910100ff0 2023-10-08T12:55:04.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.464+0000 7fc9183ff700 1 -- 172.21.15.59:0/1584243423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9101a5780 con 0x7fc910100ff0 2023-10-08T12:55:04.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:04 smithi173 ceph-mon[135182]: pgmap v744: 97 pgs: 97 active+clean; 654 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 368 op/s 2023-10-08T12:55:04.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:04 smithi173 ceph-mon[135182]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T12:55:04.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.465+0000 7fc9183ff700 1 -- 172.21.15.59:0/1584243423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc910101d70 con 0x7fc910100ff0 2023-10-08T12:55:04.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.468+0000 7fc9077fe700 1 -- 172.21.15.59:0/1584243423 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc900003f80 con 0x7fc910100ff0 2023-10-08T12:55:04.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.469+0000 7fc9077fe700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8fc0a15f0 0x7fc8fc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:04.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.470+0000 7fc9077fe700 1 -- 172.21.15.59:0/1584243423 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fc900014070 con 0x7fc910100ff0 2023-10-08T12:55:04.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.470+0000 7fc91619b700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8fc0a15f0 0x7fc8fc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:04.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.470+0000 7fc91619b700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8fc0a15f0 0x7fc8fc0a3ab0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc90c005950 tx=0x7fc90c009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:04.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.471+0000 7fc9077fe700 1 -- 172.21.15.59:0/1584243423 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc900096850 con 0x7fc910100ff0 2023-10-08T12:55:04.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.749+0000 7fc9183ff700 1 -- 172.21.15.59:0/1584243423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc910067450 con 0x7fc910100ff0 2023-10-08T12:55:04.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.750+0000 7fc9077fe700 1 -- 172.21.15.59:0/1584243423 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fc900099e70 con 0x7fc910100ff0 2023-10-08T12:55:04.752 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:55:04.752 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:55:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.752+0000 7fc9183ff700 1 -- 172.21.15.59:0/1584243423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8fc0a15f0 msgr2=0x7fc8fc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.752+0000 7fc9183ff700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8fc0a15f0 0x7fc8fc0a3ab0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc90c005950 tx=0x7fc90c009310 comp rx=0 tx=0).stop 2023-10-08T12:55:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.752+0000 7fc9183ff700 1 -- 172.21.15.59:0/1584243423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc910100ff0 msgr2=0x7fc91019eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.752+0000 7fc9183ff700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc910100ff0 0x7fc91019eeb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc90000e9f0 tx=0x7fc90000ed00 comp rx=0 tx=0).stop 2023-10-08T12:55:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.752+0000 7fc9183ff700 1 -- 172.21.15.59:0/1584243423 shutdown_connections 2023-10-08T12:55:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.752+0000 7fc9183ff700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8fc0a15f0 0x7fc8fc0a3ab0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.752+0000 7fc9183ff700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc910106640 0x7fc910198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.752+0000 7fc9183ff700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc910100630 0x7fc91019e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.752+0000 7fc9183ff700 1 --2- 172.21.15.59:0/1584243423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc910100ff0 0x7fc91019eeb0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:04.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.752+0000 7fc9183ff700 1 -- 172.21.15.59:0/1584243423 >> 172.21.15.59:0/1584243423 conn(0x7fc9100fc140 msgr2=0x7fc9100fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:04.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.752+0000 7fc9183ff700 1 -- 172.21.15.59:0/1584243423 shutdown_connections 2023-10-08T12:55:04.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.753+0000 7fc9183ff700 1 -- 172.21.15.59:0/1584243423 wait complete. 2023-10-08T12:55:04.755 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:55:04.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:55:04.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 14332 27.10 MB/sec warmup 35 sec latency 1709.797 ms 2023-10-08T12:55:04.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.997+0000 7fd9831ff700 1 -- 172.21.15.59:0/1137302004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c067ce0 msgr2=0x7fd97c0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:04.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.997+0000 7fd9831ff700 1 --2- 172.21.15.59:0/1137302004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c067ce0 0x7fd97c0680c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0099c0 tx=0x7fd96c009cd0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.998+0000 7fd9831ff700 1 -- 172.21.15.59:0/1137302004 shutdown_connections 2023-10-08T12:55:05.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.998+0000 7fd9831ff700 1 --2- 172.21.15.59:0/1137302004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd97c105b80 0x7fd97c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.998+0000 7fd9831ff700 1 --2- 172.21.15.59:0/1137302004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c067ce0 0x7fd97c0680c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.998+0000 7fd9831ff700 1 --2- 172.21.15.59:0/1137302004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd97c1051c0 0x7fd97c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.998+0000 7fd9831ff700 1 -- 172.21.15.59:0/1137302004 >> 172.21.15.59:0/1137302004 conn(0x7fd97c076780 msgr2=0x7fd97c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:05.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.998+0000 7fd9831ff700 1 -- 172.21.15.59:0/1137302004 shutdown_connections 2023-10-08T12:55:05.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.998+0000 7fd9831ff700 1 -- 172.21.15.59:0/1137302004 wait complete. 2023-10-08T12:55:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.999+0000 7fd9831ff700 1 Processor -- start 2023-10-08T12:55:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.999+0000 7fd9831ff700 1 -- start start 2023-10-08T12:55:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.999+0000 7fd9831ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c067ce0 0x7fd97c198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.999+0000 7fd9831ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd97c1051c0 0x7fd97c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.999+0000 7fd9831ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd97c105b80 0x7fd97c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.999+0000 7fd9831ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c19dd30 con 0x7fd97c067ce0 2023-10-08T12:55:05.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.999+0000 7fd9831ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c19dea0 con 0x7fd97c1051c0 2023-10-08T12:55:05.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:04.999+0000 7fd9831ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c19e060 con 0x7fd97c105b80 2023-10-08T12:55:05.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd97bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd97c1051c0 0x7fd97c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd97bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd97c1051c0 0x7fd97c199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50174/0 (socket says 172.21.15.59:50174) 2023-10-08T12:55:05.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd980f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c067ce0 0x7fd97c198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd97bfff700 1 -- 172.21.15.59:0/3456211190 learned_addr learned my addr 172.21.15.59:0/3456211190 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:05.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd98179c700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd97c105b80 0x7fd97c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd97bfff700 1 -- 172.21.15.59:0/3456211190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd97c105b80 msgr2=0x7fd97c19d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:05.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd97bfff700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd97c105b80 0x7fd97c19d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd97bfff700 1 -- 172.21.15.59:0/3456211190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c067ce0 msgr2=0x7fd97c198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:05.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd97bfff700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c067ce0 0x7fd97c198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd97bfff700 1 -- 172.21.15.59:0/3456211190 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c0095f0 con 0x7fd97c1051c0 2023-10-08T12:55:05.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd980f9b700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c067ce0 0x7fd97c198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:05.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd97bfff700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd97c1051c0 0x7fd97c199350 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd97000e9a0 tx=0x7fd97000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:05.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.000+0000 7fd979ffb700 1 -- 172.21.15.59:0/3456211190 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970009790 con 0x7fd97c1051c0 2023-10-08T12:55:05.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.001+0000 7fd9831ff700 1 -- 172.21.15.59:0/3456211190 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97c19e340 con 0x7fd97c1051c0 2023-10-08T12:55:05.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.001+0000 7fd979ffb700 1 -- 172.21.15.59:0/3456211190 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd970010430 con 0x7fd97c1051c0 2023-10-08T12:55:05.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.001+0000 7fd979ffb700 1 -- 172.21.15.59:0/3456211190 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970018680 con 0x7fd97c1051c0 2023-10-08T12:55:05.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.001+0000 7fd9831ff700 1 -- 172.21.15.59:0/3456211190 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97c1a5b80 con 0x7fd97c1051c0 2023-10-08T12:55:05.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.004+0000 7fd979ffb700 1 -- 172.21.15.59:0/3456211190 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd9700105a0 con 0x7fd97c1051c0 2023-10-08T12:55:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.006+0000 7fd996bf1b80 1 Processor -- start 2023-10-08T12:55:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.006+0000 7fd996bf1b80 1 -- start start 2023-10-08T12:55:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.006+0000 7fd979ffb700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9640a15f0 0x7fd9640a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.006+0000 7fd979ffb700 1 -- 172.21.15.59:0/3456211190 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fd970014070 con 0x7fd97c1051c0 2023-10-08T12:55:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.006+0000 7fd98179c700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9640a15f0 0x7fd9640a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.006+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 0x5630e1558260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.006+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e15587a0 0x5630e1563110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.006+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e1565a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.006+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e14c1460 con 0x5630e15587a0 2023-10-08T12:55:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.006+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e14b2c20 con 0x5630e1563650 2023-10-08T12:55:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.006+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e14b0540 con 0x5630e1557e80 2023-10-08T12:55:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd980f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 0x5630e1558260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd98179c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e1565a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd98179c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e1565a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50190/0 (socket says 172.21.15.59:50190) 2023-10-08T12:55:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd98179c700 1 -- 172.21.15.59:0/3202318621 learned_addr learned my addr 172.21.15.59:0/3202318621 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd980f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 0x5630e1558260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:55720/0 (socket says 172.21.15.59:55720) 2023-10-08T12:55:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd97bfff700 1 --2- 172.21.15.59:0/3202318621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e15587a0 0x5630e1563110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd98179c700 1 -- 172.21.15.59:0/3202318621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 msgr2=0x5630e1558260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd98179c700 1 --2- 172.21.15.59:0/3202318621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 0x5630e1558260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd98179c700 1 -- 172.21.15.59:0/3202318621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e15587a0 msgr2=0x5630e1563110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd98179c700 1 --2- 172.21.15.59:0/3202318621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e15587a0 0x5630e1563110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd98179c700 1 -- 172.21.15.59:0/3202318621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e12d6de0 con 0x5630e1563650 2023-10-08T12:55:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd98179c700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9640a15f0 0x7fd9640a3ab0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd97400f930 tx=0x7fd97400fcf0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.007+0000 7fd98179c700 1 --2- 172.21.15.59:0/3202318621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e1565a40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd97400f400 tx=0x7fd974020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edb128ee5d2ba664 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.008+0000 7fd962ffd700 1 -- 172.21.15.59:0/3202318621 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97400e040 con 0x5630e1563650 2023-10-08T12:55:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.008+0000 7fd962ffd700 1 -- 172.21.15.59:0/3202318621 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd97400f040 con 0x5630e1563650 2023-10-08T12:55:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.008+0000 7fd962ffd700 1 -- 172.21.15.59:0/3202318621 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97401ab90 con 0x5630e1563650 2023-10-08T12:55:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.008+0000 7fd996bf1b80 1 -- 172.21.15.59:0/3202318621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 msgr2=0x5630e1565a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.008+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/3202318621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e1565a40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd97400f400 tx=0x7fd974020000 comp rx=0 tx=0).stop 2023-10-08T12:55:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.009+0000 7fd996bf1b80 1 -- 172.21.15.59:0/3202318621 shutdown_connections 2023-10-08T12:55:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.009+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/3202318621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e1565a40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.009+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/3202318621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 0x5630e1558260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.009+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/3202318621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e15587a0 0x5630e1563110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.009+0000 7fd996bf1b80 1 -- 172.21.15.59:0/3202318621 >> 172.21.15.59:0/3202318621 conn(0x5630e14cd260 msgr2=0x5630e15542d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.009+0000 7fd996bf1b80 1 -- 172.21.15.59:0/3202318621 shutdown_connections 2023-10-08T12:55:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.009+0000 7fd996bf1b80 1 -- 172.21.15.59:0/3202318621 wait complete. 2023-10-08T12:55:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.009+0000 7fd996bf1b80 1 -- start start 2023-10-08T12:55:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd996bf1b80 1 Processor -- start 2023-10-08T12:55:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 0x5630e1563080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e15587a0 0x5630e1560410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e1560b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e14abe30 con 0x5630e15587a0 2023-10-08T12:55:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1448710 con 0x5630e1563650 2023-10-08T12:55:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e14483b0 con 0x5630e1557e80 2023-10-08T12:55:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd996bf1b80 10 client.0 _ll_register_callbacks cb 0x5630e12a5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:05.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd98179c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e1560b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd97bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e15587a0 0x5630e1560410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd980f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 0x5630e1563080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd98179c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e1560b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50200/0 (socket says 172.21.15.59:50200) 2023-10-08T12:55:05.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.010+0000 7fd98179c700 1 -- 172.21.15.59:0/1916947851 learned_addr learned my addr 172.21.15.59:0/1916947851 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:05.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.011+0000 7fd980f9b700 1 -- 172.21.15.59:0/1916947851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 msgr2=0x5630e1560b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.011+0000 7fd980f9b700 1 --2- 172.21.15.59:0/1916947851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e1560b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.011+0000 7fd980f9b700 1 -- 172.21.15.59:0/1916947851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e15587a0 msgr2=0x5630e1560410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.011+0000 7fd980f9b700 1 --2- 172.21.15.59:0/1916947851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e15587a0 0x5630e1560410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.011+0000 7fd980f9b700 1 -- 172.21.15.59:0/1916947851 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97400fe70 con 0x5630e1557e80 2023-10-08T12:55:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.011+0000 7fd980f9b700 1 --2- 172.21.15.59:0/1916947851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 0x5630e1563080 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0098e0 tx=0x7fd96c0052e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4c89579e67b69e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.011+0000 7fd95bfff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:55:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.011+0000 7fd95bfff700 1 -- 172.21.15.59:0/1916947851 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c01c070 con 0x5630e1557e80 2023-10-08T12:55:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.011+0000 7fd996bf1b80 1 -- 172.21.15.59:0/1916947851 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630e1473eb0 con 0x5630e1557e80 2023-10-08T12:55:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.011+0000 7fd95bfff700 1 -- 172.21.15.59:0/1916947851 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fd96c003880 con 0x5630e1557e80 2023-10-08T12:55:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.012+0000 7fd95bfff700 1 -- 172.21.15.59:0/1916947851 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd96c005720 con 0x5630e1557e80 2023-10-08T12:55:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.012+0000 7fd996bf1b80 10 client.27484 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.012+0000 7fd996bf1b80 1 -- 172.21.15.59:0/1916947851 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5630e12bfc60 con 0x5630e1557e80 2023-10-08T12:55:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.012+0000 7fd95bfff700 1 -- 172.21.15.59:0/1916947851 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd96c032020 con 0x5630e1557e80 2023-10-08T12:55:05.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.012+0000 7fd95bfff700 1 -- 172.21.15.59:0/1916947851 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd96c00fb30 con 0x5630e1557e80 2023-10-08T12:55:05.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.012+0000 7fd996bf1b80 10 client.27484 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:05.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.012+0000 7fd996bf1b80 10 client.27484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:05.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.012+0000 7fd996bf1b80 20 client.27484 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:05.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.012+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/1916947851 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5630e15730b0 0x5630e15754a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.012+0000 7fd996bf1b80 4 client.27484 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:55:05.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.012+0000 7fd996bf1b80 1 -- 172.21.15.59:0/1916947851 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630e14a4e10 con 0x5630e15730b0 2023-10-08T12:55:05.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.013+0000 7fd97bfff700 1 --2- 172.21.15.59:0/1916947851 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5630e15730b0 0x5630e15754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.013+0000 7fd97bfff700 1 --2- 172.21.15.59:0/1916947851 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5630e15730b0 0x5630e15754a0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d1e3889c1ac09f2 server_cookie=2674384896660933 in_seq=0 out_seq=0 2023-10-08T12:55:05.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.013+0000 7fd95bfff700 10 client.27484 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:05.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd95bfff700 1 -- 172.21.15.59:0/1916947851 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5630e14a4e10 con 0x5630e15730b0 2023-10-08T12:55:05.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd95bfff700 10 client.27484 handle_command_reply: tid=0 2023-10-08T12:55:05.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 1 client.27484 shutdown 2023-10-08T12:55:05.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 1 -- 172.21.15.59:0/1916947851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 msgr2=0x5630e1563080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:05.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/1916947851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 0x5630e1563080 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0098e0 tx=0x7fd96c0052e0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 1 -- 172.21.15.59:0/1916947851 shutdown_connections 2023-10-08T12:55:05.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/1916947851 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5630e15730b0 0x5630e15754a0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/1916947851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e1560b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/1916947851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e1557e80 0x5630e1563080 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/1916947851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e15587a0 0x5630e1560410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd95bfff700 0 client.27484 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:05.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 1 -- 172.21.15.59:0/1916947851 >> 172.21.15.59:0/1916947851 conn(0x5630e14cd260 msgr2=0x5630e1553ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:05.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 1 -- 172.21.15.59:0/1916947851 shutdown_connections 2023-10-08T12:55:05.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 1 -- 172.21.15.59:0/1916947851 wait complete. 2023-10-08T12:55:05.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.015+0000 7fd996bf1b80 20 client.27484 trim_cache size 0 max 16384 2023-10-08T12:55:05.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd996bf1b80 1 Processor -- start 2023-10-08T12:55:05.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd996bf1b80 1 -- start start 2023-10-08T12:55:05.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1557e80 0x5630e1565a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 0x5630e155adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1563650 0x5630e156a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e132c920 con 0x5630e1563650 2023-10-08T12:55:05.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e156a680 con 0x5630e1557e80 2023-10-08T12:55:05.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1555030 con 0x5630e15587a0 2023-10-08T12:55:05.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd980f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1557e80 0x5630e1565a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd980f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1557e80 0x5630e1565a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50206/0 (socket says 172.21.15.59:50206) 2023-10-08T12:55:05.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd97bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 0x5630e155adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd980f9b700 1 -- 172.21.15.59:0/3970602845 learned_addr learned my addr 172.21.15.59:0/3970602845 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:05.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.032+0000 7fd98179c700 1 --2- 172.21.15.59:0/3970602845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1563650 0x5630e156a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.033+0000 7fd97bfff700 1 -- 172.21.15.59:0/3970602845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1557e80 msgr2=0x5630e1565a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:05.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.033+0000 7fd97bfff700 1 --2- 172.21.15.59:0/3970602845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1557e80 0x5630e1565a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.033+0000 7fd97bfff700 1 -- 172.21.15.59:0/3970602845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1563650 msgr2=0x5630e156a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:05.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.033+0000 7fd97bfff700 1 --2- 172.21.15.59:0/3970602845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1563650 0x5630e156a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.033+0000 7fd97bfff700 1 -- 172.21.15.59:0/3970602845 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e12fd250 con 0x5630e15587a0 2023-10-08T12:55:05.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.033+0000 7fd980f9b700 1 --2- 172.21.15.59:0/3970602845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1557e80 0x5630e1565a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:05.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.033+0000 7fd98179c700 1 --2- 172.21.15.59:0/3970602845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1563650 0x5630e156a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:05.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.033+0000 7fd97bfff700 1 --2- 172.21.15.59:0/3970602845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 0x5630e155adb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd9700caa10 tx=0x7fd97009a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2e9e71268df0e27 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:05.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.033+0000 7fd9637fe700 1 -- 172.21.15.59:0/3970602845 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700983e0 con 0x5630e15587a0 2023-10-08T12:55:05.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.033+0000 7fd9637fe700 1 -- 172.21.15.59:0/3970602845 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd97009e120 con 0x5630e15587a0 2023-10-08T12:55:05.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.033+0000 7fd9637fe700 1 -- 172.21.15.59:0/3970602845 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970099790 con 0x5630e15587a0 2023-10-08T12:55:05.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.034+0000 7fd996bf1b80 1 -- 172.21.15.59:0/3970602845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 msgr2=0x5630e155adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:05.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.034+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/3970602845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 0x5630e155adb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd9700caa10 tx=0x7fd97009a1a0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.034+0000 7fd996bf1b80 1 -- 172.21.15.59:0/3970602845 shutdown_connections 2023-10-08T12:55:05.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.034+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/3970602845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1557e80 0x5630e1565a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.034+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/3970602845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1563650 0x5630e156a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.034+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/3970602845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 0x5630e155adb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.034+0000 7fd996bf1b80 1 -- 172.21.15.59:0/3970602845 >> 172.21.15.59:0/3970602845 conn(0x5630e14cd260 msgr2=0x5630e1562c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.034+0000 7fd996bf1b80 1 -- 172.21.15.59:0/3970602845 shutdown_connections 2023-10-08T12:55:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.034+0000 7fd996bf1b80 1 -- 172.21.15.59:0/3970602845 wait complete. 2023-10-08T12:55:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.035+0000 7fd996bf1b80 1 -- start start 2023-10-08T12:55:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.035+0000 7fd996bf1b80 1 Processor -- start 2023-10-08T12:55:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.035+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1557e80 0x5630e1568740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.035+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 0x5630e1568c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.035+0000 7fd996bf1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e15691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.035+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e156a4c0 con 0x5630e1557e80 2023-10-08T12:55:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.035+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e15c6ee0 con 0x5630e1563650 2023-10-08T12:55:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.035+0000 7fd996bf1b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e15c7020 con 0x5630e15587a0 2023-10-08T12:55:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.035+0000 7fd996bf1b80 10 client.0 _ll_register_callbacks cb 0x7fd96c00be50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.035+0000 7fd980f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1557e80 0x5630e1568740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd98179c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e15691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd97bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 0x5630e1568c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd97bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 0x5630e1568c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:55754/0 (socket says 172.21.15.59:55754) 2023-10-08T12:55:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd97bfff700 1 -- 172.21.15.59:0/4160699568 learned_addr learned my addr 172.21.15.59:0/4160699568 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd97bfff700 1 -- 172.21.15.59:0/4160699568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 msgr2=0x5630e15691c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd97bfff700 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e15691c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd97bfff700 1 -- 172.21.15.59:0/4160699568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1557e80 msgr2=0x5630e1568740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd97bfff700 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1557e80 0x5630e1568740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd97bfff700 1 -- 172.21.15.59:0/4160699568 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630e12bfc60 con 0x5630e15587a0 2023-10-08T12:55:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd980f9b700 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1557e80 0x5630e1568740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd97bfff700 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 0x5630e1568c80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd97009e5b0 tx=0x7fd97009a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a92f28000934e90 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd95bfff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:55:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd95bfff700 1 -- 172.21.15.59:0/4160699568 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970010880 con 0x5630e15587a0 2023-10-08T12:55:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd996bf1b80 1 -- 172.21.15.59:0/4160699568 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd97400f040 con 0x5630e15587a0 2023-10-08T12:55:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.036+0000 7fd95bfff700 1 -- 172.21.15.59:0/4160699568 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fd9700b1030 con 0x5630e15587a0 2023-10-08T12:55:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd95bfff700 1 -- 172.21.15.59:0/4160699568 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9700109e0 con 0x5630e15587a0 2023-10-08T12:55:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd996bf1b80 10 client.27490 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd996bf1b80 1 -- 172.21.15.59:0/4160699568 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5630e12d6de0 con 0x5630e15587a0 2023-10-08T12:55:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd95bfff700 1 -- 172.21.15.59:0/4160699568 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd97400f040 con 0x5630e15587a0 2023-10-08T12:55:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd95bfff700 1 -- 172.21.15.59:0/4160699568 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd9700a21a0 con 0x5630e15587a0 2023-10-08T12:55:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd996bf1b80 10 client.27490 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:05.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd996bf1b80 10 client.27490 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:05.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd996bf1b80 20 client.27490 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:05.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5630e15c8430 0x5630e15ca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:05.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd996bf1b80 4 client.27490 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:55:05.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd996bf1b80 1 -- 172.21.15.59:0/4160699568 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5630e14a4b30 con 0x5630e15c8430 2023-10-08T12:55:05.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.037+0000 7fd980f9b700 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5630e15c8430 0x5630e15ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:05.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.038+0000 7fd95bfff700 10 client.27490 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.038+0000 7fd980f9b700 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5630e15c8430 0x5630e15ca850 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c044607e91306c3 server_cookie=d7edf093ace6b4c3 in_seq=0 out_seq=0 2023-10-08T12:55:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.039+0000 7fd95bfff700 1 -- 172.21.15.59:0/4160699568 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5630e14a4b30 con 0x5630e15c8430 2023-10-08T12:55:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.039+0000 7fd95bfff700 10 client.27490 handle_command_reply: tid=0 2023-10-08T12:55:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.040+0000 7fd996bf1b80 1 client.27490 shutdown 2023-10-08T12:55:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.040+0000 7fd996bf1b80 1 -- 172.21.15.59:0/4160699568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 msgr2=0x5630e1568c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.040+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 0x5630e1568c80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd97009e5b0 tx=0x7fd97009a420 comp rx=0 tx=0).stop 2023-10-08T12:55:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.040+0000 7fd996bf1b80 1 -- 172.21.15.59:0/4160699568 shutdown_connections 2023-10-08T12:55:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.040+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5630e15c8430 0x5630e15ca850 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.040+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e1563650 0x5630e15691c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.040+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630e1557e80 0x5630e1568740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.040+0000 7fd95bfff700 0 client.27490 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.040+0000 7fd996bf1b80 1 --2- 172.21.15.59:0/4160699568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630e15587a0 0x5630e1568c80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.040+0000 7fd996bf1b80 1 -- 172.21.15.59:0/4160699568 >> 172.21.15.59:0/4160699568 conn(0x5630e14cd260 msgr2=0x5630e155b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.040+0000 7fd996bf1b80 1 -- 172.21.15.59:0/4160699568 shutdown_connections 2023-10-08T12:55:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.041+0000 7fd996bf1b80 1 -- 172.21.15.59:0/4160699568 wait complete. 2023-10-08T12:55:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.041+0000 7fd996bf1b80 20 client.27490 trim_cache size 0 max 16384 2023-10-08T12:55:05.052 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:55:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.041+0000 7fd9831ff700 1 -- 172.21.15.59:0/3456211190 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9640a15f0 msgr2=0x7fd9640a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:05.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.041+0000 7fd9831ff700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9640a15f0 0x7fd9640a3ab0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd97400f930 tx=0x7fd97400fcf0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.041+0000 7fd9831ff700 1 -- 172.21.15.59:0/3456211190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd97c1051c0 msgr2=0x7fd97c199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:05.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.041+0000 7fd9831ff700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd97c1051c0 0x7fd97c199350 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd97000e9a0 tx=0x7fd97000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.042+0000 7fd9831ff700 1 -- 172.21.15.59:0/3456211190 shutdown_connections 2023-10-08T12:55:05.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.042+0000 7fd9831ff700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd9640a15f0 0x7fd9640a3ab0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.042+0000 7fd9831ff700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd97c105b80 0x7fd97c19d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.042+0000 7fd9831ff700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c067ce0 0x7fd97c198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.042+0000 7fd9831ff700 1 --2- 172.21.15.59:0/3456211190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd97c1051c0 0x7fd97c199350 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:05.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.042+0000 7fd9831ff700 1 -- 172.21.15.59:0/3456211190 >> 172.21.15.59:0/3456211190 conn(0x7fd97c076780 msgr2=0x7fd97c100aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:05.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.042+0000 7fd9831ff700 1 -- 172.21.15.59:0/3456211190 shutdown_connections 2023-10-08T12:55:05.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:05.042+0000 7fd9831ff700 1 -- 172.21.15.59:0/3456211190 wait complete. 2023-10-08T12:55:05.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:05 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1584243423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:55:05.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:05 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1584243423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:55:05.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:05 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1584243423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:55:05.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 14479 26.44 MB/sec warmup 36 sec latency 2226.126 ms 2023-10-08T12:55:06.063 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:55:06.064 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:55:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.298+0000 7ff06cfff700 1 -- 172.21.15.59:0/1607229630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff068106740 msgr2=0x7ff068106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.298+0000 7ff06cfff700 1 --2- 172.21.15.59:0/1607229630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff068106740 0x7ff068106b20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff058009990 tx=0x7ff058009ca0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.298+0000 7ff06cfff700 1 -- 172.21.15.59:0/1607229630 shutdown_connections 2023-10-08T12:55:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.298+0000 7ff06cfff700 1 --2- 172.21.15.59:0/1607229630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff068106740 0x7ff068106b20 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.298+0000 7ff06cfff700 1 --2- 172.21.15.59:0/1607229630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0681010f0 0x7ff06810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.298+0000 7ff06cfff700 1 --2- 172.21.15.59:0/1607229630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068100730 0x7ff068100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.298+0000 7ff06cfff700 1 -- 172.21.15.59:0/1607229630 >> 172.21.15.59:0/1607229630 conn(0x7ff0680fc200 msgr2=0x7ff0680fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.298+0000 7ff06cfff700 1 -- 172.21.15.59:0/1607229630 shutdown_connections 2023-10-08T12:55:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.299+0000 7ff06cfff700 1 -- 172.21.15.59:0/1607229630 wait complete. 2023-10-08T12:55:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.300+0000 7ff06cfff700 1 Processor -- start 2023-10-08T12:55:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.300+0000 7ff06cfff700 1 -- start start 2023-10-08T12:55:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.300+0000 7ff06cfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068100730 0x7ff06819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.300+0000 7ff06cfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0681010f0 0x7ff06819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.300+0000 7ff06cfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068106740 0x7ff068196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.300+0000 7ff06cfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068197060 con 0x7ff068100730 2023-10-08T12:55:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.300+0000 7ff06cfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0681971d0 con 0x7ff0681010f0 2023-10-08T12:55:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.300+0000 7ff06cfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068197390 con 0x7ff068106740 2023-10-08T12:55:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.301+0000 7ff06659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068100730 0x7ff06819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.301+0000 7ff065d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0681010f0 0x7ff06819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.301+0000 7ff065d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0681010f0 0x7ff06819ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50226/0 (socket says 172.21.15.59:50226) 2023-10-08T12:55:06.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.301+0000 7ff065d9b700 1 -- 172.21.15.59:0/179259512 learned_addr learned my addr 172.21.15.59:0/179259512 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:06.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.301+0000 7ff066d9d700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068106740 0x7ff068196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.301+0000 7ff065d9b700 1 -- 172.21.15.59:0/179259512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068106740 msgr2=0x7ff068196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.301+0000 7ff065d9b700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068106740 0x7ff068196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.301+0000 7ff065d9b700 1 -- 172.21.15.59:0/179259512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068100730 msgr2=0x7ff06819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.301+0000 7ff065d9b700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068100730 0x7ff06819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.301+0000 7ff065d9b700 1 -- 172.21.15.59:0/179259512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580095f0 con 0x7ff0681010f0 2023-10-08T12:55:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.302+0000 7ff065d9b700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0681010f0 0x7ff06819ce10 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00e9a0 tx=0x7ff05c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.302+0000 7ff0577fe700 1 -- 172.21.15.59:0/179259512 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c009790 con 0x7ff0681010f0 2023-10-08T12:55:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.302+0000 7ff0577fe700 1 -- 172.21.15.59:0/179259512 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff05c010430 con 0x7ff0681010f0 2023-10-08T12:55:06.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.302+0000 7ff06cfff700 1 -- 172.21.15.59:0/179259512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff068197670 con 0x7ff0681010f0 2023-10-08T12:55:06.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.302+0000 7ff0577fe700 1 -- 172.21.15.59:0/179259512 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c018680 con 0x7ff0681010f0 2023-10-08T12:55:06.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.302+0000 7ff06cfff700 1 -- 172.21.15.59:0/179259512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0681a38c0 con 0x7ff0681010f0 2023-10-08T12:55:06.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.306+0000 7ff0577fe700 1 -- 172.21.15.59:0/179259512 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff05c0105a0 con 0x7ff0681010f0 2023-10-08T12:55:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.307+0000 7ff0809a5b80 1 Processor -- start 2023-10-08T12:55:06.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.307+0000 7ff0809a5b80 1 -- start start 2023-10-08T12:55:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.307+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 0x555bfb6ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.307+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6ea820 0x555bfb6f5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.307+0000 7ff0577fe700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff0500a1670 0x7ff0500a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.307+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.307+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb6534e0 con 0x555bfb6f56d0 2023-10-08T12:55:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.307+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb644ca0 con 0x555bfb6e9f00 2023-10-08T12:55:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.307+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb6425c0 con 0x555bfb6ea820 2023-10-08T12:55:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff0577fe700 1 -- 172.21.15.59:0/179259512 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7ff05c014070 con 0x7ff0681010f0 2023-10-08T12:55:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff066d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 0x555bfb6ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff066d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 0x555bfb6ea2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50240/0 (socket says 172.21.15.59:50240) 2023-10-08T12:55:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff066d9d700 1 -- 172.21.15.59:0/1570374986 learned_addr learned my addr 172.21.15.59:0/1570374986 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff06659c700 1 --2- 172.21.15.59:0/1570374986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6ea820 0x555bfb6f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff066d9d700 1 --2- 172.21.15.59:0/1570374986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff06659c700 1 -- 172.21.15.59:0/1570374986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 msgr2=0x555bfb6ea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff06659c700 1 --2- 172.21.15.59:0/1570374986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 0x555bfb6ea2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff06659c700 1 -- 172.21.15.59:0/1570374986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 msgr2=0x555bfb6f7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff06659c700 1 --2- 172.21.15.59:0/1570374986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff06659c700 1 -- 172.21.15.59:0/1570374986 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bfb468e60 con 0x555bfb6ea820 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.308+0000 7ff066d9d700 1 --2- 172.21.15.59:0/1570374986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.309+0000 7ff06659c700 1 --2- 172.21.15.59:0/1570374986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6ea820 0x555bfb6f5190 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff0580098e0 tx=0x7ff058005ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ffcbb47f2e65a0d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.309+0000 7ff065d9b700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff0500a1670 0x7ff0500a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.309+0000 7ff054ff9700 1 -- 172.21.15.59:0/1570374986 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0580056a0 con 0x555bfb6ea820 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.309+0000 7ff054ff9700 1 -- 172.21.15.59:0/1570374986 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff05801e040 con 0x555bfb6ea820 2023-10-08T12:55:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.309+0000 7ff054ff9700 1 -- 172.21.15.59:0/1570374986 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800bd40 con 0x555bfb6ea820 2023-10-08T12:55:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.310+0000 7ff065d9b700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff0500a1670 0x7ff0500a3b30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff05c096cb0 tx=0x7ff05c010b80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.310+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1570374986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6ea820 msgr2=0x555bfb6f5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.310+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/1570374986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6ea820 0x555bfb6f5190 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff0580098e0 tx=0x7ff058005ec0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.310+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1570374986 shutdown_connections 2023-10-08T12:55:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.310+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/1570374986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 0x555bfb6ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.310+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/1570374986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.310+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/1570374986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6ea820 0x555bfb6f5190 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.310+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1570374986 >> 172.21.15.59:0/1570374986 conn(0x555bfb65f2e0 msgr2=0x555bfb6e6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.310+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1570374986 shutdown_connections 2023-10-08T12:55:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.310+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1570374986 wait complete. 2023-10-08T12:55:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.311+0000 7ff0809a5b80 1 -- start start 2023-10-08T12:55:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.311+0000 7ff0809a5b80 1 Processor -- start 2023-10-08T12:55:06.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.312+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 0x555bfb6f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.312+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6ea820 0x555bfb6f2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.312+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.312+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb63deb0 con 0x555bfb6f56d0 2023-10-08T12:55:06.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.312+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb5da790 con 0x555bfb6e9f00 2023-10-08T12:55:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.312+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb5da430 con 0x555bfb6ea820 2023-10-08T12:55:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.312+0000 7ff0809a5b80 10 client.0 _ll_register_callbacks cb 0x555bfb437880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.312+0000 7ff066d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 0x555bfb6f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.313+0000 7ff066d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 0x555bfb6f50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50254/0 (socket says 172.21.15.59:50254) 2023-10-08T12:55:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.313+0000 7ff066d9d700 1 -- 172.21.15.59:0/1567488826 learned_addr learned my addr 172.21.15.59:0/1567488826 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.313+0000 7ff066d9d700 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.313+0000 7ff06659c700 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6ea820 0x555bfb6f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.313+0000 7ff066d9d700 1 -- 172.21.15.59:0/1567488826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6ea820 msgr2=0x555bfb6f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.313+0000 7ff066d9d700 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6ea820 0x555bfb6f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.313+0000 7ff066d9d700 1 -- 172.21.15.59:0/1567488826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 msgr2=0x555bfb6f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.313+0000 7ff066d9d700 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.313+0000 7ff066d9d700 1 -- 172.21.15.59:0/1567488826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06810df00 con 0x555bfb6e9f00 2023-10-08T12:55:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.313+0000 7ff066d9d700 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 0x555bfb6f50f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff06001c6e0 tx=0x7ff06000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a9393a6b3398d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.313+0000 7ff04dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:55:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.314+0000 7ff04dffb700 1 -- 172.21.15.59:0/1567488826 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000e030 con 0x555bfb6e9f00 2023-10-08T12:55:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.314+0000 7ff04dffb700 1 -- 172.21.15.59:0/1567488826 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7ff06001a440 con 0x555bfb6e9f00 2023-10-08T12:55:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.314+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1567488826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555bfb605f30 con 0x555bfb6e9f00 2023-10-08T12:55:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.314+0000 7ff04dffb700 1 -- 172.21.15.59:0/1567488826 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff06001a600 con 0x555bfb6e9f00 2023-10-08T12:55:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.314+0000 7ff0809a5b80 10 client.27509 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.314+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1567488826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x555bfb451ce0 con 0x555bfb6e9f00 2023-10-08T12:55:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.314+0000 7ff04dffb700 1 -- 172.21.15.59:0/1567488826 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555bfb605f30 con 0x555bfb6e9f00 2023-10-08T12:55:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.314+0000 7ff04dffb700 1 -- 172.21.15.59:0/1567488826 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff060024020 con 0x555bfb6e9f00 2023-10-08T12:55:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.315+0000 7ff0809a5b80 10 client.27509 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.315+0000 7ff0809a5b80 10 client.27509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.315+0000 7ff0809a5b80 20 client.27509 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.315+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555bfb705180 0x555bfb7075a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.315+0000 7ff0809a5b80 4 client.27509 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:55:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.315+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1567488826 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555bfb636e90 con 0x555bfb705180 2023-10-08T12:55:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.315+0000 7ff06659c700 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555bfb705180 0x555bfb7075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.315+0000 7ff06659c700 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555bfb705180 0x555bfb7075a0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fad6273497fb47c1 server_cookie=bf5d669d1c851383 in_seq=0 out_seq=0 2023-10-08T12:55:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.315+0000 7ff04dffb700 10 client.27509 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.320+0000 7ff04dffb700 1 -- 172.21.15.59:0/1567488826 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555bfb636e90 con 0x555bfb705180 2023-10-08T12:55:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.320+0000 7ff04dffb700 10 client.27509 handle_command_reply: tid=0 2023-10-08T12:55:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 1 client.27509 shutdown 2023-10-08T12:55:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1567488826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 msgr2=0x555bfb6f50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 0x555bfb6f50f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff06001c6e0 tx=0x7ff06000b040 comp rx=0 tx=0).stop 2023-10-08T12:55:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1567488826 shutdown_connections 2023-10-08T12:55:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555bfb705180 0x555bfb7075a0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6e9f00 0x555bfb6f50f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/1567488826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6ea820 0x555bfb6f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff04dffb700 0 client.27509 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1567488826 >> 172.21.15.59:0/1567488826 conn(0x555bfb65f2e0 msgr2=0x555bfb6e5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1567488826 shutdown_connections 2023-10-08T12:55:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 1 -- 172.21.15.59:0/1567488826 wait complete. 2023-10-08T12:55:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.321+0000 7ff0809a5b80 20 client.27509 trim_cache size 0 max 16384 2023-10-08T12:55:06.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.339+0000 7ff0809a5b80 1 Processor -- start 2023-10-08T12:55:06.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.339+0000 7ff0809a5b80 1 -- start start 2023-10-08T12:55:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6e9f00 0x555bfb6fc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6ea820 0x555bfb6f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb4be9a0 con 0x555bfb6f56d0 2023-10-08T12:55:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb7027e0 con 0x555bfb6ea820 2023-10-08T12:55:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb6eb150 con 0x555bfb6e9f00 2023-10-08T12:55:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff06659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6ea820 0x555bfb6f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff06659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6ea820 0x555bfb6f0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50260/0 (socket says 172.21.15.59:50260) 2023-10-08T12:55:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff06659c700 1 -- 172.21.15.59:0/3974543750 learned_addr learned my addr 172.21.15.59:0/3974543750 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff066d9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6e9f00 0x555bfb6fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff066d9d700 1 --2- 172.21.15.59:0/3974543750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff06659c700 1 -- 172.21.15.59:0/3974543750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6e9f00 msgr2=0x555bfb6fc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff06659c700 1 --2- 172.21.15.59:0/3974543750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6e9f00 0x555bfb6fc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff06659c700 1 -- 172.21.15.59:0/3974543750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 msgr2=0x555bfb6f12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff06659c700 1 --2- 172.21.15.59:0/3974543750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.340+0000 7ff06659c700 1 -- 172.21.15.59:0/3974543750 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bfb48f2d0 con 0x555bfb6ea820 2023-10-08T12:55:06.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.341+0000 7ff06659c700 1 --2- 172.21.15.59:0/3974543750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6ea820 0x555bfb6f0d80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff058009990 tx=0x7ff058033040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90793399c8731841 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.341+0000 7ff0557fa700 1 -- 172.21.15.59:0/3974543750 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058036040 con 0x555bfb6ea820 2023-10-08T12:55:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.341+0000 7ff0557fa700 1 -- 172.21.15.59:0/3974543750 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff058009290 con 0x555bfb6ea820 2023-10-08T12:55:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.341+0000 7ff0557fa700 1 -- 172.21.15.59:0/3974543750 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800b8f0 con 0x555bfb6ea820 2023-10-08T12:55:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.342+0000 7ff0809a5b80 1 -- 172.21.15.59:0/3974543750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6ea820 msgr2=0x555bfb6f0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.342+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/3974543750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6ea820 0x555bfb6f0d80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff058009990 tx=0x7ff058033040 comp rx=0 tx=0).stop 2023-10-08T12:55:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.342+0000 7ff0809a5b80 1 -- 172.21.15.59:0/3974543750 shutdown_connections 2023-10-08T12:55:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.342+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/3974543750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6f56d0 0x555bfb6f12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.342+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/3974543750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6e9f00 0x555bfb6fc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.342+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/3974543750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6ea820 0x555bfb6f0d80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.342+0000 7ff0809a5b80 1 -- 172.21.15.59:0/3974543750 >> 172.21.15.59:0/3974543750 conn(0x555bfb65f2e0 msgr2=0x555bfb6ed7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.342+0000 7ff0809a5b80 1 -- 172.21.15.59:0/3974543750 shutdown_connections 2023-10-08T12:55:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.342+0000 7ff0809a5b80 1 -- 172.21.15.59:0/3974543750 wait complete. 2023-10-08T12:55:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.342+0000 7ff0809a5b80 1 -- start start 2023-10-08T12:55:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.342+0000 7ff0809a5b80 1 Processor -- start 2023-10-08T12:55:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6e9f00 0x555bfb6faa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6ea820 0x555bfb6faf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff0809a5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6f56d0 0x555bfb6fb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb759000 con 0x555bfb6ea820 2023-10-08T12:55:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb759170 con 0x555bfb6f56d0 2023-10-08T12:55:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff0809a5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfb759330 con 0x555bfb6e9f00 2023-10-08T12:55:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff0809a5b80 10 client.0 _ll_register_callbacks cb 0x7ff060008bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff06659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6ea820 0x555bfb6faf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff06659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6ea820 0x555bfb6faf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42656/0 (socket says 172.21.15.59:42656) 2023-10-08T12:55:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff06659c700 1 -- 172.21.15.59:0/2723216504 learned_addr learned my addr 172.21.15.59:0/2723216504 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff066d9d700 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6f56d0 0x555bfb6fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff066d9d700 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6e9f00 0x555bfb6faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff06659c700 1 -- 172.21.15.59:0/2723216504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6e9f00 msgr2=0x555bfb6faa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff06659c700 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6e9f00 0x555bfb6faa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff06659c700 1 -- 172.21.15.59:0/2723216504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6f56d0 msgr2=0x555bfb6fb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff06659c700 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6f56d0 0x555bfb6fb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff06659c700 1 -- 172.21.15.59:0/2723216504 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555bfb468e60 con 0x555bfb6ea820 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.343+0000 7ff066d9d700 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6e9f00 0x555bfb6faa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.344+0000 7ff06659c700 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6ea820 0x555bfb6faf50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff058005920 tx=0x7ff05800b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f7b1f425a9f4b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.344+0000 7ff04dffb700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.344+0000 7ff04dffb700 1 -- 172.21.15.59:0/2723216504 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058036070 con 0x555bfb6ea820 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.344+0000 7ff0809a5b80 1 -- 172.21.15.59:0/2723216504 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff05801e040 con 0x555bfb6ea820 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.344+0000 7ff04dffb700 1 -- 172.21.15.59:0/2723216504 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7ff05803c420 con 0x555bfb6ea820 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.344+0000 7ff04dffb700 1 -- 172.21.15.59:0/2723216504 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff05803c970 con 0x555bfb6ea820 2023-10-08T12:55:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.344+0000 7ff0809a5b80 10 client.17496 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.344+0000 7ff0809a5b80 1 -- 172.21.15.59:0/2723216504 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x555bfb467330 con 0x555bfb6ea820 2023-10-08T12:55:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.345+0000 7ff04dffb700 1 -- 172.21.15.59:0/2723216504 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff05801e040 con 0x555bfb6ea820 2023-10-08T12:55:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.345+0000 7ff04dffb700 1 -- 172.21.15.59:0/2723216504 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff058044070 con 0x555bfb6ea820 2023-10-08T12:55:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.345+0000 7ff0809a5b80 10 client.17496 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.345+0000 7ff0809a5b80 10 client.17496 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.345+0000 7ff0809a5b80 20 client.17496 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.345+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555bfb75a690 0x555bfb75cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.345+0000 7ff0809a5b80 4 client.17496 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:55:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.345+0000 7ff0809a5b80 1 -- 172.21.15.59:0/2723216504 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555bfb636bb0 con 0x555bfb75a690 2023-10-08T12:55:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.345+0000 7ff066d9d700 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555bfb75a690 0x555bfb75cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.346+0000 7ff04dffb700 10 client.17496 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.346+0000 7ff066d9d700 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555bfb75a690 0x555bfb75cab0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0e14aa8ea57d912 server_cookie=352ba7d0b57f2f41 in_seq=0 out_seq=0 2023-10-08T12:55:06.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.364+0000 7ff04dffb700 1 -- 172.21.15.59:0/2723216504 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555bfb636bb0 con 0x555bfb75a690 2023-10-08T12:55:06.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.364+0000 7ff04dffb700 10 client.17496 handle_command_reply: tid=0 2023-10-08T12:55:06.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.364+0000 7ff0809a5b80 1 client.17496 shutdown 2023-10-08T12:55:06.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.364+0000 7ff0809a5b80 1 -- 172.21.15.59:0/2723216504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6ea820 msgr2=0x555bfb6faf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.364+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6ea820 0x555bfb6faf50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff058005920 tx=0x7ff05800b310 comp rx=0 tx=0).stop 2023-10-08T12:55:06.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.365+0000 7ff0809a5b80 1 -- 172.21.15.59:0/2723216504 shutdown_connections 2023-10-08T12:55:06.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.365+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555bfb75a690 0x555bfb75cab0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.365+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bfb6f56d0 0x555bfb6fb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.365+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bfb6e9f00 0x555bfb6faa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.365+0000 7ff0809a5b80 1 --2- 172.21.15.59:0/2723216504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bfb6ea820 0x555bfb6faf50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.365+0000 7ff0809a5b80 1 -- 172.21.15.59:0/2723216504 >> 172.21.15.59:0/2723216504 conn(0x555bfb65f2e0 msgr2=0x555bfb6e5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.365+0000 7ff04dffb700 0 client.17496 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:06.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.365+0000 7ff0809a5b80 1 -- 172.21.15.59:0/2723216504 shutdown_connections 2023-10-08T12:55:06.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.365+0000 7ff0809a5b80 1 -- 172.21.15.59:0/2723216504 wait complete. 2023-10-08T12:55:06.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.365+0000 7ff0809a5b80 20 client.17496 trim_cache size 0 max 16384 2023-10-08T12:55:06.367 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:55:06.368 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:55:06.368 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "5059edb6-b7f2-44b0-b88b-e66fbe47d6ad", 2023-10-08T12:55:06.368 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:55:06.368 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:55:06.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 -- 172.21.15.59:0/179259512 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff0500a1670 msgr2=0x7ff0500a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff0500a1670 0x7ff0500a3b30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff05c096cb0 tx=0x7ff05c010b80 comp rx=0 tx=0).stop 2023-10-08T12:55:06.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 -- 172.21.15.59:0/179259512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0681010f0 msgr2=0x7ff06819ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0681010f0 0x7ff06819ce10 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00e9a0 tx=0x7ff05c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 -- 172.21.15.59:0/179259512 shutdown_connections 2023-10-08T12:55:06.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff0500a1670 0x7ff0500a3b30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068106740 0x7ff068196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068100730 0x7ff06819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 --2- 172.21.15.59:0/179259512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0681010f0 0x7ff06819ce10 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 -- 172.21.15.59:0/179259512 >> 172.21.15.59:0/179259512 conn(0x7ff0680fc200 msgr2=0x7ff0680fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 -- 172.21.15.59:0/179259512 shutdown_connections 2023-10-08T12:55:06.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.366+0000 7ff06cfff700 1 -- 172.21.15.59:0/179259512 wait complete. 2023-10-08T12:55:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:06 smithi092 ceph-mon[134093]: pgmap v746: 97 pgs: 97 active+clean; 718 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 18 MiB/s wr, 439 op/s 2023-10-08T12:55:06.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:06 smithi059 ceph-mon[98489]: pgmap v746: 97 pgs: 97 active+clean; 718 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 18 MiB/s wr, 439 op/s 2023-10-08T12:55:06.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:55:06.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:06 smithi173 ceph-mon[135182]: pgmap v746: 97 pgs: 97 active+clean; 718 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 18 MiB/s wr, 439 op/s 2023-10-08T12:55:06.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.642+0000 7ff9efbff700 1 -- 172.21.15.59:0/3173316696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e8073540 msgr2=0x7ff9e810ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.642+0000 7ff9efbff700 1 --2- 172.21.15.59:0/3173316696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e8073540 0x7ff9e810ca30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009990 tx=0x7ff9d8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.642+0000 7ff9efbff700 1 -- 172.21.15.59:0/3173316696 shutdown_connections 2023-10-08T12:55:06.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.642+0000 7ff9efbff700 1 --2- 172.21.15.59:0/3173316696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9e810cf70 0x7ff9e810f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.642+0000 7ff9efbff700 1 --2- 172.21.15.59:0/3173316696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e8072c20 0x7ff9e8073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.642+0000 7ff9efbff700 1 --2- 172.21.15.59:0/3173316696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e8073540 0x7ff9e810ca30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.642+0000 7ff9efbff700 1 -- 172.21.15.59:0/3173316696 >> 172.21.15.59:0/3173316696 conn(0x7ff9e80fc200 msgr2=0x7ff9e80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.642+0000 7ff9efbff700 1 -- 172.21.15.59:0/3173316696 shutdown_connections 2023-10-08T12:55:06.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.642+0000 7ff9efbff700 1 -- 172.21.15.59:0/3173316696 wait complete. 2023-10-08T12:55:06.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.644+0000 7ff9efbff700 1 Processor -- start 2023-10-08T12:55:06.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.644+0000 7ff9efbff700 1 -- start start 2023-10-08T12:55:06.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.644+0000 7ff9efbff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e8072c20 0x7ff9e8198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.644+0000 7ff9efbff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e8073540 0x7ff9e81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.644+0000 7ff9efbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9e810cf70 0x7ff9e819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.644+0000 7ff9efbff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e819dd90 con 0x7ff9e8072c20 2023-10-08T12:55:06.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.644+0000 7ff9efbff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e819df00 con 0x7ff9e8073540 2023-10-08T12:55:06.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.644+0000 7ff9efbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e819e0c0 con 0x7ff9e810cf70 2023-10-08T12:55:06.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.644+0000 7ff9ed19a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e8073540 0x7ff9e81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.644+0000 7ff9ed19a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e8073540 0x7ff9e81993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50294/0 (socket says 172.21.15.59:50294) 2023-10-08T12:55:06.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.645+0000 7ff9ed19a700 1 -- 172.21.15.59:0/3935181673 learned_addr learned my addr 172.21.15.59:0/3935181673 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:06.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.645+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e8072c20 0x7ff9e8198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.645+0000 7ff9ee19c700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9e810cf70 0x7ff9e819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.645+0000 7ff9ed19a700 1 -- 172.21.15.59:0/3935181673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9e810cf70 msgr2=0x7ff9e819d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.645+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9e810cf70 0x7ff9e819d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.645+0000 7ff9ed19a700 1 -- 172.21.15.59:0/3935181673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e8072c20 msgr2=0x7ff9e8198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.645+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e8072c20 0x7ff9e8198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.645+0000 7ff9ed19a700 1 -- 172.21.15.59:0/3935181673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d80095f0 con 0x7ff9e8073540 2023-10-08T12:55:06.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.645+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e8072c20 0x7ff9e8198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:06.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.645+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e8073540 0x7ff9e81993b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8005720 tx=0x7ff9d8005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.645+0000 7ff9deffd700 1 -- 172.21.15.59:0/3935181673 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d801d070 con 0x7ff9e8073540 2023-10-08T12:55:06.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.646+0000 7ff9deffd700 1 -- 172.21.15.59:0/3935181673 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9d8022470 con 0x7ff9e8073540 2023-10-08T12:55:06.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.646+0000 7ff9efbff700 1 -- 172.21.15.59:0/3935181673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e819e340 con 0x7ff9e8073540 2023-10-08T12:55:06.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.646+0000 7ff9deffd700 1 -- 172.21.15.59:0/3935181673 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8017650 con 0x7ff9e8073540 2023-10-08T12:55:06.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.646+0000 7ff9efbff700 1 -- 172.21.15.59:0/3935181673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e81a5be0 con 0x7ff9e8073540 2023-10-08T12:55:06.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.650+0000 7ff9deffd700 1 -- 172.21.15.59:0/3935181673 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff9d80225e0 con 0x7ff9e8073540 2023-10-08T12:55:06.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.652+0000 7ffa035d9b80 1 Processor -- start 2023-10-08T12:55:06.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.652+0000 7ffa035d9b80 1 -- start start 2023-10-08T12:55:06.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.652+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68d6e80 0x5640a68d7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.652+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 0x5640a68e2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.652+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68e2650 0x5640a68e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.652+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a6840460 con 0x5640a68d6e80 2023-10-08T12:55:06.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.652+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a6831c20 con 0x5640a68e2650 2023-10-08T12:55:06.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.652+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a682f540 con 0x5640a68d77a0 2023-10-08T12:55:06.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.652+0000 7ff9deffd700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9d40a1670 0x7ff9d40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.653+0000 7ff9deffd700 1 -- 172.21.15.59:0/3935181673 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7ff9d80ce4f0 con 0x7ff9e8073540 2023-10-08T12:55:06.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.653+0000 7ff9ed99b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 0x5640a68e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.653+0000 7ff9ed99b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 0x5640a68e2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:55836/0 (socket says 172.21.15.59:55836) 2023-10-08T12:55:06.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.653+0000 7ff9ed99b700 1 -- 172.21.15.59:0/1308849972 learned_addr learned my addr 172.21.15.59:0/1308849972 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:06.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.653+0000 7ff9ee19c700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9d40a1670 0x7ff9d40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.653+0000 7ff9ed99b700 1 -- 172.21.15.59:0/1308849972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68e2650 msgr2=0x5640a68e4a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:55:06.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.653+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/1308849972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68e2650 0x5640a68e4a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.653+0000 7ff9ee19c700 1 --2- 172.21.15.59:0/1308849972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68d6e80 0x5640a68d7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.653+0000 7ff9ed99b700 1 -- 172.21.15.59:0/1308849972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68d6e80 msgr2=0x5640a68d7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.654+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/1308849972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68d6e80 0x5640a68d7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.654+0000 7ff9ed99b700 1 -- 172.21.15.59:0/1308849972 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640a6655de0 con 0x5640a68d77a0 2023-10-08T12:55:06.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.654+0000 7ff9ee19c700 1 --2- 172.21.15.59:0/1308849972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68d6e80 0x5640a68d7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:55:06.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.654+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/1308849972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 0x5640a68e2110 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009e10 tx=0x7ff9e40116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f4efb07374b3180 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.654+0000 7ff9ee19c700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9d40a1670 0x7ff9d40a3b30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009550 tx=0x7ff9e000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.654+0000 7ff9d3fff700 1 -- 172.21.15.59:0/1308849972 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4011ed0 con 0x5640a68d77a0 2023-10-08T12:55:06.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.654+0000 7ff9d3fff700 1 -- 172.21.15.59:0/1308849972 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9e401b930 con 0x5640a68d77a0 2023-10-08T12:55:06.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.654+0000 7ff9d3fff700 1 -- 172.21.15.59:0/1308849972 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e40129b0 con 0x5640a68d77a0 2023-10-08T12:55:06.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.655+0000 7ffa035d9b80 1 -- 172.21.15.59:0/1308849972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 msgr2=0x5640a68e2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.655+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/1308849972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 0x5640a68e2110 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009e10 tx=0x7ff9e40116c0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.655+0000 7ffa035d9b80 1 -- 172.21.15.59:0/1308849972 shutdown_connections 2023-10-08T12:55:06.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.655+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/1308849972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68e2650 0x5640a68e4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.655+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/1308849972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68d6e80 0x5640a68d7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.655+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/1308849972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 0x5640a68e2110 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.655+0000 7ffa035d9b80 1 -- 172.21.15.59:0/1308849972 >> 172.21.15.59:0/1308849972 conn(0x5640a684c260 msgr2=0x5640a68d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.656+0000 7ffa035d9b80 1 -- 172.21.15.59:0/1308849972 shutdown_connections 2023-10-08T12:55:06.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.656+0000 7ffa035d9b80 1 -- 172.21.15.59:0/1308849972 wait complete. 2023-10-08T12:55:06.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.656+0000 7ffa035d9b80 1 -- start start 2023-10-08T12:55:06.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.657+0000 7ffa035d9b80 1 Processor -- start 2023-10-08T12:55:06.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.657+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d6e80 0x5640a68df4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.657+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 0x5640a68dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.657+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68dff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.657+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a682ae30 con 0x5640a68e2650 2023-10-08T12:55:06.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.657+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a67c7710 con 0x5640a68d6e80 2023-10-08T12:55:06.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.657+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a67c73b0 con 0x5640a68d77a0 2023-10-08T12:55:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.658+0000 7ff9ed99b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d6e80 0x5640a68df4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.658+0000 7ffa035d9b80 10 client.0 _ll_register_callbacks cb 0x5640a6624800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.658+0000 7ff9ed99b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d6e80 0x5640a68df4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50308/0 (socket says 172.21.15.59:50308) 2023-10-08T12:55:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.658+0000 7ff9ed99b700 1 -- 172.21.15.59:0/2814693330 learned_addr learned my addr 172.21.15.59:0/2814693330 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.658+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 0x5640a68dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.658+0000 7ff9ed99b700 1 -- 172.21.15.59:0/2814693330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 msgr2=0x5640a68dfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.658+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 0x5640a68dfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.658+0000 7ff9ed99b700 1 -- 172.21.15.59:0/2814693330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 msgr2=0x5640a68dff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.658+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68dff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.658+0000 7ff9ed99b700 1 -- 172.21.15.59:0/2814693330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e4009a10 con 0x5640a68d6e80 2023-10-08T12:55:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.658+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d6e80 0x5640a68df4c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4000c00 tx=0x7ff9e401bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d96bc050fca3ea1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.659+0000 7ff9d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:55:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.659+0000 7ff9d17fa700 1 -- 172.21.15.59:0/2814693330 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4020070 con 0x5640a68d6e80 2023-10-08T12:55:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.659+0000 7ff9d17fa700 1 -- 172.21.15.59:0/2814693330 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7ff9e4004020 con 0x5640a68d6e80 2023-10-08T12:55:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.659+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2814693330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640a67f2eb0 con 0x5640a68d6e80 2023-10-08T12:55:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.659+0000 7ff9d17fa700 1 -- 172.21.15.59:0/2814693330 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9e40041e0 con 0x5640a68d6e80 2023-10-08T12:55:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.659+0000 7ffa035d9b80 10 client.27524 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.659+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2814693330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5640a663ec60 con 0x5640a68d6e80 2023-10-08T12:55:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.659+0000 7ff9d17fa700 1 -- 172.21.15.59:0/2814693330 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5640a67f2eb0 con 0x5640a68d6e80 2023-10-08T12:55:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.660+0000 7ff9d17fa700 1 -- 172.21.15.59:0/2814693330 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff9e40047e0 con 0x5640a68d6e80 2023-10-08T12:55:06.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.660+0000 7ffa035d9b80 10 client.27524 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:06.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.660+0000 7ffa035d9b80 10 client.27524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:06.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.660+0000 7ffa035d9b80 20 client.27524 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:06.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.660+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5640a68fa800 0x5640a68fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.660+0000 7ffa035d9b80 4 client.27524 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:55:06.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.660+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2814693330 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640a6823e10 con 0x5640a68fa800 2023-10-08T12:55:06.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.660+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5640a68fa800 0x5640a68fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.661+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5640a68fa800 0x5640a68fcc20 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c181237d04940d7 server_cookie=860d631219932e40 in_seq=0 out_seq=0 2023-10-08T12:55:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.661+0000 7ff9d17fa700 10 client.27524 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ff9d17fa700 1 -- 172.21.15.59:0/2814693330 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5640a6823e10 con 0x5640a68fa800 2023-10-08T12:55:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ff9d17fa700 10 client.27524 handle_command_reply: tid=0 2023-10-08T12:55:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ffa035d9b80 1 client.27524 shutdown 2023-10-08T12:55:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2814693330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d6e80 msgr2=0x5640a68df4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d6e80 0x5640a68df4c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4000c00 tx=0x7ff9e401bec0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2814693330 shutdown_connections 2023-10-08T12:55:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5640a68fa800 0x5640a68fcc20 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d6e80 0x5640a68df4c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ff9d17fa700 0 client.27524 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68dff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/2814693330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d77a0 0x5640a68dfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.662+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2814693330 >> 172.21.15.59:0/2814693330 conn(0x5640a684c260 msgr2=0x5640a68d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.663+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2814693330 shutdown_connections 2023-10-08T12:55:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.663+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2814693330 wait complete. 2023-10-08T12:55:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.663+0000 7ffa035d9b80 20 client.27524 trim_cache size 0 max 16384 2023-10-08T12:55:06.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.687+0000 7ffa035d9b80 1 Processor -- start 2023-10-08T12:55:06.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.687+0000 7ffa035d9b80 1 -- start start 2023-10-08T12:55:06.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.687+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d6e80 0x5640a68f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.687+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68d9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.687+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68dc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.687+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a66ab920 con 0x5640a68e2650 2023-10-08T12:55:06.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.687+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a68d3ea0 con 0x5640a68d77a0 2023-10-08T12:55:06.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.687+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a68fa5e0 con 0x5640a68d6e80 2023-10-08T12:55:06.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ed19a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68d9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ee19c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68dc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ed19a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68d9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50318/0 (socket says 172.21.15.59:50318) 2023-10-08T12:55:06.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ed19a700 1 -- 172.21.15.59:0/2492758541 learned_addr learned my addr 172.21.15.59:0/2492758541 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:06.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/2492758541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d6e80 0x5640a68f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ed19a700 1 -- 172.21.15.59:0/2492758541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d6e80 msgr2=0x5640a68f19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/2492758541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d6e80 0x5640a68f19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ed19a700 1 -- 172.21.15.59:0/2492758541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 msgr2=0x5640a68dc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/2492758541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68dc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ed19a700 1 -- 172.21.15.59:0/2492758541 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640a667c250 con 0x5640a68d77a0 2023-10-08T12:55:06.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ee19c700 1 --2- 172.21.15.59:0/2492758541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68dc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:06.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/2492758541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68d9d50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8022890 tx=0x7ff9d801a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=161074cbcc867f41 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.688+0000 7ff9dcbff700 1 -- 172.21.15.59:0/2492758541 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d809aec0 con 0x5640a68d77a0 2023-10-08T12:55:06.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.689+0000 7ff9dcbff700 1 -- 172.21.15.59:0/2492758541 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9d809bc60 con 0x5640a68d77a0 2023-10-08T12:55:06.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.689+0000 7ff9dcbff700 1 -- 172.21.15.59:0/2492758541 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80999e0 con 0x5640a68d77a0 2023-10-08T12:55:06.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.689+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2492758541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 msgr2=0x5640a68d9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.689+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/2492758541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68d9d50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8022890 tx=0x7ff9d801a040 comp rx=0 tx=0).stop 2023-10-08T12:55:06.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.689+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2492758541 shutdown_connections 2023-10-08T12:55:06.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.689+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/2492758541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68dc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.689+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/2492758541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d6e80 0x5640a68f19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.689+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/2492758541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68d9d50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.689+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2492758541 >> 172.21.15.59:0/2492758541 conn(0x5640a684c260 msgr2=0x5640a68dfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.689+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2492758541 shutdown_connections 2023-10-08T12:55:06.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.689+0000 7ffa035d9b80 1 -- 172.21.15.59:0/2492758541 wait complete. 2023-10-08T12:55:06.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.690+0000 7ffa035d9b80 1 -- start start 2023-10-08T12:55:06.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.690+0000 7ffa035d9b80 1 Processor -- start 2023-10-08T12:55:06.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.690+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d6e80 0x5640a68f1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.690+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68efc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.690+0000 7ffa035d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68f0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.690+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a68f06b0 con 0x5640a68e2650 2023-10-08T12:55:06.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.690+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a68f0820 con 0x5640a68d77a0 2023-10-08T12:55:06.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ffa035d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640a68f09e0 con 0x5640a68d6e80 2023-10-08T12:55:06.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ffa035d9b80 10 client.0 _ll_register_callbacks cb 0x7ff9e4009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:06.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9ed19a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9ed19a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68efc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50332/0 (socket says 172.21.15.59:50332) 2023-10-08T12:55:06.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9ed19a700 1 -- 172.21.15.59:0/770141511 learned_addr learned my addr 172.21.15.59:0/770141511 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:06.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9ee19c700 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68f0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d6e80 0x5640a68f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9ed19a700 1 -- 172.21.15.59:0/770141511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d6e80 msgr2=0x5640a68f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d6e80 0x5640a68f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9ed19a700 1 -- 172.21.15.59:0/770141511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 msgr2=0x5640a68f0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:06.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68f0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9ed19a700 1 -- 172.21.15.59:0/770141511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e0011040 con 0x5640a68d77a0 2023-10-08T12:55:06.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9ed19a700 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68efc30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8097a60 tx=0x7ff9d80cbc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff12cc5a5a3b96f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:06.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.691+0000 7ff9d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:55:06.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ff9d17fa700 1 -- 172.21.15.59:0/770141511 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d809f6b0 con 0x5640a68d77a0 2023-10-08T12:55:06.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ff9d17fa700 1 -- 172.21.15.59:0/770141511 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8485+0+0 (secure 0 0 0) 0x7ff9d80a3860 con 0x5640a68d77a0 2023-10-08T12:55:06.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ffa035d9b80 1 -- 172.21.15.59:0/770141511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff9e401b930 con 0x5640a68d77a0 2023-10-08T12:55:06.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ff9d17fa700 1 -- 172.21.15.59:0/770141511 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9d809b7c0 con 0x5640a68d77a0 2023-10-08T12:55:06.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ffa035d9b80 10 client.27530 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:06.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ffa035d9b80 1 -- 172.21.15.59:0/770141511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7ff9e81a5be0 con 0x5640a68d77a0 2023-10-08T12:55:06.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ff9d17fa700 1 -- 172.21.15.59:0/770141511 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9e401b930 con 0x5640a68d77a0 2023-10-08T12:55:06.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ff9d17fa700 1 -- 172.21.15.59:0/770141511 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff9d80b0070 con 0x5640a68d77a0 2023-10-08T12:55:06.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ffa035d9b80 10 client.27530 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:06.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ffa035d9b80 10 client.27530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:06.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ffa035d9b80 20 client.27530 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:06.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5640a694f6c0 0x5640a6951ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:06.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ffa035d9b80 4 client.27530 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:55:06.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.692+0000 7ffa035d9b80 1 -- 172.21.15.59:0/770141511 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5640a6823b30 con 0x5640a694f6c0 2023-10-08T12:55:06.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.693+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5640a694f6c0 0x5640a6951ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:06.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.693+0000 7ff9ed99b700 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5640a694f6c0 0x5640a6951ab0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4522df8cd47b96a server_cookie=19295d5d70bc30fd in_seq=0 out_seq=0 2023-10-08T12:55:06.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.693+0000 7ff9d17fa700 10 client.27530 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:06.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ff9d17fa700 1 -- 172.21.15.59:0/770141511 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x5640a6823b30 con 0x5640a694f6c0 2023-10-08T12:55:06.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ff9d17fa700 10 client.27530 handle_command_reply: tid=0 2023-10-08T12:55:06.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 1 client.27530 shutdown 2023-10-08T12:55:06.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 1 -- 172.21.15.59:0/770141511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 msgr2=0x5640a68efc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68efc30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8097a60 tx=0x7ff9d80cbc30 comp rx=0 tx=0).stop 2023-10-08T12:55:06.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 1 -- 172.21.15.59:0/770141511 shutdown_connections 2023-10-08T12:55:06.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5640a694f6c0 0x5640a6951ab0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640a68e2650 0x5640a68f0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640a68d6e80 0x5640a68f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ff9d17fa700 0 client.27530 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:06.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 1 --2- 172.21.15.59:0/770141511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640a68d77a0 0x5640a68efc30 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 1 -- 172.21.15.59:0/770141511 >> 172.21.15.59:0/770141511 conn(0x5640a684c260 msgr2=0x5640a68d2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 1 -- 172.21.15.59:0/770141511 shutdown_connections 2023-10-08T12:55:06.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 1 -- 172.21.15.59:0/770141511 wait complete. 2023-10-08T12:55:06.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.695+0000 7ffa035d9b80 20 client.27530 trim_cache size 0 max 16384 2023-10-08T12:55:06.702 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:55:06.702 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "scrub active (84 inodes in the stack)", 2023-10-08T12:55:06.702 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:55:06.702 INFO:teuthology.orchestra.run.smithi059.stdout: "5059edb6-b7f2-44b0-b88b-e66fbe47d6ad": { 2023-10-08T12:55:06.702 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:55:06.703 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "5059edb6-b7f2-44b0-b88b-e66fbe47d6ad", 2023-10-08T12:55:06.703 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:55:06.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:55:06.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:55:06.703 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:55:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 -- 172.21.15.59:0/3935181673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9d40a1670 msgr2=0x7ff9d40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9d40a1670 0x7ff9d40a3b30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009550 tx=0x7ff9e000b040 comp rx=0 tx=0).stop 2023-10-08T12:55:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 -- 172.21.15.59:0/3935181673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e8073540 msgr2=0x7ff9e81993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e8073540 0x7ff9e81993b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8005720 tx=0x7ff9d8005750 comp rx=0 tx=0).stop 2023-10-08T12:55:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 -- 172.21.15.59:0/3935181673 shutdown_connections 2023-10-08T12:55:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9d40a1670 0x7ff9d40a3b30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9e810cf70 0x7ff9e819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e8072c20 0x7ff9e8198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 --2- 172.21.15.59:0/3935181673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e8073540 0x7ff9e81993b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 -- 172.21.15.59:0/3935181673 >> 172.21.15.59:0/3935181673 conn(0x7ff9e80fc200 msgr2=0x7ff9e80fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:06.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 -- 172.21.15.59:0/3935181673 shutdown_connections 2023-10-08T12:55:06.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:06.696+0000 7ff9efbff700 1 -- 172.21.15.59:0/3935181673 wait complete. 2023-10-08T12:55:06.717 INFO:tasks.cephfs.filesystem:scrub status for tag:5059edb6-b7f2-44b0-b88b-e66fbe47d6ad - {'path': '/', 'tag': '5059edb6-b7f2-44b0-b88b-e66fbe47d6ad', 'options': 'recursive,force'} 2023-10-08T12:55:06.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 14838 26.28 MB/sec warmup 37 sec latency 186.863 ms 2023-10-08T12:55:07.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:07 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:55:07.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:07 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:07.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:07 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:55:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:07 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:55:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:07 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:07.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:07 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:55:07.519 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:07 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:55:07.519 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:07 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:07.519 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:07 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:55:07.938 INFO:tasks.workunit.client.0.smithi059.stdout: 10 15294 25.94 MB/sec warmup 38 sec latency 187.314 ms 2023-10-08T12:55:08.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:08 smithi092 ceph-mon[134093]: pgmap v747: 97 pgs: 97 active+clean; 799 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 27 MiB/s wr, 547 op/s 2023-10-08T12:55:08.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:08 smithi173 ceph-mon[135182]: pgmap v747: 97 pgs: 97 active+clean; 799 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 27 MiB/s wr, 547 op/s 2023-10-08T12:55:08.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:08 smithi059 ceph-mon[98489]: pgmap v747: 97 pgs: 97 active+clean; 799 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 27 MiB/s wr, 547 op/s 2023-10-08T12:55:08.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 15891 26.08 MB/sec warmup 39 sec latency 161.748 ms 2023-10-08T12:55:09.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:09 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:09.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:09 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:09.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:09 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:09.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 16548 26.64 MB/sec warmup 40 sec latency 37.811 ms 2023-10-08T12:55:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:10 smithi092 ceph-mon[134093]: pgmap v748: 97 pgs: 97 active+clean; 848 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 33 MiB/s wr, 630 op/s 2023-10-08T12:55:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:10 smithi173 ceph-mon[135182]: pgmap v748: 97 pgs: 97 active+clean; 848 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 33 MiB/s wr, 630 op/s 2023-10-08T12:55:10.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:10 smithi059 ceph-mon[98489]: pgmap v748: 97 pgs: 97 active+clean; 848 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 33 MiB/s wr, 630 op/s 2023-10-08T12:55:10.937 INFO:tasks.workunit.client.0.smithi059.stdout: 10 17061 26.98 MB/sec warmup 41 sec latency 63.262 ms 2023-10-08T12:55:11.938 INFO:tasks.workunit.client.0.smithi059.stdout: 10 17317 26.72 MB/sec warmup 42 sec latency 164.193 ms 2023-10-08T12:55:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:12 smithi092 ceph-mon[134093]: pgmap v749: 97 pgs: 97 active+clean; 824 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 30 MiB/s wr, 694 op/s 2023-10-08T12:55:12.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:12 smithi173 ceph-mon[135182]: pgmap v749: 97 pgs: 97 active+clean; 824 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 30 MiB/s wr, 694 op/s 2023-10-08T12:55:12.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:12 smithi059 ceph-mon[98489]: pgmap v749: 97 pgs: 97 active+clean; 824 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 30 MiB/s wr, 694 op/s 2023-10-08T12:55:12.938 INFO:tasks.workunit.client.0.smithi059.stdout: 10 17509 26.19 MB/sec warmup 43 sec latency 190.884 ms 2023-10-08T12:55:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:13 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:55:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:13 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:55:13.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:13 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:55:13.938 INFO:tasks.workunit.client.0.smithi059.stdout: 10 17708 25.68 MB/sec warmup 44 sec latency 279.967 ms 2023-10-08T12:55:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:14 smithi173 ceph-mon[135182]: pgmap v750: 97 pgs: 97 active+clean; 815 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 27 MiB/s wr, 665 op/s 2023-10-08T12:55:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:14 smithi173 ceph-mon[135182]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T12:55:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:14 smithi059 ceph-mon[98489]: pgmap v750: 97 pgs: 97 active+clean; 815 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 27 MiB/s wr, 665 op/s 2023-10-08T12:55:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:14 smithi059 ceph-mon[98489]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T12:55:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:14 smithi092 ceph-mon[134093]: pgmap v750: 97 pgs: 97 active+clean; 815 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 27 MiB/s wr, 665 op/s 2023-10-08T12:55:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:14 smithi092 ceph-mon[134093]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T12:55:14.938 INFO:tasks.workunit.client.0.smithi059.stdout: 10 18102 25.58 MB/sec warmup 45 sec latency 45.848 ms 2023-10-08T12:55:15.938 INFO:tasks.workunit.client.0.smithi059.stdout: 10 18729 25.44 MB/sec warmup 46 sec latency 84.336 ms 2023-10-08T12:55:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:16 smithi173 ceph-mon[135182]: pgmap v752: 97 pgs: 97 active+clean; 823 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 21 MiB/s wr, 569 op/s 2023-10-08T12:55:16.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:16 smithi059 ceph-mon[98489]: pgmap v752: 97 pgs: 97 active+clean; 823 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 21 MiB/s wr, 569 op/s 2023-10-08T12:55:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:16 smithi092 ceph-mon[134093]: pgmap v752: 97 pgs: 97 active+clean; 823 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 21 MiB/s wr, 569 op/s 2023-10-08T12:55:16.938 INFO:tasks.workunit.client.0.smithi059.stdout: 10 19241 25.43 MB/sec warmup 47 sec latency 144.479 ms 2023-10-08T12:55:17.938 INFO:tasks.workunit.client.0.smithi059.stdout: 10 19928 25.94 MB/sec warmup 48 sec latency 72.148 ms 2023-10-08T12:55:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:18 smithi173 ceph-mon[135182]: pgmap v753: 97 pgs: 97 active+clean; 834 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 499 op/s 2023-10-08T12:55:18.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:18 smithi059 ceph-mon[98489]: pgmap v753: 97 pgs: 97 active+clean; 834 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 499 op/s 2023-10-08T12:55:18.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:18 smithi092 ceph-mon[134093]: pgmap v753: 97 pgs: 97 active+clean; 834 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 499 op/s 2023-10-08T12:55:18.938 INFO:tasks.workunit.client.0.smithi059.stdout: 10 20194 25.88 MB/sec warmup 49 sec latency 371.204 ms 2023-10-08T12:55:19.938 INFO:tasks.workunit.client.0.smithi059.stdout: 10 20508 25.81 MB/sec warmup 50 sec latency 165.019 ms 2023-10-08T12:55:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:19 smithi173 ceph-mon[135182]: pgmap v754: 97 pgs: 97 active+clean; 846 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.5 MiB/s wr, 393 op/s 2023-10-08T12:55:20.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:19 smithi059 ceph-mon[98489]: pgmap v754: 97 pgs: 97 active+clean; 846 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.5 MiB/s wr, 393 op/s 2023-10-08T12:55:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:19 smithi092 ceph-mon[134093]: pgmap v754: 97 pgs: 97 active+clean; 846 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.5 MiB/s wr, 393 op/s 2023-10-08T12:55:20.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 20778 25.54 MB/sec warmup 51 sec latency 151.236 ms 2023-10-08T12:55:21.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 20942 25.10 MB/sec warmup 52 sec latency 319.852 ms 2023-10-08T12:55:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:22 smithi092 ceph-mon[134093]: pgmap v755: 97 pgs: 97 active+clean; 816 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 318 op/s 2023-10-08T12:55:22.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:22 smithi173 ceph-mon[135182]: pgmap v755: 97 pgs: 97 active+clean; 816 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 318 op/s 2023-10-08T12:55:22.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:22 smithi059 ceph-mon[98489]: pgmap v755: 97 pgs: 97 active+clean; 816 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 318 op/s 2023-10-08T12:55:22.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 21181 24.72 MB/sec warmup 53 sec latency 554.377 ms 2023-10-08T12:55:23.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 21660 24.88 MB/sec warmup 54 sec latency 141.938 ms 2023-10-08T12:55:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:24 smithi092 ceph-mon[134093]: pgmap v756: 97 pgs: 97 active+clean; 776 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 272 op/s 2023-10-08T12:55:24.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:24 smithi173 ceph-mon[135182]: pgmap v756: 97 pgs: 97 active+clean; 776 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 272 op/s 2023-10-08T12:55:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:24 smithi059 ceph-mon[98489]: pgmap v756: 97 pgs: 97 active+clean; 776 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 272 op/s 2023-10-08T12:55:24.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 22397 24.80 MB/sec warmup 55 sec latency 40.150 ms 2023-10-08T12:55:25.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 22916 25.13 MB/sec warmup 56 sec latency 158.915 ms 2023-10-08T12:55:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:26 smithi092 ceph-mon[134093]: pgmap v757: 97 pgs: 97 active+clean; 782 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 266 op/s 2023-10-08T12:55:26.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:26 smithi173 ceph-mon[135182]: pgmap v757: 97 pgs: 97 active+clean; 782 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 266 op/s 2023-10-08T12:55:26.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:26 smithi059 ceph-mon[98489]: pgmap v757: 97 pgs: 97 active+clean; 782 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 266 op/s 2023-10-08T12:55:26.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 23573 25.49 MB/sec warmup 57 sec latency 175.865 ms 2023-10-08T12:55:27.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 23842 25.33 MB/sec warmup 58 sec latency 171.988 ms 2023-10-08T12:55:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:28 smithi092 ceph-mon[134093]: pgmap v758: 97 pgs: 97 active+clean; 796 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.3 MiB/s wr, 279 op/s 2023-10-08T12:55:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:28 smithi173 ceph-mon[135182]: pgmap v758: 97 pgs: 97 active+clean; 796 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.3 MiB/s wr, 279 op/s 2023-10-08T12:55:28.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:28 smithi059 ceph-mon[98489]: pgmap v758: 97 pgs: 97 active+clean; 796 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.3 MiB/s wr, 279 op/s 2023-10-08T12:55:28.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 24093 25.09 MB/sec warmup 59 sec latency 67.284 ms 2023-10-08T12:55:29.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 24347 24.84 MB/sec warmup 60 sec latency 197.173 ms 2023-10-08T12:55:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:29 smithi173 ceph-mon[135182]: pgmap v759: 97 pgs: 97 active+clean; 800 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 254 op/s 2023-10-08T12:55:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:29 smithi059 ceph-mon[98489]: pgmap v759: 97 pgs: 97 active+clean; 800 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 254 op/s 2023-10-08T12:55:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:29 smithi092 ceph-mon[134093]: pgmap v759: 97 pgs: 97 active+clean; 800 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 254 op/s 2023-10-08T12:55:30.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 24648 24.58 MB/sec warmup 61 sec latency 240.644 ms 2023-10-08T12:55:31.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 25202 24.72 MB/sec warmup 62 sec latency 134.041 ms 2023-10-08T12:55:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:32 smithi092 ceph-mon[134093]: pgmap v760: 97 pgs: 97 active+clean; 811 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.3 MiB/s wr, 268 op/s 2023-10-08T12:55:32.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:32 smithi173 ceph-mon[135182]: pgmap v760: 97 pgs: 97 active+clean; 811 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.3 MiB/s wr, 268 op/s 2023-10-08T12:55:32.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:32 smithi059 ceph-mon[98489]: pgmap v760: 97 pgs: 97 active+clean; 811 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.3 MiB/s wr, 268 op/s 2023-10-08T12:55:32.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 25826 24.57 MB/sec warmup 63 sec latency 168.830 ms 2023-10-08T12:55:33.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 26358 24.87 MB/sec warmup 64 sec latency 184.367 ms 2023-10-08T12:55:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:34 smithi092 ceph-mon[134093]: pgmap v761: 97 pgs: 97 active+clean; 823 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.2 MiB/s wr, 276 op/s 2023-10-08T12:55:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:34 smithi173 ceph-mon[135182]: pgmap v761: 97 pgs: 97 active+clean; 823 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.2 MiB/s wr, 276 op/s 2023-10-08T12:55:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:34 smithi059 ceph-mon[98489]: pgmap v761: 97 pgs: 97 active+clean; 823 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.2 MiB/s wr, 276 op/s 2023-10-08T12:55:34.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 26943 25.07 MB/sec warmup 65 sec latency 165.785 ms 2023-10-08T12:55:35.939 INFO:tasks.workunit.client.0.smithi059.stdout: 10 27296 25.04 MB/sec warmup 66 sec latency 146.546 ms 2023-10-08T12:55:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:36 smithi092 ceph-mon[134093]: pgmap v762: 97 pgs: 97 active+clean; 826 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 263 op/s 2023-10-08T12:55:36.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:36 smithi173 ceph-mon[135182]: pgmap v762: 97 pgs: 97 active+clean; 826 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 263 op/s 2023-10-08T12:55:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:36 smithi059 ceph-mon[98489]: pgmap v762: 97 pgs: 97 active+clean; 826 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 263 op/s 2023-10-08T12:55:36.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:55:36.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.933+0000 7f7e355ff700 1 -- 172.21.15.59:0/3567049814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e30106740 msgr2=0x7f7e30106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:36.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.933+0000 7f7e355ff700 1 --2- 172.21.15.59:0/3567049814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e30106740 0x7f7e30106b20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009990 tx=0x7f7e20009ca0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.934+0000 7f7e355ff700 1 -- 172.21.15.59:0/3567049814 shutdown_connections 2023-10-08T12:55:36.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.934+0000 7f7e355ff700 1 --2- 172.21.15.59:0/3567049814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e301010f0 0x7f7e3010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.934+0000 7f7e355ff700 1 --2- 172.21.15.59:0/3567049814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e30106740 0x7f7e30106b20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.934+0000 7f7e355ff700 1 --2- 172.21.15.59:0/3567049814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e30100730 0x7f7e30100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.934+0000 7f7e355ff700 1 -- 172.21.15.59:0/3567049814 >> 172.21.15.59:0/3567049814 conn(0x7f7e300fc200 msgr2=0x7f7e300fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:36.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.934+0000 7f7e355ff700 1 -- 172.21.15.59:0/3567049814 shutdown_connections 2023-10-08T12:55:36.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.934+0000 7f7e355ff700 1 -- 172.21.15.59:0/3567049814 wait complete. 2023-10-08T12:55:36.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.935+0000 7f7e355ff700 1 Processor -- start 2023-10-08T12:55:36.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.935+0000 7f7e355ff700 1 -- start start 2023-10-08T12:55:36.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.935+0000 7f7e355ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e30100730 0x7f7e3019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.935+0000 7f7e355ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e301010f0 0x7f7e3019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.935+0000 7f7e355ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e30106740 0x7f7e301969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.935+0000 7f7e355ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e30197020 con 0x7f7e30106740 2023-10-08T12:55:36.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.935+0000 7f7e355ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e30197190 con 0x7f7e30100730 2023-10-08T12:55:36.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e355ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e30197350 con 0x7f7e301010f0 2023-10-08T12:55:36.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e30100730 0x7f7e3019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e30100730 0x7f7e3019c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54286/0 (socket says 172.21.15.59:54286) 2023-10-08T12:55:36.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2effd700 1 -- 172.21.15.59:0/2046656567 learned_addr learned my addr 172.21.15.59:0/2046656567 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:36.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2e7fc700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e301010f0 0x7f7e3019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2f7fe700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e30106740 0x7f7e301969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2effd700 1 -- 172.21.15.59:0/2046656567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e301010f0 msgr2=0x7f7e3019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:36.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2effd700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e301010f0 0x7f7e3019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2effd700 1 -- 172.21.15.59:0/2046656567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e30106740 msgr2=0x7f7e301969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:36.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2effd700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e30106740 0x7f7e301969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2effd700 1 -- 172.21.15.59:0/2046656567 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e200095f0 con 0x7f7e30100730 2023-10-08T12:55:36.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2f7fe700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e30106740 0x7f7e301969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:36.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.936+0000 7f7e2effd700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e30100730 0x7f7e3019c890 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7e20000c00 tx=0x7f7e20005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:36.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.937+0000 7f7e17fff700 1 -- 172.21.15.59:0/2046656567 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2001d070 con 0x7f7e30100730 2023-10-08T12:55:36.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.937+0000 7f7e355ff700 1 -- 172.21.15.59:0/2046656567 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e301975d0 con 0x7f7e30100730 2023-10-08T12:55:36.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.937+0000 7f7e17fff700 1 -- 172.21.15.59:0/2046656567 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e20022470 con 0x7f7e30100730 2023-10-08T12:55:36.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.937+0000 7f7e17fff700 1 -- 172.21.15.59:0/2046656567 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20017650 con 0x7f7e30100730 2023-10-08T12:55:36.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.937+0000 7f7e355ff700 1 -- 172.21.15.59:0/2046656567 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e301a3880 con 0x7f7e30100730 2023-10-08T12:55:36.940 INFO:tasks.workunit.client.0.smithi059.stdout: 10 27600 24.91 MB/sec warmup 67 sec latency 69.463 ms 2023-10-08T12:55:36.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.942+0000 7f7e17fff700 1 -- 172.21.15.59:0/2046656567 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7e200225e0 con 0x7f7e30100730 2023-10-08T12:55:36.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.942+0000 7f7e48e8bb80 1 Processor -- start 2023-10-08T12:55:36.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.942+0000 7f7e48e8bb80 1 -- start start 2023-10-08T12:55:36.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.943+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188239260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.943+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x556188244110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.943+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x556188246a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.943+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561881a2460 con 0x556188244650 2023-10-08T12:55:36.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.943+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188193c20 con 0x5561882397a0 2023-10-08T12:55:36.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.943+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188191540 con 0x556188238e80 2023-10-08T12:55:36.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.943+0000 7f7e2f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188239260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.943+0000 7f7e2effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x556188244110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.943+0000 7f7e2f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188239260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38326/0 (socket says 172.21.15.59:38326) 2023-10-08T12:55:36.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.943+0000 7f7e2f7fe700 1 -- 172.21.15.59:0/134183064 learned_addr learned my addr 172.21.15.59:0/134183064 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:36.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.943+0000 7f7e2e7fc700 1 --2- 172.21.15.59:0/134183064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x556188246a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e17fff700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e180a15f0 0x7f7e180a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e2f7fe700 1 -- 172.21.15.59:0/134183064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 msgr2=0x556188244110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:36.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e2f7fe700 1 --2- 172.21.15.59:0/134183064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x556188244110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e2f7fe700 1 -- 172.21.15.59:0/134183064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 msgr2=0x556188246a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:36.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e2f7fe700 1 --2- 172.21.15.59:0/134183064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x556188246a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e2f7fe700 1 -- 172.21.15.59:0/134183064 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556187fb7de0 con 0x556188238e80 2023-10-08T12:55:36.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e17fff700 1 -- 172.21.15.59:0/2046656567 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7e200ce3b0 con 0x7f7e30100730 2023-10-08T12:55:36.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e2f7fe700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e180a15f0 0x7f7e180a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e2f7fe700 1 --2- 172.21.15.59:0/134183064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188239260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009470 tx=0x7f7e28009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3e07c01de5ba447 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:36.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e157fa700 1 -- 172.21.15.59:0/134183064 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2801b030 con 0x556188238e80 2023-10-08T12:55:36.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e157fa700 1 -- 172.21.15.59:0/134183064 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e2800f040 con 0x556188238e80 2023-10-08T12:55:36.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.944+0000 7f7e157fa700 1 -- 172.21.15.59:0/134183064 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2800e070 con 0x556188238e80 2023-10-08T12:55:36.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.945+0000 7f7e2f7fe700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e180a15f0 0x7f7e180a3ab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7e2801b000 tx=0x7f7e28014b80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:36.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.945+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/134183064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 msgr2=0x556188239260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:36.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.945+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/134183064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188239260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009470 tx=0x7f7e28009920 comp rx=0 tx=0).stop 2023-10-08T12:55:36.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.945+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/134183064 shutdown_connections 2023-10-08T12:55:36.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.945+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/134183064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x556188246a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.945+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/134183064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188239260 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.945+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/134183064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x556188244110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.945+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/134183064 >> 172.21.15.59:0/134183064 conn(0x5561881ae260 msgr2=0x5561882352d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:36.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.945+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/134183064 shutdown_connections 2023-10-08T12:55:36.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.945+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/134183064 wait complete. 2023-10-08T12:55:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.946+0000 7f7e48e8bb80 1 -- start start 2023-10-08T12:55:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.946+0000 7f7e48e8bb80 1 Processor -- start 2023-10-08T12:55:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556188238e80 0x556188241450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561882397a0 0x556188241990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188244650 0x556188241ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55618818ce30 con 0x5561882397a0 2023-10-08T12:55:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188129710 con 0x556188238e80 2023-10-08T12:55:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561881293b0 con 0x556188244650 2023-10-08T12:55:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e48e8bb80 10 client.0 _ll_register_callbacks cb 0x556187f86800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e2effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556188238e80 0x556188241450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e2f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188244650 0x556188241ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e2effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556188238e80 0x556188241450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54310/0 (socket says 172.21.15.59:54310) 2023-10-08T12:55:36.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e2effd700 1 -- 172.21.15.59:0/3807928388 learned_addr learned my addr 172.21.15.59:0/3807928388 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:36.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e2e7fc700 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561882397a0 0x556188241990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e2effd700 1 -- 172.21.15.59:0/3807928388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188244650 msgr2=0x556188241ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:36.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e2effd700 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188244650 0x556188241ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e2effd700 1 -- 172.21.15.59:0/3807928388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561882397a0 msgr2=0x556188241990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:36.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e2effd700 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561882397a0 0x556188241990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.947+0000 7f7e2effd700 1 -- 172.21.15.59:0/3807928388 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e280090f0 con 0x556188238e80 2023-10-08T12:55:36.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.948+0000 7f7e2f7fe700 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188244650 0x556188241ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:36.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.948+0000 7f7e2effd700 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556188238e80 0x556188241450 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7e20006010 tx=0x7f7e200cc0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2039fc59fce562b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:36.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.948+0000 7f7e12ff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:55:36.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.948+0000 7f7e12ff5700 1 -- 172.21.15.59:0/3807928388 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e200d8310 con 0x556188238e80 2023-10-08T12:55:36.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.948+0000 7f7e12ff5700 1 -- 172.21.15.59:0/3807928388 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7e2009bb70 con 0x556188238e80 2023-10-08T12:55:36.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.948+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/3807928388 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556188154eb0 con 0x556188238e80 2023-10-08T12:55:36.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.948+0000 7f7e12ff5700 1 -- 172.21.15.59:0/3807928388 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e200977b0 con 0x556188238e80 2023-10-08T12:55:36.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.948+0000 7f7e48e8bb80 10 client.27542 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:36.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.948+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/3807928388 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x556187fa0c60 con 0x556188238e80 2023-10-08T12:55:36.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.948+0000 7f7e12ff5700 1 -- 172.21.15.59:0/3807928388 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556188154eb0 con 0x556188238e80 2023-10-08T12:55:36.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.949+0000 7f7e12ff5700 1 -- 172.21.15.59:0/3807928388 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7e2009a960 con 0x556188238e80 2023-10-08T12:55:36.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.949+0000 7f7e48e8bb80 10 client.27542 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:36.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.949+0000 7f7e48e8bb80 10 client.27542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:36.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.949+0000 7f7e48e8bb80 20 client.27542 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:36.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.949+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556188253f30 0x556188256320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.949+0000 7f7e48e8bb80 4 client.27542 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:55:36.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.949+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/3807928388 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556188185e10 con 0x556188253f30 2023-10-08T12:55:36.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.949+0000 7f7e2e7fc700 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556188253f30 0x556188256320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.949+0000 7f7e2e7fc700 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556188253f30 0x556188256320 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d96a9cc4e70d8f73 server_cookie=fd255b36ca7d58b3 in_seq=0 out_seq=0 2023-10-08T12:55:36.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.949+0000 7f7e12ff5700 10 client.27542 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:36.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e12ff5700 1 -- 172.21.15.59:0/3807928388 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556188185e10 con 0x556188253f30 2023-10-08T12:55:36.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e12ff5700 10 client.27542 handle_command_reply: tid=0 2023-10-08T12:55:36.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e48e8bb80 1 client.27542 shutdown 2023-10-08T12:55:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/3807928388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556188238e80 msgr2=0x556188241450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556188238e80 0x556188241450 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7e20006010 tx=0x7f7e200cc0b0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/3807928388 shutdown_connections 2023-10-08T12:55:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556188253f30 0x556188256320 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556188238e80 0x556188241450 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188244650 0x556188241ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/3807928388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561882397a0 0x556188241990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e12ff5700 0 client.27542 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/3807928388 >> 172.21.15.59:0/3807928388 conn(0x5561881ae260 msgr2=0x556188234ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/3807928388 shutdown_connections 2023-10-08T12:55:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.952+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/3807928388 wait complete. 2023-10-08T12:55:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.953+0000 7f7e48e8bb80 20 client.27542 trim_cache size 0 max 16384 2023-10-08T12:55:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.972+0000 7f7e48e8bb80 1 Processor -- start 2023-10-08T12:55:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.972+0000 7f7e48e8bb80 1 -- start start 2023-10-08T12:55:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.972+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188235480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.972+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x556188241cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.972+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x55618823e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.972+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55618800d920 con 0x556188244650 2023-10-08T12:55:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.972+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188239b80 con 0x5561882397a0 2023-10-08T12:55:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.972+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55618823a0d0 con 0x556188238e80 2023-10-08T12:55:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.972+0000 7f7e2effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188235480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.972+0000 7f7e2effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188235480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38340/0 (socket says 172.21.15.59:38340) 2023-10-08T12:55:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e2effd700 1 -- 172.21.15.59:0/1455339408 learned_addr learned my addr 172.21.15.59:0/1455339408 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e2e7fc700 1 --2- 172.21.15.59:0/1455339408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x556188241cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e2f7fe700 1 --2- 172.21.15.59:0/1455339408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x55618823e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e2effd700 1 -- 172.21.15.59:0/1455339408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 msgr2=0x556188241cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e2effd700 1 --2- 172.21.15.59:0/1455339408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x556188241cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e2effd700 1 -- 172.21.15.59:0/1455339408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 msgr2=0x55618823e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e2effd700 1 --2- 172.21.15.59:0/1455339408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x55618823e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e2effd700 1 -- 172.21.15.59:0/1455339408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561882312a0 con 0x556188238e80 2023-10-08T12:55:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e2effd700 1 --2- 172.21.15.59:0/1455339408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188235480 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7e200a3240 tx=0x7f7e200d1f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd3cb011c1a7f119 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e15ffb700 1 -- 172.21.15.59:0/1455339408 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e200b3ea0 con 0x556188238e80 2023-10-08T12:55:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e15ffb700 1 -- 172.21.15.59:0/1455339408 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e200977b0 con 0x556188238e80 2023-10-08T12:55:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.973+0000 7f7e15ffb700 1 -- 172.21.15.59:0/1455339408 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2009bb70 con 0x556188238e80 2023-10-08T12:55:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.974+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/1455339408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 msgr2=0x556188235480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.974+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/1455339408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188235480 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7e200a3240 tx=0x7f7e200d1f60 comp rx=0 tx=0).stop 2023-10-08T12:55:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.974+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/1455339408 shutdown_connections 2023-10-08T12:55:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.974+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/1455339408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x55618823e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.974+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/1455339408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x556188235480 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.974+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/1455339408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x556188241cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.974+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/1455339408 >> 172.21.15.59:0/1455339408 conn(0x5561881ae260 msgr2=0x556188234d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.974+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/1455339408 shutdown_connections 2023-10-08T12:55:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.974+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/1455339408 wait complete. 2023-10-08T12:55:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.975+0000 7f7e48e8bb80 1 -- start start 2023-10-08T12:55:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.975+0000 7f7e48e8bb80 1 Processor -- start 2023-10-08T12:55:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.975+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x55618829ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.975+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x5561882a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.975+0000 7f7e48e8bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x556188247170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.975+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188247730 con 0x556188244650 2023-10-08T12:55:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.975+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561882478a0 con 0x5561882397a0 2023-10-08T12:55:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.975+0000 7f7e48e8bb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188247a60 con 0x556188238e80 2023-10-08T12:55:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.975+0000 7f7e48e8bb80 10 client.0 _ll_register_callbacks cb 0x7f7e200092d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e2e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x5561882a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e2f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x556188247170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e2e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x5561882a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54328/0 (socket says 172.21.15.59:54328) 2023-10-08T12:55:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e2e7fc700 1 -- 172.21.15.59:0/2648675453 learned_addr learned my addr 172.21.15.59:0/2648675453 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e2effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x55618829ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e2e7fc700 1 -- 172.21.15.59:0/2648675453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 msgr2=0x55618829ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e2e7fc700 1 --2- 172.21.15.59:0/2648675453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x55618829ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e2e7fc700 1 -- 172.21.15.59:0/2648675453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 msgr2=0x556188247170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e2e7fc700 1 --2- 172.21.15.59:0/2648675453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x556188247170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e2e7fc700 1 -- 172.21.15.59:0/2648675453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556187fa0c60 con 0x5561882397a0 2023-10-08T12:55:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e2e7fc700 1 --2- 172.21.15.59:0/2648675453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x5561882a0440 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x556188256bf0 tx=0x7f7e240094b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db223972db4de582 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.976+0000 7f7e12ff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:55:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e12ff5700 1 -- 172.21.15.59:0/2648675453 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24017070 con 0x5561882397a0 2023-10-08T12:55:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/2648675453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556188234b60 con 0x5561882397a0 2023-10-08T12:55:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e12ff5700 1 -- 172.21.15.59:0/2648675453 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7e2401e980 con 0x5561882397a0 2023-10-08T12:55:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e12ff5700 1 -- 172.21.15.59:0/2648675453 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e2401eb40 con 0x5561882397a0 2023-10-08T12:55:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e48e8bb80 10 client.27548 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/2648675453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x556187fde250 con 0x5561882397a0 2023-10-08T12:55:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e12ff5700 1 -- 172.21.15.59:0/2648675453 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556188234b60 con 0x5561882397a0 2023-10-08T12:55:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e12ff5700 1 -- 172.21.15.59:0/2648675453 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7e24027470 con 0x5561882397a0 2023-10-08T12:55:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e48e8bb80 10 client.27548 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e48e8bb80 10 client.27548 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e48e8bb80 20 client.27548 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/2648675453 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561882a8fc0 0x5561882ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e48e8bb80 4 client.27548 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:55:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.977+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/2648675453 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f7e2800f040 con 0x5561882a8fc0 2023-10-08T12:55:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.978+0000 7f7e2effd700 1 --2- 172.21.15.59:0/2648675453 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561882a8fc0 0x5561882ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.978+0000 7f7e2effd700 1 --2- 172.21.15.59:0/2648675453 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561882a8fc0 0x5561882ab3e0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba56f3745bb9c981 server_cookie=4f37c846719d4fbc in_seq=0 out_seq=0 2023-10-08T12:55:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.978+0000 7f7e12ff5700 10 client.27548 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:36.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e12ff5700 1 -- 172.21.15.59:0/2648675453 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f7e2800f040 con 0x5561882a8fc0 2023-10-08T12:55:36.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e12ff5700 10 client.27548 handle_command_reply: tid=0 2023-10-08T12:55:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 1 client.27548 shutdown 2023-10-08T12:55:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/2648675453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 msgr2=0x5561882a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/2648675453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x5561882a0440 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x556188256bf0 tx=0x7f7e240094b0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/2648675453 shutdown_connections 2023-10-08T12:55:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/2648675453 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561882a8fc0 0x5561882ab3e0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/2648675453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556188244650 0x556188247170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/2648675453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556188238e80 0x55618829ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 1 --2- 172.21.15.59:0/2648675453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561882397a0 0x5561882a0440 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e12ff5700 0 client.27548 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/2648675453 >> 172.21.15.59:0/2648675453 conn(0x5561881ae260 msgr2=0x55618823fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:36.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/2648675453 shutdown_connections 2023-10-08T12:55:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 1 -- 172.21.15.59:0/2648675453 wait complete. 2023-10-08T12:55:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.983+0000 7f7e48e8bb80 20 client.27548 trim_cache size 0 max 16384 2023-10-08T12:55:36.986 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:55:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:55:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:55:36.986 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:55:36.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 -- 172.21.15.59:0/2046656567 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e180a15f0 msgr2=0x7f7e180a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:36.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e180a15f0 0x7f7e180a3ab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7e2801b000 tx=0x7f7e28014b80 comp rx=0 tx=0).stop 2023-10-08T12:55:36.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 -- 172.21.15.59:0/2046656567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e30100730 msgr2=0x7f7e3019c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:36.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e30100730 0x7f7e3019c890 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7e20000c00 tx=0x7f7e20005740 comp rx=0 tx=0).stop 2023-10-08T12:55:36.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 -- 172.21.15.59:0/2046656567 shutdown_connections 2023-10-08T12:55:36.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e180a15f0 0x7f7e180a3ab0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e30100730 0x7f7e3019c890 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e30106740 0x7f7e301969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 --2- 172.21.15.59:0/2046656567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e301010f0 0x7f7e3019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 -- 172.21.15.59:0/2046656567 >> 172.21.15.59:0/2046656567 conn(0x7f7e300fc200 msgr2=0x7f7e300fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 -- 172.21.15.59:0/2046656567 shutdown_connections 2023-10-08T12:55:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:36.984+0000 7f7e355ff700 1 -- 172.21.15.59:0/2046656567 wait complete. 2023-10-08T12:55:37.004 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:55:37.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:55:37.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.219+0000 7fc5197ff700 1 -- 172.21.15.59:0/2722268219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc514106640 msgr2=0x7fc514106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.219+0000 7fc5197ff700 1 --2- 172.21.15.59:0/2722268219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc514106640 0x7fc514106a20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc504009990 tx=0x7fc504009ca0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.219+0000 7fc5197ff700 1 -- 172.21.15.59:0/2722268219 shutdown_connections 2023-10-08T12:55:37.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.219+0000 7fc5197ff700 1 --2- 172.21.15.59:0/2722268219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc514106640 0x7fc514106a20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.219+0000 7fc5197ff700 1 --2- 172.21.15.59:0/2722268219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc514100ff0 0x7fc51410d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.219+0000 7fc5197ff700 1 --2- 172.21.15.59:0/2722268219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc514100630 0x7fc514100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.219+0000 7fc5197ff700 1 -- 172.21.15.59:0/2722268219 >> 172.21.15.59:0/2722268219 conn(0x7fc5140fc140 msgr2=0x7fc5140fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:37.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.219+0000 7fc5197ff700 1 -- 172.21.15.59:0/2722268219 shutdown_connections 2023-10-08T12:55:37.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.219+0000 7fc5197ff700 1 -- 172.21.15.59:0/2722268219 wait complete. 2023-10-08T12:55:37.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.220+0000 7fc5197ff700 1 Processor -- start 2023-10-08T12:55:37.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.221+0000 7fc5197ff700 1 -- start start 2023-10-08T12:55:37.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.221+0000 7fc5197ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc514100630 0x7fc51419e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.221+0000 7fc5197ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc514100ff0 0x7fc51419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.221+0000 7fc5197ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc514106640 0x7fc514198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.221+0000 7fc5197ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5141991a0 con 0x7fc514100630 2023-10-08T12:55:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.221+0000 7fc5197ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc514199310 con 0x7fc514106640 2023-10-08T12:55:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.221+0000 7fc5197ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5141994d0 con 0x7fc514100ff0 2023-10-08T12:55:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.222+0000 7fc50bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc514100ff0 0x7fc51419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.222+0000 7fc5137fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc514106640 0x7fc514198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.222+0000 7fc50bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc514100ff0 0x7fc51419ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38356/0 (socket says 172.21.15.59:38356) 2023-10-08T12:55:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.222+0000 7fc50bfff700 1 -- 172.21.15.59:0/2163160881 learned_addr learned my addr 172.21.15.59:0/2163160881 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.222+0000 7fc512ffd700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc514100630 0x7fc51419e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.222+0000 7fc50bfff700 1 -- 172.21.15.59:0/2163160881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc514106640 msgr2=0x7fc514198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.222+0000 7fc50bfff700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc514106640 0x7fc514198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.222+0000 7fc50bfff700 1 -- 172.21.15.59:0/2163160881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc514100630 msgr2=0x7fc51419e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.222+0000 7fc50bfff700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc514100630 0x7fc51419e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.222+0000 7fc50bfff700 1 -- 172.21.15.59:0/2163160881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5040095f0 con 0x7fc514100ff0 2023-10-08T12:55:37.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.223+0000 7fc50bfff700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc514100ff0 0x7fc51419ef00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00e9a0 tx=0x7fc4fc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:37.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.223+0000 7fc510ff9700 1 -- 172.21.15.59:0/2163160881 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc009790 con 0x7fc514100ff0 2023-10-08T12:55:37.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.223+0000 7fc510ff9700 1 -- 172.21.15.59:0/2163160881 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4fc010430 con 0x7fc514100ff0 2023-10-08T12:55:37.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.223+0000 7fc5197ff700 1 -- 172.21.15.59:0/2163160881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5141997b0 con 0x7fc514100ff0 2023-10-08T12:55:37.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.223+0000 7fc510ff9700 1 -- 172.21.15.59:0/2163160881 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc018680 con 0x7fc514100ff0 2023-10-08T12:55:37.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.223+0000 7fc5197ff700 1 -- 172.21.15.59:0/2163160881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5141a59b0 con 0x7fc514100ff0 2023-10-08T12:55:37.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.224+0000 7fc5197ff700 1 -- 172.21.15.59:0/2163160881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc514101d70 con 0x7fc514100ff0 2023-10-08T12:55:37.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.226+0000 7fc510ff9700 1 -- 172.21.15.59:0/2163160881 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc4fc0105a0 con 0x7fc514100ff0 2023-10-08T12:55:37.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.227+0000 7fc510ff9700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5000a15f0 0x7fc5000a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.228+0000 7fc510ff9700 1 -- 172.21.15.59:0/2163160881 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fc4fc014070 con 0x7fc514100ff0 2023-10-08T12:55:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.228+0000 7fc512ffd700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5000a15f0 0x7fc5000a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.228+0000 7fc512ffd700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5000a15f0 0x7fc5000a3ab0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc504006010 tx=0x7fc50400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:37.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.229+0000 7fc510ff9700 1 -- 172.21.15.59:0/2163160881 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc4fc0965f0 con 0x7fc514100ff0 2023-10-08T12:55:37.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.505+0000 7fc5197ff700 1 -- 172.21.15.59:0/2163160881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc514067450 con 0x7fc514100ff0 2023-10-08T12:55:37.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.506+0000 7fc510ff9700 1 -- 172.21.15.59:0/2163160881 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fc4fc0cc090 con 0x7fc514100ff0 2023-10-08T12:55:37.507 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:55:37.508 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:55:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.509+0000 7fc5197ff700 1 -- 172.21.15.59:0/2163160881 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5000a15f0 msgr2=0x7fc5000a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.509+0000 7fc5197ff700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5000a15f0 0x7fc5000a3ab0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc504006010 tx=0x7fc50400b260 comp rx=0 tx=0).stop 2023-10-08T12:55:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.509+0000 7fc5197ff700 1 -- 172.21.15.59:0/2163160881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc514100ff0 msgr2=0x7fc51419ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.509+0000 7fc5197ff700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc514100ff0 0x7fc51419ef00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00e9a0 tx=0x7fc4fc00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.510+0000 7fc5197ff700 1 -- 172.21.15.59:0/2163160881 shutdown_connections 2023-10-08T12:55:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.510+0000 7fc5197ff700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5000a15f0 0x7fc5000a3ab0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.510+0000 7fc5197ff700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc514106640 0x7fc514198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.510+0000 7fc5197ff700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc514100630 0x7fc51419e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.510+0000 7fc5197ff700 1 --2- 172.21.15.59:0/2163160881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc514100ff0 0x7fc51419ef00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.510+0000 7fc5197ff700 1 -- 172.21.15.59:0/2163160881 >> 172.21.15.59:0/2163160881 conn(0x7fc5140fc140 msgr2=0x7fc5140fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:37.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.510+0000 7fc5197ff700 1 -- 172.21.15.59:0/2163160881 shutdown_connections 2023-10-08T12:55:37.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.510+0000 7fc5197ff700 1 -- 172.21.15.59:0/2163160881 wait complete. 2023-10-08T12:55:37.512 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:55:37.531 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:55:37.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.765+0000 7f7d541ff700 1 -- 172.21.15.59:0/3910836310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d4c111750 msgr2=0x7f7d4c113b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.765+0000 7f7d541ff700 1 --2- 172.21.15.59:0/3910836310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d4c111750 0x7f7d4c113b40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009f90 tx=0x7f7d4400b330 comp rx=0 tx=0).stop 2023-10-08T12:55:37.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.765+0000 7f7d541ff700 1 -- 172.21.15.59:0/3910836310 shutdown_connections 2023-10-08T12:55:37.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.765+0000 7f7d541ff700 1 --2- 172.21.15.59:0/3910836310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d4c111750 0x7f7d4c113b40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.765+0000 7f7d541ff700 1 --2- 172.21.15.59:0/3910836310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d4c072b90 0x7f7d4c072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.765+0000 7f7d541ff700 1 --2- 172.21.15.59:0/3910836310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d4c0734b0 0x7f7d4c111210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.765+0000 7f7d541ff700 1 -- 172.21.15.59:0/3910836310 >> 172.21.15.59:0/3910836310 conn(0x7f7d4c0fc230 msgr2=0x7f7d4c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:37.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.765+0000 7f7d541ff700 1 -- 172.21.15.59:0/3910836310 shutdown_connections 2023-10-08T12:55:37.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.766+0000 7f7d541ff700 1 -- 172.21.15.59:0/3910836310 wait complete. 2023-10-08T12:55:37.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.766+0000 7f7d541ff700 1 Processor -- start 2023-10-08T12:55:37.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d541ff700 1 -- start start 2023-10-08T12:55:37.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d541ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d4c072b90 0x7f7d4c19d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d541ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d4c0734b0 0x7f7d4c19d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d541ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d4c111750 0x7f7d4c1a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d541ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1a2370 con 0x7f7d4c072b90 2023-10-08T12:55:37.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d541ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1a24e0 con 0x7f7d4c0734b0 2023-10-08T12:55:37.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d541ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1a26a0 con 0x7f7d4c111750 2023-10-08T12:55:37.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d5179a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d4c0734b0 0x7f7d4c19d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d5279c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d4c111750 0x7f7d4c1a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d5179a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d4c0734b0 0x7f7d4c19d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54372/0 (socket says 172.21.15.59:54372) 2023-10-08T12:55:37.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d5179a700 1 -- 172.21.15.59:0/1675783693 learned_addr learned my addr 172.21.15.59:0/1675783693 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:37.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.767+0000 7f7d51f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d4c072b90 0x7f7d4c19d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.768+0000 7f7d5179a700 1 -- 172.21.15.59:0/1675783693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d4c111750 msgr2=0x7f7d4c1a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.768+0000 7f7d5179a700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d4c111750 0x7f7d4c1a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.768+0000 7f7d5179a700 1 -- 172.21.15.59:0/1675783693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d4c072b90 msgr2=0x7f7d4c19d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.768+0000 7f7d5179a700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d4c072b90 0x7f7d4c19d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.768+0000 7f7d5179a700 1 -- 172.21.15.59:0/1675783693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d44009c40 con 0x7f7d4c0734b0 2023-10-08T12:55:37.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.768+0000 7f7d5179a700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d4c0734b0 0x7f7d4c19d990 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00e9c0 tx=0x7f7d3c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:37.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.768+0000 7f7d42ffd700 1 -- 172.21.15.59:0/1675783693 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c004a30 con 0x7f7d4c0734b0 2023-10-08T12:55:37.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.768+0000 7f7d42ffd700 1 -- 172.21.15.59:0/1675783693 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d3c00cc80 con 0x7f7d4c0734b0 2023-10-08T12:55:37.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.768+0000 7f7d541ff700 1 -- 172.21.15.59:0/1675783693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c1a2980 con 0x7f7d4c0734b0 2023-10-08T12:55:37.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.768+0000 7f7d42ffd700 1 -- 172.21.15.59:0/1675783693 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c0054e0 con 0x7f7d4c0734b0 2023-10-08T12:55:37.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.768+0000 7f7d541ff700 1 -- 172.21.15.59:0/1675783693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c1aa1c0 con 0x7f7d4c0734b0 2023-10-08T12:55:37.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.772+0000 7f7d42ffd700 1 -- 172.21.15.59:0/1675783693 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7d3c004b90 con 0x7f7d4c0734b0 2023-10-08T12:55:37.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.773+0000 7f7d67b2ab80 1 Processor -- start 2023-10-08T12:55:37.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.773+0000 7f7d42ffd700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d380a15f0 0x7f7d380a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.773+0000 7f7d67b2ab80 1 -- start start 2023-10-08T12:55:37.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d42ffd700 1 -- 172.21.15.59:0/1675783693 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7d3c014070 con 0x7f7d4c0734b0 2023-10-08T12:55:37.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d5279c700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d380a15f0 0x7f7d380a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x55584063a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584063a7a0 0x555840645110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x555840647a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558405a3460 con 0x55584063a7a0 2023-10-08T12:55:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555840594c20 con 0x555840645650 2023-10-08T12:55:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555840592540 con 0x555840639e80 2023-10-08T12:55:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d51f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x55584063a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d51f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x55584063a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38388/0 (socket says 172.21.15.59:38388) 2023-10-08T12:55:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d51f9b700 1 -- 172.21.15.59:0/945240631 learned_addr learned my addr 172.21.15.59:0/945240631 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d5179a700 1 --2- 172.21.15.59:0/945240631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584063a7a0 0x555840645110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.774+0000 7f7d5279c700 1 --2- 172.21.15.59:0/945240631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x555840647a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.775+0000 7f7d51f9b700 1 -- 172.21.15.59:0/945240631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 msgr2=0x555840647a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.775+0000 7f7d51f9b700 1 --2- 172.21.15.59:0/945240631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x555840647a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.775+0000 7f7d51f9b700 1 -- 172.21.15.59:0/945240631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584063a7a0 msgr2=0x555840645110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:37.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.775+0000 7f7d51f9b700 1 --2- 172.21.15.59:0/945240631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584063a7a0 0x555840645110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.775+0000 7f7d51f9b700 1 -- 172.21.15.59:0/945240631 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558403b8de0 con 0x555840639e80 2023-10-08T12:55:37.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.775+0000 7f7d5279c700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d380a15f0 0x7f7d380a3ab0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009790 tx=0x7f7d44009700 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:37.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.775+0000 7f7d51f9b700 1 --2- 172.21.15.59:0/945240631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x55584063a260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009db0 tx=0x7f7d48011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48b3784cda713cc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:37.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.775+0000 7f7d37fff700 1 -- 172.21.15.59:0/945240631 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48004230 con 0x555840639e80 2023-10-08T12:55:37.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.775+0000 7f7d37fff700 1 -- 172.21.15.59:0/945240631 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d48004390 con 0x555840639e80 2023-10-08T12:55:37.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.775+0000 7f7d37fff700 1 -- 172.21.15.59:0/945240631 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48019860 con 0x555840639e80 2023-10-08T12:55:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.776+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/945240631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 msgr2=0x55584063a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.776+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/945240631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x55584063a260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009db0 tx=0x7f7d48011720 comp rx=0 tx=0).stop 2023-10-08T12:55:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.776+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/945240631 shutdown_connections 2023-10-08T12:55:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.776+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/945240631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x555840647a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.776+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/945240631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x55584063a260 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.776+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/945240631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584063a7a0 0x555840645110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.776+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/945240631 >> 172.21.15.59:0/945240631 conn(0x5558405af260 msgr2=0x5558406362d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.776+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/945240631 shutdown_connections 2023-10-08T12:55:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.776+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/945240631 wait complete. 2023-10-08T12:55:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.777+0000 7f7d67b2ab80 1 -- start start 2023-10-08T12:55:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.777+0000 7f7d67b2ab80 1 Processor -- start 2023-10-08T12:55:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x555840644ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584063a7a0 0x555840642330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x5558406428f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584058de30 con 0x55584063a7a0 2023-10-08T12:55:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584052a710 con 0x555840645650 2023-10-08T12:55:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584052a3b0 con 0x555840639e80 2023-10-08T12:55:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d67b2ab80 10 client.0 _ll_register_callbacks cb 0x555840387800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d51f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x555840644ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d51f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x555840644ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38396/0 (socket says 172.21.15.59:38396) 2023-10-08T12:55:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d51f9b700 1 -- 172.21.15.59:0/1451907430 learned_addr learned my addr 172.21.15.59:0/1451907430 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d5179a700 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584063a7a0 0x555840642330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d5279c700 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x5558406428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d51f9b700 1 -- 172.21.15.59:0/1451907430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 msgr2=0x5558406428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d51f9b700 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x5558406428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.778+0000 7f7d51f9b700 1 -- 172.21.15.59:0/1451907430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584063a7a0 msgr2=0x555840642330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.779+0000 7f7d51f9b700 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584063a7a0 0x555840642330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.779+0000 7f7d51f9b700 1 -- 172.21.15.59:0/1451907430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d480099e0 con 0x555840639e80 2023-10-08T12:55:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.779+0000 7f7d5179a700 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584063a7a0 0x555840642330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.779+0000 7f7d51f9b700 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x555840644ff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d48000c00 tx=0x7f7d48009970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fdf4bf77a6d04fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.779+0000 7f7d357fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:55:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.779+0000 7f7d357fa700 1 -- 172.21.15.59:0/1451907430 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48005450 con 0x555840639e80 2023-10-08T12:55:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.779+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/1451907430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555840555eb0 con 0x555840639e80 2023-10-08T12:55:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.779+0000 7f7d357fa700 1 -- 172.21.15.59:0/1451907430 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7d48005ce0 con 0x555840639e80 2023-10-08T12:55:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.779+0000 7f7d357fa700 1 -- 172.21.15.59:0/1451907430 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d48004500 con 0x555840639e80 2023-10-08T12:55:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.779+0000 7f7d67b2ab80 10 client.27562 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.779+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/1451907430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5558403a1c60 con 0x555840639e80 2023-10-08T12:55:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.780+0000 7f7d357fa700 1 -- 172.21.15.59:0/1451907430 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555840555eb0 con 0x555840639e80 2023-10-08T12:55:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.780+0000 7f7d357fa700 1 -- 172.21.15.59:0/1451907430 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7d48021040 con 0x555840639e80 2023-10-08T12:55:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.780+0000 7f7d67b2ab80 10 client.27562 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.780+0000 7f7d67b2ab80 10 client.27562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.780+0000 7f7d67b2ab80 20 client.27562 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.780+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555840655000 0x5558406573f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.780+0000 7f7d67b2ab80 4 client.27562 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:55:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.780+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/1451907430 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555840586e10 con 0x555840655000 2023-10-08T12:55:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.780+0000 7f7d5179a700 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555840655000 0x5558406573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.780+0000 7f7d357fa700 10 client.27562 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.780+0000 7f7d5179a700 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555840655000 0x5558406573f0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb62f1612c222c9f server_cookie=1c946fa3b8099060 in_seq=0 out_seq=0 2023-10-08T12:55:37.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d357fa700 1 -- 172.21.15.59:0/1451907430 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555840586e10 con 0x555840655000 2023-10-08T12:55:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d357fa700 10 client.27562 handle_command_reply: tid=0 2023-10-08T12:55:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d67b2ab80 1 client.27562 shutdown 2023-10-08T12:55:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/1451907430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 msgr2=0x555840644ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x555840644ff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d48000c00 tx=0x7f7d48009970 comp rx=0 tx=0).stop 2023-10-08T12:55:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/1451907430 shutdown_connections 2023-10-08T12:55:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x555840655000 0x5558406573f0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x5558406428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x555840644ff0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d357fa700 0 client.27562 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/1451907430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584063a7a0 0x555840642330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.784+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/1451907430 >> 172.21.15.59:0/1451907430 conn(0x5558405af260 msgr2=0x555840635ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.785+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/1451907430 shutdown_connections 2023-10-08T12:55:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.785+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/1451907430 wait complete. 2023-10-08T12:55:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.785+0000 7f7d67b2ab80 20 client.27562 trim_cache size 0 max 16384 2023-10-08T12:55:37.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.798+0000 7f7d67b2ab80 1 Processor -- start 2023-10-08T12:55:37.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.798+0000 7f7d67b2ab80 1 -- start start 2023-10-08T12:55:37.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x55584064c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55584063a7a0 0x555840640c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840645650 0x555840641140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584040e920 con 0x555840645650 2023-10-08T12:55:37.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x555840641680 con 0x55584063a7a0 2023-10-08T12:55:37.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558406438b0 con 0x555840639e80 2023-10-08T12:55:37.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d5279c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840645650 0x555840641140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d5179a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55584063a7a0 0x555840640c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d5179a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55584063a7a0 0x555840640c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54392/0 (socket says 172.21.15.59:54392) 2023-10-08T12:55:37.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d5179a700 1 -- 172.21.15.59:0/2476640056 learned_addr learned my addr 172.21.15.59:0/2476640056 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:37.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d5279c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840645650 0x555840641140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45966/0 (socket says 172.21.15.59:45966) 2023-10-08T12:55:37.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.799+0000 7f7d51f9b700 1 --2- 172.21.15.59:0/2476640056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x55584064c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.800+0000 7f7d5179a700 1 -- 172.21.15.59:0/2476640056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 msgr2=0x55584064c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:37.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.800+0000 7f7d5179a700 1 --2- 172.21.15.59:0/2476640056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x55584064c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.800+0000 7f7d5179a700 1 -- 172.21.15.59:0/2476640056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840645650 msgr2=0x555840641140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:37.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.800+0000 7f7d5179a700 1 --2- 172.21.15.59:0/2476640056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840645650 0x555840641140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.800+0000 7f7d5179a700 1 -- 172.21.15.59:0/2476640056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558403df250 con 0x55584063a7a0 2023-10-08T12:55:37.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.800+0000 7f7d5279c700 1 --2- 172.21.15.59:0/2476640056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840645650 0x555840641140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:37.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.800+0000 7f7d5179a700 1 --2- 172.21.15.59:0/2476640056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55584063a7a0 0x555840640c00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0ca960 tx=0x7f7d3c099c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8cf20d2e9af4758 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:37.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.800+0000 7f7d40ff9700 1 -- 172.21.15.59:0/2476640056 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c09e290 con 0x55584063a7a0 2023-10-08T12:55:37.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.800+0000 7f7d40ff9700 1 -- 172.21.15.59:0/2476640056 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d3c0a24d0 con 0x55584063a7a0 2023-10-08T12:55:37.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.800+0000 7f7d40ff9700 1 -- 172.21.15.59:0/2476640056 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c016590 con 0x55584063a7a0 2023-10-08T12:55:37.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.801+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2476640056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55584063a7a0 msgr2=0x555840640c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.801+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/2476640056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55584063a7a0 0x555840640c00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0ca960 tx=0x7f7d3c099c80 comp rx=0 tx=0).stop 2023-10-08T12:55:37.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.801+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2476640056 shutdown_connections 2023-10-08T12:55:37.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.801+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/2476640056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840645650 0x555840641140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.801+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/2476640056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555840639e80 0x55584064c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.801+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/2476640056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55584063a7a0 0x555840640c00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.801+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2476640056 >> 172.21.15.59:0/2476640056 conn(0x5558405af260 msgr2=0x55584063d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:37.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.801+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2476640056 shutdown_connections 2023-10-08T12:55:37.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.801+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2476640056 wait complete. 2023-10-08T12:55:37.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.801+0000 7f7d67b2ab80 1 -- start start 2023-10-08T12:55:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.802+0000 7f7d67b2ab80 1 Processor -- start 2023-10-08T12:55:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.802+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840639e80 0x55584064c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.802+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55584063a7a0 0x55584064a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.802+0000 7f7d67b2ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x55584064abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.802+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584064b1c0 con 0x555840639e80 2023-10-08T12:55:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.802+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584064b330 con 0x555840645650 2023-10-08T12:55:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.802+0000 7f7d67b2ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584064b4f0 con 0x55584063a7a0 2023-10-08T12:55:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.802+0000 7f7d67b2ab80 10 client.0 _ll_register_callbacks cb 0x555840387800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d51f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840639e80 0x55584064c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d5279c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x55584064abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d5179a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55584063a7a0 0x55584064a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d5279c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x55584064abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54404/0 (socket says 172.21.15.59:54404) 2023-10-08T12:55:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d5279c700 1 -- 172.21.15.59:0/2069732922 learned_addr learned my addr 172.21.15.59:0/2069732922 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d51f9b700 1 -- 172.21.15.59:0/2069732922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55584063a7a0 msgr2=0x55584064a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d51f9b700 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55584063a7a0 0x55584064a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d51f9b700 1 -- 172.21.15.59:0/2069732922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 msgr2=0x55584064abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d51f9b700 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x55584064abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d51f9b700 1 -- 172.21.15.59:0/2069732922 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d44024070 con 0x555840639e80 2023-10-08T12:55:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d5179a700 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55584063a7a0 0x55584064a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d5279c700 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x55584064abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d51f9b700 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840639e80 0x55584064c160 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7d48005950 tx=0x7f7d48019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f66a7e2bb97297c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.803+0000 7f7d357fa700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:55:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d357fa700 1 -- 172.21.15.59:0/2069732922 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48009cb0 con 0x555840639e80 2023-10-08T12:55:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2069732922 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d48004390 con 0x555840639e80 2023-10-08T12:55:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d357fa700 1 -- 172.21.15.59:0/2069732922 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7d48000e40 con 0x555840639e80 2023-10-08T12:55:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d357fa700 1 -- 172.21.15.59:0/2069732922 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d480039e0 con 0x555840639e80 2023-10-08T12:55:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d67b2ab80 10 client.17550 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2069732922 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f7d4c1aa1c0 con 0x555840639e80 2023-10-08T12:55:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d357fa700 1 -- 172.21.15.59:0/2069732922 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d48004390 con 0x555840639e80 2023-10-08T12:55:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d357fa700 1 -- 172.21.15.59:0/2069732922 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7d48011790 con 0x555840639e80 2023-10-08T12:55:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d67b2ab80 10 client.17550 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d67b2ab80 10 client.17550 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d67b2ab80 20 client.17550 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:37.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5558406aa030 0x5558406ac420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:37.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d67b2ab80 4 client.17550 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:55:37.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.804+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2069732922 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555840586b30 con 0x5558406aa030 2023-10-08T12:55:37.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.805+0000 7f7d5179a700 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5558406aa030 0x5558406ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:37.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.805+0000 7f7d5179a700 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5558406aa030 0x5558406ac420 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b3d135bc0912131 server_cookie=c904fef529ec7081 in_seq=0 out_seq=0 2023-10-08T12:55:37.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.805+0000 7f7d357fa700 10 client.17550 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d357fa700 1 -- 172.21.15.59:0/2069732922 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555840586b30 con 0x5558406aa030 2023-10-08T12:55:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d357fa700 10 client.17550 handle_command_reply: tid=0 2023-10-08T12:55:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 1 client.17550 shutdown 2023-10-08T12:55:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2069732922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840639e80 msgr2=0x55584064c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840639e80 0x55584064c160 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7d48005950 tx=0x7f7d48019760 comp rx=0 tx=0).stop 2023-10-08T12:55:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2069732922 shutdown_connections 2023-10-08T12:55:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5558406aa030 0x5558406ac420 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555840645650 0x55584064abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555840639e80 0x55584064c160 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 1 --2- 172.21.15.59:0/2069732922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55584063a7a0 0x55584064a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2069732922 >> 172.21.15.59:0/2069732922 conn(0x5558405af260 msgr2=0x555840640b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:37.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d357fa700 0 client.17550 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:37.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2069732922 shutdown_connections 2023-10-08T12:55:37.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 1 -- 172.21.15.59:0/2069732922 wait complete. 2023-10-08T12:55:37.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d67b2ab80 20 client.17550 trim_cache size 0 max 16384 2023-10-08T12:55:37.813 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:55:37.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d541ff700 1 -- 172.21.15.59:0/1675783693 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d380a15f0 msgr2=0x7f7d380a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d541ff700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d380a15f0 0x7f7d380a3ab0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009790 tx=0x7f7d44009700 comp rx=0 tx=0).stop 2023-10-08T12:55:37.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d541ff700 1 -- 172.21.15.59:0/1675783693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d4c0734b0 msgr2=0x7f7d4c19d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:37.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d541ff700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d4c0734b0 0x7f7d4c19d990 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00e9c0 tx=0x7f7d3c00ecd0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d541ff700 1 -- 172.21.15.59:0/1675783693 shutdown_connections 2023-10-08T12:55:37.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d541ff700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7d380a15f0 0x7f7d380a3ab0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d541ff700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d4c111750 0x7f7d4c1a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d541ff700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d4c072b90 0x7f7d4c19d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d541ff700 1 --2- 172.21.15.59:0/1675783693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d4c0734b0 0x7f7d4c19d990 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:37.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.811+0000 7f7d541ff700 1 -- 172.21.15.59:0/1675783693 >> 172.21.15.59:0/1675783693 conn(0x7f7d4c0fc230 msgr2=0x7f7d4c0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:37.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.812+0000 7f7d541ff700 1 -- 172.21.15.59:0/1675783693 shutdown_connections 2023-10-08T12:55:37.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:37.812+0000 7f7d541ff700 1 -- 172.21.15.59:0/1675783693 wait complete. 2023-10-08T12:55:37.940 INFO:tasks.workunit.client.0.smithi059.stdout: 10 27882 24.69 MB/sec warmup 68 sec latency 135.242 ms 2023-10-08T12:55:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:38 smithi092 ceph-mon[134093]: pgmap v763: 97 pgs: 97 active+clean; 831 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.0 MiB/s wr, 281 op/s 2023-10-08T12:55:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:38 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2163160881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:55:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:38 smithi173 ceph-mon[135182]: pgmap v763: 97 pgs: 97 active+clean; 831 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.0 MiB/s wr, 281 op/s 2023-10-08T12:55:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:38 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2163160881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:55:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:38 smithi059 ceph-mon[98489]: pgmap v763: 97 pgs: 97 active+clean; 831 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.0 MiB/s wr, 281 op/s 2023-10-08T12:55:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:38 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2163160881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:55:38.832 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:55:38.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:55:38.940 INFO:tasks.workunit.client.0.smithi059.stdout: 10 28156 24.52 MB/sec warmup 69 sec latency 173.651 ms 2023-10-08T12:55:39.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.056+0000 7f3bf4fff700 1 -- 172.21.15.59:0/150407047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bf0100000 msgr2=0x7f3bf010c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.056+0000 7f3bf4fff700 1 --2- 172.21.15.59:0/150407047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bf0100000 0x7f3bf010c510 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3be800b0a0 tx=0x7f3be800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.056+0000 7f3bf4fff700 1 -- 172.21.15.59:0/150407047 shutdown_connections 2023-10-08T12:55:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.056+0000 7f3bf4fff700 1 --2- 172.21.15.59:0/150407047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bf0100000 0x7f3bf010c510 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.056+0000 7f3bf4fff700 1 --2- 172.21.15.59:0/150407047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf0105650 0x7f3bf0105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.056+0000 7f3bf4fff700 1 --2- 172.21.15.59:0/150407047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bf00ff640 0x7f3bf00ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.056+0000 7f3bf4fff700 1 -- 172.21.15.59:0/150407047 >> 172.21.15.59:0/150407047 conn(0x7f3bf00767c0 msgr2=0x7f3bf0076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.056+0000 7f3bf4fff700 1 -- 172.21.15.59:0/150407047 shutdown_connections 2023-10-08T12:55:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.056+0000 7f3bf4fff700 1 -- 172.21.15.59:0/150407047 wait complete. 2023-10-08T12:55:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.057+0000 7f3bf4fff700 1 Processor -- start 2023-10-08T12:55:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.058+0000 7f3bf4fff700 1 -- start start 2023-10-08T12:55:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.058+0000 7f3bf4fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bf00ff640 0x7f3bf019e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.058+0000 7f3bf4fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bf0100000 0x7f3bf019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.058+0000 7f3bf4fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf0105650 0x7f3bf0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.058+0000 7f3bf4fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0199190 con 0x7f3bf0100000 2023-10-08T12:55:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.058+0000 7f3bf4fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0199300 con 0x7f3bf00ff640 2023-10-08T12:55:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.058+0000 7f3bf4fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01994c0 con 0x7f3bf0105650 2023-10-08T12:55:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.058+0000 7f3bee59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bf00ff640 0x7f3bf019e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.058+0000 7f3bee59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bf00ff640 0x7f3bf019e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54408/0 (socket says 172.21.15.59:54408) 2023-10-08T12:55:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.058+0000 7f3bee59c700 1 -- 172.21.15.59:0/828862802 learned_addr learned my addr 172.21.15.59:0/828862802 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.058+0000 7f3be7fff700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bf0100000 0x7f3bf019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.059+0000 7f3beed9d700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf0105650 0x7f3bf0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.059+0000 7f3bee59c700 1 -- 172.21.15.59:0/828862802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf0105650 msgr2=0x7f3bf0198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.059+0000 7f3bee59c700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf0105650 0x7f3bf0198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.059+0000 7f3bee59c700 1 -- 172.21.15.59:0/828862802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bf0100000 msgr2=0x7f3bf019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.059+0000 7f3bee59c700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bf0100000 0x7f3bf019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.059+0000 7f3bee59c700 1 -- 172.21.15.59:0/828862802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8009d00 con 0x7f3bf00ff640 2023-10-08T12:55:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.059+0000 7f3bee59c700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bf00ff640 0x7f3bf019e9a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3be000d950 tx=0x7f3be000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.059+0000 7f3be77fe700 1 -- 172.21.15.59:0/828862802 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0009940 con 0x7f3bf00ff640 2023-10-08T12:55:39.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.059+0000 7f3be77fe700 1 -- 172.21.15.59:0/828862802 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3be0010460 con 0x7f3bf00ff640 2023-10-08T12:55:39.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.059+0000 7f3bf4fff700 1 -- 172.21.15.59:0/828862802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf01997a0 con 0x7f3bf00ff640 2023-10-08T12:55:39.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.059+0000 7f3be77fe700 1 -- 172.21.15.59:0/828862802 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be000f620 con 0x7f3bf00ff640 2023-10-08T12:55:39.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.060+0000 7f3bf4fff700 1 -- 172.21.15.59:0/828862802 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf01a5a40 con 0x7f3bf00ff640 2023-10-08T12:55:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.065+0000 7f3be77fe700 1 -- 172.21.15.59:0/828862802 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3be00108d0 con 0x7f3bf00ff640 2023-10-08T12:55:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.065+0000 7f3c08928b80 1 Processor -- start 2023-10-08T12:55:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3c08928b80 1 -- start start 2023-10-08T12:55:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a26f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a2702190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a2704ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3c08928b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a26604e0 con 0x5628a26f7820 2023-10-08T12:55:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3c08928b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a2651ca0 con 0x5628a27026d0 2023-10-08T12:55:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3c08928b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a264f5c0 con 0x5628a26f6f00 2023-10-08T12:55:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3be77fe700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3bdc0a1670 0x7f3bdc0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3be7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a2704ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3bee59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a2702190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3be7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a2704ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54412/0 (socket says 172.21.15.59:54412) 2023-10-08T12:55:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.066+0000 7f3be7fff700 1 -- 172.21.15.59:0/3037806592 learned_addr learned my addr 172.21.15.59:0/3037806592 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.067+0000 7f3beed9d700 1 --2- 172.21.15.59:0/3037806592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a26f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.067+0000 7f3beed9d700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3bdc0a1670 0x7f3bdc0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.067+0000 7f3be77fe700 1 -- 172.21.15.59:0/828862802 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3be00ccdf0 con 0x7f3bf00ff640 2023-10-08T12:55:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.067+0000 7f3be7fff700 1 -- 172.21.15.59:0/3037806592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 msgr2=0x5628a26f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.067+0000 7f3be7fff700 1 --2- 172.21.15.59:0/3037806592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a26f72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.067+0000 7f3be7fff700 1 -- 172.21.15.59:0/3037806592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 msgr2=0x5628a2702190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.067+0000 7f3be7fff700 1 --2- 172.21.15.59:0/3037806592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a2702190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.067+0000 7f3be7fff700 1 -- 172.21.15.59:0/3037806592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628a2475e60 con 0x5628a27026d0 2023-10-08T12:55:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.067+0000 7f3be7fff700 1 --2- 172.21.15.59:0/3037806592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a2704ac0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009d50 tx=0x7f3bd8011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf6477e8bc69b5dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.067+0000 7f3be4ff9700 1 -- 172.21.15.59:0/3037806592 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8019630 con 0x5628a27026d0 2023-10-08T12:55:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.068+0000 7f3be4ff9700 1 -- 172.21.15.59:0/3037806592 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bd8019c50 con 0x5628a27026d0 2023-10-08T12:55:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.068+0000 7f3be4ff9700 1 -- 172.21.15.59:0/3037806592 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd800ebb0 con 0x5628a27026d0 2023-10-08T12:55:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.068+0000 7f3beed9d700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3bdc0a1670 0x7f3bdc0a3b30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009cd0 tx=0x7f3be80061f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.068+0000 7f3c08928b80 1 -- 172.21.15.59:0/3037806592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 msgr2=0x5628a2704ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.068+0000 7f3c08928b80 1 --2- 172.21.15.59:0/3037806592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a2704ac0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009d50 tx=0x7f3bd8011720 comp rx=0 tx=0).stop 2023-10-08T12:55:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.068+0000 7f3c08928b80 1 -- 172.21.15.59:0/3037806592 shutdown_connections 2023-10-08T12:55:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.068+0000 7f3c08928b80 1 --2- 172.21.15.59:0/3037806592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a2704ac0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.068+0000 7f3c08928b80 1 --2- 172.21.15.59:0/3037806592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a26f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.068+0000 7f3c08928b80 1 --2- 172.21.15.59:0/3037806592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a2702190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.068+0000 7f3c08928b80 1 -- 172.21.15.59:0/3037806592 >> 172.21.15.59:0/3037806592 conn(0x5628a266c2e0 msgr2=0x5628a26f3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.069+0000 7f3c08928b80 1 -- 172.21.15.59:0/3037806592 shutdown_connections 2023-10-08T12:55:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.069+0000 7f3c08928b80 1 -- 172.21.15.59:0/3037806592 wait complete. 2023-10-08T12:55:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.069+0000 7f3c08928b80 1 -- start start 2023-10-08T12:55:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.069+0000 7f3c08928b80 1 Processor -- start 2023-10-08T12:55:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a27020a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a26ff320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a26ff930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3c08928b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a264aeb0 con 0x5628a26f7820 2023-10-08T12:55:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3c08928b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a25e7790 con 0x5628a27026d0 2023-10-08T12:55:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3c08928b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a25e7430 con 0x5628a26f6f00 2023-10-08T12:55:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3c08928b80 10 client.0 _ll_register_callbacks cb 0x5628a2444880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:39.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3bee59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a27020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3bee59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a27020a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38436/0 (socket says 172.21.15.59:38436) 2023-10-08T12:55:39.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3bee59c700 1 -- 172.21.15.59:0/1437768812 learned_addr learned my addr 172.21.15.59:0/1437768812 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:39.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3be7fff700 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a26ff320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.070+0000 7f3beed9d700 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a26ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3bee59c700 1 -- 172.21.15.59:0/1437768812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 msgr2=0x5628a26ff930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3bee59c700 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a26ff930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3bee59c700 1 -- 172.21.15.59:0/1437768812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 msgr2=0x5628a26ff320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3bee59c700 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a26ff320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3bee59c700 1 -- 172.21.15.59:0/1437768812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd8009980 con 0x5628a26f6f00 2023-10-08T12:55:39.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3be7fff700 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a26ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:39.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3bee59c700 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a27020a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3be0099b20 tx=0x7f3be00692d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a2e0a5d209d3409 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3bd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:55:39.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/1437768812 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be009a280 con 0x5628a26f6f00 2023-10-08T12:55:39.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3c08928b80 1 -- 172.21.15.59:0/1437768812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628a2612f30 con 0x5628a26f6f00 2023-10-08T12:55:39.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/1437768812 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3be0099e20 con 0x5628a26f6f00 2023-10-08T12:55:39.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/1437768812 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3be009df70 con 0x5628a26f6f00 2023-10-08T12:55:39.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3c08928b80 10 client.27580 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:39.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.071+0000 7f3c08928b80 1 -- 172.21.15.59:0/1437768812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5628a245ece0 con 0x5628a26f6f00 2023-10-08T12:55:39.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.072+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/1437768812 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3be00b1020 con 0x5628a26f6f00 2023-10-08T12:55:39.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.072+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/1437768812 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3be00a1d20 con 0x5628a26f6f00 2023-10-08T12:55:39.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.072+0000 7f3c08928b80 10 client.27580 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:39.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.072+0000 7f3c08928b80 10 client.27580 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:39.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.072+0000 7f3c08928b80 20 client.27580 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:39.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.072+0000 7f3c08928b80 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5628a27120a0 0x5628a27144c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.072+0000 7f3c08928b80 4 client.27580 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:55:39.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.072+0000 7f3c08928b80 1 -- 172.21.15.59:0/1437768812 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628a2643e90 con 0x5628a27120a0 2023-10-08T12:55:39.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.072+0000 7f3be7fff700 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5628a27120a0 0x5628a27144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.073+0000 7f3be7fff700 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5628a27120a0 0x5628a27144c0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7c5e1e9c1d08347 server_cookie=1fcc56a6c169254 in_seq=0 out_seq=0 2023-10-08T12:55:39.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.073+0000 7f3bd5ffb700 10 client.27580 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:39.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.076+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/1437768812 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5628a2643e90 con 0x5628a27120a0 2023-10-08T12:55:39.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.076+0000 7f3bd5ffb700 10 client.27580 handle_command_reply: tid=0 2023-10-08T12:55:39.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.076+0000 7f3c08928b80 1 client.27580 shutdown 2023-10-08T12:55:39.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3c08928b80 1 -- 172.21.15.59:0/1437768812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 msgr2=0x5628a27020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3c08928b80 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a27020a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3be0099b20 tx=0x7f3be00692d0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3c08928b80 1 -- 172.21.15.59:0/1437768812 shutdown_connections 2023-10-08T12:55:39.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3c08928b80 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5628a27120a0 0x5628a27144c0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3c08928b80 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a26ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3c08928b80 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a27020a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3c08928b80 1 --2- 172.21.15.59:0/1437768812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a26ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3bd5ffb700 0 client.27580 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:39.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3c08928b80 1 -- 172.21.15.59:0/1437768812 >> 172.21.15.59:0/1437768812 conn(0x5628a266c2e0 msgr2=0x5628a26f2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3c08928b80 1 -- 172.21.15.59:0/1437768812 shutdown_connections 2023-10-08T12:55:39.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3c08928b80 1 -- 172.21.15.59:0/1437768812 wait complete. 2023-10-08T12:55:39.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.077+0000 7f3c08928b80 20 client.27580 trim_cache size 0 max 16384 2023-10-08T12:55:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.095+0000 7f3c08928b80 1 Processor -- start 2023-10-08T12:55:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.095+0000 7f3c08928b80 1 -- start start 2023-10-08T12:55:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.095+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a26f6f00 0x5628a26fe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f7820 0x5628a270e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a27026d0 0x5628a2709220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3c08928b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a24cb9a0 con 0x5628a27026d0 2023-10-08T12:55:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3c08928b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a26f4850 con 0x5628a26f6f00 2023-10-08T12:55:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3c08928b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a27007b0 con 0x5628a26f7820 2023-10-08T12:55:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3bee59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a26f6f00 0x5628a26fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3be7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f7820 0x5628a270e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3beed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a27026d0 0x5628a2709220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3bee59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a26f6f00 0x5628a26fe290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54426/0 (socket says 172.21.15.59:54426) 2023-10-08T12:55:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3bee59c700 1 -- 172.21.15.59:0/3983057419 learned_addr learned my addr 172.21.15.59:0/3983057419 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3be7fff700 1 -- 172.21.15.59:0/3983057419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a26f6f00 msgr2=0x5628a26fe290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3be7fff700 1 --2- 172.21.15.59:0/3983057419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a26f6f00 0x5628a26fe290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3be7fff700 1 -- 172.21.15.59:0/3983057419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a27026d0 msgr2=0x5628a2709220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3be7fff700 1 --2- 172.21.15.59:0/3983057419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a27026d0 0x5628a2709220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3be7fff700 1 -- 172.21.15.59:0/3983057419 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628a249c2d0 con 0x5628a26f7820 2023-10-08T12:55:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.096+0000 7f3bee59c700 1 --2- 172.21.15.59:0/3983057419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a26f6f00 0x5628a26fe290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.097+0000 7f3be7fff700 1 --2- 172.21.15.59:0/3983057419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f7820 0x5628a270e080 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009d20 tx=0x7f3bd8000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f4a05fe2c78c1e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.097+0000 7f3be57fa700 1 -- 172.21.15.59:0/3983057419 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80197b0 con 0x5628a26f7820 2023-10-08T12:55:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.097+0000 7f3be57fa700 1 -- 172.21.15.59:0/3983057419 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bd8019dc0 con 0x5628a26f7820 2023-10-08T12:55:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.097+0000 7f3be57fa700 1 -- 172.21.15.59:0/3983057419 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd800e9e0 con 0x5628a26f7820 2023-10-08T12:55:39.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.097+0000 7f3c08928b80 1 -- 172.21.15.59:0/3983057419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f7820 msgr2=0x5628a270e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.097+0000 7f3c08928b80 1 --2- 172.21.15.59:0/3983057419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f7820 0x5628a270e080 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009d20 tx=0x7f3bd8000bc0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.097+0000 7f3c08928b80 1 -- 172.21.15.59:0/3983057419 shutdown_connections 2023-10-08T12:55:39.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.097+0000 7f3c08928b80 1 --2- 172.21.15.59:0/3983057419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a26f6f00 0x5628a26fe290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.097+0000 7f3c08928b80 1 --2- 172.21.15.59:0/3983057419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a27026d0 0x5628a2709220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.097+0000 7f3c08928b80 1 --2- 172.21.15.59:0/3983057419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f7820 0x5628a270e080 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.097+0000 7f3c08928b80 1 -- 172.21.15.59:0/3983057419 >> 172.21.15.59:0/3983057419 conn(0x5628a266c2e0 msgr2=0x5628a270d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.098+0000 7f3c08928b80 1 -- 172.21.15.59:0/3983057419 shutdown_connections 2023-10-08T12:55:39.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.098+0000 7f3c08928b80 1 -- 172.21.15.59:0/3983057419 wait complete. 2023-10-08T12:55:39.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.098+0000 7f3c08928b80 1 -- start start 2023-10-08T12:55:39.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.098+0000 7f3c08928b80 1 Processor -- start 2023-10-08T12:55:39.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a2708840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a2708d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3c08928b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a275f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3c08928b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a275f860 con 0x5628a26f7820 2023-10-08T12:55:39.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3c08928b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a275f9d0 con 0x5628a27026d0 2023-10-08T12:55:39.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3c08928b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a275fb90 con 0x5628a26f6f00 2023-10-08T12:55:39.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3c08928b80 10 client.0 _ll_register_callbacks cb 0x7f3be000bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:39.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3bee59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a2708840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3bee59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a2708840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38454/0 (socket says 172.21.15.59:38454) 2023-10-08T12:55:39.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3bee59c700 1 -- 172.21.15.59:0/4244229278 learned_addr learned my addr 172.21.15.59:0/4244229278 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:39.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3beed9d700 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a275f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.099+0000 7f3be7fff700 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a2708d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3bee59c700 1 -- 172.21.15.59:0/4244229278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 msgr2=0x5628a275f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3bee59c700 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a275f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3bee59c700 1 -- 172.21.15.59:0/4244229278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 msgr2=0x5628a2708d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3bee59c700 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a2708d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3bee59c700 1 -- 172.21.15.59:0/4244229278 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628a245ece0 con 0x5628a26f6f00 2023-10-08T12:55:39.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3bee59c700 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a2708840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3be000bfd0 tx=0x7f3be0099a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9c36e6df406363 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3bd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:55:39.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/4244229278 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0099e20 con 0x5628a26f6f00 2023-10-08T12:55:39.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/4244229278 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3be00b2080 con 0x5628a26f6f00 2023-10-08T12:55:39.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3c08928b80 1 -- 172.21.15.59:0/4244229278 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3bd8019c50 con 0x5628a26f6f00 2023-10-08T12:55:39.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/4244229278 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3be009df70 con 0x5628a26f6f00 2023-10-08T12:55:39.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3c08928b80 10 client.27586 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:39.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.100+0000 7f3c08928b80 1 -- 172.21.15.59:0/4244229278 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5628a2475e60 con 0x5628a26f6f00 2023-10-08T12:55:39.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.101+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/4244229278 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bd8019c50 con 0x5628a26f6f00 2023-10-08T12:55:39.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.101+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/4244229278 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3be0095dd0 con 0x5628a26f6f00 2023-10-08T12:55:39.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.101+0000 7f3c08928b80 10 client.27586 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:39.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.101+0000 7f3c08928b80 10 client.27586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:39.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.101+0000 7f3c08928b80 20 client.27586 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:39.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.101+0000 7f3c08928b80 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5628a2768280 0x5628a276a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.101+0000 7f3c08928b80 4 client.27586 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:55:39.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.101+0000 7f3c08928b80 1 -- 172.21.15.59:0/4244229278 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5628a2643bb0 con 0x5628a2768280 2023-10-08T12:55:39.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.101+0000 7f3be7fff700 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5628a2768280 0x5628a276a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.101+0000 7f3be7fff700 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5628a2768280 0x5628a276a670 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0f67e6049eeac1b server_cookie=5488d364f3bb2781 in_seq=0 out_seq=0 2023-10-08T12:55:39.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.101+0000 7f3bd5ffb700 10 client.27586 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:39.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3bd5ffb700 1 -- 172.21.15.59:0/4244229278 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5628a2643bb0 con 0x5628a2768280 2023-10-08T12:55:39.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3bd5ffb700 10 client.27586 handle_command_reply: tid=0 2023-10-08T12:55:39.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3c08928b80 1 client.27586 shutdown 2023-10-08T12:55:39.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3c08928b80 1 -- 172.21.15.59:0/4244229278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 msgr2=0x5628a2708840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3c08928b80 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a2708840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3be000bfd0 tx=0x7f3be0099a90 comp rx=0 tx=0).stop 2023-10-08T12:55:39.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3c08928b80 1 -- 172.21.15.59:0/4244229278 shutdown_connections 2023-10-08T12:55:39.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3c08928b80 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5628a2768280 0x5628a276a670 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3c08928b80 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628a27026d0 0x5628a275f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3bd5ffb700 0 client.27586 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:39.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3c08928b80 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628a26f6f00 0x5628a2708840 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3c08928b80 1 --2- 172.21.15.59:0/4244229278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628a26f7820 0x5628a2708d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3c08928b80 1 -- 172.21.15.59:0/4244229278 >> 172.21.15.59:0/4244229278 conn(0x5628a266c2e0 msgr2=0x5628a270e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.105+0000 7f3c08928b80 1 -- 172.21.15.59:0/4244229278 shutdown_connections 2023-10-08T12:55:39.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3c08928b80 1 -- 172.21.15.59:0/4244229278 wait complete. 2023-10-08T12:55:39.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3c08928b80 20 client.27586 trim_cache size 0 max 16384 2023-10-08T12:55:39.118 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:55:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:55:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "9c56ed34-c92a-4ff9-832a-4eceaa9c1865", 2023-10-08T12:55:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:55:39.119 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:55:39.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3bf4fff700 1 -- 172.21.15.59:0/828862802 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3bdc0a1670 msgr2=0x7f3bdc0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3bf4fff700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3bdc0a1670 0x7f3bdc0a3b30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009cd0 tx=0x7f3be80061f0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3bf4fff700 1 -- 172.21.15.59:0/828862802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bf00ff640 msgr2=0x7f3bf019e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3bf4fff700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bf00ff640 0x7f3bf019e9a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3be000d950 tx=0x7f3be000dc60 comp rx=0 tx=0).stop 2023-10-08T12:55:39.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3bf4fff700 1 -- 172.21.15.59:0/828862802 shutdown_connections 2023-10-08T12:55:39.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3bf4fff700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3bdc0a1670 0x7f3bdc0a3b30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3bf4fff700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bf00ff640 0x7f3bf019e9a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3bf4fff700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf0105650 0x7f3bf0198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3bf4fff700 1 --2- 172.21.15.59:0/828862802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bf0100000 0x7f3bf019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.106+0000 7f3bf4fff700 1 -- 172.21.15.59:0/828862802 >> 172.21.15.59:0/828862802 conn(0x7f3bf00767c0 msgr2=0x7f3bf00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.107+0000 7f3bf4fff700 1 -- 172.21.15.59:0/828862802 shutdown_connections 2023-10-08T12:55:39.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.107+0000 7f3bf4fff700 1 -- 172.21.15.59:0/828862802 wait complete. 2023-10-08T12:55:39.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:55:39.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.436+0000 7f3d717ff700 1 -- 172.21.15.59:0/567593137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6c106740 msgr2=0x7f3d6c106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.436+0000 7f3d717ff700 1 --2- 172.21.15.59:0/567593137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6c106740 0x7f3d6c106b20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009990 tx=0x7f3d5c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.436+0000 7f3d717ff700 1 -- 172.21.15.59:0/567593137 shutdown_connections 2023-10-08T12:55:39.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.436+0000 7f3d717ff700 1 --2- 172.21.15.59:0/567593137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6c106740 0x7f3d6c106b20 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.436+0000 7f3d717ff700 1 --2- 172.21.15.59:0/567593137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d6c1010f0 0x7f3d6c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.436+0000 7f3d717ff700 1 --2- 172.21.15.59:0/567593137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d6c100730 0x7f3d6c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.436+0000 7f3d717ff700 1 -- 172.21.15.59:0/567593137 >> 172.21.15.59:0/567593137 conn(0x7f3d6c0fc200 msgr2=0x7f3d6c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.436+0000 7f3d717ff700 1 -- 172.21.15.59:0/567593137 shutdown_connections 2023-10-08T12:55:39.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.436+0000 7f3d717ff700 1 -- 172.21.15.59:0/567593137 wait complete. 2023-10-08T12:55:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.437+0000 7f3d717ff700 1 Processor -- start 2023-10-08T12:55:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.437+0000 7f3d717ff700 1 -- start start 2023-10-08T12:55:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d717ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d6c100730 0x7f3d6c198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d717ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d6c1010f0 0x7f3d6c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d717ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6c106740 0x7f3d6c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d717ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c19dcc0 con 0x7f3d6c100730 2023-10-08T12:55:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d717ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c19de30 con 0x7f3d6c106740 2023-10-08T12:55:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d717ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c19dff0 con 0x7f3d6c1010f0 2023-10-08T12:55:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d6a7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d6c1010f0 0x7f3d6c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d6b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6c106740 0x7f3d6c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d6b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6c106740 0x7f3d6c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54458/0 (socket says 172.21.15.59:54458) 2023-10-08T12:55:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d6b7fe700 1 -- 172.21.15.59:0/3537687242 learned_addr learned my addr 172.21.15.59:0/3537687242 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d6a7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d6c1010f0 0x7f3d6c1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38468/0 (socket says 172.21.15.59:38468) 2023-10-08T12:55:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d6affd700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d6c100730 0x7f3d6c198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d6b7fe700 1 -- 172.21.15.59:0/3537687242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d6c1010f0 msgr2=0x7f3d6c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d6b7fe700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d6c1010f0 0x7f3d6c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d6b7fe700 1 -- 172.21.15.59:0/3537687242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d6c100730 msgr2=0x7f3d6c198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d6b7fe700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d6c100730 0x7f3d6c198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.438+0000 7f3d6b7fe700 1 -- 172.21.15.59:0/3537687242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0095f0 con 0x7f3d6c106740 2023-10-08T12:55:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.439+0000 7f3d6b7fe700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6c106740 0x7f3d6c19d680 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400ef30 tx=0x7f3d6400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.439+0000 7f3d53fff700 1 -- 172.21.15.59:0/3537687242 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64018070 con 0x7f3d6c106740 2023-10-08T12:55:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.439+0000 7f3d53fff700 1 -- 172.21.15.59:0/3537687242 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d6400f040 con 0x7f3d6c106740 2023-10-08T12:55:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.439+0000 7f3d717ff700 1 -- 172.21.15.59:0/3537687242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c19e270 con 0x7f3d6c106740 2023-10-08T12:55:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.439+0000 7f3d53fff700 1 -- 172.21.15.59:0/3537687242 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400cd00 con 0x7f3d6c106740 2023-10-08T12:55:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.439+0000 7f3d717ff700 1 -- 172.21.15.59:0/3537687242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c1a5b10 con 0x7f3d6c106740 2023-10-08T12:55:39.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.442+0000 7f3d53fff700 1 -- 172.21.15.59:0/3537687242 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3d64003a00 con 0x7f3d6c106740 2023-10-08T12:55:39.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.443+0000 7f3d85206b80 1 Processor -- start 2023-10-08T12:55:39.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d85206b80 1 -- start start 2023-10-08T12:55:39.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d53fff700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d540a15f0 0x7f3d540a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d53fff700 1 -- 172.21.15.59:0/3537687242 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3d640ccbe0 con 0x7f3d6c106740 2023-10-08T12:55:39.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d6a7fc700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d540a15f0 0x7f3d540a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f152e80 0x55649f153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f1537a0 0x55649f15e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 0x55649f160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d85206b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649f0bc460 con 0x55649f1537a0 2023-10-08T12:55:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d85206b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649f0adc20 con 0x55649f152e80 2023-10-08T12:55:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d85206b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649f0ab540 con 0x55649f15e650 2023-10-08T12:55:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d6affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f152e80 0x55649f153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d6affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f152e80 0x55649f153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54472/0 (socket says 172.21.15.59:54472) 2023-10-08T12:55:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.444+0000 7f3d6affd700 1 -- 172.21.15.59:0/3779673515 learned_addr learned my addr 172.21.15.59:0/3779673515 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d6a7fc700 1 --2- 172.21.15.59:0/3779673515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f1537a0 0x55649f15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d6b7fe700 1 --2- 172.21.15.59:0/3779673515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 0x55649f160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d6affd700 1 -- 172.21.15.59:0/3779673515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 msgr2=0x55649f160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d6affd700 1 --2- 172.21.15.59:0/3779673515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 0x55649f160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d6affd700 1 -- 172.21.15.59:0/3779673515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f1537a0 msgr2=0x55649f15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d6affd700 1 --2- 172.21.15.59:0/3779673515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f1537a0 0x55649f15e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d6affd700 1 -- 172.21.15.59:0/3779673515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55649eed1de0 con 0x55649f152e80 2023-10-08T12:55:39.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d6b7fe700 1 --2- 172.21.15.59:0/3779673515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 0x55649f160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:39.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d6affd700 1 --2- 172.21.15.59:0/3779673515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f152e80 0x55649f153260 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c005ef0 tx=0x7f3d5c00b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe6e985423f230e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d6a7fc700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d540a15f0 0x7f3d540a3ab0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c19a2f0 tx=0x7f3d60013900 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d517fa700 1 -- 172.21.15.59:0/3779673515 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c01d070 con 0x55649f152e80 2023-10-08T12:55:39.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d517fa700 1 -- 172.21.15.59:0/3779673515 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d5c01e040 con 0x55649f152e80 2023-10-08T12:55:39.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d517fa700 1 -- 172.21.15.59:0/3779673515 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0048f0 con 0x55649f152e80 2023-10-08T12:55:39.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d85206b80 1 -- 172.21.15.59:0/3779673515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f152e80 msgr2=0x55649f153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d85206b80 1 --2- 172.21.15.59:0/3779673515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f152e80 0x55649f153260 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c005ef0 tx=0x7f3d5c00b610 comp rx=0 tx=0).stop 2023-10-08T12:55:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d85206b80 1 -- 172.21.15.59:0/3779673515 shutdown_connections 2023-10-08T12:55:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d85206b80 1 --2- 172.21.15.59:0/3779673515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f152e80 0x55649f153260 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d85206b80 1 --2- 172.21.15.59:0/3779673515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 0x55649f160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d85206b80 1 --2- 172.21.15.59:0/3779673515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f1537a0 0x55649f15e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d85206b80 1 -- 172.21.15.59:0/3779673515 >> 172.21.15.59:0/3779673515 conn(0x55649f0c8260 msgr2=0x55649f14f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d85206b80 1 -- 172.21.15.59:0/3779673515 shutdown_connections 2023-10-08T12:55:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.446+0000 7f3d85206b80 1 -- 172.21.15.59:0/3779673515 wait complete. 2023-10-08T12:55:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.447+0000 7f3d85206b80 1 -- start start 2023-10-08T12:55:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.447+0000 7f3d85206b80 1 Processor -- start 2023-10-08T12:55:39.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f152e80 0x55649f15dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f1537a0 0x55649f15b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 0x55649f15b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d85206b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649f0a6e30 con 0x55649f1537a0 2023-10-08T12:55:39.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d85206b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649f043710 con 0x55649f15e650 2023-10-08T12:55:39.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d85206b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649f0433b0 con 0x55649f152e80 2023-10-08T12:55:39.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d85206b80 10 client.0 _ll_register_callbacks cb 0x55649eea0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:39.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d6b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 0x55649f15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d6a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f1537a0 0x55649f15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d6b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 0x55649f15b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54476/0 (socket says 172.21.15.59:54476) 2023-10-08T12:55:39.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d6b7fe700 1 -- 172.21.15.59:0/1727374652 learned_addr learned my addr 172.21.15.59:0/1727374652 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:39.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d6affd700 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f152e80 0x55649f15dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d6b7fe700 1 -- 172.21.15.59:0/1727374652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f152e80 msgr2=0x55649f15dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d6b7fe700 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f152e80 0x55649f15dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d6b7fe700 1 -- 172.21.15.59:0/1727374652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f1537a0 msgr2=0x55649f15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d6b7fe700 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f1537a0 0x55649f15b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.448+0000 7f3d6b7fe700 1 -- 172.21.15.59:0/1727374652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c10df00 con 0x55649f15e650 2023-10-08T12:55:39.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d6b7fe700 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 0x55649f15b930 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3d64099bd0 tx=0x7f3d64099690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2982fd9607d9a4a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d4eff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:55:39.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d4eff5700 1 -- 172.21.15.59:0/1727374652 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6409a340 con 0x55649f15e650 2023-10-08T12:55:39.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d4eff5700 1 -- 172.21.15.59:0/1727374652 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3d6400ce60 con 0x55649f15e650 2023-10-08T12:55:39.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d85206b80 1 -- 172.21.15.59:0/1727374652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55649f06eeb0 con 0x55649f15e650 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d4eff5700 1 -- 172.21.15.59:0/1727374652 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d64099c40 con 0x55649f15e650 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d85206b80 10 client.27602 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d85206b80 1 -- 172.21.15.59:0/1727374652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55649eebac60 con 0x55649f15e650 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d4eff5700 1 -- 172.21.15.59:0/1727374652 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55649f06eeb0 con 0x55649f15e650 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d4eff5700 1 -- 172.21.15.59:0/1727374652 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3d64099130 con 0x55649f15e650 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d85206b80 10 client.27602 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d85206b80 10 client.27602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d85206b80 20 client.27602 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d85206b80 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55649f16dfa0 0x55649f1703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d85206b80 4 client.27602 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.449+0000 7f3d85206b80 1 -- 172.21.15.59:0/1727374652 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55649f09fe10 con 0x55649f16dfa0 2023-10-08T12:55:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.450+0000 7f3d6affd700 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55649f16dfa0 0x55649f1703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.450+0000 7f3d6affd700 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55649f16dfa0 0x55649f1703c0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16cf62cbb7814c05 server_cookie=148552a1a7d2dde2 in_seq=0 out_seq=0 2023-10-08T12:55:39.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.450+0000 7f3d4eff5700 10 client.27602 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:39.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d4eff5700 1 -- 172.21.15.59:0/1727374652 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55649f09fe10 con 0x55649f16dfa0 2023-10-08T12:55:39.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d4eff5700 10 client.27602 handle_command_reply: tid=0 2023-10-08T12:55:39.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 1 client.27602 shutdown 2023-10-08T12:55:39.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 1 -- 172.21.15.59:0/1727374652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 msgr2=0x55649f15b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 0x55649f15b930 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3d64099bd0 tx=0x7f3d64099690 comp rx=0 tx=0).stop 2023-10-08T12:55:39.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 1 -- 172.21.15.59:0/1727374652 shutdown_connections 2023-10-08T12:55:39.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55649f16dfa0 0x55649f1703c0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 0x55649f15b930 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f152e80 0x55649f15dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d4eff5700 0 client.27602 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:39.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 1 --2- 172.21.15.59:0/1727374652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f1537a0 0x55649f15b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 1 -- 172.21.15.59:0/1727374652 >> 172.21.15.59:0/1727374652 conn(0x55649f0c8260 msgr2=0x55649f14eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 1 -- 172.21.15.59:0/1727374652 shutdown_connections 2023-10-08T12:55:39.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 1 -- 172.21.15.59:0/1727374652 wait complete. 2023-10-08T12:55:39.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.454+0000 7f3d85206b80 20 client.27602 trim_cache size 0 max 16384 2023-10-08T12:55:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.472+0000 7f3d85206b80 1 Processor -- start 2023-10-08T12:55:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.472+0000 7f3d85206b80 1 -- start start 2023-10-08T12:55:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.472+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 0x55649f165180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f1537a0 0x55649f1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 0x55649f159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d85206b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649ef27920 con 0x55649f152e80 2023-10-08T12:55:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d85206b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649f15e370 con 0x55649f1537a0 2023-10-08T12:55:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d85206b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649f153b80 con 0x55649f15e650 2023-10-08T12:55:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f1537a0 0x55649f1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f1537a0 0x55649f1566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:54480/0 (socket says 172.21.15.59:54480) 2023-10-08T12:55:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 0x55649f165180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6a7fc700 1 -- 172.21.15.59:0/4074890781 learned_addr learned my addr 172.21.15.59:0/4074890781 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6b7fe700 1 --2- 172.21.15.59:0/4074890781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 0x55649f159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6a7fc700 1 -- 172.21.15.59:0/4074890781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 msgr2=0x55649f159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6a7fc700 1 --2- 172.21.15.59:0/4074890781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 0x55649f159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6a7fc700 1 -- 172.21.15.59:0/4074890781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 msgr2=0x55649f165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6a7fc700 1 --2- 172.21.15.59:0/4074890781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 0x55649f165180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6a7fc700 1 -- 172.21.15.59:0/4074890781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55649eef8250 con 0x55649f1537a0 2023-10-08T12:55:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6b7fe700 1 --2- 172.21.15.59:0/4074890781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 0x55649f159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:55:39.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.473+0000 7f3d6affd700 1 --2- 172.21.15.59:0/4074890781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 0x55649f165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:39.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.474+0000 7f3d6a7fc700 1 --2- 172.21.15.59:0/4074890781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f1537a0 0x55649f1566b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3d60004160 tx=0x7f3d6001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=755ef1e7033ce269 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.474+0000 7f3d51ffb700 1 -- 172.21.15.59:0/4074890781 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60003b10 con 0x55649f1537a0 2023-10-08T12:55:39.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.474+0000 7f3d51ffb700 1 -- 172.21.15.59:0/4074890781 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d60004cf0 con 0x55649f1537a0 2023-10-08T12:55:39.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.474+0000 7f3d51ffb700 1 -- 172.21.15.59:0/4074890781 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60005410 con 0x55649f1537a0 2023-10-08T12:55:39.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.475+0000 7f3d85206b80 1 -- 172.21.15.59:0/4074890781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f1537a0 msgr2=0x55649f1566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.475+0000 7f3d85206b80 1 --2- 172.21.15.59:0/4074890781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f1537a0 0x55649f1566b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3d60004160 tx=0x7f3d6001f000 comp rx=0 tx=0).stop 2023-10-08T12:55:39.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.475+0000 7f3d85206b80 1 -- 172.21.15.59:0/4074890781 shutdown_connections 2023-10-08T12:55:39.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.475+0000 7f3d85206b80 1 --2- 172.21.15.59:0/4074890781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f15e650 0x55649f159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.475+0000 7f3d85206b80 1 --2- 172.21.15.59:0/4074890781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 0x55649f165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.475+0000 7f3d85206b80 1 --2- 172.21.15.59:0/4074890781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f1537a0 0x55649f1566b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.475+0000 7f3d85206b80 1 -- 172.21.15.59:0/4074890781 >> 172.21.15.59:0/4074890781 conn(0x55649f0c8260 msgr2=0x55649f15dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.475+0000 7f3d85206b80 1 -- 172.21.15.59:0/4074890781 shutdown_connections 2023-10-08T12:55:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.475+0000 7f3d85206b80 1 -- 172.21.15.59:0/4074890781 wait complete. 2023-10-08T12:55:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.475+0000 7f3d85206b80 1 -- start start 2023-10-08T12:55:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.476+0000 7f3d85206b80 1 Processor -- start 2023-10-08T12:55:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.476+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 0x55649f1638a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.476+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f1537a0 0x55649f163de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.476+0000 7f3d85206b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 0x55649f164320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.476+0000 7f3d85206b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649f1c1de0 con 0x55649f152e80 2023-10-08T12:55:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.476+0000 7f3d85206b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649f1c1f20 con 0x55649f15e650 2023-10-08T12:55:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.476+0000 7f3d85206b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55649f1c20e0 con 0x55649f1537a0 2023-10-08T12:55:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.476+0000 7f3d85206b80 10 client.0 _ll_register_callbacks cb 0x7f3d64099780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.476+0000 7f3d6affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 0x55649f1638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6a7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f1537a0 0x55649f163de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 0x55649f164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6a7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f1537a0 0x55649f163de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38510/0 (socket says 172.21.15.59:38510) 2023-10-08T12:55:39.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6a7fc700 1 -- 172.21.15.59:0/2620487580 learned_addr learned my addr 172.21.15.59:0/2620487580 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:55:39.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6a7fc700 1 -- 172.21.15.59:0/2620487580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 msgr2=0x55649f164320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6a7fc700 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 0x55649f164320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6a7fc700 1 -- 172.21.15.59:0/2620487580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 msgr2=0x55649f1638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:39.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6a7fc700 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 0x55649f1638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6a7fc700 1 -- 172.21.15.59:0/2620487580 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55649eed1de0 con 0x55649f1537a0 2023-10-08T12:55:39.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6affd700 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 0x55649f1638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:39.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6b7fe700 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 0x55649f164320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:39.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d6a7fc700 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f1537a0 0x55649f163de0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3d60022040 tx=0x7f3d60004e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b59e366e759ce7b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:39.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.477+0000 7f3d4eff5700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:55:39.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d4eff5700 1 -- 172.21.15.59:0/2620487580 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60004b20 con 0x55649f1537a0 2023-10-08T12:55:39.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d85206b80 1 -- 172.21.15.59:0/2620487580 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d5c01e040 con 0x55649f1537a0 2023-10-08T12:55:39.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d4eff5700 1 -- 172.21.15.59:0/2620487580 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f3d60005000 con 0x55649f1537a0 2023-10-08T12:55:39.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d4eff5700 1 -- 172.21.15.59:0/2620487580 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d600051c0 con 0x55649f1537a0 2023-10-08T12:55:39.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d85206b80 10 client.27604 fetch_fsmap learned FSMap version 20 2023-10-08T12:55:39.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d85206b80 1 -- 172.21.15.59:0/2620487580 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f3d600122a0 con 0x55649f1537a0 2023-10-08T12:55:39.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d4eff5700 1 -- 172.21.15.59:0/2620487580 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d5c01e040 con 0x55649f1537a0 2023-10-08T12:55:39.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d4eff5700 1 -- 172.21.15.59:0/2620487580 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3d60028040 con 0x55649f1537a0 2023-10-08T12:55:39.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d85206b80 10 client.27604 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:55:39.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d85206b80 10 client.27604 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:39.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d85206b80 20 client.27604 populate_metadata read hostname 'smithi059' 2023-10-08T12:55:39.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d85206b80 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55649f1c3880 0x55649f1c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:39.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d85206b80 4 client.27604 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:55:39.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.478+0000 7f3d85206b80 1 -- 172.21.15.59:0/2620487580 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55649f09fb30 con 0x55649f1c3880 2023-10-08T12:55:39.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.479+0000 7f3d6affd700 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55649f1c3880 0x55649f1c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:39.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.479+0000 7f3d6affd700 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55649f1c3880 0x55649f1c5ca0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56069385bb659593 server_cookie=1db6909e82c74972 in_seq=0 out_seq=0 2023-10-08T12:55:39.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.479+0000 7f3d4eff5700 10 client.27604 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:39.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.481+0000 7f3d4eff5700 1 -- 172.21.15.59:0/2620487580 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55649f09fb30 con 0x55649f1c3880 2023-10-08T12:55:39.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.481+0000 7f3d4eff5700 10 client.27604 handle_command_reply: tid=0 2023-10-08T12:55:39.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.481+0000 7f3d85206b80 1 client.27604 shutdown 2023-10-08T12:55:39.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d85206b80 1 -- 172.21.15.59:0/2620487580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f1537a0 msgr2=0x55649f163de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d85206b80 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f1537a0 0x55649f163de0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3d60022040 tx=0x7f3d60004e60 comp rx=0 tx=0).stop 2023-10-08T12:55:39.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d85206b80 1 -- 172.21.15.59:0/2620487580 shutdown_connections 2023-10-08T12:55:39.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d85206b80 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55649f1c3880 0x55649f1c5ca0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d85206b80 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55649f15e650 0x55649f164320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d85206b80 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55649f152e80 0x55649f1638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d85206b80 1 --2- 172.21.15.59:0/2620487580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55649f1537a0 0x55649f163de0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d4eff5700 0 client.27604 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:55:39.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d85206b80 1 -- 172.21.15.59:0/2620487580 >> 172.21.15.59:0/2620487580 conn(0x55649f0c8260 msgr2=0x55649f1566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d85206b80 1 -- 172.21.15.59:0/2620487580 shutdown_connections 2023-10-08T12:55:39.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d85206b80 1 -- 172.21.15.59:0/2620487580 wait complete. 2023-10-08T12:55:39.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.482+0000 7f3d85206b80 20 client.27604 trim_cache size 0 max 16384 2023-10-08T12:55:39.488 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:55:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "scrub active (584 inodes in the stack)", 2023-10-08T12:55:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:55:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "9c56ed34-c92a-4ff9-832a-4eceaa9c1865": { 2023-10-08T12:55:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:55:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "9c56ed34-c92a-4ff9-832a-4eceaa9c1865", 2023-10-08T12:55:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:55:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:55:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:55:39.489 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:55:39.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 -- 172.21.15.59:0/3537687242 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d540a15f0 msgr2=0x7f3d540a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d540a15f0 0x7f3d540a3ab0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c19a2f0 tx=0x7f3d60013900 comp rx=0 tx=0).stop 2023-10-08T12:55:39.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 -- 172.21.15.59:0/3537687242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6c106740 msgr2=0x7f3d6c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:39.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6c106740 0x7f3d6c19d680 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400ef30 tx=0x7f3d6400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 -- 172.21.15.59:0/3537687242 shutdown_connections 2023-10-08T12:55:39.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3d540a15f0 0x7f3d540a3ab0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6c106740 0x7f3d6c19d680 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d6c100730 0x7f3d6c198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 --2- 172.21.15.59:0/3537687242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d6c1010f0 0x7f3d6c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 -- 172.21.15.59:0/3537687242 >> 172.21.15.59:0/3537687242 conn(0x7f3d6c0fc200 msgr2=0x7f3d6c0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 -- 172.21.15.59:0/3537687242 shutdown_connections 2023-10-08T12:55:39.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:55:39.483+0000 7f3d717ff700 1 -- 172.21.15.59:0/3537687242 wait complete. 2023-10-08T12:55:39.502 INFO:tasks.cephfs.filesystem:scrub status for tag:9c56ed34-c92a-4ff9-832a-4eceaa9c1865 - {'path': '/', 'tag': '9c56ed34-c92a-4ff9-832a-4eceaa9c1865', 'options': 'recursive,force'} 2023-10-08T12:55:39.940 INFO:tasks.workunit.client.0.smithi059.stdout: 10 28329 24.31 MB/sec warmup 70 sec latency 559.026 ms 2023-10-08T12:55:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:39 smithi173 ceph-mon[135182]: pgmap v764: 97 pgs: 97 active+clean; 840 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.8 MiB/s wr, 273 op/s 2023-10-08T12:55:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:39 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:55:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:39 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:39 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:55:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:39 smithi059 ceph-mon[98489]: pgmap v764: 97 pgs: 97 active+clean; 840 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.8 MiB/s wr, 273 op/s 2023-10-08T12:55:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:39 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:55:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:39 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:39 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:55:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:39 smithi092 ceph-mon[134093]: pgmap v764: 97 pgs: 97 active+clean; 840 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.8 MiB/s wr, 273 op/s 2023-10-08T12:55:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:39 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:55:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:39 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:39 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:55:40.940 INFO:tasks.workunit.client.0.smithi059.stdout: 10 28709 24.20 MB/sec warmup 71 sec latency 153.709 ms 2023-10-08T12:55:41.940 INFO:tasks.workunit.client.0.smithi059.stdout: 10 29351 24.14 MB/sec warmup 72 sec latency 185.586 ms 2023-10-08T12:55:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:42 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:42.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:42 smithi092 ceph-mon[134093]: pgmap v765: 97 pgs: 97 active+clean; 852 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.6 MiB/s wr, 299 op/s 2023-10-08T12:55:42.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:42 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:42.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:42 smithi173 ceph-mon[135182]: pgmap v765: 97 pgs: 97 active+clean; 852 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.6 MiB/s wr, 299 op/s 2023-10-08T12:55:42.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:42 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:55:42.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:42 smithi059 ceph-mon[98489]: pgmap v765: 97 pgs: 97 active+clean; 852 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.6 MiB/s wr, 299 op/s 2023-10-08T12:55:42.940 INFO:tasks.workunit.client.0.smithi059.stdout: 10 29958 24.44 MB/sec warmup 73 sec latency 37.677 ms 2023-10-08T12:55:43.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:43 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:55:43.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:43 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:55:43.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:43 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:55:43.940 INFO:tasks.workunit.client.0.smithi059.stdout: 10 30482 24.63 MB/sec warmup 74 sec latency 165.729 ms 2023-10-08T12:55:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:44 smithi092 ceph-mon[134093]: pgmap v766: 97 pgs: 97 active+clean; 857 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.9 MiB/s wr, 303 op/s 2023-10-08T12:55:44.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:44 smithi173 ceph-mon[135182]: pgmap v766: 97 pgs: 97 active+clean; 857 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.9 MiB/s wr, 303 op/s 2023-10-08T12:55:44.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:44 smithi059 ceph-mon[98489]: pgmap v766: 97 pgs: 97 active+clean; 857 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.9 MiB/s wr, 303 op/s 2023-10-08T12:55:44.940 INFO:tasks.workunit.client.0.smithi059.stdout: 10 30703 24.52 MB/sec warmup 75 sec latency 168.078 ms 2023-10-08T12:55:45.941 INFO:tasks.workunit.client.0.smithi059.stdout: 10 31015 24.43 MB/sec warmup 76 sec latency 154.090 ms 2023-10-08T12:55:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:46 smithi092 ceph-mon[134093]: pgmap v767: 97 pgs: 97 active+clean; 864 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 283 op/s 2023-10-08T12:55:46.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:46 smithi173 ceph-mon[135182]: pgmap v767: 97 pgs: 97 active+clean; 864 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 283 op/s 2023-10-08T12:55:46.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:46 smithi059 ceph-mon[98489]: pgmap v767: 97 pgs: 97 active+clean; 864 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 283 op/s 2023-10-08T12:55:46.941 INFO:tasks.workunit.client.0.smithi059.stdout: 10 31234 24.16 MB/sec warmup 77 sec latency 223.109 ms 2023-10-08T12:55:47.941 INFO:tasks.workunit.client.0.smithi059.stdout: 10 31566 24.01 MB/sec warmup 78 sec latency 195.844 ms 2023-10-08T12:55:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:48 smithi092 ceph-mon[134093]: pgmap v768: 97 pgs: 97 active+clean; 863 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.2 MiB/s wr, 314 op/s 2023-10-08T12:55:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:48 smithi173 ceph-mon[135182]: pgmap v768: 97 pgs: 97 active+clean; 863 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.2 MiB/s wr, 314 op/s 2023-10-08T12:55:48.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:48 smithi059 ceph-mon[98489]: pgmap v768: 97 pgs: 97 active+clean; 863 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.2 MiB/s wr, 314 op/s 2023-10-08T12:55:48.941 INFO:tasks.workunit.client.0.smithi059.stdout: 10 32055 24.01 MB/sec warmup 79 sec latency 235.330 ms 2023-10-08T12:55:49.941 INFO:tasks.workunit.client.0.smithi059.stdout: 10 32400 23.78 MB/sec warmup 80 sec latency 383.681 ms 2023-10-08T12:55:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:49 smithi173 ceph-mon[135182]: pgmap v769: 97 pgs: 97 active+clean; 877 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.3 MiB/s wr, 358 op/s 2023-10-08T12:55:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:49 smithi059 ceph-mon[98489]: pgmap v769: 97 pgs: 97 active+clean; 877 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.3 MiB/s wr, 358 op/s 2023-10-08T12:55:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:49 smithi092 ceph-mon[134093]: pgmap v769: 97 pgs: 97 active+clean; 877 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.3 MiB/s wr, 358 op/s 2023-10-08T12:55:50.941 INFO:tasks.workunit.client.0.smithi059.stdout: 10 32879 23.77 MB/sec warmup 81 sec latency 187.654 ms 2023-10-08T12:55:51.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:50 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:55:51.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:50 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:55:51.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:50 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:55:51.941 INFO:tasks.workunit.client.0.smithi059.stdout: 10 33603 24.14 MB/sec warmup 82 sec latency 51.736 ms 2023-10-08T12:55:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:51 smithi173 ceph-mon[135182]: pgmap v770: 97 pgs: 97 active+clean; 880 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.9 MiB/s wr, 338 op/s 2023-10-08T12:55:52.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:51 smithi059 ceph-mon[98489]: pgmap v770: 97 pgs: 97 active+clean; 880 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.9 MiB/s wr, 338 op/s 2023-10-08T12:55:52.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:51 smithi092 ceph-mon[134093]: pgmap v770: 97 pgs: 97 active+clean; 880 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.9 MiB/s wr, 338 op/s 2023-10-08T12:55:52.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 34054 24.32 MB/sec warmup 83 sec latency 125.469 ms 2023-10-08T12:55:53.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:52 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:55:53.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:52 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:55:53.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:52 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:55:53.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:52 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:55:53.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:52 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:55:53.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:52 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:55:53.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:52 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:55:53.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:52 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:55:53.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:52 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:55:53.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 34327 24.22 MB/sec warmup 84 sec latency 214.694 ms 2023-10-08T12:55:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:53 smithi173 ceph-mon[135182]: pgmap v771: 97 pgs: 97 active+clean; 892 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.0 MiB/s wr, 380 op/s 2023-10-08T12:55:54.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:53 smithi059 ceph-mon[98489]: pgmap v771: 97 pgs: 97 active+clean; 892 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.0 MiB/s wr, 380 op/s 2023-10-08T12:55:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:53 smithi092 ceph-mon[134093]: pgmap v771: 97 pgs: 97 active+clean; 892 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.0 MiB/s wr, 380 op/s 2023-10-08T12:55:54.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 34492 24.02 MB/sec warmup 85 sec latency 317.820 ms 2023-10-08T12:55:55.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 34709 23.81 MB/sec warmup 86 sec latency 214.060 ms 2023-10-08T12:55:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:56 smithi092 ceph-mon[134093]: pgmap v772: 97 pgs: 97 active+clean; 895 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 355 op/s 2023-10-08T12:55:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:56 smithi173 ceph-mon[135182]: pgmap v772: 97 pgs: 97 active+clean; 895 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 355 op/s 2023-10-08T12:55:56.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:56 smithi059 ceph-mon[98489]: pgmap v772: 97 pgs: 97 active+clean; 895 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 355 op/s 2023-10-08T12:55:56.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 35020 23.72 MB/sec warmup 87 sec latency 141.948 ms 2023-10-08T12:55:57.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 35522 23.68 MB/sec warmup 88 sec latency 149.557 ms 2023-10-08T12:55:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:58 smithi092 ceph-mon[134093]: pgmap v773: 97 pgs: 97 active+clean; 901 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.7 MiB/s wr, 353 op/s 2023-10-08T12:55:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:58 smithi173 ceph-mon[135182]: pgmap v773: 97 pgs: 97 active+clean; 901 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.7 MiB/s wr, 353 op/s 2023-10-08T12:55:58.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:58 smithi059 ceph-mon[98489]: pgmap v773: 97 pgs: 97 active+clean; 901 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.7 MiB/s wr, 353 op/s 2023-10-08T12:55:58.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 36178 23.69 MB/sec warmup 89 sec latency 127.367 ms 2023-10-08T12:55:59.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 36601 23.81 MB/sec warmup 90 sec latency 333.277 ms 2023-10-08T12:56:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:55:59 smithi173 ceph-mon[135182]: pgmap v774: 97 pgs: 97 active+clean; 902 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.7 MiB/s wr, 363 op/s 2023-10-08T12:56:00.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:55:59 smithi059 ceph-mon[98489]: pgmap v774: 97 pgs: 97 active+clean; 902 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.7 MiB/s wr, 363 op/s 2023-10-08T12:56:00.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:55:59 smithi092 ceph-mon[134093]: pgmap v774: 97 pgs: 97 active+clean; 902 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.7 MiB/s wr, 363 op/s 2023-10-08T12:56:00.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 37161 23.93 MB/sec warmup 91 sec latency 416.104 ms 2023-10-08T12:56:01.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 37458 23.91 MB/sec warmup 92 sec latency 151.720 ms 2023-10-08T12:56:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:02 smithi092 ceph-mon[134093]: pgmap v775: 97 pgs: 97 active+clean; 884 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 327 op/s 2023-10-08T12:56:02.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:02 smithi173 ceph-mon[135182]: pgmap v775: 97 pgs: 97 active+clean; 884 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 327 op/s 2023-10-08T12:56:02.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:02 smithi059 ceph-mon[98489]: pgmap v775: 97 pgs: 97 active+clean; 884 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 327 op/s 2023-10-08T12:56:02.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 37691 23.79 MB/sec warmup 93 sec latency 116.270 ms 2023-10-08T12:56:03.942 INFO:tasks.workunit.client.0.smithi059.stdout: 10 37966 23.68 MB/sec warmup 94 sec latency 59.346 ms 2023-10-08T12:56:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:04 smithi092 ceph-mon[134093]: pgmap v776: 97 pgs: 97 active+clean; 827 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.6 MiB/s wr, 432 op/s 2023-10-08T12:56:04.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:04 smithi092 ceph-mon[134093]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T12:56:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:04 smithi173 ceph-mon[135182]: pgmap v776: 97 pgs: 97 active+clean; 827 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.6 MiB/s wr, 432 op/s 2023-10-08T12:56:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:04 smithi173 ceph-mon[135182]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T12:56:04.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:04 smithi059 ceph-mon[98489]: pgmap v776: 97 pgs: 97 active+clean; 827 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.6 MiB/s wr, 432 op/s 2023-10-08T12:56:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:04 smithi059 ceph-mon[98489]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T12:56:04.943 INFO:tasks.workunit.client.0.smithi059.stdout: 10 38228 23.55 MB/sec warmup 95 sec latency 195.712 ms 2023-10-08T12:56:05.943 INFO:tasks.workunit.client.0.smithi059.stdout: 10 38443 23.39 MB/sec warmup 96 sec latency 433.768 ms 2023-10-08T12:56:06.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:06 smithi092 ceph-mon[134093]: pgmap v778: 97 pgs: 97 active+clean; 826 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 448 op/s 2023-10-08T12:56:06.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:06 smithi173 ceph-mon[135182]: pgmap v778: 97 pgs: 97 active+clean; 826 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 448 op/s 2023-10-08T12:56:06.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:06 smithi059 ceph-mon[98489]: pgmap v778: 97 pgs: 97 active+clean; 826 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 448 op/s 2023-10-08T12:56:06.944 INFO:tasks.workunit.client.0.smithi059.stdout: 10 38861 23.35 MB/sec warmup 97 sec latency 229.315 ms 2023-10-08T12:56:07.944 INFO:tasks.workunit.client.0.smithi059.stdout: 10 39435 23.35 MB/sec warmup 98 sec latency 199.260 ms 2023-10-08T12:56:08.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:08 smithi092 ceph-mon[134093]: pgmap v779: 97 pgs: 97 active+clean; 830 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.4 MiB/s wr, 559 op/s 2023-10-08T12:56:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:08 smithi173 ceph-mon[135182]: pgmap v779: 97 pgs: 97 active+clean; 830 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.4 MiB/s wr, 559 op/s 2023-10-08T12:56:08.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:08 smithi059 ceph-mon[98489]: pgmap v779: 97 pgs: 97 active+clean; 830 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.4 MiB/s wr, 559 op/s 2023-10-08T12:56:08.944 INFO:tasks.workunit.client.0.smithi059.stdout: 10 39928 23.44 MB/sec warmup 99 sec latency 199.959 ms 2023-10-08T12:56:09.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:56:09.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.729+0000 7f20537ff700 1 -- 172.21.15.59:0/656850826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f204c106740 msgr2=0x7f204c106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:09.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.729+0000 7f20537ff700 1 --2- 172.21.15.59:0/656850826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f204c106740 0x7f204c106b20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2048009990 tx=0x7f2048009ca0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.730+0000 7f20537ff700 1 -- 172.21.15.59:0/656850826 shutdown_connections 2023-10-08T12:56:09.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.730+0000 7f20537ff700 1 --2- 172.21.15.59:0/656850826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f204c106740 0x7f204c106b20 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.730+0000 7f20537ff700 1 --2- 172.21.15.59:0/656850826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c1010f0 0x7f204c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.730+0000 7f20537ff700 1 --2- 172.21.15.59:0/656850826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f204c100730 0x7f204c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.730+0000 7f20537ff700 1 -- 172.21.15.59:0/656850826 >> 172.21.15.59:0/656850826 conn(0x7f204c0fc200 msgr2=0x7f204c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:09.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.730+0000 7f20537ff700 1 -- 172.21.15.59:0/656850826 shutdown_connections 2023-10-08T12:56:09.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.730+0000 7f20537ff700 1 -- 172.21.15.59:0/656850826 wait complete. 2023-10-08T12:56:09.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.731+0000 7f20537ff700 1 Processor -- start 2023-10-08T12:56:09.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.731+0000 7f20537ff700 1 -- start start 2023-10-08T12:56:09.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.732+0000 7f20537ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c100730 0x7f204c19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.732+0000 7f20537ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f204c1010f0 0x7f204c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.732+0000 7f20537ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f204c106740 0x7f204c1969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.732+0000 7f20537ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c197040 con 0x7f204c100730 2023-10-08T12:56:09.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.732+0000 7f20537ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c1971b0 con 0x7f204c1010f0 2023-10-08T12:56:09.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.732+0000 7f20537ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c197370 con 0x7f204c106740 2023-10-08T12:56:09.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.732+0000 7f2050d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f204c1010f0 0x7f204c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.732+0000 7f2051d9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f204c106740 0x7f204c1969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.732+0000 7f2050d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f204c1010f0 0x7f204c19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57194/0 (socket says 172.21.15.59:57194) 2023-10-08T12:56:09.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.732+0000 7f2050d9a700 1 -- 172.21.15.59:0/3505228225 learned_addr learned my addr 172.21.15.59:0/3505228225 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:09.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.732+0000 7f205159b700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c100730 0x7f204c19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f2050d9a700 1 -- 172.21.15.59:0/3505228225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f204c106740 msgr2=0x7f204c1969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f2050d9a700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f204c106740 0x7f204c1969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f2050d9a700 1 -- 172.21.15.59:0/3505228225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c100730 msgr2=0x7f204c19c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f2050d9a700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c100730 0x7f204c19c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f2050d9a700 1 -- 172.21.15.59:0/3505228225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480095f0 con 0x7f204c1010f0 2023-10-08T12:56:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f205159b700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c100730 0x7f204c19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:56:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f2050d9a700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f204c1010f0 0x7f204c19cdf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f203c00e9a0 tx=0x7f203c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f20427fc700 1 -- 172.21.15.59:0/3505228225 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c009790 con 0x7f204c1010f0 2023-10-08T12:56:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f20427fc700 1 -- 172.21.15.59:0/3505228225 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f203c00cbd0 con 0x7f204c1010f0 2023-10-08T12:56:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f20537ff700 1 -- 172.21.15.59:0/3505228225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c197650 con 0x7f204c1010f0 2023-10-08T12:56:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f20427fc700 1 -- 172.21.15.59:0/3505228225 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c018680 con 0x7f204c1010f0 2023-10-08T12:56:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.733+0000 7f20537ff700 1 -- 172.21.15.59:0/3505228225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c1a38a0 con 0x7f204c1010f0 2023-10-08T12:56:09.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.738+0000 7f20427fc700 1 -- 172.21.15.59:0/3505228225 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f203c00cd40 con 0x7f204c1010f0 2023-10-08T12:56:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.740+0000 7f2067103b80 1 Processor -- start 2023-10-08T12:56:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.740+0000 7f2067103b80 1 -- start start 2023-10-08T12:56:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.740+0000 7f2067103b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 0x564275b5e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.740+0000 7f2067103b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 0x564275b6d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.740+0000 7f2067103b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b6fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.740+0000 7f2067103b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275ac7460 con 0x564275b5de80 2023-10-08T12:56:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.740+0000 7f2067103b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275ab8c20 con 0x564275b6da60 2023-10-08T12:56:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.740+0000 7f2067103b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275ab6540 con 0x564275b5e7a0 2023-10-08T12:56:09.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.741+0000 7f2051d9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 0x564275b5e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.741+0000 7f2051d9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 0x564275b5e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35492/0 (socket says 172.21.15.59:35492) 2023-10-08T12:56:09.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.741+0000 7f2051d9c700 1 -- 172.21.15.59:0/1134580967 learned_addr learned my addr 172.21.15.59:0/1134580967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:09.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.741+0000 7f205159b700 1 --2- 172.21.15.59:0/1134580967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 0x564275b6d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.741+0000 7f2050d9a700 1 --2- 172.21.15.59:0/1134580967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b6fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f205159b700 1 -- 172.21.15.59:0/1134580967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 msgr2=0x564275b6fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:09.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f20427fc700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20380a1670 0x7f20380a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f205159b700 1 --2- 172.21.15.59:0/1134580967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b6fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f205159b700 1 -- 172.21.15.59:0/1134580967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 msgr2=0x564275b5e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:09.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f205159b700 1 --2- 172.21.15.59:0/1134580967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 0x564275b5e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f205159b700 1 -- 172.21.15.59:0/1134580967 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642758dcde0 con 0x564275b5e7a0 2023-10-08T12:56:09.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f20427fc700 1 -- 172.21.15.59:0/3505228225 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f203c014070 con 0x7f204c1010f0 2023-10-08T12:56:09.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f205159b700 1 --2- 172.21.15.59:0/1134580967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 0x564275b6d520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2048000c00 tx=0x7f2048005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33443adfbbda5ca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:09.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f2051d9c700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20380a1670 0x7f20380a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f20377fe700 1 -- 172.21.15.59:0/1134580967 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20480049e0 con 0x564275b5e7a0 2023-10-08T12:56:09.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f20377fe700 1 -- 172.21.15.59:0/1134580967 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f204801e040 con 0x564275b5e7a0 2023-10-08T12:56:09.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.742+0000 7f20377fe700 1 -- 172.21.15.59:0/1134580967 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204800b9b0 con 0x564275b5e7a0 2023-10-08T12:56:09.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.743+0000 7f2067103b80 1 -- 172.21.15.59:0/1134580967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 msgr2=0x564275b6d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:09.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.743+0000 7f2051d9c700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20380a1670 0x7f20380a3b30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f20440075c0 tx=0x7f2044009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:09.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.743+0000 7f2067103b80 1 --2- 172.21.15.59:0/1134580967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 0x564275b6d520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2048000c00 tx=0x7f2048005c00 comp rx=0 tx=0).stop 2023-10-08T12:56:09.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.743+0000 7f2067103b80 1 -- 172.21.15.59:0/1134580967 shutdown_connections 2023-10-08T12:56:09.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.744+0000 7f2067103b80 1 --2- 172.21.15.59:0/1134580967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b6fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.744+0000 7f2067103b80 1 --2- 172.21.15.59:0/1134580967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 0x564275b5e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.744+0000 7f2067103b80 1 --2- 172.21.15.59:0/1134580967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 0x564275b6d520 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.744+0000 7f2067103b80 1 -- 172.21.15.59:0/1134580967 >> 172.21.15.59:0/1134580967 conn(0x564275ad3260 msgr2=0x564275b5a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:09.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.744+0000 7f2067103b80 1 -- 172.21.15.59:0/1134580967 shutdown_connections 2023-10-08T12:56:09.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.744+0000 7f2067103b80 1 -- 172.21.15.59:0/1134580967 wait complete. 2023-10-08T12:56:09.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.745+0000 7f2067103b80 1 -- start start 2023-10-08T12:56:09.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.745+0000 7f2067103b80 1 Processor -- start 2023-10-08T12:56:09.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.746+0000 7f2067103b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 0x564275b6d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.746+0000 7f2067103b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b5e7a0 0x564275b6a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.746+0000 7f2067103b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b6da60 0x564275b6ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.746+0000 7f2067103b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275ab1e30 con 0x564275b6da60 2023-10-08T12:56:09.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.746+0000 7f2067103b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275a4e710 con 0x564275b5e7a0 2023-10-08T12:56:09.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.746+0000 7f2067103b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275a4e3b0 con 0x564275b5de80 2023-10-08T12:56:09.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.746+0000 7f2067103b80 10 client.0 _ll_register_callbacks cb 0x5642758ab800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:09.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.746+0000 7f205159b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 0x564275b6d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.746+0000 7f2050d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b5e7a0 0x564275b6a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.746+0000 7f205159b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 0x564275b6d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38932/0 (socket says 172.21.15.59:38932) 2023-10-08T12:56:09.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.746+0000 7f205159b700 1 -- 172.21.15.59:0/896593694 learned_addr learned my addr 172.21.15.59:0/896593694 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:09.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.747+0000 7f2051d9c700 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b6da60 0x564275b6ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.747+0000 7f205159b700 1 -- 172.21.15.59:0/896593694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b5e7a0 msgr2=0x564275b6a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:09.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.747+0000 7f205159b700 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b5e7a0 0x564275b6a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.747+0000 7f205159b700 1 -- 172.21.15.59:0/896593694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b6da60 msgr2=0x564275b6ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:09.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.747+0000 7f205159b700 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b6da60 0x564275b6ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.747+0000 7f205159b700 1 -- 172.21.15.59:0/896593694 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c10df00 con 0x564275b5de80 2023-10-08T12:56:09.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.747+0000 7f2050d9a700 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b5e7a0 0x564275b6a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:09.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.747+0000 7f205159b700 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 0x564275b6d120 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f20480056b0 tx=0x7f204800be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eff14574d24cbb14 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:09.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.747+0000 7f2034ff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:56:09.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.748+0000 7f2034ff9700 1 -- 172.21.15.59:0/896593694 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204800f930 con 0x564275b5de80 2023-10-08T12:56:09.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.748+0000 7f2067103b80 1 -- 172.21.15.59:0/896593694 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564275a79eb0 con 0x564275b5de80 2023-10-08T12:56:09.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.748+0000 7f2034ff9700 1 -- 172.21.15.59:0/896593694 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f204800fa90 con 0x564275b5de80 2023-10-08T12:56:09.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.748+0000 7f2034ff9700 1 -- 172.21.15.59:0/896593694 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f204800fc50 con 0x564275b5de80 2023-10-08T12:56:09.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.748+0000 7f2067103b80 10 client.27616 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:09.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.748+0000 7f2067103b80 1 -- 172.21.15.59:0/896593694 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5642758c5c60 con 0x564275b5de80 2023-10-08T12:56:09.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.748+0000 7f2034ff9700 1 -- 172.21.15.59:0/896593694 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2048039020 con 0x564275b5de80 2023-10-08T12:56:09.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.748+0000 7f2034ff9700 1 -- 172.21.15.59:0/896593694 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f20480173f0 con 0x564275b5de80 2023-10-08T12:56:09.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.749+0000 7f2067103b80 10 client.27616 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:09.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.749+0000 7f2067103b80 10 client.27616 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:09.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.749+0000 7f2067103b80 20 client.27616 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:09.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.749+0000 7f2067103b80 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564275b72e30 0x564275b75220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.749+0000 7f2067103b80 4 client.27616 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:56:09.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.749+0000 7f2067103b80 1 -- 172.21.15.59:0/896593694 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564275aaae10 con 0x564275b72e30 2023-10-08T12:56:09.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.749+0000 7f2050d9a700 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564275b72e30 0x564275b75220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.749+0000 7f2050d9a700 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564275b72e30 0x564275b75220 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bd9295fccf28461 server_cookie=f107fa59416df3bf in_seq=0 out_seq=0 2023-10-08T12:56:09.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.749+0000 7f2034ff9700 10 client.27616 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:09.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.752+0000 7f2034ff9700 1 -- 172.21.15.59:0/896593694 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564275aaae10 con 0x564275b72e30 2023-10-08T12:56:09.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.752+0000 7f2034ff9700 10 client.27616 handle_command_reply: tid=0 2023-10-08T12:56:09.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2067103b80 1 client.27616 shutdown 2023-10-08T12:56:09.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2067103b80 1 -- 172.21.15.59:0/896593694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 msgr2=0x564275b6d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:09.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2067103b80 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 0x564275b6d120 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f20480056b0 tx=0x7f204800be40 comp rx=0 tx=0).stop 2023-10-08T12:56:09.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2067103b80 1 -- 172.21.15.59:0/896593694 shutdown_connections 2023-10-08T12:56:09.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2067103b80 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564275b72e30 0x564275b75220 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2067103b80 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b6da60 0x564275b6ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2067103b80 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 0x564275b6d120 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2067103b80 1 --2- 172.21.15.59:0/896593694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b5e7a0 0x564275b6a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2034ff9700 0 client.27616 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:09.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2067103b80 1 -- 172.21.15.59:0/896593694 >> 172.21.15.59:0/896593694 conn(0x564275ad3260 msgr2=0x564275b59ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:09.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2067103b80 1 -- 172.21.15.59:0/896593694 shutdown_connections 2023-10-08T12:56:09.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.753+0000 7f2067103b80 1 -- 172.21.15.59:0/896593694 wait complete. 2023-10-08T12:56:09.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.754+0000 7f2067103b80 20 client.27616 trim_cache size 0 max 16384 2023-10-08T12:56:09.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.775+0000 7f2067103b80 1 Processor -- start 2023-10-08T12:56:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.775+0000 7f2067103b80 1 -- start start 2023-10-08T12:56:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.775+0000 7f2067103b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 0x564275b6b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.775+0000 7f2067103b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5e7a0 0x564275b79a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.775+0000 7f2067103b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b75220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.775+0000 7f2067103b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275932920 con 0x564275b5e7a0 2023-10-08T12:56:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.775+0000 7f2067103b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275b54570 con 0x564275b6da60 2023-10-08T12:56:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.775+0000 7f2067103b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275b79f70 con 0x564275b5de80 2023-10-08T12:56:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.775+0000 7f2051d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b75220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.775+0000 7f2050d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5e7a0 0x564275b79a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.776+0000 7f2051d9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b75220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57208/0 (socket says 172.21.15.59:57208) 2023-10-08T12:56:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.776+0000 7f2051d9c700 1 -- 172.21.15.59:0/1597014397 learned_addr learned my addr 172.21.15.59:0/1597014397 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.776+0000 7f205159b700 1 --2- 172.21.15.59:0/1597014397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 0x564275b6b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.776+0000 7f2051d9c700 1 -- 172.21.15.59:0/1597014397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 msgr2=0x564275b6b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.776+0000 7f2051d9c700 1 --2- 172.21.15.59:0/1597014397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 0x564275b6b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.776+0000 7f2051d9c700 1 -- 172.21.15.59:0/1597014397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5e7a0 msgr2=0x564275b79a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.776+0000 7f2051d9c700 1 --2- 172.21.15.59:0/1597014397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5e7a0 0x564275b79a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.776+0000 7f2051d9c700 1 -- 172.21.15.59:0/1597014397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564275903250 con 0x564275b6da60 2023-10-08T12:56:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.776+0000 7f205159b700 1 --2- 172.21.15.59:0/1597014397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 0x564275b6b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.776+0000 7f2051d9c700 1 --2- 172.21.15.59:0/1597014397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b75220 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2044017a10 tx=0x7f2044004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63b7df2b6a5b31f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.776+0000 7f2037fff700 1 -- 172.21.15.59:0/1597014397 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204400e040 con 0x564275b6da60 2023-10-08T12:56:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.777+0000 7f2037fff700 1 -- 172.21.15.59:0/1597014397 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f204400f040 con 0x564275b6da60 2023-10-08T12:56:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.777+0000 7f2037fff700 1 -- 172.21.15.59:0/1597014397 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044016b10 con 0x564275b6da60 2023-10-08T12:56:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.777+0000 7f2067103b80 1 -- 172.21.15.59:0/1597014397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 msgr2=0x564275b75220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.777+0000 7f2067103b80 1 --2- 172.21.15.59:0/1597014397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b75220 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2044017a10 tx=0x7f2044004b40 comp rx=0 tx=0).stop 2023-10-08T12:56:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.778+0000 7f2067103b80 1 -- 172.21.15.59:0/1597014397 shutdown_connections 2023-10-08T12:56:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.778+0000 7f2067103b80 1 --2- 172.21.15.59:0/1597014397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b75220 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.778+0000 7f2067103b80 1 --2- 172.21.15.59:0/1597014397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5de80 0x564275b6b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.778+0000 7f2067103b80 1 --2- 172.21.15.59:0/1597014397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5e7a0 0x564275b79a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.778+0000 7f2067103b80 1 -- 172.21.15.59:0/1597014397 >> 172.21.15.59:0/1597014397 conn(0x564275ad3260 msgr2=0x564275b55f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.778+0000 7f2067103b80 1 -- 172.21.15.59:0/1597014397 shutdown_connections 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.778+0000 7f2067103b80 1 -- 172.21.15.59:0/1597014397 wait complete. 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.778+0000 7f2067103b80 1 -- start start 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.778+0000 7f2067103b80 1 Processor -- start 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2067103b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 0x564275bd6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2067103b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 0x564275bd67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2067103b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b78a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2067103b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275b79030 con 0x564275b5de80 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2067103b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275b791a0 con 0x564275b6da60 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2067103b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564275b79360 con 0x564275b5e7a0 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2067103b80 10 client.0 _ll_register_callbacks cb 0x7f2044009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f205159b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 0x564275bd6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2050d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 0x564275bd67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f205159b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 0x564275bd6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35530/0 (socket says 172.21.15.59:35530) 2023-10-08T12:56:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f205159b700 1 -- 172.21.15.59:0/2517758189 learned_addr learned my addr 172.21.15.59:0/2517758189 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2050d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 0x564275bd67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:38948/0 (socket says 172.21.15.59:38948) 2023-10-08T12:56:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2051d9c700 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b78a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2051d9c700 1 -- 172.21.15.59:0/2517758189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 msgr2=0x564275bd67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2051d9c700 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 0x564275bd67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2051d9c700 1 -- 172.21.15.59:0/2517758189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 msgr2=0x564275bd6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2051d9c700 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 0x564275bd6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.779+0000 7f2051d9c700 1 -- 172.21.15.59:0/2517758189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642758c5c60 con 0x564275b6da60 2023-10-08T12:56:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.780+0000 7f2051d9c700 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b78a60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2044009460 tx=0x7f2044016d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57ad815321567d2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:09.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.780+0000 7f2034ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:56:09.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.780+0000 7f2034ff9700 1 -- 172.21.15.59:0/2517758189 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204400e040 con 0x564275b6da60 2023-10-08T12:56:09.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.780+0000 7f2067103b80 1 -- 172.21.15.59:0/2517758189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f204801e040 con 0x564275b6da60 2023-10-08T12:56:09.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.780+0000 7f2034ff9700 1 -- 172.21.15.59:0/2517758189 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f204401c040 con 0x564275b6da60 2023-10-08T12:56:09.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.780+0000 7f2034ff9700 1 -- 172.21.15.59:0/2517758189 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20440164b0 con 0x564275b6da60 2023-10-08T12:56:09.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.780+0000 7f2067103b80 10 client.27626 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:09.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.780+0000 7f2067103b80 1 -- 172.21.15.59:0/2517758189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f20440176f0 con 0x564275b6da60 2023-10-08T12:56:09.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.781+0000 7f2034ff9700 1 -- 172.21.15.59:0/2517758189 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f204801e040 con 0x564275b6da60 2023-10-08T12:56:09.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.781+0000 7f2034ff9700 1 -- 172.21.15.59:0/2517758189 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2044033070 con 0x564275b6da60 2023-10-08T12:56:09.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.781+0000 7f2067103b80 10 client.27626 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:09.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.781+0000 7f2067103b80 10 client.27626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:09.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.781+0000 7f2067103b80 20 client.27626 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:09.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.781+0000 7f2067103b80 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564275bdf0b0 0x564275be14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:09.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.781+0000 7f2067103b80 4 client.27626 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:56:09.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.781+0000 7f2067103b80 1 -- 172.21.15.59:0/2517758189 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564275aaab30 con 0x564275bdf0b0 2023-10-08T12:56:09.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.782+0000 7f205159b700 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564275bdf0b0 0x564275be14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:09.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.782+0000 7f2034ff9700 10 client.27626 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:09.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.782+0000 7f205159b700 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564275bdf0b0 0x564275be14a0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f8db4d762815148 server_cookie=7c03e92f59767daf in_seq=0 out_seq=0 2023-10-08T12:56:09.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2034ff9700 1 -- 172.21.15.59:0/2517758189 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564275aaab30 con 0x564275bdf0b0 2023-10-08T12:56:09.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2034ff9700 10 client.27626 handle_command_reply: tid=0 2023-10-08T12:56:09.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2067103b80 1 client.27626 shutdown 2023-10-08T12:56:09.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2067103b80 1 -- 172.21.15.59:0/2517758189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 msgr2=0x564275b78a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:09.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2067103b80 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b78a60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2044009460 tx=0x7f2044016d90 comp rx=0 tx=0).stop 2023-10-08T12:56:09.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2067103b80 1 -- 172.21.15.59:0/2517758189 shutdown_connections 2023-10-08T12:56:09.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2067103b80 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564275bdf0b0 0x564275be14a0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2067103b80 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564275b6da60 0x564275b78a60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2034ff9700 0 client.27626 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:09.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2067103b80 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564275b5de80 0x564275bd6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2067103b80 1 --2- 172.21.15.59:0/2517758189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564275b5e7a0 0x564275bd67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2067103b80 1 -- 172.21.15.59:0/2517758189 >> 172.21.15.59:0/2517758189 conn(0x564275ad3260 msgr2=0x564275b65bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:09.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2067103b80 1 -- 172.21.15.59:0/2517758189 shutdown_connections 2023-10-08T12:56:09.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.789+0000 7f2067103b80 1 -- 172.21.15.59:0/2517758189 wait complete. 2023-10-08T12:56:09.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f2067103b80 20 client.27626 trim_cache size 0 max 16384 2023-10-08T12:56:09.792 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:56:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:56:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:56:09.792 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:56:09.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f20537ff700 1 -- 172.21.15.59:0/3505228225 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20380a1670 msgr2=0x7f20380a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:09.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f20537ff700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20380a1670 0x7f20380a3b30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f20440075c0 tx=0x7f2044009040 comp rx=0 tx=0).stop 2023-10-08T12:56:09.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f20537ff700 1 -- 172.21.15.59:0/3505228225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f204c1010f0 msgr2=0x7f204c19cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:09.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f20537ff700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f204c1010f0 0x7f204c19cdf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f203c00e9a0 tx=0x7f203c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f20537ff700 1 -- 172.21.15.59:0/3505228225 shutdown_connections 2023-10-08T12:56:09.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f20537ff700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f20380a1670 0x7f20380a3b30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f20537ff700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f204c106740 0x7f204c1969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f20537ff700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c100730 0x7f204c19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f20537ff700 1 --2- 172.21.15.59:0/3505228225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f204c1010f0 0x7f204c19cdf0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:09.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f20537ff700 1 -- 172.21.15.59:0/3505228225 >> 172.21.15.59:0/3505228225 conn(0x7f204c0fc200 msgr2=0x7f204c0fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:09.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.790+0000 7f20537ff700 1 -- 172.21.15.59:0/3505228225 shutdown_connections 2023-10-08T12:56:09.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:09.791+0000 7f20537ff700 1 -- 172.21.15.59:0/3505228225 wait complete. 2023-10-08T12:56:09.811 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:56:09.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:56:09.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 40446 23.56 MB/sec warmup 100 sec latency 92.647 ms 2023-10-08T12:56:10.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.118+0000 7fc8e61ff700 1 -- 172.21.15.59:0/3553615726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e010ce70 msgr2=0x7fc8e010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.118+0000 7fc8e61ff700 1 --2- 172.21.15.59:0/3553615726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e010ce70 0x7fc8e010f2e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc8d800b0a0 tx=0x7fc8d800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.118+0000 7fc8e61ff700 1 -- 172.21.15.59:0/3553615726 shutdown_connections 2023-10-08T12:56:10.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.118+0000 7fc8e61ff700 1 --2- 172.21.15.59:0/3553615726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e010ce70 0x7fc8e010f2e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.118+0000 7fc8e61ff700 1 --2- 172.21.15.59:0/3553615726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e0072c20 0x7fc8e0073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.118+0000 7fc8e61ff700 1 --2- 172.21.15.59:0/3553615726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e0073540 0x7fc8e010c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.118+0000 7fc8e61ff700 1 -- 172.21.15.59:0/3553615726 >> 172.21.15.59:0/3553615726 conn(0x7fc8e00fc1a0 msgr2=0x7fc8e00fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:10.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.118+0000 7fc8e61ff700 1 -- 172.21.15.59:0/3553615726 shutdown_connections 2023-10-08T12:56:10.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.118+0000 7fc8e61ff700 1 -- 172.21.15.59:0/3553615726 wait complete. 2023-10-08T12:56:10.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.119+0000 7fc8e61ff700 1 Processor -- start 2023-10-08T12:56:10.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.119+0000 7fc8e61ff700 1 -- start start 2023-10-08T12:56:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.119+0000 7fc8e61ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e0072c20 0x7fc8e0198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.119+0000 7fc8e61ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0073540 0x7fc8e0199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.119+0000 7fc8e61ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e010ce70 0x7fc8e019d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8e61ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e019dd40 con 0x7fc8e010ce70 2023-10-08T12:56:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8e61ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e019deb0 con 0x7fc8e0073540 2023-10-08T12:56:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8e61ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e019e070 con 0x7fc8e0072c20 2023-10-08T12:56:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8deffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0073540 0x7fc8e0199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8df7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e0072c20 0x7fc8e0198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8deffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0073540 0x7fc8e0199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:57232/0 (socket says 172.21.15.59:57232) 2023-10-08T12:56:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8deffd700 1 -- 172.21.15.59:0/2721907785 learned_addr learned my addr 172.21.15.59:0/2721907785 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8dffff700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e010ce70 0x7fc8e019d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8deffd700 1 -- 172.21.15.59:0/2721907785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e0072c20 msgr2=0x7fc8e0198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8deffd700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e0072c20 0x7fc8e0198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8deffd700 1 -- 172.21.15.59:0/2721907785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e010ce70 msgr2=0x7fc8e019d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8deffd700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e010ce70 0x7fc8e019d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8deffd700 1 -- 172.21.15.59:0/2721907785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8009d00 con 0x7fc8e0073540 2023-10-08T12:56:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8dffff700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e010ce70 0x7fc8e019d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.120+0000 7fc8deffd700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0073540 0x7fc8e0199360 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400e9a0 tx=0x7fc8d400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.121+0000 7fc8dcff9700 1 -- 172.21.15.59:0/2721907785 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4009790 con 0x7fc8e0073540 2023-10-08T12:56:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.121+0000 7fc8dcff9700 1 -- 172.21.15.59:0/2721907785 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8d4010430 con 0x7fc8e0073540 2023-10-08T12:56:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.121+0000 7fc8e61ff700 1 -- 172.21.15.59:0/2721907785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e019e350 con 0x7fc8e0073540 2023-10-08T12:56:10.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.121+0000 7fc8dcff9700 1 -- 172.21.15.59:0/2721907785 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4018680 con 0x7fc8e0073540 2023-10-08T12:56:10.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.121+0000 7fc8e61ff700 1 -- 172.21.15.59:0/2721907785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e01a5b90 con 0x7fc8e0073540 2023-10-08T12:56:10.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.122+0000 7fc8e61ff700 1 -- 172.21.15.59:0/2721907785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e0108080 con 0x7fc8e0073540 2023-10-08T12:56:10.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.124+0000 7fc8dcff9700 1 -- 172.21.15.59:0/2721907785 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc8d40105a0 con 0x7fc8e0073540 2023-10-08T12:56:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.126+0000 7fc8dcff9700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8c80a1670 0x7fc8c80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.126+0000 7fc8dcff9700 1 -- 172.21.15.59:0/2721907785 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fc8d4014070 con 0x7fc8e0073540 2023-10-08T12:56:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.126+0000 7fc8df7fe700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8c80a1670 0x7fc8c80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.127+0000 7fc8df7fe700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8c80a1670 0x7fc8c80a3b30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009c60 tx=0x7fc8d0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.127+0000 7fc8dcff9700 1 -- 172.21.15.59:0/2721907785 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc8d4096560 con 0x7fc8e0073540 2023-10-08T12:56:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:09 smithi059 ceph-mon[98489]: pgmap v780: 97 pgs: 97 active+clean; 838 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.9 MiB/s wr, 567 op/s 2023-10-08T12:56:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:09 smithi092 ceph-mon[134093]: pgmap v780: 97 pgs: 97 active+clean; 838 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.9 MiB/s wr, 567 op/s 2023-10-08T12:56:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.403+0000 7fc8e61ff700 1 -- 172.21.15.59:0/2721907785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8e00742d0 con 0x7fc8e0073540 2023-10-08T12:56:10.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.404+0000 7fc8dcff9700 1 -- 172.21.15.59:0/2721907785 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fc8d4099b80 con 0x7fc8e0073540 2023-10-08T12:56:10.405 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:56:10.406 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:56:10.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 -- 172.21.15.59:0/2721907785 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8c80a1670 msgr2=0x7fc8c80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8c80a1670 0x7fc8c80a3b30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009c60 tx=0x7fc8d0009260 comp rx=0 tx=0).stop 2023-10-08T12:56:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 -- 172.21.15.59:0/2721907785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0073540 msgr2=0x7fc8e0199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0073540 0x7fc8e0199360 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400e9a0 tx=0x7fc8d400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 -- 172.21.15.59:0/2721907785 shutdown_connections 2023-10-08T12:56:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc8c80a1670 0x7fc8c80a3b30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e010ce70 0x7fc8e019d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e0072c20 0x7fc8e0198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 --2- 172.21.15.59:0/2721907785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0073540 0x7fc8e0199360 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 -- 172.21.15.59:0/2721907785 >> 172.21.15.59:0/2721907785 conn(0x7fc8e00fc1a0 msgr2=0x7fc8e00fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:10.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 -- 172.21.15.59:0/2721907785 shutdown_connections 2023-10-08T12:56:10.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.406+0000 7fc8e61ff700 1 -- 172.21.15.59:0/2721907785 wait complete. 2023-10-08T12:56:10.409 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:56:10.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:56:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:09 smithi173 ceph-mon[135182]: pgmap v780: 97 pgs: 97 active+clean; 838 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.9 MiB/s wr, 567 op/s 2023-10-08T12:56:10.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.664+0000 7fbea29ff700 1 -- 172.21.15.59:0/428918994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe9c106750 msgr2=0x7fbe9c106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.664+0000 7fbea29ff700 1 --2- 172.21.15.59:0/428918994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe9c106750 0x7fbe9c106b30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009990 tx=0x7fbe8c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.664+0000 7fbea29ff700 1 -- 172.21.15.59:0/428918994 shutdown_connections 2023-10-08T12:56:10.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.664+0000 7fbea29ff700 1 --2- 172.21.15.59:0/428918994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9c101100 0x7fbe9c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.664+0000 7fbea29ff700 1 --2- 172.21.15.59:0/428918994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe9c106750 0x7fbe9c106b30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.664+0000 7fbea29ff700 1 --2- 172.21.15.59:0/428918994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe9c100740 0x7fbe9c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.664+0000 7fbea29ff700 1 -- 172.21.15.59:0/428918994 >> 172.21.15.59:0/428918994 conn(0x7fbe9c0fc230 msgr2=0x7fbe9c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:10.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.664+0000 7fbea29ff700 1 -- 172.21.15.59:0/428918994 shutdown_connections 2023-10-08T12:56:10.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.664+0000 7fbea29ff700 1 -- 172.21.15.59:0/428918994 wait complete. 2023-10-08T12:56:10.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.665+0000 7fbea29ff700 1 Processor -- start 2023-10-08T12:56:10.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.665+0000 7fbea29ff700 1 -- start start 2023-10-08T12:56:10.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbea29ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe9c100740 0x7fbe9c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbea29ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe9c101100 0x7fbe9c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbea29ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9c106750 0x7fbe9c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbea29ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c19dcd0 con 0x7fbe9c106750 2023-10-08T12:56:10.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbea29ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c19de40 con 0x7fbe9c100740 2023-10-08T12:56:10.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbea29ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c19e000 con 0x7fbe9c101100 2023-10-08T12:56:10.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbe9bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe9c100740 0x7fbe9c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbe9bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe9c100740 0x7fbe9c198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50660/0 (socket says 172.21.15.59:50660) 2023-10-08T12:56:10.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbe9bfff700 1 -- 172.21.15.59:0/1887451113 learned_addr learned my addr 172.21.15.59:0/1887451113 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:10.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbe9b7fe700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe9c101100 0x7fbe9c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbea0f9c700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9c106750 0x7fbe9c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbe9bfff700 1 -- 172.21.15.59:0/1887451113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe9c101100 msgr2=0x7fbe9c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe9c101100 0x7fbe9c1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbe9bfff700 1 -- 172.21.15.59:0/1887451113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9c106750 msgr2=0x7fbe9c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9c106750 0x7fbe9c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.666+0000 7fbe9bfff700 1 -- 172.21.15.59:0/1887451113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c0095f0 con 0x7fbe9c100740 2023-10-08T12:56:10.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.667+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe9c100740 0x7fbe9c198db0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005910 tx=0x7fbe8c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:10.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.667+0000 7fbe997fa700 1 -- 172.21.15.59:0/1887451113 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c01d070 con 0x7fbe9c100740 2023-10-08T12:56:10.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.667+0000 7fbe997fa700 1 -- 172.21.15.59:0/1887451113 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe8c022470 con 0x7fbe9c100740 2023-10-08T12:56:10.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.667+0000 7fbea29ff700 1 -- 172.21.15.59:0/1887451113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c19e280 con 0x7fbe9c100740 2023-10-08T12:56:10.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.667+0000 7fbe997fa700 1 -- 172.21.15.59:0/1887451113 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c017650 con 0x7fbe9c100740 2023-10-08T12:56:10.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.667+0000 7fbea29ff700 1 -- 172.21.15.59:0/1887451113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c1a5b20 con 0x7fbe9c100740 2023-10-08T12:56:10.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.670+0000 7fbe997fa700 1 -- 172.21.15.59:0/1887451113 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbe8c0225e0 con 0x7fbe9c100740 2023-10-08T12:56:10.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.671+0000 7fbeb62c5b80 1 Processor -- start 2023-10-08T12:56:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbeb62c5b80 1 -- start start 2023-10-08T12:56:10.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbe997fa700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe840a15f0 0x7fbe840a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cdc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdc7a0 0x562f37ce7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbe997fa700 1 -- 172.21.15.59:0/1887451113 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fbe8c0ce470 con 0x7fbe9c100740 2023-10-08T12:56:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37ce7650 0x562f37ce9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37c45460 con 0x562f37cdc7a0 2023-10-08T12:56:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37c36c20 con 0x562f37cdbe80 2023-10-08T12:56:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37c34540 con 0x562f37ce7650 2023-10-08T12:56:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbe9bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cdc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbe9bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cdc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50670/0 (socket says 172.21.15.59:50670) 2023-10-08T12:56:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbe9bfff700 1 -- 172.21.15.59:0/2239539298 learned_addr learned my addr 172.21.15.59:0/2239539298 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbea0f9c700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe840a15f0 0x7fbe840a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.672+0000 7fbe9b7fe700 1 --2- 172.21.15.59:0/2239539298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdc7a0 0x562f37ce7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.673+0000 7fbea0f9c700 1 --2- 172.21.15.59:0/2239539298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37ce7650 0x562f37ce9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.673+0000 7fbe9bfff700 1 -- 172.21.15.59:0/2239539298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37ce7650 msgr2=0x562f37ce9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.673+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/2239539298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37ce7650 0x562f37ce9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.673+0000 7fbe9bfff700 1 -- 172.21.15.59:0/2239539298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdc7a0 msgr2=0x562f37ce7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.673+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/2239539298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdc7a0 0x562f37ce7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.673+0000 7fbe9bfff700 1 -- 172.21.15.59:0/2239539298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f37a5ade0 con 0x562f37cdbe80 2023-10-08T12:56:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.673+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/2239539298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cdc260 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c000c00 tx=0x7fbe8c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd23a9a0ec1f3abd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.673+0000 7fbea0f9c700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe840a15f0 0x7fbe840a3ab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbe94015b00 tx=0x7fbe94009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.673+0000 7fbe827fc700 1 -- 172.21.15.59:0/2239539298 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c09bba0 con 0x562f37cdbe80 2023-10-08T12:56:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.673+0000 7fbe827fc700 1 -- 172.21.15.59:0/2239539298 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe8c09b4a0 con 0x562f37cdbe80 2023-10-08T12:56:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.673+0000 7fbe827fc700 1 -- 172.21.15.59:0/2239539298 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c09b960 con 0x562f37cdbe80 2023-10-08T12:56:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.674+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/2239539298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 msgr2=0x562f37cdc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.674+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/2239539298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cdc260 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c000c00 tx=0x7fbe8c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.674+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/2239539298 shutdown_connections 2023-10-08T12:56:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.674+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/2239539298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cdc260 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.674+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/2239539298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37ce7650 0x562f37ce9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.674+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/2239539298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdc7a0 0x562f37ce7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.674+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/2239539298 >> 172.21.15.59:0/2239539298 conn(0x562f37c51260 msgr2=0x562f37cd82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.674+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/2239539298 shutdown_connections 2023-10-08T12:56:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.674+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/2239539298 wait complete. 2023-10-08T12:56:10.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.675+0000 7fbeb62c5b80 1 -- start start 2023-10-08T12:56:10.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.675+0000 7fbeb62c5b80 1 Processor -- start 2023-10-08T12:56:10.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdbe80 0x562f37ce7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37cdc7a0 0x562f37ce7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37ce7650 0x562f37cf2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37c2fe30 con 0x562f37cdbe80 2023-10-08T12:56:10.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37bcc710 con 0x562f37ce7650 2023-10-08T12:56:10.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37bcc3b0 con 0x562f37cdc7a0 2023-10-08T12:56:10.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbeb62c5b80 10 client.0 _ll_register_callbacks cb 0x562f37a29800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:10.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbea0f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37ce7650 0x562f37cf2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbea0f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37ce7650 0x562f37cf2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50682/0 (socket says 172.21.15.59:50682) 2023-10-08T12:56:10.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbea0f9c700 1 -- 172.21.15.59:0/1121136770 learned_addr learned my addr 172.21.15.59:0/1121136770 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:10.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdbe80 0x562f37ce7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbe9b7fe700 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37cdc7a0 0x562f37ce7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbea0f9c700 1 -- 172.21.15.59:0/1121136770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37cdc7a0 msgr2=0x562f37ce7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:10.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbea0f9c700 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37cdc7a0 0x562f37ce7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbea0f9c700 1 -- 172.21.15.59:0/1121136770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdbe80 msgr2=0x562f37ce7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:10.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbea0f9c700 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdbe80 0x562f37ce7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbea0f9c700 1 -- 172.21.15.59:0/1121136770 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c1a5b20 con 0x562f37ce7650 2023-10-08T12:56:10.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.676+0000 7fbe9b7fe700 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37cdc7a0 0x562f37ce7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:56:10.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.677+0000 7fbea0f9c700 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37ce7650 0x562f37cf2ab0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbe94006130 tx=0x7fbe94004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc775c23ceaa810a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:10.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.677+0000 7fbe7b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:56:10.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.677+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/1121136770 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9400e040 con 0x562f37ce7650 2023-10-08T12:56:10.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.677+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/1121136770 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f37bf7eb0 con 0x562f37ce7650 2023-10-08T12:56:10.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.677+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/1121136770 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fbe9401e040 con 0x562f37ce7650 2023-10-08T12:56:10.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.677+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/1121136770 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe94007910 con 0x562f37ce7650 2023-10-08T12:56:10.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.677+0000 7fbeb62c5b80 10 client.27644 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:10.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.677+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/1121136770 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x562f37a43c60 con 0x562f37ce7650 2023-10-08T12:56:10.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.677+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/1121136770 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562f37bf7eb0 con 0x562f37ce7650 2023-10-08T12:56:10.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.678+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/1121136770 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbe94024d10 con 0x562f37ce7650 2023-10-08T12:56:10.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.678+0000 7fbeb62c5b80 10 client.27644 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:10.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.678+0000 7fbeb62c5b80 10 client.27644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:10.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.678+0000 7fbeb62c5b80 20 client.27644 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:10.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.678+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562f37cf6f00 0x562f37cf9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.678+0000 7fbeb62c5b80 4 client.27644 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:56:10.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.678+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/1121136770 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f37c28e10 con 0x562f37cf6f00 2023-10-08T12:56:10.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.678+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562f37cf6f00 0x562f37cf9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.679+0000 7fbe7b7fe700 10 client.27644 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:10.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.679+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562f37cf6f00 0x562f37cf9320 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=595885401fc7e864 server_cookie=10712756a7d6f505 in_seq=0 out_seq=0 2023-10-08T12:56:10.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/1121136770 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562f37c28e10 con 0x562f37cf6f00 2023-10-08T12:56:10.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbe7b7fe700 10 client.27644 handle_command_reply: tid=0 2023-10-08T12:56:10.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 1 client.27644 shutdown 2023-10-08T12:56:10.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/1121136770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37ce7650 msgr2=0x562f37cf2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37ce7650 0x562f37cf2ab0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbe94006130 tx=0x7fbe94004b40 comp rx=0 tx=0).stop 2023-10-08T12:56:10.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/1121136770 shutdown_connections 2023-10-08T12:56:10.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562f37cf6f00 0x562f37cf9320 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37ce7650 0x562f37cf2ab0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdbe80 0x562f37ce7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/1121136770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37cdc7a0 0x562f37ce7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbe7b7fe700 0 client.27644 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:10.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/1121136770 >> 172.21.15.59:0/1121136770 conn(0x562f37c51260 msgr2=0x562f37cd7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:10.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/1121136770 shutdown_connections 2023-10-08T12:56:10.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/1121136770 wait complete. 2023-10-08T12:56:10.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.681+0000 7fbeb62c5b80 20 client.27644 trim_cache size 0 max 16384 2023-10-08T12:56:10.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.695+0000 7fbeb62c5b80 1 Processor -- start 2023-10-08T12:56:10.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbeb62c5b80 1 -- start start 2023-10-08T12:56:10.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cec900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37cdc7a0 0x562f37ce1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37ce7650 0x562f37ce1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37ab0920 con 0x562f37ce7650 2023-10-08T12:56:10.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37bf7eb0 con 0x562f37cdbe80 2023-10-08T12:56:10.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37ce6e30 con 0x562f37cdc7a0 2023-10-08T12:56:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbe9bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cec900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbea0f9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37ce7650 0x562f37ce1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbe9b7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37cdc7a0 0x562f37ce1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbe9bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cec900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50688/0 (socket says 172.21.15.59:50688) 2023-10-08T12:56:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.696+0000 7fbe9bfff700 1 -- 172.21.15.59:0/2214724825 learned_addr learned my addr 172.21.15.59:0/2214724825 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.697+0000 7fbe9bfff700 1 -- 172.21.15.59:0/2214724825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37cdc7a0 msgr2=0x562f37ce1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.697+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/2214724825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37cdc7a0 0x562f37ce1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.697+0000 7fbe9bfff700 1 -- 172.21.15.59:0/2214724825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37ce7650 msgr2=0x562f37ce1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.697+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/2214724825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37ce7650 0x562f37ce1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.697+0000 7fbe9bfff700 1 -- 172.21.15.59:0/2214724825 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f37a81250 con 0x562f37cdbe80 2023-10-08T12:56:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.697+0000 7fbea0f9c700 1 --2- 172.21.15.59:0/2214724825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37ce7650 0x562f37ce1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.697+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/2214724825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cec900 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c09b150 tx=0x7fbe8c022f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c1e2f635302930 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.697+0000 7fbe82ffd700 1 -- 172.21.15.59:0/2214724825 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0b9040 con 0x562f37cdbe80 2023-10-08T12:56:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.697+0000 7fbe82ffd700 1 -- 172.21.15.59:0/2214724825 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe8c0b7070 con 0x562f37cdbe80 2023-10-08T12:56:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.697+0000 7fbe82ffd700 1 -- 172.21.15.59:0/2214724825 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c09b700 con 0x562f37cdbe80 2023-10-08T12:56:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.698+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/2214724825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 msgr2=0x562f37cec900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.698+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/2214724825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cec900 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c09b150 tx=0x7fbe8c022f90 comp rx=0 tx=0).stop 2023-10-08T12:56:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.698+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/2214724825 shutdown_connections 2023-10-08T12:56:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.698+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/2214724825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdbe80 0x562f37cec900 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.698+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/2214724825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37ce7650 0x562f37ce1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.698+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/2214724825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37cdc7a0 0x562f37ce1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.698+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/2214724825 >> 172.21.15.59:0/2214724825 conn(0x562f37c51260 msgr2=0x562f37ce0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.698+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/2214724825 shutdown_connections 2023-10-08T12:56:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.698+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/2214724825 wait complete. 2023-10-08T12:56:10.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.698+0000 7fbeb62c5b80 1 -- start start 2023-10-08T12:56:10.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbeb62c5b80 1 Processor -- start 2023-10-08T12:56:10.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdbe80 0x562f37d43030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdc7a0 0x562f37d43570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbeb62c5b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37ce7650 0x562f37d43d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37d44460 con 0x562f37cdbe80 2023-10-08T12:56:10.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37d445d0 con 0x562f37cdc7a0 2023-10-08T12:56:10.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbeb62c5b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f37d44790 con 0x562f37ce7650 2023-10-08T12:56:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbeb62c5b80 10 client.0 _ll_register_callbacks cb 0x7fbe940093e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbe9bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdbe80 0x562f37d43030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbe9b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdc7a0 0x562f37d43570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbe9b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdc7a0 0x562f37d43570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50692/0 (socket says 172.21.15.59:50692) 2023-10-08T12:56:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbe9b7fe700 1 -- 172.21.15.59:0/835347671 learned_addr learned my addr 172.21.15.59:0/835347671 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.699+0000 7fbe9bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdbe80 0x562f37d43030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58724/0 (socket says 172.21.15.59:58724) 2023-10-08T12:56:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbea0f9c700 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37ce7650 0x562f37d43d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbe9b7fe700 1 -- 172.21.15.59:0/835347671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37ce7650 msgr2=0x562f37d43d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbe9b7fe700 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37ce7650 0x562f37d43d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbe9b7fe700 1 -- 172.21.15.59:0/835347671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdbe80 msgr2=0x562f37d43030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbe9b7fe700 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdbe80 0x562f37d43030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbe9b7fe700 1 -- 172.21.15.59:0/835347671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f37a43c60 con 0x562f37cdc7a0 2023-10-08T12:56:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbea0f9c700 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37ce7650 0x562f37d43d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:56:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbe9b7fe700 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdc7a0 0x562f37d43570 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x562f37ce6d90 tx=0x7fbe90010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a606a2d3e3400320 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbe7b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:56:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/835347671 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90004460 con 0x562f37cdc7a0 2023-10-08T12:56:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/835347671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe8c09b4a0 con 0x562f37cdc7a0 2023-10-08T12:56:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.700+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/835347671 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fbe9000f7a0 con 0x562f37cdc7a0 2023-10-08T12:56:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/835347671 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe9000f960 con 0x562f37cdc7a0 2023-10-08T12:56:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbeb62c5b80 10 client.27650 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/835347671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x562f37a5ade0 con 0x562f37cdc7a0 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/835347671 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe9002a020 con 0x562f37cdc7a0 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/835347671 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbe90025390 con 0x562f37cdc7a0 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbeb62c5b80 10 client.27650 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbeb62c5b80 10 client.27650 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbeb62c5b80 20 client.27650 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562f37d4c0d0 0x562f37d4e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbeb62c5b80 4 client.27650 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/835347671 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562f37c28b30 con 0x562f37d4c0d0 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.701+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562f37d4c0d0 0x562f37d4e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.702+0000 7fbe9bfff700 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562f37d4c0d0 0x562f37d4e4f0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c93e31a27f63df63 server_cookie=c1f642341513167a in_seq=0 out_seq=0 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.702+0000 7fbe7b7fe700 10 client.27650 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.705+0000 7fbe7b7fe700 1 -- 172.21.15.59:0/835347671 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562f37c28b30 con 0x562f37d4c0d0 2023-10-08T12:56:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.705+0000 7fbe7b7fe700 10 client.27650 handle_command_reply: tid=0 2023-10-08T12:56:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.705+0000 7fbeb62c5b80 1 client.27650 shutdown 2023-10-08T12:56:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/835347671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdc7a0 msgr2=0x562f37d43570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdc7a0 0x562f37d43570 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x562f37ce6d90 tx=0x7fbe90010c10 comp rx=0 tx=0).stop 2023-10-08T12:56:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/835347671 shutdown_connections 2023-10-08T12:56:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x562f37d4c0d0 0x562f37d4e4f0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f37ce7650 0x562f37d43d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f37cdbe80 0x562f37d43030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbeb62c5b80 1 --2- 172.21.15.59:0/835347671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f37cdc7a0 0x562f37d43570 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/835347671 >> 172.21.15.59:0/835347671 conn(0x562f37c51260 msgr2=0x562f37ce1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:10.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbe7b7fe700 0 client.27650 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:10.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/835347671 shutdown_connections 2023-10-08T12:56:10.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbeb62c5b80 1 -- 172.21.15.59:0/835347671 wait complete. 2023-10-08T12:56:10.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbeb62c5b80 20 client.27650 trim_cache size 0 max 16384 2023-10-08T12:56:10.710 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:56:10.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbea29ff700 1 -- 172.21.15.59:0/1887451113 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe840a15f0 msgr2=0x7fbe840a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbea29ff700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe840a15f0 0x7fbe840a3ab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbe94015b00 tx=0x7fbe94009920 comp rx=0 tx=0).stop 2023-10-08T12:56:10.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbea29ff700 1 -- 172.21.15.59:0/1887451113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe9c100740 msgr2=0x7fbe9c198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:10.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.706+0000 7fbea29ff700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe9c100740 0x7fbe9c198db0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005910 tx=0x7fbe8c004730 comp rx=0 tx=0).stop 2023-10-08T12:56:10.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.707+0000 7fbea29ff700 1 -- 172.21.15.59:0/1887451113 shutdown_connections 2023-10-08T12:56:10.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.707+0000 7fbea29ff700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbe840a15f0 0x7fbe840a3ab0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.707+0000 7fbea29ff700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe9c100740 0x7fbe9c198db0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.707+0000 7fbea29ff700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9c106750 0x7fbe9c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.707+0000 7fbea29ff700 1 --2- 172.21.15.59:0/1887451113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe9c101100 0x7fbe9c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:10.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.707+0000 7fbea29ff700 1 -- 172.21.15.59:0/1887451113 >> 172.21.15.59:0/1887451113 conn(0x7fbe9c0fc230 msgr2=0x7fbe9c0fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:10.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.707+0000 7fbea29ff700 1 -- 172.21.15.59:0/1887451113 shutdown_connections 2023-10-08T12:56:10.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:10.707+0000 7fbea29ff700 1 -- 172.21.15.59:0/1887451113 wait complete. 2023-10-08T12:56:10.945 INFO:tasks.workunit.client.0.smithi059.stdout: 10 40817 23.59 MB/sec warmup 101 sec latency 132.581 ms 2023-10-08T12:56:11.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:10 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2721907785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:56:11.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:10 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2721907785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:56:11.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:10 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2721907785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:56:11.728 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:56:11.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:56:11.945 INFO:tasks.workunit.client.0.smithi059.stdout: 10 41093 23.52 MB/sec warmup 102 sec latency 154.289 ms 2023-10-08T12:56:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.954+0000 7fa09b5ff700 1 -- 172.21.15.59:0/4067496532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa094067ce0 msgr2=0x7fa0940680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.954+0000 7fa09b5ff700 1 --2- 172.21.15.59:0/4067496532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa094067ce0 0x7fa0940680c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa090009990 tx=0x7fa090009ca0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.954+0000 7fa09b5ff700 1 -- 172.21.15.59:0/4067496532 shutdown_connections 2023-10-08T12:56:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.954+0000 7fa09b5ff700 1 --2- 172.21.15.59:0/4067496532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa094067ce0 0x7fa0940680c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.954+0000 7fa09b5ff700 1 --2- 172.21.15.59:0/4067496532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa094105b80 0x7fa09410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.954+0000 7fa09b5ff700 1 --2- 172.21.15.59:0/4067496532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941051c0 0x7fa094105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.954+0000 7fa09b5ff700 1 -- 172.21.15.59:0/4067496532 >> 172.21.15.59:0/4067496532 conn(0x7fa094076780 msgr2=0x7fa094076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.954+0000 7fa09b5ff700 1 -- 172.21.15.59:0/4067496532 shutdown_connections 2023-10-08T12:56:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.954+0000 7fa09b5ff700 1 -- 172.21.15.59:0/4067496532 wait complete. 2023-10-08T12:56:11.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.955+0000 7fa09b5ff700 1 Processor -- start 2023-10-08T12:56:11.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.955+0000 7fa09b5ff700 1 -- start start 2023-10-08T12:56:11.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09b5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa094067ce0 0x7fa094198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09b5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0941051c0 0x7fa0941993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09b5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa094105b80 0x7fa09419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09b5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09419dd10 con 0x7fa094105b80 2023-10-08T12:56:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09b5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09419de80 con 0x7fa0941051c0 2023-10-08T12:56:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09b5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09419e040 con 0x7fa094067ce0 2023-10-08T12:56:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09939b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa094067ce0 0x7fa094198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09939b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa094067ce0 0x7fa094198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34616/0 (socket says 172.21.15.59:34616) 2023-10-08T12:56:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09939b700 1 -- 172.21.15.59:0/3319387818 learned_addr learned my addr 172.21.15.59:0/3319387818 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa099b9c700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa094105b80 0x7fa09419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa098b9a700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0941051c0 0x7fa0941993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09939b700 1 -- 172.21.15.59:0/3319387818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0941051c0 msgr2=0x7fa0941993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09939b700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0941051c0 0x7fa0941993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09939b700 1 -- 172.21.15.59:0/3319387818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa094105b80 msgr2=0x7fa09419d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09939b700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa094105b80 0x7fa09419d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.956+0000 7fa09939b700 1 -- 172.21.15.59:0/3319387818 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900095f0 con 0x7fa094067ce0 2023-10-08T12:56:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.957+0000 7fa09939b700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa094067ce0 0x7fa094198e90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa090000c00 tx=0x7fa090004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.957+0000 7fa08a7fc700 1 -- 172.21.15.59:0/3319387818 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09001d070 con 0x7fa094067ce0 2023-10-08T12:56:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.957+0000 7fa08a7fc700 1 -- 172.21.15.59:0/3319387818 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa090022470 con 0x7fa094067ce0 2023-10-08T12:56:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.957+0000 7fa09b5ff700 1 -- 172.21.15.59:0/3319387818 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09419e2c0 con 0x7fa094067ce0 2023-10-08T12:56:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.957+0000 7fa08a7fc700 1 -- 172.21.15.59:0/3319387818 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090017650 con 0x7fa094067ce0 2023-10-08T12:56:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.957+0000 7fa09b5ff700 1 -- 172.21.15.59:0/3319387818 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0941a5b60 con 0x7fa094067ce0 2023-10-08T12:56:11.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.960+0000 7fa08a7fc700 1 -- 172.21.15.59:0/3319387818 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa0900225e0 con 0x7fa094067ce0 2023-10-08T12:56:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.962+0000 7fa08a7fc700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0800a15f0 0x7fa0800a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.962+0000 7fa0af014b80 1 Processor -- start 2023-10-08T12:56:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.962+0000 7fa08a7fc700 1 -- 172.21.15.59:0/3319387818 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fa0900ce2e0 con 0x7fa094067ce0 2023-10-08T12:56:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.962+0000 7fa0af014b80 1 -- start start 2023-10-08T12:56:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.962+0000 7fa098b9a700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0800a15f0 0x7fa0800a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.962+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a480f00 0x56064a4812e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.962+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a481820 0x56064a48c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.962+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a48eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa0af014b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a3ea4e0 con 0x56064a480f00 2023-10-08T12:56:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa0af014b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a3dbca0 con 0x56064a48c6d0 2023-10-08T12:56:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa0af014b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a3d95c0 con 0x56064a481820 2023-10-08T12:56:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa099b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a48eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa09939b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a480f00 0x56064a4812e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa099b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a48eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50708/0 (socket says 172.21.15.59:50708) 2023-10-08T12:56:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa099b9c700 1 -- 172.21.15.59:0/3575426116 learned_addr learned my addr 172.21.15.59:0/3575426116 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa098b9a700 1 --2- 172.21.15.59:0/3575426116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a481820 0x56064a48c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa098b9a700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0800a15f0 0x7fa0800a3ab0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa09419a3e0 tx=0x7fa084009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa099b9c700 1 -- 172.21.15.59:0/3575426116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a481820 msgr2=0x56064a48c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa099b9c700 1 --2- 172.21.15.59:0/3575426116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a481820 0x56064a48c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa099b9c700 1 -- 172.21.15.59:0/3575426116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a480f00 msgr2=0x56064a4812e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa099b9c700 1 --2- 172.21.15.59:0/3575426116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a480f00 0x56064a4812e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.963+0000 7fa099b9c700 1 -- 172.21.15.59:0/3575426116 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56064a1ffe60 con 0x56064a48c6d0 2023-10-08T12:56:11.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.964+0000 7fa099b9c700 1 --2- 172.21.15.59:0/3575426116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a48eac0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0116b0 tx=0x7fa08c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd190bf67a6861a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:11.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.964+0000 7fa07f7fe700 1 -- 172.21.15.59:0/3575426116 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00e040 con 0x56064a48c6d0 2023-10-08T12:56:11.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.964+0000 7fa07f7fe700 1 -- 172.21.15.59:0/3575426116 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa08c00f040 con 0x56064a48c6d0 2023-10-08T12:56:11.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.964+0000 7fa07f7fe700 1 -- 172.21.15.59:0/3575426116 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c004890 con 0x56064a48c6d0 2023-10-08T12:56:11.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.964+0000 7fa0af014b80 1 -- 172.21.15.59:0/3575426116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 msgr2=0x56064a48eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:11.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.964+0000 7fa0af014b80 1 --2- 172.21.15.59:0/3575426116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a48eac0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0116b0 tx=0x7fa08c009920 comp rx=0 tx=0).stop 2023-10-08T12:56:11.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.965+0000 7fa0af014b80 1 -- 172.21.15.59:0/3575426116 shutdown_connections 2023-10-08T12:56:11.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.965+0000 7fa0af014b80 1 --2- 172.21.15.59:0/3575426116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a48eac0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.965+0000 7fa0af014b80 1 --2- 172.21.15.59:0/3575426116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a480f00 0x56064a4812e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.965+0000 7fa0af014b80 1 --2- 172.21.15.59:0/3575426116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a481820 0x56064a48c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.965+0000 7fa0af014b80 1 -- 172.21.15.59:0/3575426116 >> 172.21.15.59:0/3575426116 conn(0x56064a3f62e0 msgr2=0x56064a47d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:11.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.965+0000 7fa0af014b80 1 -- 172.21.15.59:0/3575426116 shutdown_connections 2023-10-08T12:56:11.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.965+0000 7fa0af014b80 1 -- 172.21.15.59:0/3575426116 wait complete. 2023-10-08T12:56:11.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.965+0000 7fa0af014b80 1 -- start start 2023-10-08T12:56:11.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.965+0000 7fa0af014b80 1 Processor -- start 2023-10-08T12:56:11.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a48c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a481820 0x56064a489450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a489b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa0af014b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a3d4eb0 con 0x56064a481820 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa0af014b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a371790 con 0x56064a48c6d0 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa0af014b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a371430 con 0x56064a480f00 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa0af014b80 10 client.0 _ll_register_callbacks cb 0x56064a1ce880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa099b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a489b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa09939b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a48c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa099b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a489b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50716/0 (socket says 172.21.15.59:50716) 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa099b9c700 1 -- 172.21.15.59:0/4007065681 learned_addr learned my addr 172.21.15.59:0/4007065681 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa098b9a700 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a481820 0x56064a489450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa099b9c700 1 -- 172.21.15.59:0/4007065681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 msgr2=0x56064a48c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:11.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa099b9c700 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a48c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa099b9c700 1 -- 172.21.15.59:0/4007065681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a481820 msgr2=0x56064a489450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.966+0000 7fa099b9c700 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a481820 0x56064a489450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.967+0000 7fa099b9c700 1 -- 172.21.15.59:0/4007065681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c011330 con 0x56064a48c6d0 2023-10-08T12:56:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.967+0000 7fa09939b700 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a48c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.967+0000 7fa099b9c700 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a489b90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009b20 tx=0x7fa08c006000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cf619164dfb29f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.967+0000 7fa07cff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:56:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.967+0000 7fa07cff9700 1 -- 172.21.15.59:0/4007065681 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00e070 con 0x56064a48c6d0 2023-10-08T12:56:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.967+0000 7fa0af014b80 1 -- 172.21.15.59:0/4007065681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56064a39cf30 con 0x56064a48c6d0 2023-10-08T12:56:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.967+0000 7fa07cff9700 1 -- 172.21.15.59:0/4007065681 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fa08c004140 con 0x56064a48c6d0 2023-10-08T12:56:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.967+0000 7fa07cff9700 1 -- 172.21.15.59:0/4007065681 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa08c003c10 con 0x56064a48c6d0 2023-10-08T12:56:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.967+0000 7fa0af014b80 10 client.27662 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:11.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.967+0000 7fa0af014b80 1 -- 172.21.15.59:0/4007065681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56064a1e8ce0 con 0x56064a48c6d0 2023-10-08T12:56:11.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.968+0000 7fa07cff9700 1 -- 172.21.15.59:0/4007065681 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56064a39cf30 con 0x56064a48c6d0 2023-10-08T12:56:11.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.968+0000 7fa07cff9700 1 -- 172.21.15.59:0/4007065681 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa08c01e470 con 0x56064a48c6d0 2023-10-08T12:56:11.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.968+0000 7fa0af014b80 10 client.27662 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:11.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.968+0000 7fa0af014b80 10 client.27662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:11.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.968+0000 7fa0af014b80 20 client.27662 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:11.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.968+0000 7fa0af014b80 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56064a49c150 0x56064a49e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.968+0000 7fa0af014b80 4 client.27662 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:56:11.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.968+0000 7fa0af014b80 1 -- 172.21.15.59:0/4007065681 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56064a3cde90 con 0x56064a49c150 2023-10-08T12:56:11.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.968+0000 7fa09939b700 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56064a49c150 0x56064a49e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.969+0000 7fa09939b700 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56064a49c150 0x56064a49e570 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55fa39b465dd6a77 server_cookie=e78a73f4475f202b in_seq=0 out_seq=0 2023-10-08T12:56:11.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.969+0000 7fa07cff9700 10 client.27662 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:11.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.971+0000 7fa07cff9700 1 -- 172.21.15.59:0/4007065681 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56064a3cde90 con 0x56064a49c150 2023-10-08T12:56:11.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.971+0000 7fa07cff9700 10 client.27662 handle_command_reply: tid=0 2023-10-08T12:56:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 1 client.27662 shutdown 2023-10-08T12:56:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 1 -- 172.21.15.59:0/4007065681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 msgr2=0x56064a489b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a489b90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009b20 tx=0x7fa08c006000 comp rx=0 tx=0).stop 2023-10-08T12:56:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 1 -- 172.21.15.59:0/4007065681 shutdown_connections 2023-10-08T12:56:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56064a49c150 0x56064a49e570 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a48c6d0 0x56064a489b90 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a48c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 1 --2- 172.21.15.59:0/4007065681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a481820 0x56064a489450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 1 -- 172.21.15.59:0/4007065681 >> 172.21.15.59:0/4007065681 conn(0x56064a3f62e0 msgr2=0x56064a47cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa07cff9700 0 client.27662 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 1 -- 172.21.15.59:0/4007065681 shutdown_connections 2023-10-08T12:56:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 1 -- 172.21.15.59:0/4007065681 wait complete. 2023-10-08T12:56:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.972+0000 7fa0af014b80 20 client.27662 trim_cache size 0 max 16384 2023-10-08T12:56:11.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.991+0000 7fa0af014b80 1 Processor -- start 2023-10-08T12:56:11.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.991+0000 7fa0af014b80 1 -- start start 2023-10-08T12:56:11.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.991+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a493220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.991+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a481820 0x56064a498080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.991+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a48c6d0 0x56064a48bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.991+0000 7fa0af014b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a2559a0 con 0x56064a48c6d0 2023-10-08T12:56:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.991+0000 7fa0af014b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a48aa50 con 0x56064a481820 2023-10-08T12:56:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.991+0000 7fa0af014b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a48a170 con 0x56064a480f00 2023-10-08T12:56:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa098b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a481820 0x56064a498080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa09939b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a493220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa098b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a481820 0x56064a498080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50722/0 (socket says 172.21.15.59:50722) 2023-10-08T12:56:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa098b9a700 1 -- 172.21.15.59:0/794978536 learned_addr learned my addr 172.21.15.59:0/794978536 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa09939b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a493220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34636/0 (socket says 172.21.15.59:34636) 2023-10-08T12:56:11.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa099b9c700 1 --2- 172.21.15.59:0/794978536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a48c6d0 0x56064a48bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:11.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa09939b700 1 -- 172.21.15.59:0/794978536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a481820 msgr2=0x56064a498080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:11.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa09939b700 1 --2- 172.21.15.59:0/794978536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a481820 0x56064a498080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa09939b700 1 -- 172.21.15.59:0/794978536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a48c6d0 msgr2=0x56064a48bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:11.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa09939b700 1 --2- 172.21.15.59:0/794978536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a48c6d0 0x56064a48bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa09939b700 1 -- 172.21.15.59:0/794978536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56064a4a3160 con 0x56064a480f00 2023-10-08T12:56:11.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.992+0000 7fa09939b700 1 --2- 172.21.15.59:0/794978536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a493220 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa0900cb9f0 tx=0x7fa09002e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb24baf5c494ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:11.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.995+0000 7fa07ffff700 1 -- 172.21.15.59:0/794978536 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09009b310 con 0x56064a480f00 2023-10-08T12:56:11.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.995+0000 7fa07ffff700 1 -- 172.21.15.59:0/794978536 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0900cd040 con 0x56064a480f00 2023-10-08T12:56:11.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.995+0000 7fa07ffff700 1 -- 172.21.15.59:0/794978536 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900997d0 con 0x56064a480f00 2023-10-08T12:56:11.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.996+0000 7fa0af014b80 1 -- 172.21.15.59:0/794978536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 msgr2=0x56064a493220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:11.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.996+0000 7fa0af014b80 1 --2- 172.21.15.59:0/794978536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a493220 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa0900cb9f0 tx=0x7fa09002e040 comp rx=0 tx=0).stop 2023-10-08T12:56:11.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.996+0000 7fa0af014b80 1 -- 172.21.15.59:0/794978536 shutdown_connections 2023-10-08T12:56:11.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.996+0000 7fa0af014b80 1 --2- 172.21.15.59:0/794978536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a48c6d0 0x56064a48bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.996+0000 7fa0af014b80 1 --2- 172.21.15.59:0/794978536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a493220 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.996+0000 7fa0af014b80 1 --2- 172.21.15.59:0/794978536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a481820 0x56064a498080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:11.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.996+0000 7fa0af014b80 1 -- 172.21.15.59:0/794978536 >> 172.21.15.59:0/794978536 conn(0x56064a3f62e0 msgr2=0x56064a497970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:11.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.996+0000 7fa0af014b80 1 -- 172.21.15.59:0/794978536 shutdown_connections 2023-10-08T12:56:11.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.996+0000 7fa0af014b80 1 -- 172.21.15.59:0/794978536 wait complete. 2023-10-08T12:56:12.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.997+0000 7fa0af014b80 1 -- start start 2023-10-08T12:56:12.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.997+0000 7fa0af014b80 1 Processor -- start 2023-10-08T12:56:12.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a492e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a481820 0x56064a4933b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa0af014b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a48c6d0 0x56064a491460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa0af014b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a491b70 con 0x56064a48c6d0 2023-10-08T12:56:12.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa0af014b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a491ce0 con 0x56064a481820 2023-10-08T12:56:12.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa0af014b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064a491ea0 con 0x56064a480f00 2023-10-08T12:56:12.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa0af014b80 10 client.0 _ll_register_callbacks cb 0x7fa090005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:12.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa09939b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a492e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa098b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a481820 0x56064a4933b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa09939b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a492e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34638/0 (socket says 172.21.15.59:34638) 2023-10-08T12:56:12.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa09939b700 1 -- 172.21.15.59:0/2167984895 learned_addr learned my addr 172.21.15.59:0/2167984895 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:12.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.998+0000 7fa099b9c700 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a48c6d0 0x56064a491460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.999+0000 7fa09939b700 1 -- 172.21.15.59:0/2167984895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a481820 msgr2=0x56064a4933b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:12.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.999+0000 7fa09939b700 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a481820 0x56064a4933b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.999+0000 7fa09939b700 1 -- 172.21.15.59:0/2167984895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a48c6d0 msgr2=0x56064a491460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:12.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.999+0000 7fa09939b700 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a48c6d0 0x56064a491460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.999+0000 7fa09939b700 1 -- 172.21.15.59:0/2167984895 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0941a5b60 con 0x56064a480f00 2023-10-08T12:56:12.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.999+0000 7fa099b9c700 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a48c6d0 0x56064a491460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:56:12.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.999+0000 7fa09939b700 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a492e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa090006010 tx=0x7fa090009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec3d0336024b5411 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:12.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.999+0000 7fa07cff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:56:12.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.999+0000 7fa07cff9700 1 -- 172.21.15.59:0/2167984895 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09009b310 con 0x56064a480f00 2023-10-08T12:56:12.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.999+0000 7fa07cff9700 1 -- 172.21.15.59:0/2167984895 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fa0900a3610 con 0x56064a480f00 2023-10-08T12:56:12.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:11.999+0000 7fa0af014b80 1 -- 172.21.15.59:0/2167984895 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa08c00f040 con 0x56064a480f00 2023-10-08T12:56:12.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa07cff9700 1 -- 172.21.15.59:0/2167984895 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa09009f120 con 0x56064a480f00 2023-10-08T12:56:12.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa0af014b80 10 client.27664 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:12.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa0af014b80 1 -- 172.21.15.59:0/2167984895 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56064a2262d0 con 0x56064a480f00 2023-10-08T12:56:12.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa07cff9700 1 -- 172.21.15.59:0/2167984895 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa08c00f040 con 0x56064a480f00 2023-10-08T12:56:12.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa07cff9700 1 -- 172.21.15.59:0/2167984895 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa09009a890 con 0x56064a480f00 2023-10-08T12:56:12.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa0af014b80 10 client.27664 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:12.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa0af014b80 10 client.27664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:12.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa0af014b80 20 client.27664 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:12.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa0af014b80 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56064a4f0f40 0x56064a4f3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa0af014b80 4 client.27664 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:56:12.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa0af014b80 1 -- 172.21.15.59:0/2167984895 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56064a3cdbb0 con 0x56064a4f0f40 2023-10-08T12:56:12.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.000+0000 7fa098b9a700 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56064a4f0f40 0x56064a4f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.001+0000 7fa098b9a700 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56064a4f0f40 0x56064a4f3360 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc18b235c25897dd server_cookie=309688151326ca35 in_seq=0 out_seq=0 2023-10-08T12:56:12.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.001+0000 7fa07cff9700 10 client.27664 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:12.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa07cff9700 1 -- 172.21.15.59:0/2167984895 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56064a3cdbb0 con 0x56064a4f0f40 2023-10-08T12:56:12.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa07cff9700 10 client.27664 handle_command_reply: tid=0 2023-10-08T12:56:12.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa0af014b80 1 client.27664 shutdown 2023-10-08T12:56:12.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa0af014b80 1 -- 172.21.15.59:0/2167984895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 msgr2=0x56064a492e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa0af014b80 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a492e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa090006010 tx=0x7fa090009ca0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa0af014b80 1 -- 172.21.15.59:0/2167984895 shutdown_connections 2023-10-08T12:56:12.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa0af014b80 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56064a4f0f40 0x56064a4f3360 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa0af014b80 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56064a48c6d0 0x56064a491460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa0af014b80 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56064a480f00 0x56064a492e70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa07cff9700 0 client.27664 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:12.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa0af014b80 1 --2- 172.21.15.59:0/2167984895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56064a481820 0x56064a4933b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa0af014b80 1 -- 172.21.15.59:0/2167984895 >> 172.21.15.59:0/2167984895 conn(0x56064a3f62e0 msgr2=0x56064a497970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:12.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.011+0000 7fa0af014b80 1 -- 172.21.15.59:0/2167984895 shutdown_connections 2023-10-08T12:56:12.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa0af014b80 1 -- 172.21.15.59:0/2167984895 wait complete. 2023-10-08T12:56:12.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa0af014b80 20 client.27664 trim_cache size 0 max 16384 2023-10-08T12:56:12.014 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:56:12.014 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:56:12.014 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "4a5bedbc-7cd8-4848-826b-68f9cf4ac5cc", 2023-10-08T12:56:12.015 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:56:12.015 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:56:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa09b5ff700 1 -- 172.21.15.59:0/3319387818 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0800a15f0 msgr2=0x7fa0800a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa09b5ff700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0800a15f0 0x7fa0800a3ab0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa09419a3e0 tx=0x7fa084009260 comp rx=0 tx=0).stop 2023-10-08T12:56:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa09b5ff700 1 -- 172.21.15.59:0/3319387818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa094067ce0 msgr2=0x7fa094198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa09b5ff700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa094067ce0 0x7fa094198e90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa090000c00 tx=0x7fa090004730 comp rx=0 tx=0).stop 2023-10-08T12:56:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa09b5ff700 1 -- 172.21.15.59:0/3319387818 shutdown_connections 2023-10-08T12:56:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa09b5ff700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa0800a15f0 0x7fa0800a3ab0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa09b5ff700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa094105b80 0x7fa09419d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa09b5ff700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa094067ce0 0x7fa094198e90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa09b5ff700 1 --2- 172.21.15.59:0/3319387818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0941051c0 0x7fa0941993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.012+0000 7fa09b5ff700 1 -- 172.21.15.59:0/3319387818 >> 172.21.15.59:0/3319387818 conn(0x7fa094076780 msgr2=0x7fa094100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.013+0000 7fa09b5ff700 1 -- 172.21.15.59:0/3319387818 shutdown_connections 2023-10-08T12:56:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.013+0000 7fa09b5ff700 1 -- 172.21.15.59:0/3319387818 wait complete. 2023-10-08T12:56:12.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:56:12.097 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:11 smithi059 ceph-mon[98489]: pgmap v781: 97 pgs: 97 active+clean; 850 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.4 MiB/s wr, 627 op/s 2023-10-08T12:56:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.254+0000 7f947d9ff700 1 -- 172.21.15.59:0/768731921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9478101100 msgr2=0x7f947810d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.254+0000 7f947d9ff700 1 --2- 172.21.15.59:0/768731921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9478101100 0x7f947810d610 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f947000b0a0 tx=0x7f947000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.254+0000 7f947d9ff700 1 -- 172.21.15.59:0/768731921 shutdown_connections 2023-10-08T12:56:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.254+0000 7f947d9ff700 1 --2- 172.21.15.59:0/768731921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9478101100 0x7f947810d610 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.254+0000 7f947d9ff700 1 --2- 172.21.15.59:0/768731921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9478106750 0x7f9478106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.254+0000 7f947d9ff700 1 --2- 172.21.15.59:0/768731921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9478100740 0x7f9478100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.254+0000 7f947d9ff700 1 -- 172.21.15.59:0/768731921 >> 172.21.15.59:0/768731921 conn(0x7f94780fc230 msgr2=0x7f94780fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.254+0000 7f947d9ff700 1 -- 172.21.15.59:0/768731921 shutdown_connections 2023-10-08T12:56:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.254+0000 7f947d9ff700 1 -- 172.21.15.59:0/768731921 wait complete. 2023-10-08T12:56:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.255+0000 7f947d9ff700 1 Processor -- start 2023-10-08T12:56:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.255+0000 7f947d9ff700 1 -- start start 2023-10-08T12:56:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f947d9ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9478100740 0x7f9478072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f947d9ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9478101100 0x7f9478073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f947d9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9478106750 0x7f9478073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f947d9ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94781a4fa0 con 0x7f9478100740 2023-10-08T12:56:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f947d9ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94781a5110 con 0x7f9478101100 2023-10-08T12:56:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f947d9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94781a52d0 con 0x7f9478106750 2023-10-08T12:56:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f9476ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9478100740 0x7f9478072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f94777fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9478106750 0x7f9478073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f94767fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9478101100 0x7f9478073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f9476ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9478100740 0x7f9478072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58808/0 (socket says 172.21.15.59:58808) 2023-10-08T12:56:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f9476ffd700 1 -- 172.21.15.59:0/580544977 learned_addr learned my addr 172.21.15.59:0/580544977 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f9476ffd700 1 -- 172.21.15.59:0/580544977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9478106750 msgr2=0x7f9478073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f9476ffd700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9478106750 0x7f9478073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f9476ffd700 1 -- 172.21.15.59:0/580544977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9478101100 msgr2=0x7f9478073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f9476ffd700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9478101100 0x7f9478073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f9476ffd700 1 -- 172.21.15.59:0/580544977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c009520 con 0x7f9478100740 2023-10-08T12:56:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f94777fe700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9478106750 0x7f9478073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.256+0000 7f94767fc700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9478101100 0x7f9478073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.257+0000 7f9476ffd700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9478100740 0x7f9478072af0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f946800eb30 tx=0x7f946800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.257+0000 7f947c9fd700 1 -- 172.21.15.59:0/580544977 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468009880 con 0x7f9478100740 2023-10-08T12:56:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.257+0000 7f947d9ff700 1 -- 172.21.15.59:0/580544977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9468009520 con 0x7f9478100740 2023-10-08T12:56:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.257+0000 7f947c9fd700 1 -- 172.21.15.59:0/580544977 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94680044e0 con 0x7f9478100740 2023-10-08T12:56:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.257+0000 7f947c9fd700 1 -- 172.21.15.59:0/580544977 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468003d80 con 0x7f9478100740 2023-10-08T12:56:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.257+0000 7f947d9ff700 1 -- 172.21.15.59:0/580544977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9470009d00 con 0x7f9478100740 2023-10-08T12:56:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.260+0000 7f947c9fd700 1 -- 172.21.15.59:0/580544977 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9468003f20 con 0x7f9478100740 2023-10-08T12:56:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.262+0000 7f947c9fd700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94600a15f0 0x7f94600a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.262+0000 7f9491388b80 1 Processor -- start 2023-10-08T12:56:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.262+0000 7f947c9fd700 1 -- 172.21.15.59:0/580544977 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f9468014070 con 0x7f9478100740 2023-10-08T12:56:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.262+0000 7f94767fc700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94600a15f0 0x7f94600a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.262+0000 7f9491388b80 1 -- start start 2023-10-08T12:56:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9491388b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9491388b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977d8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9491388b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977d8650 0x55e4977daa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f94767fc700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94600a15f0 0x7f94600a3ab0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f946c009fd0 tx=0x7f946c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9491388b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e497736460 con 0x55e4977cd7a0 2023-10-08T12:56:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9491388b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e497727c20 con 0x55e4977cce80 2023-10-08T12:56:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9491388b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e497725540 con 0x55e4977d8650 2023-10-08T12:56:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9476ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9476ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50758/0 (socket says 172.21.15.59:50758) 2023-10-08T12:56:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9476ffd700 1 -- 172.21.15.59:0/2582126451 learned_addr learned my addr 172.21.15.59:0/2582126451 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f94767fc700 1 --2- 172.21.15.59:0/2582126451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977d8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f94777fe700 1 --2- 172.21.15.59:0/2582126451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977d8650 0x55e4977daa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9476ffd700 1 -- 172.21.15.59:0/2582126451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977d8650 msgr2=0x55e4977daa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9476ffd700 1 --2- 172.21.15.59:0/2582126451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977d8650 0x55e4977daa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9476ffd700 1 -- 172.21.15.59:0/2582126451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 msgr2=0x55e4977d8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9476ffd700 1 --2- 172.21.15.59:0/2582126451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977d8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.263+0000 7f9476ffd700 1 -- 172.21.15.59:0/2582126451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e49754bde0 con 0x55e4977cce80 2023-10-08T12:56:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.264+0000 7f9476ffd700 1 --2- 172.21.15.59:0/2582126451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977cd260 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f946800eb00 tx=0x7f9468099f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccac84ef71e85e2a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.264+0000 7f945dffb700 1 -- 172.21.15.59:0/2582126451 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946809a5b0 con 0x55e4977cce80 2023-10-08T12:56:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.264+0000 7f945dffb700 1 -- 172.21.15.59:0/2582126451 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f946809e700 con 0x55e4977cce80 2023-10-08T12:56:12.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.264+0000 7f945dffb700 1 -- 172.21.15.59:0/2582126451 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946809a810 con 0x55e4977cce80 2023-10-08T12:56:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.264+0000 7f9491388b80 1 -- 172.21.15.59:0/2582126451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 msgr2=0x55e4977cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.264+0000 7f9491388b80 1 --2- 172.21.15.59:0/2582126451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977cd260 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f946800eb00 tx=0x7f9468099f10 comp rx=0 tx=0).stop 2023-10-08T12:56:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.265+0000 7f9491388b80 1 -- 172.21.15.59:0/2582126451 shutdown_connections 2023-10-08T12:56:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.265+0000 7f9491388b80 1 --2- 172.21.15.59:0/2582126451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977cd260 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.265+0000 7f9491388b80 1 --2- 172.21.15.59:0/2582126451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977d8650 0x55e4977daa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.265+0000 7f9491388b80 1 --2- 172.21.15.59:0/2582126451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977d8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.265+0000 7f9491388b80 1 -- 172.21.15.59:0/2582126451 >> 172.21.15.59:0/2582126451 conn(0x55e497742260 msgr2=0x55e4977c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.265+0000 7f9491388b80 1 -- 172.21.15.59:0/2582126451 shutdown_connections 2023-10-08T12:56:12.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.265+0000 7f9491388b80 1 -- 172.21.15.59:0/2582126451 wait complete. 2023-10-08T12:56:12.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.265+0000 7f9491388b80 1 -- start start 2023-10-08T12:56:12.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.266+0000 7f9491388b80 1 Processor -- start 2023-10-08T12:56:12.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.266+0000 7f9491388b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cce80 0x55e4977d80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.266+0000 7f9491388b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977cd7a0 0x55e4977d5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.266+0000 7f9491388b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977d8650 0x55e4977d5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9491388b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e497720e30 con 0x55e4977cce80 2023-10-08T12:56:12.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9491388b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4976bd710 con 0x55e4977d8650 2023-10-08T12:56:12.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9491388b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4976bd3b0 con 0x55e4977cd7a0 2023-10-08T12:56:12.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9491388b80 10 client.0 _ll_register_callbacks cb 0x55e49751a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:12.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9476ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cce80 0x55e4977d80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f94777fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977d8650 0x55e4977d5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f94767fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977cd7a0 0x55e4977d5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9476ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cce80 0x55e4977d80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58814/0 (socket says 172.21.15.59:58814) 2023-10-08T12:56:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9476ffd700 1 -- 172.21.15.59:0/751312675 learned_addr learned my addr 172.21.15.59:0/751312675 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9476ffd700 1 -- 172.21.15.59:0/751312675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977cd7a0 msgr2=0x55e4977d5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9476ffd700 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977cd7a0 0x55e4977d5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9476ffd700 1 -- 172.21.15.59:0/751312675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977d8650 msgr2=0x55e4977d5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9476ffd700 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977d8650 0x55e4977d5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9476ffd700 1 -- 172.21.15.59:0/751312675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9470009d00 con 0x55e4977cce80 2023-10-08T12:56:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f94767fc700 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977cd7a0 0x55e4977d5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.267+0000 7f9476ffd700 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cce80 0x55e4977d80a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f94680cb2a0 tx=0x7f9468005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588bc7029f3f714b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9456ffd700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:56:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9456ffd700 1 -- 172.21.15.59:0/751312675 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946809a5b0 con 0x55e4977cce80 2023-10-08T12:56:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9491388b80 1 -- 172.21.15.59:0/751312675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4976e8eb0 con 0x55e4977cce80 2023-10-08T12:56:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9456ffd700 1 -- 172.21.15.59:0/751312675 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f946800cdd0 con 0x55e4977cce80 2023-10-08T12:56:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9456ffd700 1 -- 172.21.15.59:0/751312675 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9468099aa0 con 0x55e4977cce80 2023-10-08T12:56:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9491388b80 10 client.17658 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9491388b80 1 -- 172.21.15.59:0/751312675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e497534c60 con 0x55e4977cce80 2023-10-08T12:56:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9456ffd700 1 -- 172.21.15.59:0/751312675 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e4976e8eb0 con 0x55e4977cce80 2023-10-08T12:56:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9456ffd700 1 -- 172.21.15.59:0/751312675 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f94680a24b0 con 0x55e4977cce80 2023-10-08T12:56:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9491388b80 10 client.17658 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:12.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9491388b80 10 client.17658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:12.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9491388b80 20 client.17658 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:12.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9491388b80 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e4977e7cf0 0x55e4977ea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9491388b80 4 client.17658 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:56:12.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.268+0000 7f9491388b80 1 -- 172.21.15.59:0/751312675 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e497719e10 con 0x55e4977e7cf0 2023-10-08T12:56:12.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.269+0000 7f94767fc700 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e4977e7cf0 0x55e4977ea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.269+0000 7f94767fc700 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e4977e7cf0 0x55e4977ea0e0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60c28f06876f56e0 server_cookie=3f78c18823f18f5d in_seq=0 out_seq=0 2023-10-08T12:56:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.269+0000 7f9456ffd700 10 client.17658 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9456ffd700 1 -- 172.21.15.59:0/751312675 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e497719e10 con 0x55e4977e7cf0 2023-10-08T12:56:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9456ffd700 10 client.17658 handle_command_reply: tid=0 2023-10-08T12:56:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9491388b80 1 client.17658 shutdown 2023-10-08T12:56:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9491388b80 1 -- 172.21.15.59:0/751312675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cce80 msgr2=0x55e4977d80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9491388b80 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cce80 0x55e4977d80a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f94680cb2a0 tx=0x7f9468005760 comp rx=0 tx=0).stop 2023-10-08T12:56:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9491388b80 1 -- 172.21.15.59:0/751312675 shutdown_connections 2023-10-08T12:56:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9491388b80 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e4977e7cf0 0x55e4977ea0e0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9491388b80 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977d8650 0x55e4977d5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9491388b80 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cce80 0x55e4977d80a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9491388b80 1 --2- 172.21.15.59:0/751312675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977cd7a0 0x55e4977d5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9456ffd700 0 client.17658 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9491388b80 1 -- 172.21.15.59:0/751312675 >> 172.21.15.59:0/751312675 conn(0x55e497742260 msgr2=0x55e4977c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9491388b80 1 -- 172.21.15.59:0/751312675 shutdown_connections 2023-10-08T12:56:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.273+0000 7f9491388b80 1 -- 172.21.15.59:0/751312675 wait complete. 2023-10-08T12:56:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.274+0000 7f9491388b80 20 client.17658 trim_cache size 0 max 16384 2023-10-08T12:56:12.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.291+0000 7f9491388b80 1 Processor -- start 2023-10-08T12:56:12.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f9491388b80 1 -- start start 2023-10-08T12:56:12.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f9491388b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977cce80 0x55e4977df1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f9491388b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977e38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f9491388b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977d8650 0x55e4977d48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f9491388b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4975a1920 con 0x55e4977cd7a0 2023-10-08T12:56:12.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f9491388b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4977cdb80 con 0x55e4977d8650 2023-10-08T12:56:12.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f9491388b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4977c5ae0 con 0x55e4977cce80 2023-10-08T12:56:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f94767fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977e38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f94767fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977e38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58818/0 (socket says 172.21.15.59:58818) 2023-10-08T12:56:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f94767fc700 1 -- 172.21.15.59:0/85293977 learned_addr learned my addr 172.21.15.59:0/85293977 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f9476ffd700 1 --2- 172.21.15.59:0/85293977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977cce80 0x55e4977df1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.292+0000 7f94777fe700 1 --2- 172.21.15.59:0/85293977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977d8650 0x55e4977d48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.293+0000 7f94767fc700 1 -- 172.21.15.59:0/85293977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977cce80 msgr2=0x55e4977df1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.293+0000 7f94767fc700 1 --2- 172.21.15.59:0/85293977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977cce80 0x55e4977df1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.293+0000 7f94767fc700 1 -- 172.21.15.59:0/85293977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977d8650 msgr2=0x55e4977d48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.293+0000 7f94767fc700 1 --2- 172.21.15.59:0/85293977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977d8650 0x55e4977d48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.293+0000 7f94767fc700 1 -- 172.21.15.59:0/85293977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e497572250 con 0x55e4977cd7a0 2023-10-08T12:56:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.293+0000 7f94767fc700 1 --2- 172.21.15.59:0/85293977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977e38f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f94780741d0 tx=0x7f946c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13326cbe5a76484 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.293+0000 7f945e7fc700 1 -- 172.21.15.59:0/85293977 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c027410 con 0x55e4977cd7a0 2023-10-08T12:56:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.293+0000 7f945e7fc700 1 -- 172.21.15.59:0/85293977 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f946c027570 con 0x55e4977cd7a0 2023-10-08T12:56:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.293+0000 7f945e7fc700 1 -- 172.21.15.59:0/85293977 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c02fb00 con 0x55e4977cd7a0 2023-10-08T12:56:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.294+0000 7f9491388b80 1 -- 172.21.15.59:0/85293977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 msgr2=0x55e4977e38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.294+0000 7f9491388b80 1 --2- 172.21.15.59:0/85293977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977e38f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f94780741d0 tx=0x7f946c014000 comp rx=0 tx=0).stop 2023-10-08T12:56:12.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.294+0000 7f9491388b80 1 -- 172.21.15.59:0/85293977 shutdown_connections 2023-10-08T12:56:12.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.294+0000 7f9491388b80 1 --2- 172.21.15.59:0/85293977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977d8650 0x55e4977d48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.294+0000 7f9491388b80 1 --2- 172.21.15.59:0/85293977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977cce80 0x55e4977df1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.294+0000 7f9491388b80 1 --2- 172.21.15.59:0/85293977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977e38f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.294+0000 7f9491388b80 1 -- 172.21.15.59:0/85293977 >> 172.21.15.59:0/85293977 conn(0x55e497742260 msgr2=0x55e4977c84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:12.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.294+0000 7f9491388b80 1 -- 172.21.15.59:0/85293977 shutdown_connections 2023-10-08T12:56:12.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.294+0000 7f9491388b80 1 -- 172.21.15.59:0/85293977 wait complete. 2023-10-08T12:56:12.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.295+0000 7f9491388b80 1 -- start start 2023-10-08T12:56:12.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.295+0000 7f9491388b80 1 Processor -- start 2023-10-08T12:56:12.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.295+0000 7f9491388b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977df210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.295+0000 7f9491388b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977dd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.295+0000 7f9491388b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977d8650 0x55e4977ddd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.295+0000 7f9491388b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4977de460 con 0x55e4977cd7a0 2023-10-08T12:56:12.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.295+0000 7f9491388b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4977de5d0 con 0x55e4977cce80 2023-10-08T12:56:12.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.295+0000 7f9491388b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e49783bad0 con 0x55e4977d8650 2023-10-08T12:56:12.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.295+0000 7f9491388b80 10 client.0 _ll_register_callbacks cb 0x7f946809a0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:12.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9476ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977df210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9476ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977df210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50784/0 (socket says 172.21.15.59:50784) 2023-10-08T12:56:12.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9476ffd700 1 -- 172.21.15.59:0/2468557291 learned_addr learned my addr 172.21.15.59:0/2468557291 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:12.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f94777fe700 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977d8650 0x55e4977ddd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f94767fc700 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977dd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9476ffd700 1 -- 172.21.15.59:0/2468557291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977d8650 msgr2=0x55e4977ddd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:12.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9476ffd700 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977d8650 0x55e4977ddd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9476ffd700 1 -- 172.21.15.59:0/2468557291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 msgr2=0x55e4977dd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:12.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9476ffd700 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977dd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9476ffd700 1 -- 172.21.15.59:0/2468557291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946c017050 con 0x55e4977cce80 2023-10-08T12:56:12.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9476ffd700 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977df210 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f94680044b0 tx=0x7f9468085170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28d453ee7453fb9f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:12.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9456ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:56:12.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9456ffd700 1 -- 172.21.15.59:0/2468557291 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946809e530 con 0x55e4977cce80 2023-10-08T12:56:12.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9456ffd700 1 -- 172.21.15.59:0/2468557291 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f946800cdd0 con 0x55e4977cce80 2023-10-08T12:56:12.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9491388b80 1 -- 172.21.15.59:0/2468557291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f946809e700 con 0x55e4977cce80 2023-10-08T12:56:12.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9456ffd700 1 -- 172.21.15.59:0/2468557291 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9468083b90 con 0x55e4977cce80 2023-10-08T12:56:12.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9491388b80 10 client.27686 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:12.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.296+0000 7f9491388b80 1 -- 172.21.15.59:0/2468557291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55e49754a2b0 con 0x55e4977cce80 2023-10-08T12:56:12.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.297+0000 7f9456ffd700 1 -- 172.21.15.59:0/2468557291 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f946809e700 con 0x55e4977cce80 2023-10-08T12:56:12.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.297+0000 7f9456ffd700 1 -- 172.21.15.59:0/2468557291 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f946809a810 con 0x55e4977cce80 2023-10-08T12:56:12.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.297+0000 7f9491388b80 10 client.27686 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:12.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.297+0000 7f9491388b80 10 client.27686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:12.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.297+0000 7f9491388b80 20 client.27686 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:12.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.297+0000 7f9491388b80 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e49783cd90 0x55e49783f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:12.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.297+0000 7f9491388b80 4 client.27686 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:56:12.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.297+0000 7f9491388b80 1 -- 172.21.15.59:0/2468557291 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e497719b30 con 0x55e49783cd90 2023-10-08T12:56:12.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.297+0000 7f94767fc700 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e49783cd90 0x55e49783f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:12.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.298+0000 7f94767fc700 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e49783cd90 0x55e49783f180 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5873a3883e1d8049 server_cookie=8a4950f37da0dda in_seq=0 out_seq=0 2023-10-08T12:56:12.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.298+0000 7f9456ffd700 10 client.27686 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9456ffd700 1 -- 172.21.15.59:0/2468557291 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55e497719b30 con 0x55e49783cd90 2023-10-08T12:56:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9456ffd700 10 client.27686 handle_command_reply: tid=0 2023-10-08T12:56:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 1 client.27686 shutdown 2023-10-08T12:56:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 1 -- 172.21.15.59:0/2468557291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 msgr2=0x55e4977df210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977df210 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f94680044b0 tx=0x7f9468085170 comp rx=0 tx=0).stop 2023-10-08T12:56:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 1 -- 172.21.15.59:0/2468557291 shutdown_connections 2023-10-08T12:56:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e49783cd90 0x55e49783f180 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4977cce80 0x55e4977df210 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4977d8650 0x55e4977ddd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9456ffd700 0 client.27686 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 1 --2- 172.21.15.59:0/2468557291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4977cd7a0 0x55e4977dd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 1 -- 172.21.15.59:0/2468557291 >> 172.21.15.59:0/2468557291 conn(0x55e497742260 msgr2=0x55e4977e38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 1 -- 172.21.15.59:0/2468557291 shutdown_connections 2023-10-08T12:56:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 1 -- 172.21.15.59:0/2468557291 wait complete. 2023-10-08T12:56:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.304+0000 7f9491388b80 20 client.27686 trim_cache size 0 max 16384 2023-10-08T12:56:12.307 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:56:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "scrub active (254 inodes in the stack)", 2023-10-08T12:56:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:56:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: "4a5bedbc-7cd8-4848-826b-68f9cf4ac5cc": { 2023-10-08T12:56:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:56:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "4a5bedbc-7cd8-4848-826b-68f9cf4ac5cc", 2023-10-08T12:56:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:56:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:56:12.308 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:56:12.308 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:56:12.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 -- 172.21.15.59:0/580544977 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94600a15f0 msgr2=0x7f94600a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94600a15f0 0x7f94600a3ab0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f946c009fd0 tx=0x7f946c009260 comp rx=0 tx=0).stop 2023-10-08T12:56:12.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 -- 172.21.15.59:0/580544977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9478100740 msgr2=0x7f9478072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9478100740 0x7f9478072af0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f946800eb30 tx=0x7f946800ee40 comp rx=0 tx=0).stop 2023-10-08T12:56:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 -- 172.21.15.59:0/580544977 shutdown_connections 2023-10-08T12:56:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94600a15f0 0x7f94600a3ab0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9478106750 0x7f9478073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9478100740 0x7f9478072af0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 --2- 172.21.15.59:0/580544977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9478101100 0x7f9478073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 -- 172.21.15.59:0/580544977 >> 172.21.15.59:0/580544977 conn(0x7f94780fc230 msgr2=0x7f94780fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 -- 172.21.15.59:0/580544977 shutdown_connections 2023-10-08T12:56:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:12.305+0000 7f947d9ff700 1 -- 172.21.15.59:0/580544977 wait complete. 2023-10-08T12:56:12.324 INFO:tasks.cephfs.filesystem:scrub status for tag:4a5bedbc-7cd8-4848-826b-68f9cf4ac5cc - {'path': '/', 'tag': '4a5bedbc-7cd8-4848-826b-68f9cf4ac5cc', 'options': 'recursive,force'} 2023-10-08T12:56:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:11 smithi092 ceph-mon[134093]: pgmap v781: 97 pgs: 97 active+clean; 850 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.4 MiB/s wr, 627 op/s 2023-10-08T12:56:12.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:11 smithi173 ceph-mon[135182]: pgmap v781: 97 pgs: 97 active+clean; 850 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.4 MiB/s wr, 627 op/s 2023-10-08T12:56:12.945 INFO:tasks.workunit.client.0.smithi059.stdout: 10 41321 23.36 MB/sec warmup 103 sec latency 138.434 ms 2023-10-08T12:56:13.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:12 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:56:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:12 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:13.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:12 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:56:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:13 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:56:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:13 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:13.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:13 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:56:13.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:12 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:56:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:12 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:13.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:12 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:56:13.945 INFO:tasks.workunit.client.0.smithi059.stdout: 10 41582 23.26 MB/sec warmup 104 sec latency 161.560 ms 2023-10-08T12:56:14.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:14 smithi059 ceph-mon[98489]: pgmap v782: 97 pgs: 97 active+clean; 865 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.1 MiB/s wr, 564 op/s 2023-10-08T12:56:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:14 smithi059 ceph-mon[98489]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T12:56:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:14 smithi092 ceph-mon[134093]: pgmap v782: 97 pgs: 97 active+clean; 865 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.1 MiB/s wr, 564 op/s 2023-10-08T12:56:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:14 smithi092 ceph-mon[134093]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T12:56:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:14 smithi173 ceph-mon[135182]: pgmap v782: 97 pgs: 97 active+clean; 865 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.1 MiB/s wr, 564 op/s 2023-10-08T12:56:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:14 smithi173 ceph-mon[135182]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T12:56:14.945 INFO:tasks.workunit.client.0.smithi059.stdout: 10 41873 23.12 MB/sec warmup 105 sec latency 179.863 ms 2023-10-08T12:56:15.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:15 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:15.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:15 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:15.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:15 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:15.945 INFO:tasks.workunit.client.0.smithi059.stdout: 10 42142 23.04 MB/sec warmup 106 sec latency 537.882 ms 2023-10-08T12:56:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:16 smithi092 ceph-mon[134093]: pgmap v784: 97 pgs: 97 active+clean; 864 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.6 MiB/s wr, 486 op/s 2023-10-08T12:56:16.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:16 smithi173 ceph-mon[135182]: pgmap v784: 97 pgs: 97 active+clean; 864 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.6 MiB/s wr, 486 op/s 2023-10-08T12:56:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:16 smithi059 ceph-mon[98489]: pgmap v784: 97 pgs: 97 active+clean; 864 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.6 MiB/s wr, 486 op/s 2023-10-08T12:56:16.945 INFO:tasks.workunit.client.0.smithi059.stdout: 10 42653 23.01 MB/sec warmup 107 sec latency 191.934 ms 2023-10-08T12:56:17.945 INFO:tasks.workunit.client.0.smithi059.stdout: 10 43182 23.05 MB/sec warmup 108 sec latency 185.259 ms 2023-10-08T12:56:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:18 smithi092 ceph-mon[134093]: pgmap v785: 97 pgs: 97 active+clean; 876 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.4 MiB/s wr, 383 op/s 2023-10-08T12:56:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:18 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:56:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:18 smithi173 ceph-mon[135182]: pgmap v785: 97 pgs: 97 active+clean; 876 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.4 MiB/s wr, 383 op/s 2023-10-08T12:56:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:18 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:56:18.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:18 smithi059 ceph-mon[98489]: pgmap v785: 97 pgs: 97 active+clean; 876 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.4 MiB/s wr, 383 op/s 2023-10-08T12:56:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:18 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:56:18.945 INFO:tasks.workunit.client.0.smithi059.stdout: 10 43447 22.99 MB/sec warmup 109 sec latency 420.609 ms 2023-10-08T12:56:19.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 44027 23.18 MB/sec warmup 110 sec latency 78.971 ms 2023-10-08T12:56:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:19 smithi173 ceph-mon[135182]: pgmap v786: 97 pgs: 97 active+clean; 888 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.6 MiB/s wr, 395 op/s 2023-10-08T12:56:20.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:19 smithi059 ceph-mon[98489]: pgmap v786: 97 pgs: 97 active+clean; 888 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.6 MiB/s wr, 395 op/s 2023-10-08T12:56:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:19 smithi092 ceph-mon[134093]: pgmap v786: 97 pgs: 97 active+clean; 888 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.6 MiB/s wr, 395 op/s 2023-10-08T12:56:20.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 44352 23.18 MB/sec warmup 111 sec latency 219.652 ms 2023-10-08T12:56:21.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 44610 23.12 MB/sec warmup 112 sec latency 136.988 ms 2023-10-08T12:56:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:22 smithi092 ceph-mon[134093]: pgmap v787: 97 pgs: 97 active+clean; 900 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.0 MiB/s wr, 386 op/s 2023-10-08T12:56:22.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:22 smithi173 ceph-mon[135182]: pgmap v787: 97 pgs: 97 active+clean; 900 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.0 MiB/s wr, 386 op/s 2023-10-08T12:56:22.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:22 smithi059 ceph-mon[98489]: pgmap v787: 97 pgs: 97 active+clean; 900 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.0 MiB/s wr, 386 op/s 2023-10-08T12:56:22.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 44847 23.00 MB/sec warmup 113 sec latency 180.931 ms 2023-10-08T12:56:23.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 45158 22.91 MB/sec warmup 114 sec latency 225.034 ms 2023-10-08T12:56:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:24 smithi092 ceph-mon[134093]: pgmap v788: 97 pgs: 97 active+clean; 914 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.9 MiB/s wr, 374 op/s 2023-10-08T12:56:24.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:24 smithi173 ceph-mon[135182]: pgmap v788: 97 pgs: 97 active+clean; 914 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.9 MiB/s wr, 374 op/s 2023-10-08T12:56:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:24 smithi059 ceph-mon[98489]: pgmap v788: 97 pgs: 97 active+clean; 914 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.9 MiB/s wr, 374 op/s 2023-10-08T12:56:24.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 45574 22.86 MB/sec warmup 115 sec latency 73.910 ms 2023-10-08T12:56:25.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 45970 22.80 MB/sec warmup 116 sec latency 298.403 ms 2023-10-08T12:56:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:26 smithi092 ceph-mon[134093]: pgmap v789: 97 pgs: 97 active+clean; 897 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.4 MiB/s wr, 408 op/s 2023-10-08T12:56:26.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:26 smithi173 ceph-mon[135182]: pgmap v789: 97 pgs: 97 active+clean; 897 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.4 MiB/s wr, 408 op/s 2023-10-08T12:56:26.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:26 smithi059 ceph-mon[98489]: pgmap v789: 97 pgs: 97 active+clean; 897 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.4 MiB/s wr, 408 op/s 2023-10-08T12:56:26.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 46468 22.81 MB/sec warmup 117 sec latency 118.941 ms 2023-10-08T12:56:27.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 46927 22.85 MB/sec warmup 118 sec latency 144.044 ms 2023-10-08T12:56:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:28 smithi092 ceph-mon[134093]: pgmap v790: 97 pgs: 97 active+clean; 865 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 396 op/s 2023-10-08T12:56:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:28 smithi173 ceph-mon[135182]: pgmap v790: 97 pgs: 97 active+clean; 865 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 396 op/s 2023-10-08T12:56:28.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:28 smithi059 ceph-mon[98489]: pgmap v790: 97 pgs: 97 active+clean; 865 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 396 op/s 2023-10-08T12:56:28.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 47415 23.00 MB/sec warmup 119 sec latency 118.626 ms 2023-10-08T12:56:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:29 smithi173 ceph-mon[135182]: pgmap v791: 97 pgs: 97 active+clean; 835 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 394 op/s 2023-10-08T12:56:30.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:29 smithi059 ceph-mon[98489]: pgmap v791: 97 pgs: 97 active+clean; 835 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 394 op/s 2023-10-08T12:56:30.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:29 smithi092 ceph-mon[134093]: pgmap v791: 97 pgs: 97 active+clean; 835 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 394 op/s 2023-10-08T12:56:30.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 47963 7.08 MB/sec execute 1 sec latency 226.149 ms 2023-10-08T12:56:31.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 48229 8.52 MB/sec execute 2 sec latency 254.954 ms 2023-10-08T12:56:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:32 smithi092 ceph-mon[134093]: pgmap v792: 97 pgs: 97 active+clean; 838 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.4 MiB/s wr, 385 op/s 2023-10-08T12:56:32.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:32 smithi173 ceph-mon[135182]: pgmap v792: 97 pgs: 97 active+clean; 838 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.4 MiB/s wr, 385 op/s 2023-10-08T12:56:32.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:32 smithi059 ceph-mon[98489]: pgmap v792: 97 pgs: 97 active+clean; 838 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.4 MiB/s wr, 385 op/s 2023-10-08T12:56:32.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 48632 12.43 MB/sec execute 3 sec latency 178.119 ms 2023-10-08T12:56:33.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 49132 13.56 MB/sec execute 4 sec latency 243.071 ms 2023-10-08T12:56:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:34 smithi092 ceph-mon[134093]: pgmap v793: 97 pgs: 97 active+clean; 841 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.4 MiB/s wr, 364 op/s 2023-10-08T12:56:34.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:34 smithi173 ceph-mon[135182]: pgmap v793: 97 pgs: 97 active+clean; 841 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.4 MiB/s wr, 364 op/s 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:34 smithi059 ceph-mon[98489]: pgmap v793: 97 pgs: 97 active+clean; 841 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.4 MiB/s wr, 364 op/s 2023-10-08T12:56:34.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 49740 18.05 MB/sec execute 5 sec latency 37.406 ms 2023-10-08T12:56:35.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 50259 20.88 MB/sec execute 6 sec latency 205.577 ms 2023-10-08T12:56:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:36 smithi092 ceph-mon[134093]: pgmap v794: 97 pgs: 97 active+clean; 847 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 335 op/s 2023-10-08T12:56:36.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:36 smithi173 ceph-mon[135182]: pgmap v794: 97 pgs: 97 active+clean; 847 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 335 op/s 2023-10-08T12:56:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:36 smithi059 ceph-mon[98489]: pgmap v794: 97 pgs: 97 active+clean; 847 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 335 op/s 2023-10-08T12:56:36.946 INFO:tasks.workunit.client.0.smithi059.stdout: 10 50728 22.30 MB/sec execute 7 sec latency 161.181 ms 2023-10-08T12:56:37.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 51120 22.68 MB/sec execute 8 sec latency 166.764 ms 2023-10-08T12:56:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:38 smithi092 ceph-mon[134093]: pgmap v795: 97 pgs: 97 active+clean; 854 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 303 op/s 2023-10-08T12:56:38.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:38 smithi173 ceph-mon[135182]: pgmap v795: 97 pgs: 97 active+clean; 854 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 303 op/s 2023-10-08T12:56:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:38 smithi059 ceph-mon[98489]: pgmap v795: 97 pgs: 97 active+clean; 854 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 303 op/s 2023-10-08T12:56:38.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 51369 21.35 MB/sec execute 9 sec latency 79.626 ms 2023-10-08T12:56:39.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 51670 20.42 MB/sec execute 10 sec latency 77.772 ms 2023-10-08T12:56:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:39 smithi173 ceph-mon[135182]: pgmap v796: 97 pgs: 97 active+clean; 868 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.5 MiB/s wr, 349 op/s 2023-10-08T12:56:40.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:39 smithi059 ceph-mon[98489]: pgmap v796: 97 pgs: 97 active+clean; 868 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.5 MiB/s wr, 349 op/s 2023-10-08T12:56:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:39 smithi092 ceph-mon[134093]: pgmap v796: 97 pgs: 97 active+clean; 868 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.5 MiB/s wr, 349 op/s 2023-10-08T12:56:40.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 51902 19.39 MB/sec execute 11 sec latency 237.459 ms 2023-10-08T12:56:41.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 52309 19.43 MB/sec execute 12 sec latency 345.823 ms 2023-10-08T12:56:42.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:56:42.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:42 smithi092 ceph-mon[134093]: pgmap v797: 97 pgs: 97 active+clean; 868 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.2 MiB/s wr, 315 op/s 2023-10-08T12:56:42.432 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:42 smithi059 ceph-mon[98489]: pgmap v797: 97 pgs: 97 active+clean; 868 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.2 MiB/s wr, 315 op/s 2023-10-08T12:56:42.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:42 smithi173 ceph-mon[135182]: pgmap v797: 97 pgs: 97 active+clean; 868 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.2 MiB/s wr, 315 op/s 2023-10-08T12:56:42.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.591+0000 7f32c4fff700 1 -- 172.21.15.59:0/3164192449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c01051c0 msgr2=0x7f32c0105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.591+0000 7f32c4fff700 1 --2- 172.21.15.59:0/3164192449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c01051c0 0x7f32c0105640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f32b40099c0 tx=0x7f32b4009cd0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.591+0000 7f32c4fff700 1 -- 172.21.15.59:0/3164192449 shutdown_connections 2023-10-08T12:56:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.591+0000 7f32c4fff700 1 --2- 172.21.15.59:0/3164192449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32c0105b80 0x7f32c010d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.591+0000 7f32c4fff700 1 --2- 172.21.15.59:0/3164192449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c0067ce0 0x7f32c00680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.591+0000 7f32c4fff700 1 --2- 172.21.15.59:0/3164192449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c01051c0 0x7f32c0105640 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.591+0000 7f32c4fff700 1 -- 172.21.15.59:0/3164192449 >> 172.21.15.59:0/3164192449 conn(0x7f32c0076780 msgr2=0x7f32c0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.591+0000 7f32c4fff700 1 -- 172.21.15.59:0/3164192449 shutdown_connections 2023-10-08T12:56:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.591+0000 7f32c4fff700 1 -- 172.21.15.59:0/3164192449 wait complete. 2023-10-08T12:56:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.592+0000 7f32c4fff700 1 Processor -- start 2023-10-08T12:56:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.592+0000 7f32c4fff700 1 -- start start 2023-10-08T12:56:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.593+0000 7f32c4fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c0067ce0 0x7f32c00ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.593+0000 7f32c4fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32c01051c0 0x7f32c00ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.593+0000 7f32c4fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c0105b80 0x7f32c0100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.593+0000 7f32c4fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01a4fd0 con 0x7f32c0067ce0 2023-10-08T12:56:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.593+0000 7f32c4fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01a5140 con 0x7f32c01051c0 2023-10-08T12:56:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.593+0000 7f32c4fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01a5300 con 0x7f32c0105b80 2023-10-08T12:56:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.593+0000 7f32bdd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32c01051c0 0x7f32c00ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.593+0000 7f32be59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c0067ce0 0x7f32c00ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.593+0000 7f32bdd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32c01051c0 0x7f32c00ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33142/0 (socket says 172.21.15.59:33142) 2023-10-08T12:56:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.593+0000 7f32bdd9b700 1 -- 172.21.15.59:0/1209263510 learned_addr learned my addr 172.21.15.59:0/1209263510 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.593+0000 7f32bed9d700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c0105b80 0x7f32c0100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32bdd9b700 1 -- 172.21.15.59:0/1209263510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c0105b80 msgr2=0x7f32c0100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32bdd9b700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c0105b80 0x7f32c0100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32bdd9b700 1 -- 172.21.15.59:0/1209263510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c0067ce0 msgr2=0x7f32c00ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32bdd9b700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c0067ce0 0x7f32c00ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32bdd9b700 1 -- 172.21.15.59:0/1209263510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40095f0 con 0x7f32c01051c0 2023-10-08T12:56:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32be59c700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c0067ce0 0x7f32c00ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32bed9d700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c0105b80 0x7f32c0100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32bdd9b700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32c01051c0 0x7f32c00ffbf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f32b400b580 tx=0x7f32b400bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32af7fe700 1 -- 172.21.15.59:0/1209263510 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b401c070 con 0x7f32c01051c0 2023-10-08T12:56:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32c4fff700 1 -- 172.21.15.59:0/1209263510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c01a5580 con 0x7f32c01051c0 2023-10-08T12:56:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32af7fe700 1 -- 172.21.15.59:0/1209263510 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32b400fd40 con 0x7f32c01051c0 2023-10-08T12:56:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32af7fe700 1 -- 172.21.15.59:0/1209263510 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4022b80 con 0x7f32c01051c0 2023-10-08T12:56:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.594+0000 7f32c4fff700 1 -- 172.21.15.59:0/1209263510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c01a5a00 con 0x7f32c01051c0 2023-10-08T12:56:42.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.598+0000 7f32af7fe700 1 -- 172.21.15.59:0/1209263510 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f32b4020070 con 0x7f32c01051c0 2023-10-08T12:56:42.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.599+0000 7f32af7fe700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32a80a15f0 0x7f32a80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.599+0000 7f32d884ab80 1 Processor -- start 2023-10-08T12:56:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.599+0000 7f32af7fe700 1 -- 172.21.15.59:0/1209263510 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f32b40cdea0 con 0x7f32c01051c0 2023-10-08T12:56:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.600+0000 7f32be59c700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32a80a15f0 0x7f32a80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.600+0000 7f32d884ab80 1 -- start start 2023-10-08T12:56:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.600+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 0x55a37de5c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.600+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5c7a0 0x55a37de67110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.600+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de69a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.600+0000 7f32d884ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37ddc5460 con 0x55a37de5be80 2023-10-08T12:56:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.600+0000 7f32d884ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37ddb6c20 con 0x55a37de5c7a0 2023-10-08T12:56:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.600+0000 7f32d884ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37ddb4540 con 0x55a37de67650 2023-10-08T12:56:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.600+0000 7f32bdd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5c7a0 0x55a37de67110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32bdd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5c7a0 0x55a37de67110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33156/0 (socket says 172.21.15.59:33156) 2023-10-08T12:56:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32bdd9b700 1 -- 172.21.15.59:0/976429940 learned_addr learned my addr 172.21.15.59:0/976429940 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32be59c700 1 --2- 172.21.15.59:0/976429940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 0x55a37de5c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32bed9d700 1 --2- 172.21.15.59:0/976429940 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de69a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32be59c700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32a80a15f0 0x7f32a80a3ab0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f32b0011490 tx=0x7f32b0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32bdd9b700 1 -- 172.21.15.59:0/976429940 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 msgr2=0x55a37de69a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32bdd9b700 1 --2- 172.21.15.59:0/976429940 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de69a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32bdd9b700 1 -- 172.21.15.59:0/976429940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 msgr2=0x55a37de5c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32bdd9b700 1 --2- 172.21.15.59:0/976429940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 0x55a37de5c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32bdd9b700 1 -- 172.21.15.59:0/976429940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a37dbdade0 con 0x55a37de5c7a0 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32bdd9b700 1 --2- 172.21.15.59:0/976429940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5c7a0 0x55a37de67110 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f32b409ac00 tx=0x7f32b409aa40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=334d457e5ee689fd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.601+0000 7f32acff9700 1 -- 172.21.15.59:0/976429940 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b409af00 con 0x55a37de5c7a0 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.602+0000 7f32acff9700 1 -- 172.21.15.59:0/976429940 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32b409f050 con 0x55a37de5c7a0 2023-10-08T12:56:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.602+0000 7f32acff9700 1 -- 172.21.15.59:0/976429940 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b409b3c0 con 0x55a37de5c7a0 2023-10-08T12:56:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.603+0000 7f32d884ab80 1 -- 172.21.15.59:0/976429940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5c7a0 msgr2=0x55a37de67110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.603+0000 7f32d884ab80 1 --2- 172.21.15.59:0/976429940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5c7a0 0x55a37de67110 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f32b409ac00 tx=0x7f32b409aa40 comp rx=0 tx=0).stop 2023-10-08T12:56:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.603+0000 7f32d884ab80 1 -- 172.21.15.59:0/976429940 shutdown_connections 2023-10-08T12:56:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.603+0000 7f32d884ab80 1 --2- 172.21.15.59:0/976429940 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de69a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.603+0000 7f32d884ab80 1 --2- 172.21.15.59:0/976429940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 0x55a37de5c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.603+0000 7f32d884ab80 1 --2- 172.21.15.59:0/976429940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5c7a0 0x55a37de67110 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.603+0000 7f32d884ab80 1 -- 172.21.15.59:0/976429940 >> 172.21.15.59:0/976429940 conn(0x55a37ddd1260 msgr2=0x55a37de582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.603+0000 7f32d884ab80 1 -- 172.21.15.59:0/976429940 shutdown_connections 2023-10-08T12:56:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.603+0000 7f32d884ab80 1 -- 172.21.15.59:0/976429940 wait complete. 2023-10-08T12:56:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.603+0000 7f32d884ab80 1 -- start start 2023-10-08T12:56:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.604+0000 7f32d884ab80 1 Processor -- start 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.604+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 0x55a37de70240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.604+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de5c7a0 0x55a37de70780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.604+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de67650 0x55a37de7b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.604+0000 7f32d884ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37ddafe30 con 0x55a37de5be80 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.604+0000 7f32d884ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37dd4c710 con 0x55a37de67650 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.604+0000 7f32d884ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37dd4c3b0 con 0x55a37de5c7a0 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.604+0000 7f32d884ab80 10 client.0 _ll_register_callbacks cb 0x55a37dba9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32be59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 0x55a37de70240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32bdd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de5c7a0 0x55a37de70780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32be59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 0x55a37de70240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53434/0 (socket says 172.21.15.59:53434) 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32be59c700 1 -- 172.21.15.59:0/4087448046 learned_addr learned my addr 172.21.15.59:0/4087448046 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32bed9d700 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de67650 0x55a37de7b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32be59c700 1 -- 172.21.15.59:0/4087448046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de5c7a0 msgr2=0x55a37de70780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32be59c700 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de5c7a0 0x55a37de70780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32be59c700 1 -- 172.21.15.59:0/4087448046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de67650 msgr2=0x55a37de7b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32be59c700 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de67650 0x55a37de7b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32be59c700 1 -- 172.21.15.59:0/4087448046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c01a5a00 con 0x55a37de5be80 2023-10-08T12:56:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32be59c700 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 0x55a37de70240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f32b0003950 tx=0x7f32b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307cfb26f8a6434f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.605+0000 7f32a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:56:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.606+0000 7f32a5ffb700 1 -- 172.21.15.59:0/4087448046 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b001f7c0 con 0x55a37de5be80 2023-10-08T12:56:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.606+0000 7f32d884ab80 1 -- 172.21.15.59:0/4087448046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a37dd77eb0 con 0x55a37de5be80 2023-10-08T12:56:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.606+0000 7f32a5ffb700 1 -- 172.21.15.59:0/4087448046 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f32b001f920 con 0x55a37de5be80 2023-10-08T12:56:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.606+0000 7f32a5ffb700 1 -- 172.21.15.59:0/4087448046 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32b001fae0 con 0x55a37de5be80 2023-10-08T12:56:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.606+0000 7f32d884ab80 10 client.17676 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.606+0000 7f32d884ab80 1 -- 172.21.15.59:0/4087448046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55a37dbc3c60 con 0x55a37de5be80 2023-10-08T12:56:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.606+0000 7f32a5ffb700 1 -- 172.21.15.59:0/4087448046 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a37dd77eb0 con 0x55a37de5be80 2023-10-08T12:56:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.606+0000 7f32a5ffb700 1 -- 172.21.15.59:0/4087448046 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f32b0028440 con 0x55a37de5be80 2023-10-08T12:56:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.607+0000 7f32d884ab80 10 client.17676 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.607+0000 7f32d884ab80 10 client.17676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.607+0000 7f32d884ab80 20 client.17676 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.607+0000 7f32d884ab80 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a37de6b7e0 0x55a37de6dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.607+0000 7f32d884ab80 4 client.17676 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:56:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.607+0000 7f32d884ab80 1 -- 172.21.15.59:0/4087448046 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a37dda8e10 con 0x55a37de6b7e0 2023-10-08T12:56:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.607+0000 7f32bdd9b700 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a37de6b7e0 0x55a37de6dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.607+0000 7f32bdd9b700 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a37de6b7e0 0x55a37de6dbd0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fc5851b023757c2 server_cookie=c451ae768be8ba8 in_seq=0 out_seq=0 2023-10-08T12:56:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.607+0000 7f32a5ffb700 10 client.17676 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32a5ffb700 1 -- 172.21.15.59:0/4087448046 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a37dda8e10 con 0x55a37de6b7e0 2023-10-08T12:56:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32a5ffb700 10 client.17676 handle_command_reply: tid=0 2023-10-08T12:56:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32d884ab80 1 client.17676 shutdown 2023-10-08T12:56:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32d884ab80 1 -- 172.21.15.59:0/4087448046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 msgr2=0x55a37de70240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32d884ab80 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 0x55a37de70240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f32b0003950 tx=0x7f32b00047c0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32d884ab80 1 -- 172.21.15.59:0/4087448046 shutdown_connections 2023-10-08T12:56:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32d884ab80 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a37de6b7e0 0x55a37de6dbd0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32d884ab80 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de67650 0x55a37de7b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32d884ab80 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5be80 0x55a37de70240 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32a5ffb700 0 client.17676 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32d884ab80 1 --2- 172.21.15.59:0/4087448046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de5c7a0 0x55a37de70780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32d884ab80 1 -- 172.21.15.59:0/4087448046 >> 172.21.15.59:0/4087448046 conn(0x55a37ddd1260 msgr2=0x55a37de57ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32d884ab80 1 -- 172.21.15.59:0/4087448046 shutdown_connections 2023-10-08T12:56:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.611+0000 7f32d884ab80 1 -- 172.21.15.59:0/4087448046 wait complete. 2023-10-08T12:56:42.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.612+0000 7f32d884ab80 20 client.17676 trim_cache size 0 max 16384 2023-10-08T12:56:42.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.630+0000 7f32d884ab80 1 Processor -- start 2023-10-08T12:56:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.630+0000 7f32d884ab80 1 -- start start 2023-10-08T12:56:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.630+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de75280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.630+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5c7a0 0x55a37de660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.630+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de65120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.630+0000 7f32d884ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37dc30920 con 0x55a37de5c7a0 2023-10-08T12:56:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.630+0000 7f32d884ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37de52570 con 0x55a37de5be80 2023-10-08T12:56:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.630+0000 7f32d884ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37de59060 con 0x55a37de67650 2023-10-08T12:56:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.631+0000 7f32be59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de75280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.631+0000 7f32bdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5c7a0 0x55a37de660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.631+0000 7f32be59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de75280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33182/0 (socket says 172.21.15.59:33182) 2023-10-08T12:56:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.631+0000 7f32be59c700 1 -- 172.21.15.59:0/863546626 learned_addr learned my addr 172.21.15.59:0/863546626 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.631+0000 7f32bed9d700 1 --2- 172.21.15.59:0/863546626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de65120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.631+0000 7f32be59c700 1 -- 172.21.15.59:0/863546626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 msgr2=0x55a37de65120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.631+0000 7f32be59c700 1 --2- 172.21.15.59:0/863546626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de65120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.631+0000 7f32be59c700 1 -- 172.21.15.59:0/863546626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5c7a0 msgr2=0x55a37de660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.631+0000 7f32be59c700 1 --2- 172.21.15.59:0/863546626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5c7a0 0x55a37de660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.631+0000 7f32be59c700 1 -- 172.21.15.59:0/863546626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a37dc01250 con 0x55a37de5be80 2023-10-08T12:56:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.631+0000 7f32be59c700 1 --2- 172.21.15.59:0/863546626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de75280 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f32b00094f0 tx=0x7f32b0005e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d1236ec395f4556 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.632+0000 7f32ad7fa700 1 -- 172.21.15.59:0/863546626 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b00289c0 con 0x55a37de5be80 2023-10-08T12:56:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.632+0000 7f32ad7fa700 1 -- 172.21.15.59:0/863546626 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32b0028b20 con 0x55a37de5be80 2023-10-08T12:56:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.632+0000 7f32ad7fa700 1 -- 172.21.15.59:0/863546626 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0032760 con 0x55a37de5be80 2023-10-08T12:56:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.632+0000 7f32d884ab80 1 -- 172.21.15.59:0/863546626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 msgr2=0x55a37de75280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.632+0000 7f32d884ab80 1 --2- 172.21.15.59:0/863546626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de75280 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f32b00094f0 tx=0x7f32b0005e40 comp rx=0 tx=0).stop 2023-10-08T12:56:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.632+0000 7f32d884ab80 1 -- 172.21.15.59:0/863546626 shutdown_connections 2023-10-08T12:56:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.632+0000 7f32d884ab80 1 --2- 172.21.15.59:0/863546626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de75280 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.632+0000 7f32d884ab80 1 --2- 172.21.15.59:0/863546626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de65120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.632+0000 7f32d884ab80 1 --2- 172.21.15.59:0/863546626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5c7a0 0x55a37de660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.632+0000 7f32d884ab80 1 -- 172.21.15.59:0/863546626 >> 172.21.15.59:0/863546626 conn(0x55a37ddd1260 msgr2=0x55a37de56a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.633+0000 7f32d884ab80 1 -- 172.21.15.59:0/863546626 shutdown_connections 2023-10-08T12:56:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.633+0000 7f32d884ab80 1 -- 172.21.15.59:0/863546626 wait complete. 2023-10-08T12:56:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.633+0000 7f32d884ab80 1 -- start start 2023-10-08T12:56:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.633+0000 7f32d884ab80 1 Processor -- start 2023-10-08T12:56:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de73a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5c7a0 0x55a37de73f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32d884ab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32d884ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37dedba60 con 0x55a37de5c7a0 2023-10-08T12:56:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32d884ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37dedbbd0 con 0x55a37de5be80 2023-10-08T12:56:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32d884ab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37dedbd90 con 0x55a37de67650 2023-10-08T12:56:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32d884ab80 10 client.0 _ll_register_callbacks cb 0x55a37dba9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32be59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de73a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32bdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5c7a0 0x55a37de73f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32be59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de73a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33190/0 (socket says 172.21.15.59:33190) 2023-10-08T12:56:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32be59c700 1 -- 172.21.15.59:0/826020178 learned_addr learned my addr 172.21.15.59:0/826020178 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32bed9d700 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32bdd9b700 1 -- 172.21.15.59:0/826020178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 msgr2=0x55a37de744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32bdd9b700 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de744b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32bdd9b700 1 -- 172.21.15.59:0/826020178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 msgr2=0x55a37de73a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32bdd9b700 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de73a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32bdd9b700 1 -- 172.21.15.59:0/826020178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a37dbc3c60 con 0x55a37de5c7a0 2023-10-08T12:56:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.634+0000 7f32be59c700 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de73a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.635+0000 7f32bdd9b700 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5c7a0 0x55a37de73f70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55a37de5cc70 tx=0x7f32b40b0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57362a47ed87ef5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.635+0000 7f32a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:56:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.635+0000 7f32a5ffb700 1 -- 172.21.15.59:0/826020178 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b409aa40 con 0x55a37de5c7a0 2023-10-08T12:56:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.635+0000 7f32d884ab80 1 -- 172.21.15.59:0/826020178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32b409f050 con 0x55a37de5c7a0 2023-10-08T12:56:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.635+0000 7f32a5ffb700 1 -- 172.21.15.59:0/826020178 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f32b40b8070 con 0x55a37de5c7a0 2023-10-08T12:56:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.635+0000 7f32a5ffb700 1 -- 172.21.15.59:0/826020178 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32b40a10b0 con 0x55a37de5c7a0 2023-10-08T12:56:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.635+0000 7f32d884ab80 10 client.17682 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.635+0000 7f32d884ab80 1 -- 172.21.15.59:0/826020178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55a37dbd92b0 con 0x55a37de5c7a0 2023-10-08T12:56:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.635+0000 7f32a5ffb700 1 -- 172.21.15.59:0/826020178 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32b40a7020 con 0x55a37de5c7a0 2023-10-08T12:56:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.635+0000 7f32a5ffb700 1 -- 172.21.15.59:0/826020178 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f32b409b160 con 0x55a37de5c7a0 2023-10-08T12:56:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.636+0000 7f32d884ab80 10 client.17682 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.636+0000 7f32d884ab80 10 client.17682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.636+0000 7f32d884ab80 20 client.17682 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:42.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.636+0000 7f32d884ab80 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a37dedd1b0 0x55a37dedf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.636+0000 7f32d884ab80 4 client.17682 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:56:42.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.636+0000 7f32d884ab80 1 -- 172.21.15.59:0/826020178 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a37dda8b30 con 0x55a37dedd1b0 2023-10-08T12:56:42.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.636+0000 7f32be59c700 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a37dedd1b0 0x55a37dedf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.636+0000 7f32a5ffb700 10 client.17682 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:42.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.636+0000 7f32be59c700 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a37dedd1b0 0x55a37dedf5d0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a00e873b3368f96c server_cookie=ae44fc21acf8c621 in_seq=0 out_seq=0 2023-10-08T12:56:42.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32a5ffb700 1 -- 172.21.15.59:0/826020178 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a37dda8b30 con 0x55a37dedd1b0 2023-10-08T12:56:42.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32a5ffb700 10 client.17682 handle_command_reply: tid=0 2023-10-08T12:56:42.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 1 client.17682 shutdown 2023-10-08T12:56:42.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 1 -- 172.21.15.59:0/826020178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5c7a0 msgr2=0x55a37de73f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5c7a0 0x55a37de73f70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55a37de5cc70 tx=0x7f32b40b0040 comp rx=0 tx=0).stop 2023-10-08T12:56:42.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 1 -- 172.21.15.59:0/826020178 shutdown_connections 2023-10-08T12:56:42.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55a37dedd1b0 0x55a37dedf5d0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a37de5be80 0x55a37de73a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a37de67650 0x55a37de744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32a5ffb700 0 client.17682 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 1 --2- 172.21.15.59:0/826020178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a37de5c7a0 0x55a37de73f70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 1 -- 172.21.15.59:0/826020178 >> 172.21.15.59:0/826020178 conn(0x55a37ddd1260 msgr2=0x55a37de65fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 1 -- 172.21.15.59:0/826020178 shutdown_connections 2023-10-08T12:56:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 1 -- 172.21.15.59:0/826020178 wait complete. 2023-10-08T12:56:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.640+0000 7f32d884ab80 20 client.17682 trim_cache size 0 max 16384 2023-10-08T12:56:42.644 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:56:42.645 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:56:42.645 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:56:42.645 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:56:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 -- 172.21.15.59:0/1209263510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32a80a15f0 msgr2=0x7f32a80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32a80a15f0 0x7f32a80a3ab0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f32b0011490 tx=0x7f32b0009260 comp rx=0 tx=0).stop 2023-10-08T12:56:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 -- 172.21.15.59:0/1209263510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32c01051c0 msgr2=0x7f32c00ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32c01051c0 0x7f32c00ffbf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f32b400b580 tx=0x7f32b400bfd0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 -- 172.21.15.59:0/1209263510 shutdown_connections 2023-10-08T12:56:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32a80a15f0 0x7f32a80a3ab0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c0105b80 0x7f32c0100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c0067ce0 0x7f32c00ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 --2- 172.21.15.59:0/1209263510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32c01051c0 0x7f32c00ffbf0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 -- 172.21.15.59:0/1209263510 >> 172.21.15.59:0/1209263510 conn(0x7f32c0076780 msgr2=0x7f32c00fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 -- 172.21.15.59:0/1209263510 shutdown_connections 2023-10-08T12:56:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.641+0000 7f32c4fff700 1 -- 172.21.15.59:0/1209263510 wait complete. 2023-10-08T12:56:42.661 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:56:42.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:56:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.884+0000 7f6c52fff700 1 -- 172.21.15.59:0/56133128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c4c100ff0 msgr2=0x7f6c4c10d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.884+0000 7f6c52fff700 1 --2- 172.21.15.59:0/56133128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c4c100ff0 0x7f6c4c10d500 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009f90 tx=0x7f6c4400b330 comp rx=0 tx=0).stop 2023-10-08T12:56:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.884+0000 7f6c52fff700 1 -- 172.21.15.59:0/56133128 shutdown_connections 2023-10-08T12:56:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.884+0000 7f6c52fff700 1 --2- 172.21.15.59:0/56133128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c4c100ff0 0x7f6c4c10d500 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.884+0000 7f6c52fff700 1 --2- 172.21.15.59:0/56133128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c106640 0x7f6c4c106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.884+0000 7f6c52fff700 1 --2- 172.21.15.59:0/56133128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4c100630 0x7f6c4c100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.884+0000 7f6c52fff700 1 -- 172.21.15.59:0/56133128 >> 172.21.15.59:0/56133128 conn(0x7f6c4c0fc1a0 msgr2=0x7f6c4c0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.884+0000 7f6c52fff700 1 -- 172.21.15.59:0/56133128 shutdown_connections 2023-10-08T12:56:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.884+0000 7f6c52fff700 1 -- 172.21.15.59:0/56133128 wait complete. 2023-10-08T12:56:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.885+0000 7f6c52fff700 1 Processor -- start 2023-10-08T12:56:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.885+0000 7f6c52fff700 1 -- start start 2023-10-08T12:56:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c52fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4c100630 0x7f6c4c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c52fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c4c100ff0 0x7f6c4c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c52fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c106640 0x7f6c4c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c52fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1a4df0 con 0x7f6c4c100630 2023-10-08T12:56:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c52fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1a4f60 con 0x7f6c4c100ff0 2023-10-08T12:56:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c52fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1a5120 con 0x7f6c4c106640 2023-10-08T12:56:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c50d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4c100630 0x7f6c4c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c4bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c4c100ff0 0x7f6c4c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c5159c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c106640 0x7f6c4c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c5159c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c106640 0x7f6c4c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:57978/0 (socket says 172.21.15.59:57978) 2023-10-08T12:56:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c4bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c4c100ff0 0x7f6c4c073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33214/0 (socket says 172.21.15.59:33214) 2023-10-08T12:56:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c50d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4c100630 0x7f6c4c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53474/0 (socket says 172.21.15.59:53474) 2023-10-08T12:56:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.886+0000 7f6c5159c700 1 -- 172.21.15.59:0/1625740476 learned_addr learned my addr 172.21.15.59:0/1625740476 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.887+0000 7f6c5159c700 1 -- 172.21.15.59:0/1625740476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c4c100ff0 msgr2=0x7f6c4c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.887+0000 7f6c5159c700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c4c100ff0 0x7f6c4c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.887+0000 7f6c5159c700 1 -- 172.21.15.59:0/1625740476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4c100630 msgr2=0x7f6c4c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.887+0000 7f6c5159c700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4c100630 0x7f6c4c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.887+0000 7f6c5159c700 1 -- 172.21.15.59:0/1625740476 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c44009c40 con 0x7f6c4c106640 2023-10-08T12:56:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.887+0000 7f6c5159c700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c106640 0x7f6c4c073570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c44008fb0 tx=0x7f6c440094f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.887+0000 7f6c49ffb700 1 -- 172.21.15.59:0/1625740476 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4400e040 con 0x7f6c4c106640 2023-10-08T12:56:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.887+0000 7f6c52fff700 1 -- 172.21.15.59:0/1625740476 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c1a53a0 con 0x7f6c4c106640 2023-10-08T12:56:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.887+0000 7f6c49ffb700 1 -- 172.21.15.59:0/1625740476 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c4400bbf0 con 0x7f6c4c106640 2023-10-08T12:56:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.887+0000 7f6c49ffb700 1 -- 172.21.15.59:0/1625740476 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44005040 con 0x7f6c4c106640 2023-10-08T12:56:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.887+0000 7f6c52fff700 1 -- 172.21.15.59:0/1625740476 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c1a5820 con 0x7f6c4c106640 2023-10-08T12:56:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.888+0000 7f6c52fff700 1 -- 172.21.15.59:0/1625740476 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c108c50 con 0x7f6c4c106640 2023-10-08T12:56:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.890+0000 7f6c49ffb700 1 -- 172.21.15.59:0/1625740476 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6c4401d470 con 0x7f6c4c106640 2023-10-08T12:56:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.892+0000 7f6c49ffb700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c3c0a15f0 0x7f6c3c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.892+0000 7f6c49ffb700 1 -- 172.21.15.59:0/1625740476 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f6c440ce930 con 0x7f6c4c106640 2023-10-08T12:56:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.892+0000 7f6c50d9b700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c3c0a15f0 0x7f6c3c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:42.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.893+0000 7f6c50d9b700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c3c0a15f0 0x7f6c3c0a3ab0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009be0 tx=0x7f6c40009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:42.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:42.894+0000 7f6c49ffb700 1 -- 172.21.15.59:0/1625740476 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6c44097cd0 con 0x7f6c4c106640 2023-10-08T12:56:42.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 52849 19.51 MB/sec execute 13 sec latency 154.032 ms 2023-10-08T12:56:43.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.181+0000 7f6c52fff700 1 -- 172.21.15.59:0/1625740476 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c4c074070 con 0x7f6c4c106640 2023-10-08T12:56:43.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.182+0000 7f6c49ffb700 1 -- 172.21.15.59:0/1625740476 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f6c4409b2f0 con 0x7f6c4c106640 2023-10-08T12:56:43.183 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:56:43.183 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:56:43.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 -- 172.21.15.59:0/1625740476 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c3c0a15f0 msgr2=0x7f6c3c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:43.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c3c0a15f0 0x7f6c3c0a3ab0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009be0 tx=0x7f6c40009260 comp rx=0 tx=0).stop 2023-10-08T12:56:43.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 -- 172.21.15.59:0/1625740476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c106640 msgr2=0x7f6c4c073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:43.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c106640 0x7f6c4c073570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c44008fb0 tx=0x7f6c440094f0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 -- 172.21.15.59:0/1625740476 shutdown_connections 2023-10-08T12:56:43.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6c3c0a15f0 0x7f6c3c0a3ab0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c106640 0x7f6c4c073570 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4c100630 0x7f6c4c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 --2- 172.21.15.59:0/1625740476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c4c100ff0 0x7f6c4c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 -- 172.21.15.59:0/1625740476 >> 172.21.15.59:0/1625740476 conn(0x7f6c4c0fc1a0 msgr2=0x7f6c4c0fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:43.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 -- 172.21.15.59:0/1625740476 shutdown_connections 2023-10-08T12:56:43.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.185+0000 7f6c52fff700 1 -- 172.21.15.59:0/1625740476 wait complete. 2023-10-08T12:56:43.187 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:56:43.208 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:56:43.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.440+0000 7f229ffff700 1 -- 172.21.15.59:0/927432683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2298106750 msgr2=0x7f2298106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:43.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.440+0000 7f229ffff700 1 --2- 172.21.15.59:0/927432683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2298106750 0x7f2298106b30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2294009990 tx=0x7f2294009ca0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.440+0000 7f229ffff700 1 -- 172.21.15.59:0/927432683 shutdown_connections 2023-10-08T12:56:43.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.440+0000 7f229ffff700 1 --2- 172.21.15.59:0/927432683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2298106750 0x7f2298106b30 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.440+0000 7f229ffff700 1 --2- 172.21.15.59:0/927432683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2298101100 0x7f229810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.440+0000 7f229ffff700 1 --2- 172.21.15.59:0/927432683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2298100740 0x7f2298100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.440+0000 7f229ffff700 1 -- 172.21.15.59:0/927432683 >> 172.21.15.59:0/927432683 conn(0x7f22980fc230 msgr2=0x7f22980fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:43.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.440+0000 7f229ffff700 1 -- 172.21.15.59:0/927432683 shutdown_connections 2023-10-08T12:56:43.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.440+0000 7f229ffff700 1 -- 172.21.15.59:0/927432683 wait complete. 2023-10-08T12:56:43.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.441+0000 7f229ffff700 1 Processor -- start 2023-10-08T12:56:43.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.441+0000 7f229ffff700 1 -- start start 2023-10-08T12:56:43.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2298100740 0x7f229819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2298101100 0x7f229819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2298106750 0x7f2298196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229ffff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2298197070 con 0x7f2298106750 2023-10-08T12:56:43.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229ffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22981971e0 con 0x7f2298100740 2023-10-08T12:56:43.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229ffff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22981973a0 con 0x7f2298101100 2023-10-08T12:56:43.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2298100740 0x7f229819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2298100740 0x7f229819c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33230/0 (socket says 172.21.15.59:33230) 2023-10-08T12:56:43.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229dd9b700 1 -- 172.21.15.59:0/2037800405 learned_addr learned my addr 172.21.15.59:0/2037800405 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:43.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229d59a700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2298101100 0x7f229819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229e59c700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2298106750 0x7f2298196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229dd9b700 1 -- 172.21.15.59:0/2037800405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2298101100 msgr2=0x7f229819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:43.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229dd9b700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2298101100 0x7f229819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229dd9b700 1 -- 172.21.15.59:0/2037800405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2298106750 msgr2=0x7f2298196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:43.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229dd9b700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2298106750 0x7f2298196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.442+0000 7f229dd9b700 1 -- 172.21.15.59:0/2037800405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940095f0 con 0x7f2298100740 2023-10-08T12:56:43.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.443+0000 7f229dd9b700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2298100740 0x7f229819c890 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2294000c00 tx=0x7f2294005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:43.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.443+0000 7f228effd700 1 -- 172.21.15.59:0/2037800405 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229401d070 con 0x7f2298100740 2023-10-08T12:56:43.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.443+0000 7f228effd700 1 -- 172.21.15.59:0/2037800405 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2294022470 con 0x7f2298100740 2023-10-08T12:56:43.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.443+0000 7f228effd700 1 -- 172.21.15.59:0/2037800405 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294017650 con 0x7f2298100740 2023-10-08T12:56:43.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.443+0000 7f229ffff700 1 -- 172.21.15.59:0/2037800405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2298197620 con 0x7f2298100740 2023-10-08T12:56:43.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.443+0000 7f229ffff700 1 -- 172.21.15.59:0/2037800405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22981a3880 con 0x7f2298100740 2023-10-08T12:56:43.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.447+0000 7f228effd700 1 -- 172.21.15.59:0/2037800405 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f22940225e0 con 0x7f2298100740 2023-10-08T12:56:43.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.448+0000 7f22b3a14b80 1 Processor -- start 2023-10-08T12:56:43.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.448+0000 7f22b3a14b80 1 -- start start 2023-10-08T12:56:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d54b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d54b650 0x56467d54da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d4a9460 con 0x56467d54b650 2023-10-08T12:56:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d49ac20 con 0x56467d53fe80 2023-10-08T12:56:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d498540 con 0x56467d5407a0 2023-10-08T12:56:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f229e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f229e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33240/0 (socket says 172.21.15.59:33240) 2023-10-08T12:56:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f229e59c700 1 -- 172.21.15.59:0/517269248 learned_addr learned my addr 172.21.15.59:0/517269248 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f229d59a700 1 --2- 172.21.15.59:0/517269248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d54b650 0x56467d54da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f228effd700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f22840a1670 0x7f22840a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f229dd9b700 1 --2- 172.21.15.59:0/517269248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d54b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f228effd700 1 -- 172.21.15.59:0/2037800405 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f22940ce2c0 con 0x7f2298100740 2023-10-08T12:56:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f229e59c700 1 -- 172.21.15.59:0/517269248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 msgr2=0x56467d54b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f229e59c700 1 --2- 172.21.15.59:0/517269248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d54b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f229e59c700 1 -- 172.21.15.59:0/517269248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d54b650 msgr2=0x56467d54da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f229e59c700 1 --2- 172.21.15.59:0/517269248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d54b650 0x56467d54da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.449+0000 7f229e59c700 1 -- 172.21.15.59:0/517269248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56467d2bede0 con 0x56467d53fe80 2023-10-08T12:56:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.450+0000 7f229e59c700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f22840a1670 0x7f22840a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.450+0000 7f229e59c700 1 --2- 172.21.15.59:0/517269248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f22900117c0 tx=0x7f2290011ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb1ef5ec6eceef96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.450+0000 7f2283fff700 1 -- 172.21.15.59:0/517269248 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229000e040 con 0x56467d53fe80 2023-10-08T12:56:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.450+0000 7f2283fff700 1 -- 172.21.15.59:0/517269248 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2290027070 con 0x56467d53fe80 2023-10-08T12:56:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.450+0000 7f2283fff700 1 -- 172.21.15.59:0/517269248 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22900239f0 con 0x56467d53fe80 2023-10-08T12:56:43.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.451+0000 7f22b3a14b80 1 -- 172.21.15.59:0/517269248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 msgr2=0x56467d540260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:43.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.451+0000 7f229e59c700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f22840a1670 0x7f22840a3b30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2290022000 tx=0x7f229001f000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:43.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.451+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/517269248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f22900117c0 tx=0x7f2290011ad0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.451+0000 7f22b3a14b80 1 -- 172.21.15.59:0/517269248 shutdown_connections 2023-10-08T12:56:43.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.451+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/517269248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.451+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/517269248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d54b650 0x56467d54da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.451+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/517269248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d54b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.451+0000 7f22b3a14b80 1 -- 172.21.15.59:0/517269248 >> 172.21.15.59:0/517269248 conn(0x56467d4b5260 msgr2=0x56467d53c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.451+0000 7f22b3a14b80 1 -- 172.21.15.59:0/517269248 shutdown_connections 2023-10-08T12:56:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.451+0000 7f22b3a14b80 1 -- 172.21.15.59:0/517269248 wait complete. 2023-10-08T12:56:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.452+0000 7f22b3a14b80 1 -- start start 2023-10-08T12:56:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.452+0000 7f22b3a14b80 1 Processor -- start 2023-10-08T12:56:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.452+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d53fe80 0x56467d54b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.452+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d548370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.452+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d54b650 0x56467d548ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.452+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d493e30 con 0x56467d53fe80 2023-10-08T12:56:43.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.452+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d430710 con 0x56467d54b650 2023-10-08T12:56:43.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.452+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d4303b0 con 0x56467d5407a0 2023-10-08T12:56:43.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.452+0000 7f22b3a14b80 10 client.0 _ll_register_callbacks cb 0x56467d28d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:43.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d53fe80 0x56467d54b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d54b650 0x56467d548ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d53fe80 0x56467d54b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53488/0 (socket says 172.21.15.59:53488) 2023-10-08T12:56:43.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229dd9b700 1 -- 172.21.15.59:0/3237085270 learned_addr learned my addr 172.21.15.59:0/3237085270 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:43.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229d59a700 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d548370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229dd9b700 1 -- 172.21.15.59:0/3237085270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 msgr2=0x56467d548370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:43.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229dd9b700 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d548370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229dd9b700 1 -- 172.21.15.59:0/3237085270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d54b650 msgr2=0x56467d548ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:43.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229dd9b700 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d54b650 0x56467d548ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229dd9b700 1 -- 172.21.15.59:0/3237085270 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2290011380 con 0x56467d53fe80 2023-10-08T12:56:43.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229e59c700 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d54b650 0x56467d548ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:43.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f229dd9b700 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d53fe80 0x56467d54b080 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2294006010 tx=0x7f229401feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c3a1965a3dc791 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:43.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.453+0000 7f22817fa700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:56:43.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22817fa700 1 -- 172.21.15.59:0/3237085270 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229409f360 con 0x56467d53fe80 2023-10-08T12:56:43.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22b3a14b80 1 -- 172.21.15.59:0/3237085270 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56467d45beb0 con 0x56467d53fe80 2023-10-08T12:56:43.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22817fa700 1 -- 172.21.15.59:0/3237085270 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f2294066dd0 con 0x56467d53fe80 2023-10-08T12:56:43.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22817fa700 1 -- 172.21.15.59:0/3237085270 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2294097780 con 0x56467d53fe80 2023-10-08T12:56:43.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22b3a14b80 10 client.17700 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:43.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22b3a14b80 1 -- 172.21.15.59:0/3237085270 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56467d2a7c60 con 0x56467d53fe80 2023-10-08T12:56:43.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22817fa700 1 -- 172.21.15.59:0/3237085270 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2294094080 con 0x56467d53fe80 2023-10-08T12:56:43.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22817fa700 1 -- 172.21.15.59:0/3237085270 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f229409b6a0 con 0x56467d53fe80 2023-10-08T12:56:43.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22b3a14b80 10 client.17700 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:43.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22b3a14b80 10 client.17700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:43.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22b3a14b80 20 client.17700 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:43.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56467d55ae30 0x56467d55d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22b3a14b80 4 client.17700 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:56:43.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.454+0000 7f22b3a14b80 1 -- 172.21.15.59:0/3237085270 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56467d48ce10 con 0x56467d55ae30 2023-10-08T12:56:43.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.455+0000 7f229d59a700 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56467d55ae30 0x56467d55d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.455+0000 7f229d59a700 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56467d55ae30 0x56467d55d220 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2b8aa3828a180f server_cookie=a45f3cd63fabcda7 in_seq=0 out_seq=0 2023-10-08T12:56:43.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.455+0000 7f22817fa700 10 client.17700 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:43.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22817fa700 1 -- 172.21.15.59:0/3237085270 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56467d48ce10 con 0x56467d55ae30 2023-10-08T12:56:43.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22817fa700 10 client.17700 handle_command_reply: tid=0 2023-10-08T12:56:43.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22b3a14b80 1 client.17700 shutdown 2023-10-08T12:56:43.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22b3a14b80 1 -- 172.21.15.59:0/3237085270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d53fe80 msgr2=0x56467d54b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:43.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d53fe80 0x56467d54b080 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2294006010 tx=0x7f229401feb0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22b3a14b80 1 -- 172.21.15.59:0/3237085270 shutdown_connections 2023-10-08T12:56:43.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56467d55ae30 0x56467d55d220 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d54b650 0x56467d548ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d53fe80 0x56467d54b080 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/3237085270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d548370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22817fa700 0 client.17700 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:43.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.457+0000 7f22b3a14b80 1 -- 172.21.15.59:0/3237085270 >> 172.21.15.59:0/3237085270 conn(0x56467d4b5260 msgr2=0x56467d53bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:43.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.458+0000 7f22b3a14b80 1 -- 172.21.15.59:0/3237085270 shutdown_connections 2023-10-08T12:56:43.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.458+0000 7f22b3a14b80 1 -- 172.21.15.59:0/3237085270 wait complete. 2023-10-08T12:56:43.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.458+0000 7f22b3a14b80 20 client.17700 trim_cache size 0 max 16384 2023-10-08T12:56:43.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.475+0000 7f22b3a14b80 1 Processor -- start 2023-10-08T12:56:43.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.475+0000 7f22b3a14b80 1 -- start start 2023-10-08T12:56:43.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.475+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.475+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d5521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.475+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d54b650 0x56467d54acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d314920 con 0x56467d54b650 2023-10-08T12:56:43.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d549970 con 0x56467d53fe80 2023-10-08T12:56:43.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d538ae0 con 0x56467d5407a0 2023-10-08T12:56:43.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229d59a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d5521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33268/0 (socket says 172.21.15.59:33268) 2023-10-08T12:56:43.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229d59a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d5521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58028/0 (socket says 172.21.15.59:58028) 2023-10-08T12:56:43.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229dd9b700 1 -- 172.21.15.59:0/261797310 learned_addr learned my addr 172.21.15.59:0/261797310 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:43.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229e59c700 1 --2- 172.21.15.59:0/261797310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d54b650 0x56467d54acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229dd9b700 1 -- 172.21.15.59:0/261797310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 msgr2=0x56467d5521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:43.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229dd9b700 1 --2- 172.21.15.59:0/261797310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d5521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229dd9b700 1 -- 172.21.15.59:0/261797310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d54b650 msgr2=0x56467d54acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:43.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229dd9b700 1 --2- 172.21.15.59:0/261797310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d54b650 0x56467d54acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229dd9b700 1 -- 172.21.15.59:0/261797310 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56467d2e5250 con 0x56467d53fe80 2023-10-08T12:56:43.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229d59a700 1 --2- 172.21.15.59:0/261797310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d5521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:43.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.476+0000 7f229dd9b700 1 --2- 172.21.15.59:0/261797310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2294005f50 tx=0x7f2294009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=227886faa3e9da91 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:43.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.477+0000 7f228cff9700 1 -- 172.21.15.59:0/261797310 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294066e10 con 0x56467d53fe80 2023-10-08T12:56:43.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.477+0000 7f228cff9700 1 -- 172.21.15.59:0/261797310 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56467d45beb0 con 0x56467d53fe80 2023-10-08T12:56:43.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.477+0000 7f228cff9700 1 -- 172.21.15.59:0/261797310 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229409f3c0 con 0x56467d53fe80 2023-10-08T12:56:43.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.477+0000 7f22b3a14b80 1 -- 172.21.15.59:0/261797310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 msgr2=0x56467d540260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:43.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.477+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/261797310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2294005f50 tx=0x7f2294009ca0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.477+0000 7f22b3a14b80 1 -- 172.21.15.59:0/261797310 shutdown_connections 2023-10-08T12:56:43.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.477+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/261797310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d540260 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.477+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/261797310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d54b650 0x56467d54acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.477+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/261797310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d5407a0 0x56467d5521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.477+0000 7f22b3a14b80 1 -- 172.21.15.59:0/261797310 >> 172.21.15.59:0/261797310 conn(0x56467d4b5260 msgr2=0x56467d53b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:43.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.478+0000 7f22b3a14b80 1 -- 172.21.15.59:0/261797310 shutdown_connections 2023-10-08T12:56:43.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.478+0000 7f22b3a14b80 1 -- 172.21.15.59:0/261797310 wait complete. 2023-10-08T12:56:43.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.478+0000 7f22b3a14b80 1 -- start start 2023-10-08T12:56:43.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.478+0000 7f22b3a14b80 1 Processor -- start 2023-10-08T12:56:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d552390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d5407a0 0x56467d550180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f22b3a14b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d54b650 0x56467d5508c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d550fd0 con 0x56467d5407a0 2023-10-08T12:56:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d5adbf0 con 0x56467d53fe80 2023-10-08T12:56:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f22b3a14b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467d5add30 con 0x56467d54b650 2023-10-08T12:56:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f22b3a14b80 10 client.0 _ll_register_callbacks cb 0x7f22940092d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f229dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d552390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f229e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d54b650 0x56467d5508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f229d59a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d5407a0 0x56467d550180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f229e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d54b650 0x56467d5508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58030/0 (socket says 172.21.15.59:58030) 2023-10-08T12:56:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f229dd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d552390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33278/0 (socket says 172.21.15.59:33278) 2023-10-08T12:56:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.479+0000 7f229e59c700 1 -- 172.21.15.59:0/560777456 learned_addr learned my addr 172.21.15.59:0/560777456 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.480+0000 7f229e59c700 1 -- 172.21.15.59:0/560777456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 msgr2=0x56467d552390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.480+0000 7f229e59c700 1 --2- 172.21.15.59:0/560777456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d552390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.480+0000 7f229e59c700 1 -- 172.21.15.59:0/560777456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d5407a0 msgr2=0x56467d550180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.480+0000 7f229e59c700 1 --2- 172.21.15.59:0/560777456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d5407a0 0x56467d550180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.480+0000 7f229e59c700 1 -- 172.21.15.59:0/560777456 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2288009c70 con 0x56467d54b650 2023-10-08T12:56:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.480+0000 7f229e59c700 1 --2- 172.21.15.59:0/560777456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d54b650 0x56467d5508c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2290011730 tx=0x7f2290028000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a3c04e34bda30d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.480+0000 7f22817fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:56:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22817fa700 1 -- 172.21.15.59:0/560777456 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229000e040 con 0x56467d54b650 2023-10-08T12:56:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22b3a14b80 1 -- 172.21.15.59:0/560777456 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2290027070 con 0x56467d54b650 2023-10-08T12:56:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22817fa700 1 -- 172.21.15.59:0/560777456 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f2290023450 con 0x56467d54b650 2023-10-08T12:56:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22817fa700 1 -- 172.21.15.59:0/560777456 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2290009270 con 0x56467d54b650 2023-10-08T12:56:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22b3a14b80 10 client.27724 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22b3a14b80 1 -- 172.21.15.59:0/560777456 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56467d2a7c60 con 0x56467d54b650 2023-10-08T12:56:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22817fa700 1 -- 172.21.15.59:0/560777456 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2290027070 con 0x56467d54b650 2023-10-08T12:56:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22817fa700 1 -- 172.21.15.59:0/560777456 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f229002d610 con 0x56467d54b650 2023-10-08T12:56:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22b3a14b80 10 client.27724 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22b3a14b80 10 client.27724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22b3a14b80 20 client.27724 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/560777456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56467d5af3d0 0x56467d5b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22b3a14b80 4 client.27724 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:56:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.481+0000 7f22b3a14b80 1 -- 172.21.15.59:0/560777456 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56467d48cb30 con 0x56467d5af3d0 2023-10-08T12:56:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.482+0000 7f229dd9b700 1 --2- 172.21.15.59:0/560777456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56467d5af3d0 0x56467d5b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.482+0000 7f229dd9b700 1 --2- 172.21.15.59:0/560777456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56467d5af3d0 0x56467d5b17f0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=848cd5906200bf21 server_cookie=8da6588991665116 in_seq=0 out_seq=0 2023-10-08T12:56:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.482+0000 7f22817fa700 10 client.27724 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:43.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22817fa700 1 -- 172.21.15.59:0/560777456 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56467d48cb30 con 0x56467d5af3d0 2023-10-08T12:56:43.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22817fa700 10 client.27724 handle_command_reply: tid=0 2023-10-08T12:56:43.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22b3a14b80 1 client.27724 shutdown 2023-10-08T12:56:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22b3a14b80 1 -- 172.21.15.59:0/560777456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d54b650 msgr2=0x56467d5508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/560777456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d54b650 0x56467d5508c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2290011730 tx=0x7f2290028000 comp rx=0 tx=0).stop 2023-10-08T12:56:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22b3a14b80 1 -- 172.21.15.59:0/560777456 shutdown_connections 2023-10-08T12:56:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/560777456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56467d5af3d0 0x56467d5b17f0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/560777456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56467d53fe80 0x56467d552390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/560777456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56467d54b650 0x56467d5508c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22b3a14b80 1 --2- 172.21.15.59:0/560777456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56467d5407a0 0x56467d550180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22817fa700 0 client.27724 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.485+0000 7f22b3a14b80 1 -- 172.21.15.59:0/560777456 >> 172.21.15.59:0/560777456 conn(0x56467d4b5260 msgr2=0x56467d5436f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.486+0000 7f22b3a14b80 1 -- 172.21.15.59:0/560777456 shutdown_connections 2023-10-08T12:56:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.486+0000 7f22b3a14b80 1 -- 172.21.15.59:0/560777456 wait complete. 2023-10-08T12:56:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.486+0000 7f22b3a14b80 20 client.27724 trim_cache size 0 max 16384 2023-10-08T12:56:43.492 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:56:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 -- 172.21.15.59:0/2037800405 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f22840a1670 msgr2=0x7f22840a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f22840a1670 0x7f22840a3b30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2290022000 tx=0x7f229001f000 comp rx=0 tx=0).stop 2023-10-08T12:56:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 -- 172.21.15.59:0/2037800405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2298100740 msgr2=0x7f229819c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2298100740 0x7f229819c890 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2294000c00 tx=0x7f2294005740 comp rx=0 tx=0).stop 2023-10-08T12:56:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 -- 172.21.15.59:0/2037800405 shutdown_connections 2023-10-08T12:56:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f22840a1670 0x7f22840a3b30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2298100740 0x7f229819c890 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2298106750 0x7f2298196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 --2- 172.21.15.59:0/2037800405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2298101100 0x7f229819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 -- 172.21.15.59:0/2037800405 >> 172.21.15.59:0/2037800405 conn(0x7f22980fc230 msgr2=0x7f22980fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 -- 172.21.15.59:0/2037800405 shutdown_connections 2023-10-08T12:56:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:43.487+0000 7f229ffff700 1 -- 172.21.15.59:0/2037800405 wait complete. 2023-10-08T12:56:43.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 53410 20.63 MB/sec execute 14 sec latency 178.163 ms 2023-10-08T12:56:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:44 smithi092 ceph-mon[134093]: pgmap v798: 97 pgs: 97 active+clean; 887 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.4 MiB/s wr, 359 op/s 2023-10-08T12:56:44.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:44 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1625740476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:56:44.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:44 smithi173 ceph-mon[135182]: pgmap v798: 97 pgs: 97 active+clean; 887 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.4 MiB/s wr, 359 op/s 2023-10-08T12:56:44.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:44 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1625740476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:56:44.509 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:56:44.509 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:56:44.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:44 smithi059 ceph-mon[98489]: pgmap v798: 97 pgs: 97 active+clean; 887 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.4 MiB/s wr, 359 op/s 2023-10-08T12:56:44.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:44 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1625740476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:56:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.734+0000 7f52db7ff700 1 -- 172.21.15.59:0/1590497903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d41051c0 msgr2=0x7f52d4105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.734+0000 7f52db7ff700 1 --2- 172.21.15.59:0/1590497903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d41051c0 0x7f52d4105640 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009990 tx=0x7f52c4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.734+0000 7f52db7ff700 1 -- 172.21.15.59:0/1590497903 shutdown_connections 2023-10-08T12:56:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.734+0000 7f52db7ff700 1 --2- 172.21.15.59:0/1590497903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d4105b80 0x7f52d410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.734+0000 7f52db7ff700 1 --2- 172.21.15.59:0/1590497903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d4067ce0 0x7f52d40680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.734+0000 7f52db7ff700 1 --2- 172.21.15.59:0/1590497903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d41051c0 0x7f52d4105640 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.734+0000 7f52db7ff700 1 -- 172.21.15.59:0/1590497903 >> 172.21.15.59:0/1590497903 conn(0x7f52d4076780 msgr2=0x7f52d4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:44.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.734+0000 7f52db7ff700 1 -- 172.21.15.59:0/1590497903 shutdown_connections 2023-10-08T12:56:44.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.734+0000 7f52db7ff700 1 -- 172.21.15.59:0/1590497903 wait complete. 2023-10-08T12:56:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.735+0000 7f52db7ff700 1 Processor -- start 2023-10-08T12:56:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.735+0000 7f52db7ff700 1 -- start start 2023-10-08T12:56:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.735+0000 7f52db7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d4067ce0 0x7f52d419c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.735+0000 7f52db7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d41051c0 0x7f52d419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.735+0000 7f52db7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d4105b80 0x7f52d4196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52db7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d41970f0 con 0x7f52d41051c0 2023-10-08T12:56:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52db7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d4197260 con 0x7f52d4067ce0 2023-10-08T12:56:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52db7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d4197420 con 0x7f52d4105b80 2023-10-08T12:56:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d959b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d4067ce0 0x7f52d419c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d959b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d4067ce0 0x7f52d419c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33282/0 (socket says 172.21.15.59:33282) 2023-10-08T12:56:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d959b700 1 -- 172.21.15.59:0/338448697 learned_addr learned my addr 172.21.15.59:0/338448697 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d41051c0 0x7f52d419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d9d9c700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d4105b80 0x7f52d4196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d959b700 1 -- 172.21.15.59:0/338448697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d4105b80 msgr2=0x7f52d4196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:44.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d959b700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d4105b80 0x7f52d4196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d959b700 1 -- 172.21.15.59:0/338448697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d41051c0 msgr2=0x7f52d419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:44.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d959b700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d41051c0 0x7f52d419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d959b700 1 -- 172.21.15.59:0/338448697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40095f0 con 0x7f52d4067ce0 2023-10-08T12:56:44.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d9d9c700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d4105b80 0x7f52d4196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:56:44.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d41051c0 0x7f52d419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:56:44.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.736+0000 7f52d959b700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d4067ce0 0x7f52d419c960 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f52d000e9a0 tx=0x7f52d000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:44.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.737+0000 7f52ca7fc700 1 -- 172.21.15.59:0/338448697 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0009790 con 0x7f52d4067ce0 2023-10-08T12:56:44.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.737+0000 7f52ca7fc700 1 -- 172.21.15.59:0/338448697 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52d000cbd0 con 0x7f52d4067ce0 2023-10-08T12:56:44.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.737+0000 7f52db7ff700 1 -- 172.21.15.59:0/338448697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d4197700 con 0x7f52d4067ce0 2023-10-08T12:56:44.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.737+0000 7f52ca7fc700 1 -- 172.21.15.59:0/338448697 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0018680 con 0x7f52d4067ce0 2023-10-08T12:56:44.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.737+0000 7f52db7ff700 1 -- 172.21.15.59:0/338448697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d41a3950 con 0x7f52d4067ce0 2023-10-08T12:56:44.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.740+0000 7f52ca7fc700 1 -- 172.21.15.59:0/338448697 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f52d000cd40 con 0x7f52d4067ce0 2023-10-08T12:56:44.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.741+0000 7f52ef1f4b80 1 Processor -- start 2023-10-08T12:56:44.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.742+0000 7f52ca7fc700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52c00a15f0 0x7f52c00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.742+0000 7f52ca7fc700 1 -- 172.21.15.59:0/338448697 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f52d0014070 con 0x7f52d4067ce0 2023-10-08T12:56:44.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.742+0000 7f52ef1f4b80 1 -- start start 2023-10-08T12:56:44.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.742+0000 7f52d9d9c700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52c00a15f0 0x7f52c00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.742+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ebf22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.742+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf2820 0x55da6ebfd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.742+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebfd6d0 0x55da6ebffac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.742+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6eb5b4e0 con 0x55da6ebfd6d0 2023-10-08T12:56:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.742+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6eb4cca0 con 0x55da6ebf1f00 2023-10-08T12:56:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.742+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6eb4a5c0 con 0x55da6ebf2820 2023-10-08T12:56:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d959b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ebf22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d959b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ebf22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33288/0 (socket says 172.21.15.59:33288) 2023-10-08T12:56:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d959b700 1 -- 172.21.15.59:0/4254035501 learned_addr learned my addr 172.21.15.59:0/4254035501 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/4254035501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf2820 0x55da6ebfd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d9d9c700 1 --2- 172.21.15.59:0/4254035501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebfd6d0 0x55da6ebffac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d8d9a700 1 -- 172.21.15.59:0/4254035501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 msgr2=0x55da6ebf22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/4254035501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ebf22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d8d9a700 1 -- 172.21.15.59:0/4254035501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebfd6d0 msgr2=0x55da6ebffac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/4254035501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebfd6d0 0x55da6ebffac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d9d9c700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52c00a15f0 0x7f52c00a3ab0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009410 tx=0x7f52cc009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d8d9a700 1 -- 172.21.15.59:0/4254035501 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da6e970e60 con 0x55da6ebf2820 2023-10-08T12:56:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.743+0000 7f52d959b700 1 --2- 172.21.15.59:0/4254035501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ebf22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.744+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/4254035501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf2820 0x55da6ebfd190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f52c40098e0 tx=0x7f52c4005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef5d27cadc4e2958 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.744+0000 7f52bf7fe700 1 -- 172.21.15.59:0/4254035501 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c40056a0 con 0x55da6ebf2820 2023-10-08T12:56:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.744+0000 7f52bf7fe700 1 -- 172.21.15.59:0/4254035501 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52c401e040 con 0x55da6ebf2820 2023-10-08T12:56:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.744+0000 7f52bf7fe700 1 -- 172.21.15.59:0/4254035501 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4004a40 con 0x55da6ebf2820 2023-10-08T12:56:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.745+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/4254035501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf2820 msgr2=0x55da6ebfd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.745+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/4254035501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf2820 0x55da6ebfd190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f52c40098e0 tx=0x7f52c4005c00 comp rx=0 tx=0).stop 2023-10-08T12:56:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.745+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/4254035501 shutdown_connections 2023-10-08T12:56:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.745+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/4254035501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ebf22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.745+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/4254035501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebfd6d0 0x55da6ebffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.745+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/4254035501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf2820 0x55da6ebfd190 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.745+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/4254035501 >> 172.21.15.59:0/4254035501 conn(0x55da6eb672e0 msgr2=0x55da6ebee350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:44.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.745+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/4254035501 shutdown_connections 2023-10-08T12:56:44.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.745+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/4254035501 wait complete. 2023-10-08T12:56:44.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.745+0000 7f52ef1f4b80 1 -- start start 2023-10-08T12:56:44.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.746+0000 7f52ef1f4b80 1 Processor -- start 2023-10-08T12:56:44.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf1f00 0x55da6ebfd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf2820 0x55da6ebfa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebfd6d0 0x55da6ebfa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6eb45eb0 con 0x55da6ebfd6d0 2023-10-08T12:56:44.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6eae2790 con 0x55da6ebf2820 2023-10-08T12:56:44.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6eae2430 con 0x55da6ebf1f00 2023-10-08T12:56:44.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52ef1f4b80 10 client.0 _ll_register_callbacks cb 0x55da6e93f880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52d8d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf2820 0x55da6ebfa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52d8d9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf2820 0x55da6ebfa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33304/0 (socket says 172.21.15.59:33304) 2023-10-08T12:56:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52d8d9a700 1 -- 172.21.15.59:0/633401874 learned_addr learned my addr 172.21.15.59:0/633401874 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52d959b700 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf1f00 0x55da6ebfd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52d9d9c700 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebfd6d0 0x55da6ebfa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52d959b700 1 -- 172.21.15.59:0/633401874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf2820 msgr2=0x55da6ebfa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52d959b700 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf2820 0x55da6ebfa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52d959b700 1 -- 172.21.15.59:0/633401874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebfd6d0 msgr2=0x55da6ebfa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52d959b700 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebfd6d0 0x55da6ebfa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52d959b700 1 -- 172.21.15.59:0/633401874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d41a3950 con 0x55da6ebf1f00 2023-10-08T12:56:44.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.747+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf2820 0x55da6ebfa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:44.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52d959b700 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf1f00 0x55da6ebfd080 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f52d000f010 tx=0x7f52d009ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae3fcabd0332118f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:44.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:56:44.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52bcff9700 1 -- 172.21.15.59:0/633401874 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d009e560 con 0x55da6ebf1f00 2023-10-08T12:56:44.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52bcff9700 1 -- 172.21.15.59:0/633401874 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f52d00a27a0 con 0x55da6ebf1f00 2023-10-08T12:56:44.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/633401874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da6eb0df30 con 0x55da6ebf1f00 2023-10-08T12:56:44.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52bcff9700 1 -- 172.21.15.59:0/633401874 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52d009e0d0 con 0x55da6ebf1f00 2023-10-08T12:56:44.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52ef1f4b80 10 client.27736 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:44.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/633401874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f52d410dec0 con 0x55da6ebf1f00 2023-10-08T12:56:44.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52bcff9700 1 -- 172.21.15.59:0/633401874 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55da6eb0df30 con 0x55da6ebf1f00 2023-10-08T12:56:44.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52bcff9700 1 -- 172.21.15.59:0/633401874 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f52d0099470 con 0x55da6ebf1f00 2023-10-08T12:56:44.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52ef1f4b80 10 client.27736 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:44.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52ef1f4b80 10 client.27736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:44.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.748+0000 7f52ef1f4b80 20 client.27736 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:44.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.749+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55da6ec02920 0x55da6ec02d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.749+0000 7f52ef1f4b80 4 client.27736 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:56:44.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.749+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/633401874 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da6eb3ee90 con 0x55da6ec02920 2023-10-08T12:56:44.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.749+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55da6ec02920 0x55da6ec02d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.749+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55da6ec02920 0x55da6ec02d00 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85fada14181d9ac1 server_cookie=ed52d1027ae877cb in_seq=0 out_seq=0 2023-10-08T12:56:44.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.749+0000 7f52bcff9700 10 client.27736 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:44.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52bcff9700 1 -- 172.21.15.59:0/633401874 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55da6eb3ee90 con 0x55da6ec02920 2023-10-08T12:56:44.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52bcff9700 10 client.27736 handle_command_reply: tid=0 2023-10-08T12:56:44.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 1 client.27736 shutdown 2023-10-08T12:56:44.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/633401874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf1f00 msgr2=0x55da6ebfd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:44.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf1f00 0x55da6ebfd080 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f52d000f010 tx=0x7f52d009ac00 comp rx=0 tx=0).stop 2023-10-08T12:56:44.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/633401874 shutdown_connections 2023-10-08T12:56:44.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55da6ec02920 0x55da6ec02d00 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebfd6d0 0x55da6ebfa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebf1f00 0x55da6ebfd080 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/633401874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf2820 0x55da6ebfa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52bcff9700 0 client.27736 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:44.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/633401874 >> 172.21.15.59:0/633401874 conn(0x55da6eb672e0 msgr2=0x55da6ebedf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:44.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/633401874 shutdown_connections 2023-10-08T12:56:44.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/633401874 wait complete. 2023-10-08T12:56:44.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.753+0000 7f52ef1f4b80 20 client.27736 trim_cache size 0 max 16384 2023-10-08T12:56:44.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.773+0000 7f52ef1f4b80 1 Processor -- start 2023-10-08T12:56:44.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.773+0000 7f52ef1f4b80 1 -- start start 2023-10-08T12:56:44.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec0d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebf2820 0x55da6ec03d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebfd6d0 0x55da6ec12ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6e9c69a0 con 0x55da6ebf2820 2023-10-08T12:56:44.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6ebf3150 con 0x55da6ebf1f00 2023-10-08T12:56:44.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6ec04280 con 0x55da6ebfd6d0 2023-10-08T12:56:44.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52d959b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec0d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52d959b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec0d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33320/0 (socket says 172.21.15.59:33320) 2023-10-08T12:56:44.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52d959b700 1 -- 172.21.15.59:0/606148606 learned_addr learned my addr 172.21.15.59:0/606148606 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:44.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/606148606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebf2820 0x55da6ec03d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52d9d9c700 1 --2- 172.21.15.59:0/606148606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebfd6d0 0x55da6ec12ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52d959b700 1 -- 172.21.15.59:0/606148606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebfd6d0 msgr2=0x55da6ec12ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:44.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52d959b700 1 --2- 172.21.15.59:0/606148606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebfd6d0 0x55da6ec12ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52d959b700 1 -- 172.21.15.59:0/606148606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebf2820 msgr2=0x55da6ec03d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:44.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.774+0000 7f52d959b700 1 --2- 172.21.15.59:0/606148606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebf2820 0x55da6ec03d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.775+0000 7f52d959b700 1 -- 172.21.15.59:0/606148606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da6e959ce0 con 0x55da6ebf1f00 2023-10-08T12:56:44.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.775+0000 7f52d959b700 1 --2- 172.21.15.59:0/606148606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec0d5f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f52d009a110 tx=0x7f52d0010b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=372c09f37bd336c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:44.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.775+0000 7f52bffff700 1 -- 172.21.15.59:0/606148606 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d00a27a0 con 0x55da6ebf1f00 2023-10-08T12:56:44.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.775+0000 7f52bffff700 1 -- 172.21.15.59:0/606148606 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52d009e560 con 0x55da6ebf1f00 2023-10-08T12:56:44.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.775+0000 7f52bffff700 1 -- 172.21.15.59:0/606148606 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d00a2310 con 0x55da6ebf1f00 2023-10-08T12:56:44.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.776+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/606148606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 msgr2=0x55da6ec0d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:44.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.776+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/606148606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec0d5f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f52d009a110 tx=0x7f52d0010b50 comp rx=0 tx=0).stop 2023-10-08T12:56:44.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.776+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/606148606 shutdown_connections 2023-10-08T12:56:44.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.776+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/606148606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec0d5f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.776+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/606148606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebfd6d0 0x55da6ec12ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.776+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/606148606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebf2820 0x55da6ec03d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.776+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/606148606 >> 172.21.15.59:0/606148606 conn(0x55da6eb672e0 msgr2=0x55da6ec03630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:44.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.776+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/606148606 shutdown_connections 2023-10-08T12:56:44.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.776+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/606148606 wait complete. 2023-10-08T12:56:44.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.776+0000 7f52ef1f4b80 1 -- start start 2023-10-08T12:56:44.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52ef1f4b80 1 Processor -- start 2023-10-08T12:56:44.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec10c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebf2820 0x55da6ec11190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52ef1f4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebfd6d0 0x55da6ec60e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6ec11aa0 con 0x55da6ebf2820 2023-10-08T12:56:44.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6ec613a0 con 0x55da6ebf1f00 2023-10-08T12:56:44.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52ef1f4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6ec614e0 con 0x55da6ebfd6d0 2023-10-08T12:56:44.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52ef1f4b80 10 client.0 _ll_register_callbacks cb 0x7f52d0099e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:44.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52d959b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec10c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52d959b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec10c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33330/0 (socket says 172.21.15.59:33330) 2023-10-08T12:56:44.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52d959b700 1 -- 172.21.15.59:0/3202265667 learned_addr learned my addr 172.21.15.59:0/3202265667 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:44.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.777+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebf2820 0x55da6ec11190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52d9d9c700 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebfd6d0 0x55da6ec60e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52d959b700 1 -- 172.21.15.59:0/3202265667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebfd6d0 msgr2=0x55da6ec60e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:44.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52d959b700 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebfd6d0 0x55da6ec60e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52d959b700 1 -- 172.21.15.59:0/3202265667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebf2820 msgr2=0x55da6ec11190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:44.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52d959b700 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebf2820 0x55da6ec11190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52d959b700 1 -- 172.21.15.59:0/3202265667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d410dec0 con 0x55da6ebf1f00 2023-10-08T12:56:44.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52d959b700 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec10c50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f52d00cd3b0 tx=0x7f52d009ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa3648d81afbaae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:44.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:56:44.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52bcff9700 1 -- 172.21.15.59:0/3202265667 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d00a2510 con 0x55da6ebf1f00 2023-10-08T12:56:44.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52bcff9700 1 -- 172.21.15.59:0/3202265667 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f52d0061030 con 0x55da6ebf1f00 2023-10-08T12:56:44.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/3202265667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f52c401e040 con 0x55da6ebf1f00 2023-10-08T12:56:44.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52bcff9700 1 -- 172.21.15.59:0/3202265667 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52d00a27a0 con 0x55da6ebf1f00 2023-10-08T12:56:44.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52ef1f4b80 10 client.27746 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:44.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.778+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/3202265667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55da6e9972d0 con 0x55da6ebf1f00 2023-10-08T12:56:44.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.779+0000 7f52bcff9700 1 -- 172.21.15.59:0/3202265667 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52c401e040 con 0x55da6ebf1f00 2023-10-08T12:56:44.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.779+0000 7f52bcff9700 1 -- 172.21.15.59:0/3202265667 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f52d00b82b0 con 0x55da6ebf1f00 2023-10-08T12:56:44.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.779+0000 7f52ef1f4b80 10 client.27746 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.779+0000 7f52ef1f4b80 10 client.27746 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.779+0000 7f52ef1f4b80 20 client.27746 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.779+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55da6ec62810 0x55da6ec64c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.779+0000 7f52ef1f4b80 4 client.27746 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:56:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.779+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/3202265667 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55da6eb3ebb0 con 0x55da6ec62810 2023-10-08T12:56:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.779+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55da6ec62810 0x55da6ec64c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.780+0000 7f52d8d9a700 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55da6ec62810 0x55da6ec64c00 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=959571cf36727976 server_cookie=2faf396e730ad9a7 in_seq=0 out_seq=0 2023-10-08T12:56:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.780+0000 7f52bcff9700 10 client.27746 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:44.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52bcff9700 1 -- 172.21.15.59:0/3202265667 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55da6eb3ebb0 con 0x55da6ec62810 2023-10-08T12:56:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52bcff9700 10 client.27746 handle_command_reply: tid=0 2023-10-08T12:56:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52ef1f4b80 1 client.27746 shutdown 2023-10-08T12:56:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/3202265667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 msgr2=0x55da6ec10c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec10c50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f52d00cd3b0 tx=0x7f52d009ac80 comp rx=0 tx=0).stop 2023-10-08T12:56:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/3202265667 shutdown_connections 2023-10-08T12:56:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55da6ec62810 0x55da6ec64c00 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55da6ebf1f00 0x55da6ec10c50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da6ebfd6d0 0x55da6ec60e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52bcff9700 0 client.27746 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52ef1f4b80 1 --2- 172.21.15.59:0/3202265667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6ebf2820 0x55da6ec11190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/3202265667 >> 172.21.15.59:0/3202265667 conn(0x55da6eb672e0 msgr2=0x55da6ebf3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.782+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/3202265667 shutdown_connections 2023-10-08T12:56:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52ef1f4b80 1 -- 172.21.15.59:0/3202265667 wait complete. 2023-10-08T12:56:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52ef1f4b80 20 client.27746 trim_cache size 0 max 16384 2023-10-08T12:56:44.791 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:56:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:56:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "95f7e23a-5195-4d09-aec5-64d322dfb6a1", 2023-10-08T12:56:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:56:44.792 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:56:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52db7ff700 1 -- 172.21.15.59:0/338448697 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52c00a15f0 msgr2=0x7f52c00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52db7ff700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52c00a15f0 0x7f52c00a3ab0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009410 tx=0x7f52cc009920 comp rx=0 tx=0).stop 2023-10-08T12:56:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52db7ff700 1 -- 172.21.15.59:0/338448697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d4067ce0 msgr2=0x7f52d419c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52db7ff700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d4067ce0 0x7f52d419c960 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f52d000e9a0 tx=0x7f52d000ed60 comp rx=0 tx=0).stop 2023-10-08T12:56:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52db7ff700 1 -- 172.21.15.59:0/338448697 shutdown_connections 2023-10-08T12:56:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52db7ff700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f52c00a15f0 0x7f52c00a3ab0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52db7ff700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d4067ce0 0x7f52d419c960 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52db7ff700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d4105b80 0x7f52d4196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52db7ff700 1 --2- 172.21.15.59:0/338448697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d41051c0 0x7f52d419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.783+0000 7f52db7ff700 1 -- 172.21.15.59:0/338448697 >> 172.21.15.59:0/338448697 conn(0x7f52d4076780 msgr2=0x7f52d40fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.784+0000 7f52db7ff700 1 -- 172.21.15.59:0/338448697 shutdown_connections 2023-10-08T12:56:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:44.784+0000 7f52db7ff700 1 -- 172.21.15.59:0/338448697 wait complete. 2023-10-08T12:56:44.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:56:44.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 53887 21.43 MB/sec execute 15 sec latency 224.589 ms 2023-10-08T12:56:45.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.077+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1247418179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39f0100590 msgr2=0x7f39f0100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.077+0000 7f39f4f9d700 1 --2- 172.21.15.59:0/1247418179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39f0100590 0x7f39f0100a10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009920 tx=0x7f39e4009c30 comp rx=0 tx=0).stop 2023-10-08T12:56:45.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.077+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1247418179 shutdown_connections 2023-10-08T12:56:45.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.077+0000 7f39f4f9d700 1 --2- 172.21.15.59:0/1247418179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39f0100f50 0x7f39f010d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.077+0000 7f39f4f9d700 1 --2- 172.21.15.59:0/1247418179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0106650 0x7f39f0106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.077+0000 7f39f4f9d700 1 --2- 172.21.15.59:0/1247418179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39f0100590 0x7f39f0100a10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.077+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1247418179 >> 172.21.15.59:0/1247418179 conn(0x7f39f00fc060 msgr2=0x7f39f00fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.077+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1247418179 shutdown_connections 2023-10-08T12:56:45.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.077+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1247418179 wait complete. 2023-10-08T12:56:45.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.078+0000 7f39f4f9d700 1 Processor -- start 2023-10-08T12:56:45.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39f4f9d700 1 -- start start 2023-10-08T12:56:45.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39f4f9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0100590 0x7f39f0198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39f4f9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39f0100f50 0x7f39f0199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39f4f9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39f0106650 0x7f39f019c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39f4f9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f019cb30 con 0x7f39f0100590 2023-10-08T12:56:45.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39f4f9d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f019cca0 con 0x7f39f0106650 2023-10-08T12:56:45.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39f4f9d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f019ce60 con 0x7f39f0100f50 2023-10-08T12:56:45.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39ef7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0100590 0x7f39f0198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39eeffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39f0100f50 0x7f39f0199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39effff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39f0106650 0x7f39f019c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39effff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39f0106650 0x7f39f019c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33356/0 (socket says 172.21.15.59:33356) 2023-10-08T12:56:45.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39eeffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39f0100f50 0x7f39f0199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58112/0 (socket says 172.21.15.59:58112) 2023-10-08T12:56:45.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.079+0000 7f39effff700 1 -- 172.21.15.59:0/1990600042 learned_addr learned my addr 172.21.15.59:0/1990600042 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:45.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.080+0000 7f39eeffd700 1 -- 172.21.15.59:0/1990600042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39f0106650 msgr2=0x7f39f019c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.080+0000 7f39eeffd700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39f0106650 0x7f39f019c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.080+0000 7f39eeffd700 1 -- 172.21.15.59:0/1990600042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0100590 msgr2=0x7f39f0198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.080+0000 7f39eeffd700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0100590 0x7f39f0198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.080+0000 7f39eeffd700 1 -- 172.21.15.59:0/1990600042 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e00095f0 con 0x7f39f0100f50 2023-10-08T12:56:45.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.080+0000 7f39eeffd700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39f0100f50 0x7f39f0199240 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f39e4000c00 tx=0x7f39e400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.080+0000 7f39ecff9700 1 -- 172.21.15.59:0/1990600042 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e401c070 con 0x7f39f0100f50 2023-10-08T12:56:45.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.080+0000 7f39ecff9700 1 -- 172.21.15.59:0/1990600042 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39e400ba20 con 0x7f39f0100f50 2023-10-08T12:56:45.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.080+0000 7f39ecff9700 1 -- 172.21.15.59:0/1990600042 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4004930 con 0x7f39f0100f50 2023-10-08T12:56:45.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.080+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1990600042 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e4009520 con 0x7f39f0100f50 2023-10-08T12:56:45.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.081+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1990600042 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f019d320 con 0x7f39f0100f50 2023-10-08T12:56:45.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.085+0000 7f39ecff9700 1 -- 172.21.15.59:0/1990600042 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f39e4020070 con 0x7f39f0100f50 2023-10-08T12:56:45.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.086+0000 7f3a09a40b80 1 Processor -- start 2023-10-08T12:56:45.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.086+0000 7f3a09a40b80 1 -- start start 2023-10-08T12:56:45.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39ecff9700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f39d80a1670 0x7f39d80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250050 0x56157d250430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 0x56157d25b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d25b800 0x56157d25dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d1b9460 con 0x56157d250970 2023-10-08T12:56:45.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d1aac20 con 0x56157d250050 2023-10-08T12:56:45.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d1a8540 con 0x56157d25b800 2023-10-08T12:56:45.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39ecff9700 1 -- 172.21.15.59:0/1990600042 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f39e40cda90 con 0x7f39f0100f50 2023-10-08T12:56:45.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39ef7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250050 0x56157d250430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39ef7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250050 0x56157d250430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33370/0 (socket says 172.21.15.59:33370) 2023-10-08T12:56:45.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39effff700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f39d80a1670 0x7f39d80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39ef7fe700 1 -- 172.21.15.59:0/3717595115 learned_addr learned my addr 172.21.15.59:0/3717595115 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:45.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39eeffd700 1 --2- 172.21.15.59:0/3717595115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 0x56157d25b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39effff700 1 --2- 172.21.15.59:0/3717595115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d25b800 0x56157d25dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39ef7fe700 1 -- 172.21.15.59:0/3717595115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d25b800 msgr2=0x56157d25dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39ef7fe700 1 --2- 172.21.15.59:0/3717595115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d25b800 0x56157d25dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39ef7fe700 1 -- 172.21.15.59:0/3717595115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 msgr2=0x56157d25b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39ef7fe700 1 --2- 172.21.15.59:0/3717595115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 0x56157d25b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39ef7fe700 1 -- 172.21.15.59:0/3717595115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56157cfcede0 con 0x56157d250050 2023-10-08T12:56:45.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.087+0000 7f39eeffd700 1 --2- 172.21.15.59:0/3717595115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 0x56157d25b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:56:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.088+0000 7f39ef7fe700 1 --2- 172.21.15.59:0/3717595115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250050 0x56157d250430 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009f40 tx=0x7f39e0011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0504b3b0db7b219 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.088+0000 7f39effff700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f39d80a1670 0x7f39d80a3b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009d30 tx=0x7f39e8009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.088+0000 7f39d5ffb700 1 -- 172.21.15.59:0/3717595115 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0004310 con 0x56157d250050 2023-10-08T12:56:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.088+0000 7f39d5ffb700 1 -- 172.21.15.59:0/3717595115 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39e0004470 con 0x56157d250050 2023-10-08T12:56:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.088+0000 7f39d5ffb700 1 -- 172.21.15.59:0/3717595115 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0019910 con 0x56157d250050 2023-10-08T12:56:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.089+0000 7f3a09a40b80 1 -- 172.21.15.59:0/3717595115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250050 msgr2=0x56157d250430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.089+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/3717595115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250050 0x56157d250430 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009f40 tx=0x7f39e0011720 comp rx=0 tx=0).stop 2023-10-08T12:56:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.089+0000 7f3a09a40b80 1 -- 172.21.15.59:0/3717595115 shutdown_connections 2023-10-08T12:56:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.089+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/3717595115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250050 0x56157d250430 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.089+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/3717595115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d25b800 0x56157d25dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.089+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/3717595115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 0x56157d25b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.089+0000 7f3a09a40b80 1 -- 172.21.15.59:0/3717595115 >> 172.21.15.59:0/3717595115 conn(0x56157d1c5260 msgr2=0x56157d24c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.089+0000 7f3a09a40b80 1 -- 172.21.15.59:0/3717595115 shutdown_connections 2023-10-08T12:56:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.089+0000 7f3a09a40b80 1 -- 172.21.15.59:0/3717595115 wait complete. 2023-10-08T12:56:45.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.090+0000 7f3a09a40b80 1 -- start start 2023-10-08T12:56:45.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.090+0000 7f3a09a40b80 1 Processor -- start 2023-10-08T12:56:45.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.090+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 0x56157d25b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.090+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 0x56157d2584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.090+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d25b800 0x56157d258b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d1a3e30 con 0x56157d25b800 2023-10-08T12:56:45.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d140710 con 0x56157d250970 2023-10-08T12:56:45.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d1403b0 con 0x56157d250050 2023-10-08T12:56:45.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f3a09a40b80 10 client.0 _ll_register_callbacks cb 0x56157cf9d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:45.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 0x56157d2584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 0x56157d2584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33380/0 (socket says 172.21.15.59:33380) 2023-10-08T12:56:45.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39eeffd700 1 -- 172.21.15.59:0/1949599829 learned_addr learned my addr 172.21.15.59:0/1949599829 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:45.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39effff700 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d25b800 0x56157d258b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39ef7fe700 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 0x56157d25b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39eeffd700 1 -- 172.21.15.59:0/1949599829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 msgr2=0x56157d25b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39eeffd700 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 0x56157d25b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39eeffd700 1 -- 172.21.15.59:0/1949599829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d25b800 msgr2=0x56157d258b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39eeffd700 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d25b800 0x56157d258b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39eeffd700 1 -- 172.21.15.59:0/1949599829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e0009ba0 con 0x56157d250970 2023-10-08T12:56:45.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39ef7fe700 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 0x56157d25b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:56:45.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39effff700 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d25b800 0x56157d258b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:56:45.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39eeffd700 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 0x56157d2584f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f39e409a850 tx=0x7f39e409a7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b53e261d31a0133 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.091+0000 7f39ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:56:45.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f39ceffd700 1 -- 172.21.15.59:0/1949599829 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4005240 con 0x56157d250970 2023-10-08T12:56:45.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f3a09a40b80 1 -- 172.21.15.59:0/1949599829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56157d16beb0 con 0x56157d250970 2023-10-08T12:56:45.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f39ceffd700 1 -- 172.21.15.59:0/1949599829 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f39e409ab50 con 0x56157d250970 2023-10-08T12:56:45.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f39ceffd700 1 -- 172.21.15.59:0/1949599829 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39e409eca0 con 0x56157d250970 2023-10-08T12:56:45.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f3a09a40b80 10 client.27758 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:45.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f3a09a40b80 1 -- 172.21.15.59:0/1949599829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56157cfb7c60 con 0x56157d250970 2023-10-08T12:56:45.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f39ceffd700 1 -- 172.21.15.59:0/1949599829 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56157d16beb0 con 0x56157d250970 2023-10-08T12:56:45.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f39ceffd700 1 -- 172.21.15.59:0/1949599829 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f39e409a040 con 0x56157d250970 2023-10-08T12:56:45.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f3a09a40b80 10 client.27758 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:45.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f3a09a40b80 10 client.27758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:45.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f3a09a40b80 20 client.27758 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:45.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56157d26aec0 0x56157d26d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f3a09a40b80 4 client.27758 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:56:45.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.092+0000 7f3a09a40b80 1 -- 172.21.15.59:0/1949599829 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56157d19ce10 con 0x56157d26aec0 2023-10-08T12:56:45.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.093+0000 7f39ef7fe700 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56157d26aec0 0x56157d26d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.093+0000 7f39ef7fe700 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56157d26aec0 0x56157d26d2e0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95e055b51eb6ca99 server_cookie=68daf17cd8de3749 in_seq=0 out_seq=0 2023-10-08T12:56:45.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.093+0000 7f39ceffd700 10 client.27758 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:45.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f39ceffd700 1 -- 172.21.15.59:0/1949599829 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56157d19ce10 con 0x56157d26aec0 2023-10-08T12:56:45.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f39ceffd700 10 client.27758 handle_command_reply: tid=0 2023-10-08T12:56:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f3a09a40b80 1 client.27758 shutdown 2023-10-08T12:56:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f3a09a40b80 1 -- 172.21.15.59:0/1949599829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 msgr2=0x56157d2584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 0x56157d2584f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f39e409a850 tx=0x7f39e409a7c0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f3a09a40b80 1 -- 172.21.15.59:0/1949599829 shutdown_connections 2023-10-08T12:56:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56157d26aec0 0x56157d26d2e0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d25b800 0x56157d258b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 0x56157d25b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/1949599829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 0x56157d2584f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f39ceffd700 0 client.27758 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:45.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.098+0000 7f3a09a40b80 1 -- 172.21.15.59:0/1949599829 >> 172.21.15.59:0/1949599829 conn(0x56157d1c5260 msgr2=0x56157d2520f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.099+0000 7f3a09a40b80 1 -- 172.21.15.59:0/1949599829 shutdown_connections 2023-10-08T12:56:45.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.099+0000 7f3a09a40b80 1 -- 172.21.15.59:0/1949599829 wait complete. 2023-10-08T12:56:45.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.099+0000 7f3a09a40b80 20 client.27758 trim_cache size 0 max 16384 2023-10-08T12:56:45.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.120+0000 7f3a09a40b80 1 Processor -- start 2023-10-08T12:56:45.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.120+0000 7f3a09a40b80 1 -- start start 2023-10-08T12:56:45.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.120+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250050 0x56157d2584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.120+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 0x56157d262320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.120+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d25b800 0x56157d256dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.120+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d024920 con 0x56157d250050 2023-10-08T12:56:45.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.120+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d19ce10 con 0x56157d250970 2023-10-08T12:56:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.120+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d251f00 con 0x56157d25b800 2023-10-08T12:56:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.120+0000 7f39ef7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250050 0x56157d2584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.121+0000 7f39ef7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250050 0x56157d2584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53610/0 (socket says 172.21.15.59:53610) 2023-10-08T12:56:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.121+0000 7f39eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 0x56157d262320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.121+0000 7f39ef7fe700 1 -- 172.21.15.59:0/2978288088 learned_addr learned my addr 172.21.15.59:0/2978288088 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.121+0000 7f39effff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d25b800 0x56157d256dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.121+0000 7f39eeffd700 1 -- 172.21.15.59:0/2978288088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d25b800 msgr2=0x56157d256dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.121+0000 7f39eeffd700 1 --2- 172.21.15.59:0/2978288088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d25b800 0x56157d256dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.121+0000 7f39eeffd700 1 -- 172.21.15.59:0/2978288088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250050 msgr2=0x56157d2584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.121+0000 7f39eeffd700 1 --2- 172.21.15.59:0/2978288088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250050 0x56157d2584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.121+0000 7f39eeffd700 1 -- 172.21.15.59:0/2978288088 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56157cff5250 con 0x56157d250970 2023-10-08T12:56:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.121+0000 7f39eeffd700 1 --2- 172.21.15.59:0/2978288088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 0x56157d262320 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f39e40cb2e0 tx=0x7f39e4099100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76dfe7e8f09b988 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.121+0000 7f39d67fc700 1 -- 172.21.15.59:0/2978288088 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e409ab50 con 0x56157d250970 2023-10-08T12:56:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.122+0000 7f39d67fc700 1 -- 172.21.15.59:0/2978288088 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39e409eca0 con 0x56157d250970 2023-10-08T12:56:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.122+0000 7f39d67fc700 1 -- 172.21.15.59:0/2978288088 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e409b010 con 0x56157d250970 2023-10-08T12:56:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.122+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2978288088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 msgr2=0x56157d262320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.122+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/2978288088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 0x56157d262320 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f39e40cb2e0 tx=0x7f39e4099100 comp rx=0 tx=0).stop 2023-10-08T12:56:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.122+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2978288088 shutdown_connections 2023-10-08T12:56:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.122+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/2978288088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d25b800 0x56157d256dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.122+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/2978288088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250050 0x56157d2584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.122+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/2978288088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d250970 0x56157d262320 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.122+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2978288088 >> 172.21.15.59:0/2978288088 conn(0x56157d1c5260 msgr2=0x56157d2537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.123+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2978288088 shutdown_connections 2023-10-08T12:56:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.123+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2978288088 wait complete. 2023-10-08T12:56:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.123+0000 7f3a09a40b80 1 -- start start 2023-10-08T12:56:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.123+0000 7f3a09a40b80 1 Processor -- start 2023-10-08T12:56:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 0x56157d260200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 0x56157d260740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f3a09a40b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d25b800 0x56157d2bdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d2be230 con 0x56157d250970 2023-10-08T12:56:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d2be370 con 0x56157d25b800 2023-10-08T12:56:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f3a09a40b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157d2be4b0 con 0x56157d250050 2023-10-08T12:56:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f3a09a40b80 10 client.0 _ll_register_callbacks cb 0x56157cf9d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f39eeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 0x56157d260740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f39effff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d25b800 0x56157d2bdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f39effff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d25b800 0x56157d2bdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:33404/0 (socket says 172.21.15.59:33404) 2023-10-08T12:56:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f39effff700 1 -- 172.21.15.59:0/2219708288 learned_addr learned my addr 172.21.15.59:0/2219708288 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:56:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f39ef7fe700 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 0x56157d260200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f39effff700 1 -- 172.21.15.59:0/2219708288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 msgr2=0x56157d260200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f39effff700 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 0x56157d260200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f39effff700 1 -- 172.21.15.59:0/2219708288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 msgr2=0x56157d260740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.124+0000 7f39effff700 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 0x56157d260740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.125+0000 7f39effff700 1 -- 172.21.15.59:0/2219708288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56157cfb7c60 con 0x56157d25b800 2023-10-08T12:56:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.125+0000 7f39ef7fe700 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 0x56157d260200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.125+0000 7f39eeffd700 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 0x56157d260740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.125+0000 7f39effff700 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d25b800 0x56157d2bdcf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f39e8018e50 tx=0x7f39e800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=858bc836a1de17c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.125+0000 7f39ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:56:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.125+0000 7f39ceffd700 1 -- 172.21.15.59:0/2219708288 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e800e040 con 0x56157d25b800 2023-10-08T12:56:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.125+0000 7f39ceffd700 1 -- 172.21.15.59:0/2219708288 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f39e801f040 con 0x56157d25b800 2023-10-08T12:56:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.125+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2219708288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39e0004470 con 0x56157d25b800 2023-10-08T12:56:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.125+0000 7f39ceffd700 1 -- 172.21.15.59:0/2219708288 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39e8018e80 con 0x56157d25b800 2023-10-08T12:56:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.125+0000 7f3a09a40b80 10 client.27764 fetch_fsmap learned FSMap version 20 2023-10-08T12:56:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.125+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2219708288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56157cfcd2b0 con 0x56157d25b800 2023-10-08T12:56:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.126+0000 7f39ceffd700 1 -- 172.21.15.59:0/2219708288 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39e0004470 con 0x56157d25b800 2023-10-08T12:56:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.126+0000 7f39ceffd700 1 -- 172.21.15.59:0/2219708288 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f39e8038480 con 0x56157d25b800 2023-10-08T12:56:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.126+0000 7f3a09a40b80 10 client.27764 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:56:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.126+0000 7f3a09a40b80 10 client.27764 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.126+0000 7f3a09a40b80 20 client.27764 populate_metadata read hostname 'smithi059' 2023-10-08T12:56:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.126+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56157d2bfd20 0x56157d2c2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.126+0000 7f3a09a40b80 4 client.27764 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:56:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.126+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2219708288 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56157d19cb30 con 0x56157d2bfd20 2023-10-08T12:56:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.126+0000 7f39ef7fe700 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56157d2bfd20 0x56157d2c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.126+0000 7f39ef7fe700 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56157d2bfd20 0x56157d2c2140 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57edc79597de9281 server_cookie=ccdbb45da4d15e26 in_seq=0 out_seq=0 2023-10-08T12:56:45.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.126+0000 7f39ceffd700 10 client.27764 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:45.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f39ceffd700 1 -- 172.21.15.59:0/2219708288 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x56157d19cb30 con 0x56157d2bfd20 2023-10-08T12:56:45.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f39ceffd700 10 client.27764 handle_command_reply: tid=0 2023-10-08T12:56:45.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f3a09a40b80 1 client.27764 shutdown 2023-10-08T12:56:45.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2219708288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d25b800 msgr2=0x56157d2bdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d25b800 0x56157d2bdcf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f39e8018e50 tx=0x7f39e800b040 comp rx=0 tx=0).stop 2023-10-08T12:56:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2219708288 shutdown_connections 2023-10-08T12:56:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56157d2bfd20 0x56157d2c2140 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56157d25b800 0x56157d2bdcf0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56157d250050 0x56157d260200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f3a09a40b80 1 --2- 172.21.15.59:0/2219708288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56157d250970 0x56157d260740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2219708288 >> 172.21.15.59:0/2219708288 conn(0x56157d1c5260 msgr2=0x56157d24bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.131+0000 7f39ceffd700 0 client.27764 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:56:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.132+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2219708288 shutdown_connections 2023-10-08T12:56:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.132+0000 7f3a09a40b80 1 -- 172.21.15.59:0/2219708288 wait complete. 2023-10-08T12:56:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.132+0000 7f3a09a40b80 20 client.27764 trim_cache size 0 max 16384 2023-10-08T12:56:45.137 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:56:45.137 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "scrub active (536 inodes in the stack)", 2023-10-08T12:56:45.137 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:56:45.137 INFO:teuthology.orchestra.run.smithi059.stdout: "95f7e23a-5195-4d09-aec5-64d322dfb6a1": { 2023-10-08T12:56:45.137 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:56:45.137 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "95f7e23a-5195-4d09-aec5-64d322dfb6a1", 2023-10-08T12:56:45.138 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:56:45.138 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:56:45.138 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:56:45.138 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:56:45.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.132+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1990600042 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f39d80a1670 msgr2=0x7f39d80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.132+0000 7f39f4f9d700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f39d80a1670 0x7f39d80a3b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009d30 tx=0x7f39e8009920 comp rx=0 tx=0).stop 2023-10-08T12:56:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.132+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1990600042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39f0100f50 msgr2=0x7f39f0199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.132+0000 7f39f4f9d700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39f0100f50 0x7f39f0199240 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f39e4000c00 tx=0x7f39e400fa00 comp rx=0 tx=0).stop 2023-10-08T12:56:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.133+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1990600042 shutdown_connections 2023-10-08T12:56:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.133+0000 7f39f4f9d700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f39d80a1670 0x7f39d80a3b30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.133+0000 7f39f4f9d700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39f0106650 0x7f39f019c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.133+0000 7f39f4f9d700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0100590 0x7f39f0198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.133+0000 7f39f4f9d700 1 --2- 172.21.15.59:0/1990600042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39f0100f50 0x7f39f0199240 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.133+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1990600042 >> 172.21.15.59:0/1990600042 conn(0x7f39f00fc060 msgr2=0x7f39f00fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.133+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1990600042 shutdown_connections 2023-10-08T12:56:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:56:45.133+0000 7f39f4f9d700 1 -- 172.21.15.59:0/1990600042 wait complete. 2023-10-08T12:56:45.153 INFO:tasks.cephfs.filesystem:scrub status for tag:95f7e23a-5195-4d09-aec5-64d322dfb6a1 - {'path': '/', 'tag': '95f7e23a-5195-4d09-aec5-64d322dfb6a1', 'options': 'recursive,force'} 2023-10-08T12:56:45.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:45 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:56:45.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:45 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:45.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:45 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:56:45.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:45 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:56:45.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:45 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:45.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:45 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:56:45.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:45 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:56:45.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:45 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:45.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:45 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:56:45.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 54227 21.50 MB/sec execute 16 sec latency 163.282 ms 2023-10-08T12:56:46.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:46 smithi092 ceph-mon[134093]: pgmap v799: 97 pgs: 97 active+clean; 887 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.0 MiB/s wr, 316 op/s 2023-10-08T12:56:46.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:46 smithi173 ceph-mon[135182]: pgmap v799: 97 pgs: 97 active+clean; 887 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.0 MiB/s wr, 316 op/s 2023-10-08T12:56:46.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:46 smithi059 ceph-mon[98489]: pgmap v799: 97 pgs: 97 active+clean; 887 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.0 MiB/s wr, 316 op/s 2023-10-08T12:56:46.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 54499 21.04 MB/sec execute 17 sec latency 154.239 ms 2023-10-08T12:56:47.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:47 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:47.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:47 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:47.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:47 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:56:47.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 54820 20.73 MB/sec execute 18 sec latency 61.133 ms 2023-10-08T12:56:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:48 smithi092 ceph-mon[134093]: pgmap v800: 97 pgs: 97 active+clean; 886 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.0 MiB/s wr, 317 op/s 2023-10-08T12:56:48.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:48 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:56:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:48 smithi173 ceph-mon[135182]: pgmap v800: 97 pgs: 97 active+clean; 886 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.0 MiB/s wr, 317 op/s 2023-10-08T12:56:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:48 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:56:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:48 smithi059 ceph-mon[98489]: pgmap v800: 97 pgs: 97 active+clean; 886 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.0 MiB/s wr, 317 op/s 2023-10-08T12:56:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:48 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:56:48.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 55150 20.41 MB/sec execute 19 sec latency 155.898 ms 2023-10-08T12:56:49.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 55549 20.83 MB/sec execute 20 sec latency 176.963 ms 2023-10-08T12:56:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:49 smithi173 ceph-mon[135182]: pgmap v801: 97 pgs: 97 active+clean; 900 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 7.6 MiB/s wr, 360 op/s 2023-10-08T12:56:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:49 smithi059 ceph-mon[98489]: pgmap v801: 97 pgs: 97 active+clean; 900 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 7.6 MiB/s wr, 360 op/s 2023-10-08T12:56:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:49 smithi092 ceph-mon[134093]: pgmap v801: 97 pgs: 97 active+clean; 900 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 7.6 MiB/s wr, 360 op/s 2023-10-08T12:56:50.947 INFO:tasks.workunit.client.0.smithi059.stdout: 10 56038 20.52 MB/sec execute 21 sec latency 233.222 ms 2023-10-08T12:56:51.948 INFO:tasks.workunit.client.0.smithi059.stdout: 10 56367 20.35 MB/sec execute 22 sec latency 523.735 ms 2023-10-08T12:56:52.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:52 smithi092 ceph-mon[134093]: pgmap v802: 97 pgs: 97 active+clean; 911 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.6 MiB/s wr, 348 op/s 2023-10-08T12:56:52.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:52 smithi173 ceph-mon[135182]: pgmap v802: 97 pgs: 97 active+clean; 911 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.6 MiB/s wr, 348 op/s 2023-10-08T12:56:52.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:52 smithi059 ceph-mon[98489]: pgmap v802: 97 pgs: 97 active+clean; 911 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.6 MiB/s wr, 348 op/s 2023-10-08T12:56:52.949 INFO:tasks.workunit.client.0.smithi059.stdout: 10 56845 20.73 MB/sec execute 23 sec latency 149.655 ms 2023-10-08T12:56:53.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:53 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:56:53.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:53 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:56:53.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:53 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:56:53.949 INFO:tasks.workunit.client.0.smithi059.stdout: 10 57327 21.36 MB/sec execute 24 sec latency 66.868 ms 2023-10-08T12:56:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:54 smithi092 ceph-mon[134093]: pgmap v803: 97 pgs: 97 active+clean; 923 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.9 MiB/s wr, 381 op/s 2023-10-08T12:56:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:56:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:56:54.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:54 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:56:54.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:54 smithi173 ceph-mon[135182]: pgmap v803: 97 pgs: 97 active+clean; 923 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.9 MiB/s wr, 381 op/s 2023-10-08T12:56:54.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:56:54.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:56:54.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:54 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:56:54.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:54 smithi059 ceph-mon[98489]: pgmap v803: 97 pgs: 97 active+clean; 923 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.9 MiB/s wr, 381 op/s 2023-10-08T12:56:54.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:56:54.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:56:54.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:54 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:56:54.949 INFO:tasks.workunit.client.0.smithi059.stdout: 10 57655 21.20 MB/sec execute 25 sec latency 113.717 ms 2023-10-08T12:56:55.951 INFO:tasks.workunit.client.0.smithi059.stdout: 10 57955 20.94 MB/sec execute 26 sec latency 135.818 ms 2023-10-08T12:56:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:56 smithi092 ceph-mon[134093]: pgmap v804: 97 pgs: 97 active+clean; 909 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 310 op/s 2023-10-08T12:56:56.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:56 smithi173 ceph-mon[135182]: pgmap v804: 97 pgs: 97 active+clean; 909 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 310 op/s 2023-10-08T12:56:56.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:56 smithi059 ceph-mon[98489]: pgmap v804: 97 pgs: 97 active+clean; 909 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 310 op/s 2023-10-08T12:56:56.951 INFO:tasks.workunit.client.0.smithi059.stdout: 10 58194 20.58 MB/sec execute 27 sec latency 227.777 ms 2023-10-08T12:56:57.951 INFO:tasks.workunit.client.0.smithi059.stdout: 10 58491 20.32 MB/sec execute 28 sec latency 172.192 ms 2023-10-08T12:56:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:58 smithi173 ceph-mon[135182]: pgmap v805: 97 pgs: 97 active+clean; 857 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.6 MiB/s wr, 353 op/s 2023-10-08T12:56:58.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:58 smithi059 ceph-mon[98489]: pgmap v805: 97 pgs: 97 active+clean; 857 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.6 MiB/s wr, 353 op/s 2023-10-08T12:56:58.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:58 smithi092 ceph-mon[134093]: pgmap v805: 97 pgs: 97 active+clean; 857 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.6 MiB/s wr, 353 op/s 2023-10-08T12:56:58.951 INFO:tasks.workunit.client.0.smithi059.stdout: 10 58830 20.23 MB/sec execute 29 sec latency 292.412 ms 2023-10-08T12:56:59.951 INFO:tasks.workunit.client.0.smithi059.stdout: 10 59468 20.40 MB/sec execute 30 sec latency 173.824 ms 2023-10-08T12:57:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:56:59 smithi173 ceph-mon[135182]: pgmap v806: 97 pgs: 97 active+clean; 821 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 7.9 MiB/s wr, 368 op/s 2023-10-08T12:57:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:56:59 smithi059 ceph-mon[98489]: pgmap v806: 97 pgs: 97 active+clean; 821 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 7.9 MiB/s wr, 368 op/s 2023-10-08T12:57:00.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:56:59 smithi092 ceph-mon[134093]: pgmap v806: 97 pgs: 97 active+clean; 821 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 7.9 MiB/s wr, 368 op/s 2023-10-08T12:57:00.951 INFO:tasks.workunit.client.0.smithi059.stdout: 10 59940 20.51 MB/sec execute 31 sec latency 157.684 ms 2023-10-08T12:57:01.951 INFO:tasks.workunit.client.0.smithi059.stdout: 10 60328 20.73 MB/sec execute 32 sec latency 287.826 ms 2023-10-08T12:57:02.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:02 smithi173 ceph-mon[135182]: pgmap v807: 97 pgs: 97 active+clean; 830 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 404 op/s 2023-10-08T12:57:02.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:02 smithi059 ceph-mon[98489]: pgmap v807: 97 pgs: 97 active+clean; 830 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 404 op/s 2023-10-08T12:57:02.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:02 smithi092 ceph-mon[134093]: pgmap v807: 97 pgs: 97 active+clean; 830 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 404 op/s 2023-10-08T12:57:02.952 INFO:tasks.workunit.client.0.smithi059.stdout: 10 60620 20.61 MB/sec execute 33 sec latency 146.600 ms 2023-10-08T12:57:03.951 INFO:tasks.workunit.client.0.smithi059.stdout: 10 61004 21.09 MB/sec execute 34 sec latency 150.575 ms 2023-10-08T12:57:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:04 smithi173 ceph-mon[135182]: pgmap v808: 97 pgs: 97 active+clean; 844 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.2 MiB/s wr, 512 op/s 2023-10-08T12:57:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:04 smithi173 ceph-mon[135182]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T12:57:04.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:04 smithi059 ceph-mon[98489]: pgmap v808: 97 pgs: 97 active+clean; 844 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.2 MiB/s wr, 512 op/s 2023-10-08T12:57:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:04 smithi059 ceph-mon[98489]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T12:57:04.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:04 smithi092 ceph-mon[134093]: pgmap v808: 97 pgs: 97 active+clean; 844 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.2 MiB/s wr, 512 op/s 2023-10-08T12:57:04.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:04 smithi092 ceph-mon[134093]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T12:57:04.951 INFO:tasks.workunit.client.0.smithi059.stdout: 10 61274 20.86 MB/sec execute 35 sec latency 222.394 ms 2023-10-08T12:57:05.951 INFO:tasks.workunit.client.0.smithi059.stdout: 10 61609 20.57 MB/sec execute 36 sec latency 143.103 ms 2023-10-08T12:57:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:06 smithi173 ceph-mon[135182]: pgmap v810: 97 pgs: 97 active+clean; 847 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.8 MiB/s wr, 624 op/s 2023-10-08T12:57:06.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:06 smithi059 ceph-mon[98489]: pgmap v810: 97 pgs: 97 active+clean; 847 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.8 MiB/s wr, 624 op/s 2023-10-08T12:57:06.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:06 smithi092 ceph-mon[134093]: pgmap v810: 97 pgs: 97 active+clean; 847 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.8 MiB/s wr, 624 op/s 2023-10-08T12:57:06.951 INFO:tasks.workunit.client.0.smithi059.stdout: 10 61773 20.18 MB/sec execute 37 sec latency 333.170 ms 2023-10-08T12:57:07.952 INFO:tasks.workunit.client.0.smithi059.stdout: 10 62106 19.96 MB/sec execute 38 sec latency 119.049 ms 2023-10-08T12:57:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:08 smithi173 ceph-mon[135182]: pgmap v811: 97 pgs: 97 active+clean; 843 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.7 MiB/s wr, 683 op/s 2023-10-08T12:57:08.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:08 smithi059 ceph-mon[98489]: pgmap v811: 97 pgs: 97 active+clean; 843 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.7 MiB/s wr, 683 op/s 2023-10-08T12:57:08.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:08 smithi092 ceph-mon[134093]: pgmap v811: 97 pgs: 97 active+clean; 843 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.7 MiB/s wr, 683 op/s 2023-10-08T12:57:08.952 INFO:tasks.workunit.client.0.smithi059.stdout: 10 62567 20.26 MB/sec execute 39 sec latency 76.007 ms 2023-10-08T12:57:09.952 INFO:tasks.workunit.client.0.smithi059.stdout: 10 63171 20.29 MB/sec execute 40 sec latency 160.342 ms 2023-10-08T12:57:10.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:09 smithi173 ceph-mon[135182]: pgmap v812: 97 pgs: 97 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.1 MiB/s wr, 754 op/s 2023-10-08T12:57:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:09 smithi059 ceph-mon[98489]: pgmap v812: 97 pgs: 97 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.1 MiB/s wr, 754 op/s 2023-10-08T12:57:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:09 smithi092 ceph-mon[134093]: pgmap v812: 97 pgs: 97 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.1 MiB/s wr, 754 op/s 2023-10-08T12:57:10.952 INFO:tasks.workunit.client.0.smithi059.stdout: 10 63619 20.51 MB/sec execute 41 sec latency 55.779 ms 2023-10-08T12:57:11.952 INFO:tasks.workunit.client.0.smithi059.stdout: 10 64003 20.64 MB/sec execute 42 sec latency 363.848 ms 2023-10-08T12:57:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:12 smithi092 ceph-mon[134093]: pgmap v813: 97 pgs: 97 active+clean; 867 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.0 MiB/s wr, 702 op/s 2023-10-08T12:57:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:12 smithi173 ceph-mon[135182]: pgmap v813: 97 pgs: 97 active+clean; 867 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.0 MiB/s wr, 702 op/s 2023-10-08T12:57:12.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:12 smithi059 ceph-mon[98489]: pgmap v813: 97 pgs: 97 active+clean; 867 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.0 MiB/s wr, 702 op/s 2023-10-08T12:57:12.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 64385 20.84 MB/sec execute 43 sec latency 168.410 ms 2023-10-08T12:57:13.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 64631 20.66 MB/sec execute 44 sec latency 217.281 ms 2023-10-08T12:57:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:14 smithi092 ceph-mon[134093]: pgmap v814: 97 pgs: 97 active+clean; 871 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.0 MiB/s wr, 558 op/s 2023-10-08T12:57:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:14 smithi092 ceph-mon[134093]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T12:57:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:14 smithi173 ceph-mon[135182]: pgmap v814: 97 pgs: 97 active+clean; 871 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.0 MiB/s wr, 558 op/s 2023-10-08T12:57:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:14 smithi173 ceph-mon[135182]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T12:57:14.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:14 smithi059 ceph-mon[98489]: pgmap v814: 97 pgs: 97 active+clean; 871 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.0 MiB/s wr, 558 op/s 2023-10-08T12:57:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:14 smithi059 ceph-mon[98489]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T12:57:14.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 65011 20.42 MB/sec execute 45 sec latency 154.981 ms 2023-10-08T12:57:15.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:57:15.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.404+0000 7fc5345ff700 1 -- 172.21.15.59:0/3831096833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc52c108110 msgr2=0x7fc52c113400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.404+0000 7fc5345ff700 1 --2- 172.21.15.59:0/3831096833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc52c108110 0x7fc52c113400 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc5280098f0 tx=0x7fc528009c00 comp rx=0 tx=0).stop 2023-10-08T12:57:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.404+0000 7fc5345ff700 1 -- 172.21.15.59:0/3831096833 shutdown_connections 2023-10-08T12:57:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.404+0000 7fc5345ff700 1 --2- 172.21.15.59:0/3831096833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52c113940 0x7fc52c115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.404+0000 7fc5345ff700 1 --2- 172.21.15.59:0/3831096833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc52c1077f0 0x7fc52c107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.404+0000 7fc5345ff700 1 --2- 172.21.15.59:0/3831096833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc52c108110 0x7fc52c113400 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.404+0000 7fc5345ff700 1 -- 172.21.15.59:0/3831096833 >> 172.21.15.59:0/3831096833 conn(0x7fc52c06b830 msgr2=0x7fc52c06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.404+0000 7fc5345ff700 1 -- 172.21.15.59:0/3831096833 shutdown_connections 2023-10-08T12:57:15.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.405+0000 7fc5345ff700 1 -- 172.21.15.59:0/3831096833 wait complete. 2023-10-08T12:57:15.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.406+0000 7fc5345ff700 1 Processor -- start 2023-10-08T12:57:15.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.407+0000 7fc5345ff700 1 -- start start 2023-10-08T12:57:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.407+0000 7fc5345ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc52c1077f0 0x7fc52c109260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.407+0000 7fc5345ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52c108110 0x7fc52c1097a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.407+0000 7fc5345ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc52c113940 0x7fc52c109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.407+0000 7fc5345ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c1ad830 con 0x7fc52c108110 2023-10-08T12:57:15.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.407+0000 7fc5345ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c1ad9a0 con 0x7fc52c113940 2023-10-08T12:57:15.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.407+0000 7fc5345ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c1adb60 con 0x7fc52c1077f0 2023-10-08T12:57:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.408+0000 7fc532b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc52c113940 0x7fc52c109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.408+0000 7fc532b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc52c113940 0x7fc52c109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50764/0 (socket says 172.21.15.59:50764) 2023-10-08T12:57:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.408+0000 7fc532b9c700 1 -- 172.21.15.59:0/3371762259 learned_addr learned my addr 172.21.15.59:0/3371762259 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.408+0000 7fc531b9a700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52c108110 0x7fc52c1097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.408+0000 7fc53239b700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc52c1077f0 0x7fc52c109260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.408+0000 7fc532b9c700 1 -- 172.21.15.59:0/3371762259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc52c1077f0 msgr2=0x7fc52c109260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.408+0000 7fc532b9c700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc52c1077f0 0x7fc52c109260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.408+0000 7fc532b9c700 1 -- 172.21.15.59:0/3371762259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52c108110 msgr2=0x7fc52c1097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.408+0000 7fc532b9c700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52c108110 0x7fc52c1097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.408+0000 7fc532b9c700 1 -- 172.21.15.59:0/3371762259 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc528009520 con 0x7fc52c113940 2023-10-08T12:57:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.409+0000 7fc532b9c700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc52c113940 0x7fc52c109ce0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc52400ef90 tx=0x7fc52400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.409+0000 7fc5237fe700 1 -- 172.21.15.59:0/3371762259 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524018070 con 0x7fc52c113940 2023-10-08T12:57:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.409+0000 7fc5237fe700 1 -- 172.21.15.59:0/3371762259 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc52400f040 con 0x7fc52c113940 2023-10-08T12:57:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.409+0000 7fc5345ff700 1 -- 172.21.15.59:0/3371762259 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52c1adde0 con 0x7fc52c113940 2023-10-08T12:57:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.409+0000 7fc5237fe700 1 -- 172.21.15.59:0/3371762259 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524003e00 con 0x7fc52c113940 2023-10-08T12:57:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.409+0000 7fc5345ff700 1 -- 172.21.15.59:0/3371762259 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c1ae2c0 con 0x7fc52c113940 2023-10-08T12:57:15.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.414+0000 7fc5237fe700 1 -- 172.21.15.59:0/3371762259 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc52400ca50 con 0x7fc52c113940 2023-10-08T12:57:15.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.415+0000 7fc547f8db80 1 Processor -- start 2023-10-08T12:57:15.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.416+0000 7fc547f8db80 1 -- start start 2023-10-08T12:57:15.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.416+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.416+0000 7fc5237fe700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5180a1670 0x7fc5180a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.416+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 0x55870f2f2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.416+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 0x55870f2f5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.416+0000 7fc547f8db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f248460 con 0x55870f2e7690 2023-10-08T12:57:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.416+0000 7fc547f8db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f239c20 con 0x55870f2e7fb0 2023-10-08T12:57:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.416+0000 7fc547f8db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f237540 con 0x55870f2f2e60 2023-10-08T12:57:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.416+0000 7fc5237fe700 1 -- 172.21.15.59:0/3371762259 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fc5240ccd20 con 0x7fc52c113940 2023-10-08T12:57:15.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc53239b700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5180a1670 0x7fc5180a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc531b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 0x55870f2f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc531b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 0x55870f2f2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50778/0 (socket says 172.21.15.59:50778) 2023-10-08T12:57:15.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc531b9a700 1 -- 172.21.15.59:0/3568783341 learned_addr learned my addr 172.21.15.59:0/3568783341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:15.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc531b9a700 1 --2- 172.21.15.59:0/3568783341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc532b9c700 1 --2- 172.21.15.59:0/3568783341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 0x55870f2f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc531b9a700 1 -- 172.21.15.59:0/3568783341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 msgr2=0x55870f2f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc531b9a700 1 --2- 172.21.15.59:0/3568783341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 0x55870f2f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc531b9a700 1 -- 172.21.15.59:0/3568783341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 msgr2=0x55870f2e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc531b9a700 1 --2- 172.21.15.59:0/3568783341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc531b9a700 1 -- 172.21.15.59:0/3568783341 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55870f05dde0 con 0x55870f2e7fb0 2023-10-08T12:57:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.417+0000 7fc53239b700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5180a1670 0x7fc5180a3b30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc51c005950 tx=0x7fc51c00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.418+0000 7fc531b9a700 1 --2- 172.21.15.59:0/3568783341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 0x55870f2f2920 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc528016000 tx=0x7fc52800bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=381d41c0311b4001 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.418+0000 7fc520bfe700 1 -- 172.21.15.59:0/3568783341 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52800f710 con 0x55870f2e7fb0 2023-10-08T12:57:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.418+0000 7fc520bfe700 1 -- 172.21.15.59:0/3568783341 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc52800f870 con 0x55870f2e7fb0 2023-10-08T12:57:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.418+0000 7fc520bfe700 1 -- 172.21.15.59:0/3568783341 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528005350 con 0x55870f2e7fb0 2023-10-08T12:57:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.419+0000 7fc547f8db80 1 -- 172.21.15.59:0/3568783341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 msgr2=0x55870f2f2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.419+0000 7fc547f8db80 1 --2- 172.21.15.59:0/3568783341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 0x55870f2f2920 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc528016000 tx=0x7fc52800bf30 comp rx=0 tx=0).stop 2023-10-08T12:57:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.419+0000 7fc547f8db80 1 -- 172.21.15.59:0/3568783341 shutdown_connections 2023-10-08T12:57:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.419+0000 7fc547f8db80 1 --2- 172.21.15.59:0/3568783341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 0x55870f2f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.419+0000 7fc547f8db80 1 --2- 172.21.15.59:0/3568783341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.419+0000 7fc547f8db80 1 --2- 172.21.15.59:0/3568783341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 0x55870f2f2920 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.419+0000 7fc547f8db80 1 -- 172.21.15.59:0/3568783341 >> 172.21.15.59:0/3568783341 conn(0x55870f254260 msgr2=0x55870f2db2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.419+0000 7fc547f8db80 1 -- 172.21.15.59:0/3568783341 shutdown_connections 2023-10-08T12:57:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.419+0000 7fc547f8db80 1 -- 172.21.15.59:0/3568783341 wait complete. 2023-10-08T12:57:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.419+0000 7fc547f8db80 1 -- start start 2023-10-08T12:57:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.420+0000 7fc547f8db80 1 Processor -- start 2023-10-08T12:57:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.420+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.420+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7fb0 0x55870f2efb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.420+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2f2e60 0x55870f2f02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.420+0000 7fc547f8db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f232e30 con 0x55870f2e7690 2023-10-08T12:57:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.420+0000 7fc547f8db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f1cf710 con 0x55870f2f2e60 2023-10-08T12:57:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.420+0000 7fc547f8db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f1cf3b0 con 0x55870f2e7fb0 2023-10-08T12:57:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.420+0000 7fc547f8db80 10 client.0 _ll_register_callbacks cb 0x55870f02c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc531b9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7fb0 0x55870f2efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc53239b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc531b9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7fb0 0x55870f2efb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51130/0 (socket says 172.21.15.59:51130) 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc531b9a700 1 -- 172.21.15.59:0/1903727734 learned_addr learned my addr 172.21.15.59:0/1903727734 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc532b9c700 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2f2e60 0x55870f2f02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc531b9a700 1 -- 172.21.15.59:0/1903727734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2f2e60 msgr2=0x55870f2f02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc531b9a700 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2f2e60 0x55870f2f02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc531b9a700 1 -- 172.21.15.59:0/1903727734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 msgr2=0x55870f2f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc531b9a700 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc531b9a700 1 -- 172.21.15.59:0/1903727734 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c116700 con 0x55870f2e7fb0 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc531b9a700 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7fb0 0x55870f2efb90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc52800fe20 tx=0x7fc528005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac8dd6c87606df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.421+0000 7fc515ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:57:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.422+0000 7fc515ffb700 1 -- 172.21.15.59:0/1903727734 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52800b970 con 0x55870f2e7fb0 2023-10-08T12:57:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.422+0000 7fc547f8db80 1 -- 172.21.15.59:0/1903727734 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55870f1faeb0 con 0x55870f2e7fb0 2023-10-08T12:57:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.422+0000 7fc515ffb700 1 -- 172.21.15.59:0/1903727734 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fc52800bad0 con 0x55870f2e7fb0 2023-10-08T12:57:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.422+0000 7fc515ffb700 1 -- 172.21.15.59:0/1903727734 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc528005110 con 0x55870f2e7fb0 2023-10-08T12:57:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.422+0000 7fc547f8db80 10 client.27769 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.422+0000 7fc547f8db80 1 -- 172.21.15.59:0/1903727734 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55870f046c60 con 0x55870f2e7fb0 2023-10-08T12:57:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.422+0000 7fc515ffb700 1 -- 172.21.15.59:0/1903727734 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc528035020 con 0x55870f2e7fb0 2023-10-08T12:57:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.422+0000 7fc515ffb700 1 -- 172.21.15.59:0/1903727734 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc528015020 con 0x55870f2e7fb0 2023-10-08T12:57:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.423+0000 7fc547f8db80 10 client.27769 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.423+0000 7fc547f8db80 10 client.27769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.423+0000 7fc547f8db80 20 client.27769 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.423+0000 7fc547f8db80 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55870f302660 0x55870f304a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.423+0000 7fc547f8db80 4 client.27769 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:57:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.423+0000 7fc547f8db80 1 -- 172.21.15.59:0/1903727734 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55870f22be10 con 0x55870f302660 2023-10-08T12:57:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.423+0000 7fc53239b700 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55870f302660 0x55870f304a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.423+0000 7fc53239b700 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55870f302660 0x55870f304a80 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5958f088d6cd04d9 server_cookie=c0a25381bfaabe04 in_seq=0 out_seq=0 2023-10-08T12:57:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.423+0000 7fc515ffb700 10 client.27769 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc515ffb700 1 -- 172.21.15.59:0/1903727734 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55870f22be10 con 0x55870f302660 2023-10-08T12:57:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc515ffb700 10 client.27769 handle_command_reply: tid=0 2023-10-08T12:57:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc547f8db80 1 client.27769 shutdown 2023-10-08T12:57:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc547f8db80 1 -- 172.21.15.59:0/1903727734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7fb0 msgr2=0x55870f2efb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc547f8db80 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7fb0 0x55870f2efb90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc52800fe20 tx=0x7fc528005dc0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc547f8db80 1 -- 172.21.15.59:0/1903727734 shutdown_connections 2023-10-08T12:57:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc547f8db80 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55870f302660 0x55870f304a80 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc547f8db80 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2f2e60 0x55870f2f02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc547f8db80 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc515ffb700 0 client.27769 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc547f8db80 1 --2- 172.21.15.59:0/1903727734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7fb0 0x55870f2efb90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.427+0000 7fc547f8db80 1 -- 172.21.15.59:0/1903727734 >> 172.21.15.59:0/1903727734 conn(0x55870f254260 msgr2=0x55870f2daec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.428+0000 7fc547f8db80 1 -- 172.21.15.59:0/1903727734 shutdown_connections 2023-10-08T12:57:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.428+0000 7fc547f8db80 1 -- 172.21.15.59:0/1903727734 wait complete. 2023-10-08T12:57:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.428+0000 7fc547f8db80 20 client.27769 trim_cache size 0 max 16384 2023-10-08T12:57:15.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.446+0000 7fc547f8db80 1 Processor -- start 2023-10-08T12:57:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.446+0000 7fc547f8db80 1 -- start start 2023-10-08T12:57:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.446+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2f9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.446+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 0x55870f2f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.446+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 0x55870f2eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.446+0000 7fc547f8db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f0b3920 con 0x55870f2e7690 2023-10-08T12:57:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.446+0000 7fc547f8db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f2d5570 con 0x55870f2e7fb0 2023-10-08T12:57:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.446+0000 7fc547f8db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f2f9ed0 con 0x55870f2f2e60 2023-10-08T12:57:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.446+0000 7fc53239b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2f9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.446+0000 7fc531b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 0x55870f2f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc532b9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 0x55870f2eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc532b9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 0x55870f2eaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51132/0 (socket says 172.21.15.59:51132) 2023-10-08T12:57:15.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc531b9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 0x55870f2f23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50810/0 (socket says 172.21.15.59:50810) 2023-10-08T12:57:15.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc532b9c700 1 -- 172.21.15.59:0/2511197836 learned_addr learned my addr 172.21.15.59:0/2511197836 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc532b9c700 1 -- 172.21.15.59:0/2511197836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 msgr2=0x55870f2f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc532b9c700 1 --2- 172.21.15.59:0/2511197836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 0x55870f2f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc532b9c700 1 -- 172.21.15.59:0/2511197836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 msgr2=0x55870f2f9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc532b9c700 1 --2- 172.21.15.59:0/2511197836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2f9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc532b9c700 1 -- 172.21.15.59:0/2511197836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55870f084250 con 0x55870f2f2e60 2023-10-08T12:57:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc532b9c700 1 --2- 172.21.15.59:0/2511197836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 0x55870f2eaf00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc524099d70 tx=0x7fc5240a0170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27c3337fe1c80f16 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc5213ff700 1 -- 172.21.15.59:0/2511197836 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524099740 con 0x55870f2f2e60 2023-10-08T12:57:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.447+0000 7fc5213ff700 1 -- 172.21.15.59:0/2511197836 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc52409a4e0 con 0x55870f2f2e60 2023-10-08T12:57:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.448+0000 7fc5213ff700 1 -- 172.21.15.59:0/2511197836 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52400cd90 con 0x55870f2f2e60 2023-10-08T12:57:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.448+0000 7fc547f8db80 1 -- 172.21.15.59:0/2511197836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 msgr2=0x55870f2eaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.448+0000 7fc547f8db80 1 --2- 172.21.15.59:0/2511197836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 0x55870f2eaf00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc524099d70 tx=0x7fc5240a0170 comp rx=0 tx=0).stop 2023-10-08T12:57:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.448+0000 7fc547f8db80 1 -- 172.21.15.59:0/2511197836 shutdown_connections 2023-10-08T12:57:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.448+0000 7fc547f8db80 1 --2- 172.21.15.59:0/2511197836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2f2e60 0x55870f2eaf00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.448+0000 7fc547f8db80 1 --2- 172.21.15.59:0/2511197836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7690 0x55870f2f9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.448+0000 7fc547f8db80 1 --2- 172.21.15.59:0/2511197836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2e7fb0 0x55870f2f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.448+0000 7fc547f8db80 1 -- 172.21.15.59:0/2511197836 >> 172.21.15.59:0/2511197836 conn(0x55870f254260 msgr2=0x55870f2ef420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.448+0000 7fc547f8db80 1 -- 172.21.15.59:0/2511197836 shutdown_connections 2023-10-08T12:57:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.448+0000 7fc547f8db80 1 -- 172.21.15.59:0/2511197836 wait complete. 2023-10-08T12:57:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.449+0000 7fc547f8db80 1 -- start start 2023-10-08T12:57:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.449+0000 7fc547f8db80 1 Processor -- start 2023-10-08T12:57:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.449+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7690 0x55870f2f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.449+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7fb0 0x55870f2f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.449+0000 7fc547f8db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2f2e60 0x55870f2f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.449+0000 7fc547f8db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f2f9d80 con 0x55870f2e7fb0 2023-10-08T12:57:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.449+0000 7fc547f8db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f356460 con 0x55870f2f2e60 2023-10-08T12:57:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.449+0000 7fc547f8db80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870f3565d0 con 0x55870f2e7690 2023-10-08T12:57:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc547f8db80 10 client.0 _ll_register_callbacks cb 0x7fc5240097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc531b9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7fb0 0x55870f2f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc532b9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2f2e60 0x55870f2f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc531b9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7fb0 0x55870f2f84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46032/0 (socket says 172.21.15.59:46032) 2023-10-08T12:57:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc531b9a700 1 -- 172.21.15.59:0/3505059209 learned_addr learned my addr 172.21.15.59:0/3505059209 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc53239b700 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7690 0x55870f2f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc531b9a700 1 -- 172.21.15.59:0/3505059209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7690 msgr2=0x55870f2f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc531b9a700 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7690 0x55870f2f7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc531b9a700 1 -- 172.21.15.59:0/3505059209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2f2e60 msgr2=0x55870f2f89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc531b9a700 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2f2e60 0x55870f2f89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc531b9a700 1 -- 172.21.15.59:0/3505059209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c1ae2c0 con 0x55870f2e7fb0 2023-10-08T12:57:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc53239b700 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7690 0x55870f2f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc532b9c700 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2f2e60 0x55870f2f89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:15.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.450+0000 7fc531b9a700 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7fb0 0x55870f2f84b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc52802d030 tx=0x7fc528005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca399b19ef4486 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.451+0000 7fc515ffb700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:57:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.451+0000 7fc515ffb700 1 -- 172.21.15.59:0/3505059209 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52803d070 con 0x55870f2e7fb0 2023-10-08T12:57:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.451+0000 7fc547f8db80 1 -- 172.21.15.59:0/3505059209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc52800f870 con 0x55870f2e7fb0 2023-10-08T12:57:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.451+0000 7fc515ffb700 1 -- 172.21.15.59:0/3505059209 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fc528000e40 con 0x55870f2e7fb0 2023-10-08T12:57:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.451+0000 7fc515ffb700 1 -- 172.21.15.59:0/3505059209 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc528003af0 con 0x55870f2e7fb0 2023-10-08T12:57:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.451+0000 7fc547f8db80 10 client.17760 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.451+0000 7fc547f8db80 1 -- 172.21.15.59:0/3505059209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55870f05c2b0 con 0x55870f2e7fb0 2023-10-08T12:57:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.451+0000 7fc515ffb700 1 -- 172.21.15.59:0/3505059209 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc528046020 con 0x55870f2e7fb0 2023-10-08T12:57:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.451+0000 7fc515ffb700 1 -- 172.21.15.59:0/3505059209 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc528040030 con 0x55870f2e7fb0 2023-10-08T12:57:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.452+0000 7fc547f8db80 10 client.17760 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:15.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.452+0000 7fc547f8db80 10 client.17760 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.452+0000 7fc547f8db80 20 client.17760 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.452+0000 7fc547f8db80 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55870f357b10 0x55870f359f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.452+0000 7fc547f8db80 4 client.17760 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:57:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.452+0000 7fc547f8db80 1 -- 172.21.15.59:0/3505059209 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55870f22bb30 con 0x55870f357b10 2023-10-08T12:57:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.452+0000 7fc53239b700 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55870f357b10 0x55870f359f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.452+0000 7fc53239b700 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55870f357b10 0x55870f359f30 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b912facf35d77983 server_cookie=79831e793880c082 in_seq=0 out_seq=0 2023-10-08T12:57:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.452+0000 7fc515ffb700 10 client.17760 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:15.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc515ffb700 1 -- 172.21.15.59:0/3505059209 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55870f22bb30 con 0x55870f357b10 2023-10-08T12:57:15.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc515ffb700 10 client.17760 handle_command_reply: tid=0 2023-10-08T12:57:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 1 client.17760 shutdown 2023-10-08T12:57:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 1 -- 172.21.15.59:0/3505059209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7fb0 msgr2=0x55870f2f84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7fb0 0x55870f2f84b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc52802d030 tx=0x7fc528005d50 comp rx=0 tx=0).stop 2023-10-08T12:57:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 1 -- 172.21.15.59:0/3505059209 shutdown_connections 2023-10-08T12:57:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55870f357b10 0x55870f359f30 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55870f2f2e60 0x55870f2f89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55870f2e7690 0x55870f2f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc515ffb700 0 client.17760 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 1 --2- 172.21.15.59:0/3505059209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55870f2e7fb0 0x55870f2f84b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 1 -- 172.21.15.59:0/3505059209 >> 172.21.15.59:0/3505059209 conn(0x55870f254260 msgr2=0x55870f2eaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 1 -- 172.21.15.59:0/3505059209 shutdown_connections 2023-10-08T12:57:15.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 1 -- 172.21.15.59:0/3505059209 wait complete. 2023-10-08T12:57:15.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.459+0000 7fc547f8db80 20 client.17760 trim_cache size 0 max 16384 2023-10-08T12:57:15.461 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:57:15.461 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:57:15.461 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:57:15.461 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:57:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 -- 172.21.15.59:0/3371762259 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5180a1670 msgr2=0x7fc5180a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5180a1670 0x7fc5180a3b30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc51c005950 tx=0x7fc51c00b410 comp rx=0 tx=0).stop 2023-10-08T12:57:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 -- 172.21.15.59:0/3371762259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc52c113940 msgr2=0x7fc52c109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc52c113940 0x7fc52c109ce0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc52400ef90 tx=0x7fc52400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 -- 172.21.15.59:0/3371762259 shutdown_connections 2023-10-08T12:57:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fc5180a1670 0x7fc5180a3b30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc52c113940 0x7fc52c109ce0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc52c1077f0 0x7fc52c109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 --2- 172.21.15.59:0/3371762259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52c108110 0x7fc52c1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 -- 172.21.15.59:0/3371762259 >> 172.21.15.59:0/3371762259 conn(0x7fc52c06b830 msgr2=0x7fc52c06f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:15.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 -- 172.21.15.59:0/3371762259 shutdown_connections 2023-10-08T12:57:15.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.460+0000 7fc5345ff700 1 -- 172.21.15.59:0/3371762259 wait complete. 2023-10-08T12:57:15.480 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:57:15.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:57:15.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.700+0000 7ffae7dff700 1 -- 172.21.15.59:0/2390343695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae0072c20 msgr2=0x7ffae0073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.700+0000 7ffae7dff700 1 --2- 172.21.15.59:0/2390343695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae0072c20 0x7ffae0073000 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009990 tx=0x7ffadc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.700+0000 7ffae7dff700 1 -- 172.21.15.59:0/2390343695 shutdown_connections 2023-10-08T12:57:15.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.700+0000 7ffae7dff700 1 --2- 172.21.15.59:0/2390343695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae0072c20 0x7ffae0073000 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.700+0000 7ffae7dff700 1 --2- 172.21.15.59:0/2390343695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae010ce70 0x7ffae010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.700+0000 7ffae7dff700 1 --2- 172.21.15.59:0/2390343695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffae0073540 0x7ffae010c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.700+0000 7ffae7dff700 1 -- 172.21.15.59:0/2390343695 >> 172.21.15.59:0/2390343695 conn(0x7ffae00fc140 msgr2=0x7ffae00fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:15.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.701+0000 7ffae7dff700 1 -- 172.21.15.59:0/2390343695 shutdown_connections 2023-10-08T12:57:15.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.701+0000 7ffae7dff700 1 -- 172.21.15.59:0/2390343695 wait complete. 2023-10-08T12:57:15.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae7dff700 1 Processor -- start 2023-10-08T12:57:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae7dff700 1 -- start start 2023-10-08T12:57:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae7dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae0072c20 0x7ffae0198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae7dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae0073540 0x7ffae0199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae7dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffae010ce70 0x7ffae019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae7dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae019dd20 con 0x7ffae0072c20 2023-10-08T12:57:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae7dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae019de90 con 0x7ffae0073540 2023-10-08T12:57:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae7dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae019e050 con 0x7ffae010ce70 2023-10-08T12:57:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae539a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae0073540 0x7ffae0199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae5b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae0072c20 0x7ffae0198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae539a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae0073540 0x7ffae0199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50832/0 (socket says 172.21.15.59:50832) 2023-10-08T12:57:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.702+0000 7ffae539a700 1 -- 172.21.15.59:0/4274152178 learned_addr learned my addr 172.21.15.59:0/4274152178 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.703+0000 7ffae639c700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffae010ce70 0x7ffae019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.703+0000 7ffae539a700 1 -- 172.21.15.59:0/4274152178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffae010ce70 msgr2=0x7ffae019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.703+0000 7ffae539a700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffae010ce70 0x7ffae019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.703+0000 7ffae539a700 1 -- 172.21.15.59:0/4274152178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae0072c20 msgr2=0x7ffae0198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.703+0000 7ffae539a700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae0072c20 0x7ffae0198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.703+0000 7ffae539a700 1 -- 172.21.15.59:0/4274152178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc0095f0 con 0x7ffae0073540 2023-10-08T12:57:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.703+0000 7ffae539a700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae0073540 0x7ffae0199390 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ffad000e9a0 tx=0x7ffad000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.703+0000 7ffad6ffd700 1 -- 172.21.15.59:0/4274152178 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0009790 con 0x7ffae0073540 2023-10-08T12:57:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.703+0000 7ffad6ffd700 1 -- 172.21.15.59:0/4274152178 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffad0010430 con 0x7ffae0073540 2023-10-08T12:57:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.703+0000 7ffae7dff700 1 -- 172.21.15.59:0/4274152178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae019e330 con 0x7ffae0073540 2023-10-08T12:57:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.703+0000 7ffad6ffd700 1 -- 172.21.15.59:0/4274152178 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0018680 con 0x7ffae0073540 2023-10-08T12:57:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.704+0000 7ffae7dff700 1 -- 172.21.15.59:0/4274152178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae01a5b70 con 0x7ffae0073540 2023-10-08T12:57:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.705+0000 7ffae7dff700 1 -- 172.21.15.59:0/4274152178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae0108080 con 0x7ffae0073540 2023-10-08T12:57:15.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.707+0000 7ffad6ffd700 1 -- 172.21.15.59:0/4274152178 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ffad00105a0 con 0x7ffae0073540 2023-10-08T12:57:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.708+0000 7ffad6ffd700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffacc0a15f0 0x7ffacc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.708+0000 7ffad6ffd700 1 -- 172.21.15.59:0/4274152178 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7ffad0014070 con 0x7ffae0073540 2023-10-08T12:57:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.708+0000 7ffae5b9b700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffacc0a15f0 0x7ffacc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.709+0000 7ffae5b9b700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffacc0a15f0 0x7ffacc0a3ab0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffadc006010 tx=0x7ffadc00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:15.714+0000 7ffad6ffd700 1 -- 172.21.15.59:0/4274152178 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffad00967c0 con 0x7ffae0073540 2023-10-08T12:57:15.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 65345 20.23 MB/sec execute 46 sec latency 166.041 ms 2023-10-08T12:57:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.000+0000 7ffae7dff700 1 -- 172.21.15.59:0/4274152178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffae00742d0 con 0x7ffae0073540 2023-10-08T12:57:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.001+0000 7ffad6ffd700 1 -- 172.21.15.59:0/4274152178 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7ffad0026090 con 0x7ffae0073540 2023-10-08T12:57:16.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:57:16.001 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:57:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.003+0000 7ffae7dff700 1 -- 172.21.15.59:0/4274152178 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffacc0a15f0 msgr2=0x7ffacc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.003+0000 7ffae7dff700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffacc0a15f0 0x7ffacc0a3ab0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffadc006010 tx=0x7ffadc00b260 comp rx=0 tx=0).stop 2023-10-08T12:57:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.003+0000 7ffae7dff700 1 -- 172.21.15.59:0/4274152178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae0073540 msgr2=0x7ffae0199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.003+0000 7ffae7dff700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae0073540 0x7ffae0199390 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ffad000e9a0 tx=0x7ffad000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.003+0000 7ffae7dff700 1 -- 172.21.15.59:0/4274152178 shutdown_connections 2023-10-08T12:57:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.003+0000 7ffae7dff700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ffacc0a15f0 0x7ffacc0a3ab0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.003+0000 7ffae7dff700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffae010ce70 0x7ffae019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.003+0000 7ffae7dff700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae0072c20 0x7ffae0198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.003+0000 7ffae7dff700 1 --2- 172.21.15.59:0/4274152178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae0073540 0x7ffae0199390 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.003+0000 7ffae7dff700 1 -- 172.21.15.59:0/4274152178 >> 172.21.15.59:0/4274152178 conn(0x7ffae00fc140 msgr2=0x7ffae00fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.004+0000 7ffae7dff700 1 -- 172.21.15.59:0/4274152178 shutdown_connections 2023-10-08T12:57:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.004+0000 7ffae7dff700 1 -- 172.21.15.59:0/4274152178 wait complete. 2023-10-08T12:57:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:57:16.025 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:57:16.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.254+0000 7f9cddfff700 1 -- 172.21.15.59:0/2793627394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8106770 msgr2=0x7f9cd8106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.254+0000 7f9cddfff700 1 --2- 172.21.15.59:0/2793627394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8106770 0x7f9cd8106b50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009990 tx=0x7f9cc8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.254+0000 7f9cddfff700 1 -- 172.21.15.59:0/2793627394 shutdown_connections 2023-10-08T12:57:16.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.254+0000 7f9cddfff700 1 --2- 172.21.15.59:0/2793627394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd8069730 0x7f9cd810d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.254+0000 7f9cddfff700 1 --2- 172.21.15.59:0/2793627394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8106770 0x7f9cd8106b50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.254+0000 7f9cddfff700 1 --2- 172.21.15.59:0/2793627394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cd8068d90 0x7f9cd80691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.254+0000 7f9cddfff700 1 -- 172.21.15.59:0/2793627394 >> 172.21.15.59:0/2793627394 conn(0x7f9cd8076820 msgr2=0x7f9cd8076c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:16.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.254+0000 7f9cddfff700 1 -- 172.21.15.59:0/2793627394 shutdown_connections 2023-10-08T12:57:16.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.254+0000 7f9cddfff700 1 -- 172.21.15.59:0/2793627394 wait complete. 2023-10-08T12:57:16.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.255+0000 7f9cddfff700 1 Processor -- start 2023-10-08T12:57:16.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.255+0000 7f9cddfff700 1 -- start start 2023-10-08T12:57:16.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cddfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cd8068d90 0x7f9cd819c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cddfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd8069730 0x7f9cd819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cddfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8106770 0x7f9cd8196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cddfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8197100 con 0x7f9cd8106770 2023-10-08T12:57:16.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cddfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8197270 con 0x7f9cd8069730 2023-10-08T12:57:16.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cddfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8197430 con 0x7f9cd8068d90 2023-10-08T12:57:16.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd8069730 0x7f9cd819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cd8068d90 0x7f9cd819c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cd8068d90 0x7f9cd819c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51186/0 (socket says 172.21.15.59:51186) 2023-10-08T12:57:16.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd8069730 0x7f9cd819ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50844/0 (socket says 172.21.15.59:50844) 2023-10-08T12:57:16.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cd77fe700 1 -- 172.21.15.59:0/1722628068 learned_addr learned my addr 172.21.15.59:0/1722628068 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:16.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.256+0000 7f9cd7fff700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8106770 0x7f9cd8196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.257+0000 7f9cd6ffd700 1 -- 172.21.15.59:0/1722628068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cd8068d90 msgr2=0x7f9cd819c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.257+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cd8068d90 0x7f9cd819c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.257+0000 7f9cd6ffd700 1 -- 172.21.15.59:0/1722628068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8106770 msgr2=0x7f9cd8196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.257+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8106770 0x7f9cd8196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.257+0000 7f9cd6ffd700 1 -- 172.21.15.59:0/1722628068 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc80095f0 con 0x7f9cd8069730 2023-10-08T12:57:16.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.257+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd8069730 0x7f9cd819ceb0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00e9f0 tx=0x7f9ccc00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:16.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.257+0000 7f9cd4ff9700 1 -- 172.21.15.59:0/1722628068 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00c9c0 con 0x7f9cd8069730 2023-10-08T12:57:16.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.257+0000 7f9cd4ff9700 1 -- 172.21.15.59:0/1722628068 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ccc010430 con 0x7f9cd8069730 2023-10-08T12:57:16.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.257+0000 7f9cddfff700 1 -- 172.21.15.59:0/1722628068 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd8197710 con 0x7f9cd8069730 2023-10-08T12:57:16.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.257+0000 7f9cd4ff9700 1 -- 172.21.15.59:0/1722628068 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc018680 con 0x7f9cd8069730 2023-10-08T12:57:16.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.257+0000 7f9cddfff700 1 -- 172.21.15.59:0/1722628068 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd81a3960 con 0x7f9cd8069730 2023-10-08T12:57:16.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.261+0000 7f9cd4ff9700 1 -- 172.21.15.59:0/1722628068 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9ccc010860 con 0x7f9cd8069730 2023-10-08T12:57:16.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.262+0000 7f9cf190cb80 1 Processor -- start 2023-10-08T12:57:16.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.262+0000 7f9cf190cb80 1 -- start start 2023-10-08T12:57:16.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 0x5561d600c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d6017110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 0x5561d6019a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d5f75460 con 0x5561d600c7a0 2023-10-08T12:57:16.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d5f66c20 con 0x5561d6017650 2023-10-08T12:57:16.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d5f64540 con 0x5561d600be80 2023-10-08T12:57:16.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd4ff9700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9cc00a15f0 0x7f9cc00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 0x5561d6019a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d6017110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 0x5561d6019a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50850/0 (socket says 172.21.15.59:50850) 2023-10-08T12:57:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd6ffd700 1 -- 172.21.15.59:0/3334149623 learned_addr learned my addr 172.21.15.59:0/3334149623 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd7fff700 1 --2- 172.21.15.59:0/3334149623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 0x5561d600c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd7fff700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9cc00a15f0 0x7f9cc00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd4ff9700 1 -- 172.21.15.59:0/1722628068 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9ccc014070 con 0x7f9cd8069730 2023-10-08T12:57:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd6ffd700 1 -- 172.21.15.59:0/3334149623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 msgr2=0x5561d600c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/3334149623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 0x5561d600c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd6ffd700 1 -- 172.21.15.59:0/3334149623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 msgr2=0x5561d6017110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/3334149623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d6017110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.263+0000 7f9cd6ffd700 1 -- 172.21.15.59:0/3334149623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561d5d8ade0 con 0x5561d6017650 2023-10-08T12:57:16.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.264+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/3334149623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 0x5561d6019a40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0ca920 tx=0x7f9ccc010c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b30387750d58cba2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:16.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.264+0000 7f9cbdffb700 1 -- 172.21.15.59:0/3334149623 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc09e160 con 0x5561d6017650 2023-10-08T12:57:16.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.264+0000 7f9cbdffb700 1 -- 172.21.15.59:0/3334149623 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ccc09e360 con 0x5561d6017650 2023-10-08T12:57:16.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.264+0000 7f9cbdffb700 1 -- 172.21.15.59:0/3334149623 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc099700 con 0x5561d6017650 2023-10-08T12:57:16.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.265+0000 7f9cf190cb80 1 -- 172.21.15.59:0/3334149623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 msgr2=0x5561d6019a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.265+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/3334149623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 0x5561d6019a40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0ca920 tx=0x7f9ccc010c60 comp rx=0 tx=0).stop 2023-10-08T12:57:16.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.265+0000 7f9cd7fff700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9cc00a15f0 0x7f9cc00a3ab0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009790 tx=0x7f9cd0009080 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:16.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.265+0000 7f9cf190cb80 1 -- 172.21.15.59:0/3334149623 shutdown_connections 2023-10-08T12:57:16.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.265+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/3334149623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 0x5561d6019a40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.265+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/3334149623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 0x5561d600c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.265+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/3334149623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d6017110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.265+0000 7f9cf190cb80 1 -- 172.21.15.59:0/3334149623 >> 172.21.15.59:0/3334149623 conn(0x5561d5f81260 msgr2=0x5561d60082d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:16.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.265+0000 7f9cf190cb80 1 -- 172.21.15.59:0/3334149623 shutdown_connections 2023-10-08T12:57:16.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.265+0000 7f9cf190cb80 1 -- 172.21.15.59:0/3334149623 wait complete. 2023-10-08T12:57:16.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.265+0000 7f9cf190cb80 1 -- start start 2023-10-08T12:57:16.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.266+0000 7f9cf190cb80 1 Processor -- start 2023-10-08T12:57:16.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d6017010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d60143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d6017650 0x5561d60149f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d5f5fe30 con 0x5561d600c7a0 2023-10-08T12:57:16.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d5efc710 con 0x5561d600be80 2023-10-08T12:57:16.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d5efc3b0 con 0x5561d6017650 2023-10-08T12:57:16.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cf190cb80 10 client.0 _ll_register_callbacks cb 0x5561d5d59800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:16.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d6017010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d60143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d6017010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50860/0 (socket says 172.21.15.59:50860) 2023-10-08T12:57:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cd77fe700 1 -- 172.21.15.59:0/4008380456 learned_addr learned my addr 172.21.15.59:0/4008380456 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cd7fff700 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d6017650 0x5561d60149f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cd77fe700 1 -- 172.21.15.59:0/4008380456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d6017650 msgr2=0x5561d60149f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cd77fe700 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d6017650 0x5561d60149f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cd77fe700 1 -- 172.21.15.59:0/4008380456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 msgr2=0x5561d60143e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cd77fe700 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d60143e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cd77fe700 1 -- 172.21.15.59:0/4008380456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd81a3960 con 0x5561d600be80 2023-10-08T12:57:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.267+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d60143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:16.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.268+0000 7f9cd77fe700 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d6017010 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8005850 tx=0x7f9cc8005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4b160295f7d7cf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:16.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.268+0000 7f9cb6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:57:16.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.268+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/4008380456 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc801d070 con 0x5561d600be80 2023-10-08T12:57:16.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.268+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4008380456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561d5f27eb0 con 0x5561d600be80 2023-10-08T12:57:16.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.268+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/4008380456 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9cc8004500 con 0x5561d600be80 2023-10-08T12:57:16.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.268+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/4008380456 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cc80046c0 con 0x5561d600be80 2023-10-08T12:57:16.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.269+0000 7f9cf190cb80 10 client.27800 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:16.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.269+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4008380456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5561d5d73c60 con 0x5561d600be80 2023-10-08T12:57:16.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.269+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/4008380456 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5561d5f27eb0 con 0x5561d600be80 2023-10-08T12:57:16.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.269+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/4008380456 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9cc800f8e0 con 0x5561d600be80 2023-10-08T12:57:16.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.269+0000 7f9cf190cb80 10 client.27800 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:16.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.269+0000 7f9cf190cb80 10 client.27800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:16.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.269+0000 7f9cf190cb80 20 client.27800 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:16.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.269+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561d6027120 0x5561d6029540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.269+0000 7f9cf190cb80 4 client.27800 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:57:16.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.269+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4008380456 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561d5f58e10 con 0x5561d6027120 2023-10-08T12:57:16.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.269+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561d6027120 0x5561d6029540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.270+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561d6027120 0x5561d6029540 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c075c5dbe64d984 server_cookie=bf14db7fe85cc431 in_seq=0 out_seq=0 2023-10-08T12:57:16.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.270+0000 7f9cb6ffd700 10 client.27800 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:16.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.274+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/4008380456 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5561d5f58e10 con 0x5561d6027120 2023-10-08T12:57:16.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.274+0000 7f9cb6ffd700 10 client.27800 handle_command_reply: tid=0 2023-10-08T12:57:16.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.274+0000 7f9cf190cb80 1 client.27800 shutdown 2023-10-08T12:57:16.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4008380456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 msgr2=0x5561d6017010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d6017010 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8005850 tx=0x7f9cc8005c70 comp rx=0 tx=0).stop 2023-10-08T12:57:16.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4008380456 shutdown_connections 2023-10-08T12:57:16.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561d6027120 0x5561d6029540 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d6017010 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d6017650 0x5561d60149f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cb6ffd700 0 client.27800 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/4008380456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d60143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4008380456 >> 172.21.15.59:0/4008380456 conn(0x5561d5f81260 msgr2=0x5561d6007ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4008380456 shutdown_connections 2023-10-08T12:57:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4008380456 wait complete. 2023-10-08T12:57:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.275+0000 7f9cf190cb80 20 client.27800 trim_cache size 0 max 16384 2023-10-08T12:57:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.289+0000 7f9cf190cb80 1 Processor -- start 2023-10-08T12:57:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.289+0000 7f9cf190cb80 1 -- start start 2023-10-08T12:57:16.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.289+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d601e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.289+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d6016ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.289+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d6017650 0x5561d600f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.289+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d5de0920 con 0x5561d600c7a0 2023-10-08T12:57:16.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.289+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d6014ff0 con 0x5561d600be80 2023-10-08T12:57:16.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.289+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d6002570 con 0x5561d6017650 2023-10-08T12:57:16.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.290+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d601e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.290+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d6016ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.290+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d601e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50864/0 (socket says 172.21.15.59:50864) 2023-10-08T12:57:16.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.290+0000 7f9cd77fe700 1 -- 172.21.15.59:0/4061560806 learned_addr learned my addr 172.21.15.59:0/4061560806 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:16.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.290+0000 7f9cd7fff700 1 --2- 172.21.15.59:0/4061560806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d6017650 0x5561d600f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.290+0000 7f9cd6ffd700 1 -- 172.21.15.59:0/4061560806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d6017650 msgr2=0x5561d600f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.290+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/4061560806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d6017650 0x5561d600f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.290+0000 7f9cd6ffd700 1 -- 172.21.15.59:0/4061560806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 msgr2=0x5561d601e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.290+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/4061560806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d601e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.290+0000 7f9cd6ffd700 1 -- 172.21.15.59:0/4061560806 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561d5db1250 con 0x5561d600c7a0 2023-10-08T12:57:16.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.290+0000 7f9cd77fe700 1 --2- 172.21.15.59:0/4061560806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d601e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:16.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.291+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/4061560806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d6016ba0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc09a1a0 tx=0x7f9ccc009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3e768b7eb80886 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:16.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.291+0000 7f9cbe7fc700 1 -- 172.21.15.59:0/4061560806 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc09e160 con 0x5561d600c7a0 2023-10-08T12:57:16.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.291+0000 7f9cbe7fc700 1 -- 172.21.15.59:0/4061560806 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ccc0a25a0 con 0x5561d600c7a0 2023-10-08T12:57:16.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.291+0000 7f9cbe7fc700 1 -- 172.21.15.59:0/4061560806 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc0a2370 con 0x5561d600c7a0 2023-10-08T12:57:16.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.292+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4061560806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 msgr2=0x5561d6016ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.292+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/4061560806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d6016ba0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc09a1a0 tx=0x7f9ccc009f70 comp rx=0 tx=0).stop 2023-10-08T12:57:16.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.292+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4061560806 shutdown_connections 2023-10-08T12:57:16.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.292+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/4061560806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d600be80 0x5561d601e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.292+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/4061560806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d6017650 0x5561d600f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.292+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/4061560806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d6016ba0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.292+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4061560806 >> 172.21.15.59:0/4061560806 conn(0x5561d5f81260 msgr2=0x5561d60074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:16.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.292+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4061560806 shutdown_connections 2023-10-08T12:57:16.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.292+0000 7f9cf190cb80 1 -- 172.21.15.59:0/4061560806 wait complete. 2023-10-08T12:57:16.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.292+0000 7f9cf190cb80 1 -- start start 2023-10-08T12:57:16.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.292+0000 7f9cf190cb80 1 Processor -- start 2023-10-08T12:57:16.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 0x5561d601c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d601c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cf190cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 0x5561d6079f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d607a490 con 0x5561d600c7a0 2023-10-08T12:57:16.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d607a5d0 con 0x5561d6017650 2023-10-08T12:57:16.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cf190cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d607a790 con 0x5561d600be80 2023-10-08T12:57:16.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cf190cb80 10 client.0 _ll_register_callbacks cb 0x7f9cc80053c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:16.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 0x5561d601c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cd7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 0x5561d6079f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 0x5561d601c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51222/0 (socket says 172.21.15.59:51222) 2023-10-08T12:57:16.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d601c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cd77fe700 1 -- 172.21.15.59:0/832163382 learned_addr learned my addr 172.21.15.59:0/832163382 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:16.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cd77fe700 1 -- 172.21.15.59:0/832163382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 msgr2=0x5561d6079f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cd77fe700 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 0x5561d6079f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.293+0000 7f9cd77fe700 1 -- 172.21.15.59:0/832163382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 msgr2=0x5561d601c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.294+0000 7f9cd77fe700 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d601c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.294+0000 7f9cd77fe700 1 -- 172.21.15.59:0/832163382 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561d5d73c60 con 0x5561d600be80 2023-10-08T12:57:16.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.294+0000 7f9cd7fff700 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 0x5561d6079f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:16.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.294+0000 7f9cd77fe700 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 0x5561d601c350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8005e80 tx=0x7f9cc8005eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa72cc54a3c2629b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:16.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.294+0000 7f9cb6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:57:16.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.294+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/832163382 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc801d030 con 0x5561d600be80 2023-10-08T12:57:16.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.294+0000 7f9cf190cb80 1 -- 172.21.15.59:0/832163382 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ccc09e360 con 0x5561d600be80 2023-10-08T12:57:16.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.294+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/832163382 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9cc8000e40 con 0x5561d600be80 2023-10-08T12:57:16.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.294+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/832163382 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cc8024450 con 0x5561d600be80 2023-10-08T12:57:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.294+0000 7f9cf190cb80 10 client.27799 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.294+0000 7f9cf190cb80 1 -- 172.21.15.59:0/832163382 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5561d5d8ade0 con 0x5561d600be80 2023-10-08T12:57:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.295+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/832163382 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ccc09e360 con 0x5561d600be80 2023-10-08T12:57:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.295+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/832163382 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9cc8024c20 con 0x5561d600be80 2023-10-08T12:57:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.295+0000 7f9cf190cb80 10 client.27799 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.295+0000 7f9cf190cb80 10 client.27799 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.295+0000 7f9cf190cb80 20 client.27799 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.295+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561d607bad0 0x5561d607dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.295+0000 7f9cf190cb80 4 client.27799 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:57:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.295+0000 7f9cf190cb80 1 -- 172.21.15.59:0/832163382 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5561d5f58b30 con 0x5561d607bad0 2023-10-08T12:57:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.295+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561d607bad0 0x5561d607dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.296+0000 7f9cd6ffd700 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561d607bad0 0x5561d607dec0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a966ab9a81a71e1 server_cookie=2b9421936600df23 in_seq=0 out_seq=0 2023-10-08T12:57:16.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.296+0000 7f9cb6ffd700 10 client.27799 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:16.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cb6ffd700 1 -- 172.21.15.59:0/832163382 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5561d5f58b30 con 0x5561d607bad0 2023-10-08T12:57:16.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cb6ffd700 10 client.27799 handle_command_reply: tid=0 2023-10-08T12:57:16.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 1 client.27799 shutdown 2023-10-08T12:57:16.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 1 -- 172.21.15.59:0/832163382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 msgr2=0x5561d601c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 0x5561d601c350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8005e80 tx=0x7f9cc8005eb0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 1 -- 172.21.15.59:0/832163382 shutdown_connections 2023-10-08T12:57:16.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5561d607bad0 0x5561d607dec0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561d6017650 0x5561d6079f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5561d600be80 0x5561d601c350 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 1 --2- 172.21.15.59:0/832163382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561d600c7a0 0x5561d601c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cb6ffd700 0 client.27799 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:16.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 1 -- 172.21.15.59:0/832163382 >> 172.21.15.59:0/832163382 conn(0x5561d5f81260 msgr2=0x5561d600f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:16.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 1 -- 172.21.15.59:0/832163382 shutdown_connections 2023-10-08T12:57:16.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 1 -- 172.21.15.59:0/832163382 wait complete. 2023-10-08T12:57:16.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.300+0000 7f9cf190cb80 20 client.27799 trim_cache size 0 max 16384 2023-10-08T12:57:16.303 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:57:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 -- 172.21.15.59:0/1722628068 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9cc00a15f0 msgr2=0x7f9cc00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9cc00a15f0 0x7f9cc00a3ab0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009790 tx=0x7f9cd0009080 comp rx=0 tx=0).stop 2023-10-08T12:57:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 -- 172.21.15.59:0/1722628068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd8069730 msgr2=0x7f9cd819ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd8069730 0x7f9cd819ceb0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00e9f0 tx=0x7f9ccc00ed00 comp rx=0 tx=0).stop 2023-10-08T12:57:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 -- 172.21.15.59:0/1722628068 shutdown_connections 2023-10-08T12:57:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9cc00a15f0 0x7f9cc00a3ab0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8106770 0x7f9cd8196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cd8068d90 0x7f9cd819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 --2- 172.21.15.59:0/1722628068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd8069730 0x7f9cd819ceb0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 -- 172.21.15.59:0/1722628068 >> 172.21.15.59:0/1722628068 conn(0x7f9cd8076820 msgr2=0x7f9cd80fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 -- 172.21.15.59:0/1722628068 shutdown_connections 2023-10-08T12:57:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:16.301+0000 7f9cddfff700 1 -- 172.21.15.59:0/1722628068 wait complete. 2023-10-08T12:57:16.317 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:16 smithi059 ceph-mon[98489]: pgmap v816: 97 pgs: 97 active+clean; 867 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.7 MiB/s wr, 504 op/s 2023-10-08T12:57:16.317 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:16 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4274152178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:57:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:16 smithi092 ceph-mon[134093]: pgmap v816: 97 pgs: 97 active+clean; 867 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.7 MiB/s wr, 504 op/s 2023-10-08T12:57:16.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:16 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4274152178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:57:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:16 smithi173 ceph-mon[135182]: pgmap v816: 97 pgs: 97 active+clean; 867 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.7 MiB/s wr, 504 op/s 2023-10-08T12:57:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:16 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4274152178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:57:16.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 65608 20.14 MB/sec execute 47 sec latency 285.221 ms 2023-10-08T12:57:17.320 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:57:17.320 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:57:17.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.563+0000 7f9a28dff700 1 -- 172.21.15.59:0/3407790770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a2410c500 msgr2=0x7f9a24114080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.563+0000 7f9a28dff700 1 --2- 172.21.15.59:0/3407790770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a2410c500 0x7f9a24114080 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0104b0 tx=0x7f9a1c0107c0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.564+0000 7f9a28dff700 1 -- 172.21.15.59:0/3407790770 shutdown_connections 2023-10-08T12:57:17.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.564+0000 7f9a28dff700 1 --2- 172.21.15.59:0/3407790770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a2410c500 0x7f9a24114080 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.564+0000 7f9a28dff700 1 --2- 172.21.15.59:0/3407790770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a24107a60 0x7f9a24107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.564+0000 7f9a28dff700 1 --2- 172.21.15.59:0/3407790770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a24108410 0x7f9a2410bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.564+0000 7f9a28dff700 1 -- 172.21.15.59:0/3407790770 >> 172.21.15.59:0/3407790770 conn(0x7f9a2406bc80 msgr2=0x7f9a2406c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.566+0000 7f9a28dff700 1 -- 172.21.15.59:0/3407790770 shutdown_connections 2023-10-08T12:57:17.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.569+0000 7f9a28dff700 1 -- 172.21.15.59:0/3407790770 wait complete. 2023-10-08T12:57:17.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.571+0000 7f9a28dff700 1 Processor -- start 2023-10-08T12:57:17.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.571+0000 7f9a28dff700 1 -- start start 2023-10-08T12:57:17.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.571+0000 7f9a28dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a24107a60 0x7f9a241a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.571+0000 7f9a28dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a2410c500 0x7f9a2419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.572+0000 7f9a28dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a2419c9c0 0x7f9a2419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.572+0000 7f9a28dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a241ba860 con 0x7f9a2410c500 2023-10-08T12:57:17.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.572+0000 7f9a28dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a241ba9d0 con 0x7f9a2419c9c0 2023-10-08T12:57:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.572+0000 7f9a28dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a241bab90 con 0x7f9a24107a60 2023-10-08T12:57:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.572+0000 7f9a21d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a2410c500 0x7f9a2419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.572+0000 7f9a21d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a2410c500 0x7f9a2419c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46108/0 (socket says 172.21.15.59:46108) 2023-10-08T12:57:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.572+0000 7f9a21d9b700 1 -- 172.21.15.59:0/1255431510 learned_addr learned my addr 172.21.15.59:0/1255431510 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:17.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.573+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a2419c9c0 0x7f9a2419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.573+0000 7f9a21d9b700 1 -- 172.21.15.59:0/1255431510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a24107a60 msgr2=0x7f9a241a4470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:57:17.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.573+0000 7f9a21d9b700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a24107a60 0x7f9a241a4470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.573+0000 7f9a21d9b700 1 -- 172.21.15.59:0/1255431510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a2419c9c0 msgr2=0x7f9a2419ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.573+0000 7f9a21d9b700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a2419c9c0 0x7f9a2419ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.573+0000 7f9a21d9b700 1 -- 172.21.15.59:0/1255431510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c00bc60 con 0x7f9a2410c500 2023-10-08T12:57:17.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.574+0000 7f9a21d9b700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a2410c500 0x7f9a2419c480 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9a140078d0 tx=0x7f9a14007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.575+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a2419c9c0 0x7f9a2419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:57:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.576+0000 7f9a137fe700 1 -- 172.21.15.59:0/1255431510 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400f040 con 0x7f9a2410c500 2023-10-08T12:57:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.577+0000 7f9a137fe700 1 -- 172.21.15.59:0/1255431510 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a1400de20 con 0x7f9a2410c500 2023-10-08T12:57:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.577+0000 7f9a137fe700 1 -- 172.21.15.59:0/1255431510 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14012360 con 0x7f9a2410c500 2023-10-08T12:57:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.577+0000 7f9a28dff700 1 -- 172.21.15.59:0/1255431510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a241bae70 con 0x7f9a2410c500 2023-10-08T12:57:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.577+0000 7f9a28dff700 1 -- 172.21.15.59:0/1255431510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a241bb2a0 con 0x7f9a2410c500 2023-10-08T12:57:17.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.584+0000 7f9a3c800b80 1 Processor -- start 2023-10-08T12:57:17.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.584+0000 7f9a137fe700 1 -- 172.21.15.59:0/1255431510 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9a14013590 con 0x7f9a2410c500 2023-10-08T12:57:17.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.587+0000 7f9a137fe700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a0c0a1780 0x7f9a0c0a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.587+0000 7f9a137fe700 1 -- 172.21.15.59:0/1255431510 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9a140ccbc0 con 0x7f9a2410c500 2023-10-08T12:57:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.588+0000 7f9a3c800b80 1 -- start start 2023-10-08T12:57:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.589+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e0f00 0x55c2197e12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.589+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197e1820 0x55c2197ec190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.589+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197ec6d0 0x55c2197eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.589+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21974a4e0 con 0x55c2197e1820 2023-10-08T12:57:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.589+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21973bca0 con 0x55c2197e0f00 2023-10-08T12:57:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.589+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2197395c0 con 0x55c2197ec6d0 2023-10-08T12:57:17.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.589+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a0c0a1780 0x7f9a0c0a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.590+0000 7f9a22d9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197ec6d0 0x55c2197eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.590+0000 7f9a21d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197e1820 0x55c2197ec190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.590+0000 7f9a21d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197e1820 0x55c2197ec190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46112/0 (socket says 172.21.15.59:46112) 2023-10-08T12:57:17.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.590+0000 7f9a21d9b700 1 -- 172.21.15.59:0/4026144901 learned_addr learned my addr 172.21.15.59:0/4026144901 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:17.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.591+0000 7f9a22d9d700 1 -- 172.21.15.59:0/4026144901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e0f00 msgr2=0x55c2197e12e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:57:17.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.591+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/4026144901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e0f00 0x55c2197e12e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.591+0000 7f9a22d9d700 1 -- 172.21.15.59:0/4026144901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197e1820 msgr2=0x55c2197ec190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:17.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.591+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/4026144901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197e1820 0x55c2197ec190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.591+0000 7f9a22d9d700 1 -- 172.21.15.59:0/4026144901 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c21955fe60 con 0x55c2197ec6d0 2023-10-08T12:57:17.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.591+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a0c0a1780 0x7f9a0c0a3c40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c010480 tx=0x7f9a1c00b280 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:17.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.592+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/4026144901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197ec6d0 0x55c2197eeac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c010c00 tx=0x7f9a1c025000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1864d567a65a42bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:17.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.595+0000 7f9a10ff9700 1 -- 172.21.15.59:0/4026144901 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c018440 con 0x55c2197ec6d0 2023-10-08T12:57:17.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.595+0000 7f9a10ff9700 1 -- 172.21.15.59:0/4026144901 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a1c018c40 con 0x55c2197ec6d0 2023-10-08T12:57:17.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.595+0000 7f9a10ff9700 1 -- 172.21.15.59:0/4026144901 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c019840 con 0x55c2197ec6d0 2023-10-08T12:57:17.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.597+0000 7f9a3c800b80 1 -- 172.21.15.59:0/4026144901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197ec6d0 msgr2=0x55c2197eeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.597+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/4026144901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197ec6d0 0x55c2197eeac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c010c00 tx=0x7f9a1c025000 comp rx=0 tx=0).stop 2023-10-08T12:57:17.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.598+0000 7f9a3c800b80 1 -- 172.21.15.59:0/4026144901 shutdown_connections 2023-10-08T12:57:17.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.598+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/4026144901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e0f00 0x55c2197e12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.598+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/4026144901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197ec6d0 0x55c2197eeac0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.598+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/4026144901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197e1820 0x55c2197ec190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.598+0000 7f9a3c800b80 1 -- 172.21.15.59:0/4026144901 >> 172.21.15.59:0/4026144901 conn(0x55c2197562e0 msgr2=0x55c2197dd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:17.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.598+0000 7f9a3c800b80 1 -- 172.21.15.59:0/4026144901 shutdown_connections 2023-10-08T12:57:17.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.598+0000 7f9a3c800b80 1 -- 172.21.15.59:0/4026144901 wait complete. 2023-10-08T12:57:17.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.599+0000 7f9a3c800b80 1 -- start start 2023-10-08T12:57:17.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.600+0000 7f9a3c800b80 1 Processor -- start 2023-10-08T12:57:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.600+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2197e9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.600+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e1820 0x55c2197e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.600+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 0x55c2197e9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.600+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c219734eb0 con 0x55c2197ec6d0 2023-10-08T12:57:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.600+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2196d1790 con 0x55c2197e1820 2023-10-08T12:57:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.600+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2196d1430 con 0x55c2197e0f00 2023-10-08T12:57:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.600+0000 7f9a3c800b80 10 client.0 _ll_register_callbacks cb 0x55c21952e880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.601+0000 7f9a2259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2197e9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.604+0000 7f9a2259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2197e9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51274/0 (socket says 172.21.15.59:51274) 2023-10-08T12:57:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.604+0000 7f9a2259c700 1 -- 172.21.15.59:0/2269313177 learned_addr learned my addr 172.21.15.59:0/2269313177 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.604+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 0x55c2197e9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.606+0000 7f9a2259c700 1 -- 172.21.15.59:0/2269313177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e1820 msgr2=0x55c2197e9a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:57:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.606+0000 7f9a2259c700 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e1820 0x55c2197e9a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.606+0000 7f9a2259c700 1 -- 172.21.15.59:0/2269313177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 msgr2=0x55c2197e9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.606+0000 7f9a2259c700 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 0x55c2197e9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.606+0000 7f9a2259c700 1 -- 172.21.15.59:0/2269313177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a241148c0 con 0x55c2197e0f00 2023-10-08T12:57:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.606+0000 7f9a2259c700 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2197e9510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009ec0 tx=0x7f9a1800b3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36013c773e4d5bbd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.606+0000 7f9a09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:57:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.607+0000 7f9a09ffb700 1 -- 172.21.15.59:0/2269313177 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18011420 con 0x55c2197e0f00 2023-10-08T12:57:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.607+0000 7f9a09ffb700 1 -- 172.21.15.59:0/2269313177 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9a18011580 con 0x55c2197e0f00 2023-10-08T12:57:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.607+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2269313177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2196fcf30 con 0x55c2197e0f00 2023-10-08T12:57:17.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.608+0000 7f9a09ffb700 1 -- 172.21.15.59:0/2269313177 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a18011740 con 0x55c2197e0f00 2023-10-08T12:57:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.611+0000 7f9a3c800b80 10 client.27805 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.611+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2269313177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c219548ce0 con 0x55c2197e0f00 2023-10-08T12:57:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.612+0000 7f9a09ffb700 1 -- 172.21.15.59:0/2269313177 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c2196fcf30 con 0x55c2197e0f00 2023-10-08T12:57:17.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.612+0000 7f9a09ffb700 1 -- 172.21.15.59:0/2269313177 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9a1801aa00 con 0x55c2197e0f00 2023-10-08T12:57:17.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.612+0000 7f9a3c800b80 10 client.27805 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:17.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.612+0000 7f9a3c800b80 10 client.27805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:17.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.612+0000 7f9a3c800b80 20 client.27805 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:17.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.612+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c2197fc180 0x55c2197fe5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.612+0000 7f9a3c800b80 4 client.27805 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:57:17.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.612+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2269313177 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c21972de90 con 0x55c2197fc180 2023-10-08T12:57:17.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.613+0000 7f9a21d9b700 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c2197fc180 0x55c2197fe5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.613+0000 7f9a09ffb700 10 client.27805 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:17.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.613+0000 7f9a21d9b700 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c2197fc180 0x55c2197fe5a0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9ae6e298ece73dc server_cookie=7bde53eb13378be1 in_seq=0 out_seq=0 2023-10-08T12:57:17.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.620+0000 7f9a09ffb700 1 -- 172.21.15.59:0/2269313177 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c21972de90 con 0x55c2197fc180 2023-10-08T12:57:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.620+0000 7f9a09ffb700 10 client.27805 handle_command_reply: tid=0 2023-10-08T12:57:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.621+0000 7f9a3c800b80 1 client.27805 shutdown 2023-10-08T12:57:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.621+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2269313177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 msgr2=0x55c2197e9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.621+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2197e9510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009ec0 tx=0x7f9a1800b3c0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.621+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2269313177 shutdown_connections 2023-10-08T12:57:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.621+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c2197fc180 0x55c2197fe5a0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.621+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 0x55c2197e9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.621+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2197e9510 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.621+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/2269313177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e1820 0x55c2197e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.621+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2269313177 >> 172.21.15.59:0/2269313177 conn(0x55c2197562e0 msgr2=0x55c2197dcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.621+0000 7f9a09ffb700 0 client.27805 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.621+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2269313177 shutdown_connections 2023-10-08T12:57:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.622+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2269313177 wait complete. 2023-10-08T12:57:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.622+0000 7f9a3c800b80 20 client.27805 trim_cache size 0 max 16384 2023-10-08T12:57:17.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.657+0000 7f9a3c800b80 1 Processor -- start 2023-10-08T12:57:17.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.657+0000 7f9a3c800b80 1 -- start start 2023-10-08T12:57:17.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.657+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e0f00 0x55c2197f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.657+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e1820 0x55c2197e3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.657+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 0x55c2197e6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.657+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2195b59a0 con 0x55c2197ec6d0 2023-10-08T12:57:17.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.657+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2197e1c60 con 0x55c2197e0f00 2023-10-08T12:57:17.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.657+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2197e4380 con 0x55c2197e1820 2023-10-08T12:57:17.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.658+0000 7f9a22d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 0x55c2197e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.658+0000 7f9a21d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e1820 0x55c2197e3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.658+0000 7f9a22d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 0x55c2197e6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46138/0 (socket says 172.21.15.59:46138) 2023-10-08T12:57:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.658+0000 7f9a22d9d700 1 -- 172.21.15.59:0/2006693838 learned_addr learned my addr 172.21.15.59:0/2006693838 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.659+0000 7f9a22d9d700 1 -- 172.21.15.59:0/2006693838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e1820 msgr2=0x55c2197e3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.659+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/2006693838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e1820 0x55c2197e3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.659+0000 7f9a22d9d700 1 -- 172.21.15.59:0/2006693838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e0f00 msgr2=0x55c2197f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.659+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/2006693838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e0f00 0x55c2197f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.659+0000 7f9a22d9d700 1 -- 172.21.15.59:0/2006693838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2197d9320 con 0x55c2197ec6d0 2023-10-08T12:57:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.659+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/2006693838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 0x55c2197e6790 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009fa0 tx=0x7f9a1c018690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6aaa25c1e7613b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.661+0000 7f9a117fa700 1 -- 172.21.15.59:0/2006693838 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c018db0 con 0x55c2197ec6d0 2023-10-08T12:57:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.661+0000 7f9a117fa700 1 -- 172.21.15.59:0/2006693838 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a1c037040 con 0x55c2197ec6d0 2023-10-08T12:57:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.661+0000 7f9a117fa700 1 -- 172.21.15.59:0/2006693838 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c009850 con 0x55c2197ec6d0 2023-10-08T12:57:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.662+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2006693838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 msgr2=0x55c2197e6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.662+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/2006693838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 0x55c2197e6790 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009fa0 tx=0x7f9a1c018690 comp rx=0 tx=0).stop 2023-10-08T12:57:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.662+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2006693838 shutdown_connections 2023-10-08T12:57:17.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.662+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/2006693838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197e0f00 0x55c2197f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.662+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/2006693838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197ec6d0 0x55c2197e6790 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.662+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/2006693838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e1820 0x55c2197e3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.662+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2006693838 >> 172.21.15.59:0/2006693838 conn(0x55c2197562e0 msgr2=0x55c2197e2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.662+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2006693838 shutdown_connections 2023-10-08T12:57:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.662+0000 7f9a3c800b80 1 -- 172.21.15.59:0/2006693838 wait complete. 2023-10-08T12:57:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.663+0000 7f9a3c800b80 1 -- start start 2023-10-08T12:57:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.663+0000 7f9a3c800b80 1 Processor -- start 2023-10-08T12:57:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2198487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197e1820 0x55c219848d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a3c800b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197ec6d0 0x55c219843f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2198445e0 con 0x55c2197e1820 2023-10-08T12:57:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c219844750 con 0x55c2197ec6d0 2023-10-08T12:57:17.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a3c800b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c219844910 con 0x55c2197e0f00 2023-10-08T12:57:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a3c800b80 10 client.0 _ll_register_callbacks cb 0x7f9a18009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:17.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a2259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2198487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a2259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2198487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51304/0 (socket says 172.21.15.59:51304) 2023-10-08T12:57:17.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a2259c700 1 -- 172.21.15.59:0/1020368012 learned_addr learned my addr 172.21.15.59:0/1020368012 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:17.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a22d9d700 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197ec6d0 0x55c219843f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.664+0000 7f9a21d9b700 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197e1820 0x55c219848d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.665+0000 7f9a2259c700 1 -- 172.21.15.59:0/1020368012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197ec6d0 msgr2=0x55c219843f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.665+0000 7f9a2259c700 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197ec6d0 0x55c219843f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.665+0000 7f9a2259c700 1 -- 172.21.15.59:0/1020368012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197e1820 msgr2=0x55c219848d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.665+0000 7f9a2259c700 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197e1820 0x55c219848d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.665+0000 7f9a2259c700 1 -- 172.21.15.59:0/1020368012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c21955fe60 con 0x55c2197e0f00 2023-10-08T12:57:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.665+0000 7f9a2259c700 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2198487d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009b60 tx=0x7f9a18009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17ce331ce5c2f774 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.665+0000 7f9a09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:57:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.665+0000 7f9a09ffb700 1 -- 172.21.15.59:0/1020368012 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1801a5f0 con 0x55c2197e0f00 2023-10-08T12:57:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.665+0000 7f9a09ffb700 1 -- 172.21.15.59:0/1020368012 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9a18000e40 con 0x55c2197e0f00 2023-10-08T12:57:17.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.665+0000 7f9a3c800b80 1 -- 172.21.15.59:0/1020368012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a1c018c40 con 0x55c2197e0f00 2023-10-08T12:57:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.666+0000 7f9a09ffb700 1 -- 172.21.15.59:0/1020368012 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a1801a750 con 0x55c2197e0f00 2023-10-08T12:57:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.666+0000 7f9a3c800b80 10 client.27811 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.666+0000 7f9a3c800b80 1 -- 172.21.15.59:0/1020368012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c2195862d0 con 0x55c2197e0f00 2023-10-08T12:57:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.666+0000 7f9a09ffb700 1 -- 172.21.15.59:0/1020368012 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a1c018c40 con 0x55c2197e0f00 2023-10-08T12:57:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.666+0000 7f9a09ffb700 1 -- 172.21.15.59:0/1020368012 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9a18019cb0 con 0x55c2197e0f00 2023-10-08T12:57:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.666+0000 7f9a3c800b80 10 client.27811 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.666+0000 7f9a3c800b80 10 client.27811 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.666+0000 7f9a3c800b80 20 client.27811 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.666+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c219851750 0x55c219853b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.666+0000 7f9a3c800b80 4 client.27811 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:57:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.666+0000 7f9a3c800b80 1 -- 172.21.15.59:0/1020368012 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c21972dbb0 con 0x55c219851750 2023-10-08T12:57:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.667+0000 7f9a21d9b700 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c219851750 0x55c219853b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.669+0000 7f9a21d9b700 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c219851750 0x55c219853b70 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be9f1f9d072f8cc0 server_cookie=7c938ace82af9338 in_seq=0 out_seq=0 2023-10-08T12:57:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.670+0000 7f9a09ffb700 10 client.27811 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.674+0000 7f9a09ffb700 1 -- 172.21.15.59:0/1020368012 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c21972dbb0 con 0x55c219851750 2023-10-08T12:57:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.674+0000 7f9a09ffb700 10 client.27811 handle_command_reply: tid=0 2023-10-08T12:57:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.674+0000 7f9a3c800b80 1 client.27811 shutdown 2023-10-08T12:57:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.675+0000 7f9a3c800b80 1 -- 172.21.15.59:0/1020368012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 msgr2=0x55c2198487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.675+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2198487d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009b60 tx=0x7f9a18009230 comp rx=0 tx=0).stop 2023-10-08T12:57:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.678+0000 7f9a3c800b80 1 -- 172.21.15.59:0/1020368012 shutdown_connections 2023-10-08T12:57:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.678+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c219851750 0x55c219853b70 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.678+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2197ec6d0 0x55c219843f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.678+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2197e0f00 0x55c2198487d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.678+0000 7f9a3c800b80 1 --2- 172.21.15.59:0/1020368012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2197e1820 0x55c219848d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.678+0000 7f9a3c800b80 1 -- 172.21.15.59:0/1020368012 >> 172.21.15.59:0/1020368012 conn(0x55c2197562e0 msgr2=0x55c2197e37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:17.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.678+0000 7f9a09ffb700 0 client.27811 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:17.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.681+0000 7f9a3c800b80 1 -- 172.21.15.59:0/1020368012 shutdown_connections 2023-10-08T12:57:17.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.683+0000 7f9a3c800b80 1 -- 172.21.15.59:0/1020368012 wait complete. 2023-10-08T12:57:17.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.685+0000 7f9a3c800b80 20 client.27811 trim_cache size 0 max 16384 2023-10-08T12:57:17.690 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:57:17.690 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:57:17.690 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "c2a1d04e-ca26-47ce-ae6d-42d531c24036", 2023-10-08T12:57:17.690 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:57:17.690 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:57:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.691+0000 7f9a28dff700 1 -- 172.21.15.59:0/1255431510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a0c0a1780 msgr2=0x7f9a0c0a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.691+0000 7f9a28dff700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a0c0a1780 0x7f9a0c0a3c40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c010480 tx=0x7f9a1c00b280 comp rx=0 tx=0).stop 2023-10-08T12:57:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.691+0000 7f9a28dff700 1 -- 172.21.15.59:0/1255431510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a2410c500 msgr2=0x7f9a2419c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.691+0000 7f9a28dff700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a2410c500 0x7f9a2419c480 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9a140078d0 tx=0x7f9a14007c90 comp rx=0 tx=0).stop 2023-10-08T12:57:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.692+0000 7f9a28dff700 1 -- 172.21.15.59:0/1255431510 shutdown_connections 2023-10-08T12:57:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.692+0000 7f9a28dff700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f9a0c0a1780 0x7f9a0c0a3c40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.692+0000 7f9a28dff700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a2419c9c0 0x7f9a2419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.692+0000 7f9a28dff700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a24107a60 0x7f9a241a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.692+0000 7f9a28dff700 1 --2- 172.21.15.59:0/1255431510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a2410c500 0x7f9a2419c480 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.692+0000 7f9a28dff700 1 -- 172.21.15.59:0/1255431510 >> 172.21.15.59:0/1255431510 conn(0x7f9a2406bc80 msgr2=0x7f9a240704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.693+0000 7f9a28dff700 1 -- 172.21.15.59:0/1255431510 shutdown_connections 2023-10-08T12:57:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.693+0000 7f9a28dff700 1 -- 172.21.15.59:0/1255431510 wait complete. 2023-10-08T12:57:17.714 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:57:17.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 66027 20.35 MB/sec execute 48 sec latency 84.797 ms 2023-10-08T12:57:17.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.960+0000 7f7b79dff700 1 -- 172.21.15.59:0/686508098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b741051c0 msgr2=0x7f7b74105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.960+0000 7f7b79dff700 1 --2- 172.21.15.59:0/686508098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b741051c0 0x7f7b74105640 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7b680099c0 tx=0x7f7b68009cd0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.960+0000 7f7b79dff700 1 -- 172.21.15.59:0/686508098 shutdown_connections 2023-10-08T12:57:17.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.960+0000 7f7b79dff700 1 --2- 172.21.15.59:0/686508098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b74067ce0 0x7f7b740680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.960+0000 7f7b79dff700 1 --2- 172.21.15.59:0/686508098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b74105b80 0x7f7b7410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.960+0000 7f7b79dff700 1 --2- 172.21.15.59:0/686508098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b741051c0 0x7f7b74105640 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.960+0000 7f7b79dff700 1 -- 172.21.15.59:0/686508098 >> 172.21.15.59:0/686508098 conn(0x7f7b74076780 msgr2=0x7f7b74076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:17.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.960+0000 7f7b79dff700 1 -- 172.21.15.59:0/686508098 shutdown_connections 2023-10-08T12:57:17.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.960+0000 7f7b79dff700 1 -- 172.21.15.59:0/686508098 wait complete. 2023-10-08T12:57:17.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.964+0000 7f7b79dff700 1 Processor -- start 2023-10-08T12:57:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.964+0000 7f7b79dff700 1 -- start start 2023-10-08T12:57:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.964+0000 7f7b79dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b74067ce0 0x7f7b7410c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.965+0000 7f7b79dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b741051c0 0x7f7b7410cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.965+0000 7f7b79dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b74105b80 0x7f7b741a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.965+0000 7f7b79dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b741a2130 con 0x7f7b74067ce0 2023-10-08T12:57:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.965+0000 7f7b79dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b741a22a0 con 0x7f7b741051c0 2023-10-08T12:57:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.965+0000 7f7b79dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b741a2460 con 0x7f7b74105b80 2023-10-08T12:57:17.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.965+0000 7f7b73fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b74105b80 0x7f7b741a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.965+0000 7f7b73fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b74105b80 0x7f7b741a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51326/0 (socket says 172.21.15.59:51326) 2023-10-08T12:57:17.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.965+0000 7f7b73fff700 1 -- 172.21.15.59:0/96975029 learned_addr learned my addr 172.21.15.59:0/96975029 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:17.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.966+0000 7f7b737fe700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b74067ce0 0x7f7b7410c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.966+0000 7f7b73fff700 1 -- 172.21.15.59:0/96975029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b741051c0 msgr2=0x7f7b7410cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.966+0000 7f7b73fff700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b741051c0 0x7f7b7410cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.966+0000 7f7b73fff700 1 -- 172.21.15.59:0/96975029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b74067ce0 msgr2=0x7f7b7410c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.966+0000 7f7b73fff700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b74067ce0 0x7f7b7410c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.966+0000 7f7b73fff700 1 -- 172.21.15.59:0/96975029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64009520 con 0x7f7b74105b80 2023-10-08T12:57:17.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.967+0000 7f7b73fff700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b74105b80 0x7f7b741a1af0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00ef30 tx=0x7f7b6c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.967+0000 7f7b70ff9700 1 -- 172.21.15.59:0/96975029 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c018070 con 0x7f7b74105b80 2023-10-08T12:57:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.967+0000 7f7b70ff9700 1 -- 172.21.15.59:0/96975029 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b6c00f040 con 0x7f7b74105b80 2023-10-08T12:57:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.967+0000 7f7b79dff700 1 -- 172.21.15.59:0/96975029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b680095f0 con 0x7f7b74105b80 2023-10-08T12:57:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.967+0000 7f7b70ff9700 1 -- 172.21.15.59:0/96975029 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c00cdb0 con 0x7f7b74105b80 2023-10-08T12:57:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.967+0000 7f7b79dff700 1 -- 172.21.15.59:0/96975029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7406a210 con 0x7f7b74105b80 2023-10-08T12:57:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.971+0000 7f7b70ff9700 1 -- 172.21.15.59:0/96975029 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7b6c003a00 con 0x7f7b74105b80 2023-10-08T12:57:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.972+0000 7f7b8d6b3b80 1 Processor -- start 2023-10-08T12:57:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.972+0000 7f7b8d6b3b80 1 -- start start 2023-10-08T12:57:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.972+0000 7f7b70ff9700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b5c0a1670 0x7f7b5c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.972+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 0x564463e6e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b70ff9700 1 -- 172.21.15.59:0/96975029 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7b6c0ccc90 con 0x7f7b74105b80 2023-10-08T12:57:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e79110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e7ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463dd7460 con 0x564463e79650 2023-10-08T12:57:17.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463dc8c20 con 0x564463e6de80 2023-10-08T12:57:17.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463dc6540 con 0x564463e6e7a0 2023-10-08T12:57:17.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b737fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 0x564463e6e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b72ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e79110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b72ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e79110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51334/0 (socket says 172.21.15.59:51334) 2023-10-08T12:57:17.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b737fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 0x564463e6e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:50932/0 (socket says 172.21.15.59:50932) 2023-10-08T12:57:17.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b72ffd700 1 -- 172.21.15.59:0/2134303813 learned_addr learned my addr 172.21.15.59:0/2134303813 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:17.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b73fff700 1 --2- 172.21.15.59:0/2134303813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e7ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b72ffd700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b5c0a1670 0x7f7b5c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b72ffd700 1 -- 172.21.15.59:0/2134303813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 msgr2=0x564463e6e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:17.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b72ffd700 1 --2- 172.21.15.59:0/2134303813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 0x564463e6e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b72ffd700 1 -- 172.21.15.59:0/2134303813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 msgr2=0x564463e7ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:17.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b72ffd700 1 --2- 172.21.15.59:0/2134303813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e7ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.973+0000 7f7b72ffd700 1 -- 172.21.15.59:0/2134303813 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564463becde0 con 0x564463e6e7a0 2023-10-08T12:57:17.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.974+0000 7f7b72ffd700 1 --2- 172.21.15.59:0/2134303813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e79110 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7b68015000 tx=0x7f7b6800ba70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11b14e82586dcd06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:17.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.974+0000 7f7b59ffb700 1 -- 172.21.15.59:0/2134303813 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6800b790 con 0x564463e6e7a0 2023-10-08T12:57:17.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.974+0000 7f7b59ffb700 1 -- 172.21.15.59:0/2134303813 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b68005500 con 0x564463e6e7a0 2023-10-08T12:57:17.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.974+0000 7f7b59ffb700 1 -- 172.21.15.59:0/2134303813 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6800fc10 con 0x564463e6e7a0 2023-10-08T12:57:17.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.974+0000 7f7b72ffd700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b5c0a1670 0x7f7b5c0a3b30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7b68029000 tx=0x7f7b68025000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:17.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.975+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/2134303813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 msgr2=0x564463e79110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.975+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/2134303813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e79110 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7b68015000 tx=0x7f7b6800ba70 comp rx=0 tx=0).stop 2023-10-08T12:57:17.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.975+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/2134303813 shutdown_connections 2023-10-08T12:57:17.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.975+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/2134303813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 0x564463e6e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.975+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/2134303813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e7ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.975+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/2134303813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e79110 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.975+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/2134303813 >> 172.21.15.59:0/2134303813 conn(0x564463de3260 msgr2=0x564463e6a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:17.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.975+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/2134303813 shutdown_connections 2023-10-08T12:57:17.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.975+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/2134303813 wait complete. 2023-10-08T12:57:17.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.976+0000 7f7b8d6b3b80 1 -- start start 2023-10-08T12:57:17.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.976+0000 7f7b8d6b3b80 1 Processor -- start 2023-10-08T12:57:17.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.976+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 0x564463e79040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.976+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e76330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.976+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e769b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.976+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463dc1e30 con 0x564463e79650 2023-10-08T12:57:17.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.976+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463d5e710 con 0x564463e6de80 2023-10-08T12:57:17.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.976+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463d5e3b0 con 0x564463e6e7a0 2023-10-08T12:57:17.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.976+0000 7f7b8d6b3b80 10 client.0 _ll_register_callbacks cb 0x564463bbb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:17.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b72ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e76330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b737fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 0x564463e79040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b72ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e76330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51336/0 (socket says 172.21.15.59:51336) 2023-10-08T12:57:17.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b72ffd700 1 -- 172.21.15.59:0/396714417 learned_addr learned my addr 172.21.15.59:0/396714417 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:17.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b73fff700 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b737fe700 1 -- 172.21.15.59:0/396714417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 msgr2=0x564463e76330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:17.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b737fe700 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e76330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b737fe700 1 -- 172.21.15.59:0/396714417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 msgr2=0x564463e769b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:17.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b737fe700 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e769b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b737fe700 1 -- 172.21.15.59:0/396714417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6801f040 con 0x564463e6de80 2023-10-08T12:57:17.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b72ffd700 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e76330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:17.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b737fe700 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 0x564463e79040 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7b64012950 tx=0x7f7b64012c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e14e703c441ede96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:17.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.977+0000 7f7b52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:57:17.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.978+0000 7f7b52ffd700 1 -- 172.21.15.59:0/396714417 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64017070 con 0x564463e6de80 2023-10-08T12:57:17.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.978+0000 7f7b52ffd700 1 -- 172.21.15.59:0/396714417 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7b6400f580 con 0x564463e6de80 2023-10-08T12:57:17.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.978+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/396714417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564463d89eb0 con 0x564463e6de80 2023-10-08T12:57:17.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.978+0000 7f7b52ffd700 1 -- 172.21.15.59:0/396714417 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b6400f780 con 0x564463e6de80 2023-10-08T12:57:17.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.978+0000 7f7b8d6b3b80 10 client.27824 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:17.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.978+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/396714417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x564463bd5c60 con 0x564463e6de80 2023-10-08T12:57:17.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.978+0000 7f7b52ffd700 1 -- 172.21.15.59:0/396714417 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564463d89eb0 con 0x564463e6de80 2023-10-08T12:57:17.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.979+0000 7f7b52ffd700 1 -- 172.21.15.59:0/396714417 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7b64026950 con 0x564463e6de80 2023-10-08T12:57:17.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.979+0000 7f7b8d6b3b80 10 client.27824 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:17.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.979+0000 7f7b8d6b3b80 10 client.27824 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:17.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.979+0000 7f7b8d6b3b80 20 client.27824 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:17.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.979+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564463e891c0 0x564463e8b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:17.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.979+0000 7f7b8d6b3b80 4 client.27824 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:57:17.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.979+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/396714417 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564463dbae10 con 0x564463e891c0 2023-10-08T12:57:17.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.979+0000 7f7b72ffd700 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564463e891c0 0x564463e8b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:17.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.980+0000 7f7b72ffd700 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564463e891c0 0x564463e8b5b0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e52a00e4bcb7983 server_cookie=b3dd826ad7c7399e in_seq=0 out_seq=0 2023-10-08T12:57:17.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.980+0000 7f7b52ffd700 10 client.27824 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:17.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b52ffd700 1 -- 172.21.15.59:0/396714417 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564463dbae10 con 0x564463e891c0 2023-10-08T12:57:17.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b52ffd700 10 client.27824 handle_command_reply: tid=0 2023-10-08T12:57:17.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 1 client.27824 shutdown 2023-10-08T12:57:17.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/396714417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 msgr2=0x564463e79040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:17.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 0x564463e79040 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7b64012950 tx=0x7f7b64012c60 comp rx=0 tx=0).stop 2023-10-08T12:57:17.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/396714417 shutdown_connections 2023-10-08T12:57:17.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564463e891c0 0x564463e8b5b0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6de80 0x564463e79040 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e769b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/396714417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6e7a0 0x564463e76330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:17.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/396714417 >> 172.21.15.59:0/396714417 conn(0x564463de3260 msgr2=0x564463e69ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:17.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b52ffd700 0 client.27824 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:17.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/396714417 shutdown_connections 2023-10-08T12:57:17.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/396714417 wait complete. 2023-10-08T12:57:17.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:17.984+0000 7f7b8d6b3b80 20 client.27824 trim_cache size 0 max 16384 2023-10-08T12:57:18.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b8d6b3b80 1 Processor -- start 2023-10-08T12:57:18.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b8d6b3b80 1 -- start start 2023-10-08T12:57:18.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:18.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e6e7a0 0x564463e71610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:18.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e79650 0x564463e71b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463c42920 con 0x564463e6e7a0 2023-10-08T12:57:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463e66b10 con 0x564463e79650 2023-10-08T12:57:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463e772c0 con 0x564463e6de80 2023-10-08T12:57:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b737fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b72ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e6e7a0 0x564463e71610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b737fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e801a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51352/0 (socket says 172.21.15.59:51352) 2023-10-08T12:57:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b737fe700 1 -- 172.21.15.59:0/784881927 learned_addr learned my addr 172.21.15.59:0/784881927 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.002+0000 7f7b73fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e79650 0x564463e71b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.003+0000 7f7b737fe700 1 -- 172.21.15.59:0/784881927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e79650 msgr2=0x564463e71b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.003+0000 7f7b737fe700 1 --2- 172.21.15.59:0/784881927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e79650 0x564463e71b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.003+0000 7f7b737fe700 1 -- 172.21.15.59:0/784881927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e6e7a0 msgr2=0x564463e71610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.003+0000 7f7b737fe700 1 --2- 172.21.15.59:0/784881927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e6e7a0 0x564463e71610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.003+0000 7f7b737fe700 1 -- 172.21.15.59:0/784881927 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564463c13250 con 0x564463e6de80 2023-10-08T12:57:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.003+0000 7f7b72ffd700 1 --2- 172.21.15.59:0/784881927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e6e7a0 0x564463e71610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.003+0000 7f7b737fe700 1 --2- 172.21.15.59:0/784881927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e801a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7b64005a60 tx=0x7f7b6400f440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dbdb37f0bb1360d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.003+0000 7f7b5a7fc700 1 -- 172.21.15.59:0/784881927 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64017040 con 0x564463e6de80 2023-10-08T12:57:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.003+0000 7f7b5a7fc700 1 -- 172.21.15.59:0/784881927 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b6402c070 con 0x564463e6de80 2023-10-08T12:57:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.003+0000 7f7b5a7fc700 1 -- 172.21.15.59:0/784881927 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b640038e0 con 0x564463e6de80 2023-10-08T12:57:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.004+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/784881927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 msgr2=0x564463e801a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.004+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/784881927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e801a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7b64005a60 tx=0x7f7b6400f440 comp rx=0 tx=0).stop 2023-10-08T12:57:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.004+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/784881927 shutdown_connections 2023-10-08T12:57:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.004+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/784881927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e79650 0x564463e71b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.004+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/784881927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e801a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.004+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/784881927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e6e7a0 0x564463e71610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.004+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/784881927 >> 172.21.15.59:0/784881927 conn(0x564463de3260 msgr2=0x564463e78c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.004+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/784881927 shutdown_connections 2023-10-08T12:57:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.004+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/784881927 wait complete. 2023-10-08T12:57:18.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.004+0000 7f7b8d6b3b80 1 -- start start 2023-10-08T12:57:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.005+0000 7f7b8d6b3b80 1 Processor -- start 2023-10-08T12:57:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.005+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e80080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.005+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6e7a0 0x564463e7e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.005+0000 7f7b8d6b3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e7eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.005+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463e7f070 con 0x564463e79650 2023-10-08T12:57:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.005+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463e7f1b0 con 0x564463e6e7a0 2023-10-08T12:57:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.005+0000 7f7b8d6b3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564463e7f370 con 0x564463e6de80 2023-10-08T12:57:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.005+0000 7f7b8d6b3b80 10 client.0 _ll_register_callbacks cb 0x7f7b64012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.005+0000 7f7b737fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e80080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.005+0000 7f7b72ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6e7a0 0x564463e7e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.005+0000 7f7b737fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e80080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:51360/0 (socket says 172.21.15.59:51360) 2023-10-08T12:57:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.006+0000 7f7b737fe700 1 -- 172.21.15.59:0/1101711439 learned_addr learned my addr 172.21.15.59:0/1101711439 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.006+0000 7f7b73fff700 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e7eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.006+0000 7f7b737fe700 1 -- 172.21.15.59:0/1101711439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6e7a0 msgr2=0x564463e7e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.006+0000 7f7b737fe700 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6e7a0 0x564463e7e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.006+0000 7f7b737fe700 1 -- 172.21.15.59:0/1101711439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 msgr2=0x564463e7eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.006+0000 7f7b737fe700 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e7eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.006+0000 7f7b737fe700 1 -- 172.21.15.59:0/1101711439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564463becde0 con 0x564463e6de80 2023-10-08T12:57:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.006+0000 7f7b737fe700 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e80080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7b640126a0 tx=0x7f7b640268e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a91bbfcc152d8f9f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.006+0000 7f7b52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:57:18.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.006+0000 7f7b52ffd700 1 -- 172.21.15.59:0/1101711439 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64005310 con 0x564463e6de80 2023-10-08T12:57:18.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.006+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/1101711439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b68005500 con 0x564463e6de80 2023-10-08T12:57:18.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b52ffd700 1 -- 172.21.15.59:0/1101711439 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7b64005470 con 0x564463e6de80 2023-10-08T12:57:18.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b52ffd700 1 -- 172.21.15.59:0/1101711439 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b64009260 con 0x564463e6de80 2023-10-08T12:57:18.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b8d6b3b80 10 client.27829 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:18.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/1101711439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x564463bd5c60 con 0x564463e6de80 2023-10-08T12:57:18.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b52ffd700 1 -- 172.21.15.59:0/1101711439 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b68005500 con 0x564463e6de80 2023-10-08T12:57:18.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b52ffd700 1 -- 172.21.15.59:0/1101711439 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7b6400f7f0 con 0x564463e6de80 2023-10-08T12:57:18.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b8d6b3b80 10 client.27829 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b8d6b3b80 10 client.27829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b8d6b3b80 20 client.27829 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564463ede220 0x564463ee0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b8d6b3b80 4 client.27829 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:57:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/1101711439 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564463dbab30 con 0x564463ede220 2023-10-08T12:57:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.007+0000 7f7b72ffd700 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564463ede220 0x564463ee0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.008+0000 7f7b72ffd700 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564463ede220 0x564463ee0640 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c301102469946eeb server_cookie=6fa75f7aec3f4554 in_seq=0 out_seq=0 2023-10-08T12:57:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.008+0000 7f7b52ffd700 10 client.27829 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:18.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.012+0000 7f7b52ffd700 1 -- 172.21.15.59:0/1101711439 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x564463dbab30 con 0x564463ede220 2023-10-08T12:57:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.012+0000 7f7b52ffd700 10 client.27829 handle_command_reply: tid=0 2023-10-08T12:57:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.012+0000 7f7b8d6b3b80 1 client.27829 shutdown 2023-10-08T12:57:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.012+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/1101711439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 msgr2=0x564463e80080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.012+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e80080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7b640126a0 tx=0x7f7b640268e0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.012+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/1101711439 shutdown_connections 2023-10-08T12:57:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.012+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x564463ede220 0x564463ee0640 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.012+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564463e79650 0x564463e7eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.012+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564463e6de80 0x564463e80080 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.012+0000 7f7b8d6b3b80 1 --2- 172.21.15.59:0/1101711439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564463e6e7a0 0x564463e7e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.012+0000 7f7b52ffd700 0 client.27829 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:18.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/1101711439 >> 172.21.15.59:0/1101711439 conn(0x564463de3260 msgr2=0x564463e74b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:18.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/1101711439 shutdown_connections 2023-10-08T12:57:18.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b8d6b3b80 1 -- 172.21.15.59:0/1101711439 wait complete. 2023-10-08T12:57:18.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b8d6b3b80 20 client.27829 trim_cache size 0 max 16384 2023-10-08T12:57:18.017 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:57:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "scrub active (245 inodes in the stack)", 2023-10-08T12:57:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:57:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: "c2a1d04e-ca26-47ce-ae6d-42d531c24036": { 2023-10-08T12:57:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:57:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "c2a1d04e-ca26-47ce-ae6d-42d531c24036", 2023-10-08T12:57:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:57:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:57:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:57:18.018 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:57:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b79dff700 1 -- 172.21.15.59:0/96975029 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b5c0a1670 msgr2=0x7f7b5c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b79dff700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b5c0a1670 0x7f7b5c0a3b30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7b68029000 tx=0x7f7b68025000 comp rx=0 tx=0).stop 2023-10-08T12:57:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b79dff700 1 -- 172.21.15.59:0/96975029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b74105b80 msgr2=0x7f7b741a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b79dff700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b74105b80 0x7f7b741a1af0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00ef30 tx=0x7f7b6c00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b79dff700 1 -- 172.21.15.59:0/96975029 shutdown_connections 2023-10-08T12:57:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b79dff700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7b5c0a1670 0x7f7b5c0a3b30 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b79dff700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b74105b80 0x7f7b741a1af0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b79dff700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b74067ce0 0x7f7b7410c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b79dff700 1 --2- 172.21.15.59:0/96975029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b741051c0 0x7f7b7410cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.013+0000 7f7b79dff700 1 -- 172.21.15.59:0/96975029 >> 172.21.15.59:0/96975029 conn(0x7f7b74076780 msgr2=0x7f7b740fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.014+0000 7f7b79dff700 1 -- 172.21.15.59:0/96975029 shutdown_connections 2023-10-08T12:57:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:18.014+0000 7f7b79dff700 1 -- 172.21.15.59:0/96975029 wait complete. 2023-10-08T12:57:18.031 INFO:tasks.cephfs.filesystem:scrub status for tag:c2a1d04e-ca26-47ce-ae6d-42d531c24036 - {'path': '/', 'tag': 'c2a1d04e-ca26-47ce-ae6d-42d531c24036', 'options': 'recursive,force'} 2023-10-08T12:57:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:18 smithi092 ceph-mon[134093]: pgmap v817: 97 pgs: 97 active+clean; 846 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.9 MiB/s wr, 421 op/s 2023-10-08T12:57:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:18 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:57:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:18 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:18.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:18 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:57:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:18 smithi173 ceph-mon[135182]: pgmap v817: 97 pgs: 97 active+clean; 846 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.9 MiB/s wr, 421 op/s 2023-10-08T12:57:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:18 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:57:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:18 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:18 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:57:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:18 smithi059 ceph-mon[98489]: pgmap v817: 97 pgs: 97 active+clean; 846 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.9 MiB/s wr, 421 op/s 2023-10-08T12:57:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:18 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:57:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:18 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:18 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:57:18.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 66435 20.33 MB/sec execute 49 sec latency 332.555 ms 2023-10-08T12:57:19.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 66911 20.28 MB/sec execute 50 sec latency 135.384 ms 2023-10-08T12:57:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:19 smithi173 ceph-mon[135182]: pgmap v818: 97 pgs: 97 active+clean; 847 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.5 MiB/s wr, 359 op/s 2023-10-08T12:57:20.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:19 smithi059 ceph-mon[98489]: pgmap v818: 97 pgs: 97 active+clean; 847 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.5 MiB/s wr, 359 op/s 2023-10-08T12:57:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:19 smithi092 ceph-mon[134093]: pgmap v818: 97 pgs: 97 active+clean; 847 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.5 MiB/s wr, 359 op/s 2023-10-08T12:57:20.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 67374 20.58 MB/sec execute 51 sec latency 143.037 ms 2023-10-08T12:57:21.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 67718 20.73 MB/sec execute 52 sec latency 256.179 ms 2023-10-08T12:57:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:22 smithi092 ceph-mon[134093]: pgmap v819: 97 pgs: 97 active+clean; 859 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.2 MiB/s wr, 398 op/s 2023-10-08T12:57:22.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:22 smithi173 ceph-mon[135182]: pgmap v819: 97 pgs: 97 active+clean; 859 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.2 MiB/s wr, 398 op/s 2023-10-08T12:57:22.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:22 smithi059 ceph-mon[98489]: pgmap v819: 97 pgs: 97 active+clean; 859 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.2 MiB/s wr, 398 op/s 2023-10-08T12:57:22.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 67977 20.59 MB/sec execute 53 sec latency 103.968 ms 2023-10-08T12:57:23.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 68323 20.42 MB/sec execute 54 sec latency 143.350 ms 2023-10-08T12:57:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:24 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:24 smithi092 ceph-mon[134093]: pgmap v820: 97 pgs: 97 active+clean; 872 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 10 MiB/s wr, 473 op/s 2023-10-08T12:57:24.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:24 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:24.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:24 smithi173 ceph-mon[135182]: pgmap v820: 97 pgs: 97 active+clean; 872 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 10 MiB/s wr, 473 op/s 2023-10-08T12:57:24.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:24 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:24 smithi059 ceph-mon[98489]: pgmap v820: 97 pgs: 97 active+clean; 872 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 10 MiB/s wr, 473 op/s 2023-10-08T12:57:24.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 68673 20.24 MB/sec execute 55 sec latency 182.402 ms 2023-10-08T12:57:25.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 69043 20.18 MB/sec execute 56 sec latency 243.358 ms 2023-10-08T12:57:26.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:26 smithi092 ceph-mon[134093]: pgmap v821: 97 pgs: 97 active+clean; 873 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.7 MiB/s wr, 416 op/s 2023-10-08T12:57:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:26 smithi173 ceph-mon[135182]: pgmap v821: 97 pgs: 97 active+clean; 873 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.7 MiB/s wr, 416 op/s 2023-10-08T12:57:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:26 smithi059 ceph-mon[98489]: pgmap v821: 97 pgs: 97 active+clean; 873 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.7 MiB/s wr, 416 op/s 2023-10-08T12:57:26.953 INFO:tasks.workunit.client.0.smithi059.stdout: 10 69465 20.42 MB/sec execute 57 sec latency 252.693 ms 2023-10-08T12:57:27.954 INFO:tasks.workunit.client.0.smithi059.stdout: 10 69937 20.33 MB/sec execute 58 sec latency 284.777 ms 2023-10-08T12:57:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:28 smithi092 ceph-mon[134093]: pgmap v822: 97 pgs: 97 active+clean; 880 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.5 MiB/s wr, 415 op/s 2023-10-08T12:57:28.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:28 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:57:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:28 smithi173 ceph-mon[135182]: pgmap v822: 97 pgs: 97 active+clean; 880 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.5 MiB/s wr, 415 op/s 2023-10-08T12:57:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:28 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:57:28.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:28 smithi059 ceph-mon[98489]: pgmap v822: 97 pgs: 97 active+clean; 880 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.5 MiB/s wr, 415 op/s 2023-10-08T12:57:28.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:28 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:57:28.954 INFO:tasks.workunit.client.0.smithi059.stdout: 10 70373 20.38 MB/sec execute 59 sec latency 157.225 ms 2023-10-08T12:57:29.954 INFO:tasks.workunit.client.0.smithi059.stdout: 10 70836 20.57 MB/sec execute 60 sec latency 189.311 ms 2023-10-08T12:57:30.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:29 smithi059 ceph-mon[98489]: pgmap v823: 97 pgs: 97 active+clean; 890 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.8 MiB/s wr, 443 op/s 2023-10-08T12:57:30.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:29 smithi092 ceph-mon[134093]: pgmap v823: 97 pgs: 97 active+clean; 890 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.8 MiB/s wr, 443 op/s 2023-10-08T12:57:30.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:29 smithi173 ceph-mon[135182]: pgmap v823: 97 pgs: 97 active+clean; 890 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.8 MiB/s wr, 443 op/s 2023-10-08T12:57:30.954 INFO:tasks.workunit.client.0.smithi059.stdout: 10 71247 20.71 MB/sec execute 61 sec latency 183.244 ms 2023-10-08T12:57:31.954 INFO:tasks.workunit.client.0.smithi059.stdout: 10 71528 20.57 MB/sec execute 62 sec latency 215.033 ms 2023-10-08T12:57:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:32 smithi092 ceph-mon[134093]: pgmap v824: 97 pgs: 97 active+clean; 899 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.5 MiB/s wr, 435 op/s 2023-10-08T12:57:32.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:32 smithi173 ceph-mon[135182]: pgmap v824: 97 pgs: 97 active+clean; 899 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.5 MiB/s wr, 435 op/s 2023-10-08T12:57:32.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:32 smithi059 ceph-mon[98489]: pgmap v824: 97 pgs: 97 active+clean; 899 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.5 MiB/s wr, 435 op/s 2023-10-08T12:57:32.954 INFO:tasks.workunit.client.0.smithi059.stdout: 10 71807 20.39 MB/sec execute 63 sec latency 391.337 ms 2023-10-08T12:57:33.955 INFO:tasks.workunit.client.0.smithi059.stdout: 10 72159 20.36 MB/sec execute 64 sec latency 81.005 ms 2023-10-08T12:57:34.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:34 smithi092 ceph-mon[134093]: pgmap v825: 97 pgs: 97 active+clean; 908 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.6 MiB/s wr, 412 op/s 2023-10-08T12:57:34.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:34 smithi173 ceph-mon[135182]: pgmap v825: 97 pgs: 97 active+clean; 908 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.6 MiB/s wr, 412 op/s 2023-10-08T12:57:34.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:34 smithi059 ceph-mon[98489]: pgmap v825: 97 pgs: 97 active+clean; 908 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.6 MiB/s wr, 412 op/s 2023-10-08T12:57:34.954 INFO:tasks.workunit.client.0.smithi059.stdout: 10 72591 20.38 MB/sec execute 65 sec latency 89.414 ms 2023-10-08T12:57:35.954 INFO:tasks.workunit.client.0.smithi059.stdout: 10 73197 20.62 MB/sec execute 66 sec latency 151.260 ms 2023-10-08T12:57:36.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:36 smithi092 ceph-mon[134093]: pgmap v826: 97 pgs: 97 active+clean; 888 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 331 op/s 2023-10-08T12:57:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:36 smithi173 ceph-mon[135182]: pgmap v826: 97 pgs: 97 active+clean; 888 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 331 op/s 2023-10-08T12:57:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:36 smithi059 ceph-mon[98489]: pgmap v826: 97 pgs: 97 active+clean; 888 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 331 op/s 2023-10-08T12:57:36.957 INFO:tasks.workunit.client.0.smithi059.stdout: 10 73762 20.66 MB/sec execute 67 sec latency 166.680 ms 2023-10-08T12:57:37.957 INFO:tasks.workunit.client.0.smithi059.stdout: 10 74019 20.71 MB/sec execute 68 sec latency 217.707 ms 2023-10-08T12:57:38.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:38 smithi092 ceph-mon[134093]: pgmap v827: 97 pgs: 97 active+clean; 883 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 343 op/s 2023-10-08T12:57:38.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:38 smithi173 ceph-mon[135182]: pgmap v827: 97 pgs: 97 active+clean; 883 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 343 op/s 2023-10-08T12:57:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:38 smithi059 ceph-mon[98489]: pgmap v827: 97 pgs: 97 active+clean; 883 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 343 op/s 2023-10-08T12:57:38.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 74471 20.83 MB/sec execute 69 sec latency 114.238 ms 2023-10-08T12:57:39.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 74825 20.83 MB/sec execute 70 sec latency 80.647 ms 2023-10-08T12:57:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:39 smithi059 ceph-mon[98489]: pgmap v828: 97 pgs: 97 active+clean; 869 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.9 MiB/s wr, 356 op/s 2023-10-08T12:57:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:39 smithi092 ceph-mon[134093]: pgmap v828: 97 pgs: 97 active+clean; 869 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.9 MiB/s wr, 356 op/s 2023-10-08T12:57:40.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:39 smithi173 ceph-mon[135182]: pgmap v828: 97 pgs: 97 active+clean; 869 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.9 MiB/s wr, 356 op/s 2023-10-08T12:57:40.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 75153 20.69 MB/sec execute 71 sec latency 152.312 ms 2023-10-08T12:57:41.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 75495 20.59 MB/sec execute 72 sec latency 225.645 ms 2023-10-08T12:57:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:42 smithi173 ceph-mon[135182]: pgmap v829: 97 pgs: 97 active+clean; 878 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.8 MiB/s wr, 349 op/s 2023-10-08T12:57:42.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:42 smithi059 ceph-mon[98489]: pgmap v829: 97 pgs: 97 active+clean; 878 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.8 MiB/s wr, 349 op/s 2023-10-08T12:57:42.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:42 smithi092 ceph-mon[134093]: pgmap v829: 97 pgs: 97 active+clean; 878 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.8 MiB/s wr, 349 op/s 2023-10-08T12:57:42.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 75751 20.47 MB/sec execute 73 sec latency 405.455 ms 2023-10-08T12:57:43.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 76140 20.52 MB/sec execute 74 sec latency 148.910 ms 2023-10-08T12:57:44.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:44 smithi173 ceph-mon[135182]: pgmap v830: 97 pgs: 97 active+clean; 890 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.0 MiB/s wr, 349 op/s 2023-10-08T12:57:44.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:44 smithi059 ceph-mon[98489]: pgmap v830: 97 pgs: 97 active+clean; 890 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.0 MiB/s wr, 349 op/s 2023-10-08T12:57:44.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:44 smithi092 ceph-mon[134093]: pgmap v830: 97 pgs: 97 active+clean; 890 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.0 MiB/s wr, 349 op/s 2023-10-08T12:57:44.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 76828 20.65 MB/sec execute 75 sec latency 153.750 ms 2023-10-08T12:57:45.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 77252 20.78 MB/sec execute 76 sec latency 179.768 ms 2023-10-08T12:57:46.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:46 smithi173 ceph-mon[135182]: pgmap v831: 97 pgs: 97 active+clean; 896 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.3 MiB/s wr, 321 op/s 2023-10-08T12:57:46.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:46 smithi059 ceph-mon[98489]: pgmap v831: 97 pgs: 97 active+clean; 896 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.3 MiB/s wr, 321 op/s 2023-10-08T12:57:46.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:46 smithi092 ceph-mon[134093]: pgmap v831: 97 pgs: 97 active+clean; 896 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.3 MiB/s wr, 321 op/s 2023-10-08T12:57:46.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 77762 20.91 MB/sec execute 77 sec latency 171.899 ms 2023-10-08T12:57:47.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 78062 20.91 MB/sec execute 78 sec latency 424.047 ms 2023-10-08T12:57:48.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:57:48.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.260+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/111245935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1df8072ba0 msgr2=0x7f1df8072f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.260+0000 7f1dfd7ff700 1 --2- 172.21.15.59:0/111245935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1df8072ba0 0x7f1df8072f80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1de80098f0 tx=0x7f1de8009c00 comp rx=0 tx=0).stop 2023-10-08T12:57:48.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.260+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/111245935 shutdown_connections 2023-10-08T12:57:48.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.260+0000 7f1dfd7ff700 1 --2- 172.21.15.59:0/111245935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1df8072ba0 0x7f1df8072f80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.260+0000 7f1dfd7ff700 1 --2- 172.21.15.59:0/111245935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1df810d000 0x7f1df810f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.260+0000 7f1dfd7ff700 1 --2- 172.21.15.59:0/111245935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df80734c0 0x7f1df810cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.260+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/111245935 >> 172.21.15.59:0/111245935 conn(0x7f1df80fc230 msgr2=0x7f1df80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:48.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.260+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/111245935 shutdown_connections 2023-10-08T12:57:48.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.260+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/111245935 wait complete. 2023-10-08T12:57:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.261+0000 7f1dfd7ff700 1 Processor -- start 2023-10-08T12:57:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1dfd7ff700 1 -- start start 2023-10-08T12:57:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1dfd7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1df8072ba0 0x7f1df8198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1dfd7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1df80734c0 0x7f1df8199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1dfd7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df810d000 0x7f1df819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1dfd7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df819dd60 con 0x7f1df810d000 2023-10-08T12:57:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1dfd7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df819ded0 con 0x7f1df80734c0 2023-10-08T12:57:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1dfd7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df819e090 con 0x7f1df8072ba0 2023-10-08T12:57:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1df6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1df8072ba0 0x7f1df8198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1df67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1df80734c0 0x7f1df8199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1df6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1df8072ba0 0x7f1df8198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60318/0 (socket says 172.21.15.59:60318) 2023-10-08T12:57:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1df6ffd700 1 -- 172.21.15.59:0/5389124 learned_addr learned my addr 172.21.15.59:0/5389124 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.262+0000 7f1df77fe700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df810d000 0x7f1df819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1df67fc700 1 -- 172.21.15.59:0/5389124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1df8072ba0 msgr2=0x7f1df8198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1df67fc700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1df8072ba0 0x7f1df8198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1df67fc700 1 -- 172.21.15.59:0/5389124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df810d000 msgr2=0x7f1df819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1df67fc700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df810d000 0x7f1df819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1df67fc700 1 -- 172.21.15.59:0/5389124 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8009520 con 0x7f1df80734c0 2023-10-08T12:57:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1df6ffd700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1df8072ba0 0x7f1df8198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1df67fc700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1df80734c0 0x7f1df8199380 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00e9c0 tx=0x7f1dec00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1ddffff700 1 -- 172.21.15.59:0/5389124 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00c9c0 con 0x7f1df80734c0 2023-10-08T12:57:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1ddffff700 1 -- 172.21.15.59:0/5389124 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1dec010430 con 0x7f1df80734c0 2023-10-08T12:57:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/5389124 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df819e370 con 0x7f1df80734c0 2023-10-08T12:57:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1ddffff700 1 -- 172.21.15.59:0/5389124 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec018680 con 0x7f1df80734c0 2023-10-08T12:57:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.263+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/5389124 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df81a5bb0 con 0x7f1df80734c0 2023-10-08T12:57:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.267+0000 7f1ddffff700 1 -- 172.21.15.59:0/5389124 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1dec010860 con 0x7f1df80734c0 2023-10-08T12:57:48.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.268+0000 7f1e111fab80 1 Processor -- start 2023-10-08T12:57:48.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.268+0000 7f1e111fab80 1 -- start start 2023-10-08T12:57:48.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db7fe80 0x55816db80260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 0x55816db8b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db8da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1e111fab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816dae9460 con 0x55816db807a0 2023-10-08T12:57:48.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1e111fab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816dadac20 con 0x55816db8b650 2023-10-08T12:57:48.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1e111fab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816dad8540 con 0x55816db7fe80 2023-10-08T12:57:48.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1ddffff700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1de00a1670 0x7f1de00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1ddffff700 1 -- 172.21.15.59:0/5389124 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1dec014070 con 0x7f1df80734c0 2023-10-08T12:57:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1df67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db8da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1df67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db8da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48818/0 (socket says 172.21.15.59:48818) 2023-10-08T12:57:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1df77fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db7fe80 0x55816db80260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1df67fc700 1 -- 172.21.15.59:0/788489862 learned_addr learned my addr 172.21.15.59:0/788489862 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.269+0000 7f1df6ffd700 1 --2- 172.21.15.59:0/788489862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 0x55816db8b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.270+0000 7f1df67fc700 1 -- 172.21.15.59:0/788489862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db7fe80 msgr2=0x55816db80260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:48.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.270+0000 7f1df67fc700 1 --2- 172.21.15.59:0/788489862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db7fe80 0x55816db80260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.270+0000 7f1df77fe700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1de00a1670 0x7f1de00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.270+0000 7f1df67fc700 1 -- 172.21.15.59:0/788489862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 msgr2=0x55816db8b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:48.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.270+0000 7f1df67fc700 1 --2- 172.21.15.59:0/788489862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 0x55816db8b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.270+0000 7f1df67fc700 1 -- 172.21.15.59:0/788489862 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55816d8fede0 con 0x55816db8b650 2023-10-08T12:57:48.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.270+0000 7f1df67fc700 1 --2- 172.21.15.59:0/788489862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db8da40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1dec09a020 tx=0x7f1dec099e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee4087f7e450ae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:48.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.270+0000 7f1ddd7fa700 1 -- 172.21.15.59:0/788489862 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec09a790 con 0x55816db8b650 2023-10-08T12:57:48.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.270+0000 7f1ddd7fa700 1 -- 172.21.15.59:0/788489862 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1dec09a090 con 0x55816db8b650 2023-10-08T12:57:48.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.270+0000 7f1ddd7fa700 1 -- 172.21.15.59:0/788489862 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0afdd0 con 0x55816db8b650 2023-10-08T12:57:48.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.271+0000 7f1e111fab80 1 -- 172.21.15.59:0/788489862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 msgr2=0x55816db8da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.271+0000 7f1df77fe700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1de00a1670 0x7f1de00a3b30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009ec0 tx=0x7f1df000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:48.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.271+0000 7f1e111fab80 1 --2- 172.21.15.59:0/788489862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db8da40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1dec09a020 tx=0x7f1dec099e60 comp rx=0 tx=0).stop 2023-10-08T12:57:48.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.271+0000 7f1e111fab80 1 -- 172.21.15.59:0/788489862 shutdown_connections 2023-10-08T12:57:48.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.271+0000 7f1e111fab80 1 --2- 172.21.15.59:0/788489862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db8da40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.271+0000 7f1e111fab80 1 --2- 172.21.15.59:0/788489862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db7fe80 0x55816db80260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.271+0000 7f1e111fab80 1 --2- 172.21.15.59:0/788489862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 0x55816db8b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.271+0000 7f1e111fab80 1 -- 172.21.15.59:0/788489862 >> 172.21.15.59:0/788489862 conn(0x55816daf5260 msgr2=0x55816db7c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:48.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.271+0000 7f1e111fab80 1 -- 172.21.15.59:0/788489862 shutdown_connections 2023-10-08T12:57:48.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.271+0000 7f1e111fab80 1 -- 172.21.15.59:0/788489862 wait complete. 2023-10-08T12:57:48.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.272+0000 7f1e111fab80 1 -- start start 2023-10-08T12:57:48.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.272+0000 7f1e111fab80 1 Processor -- start 2023-10-08T12:57:48.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.272+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db7fe80 0x55816db8b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.272+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db807a0 0x55816db88450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.272+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db88b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.272+0000 7f1e111fab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816dad3e30 con 0x55816db7fe80 2023-10-08T12:57:48.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.272+0000 7f1e111fab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816da70710 con 0x55816db8b650 2023-10-08T12:57:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.272+0000 7f1e111fab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816da703b0 con 0x55816db807a0 2023-10-08T12:57:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.272+0000 7f1e111fab80 10 client.0 _ll_register_callbacks cb 0x55816d8cd800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.273+0000 7f1df77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db88b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.273+0000 7f1df77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db88b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48820/0 (socket says 172.21.15.59:48820) 2023-10-08T12:57:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.273+0000 7f1df77fe700 1 -- 172.21.15.59:0/1959296956 learned_addr learned my addr 172.21.15.59:0/1959296956 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.273+0000 7f1df6ffd700 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db7fe80 0x55816db8b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.273+0000 7f1df77fe700 1 -- 172.21.15.59:0/1959296956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db807a0 msgr2=0x55816db88450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.273+0000 7f1df77fe700 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db807a0 0x55816db88450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.273+0000 7f1df77fe700 1 -- 172.21.15.59:0/1959296956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db7fe80 msgr2=0x55816db8b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.273+0000 7f1df77fe700 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db7fe80 0x55816db8b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.273+0000 7f1df77fe700 1 -- 172.21.15.59:0/1959296956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df81a5bb0 con 0x55816db8b650 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.273+0000 7f1df77fe700 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db88b40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1df0018970 tx=0x7f1df0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d38a2c5edaabedc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.273+0000 7f1ddaff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.274+0000 7f1ddaff5700 1 -- 172.21.15.59:0/1959296956 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0021070 con 0x55816db8b650 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.274+0000 7f1e111fab80 1 -- 172.21.15.59:0/1959296956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55816da9beb0 con 0x55816db8b650 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.274+0000 7f1ddaff5700 1 -- 172.21.15.59:0/1959296956 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1df0007790 con 0x55816db8b650 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.274+0000 7f1ddaff5700 1 -- 172.21.15.59:0/1959296956 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1df000e070 con 0x55816db8b650 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.274+0000 7f1e111fab80 10 client.27842 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.274+0000 7f1e111fab80 1 -- 172.21.15.59:0/1959296956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55816d8e7c60 con 0x55816db8b650 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.274+0000 7f1ddaff5700 1 -- 172.21.15.59:0/1959296956 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55816da9beb0 con 0x55816db8b650 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.274+0000 7f1ddaff5700 1 -- 172.21.15.59:0/1959296956 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1df001ab00 con 0x55816db8b650 2023-10-08T12:57:48.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.275+0000 7f1e111fab80 10 client.27842 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.275+0000 7f1e111fab80 10 client.27842 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.275+0000 7f1e111fab80 20 client.27842 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.275+0000 7f1e111fab80 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55816db9b290 0x55816db9d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.275+0000 7f1e111fab80 4 client.27842 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:57:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.275+0000 7f1e111fab80 1 -- 172.21.15.59:0/1959296956 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55816dacce10 con 0x55816db9b290 2023-10-08T12:57:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.275+0000 7f1df6ffd700 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55816db9b290 0x55816db9d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.275+0000 7f1df6ffd700 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55816db9b290 0x55816db9d6b0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10375ac903756b63 server_cookie=1c83109f4f9609 in_seq=0 out_seq=0 2023-10-08T12:57:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.275+0000 7f1ddaff5700 10 client.27842 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:48.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1ddaff5700 1 -- 172.21.15.59:0/1959296956 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55816dacce10 con 0x55816db9b290 2023-10-08T12:57:48.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1ddaff5700 10 client.27842 handle_command_reply: tid=0 2023-10-08T12:57:48.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 1 client.27842 shutdown 2023-10-08T12:57:48.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 1 -- 172.21.15.59:0/1959296956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 msgr2=0x55816db88b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db88b40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1df0018970 tx=0x7f1df0004ad0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 1 -- 172.21.15.59:0/1959296956 shutdown_connections 2023-10-08T12:57:48.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55816db9b290 0x55816db9d6b0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db8b650 0x55816db88b40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db7fe80 0x55816db8b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 1 --2- 172.21.15.59:0/1959296956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db807a0 0x55816db88450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 1 -- 172.21.15.59:0/1959296956 >> 172.21.15.59:0/1959296956 conn(0x55816daf5260 msgr2=0x55816db7bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:48.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1ddaff5700 0 client.27842 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:48.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 1 -- 172.21.15.59:0/1959296956 shutdown_connections 2023-10-08T12:57:48.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 1 -- 172.21.15.59:0/1959296956 wait complete. 2023-10-08T12:57:48.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.278+0000 7f1e111fab80 20 client.27842 trim_cache size 0 max 16384 2023-10-08T12:57:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.297+0000 7f1e111fab80 1 Processor -- start 2023-10-08T12:57:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.297+0000 7f1e111fab80 1 -- start start 2023-10-08T12:57:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.298+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db7fe80 0x55816db921a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.298+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 0x55816db86d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.298+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db8b650 0x55816db872a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.298+0000 7f1e111fab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816d954920 con 0x55816db807a0 2023-10-08T12:57:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.298+0000 7f1e111fab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816db89700 con 0x55816db7fe80 2023-10-08T12:57:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.298+0000 7f1e111fab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816db78ae0 con 0x55816db8b650 2023-10-08T12:57:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.298+0000 7f1df67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 0x55816db86d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.298+0000 7f1df67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 0x55816db86d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41490/0 (socket says 172.21.15.59:41490) 2023-10-08T12:57:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.298+0000 7f1df67fc700 1 -- 172.21.15.59:0/435761373 learned_addr learned my addr 172.21.15.59:0/435761373 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.298+0000 7f1df77fe700 1 --2- 172.21.15.59:0/435761373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db8b650 0x55816db872a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1df6ffd700 1 --2- 172.21.15.59:0/435761373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db7fe80 0x55816db921a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1df67fc700 1 -- 172.21.15.59:0/435761373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db8b650 msgr2=0x55816db872a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1df67fc700 1 --2- 172.21.15.59:0/435761373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db8b650 0x55816db872a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1df67fc700 1 -- 172.21.15.59:0/435761373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db7fe80 msgr2=0x55816db921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1df67fc700 1 --2- 172.21.15.59:0/435761373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db7fe80 0x55816db921a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1df67fc700 1 -- 172.21.15.59:0/435761373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55816db7b7a0 con 0x55816db807a0 2023-10-08T12:57:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1df6ffd700 1 --2- 172.21.15.59:0/435761373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db7fe80 0x55816db921a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1df77fe700 1 --2- 172.21.15.59:0/435761373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db8b650 0x55816db872a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1df67fc700 1 --2- 172.21.15.59:0/435761373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 0x55816db86d60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1dec099d90 tx=0x7f1dec00c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb4078e89e920fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1dddffb700 1 -- 172.21.15.59:0/435761373 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec09a790 con 0x55816db807a0 2023-10-08T12:57:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1dddffb700 1 -- 172.21.15.59:0/435761373 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1dec0a2420 con 0x55816db807a0 2023-10-08T12:57:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.299+0000 7f1dddffb700 1 -- 172.21.15.59:0/435761373 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec099580 con 0x55816db807a0 2023-10-08T12:57:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.300+0000 7f1e111fab80 1 -- 172.21.15.59:0/435761373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 msgr2=0x55816db86d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.300+0000 7f1e111fab80 1 --2- 172.21.15.59:0/435761373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 0x55816db86d60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1dec099d90 tx=0x7f1dec00c6e0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.300+0000 7f1e111fab80 1 -- 172.21.15.59:0/435761373 shutdown_connections 2023-10-08T12:57:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.300+0000 7f1e111fab80 1 --2- 172.21.15.59:0/435761373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db7fe80 0x55816db921a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.300+0000 7f1e111fab80 1 --2- 172.21.15.59:0/435761373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db8b650 0x55816db872a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.300+0000 7f1e111fab80 1 --2- 172.21.15.59:0/435761373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db807a0 0x55816db86d60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.300+0000 7f1e111fab80 1 -- 172.21.15.59:0/435761373 >> 172.21.15.59:0/435761373 conn(0x55816daf5260 msgr2=0x55816db837b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.300+0000 7f1e111fab80 1 -- 172.21.15.59:0/435761373 shutdown_connections 2023-10-08T12:57:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.300+0000 7f1e111fab80 1 -- 172.21.15.59:0/435761373 wait complete. 2023-10-08T12:57:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.301+0000 7f1e111fab80 1 -- start start 2023-10-08T12:57:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.301+0000 7f1e111fab80 1 Processor -- start 2023-10-08T12:57:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.301+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db7fe80 0x55816db90370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.301+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db807a0 0x55816db908b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1e111fab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db8b650 0x55816dbee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1e111fab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816dbee620 con 0x55816db8b650 2023-10-08T12:57:48.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1e111fab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816dbee760 con 0x55816db807a0 2023-10-08T12:57:48.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1e111fab80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816dbee8a0 con 0x55816db7fe80 2023-10-08T12:57:48.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1e111fab80 10 client.0 _ll_register_callbacks cb 0x7f1df00083f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:48.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1df6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db7fe80 0x55816db90370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1df67fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db807a0 0x55816db908b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1df6ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db7fe80 0x55816db90370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60368/0 (socket says 172.21.15.59:60368) 2023-10-08T12:57:48.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1df6ffd700 1 -- 172.21.15.59:0/2014704185 learned_addr learned my addr 172.21.15.59:0/2014704185 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:48.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1df77fe700 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db8b650 0x55816dbee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1df67fc700 1 -- 172.21.15.59:0/2014704185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db7fe80 msgr2=0x55816db90370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:48.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1df67fc700 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db7fe80 0x55816db90370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1df67fc700 1 -- 172.21.15.59:0/2014704185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db8b650 msgr2=0x55816dbee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:48.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1df67fc700 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db8b650 0x55816dbee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1df67fc700 1 -- 172.21.15.59:0/2014704185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df81100b0 con 0x55816db807a0 2023-10-08T12:57:48.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.302+0000 7f1df77fe700 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db8b650 0x55816dbee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:57:48.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1df67fc700 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db807a0 0x55816db908b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55816da9bff0 tx=0x7f1dec0107d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e69537590299e16 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1ddaff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:57:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1ddaff5700 1 -- 172.21.15.59:0/2014704185 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0b7070 con 0x55816db807a0 2023-10-08T12:57:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1e111fab80 1 -- 172.21.15.59:0/2014704185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1dec09a090 con 0x55816db807a0 2023-10-08T12:57:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1ddaff5700 1 -- 172.21.15.59:0/2014704185 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1dec09e1e0 con 0x55816db807a0 2023-10-08T12:57:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1ddaff5700 1 -- 172.21.15.59:0/2014704185 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dec09a790 con 0x55816db807a0 2023-10-08T12:57:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1e111fab80 10 client.27848 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1e111fab80 1 -- 172.21.15.59:0/2014704185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55816d8e7c60 con 0x55816db807a0 2023-10-08T12:57:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1ddaff5700 1 -- 172.21.15.59:0/2014704185 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1dec09a090 con 0x55816db807a0 2023-10-08T12:57:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1ddaff5700 1 -- 172.21.15.59:0/2014704185 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1dec0a2020 con 0x55816db807a0 2023-10-08T12:57:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1e111fab80 10 client.27848 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1e111fab80 10 client.27848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:48.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1e111fab80 20 client.27848 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:48.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1e111fab80 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55816dbefb30 0x55816dbf1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.303+0000 7f1e111fab80 4 client.27848 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:57:48.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.304+0000 7f1e111fab80 1 -- 172.21.15.59:0/2014704185 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55816daccb30 con 0x55816dbefb30 2023-10-08T12:57:48.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.304+0000 7f1df6ffd700 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55816dbefb30 0x55816dbf1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.304+0000 7f1df6ffd700 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55816dbefb30 0x55816dbf1f50 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3ce99389222e90c server_cookie=d1771098f9ec7e93 in_seq=0 out_seq=0 2023-10-08T12:57:48.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.304+0000 7f1ddaff5700 10 client.27848 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:48.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1ddaff5700 1 -- 172.21.15.59:0/2014704185 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55816daccb30 con 0x55816dbefb30 2023-10-08T12:57:48.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1ddaff5700 10 client.27848 handle_command_reply: tid=0 2023-10-08T12:57:48.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1e111fab80 1 client.27848 shutdown 2023-10-08T12:57:48.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1e111fab80 1 -- 172.21.15.59:0/2014704185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db807a0 msgr2=0x55816db908b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1e111fab80 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db807a0 0x55816db908b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55816da9bff0 tx=0x7f1dec0107d0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1e111fab80 1 -- 172.21.15.59:0/2014704185 shutdown_connections 2023-10-08T12:57:48.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1e111fab80 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55816dbefb30 0x55816dbf1f50 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1e111fab80 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55816db8b650 0x55816dbee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1e111fab80 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55816db7fe80 0x55816db90370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1e111fab80 1 --2- 172.21.15.59:0/2014704185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55816db807a0 0x55816db908b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1ddaff5700 0 client.27848 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:48.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.306+0000 7f1e111fab80 1 -- 172.21.15.59:0/2014704185 >> 172.21.15.59:0/2014704185 conn(0x55816daf5260 msgr2=0x55816db837b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:48.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.307+0000 7f1e111fab80 1 -- 172.21.15.59:0/2014704185 shutdown_connections 2023-10-08T12:57:48.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.307+0000 7f1e111fab80 1 -- 172.21.15.59:0/2014704185 wait complete. 2023-10-08T12:57:48.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.307+0000 7f1e111fab80 20 client.27848 trim_cache size 0 max 16384 2023-10-08T12:57:48.311 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:57:48.312 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:57:48.312 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:57:48.312 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:57:48.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/5389124 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1de00a1670 msgr2=0x7f1de00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1de00a1670 0x7f1de00a3b30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009ec0 tx=0x7f1df000b040 comp rx=0 tx=0).stop 2023-10-08T12:57:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/5389124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1df80734c0 msgr2=0x7f1df8199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1df80734c0 0x7f1df8199380 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00e9c0 tx=0x7f1dec00ecd0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/5389124 shutdown_connections 2023-10-08T12:57:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f1de00a1670 0x7f1de00a3b30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df810d000 0x7f1df819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1df8072ba0 0x7f1df8198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 --2- 172.21.15.59:0/5389124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1df80734c0 0x7f1df8199380 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/5389124 >> 172.21.15.59:0/5389124 conn(0x7f1df80fc230 msgr2=0x7f1df80fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/5389124 shutdown_connections 2023-10-08T12:57:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.308+0000 7f1dfd7ff700 1 -- 172.21.15.59:0/5389124 wait complete. 2023-10-08T12:57:48.328 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:57:48.328 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:57:48.393 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:48 smithi059 ceph-mon[98489]: pgmap v832: 97 pgs: 97 active+clean; 896 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.8 MiB/s wr, 325 op/s 2023-10-08T12:57:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:48 smithi173 ceph-mon[135182]: pgmap v832: 97 pgs: 97 active+clean; 896 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.8 MiB/s wr, 325 op/s 2023-10-08T12:57:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.548+0000 7fa3133ff700 1 -- 172.21.15.59:0/4028025484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa30c106640 msgr2=0x7fa30c106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.548+0000 7fa3133ff700 1 --2- 172.21.15.59:0/4028025484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa30c106640 0x7fa30c106a20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa308009990 tx=0x7fa308009ca0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.548+0000 7fa3133ff700 1 -- 172.21.15.59:0/4028025484 shutdown_connections 2023-10-08T12:57:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.548+0000 7fa3133ff700 1 --2- 172.21.15.59:0/4028025484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c100ff0 0x7fa30c10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.548+0000 7fa3133ff700 1 --2- 172.21.15.59:0/4028025484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa30c106640 0x7fa30c106a20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.548+0000 7fa3133ff700 1 --2- 172.21.15.59:0/4028025484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30c100630 0x7fa30c100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.548+0000 7fa3133ff700 1 -- 172.21.15.59:0/4028025484 >> 172.21.15.59:0/4028025484 conn(0x7fa30c0fc140 msgr2=0x7fa30c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:48.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.549+0000 7fa3133ff700 1 -- 172.21.15.59:0/4028025484 shutdown_connections 2023-10-08T12:57:48.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.549+0000 7fa3133ff700 1 -- 172.21.15.59:0/4028025484 wait complete. 2023-10-08T12:57:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.550+0000 7fa3133ff700 1 Processor -- start 2023-10-08T12:57:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.550+0000 7fa3133ff700 1 -- start start 2023-10-08T12:57:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.550+0000 7fa3133ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c100630 0x7fa30c19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.550+0000 7fa3133ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30c100ff0 0x7fa30c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.550+0000 7fa3133ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa30c106640 0x7fa30c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.550+0000 7fa3133ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c1991e0 con 0x7fa30c106640 2023-10-08T12:57:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.550+0000 7fa3133ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c199350 con 0x7fa30c100630 2023-10-08T12:57:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.550+0000 7fa3133ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c199510 con 0x7fa30c100ff0 2023-10-08T12:57:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.550+0000 7fa31119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c100630 0x7fa30c19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa31119b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c100630 0x7fa30c19ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48856/0 (socket says 172.21.15.59:48856) 2023-10-08T12:57:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa31119b700 1 -- 172.21.15.59:0/2965264086 learned_addr learned my addr 172.21.15.59:0/2965264086 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa31199c700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa30c106640 0x7fa30c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa31099a700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30c100ff0 0x7fa30c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa31119b700 1 -- 172.21.15.59:0/2965264086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30c100ff0 msgr2=0x7fa30c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa31119b700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30c100ff0 0x7fa30c19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa31119b700 1 -- 172.21.15.59:0/2965264086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa30c106640 msgr2=0x7fa30c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa31119b700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa30c106640 0x7fa30c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa31119b700 1 -- 172.21.15.59:0/2965264086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3080095f0 con 0x7fa30c100630 2023-10-08T12:57:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa31199c700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa30c106640 0x7fa30c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa31119b700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c100630 0x7fa30c19ea00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa308005910 tx=0x7fa308004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.551+0000 7fa3027fc700 1 -- 172.21.15.59:0/2965264086 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30801d070 con 0x7fa30c100630 2023-10-08T12:57:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.552+0000 7fa3133ff700 1 -- 172.21.15.59:0/2965264086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30c199790 con 0x7fa30c100630 2023-10-08T12:57:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.552+0000 7fa3027fc700 1 -- 172.21.15.59:0/2965264086 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa308022470 con 0x7fa30c100630 2023-10-08T12:57:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.552+0000 7fa3027fc700 1 -- 172.21.15.59:0/2965264086 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308017650 con 0x7fa30c100630 2023-10-08T12:57:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.552+0000 7fa3133ff700 1 -- 172.21.15.59:0/2965264086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c1a59f0 con 0x7fa30c100630 2023-10-08T12:57:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.553+0000 7fa3133ff700 1 -- 172.21.15.59:0/2965264086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30c101d70 con 0x7fa30c100630 2023-10-08T12:57:48.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.555+0000 7fa3027fc700 1 -- 172.21.15.59:0/2965264086 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa3080225e0 con 0x7fa30c100630 2023-10-08T12:57:48.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.556+0000 7fa3027fc700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2f80a15f0 0x7fa2f80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:48.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.557+0000 7fa3027fc700 1 -- 172.21.15.59:0/2965264086 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa3080ce740 con 0x7fa30c100630 2023-10-08T12:57:48.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.557+0000 7fa31099a700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2f80a15f0 0x7fa2f80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:48.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.557+0000 7fa31099a700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2f80a15f0 0x7fa2f80a3ab0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa30c199cf0 tx=0x7fa2fc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:48.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.559+0000 7fa3027fc700 1 -- 172.21.15.59:0/2965264086 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa308097ae0 con 0x7fa30c100630 2023-10-08T12:57:48.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:48 smithi092 ceph-mon[134093]: pgmap v832: 97 pgs: 97 active+clean; 896 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.8 MiB/s wr, 325 op/s 2023-10-08T12:57:48.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.876+0000 7fa3133ff700 1 -- 172.21.15.59:0/2965264086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa30c067450 con 0x7fa30c100630 2023-10-08T12:57:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.877+0000 7fa3027fc700 1 -- 172.21.15.59:0/2965264086 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fa30809b100 con 0x7fa30c100630 2023-10-08T12:57:48.878 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:57:48.879 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:57:48.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 -- 172.21.15.59:0/2965264086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2f80a15f0 msgr2=0x7fa2f80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2f80a15f0 0x7fa2f80a3ab0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa30c199cf0 tx=0x7fa2fc009260 comp rx=0 tx=0).stop 2023-10-08T12:57:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 -- 172.21.15.59:0/2965264086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c100630 msgr2=0x7fa30c19ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c100630 0x7fa30c19ea00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa308005910 tx=0x7fa308004730 comp rx=0 tx=0).stop 2023-10-08T12:57:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 -- 172.21.15.59:0/2965264086 shutdown_connections 2023-10-08T12:57:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2f80a15f0 0x7fa2f80a3ab0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c100630 0x7fa30c19ea00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa30c106640 0x7fa30c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 --2- 172.21.15.59:0/2965264086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30c100ff0 0x7fa30c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 -- 172.21.15.59:0/2965264086 >> 172.21.15.59:0/2965264086 conn(0x7fa30c0fc140 msgr2=0x7fa30c0fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 -- 172.21.15.59:0/2965264086 shutdown_connections 2023-10-08T12:57:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:48.880+0000 7fa3133ff700 1 -- 172.21.15.59:0/2965264086 wait complete. 2023-10-08T12:57:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:57:48.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:57:48.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 78388 20.79 MB/sec execute 79 sec latency 166.164 ms 2023-10-08T12:57:49.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.117+0000 7f554efff700 1 -- 172.21.15.59:0/2656877113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548106740 msgr2=0x7f5548106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:49.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.117+0000 7f554efff700 1 --2- 172.21.15.59:0/2656877113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548106740 0x7f5548106b20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5544009990 tx=0x7f5544009ca0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.117+0000 7f554efff700 1 -- 172.21.15.59:0/2656877113 shutdown_connections 2023-10-08T12:57:49.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.117+0000 7f554efff700 1 --2- 172.21.15.59:0/2656877113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55481010f0 0x7f554810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.117+0000 7f554efff700 1 --2- 172.21.15.59:0/2656877113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548106740 0x7f5548106b20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.117+0000 7f554efff700 1 --2- 172.21.15.59:0/2656877113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5548100730 0x7f5548100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.117+0000 7f554efff700 1 -- 172.21.15.59:0/2656877113 >> 172.21.15.59:0/2656877113 conn(0x7f55480fc200 msgr2=0x7f55480fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:49.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.117+0000 7f554efff700 1 -- 172.21.15.59:0/2656877113 shutdown_connections 2023-10-08T12:57:49.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.117+0000 7f554efff700 1 -- 172.21.15.59:0/2656877113 wait complete. 2023-10-08T12:57:49.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.118+0000 7f554efff700 1 Processor -- start 2023-10-08T12:57:49.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f554efff700 1 -- start start 2023-10-08T12:57:49.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f554efff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548100730 0x7f5548198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f554efff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55481010f0 0x7f5548199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f554efff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5548106740 0x7f554819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f554efff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554819dd00 con 0x7f5548100730 2023-10-08T12:57:49.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f554efff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554819de70 con 0x7f5548106740 2023-10-08T12:57:49.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f554efff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554819e030 con 0x7f55481010f0 2023-10-08T12:57:49.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f554cd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548100730 0x7f5548198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f554cd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548100730 0x7f5548198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41536/0 (socket says 172.21.15.59:41536) 2023-10-08T12:57:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f554d59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5548106740 0x7f554819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f554cd9b700 1 -- 172.21.15.59:0/955461611 learned_addr learned my addr 172.21.15.59:0/955461611 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.119+0000 7f553ffff700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55481010f0 0x7f5548199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f554d59c700 1 -- 172.21.15.59:0/955461611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55481010f0 msgr2=0x7f5548199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f554d59c700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55481010f0 0x7f5548199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f554d59c700 1 -- 172.21.15.59:0/955461611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548100730 msgr2=0x7f5548198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f554d59c700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548100730 0x7f5548198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f554d59c700 1 -- 172.21.15.59:0/955461611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55440095f0 con 0x7f5548106740 2023-10-08T12:57:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f553ffff700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55481010f0 0x7f5548199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f554cd9b700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548100730 0x7f5548198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f554d59c700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5548106740 0x7f554819d6c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f554000efc0 tx=0x7f554000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f553dffb700 1 -- 172.21.15.59:0/955461611 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540018070 con 0x7f5548106740 2023-10-08T12:57:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f553dffb700 1 -- 172.21.15.59:0/955461611 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f554000f040 con 0x7f5548106740 2023-10-08T12:57:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f553dffb700 1 -- 172.21.15.59:0/955461611 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554000cd40 con 0x7f5548106740 2023-10-08T12:57:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.120+0000 7f554efff700 1 -- 172.21.15.59:0/955461611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554819e2b0 con 0x7f5548106740 2023-10-08T12:57:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.121+0000 7f554efff700 1 -- 172.21.15.59:0/955461611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55481a5b50 con 0x7f5548106740 2023-10-08T12:57:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.124+0000 7f553dffb700 1 -- 172.21.15.59:0/955461611 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5540003a00 con 0x7f5548106740 2023-10-08T12:57:49.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.125+0000 7f55628d9b80 1 Processor -- start 2023-10-08T12:57:49.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.125+0000 7f55628d9b80 1 -- start start 2023-10-08T12:57:49.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.125+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bab2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.125+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821babd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.125+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821babfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.125+0000 7f55628d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821ba1b460 con 0x55821babd650 2023-10-08T12:57:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.125+0000 7f55628d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821ba0cc20 con 0x55821bab27a0 2023-10-08T12:57:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.125+0000 7f55628d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821ba0a540 con 0x55821bab1e80 2023-10-08T12:57:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f554cd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821babd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f553dffb700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55300a1670 0x7f55300a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f553ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bab2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f554cd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821babd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48880/0 (socket says 172.21.15.59:48880) 2023-10-08T12:57:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f554cd9b700 1 -- 172.21.15.59:0/2050154934 learned_addr learned my addr 172.21.15.59:0/2050154934 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f553ffff700 1 --2- 172.21.15.59:0/2050154934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821babfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f553dffb700 1 -- 172.21.15.59:0/955461611 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f55400ccbd0 con 0x7f5548106740 2023-10-08T12:57:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f554cd9b700 1 -- 172.21.15.59:0/2050154934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 msgr2=0x55821bab2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f554cd9b700 1 --2- 172.21.15.59:0/2050154934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bab2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f554cd9b700 1 -- 172.21.15.59:0/2050154934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 msgr2=0x55821babfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f554cd9b700 1 --2- 172.21.15.59:0/2050154934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821babfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f554cd9b700 1 -- 172.21.15.59:0/2050154934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55821b830de0 con 0x55821bab27a0 2023-10-08T12:57:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f554d59c700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55300a1670 0x7f55300a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.126+0000 7f554cd9b700 1 --2- 172.21.15.59:0/2050154934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821babd110 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f554400b670 tx=0x7f554400b6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b3d534b015b3b56 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.127+0000 7f552effd700 1 -- 172.21.15.59:0/2050154934 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554401d070 con 0x55821bab27a0 2023-10-08T12:57:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.127+0000 7f552effd700 1 -- 172.21.15.59:0/2050154934 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f554401e040 con 0x55821bab27a0 2023-10-08T12:57:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.127+0000 7f552effd700 1 -- 172.21.15.59:0/2050154934 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544005410 con 0x55821bab27a0 2023-10-08T12:57:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.127+0000 7f55628d9b80 1 -- 172.21.15.59:0/2050154934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 msgr2=0x55821babd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.127+0000 7f554d59c700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55300a1670 0x7f55300a3b30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f55400ca370 tx=0x7f5540004cc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.127+0000 7f55628d9b80 1 --2- 172.21.15.59:0/2050154934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821babd110 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f554400b670 tx=0x7f554400b6a0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.128+0000 7f55628d9b80 1 -- 172.21.15.59:0/2050154934 shutdown_connections 2023-10-08T12:57:49.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.128+0000 7f55628d9b80 1 --2- 172.21.15.59:0/2050154934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821babfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.128+0000 7f55628d9b80 1 --2- 172.21.15.59:0/2050154934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bab2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.128+0000 7f55628d9b80 1 --2- 172.21.15.59:0/2050154934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821babd110 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.128+0000 7f55628d9b80 1 -- 172.21.15.59:0/2050154934 >> 172.21.15.59:0/2050154934 conn(0x55821ba27260 msgr2=0x55821baae2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:49.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.128+0000 7f55628d9b80 1 -- 172.21.15.59:0/2050154934 shutdown_connections 2023-10-08T12:57:49.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.128+0000 7f55628d9b80 1 -- 172.21.15.59:0/2050154934 wait complete. 2023-10-08T12:57:49.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.128+0000 7f55628d9b80 1 -- start start 2023-10-08T12:57:49.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.129+0000 7f55628d9b80 1 Processor -- start 2023-10-08T12:57:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.129+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab1e80 0x55821babd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.129+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab27a0 0x55821baba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.129+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821baba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.129+0000 7f55628d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821ba05e30 con 0x55821babd650 2023-10-08T12:57:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f55628d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821b9a2710 con 0x55821bab1e80 2023-10-08T12:57:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f55628d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821b9a23b0 con 0x55821bab27a0 2023-10-08T12:57:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f55628d9b80 10 client.0 _ll_register_callbacks cb 0x55821b7ff800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f553ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab1e80 0x55821babd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f553ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821baba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f554cd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab27a0 0x55821baba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f553ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab1e80 0x55821babd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48890/0 (socket says 172.21.15.59:48890) 2023-10-08T12:57:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f553ffff700 1 -- 172.21.15.59:0/2454892796 learned_addr learned my addr 172.21.15.59:0/2454892796 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f554cd9b700 1 -- 172.21.15.59:0/2454892796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab1e80 msgr2=0x55821babd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f554cd9b700 1 --2- 172.21.15.59:0/2454892796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab1e80 0x55821babd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f554cd9b700 1 -- 172.21.15.59:0/2454892796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 msgr2=0x55821baba8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f554cd9b700 1 --2- 172.21.15.59:0/2454892796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821baba8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.130+0000 7f554cd9b700 1 -- 172.21.15.59:0/2454892796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554810df00 con 0x55821bab27a0 2023-10-08T12:57:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.131+0000 7f554cd9b700 1 --2- 172.21.15.59:0/2454892796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab27a0 0x55821baba2a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5544006010 tx=0x7f5544009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de1632720e3ea0e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.131+0000 7f5527fff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.131+0000 7f5527fff700 1 -- 172.21.15.59:0/2454892796 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554401d070 con 0x55821bab27a0 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.131+0000 7f55628d9b80 1 -- 172.21.15.59:0/2454892796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55821b9cdeb0 con 0x55821bab27a0 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.131+0000 7f5527fff700 1 -- 172.21.15.59:0/2454892796 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f5544004bc0 con 0x55821bab27a0 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.131+0000 7f5527fff700 1 -- 172.21.15.59:0/2454892796 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5544005910 con 0x55821bab27a0 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.131+0000 7f55628d9b80 10 client.27862 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.131+0000 7f55628d9b80 1 -- 172.21.15.59:0/2454892796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55821b819c60 con 0x55821bab27a0 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.131+0000 7f5527fff700 1 -- 172.21.15.59:0/2454892796 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55821b9cdeb0 con 0x55821bab27a0 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.132+0000 7f5527fff700 1 -- 172.21.15.59:0/2454892796 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f554400fd00 con 0x55821bab27a0 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.132+0000 7f55628d9b80 10 client.27862 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.132+0000 7f55628d9b80 10 client.27862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:49.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.132+0000 7f55628d9b80 20 client.27862 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:49.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.132+0000 7f55628d9b80 1 --2- 172.21.15.59:0/2454892796 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55821baccc80 0x55821bacf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.132+0000 7f55628d9b80 4 client.27862 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:57:49.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.132+0000 7f55628d9b80 1 -- 172.21.15.59:0/2454892796 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55821b9fee10 con 0x55821baccc80 2023-10-08T12:57:49.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.132+0000 7f553ffff700 1 --2- 172.21.15.59:0/2454892796 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55821baccc80 0x55821bacf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.132+0000 7f553ffff700 1 --2- 172.21.15.59:0/2454892796 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55821baccc80 0x55821bacf070 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b5ecb3aeb675460 server_cookie=c4f1d7a0af4418b in_seq=0 out_seq=0 2023-10-08T12:57:49.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.132+0000 7f5527fff700 10 client.27862 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:49.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f5527fff700 1 -- 172.21.15.59:0/2454892796 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55821b9fee10 con 0x55821baccc80 2023-10-08T12:57:49.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f5527fff700 10 client.27862 handle_command_reply: tid=0 2023-10-08T12:57:49.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f55628d9b80 1 client.27862 shutdown 2023-10-08T12:57:49.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f55628d9b80 1 -- 172.21.15.59:0/2454892796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab27a0 msgr2=0x55821baba2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:49.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f55628d9b80 1 --2- 172.21.15.59:0/2454892796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab27a0 0x55821baba2a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5544006010 tx=0x7f5544009ca0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f55628d9b80 1 -- 172.21.15.59:0/2454892796 shutdown_connections 2023-10-08T12:57:49.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f55628d9b80 1 --2- 172.21.15.59:0/2454892796 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55821baccc80 0x55821bacf070 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f55628d9b80 1 --2- 172.21.15.59:0/2454892796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab1e80 0x55821babd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f55628d9b80 1 --2- 172.21.15.59:0/2454892796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821baba8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f55628d9b80 1 --2- 172.21.15.59:0/2454892796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab27a0 0x55821baba2a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f5527fff700 0 client.27862 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:49.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f55628d9b80 1 -- 172.21.15.59:0/2454892796 >> 172.21.15.59:0/2454892796 conn(0x55821ba27260 msgr2=0x55821baadec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.135+0000 7f55628d9b80 1 -- 172.21.15.59:0/2454892796 shutdown_connections 2023-10-08T12:57:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.136+0000 7f55628d9b80 1 -- 172.21.15.59:0/2454892796 wait complete. 2023-10-08T12:57:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.136+0000 7f55628d9b80 20 client.27862 trim_cache size 0 max 16384 2023-10-08T12:57:49.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.150+0000 7f55628d9b80 1 Processor -- start 2023-10-08T12:57:49.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.150+0000 7f55628d9b80 1 -- start start 2023-10-08T12:57:49.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bac9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821bab27a0 0x55821baba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821babd650 0x55821bac41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f55628d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821b886920 con 0x55821bab27a0 2023-10-08T12:57:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f55628d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821babb910 con 0x55821babd650 2023-10-08T12:57:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f55628d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821baaaae0 con 0x55821bab1e80 2023-10-08T12:57:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f553ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bac9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f554cd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821bab27a0 0x55821baba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f553ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bac9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60416/0 (socket says 172.21.15.59:60416) 2023-10-08T12:57:49.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f553ffff700 1 -- 172.21.15.59:0/3836713023 learned_addr learned my addr 172.21.15.59:0/3836713023 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:49.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f553ffff700 1 --2- 172.21.15.59:0/3836713023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821babd650 0x55821bac41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f553ffff700 1 -- 172.21.15.59:0/3836713023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821babd650 msgr2=0x55821bac41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:49.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f553ffff700 1 --2- 172.21.15.59:0/3836713023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821babd650 0x55821bac41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f553ffff700 1 -- 172.21.15.59:0/3836713023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821bab27a0 msgr2=0x55821baba1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:49.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f553ffff700 1 --2- 172.21.15.59:0/3836713023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821bab27a0 0x55821baba1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.151+0000 7f553ffff700 1 -- 172.21.15.59:0/3836713023 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55821b857250 con 0x55821bab1e80 2023-10-08T12:57:49.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.152+0000 7f553ffff700 1 --2- 172.21.15.59:0/3836713023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bac9180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5538009f80 tx=0x7f5538004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=903d4f39114570f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:49.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.152+0000 7f552f7fe700 1 -- 172.21.15.59:0/3836713023 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55380263a0 con 0x55821bab1e80 2023-10-08T12:57:49.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.152+0000 7f552f7fe700 1 -- 172.21.15.59:0/3836713023 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5538017040 con 0x55821bab1e80 2023-10-08T12:57:49.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.152+0000 7f552f7fe700 1 -- 172.21.15.59:0/3836713023 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538004830 con 0x55821bab1e80 2023-10-08T12:57:49.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.152+0000 7f55628d9b80 1 -- 172.21.15.59:0/3836713023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 msgr2=0x55821bac9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:49.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.152+0000 7f55628d9b80 1 --2- 172.21.15.59:0/3836713023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bac9180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5538009f80 tx=0x7f5538004750 comp rx=0 tx=0).stop 2023-10-08T12:57:49.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.153+0000 7f55628d9b80 1 -- 172.21.15.59:0/3836713023 shutdown_connections 2023-10-08T12:57:49.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.153+0000 7f55628d9b80 1 --2- 172.21.15.59:0/3836713023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821babd650 0x55821bac41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.153+0000 7f55628d9b80 1 --2- 172.21.15.59:0/3836713023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bac9180 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.153+0000 7f55628d9b80 1 --2- 172.21.15.59:0/3836713023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821bab27a0 0x55821baba1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.153+0000 7f55628d9b80 1 -- 172.21.15.59:0/3836713023 >> 172.21.15.59:0/3836713023 conn(0x55821ba27260 msgr2=0x55821bab8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:49.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.153+0000 7f55628d9b80 1 -- 172.21.15.59:0/3836713023 shutdown_connections 2023-10-08T12:57:49.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.153+0000 7f55628d9b80 1 -- 172.21.15.59:0/3836713023 wait complete. 2023-10-08T12:57:49.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.153+0000 7f55628d9b80 1 -- start start 2023-10-08T12:57:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.153+0000 7f55628d9b80 1 Processor -- start 2023-10-08T12:57:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bac3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821bac4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f55628d9b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821bac2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f55628d9b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821bac2c90 con 0x55821babd650 2023-10-08T12:57:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f55628d9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821bac2e00 con 0x55821bab27a0 2023-10-08T12:57:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f55628d9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821bac2fc0 con 0x55821bab1e80 2023-10-08T12:57:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f55628d9b80 10 client.0 _ll_register_callbacks cb 0x7f5538009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:49.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f554cd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821bac4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f554cd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821bac4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48910/0 (socket says 172.21.15.59:48910) 2023-10-08T12:57:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f554cd9b700 1 -- 172.21.15.59:0/3440561689 learned_addr learned my addr 172.21.15.59:0/3440561689 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f553ffff700 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bac3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f553ffff700 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821bac2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f554cd9b700 1 -- 172.21.15.59:0/3440561689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 msgr2=0x55821bac3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:49.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f554cd9b700 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bac3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f554cd9b700 1 -- 172.21.15.59:0/3440561689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 msgr2=0x55821bac2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f554cd9b700 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821bac2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.154+0000 7f554cd9b700 1 -- 172.21.15.59:0/3440561689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5538019040 con 0x55821bab27a0 2023-10-08T12:57:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.155+0000 7f553ffff700 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821bac2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:57:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.155+0000 7f554cd9b700 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821bac4380 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x55821babb8e0 tx=0x7f55440059c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=165e7fd352ba863c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.155+0000 7f5527fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:57:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.155+0000 7f5527fff700 1 -- 172.21.15.59:0/3440561689 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554401d040 con 0x55821bab27a0 2023-10-08T12:57:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.155+0000 7f55628d9b80 1 -- 172.21.15.59:0/3440561689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f554401e040 con 0x55821bab27a0 2023-10-08T12:57:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.155+0000 7f5527fff700 1 -- 172.21.15.59:0/3440561689 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f554402cc60 con 0x55821bab27a0 2023-10-08T12:57:49.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.155+0000 7f5527fff700 1 -- 172.21.15.59:0/3440561689 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f554402ce40 con 0x55821bab27a0 2023-10-08T12:57:49.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.155+0000 7f55628d9b80 10 client.27872 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:49.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.155+0000 7f55628d9b80 1 -- 172.21.15.59:0/3440561689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55821b82f2b0 con 0x55821bab27a0 2023-10-08T12:57:49.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.156+0000 7f5527fff700 1 -- 172.21.15.59:0/3440561689 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f554401e040 con 0x55821bab27a0 2023-10-08T12:57:49.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.156+0000 7f5527fff700 1 -- 172.21.15.59:0/3440561689 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f554400fb90 con 0x55821bab27a0 2023-10-08T12:57:49.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.156+0000 7f55628d9b80 10 client.27872 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.156+0000 7f55628d9b80 10 client.27872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.156+0000 7f55628d9b80 20 client.27872 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.156+0000 7f55628d9b80 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55821bb21a50 0x55821bb23e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.156+0000 7f55628d9b80 4 client.27872 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:57:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.156+0000 7f55628d9b80 1 -- 172.21.15.59:0/3440561689 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55821b9feb30 con 0x55821bb21a50 2023-10-08T12:57:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.156+0000 7f553ffff700 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55821bb21a50 0x55821bb23e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.157+0000 7f5527fff700 10 client.27872 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.157+0000 7f553ffff700 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55821bb21a50 0x55821bb23e70 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3671462333a32be8 server_cookie=62bccaaaa649824f in_seq=0 out_seq=0 2023-10-08T12:57:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.163+0000 7f5527fff700 1 -- 172.21.15.59:0/3440561689 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55821b9feb30 con 0x55821bb21a50 2023-10-08T12:57:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.163+0000 7f5527fff700 10 client.27872 handle_command_reply: tid=0 2023-10-08T12:57:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.163+0000 7f55628d9b80 1 client.27872 shutdown 2023-10-08T12:57:49.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.163+0000 7f55628d9b80 1 -- 172.21.15.59:0/3440561689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 msgr2=0x55821bac4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:49.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.163+0000 7f55628d9b80 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821bac4380 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x55821babb8e0 tx=0x7f55440059c0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f55628d9b80 1 -- 172.21.15.59:0/3440561689 shutdown_connections 2023-10-08T12:57:49.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f55628d9b80 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55821bb21a50 0x55821bb23e70 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f55628d9b80 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55821babd650 0x55821bac2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f55628d9b80 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55821bab1e80 0x55821bac3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f5527fff700 0 client.27872 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f55628d9b80 1 --2- 172.21.15.59:0/3440561689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55821bab27a0 0x55821bac4380 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f55628d9b80 1 -- 172.21.15.59:0/3440561689 >> 172.21.15.59:0/3440561689 conn(0x55821ba27260 msgr2=0x55821bab9420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f55628d9b80 1 -- 172.21.15.59:0/3440561689 shutdown_connections 2023-10-08T12:57:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f55628d9b80 1 -- 172.21.15.59:0/3440561689 wait complete. 2023-10-08T12:57:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f55628d9b80 20 client.27872 trim_cache size 0 max 16384 2023-10-08T12:57:49.168 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:57:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f554efff700 1 -- 172.21.15.59:0/955461611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55300a1670 msgr2=0x7f55300a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f554efff700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55300a1670 0x7f55300a3b30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f55400ca370 tx=0x7f5540004cc0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f554efff700 1 -- 172.21.15.59:0/955461611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5548106740 msgr2=0x7f554819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.164+0000 7f554efff700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5548106740 0x7f554819d6c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f554000efc0 tx=0x7f554000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.165+0000 7f554efff700 1 -- 172.21.15.59:0/955461611 shutdown_connections 2023-10-08T12:57:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.165+0000 7f554efff700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f55300a1670 0x7f55300a3b30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.165+0000 7f554efff700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5548106740 0x7f554819d6c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.165+0000 7f554efff700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548100730 0x7f5548198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.165+0000 7f554efff700 1 --2- 172.21.15.59:0/955461611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55481010f0 0x7f5548199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.165+0000 7f554efff700 1 -- 172.21.15.59:0/955461611 >> 172.21.15.59:0/955461611 conn(0x7f55480fc200 msgr2=0x7f554810be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.165+0000 7f554efff700 1 -- 172.21.15.59:0/955461611 shutdown_connections 2023-10-08T12:57:49.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:49.165+0000 7f554efff700 1 -- 172.21.15.59:0/955461611 wait complete. 2023-10-08T12:57:49.183 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:49 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2965264086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:57:49.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:49 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2965264086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:57:49.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:49 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2965264086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:57:49.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 78720 20.73 MB/sec execute 80 sec latency 99.111 ms 2023-10-08T12:57:50.186 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:57:50.187 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:57:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.419+0000 7f73c95ff700 1 -- 172.21.15.59:0/2862933713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c4072bc0 msgr2=0x7f73c4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.419+0000 7f73c95ff700 1 --2- 172.21.15.59:0/2862933713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c4072bc0 0x7f73c4072fa0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009990 tx=0x7f73b4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.419+0000 7f73c95ff700 1 -- 172.21.15.59:0/2862933713 shutdown_connections 2023-10-08T12:57:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.419+0000 7f73c95ff700 1 --2- 172.21.15.59:0/2862933713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c4072bc0 0x7f73c4072fa0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.419+0000 7f73c95ff700 1 --2- 172.21.15.59:0/2862933713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c410cfe0 0x7f73c410f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.419+0000 7f73c95ff700 1 --2- 172.21.15.59:0/2862933713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73c40734e0 0x7f73c410caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.419+0000 7f73c95ff700 1 -- 172.21.15.59:0/2862933713 >> 172.21.15.59:0/2862933713 conn(0x7f73c40fc230 msgr2=0x7f73c40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.419+0000 7f73c95ff700 1 -- 172.21.15.59:0/2862933713 shutdown_connections 2023-10-08T12:57:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.419+0000 7f73c95ff700 1 -- 172.21.15.59:0/2862933713 wait complete. 2023-10-08T12:57:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.420+0000 7f73c95ff700 1 Processor -- start 2023-10-08T12:57:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.420+0000 7f73c95ff700 1 -- start start 2023-10-08T12:57:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.421+0000 7f73c95ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c4072bc0 0x7f73c4198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.421+0000 7f73c95ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73c40734e0 0x7f73c41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.421+0000 7f73c95ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c410cfe0 0x7f73c419d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.421+0000 7f73c95ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c419dda0 con 0x7f73c4072bc0 2023-10-08T12:57:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.421+0000 7f73c95ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c419df10 con 0x7f73c410cfe0 2023-10-08T12:57:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.421+0000 7f73c95ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c419e0d0 con 0x7f73c40734e0 2023-10-08T12:57:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.421+0000 7f73c27fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73c40734e0 0x7f73c41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.421+0000 7f73c2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c4072bc0 0x7f73c4198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.421+0000 7f73c27fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73c40734e0 0x7f73c41993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60440/0 (socket says 172.21.15.59:60440) 2023-10-08T12:57:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.421+0000 7f73c27fc700 1 -- 172.21.15.59:0/644906427 learned_addr learned my addr 172.21.15.59:0/644906427 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.421+0000 7f73c37fe700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c410cfe0 0x7f73c419d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.422+0000 7f73c27fc700 1 -- 172.21.15.59:0/644906427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c410cfe0 msgr2=0x7f73c419d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.422+0000 7f73c27fc700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c410cfe0 0x7f73c419d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.422+0000 7f73c27fc700 1 -- 172.21.15.59:0/644906427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c4072bc0 msgr2=0x7f73c4198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.422+0000 7f73c27fc700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c4072bc0 0x7f73c4198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.422+0000 7f73c27fc700 1 -- 172.21.15.59:0/644906427 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b40095f0 con 0x7f73c40734e0 2023-10-08T12:57:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.422+0000 7f73c37fe700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c410cfe0 0x7f73c419d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.422+0000 7f73c27fc700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73c40734e0 0x7f73c41993c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f73b800e9a0 tx=0x7f73b800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.422+0000 7f73abfff700 1 -- 172.21.15.59:0/644906427 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8009790 con 0x7f73c40734e0 2023-10-08T12:57:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.422+0000 7f73abfff700 1 -- 172.21.15.59:0/644906427 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73b8010430 con 0x7f73c40734e0 2023-10-08T12:57:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.422+0000 7f73abfff700 1 -- 172.21.15.59:0/644906427 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8018680 con 0x7f73c40734e0 2023-10-08T12:57:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.422+0000 7f73c95ff700 1 -- 172.21.15.59:0/644906427 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c419e3b0 con 0x7f73c40734e0 2023-10-08T12:57:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.423+0000 7f73c95ff700 1 -- 172.21.15.59:0/644906427 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c41a5bf0 con 0x7f73c40734e0 2023-10-08T12:57:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.426+0000 7f73abfff700 1 -- 172.21.15.59:0/644906427 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f73b80105a0 con 0x7f73c40734e0 2023-10-08T12:57:50.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.427+0000 7f73dcfceb80 1 Processor -- start 2023-10-08T12:57:50.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.428+0000 7f73dcfceb80 1 -- start start 2023-10-08T12:57:50.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.428+0000 7f73abfff700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73ac0a1670 0x7f73ac0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.428+0000 7f73abfff700 1 -- 172.21.15.59:0/644906427 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f73b8014070 con 0x7f73c40734e0 2023-10-08T12:57:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.428+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bc22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.428+0000 7f73c37fe700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73ac0a1670 0x7f73ac0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.428+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bcd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.428+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bcd6d0 0x55fc57bcfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.428+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc57b2b4e0 con 0x55fc57bc2820 2023-10-08T12:57:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.428+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc57b1cca0 con 0x55fc57bc1f00 2023-10-08T12:57:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.428+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc57b1a5c0 con 0x55fc57bcd6d0 2023-10-08T12:57:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bc22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bc22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48944/0 (socket says 172.21.15.59:48944) 2023-10-08T12:57:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c2ffd700 1 -- 172.21.15.59:0/1944252659 learned_addr learned my addr 172.21.15.59:0/1944252659 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c27fc700 1 --2- 172.21.15.59:0/1944252659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bcd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c37fe700 1 --2- 172.21.15.59:0/1944252659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bcd6d0 0x55fc57bcfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c2ffd700 1 -- 172.21.15.59:0/1944252659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bcd6d0 msgr2=0x55fc57bcfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c2ffd700 1 --2- 172.21.15.59:0/1944252659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bcd6d0 0x55fc57bcfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c2ffd700 1 -- 172.21.15.59:0/1944252659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 msgr2=0x55fc57bcd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c2ffd700 1 --2- 172.21.15.59:0/1944252659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bcd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c2ffd700 1 -- 172.21.15.59:0/1944252659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc57940e60 con 0x55fc57bc1f00 2023-10-08T12:57:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c2ffd700 1 --2- 172.21.15.59:0/1944252659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bc22e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f73b4005ef0 tx=0x7f73b400b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6f2f8349741551d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.429+0000 7f73c37fe700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73ac0a1670 0x7f73ac0a3b30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f73c4069e10 tx=0x7f73bc0045c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.430+0000 7f73a97fa700 1 -- 172.21.15.59:0/1944252659 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b401d070 con 0x55fc57bc1f00 2023-10-08T12:57:50.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.430+0000 7f73a97fa700 1 -- 172.21.15.59:0/1944252659 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73b401e040 con 0x55fc57bc1f00 2023-10-08T12:57:50.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.430+0000 7f73a97fa700 1 -- 172.21.15.59:0/1944252659 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4004820 con 0x55fc57bc1f00 2023-10-08T12:57:50.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.430+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1944252659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 msgr2=0x55fc57bc22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.430+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/1944252659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bc22e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f73b4005ef0 tx=0x7f73b400b610 comp rx=0 tx=0).stop 2023-10-08T12:57:50.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.431+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1944252659 shutdown_connections 2023-10-08T12:57:50.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.431+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/1944252659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bc22e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.431+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/1944252659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bcd6d0 0x55fc57bcfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.431+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/1944252659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bcd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.431+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1944252659 >> 172.21.15.59:0/1944252659 conn(0x55fc57b372e0 msgr2=0x55fc57bbe350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.431+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1944252659 shutdown_connections 2023-10-08T12:57:50.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.431+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1944252659 wait complete. 2023-10-08T12:57:50.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.431+0000 7f73dcfceb80 1 -- start start 2023-10-08T12:57:50.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.432+0000 7f73dcfceb80 1 Processor -- start 2023-10-08T12:57:50.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.432+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc1f00 0x55fc57bcd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.432+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.432+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bcd6d0 0x55fc57bcaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.432+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc57b15eb0 con 0x55fc57bc2820 2023-10-08T12:57:50.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.432+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc57ab2790 con 0x55fc57bcd6d0 2023-10-08T12:57:50.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.432+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc57ab2430 con 0x55fc57bc1f00 2023-10-08T12:57:50.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.432+0000 7f73dcfceb80 10 client.0 _ll_register_callbacks cb 0x55fc5790f880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:50.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.432+0000 7f73c2ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc1f00 0x55fc57bcd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.432+0000 7f73c37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bcd6d0 0x55fc57bcaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.433+0000 7f73c2ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc1f00 0x55fc57bcd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60458/0 (socket says 172.21.15.59:60458) 2023-10-08T12:57:50.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.433+0000 7f73c2ffd700 1 -- 172.21.15.59:0/1069801712 learned_addr learned my addr 172.21.15.59:0/1069801712 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:50.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.433+0000 7f73c27fc700 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.433+0000 7f73c37fe700 1 -- 172.21.15.59:0/1069801712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc1f00 msgr2=0x55fc57bcd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.433+0000 7f73c37fe700 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc1f00 0x55fc57bcd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.433+0000 7f73c37fe700 1 -- 172.21.15.59:0/1069801712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 msgr2=0x55fc57bca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.433+0000 7f73c37fe700 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.433+0000 7f73c37fe700 1 -- 172.21.15.59:0/1069801712 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c4110120 con 0x55fc57bcd6d0 2023-10-08T12:57:50.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.433+0000 7f73c37fe700 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bcd6d0 0x55fc57bcaa30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0049c0 tx=0x7f73bc004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70a43e131b3f6647 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.433+0000 7f73a6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:57:50.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.433+0000 7f73a6ff5700 1 -- 172.21.15.59:0/1069801712 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc024650 con 0x55fc57bcd6d0 2023-10-08T12:57:50.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1069801712 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc57addf30 con 0x55fc57bcd6d0 2023-10-08T12:57:50.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73a6ff5700 1 -- 172.21.15.59:0/1069801712 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f73bc0247b0 con 0x55fc57bcd6d0 2023-10-08T12:57:50.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73a6ff5700 1 -- 172.21.15.59:0/1069801712 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73bc024970 con 0x55fc57bcd6d0 2023-10-08T12:57:50.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73dcfceb80 10 client.27884 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:50.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1069801712 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55fc57929ce0 con 0x55fc57bcd6d0 2023-10-08T12:57:50.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73a6ff5700 1 -- 172.21.15.59:0/1069801712 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fc57addf30 con 0x55fc57bcd6d0 2023-10-08T12:57:50.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73a6ff5700 1 -- 172.21.15.59:0/1069801712 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f73bc022030 con 0x55fc57bcd6d0 2023-10-08T12:57:50.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73dcfceb80 10 client.27884 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:50.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73dcfceb80 10 client.27884 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:50.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73dcfceb80 20 client.27884 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:50.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fc57bdd190 0x55fc57bdf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73dcfceb80 4 client.27884 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:57:50.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.434+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1069801712 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc57b0ee90 con 0x55fc57bdd190 2023-10-08T12:57:50.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.435+0000 7f73c2ffd700 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fc57bdd190 0x55fc57bdf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.435+0000 7f73c2ffd700 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fc57bdd190 0x55fc57bdf5b0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7913202b48ff5383 server_cookie=167a4fe5963de18c in_seq=0 out_seq=0 2023-10-08T12:57:50.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.435+0000 7f73a6ff5700 10 client.27884 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:50.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.437+0000 7f73a6ff5700 1 -- 172.21.15.59:0/1069801712 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fc57b0ee90 con 0x55fc57bdd190 2023-10-08T12:57:50.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.437+0000 7f73a6ff5700 10 client.27884 handle_command_reply: tid=0 2023-10-08T12:57:50.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.437+0000 7f73dcfceb80 1 client.27884 shutdown 2023-10-08T12:57:50.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.437+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1069801712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bcd6d0 msgr2=0x55fc57bcaa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.437+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bcd6d0 0x55fc57bcaa30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0049c0 tx=0x7f73bc004b40 comp rx=0 tx=0).stop 2023-10-08T12:57:50.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.437+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1069801712 shutdown_connections 2023-10-08T12:57:50.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.437+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fc57bdd190 0x55fc57bdf5b0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.437+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bcd6d0 0x55fc57bcaa30 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.437+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc1f00 0x55fc57bcd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.437+0000 7f73a6ff5700 0 client.27884 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:50.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.437+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/1069801712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.438+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1069801712 >> 172.21.15.59:0/1069801712 conn(0x55fc57b372e0 msgr2=0x55fc57bbdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.438+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1069801712 shutdown_connections 2023-10-08T12:57:50.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.438+0000 7f73dcfceb80 1 -- 172.21.15.59:0/1069801712 wait complete. 2023-10-08T12:57:50.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.438+0000 7f73dcfceb80 20 client.27884 trim_cache size 0 max 16384 2023-10-08T12:57:50.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.459+0000 7f73dcfceb80 1 Processor -- start 2023-10-08T12:57:50.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.459+0000 7f73dcfceb80 1 -- start start 2023-10-08T12:57:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.459+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bbe500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.459+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bd4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.459+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bcd6d0 0x55fc57bd8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.459+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc579969a0 con 0x55fc57bc2820 2023-10-08T12:57:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.459+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc57bc3150 con 0x55fc57bc1f00 2023-10-08T12:57:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.459+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc57bcb030 con 0x55fc57bcd6d0 2023-10-08T12:57:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bbe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c27fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bd4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bbe500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48956/0 (socket says 172.21.15.59:48956) 2023-10-08T12:57:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c2ffd700 1 -- 172.21.15.59:0/2032546698 learned_addr learned my addr 172.21.15.59:0/2032546698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c37fe700 1 --2- 172.21.15.59:0/2032546698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bcd6d0 0x55fc57bd8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c2ffd700 1 -- 172.21.15.59:0/2032546698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bcd6d0 msgr2=0x55fc57bd8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c2ffd700 1 --2- 172.21.15.59:0/2032546698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bcd6d0 0x55fc57bd8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c2ffd700 1 -- 172.21.15.59:0/2032546698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 msgr2=0x55fc57bd4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c2ffd700 1 --2- 172.21.15.59:0/2032546698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bd4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c2ffd700 1 -- 172.21.15.59:0/2032546698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc579672d0 con 0x55fc57bc1f00 2023-10-08T12:57:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c37fe700 1 --2- 172.21.15.59:0/2032546698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bcd6d0 0x55fc57bd8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:57:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.460+0000 7f73c2ffd700 1 --2- 172.21.15.59:0/2032546698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bbe500 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f73b400b6c0 tx=0x7f73b401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eefad16d6db919 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73a9ffb700 1 -- 172.21.15.59:0/2032546698 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4032070 con 0x55fc57bc1f00 2023-10-08T12:57:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73a9ffb700 1 -- 172.21.15.59:0/2032546698 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73b4005670 con 0x55fc57bc1f00 2023-10-08T12:57:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73a9ffb700 1 -- 172.21.15.59:0/2032546698 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b401d040 con 0x55fc57bc1f00 2023-10-08T12:57:50.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2032546698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 msgr2=0x55fc57bbe500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/2032546698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bbe500 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f73b400b6c0 tx=0x7f73b401a040 comp rx=0 tx=0).stop 2023-10-08T12:57:50.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2032546698 shutdown_connections 2023-10-08T12:57:50.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/2032546698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57bbe500 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/2032546698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bcd6d0 0x55fc57bd8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/2032546698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bc2820 0x55fc57bd4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2032546698 >> 172.21.15.59:0/2032546698 conn(0x55fc57b372e0 msgr2=0x55fc57bbddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2032546698 shutdown_connections 2023-10-08T12:57:50.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.461+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2032546698 wait complete. 2023-10-08T12:57:50.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.462+0000 7f73dcfceb80 1 -- start start 2023-10-08T12:57:50.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.462+0000 7f73dcfceb80 1 Processor -- start 2023-10-08T12:57:50.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57c2b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc2820 0x55fc57c2bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73dcfceb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bcd6d0 0x55fc57bd3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc57bd3b10 con 0x55fc57bcd6d0 2023-10-08T12:57:50.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc57bd3c80 con 0x55fc57bc1f00 2023-10-08T12:57:50.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73dcfceb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc57bd3e40 con 0x55fc57bc2820 2023-10-08T12:57:50.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73dcfceb80 10 client.0 _ll_register_callbacks cb 0x7f73bc00e9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73c27fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc2820 0x55fc57c2bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73c37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bcd6d0 0x55fc57bd3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73c27fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc2820 0x55fc57c2bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:60474/0 (socket says 172.21.15.59:60474) 2023-10-08T12:57:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73c27fc700 1 -- 172.21.15.59:0/2378403122 learned_addr learned my addr 172.21.15.59:0/2378403122 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73c2ffd700 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57c2b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73c27fc700 1 -- 172.21.15.59:0/2378403122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 msgr2=0x55fc57c2b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73c27fc700 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57c2b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73c27fc700 1 -- 172.21.15.59:0/2378403122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bcd6d0 msgr2=0x55fc57bd3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73c27fc700 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bcd6d0 0x55fc57bd3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.463+0000 7f73c27fc700 1 -- 172.21.15.59:0/2378403122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc57940e60 con 0x55fc57bc2820 2023-10-08T12:57:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.464+0000 7f73c27fc700 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc2820 0x55fc57c2bb90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f73b80cd1e0 tx=0x7f73b8096600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbd89c7044ade9f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.464+0000 7f73a6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:57:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.464+0000 7f73a6ff5700 1 -- 172.21.15.59:0/2378403122 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b80b6070 con 0x55fc57bc2820 2023-10-08T12:57:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.464+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2378403122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73b401e040 con 0x55fc57bc2820 2023-10-08T12:57:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.464+0000 7f73a6ff5700 1 -- 172.21.15.59:0/2378403122 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f73b809e150 con 0x55fc57bc2820 2023-10-08T12:57:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.464+0000 7f73a6ff5700 1 -- 172.21.15.59:0/2378403122 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73b809a240 con 0x55fc57bc2820 2023-10-08T12:57:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.464+0000 7f73dcfceb80 10 client.27886 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.464+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2378403122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55fc5793f330 con 0x55fc57bc2820 2023-10-08T12:57:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.465+0000 7f73a6ff5700 1 -- 172.21.15.59:0/2378403122 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73b401e040 con 0x55fc57bc2820 2023-10-08T12:57:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.465+0000 7f73a6ff5700 1 -- 172.21.15.59:0/2378403122 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f73b8099730 con 0x55fc57bc2820 2023-10-08T12:57:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.465+0000 7f73dcfceb80 10 client.27886 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.465+0000 7f73dcfceb80 10 client.27886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.465+0000 7f73dcfceb80 20 client.27886 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.465+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fc57bdd190 0x55fc57c355c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.465+0000 7f73dcfceb80 4 client.27886 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:57:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.465+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2378403122 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55fc57b0ebb0 con 0x55fc57bdd190 2023-10-08T12:57:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.465+0000 7f73c2ffd700 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fc57bdd190 0x55fc57c355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.466+0000 7f73c2ffd700 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fc57bdd190 0x55fc57c355c0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf0153b6843bfb14 server_cookie=29c23f19f87139a6 in_seq=0 out_seq=0 2023-10-08T12:57:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.466+0000 7f73a6ff5700 10 client.27886 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:50.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:50 smithi173 ceph-mon[135182]: pgmap v833: 97 pgs: 97 active+clean; 909 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 377 op/s 2023-10-08T12:57:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.473+0000 7f73a6ff5700 1 -- 172.21.15.59:0/2378403122 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55fc57b0ebb0 con 0x55fc57bdd190 2023-10-08T12:57:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.473+0000 7f73a6ff5700 10 client.27886 handle_command_reply: tid=0 2023-10-08T12:57:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.473+0000 7f73dcfceb80 1 client.27886 shutdown 2023-10-08T12:57:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.473+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2378403122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc2820 msgr2=0x55fc57c2bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.473+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc2820 0x55fc57c2bb90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f73b80cd1e0 tx=0x7f73b8096600 comp rx=0 tx=0).stop 2023-10-08T12:57:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.473+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2378403122 shutdown_connections 2023-10-08T12:57:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.473+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fc57bdd190 0x55fc57c355c0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.474+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc57bc1f00 0x55fc57c2b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.474+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc57bcd6d0 0x55fc57bd3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.474+0000 7f73dcfceb80 1 --2- 172.21.15.59:0/2378403122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc57bc2820 0x55fc57c2bb90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.474+0000 7f73a6ff5700 0 client.27886 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.474+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2378403122 >> 172.21.15.59:0/2378403122 conn(0x55fc57b372e0 msgr2=0x55fc57bd8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.474+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2378403122 shutdown_connections 2023-10-08T12:57:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.474+0000 7f73dcfceb80 1 -- 172.21.15.59:0/2378403122 wait complete. 2023-10-08T12:57:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.474+0000 7f73dcfceb80 20 client.27886 trim_cache size 0 max 16384 2023-10-08T12:57:50.477 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:57:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:57:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "6b1f9366-121a-4d24-b321-34fe95f609b7", 2023-10-08T12:57:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:57:50.477 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:57:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 -- 172.21.15.59:0/644906427 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73ac0a1670 msgr2=0x7f73ac0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73ac0a1670 0x7f73ac0a3b30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f73c4069e10 tx=0x7f73bc0045c0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 -- 172.21.15.59:0/644906427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73c40734e0 msgr2=0x7f73c41993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73c40734e0 0x7f73c41993c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f73b800e9a0 tx=0x7f73b800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 -- 172.21.15.59:0/644906427 shutdown_connections 2023-10-08T12:57:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f73ac0a1670 0x7f73ac0a3b30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c410cfe0 0x7f73c419d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c4072bc0 0x7f73c4198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 --2- 172.21.15.59:0/644906427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73c40734e0 0x7f73c41993c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 -- 172.21.15.59:0/644906427 >> 172.21.15.59:0/644906427 conn(0x7f73c40fc230 msgr2=0x7f73c40fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 -- 172.21.15.59:0/644906427 shutdown_connections 2023-10-08T12:57:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.475+0000 7f73c95ff700 1 -- 172.21.15.59:0/644906427 wait complete. 2023-10-08T12:57:50.493 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:50 smithi059 ceph-mon[98489]: pgmap v833: 97 pgs: 97 active+clean; 909 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 377 op/s 2023-10-08T12:57:50.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:57:50.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:50 smithi092 ceph-mon[134093]: pgmap v833: 97 pgs: 97 active+clean; 909 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 377 op/s 2023-10-08T12:57:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.726+0000 7f4d899ff700 1 -- 172.21.15.59:0/2830347553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d840fffe0 msgr2=0x7f4d8410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.726+0000 7f4d899ff700 1 --2- 172.21.15.59:0/2830347553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d840fffe0 0x7f4d8410c4e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009f90 tx=0x7f4d7c00b330 comp rx=0 tx=0).stop 2023-10-08T12:57:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.727+0000 7f4d899ff700 1 -- 172.21.15.59:0/2830347553 shutdown_connections 2023-10-08T12:57:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.727+0000 7f4d899ff700 1 --2- 172.21.15.59:0/2830347553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d840fffe0 0x7f4d8410c4e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.727+0000 7f4d899ff700 1 --2- 172.21.15.59:0/2830347553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d841056b0 0x7f4d84105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.727+0000 7f4d899ff700 1 --2- 172.21.15.59:0/2830347553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d840ff620 0x7f4d840ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.727+0000 7f4d899ff700 1 -- 172.21.15.59:0/2830347553 >> 172.21.15.59:0/2830347553 conn(0x7f4d84076780 msgr2=0x7f4d84076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.727+0000 7f4d899ff700 1 -- 172.21.15.59:0/2830347553 shutdown_connections 2023-10-08T12:57:50.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.727+0000 7f4d899ff700 1 -- 172.21.15.59:0/2830347553 wait complete. 2023-10-08T12:57:50.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.728+0000 7f4d899ff700 1 Processor -- start 2023-10-08T12:57:50.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.728+0000 7f4d899ff700 1 -- start start 2023-10-08T12:57:50.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d899ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d840ff620 0x7f4d8419e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d899ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d840fffe0 0x7f4d8419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d899ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d841056b0 0x7f4d84198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d899ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d841991a0 con 0x7f4d841056b0 2023-10-08T12:57:50.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d899ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84199310 con 0x7f4d840fffe0 2023-10-08T12:57:50.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d899ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d841994d0 con 0x7f4d840ff620 2023-10-08T12:57:50.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d82ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d840ff620 0x7f4d8419e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d82ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d840ff620 0x7f4d8419e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34584/0 (socket says 172.21.15.59:34584) 2023-10-08T12:57:50.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d82ffd700 1 -- 172.21.15.59:0/3572653247 learned_addr learned my addr 172.21.15.59:0/3572653247 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:50.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d827fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d840fffe0 0x7f4d8419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d837fe700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d841056b0 0x7f4d84198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d827fc700 1 -- 172.21.15.59:0/3572653247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d840ff620 msgr2=0x7f4d8419e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d827fc700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d840ff620 0x7f4d8419e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d827fc700 1 -- 172.21.15.59:0/3572653247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d841056b0 msgr2=0x7f4d84198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d827fc700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d841056b0 0x7f4d84198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d827fc700 1 -- 172.21.15.59:0/3572653247 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d740095f0 con 0x7f4d840fffe0 2023-10-08T12:57:50.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.729+0000 7f4d82ffd700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d840ff620 0x7f4d8419e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:50.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.730+0000 7f4d827fc700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d840fffe0 0x7f4d8419eef0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800e9f0 tx=0x7f4d7800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.730+0000 7f4d889fd700 1 -- 172.21.15.59:0/3572653247 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800c9c0 con 0x7f4d840fffe0 2023-10-08T12:57:50.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.730+0000 7f4d889fd700 1 -- 172.21.15.59:0/3572653247 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d78010430 con 0x7f4d840fffe0 2023-10-08T12:57:50.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.730+0000 7f4d889fd700 1 -- 172.21.15.59:0/3572653247 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78018680 con 0x7f4d840fffe0 2023-10-08T12:57:50.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.730+0000 7f4d899ff700 1 -- 172.21.15.59:0/3572653247 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c009c40 con 0x7f4d840fffe0 2023-10-08T12:57:50.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.730+0000 7f4d899ff700 1 -- 172.21.15.59:0/3572653247 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d841a5870 con 0x7f4d840fffe0 2023-10-08T12:57:50.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.733+0000 7f4d889fd700 1 -- 172.21.15.59:0/3572653247 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f4d78010860 con 0x7f4d840fffe0 2023-10-08T12:57:50.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.735+0000 7f4d889fd700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4d6c0a15f0 0x7f4d6c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.735+0000 7f4d9d336b80 1 Processor -- start 2023-10-08T12:57:50.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.736+0000 7f4d889fd700 1 -- 172.21.15.59:0/3572653247 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4d78014070 con 0x7f4d840fffe0 2023-10-08T12:57:50.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.736+0000 7f4d82ffd700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4d6c0a15f0 0x7f4d6c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.736+0000 7f4d9d336b80 1 -- start start 2023-10-08T12:57:50.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.736+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee7b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.736+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee86110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.736+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee88a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.736+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1ede4460 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.736+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1edd5c20 con 0x55fd1ee86650 2023-10-08T12:57:50.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.736+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1edd3540 con 0x55fd1ee7ae80 2023-10-08T12:57:50.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.737+0000 7f4d827fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee86110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.737+0000 7f4d837fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee88a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.737+0000 7f4d827fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee86110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37198/0 (socket says 172.21.15.59:37198) 2023-10-08T12:57:50.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.737+0000 7f4d827fc700 1 -- 172.21.15.59:0/1596694332 learned_addr learned my addr 172.21.15.59:0/1596694332 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:50.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.737+0000 7f4d82ffd700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4d6c0a15f0 0x7f4d6c0a3ab0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d74005950 tx=0x7f4d74009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.737+0000 7f4d82ffd700 1 --2- 172.21.15.59:0/1596694332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee7b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.737+0000 7f4d837fe700 1 -- 172.21.15.59:0/1596694332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 msgr2=0x55fd1ee7b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.737+0000 7f4d837fe700 1 --2- 172.21.15.59:0/1596694332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee7b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.737+0000 7f4d837fe700 1 -- 172.21.15.59:0/1596694332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7b7a0 msgr2=0x55fd1ee86110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.737+0000 7f4d837fe700 1 --2- 172.21.15.59:0/1596694332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee86110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.737+0000 7f4d837fe700 1 -- 172.21.15.59:0/1596694332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd1ebf9de0 con 0x55fd1ee86650 2023-10-08T12:57:50.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.738+0000 7f4d837fe700 1 --2- 172.21.15.59:0/1596694332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee88a40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009f90 tx=0x7f4d7c006040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45188fdc0ab87711 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.738+0000 7f4d69ffb700 1 -- 172.21.15.59:0/1596694332 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00e040 con 0x55fd1ee86650 2023-10-08T12:57:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.738+0000 7f4d69ffb700 1 -- 172.21.15.59:0/1596694332 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d7c003cc0 con 0x55fd1ee86650 2023-10-08T12:57:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.738+0000 7f4d69ffb700 1 -- 172.21.15.59:0/1596694332 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c01c440 con 0x55fd1ee86650 2023-10-08T12:57:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.739+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1596694332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 msgr2=0x55fd1ee88a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.739+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/1596694332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee88a40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009f90 tx=0x7f4d7c006040 comp rx=0 tx=0).stop 2023-10-08T12:57:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.739+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1596694332 shutdown_connections 2023-10-08T12:57:50.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.739+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/1596694332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee88a40 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.739+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/1596694332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee7b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.739+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/1596694332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee86110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.739+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1596694332 >> 172.21.15.59:0/1596694332 conn(0x55fd1edf0260 msgr2=0x55fd1ee772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.739+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1596694332 shutdown_connections 2023-10-08T12:57:50.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.740+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1596694332 wait complete. 2023-10-08T12:57:50.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.741+0000 7f4d9d336b80 1 -- start start 2023-10-08T12:57:50.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.741+0000 7f4d9d336b80 1 Processor -- start 2023-10-08T12:57:50.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee86060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee833a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1edcee30 con 0x55fd1ee7ae80 2023-10-08T12:57:50.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1ed6b710 con 0x55fd1ee86650 2023-10-08T12:57:50.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1ed6b3b0 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d9d336b80 10 client.0 _ll_register_callbacks cb 0x55fd1ebc8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:50.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d82ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee86060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d82ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee86060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37204/0 (socket says 172.21.15.59:37204) 2023-10-08T12:57:50.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d82ffd700 1 -- 172.21.15.59:0/1431582854 learned_addr learned my addr 172.21.15.59:0/1431582854 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:50.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d827fc700 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee833a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.742+0000 7f4d837fe700 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.743+0000 7f4d837fe700 1 -- 172.21.15.59:0/1431582854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7b7a0 msgr2=0x55fd1ee833a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.743+0000 7f4d837fe700 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee833a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.743+0000 7f4d837fe700 1 -- 172.21.15.59:0/1431582854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7ae80 msgr2=0x55fd1ee86060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.743+0000 7f4d837fe700 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee86060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.743+0000 7f4d837fe700 1 -- 172.21.15.59:0/1431582854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8410cde0 con 0x55fd1ee86650 2023-10-08T12:57:50.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.743+0000 7f4d82ffd700 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee86060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:50.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.743+0000 7f4d837fe700 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee839d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00b6c0 tx=0x7f4d7c00bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c08842876174b9d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.743+0000 7f4d62ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:57:50.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.743+0000 7f4d62ffd700 1 -- 172.21.15.59:0/1431582854 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00e070 con 0x55fd1ee86650 2023-10-08T12:57:50.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.743+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1431582854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd1ed96eb0 con 0x55fd1ee86650 2023-10-08T12:57:50.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.743+0000 7f4d62ffd700 1 -- 172.21.15.59:0/1431582854 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4d7c005040 con 0x55fd1ee86650 2023-10-08T12:57:50.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.744+0000 7f4d62ffd700 1 -- 172.21.15.59:0/1431582854 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d7c009ac0 con 0x55fd1ee86650 2023-10-08T12:57:50.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.744+0000 7f4d9d336b80 10 client.27902 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:50.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.744+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1431582854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55fd1ebe2c60 con 0x55fd1ee86650 2023-10-08T12:57:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.744+0000 7f4d62ffd700 1 -- 172.21.15.59:0/1431582854 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fd1ed96eb0 con 0x55fd1ee86650 2023-10-08T12:57:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.744+0000 7f4d62ffd700 1 -- 172.21.15.59:0/1431582854 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4d7c019070 con 0x55fd1ee86650 2023-10-08T12:57:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.744+0000 7f4d9d336b80 10 client.27902 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.744+0000 7f4d9d336b80 10 client.27902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.744+0000 7f4d9d336b80 20 client.27902 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.744+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fd1ee9e570 0x55fd1eea0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.744+0000 7f4d9d336b80 4 client.27902 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:57:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.744+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1431582854 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd1edc7e10 con 0x55fd1ee9e570 2023-10-08T12:57:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.745+0000 7f4d82ffd700 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fd1ee9e570 0x55fd1eea0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.745+0000 7f4d82ffd700 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fd1ee9e570 0x55fd1eea0960 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b71468975d6e8b47 server_cookie=3e83d50f8827213 in_seq=0 out_seq=0 2023-10-08T12:57:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.745+0000 7f4d62ffd700 10 client.27902 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d62ffd700 1 -- 172.21.15.59:0/1431582854 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fd1edc7e10 con 0x55fd1ee9e570 2023-10-08T12:57:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d62ffd700 10 client.27902 handle_command_reply: tid=0 2023-10-08T12:57:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 1 client.27902 shutdown 2023-10-08T12:57:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1431582854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 msgr2=0x55fd1ee839d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee839d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00b6c0 tx=0x7f4d7c00bc20 comp rx=0 tx=0).stop 2023-10-08T12:57:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1431582854 shutdown_connections 2023-10-08T12:57:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fd1ee9e570 0x55fd1eea0960 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee839d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee86060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d62ffd700 0 client.27902 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/1431582854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee833a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1431582854 >> 172.21.15.59:0/1431582854 conn(0x55fd1edf0260 msgr2=0x55fd1ee76ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1431582854 shutdown_connections 2023-10-08T12:57:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 1 -- 172.21.15.59:0/1431582854 wait complete. 2023-10-08T12:57:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.748+0000 7f4d9d336b80 20 client.27902 trim_cache size 0 max 16384 2023-10-08T12:57:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.767+0000 7f4d9d336b80 1 Processor -- start 2023-10-08T12:57:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.767+0000 7f4d9d336b80 1 -- start start 2023-10-08T12:57:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.767+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee7e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.767+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee7ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.767+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee76cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.767+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1ec4f920 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.767+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1ee7c100 con 0x55fd1ee86650 2023-10-08T12:57:50.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.767+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1ee715f0 con 0x55fd1ee7ae80 2023-10-08T12:57:50.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d837fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee76cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d827fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee7ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d837fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee76cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:40096/0 (socket says 172.21.15.59:40096) 2023-10-08T12:57:50.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d837fe700 1 -- 172.21.15.59:0/668888294 learned_addr learned my addr 172.21.15.59:0/668888294 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:50.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d82ffd700 1 --2- 172.21.15.59:0/668888294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee7e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d837fe700 1 -- 172.21.15.59:0/668888294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 msgr2=0x55fd1ee7e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d837fe700 1 --2- 172.21.15.59:0/668888294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee7e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d837fe700 1 -- 172.21.15.59:0/668888294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7b7a0 msgr2=0x55fd1ee7ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d837fe700 1 --2- 172.21.15.59:0/668888294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee7ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d837fe700 1 -- 172.21.15.59:0/668888294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd1ec20250 con 0x55fd1ee86650 2023-10-08T12:57:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d837fe700 1 --2- 172.21.15.59:0/668888294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee76cd0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009960 tx=0x7f4d7c0094d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=424b873f500b9fcf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.768+0000 7f4d6a7fc700 1 -- 172.21.15.59:0/668888294 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00e040 con 0x55fd1ee86650 2023-10-08T12:57:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.769+0000 7f4d6a7fc700 1 -- 172.21.15.59:0/668888294 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d7c009ac0 con 0x55fd1ee86650 2023-10-08T12:57:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.769+0000 7f4d6a7fc700 1 -- 172.21.15.59:0/668888294 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c01cb10 con 0x55fd1ee86650 2023-10-08T12:57:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.769+0000 7f4d9d336b80 1 -- 172.21.15.59:0/668888294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 msgr2=0x55fd1ee76cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.769+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/668888294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee76cd0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009960 tx=0x7f4d7c0094d0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.769+0000 7f4d9d336b80 1 -- 172.21.15.59:0/668888294 shutdown_connections 2023-10-08T12:57:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.769+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/668888294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee86650 0x55fd1ee76cd0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.769+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/668888294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee7e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.769+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/668888294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee7ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.769+0000 7f4d9d336b80 1 -- 172.21.15.59:0/668888294 >> 172.21.15.59:0/668888294 conn(0x55fd1edf0260 msgr2=0x55fd1ee91890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.769+0000 7f4d9d336b80 1 -- 172.21.15.59:0/668888294 shutdown_connections 2023-10-08T12:57:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.769+0000 7f4d9d336b80 1 -- 172.21.15.59:0/668888294 wait complete. 2023-10-08T12:57:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.770+0000 7f4d9d336b80 1 -- start start 2023-10-08T12:57:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.770+0000 7f4d9d336b80 1 Processor -- start 2023-10-08T12:57:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee8d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee8b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d9d336b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee86650 0x55fd1ee8ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1ee8c020 con 0x55fd1ee86650 2023-10-08T12:57:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1ee8c160 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d9d336b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1ee8c320 con 0x55fd1ee7ae80 2023-10-08T12:57:50.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d9d336b80 10 client.0 _ll_register_callbacks cb 0x7f4d78096550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:50.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d827fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee8b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d827fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee8b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:40098/0 (socket says 172.21.15.59:40098) 2023-10-08T12:57:50.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d837fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee86650 0x55fd1ee8ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d827fc700 1 -- 172.21.15.59:0/3411702055 learned_addr learned my addr 172.21.15.59:0/3411702055 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:57:50.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d82ffd700 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee8d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d827fc700 1 -- 172.21.15.59:0/3411702055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 msgr2=0x55fd1ee8d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d827fc700 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee8d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d827fc700 1 -- 172.21.15.59:0/3411702055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee86650 msgr2=0x55fd1ee8ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:50.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d827fc700 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee86650 0x55fd1ee8ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d827fc700 1 -- 172.21.15.59:0/3411702055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd1ebe2c60 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d827fc700 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee8b4c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009230 tx=0x7f4d780cd150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4271f803870f4b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.771+0000 7f4d62ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:57:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d62ffd700 1 -- 172.21.15.59:0/3411702055 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780b1070 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d9d336b80 1 -- 172.21.15.59:0/3411702055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd1edc7b30 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d62ffd700 1 -- 172.21.15.59:0/3411702055 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4d7809a910 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d62ffd700 1 -- 172.21.15.59:0/3411702055 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d7809e120 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d9d336b80 10 client.27908 fetch_fsmap learned FSMap version 20 2023-10-08T12:57:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d9d336b80 1 -- 172.21.15.59:0/3411702055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55fd1ebf82b0 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d62ffd700 1 -- 172.21.15.59:0/3411702055 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fd1edc7b30 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d62ffd700 1 -- 172.21.15.59:0/3411702055 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4d78099700 con 0x55fd1ee7b7a0 2023-10-08T12:57:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d9d336b80 10 client.27908 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:57:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d9d336b80 10 client.27908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d9d336b80 20 client.27908 populate_metadata read hostname 'smithi059' 2023-10-08T12:57:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fd1eef3950 0x55fd1eef5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d9d336b80 4 client.27908 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:57:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.772+0000 7f4d9d336b80 1 -- 172.21.15.59:0/3411702055 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fd1ec1af70 con 0x55fd1eef3950 2023-10-08T12:57:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.773+0000 7f4d82ffd700 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fd1eef3950 0x55fd1eef5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.773+0000 7f4d82ffd700 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fd1eef3950 0x55fd1eef5d70 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=994d921f023482c1 server_cookie=8145055cafb43261 in_seq=0 out_seq=0 2023-10-08T12:57:50.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.773+0000 7f4d62ffd700 10 client.27908 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:50.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d62ffd700 1 -- 172.21.15.59:0/3411702055 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55fd1ec1af70 con 0x55fd1eef3950 2023-10-08T12:57:50.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d62ffd700 10 client.27908 handle_command_reply: tid=0 2023-10-08T12:57:50.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d9d336b80 1 client.27908 shutdown 2023-10-08T12:57:50.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d9d336b80 1 -- 172.21.15.59:0/3411702055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee7b7a0 msgr2=0x55fd1ee8b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee8b4c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009230 tx=0x7f4d780cd150 comp rx=0 tx=0).stop 2023-10-08T12:57:50.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d9d336b80 1 -- 172.21.15.59:0/3411702055 shutdown_connections 2023-10-08T12:57:50.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fd1eef3950 0x55fd1eef5d70 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd1ee86650 0x55fd1ee8ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd1ee7ae80 0x55fd1ee8d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d62ffd700 0 client.27908 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:57:50.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d9d336b80 1 --2- 172.21.15.59:0/3411702055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd1ee7b7a0 0x55fd1ee8b4c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d9d336b80 1 -- 172.21.15.59:0/3411702055 >> 172.21.15.59:0/3411702055 conn(0x55fd1edf0260 msgr2=0x55fd1ee7e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d9d336b80 1 -- 172.21.15.59:0/3411702055 shutdown_connections 2023-10-08T12:57:50.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.776+0000 7f4d9d336b80 1 -- 172.21.15.59:0/3411702055 wait complete. 2023-10-08T12:57:50.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d9d336b80 20 client.27908 trim_cache size 0 max 16384 2023-10-08T12:57:50.784 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:57:50.784 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "scrub active (414 inodes in the stack)", 2023-10-08T12:57:50.784 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:57:50.784 INFO:teuthology.orchestra.run.smithi059.stdout: "6b1f9366-121a-4d24-b321-34fe95f609b7": { 2023-10-08T12:57:50.785 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:57:50.785 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "6b1f9366-121a-4d24-b321-34fe95f609b7", 2023-10-08T12:57:50.785 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:57:50.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:57:50.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:57:50.785 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:57:50.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 -- 172.21.15.59:0/3572653247 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4d6c0a15f0 msgr2=0x7f4d6c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4d6c0a15f0 0x7f4d6c0a3ab0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d74005950 tx=0x7f4d74009310 comp rx=0 tx=0).stop 2023-10-08T12:57:50.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 -- 172.21.15.59:0/3572653247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d840fffe0 msgr2=0x7f4d8419eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:50.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d840fffe0 0x7f4d8419eef0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800e9f0 tx=0x7f4d7800ed00 comp rx=0 tx=0).stop 2023-10-08T12:57:50.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 -- 172.21.15.59:0/3572653247 shutdown_connections 2023-10-08T12:57:50.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4d6c0a15f0 0x7f4d6c0a3ab0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d841056b0 0x7f4d84198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d840ff620 0x7f4d8419e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 --2- 172.21.15.59:0/3572653247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d840fffe0 0x7f4d8419eef0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:50.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 -- 172.21.15.59:0/3572653247 >> 172.21.15.59:0/3572653247 conn(0x7f4d84076780 msgr2=0x7f4d840fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:50.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 -- 172.21.15.59:0/3572653247 shutdown_connections 2023-10-08T12:57:50.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:57:50.777+0000 7f4d899ff700 1 -- 172.21.15.59:0/3572653247 wait complete. 2023-10-08T12:57:50.797 INFO:tasks.cephfs.filesystem:scrub status for tag:6b1f9366-121a-4d24-b321-34fe95f609b7 - {'path': '/', 'tag': '6b1f9366-121a-4d24-b321-34fe95f609b7', 'options': 'recursive,force'} 2023-10-08T12:57:50.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 79092 20.69 MB/sec execute 81 sec latency 116.497 ms 2023-10-08T12:57:51.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:51 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:57:51.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:51 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:51.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:51 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:57:51.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:51 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:57:51.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:51 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:51.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:51 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:57:51.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:51 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:57:51.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:51 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:51.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:51 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:57:51.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 79490 20.75 MB/sec execute 82 sec latency 142.418 ms 2023-10-08T12:57:52.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:52 smithi173 ceph-mon[135182]: pgmap v834: 97 pgs: 97 active+clean; 914 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.4 MiB/s wr, 358 op/s 2023-10-08T12:57:52.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:52 smithi059 ceph-mon[98489]: pgmap v834: 97 pgs: 97 active+clean; 914 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.4 MiB/s wr, 358 op/s 2023-10-08T12:57:52.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:52 smithi092 ceph-mon[134093]: pgmap v834: 97 pgs: 97 active+clean; 914 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.4 MiB/s wr, 358 op/s 2023-10-08T12:57:52.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 79818 20.73 MB/sec execute 83 sec latency 472.138 ms 2023-10-08T12:57:53.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:53 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:53.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:53 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:57:53.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:53 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:53.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:53 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:57:53.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:53 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:57:53.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:53 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:57:53.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 80293 20.67 MB/sec execute 84 sec latency 171.087 ms 2023-10-08T12:57:54.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:54 smithi173 ceph-mon[135182]: pgmap v835: 97 pgs: 97 active+clean; 923 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.6 MiB/s wr, 382 op/s 2023-10-08T12:57:54.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:54 smithi059 ceph-mon[98489]: pgmap v835: 97 pgs: 97 active+clean; 923 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.6 MiB/s wr, 382 op/s 2023-10-08T12:57:54.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:54 smithi092 ceph-mon[134093]: pgmap v835: 97 pgs: 97 active+clean; 923 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.6 MiB/s wr, 382 op/s 2023-10-08T12:57:54.958 INFO:tasks.workunit.client.0.smithi059.stdout: 10 80735 20.79 MB/sec execute 85 sec latency 46.676 ms 2023-10-08T12:57:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:55 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:55.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:55 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:55.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:55 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:55.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 81155 20.89 MB/sec execute 86 sec latency 121.053 ms 2023-10-08T12:57:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:56 smithi173 ceph-mon[135182]: pgmap v836: 97 pgs: 97 active+clean; 924 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.4 MiB/s wr, 357 op/s 2023-10-08T12:57:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:57:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:57:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:57:56.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:56 smithi059 ceph-mon[98489]: pgmap v836: 97 pgs: 97 active+clean; 924 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.4 MiB/s wr, 357 op/s 2023-10-08T12:57:56.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:57:56.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:57:56.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:57:56.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:56 smithi092 ceph-mon[134093]: pgmap v836: 97 pgs: 97 active+clean; 924 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.4 MiB/s wr, 357 op/s 2023-10-08T12:57:56.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:57:56.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:57:56.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:57:56.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 81533 20.89 MB/sec execute 87 sec latency 161.166 ms 2023-10-08T12:57:57.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 81746 20.75 MB/sec execute 88 sec latency 266.261 ms 2023-10-08T12:57:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:58 smithi173 ceph-mon[135182]: pgmap v837: 97 pgs: 97 active+clean; 936 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 402 op/s 2023-10-08T12:57:58.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:58 smithi059 ceph-mon[98489]: pgmap v837: 97 pgs: 97 active+clean; 936 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 402 op/s 2023-10-08T12:57:58.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:58 smithi092 ceph-mon[134093]: pgmap v837: 97 pgs: 97 active+clean; 936 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 402 op/s 2023-10-08T12:57:58.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 82033 20.66 MB/sec execute 89 sec latency 153.746 ms 2023-10-08T12:57:59.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 82390 20.57 MB/sec execute 90 sec latency 181.493 ms 2023-10-08T12:58:00.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:57:59 smithi059 ceph-mon[98489]: pgmap v838: 97 pgs: 97 active+clean; 940 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.2 MiB/s wr, 427 op/s 2023-10-08T12:58:00.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:57:59 smithi092 ceph-mon[134093]: pgmap v838: 97 pgs: 97 active+clean; 940 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.2 MiB/s wr, 427 op/s 2023-10-08T12:58:00.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:57:59 smithi173 ceph-mon[135182]: pgmap v838: 97 pgs: 97 active+clean; 940 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.2 MiB/s wr, 427 op/s 2023-10-08T12:58:00.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 82907 20.70 MB/sec execute 91 sec latency 160.941 ms 2023-10-08T12:58:01.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 83321 20.64 MB/sec execute 92 sec latency 248.489 ms 2023-10-08T12:58:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:02 smithi092 ceph-mon[134093]: pgmap v839: 97 pgs: 97 active+clean; 909 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.4 MiB/s wr, 392 op/s 2023-10-08T12:58:02.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:02 smithi173 ceph-mon[135182]: pgmap v839: 97 pgs: 97 active+clean; 909 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.4 MiB/s wr, 392 op/s 2023-10-08T12:58:02.517 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:02 smithi059 ceph-mon[98489]: pgmap v839: 97 pgs: 97 active+clean; 909 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.4 MiB/s wr, 392 op/s 2023-10-08T12:58:02.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 83596 20.52 MB/sec execute 93 sec latency 448.240 ms 2023-10-08T12:58:03.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 83850 20.43 MB/sec execute 94 sec latency 154.728 ms 2023-10-08T12:58:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:04 smithi092 ceph-mon[134093]: pgmap v840: 97 pgs: 97 active+clean; 900 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 8.9 MiB/s wr, 476 op/s 2023-10-08T12:58:04.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:04 smithi092 ceph-mon[134093]: osdmap e107: 12 total, 12 up, 12 in 2023-10-08T12:58:04.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:04 smithi173 ceph-mon[135182]: pgmap v840: 97 pgs: 97 active+clean; 900 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 8.9 MiB/s wr, 476 op/s 2023-10-08T12:58:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:04 smithi173 ceph-mon[135182]: osdmap e107: 12 total, 12 up, 12 in 2023-10-08T12:58:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:04 smithi059 ceph-mon[98489]: pgmap v840: 97 pgs: 97 active+clean; 900 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 8.9 MiB/s wr, 476 op/s 2023-10-08T12:58:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:04 smithi059 ceph-mon[98489]: osdmap e107: 12 total, 12 up, 12 in 2023-10-08T12:58:04.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 84296 20.60 MB/sec execute 95 sec latency 110.234 ms 2023-10-08T12:58:05.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 84832 20.82 MB/sec execute 96 sec latency 42.345 ms 2023-10-08T12:58:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:06 smithi173 ceph-mon[135182]: pgmap v842: 97 pgs: 97 active+clean; 892 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.0 MiB/s wr, 508 op/s 2023-10-08T12:58:06.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:06 smithi059 ceph-mon[98489]: pgmap v842: 97 pgs: 97 active+clean; 892 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.0 MiB/s wr, 508 op/s 2023-10-08T12:58:06.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:06 smithi092 ceph-mon[134093]: pgmap v842: 97 pgs: 97 active+clean; 892 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.0 MiB/s wr, 508 op/s 2023-10-08T12:58:06.959 INFO:tasks.workunit.client.0.smithi059.stdout: 10 85092 20.73 MB/sec execute 97 sec latency 149.290 ms 2023-10-08T12:58:07.960 INFO:tasks.workunit.client.0.smithi059.stdout: 10 85272 20.62 MB/sec execute 98 sec latency 393.078 ms 2023-10-08T12:58:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:08 smithi173 ceph-mon[135182]: pgmap v843: 97 pgs: 97 active+clean; 889 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.5 MiB/s wr, 545 op/s 2023-10-08T12:58:08.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:08 smithi059 ceph-mon[98489]: pgmap v843: 97 pgs: 97 active+clean; 889 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.5 MiB/s wr, 545 op/s 2023-10-08T12:58:08.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:08 smithi092 ceph-mon[134093]: pgmap v843: 97 pgs: 97 active+clean; 889 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.5 MiB/s wr, 545 op/s 2023-10-08T12:58:08.960 INFO:tasks.workunit.client.0.smithi059.stdout: 10 85555 20.48 MB/sec execute 99 sec latency 545.442 ms 2023-10-08T12:58:09.960 INFO:tasks.workunit.client.0.smithi059.stdout: 10 85904 20.42 MB/sec execute 100 sec latency 217.825 ms 2023-10-08T12:58:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:09 smithi059 ceph-mon[98489]: pgmap v844: 97 pgs: 97 active+clean; 897 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.9 MiB/s wr, 577 op/s 2023-10-08T12:58:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:09 smithi092 ceph-mon[134093]: pgmap v844: 97 pgs: 97 active+clean; 897 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.9 MiB/s wr, 577 op/s 2023-10-08T12:58:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:09 smithi173 ceph-mon[135182]: pgmap v844: 97 pgs: 97 active+clean; 897 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.9 MiB/s wr, 577 op/s 2023-10-08T12:58:10.960 INFO:tasks.workunit.client.0.smithi059.stdout: 10 86372 20.51 MB/sec execute 101 sec latency 90.032 ms 2023-10-08T12:58:11.960 INFO:tasks.workunit.client.0.smithi059.stdout: 10 87011 20.55 MB/sec execute 102 sec latency 131.233 ms 2023-10-08T12:58:12.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:12 smithi092 ceph-mon[134093]: pgmap v845: 97 pgs: 97 active+clean; 899 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.0 MiB/s wr, 569 op/s 2023-10-08T12:58:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:12 smithi173 ceph-mon[135182]: pgmap v845: 97 pgs: 97 active+clean; 899 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.0 MiB/s wr, 569 op/s 2023-10-08T12:58:12.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:12 smithi059 ceph-mon[98489]: pgmap v845: 97 pgs: 97 active+clean; 899 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.0 MiB/s wr, 569 op/s 2023-10-08T12:58:12.960 INFO:tasks.workunit.client.0.smithi059.stdout: 10 87385 20.62 MB/sec execute 103 sec latency 306.012 ms 2023-10-08T12:58:13.960 INFO:tasks.workunit.client.0.smithi059.stdout: 10 87657 20.55 MB/sec execute 104 sec latency 517.462 ms 2023-10-08T12:58:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:14 smithi092 ceph-mon[134093]: pgmap v846: 97 pgs: 97 active+clean; 907 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 518 op/s 2023-10-08T12:58:14.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:14 smithi092 ceph-mon[134093]: osdmap e108: 12 total, 12 up, 12 in 2023-10-08T12:58:14.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:14 smithi173 ceph-mon[135182]: pgmap v846: 97 pgs: 97 active+clean; 907 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 518 op/s 2023-10-08T12:58:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:14 smithi173 ceph-mon[135182]: osdmap e108: 12 total, 12 up, 12 in 2023-10-08T12:58:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:14 smithi059 ceph-mon[98489]: pgmap v846: 97 pgs: 97 active+clean; 907 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 518 op/s 2023-10-08T12:58:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:14 smithi059 ceph-mon[98489]: osdmap e108: 12 total, 12 up, 12 in 2023-10-08T12:58:14.960 INFO:tasks.workunit.client.0.smithi059.stdout: 10 88078 20.70 MB/sec execute 105 sec latency 189.946 ms 2023-10-08T12:58:15.960 INFO:tasks.workunit.client.0.smithi059.stdout: 10 88403 20.64 MB/sec execute 106 sec latency 144.986 ms 2023-10-08T12:58:16.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:16 smithi092 ceph-mon[134093]: pgmap v848: 97 pgs: 97 active+clean; 904 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 9.1 MiB/s wr, 504 op/s 2023-10-08T12:58:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:16 smithi173 ceph-mon[135182]: pgmap v848: 97 pgs: 97 active+clean; 904 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 9.1 MiB/s wr, 504 op/s 2023-10-08T12:58:16.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:16 smithi059 ceph-mon[98489]: pgmap v848: 97 pgs: 97 active+clean; 904 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 9.1 MiB/s wr, 504 op/s 2023-10-08T12:58:16.960 INFO:tasks.workunit.client.0.smithi059.stdout: 10 88676 20.56 MB/sec execute 107 sec latency 169.181 ms 2023-10-08T12:58:17.961 INFO:tasks.workunit.client.0.smithi059.stdout: 10 88996 20.46 MB/sec execute 108 sec latency 204.646 ms 2023-10-08T12:58:18.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:18 smithi173 ceph-mon[135182]: pgmap v849: 97 pgs: 97 active+clean; 903 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 9.0 MiB/s wr, 418 op/s 2023-10-08T12:58:18.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:18 smithi059 ceph-mon[98489]: pgmap v849: 97 pgs: 97 active+clean; 903 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 9.0 MiB/s wr, 418 op/s 2023-10-08T12:58:18.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:18 smithi092 ceph-mon[134093]: pgmap v849: 97 pgs: 97 active+clean; 903 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 9.0 MiB/s wr, 418 op/s 2023-10-08T12:58:18.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 89147 20.33 MB/sec execute 109 sec latency 662.345 ms 2023-10-08T12:58:19.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 89527 20.31 MB/sec execute 110 sec latency 275.466 ms 2023-10-08T12:58:20.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:19 smithi059 ceph-mon[98489]: pgmap v850: 97 pgs: 97 active+clean; 875 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 8.4 MiB/s wr, 351 op/s 2023-10-08T12:58:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:19 smithi092 ceph-mon[134093]: pgmap v850: 97 pgs: 97 active+clean; 875 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 8.4 MiB/s wr, 351 op/s 2023-10-08T12:58:20.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:19 smithi173 ceph-mon[135182]: pgmap v850: 97 pgs: 97 active+clean; 875 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 8.4 MiB/s wr, 351 op/s 2023-10-08T12:58:20.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:58:20.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 90298 20.46 MB/sec execute 111 sec latency 139.756 ms 2023-10-08T12:58:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.026+0000 7f976bbff700 1 -- 172.21.15.59:0/3547393148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9764105b80 msgr2=0x7f976410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.026+0000 7f976bbff700 1 --2- 172.21.15.59:0/3547393148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9764105b80 0x7f976410d590 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f975c00b0d0 tx=0x7f975c00b3e0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.026+0000 7f976bbff700 1 -- 172.21.15.59:0/3547393148 shutdown_connections 2023-10-08T12:58:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.026+0000 7f976bbff700 1 --2- 172.21.15.59:0/3547393148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9764105b80 0x7f976410d590 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.026+0000 7f976bbff700 1 --2- 172.21.15.59:0/3547393148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9764067ce0 0x7f97640680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.026+0000 7f976bbff700 1 --2- 172.21.15.59:0/3547393148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97641051c0 0x7f9764105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.026+0000 7f976bbff700 1 -- 172.21.15.59:0/3547393148 >> 172.21.15.59:0/3547393148 conn(0x7f9764076780 msgr2=0x7f9764076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.026+0000 7f976bbff700 1 -- 172.21.15.59:0/3547393148 shutdown_connections 2023-10-08T12:58:21.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.026+0000 7f976bbff700 1 -- 172.21.15.59:0/3547393148 wait complete. 2023-10-08T12:58:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.027+0000 7f976bbff700 1 Processor -- start 2023-10-08T12:58:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.027+0000 7f976bbff700 1 -- start start 2023-10-08T12:58:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976bbff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9764067ce0 0x7f9764196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976bbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97641051c0 0x7f97641972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976bbff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9764105b80 0x7f976419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976bbff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976419bc90 con 0x7f9764067ce0 2023-10-08T12:58:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976bbff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976419be00 con 0x7f9764105b80 2023-10-08T12:58:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976bbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976419bfc0 con 0x7f97641051c0 2023-10-08T12:58:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976a19c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9764105b80 0x7f976419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976919a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97641051c0 0x7f97641972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976a19c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9764105b80 0x7f976419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:37930/0 (socket says 172.21.15.59:37930) 2023-10-08T12:58:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976a19c700 1 -- 172.21.15.59:0/2604711609 learned_addr learned my addr 172.21.15.59:0/2604711609 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976919a700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97641051c0 0x7f97641972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:33354/0 (socket says 172.21.15.59:33354) 2023-10-08T12:58:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976999b700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9764067ce0 0x7f9764196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.028+0000 7f976a19c700 1 -- 172.21.15.59:0/2604711609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97641051c0 msgr2=0x7f97641972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.029+0000 7f976a19c700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97641051c0 0x7f97641972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.029+0000 7f976a19c700 1 -- 172.21.15.59:0/2604711609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9764067ce0 msgr2=0x7f9764196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.029+0000 7f976a19c700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9764067ce0 0x7f9764196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.029+0000 7f976a19c700 1 -- 172.21.15.59:0/2604711609 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760009520 con 0x7f9764105b80 2023-10-08T12:58:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.029+0000 7f976a19c700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9764105b80 0x7f976419b650 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f975c00bcd0 tx=0x7f975c00bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.029+0000 7f975affd700 1 -- 172.21.15.59:0/2604711609 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c00e040 con 0x7f9764105b80 2023-10-08T12:58:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.029+0000 7f975affd700 1 -- 172.21.15.59:0/2604711609 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f975c005070 con 0x7f9764105b80 2023-10-08T12:58:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.029+0000 7f975affd700 1 -- 172.21.15.59:0/2604711609 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c01b6a0 con 0x7f9764105b80 2023-10-08T12:58:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.029+0000 7f976bbff700 1 -- 172.21.15.59:0/2604711609 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9754009520 con 0x7f9764105b80 2023-10-08T12:58:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.029+0000 7f976bbff700 1 -- 172.21.15.59:0/2604711609 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c009d00 con 0x7f9764105b80 2023-10-08T12:58:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.033+0000 7f975affd700 1 -- 172.21.15.59:0/2604711609 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f975c0051e0 con 0x7f9764105b80 2023-10-08T12:58:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.034+0000 7f977f5c0b80 1 Processor -- start 2023-10-08T12:58:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.035+0000 7f975affd700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f97500a1670 0x7f97500a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.035+0000 7f977f5c0b80 1 -- start start 2023-10-08T12:58:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.035+0000 7f975affd700 1 -- 172.21.15.59:0/2604711609 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f975c0cdaf0 con 0x7f9764105b80 2023-10-08T12:58:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.035+0000 7f976919a700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f97500a1670 0x7f97500a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.035+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca06e50 0x55747ca05290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.035+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 0x55747ca05c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.035+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca14cf0 0x55747ca170e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.035+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747c96a460 con 0x55747ca14cf0 2023-10-08T12:58:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.035+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747c95bc20 con 0x55747ca06e50 2023-10-08T12:58:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.035+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747c959540 con 0x55747ca057d0 2023-10-08T12:58:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976999b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca06e50 0x55747ca05290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976919a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 0x55747ca05c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976999b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca06e50 0x55747ca05290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:37944/0 (socket says 172.21.15.59:37944) 2023-10-08T12:58:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976999b700 1 -- 172.21.15.59:0/353087371 learned_addr learned my addr 172.21.15.59:0/353087371 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976a19c700 1 --2- 172.21.15.59:0/353087371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca14cf0 0x55747ca170e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976999b700 1 -- 172.21.15.59:0/353087371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 msgr2=0x55747ca05c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976999b700 1 --2- 172.21.15.59:0/353087371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 0x55747ca05c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976999b700 1 -- 172.21.15.59:0/353087371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca14cf0 msgr2=0x55747ca170e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976999b700 1 --2- 172.21.15.59:0/353087371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca14cf0 0x55747ca170e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976999b700 1 -- 172.21.15.59:0/353087371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55747c77fde0 con 0x55747ca06e50 2023-10-08T12:58:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976a19c700 1 --2- 172.21.15.59:0/353087371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca14cf0 0x55747ca170e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976919a700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f97500a1670 0x7f97500a3b30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f97641982c0 tx=0x7f97540119f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.036+0000 7f976999b700 1 --2- 172.21.15.59:0/353087371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca06e50 0x55747ca05290 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9760009f10 tx=0x7f9760011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2342af69d10a5876 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.037+0000 7f974ffff700 1 -- 172.21.15.59:0/353087371 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760019630 con 0x55747ca06e50 2023-10-08T12:58:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.037+0000 7f974ffff700 1 -- 172.21.15.59:0/353087371 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9760019c50 con 0x55747ca06e50 2023-10-08T12:58:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.037+0000 7f974ffff700 1 -- 172.21.15.59:0/353087371 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000ece0 con 0x55747ca06e50 2023-10-08T12:58:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.037+0000 7f977f5c0b80 1 -- 172.21.15.59:0/353087371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca06e50 msgr2=0x55747ca05290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.037+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/353087371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca06e50 0x55747ca05290 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9760009f10 tx=0x7f9760011720 comp rx=0 tx=0).stop 2023-10-08T12:58:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.037+0000 7f977f5c0b80 1 -- 172.21.15.59:0/353087371 shutdown_connections 2023-10-08T12:58:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.037+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/353087371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca06e50 0x55747ca05290 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.037+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/353087371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca14cf0 0x55747ca170e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.037+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/353087371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 0x55747ca05c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.037+0000 7f977f5c0b80 1 -- 172.21.15.59:0/353087371 >> 172.21.15.59:0/353087371 conn(0x55747c976260 msgr2=0x55747c9fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.037+0000 7f977f5c0b80 1 -- 172.21.15.59:0/353087371 shutdown_connections 2023-10-08T12:58:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.038+0000 7f977f5c0b80 1 -- 172.21.15.59:0/353087371 wait complete. 2023-10-08T12:58:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.038+0000 7f977f5c0b80 1 -- start start 2023-10-08T12:58:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.038+0000 7f977f5c0b80 1 Processor -- start 2023-10-08T12:58:21.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 0x55747ca02820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca06e50 0x55747c9ffb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 0x55747ca000f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747c954e30 con 0x55747ca06e50 2023-10-08T12:58:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747c8f1710 con 0x55747ca14cf0 2023-10-08T12:58:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747c8f13b0 con 0x55747ca057d0 2023-10-08T12:58:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f977f5c0b80 10 client.0 _ll_register_callbacks cb 0x55747c74e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f976999b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 0x55747ca02820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f976999b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 0x55747ca02820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:33370/0 (socket says 172.21.15.59:33370) 2023-10-08T12:58:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f976999b700 1 -- 172.21.15.59:0/4234509007 learned_addr learned my addr 172.21.15.59:0/4234509007 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f976a19c700 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 0x55747ca000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f976919a700 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca06e50 0x55747c9ffb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f976999b700 1 -- 172.21.15.59:0/4234509007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 msgr2=0x55747ca000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f976999b700 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 0x55747ca000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f976999b700 1 -- 172.21.15.59:0/4234509007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca06e50 msgr2=0x55747c9ffb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f976999b700 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca06e50 0x55747c9ffb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f976999b700 1 -- 172.21.15.59:0/4234509007 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9760009b70 con 0x55747ca057d0 2023-10-08T12:58:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.039+0000 7f976919a700 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca06e50 0x55747c9ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.040+0000 7f976999b700 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 0x55747ca02820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f976000e860 tx=0x7f9760009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fb135f757d7a234 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.040+0000 7f974d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:58:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.040+0000 7f974d7fa700 1 -- 172.21.15.59:0/4234509007 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760019630 con 0x55747ca057d0 2023-10-08T12:58:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.040+0000 7f974d7fa700 1 -- 172.21.15.59:0/4234509007 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9760019790 con 0x55747ca057d0 2023-10-08T12:58:21.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.040+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4234509007 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55747c91ceb0 con 0x55747ca057d0 2023-10-08T12:58:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.040+0000 7f974d7fa700 1 -- 172.21.15.59:0/4234509007 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f976000eec0 con 0x55747ca057d0 2023-10-08T12:58:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.040+0000 7f977f5c0b80 10 client.27916 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.040+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4234509007 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55747c768c60 con 0x55747ca057d0 2023-10-08T12:58:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.040+0000 7f974d7fa700 1 -- 172.21.15.59:0/4234509007 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55747c91ceb0 con 0x55747ca057d0 2023-10-08T12:58:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.041+0000 7f974d7fa700 1 -- 172.21.15.59:0/4234509007 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9760004870 con 0x55747ca057d0 2023-10-08T12:58:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.041+0000 7f977f5c0b80 10 client.27916 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.041+0000 7f977f5c0b80 10 client.27916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.041+0000 7f977f5c0b80 20 client.27916 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.041+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55747ca24830 0x55747ca26c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.041+0000 7f977f5c0b80 4 client.27916 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:58:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.041+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4234509007 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55747c94de10 con 0x55747ca24830 2023-10-08T12:58:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.041+0000 7f976919a700 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55747ca24830 0x55747ca26c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.041+0000 7f976919a700 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55747ca24830 0x55747ca26c50 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19c2595765e5f5de server_cookie=ac6b51a141cdb996 in_seq=0 out_seq=0 2023-10-08T12:58:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.041+0000 7f974d7fa700 10 client.27916 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f974d7fa700 1 -- 172.21.15.59:0/4234509007 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55747c94de10 con 0x55747ca24830 2023-10-08T12:58:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f974d7fa700 10 client.27916 handle_command_reply: tid=0 2023-10-08T12:58:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f977f5c0b80 1 client.27916 shutdown 2023-10-08T12:58:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4234509007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 msgr2=0x55747ca02820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 0x55747ca02820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f976000e860 tx=0x7f9760009920 comp rx=0 tx=0).stop 2023-10-08T12:58:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4234509007 shutdown_connections 2023-10-08T12:58:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55747ca24830 0x55747ca26c50 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 0x55747ca000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca057d0 0x55747ca02820 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f974d7fa700 0 client.27916 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4234509007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca06e50 0x55747c9ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4234509007 >> 172.21.15.59:0/4234509007 conn(0x55747c976260 msgr2=0x55747c9fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4234509007 shutdown_connections 2023-10-08T12:58:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.043+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4234509007 wait complete. 2023-10-08T12:58:21.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.044+0000 7f977f5c0b80 20 client.27916 trim_cache size 0 max 16384 2023-10-08T12:58:21.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.064+0000 7f977f5c0b80 1 Processor -- start 2023-10-08T12:58:21.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.064+0000 7f977f5c0b80 1 -- start start 2023-10-08T12:58:21.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.064+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca057d0 0x55747ca1ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.064+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca06e50 0x55747ca142d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.064+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 0x55747ca20190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.064+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747c7d5920 con 0x55747ca057d0 2023-10-08T12:58:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.064+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747c9f9ae0 con 0x55747ca14cf0 2023-10-08T12:58:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.064+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747ca11650 con 0x55747ca06e50 2023-10-08T12:58:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976a19c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 0x55747ca20190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976999b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca057d0 0x55747ca1ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976919a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca06e50 0x55747ca142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976a19c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 0x55747ca20190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:37962/0 (socket says 172.21.15.59:37962) 2023-10-08T12:58:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976a19c700 1 -- 172.21.15.59:0/2658424513 learned_addr learned my addr 172.21.15.59:0/2658424513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976a19c700 1 -- 172.21.15.59:0/2658424513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca06e50 msgr2=0x55747ca142d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976a19c700 1 --2- 172.21.15.59:0/2658424513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca06e50 0x55747ca142d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976a19c700 1 -- 172.21.15.59:0/2658424513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca057d0 msgr2=0x55747ca1ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976a19c700 1 --2- 172.21.15.59:0/2658424513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca057d0 0x55747ca1ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976a19c700 1 -- 172.21.15.59:0/2658424513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55747c7a6250 con 0x55747ca14cf0 2023-10-08T12:58:21.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976919a700 1 --2- 172.21.15.59:0/2658424513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca06e50 0x55747ca142d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:21.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f976a19c700 1 --2- 172.21.15.59:0/2658424513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 0x55747ca20190 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f975c007fd0 tx=0x7f975c09aa40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9fc6f9bf01d041 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.065+0000 7f9758bff700 1 -- 172.21.15.59:0/2658424513 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c085040 con 0x55747ca14cf0 2023-10-08T12:58:21.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.066+0000 7f9758bff700 1 -- 172.21.15.59:0/2658424513 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f975c09ab50 con 0x55747ca14cf0 2023-10-08T12:58:21.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.066+0000 7f9758bff700 1 -- 172.21.15.59:0/2658424513 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c019320 con 0x55747ca14cf0 2023-10-08T12:58:21.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.066+0000 7f977f5c0b80 1 -- 172.21.15.59:0/2658424513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 msgr2=0x55747ca20190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.066+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/2658424513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 0x55747ca20190 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f975c007fd0 tx=0x7f975c09aa40 comp rx=0 tx=0).stop 2023-10-08T12:58:21.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.066+0000 7f977f5c0b80 1 -- 172.21.15.59:0/2658424513 shutdown_connections 2023-10-08T12:58:21.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.066+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/2658424513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca14cf0 0x55747ca20190 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.066+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/2658424513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca057d0 0x55747ca1ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.066+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/2658424513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca06e50 0x55747ca142d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.066+0000 7f977f5c0b80 1 -- 172.21.15.59:0/2658424513 >> 172.21.15.59:0/2658424513 conn(0x55747c976260 msgr2=0x55747ca04e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.066+0000 7f977f5c0b80 1 -- 172.21.15.59:0/2658424513 shutdown_connections 2023-10-08T12:58:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.066+0000 7f977f5c0b80 1 -- 172.21.15.59:0/2658424513 wait complete. 2023-10-08T12:58:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.067+0000 7f977f5c0b80 1 -- start start 2023-10-08T12:58:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f977f5c0b80 1 Processor -- start 2023-10-08T12:58:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca057d0 0x55747ca1ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca06e50 0x55747ca19e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f977f5c0b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca14cf0 0x55747ca1a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747ca1ac60 con 0x55747ca06e50 2023-10-08T12:58:21.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747ca78670 con 0x55747ca057d0 2023-10-08T12:58:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f977f5c0b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747ca787b0 con 0x55747ca14cf0 2023-10-08T12:58:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f977f5c0b80 10 client.0 _ll_register_callbacks cb 0x7f975400f420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f976999b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca057d0 0x55747ca1ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f976999b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca057d0 0x55747ca1ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:37972/0 (socket says 172.21.15.59:37972) 2023-10-08T12:58:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f976999b700 1 -- 172.21.15.59:0/4145568318 learned_addr learned my addr 172.21.15.59:0/4145568318 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.068+0000 7f976919a700 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca06e50 0x55747ca19e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.069+0000 7f976a19c700 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca14cf0 0x55747ca1a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.069+0000 7f976999b700 1 -- 172.21.15.59:0/4145568318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca14cf0 msgr2=0x55747ca1a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.069+0000 7f976999b700 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca14cf0 0x55747ca1a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.069+0000 7f976999b700 1 -- 172.21.15.59:0/4145568318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca06e50 msgr2=0x55747ca19e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.069+0000 7f976999b700 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca06e50 0x55747ca19e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.069+0000 7f976999b700 1 -- 172.21.15.59:0/4145568318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9754009a50 con 0x55747ca057d0 2023-10-08T12:58:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.069+0000 7f976999b700 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca057d0 0x55747ca1ba40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9760000c00 tx=0x7f976000e7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7438ee473a6536a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.069+0000 7f974d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.069+0000 7f974d7fa700 1 -- 172.21.15.59:0/4145568318 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760011aa0 con 0x55747ca057d0 2023-10-08T12:58:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.069+0000 7f974d7fa700 1 -- 172.21.15.59:0/4145568318 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9760019430 con 0x55747ca057d0 2023-10-08T12:58:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.069+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4145568318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9760019c50 con 0x55747ca057d0 2023-10-08T12:58:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.070+0000 7f974d7fa700 1 -- 172.21.15.59:0/4145568318 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f976000eec0 con 0x55747ca057d0 2023-10-08T12:58:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.070+0000 7f977f5c0b80 10 client.27926 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.070+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4145568318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f975c009d00 con 0x55747ca057d0 2023-10-08T12:58:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.070+0000 7f974d7fa700 1 -- 172.21.15.59:0/4145568318 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9760019c50 con 0x55747ca057d0 2023-10-08T12:58:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.070+0000 7f974d7fa700 1 -- 172.21.15.59:0/4145568318 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9760005140 con 0x55747ca057d0 2023-10-08T12:58:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.070+0000 7f977f5c0b80 10 client.27926 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.070+0000 7f977f5c0b80 10 client.27926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.070+0000 7f977f5c0b80 20 client.27926 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.070+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55747ca79b00 0x55747ca7bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.070+0000 7f977f5c0b80 4 client.27926 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:58:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.070+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4145568318 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55747c94db30 con 0x55747ca79b00 2023-10-08T12:58:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.071+0000 7f976919a700 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55747ca79b00 0x55747ca7bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.071+0000 7f976919a700 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55747ca79b00 0x55747ca7bef0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baf0b907b8476142 server_cookie=10df85cf42162f8 in_seq=0 out_seq=0 2023-10-08T12:58:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.071+0000 7f974d7fa700 10 client.27926 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.072+0000 7f974d7fa700 1 -- 172.21.15.59:0/4145568318 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55747c94db30 con 0x55747ca79b00 2023-10-08T12:58:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.072+0000 7f974d7fa700 10 client.27926 handle_command_reply: tid=0 2023-10-08T12:58:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.072+0000 7f977f5c0b80 1 client.27926 shutdown 2023-10-08T12:58:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4145568318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca057d0 msgr2=0x55747ca1ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca057d0 0x55747ca1ba40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9760000c00 tx=0x7f976000e7f0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4145568318 shutdown_connections 2023-10-08T12:58:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55747ca79b00 0x55747ca7bef0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55747ca057d0 0x55747ca1ba40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55747ca14cf0 0x55747ca1a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f977f5c0b80 1 --2- 172.21.15.59:0/4145568318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55747ca06e50 0x55747ca19e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f974d7fa700 0 client.27926 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4145568318 >> 172.21.15.59:0/4145568318 conn(0x55747c976260 msgr2=0x55747ca14210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4145568318 shutdown_connections 2023-10-08T12:58:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f977f5c0b80 1 -- 172.21.15.59:0/4145568318 wait complete. 2023-10-08T12:58:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.073+0000 7f977f5c0b80 20 client.27926 trim_cache size 0 max 16384 2023-10-08T12:58:21.078 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:58:21.078 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:58:21.078 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:58:21.079 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:58:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 -- 172.21.15.59:0/2604711609 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f97500a1670 msgr2=0x7f97500a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f97500a1670 0x7f97500a3b30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f97641982c0 tx=0x7f97540119f0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 -- 172.21.15.59:0/2604711609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9764105b80 msgr2=0x7f976419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9764105b80 0x7f976419b650 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f975c00bcd0 tx=0x7f975c00bd00 comp rx=0 tx=0).stop 2023-10-08T12:58:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 -- 172.21.15.59:0/2604711609 shutdown_connections 2023-10-08T12:58:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f97500a1670 0x7f97500a3b30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9764105b80 0x7f976419b650 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9764067ce0 0x7f9764196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 --2- 172.21.15.59:0/2604711609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97641051c0 0x7f97641972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 -- 172.21.15.59:0/2604711609 >> 172.21.15.59:0/2604711609 conn(0x7f9764076780 msgr2=0x7f97640fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 -- 172.21.15.59:0/2604711609 shutdown_connections 2023-10-08T12:58:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.074+0000 7f976bbff700 1 -- 172.21.15.59:0/2604711609 wait complete. 2023-10-08T12:58:21.094 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:58:21.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:58:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.337+0000 7fb10dbff700 1 -- 172.21.15.59:0/3760622707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1080ffdc0 msgr2=0x7fb10810ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.337+0000 7fb10dbff700 1 --2- 172.21.15.59:0/3760622707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1080ffdc0 0x7fb10810ca80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009990 tx=0x7fb0fc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.337+0000 7fb10dbff700 1 -- 172.21.15.59:0/3760622707 shutdown_connections 2023-10-08T12:58:21.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.337+0000 7fb10dbff700 1 --2- 172.21.15.59:0/3760622707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb10810cfc0 0x7fb10810f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.337+0000 7fb10dbff700 1 --2- 172.21.15.59:0/3760622707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1080ff410 0x7fb1080ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.337+0000 7fb10dbff700 1 --2- 172.21.15.59:0/3760622707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1080ffdc0 0x7fb10810ca80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.337+0000 7fb10dbff700 1 -- 172.21.15.59:0/3760622707 >> 172.21.15.59:0/3760622707 conn(0x7fb1080fb070 msgr2=0x7fb1080fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.337+0000 7fb10dbff700 1 -- 172.21.15.59:0/3760622707 shutdown_connections 2023-10-08T12:58:21.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.337+0000 7fb10dbff700 1 -- 172.21.15.59:0/3760622707 wait complete. 2023-10-08T12:58:21.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.338+0000 7fb10dbff700 1 Processor -- start 2023-10-08T12:58:21.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.338+0000 7fb10dbff700 1 -- start start 2023-10-08T12:58:21.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb10dbff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1080ff410 0x7fb108198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb10dbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1080ffdc0 0x7fb1081992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb10dbff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb10810cfc0 0x7fb10819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb10dbff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10819dc90 con 0x7fb1080ff410 2023-10-08T12:58:21.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb10dbff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10819de00 con 0x7fb10810cfc0 2023-10-08T12:58:21.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb10dbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10819dfc0 con 0x7fb1080ffdc0 2023-10-08T12:58:21.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb107fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb10810cfc0 0x7fb10819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb107fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb10810cfc0 0x7fb10819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:37998/0 (socket says 172.21.15.59:37998) 2023-10-08T12:58:21.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb1077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1080ff410 0x7fb108198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb107fff700 1 -- 172.21.15.59:0/2970410107 learned_addr learned my addr 172.21.15.59:0/2970410107 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:21.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb106ffd700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1080ffdc0 0x7fb1081992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb107fff700 1 -- 172.21.15.59:0/2970410107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1080ffdc0 msgr2=0x7fb1081992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb107fff700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1080ffdc0 0x7fb1081992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb107fff700 1 -- 172.21.15.59:0/2970410107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1080ff410 msgr2=0x7fb108198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb107fff700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1080ff410 0x7fb108198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb107fff700 1 -- 172.21.15.59:0/2970410107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0095f0 con 0x7fb10810cfc0 2023-10-08T12:58:21.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.339+0000 7fb1077fe700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1080ff410 0x7fb108198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:21.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.340+0000 7fb107fff700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb10810cfc0 0x7fb10819d650 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb100007e90 tx=0x7fb10000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.340+0000 7fb104ff9700 1 -- 172.21.15.59:0/2970410107 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100009ea0 con 0x7fb10810cfc0 2023-10-08T12:58:21.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.340+0000 7fb10dbff700 1 -- 172.21.15.59:0/2970410107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10819e2a0 con 0x7fb10810cfc0 2023-10-08T12:58:21.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.340+0000 7fb104ff9700 1 -- 172.21.15.59:0/2970410107 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb10000f040 con 0x7fb10810cfc0 2023-10-08T12:58:21.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.340+0000 7fb104ff9700 1 -- 172.21.15.59:0/2970410107 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000125f0 con 0x7fb10810cfc0 2023-10-08T12:58:21.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.340+0000 7fb10dbff700 1 -- 172.21.15.59:0/2970410107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1081a5ae0 con 0x7fb10810cfc0 2023-10-08T12:58:21.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.341+0000 7fb10dbff700 1 -- 172.21.15.59:0/2970410107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1081081e0 con 0x7fb10810cfc0 2023-10-08T12:58:21.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.344+0000 7fb104ff9700 1 -- 172.21.15.59:0/2970410107 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb100015400 con 0x7fb10810cfc0 2023-10-08T12:58:21.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.345+0000 7fb104ff9700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb0f00a1670 0x7fb0f00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.345+0000 7fb104ff9700 1 -- 172.21.15.59:0/2970410107 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fb1000cc9c0 con 0x7fb10810cfc0 2023-10-08T12:58:21.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.345+0000 7fb1077fe700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb0f00a1670 0x7fb0f00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.346+0000 7fb1077fe700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb0f00a1670 0x7fb0f00a3b30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8011490 tx=0x7fb0f8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.350+0000 7fb104ff9700 1 -- 172.21.15.59:0/2970410107 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb100095d30 con 0x7fb10810cfc0 2023-10-08T12:58:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.665+0000 7fb10dbff700 1 -- 172.21.15.59:0/2970410107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb108069290 con 0x7fb10810cfc0 2023-10-08T12:58:21.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.666+0000 7fb104ff9700 1 -- 172.21.15.59:0/2970410107 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fb100099350 con 0x7fb10810cfc0 2023-10-08T12:58:21.667 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:58:21.668 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:58:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 -- 172.21.15.59:0/2970410107 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb0f00a1670 msgr2=0x7fb0f00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb0f00a1670 0x7fb0f00a3b30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8011490 tx=0x7fb0f8009260 comp rx=0 tx=0).stop 2023-10-08T12:58:21.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 -- 172.21.15.59:0/2970410107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb10810cfc0 msgr2=0x7fb10819d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb10810cfc0 0x7fb10819d650 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb100007e90 tx=0x7fb10000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 -- 172.21.15.59:0/2970410107 shutdown_connections 2023-10-08T12:58:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb0f00a1670 0x7fb0f00a3b30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb10810cfc0 0x7fb10819d650 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1080ff410 0x7fb108198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 --2- 172.21.15.59:0/2970410107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1080ffdc0 0x7fb1081992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 -- 172.21.15.59:0/2970410107 >> 172.21.15.59:0/2970410107 conn(0x7fb1080fb070 msgr2=0x7fb1080fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 -- 172.21.15.59:0/2970410107 shutdown_connections 2023-10-08T12:58:21.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.669+0000 7fb10dbff700 1 -- 172.21.15.59:0/2970410107 wait complete. 2023-10-08T12:58:21.672 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:58:21.691 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:58:21.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.932+0000 7f12ae3ff700 1 -- 172.21.15.59:0/3440510998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a81010e0 msgr2=0x7f12a810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.932+0000 7f12ae3ff700 1 --2- 172.21.15.59:0/3440510998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a81010e0 0x7f12a810d5f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f12a000b0a0 tx=0x7f12a000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.932+0000 7f12ae3ff700 1 -- 172.21.15.59:0/3440510998 shutdown_connections 2023-10-08T12:58:21.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.932+0000 7f12ae3ff700 1 --2- 172.21.15.59:0/3440510998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a81010e0 0x7f12a810d5f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.932+0000 7f12ae3ff700 1 --2- 172.21.15.59:0/3440510998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12a8106730 0x7f12a8106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.932+0000 7f12ae3ff700 1 --2- 172.21.15.59:0/3440510998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a8100720 0x7f12a8100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.932+0000 7f12ae3ff700 1 -- 172.21.15.59:0/3440510998 >> 172.21.15.59:0/3440510998 conn(0x7f12a80fc230 msgr2=0x7f12a80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.932+0000 7f12ae3ff700 1 -- 172.21.15.59:0/3440510998 shutdown_connections 2023-10-08T12:58:21.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.932+0000 7f12ae3ff700 1 -- 172.21.15.59:0/3440510998 wait complete. 2023-10-08T12:58:21.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.934+0000 7f12ae3ff700 1 Processor -- start 2023-10-08T12:58:21.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.934+0000 7f12ae3ff700 1 -- start start 2023-10-08T12:58:21.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12ae3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12a8100720 0x7f12a819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12ae3ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a81010e0 0x7f12a819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12ae3ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a8106730 0x7f12a81969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12ae3ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8197010 con 0x7f12a8106730 2023-10-08T12:58:21.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12ae3ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8197180 con 0x7f12a81010e0 2023-10-08T12:58:21.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12ae3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8197340 con 0x7f12a8100720 2023-10-08T12:58:21.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12a8100720 0x7f12a819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12a8100720 0x7f12a819c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:33450/0 (socket says 172.21.15.59:33450) 2023-10-08T12:58:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a81010e0 0x7f12a819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12a7fff700 1 -- 172.21.15.59:0/1820393502 learned_addr learned my addr 172.21.15.59:0/1820393502 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:21.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12ac99c700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a8106730 0x7f12a81969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12a7fff700 1 -- 172.21.15.59:0/1820393502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a81010e0 msgr2=0x7f12a819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12a7fff700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a81010e0 0x7f12a819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12a7fff700 1 -- 172.21.15.59:0/1820393502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a8106730 msgr2=0x7f12a81969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12a7fff700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a8106730 0x7f12a81969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12a7fff700 1 -- 172.21.15.59:0/1820393502 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a0009d00 con 0x7f12a8100720 2023-10-08T12:58:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.935+0000 7f12ac99c700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a8106730 0x7f12a81969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:58:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.936+0000 7f12a7fff700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12a8100720 0x7f12a819c830 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f129800e9a0 tx=0x7f129800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.936+0000 7f12a57fa700 1 -- 172.21.15.59:0/1820393502 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298009790 con 0x7f12a8100720 2023-10-08T12:58:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.936+0000 7f12a57fa700 1 -- 172.21.15.59:0/1820393502 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f129800cbd0 con 0x7f12a8100720 2023-10-08T12:58:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.936+0000 7f12ae3ff700 1 -- 172.21.15.59:0/1820393502 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a8197620 con 0x7f12a8100720 2023-10-08T12:58:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.936+0000 7f12a57fa700 1 -- 172.21.15.59:0/1820393502 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298018680 con 0x7f12a8100720 2023-10-08T12:58:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.936+0000 7f12ae3ff700 1 -- 172.21.15.59:0/1820393502 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a81a3820 con 0x7f12a8100720 2023-10-08T12:58:21.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.940+0000 7f12a57fa700 1 -- 172.21.15.59:0/1820393502 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f129800cd40 con 0x7f12a8100720 2023-10-08T12:58:21.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.942+0000 7f12c1d7eb80 1 Processor -- start 2023-10-08T12:58:21.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.942+0000 7f12c1d7eb80 1 -- start start 2023-10-08T12:58:21.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.942+0000 7f12a57fa700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f12900a1670 0x7f12900a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.943+0000 7f12a57fa700 1 -- 172.21.15.59:0/1820393502 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1298014070 con 0x7f12a8100720 2023-10-08T12:58:21.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.943+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8dfd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.943+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfd7a0 0x5580c8e08110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.943+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8e08650 0x5580c8e0aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.943+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8d66460 con 0x5580c8dfce80 2023-10-08T12:58:21.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.943+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8d57c20 con 0x5580c8dfd7a0 2023-10-08T12:58:21.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.943+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8d55540 con 0x5580c8e08650 2023-10-08T12:58:21.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.943+0000 7f12ac99c700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f12900a1670 0x7f12900a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.943+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfd7a0 0x5580c8e08110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.943+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfd7a0 0x5580c8e08110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38016/0 (socket says 172.21.15.59:38016) 2023-10-08T12:58:21.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.943+0000 7f12a77fe700 1 -- 172.21.15.59:0/3013260628 learned_addr learned my addr 172.21.15.59:0/3013260628 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f12ac99c700 1 --2- 172.21.15.59:0/3013260628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8e08650 0x5580c8e0aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f12a7fff700 1 --2- 172.21.15.59:0/3013260628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8dfd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f12a77fe700 1 -- 172.21.15.59:0/3013260628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8e08650 msgr2=0x5580c8e0aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f12a77fe700 1 --2- 172.21.15.59:0/3013260628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8e08650 0x5580c8e0aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f12a77fe700 1 -- 172.21.15.59:0/3013260628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 msgr2=0x5580c8dfd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f12a77fe700 1 --2- 172.21.15.59:0/3013260628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8dfd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f12a77fe700 1 -- 172.21.15.59:0/3013260628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580c8b7bde0 con 0x5580c8dfd7a0 2023-10-08T12:58:21.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f12a7fff700 1 --2- 172.21.15.59:0/3013260628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8dfd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:58:21.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f12ac99c700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f12900a1670 0x7f12900a3b30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009610 tx=0x7f12a0007cc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f12a77fe700 1 --2- 172.21.15.59:0/3013260628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfd7a0 0x5580c8e08110 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f129c009d50 tx=0x7f129c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98dbdf62b2e0a3f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f128e7fc700 1 -- 172.21.15.59:0/3013260628 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c019630 con 0x5580c8dfd7a0 2023-10-08T12:58:21.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f128e7fc700 1 -- 172.21.15.59:0/3013260628 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f129c019c50 con 0x5580c8dfd7a0 2023-10-08T12:58:21.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.944+0000 7f128e7fc700 1 -- 172.21.15.59:0/3013260628 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c00ec10 con 0x5580c8dfd7a0 2023-10-08T12:58:21.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.945+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3013260628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfd7a0 msgr2=0x5580c8e08110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.945+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/3013260628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfd7a0 0x5580c8e08110 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f129c009d50 tx=0x7f129c011720 comp rx=0 tx=0).stop 2023-10-08T12:58:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.945+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3013260628 shutdown_connections 2023-10-08T12:58:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.945+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/3013260628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8e08650 0x5580c8e0aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.945+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/3013260628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8dfd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.945+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/3013260628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfd7a0 0x5580c8e08110 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.946+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3013260628 >> 172.21.15.59:0/3013260628 conn(0x5580c8d72260 msgr2=0x5580c8df92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.946+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3013260628 shutdown_connections 2023-10-08T12:58:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.946+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3013260628 wait complete. 2023-10-08T12:58:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.946+0000 7f12c1d7eb80 1 -- start start 2023-10-08T12:58:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12c1d7eb80 1 Processor -- start 2023-10-08T12:58:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8e054a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e05f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8d50e30 con 0x5580c8dfce80 2023-10-08T12:58:21.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8ced710 con 0x5580c8e08650 2023-10-08T12:58:21.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8ced3b0 con 0x5580c8dfd7a0 2023-10-08T12:58:21.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12c1d7eb80 10 client.0 _ll_register_callbacks cb 0x5580c8b4a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:21.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12ac99c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e05f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8e054a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12ac99c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e05f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38022/0 (socket says 172.21.15.59:38022) 2023-10-08T12:58:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e059e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:33462/0 (socket says 172.21.15.59:33462) 2023-10-08T12:58:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.947+0000 7f12ac99c700 1 -- 172.21.15.59:0/3506208543 learned_addr learned my addr 172.21.15.59:0/3506208543 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.948+0000 7f12ac99c700 1 -- 172.21.15.59:0/3506208543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 msgr2=0x5580c8e059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.948+0000 7f12ac99c700 1 --2- 172.21.15.59:0/3506208543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e059e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.948+0000 7f12ac99c700 1 -- 172.21.15.59:0/3506208543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 msgr2=0x5580c8e054a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.948+0000 7f12ac99c700 1 --2- 172.21.15.59:0/3506208543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8e054a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.948+0000 7f12ac99c700 1 -- 172.21.15.59:0/3506208543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c009980 con 0x5580c8e08650 2023-10-08T12:58:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.948+0000 7f12ac99c700 1 --2- 172.21.15.59:0/3506208543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e05f20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f12a0015000 tx=0x7f12a000b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12790beac8170788 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.948+0000 7f12877fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.948+0000 7f12877fe700 1 -- 172.21.15.59:0/3506208543 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a000e040 con 0x5580c8e08650 2023-10-08T12:58:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.949+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3506208543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580c8d18eb0 con 0x5580c8e08650 2023-10-08T12:58:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.949+0000 7f12877fe700 1 -- 172.21.15.59:0/3506208543 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f12a00078b0 con 0x5580c8e08650 2023-10-08T12:58:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.949+0000 7f12877fe700 1 -- 172.21.15.59:0/3506208543 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12a001d450 con 0x5580c8e08650 2023-10-08T12:58:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.949+0000 7f12c1d7eb80 10 client.27944 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.949+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3506208543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5580c8b64c60 con 0x5580c8e08650 2023-10-08T12:58:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.949+0000 7f12877fe700 1 -- 172.21.15.59:0/3506208543 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5580c8d18eb0 con 0x5580c8e08650 2023-10-08T12:58:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.949+0000 7f12877fe700 1 -- 172.21.15.59:0/3506208543 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f12a0005270 con 0x5580c8e08650 2023-10-08T12:58:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.949+0000 7f12c1d7eb80 10 client.27944 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.949+0000 7f12c1d7eb80 10 client.27944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:21.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.949+0000 7f12c1d7eb80 20 client.27944 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:21.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.949+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/3506208543 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5580c8e181c0 0x5580c8e1a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.950+0000 7f12c1d7eb80 4 client.27944 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:58:21.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.950+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3506208543 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5580c8d49e10 con 0x5580c8e181c0 2023-10-08T12:58:21.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.950+0000 7f12a7fff700 1 --2- 172.21.15.59:0/3506208543 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5580c8e181c0 0x5580c8e1a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.950+0000 7f12a7fff700 1 --2- 172.21.15.59:0/3506208543 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5580c8e181c0 0x5580c8e1a5e0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4cc009f674d375f server_cookie=72fd007cb463d954 in_seq=0 out_seq=0 2023-10-08T12:58:21.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.950+0000 7f12877fe700 10 client.27944 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:21.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12877fe700 1 -- 172.21.15.59:0/3506208543 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5580c8d49e10 con 0x5580c8e181c0 2023-10-08T12:58:21.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12877fe700 10 client.27944 handle_command_reply: tid=0 2023-10-08T12:58:21.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12c1d7eb80 1 client.27944 shutdown 2023-10-08T12:58:21.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3506208543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 msgr2=0x5580c8e05f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/3506208543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e05f20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f12a0015000 tx=0x7f12a000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3506208543 shutdown_connections 2023-10-08T12:58:21.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/3506208543 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5580c8e181c0 0x5580c8e1a5e0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/3506208543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e05f20 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12877fe700 0 client.27944 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:21.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/3506208543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8e054a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/3506208543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3506208543 >> 172.21.15.59:0/3506208543 conn(0x5580c8d72260 msgr2=0x5580c8df8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3506208543 shutdown_connections 2023-10-08T12:58:21.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.952+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/3506208543 wait complete. 2023-10-08T12:58:21.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.953+0000 7f12c1d7eb80 20 client.27944 trim_cache size 0 max 16384 2023-10-08T12:58:21.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 90810 20.62 MB/sec execute 112 sec latency 49.191 ms 2023-10-08T12:58:21.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.970+0000 7f12c1d7eb80 1 Processor -- start 2023-10-08T12:58:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.970+0000 7f12c1d7eb80 1 -- start start 2023-10-08T12:58:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.971+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfce80 0x5580c8e0f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.971+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e05d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.971+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8e08650 0x5580c8df8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.971+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8bd1920 con 0x5580c8e08650 2023-10-08T12:58:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.971+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8e0f720 con 0x5580c8dfce80 2023-10-08T12:58:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.971+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8df0b40 con 0x5580c8dfd7a0 2023-10-08T12:58:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.971+0000 7f12ac99c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8e08650 0x5580c8df8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.971+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfce80 0x5580c8e0f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.971+0000 7f12ac99c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8e08650 0x5580c8df8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46386/0 (socket says 172.21.15.59:46386) 2023-10-08T12:58:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.971+0000 7f12ac99c700 1 -- 172.21.15.59:0/1180422471 learned_addr learned my addr 172.21.15.59:0/1180422471 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.971+0000 7f12a77fe700 1 --2- 172.21.15.59:0/1180422471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e05d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.972+0000 7f12a7fff700 1 -- 172.21.15.59:0/1180422471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 msgr2=0x5580c8e05d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.972+0000 7f12a7fff700 1 --2- 172.21.15.59:0/1180422471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e05d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.972+0000 7f12a7fff700 1 -- 172.21.15.59:0/1180422471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8e08650 msgr2=0x5580c8df8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.972+0000 7f12a7fff700 1 --2- 172.21.15.59:0/1180422471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8e08650 0x5580c8df8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.972+0000 7f12a7fff700 1 -- 172.21.15.59:0/1180422471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580c8ba2250 con 0x5580c8dfce80 2023-10-08T12:58:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.972+0000 7f12a77fe700 1 --2- 172.21.15.59:0/1180422471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e05d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:21.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.972+0000 7f12a7fff700 1 --2- 172.21.15.59:0/1180422471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfce80 0x5580c8e0f1a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f12980ca9d0 tx=0x7f129809a030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b50ac1b6d63f6acb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.972+0000 7f128effd700 1 -- 172.21.15.59:0/1180422471 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129809e3b0 con 0x5580c8dfce80 2023-10-08T12:58:21.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.973+0000 7f128effd700 1 -- 172.21.15.59:0/1180422471 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12980a25f0 con 0x5580c8dfce80 2023-10-08T12:58:21.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.973+0000 7f128effd700 1 -- 172.21.15.59:0/1180422471 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129809a720 con 0x5580c8dfce80 2023-10-08T12:58:21.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.973+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/1180422471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfce80 msgr2=0x5580c8e0f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.973+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/1180422471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfce80 0x5580c8e0f1a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f12980ca9d0 tx=0x7f129809a030 comp rx=0 tx=0).stop 2023-10-08T12:58:21.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.973+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/1180422471 shutdown_connections 2023-10-08T12:58:21.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.973+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/1180422471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8dfce80 0x5580c8e0f1a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.973+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/1180422471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8e08650 0x5580c8df8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.973+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/1180422471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e05d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.973+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/1180422471 >> 172.21.15.59:0/1180422471 conn(0x5580c8d72260 msgr2=0x5580c8e007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.974+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/1180422471 shutdown_connections 2023-10-08T12:58:21.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.974+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/1180422471 wait complete. 2023-10-08T12:58:21.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.974+0000 7f12c1d7eb80 1 -- start start 2023-10-08T12:58:21.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.974+0000 7f12c1d7eb80 1 Processor -- start 2023-10-08T12:58:21.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8e0d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e0dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12c1d7eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e0e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8e74810 con 0x5580c8dfce80 2023-10-08T12:58:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8e74950 con 0x5580c8e08650 2023-10-08T12:58:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12c1d7eb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580c8e74b10 con 0x5580c8dfd7a0 2023-10-08T12:58:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12c1d7eb80 10 client.0 _ll_register_callbacks cb 0x7f12a000bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12ac99c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e0e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12ac99c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e0e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38036/0 (socket says 172.21.15.59:38036) 2023-10-08T12:58:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12ac99c700 1 -- 172.21.15.59:0/32215747 learned_addr learned my addr 172.21.15.59:0/32215747 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8e0d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.975+0000 7f12a77fe700 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e0dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.976+0000 7f12ac99c700 1 -- 172.21.15.59:0/32215747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 msgr2=0x5580c8e0dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.976+0000 7f12ac99c700 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e0dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.976+0000 7f12ac99c700 1 -- 172.21.15.59:0/32215747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 msgr2=0x5580c8e0d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.976+0000 7f12ac99c700 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8e0d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.976+0000 7f12ac99c700 1 -- 172.21.15.59:0/32215747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1298094e70 con 0x5580c8e08650 2023-10-08T12:58:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.976+0000 7f12ac99c700 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e0e2b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f12a0005600 tx=0x7f12a0005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f547bd1a9fd241 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.976+0000 7f12877fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.976+0000 7f12877fe700 1 -- 172.21.15.59:0/32215747 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a000e040 con 0x5580c8e08650 2023-10-08T12:58:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12877fe700 1 -- 172.21.15.59:0/32215747 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f12a00051b0 con 0x5580c8e08650 2023-10-08T12:58:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/32215747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f129c019c50 con 0x5580c8e08650 2023-10-08T12:58:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12877fe700 1 -- 172.21.15.59:0/32215747 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12a0005370 con 0x5580c8e08650 2023-10-08T12:58:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12c1d7eb80 10 client.27950 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/32215747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5580c8b7a2b0 con 0x5580c8e08650 2023-10-08T12:58:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12877fe700 1 -- 172.21.15.59:0/32215747 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12a0047020 con 0x5580c8e08650 2023-10-08T12:58:21.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12877fe700 1 -- 172.21.15.59:0/32215747 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f12a003a430 con 0x5580c8e08650 2023-10-08T12:58:21.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12c1d7eb80 10 client.27950 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:21.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12c1d7eb80 10 client.27950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:21.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12c1d7eb80 20 client.27950 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:21.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5580c8e75fa0 0x5580c8e783c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:21.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12c1d7eb80 4 client.27950 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:58:21.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.977+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/32215747 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5580c8d49b30 con 0x5580c8e75fa0 2023-10-08T12:58:21.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.978+0000 7f12a7fff700 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5580c8e75fa0 0x5580c8e783c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:21.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.978+0000 7f12a7fff700 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5580c8e75fa0 0x5580c8e783c0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f66a469d9ce88f9 server_cookie=36d2576ffb8c51e8 in_seq=0 out_seq=0 2023-10-08T12:58:21.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.978+0000 7f12877fe700 10 client.27950 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.982+0000 7f12877fe700 1 -- 172.21.15.59:0/32215747 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5580c8d49b30 con 0x5580c8e75fa0 2023-10-08T12:58:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.982+0000 7f12877fe700 10 client.27950 handle_command_reply: tid=0 2023-10-08T12:58:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.982+0000 7f12c1d7eb80 1 client.27950 shutdown 2023-10-08T12:58:21.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/32215747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 msgr2=0x5580c8e0e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e0e2b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f12a0005600 tx=0x7f12a0005a20 comp rx=0 tx=0).stop 2023-10-08T12:58:21.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/32215747 shutdown_connections 2023-10-08T12:58:21.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5580c8e75fa0 0x5580c8e783c0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580c8e08650 0x5580c8e0e2b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580c8dfce80 0x5580c8e0d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12877fe700 0 client.27950 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:21.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12c1d7eb80 1 --2- 172.21.15.59:0/32215747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5580c8dfd7a0 0x5580c8e0dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/32215747 >> 172.21.15.59:0/32215747 conn(0x5580c8d72260 msgr2=0x5580c8e05d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/32215747 shutdown_connections 2023-10-08T12:58:21.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12c1d7eb80 1 -- 172.21.15.59:0/32215747 wait complete. 2023-10-08T12:58:21.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.983+0000 7f12c1d7eb80 20 client.27950 trim_cache size 0 max 16384 2023-10-08T12:58:21.986 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:58:21.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.984+0000 7f12ae3ff700 1 -- 172.21.15.59:0/1820393502 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f12900a1670 msgr2=0x7f12900a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.984+0000 7f12ae3ff700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f12900a1670 0x7f12900a3b30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009610 tx=0x7f12a0007cc0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.984+0000 7f12ae3ff700 1 -- 172.21.15.59:0/1820393502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12a8100720 msgr2=0x7f12a819c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.984+0000 7f12ae3ff700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12a8100720 0x7f12a819c830 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f129800e9a0 tx=0x7f129800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.985+0000 7f12ae3ff700 1 -- 172.21.15.59:0/1820393502 shutdown_connections 2023-10-08T12:58:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.985+0000 7f12ae3ff700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f12900a1670 0x7f12900a3b30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.985+0000 7f12ae3ff700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a8106730 0x7f12a81969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.985+0000 7f12ae3ff700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12a8100720 0x7f12a819c830 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.985+0000 7f12ae3ff700 1 --2- 172.21.15.59:0/1820393502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12a81010e0 0x7f12a819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.985+0000 7f12ae3ff700 1 -- 172.21.15.59:0/1820393502 >> 172.21.15.59:0/1820393502 conn(0x7f12a80fc230 msgr2=0x7f12a80fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.985+0000 7f12ae3ff700 1 -- 172.21.15.59:0/1820393502 shutdown_connections 2023-10-08T12:58:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:21.985+0000 7f12ae3ff700 1 -- 172.21.15.59:0/1820393502 wait complete. 2023-10-08T12:58:22.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:22 smithi059 ceph-mon[98489]: pgmap v851: 97 pgs: 97 active+clean; 882 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 8.8 MiB/s wr, 373 op/s 2023-10-08T12:58:22.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:22 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2970410107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:58:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:22 smithi092 ceph-mon[134093]: pgmap v851: 97 pgs: 97 active+clean; 882 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 8.8 MiB/s wr, 373 op/s 2023-10-08T12:58:22.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:22 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2970410107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:58:22.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:22 smithi173 ceph-mon[135182]: pgmap v851: 97 pgs: 97 active+clean; 882 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 8.8 MiB/s wr, 373 op/s 2023-10-08T12:58:22.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:22 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2970410107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:58:22.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 91272 20.71 MB/sec execute 113 sec latency 150.124 ms 2023-10-08T12:58:23.009 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:58:23.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:58:23.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.284+0000 7fa5109ff700 1 -- 172.21.15.59:0/2384702075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c105b80 msgr2=0x7fa50c10d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.284+0000 7fa5109ff700 1 --2- 172.21.15.59:0/2384702075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c105b80 0x7fa50c10d590 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b0a0 tx=0x7fa50400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.284+0000 7fa5109ff700 1 -- 172.21.15.59:0/2384702075 shutdown_connections 2023-10-08T12:58:23.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.284+0000 7fa5109ff700 1 --2- 172.21.15.59:0/2384702075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c105b80 0x7fa50c10d590 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.284+0000 7fa5109ff700 1 --2- 172.21.15.59:0/2384702075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c067ce0 0x7fa50c0680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.284+0000 7fa5109ff700 1 --2- 172.21.15.59:0/2384702075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa50c1051c0 0x7fa50c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.284+0000 7fa5109ff700 1 -- 172.21.15.59:0/2384702075 >> 172.21.15.59:0/2384702075 conn(0x7fa50c076780 msgr2=0x7fa50c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.284+0000 7fa5109ff700 1 -- 172.21.15.59:0/2384702075 shutdown_connections 2023-10-08T12:58:23.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.284+0000 7fa5109ff700 1 -- 172.21.15.59:0/2384702075 wait complete. 2023-10-08T12:58:23.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.286+0000 7fa5109ff700 1 Processor -- start 2023-10-08T12:58:23.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.286+0000 7fa5109ff700 1 -- start start 2023-10-08T12:58:23.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.286+0000 7fa5109ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c067ce0 0x7fa50c19cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.286+0000 7fa5109ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa50c1051c0 0x7fa50c19d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.286+0000 7fa5109ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c105b80 0x7fa50c196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.286+0000 7fa5109ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c197330 con 0x7fa50c067ce0 2023-10-08T12:58:23.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.286+0000 7fa5109ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c1974a0 con 0x7fa50c105b80 2023-10-08T12:58:23.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.286+0000 7fa5109ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c197660 con 0x7fa50c1051c0 2023-10-08T12:58:23.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa50ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c105b80 0x7fa50c196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c067ce0 0x7fa50c19cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa50ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c105b80 0x7fa50c196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38042/0 (socket says 172.21.15.59:38042) 2023-10-08T12:58:23.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa50ad9d700 1 -- 172.21.15.59:0/2498567310 learned_addr learned my addr 172.21.15.59:0/2498567310 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:23.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa503fff700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa50c1051c0 0x7fa50c19d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa50ad9d700 1 -- 172.21.15.59:0/2498567310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa50c1051c0 msgr2=0x7fa50c19d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa50c1051c0 0x7fa50c19d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa50ad9d700 1 -- 172.21.15.59:0/2498567310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c067ce0 msgr2=0x7fa50c19cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c067ce0 0x7fa50c19cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa50ad9d700 1 -- 172.21.15.59:0/2498567310 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504009d00 con 0x7fa50c105b80 2023-10-08T12:58:23.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa503fff700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa50c1051c0 0x7fa50c19d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:23.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c105b80 0x7fa50c196b60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b070 tx=0x7fa50400bdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa5037fe700 1 -- 172.21.15.59:0/2498567310 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400e040 con 0x7fa50c105b80 2023-10-08T12:58:23.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa5037fe700 1 -- 172.21.15.59:0/2498567310 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa50401d470 con 0x7fa50c105b80 2023-10-08T12:58:23.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa5109ff700 1 -- 172.21.15.59:0/2498567310 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c1978e0 con 0x7fa50c105b80 2023-10-08T12:58:23.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.287+0000 7fa5037fe700 1 -- 172.21.15.59:0/2498567310 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5040052a0 con 0x7fa50c105b80 2023-10-08T12:58:23.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.288+0000 7fa5109ff700 1 -- 172.21.15.59:0/2498567310 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c1a3a40 con 0x7fa50c105b80 2023-10-08T12:58:23.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.291+0000 7fa5037fe700 1 -- 172.21.15.59:0/2498567310 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa50401d5e0 con 0x7fa50c105b80 2023-10-08T12:58:23.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.293+0000 7fa524323b80 1 Processor -- start 2023-10-08T12:58:23.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.293+0000 7fa524323b80 1 -- start start 2023-10-08T12:58:23.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.293+0000 7fa5037fe700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4f80a1670 0x7fa4f80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.293+0000 7fa5037fe700 1 -- 172.21.15.59:0/2498567310 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa5040ce3d0 con 0x7fa50c105b80 2023-10-08T12:58:23.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.293+0000 7fa524323b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070352e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.293+0000 7fa524323b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207035820 0x55f2070445a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.293+0000 7fa524323b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207044ae0 0x55f207046ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.293+0000 7fa524323b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f206f9e4e0 con 0x55f207034f00 2023-10-08T12:58:23.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.293+0000 7fa524323b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f206f8fca0 con 0x55f207035820 2023-10-08T12:58:23.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.293+0000 7fa524323b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f206f8d5c0 con 0x55f207044ae0 2023-10-08T12:58:23.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.293+0000 7fa503fff700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4f80a1670 0x7fa4f80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa503fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207035820 0x55f2070445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070352e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46440/0 (socket says 172.21.15.59:46440) 2023-10-08T12:58:23.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa50a59c700 1 -- 172.21.15.59:0/3425716552 learned_addr learned my addr 172.21.15.59:0/3425716552 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:23.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/3425716552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207044ae0 0x55f207046ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa50ad9d700 1 -- 172.21.15.59:0/3425716552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207035820 msgr2=0x55f2070445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/3425716552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207035820 0x55f2070445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa50ad9d700 1 -- 172.21.15.59:0/3425716552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 msgr2=0x55f2070352e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/3425716552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070352e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa50ad9d700 1 -- 172.21.15.59:0/3425716552 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f206db3e60 con 0x55f207044ae0 2023-10-08T12:58:23.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa50a59c700 1 --2- 172.21.15.59:0/3425716552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070352e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:23.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa503fff700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4f80a1670 0x7fa4f80a3b30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa50c1982d0 tx=0x7fa4f4009960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.294+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/3425716552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207044ae0 0x55f207046ed0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa5040cbae0 tx=0x7fa50400b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a82eb79c0578a0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa500ff9700 1 -- 172.21.15.59:0/3425716552 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50409bb30 con 0x55f207044ae0 2023-10-08T12:58:23.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa500ff9700 1 -- 172.21.15.59:0/3425716552 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa50409b430 con 0x55f207044ae0 2023-10-08T12:58:23.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa500ff9700 1 -- 172.21.15.59:0/3425716552 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50401d8e0 con 0x55f207044ae0 2023-10-08T12:58:23.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa524323b80 1 -- 172.21.15.59:0/3425716552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207044ae0 msgr2=0x55f207046ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa524323b80 1 --2- 172.21.15.59:0/3425716552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207044ae0 0x55f207046ed0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa5040cbae0 tx=0x7fa50400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa524323b80 1 -- 172.21.15.59:0/3425716552 shutdown_connections 2023-10-08T12:58:23.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa524323b80 1 --2- 172.21.15.59:0/3425716552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207044ae0 0x55f207046ed0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa524323b80 1 --2- 172.21.15.59:0/3425716552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070352e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa524323b80 1 --2- 172.21.15.59:0/3425716552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207035820 0x55f2070445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa524323b80 1 -- 172.21.15.59:0/3425716552 >> 172.21.15.59:0/3425716552 conn(0x55f206faa2e0 msgr2=0x55f207031350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa524323b80 1 -- 172.21.15.59:0/3425716552 shutdown_connections 2023-10-08T12:58:23.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.295+0000 7fa524323b80 1 -- 172.21.15.59:0/3425716552 wait complete. 2023-10-08T12:58:23.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.296+0000 7fa524323b80 1 -- start start 2023-10-08T12:58:23.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.296+0000 7fa524323b80 1 Processor -- start 2023-10-08T12:58:23.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa524323b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070444a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa524323b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 0x55f207041790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa524323b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207044ae0 0x55f207041e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa524323b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f206f88eb0 con 0x55f207034f00 2023-10-08T12:58:23.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa524323b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f206f25790 con 0x55f207044ae0 2023-10-08T12:58:23.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa524323b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f206f25430 con 0x55f207035820 2023-10-08T12:58:23.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa524323b80 10 client.0 _ll_register_callbacks cb 0x55f206d82880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:23.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa503fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 0x55f207041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa50ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207044ae0 0x55f207041e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46452/0 (socket says 172.21.15.59:46452) 2023-10-08T12:58:23.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa50a59c700 1 -- 172.21.15.59:0/1479054606 learned_addr learned my addr 172.21.15.59:0/1479054606 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:23.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa503fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 0x55f207041790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:33514/0 (socket says 172.21.15.59:33514) 2023-10-08T12:58:23.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa50ad9d700 1 -- 172.21.15.59:0/1479054606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 msgr2=0x55f207041790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 0x55f207041790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa50ad9d700 1 -- 172.21.15.59:0/1479054606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 msgr2=0x55f2070444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa50ad9d700 1 -- 172.21.15.59:0/1479054606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc0099e0 con 0x55f207044ae0 2023-10-08T12:58:23.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.297+0000 7fa503fff700 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 0x55f207041790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:23.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.298+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207044ae0 0x55f207041e10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa5040a38f0 tx=0x7fa504009a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f71b24ce51b21ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.298+0000 7fa4f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:23.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.298+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/1479054606 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50401daf0 con 0x55f207044ae0 2023-10-08T12:58:23.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.298+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/1479054606 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa5040a3730 con 0x55f207044ae0 2023-10-08T12:58:23.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.298+0000 7fa524323b80 1 -- 172.21.15.59:0/1479054606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f206f50f30 con 0x55f207044ae0 2023-10-08T12:58:23.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.298+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/1479054606 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa50409f170 con 0x55f207044ae0 2023-10-08T12:58:23.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.298+0000 7fa524323b80 10 client.27962 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:23.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.298+0000 7fa524323b80 1 -- 172.21.15.59:0/1479054606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fa50c1a3a40 con 0x55f207044ae0 2023-10-08T12:58:23.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.298+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/1479054606 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f206f50f30 con 0x55f207044ae0 2023-10-08T12:58:23.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.299+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/1479054606 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa504083050 con 0x55f207044ae0 2023-10-08T12:58:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.299+0000 7fa524323b80 10 client.27962 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.299+0000 7fa524323b80 10 client.27962 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.299+0000 7fa524323b80 20 client.27962 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.299+0000 7fa524323b80 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f207053f60 0x55f207056380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.299+0000 7fa524323b80 4 client.27962 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:58:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.299+0000 7fa524323b80 1 -- 172.21.15.59:0/1479054606 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f206f81e90 con 0x55f207053f60 2023-10-08T12:58:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.299+0000 7fa50a59c700 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f207053f60 0x55f207056380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.299+0000 7fa50a59c700 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f207053f60 0x55f207056380 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f400e841ff20b580 server_cookie=912837ef8a421a2b in_seq=0 out_seq=0 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.299+0000 7fa4f1ffb700 10 client.27962 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.300+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/1479054606 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f206f81e90 con 0x55f207053f60 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.300+0000 7fa4f1ffb700 10 client.27962 handle_command_reply: tid=0 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.300+0000 7fa524323b80 1 client.27962 shutdown 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa524323b80 1 -- 172.21.15.59:0/1479054606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207044ae0 msgr2=0x55f207041e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa524323b80 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207044ae0 0x55f207041e10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa5040a38f0 tx=0x7fa504009a50 comp rx=0 tx=0).stop 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa524323b80 1 -- 172.21.15.59:0/1479054606 shutdown_connections 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa524323b80 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f207053f60 0x55f207056380 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa524323b80 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207044ae0 0x55f207041e10 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa524323b80 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa524323b80 1 --2- 172.21.15.59:0/1479054606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 0x55f207041790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa4f1ffb700 0 client.27962 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:23.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa524323b80 1 -- 172.21.15.59:0/1479054606 >> 172.21.15.59:0/1479054606 conn(0x55f206faa2e0 msgr2=0x55f207030f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa524323b80 1 -- 172.21.15.59:0/1479054606 shutdown_connections 2023-10-08T12:58:23.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa524323b80 1 -- 172.21.15.59:0/1479054606 wait complete. 2023-10-08T12:58:23.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.301+0000 7fa524323b80 20 client.27962 trim_cache size 0 max 16384 2023-10-08T12:58:23.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.320+0000 7fa524323b80 1 Processor -- start 2023-10-08T12:58:23.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.320+0000 7fa524323b80 1 -- start start 2023-10-08T12:58:23.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa524323b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207034f00 0x55f207050330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa524323b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 0x55f20704b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa524323b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207044ae0 0x55f207041090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa524323b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f206e099a0 con 0x55f207044ae0 2023-10-08T12:58:23.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa524323b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f207031900 con 0x55f207034f00 2023-10-08T12:58:23.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa524323b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2070426e0 con 0x55f207035820 2023-10-08T12:58:23.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207034f00 0x55f207050330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207034f00 0x55f207050330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38070/0 (socket says 172.21.15.59:38070) 2023-10-08T12:58:23.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa50a59c700 1 -- 172.21.15.59:0/1142898139 learned_addr learned my addr 172.21.15.59:0/1142898139 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:23.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/1142898139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207044ae0 0x55f207041090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa503fff700 1 --2- 172.21.15.59:0/1142898139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 0x55f20704b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa50a59c700 1 -- 172.21.15.59:0/1142898139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 msgr2=0x55f20704b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa50a59c700 1 --2- 172.21.15.59:0/1142898139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 0x55f20704b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa50a59c700 1 -- 172.21.15.59:0/1142898139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207044ae0 msgr2=0x55f207041090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.321+0000 7fa50a59c700 1 --2- 172.21.15.59:0/1142898139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207044ae0 0x55f207041090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.322+0000 7fa50a59c700 1 -- 172.21.15.59:0/1142898139 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f206d9cce0 con 0x55f207034f00 2023-10-08T12:58:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.322+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/1142898139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207044ae0 0x55f207041090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.322+0000 7fa50a59c700 1 --2- 172.21.15.59:0/1142898139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207034f00 0x55f207050330 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc005d90 tx=0x7fa4fc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f9c9ec4c8851606 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.322+0000 7fa5017fa700 1 -- 172.21.15.59:0/1142898139 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc025070 con 0x55f207034f00 2023-10-08T12:58:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.322+0000 7fa5017fa700 1 -- 172.21.15.59:0/1142898139 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4fc018040 con 0x55f207034f00 2023-10-08T12:58:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.322+0000 7fa5017fa700 1 -- 172.21.15.59:0/1142898139 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc017040 con 0x55f207034f00 2023-10-08T12:58:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.323+0000 7fa524323b80 1 -- 172.21.15.59:0/1142898139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207034f00 msgr2=0x55f207050330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.323+0000 7fa524323b80 1 --2- 172.21.15.59:0/1142898139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207034f00 0x55f207050330 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc005d90 tx=0x7fa4fc009260 comp rx=0 tx=0).stop 2023-10-08T12:58:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.323+0000 7fa524323b80 1 -- 172.21.15.59:0/1142898139 shutdown_connections 2023-10-08T12:58:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.323+0000 7fa524323b80 1 --2- 172.21.15.59:0/1142898139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207034f00 0x55f207050330 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.323+0000 7fa524323b80 1 --2- 172.21.15.59:0/1142898139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207044ae0 0x55f207041090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.323+0000 7fa524323b80 1 --2- 172.21.15.59:0/1142898139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207035820 0x55f20704b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.323+0000 7fa524323b80 1 -- 172.21.15.59:0/1142898139 >> 172.21.15.59:0/1142898139 conn(0x55f206faa2e0 msgr2=0x55f20704fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.323+0000 7fa524323b80 1 -- 172.21.15.59:0/1142898139 shutdown_connections 2023-10-08T12:58:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.323+0000 7fa524323b80 1 -- 172.21.15.59:0/1142898139 wait complete. 2023-10-08T12:58:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.323+0000 7fa524323b80 1 -- start start 2023-10-08T12:58:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.323+0000 7fa524323b80 1 Processor -- start 2023-10-08T12:58:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa524323b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070a1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa524323b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207035820 0x55f2070a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa524323b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207044ae0 0x55f20704a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa524323b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20704ab00 con 0x55f207034f00 2023-10-08T12:58:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa524323b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20704ac70 con 0x55f207035820 2023-10-08T12:58:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa524323b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20704ae30 con 0x55f207044ae0 2023-10-08T12:58:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa524323b80 10 client.0 _ll_register_callbacks cb 0x7fa4fc009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa503fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207035820 0x55f2070a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070a1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46472/0 (socket says 172.21.15.59:46472) 2023-10-08T12:58:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa50a59c700 1 -- 172.21.15.59:0/2145648952 learned_addr learned my addr 172.21.15.59:0/2145648952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa503fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207035820 0x55f2070a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38078/0 (socket says 172.21.15.59:38078) 2023-10-08T12:58:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa50ad9d700 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207044ae0 0x55f20704a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa50a59c700 1 -- 172.21.15.59:0/2145648952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207044ae0 msgr2=0x55f20704a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa50a59c700 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207044ae0 0x55f20704a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa50a59c700 1 -- 172.21.15.59:0/2145648952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207035820 msgr2=0x55f2070a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa50a59c700 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207035820 0x55f2070a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.324+0000 7fa50a59c700 1 -- 172.21.15.59:0/2145648952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c1a3a40 con 0x55f207034f00 2023-10-08T12:58:23.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.325+0000 7fa50a59c700 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070a1170 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc012210 tx=0x7fa4fc012240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1d2d5f64aabf69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.325+0000 7fa4f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T12:58:23.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.325+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/2145648952 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc025030 con 0x55f207034f00 2023-10-08T12:58:23.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.325+0000 7fa524323b80 1 -- 172.21.15.59:0/2145648952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa50409b430 con 0x55f207034f00 2023-10-08T12:58:23.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.325+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/2145648952 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa4fc004d70 con 0x55f207034f00 2023-10-08T12:58:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.325+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/2145648952 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4fc0210f0 con 0x55f207034f00 2023-10-08T12:58:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.325+0000 7fa524323b80 10 client.17949 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.325+0000 7fa524323b80 1 -- 172.21.15.59:0/2145648952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fa4fc009e30 con 0x55f207034f00 2023-10-08T12:58:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.326+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/2145648952 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa50409b430 con 0x55f207034f00 2023-10-08T12:58:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.326+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/2145648952 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa4fc0051a0 con 0x55f207034f00 2023-10-08T12:58:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.326+0000 7fa524323b80 10 client.17949 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.326+0000 7fa524323b80 10 client.17949 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.326+0000 7fa524323b80 20 client.17949 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.326+0000 7fa524323b80 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f2070aa0b0 0x55f2070ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.326+0000 7fa524323b80 4 client.17949 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:58:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.326+0000 7fa524323b80 1 -- 172.21.15.59:0/2145648952 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f206f81bb0 con 0x55f2070aa0b0 2023-10-08T12:58:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.326+0000 7fa503fff700 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f2070aa0b0 0x55f2070ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.327+0000 7fa503fff700 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f2070aa0b0 0x55f2070ac4d0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e824e771fd1dfd36 server_cookie=1d12267530ed9df0 in_seq=0 out_seq=0 2023-10-08T12:58:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.327+0000 7fa4f1ffb700 10 client.17949 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa4f1ffb700 1 -- 172.21.15.59:0/2145648952 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f206f81bb0 con 0x55f2070aa0b0 2023-10-08T12:58:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa4f1ffb700 10 client.17949 handle_command_reply: tid=0 2023-10-08T12:58:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa524323b80 1 client.17949 shutdown 2023-10-08T12:58:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa524323b80 1 -- 172.21.15.59:0/2145648952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 msgr2=0x55f2070a1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa524323b80 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070a1170 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc012210 tx=0x7fa4fc012240 comp rx=0 tx=0).stop 2023-10-08T12:58:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa524323b80 1 -- 172.21.15.59:0/2145648952 shutdown_connections 2023-10-08T12:58:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa524323b80 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f2070aa0b0 0x55f2070ac4d0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa524323b80 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f207044ae0 0x55f20704a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa524323b80 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f207034f00 0x55f2070a1170 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa524323b80 1 --2- 172.21.15.59:0/2145648952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f207035820 0x55f2070a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa4f1ffb700 0 client.17949 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa524323b80 1 -- 172.21.15.59:0/2145648952 >> 172.21.15.59:0/2145648952 conn(0x55f206faa2e0 msgr2=0x55f207043030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa524323b80 1 -- 172.21.15.59:0/2145648952 shutdown_connections 2023-10-08T12:58:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.329+0000 7fa524323b80 1 -- 172.21.15.59:0/2145648952 wait complete. 2023-10-08T12:58:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa524323b80 20 client.17949 trim_cache size 0 max 16384 2023-10-08T12:58:23.336 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:58:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:58:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "d25f80a2-4eb3-481e-95a2-6b59a9dc1686", 2023-10-08T12:58:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:58:23.336 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:58:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 -- 172.21.15.59:0/2498567310 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4f80a1670 msgr2=0x7fa4f80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4f80a1670 0x7fa4f80a3b30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa50c1982d0 tx=0x7fa4f4009960 comp rx=0 tx=0).stop 2023-10-08T12:58:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 -- 172.21.15.59:0/2498567310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c105b80 msgr2=0x7fa50c196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c105b80 0x7fa50c196b60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b070 tx=0x7fa50400bdd0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 -- 172.21.15.59:0/2498567310 shutdown_connections 2023-10-08T12:58:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa4f80a1670 0x7fa4f80a3b30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c105b80 0x7fa50c196b60 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c067ce0 0x7fa50c19cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 --2- 172.21.15.59:0/2498567310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa50c1051c0 0x7fa50c19d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 -- 172.21.15.59:0/2498567310 >> 172.21.15.59:0/2498567310 conn(0x7fa50c076780 msgr2=0x7fa50c0fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 -- 172.21.15.59:0/2498567310 shutdown_connections 2023-10-08T12:58:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.330+0000 7fa5109ff700 1 -- 172.21.15.59:0/2498567310 wait complete. 2023-10-08T12:58:23.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:58:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.587+0000 7fe6f43ff700 1 -- 172.21.15.59:0/522210839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6ec106750 msgr2=0x7fe6ec106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.587+0000 7fe6f43ff700 1 --2- 172.21.15.59:0/522210839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6ec106750 0x7fe6ec106b30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009990 tx=0x7fe6e8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.587+0000 7fe6f43ff700 1 -- 172.21.15.59:0/522210839 shutdown_connections 2023-10-08T12:58:23.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.587+0000 7fe6f43ff700 1 --2- 172.21.15.59:0/522210839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec101100 0x7fe6ec10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.587+0000 7fe6f43ff700 1 --2- 172.21.15.59:0/522210839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6ec106750 0x7fe6ec106b30 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.587+0000 7fe6f43ff700 1 --2- 172.21.15.59:0/522210839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6ec100740 0x7fe6ec100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.587+0000 7fe6f43ff700 1 -- 172.21.15.59:0/522210839 >> 172.21.15.59:0/522210839 conn(0x7fe6ec0fc230 msgr2=0x7fe6ec0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.587+0000 7fe6f43ff700 1 -- 172.21.15.59:0/522210839 shutdown_connections 2023-10-08T12:58:23.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.587+0000 7fe6f43ff700 1 -- 172.21.15.59:0/522210839 wait complete. 2023-10-08T12:58:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.588+0000 7fe6f43ff700 1 Processor -- start 2023-10-08T12:58:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.588+0000 7fe6f43ff700 1 -- start start 2023-10-08T12:58:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.589+0000 7fe6f43ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec100740 0x7fe6ec19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.589+0000 7fe6f43ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6ec101100 0x7fe6ec19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.589+0000 7fe6f43ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6ec106750 0x7fe6ec196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.589+0000 7fe6f43ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec197070 con 0x7fe6ec106750 2023-10-08T12:58:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.589+0000 7fe6f43ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec1971e0 con 0x7fe6ec100740 2023-10-08T12:58:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.589+0000 7fe6f43ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec1973a0 con 0x7fe6ec101100 2023-10-08T12:58:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.589+0000 7fe6f219b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec100740 0x7fe6ec19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.589+0000 7fe6f199a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6ec101100 0x7fe6ec19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.589+0000 7fe6f219b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec100740 0x7fe6ec19c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38096/0 (socket says 172.21.15.59:38096) 2023-10-08T12:58:23.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.589+0000 7fe6f219b700 1 -- 172.21.15.59:0/3678744083 learned_addr learned my addr 172.21.15.59:0/3678744083 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:23.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.589+0000 7fe6f299c700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6ec106750 0x7fe6ec196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.590+0000 7fe6f219b700 1 -- 172.21.15.59:0/3678744083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6ec101100 msgr2=0x7fe6ec19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.590+0000 7fe6f219b700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6ec101100 0x7fe6ec19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.590+0000 7fe6f219b700 1 -- 172.21.15.59:0/3678744083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6ec106750 msgr2=0x7fe6ec196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.590+0000 7fe6f219b700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6ec106750 0x7fe6ec196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.590+0000 7fe6f219b700 1 -- 172.21.15.59:0/3678744083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e80095f0 con 0x7fe6ec100740 2023-10-08T12:58:23.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.590+0000 7fe6f219b700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec100740 0x7fe6ec19c890 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8000c00 tx=0x7fe6e8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.590+0000 7fe6e37fe700 1 -- 172.21.15.59:0/3678744083 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e801d070 con 0x7fe6ec100740 2023-10-08T12:58:23.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.590+0000 7fe6f43ff700 1 -- 172.21.15.59:0/3678744083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ec197620 con 0x7fe6ec100740 2023-10-08T12:58:23.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.590+0000 7fe6e37fe700 1 -- 172.21.15.59:0/3678744083 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6e8022470 con 0x7fe6ec100740 2023-10-08T12:58:23.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.590+0000 7fe6e37fe700 1 -- 172.21.15.59:0/3678744083 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8017650 con 0x7fe6ec100740 2023-10-08T12:58:23.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.590+0000 7fe6f43ff700 1 -- 172.21.15.59:0/3678744083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ec1a3880 con 0x7fe6ec100740 2023-10-08T12:58:23.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.594+0000 7fe6e37fe700 1 -- 172.21.15.59:0/3678744083 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe6e80225e0 con 0x7fe6ec100740 2023-10-08T12:58:23.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.595+0000 7fe707cedb80 1 Processor -- start 2023-10-08T12:58:23.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.595+0000 7fe707cedb80 1 -- start start 2023-10-08T12:58:23.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.595+0000 7fe6e37fe700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6d80a15f0 0x7fe6d80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.595+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16cae80 0x560cf16cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.595+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.595+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16d6650 0x560cf16d8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.595+0000 7fe707cedb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf1634460 con 0x560cf16d6650 2023-10-08T12:58:23.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.595+0000 7fe707cedb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf1625c20 con 0x560cf16cb7a0 2023-10-08T12:58:23.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.595+0000 7fe707cedb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf1623540 con 0x560cf16cae80 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.595+0000 7fe6e37fe700 1 -- 172.21.15.59:0/3678744083 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe6e80ce3f0 con 0x7fe6ec100740 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f219b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16cae80 0x560cf16cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f299c700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6d80a15f0 0x7fe6d80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38112/0 (socket says 172.21.15.59:38112) 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f199a700 1 -- 172.21.15.59:0/2065941333 learned_addr learned my addr 172.21.15.59:0/2065941333 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f219b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16cae80 0x560cf16cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:33552/0 (socket says 172.21.15.59:33552) 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f299c700 1 --2- 172.21.15.59:0/2065941333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16d6650 0x560cf16d8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f199a700 1 -- 172.21.15.59:0/2065941333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16cae80 msgr2=0x560cf16cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f199a700 1 --2- 172.21.15.59:0/2065941333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16cae80 0x560cf16cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f199a700 1 -- 172.21.15.59:0/2065941333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16d6650 msgr2=0x560cf16d8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f199a700 1 --2- 172.21.15.59:0/2065941333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16d6650 0x560cf16d8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f199a700 1 -- 172.21.15.59:0/2065941333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf1449de0 con 0x560cf16cb7a0 2023-10-08T12:58:23.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f219b700 1 --2- 172.21.15.59:0/2065941333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16cae80 0x560cf16cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:23.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f299c700 1 --2- 172.21.15.59:0/2065941333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16d6650 0x560cf16d8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:23.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.596+0000 7fe6f199a700 1 --2- 172.21.15.59:0/2065941333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d6110 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009d50 tx=0x7fe6dc011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e7433a08403d7d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.597+0000 7fe6f299c700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6d80a15f0 0x7fe6d80a3ab0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009ec0 tx=0x7fe6e4009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.597+0000 7fe6e0bfe700 1 -- 172.21.15.59:0/2065941333 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc019630 con 0x560cf16cb7a0 2023-10-08T12:58:23.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.597+0000 7fe6e0bfe700 1 -- 172.21.15.59:0/2065941333 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6dc019c50 con 0x560cf16cb7a0 2023-10-08T12:58:23.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.597+0000 7fe6e0bfe700 1 -- 172.21.15.59:0/2065941333 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00ec10 con 0x560cf16cb7a0 2023-10-08T12:58:23.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.597+0000 7fe707cedb80 1 -- 172.21.15.59:0/2065941333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 msgr2=0x560cf16d6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.597+0000 7fe707cedb80 1 --2- 172.21.15.59:0/2065941333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d6110 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009d50 tx=0x7fe6dc011720 comp rx=0 tx=0).stop 2023-10-08T12:58:23.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.597+0000 7fe707cedb80 1 -- 172.21.15.59:0/2065941333 shutdown_connections 2023-10-08T12:58:23.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.597+0000 7fe707cedb80 1 --2- 172.21.15.59:0/2065941333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16d6650 0x560cf16d8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.597+0000 7fe707cedb80 1 --2- 172.21.15.59:0/2065941333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16cae80 0x560cf16cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.597+0000 7fe707cedb80 1 --2- 172.21.15.59:0/2065941333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d6110 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.597+0000 7fe707cedb80 1 -- 172.21.15.59:0/2065941333 >> 172.21.15.59:0/2065941333 conn(0x560cf1640260 msgr2=0x560cf16c72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.598+0000 7fe707cedb80 1 -- 172.21.15.59:0/2065941333 shutdown_connections 2023-10-08T12:58:23.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.598+0000 7fe707cedb80 1 -- 172.21.15.59:0/2065941333 wait complete. 2023-10-08T12:58:23.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.598+0000 7fe707cedb80 1 -- start start 2023-10-08T12:58:23.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.598+0000 7fe707cedb80 1 Processor -- start 2023-10-08T12:58:23.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cae80 0x560cf16d6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf16d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe707cedb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf161ee30 con 0x560cf16cae80 2023-10-08T12:58:23.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe707cedb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf15bb710 con 0x560cf16cb7a0 2023-10-08T12:58:23.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe707cedb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf15bb3b0 con 0x560cf16d6650 2023-10-08T12:58:23.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe707cedb80 10 client.0 _ll_register_callbacks cb 0x560cf1418800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:23.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe6f199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe6f199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38126/0 (socket says 172.21.15.59:38126) 2023-10-08T12:58:23.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe6f299c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf16d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe6f199a700 1 -- 172.21.15.59:0/2198743007 learned_addr learned my addr 172.21.15.59:0/2198743007 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.599+0000 7fe6f219b700 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cae80 0x560cf16d6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.600+0000 7fe6f299c700 1 -- 172.21.15.59:0/2198743007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 msgr2=0x560cf16d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.600+0000 7fe6f299c700 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.600+0000 7fe6f299c700 1 -- 172.21.15.59:0/2198743007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cae80 msgr2=0x560cf16d6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.600+0000 7fe6f299c700 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cae80 0x560cf16d6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.600+0000 7fe6f299c700 1 -- 172.21.15.59:0/2198743007 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ec1a3880 con 0x560cf16d6650 2023-10-08T12:58:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.600+0000 7fe6f199a700 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.600+0000 7fe6f219b700 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cae80 0x560cf16d6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.600+0000 7fe6f299c700 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf16d3ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009fd0 tx=0x7fe6e4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1b31f2846bc22cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.600+0000 7fe6d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:58:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.600+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/2198743007 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4020070 con 0x560cf16d6650 2023-10-08T12:58:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe707cedb80 1 -- 172.21.15.59:0/2198743007 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560cf15e6eb0 con 0x560cf16d6650 2023-10-08T12:58:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/2198743007 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe6e401b640 con 0x560cf16d6650 2023-10-08T12:58:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/2198743007 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6e400e070 con 0x560cf16d6650 2023-10-08T12:58:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe707cedb80 10 client.27976 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe707cedb80 1 -- 172.21.15.59:0/2198743007 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fe6dc009980 con 0x560cf16d6650 2023-10-08T12:58:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/2198743007 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560cf15e6eb0 con 0x560cf16d6650 2023-10-08T12:58:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/2198743007 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe6e40268e0 con 0x560cf16d6650 2023-10-08T12:58:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe707cedb80 10 client.27976 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe707cedb80 10 client.27976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe707cedb80 20 client.27976 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe707cedb80 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560cf16e62b0 0x560cf16e86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe707cedb80 4 client.27976 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:58:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.601+0000 7fe707cedb80 1 -- 172.21.15.59:0/2198743007 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560cf1617e10 con 0x560cf16e62b0 2023-10-08T12:58:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.602+0000 7fe6f219b700 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560cf16e62b0 0x560cf16e86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.602+0000 7fe6f219b700 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560cf16e62b0 0x560cf16e86d0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14edd37bbff7ecf7 server_cookie=2a8b361208e98624 in_seq=0 out_seq=0 2023-10-08T12:58:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.602+0000 7fe6d5ffb700 10 client.27976 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:23.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/2198743007 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560cf1617e10 con 0x560cf16e62b0 2023-10-08T12:58:23.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe6d5ffb700 10 client.27976 handle_command_reply: tid=0 2023-10-08T12:58:23.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe707cedb80 1 client.27976 shutdown 2023-10-08T12:58:23.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe707cedb80 1 -- 172.21.15.59:0/2198743007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 msgr2=0x560cf16d3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe707cedb80 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf16d3ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009fd0 tx=0x7fe6e4004b40 comp rx=0 tx=0).stop 2023-10-08T12:58:23.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe707cedb80 1 -- 172.21.15.59:0/2198743007 shutdown_connections 2023-10-08T12:58:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe707cedb80 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560cf16e62b0 0x560cf16e86d0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe707cedb80 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf16d3ab0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe707cedb80 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cae80 0x560cf16d6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe707cedb80 1 --2- 172.21.15.59:0/2198743007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe707cedb80 1 -- 172.21.15.59:0/2198743007 >> 172.21.15.59:0/2198743007 conn(0x560cf1640260 msgr2=0x560cf16c6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe6d5ffb700 0 client.27976 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe707cedb80 1 -- 172.21.15.59:0/2198743007 shutdown_connections 2023-10-08T12:58:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.616+0000 7fe707cedb80 1 -- 172.21.15.59:0/2198743007 wait complete. 2023-10-08T12:58:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.617+0000 7fe707cedb80 20 client.27976 trim_cache size 0 max 16384 2023-10-08T12:58:23.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.638+0000 7fe707cedb80 1 Processor -- start 2023-10-08T12:58:23.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.638+0000 7fe707cedb80 1 -- start start 2023-10-08T12:58:23.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.639+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cae80 0x560cf16dd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.639+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cb7a0 0x560cf16ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.639+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf16cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.639+0000 7fe707cedb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf149f920 con 0x560cf16cb7a0 2023-10-08T12:58:23.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.639+0000 7fe707cedb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf16d46f0 con 0x560cf16cae80 2023-10-08T12:58:23.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.639+0000 7fe707cedb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf16c8060 con 0x560cf16d6650 2023-10-08T12:58:23.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.639+0000 7fe6f219b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cae80 0x560cf16dd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.639+0000 7fe6f219b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cae80 0x560cf16dd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38142/0 (socket says 172.21.15.59:38142) 2023-10-08T12:58:23.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.639+0000 7fe6f219b700 1 -- 172.21.15.59:0/4212278950 learned_addr learned my addr 172.21.15.59:0/4212278950 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:23.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.639+0000 7fe6f299c700 1 --2- 172.21.15.59:0/4212278950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf16cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.639+0000 7fe6f199a700 1 --2- 172.21.15.59:0/4212278950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cb7a0 0x560cf16ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.640+0000 7fe6f299c700 1 -- 172.21.15.59:0/4212278950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cae80 msgr2=0x560cf16dd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.640+0000 7fe6f299c700 1 --2- 172.21.15.59:0/4212278950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cae80 0x560cf16dd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.640+0000 7fe6f299c700 1 -- 172.21.15.59:0/4212278950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cb7a0 msgr2=0x560cf16ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.640+0000 7fe6f299c700 1 --2- 172.21.15.59:0/4212278950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cb7a0 0x560cf16ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.640+0000 7fe6f299c700 1 -- 172.21.15.59:0/4212278950 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf1432c60 con 0x560cf16d6650 2023-10-08T12:58:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.640+0000 7fe6f219b700 1 --2- 172.21.15.59:0/4212278950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cae80 0x560cf16dd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.640+0000 7fe6f299c700 1 --2- 172.21.15.59:0/4212278950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf16cec30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4000f80 tx=0x7fe6e4009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f78842e847b06fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.641+0000 7fe6e13ff700 1 -- 172.21.15.59:0/4212278950 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4020070 con 0x560cf16d6650 2023-10-08T12:58:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.641+0000 7fe6e13ff700 1 -- 172.21.15.59:0/4212278950 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6e400f040 con 0x560cf16d6650 2023-10-08T12:58:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.641+0000 7fe6e13ff700 1 -- 172.21.15.59:0/4212278950 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4026420 con 0x560cf16d6650 2023-10-08T12:58:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.641+0000 7fe707cedb80 1 -- 172.21.15.59:0/4212278950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 msgr2=0x560cf16cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.641+0000 7fe707cedb80 1 --2- 172.21.15.59:0/4212278950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf16cec30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4000f80 tx=0x7fe6e4009500 comp rx=0 tx=0).stop 2023-10-08T12:58:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.642+0000 7fe707cedb80 1 -- 172.21.15.59:0/4212278950 shutdown_connections 2023-10-08T12:58:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.642+0000 7fe707cedb80 1 --2- 172.21.15.59:0/4212278950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cae80 0x560cf16dd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.642+0000 7fe707cedb80 1 --2- 172.21.15.59:0/4212278950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf16cec30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.642+0000 7fe707cedb80 1 --2- 172.21.15.59:0/4212278950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cb7a0 0x560cf16ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.642+0000 7fe707cedb80 1 -- 172.21.15.59:0/4212278950 >> 172.21.15.59:0/4212278950 conn(0x560cf1640260 msgr2=0x560cf16c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.642+0000 7fe707cedb80 1 -- 172.21.15.59:0/4212278950 shutdown_connections 2023-10-08T12:58:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.642+0000 7fe707cedb80 1 -- 172.21.15.59:0/4212278950 wait complete. 2023-10-08T12:58:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.642+0000 7fe707cedb80 1 -- start start 2023-10-08T12:58:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.642+0000 7fe707cedb80 1 Processor -- start 2023-10-08T12:58:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cae80 0x560cf16db370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16db8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe707cedb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf17390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe707cedb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf1739620 con 0x560cf16cae80 2023-10-08T12:58:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe707cedb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf1739760 con 0x560cf16cb7a0 2023-10-08T12:58:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe707cedb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf17398a0 con 0x560cf16d6650 2023-10-08T12:58:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe707cedb80 10 client.0 _ll_register_callbacks cb 0x7fe6e4008dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe6f199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16db8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe6f219b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cae80 0x560cf16db370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe6f199a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16db8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:38154/0 (socket says 172.21.15.59:38154) 2023-10-08T12:58:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe6f199a700 1 -- 172.21.15.59:0/215652685 learned_addr learned my addr 172.21.15.59:0/215652685 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.643+0000 7fe6f299c700 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf17390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.644+0000 7fe6f199a700 1 -- 172.21.15.59:0/215652685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 msgr2=0x560cf17390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.644+0000 7fe6f199a700 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf17390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.644+0000 7fe6f199a700 1 -- 172.21.15.59:0/215652685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cae80 msgr2=0x560cf16db370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.644+0000 7fe6f199a700 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cae80 0x560cf16db370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.644+0000 7fe6f199a700 1 -- 172.21.15.59:0/215652685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ec197620 con 0x560cf16cb7a0 2023-10-08T12:58:23.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.644+0000 7fe6f199a700 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16db8b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc005950 tx=0x7fe6dc00e710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7283f3e6a0302d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:23.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.644+0000 7fe6d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:23.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.644+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/215652685 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00ec30 con 0x560cf16cb7a0 2023-10-08T12:58:23.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.644+0000 7fe707cedb80 1 -- 172.21.15.59:0/215652685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe6dc019c50 con 0x560cf16cb7a0 2023-10-08T12:58:23.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.644+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/215652685 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe6dc005ce0 con 0x560cf16cb7a0 2023-10-08T12:58:23.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/215652685 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6dc00ed90 con 0x560cf16cb7a0 2023-10-08T12:58:23.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe707cedb80 10 client.27986 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:23.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe707cedb80 1 -- 172.21.15.59:0/215652685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fe6dc009980 con 0x560cf16cb7a0 2023-10-08T12:58:23.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/215652685 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6dc019c50 con 0x560cf16cb7a0 2023-10-08T12:58:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/215652685 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe6dc02a030 con 0x560cf16cb7a0 2023-10-08T12:58:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe707cedb80 10 client.27986 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe707cedb80 10 client.27986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe707cedb80 20 client.27986 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe707cedb80 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560cf173b010 0x560cf173d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe707cedb80 4 client.27986 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:58:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe707cedb80 1 -- 172.21.15.59:0/215652685 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560cf1617b30 con 0x560cf173b010 2023-10-08T12:58:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.645+0000 7fe6f219b700 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560cf173b010 0x560cf173d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.646+0000 7fe6f219b700 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560cf173b010 0x560cf173d430 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec013aadd965c484 server_cookie=100f23bc63cc7a in_seq=0 out_seq=0 2023-10-08T12:58:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.646+0000 7fe6d5ffb700 10 client.27986 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:23.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe6d5ffb700 1 -- 172.21.15.59:0/215652685 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x560cf1617b30 con 0x560cf173b010 2023-10-08T12:58:23.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe6d5ffb700 10 client.27986 handle_command_reply: tid=0 2023-10-08T12:58:23.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 1 client.27986 shutdown 2023-10-08T12:58:23.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 1 -- 172.21.15.59:0/215652685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 msgr2=0x560cf16db8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16db8b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc005950 tx=0x7fe6dc00e710 comp rx=0 tx=0).stop 2023-10-08T12:58:23.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 1 -- 172.21.15.59:0/215652685 shutdown_connections 2023-10-08T12:58:23.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x560cf173b010 0x560cf173d430 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cf16d6650 0x560cf17390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf16cae80 0x560cf16db370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 1 --2- 172.21.15.59:0/215652685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cf16cb7a0 0x560cf16db8b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 1 -- 172.21.15.59:0/215652685 >> 172.21.15.59:0/215652685 conn(0x560cf1640260 msgr2=0x560cf16ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe6d5ffb700 0 client.27986 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:23.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 1 -- 172.21.15.59:0/215652685 shutdown_connections 2023-10-08T12:58:23.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 1 -- 172.21.15.59:0/215652685 wait complete. 2023-10-08T12:58:23.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.651+0000 7fe707cedb80 20 client.27986 trim_cache size 0 max 16384 2023-10-08T12:58:23.655 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:58:23.655 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "scrub active (690 inodes in the stack)", 2023-10-08T12:58:23.655 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:58:23.655 INFO:teuthology.orchestra.run.smithi059.stdout: "d25f80a2-4eb3-481e-95a2-6b59a9dc1686": { 2023-10-08T12:58:23.655 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:58:23.656 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "d25f80a2-4eb3-481e-95a2-6b59a9dc1686", 2023-10-08T12:58:23.656 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:58:23.656 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:58:23.656 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:58:23.656 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:58:23.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 -- 172.21.15.59:0/3678744083 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6d80a15f0 msgr2=0x7fe6d80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6d80a15f0 0x7fe6d80a3ab0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009ec0 tx=0x7fe6e4009920 comp rx=0 tx=0).stop 2023-10-08T12:58:23.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 -- 172.21.15.59:0/3678744083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec100740 msgr2=0x7fe6ec19c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:23.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec100740 0x7fe6ec19c890 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8000c00 tx=0x7fe6e8005740 comp rx=0 tx=0).stop 2023-10-08T12:58:23.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 -- 172.21.15.59:0/3678744083 shutdown_connections 2023-10-08T12:58:23.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe6d80a15f0 0x7fe6d80a3ab0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec100740 0x7fe6ec19c890 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6ec106750 0x7fe6ec196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 --2- 172.21.15.59:0/3678744083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6ec101100 0x7fe6ec19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:23.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 -- 172.21.15.59:0/3678744083 >> 172.21.15.59:0/3678744083 conn(0x7fe6ec0fc230 msgr2=0x7fe6ec0fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:23.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 -- 172.21.15.59:0/3678744083 shutdown_connections 2023-10-08T12:58:23.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:23.652+0000 7fe6f43ff700 1 -- 172.21.15.59:0/3678744083 wait complete. 2023-10-08T12:58:23.673 INFO:tasks.cephfs.filesystem:scrub status for tag:d25f80a2-4eb3-481e-95a2-6b59a9dc1686 - {'path': '/', 'tag': 'd25f80a2-4eb3-481e-95a2-6b59a9dc1686', 'options': 'recursive,force'} 2023-10-08T12:58:23.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 91450 20.66 MB/sec execute 114 sec latency 373.488 ms 2023-10-08T12:58:24.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:24 smithi092 ceph-mon[134093]: pgmap v852: 97 pgs: 97 active+clean; 896 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.5 MiB/s wr, 367 op/s 2023-10-08T12:58:24.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:24 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:58:24.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:24 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:24.378 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:24 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:58:24.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:24 smithi173 ceph-mon[135182]: pgmap v852: 97 pgs: 97 active+clean; 896 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.5 MiB/s wr, 367 op/s 2023-10-08T12:58:24.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:24 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:58:24.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:24 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:24.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:24 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:58:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:24 smithi059 ceph-mon[98489]: pgmap v852: 97 pgs: 97 active+clean; 896 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.5 MiB/s wr, 367 op/s 2023-10-08T12:58:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:24 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:58:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:24 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:24 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:58:24.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 91707 20.61 MB/sec execute 115 sec latency 153.199 ms 2023-10-08T12:58:25.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 91986 20.52 MB/sec execute 116 sec latency 127.827 ms 2023-10-08T12:58:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:26 smithi173 ceph-mon[135182]: pgmap v853: 97 pgs: 97 active+clean; 903 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.0 MiB/s wr, 371 op/s 2023-10-08T12:58:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:26 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:26 smithi059 ceph-mon[98489]: pgmap v853: 97 pgs: 97 active+clean; 903 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.0 MiB/s wr, 371 op/s 2023-10-08T12:58:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:26 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:26.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:26 smithi092 ceph-mon[134093]: pgmap v853: 97 pgs: 97 active+clean; 903 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.0 MiB/s wr, 371 op/s 2023-10-08T12:58:26.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:26 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:26.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 92325 20.45 MB/sec execute 117 sec latency 139.052 ms 2023-10-08T12:58:27.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 92738 20.44 MB/sec execute 118 sec latency 151.514 ms 2023-10-08T12:58:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:28 smithi173 ceph-mon[135182]: pgmap v854: 97 pgs: 97 active+clean; 916 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.9 MiB/s wr, 376 op/s 2023-10-08T12:58:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:28 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:58:28.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:28 smithi059 ceph-mon[98489]: pgmap v854: 97 pgs: 97 active+clean; 916 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.9 MiB/s wr, 376 op/s 2023-10-08T12:58:28.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:28 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:58:28.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:28 smithi092 ceph-mon[134093]: pgmap v854: 97 pgs: 97 active+clean; 916 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.9 MiB/s wr, 376 op/s 2023-10-08T12:58:28.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:28 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:58:28.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 93031 20.44 MB/sec execute 119 sec latency 263.696 ms 2023-10-08T12:58:29.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 93516 20.41 MB/sec execute 120 sec latency 224.547 ms 2023-10-08T12:58:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:29 smithi059 ceph-mon[98489]: pgmap v855: 97 pgs: 97 active+clean; 922 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.6 MiB/s wr, 395 op/s 2023-10-08T12:58:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:29 smithi092 ceph-mon[134093]: pgmap v855: 97 pgs: 97 active+clean; 922 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.6 MiB/s wr, 395 op/s 2023-10-08T12:58:30.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:29 smithi173 ceph-mon[135182]: pgmap v855: 97 pgs: 97 active+clean; 922 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.6 MiB/s wr, 395 op/s 2023-10-08T12:58:30.962 INFO:tasks.workunit.client.0.smithi059.stdout: 10 94005 20.47 MB/sec execute 121 sec latency 244.518 ms 2023-10-08T12:58:31.963 INFO:tasks.workunit.client.0.smithi059.stdout: 10 94459 20.56 MB/sec execute 122 sec latency 162.267 ms 2023-10-08T12:58:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:32 smithi092 ceph-mon[134093]: pgmap v856: 97 pgs: 97 active+clean; 927 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 8.6 MiB/s wr, 421 op/s 2023-10-08T12:58:32.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:32 smithi173 ceph-mon[135182]: pgmap v856: 97 pgs: 97 active+clean; 927 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 8.6 MiB/s wr, 421 op/s 2023-10-08T12:58:32.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:32 smithi059 ceph-mon[98489]: pgmap v856: 97 pgs: 97 active+clean; 927 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 8.6 MiB/s wr, 421 op/s 2023-10-08T12:58:32.963 INFO:tasks.workunit.client.0.smithi059.stdout: 10 94866 20.63 MB/sec execute 123 sec latency 178.444 ms 2023-10-08T12:58:33.963 INFO:tasks.workunit.client.0.smithi059.stdout: 10 95052 20.55 MB/sec execute 124 sec latency 330.493 ms 2023-10-08T12:58:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:34 smithi173 ceph-mon[135182]: pgmap v857: 97 pgs: 97 active+clean; 941 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.4 MiB/s wr, 445 op/s 2023-10-08T12:58:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:34 smithi059 ceph-mon[98489]: pgmap v857: 97 pgs: 97 active+clean; 941 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.4 MiB/s wr, 445 op/s 2023-10-08T12:58:34.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:34 smithi092 ceph-mon[134093]: pgmap v857: 97 pgs: 97 active+clean; 941 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.4 MiB/s wr, 445 op/s 2023-10-08T12:58:34.963 INFO:tasks.workunit.client.0.smithi059.stdout: 10 95366 20.47 MB/sec execute 125 sec latency 168.934 ms 2023-10-08T12:58:35.963 INFO:tasks.workunit.client.0.smithi059.stdout: 10 95702 20.40 MB/sec execute 126 sec latency 192.758 ms 2023-10-08T12:58:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:36 smithi173 ceph-mon[135182]: pgmap v858: 97 pgs: 97 active+clean; 930 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.6 MiB/s wr, 390 op/s 2023-10-08T12:58:36.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:36 smithi059 ceph-mon[98489]: pgmap v858: 97 pgs: 97 active+clean; 930 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.6 MiB/s wr, 390 op/s 2023-10-08T12:58:36.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:36 smithi092 ceph-mon[134093]: pgmap v858: 97 pgs: 97 active+clean; 930 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.6 MiB/s wr, 390 op/s 2023-10-08T12:58:36.963 INFO:tasks.workunit.client.0.smithi059.stdout: 10 96106 20.37 MB/sec execute 127 sec latency 114.293 ms 2023-10-08T12:58:37.964 INFO:tasks.workunit.client.0.smithi059.stdout: 10 96702 20.53 MB/sec execute 128 sec latency 50.488 ms 2023-10-08T12:58:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:38 smithi173 ceph-mon[135182]: pgmap v859: 97 pgs: 97 active+clean; 915 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.9 MiB/s wr, 392 op/s 2023-10-08T12:58:38.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:38 smithi059 ceph-mon[98489]: pgmap v859: 97 pgs: 97 active+clean; 915 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.9 MiB/s wr, 392 op/s 2023-10-08T12:58:38.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:38 smithi092 ceph-mon[134093]: pgmap v859: 97 pgs: 97 active+clean; 915 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.9 MiB/s wr, 392 op/s 2023-10-08T12:58:38.964 INFO:tasks.workunit.client.0.smithi059.stdout: 10 97178 20.53 MB/sec execute 129 sec latency 393.466 ms 2023-10-08T12:58:39.964 INFO:tasks.workunit.client.0.smithi059.stdout: 10 97551 20.54 MB/sec execute 130 sec latency 184.442 ms 2023-10-08T12:58:40.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:39 smithi059 ceph-mon[98489]: pgmap v860: 97 pgs: 97 active+clean; 893 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.2 MiB/s wr, 362 op/s 2023-10-08T12:58:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:40 smithi092 ceph-mon[134093]: pgmap v860: 97 pgs: 97 active+clean; 893 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.2 MiB/s wr, 362 op/s 2023-10-08T12:58:40.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:40 smithi173 ceph-mon[135182]: pgmap v860: 97 pgs: 97 active+clean; 893 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.2 MiB/s wr, 362 op/s 2023-10-08T12:58:40.964 INFO:tasks.workunit.client.0.smithi059.stdout: 10 97962 20.59 MB/sec execute 131 sec latency 186.521 ms 2023-10-08T12:58:41.964 INFO:tasks.workunit.client.0.smithi059.stdout: 10 98349 20.67 MB/sec execute 132 sec latency 100.058 ms 2023-10-08T12:58:42.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:42 smithi173 ceph-mon[135182]: pgmap v861: 97 pgs: 97 active+clean; 901 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.6 MiB/s wr, 339 op/s 2023-10-08T12:58:42.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:42 smithi059 ceph-mon[98489]: pgmap v861: 97 pgs: 97 active+clean; 901 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.6 MiB/s wr, 339 op/s 2023-10-08T12:58:42.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:42 smithi092 ceph-mon[134093]: pgmap v861: 97 pgs: 97 active+clean; 901 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.6 MiB/s wr, 339 op/s 2023-10-08T12:58:42.964 INFO:tasks.workunit.client.0.smithi059.stdout: 10 98646 20.60 MB/sec execute 133 sec latency 132.984 ms 2023-10-08T12:58:43.964 INFO:tasks.workunit.client.0.smithi059.stdout: 10 98834 20.51 MB/sec execute 134 sec latency 353.966 ms 2023-10-08T12:58:44.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:44 smithi173 ceph-mon[135182]: pgmap v862: 97 pgs: 97 active+clean; 914 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.8 MiB/s wr, 360 op/s 2023-10-08T12:58:44.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:44 smithi059 ceph-mon[98489]: pgmap v862: 97 pgs: 97 active+clean; 914 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.8 MiB/s wr, 360 op/s 2023-10-08T12:58:44.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:44 smithi092 ceph-mon[134093]: pgmap v862: 97 pgs: 97 active+clean; 914 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.8 MiB/s wr, 360 op/s 2023-10-08T12:58:44.964 INFO:tasks.workunit.client.0.smithi059.stdout: 10 99211 20.43 MB/sec execute 135 sec latency 165.781 ms 2023-10-08T12:58:45.965 INFO:tasks.workunit.client.0.smithi059.stdout: 10 99555 20.43 MB/sec execute 136 sec latency 188.393 ms 2023-10-08T12:58:46.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:46 smithi173 ceph-mon[135182]: pgmap v863: 97 pgs: 97 active+clean; 919 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.3 MiB/s wr, 303 op/s 2023-10-08T12:58:46.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:46 smithi059 ceph-mon[98489]: pgmap v863: 97 pgs: 97 active+clean; 919 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.3 MiB/s wr, 303 op/s 2023-10-08T12:58:46.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:46 smithi092 ceph-mon[134093]: pgmap v863: 97 pgs: 97 active+clean; 919 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.3 MiB/s wr, 303 op/s 2023-10-08T12:58:46.965 INFO:tasks.workunit.client.0.smithi059.stdout: 10 99962 20.47 MB/sec execute 137 sec latency 390.295 ms 2023-10-08T12:58:47.965 INFO:tasks.workunit.client.0.smithi059.stdout: 10 100613 20.50 MB/sec execute 138 sec latency 150.972 ms 2023-10-08T12:58:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:48 smithi173 ceph-mon[135182]: pgmap v864: 97 pgs: 97 active+clean; 934 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 8.7 MiB/s wr, 365 op/s 2023-10-08T12:58:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:48 smithi059 ceph-mon[98489]: pgmap v864: 97 pgs: 97 active+clean; 934 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 8.7 MiB/s wr, 365 op/s 2023-10-08T12:58:48.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:48 smithi092 ceph-mon[134093]: pgmap v864: 97 pgs: 97 active+clean; 934 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 8.7 MiB/s wr, 365 op/s 2023-10-08T12:58:48.965 INFO:tasks.workunit.client.0.smithi059.stdout: 10 100889 20.51 MB/sec execute 139 sec latency 371.043 ms 2023-10-08T12:58:49.965 INFO:tasks.workunit.client.0.smithi059.stdout: 10 101339 20.59 MB/sec execute 140 sec latency 190.234 ms 2023-10-08T12:58:50.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:50 smithi059 ceph-mon[98489]: pgmap v865: 97 pgs: 97 active+clean; 943 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.1 MiB/s wr, 372 op/s 2023-10-08T12:58:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:50 smithi092 ceph-mon[134093]: pgmap v865: 97 pgs: 97 active+clean; 943 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.1 MiB/s wr, 372 op/s 2023-10-08T12:58:50.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:50 smithi173 ceph-mon[135182]: pgmap v865: 97 pgs: 97 active+clean; 943 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.1 MiB/s wr, 372 op/s 2023-10-08T12:58:50.965 INFO:tasks.workunit.client.0.smithi059.stdout: 10 101690 20.60 MB/sec execute 141 sec latency 193.631 ms 2023-10-08T12:58:51.965 INFO:tasks.workunit.client.0.smithi059.stdout: 10 101986 20.54 MB/sec execute 142 sec latency 164.860 ms 2023-10-08T12:58:52.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:52 smithi173 ceph-mon[135182]: pgmap v866: 97 pgs: 97 active+clean; 948 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.5 MiB/s wr, 375 op/s 2023-10-08T12:58:52.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:52 smithi059 ceph-mon[98489]: pgmap v866: 97 pgs: 97 active+clean; 948 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.5 MiB/s wr, 375 op/s 2023-10-08T12:58:52.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:52 smithi092 ceph-mon[134093]: pgmap v866: 97 pgs: 97 active+clean; 948 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.5 MiB/s wr, 375 op/s 2023-10-08T12:58:52.965 INFO:tasks.workunit.client.0.smithi059.stdout: 10 102348 20.48 MB/sec execute 143 sec latency 157.970 ms 2023-10-08T12:58:53.674 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:58:53.965 INFO:tasks.workunit.client.0.smithi059.stdout: 10 102672 20.42 MB/sec execute 144 sec latency 227.496 ms 2023-10-08T12:58:54.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.019+0000 7f94539ff700 1 -- 172.21.15.59:0/289645800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f944c100730 msgr2=0x7f944c100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.019+0000 7f94539ff700 1 --2- 172.21.15.59:0/289645800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f944c100730 0x7f944c100bb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f943c009990 tx=0x7f943c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.020+0000 7f94539ff700 1 -- 172.21.15.59:0/289645800 shutdown_connections 2023-10-08T12:58:54.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.020+0000 7f94539ff700 1 --2- 172.21.15.59:0/289645800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f944c1010f0 0x7f944c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.020+0000 7f94539ff700 1 --2- 172.21.15.59:0/289645800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f944c106740 0x7f944c106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.020+0000 7f94539ff700 1 --2- 172.21.15.59:0/289645800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f944c100730 0x7f944c100bb0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.020+0000 7f94539ff700 1 -- 172.21.15.59:0/289645800 >> 172.21.15.59:0/289645800 conn(0x7f944c0fc200 msgr2=0x7f944c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.020+0000 7f94539ff700 1 -- 172.21.15.59:0/289645800 shutdown_connections 2023-10-08T12:58:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.020+0000 7f94539ff700 1 -- 172.21.15.59:0/289645800 wait complete. 2023-10-08T12:58:54.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.021+0000 7f94539ff700 1 Processor -- start 2023-10-08T12:58:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.021+0000 7f94539ff700 1 -- start start 2023-10-08T12:58:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.021+0000 7f94539ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f944c100730 0x7f944c19ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.021+0000 7f94539ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f944c1010f0 0x7f944c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.021+0000 7f94539ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f944c106740 0x7f944c198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.021+0000 7f94539ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c199250 con 0x7f944c1010f0 2023-10-08T12:58:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.021+0000 7f94539ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c1993c0 con 0x7f944c106740 2023-10-08T12:58:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.021+0000 7f94539ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c199580 con 0x7f944c100730 2023-10-08T12:58:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f9451f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f944c106740 0x7f944c198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f9450f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f944c1010f0 0x7f944c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f9451f9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f944c106740 0x7f944c198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44158/0 (socket says 172.21.15.59:44158) 2023-10-08T12:58:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f9451f9c700 1 -- 172.21.15.59:0/3216514378 learned_addr learned my addr 172.21.15.59:0/3216514378 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f945179b700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f944c100730 0x7f944c19ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f9451f9c700 1 -- 172.21.15.59:0/3216514378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f944c100730 msgr2=0x7f944c19ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f9451f9c700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f944c100730 0x7f944c19ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f9451f9c700 1 -- 172.21.15.59:0/3216514378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f944c1010f0 msgr2=0x7f944c19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f9451f9c700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f944c1010f0 0x7f944c19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f9451f9c700 1 -- 172.21.15.59:0/3216514378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9444009c40 con 0x7f944c106740 2023-10-08T12:58:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f9451f9c700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f944c106740 0x7f944c198bf0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f944400c370 tx=0x7f944400c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.022+0000 7f94427fc700 1 -- 172.21.15.59:0/3216514378 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444017070 con 0x7f944c106740 2023-10-08T12:58:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.023+0000 7f94427fc700 1 -- 172.21.15.59:0/3216514378 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f944400f040 con 0x7f944c106740 2023-10-08T12:58:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.023+0000 7f94427fc700 1 -- 172.21.15.59:0/3216514378 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400e050 con 0x7f944c106740 2023-10-08T12:58:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.023+0000 7f94539ff700 1 -- 172.21.15.59:0/3216514378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9448009520 con 0x7f944c106740 2023-10-08T12:58:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.023+0000 7f94539ff700 1 -- 172.21.15.59:0/3216514378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0095f0 con 0x7f944c106740 2023-10-08T12:58:54.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.026+0000 7f94427fc700 1 -- 172.21.15.59:0/3216514378 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f944400cb60 con 0x7f944c106740 2023-10-08T12:58:54.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.027+0000 7f946736cb80 1 Processor -- start 2023-10-08T12:58:54.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.027+0000 7f946736cb80 1 -- start start 2023-10-08T12:58:54.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.027+0000 7f946736cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 0x55e7ed68b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f946736cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 0x55e7ed696110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f94427fc700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94380a15f0 0x7f94380a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f946736cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed696650 0x55e7ed698a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f946736cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed5f4460 con 0x55e7ed68b7a0 2023-10-08T12:58:54.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f946736cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed5e5c20 con 0x55e7ed68ae80 2023-10-08T12:58:54.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f946736cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed5e3540 con 0x55e7ed696650 2023-10-08T12:58:54.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f94427fc700 1 -- 172.21.15.59:0/3216514378 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f94440ccab0 con 0x7f944c106740 2023-10-08T12:58:54.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f945179b700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94380a15f0 0x7f94380a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f9450f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 0x55e7ed68b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f9450f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 0x55e7ed696110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f9450f9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 0x55e7ed696110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47120/0 (socket says 172.21.15.59:47120) 2023-10-08T12:58:54.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f9450f9a700 1 -- 172.21.15.59:0/3388475770 learned_addr learned my addr 172.21.15.59:0/3388475770 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:54.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.028+0000 7f9451f9c700 1 --2- 172.21.15.59:0/3388475770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed696650 0x55e7ed698a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.029+0000 7f9451f9c700 1 -- 172.21.15.59:0/3388475770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 msgr2=0x55e7ed68b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.029+0000 7f9451f9c700 1 --2- 172.21.15.59:0/3388475770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 0x55e7ed68b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.029+0000 7f9451f9c700 1 -- 172.21.15.59:0/3388475770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 msgr2=0x55e7ed696110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.029+0000 7f9451f9c700 1 --2- 172.21.15.59:0/3388475770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 0x55e7ed696110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.029+0000 7f9451f9c700 1 -- 172.21.15.59:0/3388475770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7ed409de0 con 0x55e7ed696650 2023-10-08T12:58:54.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.029+0000 7f9450f9a700 1 --2- 172.21.15.59:0/3388475770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 0x55e7ed696110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:54.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.029+0000 7f945179b700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94380a15f0 0x7f94380a3ab0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9448009d70 tx=0x7f9448009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.029+0000 7f9451f9c700 1 --2- 172.21.15.59:0/3388475770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed696650 0x55e7ed698a40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f94440ca1c0 tx=0x7f94440995c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e01705528e802b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.030+0000 7f94377fe700 1 -- 172.21.15.59:0/3388475770 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94440092e0 con 0x55e7ed696650 2023-10-08T12:58:54.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.030+0000 7f94377fe700 1 -- 172.21.15.59:0/3388475770 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f944409a180 con 0x55e7ed696650 2023-10-08T12:58:54.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.030+0000 7f94377fe700 1 -- 172.21.15.59:0/3388475770 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444003a00 con 0x55e7ed696650 2023-10-08T12:58:54.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.030+0000 7f946736cb80 1 -- 172.21.15.59:0/3388475770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed696650 msgr2=0x55e7ed698a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.030+0000 7f946736cb80 1 --2- 172.21.15.59:0/3388475770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed696650 0x55e7ed698a40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f94440ca1c0 tx=0x7f94440995c0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.031+0000 7f946736cb80 1 -- 172.21.15.59:0/3388475770 shutdown_connections 2023-10-08T12:58:54.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.031+0000 7f946736cb80 1 --2- 172.21.15.59:0/3388475770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 0x55e7ed68b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.031+0000 7f946736cb80 1 --2- 172.21.15.59:0/3388475770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed696650 0x55e7ed698a40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.031+0000 7f946736cb80 1 --2- 172.21.15.59:0/3388475770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 0x55e7ed696110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.031+0000 7f946736cb80 1 -- 172.21.15.59:0/3388475770 >> 172.21.15.59:0/3388475770 conn(0x55e7ed600260 msgr2=0x55e7ed6872d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.031+0000 7f946736cb80 1 -- 172.21.15.59:0/3388475770 shutdown_connections 2023-10-08T12:58:54.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.031+0000 7f946736cb80 1 -- 172.21.15.59:0/3388475770 wait complete. 2023-10-08T12:58:54.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.032+0000 7f946736cb80 1 -- start start 2023-10-08T12:58:54.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.032+0000 7f946736cb80 1 Processor -- start 2023-10-08T12:58:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f946736cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 0x55e7ed696070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f946736cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 0x55e7ed693360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f946736cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed696650 0x55e7ed693a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f946736cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed5dee30 con 0x55e7ed68b7a0 2023-10-08T12:58:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f946736cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed57b710 con 0x55e7ed696650 2023-10-08T12:58:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f946736cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed57b3b0 con 0x55e7ed68ae80 2023-10-08T12:58:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f946736cb80 10 client.0 _ll_register_callbacks cb 0x55e7ed3d8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f945179b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 0x55e7ed696070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f945179b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 0x55e7ed696070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58274/0 (socket says 172.21.15.59:58274) 2023-10-08T12:58:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f945179b700 1 -- 172.21.15.59:0/3450648607 learned_addr learned my addr 172.21.15.59:0/3450648607 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f9450f9a700 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 0x55e7ed693360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.033+0000 7f9451f9c700 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed696650 0x55e7ed693a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f945179b700 1 -- 172.21.15.59:0/3450648607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed696650 msgr2=0x55e7ed693a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f945179b700 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed696650 0x55e7ed693a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f945179b700 1 -- 172.21.15.59:0/3450648607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 msgr2=0x55e7ed693360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f945179b700 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 0x55e7ed693360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f945179b700 1 -- 172.21.15.59:0/3450648607 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c020040 con 0x55e7ed68ae80 2023-10-08T12:58:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f9451f9c700 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed696650 0x55e7ed693a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f9450f9a700 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 0x55e7ed693360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f945179b700 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 0x55e7ed696070 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f94480038b0 tx=0x7f94480047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd52f22babea5ab4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f9434ff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:58:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f9434ff9700 1 -- 172.21.15.59:0/3450648607 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944801e830 con 0x55e7ed68ae80 2023-10-08T12:58:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f946736cb80 1 -- 172.21.15.59:0/3450648607 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7ed5a6eb0 con 0x55e7ed68ae80 2023-10-08T12:58:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.034+0000 7f9434ff9700 1 -- 172.21.15.59:0/3450648607 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f944801e990 con 0x55e7ed68ae80 2023-10-08T12:58:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.035+0000 7f9434ff9700 1 -- 172.21.15.59:0/3450648607 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f944801eb50 con 0x55e7ed68ae80 2023-10-08T12:58:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.035+0000 7f946736cb80 10 client.27994 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.035+0000 7f946736cb80 1 -- 172.21.15.59:0/3450648607 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f943c0095f0 con 0x55e7ed68ae80 2023-10-08T12:58:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.035+0000 7f9434ff9700 1 -- 172.21.15.59:0/3450648607 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e7ed5a6eb0 con 0x55e7ed68ae80 2023-10-08T12:58:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.035+0000 7f9434ff9700 1 -- 172.21.15.59:0/3450648607 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9448024020 con 0x55e7ed68ae80 2023-10-08T12:58:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.035+0000 7f946736cb80 10 client.27994 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.035+0000 7f946736cb80 10 client.27994 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.035+0000 7f946736cb80 20 client.27994 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.035+0000 7f946736cb80 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7ed6a6120 0x55e7ed6a8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.035+0000 7f946736cb80 4 client.27994 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:58:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.035+0000 7f946736cb80 1 -- 172.21.15.59:0/3450648607 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7ed5d7e10 con 0x55e7ed6a6120 2023-10-08T12:58:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.036+0000 7f9450f9a700 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7ed6a6120 0x55e7ed6a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.036+0000 7f9450f9a700 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7ed6a6120 0x55e7ed6a8540 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfa55faa85c4fa34 server_cookie=aa9127e515627358 in_seq=0 out_seq=0 2023-10-08T12:58:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.036+0000 7f9434ff9700 10 client.27994 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.038+0000 7f9434ff9700 1 -- 172.21.15.59:0/3450648607 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e7ed5d7e10 con 0x55e7ed6a6120 2023-10-08T12:58:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.038+0000 7f9434ff9700 10 client.27994 handle_command_reply: tid=0 2023-10-08T12:58:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.038+0000 7f946736cb80 1 client.27994 shutdown 2023-10-08T12:58:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f946736cb80 1 -- 172.21.15.59:0/3450648607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 msgr2=0x55e7ed696070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f946736cb80 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 0x55e7ed696070 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f94480038b0 tx=0x7f94480047c0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f946736cb80 1 -- 172.21.15.59:0/3450648607 shutdown_connections 2023-10-08T12:58:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f946736cb80 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7ed6a6120 0x55e7ed6a8540 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f946736cb80 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed696650 0x55e7ed693a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f946736cb80 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 0x55e7ed696070 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f9434ff9700 0 client.27994 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f946736cb80 1 --2- 172.21.15.59:0/3450648607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed68b7a0 0x55e7ed693360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f946736cb80 1 -- 172.21.15.59:0/3450648607 >> 172.21.15.59:0/3450648607 conn(0x55e7ed600260 msgr2=0x55e7ed686ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f946736cb80 1 -- 172.21.15.59:0/3450648607 shutdown_connections 2023-10-08T12:58:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f946736cb80 1 -- 172.21.15.59:0/3450648607 wait complete. 2023-10-08T12:58:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.039+0000 7f946736cb80 20 client.27994 trim_cache size 0 max 16384 2023-10-08T12:58:54.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.057+0000 7f946736cb80 1 Processor -- start 2023-10-08T12:58:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.057+0000 7f946736cb80 1 -- start start 2023-10-08T12:58:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f946736cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 0x55e7ed68ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f946736cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68b7a0 0x55e7ed6a1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f946736cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed696650 0x55e7ed6a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f946736cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed45f920 con 0x55e7ed696650 2023-10-08T12:58:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f946736cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed68c0d0 con 0x55e7ed68b7a0 2023-10-08T12:58:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f946736cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed694310 con 0x55e7ed68ae80 2023-10-08T12:58:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f9450f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68b7a0 0x55e7ed6a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f945179b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 0x55e7ed68ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f9450f9a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68b7a0 0x55e7ed6a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44182/0 (socket says 172.21.15.59:44182) 2023-10-08T12:58:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f9450f9a700 1 -- 172.21.15.59:0/71378702 learned_addr learned my addr 172.21.15.59:0/71378702 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f9451f9c700 1 --2- 172.21.15.59:0/71378702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed696650 0x55e7ed6a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f9450f9a700 1 -- 172.21.15.59:0/71378702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 msgr2=0x55e7ed68ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f9450f9a700 1 --2- 172.21.15.59:0/71378702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 0x55e7ed68ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f9450f9a700 1 -- 172.21.15.59:0/71378702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed696650 msgr2=0x55e7ed6a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f9450f9a700 1 --2- 172.21.15.59:0/71378702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed696650 0x55e7ed6a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f9450f9a700 1 -- 172.21.15.59:0/71378702 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7ed3f2c60 con 0x55e7ed68b7a0 2023-10-08T12:58:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.058+0000 7f945179b700 1 --2- 172.21.15.59:0/71378702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 0x55e7ed68ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.059+0000 7f9450f9a700 1 --2- 172.21.15.59:0/71378702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68b7a0 0x55e7ed6a1890 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f943c006010 tx=0x7f943c005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da171fb8dfee46ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.059+0000 7f9437fff700 1 -- 172.21.15.59:0/71378702 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00bc50 con 0x55e7ed68b7a0 2023-10-08T12:58:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.059+0000 7f9437fff700 1 -- 172.21.15.59:0/71378702 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f943c01e040 con 0x55e7ed68b7a0 2023-10-08T12:58:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.059+0000 7f9437fff700 1 -- 172.21.15.59:0/71378702 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c004760 con 0x55e7ed68b7a0 2023-10-08T12:58:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.060+0000 7f946736cb80 1 -- 172.21.15.59:0/71378702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68b7a0 msgr2=0x55e7ed6a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.060+0000 7f946736cb80 1 --2- 172.21.15.59:0/71378702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68b7a0 0x55e7ed6a1890 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f943c006010 tx=0x7f943c005960 comp rx=0 tx=0).stop 2023-10-08T12:58:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.060+0000 7f946736cb80 1 -- 172.21.15.59:0/71378702 shutdown_connections 2023-10-08T12:58:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.060+0000 7f946736cb80 1 --2- 172.21.15.59:0/71378702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed696650 0x55e7ed6a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.060+0000 7f946736cb80 1 --2- 172.21.15.59:0/71378702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68ae80 0x55e7ed68ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.060+0000 7f946736cb80 1 --2- 172.21.15.59:0/71378702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68b7a0 0x55e7ed6a1890 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.060+0000 7f946736cb80 1 -- 172.21.15.59:0/71378702 >> 172.21.15.59:0/71378702 conn(0x55e7ed600260 msgr2=0x55e7ed691c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.060+0000 7f946736cb80 1 -- 172.21.15.59:0/71378702 shutdown_connections 2023-10-08T12:58:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.060+0000 7f946736cb80 1 -- 172.21.15.59:0/71378702 wait complete. 2023-10-08T12:58:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.060+0000 7f946736cb80 1 -- start start 2023-10-08T12:58:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.060+0000 7f946736cb80 1 Processor -- start 2023-10-08T12:58:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f946736cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 0x55e7ed69ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f946736cb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68b7a0 0x55e7ed69b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f946736cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed696650 0x55e7ed69ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f946736cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed69bfb0 con 0x55e7ed696650 2023-10-08T12:58:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f946736cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed69c120 con 0x55e7ed68ae80 2023-10-08T12:58:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f946736cb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ed69c2e0 con 0x55e7ed68b7a0 2023-10-08T12:58:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f946736cb80 10 client.0 _ll_register_callbacks cb 0x55e7ed3d8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f945179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 0x55e7ed69ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f945179b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 0x55e7ed69ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44190/0 (socket says 172.21.15.59:44190) 2023-10-08T12:58:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f945179b700 1 -- 172.21.15.59:0/1216592537 learned_addr learned my addr 172.21.15.59:0/1216592537 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f9451f9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed696650 0x55e7ed69ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f9450f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68b7a0 0x55e7ed69b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f945179b700 1 -- 172.21.15.59:0/1216592537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68b7a0 msgr2=0x55e7ed69b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.061+0000 7f945179b700 1 --2- 172.21.15.59:0/1216592537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68b7a0 0x55e7ed69b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.062+0000 7f945179b700 1 -- 172.21.15.59:0/1216592537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed696650 msgr2=0x55e7ed69ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.062+0000 7f945179b700 1 --2- 172.21.15.59:0/1216592537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed696650 0x55e7ed69ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.062+0000 7f945179b700 1 -- 172.21.15.59:0/1216592537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0095f0 con 0x55e7ed68ae80 2023-10-08T12:58:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.062+0000 7f945179b700 1 --2- 172.21.15.59:0/1216592537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 0x55e7ed69ce70 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f944802f3e0 tx=0x7f9448009f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53f4aa59f7e6a8bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.062+0000 7f9434ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.062+0000 7f9434ff9700 1 -- 172.21.15.59:0/1216592537 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448011ab0 con 0x55e7ed68ae80 2023-10-08T12:58:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.062+0000 7f9434ff9700 1 -- 172.21.15.59:0/1216592537 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f9448003ea0 con 0x55e7ed68ae80 2023-10-08T12:58:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.062+0000 7f946736cb80 1 -- 172.21.15.59:0/1216592537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f944409a180 con 0x55e7ed68ae80 2023-10-08T12:58:54.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.062+0000 7f9434ff9700 1 -- 172.21.15.59:0/1216592537 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f944801e630 con 0x55e7ed68ae80 2023-10-08T12:58:54.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.063+0000 7f946736cb80 10 client.28004 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.063+0000 7f946736cb80 1 -- 172.21.15.59:0/1216592537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f944c10df00 con 0x55e7ed68ae80 2023-10-08T12:58:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.063+0000 7f9434ff9700 1 -- 172.21.15.59:0/1216592537 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f944409a180 con 0x55e7ed68ae80 2023-10-08T12:58:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.063+0000 7f9434ff9700 1 -- 172.21.15.59:0/1216592537 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f94480038e0 con 0x55e7ed68ae80 2023-10-08T12:58:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.063+0000 7f946736cb80 10 client.28004 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.063+0000 7f946736cb80 10 client.28004 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.063+0000 7f946736cb80 20 client.28004 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.063+0000 7f946736cb80 1 --2- 172.21.15.59:0/1216592537 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7ed703af0 0x55e7ed705f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.063+0000 7f946736cb80 4 client.28004 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:58:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.063+0000 7f946736cb80 1 -- 172.21.15.59:0/1216592537 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e7ed5d7b30 con 0x55e7ed703af0 2023-10-08T12:58:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.063+0000 7f9450f9a700 1 --2- 172.21.15.59:0/1216592537 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7ed703af0 0x55e7ed705f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.064+0000 7f9450f9a700 1 --2- 172.21.15.59:0/1216592537 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7ed703af0 0x55e7ed705f10 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94d553b42f81f3f server_cookie=83b6309c4d8c33bd in_seq=0 out_seq=0 2023-10-08T12:58:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.064+0000 7f9434ff9700 10 client.28004 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f9434ff9700 1 -- 172.21.15.59:0/1216592537 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e7ed5d7b30 con 0x55e7ed703af0 2023-10-08T12:58:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f9434ff9700 10 client.28004 handle_command_reply: tid=0 2023-10-08T12:58:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f946736cb80 1 client.28004 shutdown 2023-10-08T12:58:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f946736cb80 1 -- 172.21.15.59:0/1216592537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 msgr2=0x55e7ed69ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f946736cb80 1 --2- 172.21.15.59:0/1216592537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 0x55e7ed69ce70 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f944802f3e0 tx=0x7f9448009f40 comp rx=0 tx=0).stop 2023-10-08T12:58:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f946736cb80 1 -- 172.21.15.59:0/1216592537 shutdown_connections 2023-10-08T12:58:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f946736cb80 1 --2- 172.21.15.59:0/1216592537 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55e7ed703af0 0x55e7ed705f10 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f946736cb80 1 --2- 172.21.15.59:0/1216592537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7ed68ae80 0x55e7ed69ce70 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f946736cb80 1 --2- 172.21.15.59:0/1216592537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7ed696650 0x55e7ed69ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f9434ff9700 0 client.28004 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f946736cb80 1 --2- 172.21.15.59:0/1216592537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7ed68b7a0 0x55e7ed69b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f946736cb80 1 -- 172.21.15.59:0/1216592537 >> 172.21.15.59:0/1216592537 conn(0x55e7ed600260 msgr2=0x55e7ed694c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f946736cb80 1 -- 172.21.15.59:0/1216592537 shutdown_connections 2023-10-08T12:58:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.066+0000 7f946736cb80 1 -- 172.21.15.59:0/1216592537 wait complete. 2023-10-08T12:58:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.067+0000 7f946736cb80 20 client.28004 trim_cache size 0 max 16384 2023-10-08T12:58:54.071 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:58:54.071 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:58:54.071 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:58:54.072 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:58:54.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 -- 172.21.15.59:0/3216514378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94380a15f0 msgr2=0x7f94380a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94380a15f0 0x7f94380a3ab0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9448009d70 tx=0x7f9448009260 comp rx=0 tx=0).stop 2023-10-08T12:58:54.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 -- 172.21.15.59:0/3216514378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f944c106740 msgr2=0x7f944c198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f944c106740 0x7f944c198bf0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f944400c370 tx=0x7f944400c680 comp rx=0 tx=0).stop 2023-10-08T12:58:54.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 -- 172.21.15.59:0/3216514378 shutdown_connections 2023-10-08T12:58:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f94380a15f0 0x7f94380a3ab0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f944c106740 0x7f944c198bf0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f944c100730 0x7f944c19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 --2- 172.21.15.59:0/3216514378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f944c1010f0 0x7f944c19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 -- 172.21.15.59:0/3216514378 >> 172.21.15.59:0/3216514378 conn(0x7f944c0fc200 msgr2=0x7f944c0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 -- 172.21.15.59:0/3216514378 shutdown_connections 2023-10-08T12:58:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.068+0000 7f94539ff700 1 -- 172.21.15.59:0/3216514378 wait complete. 2023-10-08T12:58:54.092 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:58:54.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:58:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.346+0000 7fe80cbff700 1 -- 172.21.15.59:0/3029140431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80810ce70 msgr2=0x7fe80810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.346+0000 7fe80cbff700 1 --2- 172.21.15.59:0/3029140431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80810ce70 0x7fe80810f2e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe800009f90 tx=0x7fe80000b330 comp rx=0 tx=0).stop 2023-10-08T12:58:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.346+0000 7fe80cbff700 1 -- 172.21.15.59:0/3029140431 shutdown_connections 2023-10-08T12:58:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.346+0000 7fe80cbff700 1 --2- 172.21.15.59:0/3029140431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe808072c20 0x7fe808073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.346+0000 7fe80cbff700 1 --2- 172.21.15.59:0/3029140431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80810ce70 0x7fe80810f2e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.346+0000 7fe80cbff700 1 --2- 172.21.15.59:0/3029140431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe808073540 0x7fe80810c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.346+0000 7fe80cbff700 1 -- 172.21.15.59:0/3029140431 >> 172.21.15.59:0/3029140431 conn(0x7fe8080fc140 msgr2=0x7fe8080fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.346+0000 7fe80cbff700 1 -- 172.21.15.59:0/3029140431 shutdown_connections 2023-10-08T12:58:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.346+0000 7fe80cbff700 1 -- 172.21.15.59:0/3029140431 wait complete. 2023-10-08T12:58:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.348+0000 7fe80cbff700 1 Processor -- start 2023-10-08T12:58:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.348+0000 7fe80cbff700 1 -- start start 2023-10-08T12:58:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.348+0000 7fe80cbff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe808072c20 0x7fe808198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.348+0000 7fe80cbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe808073540 0x7fe8081993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.348+0000 7fe80cbff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80810ce70 0x7fe80819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.348+0000 7fe80cbff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80819dda0 con 0x7fe80810ce70 2023-10-08T12:58:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.348+0000 7fe80cbff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80819df10 con 0x7fe808072c20 2023-10-08T12:58:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.348+0000 7fe80cbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80819e0d0 con 0x7fe808073540 2023-10-08T12:58:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe80659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe808072c20 0x7fe808198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe805d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe808073540 0x7fe8081993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe80659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe808072c20 0x7fe808198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44202/0 (socket says 172.21.15.59:44202) 2023-10-08T12:58:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe80659c700 1 -- 172.21.15.59:0/2828956513 learned_addr learned my addr 172.21.15.59:0/2828956513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe805d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe808073540 0x7fe8081993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58298/0 (socket says 172.21.15.59:58298) 2023-10-08T12:58:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe806d9d700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80810ce70 0x7fe80819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe80659c700 1 -- 172.21.15.59:0/2828956513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe808073540 msgr2=0x7fe8081993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe80659c700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe808073540 0x7fe8081993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe80659c700 1 -- 172.21.15.59:0/2828956513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80810ce70 msgr2=0x7fe80819d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe80659c700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80810ce70 0x7fe80819d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe80659c700 1 -- 172.21.15.59:0/2828956513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc009520 con 0x7fe808072c20 2023-10-08T12:58:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.349+0000 7fe80659c700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe808072c20 0x7fe808198e80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800e9c0 tx=0x7fe7f800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.350+0000 7fe7f77fe700 1 -- 172.21.15.59:0/2828956513 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8004a30 con 0x7fe808072c20 2023-10-08T12:58:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.350+0000 7fe80cbff700 1 -- 172.21.15.59:0/2828956513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe800009c40 con 0x7fe808072c20 2023-10-08T12:58:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.350+0000 7fe7f77fe700 1 -- 172.21.15.59:0/2828956513 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7f800cc80 con 0x7fe808072c20 2023-10-08T12:58:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.350+0000 7fe7f77fe700 1 -- 172.21.15.59:0/2828956513 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80054e0 con 0x7fe808072c20 2023-10-08T12:58:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.350+0000 7fe80cbff700 1 -- 172.21.15.59:0/2828956513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80819e5a0 con 0x7fe808072c20 2023-10-08T12:58:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.351+0000 7fe80cbff700 1 -- 172.21.15.59:0/2828956513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe808108080 con 0x7fe808072c20 2023-10-08T12:58:54.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.353+0000 7fe7f77fe700 1 -- 172.21.15.59:0/2828956513 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe7f8004b90 con 0x7fe808072c20 2023-10-08T12:58:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.355+0000 7fe7f77fe700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe7f00a1670 0x7fe7f00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.355+0000 7fe7f77fe700 1 -- 172.21.15.59:0/2828956513 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe7f8014070 con 0x7fe808072c20 2023-10-08T12:58:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.355+0000 7fe805d9b700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe7f00a1670 0x7fe7f00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.356+0000 7fe805d9b700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe7f00a1670 0x7fe7f00a3b30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe80819a3d0 tx=0x7fe7fc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.358+0000 7fe7f77fe700 1 -- 172.21.15.59:0/2828956513 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe7f8096480 con 0x7fe808072c20 2023-10-08T12:58:54.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:54 smithi173 ceph-mon[135182]: pgmap v867: 97 pgs: 97 active+clean; 956 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.1 MiB/s wr, 383 op/s 2023-10-08T12:58:54.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:54 smithi059 ceph-mon[98489]: pgmap v867: 97 pgs: 97 active+clean; 956 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.1 MiB/s wr, 383 op/s 2023-10-08T12:58:54.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:54 smithi092 ceph-mon[134093]: pgmap v867: 97 pgs: 97 active+clean; 956 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.1 MiB/s wr, 383 op/s 2023-10-08T12:58:54.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.691+0000 7fe80cbff700 1 -- 172.21.15.59:0/2828956513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe80819a180 con 0x7fe808072c20 2023-10-08T12:58:54.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.691+0000 7fe7f77fe700 1 -- 172.21.15.59:0/2828956513 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7fe7f8099aa0 con 0x7fe808072c20 2023-10-08T12:58:54.693 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:58:54.693 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:58:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 -- 172.21.15.59:0/2828956513 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe7f00a1670 msgr2=0x7fe7f00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe7f00a1670 0x7fe7f00a3b30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe80819a3d0 tx=0x7fe7fc009260 comp rx=0 tx=0).stop 2023-10-08T12:58:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 -- 172.21.15.59:0/2828956513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe808072c20 msgr2=0x7fe808198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe808072c20 0x7fe808198e80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800e9c0 tx=0x7fe7f800ecd0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 -- 172.21.15.59:0/2828956513 shutdown_connections 2023-10-08T12:58:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe7f00a1670 0x7fe7f00a3b30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe808072c20 0x7fe808198e80 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80810ce70 0x7fe80819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 --2- 172.21.15.59:0/2828956513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe808073540 0x7fe8081993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 -- 172.21.15.59:0/2828956513 >> 172.21.15.59:0/2828956513 conn(0x7fe8080fc140 msgr2=0x7fe8080fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 -- 172.21.15.59:0/2828956513 shutdown_connections 2023-10-08T12:58:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.694+0000 7fe80cbff700 1 -- 172.21.15.59:0/2828956513 wait complete. 2023-10-08T12:58:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:58:54.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:58:54.965 INFO:tasks.workunit.client.0.smithi059.stdout: 10 103137 20.52 MB/sec execute 145 sec latency 259.208 ms 2023-10-08T12:58:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.969+0000 7f4f78dff700 1 -- 172.21.15.59:0/3546304893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f741051c0 msgr2=0x7f4f74105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.969+0000 7f4f78dff700 1 --2- 172.21.15.59:0/3546304893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f741051c0 0x7f4f74105640 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009990 tx=0x7f4f64009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.969+0000 7f4f78dff700 1 -- 172.21.15.59:0/3546304893 shutdown_connections 2023-10-08T12:58:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.969+0000 7f4f78dff700 1 --2- 172.21.15.59:0/3546304893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f74105b80 0x7f4f7410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.969+0000 7f4f78dff700 1 --2- 172.21.15.59:0/3546304893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f74067ce0 0x7f4f740680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.969+0000 7f4f78dff700 1 --2- 172.21.15.59:0/3546304893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f741051c0 0x7f4f74105640 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.969+0000 7f4f78dff700 1 -- 172.21.15.59:0/3546304893 >> 172.21.15.59:0/3546304893 conn(0x7f4f74076780 msgr2=0x7f4f74076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.969+0000 7f4f78dff700 1 -- 172.21.15.59:0/3546304893 shutdown_connections 2023-10-08T12:58:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.969+0000 7f4f78dff700 1 -- 172.21.15.59:0/3546304893 wait complete. 2023-10-08T12:58:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.971+0000 7f4f78dff700 1 Processor -- start 2023-10-08T12:58:54.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.971+0000 7f4f78dff700 1 -- start start 2023-10-08T12:58:54.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.971+0000 7f4f78dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f74067ce0 0x7f4f740ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.971+0000 7f4f78dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f741051c0 0x7f4f740ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.971+0000 7f4f78dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f74105b80 0x7f4f74100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.971+0000 7f4f78dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f741a4fd0 con 0x7f4f74067ce0 2023-10-08T12:58:54.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.971+0000 7f4f78dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f741a5140 con 0x7f4f74105b80 2023-10-08T12:58:54.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.971+0000 7f4f78dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f741a5300 con 0x7f4f741051c0 2023-10-08T12:58:54.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.972+0000 7f4f71d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f741051c0 0x7f4f740ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.972+0000 7f4f71d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f741051c0 0x7f4f740ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58322/0 (socket says 172.21.15.59:58322) 2023-10-08T12:58:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.972+0000 7f4f71d9b700 1 -- 172.21.15.59:0/4172577920 learned_addr learned my addr 172.21.15.59:0/4172577920 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.972+0000 7f4f7259c700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f74067ce0 0x7f4f740ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.972+0000 7f4f72d9d700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f74105b80 0x7f4f74100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.972+0000 7f4f71d9b700 1 -- 172.21.15.59:0/4172577920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f74105b80 msgr2=0x7f4f74100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.972+0000 7f4f71d9b700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f74105b80 0x7f4f74100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.972+0000 7f4f71d9b700 1 -- 172.21.15.59:0/4172577920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f74067ce0 msgr2=0x7f4f740ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.972+0000 7f4f71d9b700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f74067ce0 0x7f4f740ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.972+0000 7f4f71d9b700 1 -- 172.21.15.59:0/4172577920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c009520 con 0x7f4f741051c0 2023-10-08T12:58:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.972+0000 7f4f72d9d700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f74105b80 0x7f4f74100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:54.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.973+0000 7f4f71d9b700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f741051c0 0x7f4f740ffbf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4f64005910 tx=0x7f4f64004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.973+0000 7f4f6b7fe700 1 -- 172.21.15.59:0/4172577920 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6401d070 con 0x7f4f741051c0 2023-10-08T12:58:54.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.973+0000 7f4f6b7fe700 1 -- 172.21.15.59:0/4172577920 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f64022470 con 0x7f4f741051c0 2023-10-08T12:58:54.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.973+0000 7f4f78dff700 1 -- 172.21.15.59:0/4172577920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f640095f0 con 0x7f4f741051c0 2023-10-08T12:58:54.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.974+0000 7f4f6b7fe700 1 -- 172.21.15.59:0/4172577920 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64017650 con 0x7f4f741051c0 2023-10-08T12:58:54.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.974+0000 7f4f78dff700 1 -- 172.21.15.59:0/4172577920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f741a5870 con 0x7f4f741051c0 2023-10-08T12:58:54.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.979+0000 7f4f6b7fe700 1 -- 172.21.15.59:0/4172577920 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f4f640225e0 con 0x7f4f741051c0 2023-10-08T12:58:54.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.979+0000 7f4f8c707b80 1 Processor -- start 2023-10-08T12:58:54.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.980+0000 7f4f8c707b80 1 -- start start 2023-10-08T12:58:54.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.981+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a1e80 0x556f136a2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.981+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136ad110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.981+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136ad650 0x556f136afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.981+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f1360b460 con 0x556f136a27a0 2023-10-08T12:58:54.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.981+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f135fcc20 con 0x556f136a1e80 2023-10-08T12:58:54.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.981+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f135fa540 con 0x556f136ad650 2023-10-08T12:58:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.981+0000 7f4f72d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a1e80 0x556f136a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.981+0000 7f4f72d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a1e80 0x556f136a2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44230/0 (socket says 172.21.15.59:44230) 2023-10-08T12:58:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.981+0000 7f4f72d9d700 1 -- 172.21.15.59:0/2377713024 learned_addr learned my addr 172.21.15.59:0/2377713024 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.981+0000 7f4f7259c700 1 --2- 172.21.15.59:0/2377713024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.982+0000 7f4f72d9d700 1 -- 172.21.15.59:0/2377713024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136ad650 msgr2=0x556f136afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.982+0000 7f4f71d9b700 1 --2- 172.21.15.59:0/2377713024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136ad650 0x556f136afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.982+0000 7f4f72d9d700 1 --2- 172.21.15.59:0/2377713024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136ad650 0x556f136afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.982+0000 7f4f72d9d700 1 -- 172.21.15.59:0/2377713024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 msgr2=0x556f136ad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.982+0000 7f4f72d9d700 1 --2- 172.21.15.59:0/2377713024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136ad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.982+0000 7f4f72d9d700 1 -- 172.21.15.59:0/2377713024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f13420de0 con 0x556f136a1e80 2023-10-08T12:58:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.982+0000 7f4f7259c700 1 --2- 172.21.15.59:0/2377713024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.982+0000 7f4f6b7fe700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f600a1670 0x7f4f600a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.982+0000 7f4f72d9d700 1 --2- 172.21.15.59:0/2377713024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a1e80 0x556f136a2260 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c003ee0 tx=0x7f4f6c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71bb10a8999ac71c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.982+0000 7f4f6b7fe700 1 -- 172.21.15.59:0/4172577920 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4f640ce260 con 0x7f4f741051c0 2023-10-08T12:58:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.983+0000 7f4f68ff9700 1 -- 172.21.15.59:0/2377713024 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c004900 con 0x556f136a1e80 2023-10-08T12:58:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.983+0000 7f4f68ff9700 1 -- 172.21.15.59:0/2377713024 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f6c00f040 con 0x556f136a1e80 2023-10-08T12:58:54.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.983+0000 7f4f68ff9700 1 -- 172.21.15.59:0/2377713024 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00e870 con 0x556f136a1e80 2023-10-08T12:58:54.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.983+0000 7f4f7259c700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f600a1670 0x7f4f600a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.984+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2377713024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a1e80 msgr2=0x556f136a2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.984+0000 7f4f7259c700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f600a1670 0x7f4f600a3b30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009fd0 tx=0x7f4f5c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.984+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2377713024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a1e80 0x556f136a2260 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c003ee0 tx=0x7f4f6c009920 comp rx=0 tx=0).stop 2023-10-08T12:58:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.984+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2377713024 shutdown_connections 2023-10-08T12:58:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.984+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2377713024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a1e80 0x556f136a2260 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.984+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2377713024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136ad650 0x556f136afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.984+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2377713024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.984+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2377713024 >> 172.21.15.59:0/2377713024 conn(0x556f13617260 msgr2=0x556f1369e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.984+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2377713024 shutdown_connections 2023-10-08T12:58:54.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.984+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2377713024 wait complete. 2023-10-08T12:58:54.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.985+0000 7f4f8c707b80 1 -- start start 2023-10-08T12:58:54.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.985+0000 7f4f8c707b80 1 Processor -- start 2023-10-08T12:58:54.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136ad030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a27a0 0x556f136aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136ad650 0x556f136aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f135f5e30 con 0x556f136ad650 2023-10-08T12:58:54.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f13592710 con 0x556f136a27a0 2023-10-08T12:58:54.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f135923b0 con 0x556f136a1e80 2023-10-08T12:58:54.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f8c707b80 10 client.0 _ll_register_callbacks cb 0x556f133ef800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:54.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f71d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a27a0 0x556f136aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f71d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a27a0 0x556f136aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44238/0 (socket says 172.21.15.59:44238) 2023-10-08T12:58:54.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f71d9b700 1 -- 172.21.15.59:0/2738445873 learned_addr learned my addr 172.21.15.59:0/2738445873 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:54.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f72d9d700 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136ad650 0x556f136aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.986+0000 7f4f7259c700 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f71d9b700 1 -- 172.21.15.59:0/2738445873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 msgr2=0x556f136ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f71d9b700 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f71d9b700 1 -- 172.21.15.59:0/2738445873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136ad650 msgr2=0x556f136aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:54.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f71d9b700 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136ad650 0x556f136aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f71d9b700 1 -- 172.21.15.59:0/2738445873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c003b90 con 0x556f136a27a0 2023-10-08T12:58:54.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f71d9b700 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a27a0 0x556f136aa370 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4f64000c00 tx=0x7f4f64097790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74a8d3281d1677b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:54.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2738445873 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6409ac80 con 0x556f136a27a0 2023-10-08T12:58:54.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2738445873 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4f6409ba20 con 0x556f136a27a0 2023-10-08T12:58:54.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2738445873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f135bdeb0 con 0x556f136a27a0 2023-10-08T12:58:54.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2738445873 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f6409b320 con 0x556f136a27a0 2023-10-08T12:58:54.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f8c707b80 10 client.28022 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:54.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.987+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2738445873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x556f13409c60 con 0x556f136a27a0 2023-10-08T12:58:54.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.988+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2738445873 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f640b7020 con 0x556f136a27a0 2023-10-08T12:58:54.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.988+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2738445873 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f640a3190 con 0x556f136a27a0 2023-10-08T12:58:54.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.988+0000 7f4f8c707b80 10 client.28022 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:54.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.988+0000 7f4f8c707b80 10 client.28022 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:54.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.988+0000 7f4f8c707b80 20 client.28022 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:54.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.988+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556f136c5690 0x556f136c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.988+0000 7f4f8c707b80 4 client.28022 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:58:54.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.988+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2738445873 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f135eee10 con 0x556f136c5690 2023-10-08T12:58:54.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.988+0000 7f4f7259c700 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556f136c5690 0x556f136c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.989+0000 7f4f7259c700 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556f136c5690 0x556f136c7ab0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f2f88cf16c18530 server_cookie=91fa27e2b4bad040 in_seq=0 out_seq=0 2023-10-08T12:58:54.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.989+0000 7f4f59ffb700 10 client.28022 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:54.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2738445873 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556f135eee10 con 0x556f136c5690 2023-10-08T12:58:54.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f59ffb700 10 client.28022 handle_command_reply: tid=0 2023-10-08T12:58:54.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f8c707b80 1 client.28022 shutdown 2023-10-08T12:58:54.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2738445873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a27a0 msgr2=0x556f136aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a27a0 0x556f136aa370 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4f64000c00 tx=0x7f4f64097790 comp rx=0 tx=0).stop 2023-10-08T12:58:54.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2738445873 shutdown_connections 2023-10-08T12:58:54.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556f136c5690 0x556f136c7ab0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136ad650 0x556f136aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2738445873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136a27a0 0x556f136aa370 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f59ffb700 0 client.28022 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:54.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2738445873 >> 172.21.15.59:0/2738445873 conn(0x556f13617260 msgr2=0x556f1369dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2738445873 shutdown_connections 2023-10-08T12:58:54.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.991+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2738445873 wait complete. 2023-10-08T12:58:54.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:54.992+0000 7f4f8c707b80 20 client.28022 trim_cache size 0 max 16384 2023-10-08T12:58:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.008+0000 7f4f8c707b80 1 Processor -- start 2023-10-08T12:58:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.008+0000 7f4f8c707b80 1 -- start start 2023-10-08T12:58:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.008+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.008+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.008+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 0x556f136aa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.008+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f13476920 con 0x556f136a27a0 2023-10-08T12:58:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.008+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f135eee10 con 0x556f136ad650 2023-10-08T12:58:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.008+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f136ab2e0 con 0x556f136a1e80 2023-10-08T12:58:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f71d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:55.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f7259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:55.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f71d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47194/0 (socket says 172.21.15.59:47194) 2023-10-08T12:58:55.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f7259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58344/0 (socket says 172.21.15.59:58344) 2023-10-08T12:58:55.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f71d9b700 1 -- 172.21.15.59:0/2929946326 learned_addr learned my addr 172.21.15.59:0/2929946326 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:55.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f72d9d700 1 --2- 172.21.15.59:0/2929946326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 0x556f136aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:55.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f7259c700 1 -- 172.21.15.59:0/2929946326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 msgr2=0x556f136aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:55.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f7259c700 1 --2- 172.21.15.59:0/2929946326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 0x556f136aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f7259c700 1 -- 172.21.15.59:0/2929946326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 msgr2=0x556f136aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f7259c700 1 --2- 172.21.15.59:0/2929946326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f7259c700 1 -- 172.21.15.59:0/2929946326 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f136cc6e0 con 0x556f136a1e80 2023-10-08T12:58:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.009+0000 7f4f7259c700 1 --2- 172.21.15.59:0/2929946326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136b41e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x556f136c8360 tx=0x7f4f5c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=606aed99167fa45f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.010+0000 7f4f697fa700 1 -- 172.21.15.59:0/2929946326 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c022040 con 0x556f136a1e80 2023-10-08T12:58:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.010+0000 7f4f697fa700 1 -- 172.21.15.59:0/2929946326 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f5c0044e0 con 0x556f136a1e80 2023-10-08T12:58:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.010+0000 7f4f697fa700 1 -- 172.21.15.59:0/2929946326 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c017070 con 0x556f136a1e80 2023-10-08T12:58:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.011+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2929946326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 msgr2=0x556f136b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.011+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2929946326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136b41e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x556f136c8360 tx=0x7f4f5c017000 comp rx=0 tx=0).stop 2023-10-08T12:58:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.011+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2929946326 shutdown_connections 2023-10-08T12:58:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.011+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2929946326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 0x556f136aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.011+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2929946326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136b41e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.011+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2929946326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.011+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2929946326 >> 172.21.15.59:0/2929946326 conn(0x556f13617260 msgr2=0x556f136a56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.011+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2929946326 shutdown_connections 2023-10-08T12:58:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.011+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2929946326 wait complete. 2023-10-08T12:58:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.011+0000 7f4f8c707b80 1 -- start start 2023-10-08T12:58:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.011+0000 7f4f8c707b80 1 Processor -- start 2023-10-08T12:58:55.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:55.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:55.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f8c707b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 0x556f136b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:55.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f13719510 con 0x556f136a27a0 2023-10-08T12:58:55.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f13719680 con 0x556f136ad650 2023-10-08T12:58:55.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f8c707b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f13719840 con 0x556f136a1e80 2023-10-08T12:58:55.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f8c707b80 10 client.0 _ll_register_callbacks cb 0x7f4f64005c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:55.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f72d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 0x556f136b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:55.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f7259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:55.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f72d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 0x556f136b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44248/0 (socket says 172.21.15.59:44248) 2023-10-08T12:58:55.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f72d9d700 1 -- 172.21.15.59:0/2491453018 learned_addr learned my addr 172.21.15.59:0/2491453018 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:55.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f71d9b700 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:55.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f72d9d700 1 -- 172.21.15.59:0/2491453018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 msgr2=0x556f136b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:55.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.012+0000 7f4f72d9d700 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f72d9d700 1 -- 172.21.15.59:0/2491453018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 msgr2=0x556f136b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:55.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f72d9d700 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f72d9d700 1 -- 172.21.15.59:0/2491453018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c012d60 con 0x556f136ad650 2023-10-08T12:58:55.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f7259c700 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:55.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f72d9d700 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 0x556f136b3570 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c003ee0 tx=0x7f4f6c008f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d97841136629892 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:55.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2491453018 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c023070 con 0x556f136ad650 2023-10-08T12:58:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2491453018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f6c00f040 con 0x556f136ad650 2023-10-08T12:58:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2491453018 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4f6c007500 con 0x556f136ad650 2023-10-08T12:58:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2491453018 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f6c0076c0 con 0x556f136ad650 2023-10-08T12:58:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f8c707b80 10 client.28028 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.013+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2491453018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x556f13447250 con 0x556f136ad650 2023-10-08T12:58:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.014+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2491453018 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f6c035020 con 0x556f136ad650 2023-10-08T12:58:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.014+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2491453018 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f6c00eb70 con 0x556f136ad650 2023-10-08T12:58:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.014+0000 7f4f8c707b80 10 client.28028 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.014+0000 7f4f8c707b80 10 client.28028 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.014+0000 7f4f8c707b80 20 client.28028 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.014+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556f1371b010 0x556f1371d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.014+0000 7f4f8c707b80 4 client.28028 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:58:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.014+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2491453018 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556f135eeb30 con 0x556f1371b010 2023-10-08T12:58:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.014+0000 7f4f7259c700 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556f1371b010 0x556f1371d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.015+0000 7f4f59ffb700 10 client.28028 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.015+0000 7f4f7259c700 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556f1371b010 0x556f1371d430 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aa19a41c4a8752d server_cookie=c39170a174b08c47 in_seq=0 out_seq=0 2023-10-08T12:58:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f59ffb700 1 -- 172.21.15.59:0/2491453018 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556f135eeb30 con 0x556f1371b010 2023-10-08T12:58:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f59ffb700 10 client.28028 handle_command_reply: tid=0 2023-10-08T12:58:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f8c707b80 1 client.28028 shutdown 2023-10-08T12:58:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2491453018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 msgr2=0x556f136b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 0x556f136b3570 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c003ee0 tx=0x7f4f6c008f40 comp rx=0 tx=0).stop 2023-10-08T12:58:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2491453018 shutdown_connections 2023-10-08T12:58:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556f1371b010 0x556f1371d430 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f136ad650 0x556f136b3570 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f136a1e80 0x556f136b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f8c707b80 1 --2- 172.21.15.59:0/2491453018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f136a27a0 0x556f136b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2491453018 >> 172.21.15.59:0/2491453018 conn(0x556f13617260 msgr2=0x556f136a8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.017+0000 7f4f59ffb700 0 client.28028 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.018+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2491453018 shutdown_connections 2023-10-08T12:58:55.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.018+0000 7f4f8c707b80 1 -- 172.21.15.59:0/2491453018 wait complete. 2023-10-08T12:58:55.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.018+0000 7f4f8c707b80 20 client.28028 trim_cache size 0 max 16384 2023-10-08T12:58:55.023 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:58:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.018+0000 7f4f78dff700 1 -- 172.21.15.59:0/4172577920 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f600a1670 msgr2=0x7f4f600a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.018+0000 7f4f78dff700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f600a1670 0x7f4f600a3b30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009fd0 tx=0x7f4f5c009260 comp rx=0 tx=0).stop 2023-10-08T12:58:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.018+0000 7f4f78dff700 1 -- 172.21.15.59:0/4172577920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f741051c0 msgr2=0x7f4f740ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.018+0000 7f4f78dff700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f741051c0 0x7f4f740ffbf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4f64005910 tx=0x7f4f64004730 comp rx=0 tx=0).stop 2023-10-08T12:58:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.019+0000 7f4f78dff700 1 -- 172.21.15.59:0/4172577920 shutdown_connections 2023-10-08T12:58:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.019+0000 7f4f78dff700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4f600a1670 0x7f4f600a3b30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.019+0000 7f4f78dff700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f74105b80 0x7f4f74100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.019+0000 7f4f78dff700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f74067ce0 0x7f4f740ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.019+0000 7f4f78dff700 1 --2- 172.21.15.59:0/4172577920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f741051c0 0x7f4f740ffbf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.019+0000 7f4f78dff700 1 -- 172.21.15.59:0/4172577920 >> 172.21.15.59:0/4172577920 conn(0x7f4f74076780 msgr2=0x7f4f740fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.019+0000 7f4f78dff700 1 -- 172.21.15.59:0/4172577920 shutdown_connections 2023-10-08T12:58:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:55.019+0000 7f4f78dff700 1 -- 172.21.15.59:0/4172577920 wait complete. 2023-10-08T12:58:55.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:55 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2828956513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:58:55.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:55 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2828956513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:58:55.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:55 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2828956513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:58:55.966 INFO:tasks.workunit.client.0.smithi059.stdout: 10 103733 20.59 MB/sec execute 146 sec latency 153.281 ms 2023-10-08T12:58:56.042 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:58:56.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:58:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.274+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2392805913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec641051c0 msgr2=0x7fec64105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.274+0000 7fec6c3ff700 1 --2- 172.21.15.59:0/2392805913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec641051c0 0x7fec64105640 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fec54009990 tx=0x7fec54009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.274+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2392805913 shutdown_connections 2023-10-08T12:58:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.274+0000 7fec6c3ff700 1 --2- 172.21.15.59:0/2392805913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec64105b80 0x7fec6410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.274+0000 7fec6c3ff700 1 --2- 172.21.15.59:0/2392805913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec64067ce0 0x7fec640680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.274+0000 7fec6c3ff700 1 --2- 172.21.15.59:0/2392805913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec641051c0 0x7fec64105640 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.274+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2392805913 >> 172.21.15.59:0/2392805913 conn(0x7fec64076780 msgr2=0x7fec64076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.274+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2392805913 shutdown_connections 2023-10-08T12:58:56.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.274+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2392805913 wait complete. 2023-10-08T12:58:56.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.275+0000 7fec6c3ff700 1 Processor -- start 2023-10-08T12:58:56.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.275+0000 7fec6c3ff700 1 -- start start 2023-10-08T12:58:56.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.275+0000 7fec6c3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec64067ce0 0x7fec640ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6c3ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec641051c0 0x7fec640ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6c3ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec64105b80 0x7fec64100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6c3ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec641a4f80 con 0x7fec641051c0 2023-10-08T12:58:56.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6c3ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec641a50f0 con 0x7fec64105b80 2023-10-08T12:58:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6c3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec641a52b0 con 0x7fec64067ce0 2023-10-08T12:58:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6a99c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec64105b80 0x7fec64100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6a19b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec64067ce0 0x7fec640ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6a99c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec64105b80 0x7fec64100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44270/0 (socket says 172.21.15.59:44270) 2023-10-08T12:58:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6a99c700 1 -- 172.21.15.59:0/2865197640 learned_addr learned my addr 172.21.15.59:0/2865197640 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6999a700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec641051c0 0x7fec640ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6a99c700 1 -- 172.21.15.59:0/2865197640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec64067ce0 msgr2=0x7fec640ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6a99c700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec64067ce0 0x7fec640ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6a99c700 1 -- 172.21.15.59:0/2865197640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec641051c0 msgr2=0x7fec640ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6a99c700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec641051c0 0x7fec640ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6a99c700 1 -- 172.21.15.59:0/2865197640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec540095f0 con 0x7fec64105b80 2023-10-08T12:58:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.276+0000 7fec6999a700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec641051c0 0x7fec640ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:58:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.277+0000 7fec6a99c700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec64105b80 0x7fec64100130 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00ef30 tx=0x7fec5c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.277+0000 7fec5b7fe700 1 -- 172.21.15.59:0/2865197640 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c018070 con 0x7fec64105b80 2023-10-08T12:58:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.277+0000 7fec5b7fe700 1 -- 172.21.15.59:0/2865197640 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec5c00f040 con 0x7fec64105b80 2023-10-08T12:58:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.277+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2865197640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec641a5530 con 0x7fec64105b80 2023-10-08T12:58:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.277+0000 7fec5b7fe700 1 -- 172.21.15.59:0/2865197640 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c00cdb0 con 0x7fec64105b80 2023-10-08T12:58:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.277+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2865197640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec641a59f0 con 0x7fec64105b80 2023-10-08T12:58:56.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.280+0000 7fec5b7fe700 1 -- 172.21.15.59:0/2865197640 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fec5c003a00 con 0x7fec64105b80 2023-10-08T12:58:56.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.283+0000 7fec7fdf4b80 1 Processor -- start 2023-10-08T12:58:56.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.283+0000 7fec7fdf4b80 1 -- start start 2023-10-08T12:58:56.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.283+0000 7fec5b7fe700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fec500a15f0 0x7fec500a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.283+0000 7fec5b7fe700 1 -- 172.21.15.59:0/2865197640 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fec5c0cccb0 con 0x7fec64105b80 2023-10-08T12:58:56.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.283+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x5563323482e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.283+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332348820 0x556332353190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.283+0000 7fec6999a700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fec500a15f0 0x7fec500a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.283+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563323536d0 0x556332355ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.283+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563322b14e0 con 0x5563323536d0 2023-10-08T12:58:56.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.283+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563322a2ca0 con 0x556332347f00 2023-10-08T12:58:56.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.283+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563322a05c0 con 0x556332348820 2023-10-08T12:58:56.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6a19b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x5563323482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6a19b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x5563323482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44272/0 (socket says 172.21.15.59:44272) 2023-10-08T12:58:56.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6a19b700 1 -- 172.21.15.59:0/280407885 learned_addr learned my addr 172.21.15.59:0/280407885 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:56.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6a99c700 1 --2- 172.21.15.59:0/280407885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563323536d0 0x556332355ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6a19b700 1 -- 172.21.15.59:0/280407885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332348820 msgr2=0x556332353190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6a19b700 1 --2- 172.21.15.59:0/280407885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332348820 0x556332353190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6a19b700 1 -- 172.21.15.59:0/280407885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563323536d0 msgr2=0x556332355ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6a19b700 1 --2- 172.21.15.59:0/280407885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563323536d0 0x556332355ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6a19b700 1 -- 172.21.15.59:0/280407885 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563320c6e60 con 0x556332347f00 2023-10-08T12:58:56.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6a99c700 1 --2- 172.21.15.59:0/280407885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563323536d0 0x556332355ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:56.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6a19b700 1 --2- 172.21.15.59:0/280407885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x5563323482e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fec60009db0 tx=0x7fec60011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8effd4fd3ff3665b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.284+0000 7fec6999a700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fec500a15f0 0x7fec500a3ab0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fec54000c00 tx=0x7fec5400b610 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.285+0000 7fec58bfe700 1 -- 172.21.15.59:0/280407885 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60004230 con 0x556332347f00 2023-10-08T12:58:56.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.285+0000 7fec58bfe700 1 -- 172.21.15.59:0/280407885 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec60004390 con 0x556332347f00 2023-10-08T12:58:56.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.285+0000 7fec58bfe700 1 -- 172.21.15.59:0/280407885 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60019820 con 0x556332347f00 2023-10-08T12:58:56.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.285+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/280407885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 msgr2=0x5563323482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.285+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/280407885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x5563323482e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fec60009db0 tx=0x7fec60011720 comp rx=0 tx=0).stop 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.285+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/280407885 shutdown_connections 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.285+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/280407885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x5563323482e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.285+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/280407885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563323536d0 0x556332355ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.285+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/280407885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332348820 0x556332353190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.285+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/280407885 >> 172.21.15.59:0/280407885 conn(0x5563322bd2e0 msgr2=0x556332344350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.286+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/280407885 shutdown_connections 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.286+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/280407885 wait complete. 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.286+0000 7fec7fdf4b80 1 -- start start 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.286+0000 7fec7fdf4b80 1 Processor -- start 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x556332353040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556332348820 0x556332350330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5563323536d0 0x556332350960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55633229beb0 con 0x556332348820 2023-10-08T12:58:56.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556332238790 con 0x556332347f00 2023-10-08T12:58:56.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556332238430 con 0x5563323536d0 2023-10-08T12:58:56.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec7fdf4b80 10 client.0 _ll_register_callbacks cb 0x556332095880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:56.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec6a19b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x556332353040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec6999a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556332348820 0x556332350330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec6a19b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x556332353040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44280/0 (socket says 172.21.15.59:44280) 2023-10-08T12:58:56.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec6a19b700 1 -- 172.21.15.59:0/3201908706 learned_addr learned my addr 172.21.15.59:0/3201908706 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:56.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.287+0000 7fec6a99c700 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5563323536d0 0x556332350960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.288+0000 7fec6a19b700 1 -- 172.21.15.59:0/3201908706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5563323536d0 msgr2=0x556332350960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.288+0000 7fec6a19b700 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5563323536d0 0x556332350960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.288+0000 7fec6a19b700 1 -- 172.21.15.59:0/3201908706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556332348820 msgr2=0x556332350330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.288+0000 7fec6a19b700 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556332348820 0x556332350330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.288+0000 7fec6a19b700 1 -- 172.21.15.59:0/3201908706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec600099e0 con 0x556332347f00 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.288+0000 7fec6a99c700 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5563323536d0 0x556332350960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.288+0000 7fec6a19b700 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x556332353040 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fec60003f90 tx=0x7fec600038b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35d89ef769f75493 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.288+0000 7fec4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.288+0000 7fec4dffb700 1 -- 172.21.15.59:0/3201908706 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60005450 con 0x556332347f00 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.288+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/3201908706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556332263f30 con 0x556332347f00 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.288+0000 7fec4dffb700 1 -- 172.21.15.59:0/3201908706 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fec60005ce0 con 0x556332347f00 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec4dffb700 1 -- 172.21.15.59:0/3201908706 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec60003b50 con 0x556332347f00 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec7fdf4b80 10 client.28040 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:56.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/3201908706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5563320afce0 con 0x556332347f00 2023-10-08T12:58:56.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec4dffb700 1 -- 172.21.15.59:0/3201908706 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556332263f30 con 0x556332347f00 2023-10-08T12:58:56.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec4dffb700 1 -- 172.21.15.59:0/3201908706 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fec60021040 con 0x556332347f00 2023-10-08T12:58:56.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec7fdf4b80 10 client.28040 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:56.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec7fdf4b80 10 client.28040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:56.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec7fdf4b80 20 client.28040 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:56.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5563323630c0 0x5563323654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec7fdf4b80 4 client.28040 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:58:56.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/3201908706 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556332294e90 con 0x5563323630c0 2023-10-08T12:58:56.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.289+0000 7fec6999a700 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5563323630c0 0x5563323654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.290+0000 7fec6999a700 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5563323630c0 0x5563323654e0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae481e0d483c585d server_cookie=b971f3ee6ac659da in_seq=0 out_seq=0 2023-10-08T12:58:56.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.290+0000 7fec4dffb700 10 client.28040 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:56.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec4dffb700 1 -- 172.21.15.59:0/3201908706 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556332294e90 con 0x5563323630c0 2023-10-08T12:58:56.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec4dffb700 10 client.28040 handle_command_reply: tid=0 2023-10-08T12:58:56.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec7fdf4b80 1 client.28040 shutdown 2023-10-08T12:58:56.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/3201908706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 msgr2=0x556332353040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x556332353040 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fec60003f90 tx=0x7fec600038b0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/3201908706 shutdown_connections 2023-10-08T12:58:56.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5563323630c0 0x5563323654e0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332347f00 0x556332353040 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5563323536d0 0x556332350960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/3201908706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556332348820 0x556332350330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec4dffb700 0 client.28040 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:56.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.291+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/3201908706 >> 172.21.15.59:0/3201908706 conn(0x5563322bd2e0 msgr2=0x556332343f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.292+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/3201908706 shutdown_connections 2023-10-08T12:58:56.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.292+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/3201908706 wait complete. 2023-10-08T12:58:56.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.292+0000 7fec7fdf4b80 20 client.28040 trim_cache size 0 max 16384 2023-10-08T12:58:56.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.312+0000 7fec7fdf4b80 1 Processor -- start 2023-10-08T12:58:56.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.312+0000 7fec7fdf4b80 1 -- start start 2023-10-08T12:58:56.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 0x55633234ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556332348820 0x55633235f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563323536d0 0x55633234d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55633211c9a0 con 0x556332348820 2023-10-08T12:58:56.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556332349180 con 0x5563323536d0 2023-10-08T12:58:56.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55633233e670 con 0x556332347f00 2023-10-08T12:58:56.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec6a19b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 0x55633234ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec6a19b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 0x55633234ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58402/0 (socket says 172.21.15.59:58402) 2023-10-08T12:58:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec6a19b700 1 -- 172.21.15.59:0/792309922 learned_addr learned my addr 172.21.15.59:0/792309922 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec6a99c700 1 --2- 172.21.15.59:0/792309922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563323536d0 0x55633234d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec6999a700 1 --2- 172.21.15.59:0/792309922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556332348820 0x55633235f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.313+0000 7fec6a19b700 1 -- 172.21.15.59:0/792309922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563323536d0 msgr2=0x55633234d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.314+0000 7fec6a19b700 1 --2- 172.21.15.59:0/792309922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563323536d0 0x55633234d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.314+0000 7fec6a19b700 1 -- 172.21.15.59:0/792309922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556332348820 msgr2=0x55633235f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.314+0000 7fec6a19b700 1 --2- 172.21.15.59:0/792309922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556332348820 0x55633235f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.314+0000 7fec6a19b700 1 -- 172.21.15.59:0/792309922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563320ed2d0 con 0x556332347f00 2023-10-08T12:58:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.314+0000 7fec6a99c700 1 --2- 172.21.15.59:0/792309922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563323536d0 0x55633234d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.314+0000 7fec6999a700 1 --2- 172.21.15.59:0/792309922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556332348820 0x55633235f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:56.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.314+0000 7fec6a19b700 1 --2- 172.21.15.59:0/792309922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 0x55633234ae30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fec60001eb0 tx=0x7fec600058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e5cdb9dcb39b678 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.314+0000 7fec593ff700 1 -- 172.21.15.59:0/792309922 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60023820 con 0x556332347f00 2023-10-08T12:58:56.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.314+0000 7fec593ff700 1 -- 172.21.15.59:0/792309922 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec60005c20 con 0x556332347f00 2023-10-08T12:58:56.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.314+0000 7fec593ff700 1 -- 172.21.15.59:0/792309922 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60005580 con 0x556332347f00 2023-10-08T12:58:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.315+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/792309922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 msgr2=0x55633234ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.315+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/792309922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 0x55633234ae30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fec60001eb0 tx=0x7fec600058e0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.315+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/792309922 shutdown_connections 2023-10-08T12:58:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.315+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/792309922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563323536d0 0x55633234d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.315+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/792309922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 0x55633234ae30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.315+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/792309922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556332348820 0x55633235f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.315+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/792309922 >> 172.21.15.59:0/792309922 conn(0x5563322bd2e0 msgr2=0x55633235e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.315+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/792309922 shutdown_connections 2023-10-08T12:58:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.315+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/792309922 wait complete. 2023-10-08T12:58:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.316+0000 7fec7fdf4b80 1 -- start start 2023-10-08T12:58:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.316+0000 7fec7fdf4b80 1 Processor -- start 2023-10-08T12:58:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.316+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 0x556332358ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332348820 0x5563323590e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec7fdf4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563323536d0 0x556332359620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563323b6fe0 con 0x5563323536d0 2023-10-08T12:58:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563323b7120 con 0x556332348820 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec7fdf4b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563323b72e0 con 0x556332347f00 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec7fdf4b80 10 client.0 _ll_register_callbacks cb 0x7fec60009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec6999a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332348820 0x5563323590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec6999a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332348820 0x5563323590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44292/0 (socket says 172.21.15.59:44292) 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec6999a700 1 -- 172.21.15.59:0/2867059097 learned_addr learned my addr 172.21.15.59:0/2867059097 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec6a19b700 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 0x556332358ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec6a99c700 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563323536d0 0x556332359620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec6999a700 1 -- 172.21.15.59:0/2867059097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 msgr2=0x556332358ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec6999a700 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 0x556332358ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec6999a700 1 -- 172.21.15.59:0/2867059097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563323536d0 msgr2=0x556332359620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec6999a700 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563323536d0 0x556332359620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec6999a700 1 -- 172.21.15.59:0/2867059097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6410dec0 con 0x556332348820 2023-10-08T12:58:56.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.317+0000 7fec6a19b700 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 0x556332358ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:56.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.318+0000 7fec6999a700 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332348820 0x5563323590e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fec54009990 tx=0x7fec54009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e839e0d6bee626b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.318+0000 7fec4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:56.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.318+0000 7fec4dffb700 1 -- 172.21.15.59:0/2867059097 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5402e040 con 0x556332348820 2023-10-08T12:58:56.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.318+0000 7fec4dffb700 1 -- 172.21.15.59:0/2867059097 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fec54030ce0 con 0x556332348820 2023-10-08T12:58:56.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.318+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/2867059097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec60004390 con 0x556332348820 2023-10-08T12:58:56.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.318+0000 7fec4dffb700 1 -- 172.21.15.59:0/2867059097 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec5401e040 con 0x556332348820 2023-10-08T12:58:56.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.318+0000 7fec7fdf4b80 10 client.28046 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:56.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.318+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/2867059097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fec641a59f0 con 0x556332348820 2023-10-08T12:58:56.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.318+0000 7fec4dffb700 1 -- 172.21.15.59:0/2867059097 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec60004390 con 0x556332348820 2023-10-08T12:58:56.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.319+0000 7fec4dffb700 1 -- 172.21.15.59:0/2867059097 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fec54004670 con 0x556332348820 2023-10-08T12:58:56.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.319+0000 7fec7fdf4b80 10 client.28046 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:56.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.319+0000 7fec7fdf4b80 10 client.28046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:56.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.319+0000 7fec7fdf4b80 20 client.28046 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:56.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.319+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5563323b8bc0 0x5563323bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.319+0000 7fec7fdf4b80 4 client.28046 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:58:56.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.319+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/2867059097 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556332294bb0 con 0x5563323b8bc0 2023-10-08T12:58:56.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.319+0000 7fec6a19b700 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5563323b8bc0 0x5563323bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.319+0000 7fec6a19b700 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5563323b8bc0 0x5563323bafe0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac3fb1cbe26786d8 server_cookie=5ff7c8d8896882c4 in_seq=0 out_seq=0 2023-10-08T12:58:56.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.320+0000 7fec4dffb700 10 client.28046 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:56.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec4dffb700 1 -- 172.21.15.59:0/2867059097 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556332294bb0 con 0x5563323b8bc0 2023-10-08T12:58:56.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec4dffb700 10 client.28046 handle_command_reply: tid=0 2023-10-08T12:58:56.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec7fdf4b80 1 client.28046 shutdown 2023-10-08T12:58:56.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/2867059097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332348820 msgr2=0x5563323590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332348820 0x5563323590e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fec54009990 tx=0x7fec54009310 comp rx=0 tx=0).stop 2023-10-08T12:58:56.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/2867059097 shutdown_connections 2023-10-08T12:58:56.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5563323b8bc0 0x5563323bafe0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563323536d0 0x556332359620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556332347f00 0x556332358ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec7fdf4b80 1 --2- 172.21.15.59:0/2867059097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556332348820 0x5563323590e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec4dffb700 0 client.28046 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:56.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.329+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/2867059097 >> 172.21.15.59:0/2867059097 conn(0x5563322bd2e0 msgr2=0x55633235f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.330+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/2867059097 shutdown_connections 2023-10-08T12:58:56.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.330+0000 7fec7fdf4b80 1 -- 172.21.15.59:0/2867059097 wait complete. 2023-10-08T12:58:56.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.330+0000 7fec7fdf4b80 20 client.28046 trim_cache size 0 max 16384 2023-10-08T12:58:56.332 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:58:56.332 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:58:56.332 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "a3165806-0cc5-423a-b086-e5e175d7ce65", 2023-10-08T12:58:56.333 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:58:56.333 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:58:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.330+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2865197640 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fec500a15f0 msgr2=0x7fec500a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.330+0000 7fec6c3ff700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fec500a15f0 0x7fec500a3ab0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fec54000c00 tx=0x7fec5400b610 comp rx=0 tx=0).stop 2023-10-08T12:58:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.330+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2865197640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec64105b80 msgr2=0x7fec64100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.330+0000 7fec6c3ff700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec64105b80 0x7fec64100130 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00ef30 tx=0x7fec5c00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.331+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2865197640 shutdown_connections 2023-10-08T12:58:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.331+0000 7fec6c3ff700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fec500a15f0 0x7fec500a3ab0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.331+0000 7fec6c3ff700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec64105b80 0x7fec64100130 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.331+0000 7fec6c3ff700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec64067ce0 0x7fec640ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.331+0000 7fec6c3ff700 1 --2- 172.21.15.59:0/2865197640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec641051c0 0x7fec640ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.331+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2865197640 >> 172.21.15.59:0/2865197640 conn(0x7fec64076780 msgr2=0x7fec640fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.331+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2865197640 shutdown_connections 2023-10-08T12:58:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.331+0000 7fec6c3ff700 1 -- 172.21.15.59:0/2865197640 wait complete. 2023-10-08T12:58:56.351 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:58:56.417 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:56 smithi059 ceph-mon[98489]: pgmap v868: 97 pgs: 97 active+clean; 945 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.7 MiB/s wr, 324 op/s 2023-10-08T12:58:56.417 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:56.417 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.417 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.417 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.418 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:56 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:56 smithi173 ceph-mon[135182]: pgmap v868: 97 pgs: 97 active+clean; 945 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.7 MiB/s wr, 324 op/s 2023-10-08T12:58:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:56 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.582+0000 7f4fce9ff700 1 -- 172.21.15.59:0/3147347133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc81010f0 msgr2=0x7f4fc810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.582+0000 7f4fce9ff700 1 --2- 172.21.15.59:0/3147347133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc81010f0 0x7f4fc810d600 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000b0a0 tx=0x7f4fc000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.582+0000 7f4fce9ff700 1 -- 172.21.15.59:0/3147347133 shutdown_connections 2023-10-08T12:58:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.582+0000 7f4fce9ff700 1 --2- 172.21.15.59:0/3147347133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc81010f0 0x7f4fc810d600 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.582+0000 7f4fce9ff700 1 --2- 172.21.15.59:0/3147347133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc8106740 0x7f4fc8106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.582+0000 7f4fce9ff700 1 --2- 172.21.15.59:0/3147347133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc8100730 0x7f4fc8100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.582+0000 7f4fce9ff700 1 -- 172.21.15.59:0/3147347133 >> 172.21.15.59:0/3147347133 conn(0x7f4fc80fc200 msgr2=0x7f4fc80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.583+0000 7f4fce9ff700 1 -- 172.21.15.59:0/3147347133 shutdown_connections 2023-10-08T12:58:56.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.583+0000 7f4fce9ff700 1 -- 172.21.15.59:0/3147347133 wait complete. 2023-10-08T12:58:56.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.584+0000 7f4fce9ff700 1 Processor -- start 2023-10-08T12:58:56.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.584+0000 7f4fce9ff700 1 -- start start 2023-10-08T12:58:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.584+0000 7f4fce9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc8100730 0x7f4fc819ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.584+0000 7f4fce9ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81010f0 0x7f4fc819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.584+0000 7f4fce9ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc8106740 0x7f4fc8198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.584+0000 7f4fce9ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc81991e0 con 0x7f4fc81010f0 2023-10-08T12:58:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.584+0000 7f4fce9ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8199350 con 0x7f4fc8106740 2023-10-08T12:58:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.584+0000 7f4fce9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8199510 con 0x7f4fc8100730 2023-10-08T12:58:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.585+0000 7f4fc7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc8100730 0x7f4fc819ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.585+0000 7f4fc7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc8100730 0x7f4fc819ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58428/0 (socket says 172.21.15.59:58428) 2023-10-08T12:58:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.585+0000 7f4fc7fff700 1 -- 172.21.15.59:0/2102103996 learned_addr learned my addr 172.21.15.59:0/2102103996 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.585+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81010f0 0x7f4fc819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.585+0000 7f4fccf9c700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc8106740 0x7f4fc8198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.585+0000 7f4fc7fff700 1 -- 172.21.15.59:0/2102103996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc8106740 msgr2=0x7f4fc8198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.585+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc8106740 0x7f4fc8198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.585+0000 7f4fc7fff700 1 -- 172.21.15.59:0/2102103996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81010f0 msgr2=0x7f4fc819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.585+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81010f0 0x7f4fc819ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.585+0000 7f4fc7fff700 1 -- 172.21.15.59:0/2102103996 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0009d00 con 0x7f4fc8100730 2023-10-08T12:58:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.585+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc8100730 0x7f4fc819ea50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800e9a0 tx=0x7f4fb800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.586+0000 7f4fc57fa700 1 -- 172.21.15.59:0/2102103996 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8009790 con 0x7f4fc8100730 2023-10-08T12:58:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.586+0000 7f4fc57fa700 1 -- 172.21.15.59:0/2102103996 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fb8010430 con 0x7f4fc8100730 2023-10-08T12:58:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.586+0000 7f4fce9ff700 1 -- 172.21.15.59:0/2102103996 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc81997f0 con 0x7f4fc8100730 2023-10-08T12:58:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.586+0000 7f4fc57fa700 1 -- 172.21.15.59:0/2102103996 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8018680 con 0x7f4fc8100730 2023-10-08T12:58:56.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.586+0000 7f4fce9ff700 1 -- 172.21.15.59:0/2102103996 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc81a5a40 con 0x7f4fc8100730 2023-10-08T12:58:56.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.590+0000 7f4fc57fa700 1 -- 172.21.15.59:0/2102103996 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f4fb80105a0 con 0x7f4fc8100730 2023-10-08T12:58:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.590+0000 7f4fe23c3b80 1 Processor -- start 2023-10-08T12:58:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fe23c3b80 1 -- start start 2023-10-08T12:58:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f14260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 0x55ee34f1f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f1f650 0x55ee34f21a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34e7d460 con 0x55ee34f13e80 2023-10-08T12:58:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34e6ec20 con 0x55ee34f1f650 2023-10-08T12:58:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34e6c540 con 0x55ee34f147a0 2023-10-08T12:58:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fc7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 0x55ee34f1f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fccf9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f14260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fccf9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f14260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47272/0 (socket says 172.21.15.59:47272) 2023-10-08T12:58:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fccf9c700 1 -- 172.21.15.59:0/2533685870 learned_addr learned my addr 172.21.15.59:0/2533685870 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.591+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/2533685870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f1f650 0x55ee34f21a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.592+0000 7f4fc57fa700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4fb00a1670 0x7f4fb00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.592+0000 7f4fc77fe700 1 -- 172.21.15.59:0/2533685870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 msgr2=0x55ee34f1f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.592+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/2533685870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 0x55ee34f1f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.592+0000 7f4fc77fe700 1 -- 172.21.15.59:0/2533685870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 msgr2=0x55ee34f14260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.592+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/2533685870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f14260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.592+0000 7f4fc77fe700 1 -- 172.21.15.59:0/2533685870 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee34c92de0 con 0x55ee34f1f650 2023-10-08T12:58:56.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.592+0000 7f4fc57fa700 1 -- 172.21.15.59:0/2102103996 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4fb8014070 con 0x7f4fc8100730 2023-10-08T12:58:56.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.592+0000 7f4fccf9c700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4fb00a1670 0x7f4fb00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.592+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/2533685870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f1f650 0x55ee34f21a40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009cb0 tx=0x7f4fbc011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37adce7508e4493b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.592+0000 7f4fae7fc700 1 -- 172.21.15.59:0/2533685870 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc011d20 con 0x55ee34f1f650 2023-10-08T12:58:56.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.593+0000 7f4fae7fc700 1 -- 172.21.15.59:0/2533685870 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fbc011e80 con 0x55ee34f1f650 2023-10-08T12:58:56.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.593+0000 7f4fae7fc700 1 -- 172.21.15.59:0/2533685870 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc005240 con 0x55ee34f1f650 2023-10-08T12:58:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.593+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/2533685870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f1f650 msgr2=0x55ee34f21a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.593+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/2533685870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f1f650 0x55ee34f21a40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009cb0 tx=0x7f4fbc011440 comp rx=0 tx=0).stop 2023-10-08T12:58:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.593+0000 7f4fccf9c700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4fb00a1670 0x7f4fb00a3b30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000b0a0 tx=0x7f4fc00099e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.594+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/2533685870 shutdown_connections 2023-10-08T12:58:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.594+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/2533685870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f1f650 0x55ee34f21a40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.594+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/2533685870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f14260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.594+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/2533685870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 0x55ee34f1f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.594+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/2533685870 >> 172.21.15.59:0/2533685870 conn(0x55ee34e89260 msgr2=0x55ee34f102d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.594+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/2533685870 shutdown_connections 2023-10-08T12:58:56.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.594+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/2533685870 wait complete. 2023-10-08T12:58:56.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.594+0000 7f4fe23c3b80 1 -- start start 2023-10-08T12:58:56.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.595+0000 7f4fe23c3b80 1 Processor -- start 2023-10-08T12:58:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.595+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f13e80 0x55ee34f1efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.595+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f147a0 0x55ee34f1c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.595+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f1f650 0x55ee34f1c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.595+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34e67e30 con 0x55ee34f147a0 2023-10-08T12:58:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.595+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34e04710 con 0x55ee34f13e80 2023-10-08T12:58:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.595+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34e043b0 con 0x55ee34f1f650 2023-10-08T12:58:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fe23c3b80 10 client.0 _ll_register_callbacks cb 0x55ee34c61800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fc7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f13e80 0x55ee34f1efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fc7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f13e80 0x55ee34f1efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44322/0 (socket says 172.21.15.59:44322) 2023-10-08T12:58:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fc7fff700 1 -- 172.21.15.59:0/4027685278 learned_addr learned my addr 172.21.15.59:0/4027685278 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f147a0 0x55ee34f1c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fc7fff700 1 -- 172.21.15.59:0/4027685278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f1f650 msgr2=0x55ee34f1c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f1f650 0x55ee34f1c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fc7fff700 1 -- 172.21.15.59:0/4027685278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f147a0 msgr2=0x55ee34f1c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f147a0 0x55ee34f1c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fc7fff700 1 -- 172.21.15.59:0/4027685278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc0098e0 con 0x55ee34f13e80 2023-10-08T12:58:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f13e80 0x55ee34f1efb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009230 tx=0x7f4fb80cae80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=739255d1ca39037f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fa77fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4027685278 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb809a610 con 0x55ee34f13e80 2023-10-08T12:58:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4027685278 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4fb809a8b0 con 0x55ee34f13e80 2023-10-08T12:58:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.596+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4027685278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee34e60e10 con 0x55ee34f13e80 2023-10-08T12:58:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.597+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4027685278 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fb809a1b0 con 0x55ee34f13e80 2023-10-08T12:58:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.597+0000 7f4fe23c3b80 10 client.28058 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:56.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.597+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4027685278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55ee34c7bc60 con 0x55ee34f13e80 2023-10-08T12:58:56.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.597+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4027685278 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee34e60e10 con 0x55ee34f13e80 2023-10-08T12:58:56.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.597+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4027685278 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4fb80997c0 con 0x55ee34f13e80 2023-10-08T12:58:56.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.597+0000 7f4fe23c3b80 10 client.28058 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:56.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.597+0000 7f4fe23c3b80 10 client.28058 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:56.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.597+0000 7f4fe23c3b80 20 client.28058 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:56.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.597+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ee34f2f180 0x55ee34f31570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.597+0000 7f4fe23c3b80 4 client.28058 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:58:56.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.597+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4027685278 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee34e60b30 con 0x55ee34f2f180 2023-10-08T12:58:56.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.598+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ee34f2f180 0x55ee34f31570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.598+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ee34f2f180 0x55ee34f31570 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39778a8a4873a9c8 server_cookie=910cf21c0da4b06c in_seq=0 out_seq=0 2023-10-08T12:58:56.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.598+0000 7f4fa77fe700 10 client.28058 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:56.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4027685278 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ee34e60b30 con 0x55ee34f2f180 2023-10-08T12:58:56.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fa77fe700 10 client.28058 handle_command_reply: tid=0 2023-10-08T12:58:56.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 1 client.28058 shutdown 2023-10-08T12:58:56.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4027685278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f13e80 msgr2=0x55ee34f1efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f13e80 0x55ee34f1efb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009230 tx=0x7f4fb80cae80 comp rx=0 tx=0).stop 2023-10-08T12:58:56.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4027685278 shutdown_connections 2023-10-08T12:58:56.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ee34f2f180 0x55ee34f31570 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f13e80 0x55ee34f1efb0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f1f650 0x55ee34f1c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4027685278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f147a0 0x55ee34f1c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fa77fe700 0 client.28058 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:56.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4027685278 >> 172.21.15.59:0/4027685278 conn(0x55ee34e89260 msgr2=0x55ee34f0fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4027685278 shutdown_connections 2023-10-08T12:58:56.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4027685278 wait complete. 2023-10-08T12:58:56.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.603+0000 7f4fe23c3b80 20 client.28058 trim_cache size 0 max 16384 2023-10-08T12:58:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.623+0000 7f4fe23c3b80 1 Processor -- start 2023-10-08T12:58:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.623+0000 7f4fe23c3b80 1 -- start start 2023-10-08T12:58:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.623+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f261a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.623+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 0x55ee34f1b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.623+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f1f650 0x55ee34f17570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.623+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34ce8920 con 0x55ee34f13e80 2023-10-08T12:58:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.623+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34f10f90 con 0x55ee34f1f650 2023-10-08T12:58:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34f31570 con 0x55ee34f147a0 2023-10-08T12:58:56.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fc77fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 0x55ee34f1b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fc7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f261a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fc77fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 0x55ee34f1b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:58468/0 (socket says 172.21.15.59:58468) 2023-10-08T12:58:56.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fc77fe700 1 -- 172.21.15.59:0/1823862465 learned_addr learned my addr 172.21.15.59:0/1823862465 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:56.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fccf9c700 1 --2- 172.21.15.59:0/1823862465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f1f650 0x55ee34f17570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:56 smithi092 ceph-mon[134093]: pgmap v868: 97 pgs: 97 active+clean; 945 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.7 MiB/s wr, 324 op/s 2023-10-08T12:58:56.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:56.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:56 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:56.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fc7fff700 1 -- 172.21.15.59:0/1823862465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 msgr2=0x55ee34f1b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/1823862465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 0x55ee34f1b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fc7fff700 1 -- 172.21.15.59:0/1823862465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f1f650 msgr2=0x55ee34f17570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/1823862465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f1f650 0x55ee34f17570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fc7fff700 1 -- 172.21.15.59:0/1823862465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee34cb9250 con 0x55ee34f13e80 2023-10-08T12:58:56.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/1823862465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 0x55ee34f1b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:56.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.624+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/1823862465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f261a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8096c20 tx=0x7f4fb80cd2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b3362a32887d51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.625+0000 7f4faeffd700 1 -- 172.21.15.59:0/1823862465 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb809a610 con 0x55ee34f13e80 2023-10-08T12:58:56.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.625+0000 7f4faeffd700 1 -- 172.21.15.59:0/1823862465 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fb809a8b0 con 0x55ee34f13e80 2023-10-08T12:58:56.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.625+0000 7f4faeffd700 1 -- 172.21.15.59:0/1823862465 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8099900 con 0x55ee34f13e80 2023-10-08T12:58:56.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.625+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/1823862465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 msgr2=0x55ee34f261a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.625+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/1823862465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f261a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8096c20 tx=0x7f4fb80cd2b0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.625+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/1823862465 shutdown_connections 2023-10-08T12:58:56.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.625+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/1823862465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f1f650 0x55ee34f17570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.625+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/1823862465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f261a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.625+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/1823862465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f147a0 0x55ee34f1b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.625+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/1823862465 >> 172.21.15.59:0/1823862465 conn(0x55ee34e89260 msgr2=0x55ee34f0bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.626+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/1823862465 shutdown_connections 2023-10-08T12:58:56.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.626+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/1823862465 wait complete. 2023-10-08T12:58:56.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.626+0000 7f4fe23c3b80 1 -- start start 2023-10-08T12:58:56.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.626+0000 7f4fe23c3b80 1 Processor -- start 2023-10-08T12:58:56.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f26130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f147a0 0x55ee34f225a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fe23c3b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f1f650 0x55ee34f22ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34f231f0 con 0x55ee34f13e80 2023-10-08T12:58:56.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34f23360 con 0x55ee34f147a0 2023-10-08T12:58:56.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fe23c3b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee34f82fa0 con 0x55ee34f1f650 2023-10-08T12:58:56.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fe23c3b80 10 client.0 _ll_register_callbacks cb 0x7f4fb80d0780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:56.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fc77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f147a0 0x55ee34f225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fc7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f26130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fc77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f147a0 0x55ee34f225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44336/0 (socket says 172.21.15.59:44336) 2023-10-08T12:58:56.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fccf9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f1f650 0x55ee34f22ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fc77fe700 1 -- 172.21.15.59:0/4235096698 learned_addr learned my addr 172.21.15.59:0/4235096698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:58:56.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fc77fe700 1 -- 172.21.15.59:0/4235096698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f1f650 msgr2=0x55ee34f22ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f1f650 0x55ee34f22ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fc77fe700 1 -- 172.21.15.59:0/4235096698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 msgr2=0x55ee34f26130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:56.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.627+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f26130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.628+0000 7f4fc77fe700 1 -- 172.21.15.59:0/4235096698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc01d040 con 0x55ee34f147a0 2023-10-08T12:58:56.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.628+0000 7f4fccf9c700 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f1f650 0x55ee34f22ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:56.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.628+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f26130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:56.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.628+0000 7f4fc77fe700 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f147a0 0x55ee34f225a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009cb0 tx=0x7f4fbc012b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c8bdb3351991652 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.628+0000 7f4fa77fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:58:56.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.628+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4235096698 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc012d50 con 0x55ee34f147a0 2023-10-08T12:58:56.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.628+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4235096698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee34e2feb0 con 0x55ee34f147a0 2023-10-08T12:58:56.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.628+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4235096698 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4fbc028ab0 con 0x55ee34f147a0 2023-10-08T12:58:56.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.629+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4235096698 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fbc012eb0 con 0x55ee34f147a0 2023-10-08T12:58:56.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.629+0000 7f4fe23c3b80 10 client.28064 fetch_fsmap learned FSMap version 20 2023-10-08T12:58:56.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.629+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4235096698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55ee34c7bc60 con 0x55ee34f147a0 2023-10-08T12:58:56.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.629+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4235096698 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee34e2feb0 con 0x55ee34f147a0 2023-10-08T12:58:56.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.630+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4235096698 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4fbc004400 con 0x55ee34f147a0 2023-10-08T12:58:56.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.630+0000 7f4fe23c3b80 10 client.28064 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:58:56.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.630+0000 7f4fe23c3b80 10 client.28064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:56.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.630+0000 7f4fe23c3b80 20 client.28064 populate_metadata read hostname 'smithi059' 2023-10-08T12:58:56.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.630+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ee34f84720 0x55ee34f86b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.630+0000 7f4fe23c3b80 4 client.28064 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:58:56.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.630+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4235096698 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ee34cb3f70 con 0x55ee34f84720 2023-10-08T12:58:56.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.630+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ee34f84720 0x55ee34f86b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.630+0000 7f4fc7fff700 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ee34f84720 0x55ee34f86b40 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2416bc82110c3c7 server_cookie=f8c4c0a61778734b in_seq=0 out_seq=0 2023-10-08T12:58:56.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.630+0000 7f4fa77fe700 10 client.28064 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:56.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fa77fe700 1 -- 172.21.15.59:0/4235096698 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55ee34cb3f70 con 0x55ee34f84720 2023-10-08T12:58:56.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fa77fe700 10 client.28064 handle_command_reply: tid=0 2023-10-08T12:58:56.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fe23c3b80 1 client.28064 shutdown 2023-10-08T12:58:56.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4235096698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f147a0 msgr2=0x55ee34f225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f147a0 0x55ee34f225a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009cb0 tx=0x7f4fbc012b30 comp rx=0 tx=0).stop 2023-10-08T12:58:56.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4235096698 shutdown_connections 2023-10-08T12:58:56.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55ee34f84720 0x55ee34f86b40 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee34f1f650 0x55ee34f22ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee34f13e80 0x55ee34f26130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fa77fe700 0 client.28064 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:58:56.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fe23c3b80 1 --2- 172.21.15.59:0/4235096698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee34f147a0 0x55ee34f225a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.635+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4235096698 >> 172.21.15.59:0/4235096698 conn(0x55ee34e89260 msgr2=0x55ee34f17570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.636+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4235096698 shutdown_connections 2023-10-08T12:58:56.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.636+0000 7f4fe23c3b80 1 -- 172.21.15.59:0/4235096698 wait complete. 2023-10-08T12:58:56.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.636+0000 7f4fe23c3b80 20 client.28064 trim_cache size 0 max 16384 2023-10-08T12:58:56.639 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:58:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "scrub active (645 inodes in the stack)", 2023-10-08T12:58:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:58:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "a3165806-0cc5-423a-b086-e5e175d7ce65": { 2023-10-08T12:58:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:58:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "a3165806-0cc5-423a-b086-e5e175d7ce65", 2023-10-08T12:58:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:58:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:58:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:58:56.640 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:58:56.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.636+0000 7f4fce9ff700 1 -- 172.21.15.59:0/2102103996 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4fb00a1670 msgr2=0x7f4fb00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.636+0000 7f4fce9ff700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4fb00a1670 0x7f4fb00a3b30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000b0a0 tx=0x7f4fc00099e0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.636+0000 7f4fce9ff700 1 -- 172.21.15.59:0/2102103996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc8100730 msgr2=0x7f4fc819ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.636+0000 7f4fce9ff700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc8100730 0x7f4fc819ea50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800e9a0 tx=0x7f4fb800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.636+0000 7f4fce9ff700 1 -- 172.21.15.59:0/2102103996 shutdown_connections 2023-10-08T12:58:56.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.636+0000 7f4fce9ff700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4fb00a1670 0x7f4fb00a3b30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.637+0000 7f4fce9ff700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc8106740 0x7f4fc8198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.637+0000 7f4fce9ff700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc8100730 0x7f4fc819ea50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.637+0000 7f4fce9ff700 1 --2- 172.21.15.59:0/2102103996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81010f0 0x7f4fc819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.637+0000 7f4fce9ff700 1 -- 172.21.15.59:0/2102103996 >> 172.21.15.59:0/2102103996 conn(0x7f4fc80fc200 msgr2=0x7f4fc8072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.637+0000 7f4fce9ff700 1 -- 172.21.15.59:0/2102103996 shutdown_connections 2023-10-08T12:58:56.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:58:56.637+0000 7f4fce9ff700 1 -- 172.21.15.59:0/2102103996 wait complete. 2023-10-08T12:58:56.657 INFO:tasks.cephfs.filesystem:scrub status for tag:a3165806-0cc5-423a-b086-e5e175d7ce65 - {'path': '/', 'tag': 'a3165806-0cc5-423a-b086-e5e175d7ce65', 'options': 'recursive,force'} 2023-10-08T12:58:56.966 INFO:tasks.workunit.client.0.smithi059.stdout: 10 104115 20.57 MB/sec execute 147 sec latency 310.739 ms 2023-10-08T12:58:57.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi173 to 196.2M 2023-10-08T12:58:57.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: Unable to set osd_memory_target on smithi173 to 205771776: error parsing value: Value '205771776' is below minimum 939524096 2023-10-08T12:58:57.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-08T12:58:57.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-08T12:58:57.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:58:57.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:57.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:58:57.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:57.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:57.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:58:57.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi173 to 196.2M 2023-10-08T12:58:57.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: Unable to set osd_memory_target on smithi173 to 205771776: error parsing value: Value '205771776' is below minimum 939524096 2023-10-08T12:58:57.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-08T12:58:57.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-08T12:58:57.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:58:57.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:57.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:58:57.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:57.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:57.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:58:57.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi173 to 196.2M 2023-10-08T12:58:57.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: Unable to set osd_memory_target on smithi173 to 205771776: error parsing value: Value '205771776' is below minimum 939524096 2023-10-08T12:58:57.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi092 to 196.2M 2023-10-08T12:58:57.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: Unable to set osd_memory_target on smithi092 to 205766041: error parsing value: Value '205766041' is below minimum 939524096 2023-10-08T12:58:57.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:58:57.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:57.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:58:57.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:57.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:57.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:57.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:58:57.966 INFO:tasks.workunit.client.0.smithi059.stdout: 10 104457 20.56 MB/sec execute 148 sec latency 350.949 ms 2023-10-08T12:58:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:58 smithi173 ceph-mon[135182]: Adjusting osd_memory_target on smithi059 to 222.0M 2023-10-08T12:58:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:58 smithi173 ceph-mon[135182]: Unable to set osd_memory_target on smithi059 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-08T12:58:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:58 smithi173 ceph-mon[135182]: pgmap v869: 97 pgs: 97 active+clean; 930 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 342 op/s 2023-10-08T12:58:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:58 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:58.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:58:58 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:58:58.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:58 smithi059 ceph-mon[98489]: Adjusting osd_memory_target on smithi059 to 222.0M 2023-10-08T12:58:58.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:58 smithi059 ceph-mon[98489]: Unable to set osd_memory_target on smithi059 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-08T12:58:58.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:58 smithi059 ceph-mon[98489]: pgmap v869: 97 pgs: 97 active+clean; 930 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 342 op/s 2023-10-08T12:58:58.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:58 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:58.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:58:58 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:58:58.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:58 smithi092 ceph-mon[134093]: Adjusting osd_memory_target on smithi059 to 222.0M 2023-10-08T12:58:58.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:58 smithi092 ceph-mon[134093]: Unable to set osd_memory_target on smithi059 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-08T12:58:58.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:58 smithi092 ceph-mon[134093]: pgmap v869: 97 pgs: 97 active+clean; 930 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 342 op/s 2023-10-08T12:58:58.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:58 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:58:58.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:58:58 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:58:58.967 INFO:tasks.workunit.client.0.smithi059.stdout: 10 104849 20.63 MB/sec execute 149 sec latency 120.720 ms 2023-10-08T12:58:59.966 INFO:tasks.workunit.client.0.smithi059.stdout: 10 105133 20.61 MB/sec execute 150 sec latency 221.628 ms 2023-10-08T12:59:00.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:00 smithi059 ceph-mon[98489]: pgmap v870: 97 pgs: 97 active+clean; 912 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.4 MiB/s wr, 352 op/s 2023-10-08T12:59:00.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:00 smithi092 ceph-mon[134093]: pgmap v870: 97 pgs: 97 active+clean; 912 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.4 MiB/s wr, 352 op/s 2023-10-08T12:59:00.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:00 smithi173 ceph-mon[135182]: pgmap v870: 97 pgs: 97 active+clean; 912 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.4 MiB/s wr, 352 op/s 2023-10-08T12:59:00.967 INFO:tasks.workunit.client.0.smithi059.stdout: 10 105367 20.56 MB/sec execute 151 sec latency 110.418 ms 2023-10-08T12:59:01.967 INFO:tasks.workunit.client.0.smithi059.stdout: 10 105694 20.47 MB/sec execute 152 sec latency 150.314 ms 2023-10-08T12:59:02.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:02 smithi173 ceph-mon[135182]: pgmap v871: 97 pgs: 97 active+clean; 915 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 375 op/s 2023-10-08T12:59:02.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:02 smithi059 ceph-mon[98489]: pgmap v871: 97 pgs: 97 active+clean; 915 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 375 op/s 2023-10-08T12:59:02.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:02 smithi092 ceph-mon[134093]: pgmap v871: 97 pgs: 97 active+clean; 915 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 375 op/s 2023-10-08T12:59:02.967 INFO:tasks.workunit.client.0.smithi059.stdout: 10 105968 20.41 MB/sec execute 153 sec latency 265.442 ms 2023-10-08T12:59:03.968 INFO:tasks.workunit.client.0.smithi059.stdout: 10 106224 20.37 MB/sec execute 154 sec latency 161.188 ms 2023-10-08T12:59:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:04 smithi173 ceph-mon[135182]: pgmap v872: 97 pgs: 97 active+clean; 933 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.2 MiB/s wr, 459 op/s 2023-10-08T12:59:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:04 smithi173 ceph-mon[135182]: osdmap e109: 12 total, 12 up, 12 in 2023-10-08T12:59:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:04 smithi059 ceph-mon[98489]: pgmap v872: 97 pgs: 97 active+clean; 933 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.2 MiB/s wr, 459 op/s 2023-10-08T12:59:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:04 smithi059 ceph-mon[98489]: osdmap e109: 12 total, 12 up, 12 in 2023-10-08T12:59:04.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:04 smithi092 ceph-mon[134093]: pgmap v872: 97 pgs: 97 active+clean; 933 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.2 MiB/s wr, 459 op/s 2023-10-08T12:59:04.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:04 smithi092 ceph-mon[134093]: osdmap e109: 12 total, 12 up, 12 in 2023-10-08T12:59:04.968 INFO:tasks.workunit.client.0.smithi059.stdout: 10 106558 20.39 MB/sec execute 155 sec latency 346.654 ms 2023-10-08T12:59:05.968 INFO:tasks.workunit.client.0.smithi059.stdout: 10 107018 20.41 MB/sec execute 156 sec latency 202.400 ms 2023-10-08T12:59:06.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:06 smithi173 ceph-mon[135182]: pgmap v874: 97 pgs: 97 active+clean; 935 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.4 MiB/s wr, 540 op/s 2023-10-08T12:59:06.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:06 smithi059 ceph-mon[98489]: pgmap v874: 97 pgs: 97 active+clean; 935 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.4 MiB/s wr, 540 op/s 2023-10-08T12:59:06.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:06 smithi092 ceph-mon[134093]: pgmap v874: 97 pgs: 97 active+clean; 935 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.4 MiB/s wr, 540 op/s 2023-10-08T12:59:06.968 INFO:tasks.workunit.client.0.smithi059.stdout: 10 107527 20.41 MB/sec execute 157 sec latency 180.798 ms 2023-10-08T12:59:07.968 INFO:tasks.workunit.client.0.smithi059.stdout: 10 107972 20.48 MB/sec execute 158 sec latency 163.739 ms 2023-10-08T12:59:08.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:08 smithi173 ceph-mon[135182]: pgmap v875: 97 pgs: 97 active+clean; 937 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 9.5 MiB/s wr, 615 op/s 2023-10-08T12:59:08.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:08 smithi059 ceph-mon[98489]: pgmap v875: 97 pgs: 97 active+clean; 937 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 9.5 MiB/s wr, 615 op/s 2023-10-08T12:59:08.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:08 smithi092 ceph-mon[134093]: pgmap v875: 97 pgs: 97 active+clean; 937 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 9.5 MiB/s wr, 615 op/s 2023-10-08T12:59:08.968 INFO:tasks.workunit.client.0.smithi059.stdout: 10 108342 20.48 MB/sec execute 159 sec latency 211.351 ms 2023-10-08T12:59:09.968 INFO:tasks.workunit.client.0.smithi059.stdout: 10 108538 20.45 MB/sec execute 160 sec latency 317.535 ms 2023-10-08T12:59:10.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:10 smithi059 ceph-mon[98489]: pgmap v876: 97 pgs: 97 active+clean; 942 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.9 MiB/s wr, 598 op/s 2023-10-08T12:59:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:10 smithi092 ceph-mon[134093]: pgmap v876: 97 pgs: 97 active+clean; 942 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.9 MiB/s wr, 598 op/s 2023-10-08T12:59:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:10 smithi173 ceph-mon[135182]: pgmap v876: 97 pgs: 97 active+clean; 942 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.9 MiB/s wr, 598 op/s 2023-10-08T12:59:10.968 INFO:tasks.workunit.client.0.smithi059.stdout: 10 108795 20.42 MB/sec execute 161 sec latency 124.344 ms 2023-10-08T12:59:11.968 INFO:tasks.workunit.client.0.smithi059.stdout: 10 109185 20.37 MB/sec execute 162 sec latency 89.266 ms 2023-10-08T12:59:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:12 smithi173 ceph-mon[135182]: pgmap v877: 97 pgs: 97 active+clean; 940 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 10 MiB/s wr, 610 op/s 2023-10-08T12:59:12.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:12 smithi059 ceph-mon[98489]: pgmap v877: 97 pgs: 97 active+clean; 940 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 10 MiB/s wr, 610 op/s 2023-10-08T12:59:12.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:12 smithi092 ceph-mon[134093]: pgmap v877: 97 pgs: 97 active+clean; 940 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 10 MiB/s wr, 610 op/s 2023-10-08T12:59:12.970 INFO:tasks.workunit.client.0.smithi059.stdout: 10 109577 20.38 MB/sec execute 163 sec latency 168.187 ms 2023-10-08T12:59:13.970 INFO:tasks.workunit.client.0.smithi059.stdout: 10 109899 20.38 MB/sec execute 164 sec latency 465.434 ms 2023-10-08T12:59:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:14 smithi173 ceph-mon[135182]: pgmap v878: 97 pgs: 97 active+clean; 897 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.5 MiB/s wr, 514 op/s 2023-10-08T12:59:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:14 smithi173 ceph-mon[135182]: osdmap e110: 12 total, 12 up, 12 in 2023-10-08T12:59:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:14 smithi059 ceph-mon[98489]: pgmap v878: 97 pgs: 97 active+clean; 897 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.5 MiB/s wr, 514 op/s 2023-10-08T12:59:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:14 smithi059 ceph-mon[98489]: osdmap e110: 12 total, 12 up, 12 in 2023-10-08T12:59:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:14 smithi092 ceph-mon[134093]: pgmap v878: 97 pgs: 97 active+clean; 897 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.5 MiB/s wr, 514 op/s 2023-10-08T12:59:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:14 smithi092 ceph-mon[134093]: osdmap e110: 12 total, 12 up, 12 in 2023-10-08T12:59:14.970 INFO:tasks.workunit.client.0.smithi059.stdout: 10 110304 20.38 MB/sec execute 165 sec latency 257.985 ms 2023-10-08T12:59:15.970 INFO:tasks.workunit.client.0.smithi059.stdout: 10 110751 20.37 MB/sec execute 166 sec latency 131.441 ms 2023-10-08T12:59:16.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:16 smithi173 ceph-mon[135182]: pgmap v880: 97 pgs: 97 active+clean; 915 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 9.9 MiB/s wr, 504 op/s 2023-10-08T12:59:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:16 smithi059 ceph-mon[98489]: pgmap v880: 97 pgs: 97 active+clean; 915 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 9.9 MiB/s wr, 504 op/s 2023-10-08T12:59:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:16 smithi092 ceph-mon[134093]: pgmap v880: 97 pgs: 97 active+clean; 915 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 9.9 MiB/s wr, 504 op/s 2023-10-08T12:59:16.970 INFO:tasks.workunit.client.0.smithi059.stdout: 10 111204 20.40 MB/sec execute 167 sec latency 55.448 ms 2023-10-08T12:59:17.970 INFO:tasks.workunit.client.0.smithi059.stdout: 10 111619 20.46 MB/sec execute 168 sec latency 128.294 ms 2023-10-08T12:59:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:18 smithi173 ceph-mon[135182]: pgmap v881: 97 pgs: 97 active+clean; 919 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 10 MiB/s wr, 432 op/s 2023-10-08T12:59:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:18 smithi059 ceph-mon[98489]: pgmap v881: 97 pgs: 97 active+clean; 919 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 10 MiB/s wr, 432 op/s 2023-10-08T12:59:18.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:18 smithi092 ceph-mon[134093]: pgmap v881: 97 pgs: 97 active+clean; 919 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 10 MiB/s wr, 432 op/s 2023-10-08T12:59:18.970 INFO:tasks.workunit.client.0.smithi059.stdout: 10 111784 20.40 MB/sec execute 169 sec latency 382.755 ms 2023-10-08T12:59:19.970 INFO:tasks.workunit.client.0.smithi059.stdout: 10 111964 20.35 MB/sec execute 170 sec latency 349.008 ms 2023-10-08T12:59:20.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:20 smithi059 ceph-mon[98489]: pgmap v882: 97 pgs: 97 active+clean; 934 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 10 MiB/s wr, 404 op/s 2023-10-08T12:59:20.380 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:20 smithi092 ceph-mon[134093]: pgmap v882: 97 pgs: 97 active+clean; 934 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 10 MiB/s wr, 404 op/s 2023-10-08T12:59:20.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:20 smithi173 ceph-mon[135182]: pgmap v882: 97 pgs: 97 active+clean; 934 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 10 MiB/s wr, 404 op/s 2023-10-08T12:59:20.970 INFO:tasks.workunit.client.0.smithi059.stdout: 10 112193 20.30 MB/sec execute 171 sec latency 140.392 ms 2023-10-08T12:59:21.970 INFO:tasks.workunit.client.0.smithi059.stdout: 10 112607 20.24 MB/sec execute 172 sec latency 157.382 ms 2023-10-08T12:59:22.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:22 smithi173 ceph-mon[135182]: pgmap v883: 97 pgs: 97 active+clean; 943 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.2 MiB/s wr, 358 op/s 2023-10-08T12:59:22.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:22 smithi059 ceph-mon[98489]: pgmap v883: 97 pgs: 97 active+clean; 943 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.2 MiB/s wr, 358 op/s 2023-10-08T12:59:22.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:22 smithi092 ceph-mon[134093]: pgmap v883: 97 pgs: 97 active+clean; 943 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.2 MiB/s wr, 358 op/s 2023-10-08T12:59:22.972 INFO:tasks.workunit.client.0.smithi059.stdout: 10 112953 20.23 MB/sec execute 173 sec latency 163.286 ms 2023-10-08T12:59:23.972 INFO:tasks.workunit.client.0.smithi059.stdout: 10 113392 20.27 MB/sec execute 174 sec latency 262.117 ms 2023-10-08T12:59:24.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:24 smithi173 ceph-mon[135182]: pgmap v884: 97 pgs: 97 active+clean; 958 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 11 MiB/s wr, 390 op/s 2023-10-08T12:59:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:24 smithi059 ceph-mon[98489]: pgmap v884: 97 pgs: 97 active+clean; 958 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 11 MiB/s wr, 390 op/s 2023-10-08T12:59:24.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:24 smithi092 ceph-mon[134093]: pgmap v884: 97 pgs: 97 active+clean; 958 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 11 MiB/s wr, 390 op/s 2023-10-08T12:59:24.972 INFO:tasks.workunit.client.0.smithi059.stdout: 10 113825 20.28 MB/sec execute 175 sec latency 326.365 ms 2023-10-08T12:59:25.972 INFO:tasks.workunit.client.0.smithi059.stdout: 10 114186 20.25 MB/sec execute 176 sec latency 332.273 ms 2023-10-08T12:59:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:26 smithi173 ceph-mon[135182]: pgmap v885: 97 pgs: 97 active+clean; 963 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 10 MiB/s wr, 379 op/s 2023-10-08T12:59:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:26 smithi059 ceph-mon[98489]: pgmap v885: 97 pgs: 97 active+clean; 963 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 10 MiB/s wr, 379 op/s 2023-10-08T12:59:26.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:26 smithi092 ceph-mon[134093]: pgmap v885: 97 pgs: 97 active+clean; 963 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 10 MiB/s wr, 379 op/s 2023-10-08T12:59:26.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:59:26.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.890+0000 7f6b881ff700 1 -- 172.21.15.59:0/3964734921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b80106740 msgr2=0x7f6b80106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.890+0000 7f6b881ff700 1 --2- 172.21.15.59:0/3964734921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b80106740 0x7f6b80106b20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c009990 tx=0x7f6b7c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.891+0000 7f6b881ff700 1 -- 172.21.15.59:0/3964734921 shutdown_connections 2023-10-08T12:59:26.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.891+0000 7f6b881ff700 1 --2- 172.21.15.59:0/3964734921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b801010f0 0x7f6b8010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.891+0000 7f6b881ff700 1 --2- 172.21.15.59:0/3964734921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b80106740 0x7f6b80106b20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.891+0000 7f6b881ff700 1 --2- 172.21.15.59:0/3964734921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b80100730 0x7f6b80100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.891+0000 7f6b881ff700 1 -- 172.21.15.59:0/3964734921 >> 172.21.15.59:0/3964734921 conn(0x7f6b800fc200 msgr2=0x7f6b800fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:26.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.891+0000 7f6b881ff700 1 -- 172.21.15.59:0/3964734921 shutdown_connections 2023-10-08T12:59:26.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.891+0000 7f6b881ff700 1 -- 172.21.15.59:0/3964734921 wait complete. 2023-10-08T12:59:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.892+0000 7f6b881ff700 1 Processor -- start 2023-10-08T12:59:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.892+0000 7f6b881ff700 1 -- start start 2023-10-08T12:59:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.892+0000 7f6b881ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b80100730 0x7f6b80198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.892+0000 7f6b881ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b801010f0 0x7f6b80199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.892+0000 7f6b881ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b80106740 0x7f6b8019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.892+0000 7f6b881ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8019dd00 con 0x7f6b801010f0 2023-10-08T12:59:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.892+0000 7f6b881ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8019de70 con 0x7f6b80106740 2023-10-08T12:59:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.892+0000 7f6b881ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8019e030 con 0x7f6b80100730 2023-10-08T12:59:26.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.892+0000 7f6b85f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b80100730 0x7f6b80198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b85f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b80100730 0x7f6b80198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34424/0 (socket says 172.21.15.59:34424) 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b8679c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b80106740 0x7f6b8019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b85f9b700 1 -- 172.21.15.59:0/2862253704 learned_addr learned my addr 172.21.15.59:0/2862253704 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b8579a700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b801010f0 0x7f6b80199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b85f9b700 1 -- 172.21.15.59:0/2862253704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b80106740 msgr2=0x7f6b8019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b80106740 0x7f6b8019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b85f9b700 1 -- 172.21.15.59:0/2862253704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b801010f0 msgr2=0x7f6b80199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b801010f0 0x7f6b80199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b85f9b700 1 -- 172.21.15.59:0/2862253704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c0095f0 con 0x7f6b80100730 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b8579a700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b801010f0 0x7f6b80199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b80100730 0x7f6b80198de0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c005910 tx=0x7f6b7c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:26.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.893+0000 7f6b76ffd700 1 -- 172.21.15.59:0/2862253704 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c01d070 con 0x7f6b80100730 2023-10-08T12:59:26.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.894+0000 7f6b76ffd700 1 -- 172.21.15.59:0/2862253704 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b7c022470 con 0x7f6b80100730 2023-10-08T12:59:26.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.894+0000 7f6b881ff700 1 -- 172.21.15.59:0/2862253704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8019e2b0 con 0x7f6b80100730 2023-10-08T12:59:26.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.894+0000 7f6b76ffd700 1 -- 172.21.15.59:0/2862253704 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c017650 con 0x7f6b80100730 2023-10-08T12:59:26.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.894+0000 7f6b881ff700 1 -- 172.21.15.59:0/2862253704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b801a5b50 con 0x7f6b80100730 2023-10-08T12:59:26.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.899+0000 7f6b76ffd700 1 -- 172.21.15.59:0/2862253704 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6b7c0225e0 con 0x7f6b80100730 2023-10-08T12:59:26.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.900+0000 7f6b9ba54b80 1 Processor -- start 2023-10-08T12:59:26.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.901+0000 7f6b9ba54b80 1 -- start start 2023-10-08T12:59:26.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.901+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de142fe80 0x556de1430260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.901+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 0x556de143b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.901+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 0x556de143da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.901+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de1399460 con 0x556de142fe80 2023-10-08T12:59:26.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.901+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de138ac20 con 0x556de143b650 2023-10-08T12:59:26.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.901+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de1388540 con 0x556de14307a0 2023-10-08T12:59:26.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.901+0000 7f6b8579a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 0x556de143da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.902+0000 7f6b8579a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 0x556de143da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49566/0 (socket says 172.21.15.59:49566) 2023-10-08T12:59:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.902+0000 7f6b8579a700 1 -- 172.21.15.59:0/1201677693 learned_addr learned my addr 172.21.15.59:0/1201677693 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.902+0000 7f6b8679c700 1 --2- 172.21.15.59:0/1201677693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de142fe80 0x556de1430260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.902+0000 7f6b76ffd700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b6c0a1670 0x7f6b6c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.902+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/1201677693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 0x556de143b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.902+0000 7f6b8579a700 1 -- 172.21.15.59:0/1201677693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 msgr2=0x556de143b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.902+0000 7f6b8579a700 1 --2- 172.21.15.59:0/1201677693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 0x556de143b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.902+0000 7f6b8579a700 1 -- 172.21.15.59:0/1201677693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de142fe80 msgr2=0x556de1430260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.902+0000 7f6b8579a700 1 --2- 172.21.15.59:0/1201677693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de142fe80 0x556de1430260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.902+0000 7f6b8579a700 1 -- 172.21.15.59:0/1201677693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556de11aede0 con 0x556de143b650 2023-10-08T12:59:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.902+0000 7f6b76ffd700 1 -- 172.21.15.59:0/2862253704 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f6b7c0ce3b0 con 0x7f6b80100730 2023-10-08T12:59:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.903+0000 7f6b8679c700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b6c0a1670 0x7f6b6c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.903+0000 7f6b8579a700 1 --2- 172.21.15.59:0/1201677693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 0x556de143da40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009db0 tx=0x7f6b700116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92a65f7c86f6b175 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.903+0000 7f6b6bfff700 1 -- 172.21.15.59:0/1201677693 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70011e20 con 0x556de143b650 2023-10-08T12:59:26.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.903+0000 7f6b6bfff700 1 -- 172.21.15.59:0/1201677693 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b70012910 con 0x556de143b650 2023-10-08T12:59:26.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.903+0000 7f6b6bfff700 1 -- 172.21.15.59:0/1201677693 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000f7c0 con 0x556de143b650 2023-10-08T12:59:26.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.904+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/1201677693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 msgr2=0x556de143da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.904+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/1201677693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 0x556de143da40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009db0 tx=0x7f6b700116c0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.904+0000 7f6b8679c700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b6c0a1670 0x7f6b6c0a3b30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009710 tx=0x7f6b78004ad0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:26.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.904+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/1201677693 shutdown_connections 2023-10-08T12:59:26.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.904+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/1201677693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 0x556de143da40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.904+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/1201677693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de142fe80 0x556de1430260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.904+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/1201677693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 0x556de143b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.904+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/1201677693 >> 172.21.15.59:0/1201677693 conn(0x556de13a5260 msgr2=0x556de142c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:26.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.904+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/1201677693 shutdown_connections 2023-10-08T12:59:26.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.904+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/1201677693 wait complete. 2023-10-08T12:59:26.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.904+0000 7f6b9ba54b80 1 -- start start 2023-10-08T12:59:26.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.905+0000 7f6b9ba54b80 1 Processor -- start 2023-10-08T12:59:26.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.905+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de142fe80 0x556de143b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.905+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 0x556de1438300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.905+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 0x556de1438910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.905+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de1383e30 con 0x556de142fe80 2023-10-08T12:59:26.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.905+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de1320710 con 0x556de143b650 2023-10-08T12:59:26.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.905+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de13203b0 con 0x556de14307a0 2023-10-08T12:59:26.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.905+0000 7f6b9ba54b80 10 client.0 _ll_register_callbacks cb 0x556de117d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:59:26.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b8579a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 0x556de1438300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b8679c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 0x556de1438910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b8579a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 0x556de1438300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34446/0 (socket says 172.21.15.59:34446) 2023-10-08T12:59:26.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b8579a700 1 -- 172.21.15.59:0/4078069717 learned_addr learned my addr 172.21.15.59:0/4078069717 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:26.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de142fe80 0x556de143b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b8579a700 1 -- 172.21.15.59:0/4078069717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 msgr2=0x556de1438910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:26.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b8579a700 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 0x556de1438910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b8579a700 1 -- 172.21.15.59:0/4078069717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de142fe80 msgr2=0x556de143b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:26.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b8579a700 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de142fe80 0x556de143b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b8579a700 1 -- 172.21.15.59:0/4078069717 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b700099b0 con 0x556de14307a0 2023-10-08T12:59:26.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b8679c700 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 0x556de1438910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:26.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.906+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de142fe80 0x556de143b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:26.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.907+0000 7f6b8579a700 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 0x556de1438300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009340 tx=0x7f6b70012cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb7c723d40720051 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:26.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.907+0000 7f6b697fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:59:26.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.907+0000 7f6b697fa700 1 -- 172.21.15.59:0/4078069717 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70012660 con 0x556de14307a0 2023-10-08T12:59:26.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.907+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4078069717 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556de134beb0 con 0x556de14307a0 2023-10-08T12:59:26.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.907+0000 7f6b697fa700 1 -- 172.21.15.59:0/4078069717 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f6b70005040 con 0x556de14307a0 2023-10-08T12:59:26.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.907+0000 7f6b697fa700 1 -- 172.21.15.59:0/4078069717 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b70005200 con 0x556de14307a0 2023-10-08T12:59:26.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.907+0000 7f6b9ba54b80 10 client.28063 fetch_fsmap learned FSMap version 20 2023-10-08T12:59:26.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.907+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4078069717 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x556de1197c60 con 0x556de14307a0 2023-10-08T12:59:26.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.907+0000 7f6b697fa700 1 -- 172.21.15.59:0/4078069717 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556de134beb0 con 0x556de14307a0 2023-10-08T12:59:26.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.908+0000 7f6b697fa700 1 -- 172.21.15.59:0/4078069717 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6b70022070 con 0x556de14307a0 2023-10-08T12:59:26.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.908+0000 7f6b9ba54b80 10 client.28063 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:59:26.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.908+0000 7f6b9ba54b80 10 client.28063 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:59:26.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.908+0000 7f6b9ba54b80 20 client.28063 populate_metadata read hostname 'smithi059' 2023-10-08T12:59:26.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.908+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556de144b040 0x556de144d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.908+0000 7f6b9ba54b80 4 client.28063 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:59:26.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.908+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4078069717 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556de137ce10 con 0x556de144b040 2023-10-08T12:59:26.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.908+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556de144b040 0x556de144d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.909+0000 7f6b697fa700 10 client.28063 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:26.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.909+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556de144b040 0x556de144d460 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbd769aa275a6e1 server_cookie=d6cb95144426023e in_seq=0 out_seq=0 2023-10-08T12:59:26.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b697fa700 1 -- 172.21.15.59:0/4078069717 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556de137ce10 con 0x556de144b040 2023-10-08T12:59:26.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b697fa700 10 client.28063 handle_command_reply: tid=0 2023-10-08T12:59:26.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 1 client.28063 shutdown 2023-10-08T12:59:26.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4078069717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 msgr2=0x556de1438300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 0x556de1438300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009340 tx=0x7f6b70012cb0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4078069717 shutdown_connections 2023-10-08T12:59:26.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556de144b040 0x556de144d460 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de143b650 0x556de1438910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de142fe80 0x556de143b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4078069717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de14307a0 0x556de1438300 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4078069717 >> 172.21.15.59:0/4078069717 conn(0x556de13a5260 msgr2=0x556de142bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:26.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b697fa700 0 client.28063 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4078069717 shutdown_connections 2023-10-08T12:59:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4078069717 wait complete. 2023-10-08T12:59:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.912+0000 7f6b9ba54b80 20 client.28063 trim_cache size 0 max 16384 2023-10-08T12:59:26.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b9ba54b80 1 Processor -- start 2023-10-08T12:59:26.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b9ba54b80 1 -- start start 2023-10-08T12:59:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de142fe80 0x556de14421a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de14307a0 0x556de1436bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de143b650 0x556de1437110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de1204920 con 0x556de143b650 2023-10-08T12:59:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de1437650 con 0x556de14307a0 2023-10-08T12:59:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de14426e0 con 0x556de142fe80 2023-10-08T12:59:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b85f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de142fe80 0x556de14421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b8579a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de14307a0 0x556de1436bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b8679c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de143b650 0x556de1437110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b85f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de142fe80 0x556de14421a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34462/0 (socket says 172.21.15.59:34462) 2023-10-08T12:59:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.933+0000 7f6b85f9b700 1 -- 172.21.15.59:0/3384522172 learned_addr learned my addr 172.21.15.59:0/3384522172 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.934+0000 7f6b85f9b700 1 -- 172.21.15.59:0/3384522172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de14307a0 msgr2=0x556de1436bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.934+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/3384522172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de14307a0 0x556de1436bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.934+0000 7f6b85f9b700 1 -- 172.21.15.59:0/3384522172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de143b650 msgr2=0x556de1437110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.934+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/3384522172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de143b650 0x556de1437110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.934+0000 7f6b85f9b700 1 -- 172.21.15.59:0/3384522172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556de14282a0 con 0x556de142fe80 2023-10-08T12:59:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.934+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/3384522172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de142fe80 0x556de14421a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c09b170 tx=0x7f6b7c0d08f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4970c7af70c9d929 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.934+0000 7f6b74ff9700 1 -- 172.21.15.59:0/3384522172 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0b3ea0 con 0x556de142fe80 2023-10-08T12:59:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.934+0000 7f6b74ff9700 1 -- 172.21.15.59:0/3384522172 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b7c09b240 con 0x556de142fe80 2023-10-08T12:59:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.934+0000 7f6b74ff9700 1 -- 172.21.15.59:0/3384522172 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c09f5c0 con 0x556de142fe80 2023-10-08T12:59:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.935+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/3384522172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de142fe80 msgr2=0x556de14421a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.935+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/3384522172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de142fe80 0x556de14421a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c09b170 tx=0x7f6b7c0d08f0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.935+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/3384522172 shutdown_connections 2023-10-08T12:59:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.935+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/3384522172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de143b650 0x556de1437110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.935+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/3384522172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de142fe80 0x556de14421a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.935+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/3384522172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de14307a0 0x556de1436bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.935+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/3384522172 >> 172.21.15.59:0/3384522172 conn(0x556de13a5260 msgr2=0x556de14335b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.936+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/3384522172 shutdown_connections 2023-10-08T12:59:26.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.936+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/3384522172 wait complete. 2023-10-08T12:59:26.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.936+0000 7f6b9ba54b80 1 -- start start 2023-10-08T12:59:26.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.936+0000 7f6b9ba54b80 1 Processor -- start 2023-10-08T12:59:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de142fe80 0x556de143e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de14307a0 0x556de143e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b9ba54b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de143b650 0x556de149de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de149e3c0 con 0x556de14307a0 2023-10-08T12:59:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de149e500 con 0x556de142fe80 2023-10-08T12:59:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b9ba54b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de149e670 con 0x556de143b650 2023-10-08T12:59:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b9ba54b80 10 client.0 _ll_register_callbacks cb 0x7f6b78009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:59:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b85f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de142fe80 0x556de143e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b8579a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de14307a0 0x556de143e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b85f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de142fe80 0x556de143e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49598/0 (socket says 172.21.15.59:49598) 2023-10-08T12:59:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b85f9b700 1 -- 172.21.15.59:0/4163187236 learned_addr learned my addr 172.21.15.59:0/4163187236 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b8679c700 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de143b650 0x556de149de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.937+0000 7f6b85f9b700 1 -- 172.21.15.59:0/4163187236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de143b650 msgr2=0x556de149de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de143b650 0x556de149de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b85f9b700 1 -- 172.21.15.59:0/4163187236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de14307a0 msgr2=0x556de143e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de14307a0 0x556de143e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b85f9b700 1 -- 172.21.15.59:0/4163187236 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b801a5b50 con 0x556de142fe80 2023-10-08T12:59:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b8579a700 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de14307a0 0x556de143e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b85f9b700 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de142fe80 0x556de143e380 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c000c00 tx=0x7f6b7c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d266c4246816c85c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b697fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:59:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b697fa700 1 -- 172.21.15.59:0/4163187236 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0b3ea0 con 0x556de142fe80 2023-10-08T12:59:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b697fa700 1 -- 172.21.15.59:0/4163187236 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f6b7c09bb70 con 0x556de142fe80 2023-10-08T12:59:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4163187236 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b70012910 con 0x556de142fe80 2023-10-08T12:59:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b697fa700 1 -- 172.21.15.59:0/4163187236 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b7c09add0 con 0x556de142fe80 2023-10-08T12:59:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b9ba54b80 10 client.28082 fetch_fsmap learned FSMap version 20 2023-10-08T12:59:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.938+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4163187236 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x556de11d5250 con 0x556de142fe80 2023-10-08T12:59:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.939+0000 7f6b697fa700 1 -- 172.21.15.59:0/4163187236 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b7c080080 con 0x556de142fe80 2023-10-08T12:59:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.939+0000 7f6b697fa700 1 -- 172.21.15.59:0/4163187236 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6b7c0b2030 con 0x556de142fe80 2023-10-08T12:59:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.939+0000 7f6b9ba54b80 10 client.28082 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:59:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.939+0000 7f6b9ba54b80 10 client.28082 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:59:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.939+0000 7f6b9ba54b80 20 client.28082 populate_metadata read hostname 'smithi059' 2023-10-08T12:59:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.939+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556de149fa90 0x556de14a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.939+0000 7f6b9ba54b80 4 client.28082 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:59:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.939+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4163187236 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556de137cb30 con 0x556de149fa90 2023-10-08T12:59:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.939+0000 7f6b8579a700 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556de149fa90 0x556de14a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.940+0000 7f6b8579a700 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556de149fa90 0x556de14a1eb0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6a29eda624f37b9 server_cookie=e245ed87b0c6b9e7 in_seq=0 out_seq=0 2023-10-08T12:59:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.940+0000 7f6b697fa700 10 client.28082 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:26.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b697fa700 1 -- 172.21.15.59:0/4163187236 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556de137cb30 con 0x556de149fa90 2023-10-08T12:59:26.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b697fa700 10 client.28082 handle_command_reply: tid=0 2023-10-08T12:59:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 1 client.28082 shutdown 2023-10-08T12:59:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4163187236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de142fe80 msgr2=0x556de143e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de142fe80 0x556de143e380 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c000c00 tx=0x7f6b7c009310 comp rx=0 tx=0).stop 2023-10-08T12:59:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4163187236 shutdown_connections 2023-10-08T12:59:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x556de149fa90 0x556de14a1eb0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556de142fe80 0x556de143e380 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556de143b650 0x556de149de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 1 --2- 172.21.15.59:0/4163187236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556de14307a0 0x556de143e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b697fa700 0 client.28082 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4163187236 >> 172.21.15.59:0/4163187236 conn(0x556de13a5260 msgr2=0x556de1437b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:26.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4163187236 shutdown_connections 2023-10-08T12:59:26.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 1 -- 172.21.15.59:0/4163187236 wait complete. 2023-10-08T12:59:26.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.944+0000 7f6b9ba54b80 20 client.28082 trim_cache size 0 max 16384 2023-10-08T12:59:26.947 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:59:26.947 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:59:26.947 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:59:26.947 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:59:26.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 -- 172.21.15.59:0/2862253704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b6c0a1670 msgr2=0x7f6b6c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b6c0a1670 0x7f6b6c0a3b30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009710 tx=0x7f6b78004ad0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 -- 172.21.15.59:0/2862253704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b80100730 msgr2=0x7f6b80198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b80100730 0x7f6b80198de0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c005910 tx=0x7f6b7c004730 comp rx=0 tx=0).stop 2023-10-08T12:59:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 -- 172.21.15.59:0/2862253704 shutdown_connections 2023-10-08T12:59:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b6c0a1670 0x7f6b6c0a3b30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b80106740 0x7f6b8019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b80100730 0x7f6b80198de0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 --2- 172.21.15.59:0/2862253704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b801010f0 0x7f6b80199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 -- 172.21.15.59:0/2862253704 >> 172.21.15.59:0/2862253704 conn(0x7f6b800fc200 msgr2=0x7f6b800fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 -- 172.21.15.59:0/2862253704 shutdown_connections 2023-10-08T12:59:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:26.945+0000 7f6b881ff700 1 -- 172.21.15.59:0/2862253704 wait complete. 2023-10-08T12:59:26.969 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:59:26.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:59:26.974 INFO:tasks.workunit.client.0.smithi059.stdout: 10 114685 20.31 MB/sec execute 177 sec latency 154.402 ms 2023-10-08T12:59:27.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.196+0000 7f4d10dff700 1 -- 172.21.15.59:0/11099818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c100630 msgr2=0x7f4d0c100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.196+0000 7f4d10dff700 1 --2- 172.21.15.59:0/11099818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c100630 0x7f4d0c100ab0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009990 tx=0x7f4d00009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.196+0000 7f4d10dff700 1 -- 172.21.15.59:0/11099818 shutdown_connections 2023-10-08T12:59:27.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.196+0000 7f4d10dff700 1 --2- 172.21.15.59:0/11099818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d0c100ff0 0x7f4d0c10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.196+0000 7f4d10dff700 1 --2- 172.21.15.59:0/11099818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d0c106640 0x7f4d0c106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.196+0000 7f4d10dff700 1 --2- 172.21.15.59:0/11099818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c100630 0x7f4d0c100ab0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.196+0000 7f4d10dff700 1 -- 172.21.15.59:0/11099818 >> 172.21.15.59:0/11099818 conn(0x7f4d0c0fc1a0 msgr2=0x7f4d0c0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.196+0000 7f4d10dff700 1 -- 172.21.15.59:0/11099818 shutdown_connections 2023-10-08T12:59:27.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.196+0000 7f4d10dff700 1 -- 172.21.15.59:0/11099818 wait complete. 2023-10-08T12:59:27.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.197+0000 7f4d10dff700 1 Processor -- start 2023-10-08T12:59:27.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d10dff700 1 -- start start 2023-10-08T12:59:27.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d10dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d0c100630 0x7f4d0c19e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d10dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d0c100ff0 0x7f4d0c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d10dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c106640 0x7f4d0c198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d10dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c1991a0 con 0x7f4d0c100ff0 2023-10-08T12:59:27.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d10dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c199310 con 0x7f4d0c106640 2023-10-08T12:59:27.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d10dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c1994d0 con 0x7f4d0c100630 2023-10-08T12:59:27.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d0a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d0c100630 0x7f4d0c19e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d0a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d0c100630 0x7f4d0c19e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34482/0 (socket says 172.21.15.59:34482) 2023-10-08T12:59:27.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d0ad9d700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c106640 0x7f4d0c198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d0a59c700 1 -- 172.21.15.59:0/2195940115 learned_addr learned my addr 172.21.15.59:0/2195940115 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:27.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.198+0000 7f4d09d9b700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d0c100ff0 0x7f4d0c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.199+0000 7f4d0ad9d700 1 -- 172.21.15.59:0/2195940115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d0c100630 msgr2=0x7f4d0c19e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.199+0000 7f4d0ad9d700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d0c100630 0x7f4d0c19e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.199+0000 7f4d0ad9d700 1 -- 172.21.15.59:0/2195940115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d0c100ff0 msgr2=0x7f4d0c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.199+0000 7f4d0ad9d700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d0c100ff0 0x7f4d0c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.199+0000 7f4d0ad9d700 1 -- 172.21.15.59:0/2195940115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000095f0 con 0x7f4d0c106640 2023-10-08T12:59:27.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.199+0000 7f4d0ad9d700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c106640 0x7f4d0c198b40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400efc0 tx=0x7f4d0400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.199+0000 7f4cfb7fe700 1 -- 172.21.15.59:0/2195940115 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04018070 con 0x7f4d0c106640 2023-10-08T12:59:27.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.199+0000 7f4cfb7fe700 1 -- 172.21.15.59:0/2195940115 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d0400f040 con 0x7f4d0c106640 2023-10-08T12:59:27.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.199+0000 7f4cfb7fe700 1 -- 172.21.15.59:0/2195940115 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0400cd40 con 0x7f4d0c106640 2023-10-08T12:59:27.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.200+0000 7f4d10dff700 1 -- 172.21.15.59:0/2195940115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c199750 con 0x7f4d0c106640 2023-10-08T12:59:27.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.200+0000 7f4d10dff700 1 -- 172.21.15.59:0/2195940115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c1a5a50 con 0x7f4d0c106640 2023-10-08T12:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.201+0000 7f4d10dff700 1 -- 172.21.15.59:0/2195940115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c101d70 con 0x7f4d0c106640 2023-10-08T12:59:27.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.203+0000 7f4cfb7fe700 1 -- 172.21.15.59:0/2195940115 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f4d04003a00 con 0x7f4d0c106640 2023-10-08T12:59:27.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.204+0000 7f4cfb7fe700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4cf40a1670 0x7f4cf40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.204+0000 7f4cfb7fe700 1 -- 172.21.15.59:0/2195940115 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f4d040ccdd0 con 0x7f4d0c106640 2023-10-08T12:59:27.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.205+0000 7f4d0a59c700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4cf40a1670 0x7f4cf40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.205+0000 7f4d0a59c700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4cf40a1670 0x7f4cf40a3b30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009ca0 tx=0x7f4cfc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.210+0000 7f4cfb7fe700 1 -- 172.21.15.59:0/2195940115 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4d04096170 con 0x7f4d0c106640 2023-10-08T12:59:27.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.540+0000 7f4d10dff700 1 -- 172.21.15.59:0/2195940115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d0c19a040 con 0x7f4d0c106640 2023-10-08T12:59:27.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.542+0000 7f4cfb7fe700 1 -- 172.21.15.59:0/2195940115 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f4d04099790 con 0x7f4d0c106640 2023-10-08T12:59:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T12:59:27.543 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:59:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.546+0000 7f4d10dff700 1 -- 172.21.15.59:0/2195940115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4cf40a1670 msgr2=0x7f4cf40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.546+0000 7f4d10dff700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4cf40a1670 0x7f4cf40a3b30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009ca0 tx=0x7f4cfc009260 comp rx=0 tx=0).stop 2023-10-08T12:59:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.546+0000 7f4d10dff700 1 -- 172.21.15.59:0/2195940115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c106640 msgr2=0x7f4d0c198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.546+0000 7f4d10dff700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c106640 0x7f4d0c198b40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400efc0 tx=0x7f4d0400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.546+0000 7f4d10dff700 1 -- 172.21.15.59:0/2195940115 shutdown_connections 2023-10-08T12:59:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.546+0000 7f4d10dff700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f4cf40a1670 0x7f4cf40a3b30 secure :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009ca0 tx=0x7f4cfc009260 comp rx=0 tx=0).stop 2023-10-08T12:59:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.546+0000 7f4d10dff700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c106640 0x7f4d0c198b40 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.546+0000 7f4d10dff700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d0c100630 0x7f4d0c19e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.546+0000 7f4d10dff700 1 --2- 172.21.15.59:0/2195940115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d0c100ff0 0x7f4d0c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.546+0000 7f4d10dff700 1 -- 172.21.15.59:0/2195940115 >> 172.21.15.59:0/2195940115 conn(0x7f4d0c0fc1a0 msgr2=0x7f4d0c10b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.546+0000 7f4d10dff700 1 -- 172.21.15.59:0/2195940115 shutdown_connections 2023-10-08T12:59:27.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.547+0000 7f4d10dff700 1 -- 172.21.15.59:0/2195940115 wait complete. 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T12:59:27.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:59:27.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.853+0000 7fae631ff700 1 -- 172.21.15.59:0/4253339456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae5c100730 msgr2=0x7fae5c100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.853+0000 7fae631ff700 1 --2- 172.21.15.59:0/4253339456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae5c100730 0x7fae5c100bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009990 tx=0x7fae4c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.853+0000 7fae631ff700 1 -- 172.21.15.59:0/4253339456 shutdown_connections 2023-10-08T12:59:27.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.853+0000 7fae631ff700 1 --2- 172.21.15.59:0/4253339456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5c1010f0 0x7fae5c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.853+0000 7fae631ff700 1 --2- 172.21.15.59:0/4253339456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae5c106740 0x7fae5c106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.853+0000 7fae631ff700 1 --2- 172.21.15.59:0/4253339456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae5c100730 0x7fae5c100bb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.853+0000 7fae631ff700 1 -- 172.21.15.59:0/4253339456 >> 172.21.15.59:0/4253339456 conn(0x7fae5c0fc200 msgr2=0x7fae5c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.853+0000 7fae631ff700 1 -- 172.21.15.59:0/4253339456 shutdown_connections 2023-10-08T12:59:27.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.853+0000 7fae631ff700 1 -- 172.21.15.59:0/4253339456 wait complete. 2023-10-08T12:59:27.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.854+0000 7fae631ff700 1 Processor -- start 2023-10-08T12:59:27.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae631ff700 1 -- start start 2023-10-08T12:59:27.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae631ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae5c100730 0x7fae5c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae631ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5c1010f0 0x7fae5c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae631ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae5c106740 0x7fae5c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae631ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c19dce0 con 0x7fae5c106740 2023-10-08T12:59:27.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae631ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c19de50 con 0x7fae5c1010f0 2023-10-08T12:59:27.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae631ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c19e010 con 0x7fae5c100730 2023-10-08T12:59:27.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae60f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae5c100730 0x7fae5c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae6179c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae5c106740 0x7fae5c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae60f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae5c100730 0x7fae5c198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34500/0 (socket says 172.21.15.59:34500) 2023-10-08T12:59:27.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae60f9b700 1 -- 172.21.15.59:0/1597875611 learned_addr learned my addr 172.21.15.59:0/1597875611 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:27.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.855+0000 7fae53fff700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5c1010f0 0x7fae5c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.856+0000 7fae53fff700 1 -- 172.21.15.59:0/1597875611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae5c100730 msgr2=0x7fae5c198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.856+0000 7fae53fff700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae5c100730 0x7fae5c198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.856+0000 7fae53fff700 1 -- 172.21.15.59:0/1597875611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae5c106740 msgr2=0x7fae5c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.856+0000 7fae53fff700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae5c106740 0x7fae5c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.856+0000 7fae53fff700 1 -- 172.21.15.59:0/1597875611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0095f0 con 0x7fae5c1010f0 2023-10-08T12:59:27.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.856+0000 7fae60f9b700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae5c100730 0x7fae5c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:27.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.856+0000 7fae53fff700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5c1010f0 0x7fae5c199300 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fae4c000c00 tx=0x7fae4c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.856+0000 7fae51ffb700 1 -- 172.21.15.59:0/1597875611 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c01d070 con 0x7fae5c1010f0 2023-10-08T12:59:27.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.856+0000 7fae51ffb700 1 -- 172.21.15.59:0/1597875611 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae4c021410 con 0x7fae5c1010f0 2023-10-08T12:59:27.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.856+0000 7fae631ff700 1 -- 172.21.15.59:0/1597875611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c19e290 con 0x7fae5c1010f0 2023-10-08T12:59:27.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.856+0000 7fae51ffb700 1 -- 172.21.15.59:0/1597875611 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c021ea0 con 0x7fae5c1010f0 2023-10-08T12:59:27.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.857+0000 7fae631ff700 1 -- 172.21.15.59:0/1597875611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c1a5b30 con 0x7fae5c1010f0 2023-10-08T12:59:27.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.861+0000 7fae51ffb700 1 -- 172.21.15.59:0/1597875611 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fae4c021580 con 0x7fae5c1010f0 2023-10-08T12:59:27.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.862+0000 7fae76b15b80 1 Processor -- start 2023-10-08T12:59:27.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.863+0000 7fae76b15b80 1 -- start start 2023-10-08T12:59:27.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.864+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b436a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.864+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b441920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.864+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b444250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.864+0000 7fae76b15b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b397460 con 0x55dd7b436690 2023-10-08T12:59:27.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.864+0000 7fae76b15b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b388c20 con 0x55dd7b436fb0 2023-10-08T12:59:27.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.864+0000 7fae76b15b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b386540 con 0x55dd7b441e60 2023-10-08T12:59:27.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.864+0000 7fae53fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b444250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.865+0000 7fae53fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b444250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34502/0 (socket says 172.21.15.59:34502) 2023-10-08T12:59:27.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.865+0000 7fae53fff700 1 -- 172.21.15.59:0/123601051 learned_addr learned my addr 172.21.15.59:0/123601051 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:27.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.865+0000 7fae6179c700 1 --2- 172.21.15.59:0/123601051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b436a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.865+0000 7fae60f9b700 1 --2- 172.21.15.59:0/123601051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b441920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.865+0000 7fae51ffb700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae440a16f0 0x7fae440a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.865+0000 7fae51ffb700 1 -- 172.21.15.59:0/1597875611 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fae4c0cdfc0 con 0x7fae5c1010f0 2023-10-08T12:59:27.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.865+0000 7fae53fff700 1 -- 172.21.15.59:0/123601051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 msgr2=0x55dd7b441920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:27.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.865+0000 7fae53fff700 1 --2- 172.21.15.59:0/123601051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b441920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.865+0000 7fae53fff700 1 -- 172.21.15.59:0/123601051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 msgr2=0x55dd7b436a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:27.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.865+0000 7fae53fff700 1 --2- 172.21.15.59:0/123601051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b436a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.865+0000 7fae53fff700 1 -- 172.21.15.59:0/123601051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd7b1acde0 con 0x55dd7b441e60 2023-10-08T12:59:27.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.866+0000 7fae60f9b700 1 --2- 172.21.15.59:0/123601051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b441920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:27.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.866+0000 7fae6179c700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae440a16f0 0x7fae440a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.866+0000 7fae53fff700 1 --2- 172.21.15.59:0/123601051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b444250 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fae4c09ad20 tx=0x7fae4c009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d893777810df80e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.866+0000 7fae42ffd700 1 -- 172.21.15.59:0/123601051 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c09adf0 con 0x55dd7b441e60 2023-10-08T12:59:27.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.866+0000 7fae42ffd700 1 -- 172.21.15.59:0/123601051 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae4c09ab60 con 0x55dd7b441e60 2023-10-08T12:59:27.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.866+0000 7fae42ffd700 1 -- 172.21.15.59:0/123601051 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0a3320 con 0x55dd7b441e60 2023-10-08T12:59:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.867+0000 7fae6179c700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae440a16f0 0x7fae440a3bb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fae54009ec0 tx=0x7fae54004ad0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.867+0000 7fae76b15b80 1 -- 172.21.15.59:0/123601051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 msgr2=0x55dd7b444250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.867+0000 7fae76b15b80 1 --2- 172.21.15.59:0/123601051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b444250 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fae4c09ad20 tx=0x7fae4c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.868+0000 7fae76b15b80 1 -- 172.21.15.59:0/123601051 shutdown_connections 2023-10-08T12:59:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.868+0000 7fae76b15b80 1 --2- 172.21.15.59:0/123601051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b444250 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.868+0000 7fae76b15b80 1 --2- 172.21.15.59:0/123601051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b436a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.868+0000 7fae76b15b80 1 --2- 172.21.15.59:0/123601051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b441920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.868+0000 7fae76b15b80 1 -- 172.21.15.59:0/123601051 >> 172.21.15.59:0/123601051 conn(0x55dd7b3a3260 msgr2=0x55dd7b42a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.868+0000 7fae76b15b80 1 -- 172.21.15.59:0/123601051 shutdown_connections 2023-10-08T12:59:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.868+0000 7fae76b15b80 1 -- 172.21.15.59:0/123601051 wait complete. 2023-10-08T12:59:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.868+0000 7fae76b15b80 1 -- start start 2023-10-08T12:59:27.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.869+0000 7fae76b15b80 1 Processor -- start 2023-10-08T12:59:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436690 0x55dd7b442240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436fb0 0x55dd7b442780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b44d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae76b15b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b381e30 con 0x55dd7b436fb0 2023-10-08T12:59:27.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae76b15b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b31e710 con 0x55dd7b436690 2023-10-08T12:59:27.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae76b15b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b31e3b0 con 0x55dd7b441e60 2023-10-08T12:59:27.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae76b15b80 10 client.0 _ll_register_callbacks cb 0x55dd7b17b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:59:27.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae60f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436690 0x55dd7b442240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae60f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436690 0x55dd7b442240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49646/0 (socket says 172.21.15.59:49646) 2023-10-08T12:59:27.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae60f9b700 1 -- 172.21.15.59:0/400447991 learned_addr learned my addr 172.21.15.59:0/400447991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:27.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae53fff700 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436fb0 0x55dd7b442780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae6179c700 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b44d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae60f9b700 1 -- 172.21.15.59:0/400447991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 msgr2=0x55dd7b44d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae60f9b700 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b44d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae60f9b700 1 -- 172.21.15.59:0/400447991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436fb0 msgr2=0x55dd7b442780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae60f9b700 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436fb0 0x55dd7b442780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae60f9b700 1 -- 172.21.15.59:0/400447991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae58009ce0 con 0x55dd7b436690 2023-10-08T12:59:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.870+0000 7fae6179c700 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b44d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:59:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.871+0000 7fae60f9b700 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436690 0x55dd7b442240 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fae58011e30 tx=0x7fae5800f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec6382c040afd01c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.871+0000 7fae3bfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:59:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.871+0000 7fae3bfff700 1 -- 172.21.15.59:0/400447991 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58016070 con 0x55dd7b436690 2023-10-08T12:59:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.871+0000 7fae76b15b80 1 -- 172.21.15.59:0/400447991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd7b349eb0 con 0x55dd7b436690 2023-10-08T12:59:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.871+0000 7fae3bfff700 1 -- 172.21.15.59:0/400447991 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fae58011070 con 0x55dd7b436690 2023-10-08T12:59:27.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.871+0000 7fae3bfff700 1 -- 172.21.15.59:0/400447991 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae58011230 con 0x55dd7b436690 2023-10-08T12:59:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.871+0000 7fae76b15b80 10 client.28100 fetch_fsmap learned FSMap version 20 2023-10-08T12:59:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.871+0000 7fae76b15b80 1 -- 172.21.15.59:0/400447991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7fae5c1a5b30 con 0x55dd7b436690 2023-10-08T12:59:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.872+0000 7fae3bfff700 1 -- 172.21.15.59:0/400447991 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dd7b349eb0 con 0x55dd7b436690 2023-10-08T12:59:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.872+0000 7fae3bfff700 1 -- 172.21.15.59:0/400447991 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fae58003c80 con 0x55dd7b436690 2023-10-08T12:59:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.872+0000 7fae76b15b80 10 client.28100 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:59:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.872+0000 7fae76b15b80 10 client.28100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:59:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.872+0000 7fae76b15b80 20 client.28100 populate_metadata read hostname 'smithi059' 2023-10-08T12:59:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.872+0000 7fae76b15b80 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dd7b451720 0x55dd7b453b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.872+0000 7fae76b15b80 4 client.28100 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:59:27.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.872+0000 7fae76b15b80 1 -- 172.21.15.59:0/400447991 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd7b37ae10 con 0x55dd7b451720 2023-10-08T12:59:27.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.873+0000 7fae53fff700 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dd7b451720 0x55dd7b453b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.873+0000 7fae53fff700 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dd7b451720 0x55dd7b453b40 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61a70bb5b548ef60 server_cookie=a3a53c325b93b180 in_seq=0 out_seq=0 2023-10-08T12:59:27.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.873+0000 7fae3bfff700 10 client.28100 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:27.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.877+0000 7fae3bfff700 1 -- 172.21.15.59:0/400447991 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dd7b37ae10 con 0x55dd7b451720 2023-10-08T12:59:27.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.877+0000 7fae3bfff700 10 client.28100 handle_command_reply: tid=0 2023-10-08T12:59:27.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.877+0000 7fae76b15b80 1 client.28100 shutdown 2023-10-08T12:59:27.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.877+0000 7fae76b15b80 1 -- 172.21.15.59:0/400447991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436690 msgr2=0x55dd7b442240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.877+0000 7fae76b15b80 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436690 0x55dd7b442240 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fae58011e30 tx=0x7fae5800f6a0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.877+0000 7fae76b15b80 1 -- 172.21.15.59:0/400447991 shutdown_connections 2023-10-08T12:59:27.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.877+0000 7fae76b15b80 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dd7b451720 0x55dd7b453b40 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.877+0000 7fae76b15b80 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436690 0x55dd7b442240 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.877+0000 7fae76b15b80 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b44d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.877+0000 7fae76b15b80 1 --2- 172.21.15.59:0/400447991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436fb0 0x55dd7b442780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.877+0000 7fae76b15b80 1 -- 172.21.15.59:0/400447991 >> 172.21.15.59:0/400447991 conn(0x55dd7b3a3260 msgr2=0x55dd7b429ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.878+0000 7fae3bfff700 0 client.28100 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:27.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.878+0000 7fae76b15b80 1 -- 172.21.15.59:0/400447991 shutdown_connections 2023-10-08T12:59:27.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.878+0000 7fae76b15b80 1 -- 172.21.15.59:0/400447991 wait complete. 2023-10-08T12:59:27.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.878+0000 7fae76b15b80 20 client.28100 trim_cache size 0 max 16384 2023-10-08T12:59:27.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.897+0000 7fae76b15b80 1 Processor -- start 2023-10-08T12:59:27.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.897+0000 7fae76b15b80 1 -- start start 2023-10-08T12:59:27.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.897+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b447110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.897+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b43e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.897+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b43e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.897+0000 7fae76b15b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b202920 con 0x55dd7b436690 2023-10-08T12:59:27.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.897+0000 7fae76b15b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b441ba0 con 0x55dd7b436fb0 2023-10-08T12:59:27.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.897+0000 7fae76b15b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b42b8b0 con 0x55dd7b441e60 2023-10-08T12:59:27.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.898+0000 7fae60f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b447110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.898+0000 7fae53fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b43e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.898+0000 7fae53fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b43e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49654/0 (socket says 172.21.15.59:49654) 2023-10-08T12:59:27.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.898+0000 7fae53fff700 1 -- 172.21.15.59:0/990979677 learned_addr learned my addr 172.21.15.59:0/990979677 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:27.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.898+0000 7fae6179c700 1 --2- 172.21.15.59:0/990979677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b43e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.898+0000 7fae53fff700 1 -- 172.21.15.59:0/990979677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 msgr2=0x55dd7b43e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:27.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.898+0000 7fae53fff700 1 --2- 172.21.15.59:0/990979677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b43e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.898+0000 7fae53fff700 1 -- 172.21.15.59:0/990979677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 msgr2=0x55dd7b447110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:27.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.898+0000 7fae53fff700 1 --2- 172.21.15.59:0/990979677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b447110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.898+0000 7fae53fff700 1 -- 172.21.15.59:0/990979677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd7b4264f0 con 0x55dd7b436fb0 2023-10-08T12:59:27.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.898+0000 7fae53fff700 1 --2- 172.21.15.59:0/990979677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b43e2b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fae4c097520 tx=0x7fae4c097490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=462d9d0ba08d9668 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.899+0000 7fae437fe700 1 -- 172.21.15.59:0/990979677 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c09b7a0 con 0x55dd7b436fb0 2023-10-08T12:59:27.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.899+0000 7fae437fe700 1 -- 172.21.15.59:0/990979677 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae4c06e490 con 0x55dd7b436fb0 2023-10-08T12:59:27.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.899+0000 7fae437fe700 1 -- 172.21.15.59:0/990979677 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0a10b0 con 0x55dd7b436fb0 2023-10-08T12:59:27.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.899+0000 7fae76b15b80 1 -- 172.21.15.59:0/990979677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 msgr2=0x55dd7b43e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.899+0000 7fae76b15b80 1 --2- 172.21.15.59:0/990979677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b43e2b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fae4c097520 tx=0x7fae4c097490 comp rx=0 tx=0).stop 2023-10-08T12:59:27.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.899+0000 7fae76b15b80 1 -- 172.21.15.59:0/990979677 shutdown_connections 2023-10-08T12:59:27.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.899+0000 7fae76b15b80 1 --2- 172.21.15.59:0/990979677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b43e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.899+0000 7fae76b15b80 1 --2- 172.21.15.59:0/990979677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b447110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.899+0000 7fae76b15b80 1 --2- 172.21.15.59:0/990979677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b43e2b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.899+0000 7fae76b15b80 1 -- 172.21.15.59:0/990979677 >> 172.21.15.59:0/990979677 conn(0x55dd7b3a3260 msgr2=0x55dd7b43f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.900+0000 7fae76b15b80 1 -- 172.21.15.59:0/990979677 shutdown_connections 2023-10-08T12:59:27.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.900+0000 7fae76b15b80 1 -- 172.21.15.59:0/990979677 wait complete. 2023-10-08T12:59:27.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.900+0000 7fae76b15b80 1 -- start start 2023-10-08T12:59:27.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.900+0000 7fae76b15b80 1 Processor -- start 2023-10-08T12:59:27.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b49d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b49dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae76b15b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b4994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae76b15b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b499bd0 con 0x55dd7b436690 2023-10-08T12:59:27.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae76b15b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b499d40 con 0x55dd7b436fb0 2023-10-08T12:59:27.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae76b15b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b499f00 con 0x55dd7b441e60 2023-10-08T12:59:27.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae76b15b80 10 client.0 _ll_register_callbacks cb 0x7fae58011900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:59:27.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae53fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b49dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae60f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b49d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae53fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b49dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49662/0 (socket says 172.21.15.59:49662) 2023-10-08T12:59:27.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae53fff700 1 -- 172.21.15.59:0/4125143610 learned_addr learned my addr 172.21.15.59:0/4125143610 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:27.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.901+0000 7fae6179c700 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b4994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.902+0000 7fae53fff700 1 -- 172.21.15.59:0/4125143610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 msgr2=0x55dd7b4994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.902+0000 7fae53fff700 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b4994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.902+0000 7fae53fff700 1 -- 172.21.15.59:0/4125143610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 msgr2=0x55dd7b49d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.902+0000 7fae53fff700 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b49d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.902+0000 7fae53fff700 1 -- 172.21.15.59:0/4125143610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd7b1acde0 con 0x55dd7b436fb0 2023-10-08T12:59:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.902+0000 7fae53fff700 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b49dec0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fae4c099370 tx=0x7fae4c021c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=230eedfcc619a7bf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.902+0000 7fae3bfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:59:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.902+0000 7fae3bfff700 1 -- 172.21.15.59:0/4125143610 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0a3320 con 0x55dd7b436fb0 2023-10-08T12:59:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.902+0000 7fae76b15b80 1 -- 172.21.15.59:0/4125143610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae4c09ab60 con 0x55dd7b436fb0 2023-10-08T12:59:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.902+0000 7fae3bfff700 1 -- 172.21.15.59:0/4125143610 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fae4c09b020 con 0x55dd7b436fb0 2023-10-08T12:59:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.903+0000 7fae3bfff700 1 -- 172.21.15.59:0/4125143610 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae4c0a10b0 con 0x55dd7b436fb0 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.903+0000 7fae76b15b80 10 client.28106 fetch_fsmap learned FSMap version 20 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.903+0000 7fae76b15b80 1 -- 172.21.15.59:0/4125143610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55dd7b195c60 con 0x55dd7b436fb0 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.904+0000 7fae3bfff700 1 -- 172.21.15.59:0/4125143610 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae4c09ab60 con 0x55dd7b436fb0 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.904+0000 7fae3bfff700 1 -- 172.21.15.59:0/4125143610 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fae4c09a510 con 0x55dd7b436fb0 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.904+0000 7fae76b15b80 10 client.28106 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.904+0000 7fae76b15b80 10 client.28106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.904+0000 7fae76b15b80 20 client.28106 populate_metadata read hostname 'smithi059' 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.904+0000 7fae76b15b80 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dd7b4a6310 0x55dd7b4a8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.904+0000 7fae76b15b80 4 client.28106 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.904+0000 7fae76b15b80 1 -- 172.21.15.59:0/4125143610 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dd7b37ab30 con 0x55dd7b4a6310 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.904+0000 7fae60f9b700 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dd7b4a6310 0x55dd7b4a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.905+0000 7fae60f9b700 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dd7b4a6310 0x55dd7b4a8700 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c97dc6961afd8887 server_cookie=1c51226db413618 in_seq=0 out_seq=0 2023-10-08T12:59:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.905+0000 7fae3bfff700 10 client.28106 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae3bfff700 1 -- 172.21.15.59:0/4125143610 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dd7b37ab30 con 0x55dd7b4a6310 2023-10-08T12:59:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae3bfff700 10 client.28106 handle_command_reply: tid=0 2023-10-08T12:59:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae76b15b80 1 client.28106 shutdown 2023-10-08T12:59:27.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae76b15b80 1 -- 172.21.15.59:0/4125143610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 msgr2=0x55dd7b49dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae76b15b80 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b49dec0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fae4c099370 tx=0x7fae4c021c00 comp rx=0 tx=0).stop 2023-10-08T12:59:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae76b15b80 1 -- 172.21.15.59:0/4125143610 shutdown_connections 2023-10-08T12:59:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae76b15b80 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55dd7b4a6310 0x55dd7b4a8700 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae76b15b80 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dd7b441e60 0x55dd7b4994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae76b15b80 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd7b436690 0x55dd7b49d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae76b15b80 1 --2- 172.21.15.59:0/4125143610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7b436fb0 0x55dd7b49dec0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae76b15b80 1 -- 172.21.15.59:0/4125143610 >> 172.21.15.59:0/4125143610 conn(0x55dd7b3a3260 msgr2=0x55dd7b43fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.908+0000 7fae3bfff700 0 client.28106 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:27.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.909+0000 7fae76b15b80 1 -- 172.21.15.59:0/4125143610 shutdown_connections 2023-10-08T12:59:27.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.909+0000 7fae76b15b80 1 -- 172.21.15.59:0/4125143610 wait complete. 2023-10-08T12:59:27.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.909+0000 7fae76b15b80 20 client.28106 trim_cache size 0 max 16384 2023-10-08T12:59:27.911 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T12:59:27.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 -- 172.21.15.59:0/1597875611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae440a16f0 msgr2=0x7fae440a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae440a16f0 0x7fae440a3bb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fae54009ec0 tx=0x7fae54004ad0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 -- 172.21.15.59:0/1597875611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5c1010f0 msgr2=0x7fae5c199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5c1010f0 0x7fae5c199300 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fae4c000c00 tx=0x7fae4c004730 comp rx=0 tx=0).stop 2023-10-08T12:59:27.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 -- 172.21.15.59:0/1597875611 shutdown_connections 2023-10-08T12:59:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fae440a16f0 0x7fae440a3bb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae5c106740 0x7fae5c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae5c100730 0x7fae5c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 --2- 172.21.15.59:0/1597875611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5c1010f0 0x7fae5c199300 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 -- 172.21.15.59:0/1597875611 >> 172.21.15.59:0/1597875611 conn(0x7fae5c0fc200 msgr2=0x7fae5c10bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 -- 172.21.15.59:0/1597875611 shutdown_connections 2023-10-08T12:59:27.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:27.910+0000 7fae631ff700 1 -- 172.21.15.59:0/1597875611 wait complete. 2023-10-08T12:59:27.972 INFO:tasks.workunit.client.0.smithi059.stdout: 10 115065 20.33 MB/sec execute 178 sec latency 133.793 ms 2023-10-08T12:59:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:28 smithi059 ceph-mon[98489]: pgmap v886: 97 pgs: 97 active+clean; 970 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 355 op/s 2023-10-08T12:59:28.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:28 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2195940115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:59:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:28 smithi173 ceph-mon[135182]: pgmap v886: 97 pgs: 97 active+clean; 970 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 355 op/s 2023-10-08T12:59:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:28 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2195940115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:59:28.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:28 smithi092 ceph-mon[134093]: pgmap v886: 97 pgs: 97 active+clean; 970 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 355 op/s 2023-10-08T12:59:28.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:28 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2195940115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:59:28.937 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:59:28.937 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:59:28.972 INFO:tasks.workunit.client.0.smithi059.stdout: 10 115463 20.40 MB/sec execute 179 sec latency 100.482 ms 2023-10-08T12:59:29.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.197+0000 7fe3e3dff700 1 -- 172.21.15.59:0/617268436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc101100 msgr2=0x7fe3dc10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.197+0000 7fe3e3dff700 1 --2- 172.21.15.59:0/617268436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc101100 0x7fe3dc10d610 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400b0a0 tx=0x7fe3d400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.197+0000 7fe3e3dff700 1 -- 172.21.15.59:0/617268436 shutdown_connections 2023-10-08T12:59:29.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.197+0000 7fe3e3dff700 1 --2- 172.21.15.59:0/617268436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc101100 0x7fe3dc10d610 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.197+0000 7fe3e3dff700 1 --2- 172.21.15.59:0/617268436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3dc106750 0x7fe3dc106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.197+0000 7fe3e3dff700 1 --2- 172.21.15.59:0/617268436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3dc100740 0x7fe3dc100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.197+0000 7fe3e3dff700 1 -- 172.21.15.59:0/617268436 >> 172.21.15.59:0/617268436 conn(0x7fe3dc0fc230 msgr2=0x7fe3dc0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.197+0000 7fe3e3dff700 1 -- 172.21.15.59:0/617268436 shutdown_connections 2023-10-08T12:59:29.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.198+0000 7fe3e3dff700 1 -- 172.21.15.59:0/617268436 wait complete. 2023-10-08T12:59:29.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.199+0000 7fe3e3dff700 1 Processor -- start 2023-10-08T12:59:29.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.199+0000 7fe3e3dff700 1 -- start start 2023-10-08T12:59:29.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.200+0000 7fe3e3dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3dc100740 0x7fe3dc19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.200+0000 7fe3e3dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3dc101100 0x7fe3dc19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.200+0000 7fe3e3dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc106750 0x7fe3dc196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.200+0000 7fe3e3dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc196ff0 con 0x7fe3dc100740 2023-10-08T12:59:29.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.200+0000 7fe3e3dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc197160 con 0x7fe3dc106750 2023-10-08T12:59:29.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.200+0000 7fe3e3dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc197320 con 0x7fe3dc101100 2023-10-08T12:59:29.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.200+0000 7fe3e1b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3dc100740 0x7fe3dc19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.200+0000 7fe3e1b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3dc100740 0x7fe3dc19c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36778/0 (socket says 172.21.15.59:36778) 2023-10-08T12:59:29.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.200+0000 7fe3e1b9b700 1 -- 172.21.15.59:0/2561619342 learned_addr learned my addr 172.21.15.59:0/2561619342 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:29.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.200+0000 7fe3e239c700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc106750 0x7fe3dc196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.200+0000 7fe3e139a700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3dc101100 0x7fe3dc19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.201+0000 7fe3e239c700 1 -- 172.21.15.59:0/2561619342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3dc101100 msgr2=0x7fe3dc19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.201+0000 7fe3e239c700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3dc101100 0x7fe3dc19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.201+0000 7fe3e239c700 1 -- 172.21.15.59:0/2561619342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3dc100740 msgr2=0x7fe3dc19c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.201+0000 7fe3e239c700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3dc100740 0x7fe3dc19c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.201+0000 7fe3e239c700 1 -- 172.21.15.59:0/2561619342 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc009520 con 0x7fe3dc106750 2023-10-08T12:59:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.201+0000 7fe3e1b9b700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3dc100740 0x7fe3dc19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.201+0000 7fe3e239c700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc106750 0x7fe3dc196990 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400b070 tx=0x7fe3d40077f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.201+0000 7fe3d2ffd700 1 -- 172.21.15.59:0/2561619342 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400e040 con 0x7fe3dc106750 2023-10-08T12:59:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.201+0000 7fe3d2ffd700 1 -- 172.21.15.59:0/2561619342 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3d4004e60 con 0x7fe3dc106750 2023-10-08T12:59:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.201+0000 7fe3e3dff700 1 -- 172.21.15.59:0/2561619342 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d4009d00 con 0x7fe3dc106750 2023-10-08T12:59:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.201+0000 7fe3d2ffd700 1 -- 172.21.15.59:0/2561619342 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4005040 con 0x7fe3dc106750 2023-10-08T12:59:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.202+0000 7fe3e3dff700 1 -- 172.21.15.59:0/2561619342 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc1a3670 con 0x7fe3dc106750 2023-10-08T12:59:29.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.205+0000 7fe3d2ffd700 1 -- 172.21.15.59:0/2561619342 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe3d40051a0 con 0x7fe3dc106750 2023-10-08T12:59:29.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.206+0000 7fe3f7655b80 1 Processor -- start 2023-10-08T12:59:29.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.206+0000 7fe3f7655b80 1 -- start start 2023-10-08T12:59:29.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561840447760 0x561840447b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840438f10 0x561840439390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618404398d0 0x56184044e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618403a14e0 con 0x561840438f10 2023-10-08T12:59:29.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561840392ca0 con 0x5618404398d0 2023-10-08T12:59:29.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618403905c0 con 0x561840447760 2023-10-08T12:59:29.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3e139a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618404398d0 0x56184044e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3e1b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840438f10 0x561840439390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3e139a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618404398d0 0x56184044e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49692/0 (socket says 172.21.15.59:49692) 2023-10-08T12:59:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3e139a700 1 -- 172.21.15.59:0/4125599226 learned_addr learned my addr 172.21.15.59:0/4125599226 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3e139a700 1 --2- 172.21.15.59:0/4125599226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561840447760 0x561840447b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3d2ffd700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe3c80a1670 0x7fe3c80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3e139a700 1 -- 172.21.15.59:0/4125599226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561840447760 msgr2=0x561840447b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3e139a700 1 --2- 172.21.15.59:0/4125599226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561840447760 0x561840447b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3e139a700 1 -- 172.21.15.59:0/4125599226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840438f10 msgr2=0x561840439390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3e139a700 1 --2- 172.21.15.59:0/4125599226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840438f10 0x561840439390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.207+0000 7fe3e139a700 1 -- 172.21.15.59:0/4125599226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618401b6e60 con 0x5618404398d0 2023-10-08T12:59:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.208+0000 7fe3d2ffd700 1 -- 172.21.15.59:0/2561619342 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe3d40ce4e0 con 0x7fe3dc106750 2023-10-08T12:59:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.208+0000 7fe3e139a700 1 --2- 172.21.15.59:0/4125599226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618404398d0 0x56184044e510 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc011a10 tx=0x7fe3cc009400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4acb48f8a51b94a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.208+0000 7fe3c7fff700 1 -- 172.21.15.59:0/4125599226 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc011110 con 0x5618404398d0 2023-10-08T12:59:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.208+0000 7fe3c7fff700 1 -- 172.21.15.59:0/4125599226 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3cc0044f0 con 0x5618404398d0 2023-10-08T12:59:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.208+0000 7fe3c7fff700 1 -- 172.21.15.59:0/4125599226 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc003d80 con 0x5618404398d0 2023-10-08T12:59:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.208+0000 7fe3e239c700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe3c80a1670 0x7fe3c80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.209+0000 7fe3f7655b80 1 -- 172.21.15.59:0/4125599226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618404398d0 msgr2=0x56184044e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.209+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/4125599226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618404398d0 0x56184044e510 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc011a10 tx=0x7fe3cc009400 comp rx=0 tx=0).stop 2023-10-08T12:59:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.209+0000 7fe3e239c700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe3c80a1670 0x7fe3c80a3b30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe3d409b240 tx=0x7fe3d40099e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.209+0000 7fe3f7655b80 1 -- 172.21.15.59:0/4125599226 shutdown_connections 2023-10-08T12:59:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.209+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/4125599226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618404398d0 0x56184044e510 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.209+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/4125599226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561840447760 0x561840447b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.209+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/4125599226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840438f10 0x561840439390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.209+0000 7fe3f7655b80 1 -- 172.21.15.59:0/4125599226 >> 172.21.15.59:0/4125599226 conn(0x5618403ad2e0 msgr2=0x561840434200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.209+0000 7fe3f7655b80 1 -- 172.21.15.59:0/4125599226 shutdown_connections 2023-10-08T12:59:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.209+0000 7fe3f7655b80 1 -- 172.21.15.59:0/4125599226 wait complete. 2023-10-08T12:59:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.210+0000 7fe3f7655b80 1 -- start start 2023-10-08T12:59:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.210+0000 7fe3f7655b80 1 Processor -- start 2023-10-08T12:59:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.211+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 0x56184044e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.211+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x56184044b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.211+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840447760 0x56184044bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.211+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184038beb0 con 0x561840447760 2023-10-08T12:59:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.211+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561840328790 con 0x561840438f10 2023-10-08T12:59:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.211+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561840328430 con 0x5618404398d0 2023-10-08T12:59:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.211+0000 7fe3f7655b80 10 client.0 _ll_register_callbacks cb 0x561840185880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:59:29.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.211+0000 7fe3e139a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 0x56184044e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.212+0000 7fe3e139a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 0x56184044e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49698/0 (socket says 172.21.15.59:49698) 2023-10-08T12:59:29.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.212+0000 7fe3e139a700 1 -- 172.21.15.59:0/956411847 learned_addr learned my addr 172.21.15.59:0/956411847 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:29.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.212+0000 7fe3e139a700 1 -- 172.21.15.59:0/956411847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 msgr2=0x56184044b800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:59:29.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.212+0000 7fe3e139a700 1 --2- 172.21.15.59:0/956411847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x56184044b800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.212+0000 7fe3e139a700 1 -- 172.21.15.59:0/956411847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840447760 msgr2=0x56184044bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.212+0000 7fe3e139a700 1 --2- 172.21.15.59:0/956411847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840447760 0x56184044bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.212+0000 7fe3e139a700 1 -- 172.21.15.59:0/956411847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc019040 con 0x561840438f10 2023-10-08T12:59:29.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.212+0000 7fe3e139a700 1 --2- 172.21.15.59:0/956411847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 0x56184044e4c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc005c50 tx=0x7fe3cc009930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd1e219315e804e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.212+0000 7fe3c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:59:29.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3c57fa700 1 -- 172.21.15.59:0/956411847 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc005250 con 0x561840438f10 2023-10-08T12:59:29.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3f7655b80 1 -- 172.21.15.59:0/956411847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561840353f30 con 0x561840438f10 2023-10-08T12:59:29.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3c57fa700 1 -- 172.21.15.59:0/956411847 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe3cc0053b0 con 0x561840438f10 2023-10-08T12:59:29.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3c57fa700 1 -- 172.21.15.59:0/956411847 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3cc005570 con 0x561840438f10 2023-10-08T12:59:29.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3f7655b80 10 client.28118 fetch_fsmap learned FSMap version 20 2023-10-08T12:59:29.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3f7655b80 1 -- 172.21.15.59:0/956411847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x56184019fce0 con 0x561840438f10 2023-10-08T12:59:29.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3c57fa700 1 -- 172.21.15.59:0/956411847 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561840353f30 con 0x561840438f10 2023-10-08T12:59:29.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3c57fa700 1 -- 172.21.15.59:0/956411847 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe3cc003c50 con 0x561840438f10 2023-10-08T12:59:29.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3f7655b80 10 client.28118 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:59:29.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3f7655b80 10 client.28118 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:59:29.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3f7655b80 20 client.28118 populate_metadata read hostname 'smithi059' 2023-10-08T12:59:29.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.213+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/956411847 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56184045b9a0 0x56184045ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.214+0000 7fe3f7655b80 4 client.28118 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:59:29.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.214+0000 7fe3f7655b80 1 -- 172.21.15.59:0/956411847 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561840384e90 con 0x56184045b9a0 2023-10-08T12:59:29.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.214+0000 7fe3e1b9b700 1 --2- 172.21.15.59:0/956411847 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56184045b9a0 0x56184045ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.214+0000 7fe3e1b9b700 1 --2- 172.21.15.59:0/956411847 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56184045b9a0 0x56184045ddc0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=477c80395f9b8b66 server_cookie=c375eec9d94b7bba in_seq=0 out_seq=0 2023-10-08T12:59:29.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.214+0000 7fe3c57fa700 10 client.28118 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.219+0000 7fe3c57fa700 1 -- 172.21.15.59:0/956411847 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561840384e90 con 0x56184045b9a0 2023-10-08T12:59:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.219+0000 7fe3c57fa700 10 client.28118 handle_command_reply: tid=0 2023-10-08T12:59:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.219+0000 7fe3f7655b80 1 client.28118 shutdown 2023-10-08T12:59:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3f7655b80 1 -- 172.21.15.59:0/956411847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 msgr2=0x56184044e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/956411847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 0x56184044e4c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc005c50 tx=0x7fe3cc009930 comp rx=0 tx=0).stop 2023-10-08T12:59:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3f7655b80 1 -- 172.21.15.59:0/956411847 shutdown_connections 2023-10-08T12:59:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/956411847 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x56184045b9a0 0x56184045ddc0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/956411847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 0x56184044e4c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/956411847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840447760 0x56184044bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/956411847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x56184044b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3c57fa700 0 client.28118 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:29.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3f7655b80 1 -- 172.21.15.59:0/956411847 >> 172.21.15.59:0/956411847 conn(0x5618403ad2e0 msgr2=0x561840433df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3f7655b80 1 -- 172.21.15.59:0/956411847 shutdown_connections 2023-10-08T12:59:29.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3f7655b80 1 -- 172.21.15.59:0/956411847 wait complete. 2023-10-08T12:59:29.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.220+0000 7fe3f7655b80 20 client.28118 trim_cache size 0 max 16384 2023-10-08T12:59:29.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.240+0000 7fe3f7655b80 1 Processor -- start 2023-10-08T12:59:29.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.240+0000 7fe3f7655b80 1 -- start start 2023-10-08T12:59:29.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.240+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840438f10 0x5618404493e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.240+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840452b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.240+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840447760 0x56184044a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.240+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184020c9a0 con 0x561840438f10 2023-10-08T12:59:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.240+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x561840442b10 con 0x561840447760 2023-10-08T12:59:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.240+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184042e5f0 con 0x5618404398d0 2023-10-08T12:59:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e1b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840452b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e139a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840438f10 0x5618404493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e1b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840452b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34552/0 (socket says 172.21.15.59:34552) 2023-10-08T12:59:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e1b9b700 1 -- 172.21.15.59:0/6730062 learned_addr learned my addr 172.21.15.59:0/6730062 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e139a700 1 --2- 172.21.15.59:0/6730062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840447760 0x56184044a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e1b9b700 1 -- 172.21.15.59:0/6730062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840447760 msgr2=0x56184044a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e1b9b700 1 --2- 172.21.15.59:0/6730062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840447760 0x56184044a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e1b9b700 1 -- 172.21.15.59:0/6730062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840438f10 msgr2=0x5618404493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e1b9b700 1 --2- 172.21.15.59:0/6730062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840438f10 0x5618404493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e1b9b700 1 -- 172.21.15.59:0/6730062 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618401dd2d0 con 0x5618404398d0 2023-10-08T12:59:29.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e139a700 1 --2- 172.21.15.59:0/6730062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840447760 0x56184044a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:59:29.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3e1b9b700 1 --2- 172.21.15.59:0/6730062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840452b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x56184044ea20 tx=0x7fe3d80045f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37f7c237f63c841 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.241+0000 7fe3d0bff700 1 -- 172.21.15.59:0/6730062 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8016040 con 0x5618404398d0 2023-10-08T12:59:29.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.242+0000 7fe3d0bff700 1 -- 172.21.15.59:0/6730062 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3d801bdc0 con 0x5618404398d0 2023-10-08T12:59:29.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.242+0000 7fe3d0bff700 1 -- 172.21.15.59:0/6730062 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8004c60 con 0x5618404398d0 2023-10-08T12:59:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.242+0000 7fe3f7655b80 1 -- 172.21.15.59:0/6730062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 msgr2=0x561840452b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.242+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/6730062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840452b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x56184044ea20 tx=0x7fe3d80045f0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.242+0000 7fe3f7655b80 1 -- 172.21.15.59:0/6730062 shutdown_connections 2023-10-08T12:59:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.242+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/6730062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840447760 0x56184044a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.242+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/6730062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840438f10 0x5618404493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.242+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/6730062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840452b10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.242+0000 7fe3f7655b80 1 -- 172.21.15.59:0/6730062 >> 172.21.15.59:0/6730062 conn(0x5618403ad2e0 msgr2=0x5618404469b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.242+0000 7fe3f7655b80 1 -- 172.21.15.59:0/6730062 shutdown_connections 2023-10-08T12:59:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.242+0000 7fe3f7655b80 1 -- 172.21.15.59:0/6730062 wait complete. 2023-10-08T12:59:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.243+0000 7fe3f7655b80 1 -- start start 2023-10-08T12:59:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.243+0000 7fe3f7655b80 1 Processor -- start 2023-10-08T12:59:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 0x561840451920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840451e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3f7655b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840447760 0x5618404af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618404afd20 con 0x561840447760 2023-10-08T12:59:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618404afe60 con 0x561840438f10 2023-10-08T12:59:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3f7655b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618404b0020 con 0x5618404398d0 2023-10-08T12:59:29.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3f7655b80 10 client.0 _ll_register_callbacks cb 0x7fe3cc011910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:59:29.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3e1b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840451e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3e139a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 0x561840451920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3e1b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840451e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34558/0 (socket says 172.21.15.59:34558) 2023-10-08T12:59:29.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3e1b9b700 1 -- 172.21.15.59:0/1810400368 learned_addr learned my addr 172.21.15.59:0/1810400368 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:29.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.244+0000 7fe3e139a700 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840447760 0x5618404af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3e1b9b700 1 -- 172.21.15.59:0/1810400368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 msgr2=0x561840451920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3e1b9b700 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 0x561840451920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3e1b9b700 1 -- 172.21.15.59:0/1810400368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840447760 msgr2=0x5618404af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3e1b9b700 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840447760 0x5618404af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3e1b9b700 1 -- 172.21.15.59:0/1810400368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d8004040 con 0x5618404398d0 2023-10-08T12:59:29.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3e139a700 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 0x561840451920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3e1b9b700 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840451e60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009d90 tx=0x7fe3d8005860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2219fc02a778c680 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:59:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3c57fa700 1 -- 172.21.15.59:0/1810400368 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8016040 con 0x5618404398d0 2023-10-08T12:59:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3f7655b80 1 -- 172.21.15.59:0/1810400368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe3cc0044f0 con 0x5618404398d0 2023-10-08T12:59:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3c57fa700 1 -- 172.21.15.59:0/1810400368 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe3d8011250 con 0x5618404398d0 2023-10-08T12:59:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3c57fa700 1 -- 172.21.15.59:0/1810400368 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3d801b900 con 0x5618404398d0 2023-10-08T12:59:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3f7655b80 10 client.28108 fetch_fsmap learned FSMap version 20 2023-10-08T12:59:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.245+0000 7fe3f7655b80 1 -- 172.21.15.59:0/1810400368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x5618401b5330 con 0x5618404398d0 2023-10-08T12:59:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.246+0000 7fe3c57fa700 1 -- 172.21.15.59:0/1810400368 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3cc0044f0 con 0x5618404398d0 2023-10-08T12:59:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.246+0000 7fe3c57fa700 1 -- 172.21.15.59:0/1810400368 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe3d80039e0 con 0x5618404398d0 2023-10-08T12:59:29.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.246+0000 7fe3f7655b80 10 client.28108 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:59:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.246+0000 7fe3f7655b80 10 client.28108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:59:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.246+0000 7fe3f7655b80 20 client.28108 populate_metadata read hostname 'smithi059' 2023-10-08T12:59:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.246+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5618404b17e0 0x5618404b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.246+0000 7fe3f7655b80 4 client.28108 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:59:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.246+0000 7fe3f7655b80 1 -- 172.21.15.59:0/1810400368 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561840384bb0 con 0x5618404b17e0 2023-10-08T12:59:29.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.246+0000 7fe3e139a700 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5618404b17e0 0x5618404b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.247+0000 7fe3c57fa700 10 client.28108 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.247+0000 7fe3e139a700 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5618404b17e0 0x5618404b3c00 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3a0544e3799da4 server_cookie=a4b898ae93802418 in_seq=0 out_seq=0 2023-10-08T12:59:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.250+0000 7fe3c57fa700 1 -- 172.21.15.59:0/1810400368 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561840384bb0 con 0x5618404b17e0 2023-10-08T12:59:29.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.250+0000 7fe3c57fa700 10 client.28108 handle_command_reply: tid=0 2023-10-08T12:59:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.250+0000 7fe3f7655b80 1 client.28108 shutdown 2023-10-08T12:59:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3f7655b80 1 -- 172.21.15.59:0/1810400368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 msgr2=0x561840451e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840451e60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009d90 tx=0x7fe3d8005860 comp rx=0 tx=0).stop 2023-10-08T12:59:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3f7655b80 1 -- 172.21.15.59:0/1810400368 shutdown_connections 2023-10-08T12:59:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x5618404b17e0 0x5618404b3c00 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561840438f10 0x561840451920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561840447760 0x5618404af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3c57fa700 0 client.28108 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3f7655b80 1 --2- 172.21.15.59:0/1810400368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618404398d0 0x561840451e60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3f7655b80 1 -- 172.21.15.59:0/1810400368 >> 172.21.15.59:0/1810400368 conn(0x5618403ad2e0 msgr2=0x56184044a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3f7655b80 1 -- 172.21.15.59:0/1810400368 shutdown_connections 2023-10-08T12:59:29.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3f7655b80 1 -- 172.21.15.59:0/1810400368 wait complete. 2023-10-08T12:59:29.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.251+0000 7fe3f7655b80 20 client.28108 trim_cache size 0 max 16384 2023-10-08T12:59:29.254 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:59:29.254 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T12:59:29.254 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "2b94a71a-66db-4de7-a5fa-93cdda45b423", 2023-10-08T12:59:29.254 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T12:59:29.254 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:59:29.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 -- 172.21.15.59:0/2561619342 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe3c80a1670 msgr2=0x7fe3c80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe3c80a1670 0x7fe3c80a3b30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe3d409b240 tx=0x7fe3d40099e0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 -- 172.21.15.59:0/2561619342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc106750 msgr2=0x7fe3dc196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc106750 0x7fe3dc196990 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400b070 tx=0x7fe3d40077f0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 -- 172.21.15.59:0/2561619342 shutdown_connections 2023-10-08T12:59:29.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fe3c80a1670 0x7fe3c80a3b30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc106750 0x7fe3dc196990 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3dc100740 0x7fe3dc19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 --2- 172.21.15.59:0/2561619342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3dc101100 0x7fe3dc19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 -- 172.21.15.59:0/2561619342 >> 172.21.15.59:0/2561619342 conn(0x7fe3dc0fc230 msgr2=0x7fe3dc0fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 -- 172.21.15.59:0/2561619342 shutdown_connections 2023-10-08T12:59:29.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.252+0000 7fe3e3dff700 1 -- 172.21.15.59:0/2561619342 wait complete. 2023-10-08T12:59:29.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:59:29.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.535+0000 7f11315ff700 1 -- 172.21.15.59:0/2541510177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f112c067ce0 msgr2=0x7f112c0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.535+0000 7f11315ff700 1 --2- 172.21.15.59:0/2541510177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f112c067ce0 0x7f112c0680c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f111c009990 tx=0x7f111c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.540+0000 7f11315ff700 1 -- 172.21.15.59:0/2541510177 shutdown_connections 2023-10-08T12:59:29.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.540+0000 7f11315ff700 1 --2- 172.21.15.59:0/2541510177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f112c067ce0 0x7f112c0680c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.540+0000 7f11315ff700 1 --2- 172.21.15.59:0/2541510177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112c105b80 0x7f112c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.540+0000 7f11315ff700 1 --2- 172.21.15.59:0/2541510177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f112c1051c0 0x7f112c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.540+0000 7f11315ff700 1 -- 172.21.15.59:0/2541510177 >> 172.21.15.59:0/2541510177 conn(0x7f112c076780 msgr2=0x7f112c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.554+0000 7f11315ff700 1 -- 172.21.15.59:0/2541510177 shutdown_connections 2023-10-08T12:59:29.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.557+0000 7f11315ff700 1 -- 172.21.15.59:0/2541510177 wait complete. 2023-10-08T12:59:29.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.558+0000 7f11315ff700 1 Processor -- start 2023-10-08T12:59:29.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.563+0000 7f11315ff700 1 -- start start 2023-10-08T12:59:29.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.564+0000 7f11315ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112c067ce0 0x7f112c10c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.564+0000 7f11315ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f112c1051c0 0x7f112c10cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.564+0000 7f11315ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f112c105b80 0x7f112c06c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.564+0000 7f11315ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c06ccf0 con 0x7f112c067ce0 2023-10-08T12:59:29.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.564+0000 7f11315ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c06ce60 con 0x7f112c1051c0 2023-10-08T12:59:29.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.564+0000 7f11315ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c06d020 con 0x7f112c105b80 2023-10-08T12:59:29.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.564+0000 7f112a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f112c1051c0 0x7f112c10cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.564+0000 7f112a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f112c1051c0 0x7f112c10cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49728/0 (socket says 172.21.15.59:49728) 2023-10-08T12:59:29.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.564+0000 7f112a7fc700 1 -- 172.21.15.59:0/3431652469 learned_addr learned my addr 172.21.15.59:0/3431652469 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:29.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.564+0000 7f112b7fe700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f112c105b80 0x7f112c06c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.565+0000 7f112affd700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112c067ce0 0x7f112c10c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.566+0000 7f112a7fc700 1 -- 172.21.15.59:0/3431652469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f112c105b80 msgr2=0x7f112c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.566+0000 7f112a7fc700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f112c105b80 0x7f112c06c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.566+0000 7f112a7fc700 1 -- 172.21.15.59:0/3431652469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112c067ce0 msgr2=0x7f112c10c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.566+0000 7f112a7fc700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112c067ce0 0x7f112c10c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.566+0000 7f112a7fc700 1 -- 172.21.15.59:0/3431652469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c0095f0 con 0x7f112c1051c0 2023-10-08T12:59:29.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.572+0000 7f112a7fc700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f112c1051c0 0x7f112c10cd10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f112000d950 tx=0x7f112000dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.579+0000 7f1113fff700 1 -- 172.21.15.59:0/3431652469 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120009b40 con 0x7f112c1051c0 2023-10-08T12:59:29.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.579+0000 7f1113fff700 1 -- 172.21.15.59:0/3431652469 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1120009ca0 con 0x7f112c1051c0 2023-10-08T12:59:29.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.579+0000 7f1113fff700 1 -- 172.21.15.59:0/3431652469 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112000f620 con 0x7f112c1051c0 2023-10-08T12:59:29.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.580+0000 7f11315ff700 1 -- 172.21.15.59:0/3431652469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c06d300 con 0x7f112c1051c0 2023-10-08T12:59:29.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.581+0000 7f11315ff700 1 -- 172.21.15.59:0/3431652469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c06d990 con 0x7f112c1051c0 2023-10-08T12:59:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.588+0000 7f1144f50b80 1 Processor -- start 2023-10-08T12:59:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.588+0000 7f1144f50b80 1 -- start start 2023-10-08T12:59:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.588+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 0x55c386c57260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.588+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c62110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.588+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c62650 0x55c386c64a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.588+0000 7f1144f50b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386bc0460 con 0x55c386c56e80 2023-10-08T12:59:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.588+0000 7f1144f50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386bb1c20 con 0x55c386c62650 2023-10-08T12:59:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.588+0000 7f1144f50b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386baf540 con 0x55c386c577a0 2023-10-08T12:59:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.590+0000 7f112a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c62650 0x55c386c64a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.590+0000 7f112a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c62650 0x55c386c64a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49738/0 (socket says 172.21.15.59:49738) 2023-10-08T12:59:29.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.590+0000 7f112a7fc700 1 -- 172.21.15.59:0/1198660134 learned_addr learned my addr 172.21.15.59:0/1198660134 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:29.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.592+0000 7f112affd700 1 --2- 172.21.15.59:0/1198660134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c62110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.594+0000 7f1113fff700 1 -- 172.21.15.59:0/3431652469 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1120010460 con 0x7f112c1051c0 2023-10-08T12:59:29.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.595+0000 7f112b7fe700 1 --2- 172.21.15.59:0/1198660134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 0x55c386c57260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.595+0000 7f112affd700 1 -- 172.21.15.59:0/1198660134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c62650 msgr2=0x55c386c64a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.595+0000 7f112affd700 1 --2- 172.21.15.59:0/1198660134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c62650 0x55c386c64a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.595+0000 7f112affd700 1 -- 172.21.15.59:0/1198660134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 msgr2=0x55c386c57260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.595+0000 7f112affd700 1 --2- 172.21.15.59:0/1198660134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 0x55c386c57260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.595+0000 7f112affd700 1 -- 172.21.15.59:0/1198660134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3869d5de0 con 0x55c386c577a0 2023-10-08T12:59:29.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.597+0000 7f112affd700 1 --2- 172.21.15.59:0/1198660134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c62110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f111c0098e0 tx=0x7f111c003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f08643d93b8b7094 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.597+0000 7f1113fff700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11140a16f0 0x7f11140a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.597+0000 7f1113fff700 1 -- 172.21.15.59:0/3431652469 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f11200d2640 con 0x7f112c1051c0 2023-10-08T12:59:29.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.600+0000 7f112b7fe700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11140a16f0 0x7f11140a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.601+0000 7f112b7fe700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11140a16f0 0x7f11140a3bb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f112400b4d0 tx=0x7f112400e040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.604+0000 7f11117fa700 1 -- 172.21.15.59:0/1198660134 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c005e20 con 0x55c386c577a0 2023-10-08T12:59:29.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.604+0000 7f11117fa700 1 -- 172.21.15.59:0/1198660134 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f111c01e040 con 0x55c386c577a0 2023-10-08T12:59:29.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.604+0000 7f11117fa700 1 -- 172.21.15.59:0/1198660134 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c0054b0 con 0x55c386c577a0 2023-10-08T12:59:29.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.609+0000 7f1144f50b80 1 -- 172.21.15.59:0/1198660134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 msgr2=0x55c386c62110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.609+0000 7f1144f50b80 1 --2- 172.21.15.59:0/1198660134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c62110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f111c0098e0 tx=0x7f111c003680 comp rx=0 tx=0).stop 2023-10-08T12:59:29.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.609+0000 7f1144f50b80 1 -- 172.21.15.59:0/1198660134 shutdown_connections 2023-10-08T12:59:29.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.609+0000 7f1144f50b80 1 --2- 172.21.15.59:0/1198660134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c62650 0x55c386c64a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.609+0000 7f1144f50b80 1 --2- 172.21.15.59:0/1198660134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 0x55c386c57260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.609+0000 7f1144f50b80 1 --2- 172.21.15.59:0/1198660134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c62110 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.609+0000 7f1144f50b80 1 -- 172.21.15.59:0/1198660134 >> 172.21.15.59:0/1198660134 conn(0x55c386bcc260 msgr2=0x55c386c532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.611+0000 7f1144f50b80 1 -- 172.21.15.59:0/1198660134 shutdown_connections 2023-10-08T12:59:29.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.611+0000 7f1144f50b80 1 -- 172.21.15.59:0/1198660134 wait complete. 2023-10-08T12:59:29.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.612+0000 7f1144f50b80 1 -- start start 2023-10-08T12:59:29.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.612+0000 7f1144f50b80 1 Processor -- start 2023-10-08T12:59:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.613+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386c620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.613+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c5f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.613+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c62650 0x55c386c5fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.613+0000 7f1144f50b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386baae30 con 0x55c386c62650 2023-10-08T12:59:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.613+0000 7f1144f50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386b47710 con 0x55c386c56e80 2023-10-08T12:59:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.613+0000 7f1144f50b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386b473b0 con 0x55c386c577a0 2023-10-08T12:59:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.613+0000 7f1144f50b80 10 client.0 _ll_register_callbacks cb 0x55c3869a4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:59:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.614+0000 7f112affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386c620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.614+0000 7f112affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386c620d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49748/0 (socket says 172.21.15.59:49748) 2023-10-08T12:59:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.614+0000 7f112affd700 1 -- 172.21.15.59:0/1124088257 learned_addr learned my addr 172.21.15.59:0/1124088257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:29.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.615+0000 7f112affd700 1 -- 172.21.15.59:0/1124088257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 msgr2=0x55c386c5f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.615+0000 7f112affd700 1 --2- 172.21.15.59:0/1124088257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c5f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.615+0000 7f112affd700 1 -- 172.21.15.59:0/1124088257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c62650 msgr2=0x55c386c5fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.615+0000 7f112affd700 1 --2- 172.21.15.59:0/1124088257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c62650 0x55c386c5fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.615+0000 7f112affd700 1 -- 172.21.15.59:0/1124088257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c10dec0 con 0x55c386c56e80 2023-10-08T12:59:29.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.618+0000 7f112affd700 1 --2- 172.21.15.59:0/1124088257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386c620d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f111c005b10 tx=0x7f111c00bc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35eb41d878b38cb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.619+0000 7f110eff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:59:29.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.619+0000 7f110eff5700 1 -- 172.21.15.59:0/1124088257 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c003d30 con 0x55c386c56e80 2023-10-08T12:59:29.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.619+0000 7f110eff5700 1 -- 172.21.15.59:0/1124088257 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f111c005050 con 0x55c386c56e80 2023-10-08T12:59:29.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.620+0000 7f1144f50b80 1 -- 172.21.15.59:0/1124088257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c386b72eb0 con 0x55c386c56e80 2023-10-08T12:59:29.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.620+0000 7f110eff5700 1 -- 172.21.15.59:0/1124088257 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f111c005210 con 0x55c386c56e80 2023-10-08T12:59:29.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.622+0000 7f1144f50b80 10 client.28136 fetch_fsmap learned FSMap version 20 2023-10-08T12:59:29.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.622+0000 7f1144f50b80 1 -- 172.21.15.59:0/1124088257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c3869bec60 con 0x55c386c56e80 2023-10-08T12:59:29.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.623+0000 7f110eff5700 1 -- 172.21.15.59:0/1124088257 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f111c039030 con 0x55c386c56e80 2023-10-08T12:59:29.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.623+0000 7f110eff5700 1 -- 172.21.15.59:0/1124088257 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f111c00fc30 con 0x55c386c56e80 2023-10-08T12:59:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.624+0000 7f1144f50b80 10 client.28136 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:59:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.624+0000 7f1144f50b80 10 client.28136 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:59:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.624+0000 7f1144f50b80 20 client.28136 populate_metadata read hostname 'smithi059' 2023-10-08T12:59:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.624+0000 7f1144f50b80 1 --2- 172.21.15.59:0/1124088257 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c386c71c20 0x55c386c74040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.624+0000 7f1144f50b80 4 client.28136 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:59:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.624+0000 7f1144f50b80 1 -- 172.21.15.59:0/1124088257 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c386ba3e10 con 0x55c386c71c20 2023-10-08T12:59:29.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.624+0000 7f112a7fc700 1 --2- 172.21.15.59:0/1124088257 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c386c71c20 0x55c386c74040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.625+0000 7f112a7fc700 1 --2- 172.21.15.59:0/1124088257 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c386c71c20 0x55c386c74040 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e25e3e4d29232397 server_cookie=3b21ae2d53de619b in_seq=0 out_seq=0 2023-10-08T12:59:29.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.625+0000 7f110eff5700 10 client.28136 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.630+0000 7f110eff5700 1 -- 172.21.15.59:0/1124088257 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c386ba3e10 con 0x55c386c71c20 2023-10-08T12:59:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.630+0000 7f110eff5700 10 client.28136 handle_command_reply: tid=0 2023-10-08T12:59:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.630+0000 7f1144f50b80 1 client.28136 shutdown 2023-10-08T12:59:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.633+0000 7f1144f50b80 1 -- 172.21.15.59:0/1124088257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 msgr2=0x55c386c620d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.633+0000 7f1144f50b80 1 --2- 172.21.15.59:0/1124088257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386c620d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f111c005b10 tx=0x7f111c00bc00 comp rx=0 tx=0).stop 2023-10-08T12:59:29.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.634+0000 7f1144f50b80 1 -- 172.21.15.59:0/1124088257 shutdown_connections 2023-10-08T12:59:29.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.634+0000 7f1144f50b80 1 --2- 172.21.15.59:0/1124088257 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c386c71c20 0x55c386c74040 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.634+0000 7f1144f50b80 1 --2- 172.21.15.59:0/1124088257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386c620d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.634+0000 7f1144f50b80 1 --2- 172.21.15.59:0/1124088257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c62650 0x55c386c5fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.634+0000 7f1144f50b80 1 --2- 172.21.15.59:0/1124088257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c5f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.634+0000 7f1144f50b80 1 -- 172.21.15.59:0/1124088257 >> 172.21.15.59:0/1124088257 conn(0x55c386bcc260 msgr2=0x55c386c52ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.634+0000 7f110eff5700 0 client.28136 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:29.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.634+0000 7f1144f50b80 1 -- 172.21.15.59:0/1124088257 shutdown_connections 2023-10-08T12:59:29.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.634+0000 7f1144f50b80 1 -- 172.21.15.59:0/1124088257 wait complete. 2023-10-08T12:59:29.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.635+0000 7f1144f50b80 20 client.28136 trim_cache size 0 max 16384 2023-10-08T12:59:29.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.656+0000 7f1144f50b80 1 Processor -- start 2023-10-08T12:59:29.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.656+0000 7f1144f50b80 1 -- start start 2023-10-08T12:59:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.656+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 0x55c386c59d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.656+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c5ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.656+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c62650 0x55c386c5f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.656+0000 7f1144f50b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386a2b920 con 0x55c386c56e80 2023-10-08T12:59:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.656+0000 7f1144f50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386c53ed0 con 0x55c386c62650 2023-10-08T12:59:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.656+0000 7f1144f50b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386c4fb30 con 0x55c386c577a0 2023-10-08T12:59:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 0x55c386c59d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112a7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c5ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112a7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c5ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:34592/0 (socket says 172.21.15.59:34592) 2023-10-08T12:59:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112a7fc700 1 -- 172.21.15.59:0/203855632 learned_addr learned my addr 172.21.15.59:0/203855632 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 0x55c386c59d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36868/0 (socket says 172.21.15.59:36868) 2023-10-08T12:59:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112b7fe700 1 --2- 172.21.15.59:0/203855632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c62650 0x55c386c5f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112affd700 1 -- 172.21.15.59:0/203855632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 msgr2=0x55c386c5ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112affd700 1 --2- 172.21.15.59:0/203855632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c5ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112affd700 1 -- 172.21.15.59:0/203855632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c62650 msgr2=0x55c386c5f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112affd700 1 --2- 172.21.15.59:0/203855632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c62650 0x55c386c5f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112affd700 1 -- 172.21.15.59:0/203855632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3869fc250 con 0x55c386c56e80 2023-10-08T12:59:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.657+0000 7f112affd700 1 --2- 172.21.15.59:0/203855632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 0x55c386c59d50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f111c02c490 tx=0x7f111c005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e6069f81e43bdd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.658+0000 7f1111ffb700 1 -- 172.21.15.59:0/203855632 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c009ee0 con 0x55c386c56e80 2023-10-08T12:59:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.658+0000 7f1111ffb700 1 -- 172.21.15.59:0/203855632 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f111c039070 con 0x55c386c56e80 2023-10-08T12:59:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.658+0000 7f1111ffb700 1 -- 172.21.15.59:0/203855632 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c005e20 con 0x55c386c56e80 2023-10-08T12:59:29.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.658+0000 7f1144f50b80 1 -- 172.21.15.59:0/203855632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 msgr2=0x55c386c59d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.658+0000 7f1144f50b80 1 --2- 172.21.15.59:0/203855632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 0x55c386c59d50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f111c02c490 tx=0x7f111c005ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.658+0000 7f1144f50b80 1 -- 172.21.15.59:0/203855632 shutdown_connections 2023-10-08T12:59:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.658+0000 7f1144f50b80 1 --2- 172.21.15.59:0/203855632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c62650 0x55c386c5f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.658+0000 7f1144f50b80 1 --2- 172.21.15.59:0/203855632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c56e80 0x55c386c59d50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.658+0000 7f1144f50b80 1 --2- 172.21.15.59:0/203855632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c577a0 0x55c386c5ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.658+0000 7f1144f50b80 1 -- 172.21.15.59:0/203855632 >> 172.21.15.59:0/203855632 conn(0x55c386bcc260 msgr2=0x55c386c5a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.659+0000 7f1144f50b80 1 -- 172.21.15.59:0/203855632 shutdown_connections 2023-10-08T12:59:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.659+0000 7f1144f50b80 1 -- 172.21.15.59:0/203855632 wait complete. 2023-10-08T12:59:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.659+0000 7f1144f50b80 1 -- start start 2023-10-08T12:59:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.659+0000 7f1144f50b80 1 Processor -- start 2023-10-08T12:59:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386cbed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c577a0 0x55c386cbf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f1144f50b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c62650 0x55c386c67160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f1144f50b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386c67720 con 0x55c386c577a0 2023-10-08T12:59:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f1144f50b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386c67890 con 0x55c386c56e80 2023-10-08T12:59:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f1144f50b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c386c67a50 con 0x55c386c62650 2023-10-08T12:59:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386cbed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f1144f50b80 10 client.0 _ll_register_callbacks cb 0x7f1124009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:59:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386cbed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:49760/0 (socket says 172.21.15.59:49760) 2023-10-08T12:59:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112affd700 1 -- 172.21.15.59:0/3598673515 learned_addr learned my addr 172.21.15.59:0/3598673515 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112b7fe700 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c62650 0x55c386c67160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112a7fc700 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c577a0 0x55c386cbf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112affd700 1 -- 172.21.15.59:0/3598673515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c62650 msgr2=0x55c386c67160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112affd700 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c62650 0x55c386c67160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112affd700 1 -- 172.21.15.59:0/3598673515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c577a0 msgr2=0x55c386cbf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112affd700 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c577a0 0x55c386cbf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112affd700 1 -- 172.21.15.59:0/3598673515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3869bec60 con 0x55c386c56e80 2023-10-08T12:59:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112b7fe700 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c62650 0x55c386c67160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:59:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.660+0000 7f112a7fc700 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c577a0 0x55c386cbf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:59:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.661+0000 7f112affd700 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386cbed10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f111c006010 tx=0x7f111c009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caa467aab4959722 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.661+0000 7f110eff5700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:59:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.661+0000 7f110eff5700 1 -- 172.21.15.59:0/3598673515 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c02ca30 con 0x55c386c56e80 2023-10-08T12:59:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.661+0000 7f110eff5700 1 -- 172.21.15.59:0/3598673515 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f111c000e40 con 0x55c386c56e80 2023-10-08T12:59:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.661+0000 7f1144f50b80 1 -- 172.21.15.59:0/3598673515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f111c01e040 con 0x55c386c56e80 2023-10-08T12:59:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.661+0000 7f110eff5700 1 -- 172.21.15.59:0/3598673515 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f111c02cb90 con 0x55c386c56e80 2023-10-08T12:59:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.661+0000 7f1144f50b80 10 client.28142 fetch_fsmap learned FSMap version 20 2023-10-08T12:59:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.661+0000 7f1144f50b80 1 -- 172.21.15.59:0/3598673515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c3869d42b0 con 0x55c386c56e80 2023-10-08T12:59:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.661+0000 7f110eff5700 1 -- 172.21.15.59:0/3598673515 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f111c01e040 con 0x55c386c56e80 2023-10-08T12:59:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.662+0000 7f110eff5700 1 -- 172.21.15.59:0/3598673515 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f111c00fc50 con 0x55c386c56e80 2023-10-08T12:59:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.662+0000 7f1144f50b80 10 client.28142 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:59:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.662+0000 7f1144f50b80 10 client.28142 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:59:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.662+0000 7f1144f50b80 20 client.28142 populate_metadata read hostname 'smithi059' 2023-10-08T12:59:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.662+0000 7f1144f50b80 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c386cc66e0 0x55c386cc8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.662+0000 7f1144f50b80 4 client.28142 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:59:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.662+0000 7f1144f50b80 1 -- 172.21.15.59:0/3598673515 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c386ba3b30 con 0x55c386cc66e0 2023-10-08T12:59:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.662+0000 7f112a7fc700 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c386cc66e0 0x55c386cc8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.663+0000 7f110eff5700 10 client.28142 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.662+0000 7f112a7fc700 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c386cc66e0 0x55c386cc8b00 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8832ae674de77605 server_cookie=607f800b23624f68 in_seq=0 out_seq=0 2023-10-08T12:59:29.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.664+0000 7f110eff5700 1 -- 172.21.15.59:0/3598673515 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55c386ba3b30 con 0x55c386cc66e0 2023-10-08T12:59:29.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.664+0000 7f110eff5700 10 client.28142 handle_command_reply: tid=0 2023-10-08T12:59:29.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.664+0000 7f1144f50b80 1 client.28142 shutdown 2023-10-08T12:59:29.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f1144f50b80 1 -- 172.21.15.59:0/3598673515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 msgr2=0x55c386cbed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f1144f50b80 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386cbed10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f111c006010 tx=0x7f111c009ee0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f1144f50b80 1 -- 172.21.15.59:0/3598673515 shutdown_connections 2023-10-08T12:59:29.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f1144f50b80 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c386cc66e0 0x55c386cc8b00 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f1144f50b80 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c386c56e80 0x55c386cbed10 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f110eff5700 0 client.28142 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:29.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f1144f50b80 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c386c62650 0x55c386c67160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f1144f50b80 1 --2- 172.21.15.59:0/3598673515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c386c577a0 0x55c386cbf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f1144f50b80 1 -- 172.21.15.59:0/3598673515 >> 172.21.15.59:0/3598673515 conn(0x55c386bcc260 msgr2=0x55c386c52d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f1144f50b80 1 -- 172.21.15.59:0/3598673515 shutdown_connections 2023-10-08T12:59:29.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f1144f50b80 1 -- 172.21.15.59:0/3598673515 wait complete. 2023-10-08T12:59:29.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.665+0000 7f1144f50b80 20 client.28142 trim_cache size 0 max 16384 2023-10-08T12:59:29.670 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:59:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "scrub active (648 inodes in the stack)", 2023-10-08T12:59:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T12:59:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "2b94a71a-66db-4de7-a5fa-93cdda45b423": { 2023-10-08T12:59:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T12:59:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "2b94a71a-66db-4de7-a5fa-93cdda45b423", 2023-10-08T12:59:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T12:59:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:59:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T12:59:29.671 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:59:29.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 -- 172.21.15.59:0/3431652469 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11140a16f0 msgr2=0x7f11140a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11140a16f0 0x7f11140a3bb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f112400b4d0 tx=0x7f112400e040 comp rx=0 tx=0).stop 2023-10-08T12:59:29.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 -- 172.21.15.59:0/3431652469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f112c1051c0 msgr2=0x7f112c10cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f112c1051c0 0x7f112c10cd10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f112000d950 tx=0x7f112000dd10 comp rx=0 tx=0).stop 2023-10-08T12:59:29.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 -- 172.21.15.59:0/3431652469 shutdown_connections 2023-10-08T12:59:29.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f11140a16f0 0x7f11140a3bb0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f112c105b80 0x7f112c06c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112c067ce0 0x7f112c10c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 --2- 172.21.15.59:0/3431652469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f112c1051c0 0x7f112c10cd10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 -- 172.21.15.59:0/3431652469 >> 172.21.15.59:0/3431652469 conn(0x7f112c076780 msgr2=0x7f112c1021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 -- 172.21.15.59:0/3431652469 shutdown_connections 2023-10-08T12:59:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:29.666+0000 7f11315ff700 1 -- 172.21.15.59:0/3431652469 wait complete. 2023-10-08T12:59:29.685 INFO:tasks.cephfs.filesystem:scrub status for tag:2b94a71a-66db-4de7-a5fa-93cdda45b423 - {'path': '/', 'tag': '2b94a71a-66db-4de7-a5fa-93cdda45b423', 'options': 'recursive,force'} 2023-10-08T12:59:29.972 INFO:tasks.workunit.client.0.smithi059.stdout: 10 115638 20.32 MB/sec execute 180 sec latency 267.175 ms 2023-10-08T12:59:30.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:30 smithi059 ceph-mon[98489]: pgmap v887: 97 pgs: 97 active+clean; 976 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 9.8 MiB/s wr, 389 op/s 2023-10-08T12:59:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:30 smithi092 ceph-mon[134093]: pgmap v887: 97 pgs: 97 active+clean; 976 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 9.8 MiB/s wr, 389 op/s 2023-10-08T12:59:30.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:30 smithi173 ceph-mon[135182]: pgmap v887: 97 pgs: 97 active+clean; 976 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 9.8 MiB/s wr, 389 op/s 2023-10-08T12:59:30.972 INFO:tasks.workunit.client.0.smithi059.stdout: 10 115955 20.26 MB/sec execute 181 sec latency 159.471 ms 2023-10-08T12:59:31.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:31 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T12:59:31.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:31 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:59:31.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:31 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T12:59:31.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:31 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T12:59:31.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:31 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:59:31.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:31 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T12:59:31.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:31 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T12:59:31.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:31 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:59:31.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:31 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T12:59:31.972 INFO:tasks.workunit.client.0.smithi059.stdout: 10 116301 20.25 MB/sec execute 182 sec latency 935.340 ms 2023-10-08T12:59:32.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:32 smithi092 ceph-mon[134093]: pgmap v888: 97 pgs: 97 active+clean; 962 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 8.9 MiB/s wr, 376 op/s 2023-10-08T12:59:32.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:32 smithi173 ceph-mon[135182]: pgmap v888: 97 pgs: 97 active+clean; 962 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 8.9 MiB/s wr, 376 op/s 2023-10-08T12:59:32.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:32 smithi059 ceph-mon[98489]: pgmap v888: 97 pgs: 97 active+clean; 962 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 8.9 MiB/s wr, 376 op/s 2023-10-08T12:59:32.973 INFO:tasks.workunit.client.0.smithi059.stdout: 10 116788 20.29 MB/sec execute 183 sec latency 1935.392 ms 2023-10-08T12:59:33.973 INFO:tasks.workunit.client.0.smithi059.stdout: 10 117264 20.32 MB/sec execute 184 sec latency 2106.302 ms 2023-10-08T12:59:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:34 smithi173 ceph-mon[135182]: pgmap v889: 97 pgs: 97 active+clean; 926 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 8.8 MiB/s wr, 410 op/s 2023-10-08T12:59:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:34 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T12:59:34.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:34 smithi059 ceph-mon[98489]: pgmap v889: 97 pgs: 97 active+clean; 926 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 8.8 MiB/s wr, 410 op/s 2023-10-08T12:59:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:34 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T12:59:34.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:34 smithi092 ceph-mon[134093]: pgmap v889: 97 pgs: 97 active+clean; 926 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 8.8 MiB/s wr, 410 op/s 2023-10-08T12:59:34.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:34 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T12:59:34.973 INFO:tasks.workunit.client.0.smithi059.stdout: 10 117677 20.31 MB/sec execute 185 sec latency 294.744 ms 2023-10-08T12:59:35.973 INFO:tasks.workunit.client.0.smithi059.stdout: 10 118007 20.32 MB/sec execute 186 sec latency 168.078 ms 2023-10-08T12:59:36.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:36 smithi173 ceph-mon[135182]: pgmap v890: 97 pgs: 97 active+clean; 938 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 7.6 MiB/s wr, 391 op/s 2023-10-08T12:59:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:36 smithi059 ceph-mon[98489]: pgmap v890: 97 pgs: 97 active+clean; 938 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 7.6 MiB/s wr, 391 op/s 2023-10-08T12:59:36.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:36 smithi092 ceph-mon[134093]: pgmap v890: 97 pgs: 97 active+clean; 938 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 7.6 MiB/s wr, 391 op/s 2023-10-08T12:59:36.973 INFO:tasks.workunit.client.0.smithi059.stdout: 10 118376 20.33 MB/sec execute 187 sec latency 201.895 ms 2023-10-08T12:59:37.975 INFO:tasks.workunit.client.0.smithi059.stdout: 10 118705 20.32 MB/sec execute 188 sec latency 164.494 ms 2023-10-08T12:59:38.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:38 smithi173 ceph-mon[135182]: pgmap v891: 97 pgs: 97 active+clean; 943 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 7.4 MiB/s wr, 393 op/s 2023-10-08T12:59:38.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:38 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T12:59:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:38 smithi059 ceph-mon[98489]: pgmap v891: 97 pgs: 97 active+clean; 943 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 7.4 MiB/s wr, 393 op/s 2023-10-08T12:59:38.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:38 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T12:59:38.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:38 smithi092 ceph-mon[134093]: pgmap v891: 97 pgs: 97 active+clean; 943 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 7.4 MiB/s wr, 393 op/s 2023-10-08T12:59:38.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:38 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T12:59:38.975 INFO:tasks.workunit.client.0.smithi059.stdout: 10 119141 20.29 MB/sec execute 189 sec latency 178.356 ms 2023-10-08T12:59:39.975 INFO:tasks.workunit.client.0.smithi059.stdout: 10 119441 20.25 MB/sec execute 190 sec latency 214.735 ms 2023-10-08T12:59:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:40 smithi092 ceph-mon[134093]: pgmap v892: 97 pgs: 97 active+clean; 958 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 7.7 MiB/s wr, 408 op/s 2023-10-08T12:59:40.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:40 smithi173 ceph-mon[135182]: pgmap v892: 97 pgs: 97 active+clean; 958 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 7.7 MiB/s wr, 408 op/s 2023-10-08T12:59:40.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:40 smithi059 ceph-mon[98489]: pgmap v892: 97 pgs: 97 active+clean; 958 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 7.7 MiB/s wr, 408 op/s 2023-10-08T12:59:40.975 INFO:tasks.workunit.client.0.smithi059.stdout: 10 119833 20.26 MB/sec execute 191 sec latency 350.337 ms 2023-10-08T12:59:41.975 INFO:tasks.workunit.client.0.smithi059.stdout: 10 120313 20.34 MB/sec execute 192 sec latency 165.336 ms 2023-10-08T12:59:42.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:42 smithi173 ceph-mon[135182]: pgmap v893: 97 pgs: 97 active+clean; 970 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.1 MiB/s wr, 375 op/s 2023-10-08T12:59:42.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:42 smithi059 ceph-mon[98489]: pgmap v893: 97 pgs: 97 active+clean; 970 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.1 MiB/s wr, 375 op/s 2023-10-08T12:59:42.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:42 smithi092 ceph-mon[134093]: pgmap v893: 97 pgs: 97 active+clean; 970 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.1 MiB/s wr, 375 op/s 2023-10-08T12:59:42.975 INFO:tasks.workunit.client.0.smithi059.stdout: 10 120861 20.34 MB/sec execute 193 sec latency 145.294 ms 2023-10-08T12:59:43.975 INFO:tasks.workunit.client.0.smithi059.stdout: 10 121165 20.35 MB/sec execute 194 sec latency 79.083 ms 2023-10-08T12:59:44.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:44 smithi173 ceph-mon[135182]: pgmap v894: 97 pgs: 97 active+clean; 982 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 8.2 MiB/s wr, 401 op/s 2023-10-08T12:59:44.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:44 smithi059 ceph-mon[98489]: pgmap v894: 97 pgs: 97 active+clean; 982 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 8.2 MiB/s wr, 401 op/s 2023-10-08T12:59:44.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:44 smithi092 ceph-mon[134093]: pgmap v894: 97 pgs: 97 active+clean; 982 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 8.2 MiB/s wr, 401 op/s 2023-10-08T12:59:44.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 121580 20.38 MB/sec execute 195 sec latency 147.029 ms 2023-10-08T12:59:45.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 121809 20.36 MB/sec execute 196 sec latency 287.972 ms 2023-10-08T12:59:46.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:46 smithi173 ceph-mon[135182]: pgmap v895: 97 pgs: 97 active+clean; 975 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.2 MiB/s wr, 366 op/s 2023-10-08T12:59:46.519 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:46 smithi059 ceph-mon[98489]: pgmap v895: 97 pgs: 97 active+clean; 975 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.2 MiB/s wr, 366 op/s 2023-10-08T12:59:46.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:46 smithi092 ceph-mon[134093]: pgmap v895: 97 pgs: 97 active+clean; 975 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.2 MiB/s wr, 366 op/s 2023-10-08T12:59:46.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 122071 20.31 MB/sec execute 197 sec latency 188.892 ms 2023-10-08T12:59:47.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 122487 20.30 MB/sec execute 198 sec latency 178.279 ms 2023-10-08T12:59:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:48 smithi173 ceph-mon[135182]: pgmap v896: 97 pgs: 97 active+clean; 961 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 8.1 MiB/s wr, 352 op/s 2023-10-08T12:59:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:48 smithi059 ceph-mon[98489]: pgmap v896: 97 pgs: 97 active+clean; 961 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 8.1 MiB/s wr, 352 op/s 2023-10-08T12:59:48.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:48 smithi092 ceph-mon[134093]: pgmap v896: 97 pgs: 97 active+clean; 961 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 8.1 MiB/s wr, 352 op/s 2023-10-08T12:59:48.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 122828 20.24 MB/sec execute 199 sec latency 173.245 ms 2023-10-08T12:59:49.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 123370 20.30 MB/sec execute 200 sec latency 169.362 ms 2023-10-08T12:59:50.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:50 smithi059 ceph-mon[98489]: pgmap v897: 97 pgs: 97 active+clean; 926 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 8.5 MiB/s wr, 359 op/s 2023-10-08T12:59:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:50 smithi092 ceph-mon[134093]: pgmap v897: 97 pgs: 97 active+clean; 926 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 8.5 MiB/s wr, 359 op/s 2023-10-08T12:59:50.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:50 smithi173 ceph-mon[135182]: pgmap v897: 97 pgs: 97 active+clean; 926 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 8.5 MiB/s wr, 359 op/s 2023-10-08T12:59:50.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 123768 20.33 MB/sec execute 201 sec latency 339.472 ms 2023-10-08T12:59:51.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 124155 20.33 MB/sec execute 202 sec latency 133.311 ms 2023-10-08T12:59:52.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:52 smithi173 ceph-mon[135182]: pgmap v898: 97 pgs: 97 active+clean; 933 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.2 MiB/s wr, 321 op/s 2023-10-08T12:59:52.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:52 smithi059 ceph-mon[98489]: pgmap v898: 97 pgs: 97 active+clean; 933 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.2 MiB/s wr, 321 op/s 2023-10-08T12:59:52.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:52 smithi092 ceph-mon[134093]: pgmap v898: 97 pgs: 97 active+clean; 933 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.2 MiB/s wr, 321 op/s 2023-10-08T12:59:52.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 124546 20.34 MB/sec execute 203 sec latency 165.154 ms 2023-10-08T12:59:53.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 124942 20.38 MB/sec execute 204 sec latency 151.362 ms 2023-10-08T12:59:54.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:54 smithi173 ceph-mon[135182]: pgmap v899: 97 pgs: 97 active+clean; 949 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 9.1 MiB/s wr, 367 op/s 2023-10-08T12:59:54.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:54 smithi059 ceph-mon[98489]: pgmap v899: 97 pgs: 97 active+clean; 949 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 9.1 MiB/s wr, 367 op/s 2023-10-08T12:59:54.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:54 smithi092 ceph-mon[134093]: pgmap v899: 97 pgs: 97 active+clean; 949 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 9.1 MiB/s wr, 367 op/s 2023-10-08T12:59:54.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 125236 20.36 MB/sec execute 205 sec latency 178.673 ms 2023-10-08T12:59:55.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 125448 20.31 MB/sec execute 206 sec latency 431.474 ms 2023-10-08T12:59:56.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:56 smithi173 ceph-mon[135182]: pgmap v900: 97 pgs: 97 active+clean; 955 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 8.3 MiB/s wr, 328 op/s 2023-10-08T12:59:56.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:56 smithi059 ceph-mon[98489]: pgmap v900: 97 pgs: 97 active+clean; 955 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 8.3 MiB/s wr, 328 op/s 2023-10-08T12:59:56.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:56 smithi092 ceph-mon[134093]: pgmap v900: 97 pgs: 97 active+clean; 955 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 8.3 MiB/s wr, 328 op/s 2023-10-08T12:59:56.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 125793 20.26 MB/sec execute 207 sec latency 203.563 ms 2023-10-08T12:59:57.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:57 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:57.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:57 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:57.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:57 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:57.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 126223 20.22 MB/sec execute 208 sec latency 216.395 ms 2023-10-08T12:59:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:58 smithi173 ceph-mon[135182]: pgmap v901: 97 pgs: 97 active+clean; 956 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.6 MiB/s wr, 316 op/s 2023-10-08T12:59:58.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:58 smithi059 ceph-mon[98489]: pgmap v901: 97 pgs: 97 active+clean; 956 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.6 MiB/s wr, 316 op/s 2023-10-08T12:59:58.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:58 smithi092 ceph-mon[134093]: pgmap v901: 97 pgs: 97 active+clean; 956 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.6 MiB/s wr, 316 op/s 2023-10-08T12:59:58.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 126752 20.30 MB/sec execute 209 sec latency 181.498 ms 2023-10-08T12:59:59.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:59.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:59.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 12:59:59 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:59:59.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:59.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:59.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 12:59:59 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:59:59.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:59.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:59.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 12:59:59 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T12:59:59.686 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:59:59.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.915+0000 7fb732fff700 1 -- 172.21.15.59:0/1141519669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb72c067ce0 msgr2=0x7fb72c0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:59.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.915+0000 7fb732fff700 1 --2- 172.21.15.59:0/1141519669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb72c067ce0 0x7fb72c0680c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb720009990 tx=0x7fb720009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.915+0000 7fb732fff700 1 -- 172.21.15.59:0/1141519669 shutdown_connections 2023-10-08T12:59:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.915+0000 7fb732fff700 1 --2- 172.21.15.59:0/1141519669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb72c067ce0 0x7fb72c0680c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.915+0000 7fb732fff700 1 --2- 172.21.15.59:0/1141519669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb72c105b80 0x7fb72c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.915+0000 7fb732fff700 1 --2- 172.21.15.59:0/1141519669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c1051c0 0x7fb72c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.915+0000 7fb732fff700 1 -- 172.21.15.59:0/1141519669 >> 172.21.15.59:0/1141519669 conn(0x7fb72c076780 msgr2=0x7fb72c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.915+0000 7fb732fff700 1 -- 172.21.15.59:0/1141519669 shutdown_connections 2023-10-08T12:59:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.915+0000 7fb732fff700 1 -- 172.21.15.59:0/1141519669 wait complete. 2023-10-08T12:59:59.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.916+0000 7fb732fff700 1 Processor -- start 2023-10-08T12:59:59.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.916+0000 7fb732fff700 1 -- start start 2023-10-08T12:59:59.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.917+0000 7fb732fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb72c067ce0 0x7fb72c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.917+0000 7fb732fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb72c1051c0 0x7fb72c1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.917+0000 7fb732fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c105b80 0x7fb72c19d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.917+0000 7fb732fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c19dd80 con 0x7fb72c105b80 2023-10-08T12:59:59.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.917+0000 7fb732fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c19def0 con 0x7fb72c067ce0 2023-10-08T12:59:59.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.917+0000 7fb732fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c19e0b0 con 0x7fb72c1051c0 2023-10-08T12:59:59.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.917+0000 7fb73159c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c105b80 0x7fb72c19d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.917+0000 7fb73159c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c105b80 0x7fb72c19d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33606/0 (socket says 172.21.15.59:33606) 2023-10-08T12:59:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.917+0000 7fb73159c700 1 -- 172.21.15.59:0/3668413552 learned_addr learned my addr 172.21.15.59:0/3668413552 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.917+0000 7fb730d9b700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb72c067ce0 0x7fb72c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.917+0000 7fb72bfff700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb72c1051c0 0x7fb72c1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb73159c700 1 -- 172.21.15.59:0/3668413552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb72c1051c0 msgr2=0x7fb72c1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb73159c700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb72c1051c0 0x7fb72c1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb73159c700 1 -- 172.21.15.59:0/3668413552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb72c067ce0 msgr2=0x7fb72c198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb73159c700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb72c067ce0 0x7fb72c198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb73159c700 1 -- 172.21.15.59:0/3668413552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718009520 con 0x7fb72c105b80 2023-10-08T12:59:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb730d9b700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb72c067ce0 0x7fb72c198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb73159c700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c105b80 0x7fb72c19d740 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb72400ef30 tx=0x7fb72400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb729ffb700 1 -- 172.21.15.59:0/3668413552 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724018070 con 0x7fb72c105b80 2023-10-08T12:59:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb729ffb700 1 -- 172.21.15.59:0/3668413552 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb72400f040 con 0x7fb72c105b80 2023-10-08T12:59:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb732fff700 1 -- 172.21.15.59:0/3668413552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7200095f0 con 0x7fb72c105b80 2023-10-08T12:59:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb729ffb700 1 -- 172.21.15.59:0/3668413552 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72400cd00 con 0x7fb72c105b80 2023-10-08T12:59:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.918+0000 7fb732fff700 1 -- 172.21.15.59:0/3668413552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72c1a59f0 con 0x7fb72c105b80 2023-10-08T12:59:59.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.922+0000 7fb729ffb700 1 -- 172.21.15.59:0/3668413552 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb724003a00 con 0x7fb72c105b80 2023-10-08T12:59:59.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.924+0000 7fb729ffb700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb71c0a1670 0x7fb71c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.924+0000 7fb746a00b80 1 Processor -- start 2023-10-08T12:59:59.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.924+0000 7fb729ffb700 1 -- 172.21.15.59:0/3668413552 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fb7240ccb40 con 0x7fb72c105b80 2023-10-08T12:59:59.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.924+0000 7fb730d9b700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb71c0a1670 0x7fb71c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.924+0000 7fb746a00b80 1 -- start start 2023-10-08T12:59:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004ec260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ec7a0 0x55c9004f7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb746a00b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c900455460 con 0x55c9004ec7a0 2023-10-08T12:59:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb746a00b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c900446c20 con 0x55c9004ebe80 2023-10-08T12:59:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb746a00b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c900444540 con 0x55c9004f7650 2023-10-08T12:59:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb730d9b700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb71c0a1670 0x7fb71c0a3b30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb720006010 tx=0x7fb72000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb730d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004ec260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb730d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004ec260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53744/0 (socket says 172.21.15.59:53744) 2023-10-08T12:59:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb730d9b700 1 -- 172.21.15.59:0/735803903 learned_addr learned my addr 172.21.15.59:0/735803903 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb72bfff700 1 --2- 172.21.15.59:0/735803903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ec7a0 0x55c9004f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb73159c700 1 --2- 172.21.15.59:0/735803903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb730d9b700 1 -- 172.21.15.59:0/735803903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 msgr2=0x55c9004f9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb730d9b700 1 --2- 172.21.15.59:0/735803903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb730d9b700 1 -- 172.21.15.59:0/735803903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ec7a0 msgr2=0x55c9004f7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb730d9b700 1 --2- 172.21.15.59:0/735803903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ec7a0 0x55c9004f7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb730d9b700 1 -- 172.21.15.59:0/735803903 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c90026ade0 con 0x55c9004ebe80 2023-10-08T12:59:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.925+0000 7fb72bfff700 1 --2- 172.21.15.59:0/735803903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ec7a0 0x55c9004f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:59:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.926+0000 7fb730d9b700 1 --2- 172.21.15.59:0/735803903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004ec260 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb720005160 tx=0x7fb720020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4553bc21637a923f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.926+0000 7fb716ffd700 1 -- 172.21.15.59:0/735803903 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720004880 con 0x55c9004ebe80 2023-10-08T12:59:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.926+0000 7fb716ffd700 1 -- 172.21.15.59:0/735803903 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb72001e040 con 0x55c9004ebe80 2023-10-08T12:59:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.926+0000 7fb716ffd700 1 -- 172.21.15.59:0/735803903 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000fe20 con 0x55c9004ebe80 2023-10-08T12:59:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.926+0000 7fb746a00b80 1 -- 172.21.15.59:0/735803903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 msgr2=0x55c9004ec260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.926+0000 7fb746a00b80 1 --2- 172.21.15.59:0/735803903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004ec260 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb720005160 tx=0x7fb720020000 comp rx=0 tx=0).stop 2023-10-08T12:59:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.927+0000 7fb746a00b80 1 -- 172.21.15.59:0/735803903 shutdown_connections 2023-10-08T12:59:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.927+0000 7fb746a00b80 1 --2- 172.21.15.59:0/735803903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004ec260 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.927+0000 7fb746a00b80 1 --2- 172.21.15.59:0/735803903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.927+0000 7fb746a00b80 1 --2- 172.21.15.59:0/735803903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ec7a0 0x55c9004f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.927+0000 7fb746a00b80 1 -- 172.21.15.59:0/735803903 >> 172.21.15.59:0/735803903 conn(0x55c900461260 msgr2=0x55c9004e82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:59.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.927+0000 7fb746a00b80 1 -- 172.21.15.59:0/735803903 shutdown_connections 2023-10-08T12:59:59.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.927+0000 7fb746a00b80 1 -- 172.21.15.59:0/735803903 wait complete. 2023-10-08T12:59:59.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.927+0000 7fb746a00b80 1 -- start start 2023-10-08T12:59:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.928+0000 7fb746a00b80 1 Processor -- start 2023-10-08T12:59:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.928+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ebe80 0x55c9004f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 0x55c9004f4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb746a00b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90043fe30 con 0x55c9004ebe80 2023-10-08T12:59:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb746a00b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9003dc710 con 0x55c9004ec7a0 2023-10-08T12:59:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb746a00b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9003dc3b0 con 0x55c9004f7650 2023-10-08T12:59:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb746a00b80 10 client.0 _ll_register_callbacks cb 0x55c900239800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:59:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb72bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 0x55c9004f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb72bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 0x55c9004f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53746/0 (socket says 172.21.15.59:53746) 2023-10-08T12:59:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb72bfff700 1 -- 172.21.15.59:0/1953009089 learned_addr learned my addr 172.21.15.59:0/1953009089 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb730d9b700 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ebe80 0x55c9004f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb73159c700 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb72bfff700 1 -- 172.21.15.59:0/1953009089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 msgr2=0x55c9004f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb72bfff700 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb72bfff700 1 -- 172.21.15.59:0/1953009089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ebe80 msgr2=0x55c9004f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb72bfff700 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ebe80 0x55c9004f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb72bfff700 1 -- 172.21.15.59:0/1953009089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72c10dec0 con 0x55c9004ec7a0 2023-10-08T12:59:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb72bfff700 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 0x55c9004f4440 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb7180128d0 tx=0x7fb718012be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3bfd5d71fe62b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.929+0000 7fb70bfff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T12:59:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb70bfff700 1 -- 172.21.15.59:0/1953009089 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718017070 con 0x55c9004ec7a0 2023-10-08T12:59:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb746a00b80 1 -- 172.21.15.59:0/1953009089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c900407eb0 con 0x55c9004ec7a0 2023-10-08T12:59:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb70bfff700 1 -- 172.21.15.59:0/1953009089 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fb71800f640 con 0x55c9004ec7a0 2023-10-08T12:59:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb70bfff700 1 -- 172.21.15.59:0/1953009089 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7180122e0 con 0x55c9004ec7a0 2023-10-08T12:59:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb746a00b80 10 client.28154 fetch_fsmap learned FSMap version 20 2023-10-08T12:59:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb746a00b80 1 -- 172.21.15.59:0/1953009089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c900253c60 con 0x55c9004ec7a0 2023-10-08T12:59:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb70bfff700 1 -- 172.21.15.59:0/1953009089 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c900407eb0 con 0x55c9004ec7a0 2023-10-08T12:59:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb70bfff700 1 -- 172.21.15.59:0/1953009089 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb718010aa0 con 0x55c9004ec7a0 2023-10-08T12:59:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb746a00b80 10 client.28154 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:59:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb746a00b80 10 client.28154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:59:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb746a00b80 20 client.28154 populate_metadata read hostname 'smithi059' 2023-10-08T12:59:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.930+0000 7fb746a00b80 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c9005072a0 0x55c9005096c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.931+0000 7fb746a00b80 4 client.28154 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:59:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.931+0000 7fb746a00b80 1 -- 172.21.15.59:0/1953009089 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c900438e10 con 0x55c9005072a0 2023-10-08T12:59:59.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.931+0000 7fb730d9b700 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c9005072a0 0x55c9005096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.931+0000 7fb730d9b700 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c9005072a0 0x55c9005096c0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7113552394670ea server_cookie=d8ad360d44bdf726 in_seq=0 out_seq=0 2023-10-08T12:59:59.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.931+0000 7fb70bfff700 10 client.28154 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.934+0000 7fb70bfff700 1 -- 172.21.15.59:0/1953009089 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c900438e10 con 0x55c9005072a0 2023-10-08T12:59:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.934+0000 7fb70bfff700 10 client.28154 handle_command_reply: tid=0 2023-10-08T12:59:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.934+0000 7fb746a00b80 1 client.28154 shutdown 2023-10-08T12:59:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.934+0000 7fb746a00b80 1 -- 172.21.15.59:0/1953009089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 msgr2=0x55c9004f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.934+0000 7fb746a00b80 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 0x55c9004f4440 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb7180128d0 tx=0x7fb718012be0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.935+0000 7fb746a00b80 1 -- 172.21.15.59:0/1953009089 shutdown_connections 2023-10-08T12:59:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.935+0000 7fb746a00b80 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c9005072a0 0x55c9005096c0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.935+0000 7fb746a00b80 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.935+0000 7fb746a00b80 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ebe80 0x55c9004f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.935+0000 7fb746a00b80 1 --2- 172.21.15.59:0/1953009089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 0x55c9004f4440 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.935+0000 7fb70bfff700 0 client.28154 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.935+0000 7fb746a00b80 1 -- 172.21.15.59:0/1953009089 >> 172.21.15.59:0/1953009089 conn(0x55c900461260 msgr2=0x55c9004e7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.935+0000 7fb746a00b80 1 -- 172.21.15.59:0/1953009089 shutdown_connections 2023-10-08T12:59:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.935+0000 7fb746a00b80 1 -- 172.21.15.59:0/1953009089 wait complete. 2023-10-08T12:59:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.935+0000 7fb746a00b80 20 client.28154 trim_cache size 0 max 16384 2023-10-08T12:59:59.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.955+0000 7fb746a00b80 1 Processor -- start 2023-10-08T12:59:59.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.955+0000 7fb746a00b80 1 -- start start 2023-10-08T12:59:59.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004fe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ec7a0 0x55c900502890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb746a00b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9002c0920 con 0x55c9004ec7a0 2023-10-08T12:59:59.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb746a00b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9004ed9c0 con 0x55c9004ebe80 2023-10-08T12:59:59.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb746a00b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9004e4ae0 con 0x55c9004f7650 2023-10-08T12:59:59.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb730d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb72bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ec7a0 0x55c900502890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb730d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53762/0 (socket says 172.21.15.59:53762) 2023-10-08T12:59:59.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb730d9b700 1 -- 172.21.15.59:0/784258489 learned_addr learned my addr 172.21.15.59:0/784258489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:59.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb73159c700 1 --2- 172.21.15.59:0/784258489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb730d9b700 1 -- 172.21.15.59:0/784258489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 msgr2=0x55c9004f39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:59.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb730d9b700 1 --2- 172.21.15.59:0/784258489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb730d9b700 1 -- 172.21.15.59:0/784258489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ec7a0 msgr2=0x55c900502890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:59.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb730d9b700 1 --2- 172.21.15.59:0/784258489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ec7a0 0x55c900502890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.956+0000 7fb730d9b700 1 -- 172.21.15.59:0/784258489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c900291250 con 0x55c9004ebe80 2023-10-08T12:59:59.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.957+0000 7fb730d9b700 1 --2- 172.21.15.59:0/784258489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004fe140 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb720000c00 tx=0x7fb720026040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed64ad3423bf72ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:59.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.957+0000 7fb7177fe700 1 -- 172.21.15.59:0/784258489 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720034040 con 0x55c9004ebe80 2023-10-08T12:59:59.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.957+0000 7fb7177fe700 1 -- 172.21.15.59:0/784258489 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb72000fe90 con 0x55c9004ebe80 2023-10-08T12:59:59.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.957+0000 7fb7177fe700 1 -- 172.21.15.59:0/784258489 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72003a280 con 0x55c9004ebe80 2023-10-08T12:59:59.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.958+0000 7fb746a00b80 1 -- 172.21.15.59:0/784258489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 msgr2=0x55c9004fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:59.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.958+0000 7fb746a00b80 1 --2- 172.21.15.59:0/784258489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004fe140 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb720000c00 tx=0x7fb720026040 comp rx=0 tx=0).stop 2023-10-08T12:59:59.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.958+0000 7fb746a00b80 1 -- 172.21.15.59:0/784258489 shutdown_connections 2023-10-08T12:59:59.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.958+0000 7fb746a00b80 1 --2- 172.21.15.59:0/784258489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ebe80 0x55c9004fe140 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.958+0000 7fb746a00b80 1 --2- 172.21.15.59:0/784258489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004f39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.958+0000 7fb746a00b80 1 --2- 172.21.15.59:0/784258489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ec7a0 0x55c900502890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.958+0000 7fb746a00b80 1 -- 172.21.15.59:0/784258489 >> 172.21.15.59:0/784258489 conn(0x55c900461260 msgr2=0x55c9004e74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:59.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.958+0000 7fb746a00b80 1 -- 172.21.15.59:0/784258489 shutdown_connections 2023-10-08T12:59:59.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.958+0000 7fb746a00b80 1 -- 172.21.15.59:0/784258489 wait complete. 2023-10-08T12:59:59.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.958+0000 7fb746a00b80 1 -- start start 2023-10-08T12:59:59.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.959+0000 7fb746a00b80 1 Processor -- start 2023-10-08T12:59:59.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.959+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ebe80 0x55c9004fde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.959+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 0x55c9004fc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.959+0000 7fb746a00b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004fc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.959+0000 7fb746a00b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9004fe710 con 0x55c9004ebe80 2023-10-08T12:59:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.959+0000 7fb746a00b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9004fcc20 con 0x55c9004ec7a0 2023-10-08T12:59:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.959+0000 7fb746a00b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9004fcd90 con 0x55c9004f7650 2023-10-08T12:59:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.959+0000 7fb746a00b80 10 client.0 _ll_register_callbacks cb 0x7fb718009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:59:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb72bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 0x55c9004fc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb73159c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004fc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb72bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 0x55c9004fc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53766/0 (socket says 172.21.15.59:53766) 2023-10-08T12:59:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb730d9b700 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ebe80 0x55c9004fde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb72bfff700 1 -- 172.21.15.59:0/2047360187 learned_addr learned my addr 172.21.15.59:0/2047360187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T12:59:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb73159c700 1 -- 172.21.15.59:0/2047360187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 msgr2=0x55c9004fc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb73159c700 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 0x55c9004fc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb73159c700 1 -- 172.21.15.59:0/2047360187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ebe80 msgr2=0x55c9004fde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:59:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb73159c700 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ebe80 0x55c9004fde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb73159c700 1 -- 172.21.15.59:0/2047360187 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c90026ade0 con 0x55c9004f7650 2023-10-08T12:59:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb73159c700 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004fc6e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb7240ca2e0 tx=0x7fb724099660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=522b24bfd4483a62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb70bfff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T12:59:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.960+0000 7fb70bfff700 1 -- 172.21.15.59:0/2047360187 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72409a060 con 0x55c9004f7650 2023-10-08T12:59:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb746a00b80 1 -- 172.21.15.59:0/2047360187 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb72001e040 con 0x55c9004f7650 2023-10-08T12:59:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb70bfff700 1 -- 172.21.15.59:0/2047360187 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fb72400ce60 con 0x55c9004f7650 2023-10-08T12:59:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb70bfff700 1 -- 172.21.15.59:0/2047360187 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb724099c00 con 0x55c9004f7650 2023-10-08T12:59:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb746a00b80 10 client.28141 fetch_fsmap learned FSMap version 20 2023-10-08T12:59:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb746a00b80 1 -- 172.21.15.59:0/2047360187 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55c9002692b0 con 0x55c9004f7650 2023-10-08T12:59:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb70bfff700 1 -- 172.21.15.59:0/2047360187 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb7240b6080 con 0x55c9004f7650 2023-10-08T12:59:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb70bfff700 1 -- 172.21.15.59:0/2047360187 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb7240990f0 con 0x55c9004f7650 2023-10-08T12:59:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb746a00b80 10 client.28141 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T12:59:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb746a00b80 10 client.28141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:59:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb746a00b80 20 client.28141 populate_metadata read hostname 'smithi059' 2023-10-08T12:59:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb746a00b80 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c90055c510 0x55c90055e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb746a00b80 4 client.28141 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:59:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb746a00b80 1 -- 172.21.15.59:0/2047360187 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c900438b30 con 0x55c90055c510 2023-10-08T12:59:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.961+0000 7fb730d9b700 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c90055c510 0x55c90055e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.962+0000 7fb730d9b700 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c90055c510 0x55c90055e930 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff7e0843d8ad07dd server_cookie=c6199872dc6c0449 in_seq=0 out_seq=0 2023-10-08T12:59:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.962+0000 7fb70bfff700 10 client.28141 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.964+0000 7fb70bfff700 1 -- 172.21.15.59:0/2047360187 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c900438b30 con 0x55c90055c510 2023-10-08T12:59:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.964+0000 7fb70bfff700 10 client.28141 handle_command_reply: tid=0 2023-10-08T12:59:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 1 client.28141 shutdown 2023-10-08T12:59:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 1 -- 172.21.15.59:0/2047360187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 msgr2=0x55c9004fc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004fc6e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb7240ca2e0 tx=0x7fb724099660 comp rx=0 tx=0).stop 2023-10-08T12:59:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 1 -- 172.21.15.59:0/2047360187 shutdown_connections 2023-10-08T12:59:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55c90055c510 0x55c90055e930 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9004f7650 0x55c9004fc6e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9004ebe80 0x55c9004fde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 1 --2- 172.21.15.59:0/2047360187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9004ec7a0 0x55c9004fc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb70bfff700 0 client.28141 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T12:59:59.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 1 -- 172.21.15.59:0/2047360187 >> 172.21.15.59:0/2047360187 conn(0x55c900461260 msgr2=0x55c900502890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:59.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 1 -- 172.21.15.59:0/2047360187 shutdown_connections 2023-10-08T12:59:59.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 1 -- 172.21.15.59:0/2047360187 wait complete. 2023-10-08T12:59:59.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.965+0000 7fb746a00b80 20 client.28141 trim_cache size 0 max 16384 2023-10-08T12:59:59.973 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T12:59:59.973 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T12:59:59.973 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T12:59:59.974 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T12:59:59.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 -- 172.21.15.59:0/3668413552 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb71c0a1670 msgr2=0x7fb71c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:59.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb71c0a1670 0x7fb71c0a3b30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb720006010 tx=0x7fb72000b260 comp rx=0 tx=0).stop 2023-10-08T12:59:59.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 -- 172.21.15.59:0/3668413552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c105b80 msgr2=0x7fb72c19d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c105b80 0x7fb72c19d740 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb72400ef30 tx=0x7fb72400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 -- 172.21.15.59:0/3668413552 shutdown_connections 2023-10-08T12:59:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fb71c0a1670 0x7fb71c0a3b30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb72c067ce0 0x7fb72c198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c105b80 0x7fb72c19d740 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 --2- 172.21.15.59:0/3668413552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb72c1051c0 0x7fb72c1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 -- 172.21.15.59:0/3668413552 >> 172.21.15.59:0/3668413552 conn(0x7fb72c076780 msgr2=0x7fb72c10be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 -- 172.21.15.59:0/3668413552 shutdown_connections 2023-10-08T12:59:59.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T12:59:59.966+0000 7fb732fff700 1 -- 172.21.15.59:0/3668413552 wait complete. 2023-10-08T12:59:59.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 127360 20.38 MB/sec execute 210 sec latency 188.271 ms 2023-10-08T12:59:59.986 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:59:59.986 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:00:00.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.222+0000 7f8980dff700 1 -- 172.21.15.59:0/1342723404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f897c106640 msgr2=0x7f897c106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.222+0000 7f8980dff700 1 --2- 172.21.15.59:0/1342723404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f897c106640 0x7f897c106a20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f896c009990 tx=0x7f896c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.223+0000 7f8980dff700 1 -- 172.21.15.59:0/1342723404 shutdown_connections 2023-10-08T13:00:00.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.223+0000 7f8980dff700 1 --2- 172.21.15.59:0/1342723404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c100ff0 0x7f897c10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.223+0000 7f8980dff700 1 --2- 172.21.15.59:0/1342723404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f897c106640 0x7f897c106a20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.223+0000 7f8980dff700 1 --2- 172.21.15.59:0/1342723404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c100630 0x7f897c100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.223+0000 7f8980dff700 1 -- 172.21.15.59:0/1342723404 >> 172.21.15.59:0/1342723404 conn(0x7f897c0fc1a0 msgr2=0x7f897c0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:00.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.223+0000 7f8980dff700 1 -- 172.21.15.59:0/1342723404 shutdown_connections 2023-10-08T13:00:00.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.223+0000 7f8980dff700 1 -- 172.21.15.59:0/1342723404 wait complete. 2023-10-08T13:00:00.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.224+0000 7f8980dff700 1 Processor -- start 2023-10-08T13:00:00.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.224+0000 7f8980dff700 1 -- start start 2023-10-08T13:00:00.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8980dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c100630 0x7f897c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8980dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c100ff0 0x7f897c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8980dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f897c106640 0x7f897c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8980dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c1a4f30 con 0x7f897c106640 2023-10-08T13:00:00.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8980dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c1a50a0 con 0x7f897c100ff0 2023-10-08T13:00:00.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8980dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c1a5260 con 0x7f897c100630 2023-10-08T13:00:00.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8979d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c100ff0 0x7f897c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f897a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c100630 0x7f897c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8979d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c100ff0 0x7f897c073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:53786/0 (socket says 172.21.15.59:53786) 2023-10-08T13:00:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8979d9b700 1 -- 172.21.15.59:0/3789449298 learned_addr learned my addr 172.21.15.59:0/3789449298 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f897ad9d700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f897c106640 0x7f897c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8979d9b700 1 -- 172.21.15.59:0/3789449298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c100630 msgr2=0x7f897c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8979d9b700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c100630 0x7f897c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8979d9b700 1 -- 172.21.15.59:0/3789449298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f897c106640 msgr2=0x7f897c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.225+0000 7f8979d9b700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f897c106640 0x7f897c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.226+0000 7f8979d9b700 1 -- 172.21.15.59:0/3789449298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0095f0 con 0x7f897c100ff0 2023-10-08T13:00:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.226+0000 7f897ad9d700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f897c106640 0x7f897c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:00:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.226+0000 7f8979d9b700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c100ff0 0x7f897c073030 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f897000e9a0 tx=0x7f897000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.226+0000 7f896b7fe700 1 -- 172.21.15.59:0/3789449298 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970009790 con 0x7f897c100ff0 2023-10-08T13:00:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.226+0000 7f896b7fe700 1 -- 172.21.15.59:0/3789449298 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8970010430 con 0x7f897c100ff0 2023-10-08T13:00:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.226+0000 7f8980dff700 1 -- 172.21.15.59:0/3789449298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c1a5540 con 0x7f897c100ff0 2023-10-08T13:00:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.226+0000 7f896b7fe700 1 -- 172.21.15.59:0/3789449298 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970018680 con 0x7f897c100ff0 2023-10-08T13:00:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.226+0000 7f8980dff700 1 -- 172.21.15.59:0/3789449298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897c1a5aa0 con 0x7f897c100ff0 2023-10-08T13:00:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.227+0000 7f8980dff700 1 -- 172.21.15.59:0/3789449298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897c108c30 con 0x7f897c100ff0 2023-10-08T13:00:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.229+0000 7f896b7fe700 1 -- 172.21.15.59:0/3789449298 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f89700105a0 con 0x7f897c100ff0 2023-10-08T13:00:00.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.231+0000 7f896b7fe700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f89640a1670 0x7f89640a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.231+0000 7f896b7fe700 1 -- 172.21.15.59:0/3789449298 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f8970014070 con 0x7f897c100ff0 2023-10-08T13:00:00.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.231+0000 7f897a59c700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f89640a1670 0x7f89640a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.231+0000 7f897a59c700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f89640a1670 0x7f89640a3b30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f896c006010 tx=0x7f896c00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:00.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.234+0000 7f896b7fe700 1 -- 172.21.15.59:0/3789449298 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f89700965a0 con 0x7f897c100ff0 2023-10-08T13:00:00.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:00 smithi173 ceph-mon[135182]: pgmap v902: 97 pgs: 97 active+clean; 962 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.7 MiB/s wr, 314 op/s 2023-10-08T13:00:00.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:00 smithi173 ceph-mon[135182]: overall HEALTH_OK 2023-10-08T13:00:00.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:00 smithi059 ceph-mon[98489]: pgmap v902: 97 pgs: 97 active+clean; 962 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.7 MiB/s wr, 314 op/s 2023-10-08T13:00:00.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:00 smithi059 ceph-mon[98489]: overall HEALTH_OK 2023-10-08T13:00:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.613+0000 7f8980dff700 1 -- 172.21.15.59:0/3789449298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f897c073fd0 con 0x7f897c100ff0 2023-10-08T13:00:00.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.614+0000 7f896b7fe700 1 -- 172.21.15.59:0/3789449298 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f8970099bc0 con 0x7f897c100ff0 2023-10-08T13:00:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T13:00:00.615 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:00:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.617+0000 7f8980dff700 1 -- 172.21.15.59:0/3789449298 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f89640a1670 msgr2=0x7f89640a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.617+0000 7f8980dff700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f89640a1670 0x7f89640a3b30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f896c006010 tx=0x7f896c00b260 comp rx=0 tx=0).stop 2023-10-08T13:00:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.617+0000 7f8980dff700 1 -- 172.21.15.59:0/3789449298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c100ff0 msgr2=0x7f897c073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.617+0000 7f8980dff700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c100ff0 0x7f897c073030 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f897000e9a0 tx=0x7f897000ecb0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.617+0000 7f8980dff700 1 -- 172.21.15.59:0/3789449298 shutdown_connections 2023-10-08T13:00:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.617+0000 7f8980dff700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f89640a1670 0x7f89640a3b30 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.617+0000 7f8980dff700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f897c106640 0x7f897c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.617+0000 7f8980dff700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c100630 0x7f897c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.617+0000 7f8980dff700 1 --2- 172.21.15.59:0/3789449298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c100ff0 0x7f897c073030 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.617+0000 7f8980dff700 1 -- 172.21.15.59:0/3789449298 >> 172.21.15.59:0/3789449298 conn(0x7f897c0fc1a0 msgr2=0x7f897c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.618+0000 7f8980dff700 1 -- 172.21.15.59:0/3789449298 shutdown_connections 2023-10-08T13:00:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.618+0000 7f8980dff700 1 -- 172.21.15.59:0/3789449298 wait complete. 2023-10-08T13:00:00.620 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T13:00:00.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:00 smithi092 ceph-mon[134093]: pgmap v902: 97 pgs: 97 active+clean; 962 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.7 MiB/s wr, 314 op/s 2023-10-08T13:00:00.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:00 smithi092 ceph-mon[134093]: overall HEALTH_OK 2023-10-08T13:00:00.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T13:00:00.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.901+0000 7fa2e01ff700 1 -- 172.21.15.59:0/1791623255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d8072b90 msgr2=0x7fa2d8072f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.901+0000 7fa2e01ff700 1 --2- 172.21.15.59:0/1791623255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d8072b90 0x7fa2d8072f70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009990 tx=0x7fa2d4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.901+0000 7fa2e01ff700 1 -- 172.21.15.59:0/1791623255 shutdown_connections 2023-10-08T13:00:00.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.901+0000 7fa2e01ff700 1 --2- 172.21.15.59:0/1791623255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8111750 0x7fa2d8113b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.901+0000 7fa2e01ff700 1 --2- 172.21.15.59:0/1791623255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d8072b90 0x7fa2d8072f70 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.901+0000 7fa2e01ff700 1 --2- 172.21.15.59:0/1791623255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2d80734b0 0x7fa2d8111210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.901+0000 7fa2e01ff700 1 -- 172.21.15.59:0/1791623255 >> 172.21.15.59:0/1791623255 conn(0x7fa2d80fc230 msgr2=0x7fa2d80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:00.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.901+0000 7fa2e01ff700 1 -- 172.21.15.59:0/1791623255 shutdown_connections 2023-10-08T13:00:00.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.901+0000 7fa2e01ff700 1 -- 172.21.15.59:0/1791623255 wait complete. 2023-10-08T13:00:00.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.902+0000 7fa2e01ff700 1 Processor -- start 2023-10-08T13:00:00.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2e01ff700 1 -- start start 2023-10-08T13:00:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2e01ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8072b90 0x7fa2d819d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2e01ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d80734b0 0x7fa2d819d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2e01ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2d8111750 0x7fa2d81a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2e01ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81a2160 con 0x7fa2d80734b0 2023-10-08T13:00:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2e01ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81a22d0 con 0x7fa2d8072b90 2023-10-08T13:00:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2e01ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81a2490 con 0x7fa2d8111750 2023-10-08T13:00:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2ddf9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8072b90 0x7fa2d819d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2ddf9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8072b90 0x7fa2d819d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45016/0 (socket says 172.21.15.59:45016) 2023-10-08T13:00:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2ddf9b700 1 -- 172.21.15.59:0/2867274065 learned_addr learned my addr 172.21.15.59:0/2867274065 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2dd79a700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d80734b0 0x7fa2d819d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.903+0000 7fa2de79c700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2d8111750 0x7fa2d81a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2ddf9b700 1 -- 172.21.15.59:0/2867274065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2d8111750 msgr2=0x7fa2d81a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2ddf9b700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2d8111750 0x7fa2d81a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2ddf9b700 1 -- 172.21.15.59:0/2867274065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d80734b0 msgr2=0x7fa2d819d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2ddf9b700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d80734b0 0x7fa2d819d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2ddf9b700 1 -- 172.21.15.59:0/2867274065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40095f0 con 0x7fa2d8072b90 2023-10-08T13:00:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2dd79a700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d80734b0 0x7fa2d819d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:00:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2ddf9b700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8072b90 0x7fa2d819d240 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4005910 tx=0x7fa2d4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2ceffd700 1 -- 172.21.15.59:0/2867274065 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d401d070 con 0x7fa2d8072b90 2023-10-08T13:00:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2ceffd700 1 -- 172.21.15.59:0/2867274065 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2d4022470 con 0x7fa2d8072b90 2023-10-08T13:00:00.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2e01ff700 1 -- 172.21.15.59:0/2867274065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d81a2710 con 0x7fa2d8072b90 2023-10-08T13:00:00.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2ceffd700 1 -- 172.21.15.59:0/2867274065 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4017650 con 0x7fa2d8072b90 2023-10-08T13:00:00.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.904+0000 7fa2e01ff700 1 -- 172.21.15.59:0/2867274065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d81a9fb0 con 0x7fa2d8072b90 2023-10-08T13:00:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.909+0000 7fa2ceffd700 1 -- 172.21.15.59:0/2867274065 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa2d40225e0 con 0x7fa2d8072b90 2023-10-08T13:00:00.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.910+0000 7fa2ceffd700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2c40a1670 0x7fa2c40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.910+0000 7fa2f3abdb80 1 Processor -- start 2023-10-08T13:00:00.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.910+0000 7fa2ceffd700 1 -- 172.21.15.59:0/2867274065 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa2d40ce310 con 0x7fa2d8072b90 2023-10-08T13:00:00.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.910+0000 7fa2dd79a700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2c40a1670 0x7fa2c40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2f3abdb80 1 -- start start 2023-10-08T13:00:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2dd79a700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2c40a1670 0x7fa2c40a3b30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa2d819e790 tx=0x7fa2c8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2519e80 0x563ff251a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff251a7a0 0x563ff2525110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2525650 0x563ff2527a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff2483460 con 0x563ff251a7a0 2023-10-08T13:00:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff2474c20 con 0x563ff2525650 2023-10-08T13:00:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff2472540 con 0x563ff2519e80 2023-10-08T13:00:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2de79c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2525650 0x563ff2527a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2de79c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2525650 0x563ff2527a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45018/0 (socket says 172.21.15.59:45018) 2023-10-08T13:00:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2de79c700 1 -- 172.21.15.59:0/1915728026 learned_addr learned my addr 172.21.15.59:0/1915728026 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2dd79a700 1 --2- 172.21.15.59:0/1915728026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff251a7a0 0x563ff2525110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.911+0000 7fa2ddf9b700 1 --2- 172.21.15.59:0/1915728026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2519e80 0x563ff251a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.912+0000 7fa2de79c700 1 -- 172.21.15.59:0/1915728026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2519e80 msgr2=0x563ff251a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.912+0000 7fa2de79c700 1 --2- 172.21.15.59:0/1915728026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2519e80 0x563ff251a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.912+0000 7fa2de79c700 1 -- 172.21.15.59:0/1915728026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff251a7a0 msgr2=0x563ff2525110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.912+0000 7fa2de79c700 1 --2- 172.21.15.59:0/1915728026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff251a7a0 0x563ff2525110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.912+0000 7fa2de79c700 1 -- 172.21.15.59:0/1915728026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ff2298de0 con 0x563ff2525650 2023-10-08T13:00:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.912+0000 7fa2de79c700 1 --2- 172.21.15.59:0/1915728026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2525650 0x563ff2527a40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0011630 tx=0x7fa2d0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5249dfb896d76fd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.912+0000 7fa2c3fff700 1 -- 172.21.15.59:0/1915728026 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000e040 con 0x563ff2525650 2023-10-08T13:00:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.912+0000 7fa2c3fff700 1 -- 172.21.15.59:0/1915728026 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2d000f040 con 0x563ff2525650 2023-10-08T13:00:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.912+0000 7fa2c3fff700 1 -- 172.21.15.59:0/1915728026 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0004790 con 0x563ff2525650 2023-10-08T13:00:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.913+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/1915728026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2525650 msgr2=0x563ff2527a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.913+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/1915728026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2525650 0x563ff2527a40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0011630 tx=0x7fa2d0009920 comp rx=0 tx=0).stop 2023-10-08T13:00:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.913+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/1915728026 shutdown_connections 2023-10-08T13:00:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.913+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/1915728026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2525650 0x563ff2527a40 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.913+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/1915728026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2519e80 0x563ff251a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.913+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/1915728026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff251a7a0 0x563ff2525110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.913+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/1915728026 >> 172.21.15.59:0/1915728026 conn(0x563ff248f260 msgr2=0x563ff25162d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.913+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/1915728026 shutdown_connections 2023-10-08T13:00:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.913+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/1915728026 wait complete. 2023-10-08T13:00:00.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.914+0000 7fa2f3abdb80 1 -- start start 2023-10-08T13:00:00.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.914+0000 7fa2f3abdb80 1 Processor -- start 2023-10-08T13:00:00.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.915+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 0x563ff2524fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.915+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff251a7a0 0x563ff25223a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.915+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff2525650 0x563ff2522900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.915+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff246de30 con 0x563ff2525650 2023-10-08T13:00:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.915+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff240a710 con 0x563ff2519e80 2023-10-08T13:00:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.915+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff240a3b0 con 0x563ff251a7a0 2023-10-08T13:00:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.915+0000 7fa2f3abdb80 10 client.0 _ll_register_callbacks cb 0x563ff2267800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:00:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.915+0000 7fa2dd79a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff251a7a0 0x563ff25223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.915+0000 7fa2de79c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff2525650 0x563ff2522900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.915+0000 7fa2ddf9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 0x563ff2524fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.916+0000 7fa2dd79a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff251a7a0 0x563ff25223a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40184/0 (socket says 172.21.15.59:40184) 2023-10-08T13:00:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.916+0000 7fa2dd79a700 1 -- 172.21.15.59:0/3271341496 learned_addr learned my addr 172.21.15.59:0/3271341496 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.916+0000 7fa2de79c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff2525650 0x563ff2522900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59394/0 (socket says 172.21.15.59:59394) 2023-10-08T13:00:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.916+0000 7fa2dd79a700 1 -- 172.21.15.59:0/3271341496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 msgr2=0x563ff2524fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.916+0000 7fa2dd79a700 1 --2- 172.21.15.59:0/3271341496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 0x563ff2524fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.916+0000 7fa2dd79a700 1 -- 172.21.15.59:0/3271341496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff2525650 msgr2=0x563ff2522900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.916+0000 7fa2dd79a700 1 --2- 172.21.15.59:0/3271341496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff2525650 0x563ff2522900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.916+0000 7fa2dd79a700 1 -- 172.21.15.59:0/3271341496 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d00112b0 con 0x563ff251a7a0 2023-10-08T13:00:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.916+0000 7fa2dd79a700 1 --2- 172.21.15.59:0/3271341496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff251a7a0 0x563ff25223a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8003930 tx=0x7fa2c80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=680b9e24854a1705 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.916+0000 7fa2c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T13:00:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.917+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3271341496 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8012650 con 0x563ff251a7a0 2023-10-08T13:00:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.917+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3271341496 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa2c8018030 con 0x563ff251a7a0 2023-10-08T13:00:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.917+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3271341496 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ff2435eb0 con 0x563ff251a7a0 2023-10-08T13:00:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.917+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3271341496 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2c8004570 con 0x563ff251a7a0 2023-10-08T13:00:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.917+0000 7fa2f3abdb80 10 client.28159 fetch_fsmap learned FSMap version 20 2023-10-08T13:00:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.917+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3271341496 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x563ff2281c60 con 0x563ff251a7a0 2023-10-08T13:00:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.917+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3271341496 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563ff2435eb0 con 0x563ff251a7a0 2023-10-08T13:00:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.918+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3271341496 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa2c8026020 con 0x563ff251a7a0 2023-10-08T13:00:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.918+0000 7fa2f3abdb80 10 client.28159 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T13:00:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.918+0000 7fa2f3abdb80 10 client.28159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T13:00:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.918+0000 7fa2f3abdb80 20 client.28159 populate_metadata read hostname 'smithi059' 2023-10-08T13:00:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.918+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3271341496 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x563ff2535030 0x563ff2537450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.918+0000 7fa2f3abdb80 4 client.28159 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:00:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.918+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3271341496 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ff2466e10 con 0x563ff2535030 2023-10-08T13:00:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.918+0000 7fa2ddf9b700 1 --2- 172.21.15.59:0/3271341496 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x563ff2535030 0x563ff2537450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.919+0000 7fa2ddf9b700 1 --2- 172.21.15.59:0/3271341496 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x563ff2535030 0x563ff2537450 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=482d53fc0f158b7a server_cookie=413e7dbe5669dc71 in_seq=0 out_seq=0 2023-10-08T13:00:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.919+0000 7fa2c17fa700 10 client.28159 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.921+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3271341496 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563ff2466e10 con 0x563ff2535030 2023-10-08T13:00:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.921+0000 7fa2c17fa700 10 client.28159 handle_command_reply: tid=0 2023-10-08T13:00:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 1 client.28159 shutdown 2023-10-08T13:00:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3271341496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff251a7a0 msgr2=0x563ff25223a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3271341496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff251a7a0 0x563ff25223a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8003930 tx=0x7fa2c80047c0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3271341496 shutdown_connections 2023-10-08T13:00:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3271341496 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x563ff2535030 0x563ff2537450 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3271341496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 0x563ff2524fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3271341496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff2525650 0x563ff2522900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3271341496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff251a7a0 0x563ff25223a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3271341496 >> 172.21.15.59:0/3271341496 conn(0x563ff248f260 msgr2=0x563ff2515ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2c17fa700 0 client.28159 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3271341496 shutdown_connections 2023-10-08T13:00:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3271341496 wait complete. 2023-10-08T13:00:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.922+0000 7fa2f3abdb80 20 client.28159 trim_cache size 0 max 16384 2023-10-08T13:00:00.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.939+0000 7fa2f3abdb80 1 Processor -- start 2023-10-08T13:00:00.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.939+0000 7fa2f3abdb80 1 -- start start 2023-10-08T13:00:00.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff2519e80 0x563ff2522900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff251a7a0 0x563ff252c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 0x563ff25154d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff22ee920 con 0x563ff2519e80 2023-10-08T13:00:00.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff2522ee0 con 0x563ff251a7a0 2023-10-08T13:00:00.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff252c750 con 0x563ff2525650 2023-10-08T13:00:00.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2dd79a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff251a7a0 0x563ff252c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2ddf9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff2519e80 0x563ff2522900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2de79c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 0x563ff25154d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2dd79a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff251a7a0 0x563ff252c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45024/0 (socket says 172.21.15.59:45024) 2023-10-08T13:00:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2dd79a700 1 -- 172.21.15.59:0/1778644822 learned_addr learned my addr 172.21.15.59:0/1778644822 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2de79c700 1 -- 172.21.15.59:0/1778644822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff251a7a0 msgr2=0x563ff252c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2de79c700 1 --2- 172.21.15.59:0/1778644822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff251a7a0 0x563ff252c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2de79c700 1 -- 172.21.15.59:0/1778644822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff2519e80 msgr2=0x563ff2522900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2de79c700 1 --2- 172.21.15.59:0/1778644822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff2519e80 0x563ff2522900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.940+0000 7fa2de79c700 1 -- 172.21.15.59:0/1778644822 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ff22bf250 con 0x563ff2525650 2023-10-08T13:00:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.941+0000 7fa2de79c700 1 --2- 172.21.15.59:0/1778644822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 0x563ff25154d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0004390 tx=0x7fa2d00095e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3642f9dc7538ca32 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:00.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.941+0000 7fa2ccff9700 1 -- 172.21.15.59:0/1778644822 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000e050 con 0x563ff2525650 2023-10-08T13:00:00.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.941+0000 7fa2ccff9700 1 -- 172.21.15.59:0/1778644822 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2d0009360 con 0x563ff2525650 2023-10-08T13:00:00.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.941+0000 7fa2ccff9700 1 -- 172.21.15.59:0/1778644822 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0004070 con 0x563ff2525650 2023-10-08T13:00:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.942+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/1778644822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 msgr2=0x563ff25154d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.942+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/1778644822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 0x563ff25154d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0004390 tx=0x7fa2d00095e0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.942+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/1778644822 shutdown_connections 2023-10-08T13:00:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.942+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/1778644822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 0x563ff25154d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.942+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/1778644822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff2519e80 0x563ff2522900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.942+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/1778644822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff251a7a0 0x563ff252c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.942+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/1778644822 >> 172.21.15.59:0/1778644822 conn(0x563ff248f260 msgr2=0x563ff2511f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.942+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/1778644822 shutdown_connections 2023-10-08T13:00:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.942+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/1778644822 wait complete. 2023-10-08T13:00:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.942+0000 7fa2f3abdb80 1 -- start start 2023-10-08T13:00:00.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2f3abdb80 1 Processor -- start 2023-10-08T13:00:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 0x563ff252be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff251a7a0 0x563ff252a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2f3abdb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 0x563ff252a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff252ac70 con 0x563ff251a7a0 2023-10-08T13:00:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff252ade0 con 0x563ff2519e80 2023-10-08T13:00:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2f3abdb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff252afa0 con 0x563ff2525650 2023-10-08T13:00:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2f3abdb80 10 client.0 _ll_register_callbacks cb 0x7fa2c80043d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:00:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2ddf9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 0x563ff252be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2dd79a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff251a7a0 0x563ff252a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2ddf9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 0x563ff252be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45028/0 (socket says 172.21.15.59:45028) 2023-10-08T13:00:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2ddf9b700 1 -- 172.21.15.59:0/3239694418 learned_addr learned my addr 172.21.15.59:0/3239694418 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.943+0000 7fa2de79c700 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 0x563ff252a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.944+0000 7fa2ddf9b700 1 -- 172.21.15.59:0/3239694418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 msgr2=0x563ff252a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.944+0000 7fa2ddf9b700 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 0x563ff252a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.944+0000 7fa2ddf9b700 1 -- 172.21.15.59:0/3239694418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff251a7a0 msgr2=0x563ff252a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.944+0000 7fa2ddf9b700 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff251a7a0 0x563ff252a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.944+0000 7fa2ddf9b700 1 -- 172.21.15.59:0/3239694418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ff2298de0 con 0x563ff2519e80 2023-10-08T13:00:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.944+0000 7fa2de79c700 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 0x563ff252a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:00:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.944+0000 7fa2ddf9b700 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 0x563ff252be00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40cbb10 tx=0x7fa2d4009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b56a32974898ed92 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.944+0000 7fa2c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.944+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3239694418 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40b2070 con 0x563ff2519e80 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.944+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3239694418 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fa2d409b3d0 con 0x563ff2519e80 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.944+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3239694418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2d000f040 con 0x563ff2519e80 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3239694418 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2d409f520 con 0x563ff2519e80 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2f3abdb80 10 client.28184 fetch_fsmap learned FSMap version 20 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3239694418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x563ff22972b0 con 0x563ff2519e80 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3239694418 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2d4081080 con 0x563ff2519e80 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3239694418 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa2d409b6a0 con 0x563ff2519e80 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2f3abdb80 10 client.28184 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2f3abdb80 10 client.28184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2f3abdb80 20 client.28184 populate_metadata read hostname 'smithi059' 2023-10-08T13:00:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x563ff258a030 0x563ff258c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:00.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2f3abdb80 4 client.28184 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:00:00.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3239694418 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563ff2466b30 con 0x563ff258a030 2023-10-08T13:00:00.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.945+0000 7fa2dd79a700 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x563ff258a030 0x563ff258c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:00.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.946+0000 7fa2dd79a700 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x563ff258a030 0x563ff258c420 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=630ddfb8bb7fc2ae server_cookie=c222a5bdd8d738e6 in_seq=0 out_seq=0 2023-10-08T13:00:00.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.946+0000 7fa2c17fa700 10 client.28184 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:00.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.952+0000 7fa2c17fa700 1 -- 172.21.15.59:0/3239694418 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563ff2466b30 con 0x563ff258a030 2023-10-08T13:00:00.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.952+0000 7fa2c17fa700 10 client.28184 handle_command_reply: tid=0 2023-10-08T13:00:00.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.952+0000 7fa2f3abdb80 1 client.28184 shutdown 2023-10-08T13:00:00.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.952+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3239694418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 msgr2=0x563ff252be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.952+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 0x563ff252be00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40cbb10 tx=0x7fa2d4009310 comp rx=0 tx=0).stop 2023-10-08T13:00:00.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.953+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3239694418 shutdown_connections 2023-10-08T13:00:00.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.953+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x563ff258a030 0x563ff258c420 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.953+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ff2519e80 0x563ff252be00 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.953+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ff2525650 0x563ff252a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.953+0000 7fa2f3abdb80 1 --2- 172.21.15.59:0/3239694418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ff251a7a0 0x563ff252a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.953+0000 7fa2c17fa700 0 client.28184 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:00.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.953+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3239694418 >> 172.21.15.59:0/3239694418 conn(0x563ff248f260 msgr2=0x563ff2524bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:00.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.953+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3239694418 shutdown_connections 2023-10-08T13:00:00.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.953+0000 7fa2f3abdb80 1 -- 172.21.15.59:0/3239694418 wait complete. 2023-10-08T13:00:00.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.953+0000 7fa2f3abdb80 20 client.28184 trim_cache size 0 max 16384 2023-10-08T13:00:00.955 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T13:00:00.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 -- 172.21.15.59:0/2867274065 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2c40a1670 msgr2=0x7fa2c40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2c40a1670 0x7fa2c40a3b30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa2d819e790 tx=0x7fa2c8009260 comp rx=0 tx=0).stop 2023-10-08T13:00:00.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 -- 172.21.15.59:0/2867274065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8072b90 msgr2=0x7fa2d819d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:00.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8072b90 0x7fa2d819d240 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4005910 tx=0x7fa2d4004730 comp rx=0 tx=0).stop 2023-10-08T13:00:00.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 -- 172.21.15.59:0/2867274065 shutdown_connections 2023-10-08T13:00:00.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa2c40a1670 0x7fa2c40a3b30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d8072b90 0x7fa2d819d240 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2d8111750 0x7fa2d81a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 --2- 172.21.15.59:0/2867274065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d80734b0 0x7fa2d819d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:00.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 -- 172.21.15.59:0/2867274065 >> 172.21.15.59:0/2867274065 conn(0x7fa2d80fc230 msgr2=0x7fa2d80fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:00.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 -- 172.21.15.59:0/2867274065 shutdown_connections 2023-10-08T13:00:00.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:00.954+0000 7fa2e01ff700 1 -- 172.21.15.59:0/2867274065 wait complete. 2023-10-08T13:00:00.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 127623 20.37 MB/sec execute 211 sec latency 391.800 ms 2023-10-08T13:00:01.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:01 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3789449298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:00:01.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:01 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3789449298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:00:01.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:01 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3789449298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:00:01.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 127876 20.34 MB/sec execute 212 sec latency 133.073 ms 2023-10-08T13:00:01.980 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T13:00:01.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T13:00:02.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.279+0000 7f2624bff700 1 -- 172.21.15.59:0/350136412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2620100740 msgr2=0x7f2620100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.279+0000 7f2624bff700 1 --2- 172.21.15.59:0/350136412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2620100740 0x7f2620100bc0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f26080098f0 tx=0x7f2608009c00 comp rx=0 tx=0).stop 2023-10-08T13:00:02.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.281+0000 7f2624bff700 1 -- 172.21.15.59:0/350136412 shutdown_connections 2023-10-08T13:00:02.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.281+0000 7f2624bff700 1 --2- 172.21.15.59:0/350136412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2620101100 0x7f262010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.281+0000 7f2624bff700 1 --2- 172.21.15.59:0/350136412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2620106750 0x7f2620106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.281+0000 7f2624bff700 1 --2- 172.21.15.59:0/350136412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2620100740 0x7f2620100bc0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.281+0000 7f2624bff700 1 -- 172.21.15.59:0/350136412 >> 172.21.15.59:0/350136412 conn(0x7f26200fc230 msgr2=0x7f26200fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.281+0000 7f2624bff700 1 -- 172.21.15.59:0/350136412 shutdown_connections 2023-10-08T13:00:02.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.281+0000 7f2624bff700 1 -- 172.21.15.59:0/350136412 wait complete. 2023-10-08T13:00:02.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.283+0000 7f2624bff700 1 Processor -- start 2023-10-08T13:00:02.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.283+0000 7f2624bff700 1 -- start start 2023-10-08T13:00:02.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.284+0000 7f2624bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2620100740 0x7f2620072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.284+0000 7f2624bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2620101100 0x7f2620073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.284+0000 7f2624bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2620106750 0x7f2620073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.284+0000 7f2624bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2620074ac0 con 0x7f2620100740 2023-10-08T13:00:02.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.284+0000 7f2624bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262019ad70 con 0x7f2620106750 2023-10-08T13:00:02.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.284+0000 7f2624bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262019af30 con 0x7f2620101100 2023-10-08T13:00:02.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.284+0000 7f260ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2620101100 0x7f2620073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.284+0000 7f260ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2620101100 0x7f2620073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40232/0 (socket says 172.21.15.59:40232) 2023-10-08T13:00:02.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.284+0000 7f260ffff700 1 -- 172.21.15.59:0/1911823639 learned_addr learned my addr 172.21.15.59:0/1911823639 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:02.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.284+0000 7f261ed9d700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2620106750 0x7f2620073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.285+0000 7f260ffff700 1 -- 172.21.15.59:0/1911823639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2620106750 msgr2=0x7f2620073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.285+0000 7f260ffff700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2620106750 0x7f2620073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.285+0000 7f260ffff700 1 -- 172.21.15.59:0/1911823639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2620100740 msgr2=0x7f2620072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.285+0000 7f260ffff700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2620100740 0x7f2620072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.285+0000 7f260ffff700 1 -- 172.21.15.59:0/1911823639 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2608009520 con 0x7f2620101100 2023-10-08T13:00:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.285+0000 7f260ffff700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2620101100 0x7f2620073030 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2608005950 tx=0x7f260800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.286+0000 7f2617fff700 1 -- 172.21.15.59:0/1911823639 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260801c070 con 0x7f2620101100 2023-10-08T13:00:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.286+0000 7f2617fff700 1 -- 172.21.15.59:0/1911823639 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f260800bbd0 con 0x7f2620101100 2023-10-08T13:00:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.286+0000 7f2624bff700 1 -- 172.21.15.59:0/1911823639 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262019b1b0 con 0x7f2620101100 2023-10-08T13:00:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.286+0000 7f2617fff700 1 -- 172.21.15.59:0/1911823639 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608003a00 con 0x7f2620101100 2023-10-08T13:00:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.286+0000 7f2624bff700 1 -- 172.21.15.59:0/1911823639 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262019b690 con 0x7f2620101100 2023-10-08T13:00:02.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.291+0000 7f2617fff700 1 -- 172.21.15.59:0/1911823639 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2608020030 con 0x7f2620101100 2023-10-08T13:00:02.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.293+0000 7f2638527b80 1 Processor -- start 2023-10-08T13:00:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.294+0000 7f2638527b80 1 -- start start 2023-10-08T13:00:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.294+0000 7f2638527b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 0x55fa3875a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.294+0000 7f2638527b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3875a820 0x55fa38765190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.294+0000 7f2638527b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387656d0 0x55fa38767ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.294+0000 7f2638527b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa386c34e0 con 0x55fa387656d0 2023-10-08T13:00:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.294+0000 7f2638527b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa386b4ca0 con 0x55fa3875a820 2023-10-08T13:00:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.294+0000 7f2638527b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa386b25c0 con 0x55fa38759f00 2023-10-08T13:00:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.295+0000 7f260ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387656d0 0x55fa38767ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.295+0000 7f261e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3875a820 0x55fa38765190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.295+0000 7f260ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387656d0 0x55fa38767ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59446/0 (socket says 172.21.15.59:59446) 2023-10-08T13:00:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.295+0000 7f261e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3875a820 0x55fa38765190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45054/0 (socket says 172.21.15.59:45054) 2023-10-08T13:00:02.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.295+0000 7f260ffff700 1 -- 172.21.15.59:0/1979521485 learned_addr learned my addr 172.21.15.59:0/1979521485 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:02.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.295+0000 7f2617fff700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26000a17c0 0x7f26000a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.295+0000 7f261ed9d700 1 --2- 172.21.15.59:0/1979521485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 0x55fa3875a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.295+0000 7f261ed9d700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26000a17c0 0x7f26000a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.295+0000 7f2617fff700 1 -- 172.21.15.59:0/1911823639 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f26080cdee0 con 0x7f2620101100 2023-10-08T13:00:02.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.296+0000 7f261e59c700 1 -- 172.21.15.59:0/1979521485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 msgr2=0x55fa3875a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.296+0000 7f261e59c700 1 --2- 172.21.15.59:0/1979521485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 0x55fa3875a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.296+0000 7f261e59c700 1 -- 172.21.15.59:0/1979521485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387656d0 msgr2=0x55fa38767ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.296+0000 7f261e59c700 1 --2- 172.21.15.59:0/1979521485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387656d0 0x55fa38767ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.296+0000 7f261e59c700 1 -- 172.21.15.59:0/1979521485 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa384d8e60 con 0x55fa3875a820 2023-10-08T13:00:02.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.296+0000 7f261e59c700 1 --2- 172.21.15.59:0/1979521485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3875a820 0x55fa38765190 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f261000e440 tx=0x7f261000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e63907d53b8200db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.297+0000 7f261ed9d700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26000a17c0 0x7f26000a3c80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f261800b620 tx=0x7f26180047c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.297+0000 7f26157fa700 1 -- 172.21.15.59:0/1979521485 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610010040 con 0x55fa3875a820 2023-10-08T13:00:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.297+0000 7f26157fa700 1 -- 172.21.15.59:0/1979521485 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2610004bb0 con 0x55fa3875a820 2023-10-08T13:00:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.297+0000 7f26157fa700 1 -- 172.21.15.59:0/1979521485 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610004290 con 0x55fa3875a820 2023-10-08T13:00:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.298+0000 7f2638527b80 1 -- 172.21.15.59:0/1979521485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3875a820 msgr2=0x55fa38765190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.298+0000 7f2638527b80 1 --2- 172.21.15.59:0/1979521485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3875a820 0x55fa38765190 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f261000e440 tx=0x7f261000b040 comp rx=0 tx=0).stop 2023-10-08T13:00:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.298+0000 7f2638527b80 1 -- 172.21.15.59:0/1979521485 shutdown_connections 2023-10-08T13:00:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.298+0000 7f2638527b80 1 --2- 172.21.15.59:0/1979521485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387656d0 0x55fa38767ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.298+0000 7f2638527b80 1 --2- 172.21.15.59:0/1979521485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 0x55fa3875a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.298+0000 7f2638527b80 1 --2- 172.21.15.59:0/1979521485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3875a820 0x55fa38765190 secure :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f261000e440 tx=0x7f261000b040 comp rx=0 tx=0).stop 2023-10-08T13:00:02.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.298+0000 7f2638527b80 1 -- 172.21.15.59:0/1979521485 >> 172.21.15.59:0/1979521485 conn(0x55fa386cf2e0 msgr2=0x55fa38756350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.298+0000 7f2638527b80 1 -- 172.21.15.59:0/1979521485 shutdown_connections 2023-10-08T13:00:02.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.298+0000 7f2638527b80 1 -- 172.21.15.59:0/1979521485 wait complete. 2023-10-08T13:00:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.299+0000 7f2638527b80 1 -- start start 2023-10-08T13:00:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.300+0000 7f2638527b80 1 Processor -- start 2023-10-08T13:00:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.300+0000 7f2638527b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 0x55fa38762620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.300+0000 7f2638527b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa387656d0 0x55fa38762b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.300+0000 7f2638527b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387630a0 0x55fa38771310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.300+0000 7f2638527b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa386adeb0 con 0x55fa387630a0 2023-10-08T13:00:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.300+0000 7f2638527b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa3864a790 con 0x55fa387656d0 2023-10-08T13:00:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.300+0000 7f2638527b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa3864a430 con 0x55fa38759f00 2023-10-08T13:00:02.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.300+0000 7f2638527b80 10 client.0 _ll_register_callbacks cb 0x55fa384a7880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:00:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.301+0000 7f261e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 0x55fa38762620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.301+0000 7f261e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 0x55fa38762620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40250/0 (socket says 172.21.15.59:40250) 2023-10-08T13:00:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.301+0000 7f261e59c700 1 -- 172.21.15.59:0/282041494 learned_addr learned my addr 172.21.15.59:0/282041494 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.301+0000 7f260ffff700 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa387656d0 0x55fa38762b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.301+0000 7f261ed9d700 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387630a0 0x55fa38771310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.302+0000 7f261e59c700 1 -- 172.21.15.59:0/282041494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa387656d0 msgr2=0x55fa38762b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.302+0000 7f261e59c700 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa387656d0 0x55fa38762b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.302+0000 7f261e59c700 1 -- 172.21.15.59:0/282041494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387630a0 msgr2=0x55fa38771310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.302+0000 7f261e59c700 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387630a0 0x55fa38771310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.302+0000 7f261e59c700 1 -- 172.21.15.59:0/282041494 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261000e0c0 con 0x55fa38759f00 2023-10-08T13:00:02.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.302+0000 7f261ed9d700 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387630a0 0x55fa38771310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:00:02.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.302+0000 7f261e59c700 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 0x55fa38762620 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2610003ca0 tx=0x7f2610004d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3f0cccefc6c8ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.302+0000 7f260dffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T13:00:02.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.303+0000 7f260dffb700 1 -- 172.21.15.59:0/282041494 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610010070 con 0x55fa38759f00 2023-10-08T13:00:02.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.303+0000 7f260dffb700 1 -- 172.21.15.59:0/282041494 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f26100075c0 con 0x55fa38759f00 2023-10-08T13:00:02.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.303+0000 7f2638527b80 1 -- 172.21.15.59:0/282041494 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa38675f30 con 0x55fa38759f00 2023-10-08T13:00:02.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.303+0000 7f260dffb700 1 -- 172.21.15.59:0/282041494 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2610007780 con 0x55fa38759f00 2023-10-08T13:00:02.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.303+0000 7f2638527b80 10 client.28177 fetch_fsmap learned FSMap version 20 2023-10-08T13:00:02.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.303+0000 7f2638527b80 1 -- 172.21.15.59:0/282041494 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55fa384c1ce0 con 0x55fa38759f00 2023-10-08T13:00:02.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.304+0000 7f260dffb700 1 -- 172.21.15.59:0/282041494 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fa38675f30 con 0x55fa38759f00 2023-10-08T13:00:02.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.304+0000 7f260dffb700 1 -- 172.21.15.59:0/282041494 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f261001e790 con 0x55fa38759f00 2023-10-08T13:00:02.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.304+0000 7f2638527b80 10 client.28177 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T13:00:02.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.304+0000 7f2638527b80 10 client.28177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T13:00:02.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.304+0000 7f2638527b80 20 client.28177 populate_metadata read hostname 'smithi059' 2023-10-08T13:00:02.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.304+0000 7f2638527b80 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fa387757d0 0x55fa38777bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.304+0000 7f2638527b80 4 client.28177 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:00:02.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.304+0000 7f2638527b80 1 -- 172.21.15.59:0/282041494 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa386a6e90 con 0x55fa387757d0 2023-10-08T13:00:02.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.304+0000 7f260ffff700 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fa387757d0 0x55fa38777bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.305+0000 7f260ffff700 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fa387757d0 0x55fa38777bc0 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba1d693d595db060 server_cookie=d7773fdb4e293574 in_seq=0 out_seq=0 2023-10-08T13:00:02.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.305+0000 7f260dffb700 10 client.28177 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:02.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f260dffb700 1 -- 172.21.15.59:0/282041494 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fa386a6e90 con 0x55fa387757d0 2023-10-08T13:00:02.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f260dffb700 10 client.28177 handle_command_reply: tid=0 2023-10-08T13:00:02.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f2638527b80 1 client.28177 shutdown 2023-10-08T13:00:02.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f2638527b80 1 -- 172.21.15.59:0/282041494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 msgr2=0x55fa38762620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f2638527b80 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 0x55fa38762620 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2610003ca0 tx=0x7f2610004d20 comp rx=0 tx=0).stop 2023-10-08T13:00:02.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f2638527b80 1 -- 172.21.15.59:0/282041494 shutdown_connections 2023-10-08T13:00:02.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f2638527b80 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fa387757d0 0x55fa38777bc0 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f2638527b80 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387630a0 0x55fa38771310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f2638527b80 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa38759f00 0x55fa38762620 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f2638527b80 1 --2- 172.21.15.59:0/282041494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa387656d0 0x55fa38762b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f2638527b80 1 -- 172.21.15.59:0/282041494 >> 172.21.15.59:0/282041494 conn(0x55fa386cf2e0 msgr2=0x55fa38755f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f260dffb700 0 client.28177 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:02.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.310+0000 7f2638527b80 1 -- 172.21.15.59:0/282041494 shutdown_connections 2023-10-08T13:00:02.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.311+0000 7f2638527b80 1 -- 172.21.15.59:0/282041494 wait complete. 2023-10-08T13:00:02.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.311+0000 7f2638527b80 20 client.28177 trim_cache size 0 max 16384 2023-10-08T13:00:02.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.344+0000 7f2638527b80 1 Processor -- start 2023-10-08T13:00:02.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.344+0000 7f2638527b80 1 -- start start 2023-10-08T13:00:02.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.344+0000 7f2638527b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa38759f00 0x55fa38771080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.344+0000 7f2638527b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa387630a0 0x55fa3875cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.344+0000 7f2638527b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387656d0 0x55fa3875f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.344+0000 7f2638527b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa3852e9a0 con 0x55fa387656d0 2023-10-08T13:00:02.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.344+0000 7f2638527b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa38763cb0 con 0x55fa38759f00 2023-10-08T13:00:02.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.344+0000 7f2638527b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa387635e0 con 0x55fa387630a0 2023-10-08T13:00:02.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.345+0000 7f261e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa38759f00 0x55fa38771080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.345+0000 7f261e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa38759f00 0x55fa38771080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45064/0 (socket says 172.21.15.59:45064) 2023-10-08T13:00:02.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.345+0000 7f261e59c700 1 -- 172.21.15.59:0/2985400228 learned_addr learned my addr 172.21.15.59:0/2985400228 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:02.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.345+0000 7f261ed9d700 1 --2- 172.21.15.59:0/2985400228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387656d0 0x55fa3875f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.346+0000 7f261e59c700 1 -- 172.21.15.59:0/2985400228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa387630a0 msgr2=0x55fa3875cdd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:00:02.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.346+0000 7f261e59c700 1 --2- 172.21.15.59:0/2985400228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa387630a0 0x55fa3875cdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.346+0000 7f261e59c700 1 -- 172.21.15.59:0/2985400228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387656d0 msgr2=0x55fa3875f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.346+0000 7f261e59c700 1 --2- 172.21.15.59:0/2985400228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387656d0 0x55fa3875f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.346+0000 7f261e59c700 1 -- 172.21.15.59:0/2985400228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa3877c810 con 0x55fa38759f00 2023-10-08T13:00:02.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.346+0000 7f261e59c700 1 --2- 172.21.15.59:0/2985400228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa38759f00 0x55fa38771080 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f261001eb20 tx=0x7f26100061f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1a3b54b3f1b1fcb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.346+0000 7f2615ffb700 1 -- 172.21.15.59:0/2985400228 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610010070 con 0x55fa38759f00 2023-10-08T13:00:02.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.346+0000 7f2615ffb700 1 -- 172.21.15.59:0/2985400228 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f261001ee90 con 0x55fa38759f00 2023-10-08T13:00:02.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.346+0000 7f2615ffb700 1 -- 172.21.15.59:0/2985400228 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26100077a0 con 0x55fa38759f00 2023-10-08T13:00:02.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.347+0000 7f2638527b80 1 -- 172.21.15.59:0/2985400228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa38759f00 msgr2=0x55fa38771080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.347+0000 7f2638527b80 1 --2- 172.21.15.59:0/2985400228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa38759f00 0x55fa38771080 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f261001eb20 tx=0x7f26100061f0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.348+0000 7f2638527b80 1 -- 172.21.15.59:0/2985400228 shutdown_connections 2023-10-08T13:00:02.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.348+0000 7f2638527b80 1 --2- 172.21.15.59:0/2985400228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa38759f00 0x55fa38771080 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.348+0000 7f2638527b80 1 --2- 172.21.15.59:0/2985400228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa387656d0 0x55fa3875f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.348+0000 7f2638527b80 1 --2- 172.21.15.59:0/2985400228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa387630a0 0x55fa3875cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.348+0000 7f2638527b80 1 -- 172.21.15.59:0/2985400228 >> 172.21.15.59:0/2985400228 conn(0x55fa386cf2e0 msgr2=0x55fa38770970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.348+0000 7f2638527b80 1 -- 172.21.15.59:0/2985400228 shutdown_connections 2023-10-08T13:00:02.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.348+0000 7f2638527b80 1 -- 172.21.15.59:0/2985400228 wait complete. 2023-10-08T13:00:02.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.349+0000 7f2638527b80 1 -- start start 2023-10-08T13:00:02.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.349+0000 7f2638527b80 1 Processor -- start 2023-10-08T13:00:02.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f2638527b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa38759f00 0x55fa3876bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f2638527b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa387630a0 0x55fa3876a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f2638527b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa387656d0 0x55fa3876ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f2638527b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa3876b090 con 0x55fa38759f00 2023-10-08T13:00:02.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f2638527b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa3876b200 con 0x55fa387630a0 2023-10-08T13:00:02.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f2638527b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa3876b3c0 con 0x55fa387656d0 2023-10-08T13:00:02.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f2638527b80 10 client.0 _ll_register_callbacks cb 0x7f261800b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:00:02.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f260ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa387630a0 0x55fa3876a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f260ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa387630a0 0x55fa3876a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45072/0 (socket says 172.21.15.59:45072) 2023-10-08T13:00:02.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f260ffff700 1 -- 172.21.15.59:0/1819792932 learned_addr learned my addr 172.21.15.59:0/1819792932 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:02.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f261ed9d700 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa387656d0 0x55fa3876ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.350+0000 7f261e59c700 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa38759f00 0x55fa3876bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.351+0000 7f261ed9d700 1 -- 172.21.15.59:0/1819792932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa387630a0 msgr2=0x55fa3876a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.351+0000 7f261ed9d700 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa387630a0 0x55fa3876a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.351+0000 7f261ed9d700 1 -- 172.21.15.59:0/1819792932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa38759f00 msgr2=0x55fa3876bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.351+0000 7f261ed9d700 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa38759f00 0x55fa3876bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.351+0000 7f261ed9d700 1 -- 172.21.15.59:0/1819792932 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa384c1ce0 con 0x55fa387656d0 2023-10-08T13:00:02.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.351+0000 7f261ed9d700 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa387656d0 0x55fa3876ab50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f261800bcf0 tx=0x7f2618004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebb5997b100c1278 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.351+0000 7f260dffb700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T13:00:02.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.351+0000 7f260dffb700 1 -- 172.21.15.59:0/1819792932 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618012dd0 con 0x55fa387656d0 2023-10-08T13:00:02.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.351+0000 7f260dffb700 1 -- 172.21.15.59:0/1819792932 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f2618004830 con 0x55fa387656d0 2023-10-08T13:00:02.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.352+0000 7f2638527b80 1 -- 172.21.15.59:0/1819792932 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2610004bb0 con 0x55fa387656d0 2023-10-08T13:00:02.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.352+0000 7f260dffb700 1 -- 172.21.15.59:0/1819792932 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26180049f0 con 0x55fa387656d0 2023-10-08T13:00:02.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.352+0000 7f2638527b80 10 client.28180 fetch_fsmap learned FSMap version 20 2023-10-08T13:00:02.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.352+0000 7f2638527b80 1 -- 172.21.15.59:0/1819792932 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55fa384ff2d0 con 0x55fa387656d0 2023-10-08T13:00:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.353+0000 7f260dffb700 1 -- 172.21.15.59:0/1819792932 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2610004bb0 con 0x55fa387656d0 2023-10-08T13:00:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.353+0000 7f260dffb700 1 -- 172.21.15.59:0/1819792932 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f261802a030 con 0x55fa387656d0 2023-10-08T13:00:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.353+0000 7f2638527b80 10 client.28180 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T13:00:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.353+0000 7f2638527b80 10 client.28180 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T13:00:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.353+0000 7f2638527b80 20 client.28180 populate_metadata read hostname 'smithi059' 2023-10-08T13:00:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.353+0000 7f2638527b80 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fa387cab40 0x55fa387ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.353+0000 7f2638527b80 4 client.28180 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T13:00:02.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.353+0000 7f2638527b80 1 -- 172.21.15.59:0/1819792932 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55fa386a6bb0 con 0x55fa387cab40 2023-10-08T13:00:02.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.354+0000 7f261e59c700 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fa387cab40 0x55fa387ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.354+0000 7f261e59c700 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fa387cab40 0x55fa387ccf60 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5d2312d9def4758 server_cookie=bf4a1aa337102f2b in_seq=0 out_seq=0 2023-10-08T13:00:02.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.354+0000 7f260dffb700 10 client.28180 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:02.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f260dffb700 1 -- 172.21.15.59:0/1819792932 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55fa386a6bb0 con 0x55fa387cab40 2023-10-08T13:00:02.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f260dffb700 10 client.28180 handle_command_reply: tid=0 2023-10-08T13:00:02.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f2638527b80 1 client.28180 shutdown 2023-10-08T13:00:02.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f2638527b80 1 -- 172.21.15.59:0/1819792932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa387656d0 msgr2=0x55fa3876ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f2638527b80 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa387656d0 0x55fa3876ab50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f261800bcf0 tx=0x7f2618004750 comp rx=0 tx=0).stop 2023-10-08T13:00:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f2638527b80 1 -- 172.21.15.59:0/1819792932 shutdown_connections 2023-10-08T13:00:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f2638527b80 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55fa387cab40 0x55fa387ccf60 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f2638527b80 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa387656d0 0x55fa3876ab50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f2638527b80 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa38759f00 0x55fa3876bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f2638527b80 1 --2- 172.21.15.59:0/1819792932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa387630a0 0x55fa3876a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f2638527b80 1 -- 172.21.15.59:0/1819792932 >> 172.21.15.59:0/1819792932 conn(0x55fa386cf2e0 msgr2=0x55fa38755550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.368+0000 7f260dffb700 0 client.28180 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.369+0000 7f2638527b80 1 -- 172.21.15.59:0/1819792932 shutdown_connections 2023-10-08T13:00:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.369+0000 7f2638527b80 1 -- 172.21.15.59:0/1819792932 wait complete. 2023-10-08T13:00:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.370+0000 7f2638527b80 20 client.28180 trim_cache size 0 max 16384 2023-10-08T13:00:02.370 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T13:00:02.370 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2023-10-08T13:00:02.370 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "52718db9-88f6-466c-86b8-19624f3f27f5", 2023-10-08T13:00:02.371 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2023-10-08T13:00:02.371 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T13:00:02.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.372+0000 7f2624bff700 1 -- 172.21.15.59:0/1911823639 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26000a17c0 msgr2=0x7f26000a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.372+0000 7f2624bff700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26000a17c0 0x7f26000a3c80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f261800b620 tx=0x7f26180047c0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.372+0000 7f2624bff700 1 -- 172.21.15.59:0/1911823639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2620101100 msgr2=0x7f2620073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.372+0000 7f2624bff700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2620101100 0x7f2620073030 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2608005950 tx=0x7f260800fa00 comp rx=0 tx=0).stop 2023-10-08T13:00:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.373+0000 7f2624bff700 1 -- 172.21.15.59:0/1911823639 shutdown_connections 2023-10-08T13:00:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.373+0000 7f2624bff700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f26000a17c0 0x7f26000a3c80 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.373+0000 7f2624bff700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2620106750 0x7f2620073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.373+0000 7f2624bff700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2620100740 0x7f2620072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.373+0000 7f2624bff700 1 --2- 172.21.15.59:0/1911823639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2620101100 0x7f2620073030 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.373+0000 7f2624bff700 1 -- 172.21.15.59:0/1911823639 >> 172.21.15.59:0/1911823639 conn(0x7f26200fc230 msgr2=0x7f26200fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.374+0000 7f2624bff700 1 -- 172.21.15.59:0/1911823639 shutdown_connections 2023-10-08T13:00:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.374+0000 7f2624bff700 1 -- 172.21.15.59:0/1911823639 wait complete. 2023-10-08T13:00:02.400 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:02 smithi059 ceph-mon[98489]: pgmap v903: 97 pgs: 97 active+clean; 953 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.1 MiB/s wr, 338 op/s 2023-10-08T13:00:02.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:00:02.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:02 smithi173 ceph-mon[135182]: pgmap v903: 97 pgs: 97 active+clean; 953 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.1 MiB/s wr, 338 op/s 2023-10-08T13:00:02.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:02 smithi092 ceph-mon[134093]: pgmap v903: 97 pgs: 97 active+clean; 953 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.1 MiB/s wr, 338 op/s 2023-10-08T13:00:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.671+0000 7f097f5ff700 1 -- 172.21.15.59:0/2394481223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978106740 msgr2=0x7f0978106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.671+0000 7f097f5ff700 1 --2- 172.21.15.59:0/2394481223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978106740 0x7f0978106b20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0974009990 tx=0x7f0974009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.671+0000 7f097f5ff700 1 -- 172.21.15.59:0/2394481223 shutdown_connections 2023-10-08T13:00:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.671+0000 7f097f5ff700 1 --2- 172.21.15.59:0/2394481223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781010f0 0x7f097810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.671+0000 7f097f5ff700 1 --2- 172.21.15.59:0/2394481223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978106740 0x7f0978106b20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.671+0000 7f097f5ff700 1 --2- 172.21.15.59:0/2394481223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0978100730 0x7f0978100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.671+0000 7f097f5ff700 1 -- 172.21.15.59:0/2394481223 >> 172.21.15.59:0/2394481223 conn(0x7f09780fc200 msgr2=0x7f09780fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.671+0000 7f097f5ff700 1 -- 172.21.15.59:0/2394481223 shutdown_connections 2023-10-08T13:00:02.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.672+0000 7f097f5ff700 1 -- 172.21.15.59:0/2394481223 wait complete. 2023-10-08T13:00:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.673+0000 7f097f5ff700 1 Processor -- start 2023-10-08T13:00:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.673+0000 7f097f5ff700 1 -- start start 2023-10-08T13:00:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.673+0000 7f097f5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0978100730 0x7f0978072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.673+0000 7f097f5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781010f0 0x7f0978073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.673+0000 7f097f5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978106740 0x7f0978073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.673+0000 7f097f5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781a5000 con 0x7f0978100730 2023-10-08T13:00:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.673+0000 7f097f5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781a5170 con 0x7f09781010f0 2023-10-08T13:00:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.673+0000 7f097f5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781a5330 con 0x7f0978106740 2023-10-08T13:00:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.674+0000 7f097d39b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0978100730 0x7f0978072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.674+0000 7f097d39b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0978100730 0x7f0978072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59486/0 (socket says 172.21.15.59:59486) 2023-10-08T13:00:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.674+0000 7f097d39b700 1 -- 172.21.15.59:0/1419040822 learned_addr learned my addr 172.21.15.59:0/1419040822 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.674+0000 7f097db9c700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978106740 0x7f0978073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.674+0000 7f097d39b700 1 -- 172.21.15.59:0/1419040822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978106740 msgr2=0x7f0978073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.674+0000 7f097d39b700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978106740 0x7f0978073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.674+0000 7f097d39b700 1 -- 172.21.15.59:0/1419040822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781010f0 msgr2=0x7f0978073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.674+0000 7f097d39b700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781010f0 0x7f0978073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.674+0000 7f097d39b700 1 -- 172.21.15.59:0/1419040822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09740095f0 con 0x7f0978100730 2023-10-08T13:00:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.674+0000 7f097d39b700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0978100730 0x7f0978072af0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0974005910 tx=0x7f0974004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.675+0000 7f096e7fc700 1 -- 172.21.15.59:0/1419040822 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097401d070 con 0x7f0978100730 2023-10-08T13:00:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.675+0000 7f096e7fc700 1 -- 172.21.15.59:0/1419040822 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0974022470 con 0x7f0978100730 2023-10-08T13:00:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.675+0000 7f096e7fc700 1 -- 172.21.15.59:0/1419040822 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974017650 con 0x7f0978100730 2023-10-08T13:00:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.675+0000 7f097f5ff700 1 -- 172.21.15.59:0/1419040822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09781a55b0 con 0x7f0978100730 2023-10-08T13:00:02.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.675+0000 7f097f5ff700 1 -- 172.21.15.59:0/1419040822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09781a5a40 con 0x7f0978100730 2023-10-08T13:00:02.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.678+0000 7f096e7fc700 1 -- 172.21.15.59:0/1419040822 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f09740225e0 con 0x7f0978100730 2023-10-08T13:00:02.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.680+0000 7f096e7fc700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f09640a1670 0x7f09640a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.680+0000 7f096e7fc700 1 -- 172.21.15.59:0/1419040822 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f09740ce120 con 0x7f0978100730 2023-10-08T13:00:02.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.680+0000 7f097cb9a700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f09640a1670 0x7f09640a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.680+0000 7f0992e38b80 1 Processor -- start 2023-10-08T13:00:02.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f0992e38b80 1 -- start start 2023-10-08T13:00:02.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f097cb9a700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f09640a1670 0x7f09640a3b30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0968005950 tx=0x7f09680058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbea260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbf7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f0992e38b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42fb53460 con 0x55f42fbf5650 2023-10-08T13:00:02.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f0992e38b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42fb44c20 con 0x55f42fbe9e80 2023-10-08T13:00:02.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f0992e38b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42fb42540 con 0x55f42fbea7a0 2023-10-08T13:00:02.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f097cb9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f097d39b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbea260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f097cb9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40306/0 (socket says 172.21.15.59:40306) 2023-10-08T13:00:02.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f097cb9a700 1 -- 172.21.15.59:0/330029871 learned_addr learned my addr 172.21.15.59:0/330029871 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:02.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.681+0000 7f097db9c700 1 --2- 172.21.15.59:0/330029871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbf7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.682+0000 7f097cb9a700 1 -- 172.21.15.59:0/330029871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 msgr2=0x55f42fbea260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.682+0000 7f097cb9a700 1 --2- 172.21.15.59:0/330029871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbea260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.682+0000 7f097cb9a700 1 -- 172.21.15.59:0/330029871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 msgr2=0x55f42fbf7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.682+0000 7f097cb9a700 1 --2- 172.21.15.59:0/330029871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbf7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.682+0000 7f097cb9a700 1 -- 172.21.15.59:0/330029871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f42f968de0 con 0x55f42fbea7a0 2023-10-08T13:00:02.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.682+0000 7f097cb9a700 1 --2- 172.21.15.59:0/330029871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf5110 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f096800ebe0 tx=0x7f0968011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60125ed2abd6cb23 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.682+0000 7f09637fe700 1 -- 172.21.15.59:0/330029871 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968010ac0 con 0x55f42fbea7a0 2023-10-08T13:00:02.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.683+0000 7f09637fe700 1 -- 172.21.15.59:0/330029871 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0968009820 con 0x55f42fbea7a0 2023-10-08T13:00:02.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.683+0000 7f09637fe700 1 -- 172.21.15.59:0/330029871 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096801c680 con 0x55f42fbea7a0 2023-10-08T13:00:02.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.683+0000 7f0992e38b80 1 -- 172.21.15.59:0/330029871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 msgr2=0x55f42fbf5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.683+0000 7f0992e38b80 1 --2- 172.21.15.59:0/330029871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf5110 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f096800ebe0 tx=0x7f0968011000 comp rx=0 tx=0).stop 2023-10-08T13:00:02.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.683+0000 7f0992e38b80 1 -- 172.21.15.59:0/330029871 shutdown_connections 2023-10-08T13:00:02.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.683+0000 7f0992e38b80 1 --2- 172.21.15.59:0/330029871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbea260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.683+0000 7f0992e38b80 1 --2- 172.21.15.59:0/330029871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbf7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.683+0000 7f0992e38b80 1 --2- 172.21.15.59:0/330029871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf5110 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.683+0000 7f0992e38b80 1 -- 172.21.15.59:0/330029871 >> 172.21.15.59:0/330029871 conn(0x55f42fb5f260 msgr2=0x55f42fbe62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.684+0000 7f0992e38b80 1 -- 172.21.15.59:0/330029871 shutdown_connections 2023-10-08T13:00:02.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.684+0000 7f0992e38b80 1 -- 172.21.15.59:0/330029871 wait complete. 2023-10-08T13:00:02.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.684+0000 7f0992e38b80 1 -- start start 2023-10-08T13:00:02.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.684+0000 7f0992e38b80 1 Processor -- start 2023-10-08T13:00:02.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbf5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbf2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f0992e38b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42fb3de30 con 0x55f42fbf5650 2023-10-08T13:00:02.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f0992e38b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42fada710 con 0x55f42fbe9e80 2023-10-08T13:00:02.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f0992e38b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42fada3b0 con 0x55f42fbea7a0 2023-10-08T13:00:02.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f0992e38b80 10 client.0 _ll_register_callbacks cb 0x55f42f937800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:00:02.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f097cb9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f097d39b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbf5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f097cb9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40314/0 (socket says 172.21.15.59:40314) 2023-10-08T13:00:02.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f097cb9a700 1 -- 172.21.15.59:0/976862471 learned_addr learned my addr 172.21.15.59:0/976862471 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:02.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.685+0000 7f097db9c700 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbf2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.686+0000 7f097cb9a700 1 -- 172.21.15.59:0/976862471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 msgr2=0x55f42fbf5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.686+0000 7f097cb9a700 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbf5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.686+0000 7f097cb9a700 1 -- 172.21.15.59:0/976862471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 msgr2=0x55f42fbf2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.686+0000 7f097cb9a700 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbf2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.686+0000 7f097cb9a700 1 -- 172.21.15.59:0/976862471 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096800e890 con 0x55f42fbea7a0 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.686+0000 7f097cb9a700 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf23d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f096800f010 tx=0x7f0968025a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b50d466421043fd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.686+0000 7f0960ff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.686+0000 7f0960ff9700 1 -- 172.21.15.59:0/976862471 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096802b070 con 0x55f42fbea7a0 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.686+0000 7f0992e38b80 1 -- 172.21.15.59:0/976862471 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f42fb36e10 con 0x55f42fbea7a0 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.686+0000 7f0960ff9700 1 -- 172.21.15.59:0/976862471 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f09680108c0 con 0x55f42fbea7a0 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.687+0000 7f0960ff9700 1 -- 172.21.15.59:0/976862471 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0968010a80 con 0x55f42fbea7a0 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.687+0000 7f0992e38b80 10 client.28192 fetch_fsmap learned FSMap version 20 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.687+0000 7f0992e38b80 1 -- 172.21.15.59:0/976862471 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55f42f951c60 con 0x55f42fbea7a0 2023-10-08T13:00:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.687+0000 7f0960ff9700 1 -- 172.21.15.59:0/976862471 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f42fb36e10 con 0x55f42fbea7a0 2023-10-08T13:00:02.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.687+0000 7f0960ff9700 1 -- 172.21.15.59:0/976862471 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0968018070 con 0x55f42fbea7a0 2023-10-08T13:00:02.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.687+0000 7f0992e38b80 10 client.28192 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T13:00:02.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.687+0000 7f0992e38b80 10 client.28192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T13:00:02.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.687+0000 7f0992e38b80 20 client.28192 populate_metadata read hostname 'smithi059' 2023-10-08T13:00:02.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.687+0000 7f0992e38b80 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f42fc050d0 0x55f42fc074f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.687+0000 7f0992e38b80 4 client.28192 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:00:02.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.687+0000 7f0992e38b80 1 -- 172.21.15.59:0/976862471 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f42fb36b30 con 0x55f42fc050d0 2023-10-08T13:00:02.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.688+0000 7f097d39b700 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f42fc050d0 0x55f42fc074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.688+0000 7f097d39b700 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f42fc050d0 0x55f42fc074f0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=770433838d94f0d6 server_cookie=fc94adea17fd1a82 in_seq=0 out_seq=0 2023-10-08T13:00:02.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.688+0000 7f0960ff9700 10 client.28192 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0960ff9700 1 -- 172.21.15.59:0/976862471 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f42fb36b30 con 0x55f42fc050d0 2023-10-08T13:00:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0960ff9700 10 client.28192 handle_command_reply: tid=0 2023-10-08T13:00:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0992e38b80 1 client.28192 shutdown 2023-10-08T13:00:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0992e38b80 1 -- 172.21.15.59:0/976862471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 msgr2=0x55f42fbf23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0992e38b80 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf23d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f096800f010 tx=0x7f0968025a50 comp rx=0 tx=0).stop 2023-10-08T13:00:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0992e38b80 1 -- 172.21.15.59:0/976862471 shutdown_connections 2023-10-08T13:00:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0992e38b80 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f42fc050d0 0x55f42fc074f0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0992e38b80 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbf5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0992e38b80 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbf2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0960ff9700 0 client.28192 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0992e38b80 1 --2- 172.21.15.59:0/976862471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbf23d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0992e38b80 1 -- 172.21.15.59:0/976862471 >> 172.21.15.59:0/976862471 conn(0x55f42fb5f260 msgr2=0x55f42fbe5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0992e38b80 1 -- 172.21.15.59:0/976862471 shutdown_connections 2023-10-08T13:00:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.695+0000 7f0992e38b80 1 -- 172.21.15.59:0/976862471 wait complete. 2023-10-08T13:00:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.696+0000 7f0992e38b80 20 client.28192 trim_cache size 0 max 16384 2023-10-08T13:00:02.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.718+0000 7f0992e38b80 1 Processor -- start 2023-10-08T13:00:02.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.718+0000 7f0992e38b80 1 -- start start 2023-10-08T13:00:02.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.718+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbe9e80 0x55f42fbfc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.718+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbea7a0 0x55f42fbf0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.718+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbf5650 0x55f42fbf1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.718+0000 7f0992e38b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42f9be920 con 0x55f42fbe9e80 2023-10-08T13:00:02.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.718+0000 7f0992e38b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42fbe70d0 con 0x55f42fbea7a0 2023-10-08T13:00:02.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.718+0000 7f0992e38b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42fc01d00 con 0x55f42fbf5650 2023-10-08T13:00:02.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.719+0000 7f097db9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbf5650 0x55f42fbf1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.719+0000 7f097d39b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbe9e80 0x55f42fbfc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.719+0000 7f097db9c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbf5650 0x55f42fbf1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40330/0 (socket says 172.21.15.59:40330) 2023-10-08T13:00:02.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.719+0000 7f097db9c700 1 -- 172.21.15.59:0/1779260559 learned_addr learned my addr 172.21.15.59:0/1779260559 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:02.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.719+0000 7f097db9c700 1 -- 172.21.15.59:0/1779260559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbea7a0 msgr2=0x55f42fbf0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.719+0000 7f097db9c700 1 --2- 172.21.15.59:0/1779260559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbea7a0 0x55f42fbf0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.719+0000 7f097db9c700 1 -- 172.21.15.59:0/1779260559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbe9e80 msgr2=0x55f42fbfc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.719+0000 7f097db9c700 1 --2- 172.21.15.59:0/1779260559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbe9e80 0x55f42fbfc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.719+0000 7f097db9c700 1 -- 172.21.15.59:0/1779260559 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f42f98f250 con 0x55f42fbf5650 2023-10-08T13:00:02.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.720+0000 7f097db9c700 1 --2- 172.21.15.59:0/1779260559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbf5650 0x55f42fbf1240 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f097000a5c0 tx=0x7f0970009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebd7aee90add8e67 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.720+0000 7f0963fff700 1 -- 172.21.15.59:0/1779260559 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970010040 con 0x55f42fbf5650 2023-10-08T13:00:02.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.720+0000 7f0963fff700 1 -- 172.21.15.59:0/1779260559 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f097000ae60 con 0x55f42fbf5650 2023-10-08T13:00:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.720+0000 7f0963fff700 1 -- 172.21.15.59:0/1779260559 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097001fc60 con 0x55f42fbf5650 2023-10-08T13:00:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.721+0000 7f0992e38b80 1 -- 172.21.15.59:0/1779260559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbf5650 msgr2=0x55f42fbf1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.721+0000 7f0992e38b80 1 --2- 172.21.15.59:0/1779260559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbf5650 0x55f42fbf1240 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f097000a5c0 tx=0x7f0970009650 comp rx=0 tx=0).stop 2023-10-08T13:00:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.721+0000 7f0992e38b80 1 -- 172.21.15.59:0/1779260559 shutdown_connections 2023-10-08T13:00:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.721+0000 7f0992e38b80 1 --2- 172.21.15.59:0/1779260559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbf5650 0x55f42fbf1240 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.721+0000 7f0992e38b80 1 --2- 172.21.15.59:0/1779260559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbe9e80 0x55f42fbfc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.721+0000 7f0992e38b80 1 --2- 172.21.15.59:0/1779260559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbea7a0 0x55f42fbf0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.721+0000 7f0992e38b80 1 -- 172.21.15.59:0/1779260559 >> 172.21.15.59:0/1779260559 conn(0x55f42fb5f260 msgr2=0x55f42fbed7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.721+0000 7f0992e38b80 1 -- 172.21.15.59:0/1779260559 shutdown_connections 2023-10-08T13:00:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.721+0000 7f0992e38b80 1 -- 172.21.15.59:0/1779260559 wait complete. 2023-10-08T13:00:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.722+0000 7f0992e38b80 1 -- start start 2023-10-08T13:00:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.722+0000 7f0992e38b80 1 Processor -- start 2023-10-08T13:00:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.722+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbfa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbfae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f0992e38b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbfb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f0992e38b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42fbfc790 con 0x55f42fbf5650 2023-10-08T13:00:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f0992e38b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42fc61700 con 0x55f42fbe9e80 2023-10-08T13:00:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f0992e38b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42fc61890 con 0x55f42fbea7a0 2023-10-08T13:00:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f0992e38b80 10 client.0 _ll_register_callbacks cb 0x7f0970009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:00:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097d39b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbfa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097cb9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbfae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097d39b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbfa930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:45138/0 (socket says 172.21.15.59:45138) 2023-10-08T13:00:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097d39b700 1 -- 172.21.15.59:0/2998008959 learned_addr learned my addr 172.21.15.59:0/2998008959 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097cb9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbfae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:40342/0 (socket says 172.21.15.59:40342) 2023-10-08T13:00:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097db9c700 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbfb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097d39b700 1 -- 172.21.15.59:0/2998008959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 msgr2=0x55f42fbfae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097d39b700 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbfae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097d39b700 1 -- 172.21.15.59:0/2998008959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 msgr2=0x55f42fbfb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097d39b700 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbfb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097d39b700 1 -- 172.21.15.59:0/2998008959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f42f9672b0 con 0x55f42fbe9e80 2023-10-08T13:00:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.723+0000 7f097db9c700 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbfb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:00:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.724+0000 7f097d39b700 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbfa930 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0974000c00 tx=0x7f0974009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e89a06950de7e6cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.724+0000 7f0960ff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T13:00:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.724+0000 7f0960ff9700 1 -- 172.21.15.59:0/2998008959 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097409f330 con 0x55f42fbe9e80 2023-10-08T13:00:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.724+0000 7f0960ff9700 1 -- 172.21.15.59:0/2998008959 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f09740a34e0 con 0x55f42fbe9e80 2023-10-08T13:00:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.724+0000 7f0992e38b80 1 -- 172.21.15.59:0/2998008959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f42fb05eb0 con 0x55f42fbe9e80 2023-10-08T13:00:02.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.724+0000 7f0960ff9700 1 -- 172.21.15.59:0/2998008959 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f097409b440 con 0x55f42fbe9e80 2023-10-08T13:00:02.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.725+0000 7f0992e38b80 10 client.28211 fetch_fsmap learned FSMap version 20 2023-10-08T13:00:02.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.725+0000 7f0992e38b80 1 -- 172.21.15.59:0/2998008959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55f42fa35a80 con 0x55f42fbe9e80 2023-10-08T13:00:02.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.725+0000 7f0960ff9700 1 -- 172.21.15.59:0/2998008959 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f42fb05eb0 con 0x55f42fbe9e80 2023-10-08T13:00:02.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.725+0000 7f0960ff9700 1 -- 172.21.15.59:0/2998008959 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f09740a3050 con 0x55f42fbe9e80 2023-10-08T13:00:02.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.725+0000 7f0992e38b80 10 client.28211 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T13:00:02.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.725+0000 7f0992e38b80 10 client.28211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T13:00:02.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.725+0000 7f0992e38b80 20 client.28211 populate_metadata read hostname 'smithi059' 2023-10-08T13:00:02.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.725+0000 7f0992e38b80 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f42fc62dd0 0x55f42fc651f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:02.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.725+0000 7f0992e38b80 4 client.28211 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:00:02.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.725+0000 7f0992e38b80 1 -- 172.21.15.59:0/2998008959 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f42f989f70 con 0x55f42fc62dd0 2023-10-08T13:00:02.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.726+0000 7f097cb9a700 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f42fc62dd0 0x55f42fc651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:02.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.729+0000 7f097cb9a700 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f42fc62dd0 0x55f42fc651f0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2086368894b4419e server_cookie=779cc7e84d9f85a5 in_seq=0 out_seq=0 2023-10-08T13:00:02.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.729+0000 7f0960ff9700 10 client.28211 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:02.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.737+0000 7f0960ff9700 1 -- 172.21.15.59:0/2998008959 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55f42f989f70 con 0x55f42fc62dd0 2023-10-08T13:00:02.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.737+0000 7f0960ff9700 10 client.28211 handle_command_reply: tid=0 2023-10-08T13:00:02.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.737+0000 7f0992e38b80 1 client.28211 shutdown 2023-10-08T13:00:02.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.737+0000 7f0992e38b80 1 -- 172.21.15.59:0/2998008959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 msgr2=0x55f42fbfa930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.737+0000 7f0992e38b80 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbfa930 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0974000c00 tx=0x7f0974009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.738+0000 7f0992e38b80 1 -- 172.21.15.59:0/2998008959 shutdown_connections 2023-10-08T13:00:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.738+0000 7f0992e38b80 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55f42fc62dd0 0x55f42fc651f0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.738+0000 7f0992e38b80 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f42fbe9e80 0x55f42fbfa930 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.738+0000 7f0992e38b80 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f42fbf5650 0x55f42fbfb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.738+0000 7f0992e38b80 1 --2- 172.21.15.59:0/2998008959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42fbea7a0 0x55f42fbfae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.738+0000 7f0960ff9700 0 client.28211 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.738+0000 7f0992e38b80 1 -- 172.21.15.59:0/2998008959 >> 172.21.15.59:0/2998008959 conn(0x55f42fb5f260 msgr2=0x55f42fbf0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.738+0000 7f0992e38b80 1 -- 172.21.15.59:0/2998008959 shutdown_connections 2023-10-08T13:00:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.738+0000 7f0992e38b80 1 -- 172.21.15.59:0/2998008959 wait complete. 2023-10-08T13:00:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.738+0000 7f0992e38b80 20 client.28211 trim_cache size 0 max 16384 2023-10-08T13:00:02.740 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T13:00:02.740 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "scrub active (220 inodes in the stack)", 2023-10-08T13:00:02.740 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2023-10-08T13:00:02.740 INFO:teuthology.orchestra.run.smithi059.stdout: "52718db9-88f6-466c-86b8-19624f3f27f5": { 2023-10-08T13:00:02.740 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2023-10-08T13:00:02.740 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "52718db9-88f6-466c-86b8-19624f3f27f5", 2023-10-08T13:00:02.740 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2023-10-08T13:00:02.740 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:02.740 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:02.740 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T13:00:02.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 -- 172.21.15.59:0/1419040822 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f09640a1670 msgr2=0x7f09640a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f09640a1670 0x7f09640a3b30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0968005950 tx=0x7f09680058e0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 -- 172.21.15.59:0/1419040822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0978100730 msgr2=0x7f0978072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:02.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0978100730 0x7f0978072af0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0974005910 tx=0x7f0974004730 comp rx=0 tx=0).stop 2023-10-08T13:00:02.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 -- 172.21.15.59:0/1419040822 shutdown_connections 2023-10-08T13:00:02.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f09640a1670 0x7f09640a3b30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978106740 0x7f0978073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0978100730 0x7f0978072af0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 --2- 172.21.15.59:0/1419040822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781010f0 0x7f0978073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:02.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 -- 172.21.15.59:0/1419040822 >> 172.21.15.59:0/1419040822 conn(0x7f09780fc200 msgr2=0x7f09780fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:02.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 -- 172.21.15.59:0/1419040822 shutdown_connections 2023-10-08T13:00:02.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:02.739+0000 7f097f5ff700 1 -- 172.21.15.59:0/1419040822 wait complete. 2023-10-08T13:00:02.761 INFO:tasks.cephfs.filesystem:scrub status for tag:52718db9-88f6-466c-86b8-19624f3f27f5 - {'path': '/', 'tag': '52718db9-88f6-466c-86b8-19624f3f27f5', 'options': 'recursive,force'} 2023-10-08T13:00:02.977 INFO:tasks.workunit.client.0.smithi059.stdout: 10 128075 20.28 MB/sec execute 213 sec latency 196.376 ms 2023-10-08T13:00:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:03 smithi173 ceph-mon[135182]: scrub queued for path: / 2023-10-08T13:00:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:03 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T13:00:03.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:03 smithi173 ceph-mon[135182]: scrub summary: active paths [/] 2023-10-08T13:00:03.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:03 smithi059 ceph-mon[98489]: scrub queued for path: / 2023-10-08T13:00:03.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:03 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T13:00:03.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:03 smithi059 ceph-mon[98489]: scrub summary: active paths [/] 2023-10-08T13:00:03.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:03 smithi092 ceph-mon[134093]: scrub queued for path: / 2023-10-08T13:00:03.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:03 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T13:00:03.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:03 smithi092 ceph-mon[134093]: scrub summary: active paths [/] 2023-10-08T13:00:03.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 128340 20.27 MB/sec execute 214 sec latency 168.106 ms 2023-10-08T13:00:04.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:04 smithi173 ceph-mon[135182]: pgmap v904: 97 pgs: 97 active+clean; 908 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 8.8 MiB/s wr, 412 op/s 2023-10-08T13:00:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:04 smithi173 ceph-mon[135182]: osdmap e111: 12 total, 12 up, 12 in 2023-10-08T13:00:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:04 smithi059 ceph-mon[98489]: pgmap v904: 97 pgs: 97 active+clean; 908 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 8.8 MiB/s wr, 412 op/s 2023-10-08T13:00:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:04 smithi059 ceph-mon[98489]: osdmap e111: 12 total, 12 up, 12 in 2023-10-08T13:00:04.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:04 smithi092 ceph-mon[134093]: pgmap v904: 97 pgs: 97 active+clean; 908 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 8.8 MiB/s wr, 412 op/s 2023-10-08T13:00:04.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:04 smithi092 ceph-mon[134093]: osdmap e111: 12 total, 12 up, 12 in 2023-10-08T13:00:04.976 INFO:tasks.workunit.client.0.smithi059.stdout: 10 128613 20.25 MB/sec execute 215 sec latency 103.634 ms 2023-10-08T13:00:05.517 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:05 smithi059 ceph-mon[98489]: scrub summary: idle+waiting paths [/] 2023-10-08T13:00:05.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:05 smithi092 ceph-mon[134093]: scrub summary: idle+waiting paths [/] 2023-10-08T13:00:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:05 smithi173 ceph-mon[135182]: scrub summary: idle+waiting paths [/] 2023-10-08T13:00:05.977 INFO:tasks.workunit.client.0.smithi059.stdout: 10 128854 20.22 MB/sec execute 216 sec latency 349.903 ms 2023-10-08T13:00:06.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:06 smithi059 ceph-mon[98489]: pgmap v906: 97 pgs: 97 active+clean; 910 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.2 MiB/s wr, 467 op/s 2023-10-08T13:00:06.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:06 smithi092 ceph-mon[134093]: pgmap v906: 97 pgs: 97 active+clean; 910 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.2 MiB/s wr, 467 op/s 2023-10-08T13:00:06.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:06 smithi173 ceph-mon[135182]: pgmap v906: 97 pgs: 97 active+clean; 910 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.2 MiB/s wr, 467 op/s 2023-10-08T13:00:06.977 INFO:tasks.workunit.client.0.smithi059.stdout: 10 129243 20.19 MB/sec execute 217 sec latency 135.382 ms 2023-10-08T13:00:07.977 INFO:tasks.workunit.client.0.smithi059.stdout: 10 129579 20.15 MB/sec execute 218 sec latency 257.542 ms 2023-10-08T13:00:08.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:08 smithi059 ceph-mon[98489]: pgmap v907: 97 pgs: 97 active+clean; 908 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 9.5 MiB/s wr, 604 op/s 2023-10-08T13:00:08.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:08 smithi059 ceph-mon[98489]: scrub summary: idle 2023-10-08T13:00:08.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:08 smithi092 ceph-mon[134093]: pgmap v907: 97 pgs: 97 active+clean; 908 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 9.5 MiB/s wr, 604 op/s 2023-10-08T13:00:08.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:08 smithi092 ceph-mon[134093]: scrub summary: idle 2023-10-08T13:00:08.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:08 smithi173 ceph-mon[135182]: pgmap v907: 97 pgs: 97 active+clean; 908 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 9.5 MiB/s wr, 604 op/s 2023-10-08T13:00:08.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:08 smithi173 ceph-mon[135182]: scrub summary: idle 2023-10-08T13:00:08.977 INFO:tasks.workunit.client.0.smithi059.stdout: 10 129917 20.16 MB/sec execute 219 sec latency 296.528 ms 2023-10-08T13:00:09.977 INFO:tasks.workunit.client.0.smithi059.stdout: 10 130505 20.22 MB/sec execute 220 sec latency 150.891 ms 2023-10-08T13:00:10.359 INFO:tasks.workunit.client.0.smithi059.stdout:[136345] write failed on handle 13380 (Resource temporarily unavailable) 2023-10-08T13:00:10.360 INFO:tasks.workunit.client.0.smithi059.stdout:Child failed with status 1 2023-10-08T13:00:10.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:00:10.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:10 smithi092 ceph-mon[134093]: pgmap v908: 97 pgs: 97 active+clean; 919 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 10 MiB/s wr, 657 op/s 2023-10-08T13:00:10.386 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-10-08T13:00:10.386 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-08T13:00:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:10 smithi173 ceph-mon[135182]: pgmap v908: 97 pgs: 97 active+clean; 919 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 10 MiB/s wr, 657 op/s 2023-10-08T13:00:10.479 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:10 smithi059 ceph-mon[98489]: pgmap v908: 97 pgs: 97 active+clean; 919 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 10 MiB/s wr, 657 op/s 2023-10-08T13:00:11.453 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi059 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2023-10-08T13:00:11.640 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=318ddbe23be04754a8f57e2afa19e4c6 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi059 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2023-10-08T13:00:11.643 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-10-08T13:00:11.654 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-10-08T13:00:11.657 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T13:00:11.657 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2023-10-08T13:00:11.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-10-08T13:00:11.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-10-08T13:00:11.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-08T13:00:12.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.029+0000 7f78dadff700 1 -- 172.21.15.59:0/1377454345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d410cf00 msgr2=0x7f78d410f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:12.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.029+0000 7f78dadff700 1 --2- 172.21.15.59:0/1377454345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d410cf00 0x7f78d410f370 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00b0a0 tx=0x7f78cc00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.029+0000 7f78dadff700 1 -- 172.21.15.59:0/1377454345 shutdown_connections 2023-10-08T13:00:12.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.029+0000 7f78dadff700 1 --2- 172.21.15.59:0/1377454345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d410cf00 0x7f78d410f370 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.029+0000 7f78dadff700 1 --2- 172.21.15.59:0/1377454345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78d4072c20 0x7f78d4073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.029+0000 7f78dadff700 1 --2- 172.21.15.59:0/1377454345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d4073540 0x7f78d410c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.029+0000 7f78dadff700 1 -- 172.21.15.59:0/1377454345 >> 172.21.15.59:0/1377454345 conn(0x7f78d40fc190 msgr2=0x7f78d40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:12.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.029+0000 7f78dadff700 1 -- 172.21.15.59:0/1377454345 shutdown_connections 2023-10-08T13:00:12.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.030+0000 7f78dadff700 1 -- 172.21.15.59:0/1377454345 wait complete. 2023-10-08T13:00:12.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.030+0000 7f78dadff700 1 Processor -- start 2023-10-08T13:00:12.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78dadff700 1 -- start start 2023-10-08T13:00:12.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78dadff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d4072c20 0x7f78d4198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:12.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78dadff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78d4073540 0x7f78d4199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:12.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78dadff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d410cf00 0x7f78d419d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:12.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78dadff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d419dde0 con 0x7f78d410cf00 2023-10-08T13:00:12.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78dadff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d419df50 con 0x7f78d4072c20 2023-10-08T13:00:12.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78dadff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d419e110 con 0x7f78d4073540 2023-10-08T13:00:12.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78d939c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d410cf00 0x7f78d419d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:12.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78d939c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d410cf00 0x7f78d419d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50976/0 (socket says 172.21.15.59:50976) 2023-10-08T13:00:12.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78d939c700 1 -- 172.21.15.59:0/3498340043 learned_addr learned my addr 172.21.15.59:0/3498340043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:12.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78d8b9b700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d4072c20 0x7f78d4198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:12.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.031+0000 7f78d3fff700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78d4073540 0x7f78d4199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:12.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.032+0000 7f78d939c700 1 -- 172.21.15.59:0/3498340043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78d4073540 msgr2=0x7f78d4199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:12.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.032+0000 7f78d939c700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78d4073540 0x7f78d4199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.032+0000 7f78d939c700 1 -- 172.21.15.59:0/3498340043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d4072c20 msgr2=0x7f78d4198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:12.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.032+0000 7f78d939c700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d4072c20 0x7f78d4198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.032+0000 7f78d939c700 1 -- 172.21.15.59:0/3498340043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc009d00 con 0x7f78d410cf00 2023-10-08T13:00:12.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.032+0000 7f78d939c700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d410cf00 0x7f78d419d7a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0077f0 tx=0x7f78cc007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:12.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.032+0000 7f78d1ffb700 1 -- 172.21.15.59:0/3498340043 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00e040 con 0x7f78d410cf00 2023-10-08T13:00:12.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.032+0000 7f78dadff700 1 -- 172.21.15.59:0/3498340043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d419e390 con 0x7f78d410cf00 2023-10-08T13:00:12.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.032+0000 7f78d1ffb700 1 -- 172.21.15.59:0/3498340043 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78cc004c60 con 0x7f78d410cf00 2023-10-08T13:00:12.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.032+0000 7f78d1ffb700 1 -- 172.21.15.59:0/3498340043 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0052a0 con 0x7f78d410cf00 2023-10-08T13:00:12.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.033+0000 7f78dadff700 1 -- 172.21.15.59:0/3498340043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d41a5c30 con 0x7f78d410cf00 2023-10-08T13:00:12.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.034+0000 7f78dadff700 1 -- 172.21.15.59:0/3498340043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d4108110 con 0x7f78d410cf00 2023-10-08T13:00:12.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.035+0000 7f78d1ffb700 1 -- 172.21.15.59:0/3498340043 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f78cc01b450 con 0x7f78d410cf00 2023-10-08T13:00:12.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.037+0000 7f78d1ffb700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f78c40a15f0 0x7f78c40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:12.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.037+0000 7f78d1ffb700 1 -- 172.21.15.59:0/3498340043 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f78cc0ce790 con 0x7f78d410cf00 2023-10-08T13:00:12.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.037+0000 7f78d8b9b700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f78c40a15f0 0x7f78c40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:12.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.037+0000 7f78d8b9b700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f78c40a15f0 0x7f78c40a3ab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f78c8004630 tx=0x7f78c800b3c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:12.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.041+0000 7f78d1ffb700 1 -- 172.21.15.59:0/3498340043 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f78cc097b00 con 0x7f78d410cf00 2023-10-08T13:00:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.280+0000 7f78dadff700 1 -- 172.21.15.59:0/3498340043 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f78d419a1c0 con 0x7f78c40a15f0 2023-10-08T13:00:12.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.291+0000 7f78d1ffb700 1 -- 172.21.15.59:0/3498340043 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f78d419a1c0 con 0x7f78c40a15f0 2023-10-08T13:00:12.292 INFO:teuthology.orchestra.run.smithi059.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T12:41:20", "first": "2023-10-08T12:42:00", "last": "2023-10-08T13:00:00", "last_pruned": "2023-10-08T13:00:00", "created_count": 19, "pruned_count": 13, "active": true} 2023-10-08T13:00:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 -- 172.21.15.59:0/3498340043 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f78c40a15f0 msgr2=0x7f78c40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f78c40a15f0 0x7f78c40a3ab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f78c8004630 tx=0x7f78c800b3c0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 -- 172.21.15.59:0/3498340043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d410cf00 msgr2=0x7f78d419d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d410cf00 0x7f78d419d7a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0077f0 tx=0x7f78cc007820 comp rx=0 tx=0).stop 2023-10-08T13:00:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 -- 172.21.15.59:0/3498340043 shutdown_connections 2023-10-08T13:00:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f78c40a15f0 0x7f78c40a3ab0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d4072c20 0x7f78d4198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d410cf00 0x7f78d419d7a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 --2- 172.21.15.59:0/3498340043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78d4073540 0x7f78d4199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 -- 172.21.15.59:0/3498340043 >> 172.21.15.59:0/3498340043 conn(0x7f78d40fc190 msgr2=0x7f78d40fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 -- 172.21.15.59:0/3498340043 shutdown_connections 2023-10-08T13:00:12.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.294+0000 7f78dadff700 1 -- 172.21.15.59:0/3498340043 wait complete. 2023-10-08T13:00:12.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-08T13:00:12.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:12 smithi173 ceph-mon[135182]: pgmap v909: 97 pgs: 97 active+clean; 933 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 11 MiB/s wr, 659 op/s 2023-10-08T13:00:12.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:12 smithi059 ceph-mon[98489]: pgmap v909: 97 pgs: 97 active+clean; 933 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 11 MiB/s wr, 659 op/s 2023-10-08T13:00:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.515+0000 7f42d4fff700 1 -- 172.21.15.59:0/1434251826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d01066c0 msgr2=0x7f42d0106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.515+0000 7f42d4fff700 1 --2- 172.21.15.59:0/1434251826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d01066c0 0x7f42d0106aa0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009990 tx=0x7f42c0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.516+0000 7f42d4fff700 1 -- 172.21.15.59:0/1434251826 shutdown_connections 2023-10-08T13:00:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.516+0000 7f42d4fff700 1 --2- 172.21.15.59:0/1434251826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42d0101070 0x7f42d010d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.516+0000 7f42d4fff700 1 --2- 172.21.15.59:0/1434251826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d01066c0 0x7f42d0106aa0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.516+0000 7f42d4fff700 1 --2- 172.21.15.59:0/1434251826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d01006b0 0x7f42d0100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.516+0000 7f42d4fff700 1 -- 172.21.15.59:0/1434251826 >> 172.21.15.59:0/1434251826 conn(0x7f42d00fc1c0 msgr2=0x7f42d00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.516+0000 7f42d4fff700 1 -- 172.21.15.59:0/1434251826 shutdown_connections 2023-10-08T13:00:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.516+0000 7f42d4fff700 1 -- 172.21.15.59:0/1434251826 wait complete. 2023-10-08T13:00:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.517+0000 7f42d4fff700 1 Processor -- start 2023-10-08T13:00:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.517+0000 7f42d4fff700 1 -- start start 2023-10-08T13:00:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.517+0000 7f42d4fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42d01006b0 0x7f42d0198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.517+0000 7f42d4fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d0101070 0x7f42d0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.517+0000 7f42d4fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d01066c0 0x7f42d019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.517+0000 7f42d4fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d019dc70 con 0x7f42d01066c0 2023-10-08T13:00:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.517+0000 7f42d4fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d019dde0 con 0x7f42d0101070 2023-10-08T13:00:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.517+0000 7f42d4fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d019dfa0 con 0x7f42d01006b0 2023-10-08T13:00:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.517+0000 7f42ced9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d01066c0 0x7f42d019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42ced9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d01066c0 0x7f42d019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50996/0 (socket says 172.21.15.59:50996) 2023-10-08T13:00:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42ced9d700 1 -- 172.21.15.59:0/725719371 learned_addr learned my addr 172.21.15.59:0/725719371 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42ce59c700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42d01006b0 0x7f42d0198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42c7fff700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d0101070 0x7f42d0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42ced9d700 1 -- 172.21.15.59:0/725719371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42d01006b0 msgr2=0x7f42d0198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42ced9d700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42d01006b0 0x7f42d0198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42ced9d700 1 -- 172.21.15.59:0/725719371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d0101070 msgr2=0x7f42d0199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:12.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42ced9d700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d0101070 0x7f42d0199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42ced9d700 1 -- 172.21.15.59:0/725719371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c00095f0 con 0x7f42d01066c0 2023-10-08T13:00:12.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42ced9d700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d01066c0 0x7f42d019d630 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f42c800ef30 tx=0x7f42c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:12.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42c77fe700 1 -- 172.21.15.59:0/725719371 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8018070 con 0x7f42d01066c0 2023-10-08T13:00:12.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42c77fe700 1 -- 172.21.15.59:0/725719371 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42c800f040 con 0x7f42d01066c0 2023-10-08T13:00:12.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42d4fff700 1 -- 172.21.15.59:0/725719371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d019e220 con 0x7f42d01066c0 2023-10-08T13:00:12.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.518+0000 7f42c77fe700 1 -- 172.21.15.59:0/725719371 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c800cd00 con 0x7f42d01066c0 2023-10-08T13:00:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.519+0000 7f42d4fff700 1 -- 172.21.15.59:0/725719371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d01a5ac0 con 0x7f42d01066c0 2023-10-08T13:00:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.520+0000 7f42d4fff700 1 -- 172.21.15.59:0/725719371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d0101df0 con 0x7f42d01066c0 2023-10-08T13:00:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.522+0000 7f42c77fe700 1 -- 172.21.15.59:0/725719371 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f42c8003a00 con 0x7f42d01066c0 2023-10-08T13:00:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.523+0000 7f42c77fe700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f42bc0a1670 0x7f42bc0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.523+0000 7f42c77fe700 1 -- 172.21.15.59:0/725719371 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f42c80cd590 con 0x7f42d01066c0 2023-10-08T13:00:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.523+0000 7f42ce59c700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f42bc0a1670 0x7f42bc0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.524+0000 7f42ce59c700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f42bc0a1670 0x7f42bc0a3b30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f42c000b2e0 tx=0x7f42c0005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.525+0000 7f42c77fe700 1 -- 172.21.15.59:0/725719371 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f42c8096900 con 0x7f42d01066c0 2023-10-08T13:00:12.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:12 smithi092 ceph-mon[134093]: pgmap v909: 97 pgs: 97 active+clean; 933 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 11 MiB/s wr, 659 op/s 2023-10-08T13:00:12.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.767+0000 7f42d4fff700 1 -- 172.21.15.59:0/725719371 --> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f42d0110630 con 0x7f42bc0a1670 2023-10-08T13:00:12.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.777+0000 7f42c77fe700 1 -- 172.21.15.59:0/725719371 <== mgr.14214 v2:172.21.15.59:6800/921332174 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f42d0110630 con 0x7f42bc0a1670 2023-10-08T13:00:12.778 INFO:teuthology.orchestra.run.smithi059.stdout:/ 1m 6m3h 2023-10-08T13:00:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 -- 172.21.15.59:0/725719371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f42bc0a1670 msgr2=0x7f42bc0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:12.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f42bc0a1670 0x7f42bc0a3b30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f42c000b2e0 tx=0x7f42c0005fd0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 -- 172.21.15.59:0/725719371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d01066c0 msgr2=0x7f42d019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:12.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d01066c0 0x7f42d019d630 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f42c800ef30 tx=0x7f42c800c3a0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 -- 172.21.15.59:0/725719371 shutdown_connections 2023-10-08T13:00:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f42bc0a1670 0x7f42bc0a3b30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d01066c0 0x7f42d019d630 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42d01006b0 0x7f42d0198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 --2- 172.21.15.59:0/725719371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d0101070 0x7f42d0199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 -- 172.21.15.59:0/725719371 >> 172.21.15.59:0/725719371 conn(0x7f42d00fc1c0 msgr2=0x7f42d00fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 -- 172.21.15.59:0/725719371 shutdown_connections 2023-10-08T13:00:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:12.780+0000 7f42d4fff700 1 -- 172.21.15.59:0/725719371 wait complete. 2023-10-08T13:00:12.799 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-08T13:00:12.810 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-08T13:00:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:14 smithi173 ceph-mon[135182]: from='client.18192 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:14 smithi173 ceph-mon[135182]: from='client.18198 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:14.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:14 smithi173 ceph-mon[135182]: pgmap v910: 97 pgs: 97 active+clean; 938 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.2 MiB/s wr, 571 op/s 2023-10-08T13:00:14.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:14 smithi173 ceph-mon[135182]: osdmap e112: 12 total, 12 up, 12 in 2023-10-08T13:00:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:14 smithi059 ceph-mon[98489]: from='client.18192 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:14 smithi059 ceph-mon[98489]: from='client.18198 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:14 smithi059 ceph-mon[98489]: pgmap v910: 97 pgs: 97 active+clean; 938 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.2 MiB/s wr, 571 op/s 2023-10-08T13:00:14.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:14 smithi059 ceph-mon[98489]: osdmap e112: 12 total, 12 up, 12 in 2023-10-08T13:00:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:14 smithi092 ceph-mon[134093]: from='client.18192 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:14 smithi092 ceph-mon[134093]: from='client.18198 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:14 smithi092 ceph-mon[134093]: pgmap v910: 97 pgs: 97 active+clean; 938 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.2 MiB/s wr, 571 op/s 2023-10-08T13:00:14.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:14 smithi092 ceph-mon[134093]: osdmap e112: 12 total, 12 up, 12 in 2023-10-08T13:00:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:16 smithi173 ceph-mon[135182]: pgmap v912: 97 pgs: 97 active+clean; 943 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.5 MiB/s wr, 464 op/s 2023-10-08T13:00:16.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:16 smithi059 ceph-mon[98489]: pgmap v912: 97 pgs: 97 active+clean; 943 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.5 MiB/s wr, 464 op/s 2023-10-08T13:00:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:16 smithi092 ceph-mon[134093]: pgmap v912: 97 pgs: 97 active+clean; 943 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.5 MiB/s wr, 464 op/s 2023-10-08T13:00:18.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:18 smithi173 ceph-mon[135182]: pgmap v913: 97 pgs: 97 active+clean; 949 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.9 MiB/s wr, 311 op/s 2023-10-08T13:00:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:18 smithi059 ceph-mon[98489]: pgmap v913: 97 pgs: 97 active+clean; 949 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.9 MiB/s wr, 311 op/s 2023-10-08T13:00:18.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:18 smithi092 ceph-mon[134093]: pgmap v913: 97 pgs: 97 active+clean; 949 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.9 MiB/s wr, 311 op/s 2023-10-08T13:00:20.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:20 smithi092 ceph-mon[134093]: pgmap v914: 97 pgs: 97 active+clean; 954 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 220 op/s 2023-10-08T13:00:20.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:20 smithi173 ceph-mon[135182]: pgmap v914: 97 pgs: 97 active+clean; 954 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 220 op/s 2023-10-08T13:00:20.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:20 smithi059 ceph-mon[98489]: pgmap v914: 97 pgs: 97 active+clean; 954 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 220 op/s 2023-10-08T13:00:22.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:22 smithi173 ceph-mon[135182]: pgmap v915: 97 pgs: 97 active+clean; 955 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.7 MiB/s wr, 170 op/s 2023-10-08T13:00:22.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:22 smithi059 ceph-mon[98489]: pgmap v915: 97 pgs: 97 active+clean; 955 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.7 MiB/s wr, 170 op/s 2023-10-08T13:00:22.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:22 smithi092 ceph-mon[134093]: pgmap v915: 97 pgs: 97 active+clean; 955 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.7 MiB/s wr, 170 op/s 2023-10-08T13:00:24.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:24 smithi173 ceph-mon[135182]: pgmap v916: 97 pgs: 97 active+clean; 958 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.4 MiB/s wr, 172 op/s 2023-10-08T13:00:24.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:24 smithi059 ceph-mon[98489]: pgmap v916: 97 pgs: 97 active+clean; 958 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.4 MiB/s wr, 172 op/s 2023-10-08T13:00:24.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:24 smithi092 ceph-mon[134093]: pgmap v916: 97 pgs: 97 active+clean; 958 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.4 MiB/s wr, 172 op/s 2023-10-08T13:00:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:26 smithi173 ceph-mon[135182]: pgmap v917: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 170 op/s 2023-10-08T13:00:26.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:26 smithi059 ceph-mon[98489]: pgmap v917: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 170 op/s 2023-10-08T13:00:26.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:26 smithi092 ceph-mon[134093]: pgmap v917: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 170 op/s 2023-10-08T13:00:28.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:28 smithi173 ceph-mon[135182]: pgmap v918: 97 pgs: 97 active+clean; 962 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.8 MiB/s wr, 163 op/s 2023-10-08T13:00:28.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:28 smithi059 ceph-mon[98489]: pgmap v918: 97 pgs: 97 active+clean; 962 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.8 MiB/s wr, 163 op/s 2023-10-08T13:00:28.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:28 smithi092 ceph-mon[134093]: pgmap v918: 97 pgs: 97 active+clean; 962 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.8 MiB/s wr, 163 op/s 2023-10-08T13:00:30.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:30 smithi092 ceph-mon[134093]: pgmap v919: 97 pgs: 97 active+clean; 960 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 5.0 MiB/s wr, 148 op/s 2023-10-08T13:00:30.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:30 smithi173 ceph-mon[135182]: pgmap v919: 97 pgs: 97 active+clean; 960 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 5.0 MiB/s wr, 148 op/s 2023-10-08T13:00:30.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:30 smithi059 ceph-mon[98489]: pgmap v919: 97 pgs: 97 active+clean; 960 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 5.0 MiB/s wr, 148 op/s 2023-10-08T13:00:32.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:32 smithi173 ceph-mon[135182]: pgmap v920: 97 pgs: 97 active+clean; 962 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 150 op/s 2023-10-08T13:00:32.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:32 smithi059 ceph-mon[98489]: pgmap v920: 97 pgs: 97 active+clean; 962 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 150 op/s 2023-10-08T13:00:32.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:32 smithi092 ceph-mon[134093]: pgmap v920: 97 pgs: 97 active+clean; 962 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 150 op/s 2023-10-08T13:00:32.762 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:00:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.984+0000 7fdd15dff700 1 -- 172.21.15.59:0/2839312770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd10106740 msgr2=0x7fdd10106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.984+0000 7fdd15dff700 1 --2- 172.21.15.59:0/2839312770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd10106740 0x7fdd10106b20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009990 tx=0x7fdd00009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:32.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.984+0000 7fdd15dff700 1 -- 172.21.15.59:0/2839312770 shutdown_connections 2023-10-08T13:00:32.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.984+0000 7fdd15dff700 1 --2- 172.21.15.59:0/2839312770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd101010f0 0x7fdd1010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:32.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.984+0000 7fdd15dff700 1 --2- 172.21.15.59:0/2839312770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd10106740 0x7fdd10106b20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.984+0000 7fdd15dff700 1 --2- 172.21.15.59:0/2839312770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10100730 0x7fdd10100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.984+0000 7fdd15dff700 1 -- 172.21.15.59:0/2839312770 >> 172.21.15.59:0/2839312770 conn(0x7fdd100fc200 msgr2=0x7fdd100fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.984+0000 7fdd15dff700 1 -- 172.21.15.59:0/2839312770 shutdown_connections 2023-10-08T13:00:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.984+0000 7fdd15dff700 1 -- 172.21.15.59:0/2839312770 wait complete. 2023-10-08T13:00:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.986+0000 7fdd15dff700 1 Processor -- start 2023-10-08T13:00:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.986+0000 7fdd15dff700 1 -- start start 2023-10-08T13:00:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.986+0000 7fdd15dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10100730 0x7fdd1019c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.986+0000 7fdd15dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd101010f0 0x7fdd1019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd15dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd10106740 0x7fdd101969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd15dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd10197040 con 0x7fdd101010f0 2023-10-08T13:00:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd15dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd101971b0 con 0x7fdd10100730 2023-10-08T13:00:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd15dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd10197370 con 0x7fdd10106740 2023-10-08T13:00:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10100730 0x7fdd1019c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10100730 0x7fdd1019c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48294/0 (socket says 172.21.15.59:48294) 2023-10-08T13:00:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0f7fe700 1 -- 172.21.15.59:0/1194987357 learned_addr learned my addr 172.21.15.59:0/1194987357 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0effd700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd101010f0 0x7fdd1019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0f7fe700 1 -- 172.21.15.59:0/1194987357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd10106740 msgr2=0x7fdd101969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0ffff700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd10106740 0x7fdd101969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd10106740 0x7fdd101969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0f7fe700 1 -- 172.21.15.59:0/1194987357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd101010f0 msgr2=0x7fdd1019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd101010f0 0x7fdd1019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0f7fe700 1 -- 172.21.15.59:0/1194987357 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04009520 con 0x7fdd10100730 2023-10-08T13:00:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0effd700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd101010f0 0x7fdd1019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:00:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0ffff700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd10106740 0x7fdd101969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:00:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.987+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10100730 0x7fdd1019c8b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdd00000c00 tx=0x7fdd000057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.988+0000 7fdd0cff9700 1 -- 172.21.15.59:0/1194987357 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0001d070 con 0x7fdd10100730 2023-10-08T13:00:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.988+0000 7fdd0cff9700 1 -- 172.21.15.59:0/1194987357 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd00022470 con 0x7fdd10100730 2023-10-08T13:00:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.988+0000 7fdd0cff9700 1 -- 172.21.15.59:0/1194987357 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00017650 con 0x7fdd10100730 2023-10-08T13:00:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.988+0000 7fdd15dff700 1 -- 172.21.15.59:0/1194987357 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd000095f0 con 0x7fdd10100730 2023-10-08T13:00:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.988+0000 7fdd15dff700 1 -- 172.21.15.59:0/1194987357 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd101a36c0 con 0x7fdd10100730 2023-10-08T13:00:33.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.991+0000 7fdd0cff9700 1 -- 172.21.15.59:0/1194987357 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fdd000225e0 con 0x7fdd10100730 2023-10-08T13:00:33.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.992+0000 7fdd296fcb80 1 Processor -- start 2023-10-08T13:00:33.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd296fcb80 1 -- start start 2023-10-08T13:00:33.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd0cff9700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcf80a15f0 0x7fdcf80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bebe80 0x55bd66bec260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bec7a0 0x55bd66bf7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66bf9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd66b55460 con 0x55bd66bf7650 2023-10-08T13:00:33.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd66b46c20 con 0x55bd66bebe80 2023-10-08T13:00:33.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd66b44540 con 0x55bd66bec7a0 2023-10-08T13:00:33.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd0cff9700 1 -- 172.21.15.59:0/1194987357 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fdd000ce530 con 0x7fdd10100730 2023-10-08T13:00:33.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd0f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bebe80 0x55bd66bec260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd0f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bebe80 0x55bd66bec260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48300/0 (socket says 172.21.15.59:48300) 2023-10-08T13:00:33.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd0f7fe700 1 -- 172.21.15.59:0/563992693 learned_addr learned my addr 172.21.15.59:0/563992693 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:33.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd0ffff700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcf80a15f0 0x7fdcf80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.993+0000 7fdd0effd700 1 --2- 172.21.15.59:0/563992693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bec7a0 0x55bd66bf7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.994+0000 7fdd0ffff700 1 --2- 172.21.15.59:0/563992693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66bf9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.994+0000 7fdd0f7fe700 1 -- 172.21.15.59:0/563992693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bec7a0 msgr2=0x55bd66bf7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.994+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/563992693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bec7a0 0x55bd66bf7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.994+0000 7fdd0f7fe700 1 -- 172.21.15.59:0/563992693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 msgr2=0x55bd66bf9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.994+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/563992693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66bf9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.994+0000 7fdd0f7fe700 1 -- 172.21.15.59:0/563992693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd6696ade0 con 0x55bd66bebe80 2023-10-08T13:00:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.994+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/563992693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bebe80 0x55bd66bec260 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdd0009b290 tx=0x7fdd00005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d4653c7d334e5ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.994+0000 7fdd0ffff700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcf80a15f0 0x7fdcf80a3ab0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdd080094f0 tx=0x7fdd08009130 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.994+0000 7fdcf5ffb700 1 -- 172.21.15.59:0/563992693 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0009aef0 con 0x55bd66bebe80 2023-10-08T13:00:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.994+0000 7fdcf5ffb700 1 -- 172.21.15.59:0/563992693 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd0009bc90 con 0x55bd66bebe80 2023-10-08T13:00:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.994+0000 7fdcf5ffb700 1 -- 172.21.15.59:0/563992693 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0009f6e0 con 0x55bd66bebe80 2023-10-08T13:00:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.995+0000 7fdd296fcb80 1 -- 172.21.15.59:0/563992693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bebe80 msgr2=0x55bd66bec260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.995+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/563992693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bebe80 0x55bd66bec260 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdd0009b290 tx=0x7fdd00005fd0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.995+0000 7fdd296fcb80 1 -- 172.21.15.59:0/563992693 shutdown_connections 2023-10-08T13:00:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.995+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/563992693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bebe80 0x55bd66bec260 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.995+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/563992693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66bf9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.995+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/563992693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bec7a0 0x55bd66bf7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.995+0000 7fdd296fcb80 1 -- 172.21.15.59:0/563992693 >> 172.21.15.59:0/563992693 conn(0x55bd66b61260 msgr2=0x55bd66be82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.995+0000 7fdd296fcb80 1 -- 172.21.15.59:0/563992693 shutdown_connections 2023-10-08T13:00:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.995+0000 7fdd296fcb80 1 -- 172.21.15.59:0/563992693 wait complete. 2023-10-08T13:00:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.996+0000 7fdd296fcb80 1 -- start start 2023-10-08T13:00:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.996+0000 7fdd296fcb80 1 Processor -- start 2023-10-08T13:00:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66bf7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bec7a0 0x55bd66bf7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bf7650 0x55bd66bf84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd66b3fe30 con 0x55bd66bec7a0 2023-10-08T13:00:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd66adc710 con 0x55bd66bf7650 2023-10-08T13:00:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd66adc3b0 con 0x55bd66bebe80 2023-10-08T13:00:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd296fcb80 10 client.0 _ll_register_callbacks cb 0x55bd66939800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:00:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd0ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bf7650 0x55bd66bf84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd0effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bec7a0 0x55bd66bf7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd0ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bf7650 0x55bd66bf84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48316/0 (socket says 172.21.15.59:48316) 2023-10-08T13:00:33.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd0f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66bf7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd0ffff700 1 -- 172.21.15.59:0/2000241335 learned_addr learned my addr 172.21.15.59:0/2000241335 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:33.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd0ffff700 1 -- 172.21.15.59:0/2000241335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 msgr2=0x55bd66bf7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd0ffff700 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66bf7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd0ffff700 1 -- 172.21.15.59:0/2000241335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bec7a0 msgr2=0x55bd66bf7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd0ffff700 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bec7a0 0x55bd66bf7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd0ffff700 1 -- 172.21.15.59:0/2000241335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd101a36c0 con 0x55bd66bf7650 2023-10-08T13:00:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.997+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66bf7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:00:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.998+0000 7fdd0ffff700 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bf7650 0x55bd66bf84b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdd08019b20 tx=0x7fdd08004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=332de27c4629e549 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.998+0000 7fdceeffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2023-10-08T13:00:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.998+0000 7fdceeffd700 1 -- 172.21.15.59:0/2000241335 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0801e070 con 0x55bd66bf7650 2023-10-08T13:00:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.998+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2000241335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bd66b07eb0 con 0x55bd66bf7650 2023-10-08T13:00:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.998+0000 7fdceeffd700 1 -- 172.21.15.59:0/2000241335 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fdd08019e30 con 0x55bd66bf7650 2023-10-08T13:00:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.998+0000 7fdceeffd700 1 -- 172.21.15.59:0/2000241335 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd08017710 con 0x55bd66bf7650 2023-10-08T13:00:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.998+0000 7fdd296fcb80 10 client.28235 fetch_fsmap learned FSMap version 20 2023-10-08T13:00:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.998+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2000241335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55bd66953c60 con 0x55bd66bf7650 2023-10-08T13:00:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.999+0000 7fdceeffd700 1 -- 172.21.15.59:0/2000241335 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd08032020 con 0x55bd66bf7650 2023-10-08T13:00:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.999+0000 7fdceeffd700 1 -- 172.21.15.59:0/2000241335 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdd0802e9a0 con 0x55bd66bf7650 2023-10-08T13:00:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.999+0000 7fdd296fcb80 10 client.28235 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T13:00:33.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.999+0000 7fdd296fcb80 10 client.28235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T13:00:33.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.999+0000 7fdd296fcb80 20 client.28235 populate_metadata read hostname 'smithi059' 2023-10-08T13:00:33.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.999+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bd66c06ee0 0x55bd66c09300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.999+0000 7fdd296fcb80 4 client.28235 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:00:33.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.999+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2000241335 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bd66b38e10 con 0x55bd66c06ee0 2023-10-08T13:00:33.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:32.999+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bd66c06ee0 0x55bd66c09300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.000+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bd66c06ee0 0x55bd66c09300 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1f2ff7fa8feccaa server_cookie=3b420b63ecfa11 in_seq=0 out_seq=0 2023-10-08T13:00:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.000+0000 7fdceeffd700 10 client.28235 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.000+0000 7fdceeffd700 1 -- 172.21.15.59:0/2000241335 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bd66b38e10 con 0x55bd66c06ee0 2023-10-08T13:00:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.000+0000 7fdceeffd700 10 client.28235 handle_command_reply: tid=0 2023-10-08T13:00:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.000+0000 7fdd296fcb80 1 client.28235 shutdown 2023-10-08T13:00:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.000+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2000241335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bf7650 msgr2=0x55bd66bf84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.000+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bf7650 0x55bd66bf84b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdd08019b20 tx=0x7fdd08004b40 comp rx=0 tx=0).stop 2023-10-08T13:00:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.001+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2000241335 shutdown_connections 2023-10-08T13:00:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.001+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bd66c06ee0 0x55bd66c09300 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.001+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bf7650 0x55bd66bf84b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.001+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66bf7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.001+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/2000241335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bec7a0 0x55bd66bf7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.001+0000 7fdceeffd700 0 client.28235 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.001+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2000241335 >> 172.21.15.59:0/2000241335 conn(0x55bd66b61260 msgr2=0x55bd66be7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.001+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2000241335 shutdown_connections 2023-10-08T13:00:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.001+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2000241335 wait complete. 2023-10-08T13:00:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.001+0000 7fdd296fcb80 20 client.28235 trim_cache size 0 max 16384 2023-10-08T13:00:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.018+0000 7fdd296fcb80 1 Processor -- start 2023-10-08T13:00:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.018+0000 7fdd296fcb80 1 -- start start 2023-10-08T13:00:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.019+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66bfba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.019+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66bf0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.019+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66bf1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.019+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd669c0920 con 0x55bd66bf7650 2023-10-08T13:00:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.019+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd66c02b50 con 0x55bd66bec7a0 2023-10-08T13:00:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.019+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd66c038b0 con 0x55bd66bebe80 2023-10-08T13:00:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.019+0000 7fdd0effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66bf0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.019+0000 7fdd0ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66bf1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.019+0000 7fdd0effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66bf0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48322/0 (socket says 172.21.15.59:48322) 2023-10-08T13:00:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.019+0000 7fdd0effd700 1 -- 172.21.15.59:0/2338265775 learned_addr learned my addr 172.21.15.59:0/2338265775 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.019+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/2338265775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66bfba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.020+0000 7fdd0effd700 1 -- 172.21.15.59:0/2338265775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 msgr2=0x55bd66bfba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.020+0000 7fdd0effd700 1 --2- 172.21.15.59:0/2338265775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66bfba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.020+0000 7fdd0effd700 1 -- 172.21.15.59:0/2338265775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 msgr2=0x55bd66bf1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.020+0000 7fdd0effd700 1 --2- 172.21.15.59:0/2338265775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66bf1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.020+0000 7fdd0effd700 1 -- 172.21.15.59:0/2338265775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd66991250 con 0x55bd66bec7a0 2023-10-08T13:00:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.020+0000 7fdd0effd700 1 --2- 172.21.15.59:0/2338265775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66bf0d60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdd04012480 tx=0x7fdd04009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f45c0137b819a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.020+0000 7fdcf67fc700 1 -- 172.21.15.59:0/2338265775 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04020070 con 0x55bd66bec7a0 2023-10-08T13:00:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.020+0000 7fdcf67fc700 1 -- 172.21.15.59:0/2338265775 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd04018040 con 0x55bd66bec7a0 2023-10-08T13:00:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.020+0000 7fdcf67fc700 1 -- 172.21.15.59:0/2338265775 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04017050 con 0x55bd66bec7a0 2023-10-08T13:00:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.021+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2338265775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 msgr2=0x55bd66bf0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.021+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/2338265775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66bf0d60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdd04012480 tx=0x7fdd04009260 comp rx=0 tx=0).stop 2023-10-08T13:00:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.021+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2338265775 shutdown_connections 2023-10-08T13:00:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.021+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/2338265775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66bf1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.021+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/2338265775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66bfba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.021+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/2338265775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66bf0d60 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.021+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2338265775 >> 172.21.15.59:0/2338265775 conn(0x55bd66b61260 msgr2=0x55bd66be74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.021+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2338265775 shutdown_connections 2023-10-08T13:00:33.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.021+0000 7fdd296fcb80 1 -- 172.21.15.59:0/2338265775 wait complete. 2023-10-08T13:00:33.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.021+0000 7fdd296fcb80 1 -- start start 2023-10-08T13:00:33.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.022+0000 7fdd296fcb80 1 Processor -- start 2023-10-08T13:00:33.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.022+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66c4ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.022+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66c4f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.022+0000 7fdd296fcb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66c52df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.022+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd66c533a0 con 0x55bd66bf7650 2023-10-08T13:00:33.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.022+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd66c53510 con 0x55bd66bec7a0 2023-10-08T13:00:33.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.022+0000 7fdd296fcb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd66c536d0 con 0x55bd66bebe80 2023-10-08T13:00:33.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.022+0000 7fdd296fcb80 10 client.0 _ll_register_callbacks cb 0x7fdd080194c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:00:33.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66c52df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66c4f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66c4f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48330/0 (socket says 172.21.15.59:48330) 2023-10-08T13:00:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0effd700 1 -- 172.21.15.59:0/3785717622 learned_addr learned my addr 172.21.15.59:0/3785717622 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66c4ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0ffff700 1 -- 172.21.15.59:0/3785717622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 msgr2=0x55bd66c4ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0ffff700 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66c4ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0ffff700 1 -- 172.21.15.59:0/3785717622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 msgr2=0x55bd66c4f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0ffff700 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66c4f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0ffff700 1 -- 172.21.15.59:0/3785717622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd04009ca0 con 0x55bd66bf7650 2023-10-08T13:00:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0effd700 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66c4f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:00:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdd0ffff700 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66c52df0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdd080060b0 tx=0x7fdd0802eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7be1860c371f8d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.023+0000 7fdceeffd700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T13:00:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdceeffd700 1 -- 172.21.15.59:0/3785717622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0801e070 con 0x55bd66bf7650 2023-10-08T13:00:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdd296fcb80 1 -- 172.21.15.59:0/3785717622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd0009bc90 con 0x55bd66bf7650 2023-10-08T13:00:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdceeffd700 1 -- 172.21.15.59:0/3785717622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fdd08033080 con 0x55bd66bf7650 2023-10-08T13:00:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdceeffd700 1 -- 172.21.15.59:0/3785717622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd08007580 con 0x55bd66bf7650 2023-10-08T13:00:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdd296fcb80 10 client.18216 fetch_fsmap learned FSMap version 20 2023-10-08T13:00:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdd296fcb80 1 -- 172.21.15.59:0/3785717622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55bd669692b0 con 0x55bd66bf7650 2023-10-08T13:00:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdceeffd700 1 -- 172.21.15.59:0/3785717622 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd0009bc90 con 0x55bd66bf7650 2023-10-08T13:00:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdceeffd700 1 -- 172.21.15.59:0/3785717622 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdd08017970 con 0x55bd66bf7650 2023-10-08T13:00:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdd296fcb80 10 client.18216 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T13:00:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdd296fcb80 10 client.18216 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T13:00:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdd296fcb80 20 client.18216 populate_metadata read hostname 'smithi059' 2023-10-08T13:00:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bd66c5c170 0x55bd66c5e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdd296fcb80 4 client.18216 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:00:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.024+0000 7fdd296fcb80 1 -- 172.21.15.59:0/3785717622 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bd66b38b30 con 0x55bd66c5c170 2023-10-08T13:00:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bd66c5c170 0x55bd66c5e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdd0f7fe700 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bd66c5c170 0x55bd66c5e590 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a45776afc306d2fe server_cookie=48fffc4e181c2a06 in_seq=0 out_seq=0 2023-10-08T13:00:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdceeffd700 10 client.18216 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdceeffd700 1 -- 172.21.15.59:0/3785717622 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55bd66b38b30 con 0x55bd66c5c170 2023-10-08T13:00:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdceeffd700 10 client.18216 handle_command_reply: tid=0 2023-10-08T13:00:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdd296fcb80 1 client.18216 shutdown 2023-10-08T13:00:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdd296fcb80 1 -- 172.21.15.59:0/3785717622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 msgr2=0x55bd66c52df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66c52df0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdd080060b0 tx=0x7fdd0802eaf0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdd296fcb80 1 -- 172.21.15.59:0/3785717622 shutdown_connections 2023-10-08T13:00:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55bd66c5c170 0x55bd66c5e590 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd66bf7650 0x55bd66c52df0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bd66bebe80 0x55bd66c4ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdceeffd700 0 client.18216 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdd296fcb80 1 --2- 172.21.15.59:0/3785717622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd66bec7a0 0x55bd66c4f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.025+0000 7fdd296fcb80 1 -- 172.21.15.59:0/3785717622 >> 172.21.15.59:0/3785717622 conn(0x55bd66b61260 msgr2=0x55bd66bf1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd296fcb80 1 -- 172.21.15.59:0/3785717622 shutdown_connections 2023-10-08T13:00:33.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd296fcb80 1 -- 172.21.15.59:0/3785717622 wait complete. 2023-10-08T13:00:33.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd296fcb80 20 client.18216 trim_cache size 0 max 16384 2023-10-08T13:00:33.037 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T13:00:33.037 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2023-10-08T13:00:33.037 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2023-10-08T13:00:33.037 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T13:00:33.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd15dff700 1 -- 172.21.15.59:0/1194987357 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcf80a15f0 msgr2=0x7fdcf80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd15dff700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcf80a15f0 0x7fdcf80a3ab0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdd080094f0 tx=0x7fdd08009130 comp rx=0 tx=0).stop 2023-10-08T13:00:33.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd15dff700 1 -- 172.21.15.59:0/1194987357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10100730 msgr2=0x7fdd1019c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd15dff700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10100730 0x7fdd1019c8b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdd00000c00 tx=0x7fdd000057f0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd15dff700 1 -- 172.21.15.59:0/1194987357 shutdown_connections 2023-10-08T13:00:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd15dff700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fdcf80a15f0 0x7fdcf80a3ab0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd15dff700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10100730 0x7fdd1019c8b0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd15dff700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd10106740 0x7fdd101969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd15dff700 1 --2- 172.21.15.59:0/1194987357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd101010f0 0x7fdd1019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.026+0000 7fdd15dff700 1 -- 172.21.15.59:0/1194987357 >> 172.21.15.59:0/1194987357 conn(0x7fdd100fc200 msgr2=0x7fdd100fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.027+0000 7fdd15dff700 1 -- 172.21.15.59:0/1194987357 shutdown_connections 2023-10-08T13:00:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.027+0000 7fdd15dff700 1 -- 172.21.15.59:0/1194987357 wait complete. 2023-10-08T13:00:33.046 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T13:00:33.046 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:00:33.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.250+0000 7f823bfff700 1 -- 172.21.15.59:0/4199590480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8234100ff0 msgr2=0x7f823410d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.250+0000 7f823bfff700 1 --2- 172.21.15.59:0/4199590480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8234100ff0 0x7f823410d500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f822c00b0a0 tx=0x7f822c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.250+0000 7f823bfff700 1 -- 172.21.15.59:0/4199590480 shutdown_connections 2023-10-08T13:00:33.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.250+0000 7f823bfff700 1 --2- 172.21.15.59:0/4199590480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8234100ff0 0x7f823410d500 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.250+0000 7f823bfff700 1 --2- 172.21.15.59:0/4199590480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234106640 0x7f8234106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.250+0000 7f823bfff700 1 --2- 172.21.15.59:0/4199590480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8234100630 0x7f8234100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.250+0000 7f823bfff700 1 -- 172.21.15.59:0/4199590480 >> 172.21.15.59:0/4199590480 conn(0x7f82340fc1a0 msgr2=0x7f82340fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.250+0000 7f823bfff700 1 -- 172.21.15.59:0/4199590480 shutdown_connections 2023-10-08T13:00:33.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.250+0000 7f823bfff700 1 -- 172.21.15.59:0/4199590480 wait complete. 2023-10-08T13:00:33.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.251+0000 7f823bfff700 1 Processor -- start 2023-10-08T13:00:33.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.251+0000 7f823bfff700 1 -- start start 2023-10-08T13:00:33.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8234100630 0x7f8234072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8234100ff0 0x7f8234073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234106640 0x7f8234073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823bfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82341a4e30 con 0x7f8234100630 2023-10-08T13:00:33.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823bfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82341a4fa0 con 0x7f8234100ff0 2023-10-08T13:00:33.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82341a5160 con 0x7f8234106640 2023-10-08T13:00:33.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823959a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8234100ff0 0x7f8234073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823959a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8234100ff0 0x7f8234073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48356/0 (socket says 172.21.15.59:48356) 2023-10-08T13:00:33.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823959a700 1 -- 172.21.15.59:0/1208335447 learned_addr learned my addr 172.21.15.59:0/1208335447 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:33.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234106640 0x7f8234073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f8239d9b700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8234100630 0x7f8234072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823959a700 1 -- 172.21.15.59:0/1208335447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234106640 msgr2=0x7f8234073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823959a700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234106640 0x7f8234073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823959a700 1 -- 172.21.15.59:0/1208335447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8234100630 msgr2=0x7f8234072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.252+0000 7f823959a700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8234100630 0x7f8234072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.253+0000 7f823959a700 1 -- 172.21.15.59:0/1208335447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c009d00 con 0x7f8234100ff0 2023-10-08T13:00:33.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.253+0000 7f823a59c700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234106640 0x7f8234073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:00:33.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.253+0000 7f823959a700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8234100ff0 0x7f8234073030 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f822400e9a0 tx=0x7f822400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.253+0000 7f822affd700 1 -- 172.21.15.59:0/1208335447 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224009790 con 0x7f8234100ff0 2023-10-08T13:00:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.253+0000 7f822affd700 1 -- 172.21.15.59:0/1208335447 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8224010430 con 0x7f8234100ff0 2023-10-08T13:00:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.253+0000 7f822affd700 1 -- 172.21.15.59:0/1208335447 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224018680 con 0x7f8234100ff0 2023-10-08T13:00:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.253+0000 7f823bfff700 1 -- 172.21.15.59:0/1208335447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82341a5440 con 0x7f8234100ff0 2023-10-08T13:00:33.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.253+0000 7f823bfff700 1 -- 172.21.15.59:0/1208335447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82341a5950 con 0x7f8234100ff0 2023-10-08T13:00:33.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.254+0000 7f823bfff700 1 -- 172.21.15.59:0/1208335447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8234108c50 con 0x7f8234100ff0 2023-10-08T13:00:33.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.256+0000 7f822affd700 1 -- 172.21.15.59:0/1208335447 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f82240105a0 con 0x7f8234100ff0 2023-10-08T13:00:33.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.257+0000 7f822affd700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82200a1670 0x7f82200a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.257+0000 7f822affd700 1 -- 172.21.15.59:0/1208335447 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f8224014070 con 0x7f8234100ff0 2023-10-08T13:00:33.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.258+0000 7f8239d9b700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82200a1670 0x7f82200a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.258+0000 7f8239d9b700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82200a1670 0x7f82200a3b30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8230009be0 tx=0x7f8230009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.262+0000 7f822affd700 1 -- 172.21.15.59:0/1208335447 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8224096580 con 0x7f8234100ff0 2023-10-08T13:00:33.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.542+0000 7f823bfff700 1 -- 172.21.15.59:0/1208335447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8234101d70 con 0x7f8234100ff0 2023-10-08T13:00:33.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.543+0000 7f822affd700 1 -- 172.21.15.59:0/1208335447 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f8224099ba0 con 0x7f8234100ff0 2023-10-08T13:00:33.544 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T13:00:33.544 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:00:33.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 -- 172.21.15.59:0/1208335447 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82200a1670 msgr2=0x7f82200a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82200a1670 0x7f82200a3b30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8230009be0 tx=0x7f8230009260 comp rx=0 tx=0).stop 2023-10-08T13:00:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 -- 172.21.15.59:0/1208335447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8234100ff0 msgr2=0x7f8234073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8234100ff0 0x7f8234073030 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f822400e9a0 tx=0x7f822400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 -- 172.21.15.59:0/1208335447 shutdown_connections 2023-10-08T13:00:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f82200a1670 0x7f82200a3b30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234106640 0x7f8234073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8234100630 0x7f8234072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 --2- 172.21.15.59:0/1208335447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8234100ff0 0x7f8234073030 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 -- 172.21.15.59:0/1208335447 >> 172.21.15.59:0/1208335447 conn(0x7f82340fc1a0 msgr2=0x7f82340fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 -- 172.21.15.59:0/1208335447 shutdown_connections 2023-10-08T13:00:33.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.545+0000 7f823bfff700 1 -- 172.21.15.59:0/1208335447 wait complete. 2023-10-08T13:00:33.549 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T13:00:33.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T13:00:33.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.770+0000 7f7e6edff700 1 -- 172.21.15.59:0/244683086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e68106740 msgr2=0x7f7e68106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.770+0000 7f7e6edff700 1 --2- 172.21.15.59:0/244683086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e68106740 0x7f7e68106b20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009990 tx=0x7f7e5c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.770+0000 7f7e6edff700 1 -- 172.21.15.59:0/244683086 shutdown_connections 2023-10-08T13:00:33.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.770+0000 7f7e6edff700 1 --2- 172.21.15.59:0/244683086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e681010f0 0x7f7e6810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.770+0000 7f7e6edff700 1 --2- 172.21.15.59:0/244683086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e68106740 0x7f7e68106b20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.770+0000 7f7e6edff700 1 --2- 172.21.15.59:0/244683086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e68100730 0x7f7e68100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.770+0000 7f7e6edff700 1 -- 172.21.15.59:0/244683086 >> 172.21.15.59:0/244683086 conn(0x7f7e680fc200 msgr2=0x7f7e680fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.770+0000 7f7e6edff700 1 -- 172.21.15.59:0/244683086 shutdown_connections 2023-10-08T13:00:33.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.770+0000 7f7e6edff700 1 -- 172.21.15.59:0/244683086 wait complete. 2023-10-08T13:00:33.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.771+0000 7f7e6edff700 1 Processor -- start 2023-10-08T13:00:33.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e6edff700 1 -- start start 2023-10-08T13:00:33.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e6edff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e68100730 0x7f7e68198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e6edff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e681010f0 0x7f7e68199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e6edff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e68106740 0x7f7e6819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e6edff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6819dcc0 con 0x7f7e68106740 2023-10-08T13:00:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e6edff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6819de30 con 0x7f7e68100730 2023-10-08T13:00:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e6edff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6819dff0 con 0x7f7e681010f0 2023-10-08T13:00:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e6d39c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e68106740 0x7f7e6819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e67fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e681010f0 0x7f7e68199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e67fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e681010f0 0x7f7e68199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:48660/0 (socket says 172.21.15.59:48660) 2023-10-08T13:00:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e67fff700 1 -- 172.21.15.59:0/498768386 learned_addr learned my addr 172.21.15.59:0/498768386 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e6d39c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e68106740 0x7f7e6819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35806/0 (socket says 172.21.15.59:35806) 2023-10-08T13:00:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.772+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e68100730 0x7f7e68198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e67fff700 1 -- 172.21.15.59:0/498768386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e68100730 msgr2=0x7f7e68198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e67fff700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e68100730 0x7f7e68198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e67fff700 1 -- 172.21.15.59:0/498768386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e68106740 msgr2=0x7f7e6819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e67fff700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e68106740 0x7f7e6819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e67fff700 1 -- 172.21.15.59:0/498768386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c0095f0 con 0x7f7e681010f0 2023-10-08T13:00:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e6d39c700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e68106740 0x7f7e6819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:00:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e67fff700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e681010f0 0x7f7e68199330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400e9a0 tx=0x7f7e5400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e65ffb700 1 -- 172.21.15.59:0/498768386 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54009790 con 0x7f7e681010f0 2023-10-08T13:00:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e6edff700 1 -- 172.21.15.59:0/498768386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6819e2d0 con 0x7f7e681010f0 2023-10-08T13:00:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e65ffb700 1 -- 172.21.15.59:0/498768386 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e54010430 con 0x7f7e681010f0 2023-10-08T13:00:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e65ffb700 1 -- 172.21.15.59:0/498768386 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54018680 con 0x7f7e681010f0 2023-10-08T13:00:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.773+0000 7f7e6edff700 1 -- 172.21.15.59:0/498768386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e681a5b10 con 0x7f7e681010f0 2023-10-08T13:00:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.777+0000 7f7e65ffb700 1 -- 172.21.15.59:0/498768386 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7e540105a0 con 0x7f7e681010f0 2023-10-08T13:00:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.778+0000 7f7e826dfb80 1 Processor -- start 2023-10-08T13:00:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.779+0000 7f7e826dfb80 1 -- start start 2023-10-08T13:00:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.779+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce52260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.779+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 0x55802ce5d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.779+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802ce5fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.779+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802cdbb460 con 0x55802ce5d650 2023-10-08T13:00:33.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.779+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802cdacc20 con 0x55802ce51e80 2023-10-08T13:00:33.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.779+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802cdaa540 con 0x55802ce527a0 2023-10-08T13:00:33.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.779+0000 7f7e65ffb700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e580a15f0 0x7f7e580a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.779+0000 7f7e67fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802ce5fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6cb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 0x55802ce5d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e65ffb700 1 -- 172.21.15.59:0/498768386 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7e54014070 con 0x7f7e681010f0 2023-10-08T13:00:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6d39c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce52260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6cb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 0x55802ce5d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:48674/0 (socket says 172.21.15.59:48674) 2023-10-08T13:00:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6cb9b700 1 -- 172.21.15.59:0/2168925122 learned_addr learned my addr 172.21.15.59:0/2168925122 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6d39c700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e580a15f0 0x7f7e580a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6cb9b700 1 -- 172.21.15.59:0/2168925122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 msgr2=0x55802ce52260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/2168925122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce52260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6cb9b700 1 -- 172.21.15.59:0/2168925122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 msgr2=0x55802ce5fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/2168925122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802ce5fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6cb9b700 1 -- 172.21.15.59:0/2168925122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55802cbd0de0 con 0x55802ce527a0 2023-10-08T13:00:33.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6d39c700 1 --2- 172.21.15.59:0/2168925122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce52260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:00:33.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/2168925122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 0x55802ce5d110 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00b640 tx=0x7f7e5c00b670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=961841844c8c234e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.780+0000 7f7e6d39c700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e580a15f0 0x7f7e580a3ab0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009790 tx=0x7f7e60009130 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.781+0000 7f7e52ffd700 1 -- 172.21.15.59:0/2168925122 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c01d070 con 0x55802ce527a0 2023-10-08T13:00:33.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.781+0000 7f7e52ffd700 1 -- 172.21.15.59:0/2168925122 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e5c01e040 con 0x55802ce527a0 2023-10-08T13:00:33.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.781+0000 7f7e52ffd700 1 -- 172.21.15.59:0/2168925122 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c004820 con 0x55802ce527a0 2023-10-08T13:00:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.781+0000 7f7e826dfb80 1 -- 172.21.15.59:0/2168925122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 msgr2=0x55802ce5d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.781+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/2168925122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 0x55802ce5d110 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00b640 tx=0x7f7e5c00b670 comp rx=0 tx=0).stop 2023-10-08T13:00:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.782+0000 7f7e826dfb80 1 -- 172.21.15.59:0/2168925122 shutdown_connections 2023-10-08T13:00:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.782+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/2168925122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce52260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.782+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/2168925122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802ce5fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.782+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/2168925122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 0x55802ce5d110 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.782+0000 7f7e826dfb80 1 -- 172.21.15.59:0/2168925122 >> 172.21.15.59:0/2168925122 conn(0x55802cdc7260 msgr2=0x55802ce4e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.782+0000 7f7e826dfb80 1 -- 172.21.15.59:0/2168925122 shutdown_connections 2023-10-08T13:00:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.782+0000 7f7e826dfb80 1 -- 172.21.15.59:0/2168925122 wait complete. 2023-10-08T13:00:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.782+0000 7f7e826dfb80 1 -- start start 2023-10-08T13:00:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.782+0000 7f7e826dfb80 1 Processor -- start 2023-10-08T13:00:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce5d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce527a0 0x55802ce5a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce5d650 0x55802ce5aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802cda5e30 con 0x55802ce527a0 2023-10-08T13:00:33.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802cd42710 con 0x55802ce51e80 2023-10-08T13:00:33.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802cd423b0 con 0x55802ce5d650 2023-10-08T13:00:33.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e826dfb80 10 client.0 _ll_register_callbacks cb 0x55802cb9f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:00:33.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e67fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce527a0 0x55802ce5a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e67fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce527a0 0x55802ce5a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35824/0 (socket says 172.21.15.59:35824) 2023-10-08T13:00:33.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e67fff700 1 -- 172.21.15.59:0/722573482 learned_addr learned my addr 172.21.15.59:0/722573482 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e6d39c700 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce5d650 0x55802ce5aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.783+0000 7f7e6cb9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce5d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e67fff700 1 -- 172.21.15.59:0/722573482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce5d650 msgr2=0x55802ce5aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e67fff700 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce5d650 0x55802ce5aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e67fff700 1 -- 172.21.15.59:0/722573482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 msgr2=0x55802ce5d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e67fff700 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce5d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e67fff700 1 -- 172.21.15.59:0/722573482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e60011040 con 0x55802ce527a0 2023-10-08T13:00:33.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e67fff700 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce527a0 0x55802ce5a410 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7e5409a220 tx=0x7f7e5400aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b84ecf859d460f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e47fff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-08T13:00:33.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e47fff700 1 -- 172.21.15.59:0/722573482 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5409a290 con 0x55802ce527a0 2023-10-08T13:00:33.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e826dfb80 1 -- 172.21.15.59:0/722573482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55802cd6deb0 con 0x55802ce527a0 2023-10-08T13:00:33.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e47fff700 1 -- 172.21.15.59:0/722573482 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7e5409e3e0 con 0x55802ce527a0 2023-10-08T13:00:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e47fff700 1 -- 172.21.15.59:0/722573482 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e540a2620 con 0x55802ce527a0 2023-10-08T13:00:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e826dfb80 10 client.18234 fetch_fsmap learned FSMap version 20 2023-10-08T13:00:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.784+0000 7f7e826dfb80 1 -- 172.21.15.59:0/722573482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x7f7e6810df00 con 0x55802ce527a0 2023-10-08T13:00:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.785+0000 7f7e47fff700 1 -- 172.21.15.59:0/722573482 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e54093080 con 0x55802ce527a0 2023-10-08T13:00:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.785+0000 7f7e47fff700 1 -- 172.21.15.59:0/722573482 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7e540cf0c0 con 0x55802ce527a0 2023-10-08T13:00:33.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.785+0000 7f7e826dfb80 10 client.18234 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T13:00:33.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.785+0000 7f7e826dfb80 10 client.18234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T13:00:33.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.785+0000 7f7e826dfb80 20 client.18234 populate_metadata read hostname 'smithi059' 2023-10-08T13:00:33.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.785+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55802ce6d070 0x55802ce6f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.785+0000 7f7e826dfb80 4 client.18234 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:00:33.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.785+0000 7f7e826dfb80 1 -- 172.21.15.59:0/722573482 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55802cd9ee10 con 0x55802ce6d070 2023-10-08T13:00:33.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.785+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55802ce6d070 0x55802ce6f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.786+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55802ce6d070 0x55802ce6f460 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34ce5a435bd75b7a server_cookie=f2db5d93744f5262 in_seq=0 out_seq=0 2023-10-08T13:00:33.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.786+0000 7f7e47fff700 10 client.18234 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.786+0000 7f7e47fff700 1 -- 172.21.15.59:0/722573482 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55802cd9ee10 con 0x55802ce6d070 2023-10-08T13:00:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.786+0000 7f7e47fff700 10 client.18234 handle_command_reply: tid=0 2023-10-08T13:00:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 1 client.18234 shutdown 2023-10-08T13:00:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 1 -- 172.21.15.59:0/722573482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce527a0 msgr2=0x55802ce5a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce527a0 0x55802ce5a410 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7e5409a220 tx=0x7f7e5400aca0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 1 -- 172.21.15.59:0/722573482 shutdown_connections 2023-10-08T13:00:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55802ce6d070 0x55802ce6f460 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce5d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce5d650 0x55802ce5aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/722573482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce527a0 0x55802ce5a410 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e47fff700 0 client.18234 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 1 -- 172.21.15.59:0/722573482 >> 172.21.15.59:0/722573482 conn(0x55802cdc7260 msgr2=0x55802ce4dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 1 -- 172.21.15.59:0/722573482 shutdown_connections 2023-10-08T13:00:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 1 -- 172.21.15.59:0/722573482 wait complete. 2023-10-08T13:00:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.787+0000 7f7e826dfb80 20 client.18234 trim_cache size 0 max 16384 2023-10-08T13:00:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.801+0000 7f7e826dfb80 1 Processor -- start 2023-10-08T13:00:33.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.801+0000 7f7e826dfb80 1 -- start start 2023-10-08T13:00:33.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.801+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce51e80 0x55802ce5fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.801+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce527a0 0x55802ce64180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802ce59970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802cc26920 con 0x55802ce5d650 2023-10-08T13:00:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802ce530d0 con 0x55802ce527a0 2023-10-08T13:00:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802ce4aae0 con 0x55802ce51e80 2023-10-08T13:00:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e6cb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce51e80 0x55802ce5fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e6d39c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802ce59970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e6cb9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce51e80 0x55802ce5fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:48698/0 (socket says 172.21.15.59:48698) 2023-10-08T13:00:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e67fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce527a0 0x55802ce64180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e6cb9b700 1 -- 172.21.15.59:0/830989827 learned_addr learned my addr 172.21.15.59:0/830989827 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e6cb9b700 1 -- 172.21.15.59:0/830989827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce527a0 msgr2=0x55802ce64180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/830989827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce527a0 0x55802ce64180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e6cb9b700 1 -- 172.21.15.59:0/830989827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 msgr2=0x55802ce59970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/830989827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802ce59970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e6cb9b700 1 -- 172.21.15.59:0/830989827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55802cbb9c60 con 0x55802ce51e80 2023-10-08T13:00:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.802+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/830989827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce51e80 0x55802ce5fa40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0098e0 tx=0x7f7e5c01a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c099a6564caed07 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e537fe700 1 -- 172.21.15.59:0/830989827 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c01d040 con 0x55802ce51e80 2023-10-08T13:00:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e537fe700 1 -- 172.21.15.59:0/830989827 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e5c005960 con 0x55802ce51e80 2023-10-08T13:00:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e537fe700 1 -- 172.21.15.59:0/830989827 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c034a70 con 0x55802ce51e80 2023-10-08T13:00:33.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e826dfb80 1 -- 172.21.15.59:0/830989827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce51e80 msgr2=0x55802ce5fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/830989827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce51e80 0x55802ce5fa40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0098e0 tx=0x7f7e5c01a040 comp rx=0 tx=0).stop 2023-10-08T13:00:33.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e826dfb80 1 -- 172.21.15.59:0/830989827 shutdown_connections 2023-10-08T13:00:33.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/830989827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802ce59970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/830989827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce51e80 0x55802ce5fa40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/830989827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce527a0 0x55802ce64180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e826dfb80 1 -- 172.21.15.59:0/830989827 >> 172.21.15.59:0/830989827 conn(0x55802cdc7260 msgr2=0x55802ce4d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e826dfb80 1 -- 172.21.15.59:0/830989827 shutdown_connections 2023-10-08T13:00:33.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.803+0000 7f7e826dfb80 1 -- 172.21.15.59:0/830989827 wait complete. 2023-10-08T13:00:33.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.804+0000 7f7e826dfb80 1 -- start start 2023-10-08T13:00:33.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.804+0000 7f7e826dfb80 1 Processor -- start 2023-10-08T13:00:33.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.804+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce62370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.804+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 0x55802ce628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.804+0000 7f7e826dfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802cebfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.804+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802cec03b0 con 0x55802ce5d650 2023-10-08T13:00:33.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.804+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802cec0520 con 0x55802ce51e80 2023-10-08T13:00:33.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.804+0000 7f7e826dfb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802cec06e0 con 0x55802ce527a0 2023-10-08T13:00:33.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e826dfb80 10 client.0 _ll_register_callbacks cb 0x7f7e5409a060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:00:33.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e6d39c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802cebfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e6d39c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802cebfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35840/0 (socket says 172.21.15.59:35840) 2023-10-08T13:00:33.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e67fff700 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 0x55802ce628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e6d39c700 1 -- 172.21.15.59:0/318387509 learned_addr learned my addr 172.21.15.59:0/318387509 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:33.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce62370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e67fff700 1 -- 172.21.15.59:0/318387509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 msgr2=0x55802ce62370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e67fff700 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce62370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e67fff700 1 -- 172.21.15.59:0/318387509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 msgr2=0x55802cebfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:00:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e67fff700 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802cebfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e67fff700 1 -- 172.21.15.59:0/318387509 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55802cbd0de0 con 0x55802ce527a0 2023-10-08T13:00:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.805+0000 7f7e6d39c700 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802cebfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:00:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e67fff700 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 0x55802ce628b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7e54096790 tx=0x7f7e5409a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d26ec0958093940e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e47fff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-08T13:00:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e47fff700 1 -- 172.21.15.59:0/318387509 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54099980 con 0x55802ce527a0 2023-10-08T13:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e826dfb80 1 -- 172.21.15.59:0/318387509 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e5c01e040 con 0x55802ce527a0 2023-10-08T13:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e47fff700 1 -- 172.21.15.59:0/318387509 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f7e5409e3e0 con 0x55802ce527a0 2023-10-08T13:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e47fff700 1 -- 172.21.15.59:0/318387509 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e5409a780 con 0x55802ce527a0 2023-10-08T13:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e826dfb80 10 client.28249 fetch_fsmap learned FSMap version 20 2023-10-08T13:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e826dfb80 1 -- 172.21.15.59:0/318387509 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) v3 -- 0x55802cbf7250 con 0x55802ce527a0 2023-10-08T13:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e47fff700 1 -- 172.21.15.59:0/318387509 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e54065080 con 0x55802ce527a0 2023-10-08T13:00:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e47fff700 1 -- 172.21.15.59:0/318387509 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 20) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7e540991f0 con 0x55802ce527a0 2023-10-08T13:00:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e826dfb80 10 client.28249 fetch_fsmap finished waiting for FSMap version 20 2023-10-08T13:00:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e826dfb80 10 client.28249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T13:00:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e826dfb80 20 client.28249 populate_metadata read hostname 'smithi059' 2023-10-08T13:00:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.806+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55802cec1a00 0x55802cec3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.807+0000 7f7e826dfb80 4 client.28249 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:00:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.807+0000 7f7e826dfb80 1 -- 172.21.15.59:0/318387509 --> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55802cd9eb30 con 0x55802cec1a00 2023-10-08T13:00:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.807+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55802cec1a00 0x55802cec3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.807+0000 7f7e6cb9b700 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55802cec1a00 0x55802cec3df0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82757421d063078b server_cookie=3eb52675d30c43bb in_seq=0 out_seq=0 2023-10-08T13:00:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.807+0000 7f7e47fff700 10 client.28249 ms_handle_connect on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e47fff700 1 -- 172.21.15.59:0/318387509 <== mds.0 v2:172.21.15.92:6838/2979385377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55802cd9eb30 con 0x55802cec1a00 2023-10-08T13:00:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e47fff700 10 client.28249 handle_command_reply: tid=0 2023-10-08T13:00:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 1 client.28249 shutdown 2023-10-08T13:00:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 1 -- 172.21.15.59:0/318387509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 msgr2=0x55802ce628b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 0x55802ce628b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7e54096790 tx=0x7f7e5409a610 comp rx=0 tx=0).stop 2023-10-08T13:00:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 1 -- 172.21.15.59:0/318387509 shutdown_connections 2023-10-08T13:00:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.92:6838/2979385377,v1:172.21.15.92:6839/2979385377] conn(0x55802cec1a00 0x55802cec3df0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55802ce51e80 0x55802ce62370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55802ce5d650 0x55802cebfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e47fff700 0 client.28249 ms_handle_reset on v2:172.21.15.92:6838/2979385377 2023-10-08T13:00:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 1 --2- 172.21.15.59:0/318387509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55802ce527a0 0x55802ce628b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 1 -- 172.21.15.59:0/318387509 >> 172.21.15.59:0/318387509 conn(0x55802cdc7260 msgr2=0x55802ce55750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 1 -- 172.21.15.59:0/318387509 shutdown_connections 2023-10-08T13:00:33.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 1 -- 172.21.15.59:0/318387509 wait complete. 2023-10-08T13:00:33.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.808+0000 7f7e826dfb80 20 client.28249 trim_cache size 0 max 16384 2023-10-08T13:00:33.819 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2023-10-08T13:00:33.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 -- 172.21.15.59:0/498768386 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e580a15f0 msgr2=0x7f7e580a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e580a15f0 0x7f7e580a3ab0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009790 tx=0x7f7e60009130 comp rx=0 tx=0).stop 2023-10-08T13:00:33.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 -- 172.21.15.59:0/498768386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e681010f0 msgr2=0x7f7e68199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e681010f0 0x7f7e68199330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400e9a0 tx=0x7f7e5400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 -- 172.21.15.59:0/498768386 shutdown_connections 2023-10-08T13:00:33.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f7e580a15f0 0x7f7e580a3ab0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e68100730 0x7f7e68198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e68106740 0x7f7e6819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 --2- 172.21.15.59:0/498768386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e681010f0 0x7f7e68199330 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 -- 172.21.15.59:0/498768386 >> 172.21.15.59:0/498768386 conn(0x7f7e680fc200 msgr2=0x7f7e680fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 -- 172.21.15.59:0/498768386 shutdown_connections 2023-10-08T13:00:33.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:33.809+0000 7f7e6edff700 1 -- 172.21.15.59:0/498768386 wait complete. 2023-10-08T13:00:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:34 smithi173 ceph-mon[135182]: pgmap v921: 97 pgs: 97 active+clean; 958 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 4.0 MiB/s wr, 136 op/s 2023-10-08T13:00:34.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:34 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1208335447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:00:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:34 smithi059 ceph-mon[98489]: pgmap v921: 97 pgs: 97 active+clean; 958 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 4.0 MiB/s wr, 136 op/s 2023-10-08T13:00:34.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:34 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1208335447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:00:34.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:34 smithi092 ceph-mon[134093]: pgmap v921: 97 pgs: 97 active+clean; 958 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 4.0 MiB/s wr, 136 op/s 2023-10-08T13:00:34.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:34 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1208335447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:00:34.829 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2023-10-08T13:00:34.830 INFO:tasks.fwd_scrub:done joining 2023-10-08T13:00:34.830 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-08T13:00:34.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:00:35.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.056+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/1656056138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e08106640 msgr2=0x7f6e08106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.056+0000 7f6e0f5ff700 1 --2- 172.21.15.59:0/1656056138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e08106640 0x7f6e08106a20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009990 tx=0x7f6e04009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.056+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/1656056138 shutdown_connections 2023-10-08T13:00:35.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.056+0000 7f6e0f5ff700 1 --2- 172.21.15.59:0/1656056138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e08100ff0 0x7f6e0810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.056+0000 7f6e0f5ff700 1 --2- 172.21.15.59:0/1656056138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e08106640 0x7f6e08106a20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.056+0000 7f6e0f5ff700 1 --2- 172.21.15.59:0/1656056138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e08100630 0x7f6e08100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.056+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/1656056138 >> 172.21.15.59:0/1656056138 conn(0x7f6e080fc140 msgr2=0x7f6e080fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:35.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.056+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/1656056138 shutdown_connections 2023-10-08T13:00:35.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.056+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/1656056138 wait complete. 2023-10-08T13:00:35.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.057+0000 7f6e0f5ff700 1 Processor -- start 2023-10-08T13:00:35.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.057+0000 7f6e0f5ff700 1 -- start start 2023-10-08T13:00:35.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0f5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e08100630 0x7f6e0819ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0f5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e08100ff0 0x7f6e0819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0f5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e08106640 0x7f6e08198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0f5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e08199290 con 0x7f6e08106640 2023-10-08T13:00:35.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0f5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e08199400 con 0x7f6e08100ff0 2023-10-08T13:00:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0f5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e081995c0 con 0x7f6e08100630 2023-10-08T13:00:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0db9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e08106640 0x7f6e08198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0db9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e08106640 0x7f6e08198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35848/0 (socket says 172.21.15.59:35848) 2023-10-08T13:00:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0db9c700 1 -- 172.21.15.59:0/3134760151 learned_addr learned my addr 172.21.15.59:0/3134760151 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0d39b700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e08100630 0x7f6e0819ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0cb9a700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e08100ff0 0x7f6e0819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0db9c700 1 -- 172.21.15.59:0/3134760151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e08100630 msgr2=0x7f6e0819ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0db9c700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e08100630 0x7f6e0819ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0db9c700 1 -- 172.21.15.59:0/3134760151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e08100ff0 msgr2=0x7f6e0819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0db9c700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e08100ff0 0x7f6e0819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.058+0000 7f6e0db9c700 1 -- 172.21.15.59:0/3134760151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e040095f0 con 0x7f6e08106640 2023-10-08T13:00:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.059+0000 7f6e0db9c700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e08106640 0x7f6e08198ac0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6e00007ee0 tx=0x7f6e0000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.059+0000 7f6dfe7fc700 1 -- 172.21.15.59:0/3134760151 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000dd20 con 0x7f6e08106640 2023-10-08T13:00:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.059+0000 7f6dfe7fc700 1 -- 172.21.15.59:0/3134760151 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e0000f040 con 0x7f6e08106640 2023-10-08T13:00:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.059+0000 7f6dfe7fc700 1 -- 172.21.15.59:0/3134760151 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e000048a0 con 0x7f6e08106640 2023-10-08T13:00:35.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.059+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/3134760151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e081998a0 con 0x7f6e08106640 2023-10-08T13:00:35.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.059+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/3134760151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e081a59a0 con 0x7f6e08106640 2023-10-08T13:00:35.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.060+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/3134760151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e08101d70 con 0x7f6e08106640 2023-10-08T13:00:35.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.062+0000 7f6dfe7fc700 1 -- 172.21.15.59:0/3134760151 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6e00003a00 con 0x7f6e08106640 2023-10-08T13:00:35.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.063+0000 7f6dfe7fc700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6df40a1670 0x7f6df40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.064+0000 7f6dfe7fc700 1 -- 172.21.15.59:0/3134760151 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f6e000cc890 con 0x7f6e08106640 2023-10-08T13:00:35.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.064+0000 7f6e0d39b700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6df40a1670 0x7f6df40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.064+0000 7f6e0d39b700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6df40a1670 0x7f6df40a3b30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6e040098e0 tx=0x7f6e04005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:35.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.068+0000 7f6dfe7fc700 1 -- 172.21.15.59:0/3134760151 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6e0004f100 con 0x7f6e08106640 2023-10-08T13:00:35.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.279+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/3134760151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e08110520 con 0x7f6e08106640 2023-10-08T13:00:35.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.280+0000 7f6dfe7fc700 1 -- 172.21.15.59:0/3134760151 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+22819 (secure 0 0 0) 0x7f6e00095ba0 con 0x7f6e08106640 2023-10-08T13:00:35.282 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T13:00:35.282 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":112,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T13:00:14.016519+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":111,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":20,"length":1},{"begin":33,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:00:35.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/3134760151 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6df40a1670 msgr2=0x7f6df40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6df40a1670 0x7f6df40a3b30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6e040098e0 tx=0x7f6e04005960 comp rx=0 tx=0).stop 2023-10-08T13:00:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/3134760151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e08106640 msgr2=0x7f6e08198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e08106640 0x7f6e08198ac0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6e00007ee0 tx=0x7f6e0000d3b0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/3134760151 shutdown_connections 2023-10-08T13:00:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6df40a1670 0x7f6df40a3b30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e08106640 0x7f6e08198ac0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e08100630 0x7f6e0819ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 --2- 172.21.15.59:0/3134760151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e08100ff0 0x7f6e0819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/3134760151 >> 172.21.15.59:0/3134760151 conn(0x7f6e080fc140 msgr2=0x7f6e0810be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:35.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/3134760151 shutdown_connections 2023-10-08T13:00:35.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.283+0000 7f6e0f5ff700 1 -- 172.21.15.59:0/3134760151 wait complete. 2023-10-08T13:00:35.304 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:39:12.134451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:39:13.186137+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 111, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T13:00:35.305 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:00:35.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.512+0000 7fbbb7dff700 1 -- 172.21.15.59:0/3753411285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0101100 msgr2=0x7fbbb010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.512+0000 7fbbb7dff700 1 --2- 172.21.15.59:0/3753411285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0101100 0x7fbbb010d610 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009f90 tx=0x7fbba800b330 comp rx=0 tx=0).stop 2023-10-08T13:00:35.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.512+0000 7fbbb7dff700 1 -- 172.21.15.59:0/3753411285 shutdown_connections 2023-10-08T13:00:35.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.512+0000 7fbbb7dff700 1 --2- 172.21.15.59:0/3753411285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbb0106750 0x7fbbb0106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.513+0000 7fbbb7dff700 1 --2- 172.21.15.59:0/3753411285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0101100 0x7fbbb010d610 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.513+0000 7fbbb7dff700 1 --2- 172.21.15.59:0/3753411285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbb0100740 0x7fbbb0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.513+0000 7fbbb7dff700 1 -- 172.21.15.59:0/3753411285 >> 172.21.15.59:0/3753411285 conn(0x7fbbb00fc230 msgr2=0x7fbbb00fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:35.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.513+0000 7fbbb7dff700 1 -- 172.21.15.59:0/3753411285 shutdown_connections 2023-10-08T13:00:35.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.513+0000 7fbbb7dff700 1 -- 172.21.15.59:0/3753411285 wait complete. 2023-10-08T13:00:35.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb7dff700 1 Processor -- start 2023-10-08T13:00:35.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb7dff700 1 -- start start 2023-10-08T13:00:35.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb7dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbb0100740 0x7fbbb0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb7dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0101100 0x7fbbb0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb7dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbb0106750 0x7fbbb0073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb7dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb01a4f70 con 0x7fbbb0101100 2023-10-08T13:00:35.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb7dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb01a50e0 con 0x7fbbb0100740 2023-10-08T13:00:35.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb7dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb01a52a0 con 0x7fbbb0106750 2023-10-08T13:00:35.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb539a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0101100 0x7fbbb0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb5b9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbb0100740 0x7fbbb0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb539a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0101100 0x7fbbb0073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35872/0 (socket says 172.21.15.59:35872) 2023-10-08T13:00:35.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb539a700 1 -- 172.21.15.59:0/1668262932 learned_addr learned my addr 172.21.15.59:0/1668262932 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:35.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.514+0000 7fbbb639c700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbb0106750 0x7fbbb0073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.515+0000 7fbbb5b9b700 1 -- 172.21.15.59:0/1668262932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbb0106750 msgr2=0x7fbbb0073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.515+0000 7fbbb5b9b700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbb0106750 0x7fbbb0073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.515+0000 7fbbb5b9b700 1 -- 172.21.15.59:0/1668262932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0101100 msgr2=0x7fbbb0073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.515+0000 7fbbb5b9b700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0101100 0x7fbbb0073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.515+0000 7fbbb5b9b700 1 -- 172.21.15.59:0/1668262932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8009c40 con 0x7fbbb0100740 2023-10-08T13:00:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.515+0000 7fbbb539a700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0101100 0x7fbbb0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:00:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.515+0000 7fbbb5b9b700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbb0100740 0x7fbbb0072af0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00d750 tx=0x7fbbac00da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.515+0000 7fbba6ffd700 1 -- 172.21.15.59:0/1668262932 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac004020 con 0x7fbbb0100740 2023-10-08T13:00:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.515+0000 7fbba6ffd700 1 -- 172.21.15.59:0/1668262932 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbac004830 con 0x7fbbb0100740 2023-10-08T13:00:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.515+0000 7fbba6ffd700 1 -- 172.21.15.59:0/1668262932 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0054c0 con 0x7fbbb0100740 2023-10-08T13:00:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.515+0000 7fbbb7dff700 1 -- 172.21.15.59:0/1668262932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb01a5580 con 0x7fbbb0100740 2023-10-08T13:00:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.516+0000 7fbbb7dff700 1 -- 172.21.15.59:0/1668262932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb01a5a90 con 0x7fbbb0100740 2023-10-08T13:00:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.516+0000 7fbbb7dff700 1 -- 172.21.15.59:0/1668262932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb0108d60 con 0x7fbbb0100740 2023-10-08T13:00:35.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.519+0000 7fbba6ffd700 1 -- 172.21.15.59:0/1668262932 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbbac0049a0 con 0x7fbbb0100740 2023-10-08T13:00:35.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.520+0000 7fbba6ffd700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb9c0a1670 0x7fbb9c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.520+0000 7fbba6ffd700 1 -- 172.21.15.59:0/1668262932 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fbbac0cc920 con 0x7fbbb0100740 2023-10-08T13:00:35.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.520+0000 7fbbb539a700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb9c0a1670 0x7fbb9c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.521+0000 7fbbb539a700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb9c0a1670 0x7fbb9c0a3b30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0074220 tx=0x7fbba0009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:35.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.522+0000 7fbba6ffd700 1 -- 172.21.15.59:0/1668262932 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbbac095c30 con 0x7fbbb0100740 2023-10-08T13:00:35.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.732+0000 7fbbb7dff700 1 -- 172.21.15.59:0/1668262932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbb0073fd0 con 0x7fbbb0100740 2023-10-08T13:00:35.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.733+0000 7fbba6ffd700 1 -- 172.21.15.59:0/1668262932 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v112) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbac0140a0 con 0x7fbbb0100740 2023-10-08T13:00:35.734 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T13:00:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 -- 172.21.15.59:0/1668262932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb9c0a1670 msgr2=0x7fbb9c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb9c0a1670 0x7fbb9c0a3b30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0074220 tx=0x7fbba0009310 comp rx=0 tx=0).stop 2023-10-08T13:00:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 -- 172.21.15.59:0/1668262932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbb0100740 msgr2=0x7fbbb0072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbb0100740 0x7fbbb0072af0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00d750 tx=0x7fbbac00da60 comp rx=0 tx=0).stop 2023-10-08T13:00:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 -- 172.21.15.59:0/1668262932 shutdown_connections 2023-10-08T13:00:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fbb9c0a1670 0x7fbb9c0a3b30 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbb0100740 0x7fbbb0072af0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbb0106750 0x7fbbb0073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 --2- 172.21.15.59:0/1668262932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0101100 0x7fbbb0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 -- 172.21.15.59:0/1668262932 >> 172.21.15.59:0/1668262932 conn(0x7fbbb00fc230 msgr2=0x7fbbb00fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:35.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 -- 172.21.15.59:0/1668262932 shutdown_connections 2023-10-08T13:00:35.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.735+0000 7fbbb7dff700 1 -- 172.21.15.59:0/1668262932 wait complete. 2023-10-08T13:00:35.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:00:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.962+0000 7f8b711ff700 1 -- 172.21.15.59:0/982130627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b6c101100 msgr2=0x7f8b6c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.962+0000 7f8b711ff700 1 --2- 172.21.15.59:0/982130627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b6c101100 0x7f8b6c10d610 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400b0a0 tx=0x7f8b6400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.962+0000 7f8b711ff700 1 -- 172.21.15.59:0/982130627 shutdown_connections 2023-10-08T13:00:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.962+0000 7f8b711ff700 1 --2- 172.21.15.59:0/982130627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b6c106750 0x7f8b6c106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.962+0000 7f8b711ff700 1 --2- 172.21.15.59:0/982130627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b6c101100 0x7f8b6c10d610 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.962+0000 7f8b711ff700 1 --2- 172.21.15.59:0/982130627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c100740 0x7f8b6c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.962+0000 7f8b711ff700 1 -- 172.21.15.59:0/982130627 >> 172.21.15.59:0/982130627 conn(0x7f8b6c0fc230 msgr2=0x7f8b6c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.962+0000 7f8b711ff700 1 -- 172.21.15.59:0/982130627 shutdown_connections 2023-10-08T13:00:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.962+0000 7f8b711ff700 1 -- 172.21.15.59:0/982130627 wait complete. 2023-10-08T13:00:35.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.964+0000 7f8b711ff700 1 Processor -- start 2023-10-08T13:00:35.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.964+0000 7f8b711ff700 1 -- start start 2023-10-08T13:00:35.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.964+0000 7f8b711ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b6c100740 0x7f8b6c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.964+0000 7f8b711ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c101100 0x7f8b6c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b711ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b6c106750 0x7f8b6c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b711ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c1a4f90 con 0x7f8b6c100740 2023-10-08T13:00:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b711ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c1a5100 con 0x7f8b6c106750 2023-10-08T13:00:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b711ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c1a52c0 con 0x7f8b6c101100 2023-10-08T13:00:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b6ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b6c100740 0x7f8b6c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b6ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b6c100740 0x7f8b6c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35894/0 (socket says 172.21.15.59:35894) 2023-10-08T13:00:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b6ad9d700 1 -- 172.21.15.59:0/1208405686 learned_addr learned my addr 172.21.15.59:0/1208405686 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b6a59c700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c101100 0x7f8b6c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b6b59e700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b6c106750 0x7f8b6c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b6ad9d700 1 -- 172.21.15.59:0/1208405686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c101100 msgr2=0x7f8b6c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b6ad9d700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c101100 0x7f8b6c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b6ad9d700 1 -- 172.21.15.59:0/1208405686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b6c106750 msgr2=0x7f8b6c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:35.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b6ad9d700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b6c106750 0x7f8b6c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:35.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b6ad9d700 1 -- 172.21.15.59:0/1208405686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b64009d00 con 0x7f8b6c100740 2023-10-08T13:00:35.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.965+0000 7f8b6ad9d700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b6c100740 0x7f8b6c072af0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00e9a0 tx=0x7f8b5c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:35.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.966+0000 7f8b53fff700 1 -- 172.21.15.59:0/1208405686 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c009790 con 0x7f8b6c100740 2023-10-08T13:00:35.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.966+0000 7f8b53fff700 1 -- 172.21.15.59:0/1208405686 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b5c00cbd0 con 0x7f8b6c100740 2023-10-08T13:00:35.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.966+0000 7f8b53fff700 1 -- 172.21.15.59:0/1208405686 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c018680 con 0x7f8b6c100740 2023-10-08T13:00:35.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.966+0000 7f8b711ff700 1 -- 172.21.15.59:0/1208405686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6c1a55a0 con 0x7f8b6c100740 2023-10-08T13:00:35.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.966+0000 7f8b711ff700 1 -- 172.21.15.59:0/1208405686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6c1a5a30 con 0x7f8b6c100740 2023-10-08T13:00:35.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.967+0000 7f8b711ff700 1 -- 172.21.15.59:0/1208405686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6c108d40 con 0x7f8b6c100740 2023-10-08T13:00:35.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.969+0000 7f8b53fff700 1 -- 172.21.15.59:0/1208405686 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8b5c00cd40 con 0x7f8b6c100740 2023-10-08T13:00:35.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.970+0000 7f8b53fff700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8b540a15f0 0x7f8b540a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:35.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.970+0000 7f8b53fff700 1 -- 172.21.15.59:0/1208405686 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f8b5c014070 con 0x7f8b6c100740 2023-10-08T13:00:35.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.970+0000 7f8b6a59c700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8b540a15f0 0x7f8b540a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.971+0000 7f8b6a59c700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8b540a15f0 0x7f8b540a3ab0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c074220 tx=0x7f8b60009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:35.972+0000 7f8b53fff700 1 -- 172.21.15.59:0/1208405686 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8b5c096910 con 0x7f8b6c100740 2023-10-08T13:00:36.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.236+0000 7f8b711ff700 1 -- 172.21.15.59:0/1208405686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b6c073fd0 con 0x7f8b6c100740 2023-10-08T13:00:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.236+0000 7f8b53fff700 1 -- 172.21.15.59:0/1208405686 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b5c099f30 con 0x7f8b6c100740 2023-10-08T13:00:36.238 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-08T13:00:36.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 -- 172.21.15.59:0/1208405686 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8b540a15f0 msgr2=0x7f8b540a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8b540a15f0 0x7f8b540a3ab0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c074220 tx=0x7f8b60009260 comp rx=0 tx=0).stop 2023-10-08T13:00:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 -- 172.21.15.59:0/1208405686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b6c100740 msgr2=0x7f8b6c072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b6c100740 0x7f8b6c072af0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00e9a0 tx=0x7f8b5c00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 -- 172.21.15.59:0/1208405686 shutdown_connections 2023-10-08T13:00:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f8b540a15f0 0x7f8b540a3ab0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b6c106750 0x7f8b6c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b6c100740 0x7f8b6c072af0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 --2- 172.21.15.59:0/1208405686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c101100 0x7f8b6c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 -- 172.21.15.59:0/1208405686 >> 172.21.15.59:0/1208405686 conn(0x7f8b6c0fc230 msgr2=0x7f8b6c0fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:36.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 -- 172.21.15.59:0/1208405686 shutdown_connections 2023-10-08T13:00:36.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.239+0000 7f8b711ff700 1 -- 172.21.15.59:0/1208405686 wait complete. 2023-10-08T13:00:36.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:00:36.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.465+0000 7f33ed5ff700 1 -- 172.21.15.59:0/4038914315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e8106740 msgr2=0x7f33e8106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:36.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.466+0000 7f33ed5ff700 1 --2- 172.21.15.59:0/4038914315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e8106740 0x7f33e8106b20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009990 tx=0x7f33d8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.466+0000 7f33ed5ff700 1 -- 172.21.15.59:0/4038914315 shutdown_connections 2023-10-08T13:00:36.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.466+0000 7f33ed5ff700 1 --2- 172.21.15.59:0/4038914315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33e81010f0 0x7f33e810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.466+0000 7f33ed5ff700 1 --2- 172.21.15.59:0/4038914315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e8106740 0x7f33e8106b20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.466+0000 7f33ed5ff700 1 --2- 172.21.15.59:0/4038914315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33e8100730 0x7f33e8100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.466+0000 7f33ed5ff700 1 -- 172.21.15.59:0/4038914315 >> 172.21.15.59:0/4038914315 conn(0x7f33e80fc200 msgr2=0x7f33e80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:36.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.466+0000 7f33ed5ff700 1 -- 172.21.15.59:0/4038914315 shutdown_connections 2023-10-08T13:00:36.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.466+0000 7f33ed5ff700 1 -- 172.21.15.59:0/4038914315 wait complete. 2023-10-08T13:00:36.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.467+0000 7f33ed5ff700 1 Processor -- start 2023-10-08T13:00:36.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.467+0000 7f33ed5ff700 1 -- start start 2023-10-08T13:00:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.467+0000 7f33ed5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33e8100730 0x7f33e819ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.467+0000 7f33ed5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33e81010f0 0x7f33e819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.467+0000 7f33ed5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e8106740 0x7f33e8198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.467+0000 7f33ed5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e81991f0 con 0x7f33e8106740 2023-10-08T13:00:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.467+0000 7f33ed5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8199360 con 0x7f33e8100730 2023-10-08T13:00:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.467+0000 7f33ed5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8199520 con 0x7f33e81010f0 2023-10-08T13:00:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e8106740 0x7f33e8198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:36.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33e8100730 0x7f33e819ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:36.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33e8100730 0x7f33e819ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:48476/0 (socket says 172.21.15.59:48476) 2023-10-08T13:00:36.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e8106740 0x7f33e8198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35920/0 (socket says 172.21.15.59:35920) 2023-10-08T13:00:36.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e6ffd700 1 -- 172.21.15.59:0/79222727 learned_addr learned my addr 172.21.15.59:0/79222727 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:36.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e67fc700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33e81010f0 0x7f33e819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:36.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e6ffd700 1 -- 172.21.15.59:0/79222727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33e81010f0 msgr2=0x7f33e819efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:36.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e6ffd700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33e81010f0 0x7f33e819efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e6ffd700 1 -- 172.21.15.59:0/79222727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e8106740 msgr2=0x7f33e8198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:36.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e6ffd700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e8106740 0x7f33e8198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e6ffd700 1 -- 172.21.15.59:0/79222727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80095f0 con 0x7f33e8100730 2023-10-08T13:00:36.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e77fe700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e8106740 0x7f33e8198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:00:36.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.468+0000 7f33e6ffd700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33e8100730 0x7f33e819ea60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f33d8000c00 tx=0x7f33d8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:36.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.469+0000 7f33cffff700 1 -- 172.21.15.59:0/79222727 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d801d070 con 0x7f33e8100730 2023-10-08T13:00:36.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.469+0000 7f33cffff700 1 -- 172.21.15.59:0/79222727 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33d8022470 con 0x7f33e8100730 2023-10-08T13:00:36.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.469+0000 7f33ed5ff700 1 -- 172.21.15.59:0/79222727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e81997a0 con 0x7f33e8100730 2023-10-08T13:00:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.469+0000 7f33cffff700 1 -- 172.21.15.59:0/79222727 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8017650 con 0x7f33e8100730 2023-10-08T13:00:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.469+0000 7f33ed5ff700 1 -- 172.21.15.59:0/79222727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e81a5a50 con 0x7f33e8100730 2023-10-08T13:00:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.470+0000 7f33ed5ff700 1 -- 172.21.15.59:0/79222727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e8101e70 con 0x7f33e8100730 2023-10-08T13:00:36.478 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:36 smithi173 ceph-mon[135182]: pgmap v922: 97 pgs: 97 active+clean; 958 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 2.9 MiB/s wr, 112 op/s 2023-10-08T13:00:36.478 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:36 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3134760151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:00:36.478 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:36 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1668262932' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:00:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.472+0000 7f33cffff700 1 -- 172.21.15.59:0/79222727 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f33d80225e0 con 0x7f33e8100730 2023-10-08T13:00:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.473+0000 7f33cffff700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f33d00a1670 0x7f33d00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.473+0000 7f33cffff700 1 -- 172.21.15.59:0/79222727 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f33d80ce320 con 0x7f33e8100730 2023-10-08T13:00:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.473+0000 7f33e67fc700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f33d00a1670 0x7f33d00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.474+0000 7f33e67fc700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f33d00a1670 0x7f33d00a3b30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f33e819a230 tx=0x7f33dc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.475+0000 7f33cffff700 1 -- 172.21.15.59:0/79222727 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f33d8097740 con 0x7f33e8100730 2023-10-08T13:00:36.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:36 smithi059 ceph-mon[98489]: pgmap v922: 97 pgs: 97 active+clean; 958 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 2.9 MiB/s wr, 112 op/s 2023-10-08T13:00:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:36 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3134760151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:00:36.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:36 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1668262932' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:00:36.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:36 smithi092 ceph-mon[134093]: pgmap v922: 97 pgs: 97 active+clean; 958 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 2.9 MiB/s wr, 112 op/s 2023-10-08T13:00:36.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:36 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3134760151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:00:36.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:36 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1668262932' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:00:36.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.689+0000 7f33ed5ff700 1 -- 172.21.15.59:0/79222727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f33e8199fe0 con 0x7f33e8100730 2023-10-08T13:00:36.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.690+0000 7f33cffff700 1 -- 172.21.15.59:0/79222727 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+11 (secure 0 0 0) 0x7f33d809ad60 con 0x7f33e8100730 2023-10-08T13:00:36.691 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-08T13:00:36.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.692+0000 7f33ed5ff700 1 -- 172.21.15.59:0/79222727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f33d00a1670 msgr2=0x7f33d00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:36.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.692+0000 7f33ed5ff700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f33d00a1670 0x7f33d00a3b30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f33e819a230 tx=0x7f33dc009260 comp rx=0 tx=0).stop 2023-10-08T13:00:36.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.692+0000 7f33ed5ff700 1 -- 172.21.15.59:0/79222727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33e8100730 msgr2=0x7f33e819ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:36.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.692+0000 7f33ed5ff700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33e8100730 0x7f33e819ea60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f33d8000c00 tx=0x7f33d8004730 comp rx=0 tx=0).stop 2023-10-08T13:00:36.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.692+0000 7f33ed5ff700 1 -- 172.21.15.59:0/79222727 shutdown_connections 2023-10-08T13:00:36.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.692+0000 7f33ed5ff700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f33d00a1670 0x7f33d00a3b30 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.692+0000 7f33ed5ff700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33e8100730 0x7f33e819ea60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.692+0000 7f33ed5ff700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e8106740 0x7f33e8198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.692+0000 7f33ed5ff700 1 --2- 172.21.15.59:0/79222727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33e81010f0 0x7f33e819efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.692+0000 7f33ed5ff700 1 -- 172.21.15.59:0/79222727 >> 172.21.15.59:0/79222727 conn(0x7f33e80fc200 msgr2=0x7f33e80fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:36.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.692+0000 7f33ed5ff700 1 -- 172.21.15.59:0/79222727 shutdown_connections 2023-10-08T13:00:36.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.693+0000 7f33ed5ff700 1 -- 172.21.15.59:0/79222727 wait complete. 2023-10-08T13:00:36.712 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-08T13:00:36.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.915+0000 7ff83f3ff700 1 -- 172.21.15.59:0/4081741838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff838106640 msgr2=0x7ff838106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:36.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.915+0000 7ff83f3ff700 1 --2- 172.21.15.59:0/4081741838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff838106640 0x7ff838106a20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff834009990 tx=0x7ff834009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.915+0000 7ff83f3ff700 1 -- 172.21.15.59:0/4081741838 shutdown_connections 2023-10-08T13:00:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.915+0000 7ff83f3ff700 1 --2- 172.21.15.59:0/4081741838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838100ff0 0x7ff83810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.915+0000 7ff83f3ff700 1 --2- 172.21.15.59:0/4081741838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff838106640 0x7ff838106a20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.915+0000 7ff83f3ff700 1 --2- 172.21.15.59:0/4081741838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff838100630 0x7ff838100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.915+0000 7ff83f3ff700 1 -- 172.21.15.59:0/4081741838 >> 172.21.15.59:0/4081741838 conn(0x7ff8380fc1a0 msgr2=0x7ff8380fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.916+0000 7ff83f3ff700 1 -- 172.21.15.59:0/4081741838 shutdown_connections 2023-10-08T13:00:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.916+0000 7ff83f3ff700 1 -- 172.21.15.59:0/4081741838 wait complete. 2023-10-08T13:00:36.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83f3ff700 1 Processor -- start 2023-10-08T13:00:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83f3ff700 1 -- start start 2023-10-08T13:00:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83f3ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff838100630 0x7ff83819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83f3ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff838100ff0 0x7ff83819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83f3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838106640 0x7ff838198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83f3ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838199100 con 0x7ff838100ff0 2023-10-08T13:00:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83f3ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838199270 con 0x7ff838100630 2023-10-08T13:00:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83f3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838199430 con 0x7ff838106640 2023-10-08T13:00:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83c99a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff838100ff0 0x7ff83819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83c99a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff838100ff0 0x7ff83819eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35944/0 (socket says 172.21.15.59:35944) 2023-10-08T13:00:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83c99a700 1 -- 172.21.15.59:0/3332192942 learned_addr learned my addr 172.21.15.59:0/3332192942 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:00:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.917+0000 7ff83d19b700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff838100630 0x7ff83819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff83d99c700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838106640 0x7ff838198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff83c99a700 1 -- 172.21.15.59:0/3332192942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838106640 msgr2=0x7ff838198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff83c99a700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838106640 0x7ff838198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff83c99a700 1 -- 172.21.15.59:0/3332192942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff838100630 msgr2=0x7ff83819e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff83c99a700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff838100630 0x7ff83819e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff83c99a700 1 -- 172.21.15.59:0/3332192942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8340095f0 con 0x7ff838100ff0 2023-10-08T13:00:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff83d99c700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838106640 0x7ff838198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:00:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff83c99a700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff838100ff0 0x7ff83819eeb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff82800e9a0 tx=0x7ff82800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff82e7fc700 1 -- 172.21.15.59:0/3332192942 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828009790 con 0x7ff838100ff0 2023-10-08T13:00:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff82e7fc700 1 -- 172.21.15.59:0/3332192942 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff82800cbd0 con 0x7ff838100ff0 2023-10-08T13:00:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff82e7fc700 1 -- 172.21.15.59:0/3332192942 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828018680 con 0x7ff838100ff0 2023-10-08T13:00:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff83f3ff700 1 -- 172.21.15.59:0/3332192942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff838199710 con 0x7ff838100ff0 2023-10-08T13:00:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.918+0000 7ff83f3ff700 1 -- 172.21.15.59:0/3332192942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8381a5960 con 0x7ff838100ff0 2023-10-08T13:00:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.919+0000 7ff83f3ff700 1 -- 172.21.15.59:0/3332192942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff838101d70 con 0x7ff838100ff0 2023-10-08T13:00:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.921+0000 7ff82e7fc700 1 -- 172.21.15.59:0/3332192942 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff82800cd40 con 0x7ff838100ff0 2023-10-08T13:00:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.923+0000 7ff82e7fc700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8240a1670 0x7ff8240a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.923+0000 7ff82e7fc700 1 -- 172.21.15.59:0/3332192942 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8441+0+0 (secure 0 0 0) 0x7ff828014070 con 0x7ff838100ff0 2023-10-08T13:00:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.923+0000 7ff83d19b700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8240a1670 0x7ff8240a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.924+0000 7ff83d19b700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8240a1670 0x7ff8240a3b30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff834006010 tx=0x7ff83400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:36.925+0000 7ff82e7fc700 1 -- 172.21.15.59:0/3332192942 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff828096960 con 0x7ff838100ff0 2023-10-08T13:00:37.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.199+0000 7ff83f3ff700 1 -- 172.21.15.59:0/3332192942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7ff838110610 con 0x7ff838100ff0 2023-10-08T13:00:37.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.211+0000 7ff82e7fc700 1 -- 172.21.15.59:0/3332192942 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) v1 ==== 81+0+734402 (secure 0 0 0) 0x7ff828099f80 con 0x7ff838100ff0 2023-10-08T13:00:37.223 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T13:00:37.223 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T13:00:37.224 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 24, 2023-10-08T13:00:37.224 INFO:teuthology.orchestra.run.smithi059.stdout: "active_gid": 14214, 2023-10-08T13:00:37.224 INFO:teuthology.orchestra.run.smithi059.stdout: "active_name": "x", 2023-10-08T13:00:37.224 INFO:teuthology.orchestra.run.smithi059.stdout: "active_addrs": { 2023-10-08T13:00:37.224 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-08T13:00:37.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.224 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2023-10-08T13:00:37.225 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2023-10-08T13:00:37.225 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 921332174 2023-10-08T13:00:37.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.225 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-08T13:00:37.226 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2023-10-08T13:00:37.226 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 921332174 2023-10-08T13:00:37.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.226 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T13:00:37.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.227 INFO:teuthology.orchestra.run.smithi059.stdout: "active_addr": "172.21.15.59:6801/921332174", 2023-10-08T13:00:37.227 INFO:teuthology.orchestra.run.smithi059.stdout: "active_change": "2023-10-08T12:33:10.699204+0000", 2023-10-08T13:00:37.227 INFO:teuthology.orchestra.run.smithi059.stdout: "active_mgr_features": 4540138322906710015, 2023-10-08T13:00:37.227 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2023-10-08T13:00:37.227 INFO:teuthology.orchestra.run.smithi059.stdout: "standbys": [ 2023-10-08T13:00:37.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.227 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 24166, 2023-10-08T13:00:37.228 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "z", 2023-10-08T13:00:37.228 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_features": 4540138322906710015, 2023-10-08T13:00:37.228 INFO:teuthology.orchestra.run.smithi059.stdout: "available_modules": [ 2023-10-08T13:00:37.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.228 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "alerts", 2023-10-08T13:00:37.228 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.228 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.228 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.229 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:37.229 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:37.229 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.229 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.229 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.229 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:37.229 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.230 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.230 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.230 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T13:00:37.230 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.230 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.230 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.230 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.231 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.231 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.231 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.231 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.231 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.231 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.231 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.232 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.232 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.232 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.232 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.232 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.232 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.232 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.233 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.233 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.233 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.233 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.233 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.233 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.233 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.234 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.234 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.234 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.234 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.234 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.234 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.234 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.235 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.235 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.235 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.235 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.235 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.235 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.235 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.236 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.236 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.236 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.236 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.236 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.236 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.236 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.237 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.237 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.237 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.237 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.237 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.237 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.237 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.237 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.238 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.238 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.238 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.238 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.238 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.238 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.239 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.239 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.239 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.239 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.239 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.239 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.239 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.239 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.240 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.240 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_destination": { 2023-10-08T13:00:37.240 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_destination", 2023-10-08T13:00:37.240 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.240 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.240 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.241 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.241 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.241 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.241 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.241 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email address to send alerts to", 2023-10-08T13:00:37.241 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.241 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.241 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.242 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_from_name": { 2023-10-08T13:00:37.242 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_from_name", 2023-10-08T13:00:37.242 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.242 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.242 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.242 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "Ceph", 2023-10-08T13:00:37.243 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.243 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.243 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.243 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email From: name", 2023-10-08T13:00:37.243 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.243 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.243 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.244 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_host": { 2023-10-08T13:00:37.244 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_host", 2023-10-08T13:00:37.244 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.244 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.244 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.244 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.244 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.245 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.245 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.245 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP server", 2023-10-08T13:00:37.245 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.245 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.245 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.245 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_password": { 2023-10-08T13:00:37.246 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_password", 2023-10-08T13:00:37.246 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.246 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.246 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.246 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.246 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.246 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.247 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.247 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Password to authenticate with", 2023-10-08T13:00:37.247 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.247 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.247 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.247 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_port": { 2023-10-08T13:00:37.247 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_port", 2023-10-08T13:00:37.248 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.248 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.248 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.248 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "465", 2023-10-08T13:00:37.248 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.248 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.248 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.249 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP port", 2023-10-08T13:00:37.249 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.249 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.249 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.249 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_sender": { 2023-10-08T13:00:37.249 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_sender", 2023-10-08T13:00:37.249 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.250 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.250 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.250 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.250 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.250 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.250 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.251 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP envelope sender", 2023-10-08T13:00:37.251 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.251 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.251 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.251 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_ssl": { 2023-10-08T13:00:37.252 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_ssl", 2023-10-08T13:00:37.252 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.252 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.252 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.252 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.252 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.252 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.253 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.253 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T13:00:37.253 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.253 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.253 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.253 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_user": { 2023-10-08T13:00:37.254 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_user", 2023-10-08T13:00:37.254 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.254 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.254 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.254 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.254 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.254 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.255 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.255 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "User to authenticate as", 2023-10-08T13:00:37.255 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.255 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.255 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.255 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.255 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.256 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "balancer", 2023-10-08T13:00:37.256 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.256 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.256 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.256 INFO:teuthology.orchestra.run.smithi059.stdout: "active": { 2023-10-08T13:00:37.256 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "active", 2023-10-08T13:00:37.257 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.257 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.257 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.257 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.257 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.257 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.257 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.257 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T13:00:37.258 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.258 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.258 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.258 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_time": { 2023-10-08T13:00:37.258 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_time", 2023-10-08T13:00:37.258 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.259 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.259 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.259 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0000", 2023-10-08T13:00:37.259 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.259 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.259 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.259 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T13:00:37.260 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:00:37.260 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.260 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.260 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_weekday": { 2023-10-08T13:00:37.260 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_weekday", 2023-10-08T13:00:37.260 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:37.260 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.261 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.261 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:37.261 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2023-10-08T13:00:37.261 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2023-10-08T13:00:37.261 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.261 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T13:00:37.261 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:00:37.261 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.262 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.262 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_max_iterations": { 2023-10-08T13:00:37.262 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_max_iterations", 2023-10-08T13:00:37.262 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:37.262 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.262 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.263 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "25", 2023-10-08T13:00:37.263 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:37.263 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "250", 2023-10-08T13:00:37.263 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.263 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T13:00:37.263 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.263 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.263 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.264 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_metrics": { 2023-10-08T13:00:37.264 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_metrics", 2023-10-08T13:00:37.264 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.264 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.264 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.264 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T13:00:37.265 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.265 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.265 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.265 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T13:00:37.265 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T13:00:37.265 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.265 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.266 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_step": { 2023-10-08T13:00:37.266 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_step", 2023-10-08T13:00:37.266 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:37.266 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.266 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.266 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.5", 2023-10-08T13:00:37.266 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0.001", 2023-10-08T13:00:37.267 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "0.999", 2023-10-08T13:00:37.267 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.267 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "aggressiveness of optimization", 2023-10-08T13:00:37.267 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T13:00:37.267 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.267 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.268 INFO:teuthology.orchestra.run.smithi059.stdout: "end_time": { 2023-10-08T13:00:37.268 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_time", 2023-10-08T13:00:37.268 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.268 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.268 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.268 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2359", 2023-10-08T13:00:37.268 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.268 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.269 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.269 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T13:00:37.269 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:00:37.269 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.269 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.269 INFO:teuthology.orchestra.run.smithi059.stdout: "end_weekday": { 2023-10-08T13:00:37.269 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_weekday", 2023-10-08T13:00:37.270 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:37.270 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.270 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.270 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:37.270 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2023-10-08T13:00:37.270 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2023-10-08T13:00:37.270 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.271 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T13:00:37.271 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:00:37.271 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.271 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.271 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.271 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.272 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.272 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.272 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.272 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.272 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.272 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.272 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.272 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.273 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.273 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.273 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.273 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.273 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.273 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.273 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.273 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.274 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.274 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.274 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.274 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.274 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.274 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.275 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.275 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.275 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.275 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.275 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.275 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.275 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.276 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.276 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.276 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.276 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.276 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.276 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.276 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.277 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.277 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.277 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.277 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.277 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.277 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.277 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.278 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.278 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.278 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.278 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.278 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.278 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.278 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.278 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.279 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.279 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.279 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.279 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.279 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.279 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.280 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.280 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.280 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.280 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.280 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.280 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.280 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.281 INFO:teuthology.orchestra.run.smithi059.stdout: "min_score": { 2023-10-08T13:00:37.281 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_score", 2023-10-08T13:00:37.281 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:37.281 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.281 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.281 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:37.281 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.281 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.282 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.282 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T13:00:37.282 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.282 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.282 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.282 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2023-10-08T13:00:37.283 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2023-10-08T13:00:37.283 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.283 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.283 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.283 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "upmap", 2023-10-08T13:00:37.283 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.283 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.283 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.284 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-compat", 2023-10-08T13:00:37.284 INFO:teuthology.orchestra.run.smithi059.stdout: "none", 2023-10-08T13:00:37.284 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap" 2023-10-08T13:00:37.284 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.284 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Balancer mode", 2023-10-08T13:00:37.284 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.284 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.284 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.285 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_ids": { 2023-10-08T13:00:37.285 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_ids", 2023-10-08T13:00:37.285 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.285 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.285 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.285 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T13:00:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T13:00:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_deviation": { 2023-10-08T13:00:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_deviation", 2023-10-08T13:00:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T13:00:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T13:00:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_optimizations": { 2023-10-08T13:00:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_optimizations", 2023-10-08T13:00:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T13:00:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm", 2023-10-08T13:00:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_down_multiplier": { 2023-10-08T13:00:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_down_multiplier", 2023-10-08T13:00:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2023-10-08T13:00:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T13:00:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_refresh_rate": { 2023-10-08T13:00:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_refresh_rate", 2023-10-08T13:00:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "20", 2023-10-08T13:00:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T13:00:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_starting_port": { 2023-10-08T13:00:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_starting_port", 2023-10-08T13:00:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4721", 2023-10-08T13:00:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T13:00:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_ptrace": { 2023-10-08T13:00:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_ptrace", 2023-10-08T13:00:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T13:00:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T13:00:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_interval": { 2023-10-08T13:00:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_interval", 2023-10-08T13:00:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T13:00:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_memory_target_ratio": { 2023-10-08T13:00:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T13:00:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.7", 2023-10-08T13:00:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T13:00:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm_log_destination": { 2023-10-08T13:00:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm_log_destination", 2023-10-08T13:00:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "file", 2023-10-08T13:00:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "file,syslog", 2023-10-08T13:00:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "syslog" 2023-10-08T13:00:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T13:00:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "cgroups_split": { 2023-10-08T13:00:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cgroups_split", 2023-10-08T13:00:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T13:00:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "config_checks_enabled": { 2023-10-08T13:00:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_checks_enabled", 2023-10-08T13:00:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T13:00:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "config_dashboard": { 2023-10-08T13:00:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_dashboard", 2023-10-08T13:00:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T13:00:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_alertmanager": { 2023-10-08T13:00:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_alertmanager", 2023-10-08T13:00:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T13:00:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_base": { 2023-10-08T13:00:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_base", 2023-10-08T13:00:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T13:00:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Container image name, without the tag", 2023-10-08T13:00:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_elasticsearch": { 2023-10-08T13:00:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_elasticsearch", 2023-10-08T13:00:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T13:00:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "elasticsearch container image", 2023-10-08T13:00:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_grafana": { 2023-10-08T13:00:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_grafana", 2023-10-08T13:00:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T13:00:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_haproxy": { 2023-10-08T13:00:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_haproxy", 2023-10-08T13:00:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T13:00:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "HAproxy container image", 2023-10-08T13:00:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_agent": { 2023-10-08T13:00:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_agent", 2023-10-08T13:00:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T13:00:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger agent container image", 2023-10-08T13:00:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_collector": { 2023-10-08T13:00:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_collector", 2023-10-08T13:00:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T13:00:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger collector container image", 2023-10-08T13:00:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_query": { 2023-10-08T13:00:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_query", 2023-10-08T13:00:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T13:00:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger query container image", 2023-10-08T13:00:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_keepalived": { 2023-10-08T13:00:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_keepalived", 2023-10-08T13:00:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T13:00:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Keepalived container image", 2023-10-08T13:00:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_loki": { 2023-10-08T13:00:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_loki", 2023-10-08T13:00:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T13:00:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Loki container image", 2023-10-08T13:00:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_node_exporter": { 2023-10-08T13:00:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_node_exporter", 2023-10-08T13:00:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T13:00:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nvmeof": { 2023-10-08T13:00:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nvmeof", 2023-10-08T13:00:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T13:00:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nvme-of container image", 2023-10-08T13:00:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_prometheus": { 2023-10-08T13:00:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_prometheus", 2023-10-08T13:00:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T13:00:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_promtail": { 2023-10-08T13:00:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_promtail", 2023-10-08T13:00:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T13:00:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Promtail container image", 2023-10-08T13:00:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_snmp_gateway": { 2023-10-08T13:00:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_snmp_gateway", 2023-10-08T13:00:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T13:00:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SNMP Gateway container image", 2023-10-08T13:00:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "container_init": { 2023-10-08T13:00:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_init", 2023-10-08T13:00:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T13:00:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "daemon_cache_timeout": { 2023-10-08T13:00:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "daemon_cache_timeout", 2023-10-08T13:00:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T13:00:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "default_cephadm_command_timeout": { 2023-10-08T13:00:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T13:00:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "900", 2023-10-08T13:00:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T13:00:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "default_registry": { 2023-10-08T13:00:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_registry", 2023-10-08T13:00:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io", 2023-10-08T13:00:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T13:00:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "device_cache_timeout": { 2023-10-08T13:00:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_cache_timeout", 2023-10-08T13:00:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1800", 2023-10-08T13:00:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache device inventory", 2023-10-08T13:00:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "device_enhanced_scan": { 2023-10-08T13:00:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_enhanced_scan", 2023-10-08T13:00:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T13:00:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "facts_cache_timeout": { 2023-10-08T13:00:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "facts_cache_timeout", 2023-10-08T13:00:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache host facts data", 2023-10-08T13:00:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "host_check_interval": { 2023-10-08T13:00:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "host_check_interval", 2023-10-08T13:00:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to perform a host check", 2023-10-08T13:00:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "inventory_list_all": { 2023-10-08T13:00:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "inventory_list_all", 2023-10-08T13:00:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T13:00:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "log_refresh_metadata": { 2023-10-08T13:00:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_refresh_metadata", 2023-10-08T13:00:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T13:00:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T13:00:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T13:00:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T13:00:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T13:00:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T13:00:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T13:00:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "*", 2023-10-08T13:00:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T13:00:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "max_count_per_host": { 2023-10-08T13:00:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_count_per_host", 2023-10-08T13:00:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of daemons per service per host", 2023-10-08T13:00:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd_draining_count": { 2023-10-08T13:00:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_osd_draining_count", 2023-10-08T13:00:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T13:00:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "migration_current": { 2023-10-08T13:00:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "migration_current", 2023-10-08T13:00:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "internal - do not modify", 2023-10-08T13:00:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2023-10-08T13:00:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2023-10-08T13:00:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "root", 2023-10-08T13:00:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm-package", 2023-10-08T13:00:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "root" 2023-10-08T13:00:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T13:00:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "prometheus_alerts_path": { 2023-10-08T13:00:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus_alerts_path", 2023-10-08T13:00:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T13:00:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.387 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.387 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.387 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T13:00:37.387 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.387 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.387 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.388 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_insecure": { 2023-10-08T13:00:37.388 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_insecure", 2023-10-08T13:00:37.388 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.388 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.388 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.388 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.388 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T13:00:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_password": { 2023-10-08T13:00:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_password", 2023-10-08T13:00:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T13:00:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_url": { 2023-10-08T13:00:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_url", 2023-10-08T13:00:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.393 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.393 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T13:00:37.393 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.393 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.393 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.393 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_username": { 2023-10-08T13:00:37.393 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_username", 2023-10-08T13:00:37.394 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.394 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.394 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.394 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.394 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.394 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.394 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.394 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T13:00:37.395 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.395 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.395 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.395 INFO:teuthology.orchestra.run.smithi059.stdout: "secure_monitoring_stack": { 2023-10-08T13:00:37.395 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secure_monitoring_stack", 2023-10-08T13:00:37.395 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.396 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.396 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.396 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.396 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.396 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.396 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.396 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T13:00:37.397 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.397 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.397 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.397 INFO:teuthology.orchestra.run.smithi059.stdout: "service_discovery_port": { 2023-10-08T13:00:37.397 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "service_discovery_port", 2023-10-08T13:00:37.397 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.398 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.398 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.398 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8765", 2023-10-08T13:00:37.398 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.398 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.398 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.398 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "cephadm service discovery port", 2023-10-08T13:00:37.399 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.399 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.399 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.399 INFO:teuthology.orchestra.run.smithi059.stdout: "ssh_config_file": { 2023-10-08T13:00:37.399 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssh_config_file", 2023-10-08T13:00:37.399 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.399 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.400 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.400 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.400 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.400 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.400 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.400 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T13:00:37.400 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.401 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.401 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.401 INFO:teuthology.orchestra.run.smithi059.stdout: "use_agent": { 2023-10-08T13:00:37.401 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_agent", 2023-10-08T13:00:37.401 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.401 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.401 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.403 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.403 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.403 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.403 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.403 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T13:00:37.404 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.404 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.404 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.404 INFO:teuthology.orchestra.run.smithi059.stdout: "use_repo_digest": { 2023-10-08T13:00:37.404 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_repo_digest", 2023-10-08T13:00:37.404 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.405 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.405 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.405 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.405 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.405 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.405 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.406 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T13:00:37.406 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.406 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.406 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.406 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_failed_host_check": { 2023-10-08T13:00:37.406 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_failed_host_check", 2023-10-08T13:00:37.407 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.407 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.407 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.407 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.407 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.407 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.407 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.408 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T13:00:37.408 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.408 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.408 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.409 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_daemons": { 2023-10-08T13:00:37.409 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_daemons", 2023-10-08T13:00:37.410 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.410 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.410 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.411 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.411 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.412 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.412 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.412 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T13:00:37.412 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.412 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.413 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.413 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_hosts": { 2023-10-08T13:00:37.413 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_hosts", 2023-10-08T13:00:37.413 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.413 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.413 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.414 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.414 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.414 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.414 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.414 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T13:00:37.414 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.414 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.415 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.415 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crash", 2023-10-08T13:00:37.415 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.416 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.416 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.416 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.416 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.416 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.416 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.416 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.417 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.417 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.417 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.417 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.417 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.417 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.417 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.418 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.418 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.418 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.418 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.418 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.418 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.419 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.419 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.419 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.419 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.419 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.419 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.420 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.420 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.420 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.420 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.420 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.420 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.420 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.421 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.421 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.421 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.421 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.421 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.421 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.422 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.422 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.422 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.422 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.422 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.422 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.422 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.423 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.423 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.423 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.423 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.423 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.423 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.423 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.424 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.424 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.424 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.424 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.424 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.424 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.424 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.425 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.425 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.425 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.425 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.425 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.425 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.426 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.426 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.426 INFO:teuthology.orchestra.run.smithi059.stdout: "retain_interval": { 2023-10-08T13:00:37.426 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retain_interval", 2023-10-08T13:00:37.426 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.426 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.426 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.427 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "31536000", 2023-10-08T13:00:37.427 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.427 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.427 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.427 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T13:00:37.427 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.427 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.427 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.428 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_recent_interval": { 2023-10-08T13:00:37.428 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_recent_interval", 2023-10-08T13:00:37.428 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.428 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.428 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.429 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1209600", 2023-10-08T13:00:37.429 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.429 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.429 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.429 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T13:00:37.429 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.429 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.430 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.430 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.430 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.430 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dashboard", 2023-10-08T13:00:37.430 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.431 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.431 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.431 INFO:teuthology.orchestra.run.smithi059.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T13:00:37.431 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T13:00:37.431 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.431 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.431 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.431 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:37.432 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.432 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.432 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.432 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.432 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.432 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.432 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.433 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T13:00:37.433 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T13:00:37.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.433 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.433 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.433 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.433 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.434 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.434 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.434 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.434 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.434 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.434 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.435 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T13:00:37.435 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T13:00:37.435 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.435 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.435 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.435 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.436 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.436 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.436 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.436 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.436 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.436 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.436 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.437 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_ENABLED": { 2023-10-08T13:00:37.437 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T13:00:37.437 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.437 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.437 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.437 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.438 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.438 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.438 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.438 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.438 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.438 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.438 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.439 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T13:00:37.439 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T13:00:37.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.439 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.439 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.440 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.440 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.440 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.440 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.440 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.440 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.440 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.441 INFO:teuthology.orchestra.run.smithi059.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T13:00:37.441 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T13:00:37.441 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.441 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.441 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.441 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.441 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.442 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.442 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.442 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.442 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.442 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.442 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.443 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T13:00:37.443 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T13:00:37.443 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.443 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.443 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.443 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.443 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.444 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.444 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.444 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.444 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.444 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.444 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.444 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T13:00:37.445 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T13:00:37.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.445 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.445 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.445 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.445 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.445 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.446 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.446 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.446 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.446 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.446 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.446 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T13:00:37.447 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T13:00:37.447 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.447 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.447 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.447 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.447 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.447 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.447 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.448 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.448 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.448 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.448 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.448 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T13:00:37.448 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T13:00:37.449 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.449 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.449 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.449 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.449 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.449 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.449 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.450 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.450 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.450 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.450 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.450 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T13:00:37.450 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T13:00:37.451 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.451 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.451 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.451 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.451 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.451 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.451 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.452 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.452 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.452 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.452 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.452 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T13:00:37.452 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T13:00:37.453 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.453 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.453 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.453 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.453 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.453 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.453 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.454 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.454 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.454 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.454 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.454 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T13:00:37.454 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T13:00:37.454 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.455 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.455 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.455 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.455 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.455 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.455 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.455 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.456 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.456 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.456 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.456 INFO:teuthology.orchestra.run.smithi059.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T13:00:37.456 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T13:00:37.456 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.457 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.457 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.457 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.457 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.457 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.457 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.457 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.457 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.458 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.458 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.458 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T13:00:37.458 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T13:00:37.458 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.458 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.459 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.459 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2023-10-08T13:00:37.459 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.459 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.459 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.459 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.459 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.460 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.460 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.460 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T13:00:37.460 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T13:00:37.460 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.460 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.461 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.461 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.461 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.461 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.461 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.461 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.461 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.461 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.462 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.462 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_URL": { 2023-10-08T13:00:37.462 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_URL", 2023-10-08T13:00:37.462 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.462 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.462 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.463 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.463 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.463 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.463 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.463 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.463 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.463 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.464 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.464 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T13:00:37.464 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T13:00:37.464 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.464 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.464 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.465 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2023-10-08T13:00:37.465 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.465 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.465 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.465 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.465 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.465 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.466 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.466 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T13:00:37.466 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T13:00:37.466 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.466 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.466 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.467 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.467 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.467 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.467 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.467 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.467 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.467 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.468 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.468 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T13:00:37.468 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T13:00:37.468 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.468 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.468 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.468 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.469 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.469 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.469 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.469 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.469 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.469 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.469 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.470 INFO:teuthology.orchestra.run.smithi059.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T13:00:37.470 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T13:00:37.470 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.470 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.470 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.470 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.471 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.471 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.471 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.471 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.471 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.471 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.471 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.472 INFO:teuthology.orchestra.run.smithi059.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T13:00:37.472 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T13:00:37.472 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.472 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.472 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.472 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.473 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.473 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.473 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.473 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.473 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.473 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.473 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.474 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T13:00:37.474 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T13:00:37.474 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.474 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.474 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.474 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.474 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.475 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.475 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.475 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.475 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.475 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.475 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.476 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T13:00:37.476 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T13:00:37.476 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.476 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.476 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.476 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.476 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.476 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.477 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.477 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.477 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.477 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.477 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.477 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T13:00:37.478 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T13:00:37.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.478 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.478 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.478 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.478 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.478 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.478 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.479 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.479 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.479 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.479 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.479 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T13:00:37.479 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T13:00:37.480 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.480 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.480 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.480 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.480 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.480 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.480 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.480 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.481 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.481 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.481 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.481 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T13:00:37.481 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T13:00:37.481 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.481 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.482 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.482 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.482 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.482 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.482 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.482 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.482 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.483 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.483 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.483 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T13:00:37.483 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T13:00:37.483 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.483 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.483 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.484 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.484 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.484 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.484 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.484 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.484 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.484 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.484 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.485 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T13:00:37.485 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T13:00:37.485 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.485 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.485 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.485 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.486 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.486 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.486 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.486 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.486 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.486 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.486 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.487 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T13:00:37.487 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T13:00:37.487 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.487 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.487 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.487 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.488 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.488 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.488 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.488 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.488 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.488 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.488 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.489 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T13:00:37.489 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T13:00:37.489 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.489 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.489 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.489 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.490 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.490 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.490 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.490 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.490 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.490 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.491 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.491 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T13:00:37.491 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T13:00:37.491 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.491 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.491 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.492 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.492 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.492 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.492 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.492 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.492 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.493 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.493 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.493 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T13:00:37.493 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T13:00:37.493 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.494 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.494 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.494 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T13:00:37.494 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.494 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.494 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.495 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.495 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.495 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.495 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.495 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T13:00:37.495 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T13:00:37.495 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.496 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.496 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.496 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:37.496 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.496 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.496 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.496 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.496 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.497 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.497 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.497 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T13:00:37.497 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T13:00:37.497 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.497 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.498 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.498 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8", 2023-10-08T13:00:37.498 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.498 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.498 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.498 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.498 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.498 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T13:00:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T13:00:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "45", 2023-10-08T13:00:37.500 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.500 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.500 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.500 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.500 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.500 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.500 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.501 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T13:00:37.501 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T13:00:37.501 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.501 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.501 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.501 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.502 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.502 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.502 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.502 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.502 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.502 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.502 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.503 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T13:00:37.503 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T13:00:37.503 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.503 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.503 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.503 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2023-10-08T13:00:37.503 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.504 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.504 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.504 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.504 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.504 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.504 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.504 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T13:00:37.505 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T13:00:37.505 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.505 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.505 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.505 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.505 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.505 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.506 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.506 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.506 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.506 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.506 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.506 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T13:00:37.506 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T13:00:37.507 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.507 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.507 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.507 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.507 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.507 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.507 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.508 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.508 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.508 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.508 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.508 INFO:teuthology.orchestra.run.smithi059.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T13:00:37.508 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T13:00:37.509 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.509 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.509 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.509 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.509 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.509 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.509 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.510 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.510 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.510 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.510 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.510 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T13:00:37.510 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T13:00:37.510 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.511 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.511 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.511 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:37.511 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.511 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.511 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.511 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.512 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.512 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.512 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.512 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T13:00:37.512 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T13:00:37.512 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.513 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.513 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.513 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:37.513 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.513 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.513 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.513 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.514 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.514 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.514 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.514 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T13:00:37.514 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T13:00:37.514 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.515 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.515 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.515 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:37.515 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.515 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.515 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.515 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.515 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.516 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.516 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.516 INFO:teuthology.orchestra.run.smithi059.stdout: "cross_origin_url": { 2023-10-08T13:00:37.516 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cross_origin_url", 2023-10-08T13:00:37.516 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.516 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.517 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.517 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.517 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.517 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.517 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.517 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.517 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.518 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.518 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.518 INFO:teuthology.orchestra.run.smithi059.stdout: "crt_file": { 2023-10-08T13:00:37.518 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crt_file", 2023-10-08T13:00:37.518 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.518 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "debug": { 2023-10-08T13:00:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "debug", 2023-10-08T13:00:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable/disable debug options", 2023-10-08T13:00:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "jwt_token_ttl": { 2023-10-08T13:00:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "jwt_token_ttl", 2023-10-08T13:00:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "28800", 2023-10-08T13:00:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2023-10-08T13:00:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2023-10-08T13:00:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "motd": { 2023-10-08T13:00:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "motd", 2023-10-08T13:00:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "The message of the day", 2023-10-08T13:00:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect_resolve_ip_addr": { 2023-10-08T13:00:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T13:00:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2023-10-08T13:00:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2023-10-08T13:00:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2023-10-08T13:00:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2023-10-08T13:00:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2023-10-08T13:00:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8080", 2023-10-08T13:00:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2023-10-08T13:00:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2023-10-08T13:00:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl_server_port": { 2023-10-08T13:00:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl_server_port", 2023-10-08T13:00:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8443", 2023-10-08T13:00:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2023-10-08T13:00:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2023-10-08T13:00:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "redirect", 2023-10-08T13:00:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect" 2023-10-08T13:00:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2023-10-08T13:00:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2023-10-08T13:00:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2023-10-08T13:00:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2023-10-08T13:00:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2023-10-08T13:00:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "url_prefix": { 2023-10-08T13:00:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url_prefix", 2023-10-08T13:00:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2023-10-08T13:00:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_monitoring": { 2023-10-08T13:00:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_monitoring", 2023-10-08T13:00:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "monitor device health metrics", 2023-10-08T13:00:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "mark_out_threshold": { 2023-10-08T13:00:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mark_out_threshold", 2023-10-08T13:00:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2419200", 2023-10-08T13:00:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T13:00:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": { 2023-10-08T13:00:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_name", 2023-10-08T13:00:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "device_health_metrics", 2023-10-08T13:00:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T13:00:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "retention_period": { 2023-10-08T13:00:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retention_period", 2023-10-08T13:00:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15552000", 2023-10-08T13:00:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain device health metrics", 2023-10-08T13:00:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_frequency": { 2023-10-08T13:00:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_frequency", 2023-10-08T13:00:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2023-10-08T13:00:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T13:00:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "self_heal": { 2023-10-08T13:00:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "self_heal", 2023-10-08T13:00:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T13:00:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T13:00:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_threshold": { 2023-10-08T13:00:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_threshold", 2023-10-08T13:00:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7257600", 2023-10-08T13:00:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T13:00:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "diskprediction_local", 2023-10-08T13:00:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "predict_interval": { 2023-10-08T13:00:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predict_interval", 2023-10-08T13:00:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2023-10-08T13:00:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "predictor_model": { 2023-10-08T13:00:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predictor_model", 2023-10-08T13:00:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "prophetstor", 2023-10-08T13:00:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "influx", 2023-10-08T13:00:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": false, 2023-10-08T13:00:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "influxdb python module not found", 2023-10-08T13:00:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "batch_size": { 2023-10-08T13:00:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "batch_size", 2023-10-08T13:00:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5000", 2023-10-08T13:00:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T13:00:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "database": { 2023-10-08T13:00:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "database", 2023-10-08T13:00:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "ceph", 2023-10-08T13:00:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T13:00:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": { 2023-10-08T13:00:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hostname", 2023-10-08T13:00:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server hostname", 2023-10-08T13:00:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "30", 2023-10-08T13:00:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "5", 2023-10-08T13:00:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T13:00:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "password": { 2023-10-08T13:00:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "password", 2023-10-08T13:00:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "password of InfluxDB server user", 2023-10-08T13:00:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "port": { 2023-10-08T13:00:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "port", 2023-10-08T13:00:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8086", 2023-10-08T13:00:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server port", 2023-10-08T13:00:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2023-10-08T13:00:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2023-10-08T13:00:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "false", 2023-10-08T13:00:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:00:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "threads": { 2023-10-08T13:00:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threads", 2023-10-08T13:00:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "32", 2023-10-08T13:00:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T13:00:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "username": { 2023-10-08T13:00:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "username", 2023-10-08T13:00:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "username of InfluxDB server user", 2023-10-08T13:00:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "verify_ssl": { 2023-10-08T13:00:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "verify_ssl", 2023-10-08T13:00:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "true", 2023-10-08T13:00:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:00:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "insights", 2023-10-08T13:00:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "iostat", 2023-10-08T13:00:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "k8sevents", 2023-10-08T13:00:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_event_retention_days": { 2023-10-08T13:00:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ceph_event_retention_days", 2023-10-08T13:00:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7", 2023-10-08T13:00:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T13:00:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "config_check_secs": { 2023-10-08T13:00:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_check_secs", 2023-10-08T13:00:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "10", 2023-10-08T13:00:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T13:00:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "localpool", 2023-10-08T13:00:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "failure_domain": { 2023-10-08T13:00:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "failure_domain", 2023-10-08T13:00:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "host", 2023-10-08T13:00:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "failure domain for any created local pool", 2023-10-08T13:00:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T13:00:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": { 2023-10-08T13:00:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_size", 2023-10-08T13:00:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default min_size for any created local pool", 2023-10-08T13:00:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T13:00:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "num_rep": { 2023-10-08T13:00:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "num_rep", 2023-10-08T13:00:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3", 2023-10-08T13:00:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default replica count for any created local pool", 2023-10-08T13:00:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": { 2023-10-08T13:00:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_num", 2023-10-08T13:00:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "128", 2023-10-08T13:00:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T13:00:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "prefix": { 2023-10-08T13:00:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prefix", 2023-10-08T13:00:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name prefix for any created local pool", 2023-10-08T13:00:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "subtree": { 2023-10-08T13:00:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subtree", 2023-10-08T13:00:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "rack", 2023-10-08T13:00:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T13:00:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T13:00:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mds_autoscaler", 2023-10-08T13:00:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirroring", 2023-10-08T13:00:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "nfs", 2023-10-08T13:00:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2023-10-08T13:00:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "fail_fs": { 2023-10-08T13:00:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "fail_fs", 2023-10-08T13:00:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T13:00:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator": { 2023-10-08T13:00:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2023-10-08T13:00:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2023-10-08T13:00:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "rook", 2023-10-08T13:00:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "test_orchestrator" 2023-10-08T13:00:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Orchestrator backend", 2023-10-08T13:00:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_perf_query", 2023-10-08T13:00:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_support", 2023-10-08T13:00:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_autoscaler", 2023-10-08T13:00:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "threshold": { 2023-10-08T13:00:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threshold", 2023-10-08T13:00:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2023-10-08T13:00:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1.0", 2023-10-08T13:00:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "scaling threshold", 2023-10-08T13:00:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T13:00:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "progress", 2023-10-08T13:00:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_pg_recovery_event": { 2023-10-08T13:00:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_pg_recovery_event", 2023-10-08T13:00:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T13:00:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2023-10-08T13:00:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2023-10-08T13:00:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "max_completed_events": { 2023-10-08T13:00:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_completed_events", 2023-10-08T13:00:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "50", 2023-10-08T13:00:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "number of past completed events to remember", 2023-10-08T13:00:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long the module is going to sleep", 2023-10-08T13:00:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus", 2023-10-08T13:00:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "cache": { 2023-10-08T13:00:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cache", 2023-10-08T13:00:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "exclude_perf_counters": { 2023-10-08T13:00:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "exclude_perf_counters", 2023-10-08T13:00:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T13:00:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T13:00:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools": { 2023-10-08T13:00:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools", 2023-10-08T13:00:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T13:00:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T13:00:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300", 2023-10-08T13:00:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_interval": { 2023-10-08T13:00:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_interval", 2023-10-08T13:00:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15.0", 2023-10-08T13:00:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2023-10-08T13:00:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2023-10-08T13:00:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2023-10-08T13:00:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T13:00:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2023-10-08T13:00:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2023-10-08T13:00:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "9283", 2023-10-08T13:00:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T13:00:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "stale_cache_strategy": { 2023-10-08T13:00:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stale_cache_strategy", 2023-10-08T13:00:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "log", 2023-10-08T13:00:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2023-10-08T13:00:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2023-10-08T13:00:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "default", 2023-10-08T13:00:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "default", 2023-10-08T13:00:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "error" 2023-10-08T13:00:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2023-10-08T13:00:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2023-10-08T13:00:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2023-10-08T13:00:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2023-10-08T13:00:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2023-10-08T13:00:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2023-10-08T13:00:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_snap_create": { 2023-10-08T13:00:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_snap_create", 2023-10-08T13:00:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "mirror_snapshot_schedule": { 2023-10-08T13:00:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T13:00:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "trash_purge_schedule": { 2023-10-08T13:00:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "trash_purge_schedule", 2023-10-08T13:00:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "restful", 2023-10-08T13:00:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_auth": { 2023-10-08T13:00:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_auth", 2023-10-08T13:00:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2023-10-08T13:00:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2023-10-08T13:00:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2023-10-08T13:00:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2023-10-08T13:00:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2023-10-08T13:00:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2023-10-08T13:00:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rgw", 2023-10-08T13:00:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rook", 2023-10-08T13:00:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "drive_group_interval": { 2023-10-08T13:00:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "drive_group_interval", 2023-10-08T13:00:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300.0", 2023-10-08T13:00:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T13:00:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "storage_class": { 2023-10-08T13:00:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "storage_class", 2023-10-08T13:00:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "local", 2023-10-08T13:00:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T13:00:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "selftest", 2023-10-08T13:00:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "roption1": { 2023-10-08T13:00:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption1", 2023-10-08T13:00:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "roption2": { 2023-10-08T13:00:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption2", 2023-10-08T13:00:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "xyz", 2023-10-08T13:00:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption1": { 2023-10-08T13:00:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption1", 2023-10-08T13:00:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption2": { 2023-10-08T13:00:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption2", 2023-10-08T13:00:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption3": { 2023-10-08T13:00:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption3", 2023-10-08T13:00:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption4": { 2023-10-08T13:00:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption4", 2023-10-08T13:00:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption5": { 2023-10-08T13:00:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption5", 2023-10-08T13:00:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption6": { 2023-10-08T13:00:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption6", 2023-10-08T13:00:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption7": { 2023-10-08T13:00:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption7", 2023-10-08T13:00:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "42", 2023-10-08T13:00:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "testkey": { 2023-10-08T13:00:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testkey", 2023-10-08T13:00:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "testlkey": { 2023-10-08T13:00:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testlkey", 2023-10-08T13:00:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "testnewline": { 2023-10-08T13:00:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testnewline", 2023-10-08T13:00:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2023-10-08T13:00:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_m_granularity": { 2023-10-08T13:00:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_m_granularity", 2023-10-08T13:00:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T13:00:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "dump_on_update": { 2023-10-08T13:00:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dump_on_update", 2023-10-08T13:00:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "dump database to debug log on update", 2023-10-08T13:00:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stats", 2023-10-08T13:00:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "status", 2023-10-08T13:00:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telegraf", 2023-10-08T13:00:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "address": { 2023-10-08T13:00:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "address", 2023-10-08T13:00:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T13:00:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15", 2023-10-08T13:00:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telemetry", 2023-10-08T13:00:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_basic": { 2023-10-08T13:00:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_basic", 2023-10-08T13:00:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T13:00:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_crash": { 2023-10-08T13:00:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_crash", 2023-10-08T13:00:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T13:00:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_device": { 2023-10-08T13:00:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_device", 2023-10-08T13:00:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T13:00:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_ident": { 2023-10-08T13:00:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_ident", 2023-10-08T13:00:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T13:00:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_perf": { 2023-10-08T13:00:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_perf", 2023-10-08T13:00:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T13:00:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "contact": { 2023-10-08T13:00:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "contact", 2023-10-08T13:00:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "description": { 2023-10-08T13:00:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "description", 2023-10-08T13:00:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "device_url": { 2023-10-08T13:00:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_url", 2023-10-08T13:00:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T13:00:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2023-10-08T13:00:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2023-10-08T13:00:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "24", 2023-10-08T13:00:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "8", 2023-10-08T13:00:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "last_opt_revision": { 2023-10-08T13:00:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "last_opt_revision", 2023-10-08T13:00:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1", 2023-10-08T13:00:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard": { 2023-10-08T13:00:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard", 2023-10-08T13:00:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard_description": { 2023-10-08T13:00:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard_description", 2023-10-08T13:00:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "organization": { 2023-10-08T13:00:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "organization", 2023-10-08T13:00:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "proxy": { 2023-10-08T13:00:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "proxy", 2023-10-08T13:00:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "url": { 2023-10-08T13:00:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url", 2023-10-08T13:00:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T13:00:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "test_orchestrator", 2023-10-08T13:00:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2023-10-08T13:00:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_clones": { 2023-10-08T13:00:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_clones", 2023-10-08T13:00:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4", 2023-10-08T13:00:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T13:00:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "periodic_async_work": { 2023-10-08T13:00:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "periodic_async_work", 2023-10-08T13:00:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Periodically check for async work", 2023-10-08T13:00:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_delay": { 2023-10-08T13:00:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_delay", 2023-10-08T13:00:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T13:00:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix", 2023-10-08T13:00:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "discovery_interval": { 2023-10-08T13:00:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "discovery_interval", 2023-10-08T13:00:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "100", 2023-10-08T13:00:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "identifier": { 2023-10-08T13:00:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "identifier", 2023-10-08T13:00:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_host": { 2023-10-08T13:00:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_host", 2023-10-08T13:00:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_port": { 2023-10-08T13:00:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_port", 2023-10-08T13:00:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10051", 2023-10-08T13:00:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_sender": { 2023-10-08T13:00:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_sender", 2023-10-08T13:00:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T13:00:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T13:00:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 24182, 2023-10-08T13:00:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "y", 2023-10-08T13:00:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_features": 4540138322906710015, 2023-10-08T13:00:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "available_modules": [ 2023-10-08T13:00:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "alerts", 2023-10-08T13:00:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T13:00:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_destination": { 2023-10-08T13:00:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_destination", 2023-10-08T13:00:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email address to send alerts to", 2023-10-08T13:00:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_from_name": { 2023-10-08T13:00:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_from_name", 2023-10-08T13:00:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "Ceph", 2023-10-08T13:00:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email From: name", 2023-10-08T13:00:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_host": { 2023-10-08T13:00:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_host", 2023-10-08T13:00:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP server", 2023-10-08T13:00:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_password": { 2023-10-08T13:00:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_password", 2023-10-08T13:00:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Password to authenticate with", 2023-10-08T13:00:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_port": { 2023-10-08T13:00:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_port", 2023-10-08T13:00:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "465", 2023-10-08T13:00:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP port", 2023-10-08T13:00:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_sender": { 2023-10-08T13:00:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_sender", 2023-10-08T13:00:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP envelope sender", 2023-10-08T13:00:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_ssl": { 2023-10-08T13:00:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_ssl", 2023-10-08T13:00:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T13:00:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_user": { 2023-10-08T13:00:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_user", 2023-10-08T13:00:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "User to authenticate as", 2023-10-08T13:00:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "balancer", 2023-10-08T13:00:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "active": { 2023-10-08T13:00:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "active", 2023-10-08T13:00:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T13:00:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_time": { 2023-10-08T13:00:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_time", 2023-10-08T13:00:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0000", 2023-10-08T13:00:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T13:00:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:00:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_weekday": { 2023-10-08T13:00:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_weekday", 2023-10-08T13:00:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2023-10-08T13:00:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2023-10-08T13:00:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T13:00:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:00:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_max_iterations": { 2023-10-08T13:00:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_max_iterations", 2023-10-08T13:00:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "25", 2023-10-08T13:00:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "250", 2023-10-08T13:00:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T13:00:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_metrics": { 2023-10-08T13:00:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_metrics", 2023-10-08T13:00:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T13:00:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T13:00:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T13:00:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_step": { 2023-10-08T13:00:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_step", 2023-10-08T13:00:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.5", 2023-10-08T13:00:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0.001", 2023-10-08T13:00:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "0.999", 2023-10-08T13:00:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "aggressiveness of optimization", 2023-10-08T13:00:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T13:00:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "end_time": { 2023-10-08T13:00:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_time", 2023-10-08T13:00:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2359", 2023-10-08T13:00:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T13:00:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:00:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "end_weekday": { 2023-10-08T13:00:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_weekday", 2023-10-08T13:00:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2023-10-08T13:00:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2023-10-08T13:00:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T13:00:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:00:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "min_score": { 2023-10-08T13:00:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_score", 2023-10-08T13:00:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T13:00:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2023-10-08T13:00:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2023-10-08T13:00:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "upmap", 2023-10-08T13:00:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-compat", 2023-10-08T13:00:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "none", 2023-10-08T13:00:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap" 2023-10-08T13:00:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Balancer mode", 2023-10-08T13:00:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_ids": { 2023-10-08T13:00:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_ids", 2023-10-08T13:00:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T13:00:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T13:00:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_deviation": { 2023-10-08T13:00:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_deviation", 2023-10-08T13:00:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T13:00:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T13:00:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_optimizations": { 2023-10-08T13:00:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_optimizations", 2023-10-08T13:00:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T13:00:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm", 2023-10-08T13:00:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_down_multiplier": { 2023-10-08T13:00:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_down_multiplier", 2023-10-08T13:00:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2023-10-08T13:00:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T13:00:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_refresh_rate": { 2023-10-08T13:00:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_refresh_rate", 2023-10-08T13:00:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "20", 2023-10-08T13:00:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T13:00:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_starting_port": { 2023-10-08T13:00:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_starting_port", 2023-10-08T13:00:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4721", 2023-10-08T13:00:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T13:00:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_ptrace": { 2023-10-08T13:00:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_ptrace", 2023-10-08T13:00:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T13:00:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T13:00:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_interval": { 2023-10-08T13:00:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_interval", 2023-10-08T13:00:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T13:00:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_memory_target_ratio": { 2023-10-08T13:00:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T13:00:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.7", 2023-10-08T13:00:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T13:00:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm_log_destination": { 2023-10-08T13:00:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm_log_destination", 2023-10-08T13:00:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "file", 2023-10-08T13:00:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "file,syslog", 2023-10-08T13:00:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "syslog" 2023-10-08T13:00:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T13:00:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "cgroups_split": { 2023-10-08T13:00:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cgroups_split", 2023-10-08T13:00:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T13:00:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "config_checks_enabled": { 2023-10-08T13:00:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_checks_enabled", 2023-10-08T13:00:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T13:00:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "config_dashboard": { 2023-10-08T13:00:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_dashboard", 2023-10-08T13:00:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T13:00:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_alertmanager": { 2023-10-08T13:00:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_alertmanager", 2023-10-08T13:00:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T13:00:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_base": { 2023-10-08T13:00:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_base", 2023-10-08T13:00:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T13:00:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Container image name, without the tag", 2023-10-08T13:00:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_elasticsearch": { 2023-10-08T13:00:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_elasticsearch", 2023-10-08T13:00:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T13:00:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "elasticsearch container image", 2023-10-08T13:00:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_grafana": { 2023-10-08T13:00:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_grafana", 2023-10-08T13:00:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T13:00:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_haproxy": { 2023-10-08T13:00:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_haproxy", 2023-10-08T13:00:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T13:00:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "HAproxy container image", 2023-10-08T13:00:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_agent": { 2023-10-08T13:00:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_agent", 2023-10-08T13:00:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T13:00:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger agent container image", 2023-10-08T13:00:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_collector": { 2023-10-08T13:00:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_collector", 2023-10-08T13:00:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T13:00:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger collector container image", 2023-10-08T13:00:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_query": { 2023-10-08T13:00:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_query", 2023-10-08T13:00:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T13:00:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger query container image", 2023-10-08T13:00:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_keepalived": { 2023-10-08T13:00:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_keepalived", 2023-10-08T13:00:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T13:00:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Keepalived container image", 2023-10-08T13:00:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_loki": { 2023-10-08T13:00:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_loki", 2023-10-08T13:00:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T13:00:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Loki container image", 2023-10-08T13:00:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_node_exporter": { 2023-10-08T13:00:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_node_exporter", 2023-10-08T13:00:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T13:00:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nvmeof": { 2023-10-08T13:00:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nvmeof", 2023-10-08T13:00:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T13:00:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nvme-of container image", 2023-10-08T13:00:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_prometheus": { 2023-10-08T13:00:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_prometheus", 2023-10-08T13:00:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T13:00:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_promtail": { 2023-10-08T13:00:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_promtail", 2023-10-08T13:00:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T13:00:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Promtail container image", 2023-10-08T13:00:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_snmp_gateway": { 2023-10-08T13:00:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_snmp_gateway", 2023-10-08T13:00:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T13:00:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SNMP Gateway container image", 2023-10-08T13:00:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "container_init": { 2023-10-08T13:00:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_init", 2023-10-08T13:00:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T13:00:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "daemon_cache_timeout": { 2023-10-08T13:00:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "daemon_cache_timeout", 2023-10-08T13:00:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T13:00:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "default_cephadm_command_timeout": { 2023-10-08T13:00:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T13:00:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "900", 2023-10-08T13:00:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T13:00:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "default_registry": { 2023-10-08T13:00:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_registry", 2023-10-08T13:00:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io", 2023-10-08T13:00:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T13:00:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "device_cache_timeout": { 2023-10-08T13:00:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_cache_timeout", 2023-10-08T13:00:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1800", 2023-10-08T13:00:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache device inventory", 2023-10-08T13:00:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "device_enhanced_scan": { 2023-10-08T13:00:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_enhanced_scan", 2023-10-08T13:00:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T13:00:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "facts_cache_timeout": { 2023-10-08T13:00:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "facts_cache_timeout", 2023-10-08T13:00:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache host facts data", 2023-10-08T13:00:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "host_check_interval": { 2023-10-08T13:00:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "host_check_interval", 2023-10-08T13:00:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to perform a host check", 2023-10-08T13:00:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "inventory_list_all": { 2023-10-08T13:00:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "inventory_list_all", 2023-10-08T13:00:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T13:00:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "log_refresh_metadata": { 2023-10-08T13:00:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_refresh_metadata", 2023-10-08T13:00:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T13:00:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T13:00:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T13:00:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T13:00:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T13:00:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T13:00:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T13:00:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "*", 2023-10-08T13:00:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T13:00:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "max_count_per_host": { 2023-10-08T13:00:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_count_per_host", 2023-10-08T13:00:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of daemons per service per host", 2023-10-08T13:00:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd_draining_count": { 2023-10-08T13:00:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_osd_draining_count", 2023-10-08T13:00:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T13:00:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "migration_current": { 2023-10-08T13:00:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "migration_current", 2023-10-08T13:00:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "internal - do not modify", 2023-10-08T13:00:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2023-10-08T13:00:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2023-10-08T13:00:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "root", 2023-10-08T13:00:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm-package", 2023-10-08T13:00:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "root" 2023-10-08T13:00:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T13:00:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "prometheus_alerts_path": { 2023-10-08T13:00:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus_alerts_path", 2023-10-08T13:00:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T13:00:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T13:00:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_insecure": { 2023-10-08T13:00:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_insecure", 2023-10-08T13:00:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T13:00:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_password": { 2023-10-08T13:00:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_password", 2023-10-08T13:00:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T13:00:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_url": { 2023-10-08T13:00:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_url", 2023-10-08T13:00:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T13:00:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_username": { 2023-10-08T13:00:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_username", 2023-10-08T13:00:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T13:00:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "secure_monitoring_stack": { 2023-10-08T13:00:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secure_monitoring_stack", 2023-10-08T13:00:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T13:00:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "service_discovery_port": { 2023-10-08T13:00:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "service_discovery_port", 2023-10-08T13:00:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8765", 2023-10-08T13:00:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "cephadm service discovery port", 2023-10-08T13:00:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "ssh_config_file": { 2023-10-08T13:00:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssh_config_file", 2023-10-08T13:00:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T13:00:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "use_agent": { 2023-10-08T13:00:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_agent", 2023-10-08T13:00:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T13:00:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "use_repo_digest": { 2023-10-08T13:00:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_repo_digest", 2023-10-08T13:00:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T13:00:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_failed_host_check": { 2023-10-08T13:00:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_failed_host_check", 2023-10-08T13:00:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T13:00:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_daemons": { 2023-10-08T13:00:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_daemons", 2023-10-08T13:00:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T13:00:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_hosts": { 2023-10-08T13:00:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_hosts", 2023-10-08T13:00:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T13:00:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crash", 2023-10-08T13:00:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "retain_interval": { 2023-10-08T13:00:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retain_interval", 2023-10-08T13:00:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "31536000", 2023-10-08T13:00:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T13:00:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_recent_interval": { 2023-10-08T13:00:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_recent_interval", 2023-10-08T13:00:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1209600", 2023-10-08T13:00:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T13:00:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dashboard", 2023-10-08T13:00:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T13:00:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T13:00:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T13:00:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T13:00:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T13:00:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T13:00:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_ENABLED": { 2023-10-08T13:00:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T13:00:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T13:00:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T13:00:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T13:00:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T13:00:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T13:00:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T13:00:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T13:00:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T13:00:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T13:00:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T13:00:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T13:00:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T13:00:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T13:00:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T13:00:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T13:00:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T13:00:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T13:00:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T13:00:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T13:00:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T13:00:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T13:00:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T13:00:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2023-10-08T13:00:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T13:00:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T13:00:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_URL": { 2023-10-08T13:00:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_URL", 2023-10-08T13:00:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T13:00:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T13:00:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2023-10-08T13:00:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T13:00:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T13:00:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T13:00:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T13:00:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T13:00:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T13:00:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T13:00:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T13:00:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T13:00:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T13:00:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T13:00:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T13:00:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T13:00:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T13:00:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T13:00:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T13:00:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T13:00:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T13:00:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T13:00:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T13:00:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T13:00:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T13:00:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T13:00:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T13:00:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T13:00:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T13:00:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T13:00:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T13:00:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T13:00:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T13:00:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T13:00:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T13:00:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T13:00:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T13:00:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T13:00:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8", 2023-10-08T13:00:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T13:00:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T13:00:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "45", 2023-10-08T13:00:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T13:00:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T13:00:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T13:00:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T13:00:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2023-10-08T13:00:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T13:00:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T13:00:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T13:00:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T13:00:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T13:00:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T13:00:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T13:00:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T13:00:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T13:00:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T13:00:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T13:00:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T13:00:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "cross_origin_url": { 2023-10-08T13:00:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cross_origin_url", 2023-10-08T13:00:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "crt_file": { 2023-10-08T13:00:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crt_file", 2023-10-08T13:00:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "debug": { 2023-10-08T13:00:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "debug", 2023-10-08T13:00:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable/disable debug options", 2023-10-08T13:00:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "jwt_token_ttl": { 2023-10-08T13:00:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "jwt_token_ttl", 2023-10-08T13:00:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "28800", 2023-10-08T13:00:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2023-10-08T13:00:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2023-10-08T13:00:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "motd": { 2023-10-08T13:00:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "motd", 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "The message of the day", 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect_resolve_ip_addr": { 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2023-10-08T13:00:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8080", 2023-10-08T13:00:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2023-10-08T13:00:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2023-10-08T13:00:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl_server_port": { 2023-10-08T13:00:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl_server_port", 2023-10-08T13:00:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8443", 2023-10-08T13:00:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2023-10-08T13:00:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2023-10-08T13:00:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "redirect", 2023-10-08T13:00:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect" 2023-10-08T13:00:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2023-10-08T13:00:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2023-10-08T13:00:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2023-10-08T13:00:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2023-10-08T13:00:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2023-10-08T13:00:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "url_prefix": { 2023-10-08T13:00:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url_prefix", 2023-10-08T13:00:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2023-10-08T13:00:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_monitoring": { 2023-10-08T13:00:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_monitoring", 2023-10-08T13:00:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "monitor device health metrics", 2023-10-08T13:00:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "mark_out_threshold": { 2023-10-08T13:00:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mark_out_threshold", 2023-10-08T13:00:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2419200", 2023-10-08T13:00:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T13:00:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": { 2023-10-08T13:00:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_name", 2023-10-08T13:00:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "device_health_metrics", 2023-10-08T13:00:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T13:00:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "retention_period": { 2023-10-08T13:00:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retention_period", 2023-10-08T13:00:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15552000", 2023-10-08T13:00:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain device health metrics", 2023-10-08T13:00:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_frequency": { 2023-10-08T13:00:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_frequency", 2023-10-08T13:00:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2023-10-08T13:00:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T13:00:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "self_heal": { 2023-10-08T13:00:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "self_heal", 2023-10-08T13:00:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T13:00:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T13:00:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_threshold": { 2023-10-08T13:00:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_threshold", 2023-10-08T13:00:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7257600", 2023-10-08T13:00:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T13:00:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "diskprediction_local", 2023-10-08T13:00:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "predict_interval": { 2023-10-08T13:00:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predict_interval", 2023-10-08T13:00:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2023-10-08T13:00:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "predictor_model": { 2023-10-08T13:00:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predictor_model", 2023-10-08T13:00:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "prophetstor", 2023-10-08T13:00:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "influx", 2023-10-08T13:00:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": false, 2023-10-08T13:00:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "influxdb python module not found", 2023-10-08T13:00:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "batch_size": { 2023-10-08T13:00:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "batch_size", 2023-10-08T13:00:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5000", 2023-10-08T13:00:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T13:00:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "database": { 2023-10-08T13:00:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "database", 2023-10-08T13:00:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "ceph", 2023-10-08T13:00:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T13:00:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": { 2023-10-08T13:00:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hostname", 2023-10-08T13:00:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server hostname", 2023-10-08T13:00:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "30", 2023-10-08T13:00:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "5", 2023-10-08T13:00:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T13:00:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "password": { 2023-10-08T13:00:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "password", 2023-10-08T13:00:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "password of InfluxDB server user", 2023-10-08T13:00:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "port": { 2023-10-08T13:00:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "port", 2023-10-08T13:00:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8086", 2023-10-08T13:00:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server port", 2023-10-08T13:00:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2023-10-08T13:00:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2023-10-08T13:00:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "false", 2023-10-08T13:00:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:00:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "threads": { 2023-10-08T13:00:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threads", 2023-10-08T13:00:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "32", 2023-10-08T13:00:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T13:00:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "username": { 2023-10-08T13:00:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "username", 2023-10-08T13:00:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "username of InfluxDB server user", 2023-10-08T13:00:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "verify_ssl": { 2023-10-08T13:00:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "verify_ssl", 2023-10-08T13:00:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "true", 2023-10-08T13:00:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:00:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "insights", 2023-10-08T13:00:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "iostat", 2023-10-08T13:00:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "k8sevents", 2023-10-08T13:00:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_event_retention_days": { 2023-10-08T13:00:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ceph_event_retention_days", 2023-10-08T13:00:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7", 2023-10-08T13:00:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T13:00:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "config_check_secs": { 2023-10-08T13:00:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_check_secs", 2023-10-08T13:00:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "10", 2023-10-08T13:00:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T13:00:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "localpool", 2023-10-08T13:00:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "failure_domain": { 2023-10-08T13:00:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "failure_domain", 2023-10-08T13:00:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "host", 2023-10-08T13:00:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "failure domain for any created local pool", 2023-10-08T13:00:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T13:00:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": { 2023-10-08T13:00:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_size", 2023-10-08T13:00:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default min_size for any created local pool", 2023-10-08T13:00:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T13:00:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "num_rep": { 2023-10-08T13:00:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "num_rep", 2023-10-08T13:00:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3", 2023-10-08T13:00:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default replica count for any created local pool", 2023-10-08T13:00:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": { 2023-10-08T13:00:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_num", 2023-10-08T13:00:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "128", 2023-10-08T13:00:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T13:00:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "prefix": { 2023-10-08T13:00:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prefix", 2023-10-08T13:00:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name prefix for any created local pool", 2023-10-08T13:00:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "subtree": { 2023-10-08T13:00:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subtree", 2023-10-08T13:00:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "rack", 2023-10-08T13:00:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T13:00:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T13:00:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mds_autoscaler", 2023-10-08T13:00:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirroring", 2023-10-08T13:00:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "nfs", 2023-10-08T13:00:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2023-10-08T13:00:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "fail_fs": { 2023-10-08T13:00:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "fail_fs", 2023-10-08T13:00:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T13:00:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator": { 2023-10-08T13:00:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2023-10-08T13:00:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2023-10-08T13:00:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "rook", 2023-10-08T13:00:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "test_orchestrator" 2023-10-08T13:00:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Orchestrator backend", 2023-10-08T13:00:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_perf_query", 2023-10-08T13:00:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_support", 2023-10-08T13:00:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_autoscaler", 2023-10-08T13:00:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "threshold": { 2023-10-08T13:00:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threshold", 2023-10-08T13:00:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2023-10-08T13:00:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1.0", 2023-10-08T13:00:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "scaling threshold", 2023-10-08T13:00:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T13:00:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "progress", 2023-10-08T13:00:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_pg_recovery_event": { 2023-10-08T13:00:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_pg_recovery_event", 2023-10-08T13:00:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T13:00:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2023-10-08T13:00:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2023-10-08T13:00:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "max_completed_events": { 2023-10-08T13:00:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_completed_events", 2023-10-08T13:00:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "50", 2023-10-08T13:00:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "number of past completed events to remember", 2023-10-08T13:00:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long the module is going to sleep", 2023-10-08T13:00:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus", 2023-10-08T13:00:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "cache": { 2023-10-08T13:00:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cache", 2023-10-08T13:00:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "exclude_perf_counters": { 2023-10-08T13:00:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "exclude_perf_counters", 2023-10-08T13:00:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T13:00:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T13:00:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools": { 2023-10-08T13:00:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools", 2023-10-08T13:00:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T13:00:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T13:00:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300", 2023-10-08T13:00:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_interval": { 2023-10-08T13:00:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_interval", 2023-10-08T13:00:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15.0", 2023-10-08T13:00:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2023-10-08T13:00:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2023-10-08T13:00:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2023-10-08T13:00:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T13:00:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2023-10-08T13:00:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2023-10-08T13:00:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "9283", 2023-10-08T13:00:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T13:00:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "stale_cache_strategy": { 2023-10-08T13:00:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stale_cache_strategy", 2023-10-08T13:00:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "log", 2023-10-08T13:00:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2023-10-08T13:00:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2023-10-08T13:00:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "default", 2023-10-08T13:00:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "default", 2023-10-08T13:00:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "error" 2023-10-08T13:00:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2023-10-08T13:00:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2023-10-08T13:00:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2023-10-08T13:00:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2023-10-08T13:00:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2023-10-08T13:00:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2023-10-08T13:00:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_snap_create": { 2023-10-08T13:00:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_snap_create", 2023-10-08T13:00:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "mirror_snapshot_schedule": { 2023-10-08T13:00:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T13:00:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "trash_purge_schedule": { 2023-10-08T13:00:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "trash_purge_schedule", 2023-10-08T13:00:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "restful", 2023-10-08T13:00:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_auth": { 2023-10-08T13:00:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_auth", 2023-10-08T13:00:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2023-10-08T13:00:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2023-10-08T13:00:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2023-10-08T13:00:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2023-10-08T13:00:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2023-10-08T13:00:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2023-10-08T13:00:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rgw", 2023-10-08T13:00:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rook", 2023-10-08T13:00:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "drive_group_interval": { 2023-10-08T13:00:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "drive_group_interval", 2023-10-08T13:00:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300.0", 2023-10-08T13:00:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T13:00:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "storage_class": { 2023-10-08T13:00:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "storage_class", 2023-10-08T13:00:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "local", 2023-10-08T13:00:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T13:00:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "selftest", 2023-10-08T13:00:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "roption1": { 2023-10-08T13:00:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption1", 2023-10-08T13:00:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "roption2": { 2023-10-08T13:00:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption2", 2023-10-08T13:00:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "xyz", 2023-10-08T13:00:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption1": { 2023-10-08T13:00:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption1", 2023-10-08T13:00:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption2": { 2023-10-08T13:00:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption2", 2023-10-08T13:00:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption3": { 2023-10-08T13:00:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption3", 2023-10-08T13:00:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption4": { 2023-10-08T13:00:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption4", 2023-10-08T13:00:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption5": { 2023-10-08T13:00:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption5", 2023-10-08T13:00:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption6": { 2023-10-08T13:00:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption6", 2023-10-08T13:00:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption7": { 2023-10-08T13:00:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption7", 2023-10-08T13:00:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "42", 2023-10-08T13:00:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "testkey": { 2023-10-08T13:00:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testkey", 2023-10-08T13:00:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "testlkey": { 2023-10-08T13:00:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testlkey", 2023-10-08T13:00:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "testnewline": { 2023-10-08T13:00:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testnewline", 2023-10-08T13:00:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2023-10-08T13:00:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_m_granularity": { 2023-10-08T13:00:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_m_granularity", 2023-10-08T13:00:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T13:00:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "dump_on_update": { 2023-10-08T13:00:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dump_on_update", 2023-10-08T13:00:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "dump database to debug log on update", 2023-10-08T13:00:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stats", 2023-10-08T13:00:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "status", 2023-10-08T13:00:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telegraf", 2023-10-08T13:00:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "address": { 2023-10-08T13:00:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "address", 2023-10-08T13:00:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T13:00:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15", 2023-10-08T13:00:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telemetry", 2023-10-08T13:00:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_basic": { 2023-10-08T13:00:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_basic", 2023-10-08T13:00:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T13:00:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_crash": { 2023-10-08T13:00:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_crash", 2023-10-08T13:00:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T13:00:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_device": { 2023-10-08T13:00:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_device", 2023-10-08T13:00:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T13:00:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_ident": { 2023-10-08T13:00:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_ident", 2023-10-08T13:00:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T13:00:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_perf": { 2023-10-08T13:00:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_perf", 2023-10-08T13:00:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T13:00:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "contact": { 2023-10-08T13:00:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "contact", 2023-10-08T13:00:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "description": { 2023-10-08T13:00:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "description", 2023-10-08T13:00:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "device_url": { 2023-10-08T13:00:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_url", 2023-10-08T13:00:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T13:00:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2023-10-08T13:00:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2023-10-08T13:00:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "24", 2023-10-08T13:00:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "8", 2023-10-08T13:00:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "last_opt_revision": { 2023-10-08T13:00:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "last_opt_revision", 2023-10-08T13:00:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1", 2023-10-08T13:00:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard": { 2023-10-08T13:00:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard", 2023-10-08T13:00:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard_description": { 2023-10-08T13:00:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard_description", 2023-10-08T13:00:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "organization": { 2023-10-08T13:00:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "organization", 2023-10-08T13:00:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "proxy": { 2023-10-08T13:00:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "proxy", 2023-10-08T13:00:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "url": { 2023-10-08T13:00:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url", 2023-10-08T13:00:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T13:00:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "test_orchestrator", 2023-10-08T13:00:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2023-10-08T13:00:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_clones": { 2023-10-08T13:00:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_clones", 2023-10-08T13:00:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4", 2023-10-08T13:00:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T13:00:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "periodic_async_work": { 2023-10-08T13:00:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "periodic_async_work", 2023-10-08T13:00:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Periodically check for async work", 2023-10-08T13:00:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_delay": { 2023-10-08T13:00:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_delay", 2023-10-08T13:00:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T13:00:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix", 2023-10-08T13:00:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "discovery_interval": { 2023-10-08T13:00:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "discovery_interval", 2023-10-08T13:00:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "100", 2023-10-08T13:00:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "identifier": { 2023-10-08T13:00:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "identifier", 2023-10-08T13:00:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.863 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.863 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.863 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.863 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.863 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.863 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.863 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.864 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.864 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.864 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.864 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.864 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.864 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.865 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.865 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.865 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.865 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.865 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.865 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.865 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.866 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.866 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.866 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.866 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.866 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.866 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.866 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.867 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.867 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.867 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.867 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.867 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.867 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.867 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.868 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.868 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.868 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.868 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.868 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.868 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.868 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.869 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.869 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.869 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.869 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.869 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.869 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.869 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.870 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.870 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.870 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.870 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.870 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.870 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_host": { 2023-10-08T13:00:38.871 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_host", 2023-10-08T13:00:38.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.871 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.871 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.871 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.871 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.871 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.872 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.872 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.872 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.872 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.872 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.872 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_port": { 2023-10-08T13:00:38.872 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_port", 2023-10-08T13:00:38.873 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.873 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.873 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.873 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10051", 2023-10-08T13:00:38.873 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.873 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.873 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.874 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.874 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.874 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.874 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.874 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_sender": { 2023-10-08T13:00:38.874 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_sender", 2023-10-08T13:00:38.875 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.875 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.875 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.875 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T13:00:38.875 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.875 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.875 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.876 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.876 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.876 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.876 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.876 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.876 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.876 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.876 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T13:00:38.877 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.877 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.877 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2023-10-08T13:00:38.877 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2023-10-08T13:00:38.877 INFO:teuthology.orchestra.run.smithi059.stdout: "dashboard", 2023-10-08T13:00:38.877 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2023-10-08T13:00:38.877 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2023-10-08T13:00:38.877 INFO:teuthology.orchestra.run.smithi059.stdout: "restful", 2023-10-08T13:00:38.878 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_schedule" 2023-10-08T13:00:38.878 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.878 INFO:teuthology.orchestra.run.smithi059.stdout: "available_modules": [ 2023-10-08T13:00:38.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.878 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "alerts", 2023-10-08T13:00:38.878 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.878 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.879 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.879 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:38.879 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:38.879 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.879 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.879 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.879 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:38.879 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.880 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.880 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.880 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T13:00:38.880 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.880 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.880 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.881 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.881 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.881 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.881 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.881 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.881 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.881 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.881 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.882 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.882 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.882 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.882 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.882 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.882 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.882 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.883 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.883 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.883 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.883 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.883 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.883 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.883 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.884 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.884 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.884 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.884 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.884 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.884 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.884 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.884 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.885 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.885 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.885 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.885 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.885 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.885 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.885 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.886 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.886 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.886 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.886 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.886 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.886 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.886 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.887 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.887 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.887 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.887 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.887 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.887 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.887 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.887 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.888 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.888 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.888 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.888 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.888 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.888 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.888 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.889 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.889 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.889 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.889 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.889 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.889 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.889 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.890 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_destination": { 2023-10-08T13:00:38.890 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_destination", 2023-10-08T13:00:38.890 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.890 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.890 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.890 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.890 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.891 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.891 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.891 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email address to send alerts to", 2023-10-08T13:00:38.891 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.891 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.891 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.891 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_from_name": { 2023-10-08T13:00:38.892 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_from_name", 2023-10-08T13:00:38.892 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.892 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.892 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.892 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "Ceph", 2023-10-08T13:00:38.892 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.892 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.893 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.893 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email From: name", 2023-10-08T13:00:38.893 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.893 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.893 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.893 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_host": { 2023-10-08T13:00:38.893 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_host", 2023-10-08T13:00:38.894 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.894 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.894 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.894 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.894 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.894 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.894 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.894 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP server", 2023-10-08T13:00:38.895 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.895 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.895 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.895 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_password": { 2023-10-08T13:00:38.895 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_password", 2023-10-08T13:00:38.895 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.896 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.896 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.896 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.896 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.896 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.896 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.896 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Password to authenticate with", 2023-10-08T13:00:38.896 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.897 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.897 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.897 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_port": { 2023-10-08T13:00:38.897 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_port", 2023-10-08T13:00:38.897 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.897 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.898 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.898 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "465", 2023-10-08T13:00:38.898 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.898 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.898 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.898 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP port", 2023-10-08T13:00:38.898 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.898 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.899 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.899 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_sender": { 2023-10-08T13:00:38.899 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_sender", 2023-10-08T13:00:38.899 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.899 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.899 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.899 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.900 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.900 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.900 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.900 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP envelope sender", 2023-10-08T13:00:38.900 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.900 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.900 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.901 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_ssl": { 2023-10-08T13:00:38.901 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_ssl", 2023-10-08T13:00:38.901 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.901 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.901 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.901 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.901 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T13:00:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_user": { 2023-10-08T13:00:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_user", 2023-10-08T13:00:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "User to authenticate as", 2023-10-08T13:00:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "balancer", 2023-10-08T13:00:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: "active": { 2023-10-08T13:00:38.906 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "active", 2023-10-08T13:00:38.906 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.906 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.906 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.906 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.906 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.906 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.907 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.907 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T13:00:38.907 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.907 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.907 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.907 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_time": { 2023-10-08T13:00:38.907 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_time", 2023-10-08T13:00:38.908 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.908 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.908 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.908 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0000", 2023-10-08T13:00:38.908 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.908 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.908 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.908 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T13:00:38.909 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:00:38.909 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.909 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.909 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_weekday": { 2023-10-08T13:00:38.909 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_weekday", 2023-10-08T13:00:38.909 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:38.909 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.910 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.910 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:38.910 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2023-10-08T13:00:38.910 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2023-10-08T13:00:38.910 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.910 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T13:00:38.910 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:00:38.911 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.911 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.911 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_max_iterations": { 2023-10-08T13:00:38.911 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_max_iterations", 2023-10-08T13:00:38.911 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:38.911 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.911 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.912 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "25", 2023-10-08T13:00:38.912 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:38.912 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "250", 2023-10-08T13:00:38.912 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.912 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T13:00:38.912 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.912 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.912 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.913 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_metrics": { 2023-10-08T13:00:38.913 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_metrics", 2023-10-08T13:00:38.913 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.913 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.913 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.913 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T13:00:38.913 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.914 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.914 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.914 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T13:00:38.914 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T13:00:38.914 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.914 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.915 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_step": { 2023-10-08T13:00:38.915 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_step", 2023-10-08T13:00:38.915 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.915 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.915 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.915 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.5", 2023-10-08T13:00:38.915 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0.001", 2023-10-08T13:00:38.916 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "0.999", 2023-10-08T13:00:38.916 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.916 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "aggressiveness of optimization", 2023-10-08T13:00:38.916 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T13:00:38.916 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.916 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.916 INFO:teuthology.orchestra.run.smithi059.stdout: "end_time": { 2023-10-08T13:00:38.917 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_time", 2023-10-08T13:00:38.917 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.917 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.917 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.917 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2359", 2023-10-08T13:00:38.917 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.917 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.918 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.918 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T13:00:38.918 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:00:38.918 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.918 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.918 INFO:teuthology.orchestra.run.smithi059.stdout: "end_weekday": { 2023-10-08T13:00:38.919 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_weekday", 2023-10-08T13:00:38.919 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:38.919 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.919 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.919 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:38.919 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2023-10-08T13:00:38.919 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2023-10-08T13:00:38.920 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.920 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T13:00:38.920 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:00:38.920 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.920 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.920 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:38.921 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:38.921 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.921 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.921 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.921 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.921 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.921 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.921 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.922 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.922 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.922 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.922 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.922 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.922 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.922 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.923 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.923 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.923 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.923 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.923 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:38.923 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:38.923 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.924 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.924 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.924 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.924 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.924 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.924 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.924 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.924 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.925 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.925 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.925 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:38.925 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:38.925 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.925 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.926 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.926 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:38.926 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.926 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.926 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.926 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:38.926 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:38.927 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:38.927 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:38.927 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:38.927 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:38.927 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.927 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.927 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.927 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.928 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.928 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:38.928 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:38.928 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.928 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.929 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.929 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.929 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.929 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.929 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.929 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:38.929 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.929 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.930 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.930 INFO:teuthology.orchestra.run.smithi059.stdout: "min_score": { 2023-10-08T13:00:38.930 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_score", 2023-10-08T13:00:38.930 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.930 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.930 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.933 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:38.933 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.933 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.934 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.934 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T13:00:38.934 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.934 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.934 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.935 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2023-10-08T13:00:38.935 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2023-10-08T13:00:38.935 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.935 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.935 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.935 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "upmap", 2023-10-08T13:00:38.936 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.936 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.936 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.936 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-compat", 2023-10-08T13:00:38.936 INFO:teuthology.orchestra.run.smithi059.stdout: "none", 2023-10-08T13:00:38.936 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap" 2023-10-08T13:00:38.936 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.937 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Balancer mode", 2023-10-08T13:00:38.937 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.937 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.937 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.937 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_ids": { 2023-10-08T13:00:38.937 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_ids", 2023-10-08T13:00:38.937 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T13:00:38.939 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.939 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.939 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.939 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:38.939 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:38.939 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.939 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.940 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.940 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:38.940 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.940 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.940 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.940 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T13:00:38.940 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.941 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.941 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.941 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_deviation": { 2023-10-08T13:00:38.941 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_deviation", 2023-10-08T13:00:38.941 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.941 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.941 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.942 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:38.942 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:38.942 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.942 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.942 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T13:00:38.942 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T13:00:38.942 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.942 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.943 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_optimizations": { 2023-10-08T13:00:38.943 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_optimizations", 2023-10-08T13:00:38.943 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:38.943 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.943 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.943 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:38.944 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.944 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.944 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.944 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T13:00:38.944 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.944 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.944 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.944 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.945 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:38.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:38.945 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm", 2023-10-08T13:00:38.945 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:38.945 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:38.945 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:38.945 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_down_multiplier": { 2023-10-08T13:00:38.946 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_down_multiplier", 2023-10-08T13:00:38.946 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.946 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.946 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.946 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2023-10-08T13:00:38.946 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.946 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.947 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.947 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T13:00:38.947 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.947 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.947 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.947 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_refresh_rate": { 2023-10-08T13:00:38.948 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_refresh_rate", 2023-10-08T13:00:38.948 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.948 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.948 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.948 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "20", 2023-10-08T13:00:38.948 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.948 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.948 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.949 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T13:00:38.949 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.949 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.949 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.949 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_starting_port": { 2023-10-08T13:00:38.949 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_starting_port", 2023-10-08T13:00:38.950 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:38.950 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.950 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.950 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4721", 2023-10-08T13:00:38.950 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.950 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.950 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.950 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T13:00:38.951 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.951 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.951 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.951 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_ptrace": { 2023-10-08T13:00:38.951 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_ptrace", 2023-10-08T13:00:38.951 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.951 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.952 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.952 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.952 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.952 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.952 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.952 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T13:00:38.952 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T13:00:38.953 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.953 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.953 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_interval": { 2023-10-08T13:00:38.953 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_interval", 2023-10-08T13:00:38.953 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.953 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.953 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.954 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:38.954 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.954 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.954 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.954 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T13:00:38.954 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.954 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.955 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.955 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_memory_target_ratio": { 2023-10-08T13:00:38.955 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T13:00:38.955 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:38.955 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.955 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.956 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.7", 2023-10-08T13:00:38.956 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.956 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.956 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.956 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T13:00:38.956 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.956 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.956 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.957 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm_log_destination": { 2023-10-08T13:00:38.957 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm_log_destination", 2023-10-08T13:00:38.957 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.957 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.957 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.957 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:38.957 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.958 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.958 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:38.958 INFO:teuthology.orchestra.run.smithi059.stdout: "file", 2023-10-08T13:00:38.958 INFO:teuthology.orchestra.run.smithi059.stdout: "file,syslog", 2023-10-08T13:00:38.958 INFO:teuthology.orchestra.run.smithi059.stdout: "syslog" 2023-10-08T13:00:38.958 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:38.958 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T13:00:38.959 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.959 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.959 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.959 INFO:teuthology.orchestra.run.smithi059.stdout: "cgroups_split": { 2023-10-08T13:00:38.959 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cgroups_split", 2023-10-08T13:00:38.959 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.959 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.960 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.960 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.960 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.960 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.960 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.960 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T13:00:38.960 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.961 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.961 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.961 INFO:teuthology.orchestra.run.smithi059.stdout: "config_checks_enabled": { 2023-10-08T13:00:38.961 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_checks_enabled", 2023-10-08T13:00:38.961 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.961 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.961 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.962 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:38.962 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.962 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.962 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.962 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T13:00:38.962 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.962 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.962 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.963 INFO:teuthology.orchestra.run.smithi059.stdout: "config_dashboard": { 2023-10-08T13:00:38.963 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_dashboard", 2023-10-08T13:00:38.963 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.963 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.963 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.963 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.964 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.964 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.964 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.964 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T13:00:38.964 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.964 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.964 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.965 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_alertmanager": { 2023-10-08T13:00:38.965 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_alertmanager", 2023-10-08T13:00:38.965 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.965 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.965 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.965 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T13:00:38.966 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.966 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.966 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.966 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:38.966 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.966 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.966 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.967 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_base": { 2023-10-08T13:00:38.967 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_base", 2023-10-08T13:00:38.967 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.967 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.967 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:38.967 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T13:00:38.967 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.968 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.968 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.968 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Container image name, without the tag", 2023-10-08T13:00:38.968 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.968 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.968 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.969 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_elasticsearch": { 2023-10-08T13:00:38.969 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_elasticsearch", 2023-10-08T13:00:38.969 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.969 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.969 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.969 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T13:00:38.969 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.969 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.970 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.970 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "elasticsearch container image", 2023-10-08T13:00:38.970 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.970 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.970 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.970 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_grafana": { 2023-10-08T13:00:38.971 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_grafana", 2023-10-08T13:00:38.971 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.971 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.971 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.971 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T13:00:38.971 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.971 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.971 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.972 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:38.972 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.972 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.972 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.972 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_haproxy": { 2023-10-08T13:00:38.972 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_haproxy", 2023-10-08T13:00:38.972 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.973 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.973 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.973 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T13:00:38.973 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.973 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.973 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.973 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "HAproxy container image", 2023-10-08T13:00:38.973 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.974 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.974 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.974 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_agent": { 2023-10-08T13:00:38.974 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_agent", 2023-10-08T13:00:38.974 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.974 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.975 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.975 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T13:00:38.975 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.975 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.975 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.975 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger agent container image", 2023-10-08T13:00:38.975 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.975 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.976 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.976 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_collector": { 2023-10-08T13:00:38.976 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_collector", 2023-10-08T13:00:38.976 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.976 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.976 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.977 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T13:00:38.977 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.977 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.977 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.977 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger collector container image", 2023-10-08T13:00:38.977 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.977 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.977 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.978 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_query": { 2023-10-08T13:00:38.978 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_query", 2023-10-08T13:00:38.978 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.978 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.978 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.978 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T13:00:38.978 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.979 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.979 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.979 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger query container image", 2023-10-08T13:00:38.979 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.979 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.979 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.979 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_keepalived": { 2023-10-08T13:00:38.980 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_keepalived", 2023-10-08T13:00:38.980 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.980 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.980 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.980 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T13:00:38.980 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.980 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.981 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.981 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Keepalived container image", 2023-10-08T13:00:38.981 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.981 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.981 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.981 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_loki": { 2023-10-08T13:00:38.981 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_loki", 2023-10-08T13:00:38.982 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.982 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.982 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.982 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T13:00:38.982 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.982 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.982 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.982 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Loki container image", 2023-10-08T13:00:38.983 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.983 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.983 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.983 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_node_exporter": { 2023-10-08T13:00:38.983 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_node_exporter", 2023-10-08T13:00:38.983 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.984 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.984 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.984 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T13:00:38.984 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.984 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.984 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.984 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:38.985 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.985 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.985 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.985 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nvmeof": { 2023-10-08T13:00:38.985 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nvmeof", 2023-10-08T13:00:38.985 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.985 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.986 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.986 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T13:00:38.986 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.986 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.986 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.986 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nvme-of container image", 2023-10-08T13:00:38.986 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.987 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.987 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.987 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_prometheus": { 2023-10-08T13:00:38.987 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_prometheus", 2023-10-08T13:00:38.987 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.987 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.987 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.988 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T13:00:38.988 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.988 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.988 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.988 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2023-10-08T13:00:38.988 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.989 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.989 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.989 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_promtail": { 2023-10-08T13:00:38.989 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_promtail", 2023-10-08T13:00:38.989 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.989 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.989 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.990 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T13:00:38.990 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.990 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.990 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.990 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Promtail container image", 2023-10-08T13:00:38.990 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.990 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.991 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.991 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_snmp_gateway": { 2023-10-08T13:00:38.991 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_snmp_gateway", 2023-10-08T13:00:38.991 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.991 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.991 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.991 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T13:00:38.992 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.992 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.992 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.992 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SNMP Gateway container image", 2023-10-08T13:00:38.992 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.992 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.992 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.993 INFO:teuthology.orchestra.run.smithi059.stdout: "container_init": { 2023-10-08T13:00:38.993 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_init", 2023-10-08T13:00:38.993 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:38.993 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.993 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.993 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:38.993 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.994 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.994 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.994 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T13:00:38.994 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.994 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.994 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.995 INFO:teuthology.orchestra.run.smithi059.stdout: "daemon_cache_timeout": { 2023-10-08T13:00:38.995 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "daemon_cache_timeout", 2023-10-08T13:00:38.995 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.995 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.995 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.995 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:38.995 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.995 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.996 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.996 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T13:00:38.996 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.996 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.996 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.996 INFO:teuthology.orchestra.run.smithi059.stdout: "default_cephadm_command_timeout": { 2023-10-08T13:00:38.996 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T13:00:38.997 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:38.997 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.997 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.997 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "900", 2023-10-08T13:00:38.997 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.997 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.997 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.998 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T13:00:38.998 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:38.998 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:38.998 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:38.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:38.998 INFO:teuthology.orchestra.run.smithi059.stdout: "default_registry": { 2023-10-08T13:00:38.998 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_registry", 2023-10-08T13:00:38.999 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:38.999 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:38.999 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:38.999 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io", 2023-10-08T13:00:38.999 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:38.999 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:38.999 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:38.999 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T13:00:39.000 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.000 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.000 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.000 INFO:teuthology.orchestra.run.smithi059.stdout: "device_cache_timeout": { 2023-10-08T13:00:39.000 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_cache_timeout", 2023-10-08T13:00:39.000 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.000 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.001 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.001 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1800", 2023-10-08T13:00:39.001 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.001 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.001 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.001 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache device inventory", 2023-10-08T13:00:39.001 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.002 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.002 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.002 INFO:teuthology.orchestra.run.smithi059.stdout: "device_enhanced_scan": { 2023-10-08T13:00:39.002 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_enhanced_scan", 2023-10-08T13:00:39.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.002 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.003 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.003 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.003 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.003 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.003 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T13:00:39.003 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.003 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.003 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.004 INFO:teuthology.orchestra.run.smithi059.stdout: "facts_cache_timeout": { 2023-10-08T13:00:39.004 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "facts_cache_timeout", 2023-10-08T13:00:39.004 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.004 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.004 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.004 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:39.004 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.005 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.005 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.005 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache host facts data", 2023-10-08T13:00:39.005 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.005 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.005 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.006 INFO:teuthology.orchestra.run.smithi059.stdout: "host_check_interval": { 2023-10-08T13:00:39.006 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "host_check_interval", 2023-10-08T13:00:39.006 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.006 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.006 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.006 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:39.006 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.007 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.007 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.007 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to perform a host check", 2023-10-08T13:00:39.007 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.007 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.007 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.007 INFO:teuthology.orchestra.run.smithi059.stdout: "inventory_list_all": { 2023-10-08T13:00:39.008 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "inventory_list_all", 2023-10-08T13:00:39.008 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.008 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.008 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.008 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.008 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.008 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.008 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.009 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T13:00:39.009 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.009 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.009 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.009 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.009 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.010 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.010 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.010 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.010 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.010 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.010 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.010 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.010 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.011 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.011 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.011 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.011 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.011 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.011 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.011 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.012 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.012 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.012 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.012 INFO:teuthology.orchestra.run.smithi059.stdout: "log_refresh_metadata": { 2023-10-08T13:00:39.012 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_refresh_metadata", 2023-10-08T13:00:39.012 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.013 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.013 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.013 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.013 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.013 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.013 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.013 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T13:00:39.013 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.014 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.014 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.014 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.014 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.014 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.014 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.015 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.015 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.015 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.015 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.015 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.015 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T13:00:39.015 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.015 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.016 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.016 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.016 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.016 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.016 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.016 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.016 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.017 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.017 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.017 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.017 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.017 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.017 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.017 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.018 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.018 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.018 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.018 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.018 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.018 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.018 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.019 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.019 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.019 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.019 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.019 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.019 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.019 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.020 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.020 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.020 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.020 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.020 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.020 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.020 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T13:00:39.021 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T13:00:39.021 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.021 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.021 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.021 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.021 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.021 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.022 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.022 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T13:00:39.022 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.022 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.022 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.022 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T13:00:39.023 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T13:00:39.023 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.023 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.023 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.023 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "*", 2023-10-08T13:00:39.023 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.023 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.023 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.024 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T13:00:39.024 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.024 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.024 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.024 INFO:teuthology.orchestra.run.smithi059.stdout: "max_count_per_host": { 2023-10-08T13:00:39.024 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_count_per_host", 2023-10-08T13:00:39.025 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.025 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.025 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.025 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:39.025 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.025 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.025 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.025 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of daemons per service per host", 2023-10-08T13:00:39.026 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.026 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.026 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.026 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd_draining_count": { 2023-10-08T13:00:39.026 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_osd_draining_count", 2023-10-08T13:00:39.026 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.027 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.027 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.027 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:39.027 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.027 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.027 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.027 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T13:00:39.027 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.028 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.028 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.028 INFO:teuthology.orchestra.run.smithi059.stdout: "migration_current": { 2023-10-08T13:00:39.028 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "migration_current", 2023-10-08T13:00:39.028 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.028 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.028 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.029 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.029 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.029 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.029 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.029 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "internal - do not modify", 2023-10-08T13:00:39.029 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.029 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.030 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.030 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2023-10-08T13:00:39.030 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2023-10-08T13:00:39.030 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.030 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.030 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.031 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "root", 2023-10-08T13:00:39.031 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.031 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.031 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.031 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm-package", 2023-10-08T13:00:39.031 INFO:teuthology.orchestra.run.smithi059.stdout: "root" 2023-10-08T13:00:39.031 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.032 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T13:00:39.032 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.032 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.032 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.032 INFO:teuthology.orchestra.run.smithi059.stdout: "prometheus_alerts_path": { 2023-10-08T13:00:39.032 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus_alerts_path", 2023-10-08T13:00:39.032 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.033 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.033 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.033 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T13:00:39.033 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.033 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.033 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.033 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T13:00:39.034 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.034 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.034 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.034 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_insecure": { 2023-10-08T13:00:39.034 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_insecure", 2023-10-08T13:00:39.034 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.035 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.035 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.035 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.035 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.035 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.035 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.035 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T13:00:39.035 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.036 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.036 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.036 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_password": { 2023-10-08T13:00:39.036 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_password", 2023-10-08T13:00:39.036 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.036 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.036 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.037 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.037 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.037 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.037 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.037 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T13:00:39.037 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.037 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.038 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.038 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_url": { 2023-10-08T13:00:39.038 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_url", 2023-10-08T13:00:39.038 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.038 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.038 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.038 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.039 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.039 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.039 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.039 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T13:00:39.039 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.039 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.039 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.040 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_username": { 2023-10-08T13:00:39.040 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_username", 2023-10-08T13:00:39.040 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.040 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.040 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.040 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.040 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.041 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.041 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.041 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T13:00:39.041 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.041 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.041 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.041 INFO:teuthology.orchestra.run.smithi059.stdout: "secure_monitoring_stack": { 2023-10-08T13:00:39.042 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secure_monitoring_stack", 2023-10-08T13:00:39.042 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.042 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.042 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.042 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.042 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.042 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.043 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.043 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T13:00:39.043 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.043 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.043 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.043 INFO:teuthology.orchestra.run.smithi059.stdout: "service_discovery_port": { 2023-10-08T13:00:39.043 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "service_discovery_port", 2023-10-08T13:00:39.044 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.044 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.044 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.044 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8765", 2023-10-08T13:00:39.044 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.044 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.044 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.044 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "cephadm service discovery port", 2023-10-08T13:00:39.045 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.045 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.045 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.045 INFO:teuthology.orchestra.run.smithi059.stdout: "ssh_config_file": { 2023-10-08T13:00:39.045 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssh_config_file", 2023-10-08T13:00:39.045 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.046 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.046 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.046 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.046 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.046 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.046 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.046 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T13:00:39.046 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.047 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.047 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.047 INFO:teuthology.orchestra.run.smithi059.stdout: "use_agent": { 2023-10-08T13:00:39.047 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_agent", 2023-10-08T13:00:39.047 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.047 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.048 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.048 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.048 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.048 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.048 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.048 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T13:00:39.048 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.048 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.049 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.049 INFO:teuthology.orchestra.run.smithi059.stdout: "use_repo_digest": { 2023-10-08T13:00:39.049 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_repo_digest", 2023-10-08T13:00:39.049 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.049 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.050 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.050 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.050 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.050 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.050 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.050 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T13:00:39.050 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.051 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.051 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.051 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_failed_host_check": { 2023-10-08T13:00:39.051 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_failed_host_check", 2023-10-08T13:00:39.051 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.051 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.051 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.052 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.052 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.052 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.052 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.052 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T13:00:39.052 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.052 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.053 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.053 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_daemons": { 2023-10-08T13:00:39.053 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_daemons", 2023-10-08T13:00:39.053 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.053 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.053 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.054 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.054 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.054 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.054 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.054 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T13:00:39.054 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.054 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.055 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.055 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_hosts": { 2023-10-08T13:00:39.055 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_hosts", 2023-10-08T13:00:39.055 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.055 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.055 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.055 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.056 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.056 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.056 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.056 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T13:00:39.056 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.056 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.056 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.057 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.057 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.057 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crash", 2023-10-08T13:00:39.057 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.057 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.057 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.058 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.058 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.058 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.058 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.058 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.058 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.058 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.059 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.059 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.059 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.059 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.059 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.059 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.059 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.059 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.060 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.060 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.060 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.060 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.060 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.060 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.060 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.061 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.061 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.061 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.061 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.061 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.061 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.061 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.062 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.062 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.062 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.062 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.062 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.062 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.062 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.063 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.063 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.063 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.063 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.063 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.063 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.063 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.064 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.064 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.064 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.064 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.064 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.064 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.064 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.064 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.065 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.065 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.065 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.065 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.065 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.065 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.065 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.066 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.066 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.066 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.066 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.066 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.066 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.066 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.067 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.067 INFO:teuthology.orchestra.run.smithi059.stdout: "retain_interval": { 2023-10-08T13:00:39.067 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retain_interval", 2023-10-08T13:00:39.067 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.067 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.067 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.067 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "31536000", 2023-10-08T13:00:39.068 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.068 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.068 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.068 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T13:00:39.068 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.068 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.068 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.069 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_recent_interval": { 2023-10-08T13:00:39.069 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_recent_interval", 2023-10-08T13:00:39.069 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.069 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.069 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.069 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1209600", 2023-10-08T13:00:39.069 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.070 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.070 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.070 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T13:00:39.070 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.070 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.070 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.070 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.071 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.071 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dashboard", 2023-10-08T13:00:39.071 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.071 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.071 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.071 INFO:teuthology.orchestra.run.smithi059.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T13:00:39.072 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T13:00:39.072 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.072 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.072 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.072 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:39.072 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.072 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.072 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.073 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.073 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.073 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.073 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.073 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T13:00:39.073 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T13:00:39.073 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.074 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.074 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.074 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.074 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.074 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.074 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.074 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.075 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.075 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.075 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.075 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T13:00:39.075 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T13:00:39.075 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_ENABLED": { 2023-10-08T13:00:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T13:00:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T13:00:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T13:00:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T13:00:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T13:00:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T13:00:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T13:00:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T13:00:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T13:00:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T13:00:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T13:00:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T13:00:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T13:00:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T13:00:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T13:00:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T13:00:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T13:00:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T13:00:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T13:00:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T13:00:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T13:00:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T13:00:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T13:00:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2023-10-08T13:00:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T13:00:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T13:00:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_URL": { 2023-10-08T13:00:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_URL", 2023-10-08T13:00:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T13:00:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T13:00:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2023-10-08T13:00:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T13:00:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T13:00:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T13:00:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T13:00:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T13:00:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T13:00:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T13:00:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T13:00:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T13:00:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T13:00:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T13:00:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T13:00:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T13:00:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T13:00:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T13:00:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T13:00:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T13:00:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T13:00:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T13:00:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T13:00:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T13:00:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T13:00:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T13:00:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T13:00:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T13:00:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T13:00:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T13:00:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T13:00:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T13:00:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T13:00:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T13:00:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T13:00:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T13:00:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T13:00:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T13:00:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8", 2023-10-08T13:00:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T13:00:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T13:00:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "45", 2023-10-08T13:00:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T13:00:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T13:00:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T13:00:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T13:00:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2023-10-08T13:00:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T13:00:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T13:00:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T13:00:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T13:00:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T13:00:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T13:00:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T13:00:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T13:00:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T13:00:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T13:00:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T13:00:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T13:00:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "cross_origin_url": { 2023-10-08T13:00:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cross_origin_url", 2023-10-08T13:00:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "crt_file": { 2023-10-08T13:00:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crt_file", 2023-10-08T13:00:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "debug": { 2023-10-08T13:00:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "debug", 2023-10-08T13:00:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable/disable debug options", 2023-10-08T13:00:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "jwt_token_ttl": { 2023-10-08T13:00:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "jwt_token_ttl", 2023-10-08T13:00:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "28800", 2023-10-08T13:00:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2023-10-08T13:00:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2023-10-08T13:00:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "motd": { 2023-10-08T13:00:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "motd", 2023-10-08T13:00:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "The message of the day", 2023-10-08T13:00:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect_resolve_ip_addr": { 2023-10-08T13:00:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T13:00:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.179 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.179 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2023-10-08T13:00:39.179 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2023-10-08T13:00:39.179 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.179 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.179 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.179 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2023-10-08T13:00:39.180 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.180 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.180 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.180 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.180 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.180 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.181 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.181 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2023-10-08T13:00:39.181 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2023-10-08T13:00:39.181 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.181 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.181 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.181 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8080", 2023-10-08T13:00:39.182 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.182 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.182 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.182 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.182 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.182 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.182 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.183 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2023-10-08T13:00:39.183 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2023-10-08T13:00:39.183 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.183 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.183 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.183 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.183 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.183 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.184 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.184 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.184 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.184 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.184 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.184 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl_server_port": { 2023-10-08T13:00:39.185 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl_server_port", 2023-10-08T13:00:39.185 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.185 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.185 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.185 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8443", 2023-10-08T13:00:39.185 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.185 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.185 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.186 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.186 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.186 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.186 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.186 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2023-10-08T13:00:39.186 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2023-10-08T13:00:39.186 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.187 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.187 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.187 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "redirect", 2023-10-08T13:00:39.187 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.187 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.187 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.187 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.187 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect" 2023-10-08T13:00:39.188 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.188 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.188 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.188 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.188 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.188 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2023-10-08T13:00:39.189 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2023-10-08T13:00:39.189 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.189 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.189 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.189 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2023-10-08T13:00:39.189 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2023-10-08T13:00:39.189 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2023-10-08T13:00:39.190 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.190 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.190 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.190 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.190 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.190 INFO:teuthology.orchestra.run.smithi059.stdout: "url_prefix": { 2023-10-08T13:00:39.191 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url_prefix", 2023-10-08T13:00:39.191 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.191 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.191 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.191 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.191 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.191 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.191 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.192 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.192 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.192 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.192 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.192 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.192 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.193 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2023-10-08T13:00:39.193 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.193 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.193 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.193 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_monitoring": { 2023-10-08T13:00:39.193 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_monitoring", 2023-10-08T13:00:39.193 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.194 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.194 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.194 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.194 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.194 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.194 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.194 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "monitor device health metrics", 2023-10-08T13:00:39.195 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.195 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.195 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.195 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.195 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.195 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.195 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.196 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.196 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.196 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.196 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.196 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.196 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.196 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.196 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.197 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.197 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.197 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.197 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.197 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.197 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.197 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.198 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.198 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.198 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.198 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.198 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.198 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.199 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.199 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.199 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.199 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.199 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.199 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.199 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.199 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.200 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.200 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.200 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.200 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.200 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.200 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.201 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.201 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.201 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.201 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.201 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.201 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.201 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.201 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.202 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.202 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.202 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.202 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.202 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.202 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.203 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.203 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.203 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.203 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.203 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.203 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.203 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.204 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.204 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.204 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.204 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.204 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.204 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.204 INFO:teuthology.orchestra.run.smithi059.stdout: "mark_out_threshold": { 2023-10-08T13:00:39.205 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mark_out_threshold", 2023-10-08T13:00:39.205 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.205 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.205 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.205 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2419200", 2023-10-08T13:00:39.205 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.205 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.205 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.206 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T13:00:39.206 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.206 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.206 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.206 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": { 2023-10-08T13:00:39.206 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_name", 2023-10-08T13:00:39.206 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.207 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.207 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.207 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "device_health_metrics", 2023-10-08T13:00:39.207 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.207 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.207 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.207 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T13:00:39.208 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.208 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.208 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.208 INFO:teuthology.orchestra.run.smithi059.stdout: "retention_period": { 2023-10-08T13:00:39.208 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retention_period", 2023-10-08T13:00:39.208 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.208 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.209 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.209 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15552000", 2023-10-08T13:00:39.209 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.209 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.209 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.209 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain device health metrics", 2023-10-08T13:00:39.209 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.209 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.210 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.210 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_frequency": { 2023-10-08T13:00:39.210 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_frequency", 2023-10-08T13:00:39.210 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.210 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.210 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.211 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2023-10-08T13:00:39.211 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.211 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.211 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.211 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T13:00:39.211 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.211 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.212 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.212 INFO:teuthology.orchestra.run.smithi059.stdout: "self_heal": { 2023-10-08T13:00:39.212 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "self_heal", 2023-10-08T13:00:39.212 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.212 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.212 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.212 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.213 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.213 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.213 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.213 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T13:00:39.213 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.213 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.213 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.214 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:39.214 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:39.214 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.214 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.214 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.214 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:39.214 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.215 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.215 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.215 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T13:00:39.215 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.215 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.215 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.215 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_threshold": { 2023-10-08T13:00:39.216 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_threshold", 2023-10-08T13:00:39.216 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.216 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.216 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.216 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7257600", 2023-10-08T13:00:39.216 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.216 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.217 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.217 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T13:00:39.217 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.217 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.217 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.217 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.217 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.218 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "diskprediction_local", 2023-10-08T13:00:39.218 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.218 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.218 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.218 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.218 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.218 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.219 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.219 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.219 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.219 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.219 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.219 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.219 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.220 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.220 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.220 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.220 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.220 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.220 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.220 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.220 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.221 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.221 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.221 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.221 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.221 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.221 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.222 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.222 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.222 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.222 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.222 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.222 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.222 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.222 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.223 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.223 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.223 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.223 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.223 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.223 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.224 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.225 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.226 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "predict_interval": { 2023-10-08T13:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predict_interval", 2023-10-08T13:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2023-10-08T13:00:39.228 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.229 INFO:teuthology.orchestra.run.smithi059.stdout: "predictor_model": { 2023-10-08T13:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predictor_model", 2023-10-08T13:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "prophetstor", 2023-10-08T13:00:39.230 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2023-10-08T13:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.232 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.233 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.234 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "influx", 2023-10-08T13:00:39.234 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": false, 2023-10-08T13:00:39.234 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "influxdb python module not found", 2023-10-08T13:00:39.234 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.234 INFO:teuthology.orchestra.run.smithi059.stdout: "batch_size": { 2023-10-08T13:00:39.235 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "batch_size", 2023-10-08T13:00:39.235 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.235 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.235 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.235 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5000", 2023-10-08T13:00:39.235 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.235 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.235 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.236 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T13:00:39.236 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.236 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.236 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.236 INFO:teuthology.orchestra.run.smithi059.stdout: "database": { 2023-10-08T13:00:39.236 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "database", 2023-10-08T13:00:39.236 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.237 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.237 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.237 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "ceph", 2023-10-08T13:00:39.237 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.237 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.237 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.237 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T13:00:39.237 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.238 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.238 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.238 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": { 2023-10-08T13:00:39.238 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hostname", 2023-10-08T13:00:39.238 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.238 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.239 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.239 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.239 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.239 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.239 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.239 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server hostname", 2023-10-08T13:00:39.239 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.239 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.240 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.240 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:39.240 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:39.240 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.240 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.240 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.241 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "30", 2023-10-08T13:00:39.241 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "5", 2023-10-08T13:00:39.241 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.241 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.241 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T13:00:39.241 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.241 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.241 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.242 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.242 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.242 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.242 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.242 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.242 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.243 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.243 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.243 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.243 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.243 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.243 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.243 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.244 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.244 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.244 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.244 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.244 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.244 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.244 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.245 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.245 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.245 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.245 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.245 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.245 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.245 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.245 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.246 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.246 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.246 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.246 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.246 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.246 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.246 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.247 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.247 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.247 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.247 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.247 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.247 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.247 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.248 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.248 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.248 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.248 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.248 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.248 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.248 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.248 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.249 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.249 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.249 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.249 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.249 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.249 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.250 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.250 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.250 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.250 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.250 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.250 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.250 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.250 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.251 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.251 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.251 INFO:teuthology.orchestra.run.smithi059.stdout: "password": { 2023-10-08T13:00:39.251 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "password", 2023-10-08T13:00:39.251 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.252 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.252 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.252 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.252 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.252 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.252 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.252 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "password of InfluxDB server user", 2023-10-08T13:00:39.253 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.253 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.253 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.253 INFO:teuthology.orchestra.run.smithi059.stdout: "port": { 2023-10-08T13:00:39.253 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "port", 2023-10-08T13:00:39.253 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.253 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.254 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.254 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8086", 2023-10-08T13:00:39.254 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.254 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.254 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.254 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server port", 2023-10-08T13:00:39.254 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.254 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.255 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.255 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2023-10-08T13:00:39.255 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2023-10-08T13:00:39.255 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.255 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.255 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.255 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "false", 2023-10-08T13:00:39.256 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.256 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.256 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.256 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:00:39.256 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.256 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.256 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.257 INFO:teuthology.orchestra.run.smithi059.stdout: "threads": { 2023-10-08T13:00:39.257 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threads", 2023-10-08T13:00:39.257 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.257 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.257 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.257 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:39.257 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:39.258 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "32", 2023-10-08T13:00:39.258 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.258 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T13:00:39.258 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.258 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.258 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.259 INFO:teuthology.orchestra.run.smithi059.stdout: "username": { 2023-10-08T13:00:39.259 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "username", 2023-10-08T13:00:39.259 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.259 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.259 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.259 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.259 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.259 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.260 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.260 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "username of InfluxDB server user", 2023-10-08T13:00:39.260 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.260 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.260 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.260 INFO:teuthology.orchestra.run.smithi059.stdout: "verify_ssl": { 2023-10-08T13:00:39.261 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "verify_ssl", 2023-10-08T13:00:39.261 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.261 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.261 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.261 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "true", 2023-10-08T13:00:39.261 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.261 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.261 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.262 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:00:39.262 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.262 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.262 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.262 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.262 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.263 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "insights", 2023-10-08T13:00:39.263 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.263 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.263 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.263 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.263 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.263 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.264 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.264 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.264 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.264 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.264 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.264 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.264 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.265 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.265 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.265 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.265 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.265 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.265 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.265 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.265 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.266 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.266 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.266 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.266 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.266 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.266 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.266 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.267 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.267 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.267 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.267 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.267 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.267 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.267 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.268 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.268 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.268 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.268 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.268 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.268 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.268 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.269 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.269 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.269 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.269 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.269 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.269 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.269 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.269 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.270 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.270 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.270 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.270 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.270 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.270 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.271 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.271 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.271 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.271 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.271 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.271 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.271 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.272 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.272 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.272 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.272 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.272 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.272 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.273 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "iostat", 2023-10-08T13:00:39.273 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.273 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.273 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.273 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.273 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.274 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.274 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.274 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.274 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.274 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.274 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.274 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.275 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.275 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.275 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.275 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.275 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.275 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.275 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.276 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.276 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.276 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.276 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.276 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.276 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.276 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.277 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.277 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.277 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.277 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.277 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.277 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.277 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.277 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.278 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.278 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.278 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.278 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.278 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.278 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.279 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.279 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.279 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.279 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.279 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.279 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.279 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.279 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.280 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.280 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.280 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.280 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.280 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.280 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.280 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.280 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "k8sevents", 2023-10-08T13:00:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.284 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_event_retention_days": { 2023-10-08T13:00:39.284 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ceph_event_retention_days", 2023-10-08T13:00:39.284 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.284 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.284 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.284 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7", 2023-10-08T13:00:39.284 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.285 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.285 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.285 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T13:00:39.285 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.285 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.285 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.286 INFO:teuthology.orchestra.run.smithi059.stdout: "config_check_secs": { 2023-10-08T13:00:39.286 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_check_secs", 2023-10-08T13:00:39.286 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.286 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.286 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.286 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:39.286 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "10", 2023-10-08T13:00:39.286 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.287 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.287 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T13:00:39.287 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.287 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.287 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.287 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.287 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.288 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.288 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.288 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.288 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.288 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.288 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.288 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.289 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.289 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.289 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.289 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.289 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.289 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.289 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.289 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.290 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.290 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.290 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.290 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.290 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.290 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.291 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.291 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.291 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.291 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.291 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.291 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.291 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.292 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.292 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.292 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.292 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.292 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.292 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.292 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.293 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.293 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.293 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.293 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.293 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.293 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.293 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.294 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.294 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.294 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.294 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.294 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.294 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.294 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.294 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.295 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.295 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.295 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.295 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.295 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.295 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.296 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.296 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.296 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.296 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.296 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.296 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.296 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.296 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.297 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.297 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.297 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "localpool", 2023-10-08T13:00:39.297 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.297 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.297 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.298 INFO:teuthology.orchestra.run.smithi059.stdout: "failure_domain": { 2023-10-08T13:00:39.298 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "failure_domain", 2023-10-08T13:00:39.298 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.298 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.298 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.298 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "host", 2023-10-08T13:00:39.298 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.299 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.299 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.299 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "failure domain for any created local pool", 2023-10-08T13:00:39.299 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T13:00:39.299 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.299 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.299 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.300 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.300 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.300 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.300 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.300 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.300 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.300 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.300 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.301 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.301 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.301 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.301 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.301 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.301 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.301 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.302 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.302 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.302 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.302 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.302 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.302 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.302 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.303 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.303 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.303 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.303 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.303 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.303 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.303 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.303 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.304 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.304 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.304 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.304 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.304 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.304 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.305 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.305 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.305 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.305 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.305 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.305 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.305 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.305 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.306 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.306 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.306 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.306 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.306 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.306 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.306 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.306 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.307 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.307 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.307 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.307 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.307 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.307 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.308 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.308 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.308 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.308 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.308 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.308 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.308 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.309 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": { 2023-10-08T13:00:39.309 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_size", 2023-10-08T13:00:39.309 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.309 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.309 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.309 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.309 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.309 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.310 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.310 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default min_size for any created local pool", 2023-10-08T13:00:39.310 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T13:00:39.310 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.310 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.310 INFO:teuthology.orchestra.run.smithi059.stdout: "num_rep": { 2023-10-08T13:00:39.310 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "num_rep", 2023-10-08T13:00:39.311 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.311 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.311 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.311 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3", 2023-10-08T13:00:39.311 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.311 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.311 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.311 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default replica count for any created local pool", 2023-10-08T13:00:39.312 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.312 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.312 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.312 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": { 2023-10-08T13:00:39.312 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_num", 2023-10-08T13:00:39.312 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.313 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.313 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.313 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "128", 2023-10-08T13:00:39.313 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.313 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.313 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.313 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T13:00:39.314 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.314 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.314 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.314 INFO:teuthology.orchestra.run.smithi059.stdout: "prefix": { 2023-10-08T13:00:39.314 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prefix", 2023-10-08T13:00:39.314 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.314 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.315 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.315 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.315 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.315 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.315 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.315 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name prefix for any created local pool", 2023-10-08T13:00:39.315 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.316 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.316 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.316 INFO:teuthology.orchestra.run.smithi059.stdout: "subtree": { 2023-10-08T13:00:39.316 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subtree", 2023-10-08T13:00:39.316 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.316 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.317 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.317 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "rack", 2023-10-08T13:00:39.317 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.317 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.317 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.317 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T13:00:39.317 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T13:00:39.317 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.318 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.318 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.318 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.318 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mds_autoscaler", 2023-10-08T13:00:39.318 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.319 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.319 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.319 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.319 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.319 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.319 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.319 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.319 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.320 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.320 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.320 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.320 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.320 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.320 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.320 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.321 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.321 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.321 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.321 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.321 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.321 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.321 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.322 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.322 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.322 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.322 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.322 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.322 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.322 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.325 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.325 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.325 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.325 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.326 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.326 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.326 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.326 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.326 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.326 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.327 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.327 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.327 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.327 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.327 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.327 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.327 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.327 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirroring", 2023-10-08T13:00:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.340 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.340 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.340 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.340 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.340 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.340 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.340 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.341 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.341 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.341 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "nfs", 2023-10-08T13:00:39.341 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.341 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.341 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.342 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.342 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.342 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.342 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.342 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.342 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.342 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.343 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.343 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.343 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.343 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.343 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.343 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.343 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.344 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.344 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.344 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.344 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.344 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.344 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.345 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.345 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.345 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.345 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.345 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.345 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.345 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.346 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.346 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.346 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.346 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.346 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.346 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.347 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.347 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.347 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.347 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.347 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.347 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.347 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.347 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.348 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.348 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.348 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.348 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.348 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.348 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.348 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.349 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.349 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.349 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.349 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.349 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.349 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.349 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.350 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.350 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.350 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.350 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.350 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.350 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.350 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.351 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.351 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.351 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.351 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.352 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2023-10-08T13:00:39.352 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.352 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.352 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.352 INFO:teuthology.orchestra.run.smithi059.stdout: "fail_fs": { 2023-10-08T13:00:39.352 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "fail_fs", 2023-10-08T13:00:39.352 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.352 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.353 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.353 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.353 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.353 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.353 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.353 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T13:00:39.353 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.354 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.354 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.354 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.354 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.354 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.354 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.354 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.355 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.355 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.355 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.355 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.355 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.355 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.355 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.356 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.356 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.356 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.356 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.356 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.356 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.356 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.356 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.357 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.357 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.357 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.357 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.357 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.357 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.357 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.358 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.358 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.358 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.358 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.358 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.358 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.358 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.359 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.359 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.359 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.359 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.359 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.359 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.359 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.360 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.360 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.360 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.360 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.360 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.360 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.360 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.360 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.361 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.361 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.361 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.361 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.361 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.361 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.361 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.362 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.362 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.362 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.362 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.362 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.362 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.362 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.363 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.363 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.363 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.363 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator": { 2023-10-08T13:00:39.363 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2023-10-08T13:00:39.363 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.363 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.364 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.364 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.364 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.364 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.364 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.364 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2023-10-08T13:00:39.364 INFO:teuthology.orchestra.run.smithi059.stdout: "rook", 2023-10-08T13:00:39.365 INFO:teuthology.orchestra.run.smithi059.stdout: "test_orchestrator" 2023-10-08T13:00:39.365 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.365 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Orchestrator backend", 2023-10-08T13:00:39.365 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.365 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.365 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.366 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_perf_query", 2023-10-08T13:00:39.366 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.366 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.366 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.366 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.366 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.367 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.367 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.367 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.367 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.367 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.367 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.367 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.368 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.368 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.368 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.368 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.368 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.368 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.368 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.368 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.369 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.369 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.369 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.369 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.369 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.369 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.370 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.370 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.370 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.370 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.370 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.370 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.370 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.370 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.371 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.371 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.371 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.371 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.371 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.371 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.372 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.372 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.372 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.372 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.372 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.372 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.372 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.372 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.373 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.373 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.373 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.373 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.373 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.373 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.373 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.373 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.374 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.374 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.374 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.374 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.374 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.374 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.374 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.375 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.375 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.375 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.375 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.375 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.375 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.375 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.376 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.376 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_support", 2023-10-08T13:00:39.376 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.376 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.376 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.376 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.377 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.377 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.377 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.377 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.377 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.377 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.377 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.377 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.378 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.378 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.378 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.378 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.378 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.378 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.378 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.379 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.379 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.379 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.379 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.379 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.379 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.380 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.380 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.380 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.380 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.380 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.380 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.380 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.380 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.381 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.381 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.381 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.381 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.381 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.381 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.381 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.382 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.382 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.382 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.382 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.382 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.382 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.382 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.383 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.383 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.383 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.383 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.383 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.383 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.383 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.384 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.384 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.384 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.384 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.384 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.384 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.384 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.385 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.385 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.385 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.385 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.385 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.385 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.385 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.385 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.386 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.386 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.386 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_autoscaler", 2023-10-08T13:00:39.386 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.386 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.387 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.387 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.387 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.387 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.387 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.387 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.387 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.387 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.388 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.388 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.388 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.388 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.388 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.388 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.389 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.389 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.389 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.389 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.389 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.389 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.389 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.390 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.390 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.390 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.390 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.390 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.390 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.390 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.391 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.391 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.391 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.391 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.391 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.391 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.392 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.392 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.392 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.392 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.392 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.392 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.392 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.392 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.393 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.393 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.393 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.393 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.393 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.393 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.393 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.394 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.394 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.394 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.394 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.394 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.394 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.395 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.395 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.395 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.395 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.395 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.395 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.395 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.395 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.396 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.396 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.396 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:39.396 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:39.396 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.396 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.397 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.397 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:39.397 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.397 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.397 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.397 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.397 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.397 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.398 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.398 INFO:teuthology.orchestra.run.smithi059.stdout: "threshold": { 2023-10-08T13:00:39.398 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threshold", 2023-10-08T13:00:39.398 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:39.398 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.398 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.399 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2023-10-08T13:00:39.399 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1.0", 2023-10-08T13:00:39.399 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.399 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.399 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "scaling threshold", 2023-10-08T13:00:39.399 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T13:00:39.399 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.399 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.400 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.400 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.400 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "progress", 2023-10-08T13:00:39.400 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.400 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.400 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.401 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_pg_recovery_event": { 2023-10-08T13:00:39.401 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_pg_recovery_event", 2023-10-08T13:00:39.401 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.401 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.401 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.401 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.401 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.402 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.402 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.402 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T13:00:39.402 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.402 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.402 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.402 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2023-10-08T13:00:39.403 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2023-10-08T13:00:39.403 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.403 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.403 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.403 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.403 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.403 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.403 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.404 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.404 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.404 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.404 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.404 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.404 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.405 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.405 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.405 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.405 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.405 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.405 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.405 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.406 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.406 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.406 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.406 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.406 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.406 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.406 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.406 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.407 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.407 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.407 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.407 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.407 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.408 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.408 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.408 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.408 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.408 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.408 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.408 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.408 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.409 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.409 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.409 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.409 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.409 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.409 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.409 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.410 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.410 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.410 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.410 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.410 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.410 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.410 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.411 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.411 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.411 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.411 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.411 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.411 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.411 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.412 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.412 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.412 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.412 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.412 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.412 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.412 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.413 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.413 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.413 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.413 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.413 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.413 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.413 INFO:teuthology.orchestra.run.smithi059.stdout: "max_completed_events": { 2023-10-08T13:00:39.414 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_completed_events", 2023-10-08T13:00:39.414 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.414 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.414 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.414 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "50", 2023-10-08T13:00:39.414 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.414 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.415 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.415 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "number of past completed events to remember", 2023-10-08T13:00:39.415 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.415 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.415 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.415 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2023-10-08T13:00:39.416 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2023-10-08T13:00:39.416 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.416 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.416 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.416 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2023-10-08T13:00:39.416 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.416 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.417 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.417 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long the module is going to sleep", 2023-10-08T13:00:39.417 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.417 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.417 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.417 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.417 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.418 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus", 2023-10-08T13:00:39.418 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.418 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.418 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.418 INFO:teuthology.orchestra.run.smithi059.stdout: "cache": { 2023-10-08T13:00:39.418 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cache", 2023-10-08T13:00:39.419 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.419 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.419 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.419 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.419 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.419 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.419 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.419 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.420 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.420 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.420 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.420 INFO:teuthology.orchestra.run.smithi059.stdout: "exclude_perf_counters": { 2023-10-08T13:00:39.420 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "exclude_perf_counters", 2023-10-08T13:00:39.420 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.420 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.421 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.421 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.421 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.421 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.421 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.421 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T13:00:39.421 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T13:00:39.422 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.422 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.422 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.422 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.422 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.422 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.422 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.423 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.423 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.423 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.423 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.423 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.423 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.423 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.424 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.424 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.424 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.424 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.424 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.424 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.424 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.424 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.425 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.425 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.425 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.425 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.425 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.425 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.425 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.426 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.426 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.426 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.426 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.426 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.426 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.427 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.427 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.427 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.427 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.427 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.427 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.427 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.427 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.428 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.428 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.428 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.428 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.428 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.428 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.428 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.428 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.429 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.429 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.429 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.429 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.429 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.429 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.429 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.430 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.430 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.430 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.430 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.430 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.430 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.430 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.431 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.431 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.431 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.431 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools": { 2023-10-08T13:00:39.431 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools", 2023-10-08T13:00:39.431 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.431 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.432 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.432 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.432 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.432 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.432 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.432 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.432 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.433 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.433 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.433 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T13:00:39.433 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T13:00:39.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.433 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.434 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.434 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300", 2023-10-08T13:00:39.434 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.434 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.434 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.434 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.434 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.434 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.435 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.435 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_interval": { 2023-10-08T13:00:39.435 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_interval", 2023-10-08T13:00:39.435 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:39.435 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.435 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.435 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15.0", 2023-10-08T13:00:39.436 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.436 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.436 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.436 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.436 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.436 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.436 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.437 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2023-10-08T13:00:39.437 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2023-10-08T13:00:39.437 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.437 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.437 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.437 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2023-10-08T13:00:39.437 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.438 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.438 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.438 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T13:00:39.438 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.438 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.438 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.438 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2023-10-08T13:00:39.439 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2023-10-08T13:00:39.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.439 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.439 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "9283", 2023-10-08T13:00:39.439 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.439 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.439 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.440 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T13:00:39.440 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.440 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.440 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.440 INFO:teuthology.orchestra.run.smithi059.stdout: "stale_cache_strategy": { 2023-10-08T13:00:39.440 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stale_cache_strategy", 2023-10-08T13:00:39.441 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.441 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.441 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.441 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "log", 2023-10-08T13:00:39.441 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.441 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.441 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.441 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.442 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.442 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.442 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.442 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2023-10-08T13:00:39.442 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2023-10-08T13:00:39.442 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.443 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.443 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.443 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "default", 2023-10-08T13:00:39.443 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.443 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.443 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.443 INFO:teuthology.orchestra.run.smithi059.stdout: "default", 2023-10-08T13:00:39.444 INFO:teuthology.orchestra.run.smithi059.stdout: "error" 2023-10-08T13:00:39.444 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.444 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.444 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.444 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.444 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.444 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2023-10-08T13:00:39.445 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2023-10-08T13:00:39.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.445 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.445 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.445 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2023-10-08T13:00:39.445 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2023-10-08T13:00:39.445 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2023-10-08T13:00:39.446 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.446 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.446 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.446 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.446 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.447 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2023-10-08T13:00:39.447 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.447 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.447 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.447 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.448 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.448 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.448 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.448 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.448 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.448 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.448 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.448 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.449 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.449 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.449 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.449 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.449 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.449 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.449 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.449 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.450 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.450 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.450 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.450 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.450 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.450 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.451 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.451 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.451 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.451 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.451 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.451 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.451 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.451 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.452 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.452 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.452 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.452 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.452 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.452 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.453 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.453 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.453 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.453 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.453 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.453 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.453 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.454 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.454 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.454 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.454 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.454 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.454 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.454 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.454 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.455 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.455 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.455 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.455 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.455 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.455 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.456 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.456 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.456 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.456 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.456 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.456 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.457 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.457 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.457 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_snap_create": { 2023-10-08T13:00:39.457 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_snap_create", 2023-10-08T13:00:39.457 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.457 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.457 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.458 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2023-10-08T13:00:39.458 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.458 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.458 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.458 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.458 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.459 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.459 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.459 INFO:teuthology.orchestra.run.smithi059.stdout: "mirror_snapshot_schedule": { 2023-10-08T13:00:39.459 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T13:00:39.460 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.460 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.460 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.460 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.460 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.460 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.461 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.461 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.461 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.461 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.461 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.462 INFO:teuthology.orchestra.run.smithi059.stdout: "trash_purge_schedule": { 2023-10-08T13:00:39.462 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "trash_purge_schedule", 2023-10-08T13:00:39.462 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.462 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.462 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.462 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.463 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.463 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.463 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.463 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.463 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.463 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.464 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.464 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.464 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.464 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "restful", 2023-10-08T13:00:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_auth": { 2023-10-08T13:00:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_auth", 2023-10-08T13:00:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2023-10-08T13:00:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2023-10-08T13:00:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2023-10-08T13:00:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2023-10-08T13:00:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2023-10-08T13:00:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2023-10-08T13:00:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rgw", 2023-10-08T13:00:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rook", 2023-10-08T13:00:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "drive_group_interval": { 2023-10-08T13:00:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "drive_group_interval", 2023-10-08T13:00:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300.0", 2023-10-08T13:00:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T13:00:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.502 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.502 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.502 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.502 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.502 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.502 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.502 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.503 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.503 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.503 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.503 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.503 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.503 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.503 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.503 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.504 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.504 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.504 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.504 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.504 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.504 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.504 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.505 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.505 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.505 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.505 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.505 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.505 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.505 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "storage_class": { 2023-10-08T13:00:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "storage_class", 2023-10-08T13:00:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "local", 2023-10-08T13:00:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T13:00:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "selftest", 2023-10-08T13:00:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "roption1": { 2023-10-08T13:00:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption1", 2023-10-08T13:00:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "roption2": { 2023-10-08T13:00:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption2", 2023-10-08T13:00:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "xyz", 2023-10-08T13:00:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption1": { 2023-10-08T13:00:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption1", 2023-10-08T13:00:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption2": { 2023-10-08T13:00:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption2", 2023-10-08T13:00:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption3": { 2023-10-08T13:00:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption3", 2023-10-08T13:00:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2023-10-08T13:00:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption4": { 2023-10-08T13:00:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption4", 2023-10-08T13:00:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption5": { 2023-10-08T13:00:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption5", 2023-10-08T13:00:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption6": { 2023-10-08T13:00:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption6", 2023-10-08T13:00:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption7": { 2023-10-08T13:00:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption7", 2023-10-08T13:00:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2023-10-08T13:00:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "42", 2023-10-08T13:00:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "testkey": { 2023-10-08T13:00:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testkey", 2023-10-08T13:00:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "testlkey": { 2023-10-08T13:00:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testlkey", 2023-10-08T13:00:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "testnewline": { 2023-10-08T13:00:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testnewline", 2023-10-08T13:00:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2023-10-08T13:00:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_m_granularity": { 2023-10-08T13:00:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_m_granularity", 2023-10-08T13:00:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T13:00:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: "dump_on_update": { 2023-10-08T13:00:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dump_on_update", 2023-10-08T13:00:39.545 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.546 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.546 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.546 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "dump database to debug log on update", 2023-10-08T13:00:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.556 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.556 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.556 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.556 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.556 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.556 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.556 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.557 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.557 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.557 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.557 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stats", 2023-10-08T13:00:39.557 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.557 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.558 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.558 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.558 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.558 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.558 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.558 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.558 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.559 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.559 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.559 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.559 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.559 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.559 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.559 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.560 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.560 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.560 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.560 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.560 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.560 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.560 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.561 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.561 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.561 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.561 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.561 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.562 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.562 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.562 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.562 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.562 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.562 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.563 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.563 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.563 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.563 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.563 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.564 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.564 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.564 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.564 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.564 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.564 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.564 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.565 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.565 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.565 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.565 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.565 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.565 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.565 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.566 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.566 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.566 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.566 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.566 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.567 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.567 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.567 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.567 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.567 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.567 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.568 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.568 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.568 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.568 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.568 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.568 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.569 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "status", 2023-10-08T13:00:39.569 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.569 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.569 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.569 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.570 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.570 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.570 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.570 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.570 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.570 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.571 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.571 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.571 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.571 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.571 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.571 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.571 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.572 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.572 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.572 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.572 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.572 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.572 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.573 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.573 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.573 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.573 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.573 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.574 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.574 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.574 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.574 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.574 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.574 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.575 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.575 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.575 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.575 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.575 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.575 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.576 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.576 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.576 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.576 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.576 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.576 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.576 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.577 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.577 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.577 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.577 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.577 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.577 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.577 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.578 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.578 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.578 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.578 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.578 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.578 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.578 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.579 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.579 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.579 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.579 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.579 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.579 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.579 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.579 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.580 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telegraf", 2023-10-08T13:00:39.580 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.580 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.581 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.581 INFO:teuthology.orchestra.run.smithi059.stdout: "address": { 2023-10-08T13:00:39.581 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "address", 2023-10-08T13:00:39.581 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.581 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.581 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.581 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T13:00:39.581 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.582 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.582 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.582 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.582 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.582 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.582 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.583 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:39.583 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:39.583 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.583 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.583 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.583 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15", 2023-10-08T13:00:39.583 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.583 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.584 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.584 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.584 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.584 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.584 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.584 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.584 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.585 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.585 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.585 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.585 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.585 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.585 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.585 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.586 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.586 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.586 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.586 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.586 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.586 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.586 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.586 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.587 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.587 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.587 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.587 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.587 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.587 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.587 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.588 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.588 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.588 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.588 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.588 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.588 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.588 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.588 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.589 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.589 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.589 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.589 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.589 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.589 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.589 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.590 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.590 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.590 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.590 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.590 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.590 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.590 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.591 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.591 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.591 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.591 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.591 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.591 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.591 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.592 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.592 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.592 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.592 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.592 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.592 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.592 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.593 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.593 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.593 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.593 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.593 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.593 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.593 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.594 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.594 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telemetry", 2023-10-08T13:00:39.594 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.594 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.594 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.595 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_basic": { 2023-10-08T13:00:39.595 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_basic", 2023-10-08T13:00:39.595 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.595 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.595 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.595 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.595 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.596 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.596 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.596 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T13:00:39.596 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.596 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.596 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.596 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_crash": { 2023-10-08T13:00:39.597 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_crash", 2023-10-08T13:00:39.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.597 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.597 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.597 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.597 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.597 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.597 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.598 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T13:00:39.598 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.598 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.598 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.598 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_device": { 2023-10-08T13:00:39.598 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_device", 2023-10-08T13:00:39.599 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.599 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.599 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.599 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2023-10-08T13:00:39.599 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.599 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.599 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.599 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T13:00:39.600 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.600 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.600 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.600 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_ident": { 2023-10-08T13:00:39.600 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_ident", 2023-10-08T13:00:39.600 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.601 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.601 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.601 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.601 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.601 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.601 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.601 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T13:00:39.601 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.602 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.602 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.602 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_perf": { 2023-10-08T13:00:39.602 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_perf", 2023-10-08T13:00:39.602 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.602 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.602 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.603 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.603 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.603 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.603 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.603 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T13:00:39.603 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.603 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.603 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: "contact": { 2023-10-08T13:00:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "contact", 2023-10-08T13:00:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: "description": { 2023-10-08T13:00:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "description", 2023-10-08T13:00:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.607 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.607 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.607 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.607 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.607 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.607 INFO:teuthology.orchestra.run.smithi059.stdout: "device_url": { 2023-10-08T13:00:39.607 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_url", 2023-10-08T13:00:39.608 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.608 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.608 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.608 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T13:00:39.608 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.608 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.608 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.609 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.609 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.609 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.609 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.609 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2023-10-08T13:00:39.609 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2023-10-08T13:00:39.609 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.610 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.610 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.610 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.610 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.610 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.610 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.610 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.610 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.611 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.611 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.611 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:39.611 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:39.611 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.611 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.612 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.612 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "24", 2023-10-08T13:00:39.612 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "8", 2023-10-08T13:00:39.612 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.612 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.612 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.612 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.612 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.613 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.613 INFO:teuthology.orchestra.run.smithi059.stdout: "last_opt_revision": { 2023-10-08T13:00:39.613 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "last_opt_revision", 2023-10-08T13:00:39.613 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.613 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.613 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.613 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1", 2023-10-08T13:00:39.614 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.614 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.614 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.614 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.614 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.614 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.614 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.615 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard": { 2023-10-08T13:00:39.615 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard", 2023-10-08T13:00:39.615 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.615 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.615 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.615 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.615 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.616 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.616 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.616 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.616 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.616 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.616 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.616 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard_description": { 2023-10-08T13:00:39.617 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard_description", 2023-10-08T13:00:39.617 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.617 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.617 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.617 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.617 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.617 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.617 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.618 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.618 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.618 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.618 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.618 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.618 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.619 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.619 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.619 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.619 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.619 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.619 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.619 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.619 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.620 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.620 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.620 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.620 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.620 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.620 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.620 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.620 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.621 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.621 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.621 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.621 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.621 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.621 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.621 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.622 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.622 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.622 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.622 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.622 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.622 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.622 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.623 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.623 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.623 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.623 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.623 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.623 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.624 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.624 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.624 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.624 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.624 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.624 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.624 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.624 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.625 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.625 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.625 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.625 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.625 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.625 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.625 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.626 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.626 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.626 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.626 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.626 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.626 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.627 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.627 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.627 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.627 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.627 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.627 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.627 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.628 INFO:teuthology.orchestra.run.smithi059.stdout: "organization": { 2023-10-08T13:00:39.628 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "organization", 2023-10-08T13:00:39.628 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.628 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.628 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.628 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.628 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.628 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.629 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.629 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.629 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.629 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.629 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.629 INFO:teuthology.orchestra.run.smithi059.stdout: "proxy": { 2023-10-08T13:00:39.629 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "proxy", 2023-10-08T13:00:39.630 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.630 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.630 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.630 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.630 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.630 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.630 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.631 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.631 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.631 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.631 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.631 INFO:teuthology.orchestra.run.smithi059.stdout: "url": { 2023-10-08T13:00:39.631 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url", 2023-10-08T13:00:39.631 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.632 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.632 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.632 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T13:00:39.632 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.632 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.632 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.632 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.632 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.633 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.633 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.633 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.633 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.633 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "test_orchestrator", 2023-10-08T13:00:39.633 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.634 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.634 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.634 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.634 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.634 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.634 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.634 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.635 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.635 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.635 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.635 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.635 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.635 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.635 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.636 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.636 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.636 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.636 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.636 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.636 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.636 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.636 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.637 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.637 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.637 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.637 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.637 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.637 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.637 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.638 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.638 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.638 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.638 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.638 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.638 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.639 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.639 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.639 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.639 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.639 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.639 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.639 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.640 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.640 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.640 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.640 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.640 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.640 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.640 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.641 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.641 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.641 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.641 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.641 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.641 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.642 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.642 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.642 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.642 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.642 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.642 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.642 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.643 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.643 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.643 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.643 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.643 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.643 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.643 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.643 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2023-10-08T13:00:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.644 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.645 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.646 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.647 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.647 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.647 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.647 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.647 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.647 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.647 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.648 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.648 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.648 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.648 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.648 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.648 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.648 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.648 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.649 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.649 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.649 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.649 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.649 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.649 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.650 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.650 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.650 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.650 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.650 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.650 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.650 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.650 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.651 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.651 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.651 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.651 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.651 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.651 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.651 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.652 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.652 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.652 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.652 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.652 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.652 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.653 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.653 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.653 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.653 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.653 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.653 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.653 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.653 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.654 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_clones": { 2023-10-08T13:00:39.654 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_clones", 2023-10-08T13:00:39.654 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.654 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.654 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.654 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4", 2023-10-08T13:00:39.655 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.655 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.655 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.655 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T13:00:39.655 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.655 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.655 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.656 INFO:teuthology.orchestra.run.smithi059.stdout: "periodic_async_work": { 2023-10-08T13:00:39.656 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "periodic_async_work", 2023-10-08T13:00:39.656 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.656 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.656 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.656 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.656 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.657 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.657 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.657 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Periodically check for async work", 2023-10-08T13:00:39.657 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.657 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.657 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.658 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_delay": { 2023-10-08T13:00:39.658 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_delay", 2023-10-08T13:00:39.658 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.658 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.658 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.658 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2023-10-08T13:00:39.658 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.659 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.659 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.659 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T13:00:39.659 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.659 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.659 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.659 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.659 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.660 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix", 2023-10-08T13:00:39.660 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2023-10-08T13:00:39.660 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2023-10-08T13:00:39.660 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2023-10-08T13:00:39.660 INFO:teuthology.orchestra.run.smithi059.stdout: "discovery_interval": { 2023-10-08T13:00:39.661 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "discovery_interval", 2023-10-08T13:00:39.661 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2023-10-08T13:00:39.661 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.661 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.661 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "100", 2023-10-08T13:00:39.661 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.661 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.661 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.662 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.662 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.662 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.662 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.662 INFO:teuthology.orchestra.run.smithi059.stdout: "identifier": { 2023-10-08T13:00:39.662 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "identifier", 2023-10-08T13:00:39.663 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.663 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.663 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.663 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.663 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.663 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.663 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.663 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.664 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.664 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.664 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.664 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2023-10-08T13:00:39.664 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2023-10-08T13:00:39.664 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2023-10-08T13:00:39.664 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.665 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.665 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2023-10-08T13:00:39.665 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.665 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.665 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.665 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.665 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.666 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.666 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.666 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2023-10-08T13:00:39.666 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2023-10-08T13:00:39.666 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.666 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.666 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.667 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.667 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.667 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.667 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.667 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.667 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.667 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.667 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.668 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.668 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.668 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.668 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.668 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.668 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.668 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.669 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2023-10-08T13:00:39.669 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2023-10-08T13:00:39.669 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.669 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.669 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.670 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.670 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.670 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.670 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.670 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.670 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.670 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.670 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.671 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2023-10-08T13:00:39.671 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2023-10-08T13:00:39.671 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.671 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.671 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.671 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2023-10-08T13:00:39.672 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.672 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.672 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2023-10-08T13:00:39.672 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2023-10-08T13:00:39.672 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2023-10-08T13:00:39.672 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2023-10-08T13:00:39.672 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2023-10-08T13:00:39.672 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2023-10-08T13:00:39.673 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2023-10-08T13:00:39.673 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.673 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.673 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.673 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.673 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.673 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2023-10-08T13:00:39.674 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2023-10-08T13:00:39.674 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2023-10-08T13:00:39.674 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.674 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-08T13:00:39.674 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2023-10-08T13:00:39.674 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.674 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.675 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.675 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.675 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.675 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.675 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.675 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_host": { 2023-10-08T13:00:39.675 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_host", 2023-10-08T13:00:39.675 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.676 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.676 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.676 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2023-10-08T13:00:39.676 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.676 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.676 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.676 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.677 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.677 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.677 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.677 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_port": { 2023-10-08T13:00:39.677 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_port", 2023-10-08T13:00:39.677 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2023-10-08T13:00:39.677 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.678 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.678 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10051", 2023-10-08T13:00:39.678 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.678 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.678 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.678 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.678 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.679 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.679 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.679 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_sender": { 2023-10-08T13:00:39.679 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_sender", 2023-10-08T13:00:39.679 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2023-10-08T13:00:39.679 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2023-10-08T13:00:39.680 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2023-10-08T13:00:39.680 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T13:00:39.680 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2023-10-08T13:00:39.680 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2023-10-08T13:00:39.680 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2023-10-08T13:00:39.680 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2023-10-08T13:00:39.680 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2023-10-08T13:00:39.680 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2023-10-08T13:00:39.681 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2023-10-08T13:00:39.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.681 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.681 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2023-10-08T13:00:39.681 INFO:teuthology.orchestra.run.smithi059.stdout: "dashboard": "https://172.21.15.59:8443/" 2023-10-08T13:00:39.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.682 INFO:teuthology.orchestra.run.smithi059.stdout: "always_on_modules": { 2023-10-08T13:00:39.682 INFO:teuthology.orchestra.run.smithi059.stdout: "octopus": [ 2023-10-08T13:00:39.682 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2023-10-08T13:00:39.682 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2023-10-08T13:00:39.682 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2023-10-08T13:00:39.682 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2023-10-08T13:00:39.682 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2023-10-08T13:00:39.683 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2023-10-08T13:00:39.683 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2023-10-08T13:00:39.683 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2023-10-08T13:00:39.683 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2023-10-08T13:00:39.683 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2023-10-08T13:00:39.683 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.683 INFO:teuthology.orchestra.run.smithi059.stdout: "pacific": [ 2023-10-08T13:00:39.684 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2023-10-08T13:00:39.684 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2023-10-08T13:00:39.684 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2023-10-08T13:00:39.684 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2023-10-08T13:00:39.684 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2023-10-08T13:00:39.684 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2023-10-08T13:00:39.684 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2023-10-08T13:00:39.684 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2023-10-08T13:00:39.685 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2023-10-08T13:00:39.685 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2023-10-08T13:00:39.685 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.685 INFO:teuthology.orchestra.run.smithi059.stdout: "quincy": [ 2023-10-08T13:00:39.685 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2023-10-08T13:00:39.685 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2023-10-08T13:00:39.685 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2023-10-08T13:00:39.686 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2023-10-08T13:00:39.686 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2023-10-08T13:00:39.686 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2023-10-08T13:00:39.686 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2023-10-08T13:00:39.686 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2023-10-08T13:00:39.686 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2023-10-08T13:00:39.686 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2023-10-08T13:00:39.687 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-08T13:00:39.687 INFO:teuthology.orchestra.run.smithi059.stdout: "reef": [ 2023-10-08T13:00:39.687 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2023-10-08T13:00:39.687 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2023-10-08T13:00:39.687 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2023-10-08T13:00:39.687 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2023-10-08T13:00:39.687 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2023-10-08T13:00:39.688 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2023-10-08T13:00:39.688 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2023-10-08T13:00:39.688 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2023-10-08T13:00:39.688 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2023-10-08T13:00:39.688 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2023-10-08T13:00:39.688 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T13:00:39.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.689 INFO:teuthology.orchestra.run.smithi059.stdout: "last_failure_osd_epoch": 5, 2023-10-08T13:00:39.689 INFO:teuthology.orchestra.run.smithi059.stdout: "active_clients": [ 2023-10-08T13:00:39.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.689 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2023-10-08T13:00:39.689 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-08T13:00:39.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.690 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2023-10-08T13:00:39.690 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2023-10-08T13:00:39.690 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 398794730 2023-10-08T13:00:39.690 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.690 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T13:00:39.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.690 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "libcephsqlite", 2023-10-08T13:00:39.691 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-08T13:00:39.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.691 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2023-10-08T13:00:39.691 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2023-10-08T13:00:39.691 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 666710218 2023-10-08T13:00:39.691 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.691 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T13:00:39.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.692 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2023-10-08T13:00:39.692 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-08T13:00:39.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.692 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2023-10-08T13:00:39.692 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2023-10-08T13:00:39.693 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 649821912 2023-10-08T13:00:39.693 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.693 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T13:00:39.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.693 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2023-10-08T13:00:39.693 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-08T13:00:39.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.694 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2023-10-08T13:00:39.694 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2023-10-08T13:00:39.694 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2663218736 2023-10-08T13:00:39.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.694 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T13:00:39.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.695 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2023-10-08T13:00:39.695 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-08T13:00:39.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.695 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2023-10-08T13:00:39.695 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2023-10-08T13:00:39.695 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1583289337 2023-10-08T13:00:39.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.696 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T13:00:39.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:39.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.696 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2023-10-08T13:00:39.696 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-08T13:00:39.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-08T13:00:39.696 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2023-10-08T13:00:39.697 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2023-10-08T13:00:39.697 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 298610301 2023-10-08T13:00:39.697 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.697 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T13:00:39.697 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:39.697 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-08T13:00:39.697 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T13:00:39.699 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:37 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1208405686' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:00:39.699 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:37 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/79222727' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:00:39.700 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:38 smithi092 ceph-mon[134093]: pgmap v923: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.7 MiB/s wr, 112 op/s 2023-10-08T13:00:39.700 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:38 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3332192942' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T13:00:39.700 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:37 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1208405686' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:00:39.700 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:37 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/79222727' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:00:39.700 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:38 smithi173 ceph-mon[135182]: pgmap v923: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.7 MiB/s wr, 112 op/s 2023-10-08T13:00:39.700 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:38 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3332192942' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T13:00:39.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 -- 172.21.15.59:0/3332192942 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8240a1670 msgr2=0x7ff8240a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:39.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8240a1670 0x7ff8240a3b30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff834006010 tx=0x7ff83400b260 comp rx=0 tx=0).stop 2023-10-08T13:00:39.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 -- 172.21.15.59:0/3332192942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff838100ff0 msgr2=0x7ff83819eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:39.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff838100ff0 0x7ff83819eeb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff82800e9a0 tx=0x7ff82800ecb0 comp rx=0 tx=0).stop 2023-10-08T13:00:39.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 -- 172.21.15.59:0/3332192942 shutdown_connections 2023-10-08T13:00:39.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff8240a1670 0x7ff8240a3b30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:39.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff838100630 0x7ff83819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:39.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838106640 0x7ff838198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:39.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 --2- 172.21.15.59:0/3332192942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff838100ff0 0x7ff83819eeb0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:39.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 -- 172.21.15.59:0/3332192942 >> 172.21.15.59:0/3332192942 conn(0x7ff8380fc1a0 msgr2=0x7ff83810bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:39.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 -- 172.21.15.59:0/3332192942 shutdown_connections 2023-10-08T13:00:39.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:00:37.218+0000 7ff83f3ff700 1 -- 172.21.15.59:0/3332192942 wait complete. 2023-10-08T13:00:39.709 DEBUG:tasks.check_counter:Getting stats from a 2023-10-08T13:00:39.709 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-08T13:00:39.710 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:37 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1208405686' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:00:39.710 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:37 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/79222727' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:00:39.710 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:38 smithi059 ceph-mon[98489]: pgmap v923: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.7 MiB/s wr, 112 op/s 2023-10-08T13:00:39.710 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:38 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3332192942' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T13:00:40.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:40 smithi092 ceph-mon[134093]: pgmap v924: 97 pgs: 97 active+clean; 963 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-10-08T13:00:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:00:40.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:40 smithi173 ceph-mon[135182]: pgmap v924: 97 pgs: 97 active+clean; 963 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-10-08T13:00:40.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:40 smithi059 ceph-mon[98489]: pgmap v924: 97 pgs: 97 active+clean; 963 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-10-08T13:00:42.057 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T13:00:42.058 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:00:42.058 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 0, 2023-10-08T13:00:42.058 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2, 2023-10-08T13:00:42.059 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:00:42.059 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 0, 2023-10-08T13:00:42.059 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:42.059 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 0, 2023-10-08T13:00:42.059 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.003947909, 2023-10-08T13:00:42.059 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:00:42.059 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.000675395, 2023-10-08T13:00:42.060 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:42.060 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:42.060 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:42.060 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:42.060 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:42.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:42.061 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:42.061 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:42.061 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:42.061 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:42.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:42.061 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:00:42.062 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:00:42.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:42.062 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:00:42.062 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 2, 2023-10-08T13:00:42.062 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 264, 2023-10-08T13:00:42.063 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 320, 2023-10-08T13:00:42.063 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 199840, 2023-10-08T13:00:42.063 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:42.063 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2023-10-08T13:00:42.063 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.022696473, 2023-10-08T13:00:42.063 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.017330515, 2023-10-08T13:00:42.064 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.002115914, 2023-10-08T13:00:42.064 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:42.064 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:42.064 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 262, 2023-10-08T13:00:42.064 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.018423924, 2023-10-08T13:00:42.064 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000070320 2023-10-08T13:00:42.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:42.065 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:42.065 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:42.065 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:42.065 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:42.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:42.066 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T13:00:42.066 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 199840 2023-10-08T13:00:42.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:42.066 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:00:42.066 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 354, 2023-10-08T13:00:42.066 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 347, 2023-10-08T13:00:42.067 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 785360, 2023-10-08T13:00:42.067 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 208608, 2023-10-08T13:00:42.067 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 2, 2023-10-08T13:00:42.067 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2023-10-08T13:00:42.067 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.057103314, 2023-10-08T13:00:42.068 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.024732958, 2023-10-08T13:00:42.068 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.025875865, 2023-10-08T13:00:42.068 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.006975284, 2023-10-08T13:00:42.068 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:42.068 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 347, 2023-10-08T13:00:42.068 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.021783629, 2023-10-08T13:00:42.069 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000062777 2023-10-08T13:00:42.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:42.069 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:42.069 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:42.069 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:42.069 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:42.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:42.070 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 785360, 2023-10-08T13:00:42.070 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 208608 2023-10-08T13:00:42.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:42.070 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2023-10-08T13:00:42.070 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 0, 2023-10-08T13:00:42.071 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2023-10-08T13:00:42.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:42.071 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2023-10-08T13:00:42.071 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:00:42.071 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2023-10-08T13:00:42.072 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:00:42.072 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:00:42.072 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:00:42.072 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:00:42.072 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:00:42.072 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:00:42.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:00:42.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:00:42.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:00:42.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:00:42.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:00:42.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:00:42.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:00:42.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2023-10-08T13:00:42.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:00:42.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2023-10-08T13:00:42.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:00:42.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:00:42.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:00:42.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:00:42.076 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:00:42.076 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:00:42.076 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:00:42.076 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2023-10-08T13:00:42.076 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:00:42.076 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:00:42.077 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:00:42.077 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2023-10-08T13:00:42.077 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2023-10-08T13:00:42.077 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2023-10-08T13:00:42.077 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:00:42.077 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:00:42.077 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:00:42.078 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:00:42.078 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 148704, 2023-10-08T13:00:42.078 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 29, 2023-10-08T13:00:42.078 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:00:42.078 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2023-10-08T13:00:42.078 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2023-10-08T13:00:42.079 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2023-10-08T13:00:42.079 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:00:42.079 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2023-10-08T13:00:42.079 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:00:42.079 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2023-10-08T13:00:42.079 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 0, 2023-10-08T13:00:42.080 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 0, 2023-10-08T13:00:42.080 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:00:42.080 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:00:42.080 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2023-10-08T13:00:42.080 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2023-10-08T13:00:42.081 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 928, 2023-10-08T13:00:42.081 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 2, 2023-10-08T13:00:42.081 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2023-10-08T13:00:42.081 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2023-10-08T13:00:42.081 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2023-10-08T13:00:42.081 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2023-10-08T13:00:42.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:42.082 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:00:42.082 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2023-10-08T13:00:42.082 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2023-10-08T13:00:42.082 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2023-10-08T13:00:42.083 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 352, 2023-10-08T13:00:42.083 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 732884, 2023-10-08T13:00:42.083 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:42.083 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 352, 2023-10-08T13:00:42.083 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2023-10-08T13:00:42.083 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2023-10-08T13:00:42.084 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 352, 2023-10-08T13:00:42.084 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 732884, 2023-10-08T13:00:42.084 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2023-10-08T13:00:42.084 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:42.084 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:42.084 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:42.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:42.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:42.085 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T13:00:42.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:42 smithi173 ceph-mon[135182]: pgmap v925: 97 pgs: 97 active+clean; 962 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 2.4 MiB/s wr, 91 op/s 2023-10-08T13:00:42.470 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:42 smithi059 ceph-mon[98489]: pgmap v925: 97 pgs: 97 active+clean; 962 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 2.4 MiB/s wr, 91 op/s 2023-10-08T13:00:42.563 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2023-10-08T13:00:42.564 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2023-10-08T13:00:42.564 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2023-10-08T13:00:42.564 DEBUG:tasks.check_counter:Getting stats from d 2023-10-08T13:00:42.564 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-08T13:00:42.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:42 smithi092 ceph-mon[134093]: pgmap v925: 97 pgs: 97 active+clean; 962 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 2.4 MiB/s wr, 91 op/s 2023-10-08T13:00:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:00:44.242 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:44 smithi059 ceph-mon[98489]: pgmap v926: 97 pgs: 97 active+clean; 960 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 2.0 MiB/s wr, 88 op/s 2023-10-08T13:00:44.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:44 smithi173 ceph-mon[135182]: pgmap v926: 97 pgs: 97 active+clean; 960 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 2.0 MiB/s wr, 88 op/s 2023-10-08T13:00:44.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:44 smithi092 ceph-mon[134093]: pgmap v926: 97 pgs: 97 active+clean; 960 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 2.0 MiB/s wr, 88 op/s 2023-10-08T13:00:44.998 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T13:00:44.999 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:00:44.999 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 4, 2023-10-08T13:00:44.999 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 4, 2023-10-08T13:00:44.999 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 2992, 2023-10-08T13:00:44.999 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 448, 2023-10-08T13:00:45.000 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:45.000 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 0, 2023-10-08T13:00:45.000 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.004115751, 2023-10-08T13:00:45.000 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.000053690, 2023-10-08T13:00:45.000 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.001331111, 2023-10-08T13:00:45.000 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:45.001 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:45.001 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 3, 2023-10-08T13:00:45.001 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001192671, 2023-10-08T13:00:45.001 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000397557 2023-10-08T13:00:45.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:45.001 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:45.002 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:45.002 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:45.002 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:45.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:45.002 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T13:00:45.002 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T13:00:45.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:45.003 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:00:45.003 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 2, 2023-10-08T13:00:45.003 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 268, 2023-10-08T13:00:45.003 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 320, 2023-10-08T13:00:45.003 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 200544, 2023-10-08T13:00:45.003 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:45.004 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2023-10-08T13:00:45.004 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.024929902, 2023-10-08T13:00:45.004 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.019206577, 2023-10-08T13:00:45.004 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.002144089, 2023-10-08T13:00:45.004 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:45.004 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:45.004 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 266, 2023-10-08T13:00:45.005 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.015156445, 2023-10-08T13:00:45.005 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000056979 2023-10-08T13:00:45.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:45.005 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:45.005 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:45.005 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:45.005 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:45.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:45.006 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T13:00:45.006 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 200544 2023-10-08T13:00:45.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:45.006 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:00:45.006 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 356, 2023-10-08T13:00:45.006 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 351, 2023-10-08T13:00:45.007 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 784064, 2023-10-08T13:00:45.007 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 211440, 2023-10-08T13:00:45.007 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 2, 2023-10-08T13:00:45.007 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2023-10-08T13:00:45.007 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.058129527, 2023-10-08T13:00:45.007 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.025126397, 2023-10-08T13:00:45.007 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.027161012, 2023-10-08T13:00:45.008 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.007103203, 2023-10-08T13:00:45.008 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:45.008 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 350, 2023-10-08T13:00:45.008 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.019686089, 2023-10-08T13:00:45.008 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000056245 2023-10-08T13:00:45.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:45.009 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:45.009 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:45.009 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:45.009 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:45.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:45.009 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 784064, 2023-10-08T13:00:45.010 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 211440 2023-10-08T13:00:45.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:45.010 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2023-10-08T13:00:45.010 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 0, 2023-10-08T13:00:45.010 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2023-10-08T13:00:45.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:45.010 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2023-10-08T13:00:45.011 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:00:45.011 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2023-10-08T13:00:45.011 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:00:45.011 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:00:45.011 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:00:45.011 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:00:45.012 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:00:45.012 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:00:45.012 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:00:45.012 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:00:45.012 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:00:45.012 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:00:45.012 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:00:45.013 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:00:45.013 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:00:45.013 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2023-10-08T13:00:45.013 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:00:45.013 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2023-10-08T13:00:45.013 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:00:45.014 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:00:45.014 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:00:45.014 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:00:45.014 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:00:45.014 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:00:45.014 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:00:45.015 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2023-10-08T13:00:45.015 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:00:45.015 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:00:45.015 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:00:45.015 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2023-10-08T13:00:45.015 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2023-10-08T13:00:45.015 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2023-10-08T13:00:45.016 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:00:45.016 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:00:45.016 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:00:45.016 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:00:45.016 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 148704, 2023-10-08T13:00:45.016 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 29, 2023-10-08T13:00:45.016 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:00:45.016 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2023-10-08T13:00:45.017 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2023-10-08T13:00:45.017 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2023-10-08T13:00:45.017 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:00:45.017 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2023-10-08T13:00:45.017 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:00:45.017 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2023-10-08T13:00:45.017 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 0, 2023-10-08T13:00:45.018 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 0, 2023-10-08T13:00:45.018 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:00:45.018 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:00:45.018 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2023-10-08T13:00:45.018 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2023-10-08T13:00:45.018 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 928, 2023-10-08T13:00:45.018 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 2, 2023-10-08T13:00:45.018 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2023-10-08T13:00:45.019 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2023-10-08T13:00:45.019 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2023-10-08T13:00:45.019 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2023-10-08T13:00:45.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:45.019 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:00:45.019 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2023-10-08T13:00:45.019 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2023-10-08T13:00:45.020 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2023-10-08T13:00:45.020 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 358, 2023-10-08T13:00:45.020 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 733728, 2023-10-08T13:00:45.020 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:45.020 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 358, 2023-10-08T13:00:45.020 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2023-10-08T13:00:45.020 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2023-10-08T13:00:45.021 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 358, 2023-10-08T13:00:45.021 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 733728, 2023-10-08T13:00:45.021 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2023-10-08T13:00:45.021 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:45.021 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:45.021 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:45.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:45.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:45.022 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T13:00:45.515 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-10-08T13:00:45.516 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-10-08T13:00:45.516 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-10-08T13:00:45.516 DEBUG:tasks.check_counter:Getting stats from g 2023-10-08T13:00:45.516 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-08T13:00:46.262 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:00:46.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:46 smithi173 ceph-mon[135182]: pgmap v927: 97 pgs: 97 active+clean; 929 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.9 MiB/s wr, 79 op/s 2023-10-08T13:00:46.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:46 smithi059 ceph-mon[98489]: pgmap v927: 97 pgs: 97 active+clean; 929 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.9 MiB/s wr, 79 op/s 2023-10-08T13:00:46.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:46 smithi092 ceph-mon[134093]: pgmap v927: 97 pgs: 97 active+clean; 929 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.9 MiB/s wr, 79 op/s 2023-10-08T13:00:47.673 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T13:00:47.674 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:00:47.674 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 4, 2023-10-08T13:00:47.674 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 4, 2023-10-08T13:00:47.674 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 2992, 2023-10-08T13:00:47.674 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 448, 2023-10-08T13:00:47.674 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:47.674 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 0, 2023-10-08T13:00:47.675 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.003998417, 2023-10-08T13:00:47.675 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.000070253, 2023-10-08T13:00:47.675 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.001068446, 2023-10-08T13:00:47.675 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:47.675 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:47.675 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 3, 2023-10-08T13:00:47.675 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001496512, 2023-10-08T13:00:47.676 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000498837 2023-10-08T13:00:47.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:47.676 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:47.676 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:47.676 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:47.676 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:47.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:47.677 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T13:00:47.677 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T13:00:47.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:47.677 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:00:47.677 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 2, 2023-10-08T13:00:47.677 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 265, 2023-10-08T13:00:47.677 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 320, 2023-10-08T13:00:47.678 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 200016, 2023-10-08T13:00:47.678 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:47.678 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2023-10-08T13:00:47.678 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.024532198, 2023-10-08T13:00:47.678 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.018268958, 2023-10-08T13:00:47.678 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.002886594, 2023-10-08T13:00:47.679 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:47.679 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:47.679 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 263, 2023-10-08T13:00:47.679 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.017814402, 2023-10-08T13:00:47.679 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000067735 2023-10-08T13:00:47.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:47.679 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:47.679 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:47.680 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:47.680 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:47.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:47.680 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T13:00:47.680 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 200016 2023-10-08T13:00:47.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:47.680 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:00:47.681 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 352, 2023-10-08T13:00:47.681 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 347, 2023-10-08T13:00:47.681 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 782912, 2023-10-08T13:00:47.681 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 209408, 2023-10-08T13:00:47.681 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 2, 2023-10-08T13:00:47.681 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2023-10-08T13:00:47.681 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.057456153, 2023-10-08T13:00:47.682 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.024895994, 2023-10-08T13:00:47.682 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.026776067, 2023-10-08T13:00:47.682 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.006799423, 2023-10-08T13:00:47.682 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:47.682 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 346, 2023-10-08T13:00:47.682 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.032311951, 2023-10-08T13:00:47.682 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000093387 2023-10-08T13:00:47.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:47.683 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:47.683 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:47.683 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:47.683 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:47.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:47.683 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 782912, 2023-10-08T13:00:47.683 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 209408 2023-10-08T13:00:47.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:47.684 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2023-10-08T13:00:47.684 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 0, 2023-10-08T13:00:47.684 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2023-10-08T13:00:47.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:47.684 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2023-10-08T13:00:47.684 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:00:47.684 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2023-10-08T13:00:47.685 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:00:47.685 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:00:47.685 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:00:47.685 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:00:47.685 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:00:47.685 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:00:47.685 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:00:47.685 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:00:47.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:00:47.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:00:47.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:00:47.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:00:47.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:00:47.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2023-10-08T13:00:47.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:00:47.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2023-10-08T13:00:47.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:00:47.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:00:47.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:00:47.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:00:47.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:00:47.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:00:47.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:00:47.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2023-10-08T13:00:47.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:00:47.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:00:47.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:00:47.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2023-10-08T13:00:47.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2023-10-08T13:00:47.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2023-10-08T13:00:47.689 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:00:47.689 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:00:47.689 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:00:47.689 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:00:47.689 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 148704, 2023-10-08T13:00:47.689 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 29, 2023-10-08T13:00:47.689 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:00:47.689 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2023-10-08T13:00:47.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2023-10-08T13:00:47.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2023-10-08T13:00:47.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:00:47.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2023-10-08T13:00:47.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:00:47.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2023-10-08T13:00:47.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 0, 2023-10-08T13:00:47.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 0, 2023-10-08T13:00:47.691 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:00:47.691 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:00:47.691 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2023-10-08T13:00:47.691 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2023-10-08T13:00:47.691 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 928, 2023-10-08T13:00:47.691 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 2, 2023-10-08T13:00:47.691 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2023-10-08T13:00:47.692 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2023-10-08T13:00:47.692 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2023-10-08T13:00:47.692 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2023-10-08T13:00:47.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:47.692 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:00:47.692 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2023-10-08T13:00:47.693 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2023-10-08T13:00:47.693 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2023-10-08T13:00:47.693 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 354, 2023-10-08T13:00:47.693 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 733144, 2023-10-08T13:00:47.693 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:47.693 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 354, 2023-10-08T13:00:47.693 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2023-10-08T13:00:47.694 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2023-10-08T13:00:47.694 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 354, 2023-10-08T13:00:47.694 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 733144, 2023-10-08T13:00:47.694 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2023-10-08T13:00:47.694 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:47.694 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:47.694 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:47.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:47.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:47.695 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T13:00:48.160 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2023-10-08T13:00:48.160 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2023-10-08T13:00:48.161 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2023-10-08T13:00:48.161 DEBUG:tasks.check_counter:Getting stats from j 2023-10-08T13:00:48.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-08T13:00:48.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:48 smithi173 ceph-mon[135182]: pgmap v928: 97 pgs: 97 active+clean; 909 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 2.2 MiB/s wr, 82 op/s 2023-10-08T13:00:48.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:48 smithi059 ceph-mon[98489]: pgmap v928: 97 pgs: 97 active+clean; 909 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 2.2 MiB/s wr, 82 op/s 2023-10-08T13:00:48.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:48 smithi092 ceph-mon[134093]: pgmap v928: 97 pgs: 97 active+clean; 909 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 2.2 MiB/s wr, 82 op/s 2023-10-08T13:00:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:00:50.342 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-08T13:00:50.342 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:00:50.342 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 0, 2023-10-08T13:00:50.342 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2, 2023-10-08T13:00:50.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:00:50.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 0, 2023-10-08T13:00:50.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:50.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 0, 2023-10-08T13:00:50.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.003741076, 2023-10-08T13:00:50.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:00:50.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.000964113, 2023-10-08T13:00:50.344 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:50.344 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:50.344 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:50.344 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:50.344 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:50.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:50.344 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:50.345 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:50.345 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:50.345 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:50.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:50.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:00:50.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:00:50.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:50.346 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:00:50.346 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 6, 2023-10-08T13:00:50.346 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 272, 2023-10-08T13:00:50.346 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 3312, 2023-10-08T13:00:50.346 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 201344, 2023-10-08T13:00:50.346 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:50.346 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2023-10-08T13:00:50.346 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.025561807, 2023-10-08T13:00:50.347 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.019387450, 2023-10-08T13:00:50.347 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.002758884, 2023-10-08T13:00:50.347 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:50.347 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:50.347 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 271, 2023-10-08T13:00:50.347 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.018631419, 2023-10-08T13:00:50.347 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000068750 2023-10-08T13:00:50.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:50.348 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:50.348 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:50.348 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:50.348 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:50.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:50.348 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-08T13:00:50.348 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 201344 2023-10-08T13:00:50.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:50.349 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:00:50.349 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 358, 2023-10-08T13:00:50.349 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 353, 2023-10-08T13:00:50.349 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 784608, 2023-10-08T13:00:50.349 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 212688, 2023-10-08T13:00:50.349 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 2, 2023-10-08T13:00:50.350 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2023-10-08T13:00:50.350 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.053013321, 2023-10-08T13:00:50.350 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.017740560, 2023-10-08T13:00:50.350 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.029150718, 2023-10-08T13:00:50.350 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.007361891, 2023-10-08T13:00:50.350 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:50.350 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 352, 2023-10-08T13:00:50.350 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.020950341, 2023-10-08T13:00:50.351 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000059518 2023-10-08T13:00:50.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:50.351 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:50.351 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:50.351 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:50.351 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:50.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:50.352 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 784608, 2023-10-08T13:00:50.352 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 212688 2023-10-08T13:00:50.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:50.352 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2023-10-08T13:00:50.352 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 0, 2023-10-08T13:00:50.352 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2023-10-08T13:00:50.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:50.353 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2023-10-08T13:00:50.353 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:00:50.353 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2023-10-08T13:00:50.353 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:00:50.353 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:00:50.353 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:00:50.353 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:00:50.354 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:00:50.354 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:00:50.354 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:00:50.354 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:00:50.354 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:00:50.354 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:00:50.355 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:00:50.355 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:00:50.355 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:00:50.355 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2023-10-08T13:00:50.355 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:00:50.355 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2023-10-08T13:00:50.355 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:00:50.356 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:00:50.356 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:00:50.356 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:00:50.356 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:00:50.356 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:00:50.356 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:00:50.356 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2023-10-08T13:00:50.357 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:00:50.357 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:00:50.357 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:00:50.357 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2023-10-08T13:00:50.357 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2023-10-08T13:00:50.357 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2023-10-08T13:00:50.357 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:00:50.358 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:00:50.358 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:00:50.358 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:00:50.358 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 149752, 2023-10-08T13:00:50.358 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 31, 2023-10-08T13:00:50.358 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:00:50.359 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2023-10-08T13:00:50.359 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2023-10-08T13:00:50.359 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2023-10-08T13:00:50.359 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:00:50.359 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2023-10-08T13:00:50.359 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:00:50.360 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2023-10-08T13:00:50.360 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 0, 2023-10-08T13:00:50.360 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 0, 2023-10-08T13:00:50.360 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:00:50.360 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:00:50.360 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2023-10-08T13:00:50.360 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2023-10-08T13:00:50.361 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 928, 2023-10-08T13:00:50.361 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 2, 2023-10-08T13:00:50.361 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2023-10-08T13:00:50.361 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2023-10-08T13:00:50.361 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2023-10-08T13:00:50.361 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2023-10-08T13:00:50.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-08T13:00:50.361 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:00:50.362 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2023-10-08T13:00:50.362 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2023-10-08T13:00:50.362 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2023-10-08T13:00:50.362 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 360, 2023-10-08T13:00:50.362 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 733988, 2023-10-08T13:00:50.362 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:50.362 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 360, 2023-10-08T13:00:50.363 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2023-10-08T13:00:50.363 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2023-10-08T13:00:50.363 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 360, 2023-10-08T13:00:50.363 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 733988, 2023-10-08T13:00:50.363 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2023-10-08T13:00:50.363 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2023-10-08T13:00:50.363 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2023-10-08T13:00:50.363 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2023-10-08T13:00:50.364 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:50.364 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-08T13:00:50.364 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-08T13:00:50.364 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:50 smithi059 ceph-mon[98489]: pgmap v929: 97 pgs: 97 active+clean; 883 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 2.0 MiB/s wr, 69 op/s 2023-10-08T13:00:50.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:50 smithi092 ceph-mon[134093]: pgmap v929: 97 pgs: 97 active+clean; 883 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 2.0 MiB/s wr, 69 op/s 2023-10-08T13:00:50.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:50 smithi173 ceph-mon[135182]: pgmap v929: 97 pgs: 97 active+clean; 883 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 2.0 MiB/s wr, 69 op/s 2023-10-08T13:00:50.797 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-10-08T13:00:50.798 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-10-08T13:00:50.798 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-10-08T13:00:50.798 DEBUG:tasks.check_counter:Getting stats from b 2023-10-08T13:00:50.798 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-08T13:00:51.470 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:00:52.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:52 smithi173 ceph-mon[135182]: pgmap v930: 97 pgs: 97 active+clean; 883 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.7 MiB/s wr, 62 op/s 2023-10-08T13:00:52.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:52 smithi059 ceph-mon[98489]: pgmap v930: 97 pgs: 97 active+clean; 883 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.7 MiB/s wr, 62 op/s 2023-10-08T13:00:52.522 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:52 smithi092 ceph-mon[134093]: pgmap v930: 97 pgs: 97 active+clean; 883 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.7 MiB/s wr, 62 op/s 2023-10-08T13:00:53.265 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-08T13:00:53.265 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:00:53.265 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 109899, 2023-10-08T13:00:53.265 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 109899, 2023-10-08T13:00:53.265 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 34491717, 2023-10-08T13:00:53.266 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 1084382384, 2023-10-08T13:00:53.266 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 11, 2023-10-08T13:00:53.266 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 4, 2023-10-08T13:00:53.266 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 7.811287151, 2023-10-08T13:00:53.266 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 2.810944321, 2023-10-08T13:00:53.266 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.419764447, 2023-10-08T13:00:53.266 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 3.093436816, 2023-10-08T13:00:53.267 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:53.267 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 109898, 2023-10-08T13:00:53.267 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 22.111971995, 2023-10-08T13:00:53.267 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000201204 2023-10-08T13:00:53.267 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.267 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:53.267 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2, 2023-10-08T13:00:53.268 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000265, 2023-10-08T13:00:53.268 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000132 2023-10-08T13:00:53.268 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.268 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T13:00:53.268 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T13:00:53.268 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.268 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:00:53.269 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 121353, 2023-10-08T13:00:53.269 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 120286, 2023-10-08T13:00:53.269 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 36240155, 2023-10-08T13:00:53.269 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 1288526909, 2023-10-08T13:00:53.269 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 19, 2023-10-08T13:00:53.269 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 6, 2023-10-08T13:00:53.269 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 8.903794924, 2023-10-08T13:00:53.270 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 3.114636434, 2023-10-08T13:00:53.270 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.575416125, 2023-10-08T13:00:53.270 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 3.728216565, 2023-10-08T13:00:53.270 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:53.270 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 120285, 2023-10-08T13:00:53.270 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 20.789142191, 2023-10-08T13:00:53.270 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000172832 2023-10-08T13:00:53.271 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.271 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:53.271 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1695, 2023-10-08T13:00:53.271 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000235801, 2023-10-08T13:00:53.271 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000139 2023-10-08T13:00:53.271 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.271 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1448288, 2023-10-08T13:00:53.272 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 461376 2023-10-08T13:00:53.272 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.272 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:00:53.272 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 812363, 2023-10-08T13:00:53.272 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 1426220, 2023-10-08T13:00:53.272 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 254803802, 2023-10-08T13:00:53.272 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 1570023920, 2023-10-08T13:00:53.273 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 296, 2023-10-08T13:00:53.273 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 5, 2023-10-08T13:00:53.273 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 38.349087773, 2023-10-08T13:00:53.273 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 19.292770224, 2023-10-08T13:00:53.273 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 24.399874701, 2023-10-08T13:00:53.273 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 1.430492082, 2023-10-08T13:00:53.273 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:53.274 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1426218, 2023-10-08T13:00:53.274 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 64.119498080, 2023-10-08T13:00:53.274 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000044957 2023-10-08T13:00:53.274 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.274 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:53.274 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1114767, 2023-10-08T13:00:53.274 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.228924445, 2023-10-08T13:00:53.274 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000205 2023-10-08T13:00:53.275 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.275 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 53952, 2023-10-08T13:00:53.275 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 577840 2023-10-08T13:00:53.275 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.275 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-08T13:00:53.275 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2023-10-08T13:00:53.275 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-08T13:00:53.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.276 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2023-10-08T13:00:53.276 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-08T13:00:53.276 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-08T13:00:53.276 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 256967, 2023-10-08T13:00:53.276 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 352.927924162, 2023-10-08T13:00:53.276 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001373436 2023-10-08T13:00:53.277 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:53.277 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.277 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2023-10-08T13:00:53.277 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2023-10-08T13:00:53.277 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2023-10-08T13:00:53.277 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 94489, 2023-10-08T13:00:53.277 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 54.975695845, 2023-10-08T13:00:53.277 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000581821 2023-10-08T13:00:53.278 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:53.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.278 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2023-10-08T13:00:53.278 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 545820, 2023-10-08T13:00:53.278 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 545820, 2023-10-08T13:00:53.278 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2023-10-08T13:00:53.278 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 545820, 2023-10-08T13:00:53.279 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 3516.819909430, 2023-10-08T13:00:53.279 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006443186 2023-10-08T13:00:53.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.279 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2023-10-08T13:00:53.279 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 0, 2023-10-08T13:00:53.279 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 0, 2023-10-08T13:00:53.279 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2023-10-08T13:00:53.280 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 845, 2023-10-08T13:00:53.280 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 38, 2023-10-08T13:00:53.280 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 46, 2023-10-08T13:00:53.280 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 10278, 2023-10-08T13:00:53.280 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 4468, 2023-10-08T13:00:53.280 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 5810, 2023-10-08T13:00:53.281 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 0, 2023-10-08T13:00:53.281 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 3896, 2023-10-08T13:00:53.281 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 0, 2023-10-08T13:00:53.281 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 1119, 2023-10-08T13:00:53.281 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 1120, 2023-10-08T13:00:53.282 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 2, 2023-10-08T13:00:53.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 690671, 2023-10-08T13:00:53.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 467222, 2023-10-08T13:00:53.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 0, 2023-10-08T13:00:53.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 0, 2023-10-08T13:00:53.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:00:53.283 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2023-10-08T13:00:53.283 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 2451, 2023-10-08T13:00:53.283 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 26503, 2023-10-08T13:00:53.283 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2023-10-08T13:00:53.283 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 0, 2023-10-08T13:00:53.283 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 0, 2023-10-08T13:00:53.284 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 0, 2023-10-08T13:00:53.284 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 0, 2023-10-08T13:00:53.284 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2023-10-08T13:00:53.284 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 11358, 2023-10-08T13:00:53.284 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2023-10-08T13:00:53.284 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 712, 2023-10-08T13:00:53.284 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 214591717, 2023-10-08T13:00:53.284 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 6, 2023-10-08T13:00:53.285 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 11358, 2023-10-08T13:00:53.285 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2023-10-08T13:00:53.285 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:00:53.285 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:00:53.285 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 1847, 2023-10-08T13:00:53.285 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 38, 2023-10-08T13:00:53.285 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 1809, 2023-10-08T13:00:53.286 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 9511, 2023-10-08T13:00:53.286 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:00:53.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 46768, 2023-10-08T13:00:53.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 461104, 2023-10-08T13:00:53.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:00:53.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 10530, 2023-10-08T13:00:53.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:00:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 174580, 2023-10-08T13:00:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 95671, 2023-10-08T13:00:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 30249, 2023-10-08T13:00:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 345808 2023-10-08T13:00:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2023-10-08T13:00:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 0, 2023-10-08T13:00:53.288 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 0, 2023-10-08T13:00:53.288 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 0, 2023-10-08T13:00:53.288 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 0, 2023-10-08T13:00:53.288 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 0, 2023-10-08T13:00:53.288 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 335, 2023-10-08T13:00:53.288 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2023-10-08T13:00:53.288 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:00:53.289 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 103916, 2023-10-08T13:00:53.289 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 103581, 2023-10-08T13:00:53.289 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2023-10-08T13:00:53.289 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2023-10-08T13:00:53.289 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2023-10-08T13:00:53.289 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:00:53.289 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:00:53.290 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2023-10-08T13:00:53.290 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2023-10-08T13:00:53.290 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 38, 2023-10-08T13:00:53.290 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 0, 2023-10-08T13:00:53.290 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2023-10-08T13:00:53.290 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 84, 2023-10-08T13:00:53.290 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2023-10-08T13:00:53.291 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2023-10-08T13:00:53.291 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.291 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2023-10-08T13:00:53.291 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2023-10-08T13:00:53.291 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 458218, 2023-10-08T13:00:53.291 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 393281, 2023-10-08T13:00:53.291 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 393281, 2023-10-08T13:00:53.292 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 64937, 2023-10-08T13:00:53.292 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2023-10-08T13:00:53.292 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 12290, 2023-10-08T13:00:53.292 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 768, 2023-10-08T13:00:53.292 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 640, 2023-10-08T13:00:53.292 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 640, 2023-10-08T13:00:53.292 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 128, 2023-10-08T13:00:53.292 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 6, 2023-10-08T13:00:53.293 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2023-10-08T13:00:53.293 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 22, 2023-10-08T13:00:53.293 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 2293865137, 2023-10-08T13:00:53.293 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 2804965431, 2023-10-08T13:00:53.293 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 0, 2023-10-08T13:00:53.293 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2023-10-08T13:00:53.293 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 151679, 2023-10-08T13:00:53.294 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1031.794283722, 2023-10-08T13:00:53.294 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006802486 2023-10-08T13:00:53.294 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.294 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 0 2023-10-08T13:00:53.294 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.294 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2023-10-08T13:00:53.294 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 4420, 2023-10-08T13:00:53.295 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 108039, 2023-10-08T13:00:53.295 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 103619, 2023-10-08T13:00:53.295 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 226, 2023-10-08T13:00:53.295 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 481, 2023-10-08T13:00:53.295 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 255, 2023-10-08T13:00:53.295 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 10278, 2023-10-08T13:00:53.295 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 199879, 2023-10-08T13:00:53.296 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 189601, 2023-10-08T13:00:53.296 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 1120, 2023-10-08T13:00:53.296 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 105760, 2023-10-08T13:00:53.296 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 104640, 2023-10-08T13:00:53.296 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 99696, 2023-10-08T13:00:53.297 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 207152 2023-10-08T13:00:53.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.297 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2023-10-08T13:00:53.297 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 723528, 2023-10-08T13:00:53.297 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 0, 2023-10-08T13:00:53.297 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 545820, 2023-10-08T13:00:53.297 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 14722, 2023-10-08T13:00:53.298 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 0, 2023-10-08T13:00:53.298 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2023-10-08T13:00:53.298 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 104628, 2023-10-08T13:00:53.298 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 548.303298013, 2023-10-08T13:00:53.298 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.005240502 2023-10-08T13:00:53.298 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.298 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2023-10-08T13:00:53.299 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 276, 2023-10-08T13:00:53.299 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.680716410, 2023-10-08T13:00:53.299 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.002466363 2023-10-08T13:00:53.299 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.299 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2023-10-08T13:00:53.299 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.299 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.300 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2023-10-08T13:00:53.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.300 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.300 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2023-10-08T13:00:53.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 120162, 2023-10-08T13:00:53.301 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 538.895561958, 2023-10-08T13:00:53.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.004484741 2023-10-08T13:00:53.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.301 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2023-10-08T13:00:53.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.301 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.302 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.302 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2023-10-08T13:00:53.302 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2, 2023-10-08T13:00:53.302 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000355287, 2023-10-08T13:00:53.302 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000177643 2023-10-08T13:00:53.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.302 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2023-10-08T13:00:53.303 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.303 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.303 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.303 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.303 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2023-10-08T13:00:53.303 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.303 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.304 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.304 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.304 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2023-10-08T13:00:53.304 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.304 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.304 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.304 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.305 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2023-10-08T13:00:53.305 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 19, 2023-10-08T13:00:53.305 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.023206954, 2023-10-08T13:00:53.305 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001221418 2023-10-08T13:00:53.305 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.305 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2023-10-08T13:00:53.305 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 119, 2023-10-08T13:00:53.305 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.652127089, 2023-10-08T13:00:53.306 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.005480059 2023-10-08T13:00:53.306 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.306 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2023-10-08T13:00:53.306 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.306 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.306 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.306 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.307 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2023-10-08T13:00:53.307 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 19, 2023-10-08T13:00:53.307 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.797627494, 2023-10-08T13:00:53.307 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.041980394 2023-10-08T13:00:53.307 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.307 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2023-10-08T13:00:53.307 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 9, 2023-10-08T13:00:53.308 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.011101003, 2023-10-08T13:00:53.308 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001233444 2023-10-08T13:00:53.308 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.308 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2023-10-08T13:00:53.308 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 191216, 2023-10-08T13:00:53.308 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1634.816258750, 2023-10-08T13:00:53.308 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.008549578 2023-10-08T13:00:53.308 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.309 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2023-10-08T13:00:53.309 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 21822, 2023-10-08T13:00:53.309 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 121.914505010, 2023-10-08T13:00:53.309 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.005586770 2023-10-08T13:00:53.309 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.309 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2023-10-08T13:00:53.309 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.310 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.310 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.310 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.310 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2023-10-08T13:00:53.310 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.310 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.310 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.311 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2023-10-08T13:00:53.311 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1, 2023-10-08T13:00:53.311 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000384960, 2023-10-08T13:00:53.311 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000384960 2023-10-08T13:00:53.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.311 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2023-10-08T13:00:53.312 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 13, 2023-10-08T13:00:53.312 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.168880414, 2023-10-08T13:00:53.312 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.012990801 2023-10-08T13:00:53.312 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.312 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2023-10-08T13:00:53.312 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.312 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.313 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.313 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.313 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2023-10-08T13:00:53.313 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 264, 2023-10-08T13:00:53.313 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 8.658227701, 2023-10-08T13:00:53.313 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.032796317 2023-10-08T13:00:53.313 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.314 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2023-10-08T13:00:53.314 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.314 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.314 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.314 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.314 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2023-10-08T13:00:53.314 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3348, 2023-10-08T13:00:53.315 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 14.906602764, 2023-10-08T13:00:53.315 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.004452390 2023-10-08T13:00:53.315 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.315 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2023-10-08T13:00:53.315 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.315 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.315 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.315 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.316 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2023-10-08T13:00:53.316 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 6, 2023-10-08T13:00:53.316 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.018863525, 2023-10-08T13:00:53.316 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.003143920 2023-10-08T13:00:53.316 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.316 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2023-10-08T13:00:53.316 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.317 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.317 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.317 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.317 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2023-10-08T13:00:53.317 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 103916, 2023-10-08T13:00:53.317 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 646.972192098, 2023-10-08T13:00:53.317 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006225915 2023-10-08T13:00:53.318 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.318 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:00:53.318 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:00:53.318 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2023-10-08T13:00:53.318 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.318 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.318 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.319 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:53.319 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.319 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2023-10-08T13:00:53.319 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 2, 2023-10-08T13:00:53.319 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 3, 2023-10-08T13:00:53.319 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 1, 2023-10-08T13:00:53.319 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 2, 2023-10-08T13:00:53.319 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2023-10-08T13:00:53.320 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 55775, 2023-10-08T13:00:53.320 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 27887, 2023-10-08T13:00:53.320 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 1157, 2023-10-08T13:00:53.320 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2023-10-08T13:00:53.320 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.320 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-08T13:00:53.320 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:00:53.321 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-08T13:00:53.321 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:00:53.321 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:00:53.321 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:00:53.321 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:00:53.321 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:00:53.321 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:00:53.321 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:00:53.322 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:00:53.322 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:00:53.322 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:00:53.322 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:00:53.322 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:00:53.322 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:00:53.322 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-08T13:00:53.323 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:00:53.323 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-08T13:00:53.323 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:00:53.323 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:00:53.323 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:00:53.323 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:00:53.323 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:00:53.324 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:00:53.324 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:00:53.324 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-08T13:00:53.324 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:00:53.324 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:00:53.324 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:00:53.324 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-08T13:00:53.325 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-08T13:00:53.325 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-08T13:00:53.325 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:00:53.325 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:00:53.366 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:00:53.366 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:00:53.366 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 552020, 2023-10-08T13:00:53.366 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 2753, 2023-10-08T13:00:53.366 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 88, 2023-10-08T13:00:53.366 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 1, 2023-10-08T13:00:53.366 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-08T13:00:53.367 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-08T13:00:53.367 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:00:53.367 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-08T13:00:53.367 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:00:53.367 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-08T13:00:53.367 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 7872, 2023-10-08T13:00:53.367 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 164, 2023-10-08T13:00:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:00:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:00:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-08T13:00:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-08T13:00:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 19236142, 2023-10-08T13:00:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 233269, 2023-10-08T13:00:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-08T13:00:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-08T13:00:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-08T13:00:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-08T13:00:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2023-10-08T13:00:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2023-10-08T13:00:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2023-10-08T13:00:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 275122, 2023-10-08T13:00:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 2827845100, 2023-10-08T13:00:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 31, 2023-10-08T13:00:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 275122, 2023-10-08T13:00:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2023-10-08T13:00:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 275122, 2023-10-08T13:00:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1724.666415844, 2023-10-08T13:00:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006268733 2023-10-08T13:00:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2023-10-08T13:00:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2023-10-08T13:00:53.388 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 275122, 2023-10-08T13:00:53.388 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 279085 2023-10-08T13:00:53.388 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.389 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 275122, 2023-10-08T13:00:53.389 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 13248, 2023-10-08T13:00:53.389 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 261874, 2023-10-08T13:00:53.389 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2023-10-08T13:00:53.389 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2023-10-08T13:00:53.389 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 364, 2023-10-08T13:00:53.389 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 941, 2023-10-08T13:00:53.390 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 1852, 2023-10-08T13:00:53.390 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 153493, 2023-10-08T13:00:53.390 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 784, 2023-10-08T13:00:53.390 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2023-10-08T13:00:53.390 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2023-10-08T13:00:53.390 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2023-10-08T13:00:53.390 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 36, 2023-10-08T13:00:53.390 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 105528, 2023-10-08T13:00:53.391 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2023-10-08T13:00:53.391 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2023-10-08T13:00:53.391 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2023-10-08T13:00:53.391 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 11396, 2023-10-08T13:00:53.391 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 1882, 2023-10-08T13:00:53.391 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:00:53.391 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2023-10-08T13:00:53.392 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:00:53.392 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2023-10-08T13:00:53.392 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2023-10-08T13:00:53.392 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2023-10-08T13:00:53.392 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:00:53.392 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2023-10-08T13:00:53.392 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:00:53.392 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2023-10-08T13:00:53.393 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2023-10-08T13:00:53.393 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2023-10-08T13:00:53.393 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2023-10-08T13:00:53.393 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2023-10-08T13:00:53.393 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2023-10-08T13:00:53.393 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2023-10-08T13:00:53.393 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2023-10-08T13:00:53.394 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2023-10-08T13:00:53.394 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2023-10-08T13:00:53.394 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2023-10-08T13:00:53.394 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2023-10-08T13:00:53.394 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2023-10-08T13:00:53.394 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2023-10-08T13:00:53.394 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2023-10-08T13:00:53.394 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2023-10-08T13:00:53.395 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2023-10-08T13:00:53.395 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 112, 2023-10-08T13:00:53.395 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2023-10-08T13:00:53.395 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 29, 2023-10-08T13:00:53.395 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 12, 2023-10-08T13:00:53.395 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 12, 2023-10-08T13:00:53.395 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2023-10-08T13:00:53.395 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2023-10-08T13:00:53.396 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 2126, 2023-10-08T13:00:53.396 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 0, 2023-10-08T13:00:53.396 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 683 2023-10-08T13:00:53.396 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.396 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2023-10-08T13:00:53.396 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 1, 2023-10-08T13:00:53.396 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:00:53.397 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2023-10-08T13:00:53.397 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2023-10-08T13:00:53.397 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.397 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2023-10-08T13:00:53.397 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 1 2023-10-08T13:00:53.397 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.398 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2023-10-08T13:00:53.398 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2023-10-08T13:00:53.398 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 32, 2023-10-08T13:00:53.398 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2023-10-08T13:00:53.398 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 32, 2023-10-08T13:00:53.398 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 103581, 2023-10-08T13:00:53.398 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2023-10-08T13:00:53.399 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.399 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:00:53.399 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-08T13:00:53.399 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-08T13:00:53.399 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-08T13:00:53.399 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 1043611, 2023-10-08T13:00:53.399 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 243771844, 2023-10-08T13:00:53.400 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:53.400 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 1043611, 2023-10-08T13:00:53.400 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-08T13:00:53.400 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-08T13:00:53.400 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 1043611, 2023-10-08T13:00:53.400 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 243771844, 2023-10-08T13:00:53.400 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-08T13:00:53.400 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.401 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.401 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.401 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:53.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.401 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2023-10-08T13:00:53.401 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-08T13:00:53.401 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-08T13:00:53.402 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-08T13:00:53.402 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-08T13:00:53.402 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-08T13:00:53.402 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:53.402 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-08T13:00:53.405 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 275122, 2023-10-08T13:00:53.405 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 2838321957, 2023-10-08T13:00:53.405 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 275122, 2023-10-08T13:00:53.405 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2838321957, 2023-10-08T13:00:53.405 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-08T13:00:53.405 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.406 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.406 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.406 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:53.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.406 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2023-10-08T13:00:53.406 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-08T13:00:53.406 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2023-10-08T13:00:53.407 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-08T13:00:53.407 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2023-10-08T13:00:53.407 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2023-10-08T13:00:53.407 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:53.407 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2023-10-08T13:00:53.407 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 275122, 2023-10-08T13:00:53.407 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 275122, 2023-10-08T13:00:53.408 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 275122, 2023-10-08T13:00:53.408 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 275122, 2023-10-08T13:00:53.408 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-08T13:00:53.408 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.408 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.408 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.408 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:53.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.409 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:00:53.409 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-08T13:00:53.409 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-08T13:00:53.409 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-08T13:00:53.409 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 103581, 2023-10-08T13:00:53.409 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 10476857, 2023-10-08T13:00:53.409 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:53.410 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 103581, 2023-10-08T13:00:53.410 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-08T13:00:53.410 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-08T13:00:53.410 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 1814, 2023-10-08T13:00:53.410 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 10476857, 2023-10-08T13:00:53.410 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-08T13:00:53.410 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.410 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.411 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.411 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:53.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:53.411 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x560f24be86e0": { 2023-10-08T13:00:53.411 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-08T13:00:53.411 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2023-10-08T13:00:53.411 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-08T13:00:53.412 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 458218, 2023-10-08T13:00:53.412 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 2800771127, 2023-10-08T13:00:53.412 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:53.412 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 458218, 2023-10-08T13:00:53.412 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-08T13:00:53.412 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-08T13:00:53.412 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 151679, 2023-10-08T13:00:53.412 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2800771127, 2023-10-08T13:00:53.413 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-08T13:00:53.413 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:53.413 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:53.413 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:53.413 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:53.413 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:53.413 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-08T13:00:53.652 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2023-10-08T13:00:53.759 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=19 2023-10-08T13:00:53.759 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=13 2023-10-08T13:00:53.759 DEBUG:tasks.check_counter:Getting stats from e 2023-10-08T13:00:53.760 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-08T13:00:54.391 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:00:54.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:54 smithi173 ceph-mon[135182]: pgmap v931: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 1.4 MiB/s wr, 54 op/s 2023-10-08T13:00:54.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:54 smithi059 ceph-mon[98489]: pgmap v931: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 1.4 MiB/s wr, 54 op/s 2023-10-08T13:00:54.592 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:54 smithi092 ceph-mon[134093]: pgmap v931: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 1.4 MiB/s wr, 54 op/s 2023-10-08T13:00:55.592 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-08T13:00:55.592 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:00:55.593 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 358, 2023-10-08T13:00:55.593 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 353, 2023-10-08T13:00:55.593 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 784608, 2023-10-08T13:00:55.593 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 212672, 2023-10-08T13:00:55.593 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:55.594 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 0, 2023-10-08T13:00:55.594 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.044926561, 2023-10-08T13:00:55.594 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.015847873, 2023-10-08T13:00:55.594 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.020882645, 2023-10-08T13:00:55.594 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.007975348, 2023-10-08T13:00:55.594 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:55.594 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 352, 2023-10-08T13:00:55.594 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.013931962, 2023-10-08T13:00:55.595 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000039579 2023-10-08T13:00:55.595 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:55.595 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:55.595 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:55.595 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:55.595 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:55.595 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:55.596 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 784608, 2023-10-08T13:00:55.596 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 212672 2023-10-08T13:00:55.596 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:55.596 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:00:55.596 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 6, 2023-10-08T13:00:55.596 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 271, 2023-10-08T13:00:55.596 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 3312, 2023-10-08T13:00:55.596 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 201168, 2023-10-08T13:00:55.597 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:55.597 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2023-10-08T13:00:55.597 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.011870334, 2023-10-08T13:00:55.597 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.008466236, 2023-10-08T13:00:55.597 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.001277439, 2023-10-08T13:00:55.597 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:55.597 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:55.598 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 270, 2023-10-08T13:00:55.598 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.014723175, 2023-10-08T13:00:55.598 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000054530 2023-10-08T13:00:55.598 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:55.598 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:55.598 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:55.598 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:55.599 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:55.599 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:55.599 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-08T13:00:55.599 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 201168 2023-10-08T13:00:55.599 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:55.599 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:00:55.599 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 0, 2023-10-08T13:00:55.599 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 2, 2023-10-08T13:00:55.600 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:00:55.600 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 0, 2023-10-08T13:00:55.600 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 2, 2023-10-08T13:00:55.600 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2023-10-08T13:00:55.600 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.000333970, 2023-10-08T13:00:55.600 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:00:55.600 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.000265375, 2023-10-08T13:00:55.601 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:55.601 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:55.601 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:55.601 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:55.601 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:55.601 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:55.601 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:55.601 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:55.602 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:55.602 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:55.602 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:55.602 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:00:55.602 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:00:55.602 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:55.602 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-08T13:00:55.603 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 0, 2023-10-08T13:00:55.603 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-08T13:00:55.603 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:55.603 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-08T13:00:55.603 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:00:55.603 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-08T13:00:55.603 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:00:55.604 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:00:55.604 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:00:55.604 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:00:55.604 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:00:55.604 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:00:55.604 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:00:55.604 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:00:55.605 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:00:55.605 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:00:55.605 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:00:55.605 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:00:55.605 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:00:55.605 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-08T13:00:55.605 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:00:55.605 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-08T13:00:55.606 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:00:55.606 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:00:55.606 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:00:55.606 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:00:55.606 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:00:55.606 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:00:55.606 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:00:55.607 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-08T13:00:55.607 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:00:55.607 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:00:55.607 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:00:55.607 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-08T13:00:55.607 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-08T13:00:55.607 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-08T13:00:55.608 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:00:55.608 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:00:55.608 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:00:55.609 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:00:55.609 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 148722, 2023-10-08T13:00:55.609 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 30, 2023-10-08T13:00:55.609 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:00:55.609 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2023-10-08T13:00:55.609 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-08T13:00:55.610 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-08T13:00:55.610 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:00:55.610 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-08T13:00:55.610 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:00:55.610 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-08T13:00:55.610 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 0, 2023-10-08T13:00:55.611 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 0, 2023-10-08T13:00:55.611 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:00:55.611 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:00:55.611 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-08T13:00:55.611 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-08T13:00:55.611 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 928, 2023-10-08T13:00:55.611 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 2, 2023-10-08T13:00:55.611 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-08T13:00:55.612 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-08T13:00:55.612 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-08T13:00:55.612 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-08T13:00:55.612 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:55.612 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:00:55.612 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-08T13:00:55.612 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-08T13:00:55.613 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-08T13:00:55.613 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 360, 2023-10-08T13:00:55.613 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 733988, 2023-10-08T13:00:55.613 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:55.613 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 360, 2023-10-08T13:00:55.613 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-08T13:00:55.613 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-08T13:00:55.614 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 360, 2023-10-08T13:00:55.614 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 733988, 2023-10-08T13:00:55.614 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-08T13:00:55.614 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:55.614 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:55.614 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:55.614 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:55.614 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:55.615 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-08T13:00:55.952 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2023-10-08T13:00:55.953 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2023-10-08T13:00:55.953 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2023-10-08T13:00:55.953 DEBUG:tasks.check_counter:Getting stats from h 2023-10-08T13:00:55.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-08T13:00:56.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:56 smithi092 ceph-mon[134093]: pgmap v932: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 1010 KiB/s wr, 36 op/s 2023-10-08T13:00:56.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:56 smithi173 ceph-mon[135182]: pgmap v932: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 1010 KiB/s wr, 36 op/s 2023-10-08T13:00:56.513 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:00:56.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:56 smithi059 ceph-mon[98489]: pgmap v932: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 1010 KiB/s wr, 36 op/s 2023-10-08T13:00:57.702 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-08T13:00:57.702 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:00:57.702 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 357, 2023-10-08T13:00:57.703 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 352, 2023-10-08T13:00:57.703 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 784336, 2023-10-08T13:00:57.703 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 212048, 2023-10-08T13:00:57.703 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:57.703 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 0, 2023-10-08T13:00:57.703 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.044468302, 2023-10-08T13:00:57.703 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.015795179, 2023-10-08T13:00:57.703 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.020070832, 2023-10-08T13:00:57.704 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.007966170, 2023-10-08T13:00:57.704 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:57.704 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 351, 2023-10-08T13:00:57.704 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.011592259, 2023-10-08T13:00:57.704 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000033026 2023-10-08T13:00:57.704 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:57.704 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:57.705 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:57.705 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:57.705 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:57.705 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:57.705 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 784336, 2023-10-08T13:00:57.705 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 212048 2023-10-08T13:00:57.705 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:57.705 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:00:57.706 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 6, 2023-10-08T13:00:57.706 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 270, 2023-10-08T13:00:57.706 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 3312, 2023-10-08T13:00:57.706 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 200992, 2023-10-08T13:00:57.706 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:57.706 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2023-10-08T13:00:57.706 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.012168269, 2023-10-08T13:00:57.707 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.008577968, 2023-10-08T13:00:57.707 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.001368388, 2023-10-08T13:00:57.707 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:57.707 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:57.707 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 269, 2023-10-08T13:00:57.707 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.016399840, 2023-10-08T13:00:57.707 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000060965 2023-10-08T13:00:57.707 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:57.708 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:57.708 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:57.708 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:57.708 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:57.708 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:57.708 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-08T13:00:57.708 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 200992 2023-10-08T13:00:57.709 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:57.709 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:00:57.709 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 0, 2023-10-08T13:00:57.709 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 2, 2023-10-08T13:00:57.709 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:00:57.709 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 0, 2023-10-08T13:00:57.709 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 2, 2023-10-08T13:00:57.710 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2023-10-08T13:00:57.710 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.000394351, 2023-10-08T13:00:57.710 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:00:57.710 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.000323264, 2023-10-08T13:00:57.710 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:57.710 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:57.710 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:57.711 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:57.711 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:57.711 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:57.711 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:57.711 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:57.711 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:57.711 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:57.711 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:57.712 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:00:57.712 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:00:57.712 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:57.712 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-08T13:00:57.712 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 0, 2023-10-08T13:00:57.712 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-08T13:00:57.712 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:57.712 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-08T13:00:57.713 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:00:57.713 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-08T13:00:57.713 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:00:57.713 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:00:57.713 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:00:57.713 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:00:57.713 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:00:57.714 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:00:57.714 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:00:57.714 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:00:57.714 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:00:57.714 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:00:57.714 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:00:57.714 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:00:57.714 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:00:57.715 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-08T13:00:57.715 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:00:57.715 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-08T13:00:57.715 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:00:57.715 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:00:57.715 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:00:57.715 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:00:57.715 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:00:57.716 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:00:57.716 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:00:57.716 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-08T13:00:57.716 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:00:57.716 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:00:57.716 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:00:57.716 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-08T13:00:57.717 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-08T13:00:57.717 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-08T13:00:57.717 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:00:57.717 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:00:57.717 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:00:57.717 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:00:57.717 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 148744, 2023-10-08T13:00:57.717 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 30, 2023-10-08T13:00:57.718 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:00:57.718 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2023-10-08T13:00:57.718 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-08T13:00:57.718 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-08T13:00:57.718 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:00:57.718 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-08T13:00:57.718 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:00:57.719 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-08T13:00:57.719 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 0, 2023-10-08T13:00:57.719 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 0, 2023-10-08T13:00:57.719 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:00:57.719 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:00:57.719 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-08T13:00:57.719 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-08T13:00:57.719 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 928, 2023-10-08T13:00:57.720 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 2, 2023-10-08T13:00:57.720 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-08T13:00:57.720 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-08T13:00:57.720 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-08T13:00:57.720 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-08T13:00:57.720 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:57.720 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:00:57.721 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-08T13:00:57.721 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-08T13:00:57.721 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-08T13:00:57.721 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 359, 2023-10-08T13:00:57.721 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 733858, 2023-10-08T13:00:57.721 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:57.722 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 359, 2023-10-08T13:00:57.722 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-08T13:00:57.722 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-08T13:00:57.723 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 359, 2023-10-08T13:00:57.723 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 733858, 2023-10-08T13:00:57.723 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-08T13:00:57.723 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:57.723 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:57.723 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:57.723 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:57.724 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:57.724 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-08T13:00:58.074 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2023-10-08T13:00:58.074 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2023-10-08T13:00:58.074 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2023-10-08T13:00:58.074 DEBUG:tasks.check_counter:Getting stats from k 2023-10-08T13:00:58.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-08T13:00:58.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:00:58 smithi092 ceph-mon[134093]: pgmap v933: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 819 KiB/s wr, 25 op/s 2023-10-08T13:00:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:00:58 smithi173 ceph-mon[135182]: pgmap v933: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 819 KiB/s wr, 25 op/s 2023-10-08T13:00:58.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:00:58 smithi059 ceph-mon[98489]: pgmap v933: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 819 KiB/s wr, 25 op/s 2023-10-08T13:00:58.635 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:00:59.840 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-08T13:00:59.841 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:00:59.841 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 361, 2023-10-08T13:00:59.841 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 356, 2023-10-08T13:00:59.841 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 785424, 2023-10-08T13:00:59.841 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 214544, 2023-10-08T13:00:59.841 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2023-10-08T13:00:59.841 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 0, 2023-10-08T13:00:59.842 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.046661029, 2023-10-08T13:00:59.842 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.016762807, 2023-10-08T13:00:59.842 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.021472720, 2023-10-08T13:00:59.842 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.008292456, 2023-10-08T13:00:59.842 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:59.842 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 355, 2023-10-08T13:00:59.842 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.012933757, 2023-10-08T13:00:59.843 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000036433 2023-10-08T13:00:59.843 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:59.843 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:59.843 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:59.843 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:59.843 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:59.843 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:59.843 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 785424, 2023-10-08T13:00:59.844 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 214544 2023-10-08T13:00:59.844 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:59.844 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:00:59.844 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 5, 2023-10-08T13:00:59.844 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 273, 2023-10-08T13:00:59.844 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 3152, 2023-10-08T13:00:59.844 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 124656, 2023-10-08T13:00:59.845 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 3, 2023-10-08T13:00:59.845 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2023-10-08T13:00:59.845 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.011543113, 2023-10-08T13:00:59.845 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.008320397, 2023-10-08T13:00:59.845 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.001196532, 2023-10-08T13:00:59.845 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:59.845 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:59.846 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 272, 2023-10-08T13:00:59.846 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.010285443, 2023-10-08T13:00:59.846 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000037814 2023-10-08T13:00:59.846 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:59.846 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:59.846 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:59.846 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:59.847 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:59.847 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:59.847 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-08T13:00:59.847 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 124656 2023-10-08T13:00:59.847 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:59.847 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:00:59.847 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 0, 2023-10-08T13:00:59.847 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 2, 2023-10-08T13:00:59.848 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:00:59.848 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 0, 2023-10-08T13:00:59.848 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 2, 2023-10-08T13:00:59.848 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2023-10-08T13:00:59.848 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.000365707, 2023-10-08T13:00:59.848 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:00:59.848 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.000298879, 2023-10-08T13:00:59.849 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:00:59.849 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:00:59.849 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:59.849 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:59.849 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:59.849 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:59.849 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:00:59.850 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:59.850 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:59.850 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:59.850 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:59.850 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:00:59.850 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:00:59.850 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:59.850 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2023-10-08T13:00:59.851 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 0, 2023-10-08T13:00:59.851 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2023-10-08T13:00:59.851 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:59.851 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2023-10-08T13:00:59.851 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:00:59.851 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2023-10-08T13:00:59.851 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:00:59.852 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:00:59.852 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:00:59.852 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:00:59.852 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:00:59.852 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:00:59.852 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:00:59.852 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:00:59.853 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:00:59.853 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:00:59.853 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:00:59.853 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:00:59.853 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:00:59.853 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2023-10-08T13:00:59.853 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:00:59.853 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2023-10-08T13:00:59.854 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:00:59.854 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:00:59.854 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:00:59.854 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:00:59.854 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:00:59.855 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:00:59.855 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:00:59.855 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2023-10-08T13:00:59.855 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:00:59.855 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:00:59.855 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:00:59.855 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2023-10-08T13:00:59.856 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2023-10-08T13:00:59.856 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2023-10-08T13:00:59.856 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:00:59.856 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:00:59.856 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:00:59.856 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:00:59.856 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 148984, 2023-10-08T13:00:59.857 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 30, 2023-10-08T13:00:59.857 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:00:59.857 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2023-10-08T13:00:59.857 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2023-10-08T13:00:59.857 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2023-10-08T13:00:59.857 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:00:59.857 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2023-10-08T13:00:59.858 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:00:59.858 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2023-10-08T13:00:59.858 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 0, 2023-10-08T13:00:59.858 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 0, 2023-10-08T13:00:59.858 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:00:59.858 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:00:59.858 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2023-10-08T13:00:59.858 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2023-10-08T13:00:59.859 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 928, 2023-10-08T13:00:59.859 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 2, 2023-10-08T13:00:59.859 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2023-10-08T13:00:59.859 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2023-10-08T13:00:59.859 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2023-10-08T13:00:59.859 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2023-10-08T13:00:59.859 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-08T13:00:59.860 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:00:59.860 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2023-10-08T13:00:59.860 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2023-10-08T13:00:59.860 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2023-10-08T13:00:59.860 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 362, 2023-10-08T13:00:59.860 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 734351, 2023-10-08T13:00:59.860 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2023-10-08T13:00:59.860 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 362, 2023-10-08T13:00:59.861 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2023-10-08T13:00:59.861 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2023-10-08T13:00:59.861 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 362, 2023-10-08T13:00:59.861 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 734351, 2023-10-08T13:00:59.861 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2023-10-08T13:00:59.861 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2023-10-08T13:00:59.861 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2023-10-08T13:00:59.862 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2023-10-08T13:00:59.862 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:59.862 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-08T13:00:59.862 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-08T13:01:00.209 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:00 smithi092 ceph-mon[134093]: pgmap v934: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 260 KiB/s wr, 9 op/s 2023-10-08T13:01:00.209 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:00 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:00.284 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2023-10-08T13:01:00.285 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2023-10-08T13:01:00.285 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2023-10-08T13:01:00.285 DEBUG:tasks.check_counter:Getting stats from c 2023-10-08T13:01:00.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-08T13:01:00.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:00 smithi173 ceph-mon[135182]: pgmap v934: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 260 KiB/s wr, 9 op/s 2023-10-08T13:01:00.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:00 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:00.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:00 smithi059 ceph-mon[98489]: pgmap v934: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 260 KiB/s wr, 9 op/s 2023-10-08T13:01:00.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:00 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:01:01.326 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:01 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:01.326 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:01 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:01.326 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:01 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T13:01:01.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:01 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:01.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:01 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:01.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:01 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T13:01:01.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:01 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:01.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:01 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:01.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:01 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' 2023-10-08T13:01:02.144 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-10-08T13:01:02.144 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:01:02.144 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 358, 2023-10-08T13:01:02.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 353, 2023-10-08T13:01:02.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 784608, 2023-10-08T13:01:02.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 212672, 2023-10-08T13:01:02.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 4, 2023-10-08T13:01:02.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 0, 2023-10-08T13:01:02.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.050199059, 2023-10-08T13:01:02.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.018320620, 2023-10-08T13:01:02.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.021941697, 2023-10-08T13:01:02.146 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.008770761, 2023-10-08T13:01:02.146 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:02.146 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 352, 2023-10-08T13:01:02.146 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.018149979, 2023-10-08T13:01:02.146 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000051562 2023-10-08T13:01:02.146 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:02.146 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:02.147 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:02.147 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:02.147 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:02.147 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:02.147 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 784608, 2023-10-08T13:01:02.147 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 212672 2023-10-08T13:01:02.147 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:02.147 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:01:02.148 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 6, 2023-10-08T13:01:02.148 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 272, 2023-10-08T13:01:02.148 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 3312, 2023-10-08T13:01:02.148 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 201344, 2023-10-08T13:01:02.148 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 4, 2023-10-08T13:01:02.148 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 2, 2023-10-08T13:01:02.148 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.013529951, 2023-10-08T13:01:02.149 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.009731068, 2023-10-08T13:01:02.149 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.001264168, 2023-10-08T13:01:02.149 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:01:02.149 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:02.149 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 271, 2023-10-08T13:01:02.149 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.016685687, 2023-10-08T13:01:02.149 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000061570 2023-10-08T13:01:02.149 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:02.150 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:02.150 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:02.150 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:02.150 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:02.150 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:02.150 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-08T13:01:02.150 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 201344 2023-10-08T13:01:02.150 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:02.151 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:01:02.151 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 0, 2023-10-08T13:01:02.151 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2, 2023-10-08T13:01:02.151 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:01:02.151 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 0, 2023-10-08T13:01:02.151 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 2, 2023-10-08T13:01:02.151 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 1, 2023-10-08T13:01:02.151 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.000205193, 2023-10-08T13:01:02.152 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:01:02.152 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.000137459, 2023-10-08T13:01:02.152 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:01:02.152 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:02.152 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:02.152 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:02.152 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:02.152 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:01:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:01:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2023-10-08T13:01:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 0, 2023-10-08T13:01:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2023-10-08T13:01:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2023-10-08T13:01:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:01:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2023-10-08T13:01:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:01:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:01:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:01:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:01:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:01:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:01:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:01:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:01:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:01:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:01:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:01:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:01:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:01:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2023-10-08T13:01:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:01:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2023-10-08T13:01:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:01:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:01:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:01:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:01:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:01:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:01:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:01:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2023-10-08T13:01:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:01:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:01:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:01:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2023-10-08T13:01:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2023-10-08T13:01:02.159 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2023-10-08T13:01:02.159 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:01:02.159 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:01:02.159 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:01:02.159 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:01:02.159 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 148660, 2023-10-08T13:01:02.159 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 29, 2023-10-08T13:01:02.159 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:01:02.160 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2023-10-08T13:01:02.160 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2023-10-08T13:01:02.160 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2023-10-08T13:01:02.160 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:01:02.160 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2023-10-08T13:01:02.160 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:01:02.161 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2023-10-08T13:01:02.161 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 0, 2023-10-08T13:01:02.161 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 0, 2023-10-08T13:01:02.161 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:01:02.161 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:01:02.161 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2023-10-08T13:01:02.161 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2023-10-08T13:01:02.162 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 928, 2023-10-08T13:01:02.162 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 2, 2023-10-08T13:01:02.162 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2023-10-08T13:01:02.162 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2023-10-08T13:01:02.162 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2023-10-08T13:01:02.162 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2023-10-08T13:01:02.162 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:02.163 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:01:02.163 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2023-10-08T13:01:02.163 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2023-10-08T13:01:02.163 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2023-10-08T13:01:02.163 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 360, 2023-10-08T13:01:02.163 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 733988, 2023-10-08T13:01:02.163 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2023-10-08T13:01:02.163 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 360, 2023-10-08T13:01:02.164 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2023-10-08T13:01:02.164 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2023-10-08T13:01:02.164 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 360, 2023-10-08T13:01:02.164 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 733988, 2023-10-08T13:01:02.164 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2023-10-08T13:01:02.164 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:02.164 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:02.164 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:02.165 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:02.165 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:02.165 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-10-08T13:01:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:02 smithi173 ceph-mon[135182]: pgmap v935: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-10-08T13:01:02.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:02 smithi092 ceph-mon[134093]: pgmap v935: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-10-08T13:01:02.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:02 smithi059 ceph-mon[98489]: pgmap v935: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-10-08T13:01:02.603 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2023-10-08T13:01:02.604 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2023-10-08T13:01:02.604 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2023-10-08T13:01:02.604 DEBUG:tasks.check_counter:Getting stats from f 2023-10-08T13:01:02.604 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-08T13:01:03.203 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:01:04.375 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-10-08T13:01:04.375 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:01:04.375 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 0, 2023-10-08T13:01:04.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2, 2023-10-08T13:01:04.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:01:04.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 0, 2023-10-08T13:01:04.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 4, 2023-10-08T13:01:04.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 0, 2023-10-08T13:01:04.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.001099477, 2023-10-08T13:01:04.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:01:04.377 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.000186528, 2023-10-08T13:01:04.377 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:01:04.377 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:04.377 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:04.377 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:04.377 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:04.378 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:04.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:04.378 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:04.378 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:04.379 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:04.379 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:04.379 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:01:04.379 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:01:04.379 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:04.379 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:01:04.379 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 6, 2023-10-08T13:01:04.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 273, 2023-10-08T13:01:04.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 3312, 2023-10-08T13:01:04.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 201520, 2023-10-08T13:01:04.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 4, 2023-10-08T13:01:04.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 2, 2023-10-08T13:01:04.381 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.013849417, 2023-10-08T13:01:04.381 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.009947357, 2023-10-08T13:01:04.381 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.001327267, 2023-10-08T13:01:04.381 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:01:04.381 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:04.381 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 272, 2023-10-08T13:01:04.382 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.021245267, 2023-10-08T13:01:04.382 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000078107 2023-10-08T13:01:04.382 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:04.382 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:04.382 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:04.382 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:04.382 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:04.383 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:04.383 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-08T13:01:04.383 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 201520 2023-10-08T13:01:04.383 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:04.383 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:01:04.383 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 359, 2023-10-08T13:01:04.383 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 354, 2023-10-08T13:01:04.384 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 784880, 2023-10-08T13:01:04.384 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 213296, 2023-10-08T13:01:04.384 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 2, 2023-10-08T13:01:04.384 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 1, 2023-10-08T13:01:04.384 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.049654109, 2023-10-08T13:01:04.384 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.018764589, 2023-10-08T13:01:04.384 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.021671656, 2023-10-08T13:01:04.385 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.008630739, 2023-10-08T13:01:04.385 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:04.385 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 353, 2023-10-08T13:01:04.385 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.015136054, 2023-10-08T13:01:04.385 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000042878 2023-10-08T13:01:04.385 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:04.385 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:04.385 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:04.386 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:04.386 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:04.386 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:04.386 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 784880, 2023-10-08T13:01:04.386 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 213296 2023-10-08T13:01:04.386 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:04.386 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2023-10-08T13:01:04.387 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 0, 2023-10-08T13:01:04.387 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2023-10-08T13:01:04.387 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:04.387 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2023-10-08T13:01:04.387 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:01:04.387 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2023-10-08T13:01:04.387 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:01:04.387 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:01:04.388 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:01:04.388 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:01:04.388 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:01:04.388 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:01:04.388 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:01:04.388 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:01:04.388 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:01:04.388 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:01:04.389 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:01:04.389 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:01:04.389 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:01:04.389 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2023-10-08T13:01:04.389 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:01:04.389 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2023-10-08T13:01:04.389 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:01:04.389 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:01:04.390 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:01:04.390 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:01:04.390 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:01:04.390 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:01:04.390 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:01:04.390 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2023-10-08T13:01:04.390 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:01:04.391 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:01:04.391 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:01:04.391 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2023-10-08T13:01:04.391 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2023-10-08T13:01:04.391 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2023-10-08T13:01:04.391 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:01:04.391 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:01:04.391 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:01:04.392 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:01:04.392 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 148721, 2023-10-08T13:01:04.392 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 30, 2023-10-08T13:01:04.392 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:01:04.392 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2023-10-08T13:01:04.392 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2023-10-08T13:01:04.393 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2023-10-08T13:01:04.393 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:01:04.393 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2023-10-08T13:01:04.393 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:01:04.394 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2023-10-08T13:01:04.394 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 0, 2023-10-08T13:01:04.394 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 0, 2023-10-08T13:01:04.394 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:01:04.395 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:01:04.395 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2023-10-08T13:01:04.395 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2023-10-08T13:01:04.395 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 928, 2023-10-08T13:01:04.396 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 2, 2023-10-08T13:01:04.396 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2023-10-08T13:01:04.396 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2023-10-08T13:01:04.396 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2023-10-08T13:01:04.396 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2023-10-08T13:01:04.397 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:04.397 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:01:04.397 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2023-10-08T13:01:04.398 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2023-10-08T13:01:04.398 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2023-10-08T13:01:04.398 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 361, 2023-10-08T13:01:04.398 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 734118, 2023-10-08T13:01:04.399 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2023-10-08T13:01:04.399 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 361, 2023-10-08T13:01:04.399 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2023-10-08T13:01:04.399 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2023-10-08T13:01:04.400 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 361, 2023-10-08T13:01:04.400 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 734118, 2023-10-08T13:01:04.400 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2023-10-08T13:01:04.400 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:04.400 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:04.400 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:04.400 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:04.401 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:04.401 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-10-08T13:01:04.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:04 smithi173 ceph-mon[135182]: pgmap v936: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-10-08T13:01:04.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:04 smithi059 ceph-mon[98489]: pgmap v936: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-10-08T13:01:04.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:04 smithi092 ceph-mon[134093]: pgmap v936: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-10-08T13:01:04.757 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2023-10-08T13:01:04.757 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2023-10-08T13:01:04.757 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2023-10-08T13:01:04.757 DEBUG:tasks.check_counter:Getting stats from i 2023-10-08T13:01:04.757 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-08T13:01:05.313 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:01:06.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:06 smithi173 ceph-mon[135182]: pgmap v937: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 102 KiB/s wr, 18 op/s 2023-10-08T13:01:06.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:06 smithi059 ceph-mon[98489]: pgmap v937: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 102 KiB/s wr, 18 op/s 2023-10-08T13:01:06.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:06 smithi092 ceph-mon[134093]: pgmap v937: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 102 KiB/s wr, 18 op/s 2023-10-08T13:01:06.636 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-10-08T13:01:06.637 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:01:06.637 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 3547, 2023-10-08T13:01:06.637 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 3539, 2023-10-08T13:01:06.637 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 651857524, 2023-10-08T13:01:06.637 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 1198845, 2023-10-08T13:01:06.637 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 7, 2023-10-08T13:01:06.638 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2023-10-08T13:01:06.638 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.602232160, 2023-10-08T13:01:06.638 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.087316046, 2023-10-08T13:01:06.638 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.388083865, 2023-10-08T13:01:06.638 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.100617396, 2023-10-08T13:01:06.638 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:06.638 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3539, 2023-10-08T13:01:06.639 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.124442139, 2023-10-08T13:01:06.639 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000035163 2023-10-08T13:01:06.639 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.639 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:06.639 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.639 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.639 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.639 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.640 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 823680, 2023-10-08T13:01:06.640 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 218880 2023-10-08T13:01:06.640 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.640 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:01:06.640 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 2806, 2023-10-08T13:01:06.640 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 3074, 2023-10-08T13:01:06.640 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1095456636, 2023-10-08T13:01:06.641 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 1505998, 2023-10-08T13:01:06.641 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 8, 2023-10-08T13:01:06.641 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2023-10-08T13:01:06.641 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.634347659, 2023-10-08T13:01:06.641 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.060309354, 2023-10-08T13:01:06.641 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.490624182, 2023-10-08T13:01:06.641 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.064088721, 2023-10-08T13:01:06.641 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:06.642 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3072, 2023-10-08T13:01:06.642 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.080212065, 2023-10-08T13:01:06.642 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000026110 2023-10-08T13:01:06.642 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.642 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:06.642 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.642 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.643 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.643 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.643 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T13:01:06.643 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 633888 2023-10-08T13:01:06.643 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.644 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:01:06.644 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 2837, 2023-10-08T13:01:06.644 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2839, 2023-10-08T13:01:06.644 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1057328483, 2023-10-08T13:01:06.644 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 882314, 2023-10-08T13:01:06.644 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 6, 2023-10-08T13:01:06.644 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 5, 2023-10-08T13:01:06.645 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.618273347, 2023-10-08T13:01:06.645 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.056160301, 2023-10-08T13:01:06.645 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.476230591, 2023-10-08T13:01:06.645 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.068156106, 2023-10-08T13:01:06.645 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:06.645 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2837, 2023-10-08T13:01:06.645 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.072629338, 2023-10-08T13:01:06.646 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000025600 2023-10-08T13:01:06.646 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.646 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:06.646 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.646 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.646 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.646 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.647 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:01:06.647 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:01:06.647 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.647 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2023-10-08T13:01:06.647 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2023-10-08T13:01:06.647 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2023-10-08T13:01:06.647 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.647 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2023-10-08T13:01:06.648 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2023-10-08T13:01:06.648 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2023-10-08T13:01:06.648 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 12267, 2023-10-08T13:01:06.648 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.660985466, 2023-10-08T13:01:06.648 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000053883 2023-10-08T13:01:06.648 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:06.648 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.649 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2023-10-08T13:01:06.649 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2023-10-08T13:01:06.649 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2023-10-08T13:01:06.649 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.649 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.649 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.649 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:06.649 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2023-10-08T13:01:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 0, 2023-10-08T13:01:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 0, 2023-10-08T13:01:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2023-10-08T13:01:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2023-10-08T13:01:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2023-10-08T13:01:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2023-10-08T13:01:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2023-10-08T13:01:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 0, 2023-10-08T13:01:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2023-10-08T13:01:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2023-10-08T13:01:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 91250, 2023-10-08T13:01:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 51264, 2023-10-08T13:01:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 39858, 2023-10-08T13:01:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 128, 2023-10-08T13:01:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 18015, 2023-10-08T13:01:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 17404, 2023-10-08T13:01:06.653 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2023-10-08T13:01:06.653 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2023-10-08T13:01:06.653 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 2, 2023-10-08T13:01:06.653 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 0, 2023-10-08T13:01:06.653 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 0, 2023-10-08T13:01:06.653 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2023-10-08T13:01:06.653 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2023-10-08T13:01:06.654 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:01:06.654 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2023-10-08T13:01:06.654 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2023-10-08T13:01:06.654 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2023-10-08T13:01:06.654 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2023-10-08T13:01:06.654 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2023-10-08T13:01:06.654 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2023-10-08T13:01:06.655 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2023-10-08T13:01:06.655 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2023-10-08T13:01:06.655 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2023-10-08T13:01:06.655 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2023-10-08T13:01:06.655 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2023-10-08T13:01:06.655 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 712, 2023-10-08T13:01:06.655 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 222541348, 2023-10-08T13:01:06.656 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 6, 2023-10-08T13:01:06.656 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T13:01:06.656 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2023-10-08T13:01:06.656 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:01:06.656 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:01:06.656 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:01:06.656 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:01:06.656 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:01:06.657 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2023-10-08T13:01:06.657 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:01:06.657 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T13:01:06.657 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 0, 2023-10-08T13:01:06.657 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:01:06.657 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:01:06.657 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:01:06.658 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 0, 2023-10-08T13:01:06.658 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 0, 2023-10-08T13:01:06.658 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 0, 2023-10-08T13:01:06.658 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 0 2023-10-08T13:01:06.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.658 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2023-10-08T13:01:06.658 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2023-10-08T13:01:06.658 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2023-10-08T13:01:06.659 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2023-10-08T13:01:06.659 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2023-10-08T13:01:06.659 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2023-10-08T13:01:06.659 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2023-10-08T13:01:06.659 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2023-10-08T13:01:06.659 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:01:06.659 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 0, 2023-10-08T13:01:06.660 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2023-10-08T13:01:06.660 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2023-10-08T13:01:06.660 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2023-10-08T13:01:06.660 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2023-10-08T13:01:06.660 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:01:06.660 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:01:06.660 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2023-10-08T13:01:06.661 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2023-10-08T13:01:06.661 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:01:06.661 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2023-10-08T13:01:06.661 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2023-10-08T13:01:06.661 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:01:06.661 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2023-10-08T13:01:06.661 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2023-10-08T13:01:06.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.662 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2023-10-08T13:01:06.662 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2023-10-08T13:01:06.662 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 0, 2023-10-08T13:01:06.662 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2023-10-08T13:01:06.662 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2023-10-08T13:01:06.662 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 458254, 2023-10-08T13:01:06.662 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2023-10-08T13:01:06.663 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2023-10-08T13:01:06.663 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 0, 2023-10-08T13:01:06.663 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2023-10-08T13:01:06.663 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2023-10-08T13:01:06.663 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 128, 2023-10-08T13:01:06.663 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 39, 2023-10-08T13:01:06.663 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2023-10-08T13:01:06.663 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2023-10-08T13:01:06.664 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 2293865137, 2023-10-08T13:01:06.664 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 2805557580, 2023-10-08T13:01:06.664 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 2805557496, 2023-10-08T13:01:06.664 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2023-10-08T13:01:06.664 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.664 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.664 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.665 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 458254 2023-10-08T13:01:06.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.665 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2023-10-08T13:01:06.665 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 4421, 2023-10-08T13:01:06.665 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 108002, 2023-10-08T13:01:06.665 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 103581, 2023-10-08T13:01:06.666 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 226, 2023-10-08T13:01:06.666 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 481, 2023-10-08T13:01:06.666 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 255, 2023-10-08T13:01:06.666 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 91250, 2023-10-08T13:01:06.666 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 108654, 2023-10-08T13:01:06.666 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 17404, 2023-10-08T13:01:06.666 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2023-10-08T13:01:06.666 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 0, 2023-10-08T13:01:06.667 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 0, 2023-10-08T13:01:06.667 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 147512, 2023-10-08T13:01:06.667 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 207152 2023-10-08T13:01:06.667 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.667 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2023-10-08T13:01:06.667 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 0, 2023-10-08T13:01:06.667 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2023-10-08T13:01:06.668 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 0, 2023-10-08T13:01:06.668 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 0, 2023-10-08T13:01:06.668 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2023-10-08T13:01:06.668 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2023-10-08T13:01:06.668 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.668 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.668 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.668 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.669 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2023-10-08T13:01:06.669 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.669 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.669 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.669 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.669 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2023-10-08T13:01:06.669 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.670 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.670 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.670 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2023-10-08T13:01:06.670 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.670 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.670 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.671 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2023-10-08T13:01:06.671 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.671 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.671 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.671 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2023-10-08T13:01:06.672 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.672 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.672 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.672 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2023-10-08T13:01:06.672 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.672 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.673 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.673 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2023-10-08T13:01:06.673 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.673 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.673 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.673 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2023-10-08T13:01:06.674 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.674 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.674 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.674 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2023-10-08T13:01:06.674 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.674 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.675 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.675 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2023-10-08T13:01:06.675 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.675 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.675 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.676 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2023-10-08T13:01:06.676 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.676 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.676 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.676 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2023-10-08T13:01:06.676 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.677 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.677 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.677 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2023-10-08T13:01:06.677 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.677 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.677 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.678 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2023-10-08T13:01:06.678 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.678 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.678 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.678 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2023-10-08T13:01:06.678 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.679 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.679 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.679 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2023-10-08T13:01:06.679 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.679 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.679 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.680 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2023-10-08T13:01:06.680 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.680 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.680 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.680 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2023-10-08T13:01:06.681 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.681 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.681 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.681 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2023-10-08T13:01:06.681 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.681 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.681 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.682 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2023-10-08T13:01:06.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.682 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.682 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2023-10-08T13:01:06.683 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.683 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.683 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.683 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2023-10-08T13:01:06.683 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.683 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.683 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.684 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2023-10-08T13:01:06.684 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.684 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.684 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.684 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2023-10-08T13:01:06.685 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.685 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.685 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.685 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.685 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2023-10-08T13:01:06.685 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.685 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.686 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.686 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.686 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2023-10-08T13:01:06.686 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.686 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.686 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.686 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.686 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2023-10-08T13:01:06.687 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.687 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.687 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.687 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.687 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2023-10-08T13:01:06.687 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.687 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.688 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.688 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.688 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:01:06.688 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:01:06.688 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2023-10-08T13:01:06.688 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.688 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.689 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.689 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:06.689 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.689 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2023-10-08T13:01:06.689 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 2, 2023-10-08T13:01:06.689 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 3, 2023-10-08T13:01:06.689 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 1, 2023-10-08T13:01:06.689 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 2, 2023-10-08T13:01:06.690 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2023-10-08T13:01:06.690 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 0, 2023-10-08T13:01:06.690 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 0, 2023-10-08T13:01:06.690 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 3168, 2023-10-08T13:01:06.690 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2023-10-08T13:01:06.690 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.690 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2023-10-08T13:01:06.691 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:01:06.691 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2023-10-08T13:01:06.691 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:01:06.691 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:01:06.691 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:01:06.691 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:01:06.691 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:01:06.692 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:01:06.692 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:01:06.692 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:01:06.692 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:01:06.692 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:01:06.692 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:01:06.692 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:01:06.693 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:01:06.693 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2023-10-08T13:01:06.693 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:01:06.693 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2023-10-08T13:01:06.693 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:01:06.693 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:01:06.693 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:01:06.693 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:01:06.694 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:01:06.694 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:01:06.694 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:01:06.694 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2023-10-08T13:01:06.694 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:01:06.694 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:01:06.694 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:01:06.695 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2023-10-08T13:01:06.695 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2023-10-08T13:01:06.695 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2023-10-08T13:01:06.695 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:01:06.695 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:01:06.695 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:01:06.695 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:01:06.696 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 423344, 2023-10-08T13:01:06.696 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 5487, 2023-10-08T13:01:06.696 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:01:06.696 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2023-10-08T13:01:06.696 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2023-10-08T13:01:06.696 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2023-10-08T13:01:06.696 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:01:06.696 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2023-10-08T13:01:06.697 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:01:06.697 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2023-10-08T13:01:06.697 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7872, 2023-10-08T13:01:06.697 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 164, 2023-10-08T13:01:06.697 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:01:06.697 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:01:06.697 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2023-10-08T13:01:06.697 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2023-10-08T13:01:06.698 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 75719041, 2023-10-08T13:01:06.698 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 526977, 2023-10-08T13:01:06.698 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2023-10-08T13:01:06.698 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2023-10-08T13:01:06.698 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2023-10-08T13:01:06.698 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2023-10-08T13:01:06.698 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.699 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2023-10-08T13:01:06.699 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2023-10-08T13:01:06.699 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2023-10-08T13:01:06.699 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 8792, 2023-10-08T13:01:06.699 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 26, 2023-10-08T13:01:06.699 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 4, 2023-10-08T13:01:06.699 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 8792, 2023-10-08T13:01:06.700 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2023-10-08T13:01:06.700 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8792, 2023-10-08T13:01:06.700 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 13.466707701, 2023-10-08T13:01:06.700 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001531700 2023-10-08T13:01:06.700 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.700 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2023-10-08T13:01:06.700 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2023-10-08T13:01:06.700 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8792, 2023-10-08T13:01:06.701 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 8793 2023-10-08T13:01:06.701 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.701 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 8792, 2023-10-08T13:01:06.701 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 8792, 2023-10-08T13:01:06.701 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 0, 2023-10-08T13:01:06.701 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2023-10-08T13:01:06.701 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2023-10-08T13:01:06.702 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 5832, 2023-10-08T13:01:06.702 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 0, 2023-10-08T13:01:06.702 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 2957, 2023-10-08T13:01:06.702 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 0, 2023-10-08T13:01:06.702 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 0, 2023-10-08T13:01:06.702 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2023-10-08T13:01:06.702 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2023-10-08T13:01:06.703 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2023-10-08T13:01:06.703 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2023-10-08T13:01:06.703 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 0, 2023-10-08T13:01:06.703 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2023-10-08T13:01:06.703 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2023-10-08T13:01:06.703 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2023-10-08T13:01:06.703 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 2, 2023-10-08T13:01:06.703 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 0, 2023-10-08T13:01:06.704 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:01:06.704 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2023-10-08T13:01:06.704 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:01:06.704 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2023-10-08T13:01:06.704 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2023-10-08T13:01:06.704 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2023-10-08T13:01:06.704 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:01:06.705 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2023-10-08T13:01:06.705 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:01:06.705 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2023-10-08T13:01:06.705 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2023-10-08T13:01:06.705 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2023-10-08T13:01:06.705 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2023-10-08T13:01:06.705 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2023-10-08T13:01:06.705 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2023-10-08T13:01:06.706 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2023-10-08T13:01:06.706 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2023-10-08T13:01:06.706 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2023-10-08T13:01:06.706 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2023-10-08T13:01:06.706 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2023-10-08T13:01:06.706 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2023-10-08T13:01:06.706 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2023-10-08T13:01:06.707 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2023-10-08T13:01:06.707 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2023-10-08T13:01:06.707 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2023-10-08T13:01:06.707 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2023-10-08T13:01:06.707 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 112, 2023-10-08T13:01:06.707 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2023-10-08T13:01:06.707 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 28, 2023-10-08T13:01:06.707 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 11, 2023-10-08T13:01:06.708 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 11, 2023-10-08T13:01:06.708 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2023-10-08T13:01:06.708 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2023-10-08T13:01:06.708 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 0, 2023-10-08T13:01:06.708 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 2, 2023-10-08T13:01:06.708 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 0 2023-10-08T13:01:06.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.709 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2023-10-08T13:01:06.709 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 0, 2023-10-08T13:01:06.709 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:01:06.709 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2023-10-08T13:01:06.709 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2023-10-08T13:01:06.709 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.709 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2023-10-08T13:01:06.709 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2023-10-08T13:01:06.710 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.710 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2023-10-08T13:01:06.710 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2023-10-08T13:01:06.710 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T13:01:06.710 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2023-10-08T13:01:06.710 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2023-10-08T13:01:06.710 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2023-10-08T13:01:06.711 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2023-10-08T13:01:06.711 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.711 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:01:06.711 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2023-10-08T13:01:06.711 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2023-10-08T13:01:06.711 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2023-10-08T13:01:06.711 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 9186, 2023-10-08T13:01:06.712 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 2803792884, 2023-10-08T13:01:06.712 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2023-10-08T13:01:06.712 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 9186, 2023-10-08T13:01:06.712 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2023-10-08T13:01:06.712 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2023-10-08T13:01:06.712 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 9186, 2023-10-08T13:01:06.712 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 2803792884, 2023-10-08T13:01:06.712 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2023-10-08T13:01:06.713 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.713 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.713 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.713 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:06.713 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.713 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2023-10-08T13:01:06.713 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2023-10-08T13:01:06.714 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2023-10-08T13:01:06.714 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2023-10-08T13:01:06.714 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2023-10-08T13:01:06.714 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2023-10-08T13:01:06.714 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2023-10-08T13:01:06.714 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2023-10-08T13:01:06.714 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 8792, 2023-10-08T13:01:06.714 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 2801453533, 2023-10-08T13:01:06.715 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 8792, 2023-10-08T13:01:06.715 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 2801453533, 2023-10-08T13:01:06.715 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2023-10-08T13:01:06.715 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.715 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.715 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.715 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:06.716 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.716 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2023-10-08T13:01:06.716 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2023-10-08T13:01:06.716 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2023-10-08T13:01:06.716 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2023-10-08T13:01:06.716 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2023-10-08T13:01:06.716 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2023-10-08T13:01:06.716 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2023-10-08T13:01:06.717 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2023-10-08T13:01:06.717 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 8792, 2023-10-08T13:01:06.717 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 8792, 2023-10-08T13:01:06.717 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 8792, 2023-10-08T13:01:06.717 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 8792, 2023-10-08T13:01:06.717 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2023-10-08T13:01:06.717 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.718 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.718 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.718 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:06.718 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.718 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:01:06.718 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2023-10-08T13:01:06.718 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2023-10-08T13:01:06.718 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2023-10-08T13:01:06.719 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2023-10-08T13:01:06.719 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2023-10-08T13:01:06.719 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2023-10-08T13:01:06.719 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2023-10-08T13:01:06.719 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2023-10-08T13:01:06.719 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2023-10-08T13:01:06.719 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2023-10-08T13:01:06.720 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2023-10-08T13:01:06.720 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2023-10-08T13:01:06.720 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.720 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.720 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.720 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:06.720 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:06.720 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x559dfdeea960": { 2023-10-08T13:01:06.721 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2023-10-08T13:01:06.721 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2023-10-08T13:01:06.721 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2023-10-08T13:01:06.721 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2023-10-08T13:01:06.721 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2023-10-08T13:01:06.721 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2023-10-08T13:01:06.721 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2023-10-08T13:01:06.722 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2023-10-08T13:01:06.722 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2023-10-08T13:01:06.722 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2023-10-08T13:01:06.722 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2023-10-08T13:01:06.722 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2023-10-08T13:01:06.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:06.722 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:06.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:06.723 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:06.723 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:06.723 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-10-08T13:01:07.054 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2023-10-08T13:01:07.055 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:01:07.055 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:01:07.055 DEBUG:tasks.check_counter:Getting stats from l 2023-10-08T13:01:07.055 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-08T13:01:07.616 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:01:08.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:08 smithi173 ceph-mon[135182]: pgmap v938: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 102 KiB/s wr, 18 op/s 2023-10-08T13:01:08.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:08 smithi059 ceph-mon[98489]: pgmap v938: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 102 KiB/s wr, 18 op/s 2023-10-08T13:01:08.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:08 smithi092 ceph-mon[134093]: pgmap v938: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 102 KiB/s wr, 18 op/s 2023-10-08T13:01:08.986 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-10-08T13:01:08.987 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:01:08.987 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 0, 2023-10-08T13:01:08.987 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2, 2023-10-08T13:01:08.987 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:01:08.987 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 0, 2023-10-08T13:01:08.988 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 4, 2023-10-08T13:01:08.988 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 0, 2023-10-08T13:01:08.988 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.001233092, 2023-10-08T13:01:08.988 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:01:08.988 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.000324607, 2023-10-08T13:01:08.988 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:01:08.988 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:08.989 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:08.989 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:08.989 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:08.989 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:08.989 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:08.989 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:08.989 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:08.990 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:08.990 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:08.990 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:01:08.990 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:01:08.990 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:08.990 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:01:08.991 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 368, 2023-10-08T13:01:08.991 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 361, 2023-10-08T13:01:08.991 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 789232, 2023-10-08T13:01:08.991 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 216864, 2023-10-08T13:01:08.991 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 2, 2023-10-08T13:01:08.991 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 1, 2023-10-08T13:01:08.991 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.052169846, 2023-10-08T13:01:08.991 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.018778732, 2023-10-08T13:01:08.992 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.025017643, 2023-10-08T13:01:08.992 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.008920117, 2023-10-08T13:01:08.992 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:08.992 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 361, 2023-10-08T13:01:08.992 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.020562036, 2023-10-08T13:01:08.992 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000056958 2023-10-08T13:01:08.992 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:08.993 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:08.993 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:08.993 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:08.993 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:08.993 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:08.993 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 789232, 2023-10-08T13:01:08.994 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 216864 2023-10-08T13:01:08.994 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:08.994 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:01:08.994 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 2, 2023-10-08T13:01:08.994 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 274, 2023-10-08T13:01:08.994 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 320, 2023-10-08T13:01:08.994 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 201600, 2023-10-08T13:01:08.995 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 4, 2023-10-08T13:01:08.995 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 2, 2023-10-08T13:01:08.995 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.013762698, 2023-10-08T13:01:08.995 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.009923757, 2023-10-08T13:01:08.995 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.001131742, 2023-10-08T13:01:08.995 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:01:08.995 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:01:08.996 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 272, 2023-10-08T13:01:08.996 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.017776046, 2023-10-08T13:01:08.996 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000065353 2023-10-08T13:01:08.996 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:08.996 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:01:08.996 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:08.996 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:08.996 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:08.997 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:08.997 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T13:01:08.997 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 201600 2023-10-08T13:01:08.997 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:08.997 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2023-10-08T13:01:08.997 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 0, 2023-10-08T13:01:08.997 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2023-10-08T13:01:08.998 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:08.998 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2023-10-08T13:01:08.998 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:01:08.998 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2023-10-08T13:01:08.998 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:01:08.998 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:01:08.998 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:01:08.999 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:01:08.999 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:01:08.999 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:01:08.999 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:01:08.999 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:01:08.999 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:01:08.999 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:01:09.000 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:01:09.000 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:01:09.000 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:01:09.000 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2023-10-08T13:01:09.000 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:01:09.000 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2023-10-08T13:01:09.000 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:01:09.000 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:01:09.001 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:01:09.001 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:01:09.001 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:01:09.001 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:01:09.001 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:01:09.001 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2023-10-08T13:01:09.001 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:01:09.002 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:01:09.002 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:01:09.002 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2023-10-08T13:01:09.002 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2023-10-08T13:01:09.002 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2023-10-08T13:01:09.002 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:01:09.002 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:01:09.003 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:01:09.003 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:01:09.003 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 148721, 2023-10-08T13:01:09.003 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 30, 2023-10-08T13:01:09.003 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:01:09.003 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2023-10-08T13:01:09.003 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2023-10-08T13:01:09.004 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2023-10-08T13:01:09.004 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:01:09.004 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2023-10-08T13:01:09.004 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:01:09.004 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2023-10-08T13:01:09.004 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 0, 2023-10-08T13:01:09.004 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 0, 2023-10-08T13:01:09.005 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:01:09.005 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:01:09.005 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2023-10-08T13:01:09.005 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2023-10-08T13:01:09.005 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 928, 2023-10-08T13:01:09.005 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 2, 2023-10-08T13:01:09.005 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2023-10-08T13:01:09.006 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2023-10-08T13:01:09.006 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2023-10-08T13:01:09.006 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2023-10-08T13:01:09.006 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-08T13:01:09.006 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:01:09.006 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2023-10-08T13:01:09.006 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2023-10-08T13:01:09.006 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2023-10-08T13:01:09.007 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 366, 2023-10-08T13:01:09.007 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 734768, 2023-10-08T13:01:09.007 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2023-10-08T13:01:09.007 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 366, 2023-10-08T13:01:09.007 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2023-10-08T13:01:09.007 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2023-10-08T13:01:09.007 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 366, 2023-10-08T13:01:09.008 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 734768, 2023-10-08T13:01:09.008 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2023-10-08T13:01:09.008 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2023-10-08T13:01:09.008 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2023-10-08T13:01:09.008 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2023-10-08T13:01:09.008 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:09.008 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-08T13:01:09.009 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-10-08T13:01:09.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:09 smithi173 ceph-mon[135182]: osdmap e113: 12 total, 12 up, 12 in 2023-10-08T13:01:09.469 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2023-10-08T13:01:09.469 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2023-10-08T13:01:09.470 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2023-10-08T13:01:09.470 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-08T13:01:09.480 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-08T13:01:09.480 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T13:01:09.480 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:01:09.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:09 smithi059 ceph-mon[98489]: osdmap e113: 12 total, 12 up, 12 in 2023-10-08T13:01:09.531 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-08T13:01:09.531 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:01:09.619 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:01:09.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:09 smithi092 ceph-mon[134093]: osdmap e113: 12 total, 12 up, 12 in 2023-10-08T13:01:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.870+0000 7fa6cebff700 1 -- 172.21.15.59:0/3401219778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6c8100630 msgr2=0x7fa6c8100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.870+0000 7fa6cebff700 1 --2- 172.21.15.59:0/3401219778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6c8100630 0x7fa6c8100ab0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009990 tx=0x7fa6b4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:01:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.870+0000 7fa6cebff700 1 -- 172.21.15.59:0/3401219778 shutdown_connections 2023-10-08T13:01:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.870+0000 7fa6cebff700 1 --2- 172.21.15.59:0/3401219778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6c8100ff0 0x7fa6c810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.870+0000 7fa6cebff700 1 --2- 172.21.15.59:0/3401219778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c8106640 0x7fa6c8106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.870+0000 7fa6cebff700 1 --2- 172.21.15.59:0/3401219778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6c8100630 0x7fa6c8100ab0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.870+0000 7fa6cebff700 1 -- 172.21.15.59:0/3401219778 >> 172.21.15.59:0/3401219778 conn(0x7fa6c80fc140 msgr2=0x7fa6c80fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.870+0000 7fa6cebff700 1 -- 172.21.15.59:0/3401219778 shutdown_connections 2023-10-08T13:01:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.870+0000 7fa6cebff700 1 -- 172.21.15.59:0/3401219778 wait complete. 2023-10-08T13:01:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.871+0000 7fa6cebff700 1 Processor -- start 2023-10-08T13:01:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.871+0000 7fa6cebff700 1 -- start start 2023-10-08T13:01:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cebff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6c8100630 0x7fa6c8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cebff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6c8100ff0 0x7fa6c8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cebff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c8106640 0x7fa6c8073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cebff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c8074ac0 con 0x7fa6c8100ff0 2023-10-08T13:01:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cebff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c81a9470 con 0x7fa6c8100630 2023-10-08T13:01:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cebff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c81a9630 con 0x7fa6c8106640 2023-10-08T13:01:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6c7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6c8100ff0 0x7fa6c8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cd19c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c8106640 0x7fa6c8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cc99b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6c8100630 0x7fa6c8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6c7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6c8100ff0 0x7fa6c8073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58666/0 (socket says 172.21.15.59:58666) 2023-10-08T13:01:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6c7fff700 1 -- 172.21.15.59:0/4080542874 learned_addr learned my addr 172.21.15.59:0/4080542874 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cd19c700 1 -- 172.21.15.59:0/4080542874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6c8100630 msgr2=0x7fa6c8072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cd19c700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6c8100630 0x7fa6c8072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cd19c700 1 -- 172.21.15.59:0/4080542874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6c8100ff0 msgr2=0x7fa6c8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cd19c700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6c8100ff0 0x7fa6c8073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.872+0000 7fa6cd19c700 1 -- 172.21.15.59:0/4080542874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b40095f0 con 0x7fa6c8106640 2023-10-08T13:01:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.873+0000 7fa6c7fff700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6c8100ff0 0x7fa6c8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:01:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.873+0000 7fa6cd19c700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c8106640 0x7fa6c8073570 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000efc0 tx=0x7fa6c000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:09.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.873+0000 7fa6c5ffb700 1 -- 172.21.15.59:0/4080542874 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0018070 con 0x7fa6c8106640 2023-10-08T13:01:09.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.873+0000 7fa6cebff700 1 -- 172.21.15.59:0/4080542874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c81a98b0 con 0x7fa6c8106640 2023-10-08T13:01:09.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.873+0000 7fa6c5ffb700 1 -- 172.21.15.59:0/4080542874 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6c000f040 con 0x7fa6c8106640 2023-10-08T13:01:09.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.873+0000 7fa6c5ffb700 1 -- 172.21.15.59:0/4080542874 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000cd40 con 0x7fa6c8106640 2023-10-08T13:01:09.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.873+0000 7fa6cebff700 1 -- 172.21.15.59:0/4080542874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c81a9d70 con 0x7fa6c8106640 2023-10-08T13:01:09.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.874+0000 7fa6cebff700 1 -- 172.21.15.59:0/4080542874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c8108c50 con 0x7fa6c8106640 2023-10-08T13:01:09.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.876+0000 7fa6c5ffb700 1 -- 172.21.15.59:0/4080542874 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa6c0003a00 con 0x7fa6c8106640 2023-10-08T13:01:09.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.878+0000 7fa6c5ffb700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6b80a15f0 0x7fa6b80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:09.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.878+0000 7fa6c5ffb700 1 -- 172.21.15.59:0/4080542874 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fa6c00cd6b0 con 0x7fa6c8106640 2023-10-08T13:01:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.878+0000 7fa6cc99b700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6b80a15f0 0x7fa6b80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.878+0000 7fa6cc99b700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6b80a15f0 0x7fa6b80a3ab0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009be0 tx=0x7fa6bc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:09.880+0000 7fa6c5ffb700 1 -- 172.21.15.59:0/4080542874 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa6c0096a20 con 0x7fa6c8106640 2023-10-08T13:01:10.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.098+0000 7fa6cebff700 1 -- 172.21.15.59:0/4080542874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6c8073fd0 con 0x7fa6c8106640 2023-10-08T13:01:10.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.100+0000 7fa6c5ffb700 1 -- 172.21.15.59:0/4080542874 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+22887 (secure 0 0 0) 0x7fa6c009a040 con 0x7fa6c8106640 2023-10-08T13:01:10.101 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T13:01:10.102 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":113,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T13:01:08.175936+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":35,"snap_epoch":113,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":22,"length":1},{"begin":35,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":22,"length":1},{"begin":35,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:01:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 -- 172.21.15.59:0/4080542874 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6b80a15f0 msgr2=0x7fa6b80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6b80a15f0 0x7fa6b80a3ab0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009be0 tx=0x7fa6bc009260 comp rx=0 tx=0).stop 2023-10-08T13:01:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 -- 172.21.15.59:0/4080542874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c8106640 msgr2=0x7fa6c8073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c8106640 0x7fa6c8073570 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000efc0 tx=0x7fa6c000c3a0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 -- 172.21.15.59:0/4080542874 shutdown_connections 2023-10-08T13:01:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fa6b80a15f0 0x7fa6b80a3ab0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6c8100630 0x7fa6c8072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c8106640 0x7fa6c8073570 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 --2- 172.21.15.59:0/4080542874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6c8100ff0 0x7fa6c8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 -- 172.21.15.59:0/4080542874 >> 172.21.15.59:0/4080542874 conn(0x7fa6c80fc140 msgr2=0x7fa6c80fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:10.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 -- 172.21.15.59:0/4080542874 shutdown_connections 2023-10-08T13:01:10.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.102+0000 7fa6cebff700 1 -- 172.21.15.59:0/4080542874 wait complete. 2023-10-08T13:01:10.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:34:57.312603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:39:12.134451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:39:13.186137+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 35, 'snap_epoch': 113, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T13:01:10.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:01:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.330+0000 7fd7e5fff700 1 -- 172.21.15.59:0/2649563000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e0106750 msgr2=0x7fd7e0106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.330+0000 7fd7e5fff700 1 --2- 172.21.15.59:0/2649563000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e0106750 0x7fd7e0106b30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009990 tx=0x7fd7d0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.330+0000 7fd7e5fff700 1 -- 172.21.15.59:0/2649563000 shutdown_connections 2023-10-08T13:01:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.330+0000 7fd7e5fff700 1 --2- 172.21.15.59:0/2649563000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7e0101100 0x7fd7e010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.330+0000 7fd7e5fff700 1 --2- 172.21.15.59:0/2649563000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e0106750 0x7fd7e0106b30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.330+0000 7fd7e5fff700 1 --2- 172.21.15.59:0/2649563000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7e0100740 0x7fd7e0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.330+0000 7fd7e5fff700 1 -- 172.21.15.59:0/2649563000 >> 172.21.15.59:0/2649563000 conn(0x7fd7e00fc230 msgr2=0x7fd7e00fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.330+0000 7fd7e5fff700 1 -- 172.21.15.59:0/2649563000 shutdown_connections 2023-10-08T13:01:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.331+0000 7fd7e5fff700 1 -- 172.21.15.59:0/2649563000 wait complete. 2023-10-08T13:01:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.331+0000 7fd7e5fff700 1 Processor -- start 2023-10-08T13:01:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7e5fff700 1 -- start start 2023-10-08T13:01:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7e5fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7e0100740 0x7fd7e019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7e5fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e0101100 0x7fd7e019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7e5fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7e0106750 0x7fd7e01969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7e5fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e0197180 con 0x7fd7e0101100 2023-10-08T13:01:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7e5fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e01972f0 con 0x7fd7e0100740 2023-10-08T13:01:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7e5fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e01974b0 con 0x7fd7e0106750 2023-10-08T13:01:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7deffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e0101100 0x7fd7e019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7dffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7e0106750 0x7fd7e01969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7df7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7e0100740 0x7fd7e019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7deffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e0101100 0x7fd7e019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58686/0 (socket says 172.21.15.59:58686) 2023-10-08T13:01:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.332+0000 7fd7deffd700 1 -- 172.21.15.59:0/4250686790 learned_addr learned my addr 172.21.15.59:0/4250686790 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7deffd700 1 -- 172.21.15.59:0/4250686790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7e0106750 msgr2=0x7fd7e01969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7deffd700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7e0106750 0x7fd7e01969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7deffd700 1 -- 172.21.15.59:0/4250686790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7e0100740 msgr2=0x7fd7e019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7deffd700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7e0100740 0x7fd7e019c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7deffd700 1 -- 172.21.15.59:0/4250686790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d00095f0 con 0x7fd7e0101100 2023-10-08T13:01:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7df7fe700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7e0100740 0x7fd7e019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:01:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7deffd700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e0101100 0x7fd7e019ce50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400e9a0 tx=0x7fd7d400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7dcff9700 1 -- 172.21.15.59:0/4250686790 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4009790 con 0x7fd7e0101100 2023-10-08T13:01:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7e5fff700 1 -- 172.21.15.59:0/4250686790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e0197790 con 0x7fd7e0101100 2023-10-08T13:01:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7dcff9700 1 -- 172.21.15.59:0/4250686790 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7d4010430 con 0x7fd7e0101100 2023-10-08T13:01:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7dcff9700 1 -- 172.21.15.59:0/4250686790 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4018680 con 0x7fd7e0101100 2023-10-08T13:01:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.333+0000 7fd7e5fff700 1 -- 172.21.15.59:0/4250686790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e01a38e0 con 0x7fd7e0101100 2023-10-08T13:01:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.334+0000 7fd7e5fff700 1 -- 172.21.15.59:0/4250686790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e0108d40 con 0x7fd7e0101100 2023-10-08T13:01:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.336+0000 7fd7dcff9700 1 -- 172.21.15.59:0/4250686790 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd7d40105a0 con 0x7fd7e0101100 2023-10-08T13:01:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.338+0000 7fd7dcff9700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd7c80a15f0 0x7fd7c80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.338+0000 7fd7dcff9700 1 -- 172.21.15.59:0/4250686790 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fd7d4014070 con 0x7fd7e0101100 2023-10-08T13:01:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.338+0000 7fd7df7fe700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd7c80a15f0 0x7fd7c80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.339+0000 7fd7df7fe700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd7c80a15f0 0x7fd7c80a3ab0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0006010 tx=0x7fd7d000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.342+0000 7fd7dcff9700 1 -- 172.21.15.59:0/4250686790 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd7d4052100 con 0x7fd7e0101100 2023-10-08T13:01:10.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:10 smithi173 ceph-mon[135182]: pgmap v940: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 111 KiB/s wr, 21 op/s 2023-10-08T13:01:10.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:10 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4080542874' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:01:10.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:10 smithi059 ceph-mon[98489]: pgmap v940: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 111 KiB/s wr, 21 op/s 2023-10-08T13:01:10.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:10 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4080542874' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:01:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.555+0000 7fd7e5fff700 1 -- 172.21.15.59:0/4250686790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7e0101e80 con 0x7fd7e0101100 2023-10-08T13:01:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.555+0000 7fd7dcff9700 1 -- 172.21.15.59:0/4250686790 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7d40965d0 con 0x7fd7e0101100 2023-10-08T13:01:10.557 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-08T13:01:10.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.557+0000 7fd7e5fff700 1 -- 172.21.15.59:0/4250686790 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd7c80a15f0 msgr2=0x7fd7c80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:10.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.557+0000 7fd7e5fff700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd7c80a15f0 0x7fd7c80a3ab0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0006010 tx=0x7fd7d000b260 comp rx=0 tx=0).stop 2023-10-08T13:01:10.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.557+0000 7fd7e5fff700 1 -- 172.21.15.59:0/4250686790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e0101100 msgr2=0x7fd7e019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:10.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.557+0000 7fd7e5fff700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e0101100 0x7fd7e019ce50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400e9a0 tx=0x7fd7d400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.558+0000 7fd7e5fff700 1 -- 172.21.15.59:0/4250686790 shutdown_connections 2023-10-08T13:01:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.558+0000 7fd7e5fff700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7fd7c80a15f0 0x7fd7c80a3ab0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.558+0000 7fd7e5fff700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7e0100740 0x7fd7e019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.558+0000 7fd7e5fff700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7e0106750 0x7fd7e01969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.558+0000 7fd7e5fff700 1 --2- 172.21.15.59:0/4250686790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e0101100 0x7fd7e019ce50 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.558+0000 7fd7e5fff700 1 -- 172.21.15.59:0/4250686790 >> 172.21.15.59:0/4250686790 conn(0x7fd7e00fc230 msgr2=0x7fd7e00fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.558+0000 7fd7e5fff700 1 -- 172.21.15.59:0/4250686790 shutdown_connections 2023-10-08T13:01:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.558+0000 7fd7e5fff700 1 -- 172.21.15.59:0/4250686790 wait complete. 2023-10-08T13:01:10.577 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:01:10.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:10 smithi092 ceph-mon[134093]: pgmap v940: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 111 KiB/s wr, 21 op/s 2023-10-08T13:01:10.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:10 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4080542874' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:01:10.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.783+0000 7f67733ff700 1 -- 172.21.15.59:0/2758556586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c106740 msgr2=0x7f676c106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:10.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.783+0000 7f67733ff700 1 --2- 172.21.15.59:0/2758556586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c106740 0x7f676c106b20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6768009990 tx=0x7f6768009ca0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.784+0000 7f67733ff700 1 -- 172.21.15.59:0/2758556586 shutdown_connections 2023-10-08T13:01:10.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.784+0000 7f67733ff700 1 --2- 172.21.15.59:0/2758556586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f676c1010f0 0x7f676c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.784+0000 7f67733ff700 1 --2- 172.21.15.59:0/2758556586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c106740 0x7f676c106b20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.784+0000 7f67733ff700 1 --2- 172.21.15.59:0/2758556586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c100730 0x7f676c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.784+0000 7f67733ff700 1 -- 172.21.15.59:0/2758556586 >> 172.21.15.59:0/2758556586 conn(0x7f676c0fc200 msgr2=0x7f676c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:10.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.784+0000 7f67733ff700 1 -- 172.21.15.59:0/2758556586 shutdown_connections 2023-10-08T13:01:10.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.784+0000 7f67733ff700 1 -- 172.21.15.59:0/2758556586 wait complete. 2023-10-08T13:01:10.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.785+0000 7f67733ff700 1 Processor -- start 2023-10-08T13:01:10.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.785+0000 7f67733ff700 1 -- start start 2023-10-08T13:01:10.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.785+0000 7f67733ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c100730 0x7f676c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:10.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.785+0000 7f67733ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f676c1010f0 0x7f676c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:10.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.785+0000 7f67733ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c106740 0x7f676c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:10.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.785+0000 7f67733ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c19dce0 con 0x7f676c100730 2023-10-08T13:01:10.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.785+0000 7f67733ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c19de50 con 0x7f676c1010f0 2023-10-08T13:01:10.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.785+0000 7f67733ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c19e010 con 0x7f676c106740 2023-10-08T13:01:10.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.785+0000 7f677119b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c100730 0x7f676c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:10.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.785+0000 7f677119b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c100730 0x7f676c198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54982/0 (socket says 172.21.15.59:54982) 2023-10-08T13:01:10.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.785+0000 7f677119b700 1 -- 172.21.15.59:0/1483792916 learned_addr learned my addr 172.21.15.59:0/1483792916 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:10.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f677099a700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f676c1010f0 0x7f676c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:10.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f677199c700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c106740 0x7f676c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:10.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f677119b700 1 -- 172.21.15.59:0/1483792916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c106740 msgr2=0x7f676c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:10.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f677119b700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c106740 0x7f676c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f677119b700 1 -- 172.21.15.59:0/1483792916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f676c1010f0 msgr2=0x7f676c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:10.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f677119b700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f676c1010f0 0x7f676c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:10.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f677119b700 1 -- 172.21.15.59:0/1483792916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6764009c40 con 0x7f676c100730 2023-10-08T13:01:10.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f677119b700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c100730 0x7f676c198dc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6768005910 tx=0x7f6768004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:10.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f67627fc700 1 -- 172.21.15.59:0/1483792916 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676801d070 con 0x7f676c100730 2023-10-08T13:01:10.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f67627fc700 1 -- 172.21.15.59:0/1483792916 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6768022470 con 0x7f676c100730 2023-10-08T13:01:10.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f67733ff700 1 -- 172.21.15.59:0/1483792916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67680095f0 con 0x7f676c100730 2023-10-08T13:01:10.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.786+0000 7f67627fc700 1 -- 172.21.15.59:0/1483792916 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768017650 con 0x7f676c100730 2023-10-08T13:01:10.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.787+0000 7f67733ff700 1 -- 172.21.15.59:0/1483792916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676c1a5950 con 0x7f676c100730 2023-10-08T13:01:10.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.788+0000 7f67733ff700 1 -- 172.21.15.59:0/1483792916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676c101e70 con 0x7f676c100730 2023-10-08T13:01:10.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.789+0000 7f67627fc700 1 -- 172.21.15.59:0/1483792916 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f67680225e0 con 0x7f676c100730 2023-10-08T13:01:10.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.791+0000 7f67627fc700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f67580a1670 0x7f67580a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:10.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.791+0000 7f67627fc700 1 -- 172.21.15.59:0/1483792916 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f67680ce180 con 0x7f676c100730 2023-10-08T13:01:10.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.791+0000 7f677099a700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f67580a1670 0x7f67580a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:10.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.792+0000 7f677099a700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f67580a1670 0x7f67580a3b30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f676c19a310 tx=0x7f675c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:10.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:10.794+0000 7f67627fc700 1 -- 172.21.15.59:0/1483792916 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f676805d100 con 0x7f676c100730 2023-10-08T13:01:11.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.008+0000 7f67733ff700 1 -- 172.21.15.59:0/1483792916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f676c19a0f0 con 0x7f676c100730 2023-10-08T13:01:11.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.008+0000 7f67627fc700 1 -- 172.21.15.59:0/1483792916 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6768097550 con 0x7f676c100730 2023-10-08T13:01:11.010 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-08T13:01:11.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 -- 172.21.15.59:0/1483792916 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f67580a1670 msgr2=0x7f67580a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f67580a1670 0x7f67580a3b30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f676c19a310 tx=0x7f675c009260 comp rx=0 tx=0).stop 2023-10-08T13:01:11.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 -- 172.21.15.59:0/1483792916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c100730 msgr2=0x7f676c198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c100730 0x7f676c198dc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6768005910 tx=0x7f6768004730 comp rx=0 tx=0).stop 2023-10-08T13:01:11.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 -- 172.21.15.59:0/1483792916 shutdown_connections 2023-10-08T13:01:11.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f67580a1670 0x7f67580a3b30 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c106740 0x7f676c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676c100730 0x7f676c198dc0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 --2- 172.21.15.59:0/1483792916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f676c1010f0 0x7f676c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 -- 172.21.15.59:0/1483792916 >> 172.21.15.59:0/1483792916 conn(0x7f676c0fc200 msgr2=0x7f676c0fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:11.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 -- 172.21.15.59:0/1483792916 shutdown_connections 2023-10-08T13:01:11.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.011+0000 7f67733ff700 1 -- 172.21.15.59:0/1483792916 wait complete. 2023-10-08T13:01:11.031 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:01:11.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.257+0000 7ff95dbff700 1 -- 172.21.15.59:0/2029307685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff958100730 msgr2=0x7ff958100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.257+0000 7ff95dbff700 1 --2- 172.21.15.59:0/2029307685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff958100730 0x7ff958100bb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009990 tx=0x7ff94c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.258+0000 7ff95dbff700 1 -- 172.21.15.59:0/2029307685 shutdown_connections 2023-10-08T13:01:11.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.258+0000 7ff95dbff700 1 --2- 172.21.15.59:0/2029307685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff958106740 0x7ff958106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.258+0000 7ff95dbff700 1 --2- 172.21.15.59:0/2029307685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9581010f0 0x7ff95810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.258+0000 7ff95dbff700 1 --2- 172.21.15.59:0/2029307685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff958100730 0x7ff958100bb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.258+0000 7ff95dbff700 1 -- 172.21.15.59:0/2029307685 >> 172.21.15.59:0/2029307685 conn(0x7ff9580fc200 msgr2=0x7ff9580fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:11.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.258+0000 7ff95dbff700 1 -- 172.21.15.59:0/2029307685 shutdown_connections 2023-10-08T13:01:11.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.258+0000 7ff95dbff700 1 -- 172.21.15.59:0/2029307685 wait complete. 2023-10-08T13:01:11.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.259+0000 7ff95dbff700 1 Processor -- start 2023-10-08T13:01:11.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.259+0000 7ff95dbff700 1 -- start start 2023-10-08T13:01:11.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.259+0000 7ff95dbff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff958100730 0x7ff958072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:11.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.259+0000 7ff95dbff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9581010f0 0x7ff958073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:11.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.259+0000 7ff95dbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff958106740 0x7ff958073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:11.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.259+0000 7ff95dbff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9581a4fa0 con 0x7ff958100730 2023-10-08T13:01:11.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.259+0000 7ff95dbff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9581a5110 con 0x7ff9581010f0 2023-10-08T13:01:11.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.259+0000 7ff95dbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9581a52d0 con 0x7ff958106740 2023-10-08T13:01:11.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.259+0000 7ff9577fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff958100730 0x7ff958072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:11.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.260+0000 7ff9577fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff958100730 0x7ff958072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55002/0 (socket says 172.21.15.59:55002) 2023-10-08T13:01:11.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.260+0000 7ff9577fe700 1 -- 172.21.15.59:0/1864111897 learned_addr learned my addr 172.21.15.59:0/1864111897 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:11.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.260+0000 7ff956ffd700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9581010f0 0x7ff958073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:11.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.260+0000 7ff957fff700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff958106740 0x7ff958073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:11.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.260+0000 7ff9577fe700 1 -- 172.21.15.59:0/1864111897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff958106740 msgr2=0x7ff958073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.260+0000 7ff9577fe700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff958106740 0x7ff958073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.260+0000 7ff9577fe700 1 -- 172.21.15.59:0/1864111897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9581010f0 msgr2=0x7ff958073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.260+0000 7ff9577fe700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9581010f0 0x7ff958073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.260+0000 7ff9577fe700 1 -- 172.21.15.59:0/1864111897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c0095f0 con 0x7ff958100730 2023-10-08T13:01:11.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.260+0000 7ff9577fe700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff958100730 0x7ff958072af0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff94800d980 tx=0x7ff94800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:11.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.260+0000 7ff954ff9700 1 -- 172.21.15.59:0/1864111897 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948004220 con 0x7ff958100730 2023-10-08T13:01:11.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.261+0000 7ff954ff9700 1 -- 172.21.15.59:0/1864111897 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff948007640 con 0x7ff958100730 2023-10-08T13:01:11.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.261+0000 7ff954ff9700 1 -- 172.21.15.59:0/1864111897 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948005690 con 0x7ff958100730 2023-10-08T13:01:11.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.261+0000 7ff95dbff700 1 -- 172.21.15.59:0/1864111897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9581a55b0 con 0x7ff958100730 2023-10-08T13:01:11.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.261+0000 7ff95dbff700 1 -- 172.21.15.59:0/1864111897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9581a5a70 con 0x7ff958100730 2023-10-08T13:01:11.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.262+0000 7ff95dbff700 1 -- 172.21.15.59:0/1864111897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff958108d50 con 0x7ff958100730 2023-10-08T13:01:11.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.264+0000 7ff954ff9700 1 -- 172.21.15.59:0/1864111897 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff948004750 con 0x7ff958100730 2023-10-08T13:01:11.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.265+0000 7ff954ff9700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9400a15f0 0x7ff9400a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:11.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.265+0000 7ff954ff9700 1 -- 172.21.15.59:0/1864111897 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8485+0+0 (secure 0 0 0) 0x7ff9480cce50 con 0x7ff958100730 2023-10-08T13:01:11.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.265+0000 7ff956ffd700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9400a15f0 0x7ff9400a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:11.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.266+0000 7ff956ffd700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9400a15f0 0x7ff9400a3ab0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff958074220 tx=0x7ff94c005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:11.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.269+0000 7ff954ff9700 1 -- 172.21.15.59:0/1864111897 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff948096130 con 0x7ff958100730 2023-10-08T13:01:11.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:11 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/4250686790' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:01:11.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:11 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1483792916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:01:11.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.481+0000 7ff95dbff700 1 -- 172.21.15.59:0/1864111897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff958073fd0 con 0x7ff958100730 2023-10-08T13:01:11.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.482+0000 7ff954ff9700 1 -- 172.21.15.59:0/1864111897 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff948016020 con 0x7ff958100730 2023-10-08T13:01:11.483 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-08T13:01:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.484+0000 7ff95dbff700 1 -- 172.21.15.59:0/1864111897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9400a15f0 msgr2=0x7ff9400a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.484+0000 7ff95dbff700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9400a15f0 0x7ff9400a3ab0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff958074220 tx=0x7ff94c005fd0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.484+0000 7ff95dbff700 1 -- 172.21.15.59:0/1864111897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff958100730 msgr2=0x7ff958072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.484+0000 7ff95dbff700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff958100730 0x7ff958072af0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff94800d980 tx=0x7ff94800dc90 comp rx=0 tx=0).stop 2023-10-08T13:01:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.484+0000 7ff95dbff700 1 -- 172.21.15.59:0/1864111897 shutdown_connections 2023-10-08T13:01:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.484+0000 7ff95dbff700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7ff9400a15f0 0x7ff9400a3ab0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.484+0000 7ff95dbff700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff958106740 0x7ff958073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.484+0000 7ff95dbff700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff958100730 0x7ff958072af0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.484+0000 7ff95dbff700 1 --2- 172.21.15.59:0/1864111897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9581010f0 0x7ff958073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.484+0000 7ff95dbff700 1 -- 172.21.15.59:0/1864111897 >> 172.21.15.59:0/1864111897 conn(0x7ff9580fc200 msgr2=0x7ff9580fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.485+0000 7ff95dbff700 1 -- 172.21.15.59:0/1864111897 shutdown_connections 2023-10-08T13:01:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.485+0000 7ff95dbff700 1 -- 172.21.15.59:0/1864111897 wait complete. 2023-10-08T13:01:11.502 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:11 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/4250686790' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:01:11.502 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:11 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1483792916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:01:11.505 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T13:01:11.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:11 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/4250686790' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:01:11.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:11 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1483792916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:01:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.708+0000 7f6b42dff700 1 -- 172.21.15.59:0/1057426918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b3c072c20 msgr2=0x7f6b3c073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.708+0000 7f6b42dff700 1 --2- 172.21.15.59:0/1057426918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b3c072c20 0x7f6b3c073000 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009990 tx=0x7f6b38009ca0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.708+0000 7f6b42dff700 1 -- 172.21.15.59:0/1057426918 shutdown_connections 2023-10-08T13:01:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.708+0000 7f6b42dff700 1 --2- 172.21.15.59:0/1057426918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b3c10cf70 0x7f6b3c10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.708+0000 7f6b42dff700 1 --2- 172.21.15.59:0/1057426918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b3c072c20 0x7f6b3c073000 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.708+0000 7f6b42dff700 1 --2- 172.21.15.59:0/1057426918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b3c073540 0x7f6b3c10ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.708+0000 7f6b42dff700 1 -- 172.21.15.59:0/1057426918 >> 172.21.15.59:0/1057426918 conn(0x7f6b3c0fc200 msgr2=0x7f6b3c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.708+0000 7f6b42dff700 1 -- 172.21.15.59:0/1057426918 shutdown_connections 2023-10-08T13:01:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.709+0000 7f6b42dff700 1 -- 172.21.15.59:0/1057426918 wait complete. 2023-10-08T13:01:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.709+0000 7f6b42dff700 1 Processor -- start 2023-10-08T13:01:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b42dff700 1 -- start start 2023-10-08T13:01:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b42dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b3c072c20 0x7f6b3c198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b42dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b3c073540 0x7f6b3c1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b42dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b3c10cf70 0x7f6b3c19d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b42dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c19dd90 con 0x7f6b3c10cf70 2023-10-08T13:01:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b42dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c19df00 con 0x7f6b3c072c20 2023-10-08T13:01:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b42dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c19e0c0 con 0x7f6b3c073540 2023-10-08T13:01:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b4139c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b3c10cf70 0x7f6b3c19d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b4139c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b3c10cf70 0x7f6b3c19d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55020/0 (socket says 172.21.15.59:55020) 2023-10-08T13:01:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b4139c700 1 -- 172.21.15.59:0/2684830856 learned_addr learned my addr 172.21.15.59:0/2684830856 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b40b9b700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b3c072c20 0x7f6b3c198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.710+0000 7f6b33fff700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b3c073540 0x7f6b3c1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.711+0000 7f6b4139c700 1 -- 172.21.15.59:0/2684830856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b3c073540 msgr2=0x7f6b3c1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.711+0000 7f6b4139c700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b3c073540 0x7f6b3c1993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.711+0000 7f6b4139c700 1 -- 172.21.15.59:0/2684830856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b3c072c20 msgr2=0x7f6b3c198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.711+0000 7f6b4139c700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b3c072c20 0x7f6b3c198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.711+0000 7f6b4139c700 1 -- 172.21.15.59:0/2684830856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c009520 con 0x7f6b3c10cf70 2023-10-08T13:01:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.711+0000 7f6b40b9b700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b3c072c20 0x7f6b3c198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:01:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.711+0000 7f6b4139c700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b3c10cf70 0x7f6b3c19d750 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6b34007ee0 tx=0x7f6b3400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.711+0000 7f6b31ffb700 1 -- 172.21.15.59:0/2684830856 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b34017070 con 0x7f6b3c10cf70 2023-10-08T13:01:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.711+0000 7f6b31ffb700 1 -- 172.21.15.59:0/2684830856 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b3400f040 con 0x7f6b3c10cf70 2023-10-08T13:01:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.711+0000 7f6b42dff700 1 -- 172.21.15.59:0/2684830856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b380095f0 con 0x7f6b3c10cf70 2023-10-08T13:01:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.711+0000 7f6b31ffb700 1 -- 172.21.15.59:0/2684830856 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b34005580 con 0x7f6b3c10cf70 2023-10-08T13:01:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.712+0000 7f6b42dff700 1 -- 172.21.15.59:0/2684830856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c1a5a00 con 0x7f6b3c10cf70 2023-10-08T13:01:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.713+0000 7f6b42dff700 1 -- 172.21.15.59:0/2684830856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3c108180 con 0x7f6b3c10cf70 2023-10-08T13:01:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.715+0000 7f6b31ffb700 1 -- 172.21.15.59:0/2684830856 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6b3400db20 con 0x7f6b3c10cf70 2023-10-08T13:01:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.717+0000 7f6b31ffb700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b240a15f0 0x7f6b240a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.717+0000 7f6b31ffb700 1 -- 172.21.15.59:0/2684830856 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f6b340cc820 con 0x7f6b3c10cf70 2023-10-08T13:01:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.717+0000 7f6b40b9b700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b240a15f0 0x7f6b240a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.718+0000 7f6b40b9b700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b240a15f0 0x7f6b240a3ab0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800b2e0 tx=0x7f6b38005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.721+0000 7f6b31ffb700 1 -- 172.21.15.59:0/2684830856 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6b34095b00 con 0x7f6b3c10cf70 2023-10-08T13:01:11.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.950+0000 7f6b42dff700 1 -- 172.21.15.59:0/2684830856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6b3c0742d0 con 0x7f6b3c10cf70 2023-10-08T13:01:11.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.951+0000 7f6b31ffb700 1 -- 172.21.15.59:0/2684830856 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v113) v1 ==== 81+0+883 (secure 0 0 0) 0x7f6b34099120 con 0x7f6b3c10cf70 2023-10-08T13:01:11.952 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1331508923 2023-10-09T12:33:10.699093+0000 2023-10-08T13:01:11.953 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6801/2617395869 2023-10-09T12:33:10.699093+0000 2023-10-08T13:01:11.953 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6800/2617395869 2023-10-09T12:33:10.699093+0000 2023-10-08T13:01:11.953 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3230671169 2023-10-09T12:33:10.699093+0000 2023-10-08T13:01:11.953 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/333444394 2023-10-09T12:33:10.699093+0000 2023-10-08T13:01:11.953 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3151805130 2023-10-09T12:31:58.782739+0000 2023-10-08T13:01:11.953 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3634455687 2023-10-09T12:31:58.782739+0000 2023-10-08T13:01:11.953 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/354272646 2023-10-09T12:31:58.782739+0000 2023-10-08T13:01:11.954 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6801/815242566 2023-10-09T12:31:58.782739+0000 2023-10-08T13:01:11.954 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6800/3663319995 2023-10-09T12:31:30.486951+0000 2023-10-08T13:01:11.954 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1786512478 2023-10-09T12:31:30.486951+0000 2023-10-08T13:01:11.954 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6801/3663319995 2023-10-09T12:31:30.486951+0000 2023-10-08T13:01:11.954 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/899027669 2023-10-09T12:31:30.486951+0000 2023-10-08T13:01:11.954 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/4060854750 2023-10-09T12:31:30.486951+0000 2023-10-08T13:01:11.954 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6800/815242566 2023-10-09T12:31:58.782739+0000 2023-10-08T13:01:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.953+0000 7f6b42dff700 1 -- 172.21.15.59:0/2684830856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b240a15f0 msgr2=0x7f6b240a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.953+0000 7f6b42dff700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b240a15f0 0x7f6b240a3ab0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800b2e0 tx=0x7f6b38005fd0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.953+0000 7f6b42dff700 1 -- 172.21.15.59:0/2684830856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b3c10cf70 msgr2=0x7f6b3c19d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.953+0000 7f6b42dff700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b3c10cf70 0x7f6b3c19d750 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6b34007ee0 tx=0x7f6b3400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.954+0000 7f6b42dff700 1 -- 172.21.15.59:0/2684830856 shutdown_connections 2023-10-08T13:01:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.954+0000 7f6b42dff700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f6b240a15f0 0x7f6b240a3ab0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.954+0000 7f6b42dff700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b3c072c20 0x7f6b3c198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.954+0000 7f6b42dff700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b3c10cf70 0x7f6b3c19d750 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.954+0000 7f6b42dff700 1 --2- 172.21.15.59:0/2684830856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b3c073540 0x7f6b3c1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:11.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.954+0000 7f6b42dff700 1 -- 172.21.15.59:0/2684830856 >> 172.21.15.59:0/2684830856 conn(0x7f6b3c0fc200 msgr2=0x7f6b3c0fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:11.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.954+0000 7f6b42dff700 1 -- 172.21.15.59:0/2684830856 shutdown_connections 2023-10-08T13:01:11.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:11.954+0000 7f6b42dff700 1 -- 172.21.15.59:0/2684830856 wait complete. 2023-10-08T13:01:11.957 INFO:teuthology.orchestra.run.smithi059.stderr:listed 15 entries 2023-10-08T13:01:11.973 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T13:01:11.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:01:11.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T13:01:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:12 smithi059 ceph-mon[98489]: pgmap v941: 97 pgs: 97 active+clean; 872 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 111 KiB/s wr, 21 op/s 2023-10-08T13:01:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:12 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1864111897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:01:12.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:12 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2684830856' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:01:12.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:12 smithi173 ceph-mon[135182]: pgmap v941: 97 pgs: 97 active+clean; 872 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 111 KiB/s wr, 21 op/s 2023-10-08T13:01:12.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:12 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1864111897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:01:12.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:12 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2684830856' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:01:12.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:12 smithi092 ceph-mon[134093]: pgmap v941: 97 pgs: 97 active+clean; 872 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 111 KiB/s wr, 21 op/s 2023-10-08T13:01:12.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:12 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1864111897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:01:12.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:12 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2684830856' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:01:12.639 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-08T13:01:12.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:01:12.639 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T13:01:12.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:01:12.729 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-08T13:01:12.811 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T13:01:12.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:01:12.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T13:01:12.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:01:12.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2023-10-08T13:01:12.989 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-08T13:01:13.000 INFO:tasks.cephadm:Teardown begin 2023-10-08T13:01:13.001 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T13:01:13.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:01:13.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.211+0000 7f323a5ff700 1 -- 172.21.15.59:0/940384123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234072c20 msgr2=0x7f3234073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:13.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.211+0000 7f323a5ff700 1 --2- 172.21.15.59:0/940384123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234072c20 0x7f3234073000 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3224009990 tx=0x7f3224009ca0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.211+0000 7f323a5ff700 1 -- 172.21.15.59:0/940384123 shutdown_connections 2023-10-08T13:01:13.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.211+0000 7f323a5ff700 1 --2- 172.21.15.59:0/940384123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f323410ce70 0x7f323410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.211+0000 7f323a5ff700 1 --2- 172.21.15.59:0/940384123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234072c20 0x7f3234073000 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.211+0000 7f323a5ff700 1 --2- 172.21.15.59:0/940384123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3234073540 0x7f323410c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.211+0000 7f323a5ff700 1 -- 172.21.15.59:0/940384123 >> 172.21.15.59:0/940384123 conn(0x7f32340fc1a0 msgr2=0x7f32340fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:13.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.211+0000 7f323a5ff700 1 -- 172.21.15.59:0/940384123 shutdown_connections 2023-10-08T13:01:13.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.211+0000 7f323a5ff700 1 -- 172.21.15.59:0/940384123 wait complete. 2023-10-08T13:01:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.212+0000 7f323a5ff700 1 Processor -- start 2023-10-08T13:01:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.212+0000 7f323a5ff700 1 -- start start 2023-10-08T13:01:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.212+0000 7f323a5ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234072c20 0x7f3234198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.212+0000 7f323a5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3234073540 0x7f32341992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.212+0000 7f323a5ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f323410ce70 0x7f323419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.212+0000 7f323a5ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323419dc90 con 0x7f3234072c20 2023-10-08T13:01:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.212+0000 7f323a5ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323419de00 con 0x7f323410ce70 2023-10-08T13:01:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.212+0000 7f323a5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323419dfc0 con 0x7f3234073540 2023-10-08T13:01:13.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.213+0000 7f3233fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234072c20 0x7f3234198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:13.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.213+0000 7f3233fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234072c20 0x7f3234198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55048/0 (socket says 172.21.15.59:55048) 2023-10-08T13:01:13.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.213+0000 7f3233fff700 1 -- 172.21.15.59:0/3105392057 learned_addr learned my addr 172.21.15.59:0/3105392057 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:13.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.213+0000 7f3238b9c700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f323410ce70 0x7f323419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:13.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.213+0000 7f322bfff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3234073540 0x7f32341992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:13.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.213+0000 7f3233fff700 1 -- 172.21.15.59:0/3105392057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3234073540 msgr2=0x7f32341992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:13.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.213+0000 7f3233fff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3234073540 0x7f32341992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.213+0000 7f3233fff700 1 -- 172.21.15.59:0/3105392057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f323410ce70 msgr2=0x7f323419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.213+0000 7f3233fff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f323410ce70 0x7f323419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.213+0000 7f3233fff700 1 -- 172.21.15.59:0/3105392057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240095f0 con 0x7f3234072c20 2023-10-08T13:01:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.213+0000 7f3233fff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234072c20 0x7f3234198d70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3224005910 tx=0x7f3224004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.214+0000 7f3231ffb700 1 -- 172.21.15.59:0/3105392057 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322401d070 con 0x7f3234072c20 2023-10-08T13:01:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.214+0000 7f3231ffb700 1 -- 172.21.15.59:0/3105392057 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3224022470 con 0x7f3234072c20 2023-10-08T13:01:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.214+0000 7f3231ffb700 1 -- 172.21.15.59:0/3105392057 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224017650 con 0x7f3234072c20 2023-10-08T13:01:13.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.214+0000 7f323a5ff700 1 -- 172.21.15.59:0/3105392057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323419e240 con 0x7f3234072c20 2023-10-08T13:01:13.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.214+0000 7f323a5ff700 1 -- 172.21.15.59:0/3105392057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323419e4c0 con 0x7f3234072c20 2023-10-08T13:01:13.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.215+0000 7f323a5ff700 1 -- 172.21.15.59:0/3105392057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3234108080 con 0x7f3234072c20 2023-10-08T13:01:13.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.217+0000 7f3231ffb700 1 -- 172.21.15.59:0/3105392057 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f32240225e0 con 0x7f3234072c20 2023-10-08T13:01:13.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.218+0000 7f3231ffb700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32200a15f0 0x7f32200a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:13.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.218+0000 7f3231ffb700 1 -- 172.21.15.59:0/3105392057 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f32240ce680 con 0x7f3234072c20 2023-10-08T13:01:13.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.219+0000 7f322bfff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32200a15f0 0x7f32200a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:13.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.219+0000 7f322bfff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32200a15f0 0x7f32200a3ab0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f323419a2c0 tx=0x7f321c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:13.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.220+0000 7f3231ffb700 1 -- 172.21.15.59:0/3105392057 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f32240979f0 con 0x7f3234072c20 2023-10-08T13:01:13.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.487+0000 7f323a5ff700 1 -- 172.21.15.59:0/3105392057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32340742d0 con 0x7f3234072c20 2023-10-08T13:01:13.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.488+0000 7f3231ffb700 1 -- 172.21.15.59:0/3105392057 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f322409b010 con 0x7f3234072c20 2023-10-08T13:01:13.489 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T13:01:13.489 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:01:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.490+0000 7f323a5ff700 1 -- 172.21.15.59:0/3105392057 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32200a15f0 msgr2=0x7f32200a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.490+0000 7f323a5ff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32200a15f0 0x7f32200a3ab0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f323419a2c0 tx=0x7f321c009260 comp rx=0 tx=0).stop 2023-10-08T13:01:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.490+0000 7f323a5ff700 1 -- 172.21.15.59:0/3105392057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234072c20 msgr2=0x7f3234198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.490+0000 7f323a5ff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234072c20 0x7f3234198d70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3224005910 tx=0x7f3224004730 comp rx=0 tx=0).stop 2023-10-08T13:01:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.490+0000 7f323a5ff700 1 -- 172.21.15.59:0/3105392057 shutdown_connections 2023-10-08T13:01:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.490+0000 7f323a5ff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f32200a15f0 0x7f32200a3ab0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.491+0000 7f323a5ff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f323410ce70 0x7f323419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.491+0000 7f323a5ff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234072c20 0x7f3234198d70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.491+0000 7f323a5ff700 1 --2- 172.21.15.59:0/3105392057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3234073540 0x7f32341992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.491+0000 7f323a5ff700 1 -- 172.21.15.59:0/3105392057 >> 172.21.15.59:0/3105392057 conn(0x7f32340fc1a0 msgr2=0x7f32340fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:13.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.491+0000 7f323a5ff700 1 -- 172.21.15.59:0/3105392057 shutdown_connections 2023-10-08T13:01:13.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.491+0000 7f323a5ff700 1 -- 172.21.15.59:0/3105392057 wait complete. 2023-10-08T13:01:13.495 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T13:01:13.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:01:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.713+0000 7f3cc5bff700 1 -- 172.21.15.59:0/1175288188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc0106640 msgr2=0x7f3cc0106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.713+0000 7f3cc5bff700 1 --2- 172.21.15.59:0/1175288188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc0106640 0x7f3cc0106a20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009990 tx=0x7f3cb0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.713+0000 7f3cc5bff700 1 -- 172.21.15.59:0/1175288188 shutdown_connections 2023-10-08T13:01:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.713+0000 7f3cc5bff700 1 --2- 172.21.15.59:0/1175288188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cc0100ff0 0x7f3cc010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.713+0000 7f3cc5bff700 1 --2- 172.21.15.59:0/1175288188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc0106640 0x7f3cc0106a20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.713+0000 7f3cc5bff700 1 --2- 172.21.15.59:0/1175288188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cc0100630 0x7f3cc0100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.713+0000 7f3cc5bff700 1 -- 172.21.15.59:0/1175288188 >> 172.21.15.59:0/1175288188 conn(0x7f3cc00fc1a0 msgr2=0x7f3cc00fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.713+0000 7f3cc5bff700 1 -- 172.21.15.59:0/1175288188 shutdown_connections 2023-10-08T13:01:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.713+0000 7f3cc5bff700 1 -- 172.21.15.59:0/1175288188 wait complete. 2023-10-08T13:01:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.714+0000 7f3cc5bff700 1 Processor -- start 2023-10-08T13:01:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.714+0000 7f3cc5bff700 1 -- start start 2023-10-08T13:01:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.715+0000 7f3cc5bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cc0100630 0x7f3cc0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.715+0000 7f3cc5bff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cc0100ff0 0x7f3cc0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.715+0000 7f3cc5bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc0106640 0x7f3cc0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.715+0000 7f3cc5bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc01a4e70 con 0x7f3cc0106640 2023-10-08T13:01:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.715+0000 7f3cc5bff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc01a4fe0 con 0x7f3cc0100ff0 2023-10-08T13:01:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.715+0000 7f3cc5bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc01a51a0 con 0x7f3cc0100630 2023-10-08T13:01:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.715+0000 7f3cbffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc0106640 0x7f3cc0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.715+0000 7f3cbf7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cc0100630 0x7f3cc0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.715+0000 7f3cbffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc0106640 0x7f3cc0073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55068/0 (socket says 172.21.15.59:55068) 2023-10-08T13:01:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.715+0000 7f3cbffff700 1 -- 172.21.15.59:0/3331062692 learned_addr learned my addr 172.21.15.59:0/3331062692 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.715+0000 7f3cb7fff700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cc0100ff0 0x7f3cc0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.716+0000 7f3cbf7fe700 1 -- 172.21.15.59:0/3331062692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cc0100ff0 msgr2=0x7f3cc0073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.716+0000 7f3cbf7fe700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cc0100ff0 0x7f3cc0073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.716+0000 7f3cbf7fe700 1 -- 172.21.15.59:0/3331062692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc0106640 msgr2=0x7f3cc0073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:13.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.716+0000 7f3cbf7fe700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc0106640 0x7f3cc0073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.716+0000 7f3cbf7fe700 1 -- 172.21.15.59:0/3331062692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb00095f0 con 0x7f3cc0100630 2023-10-08T13:01:13.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.716+0000 7f3cbf7fe700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cc0100630 0x7f3cc0072af0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0000c00 tx=0x7f3cb0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:13.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.716+0000 7f3cbd7fa700 1 -- 172.21.15.59:0/3331062692 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb001d070 con 0x7f3cc0100630 2023-10-08T13:01:13.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.716+0000 7f3cc5bff700 1 -- 172.21.15.59:0/3331062692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc01a5420 con 0x7f3cc0100630 2023-10-08T13:01:13.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.716+0000 7f3cbd7fa700 1 -- 172.21.15.59:0/3331062692 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3cb0021410 con 0x7f3cc0100630 2023-10-08T13:01:13.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.716+0000 7f3cbd7fa700 1 -- 172.21.15.59:0/3331062692 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0017650 con 0x7f3cc0100630 2023-10-08T13:01:13.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.716+0000 7f3cc5bff700 1 -- 172.21.15.59:0/3331062692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc01a5900 con 0x7f3cc0100630 2023-10-08T13:01:13.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.717+0000 7f3cc5bff700 1 -- 172.21.15.59:0/3331062692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc0108c30 con 0x7f3cc0100630 2023-10-08T13:01:13.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.719+0000 7f3cbd7fa700 1 -- 172.21.15.59:0/3331062692 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3cb0021580 con 0x7f3cc0100630 2023-10-08T13:01:13.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.721+0000 7f3cbd7fa700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3cac0a15f0 0x7f3cac0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:13.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.721+0000 7f3cbd7fa700 1 -- 172.21.15.59:0/3331062692 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8485+0+0 (secure 0 0 0) 0x7f3cb00ce440 con 0x7f3cc0100630 2023-10-08T13:01:13.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.721+0000 7f3cb7fff700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3cac0a15f0 0x7f3cac0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:13.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.722+0000 7f3cb7fff700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3cac0a15f0 0x7f3cac0a3ab0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0074220 tx=0x7f3ca8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:13.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.722+0000 7f3cbd7fa700 1 -- 172.21.15.59:0/3331062692 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3cb00977b0 con 0x7f3cc0100630 2023-10-08T13:01:13.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.981+0000 7f3cc5bff700 1 -- 172.21.15.59:0/3331062692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cc0101d70 con 0x7f3cc0100630 2023-10-08T13:01:13.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.982+0000 7f3cbd7fa700 1 -- 172.21.15.59:0/3331062692 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+11262 (secure 0 0 0) 0x7f3cb009add0 con 0x7f3cc0100630 2023-10-08T13:01:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T13:01:13.984 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/1582249232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":1582249232},{"type":"v1","addr":"172.21.15.59:6837","nonce":1582249232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3140194439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3140194439},{"type":"v1","addr":"172.21.15.59:6839","nonce":3140194439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/3603700494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":3603700494},{"type":"v1","addr":"172.21.15.59:6841","nonce":3603700494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24593,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2525965671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2525965671},{"type":"v1","addr":"172.21.15.92:6833","nonce":2525965671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3717916833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3717916833},{"type":"v1","addr":"172.21.15.173:6833","nonce":3717916833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/353168083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":353168083},{"type":"v1","addr":"172.21.15.59:6835","nonce":353168083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/798745329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":798745329},{"type":"v1","addr":"172.21.15.92:6835","nonce":798745329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24646,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1081657553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1081657553},{"type":"v1","addr":"172.21.15.173:6835","nonce":1081657553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1001466762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1001466762},{"type":"v1","addr":"172.21.15.173:6837","nonce":1001466762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24665,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/3270985909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":3270985909},{"type":"v1","addr":"172.21.15.92:6837","nonce":3270985909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:39:13.722264+0000","modified":"2023-10-08T12:39:18.723320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2951536251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2951536251},{"type":"v1","addr":"172.21.15.173:6839","nonce":2951536251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24710":{"gid":24710,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6839/2979385377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2979385377},{"type":"v1","addr":"172.21.15.92:6839","nonce":2979385377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:01:13.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 -- 172.21.15.59:0/3331062692 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3cac0a15f0 msgr2=0x7f3cac0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:13.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3cac0a15f0 0x7f3cac0a3ab0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0074220 tx=0x7f3ca8009260 comp rx=0 tx=0).stop 2023-10-08T13:01:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 -- 172.21.15.59:0/3331062692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cc0100630 msgr2=0x7f3cc0072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cc0100630 0x7f3cc0072af0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0000c00 tx=0x7f3cb0004730 comp rx=0 tx=0).stop 2023-10-08T13:01:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 -- 172.21.15.59:0/3331062692 shutdown_connections 2023-10-08T13:01:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f3cac0a15f0 0x7f3cac0a3ab0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc0106640 0x7f3cc0073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cc0100630 0x7f3cc0072af0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 --2- 172.21.15.59:0/3331062692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cc0100ff0 0x7f3cc0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:13.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 -- 172.21.15.59:0/3331062692 >> 172.21.15.59:0/3331062692 conn(0x7f3cc00fc1a0 msgr2=0x7f3cc00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:13.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 -- 172.21.15.59:0/3331062692 shutdown_connections 2023-10-08T13:01:13.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:13.985+0000 7f3cc5bff700 1 -- 172.21.15.59:0/3331062692 wait complete. 2023-10-08T13:01:13.988 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 20 2023-10-08T13:01:14.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:01:14.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.215+0000 7f98d37ff700 1 -- 172.21.15.59:0/2564790113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98cc100630 msgr2=0x7f98cc100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:14.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.215+0000 7f98d37ff700 1 --2- 172.21.15.59:0/2564790113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98cc100630 0x7f98cc100ab0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009990 tx=0x7f98bc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.215+0000 7f98d37ff700 1 -- 172.21.15.59:0/2564790113 shutdown_connections 2023-10-08T13:01:14.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.215+0000 7f98d37ff700 1 --2- 172.21.15.59:0/2564790113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98cc106640 0x7f98cc106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.215+0000 7f98d37ff700 1 --2- 172.21.15.59:0/2564790113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98cc100ff0 0x7f98cc10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.215+0000 7f98d37ff700 1 --2- 172.21.15.59:0/2564790113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98cc100630 0x7f98cc100ab0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.215+0000 7f98d37ff700 1 -- 172.21.15.59:0/2564790113 >> 172.21.15.59:0/2564790113 conn(0x7f98cc0fc140 msgr2=0x7f98cc0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:14.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.215+0000 7f98d37ff700 1 -- 172.21.15.59:0/2564790113 shutdown_connections 2023-10-08T13:01:14.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.215+0000 7f98d37ff700 1 -- 172.21.15.59:0/2564790113 wait complete. 2023-10-08T13:01:14.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.216+0000 7f98d37ff700 1 Processor -- start 2023-10-08T13:01:14.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.216+0000 7f98d37ff700 1 -- start start 2023-10-08T13:01:14.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d37ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98cc100630 0x7f98cc19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:14.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d37ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98cc100ff0 0x7f98cc19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:14.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d37ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98cc106640 0x7f98cc198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:14.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d37ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc199190 con 0x7f98cc100ff0 2023-10-08T13:01:14.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d37ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc199300 con 0x7f98cc106640 2023-10-08T13:01:14.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d37ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc1994c0 con 0x7f98cc100630 2023-10-08T13:01:14.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d159b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98cc100630 0x7f98cc19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:14.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d0d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98cc100ff0 0x7f98cc19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:14.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d0d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98cc100ff0 0x7f98cc19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55090/0 (socket says 172.21.15.59:55090) 2023-10-08T13:01:14.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d159b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98cc100630 0x7f98cc19ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:35668/0 (socket says 172.21.15.59:35668) 2023-10-08T13:01:14.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d0d9a700 1 -- 172.21.15.59:0/300534884 learned_addr learned my addr 172.21.15.59:0/300534884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:14.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d1d9c700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98cc106640 0x7f98cc198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:14.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d0d9a700 1 -- 172.21.15.59:0/300534884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98cc100630 msgr2=0x7f98cc19ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:14.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d0d9a700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98cc100630 0x7f98cc19ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d0d9a700 1 -- 172.21.15.59:0/300534884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98cc106640 msgr2=0x7f98cc198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:14.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.217+0000 7f98d0d9a700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98cc106640 0x7f98cc198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.218+0000 7f98d0d9a700 1 -- 172.21.15.59:0/300534884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc0095f0 con 0x7f98cc100ff0 2023-10-08T13:01:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.218+0000 7f98d0d9a700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98cc100ff0 0x7f98cc19ef40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f98bc000c00 tx=0x7f98bc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.218+0000 7f98c27fc700 1 -- 172.21.15.59:0/300534884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc01d070 con 0x7f98cc100ff0 2023-10-08T13:01:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.218+0000 7f98d37ff700 1 -- 172.21.15.59:0/300534884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc199740 con 0x7f98cc100ff0 2023-10-08T13:01:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.218+0000 7f98c27fc700 1 -- 172.21.15.59:0/300534884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98bc022470 con 0x7f98cc100ff0 2023-10-08T13:01:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.218+0000 7f98c27fc700 1 -- 172.21.15.59:0/300534884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc017650 con 0x7f98cc100ff0 2023-10-08T13:01:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.218+0000 7f98d37ff700 1 -- 172.21.15.59:0/300534884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc1a59f0 con 0x7f98cc100ff0 2023-10-08T13:01:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.219+0000 7f98d37ff700 1 -- 172.21.15.59:0/300534884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98cc101d70 con 0x7f98cc100ff0 2023-10-08T13:01:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.221+0000 7f98c27fc700 1 -- 172.21.15.59:0/300534884 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f98bc0225e0 con 0x7f98cc100ff0 2023-10-08T13:01:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.223+0000 7f98c27fc700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98b80a15f0 0x7f98b80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.223+0000 7f98c27fc700 1 -- 172.21.15.59:0/300534884 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f98bc0ce440 con 0x7f98cc100ff0 2023-10-08T13:01:14.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.223+0000 7f98d159b700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98b80a15f0 0x7f98b80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:14.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.224+0000 7f98d159b700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98b80a15f0 0x7f98b80a3ab0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009be0 tx=0x7f98c8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:14.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.227+0000 7f98c27fc700 1 -- 172.21.15.59:0/300534884 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f98bc0977e0 con 0x7f98cc100ff0 2023-10-08T13:01:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:14 smithi059 ceph-mon[98489]: pgmap v942: 97 pgs: 97 active+clean; 849 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 361 KiB/s wr, 26 op/s 2023-10-08T13:01:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:14 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3105392057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:01:14.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:14 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3331062692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:01:14.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:14 smithi059 ceph-mon[98489]: osdmap e114: 12 total, 12 up, 12 in 2023-10-08T13:01:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.452+0000 7f98d37ff700 1 -- 172.21.15.59:0/300534884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98cc067450 con 0x7f98cc100ff0 2023-10-08T13:01:14.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.454+0000 7f98c27fc700 1 -- 172.21.15.59:0/300534884 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+22819 (secure 0 0 0) 0x7f98bc09ae00 con 0x7f98cc100ff0 2023-10-08T13:01:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-08T13:01:14.455 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":114,"fsid":"6a005028-65d6-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:30:57.612939+0000","modified":"2023-10-08T13:01:14.034836+0000","last_up_change":"2023-10-08T12:38:25.059260+0000","last_in_change":"2023-10-08T12:38:07.689577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:34:57.312603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:39:12.134451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:39:13.186137+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":35,"snap_epoch":113,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5340c12-0b40-4986-9508-e0a83f131b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6803","nonce":2710052555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6805","nonce":2710052555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6809","nonce":2710052555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2710052555},{"type":"v1","addr":"172.21.15.59:6807","nonce":2710052555}]},"public_addr":"172.21.15.59:6803/2710052555","cluster_addr":"172.21.15.59:6805/2710052555","heartbeat_back_addr":"172.21.15.59:6809/2710052555","heartbeat_front_addr":"172.21.15.59:6807/2710052555","state":["exists","up"]},{"osd":1,"uuid":"a81a353e-18b3-4793-912d-cd6a9809bcbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6801","nonce":2233119167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6803","nonce":2233119167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6807","nonce":2233119167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2233119167},{"type":"v1","addr":"172.21.15.92:6805","nonce":2233119167}]},"public_addr":"172.21.15.92:6801/2233119167","cluster_addr":"172.21.15.92:6803/2233119167","heartbeat_back_addr":"172.21.15.92:6807/2233119167","heartbeat_front_addr":"172.21.15.92:6805/2233119167","state":["exists","up"]},{"osd":2,"uuid":"59e0e0de-0540-4276-902c-0026e2feec5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6801","nonce":425637029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6803","nonce":425637029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6807","nonce":425637029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":425637029},{"type":"v1","addr":"172.21.15.173:6805","nonce":425637029}]},"public_addr":"172.21.15.173:6801/425637029","cluster_addr":"172.21.15.173:6803/425637029","heartbeat_back_addr":"172.21.15.173:6807/425637029","heartbeat_front_addr":"172.21.15.173:6805/425637029","state":["exists","up"]},{"osd":3,"uuid":"e6ce7d51-2782-4f16-9a52-a8dff84acc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6811","nonce":2771486592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6813","nonce":2771486592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6817","nonce":2771486592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2771486592},{"type":"v1","addr":"172.21.15.59:6815","nonce":2771486592}]},"public_addr":"172.21.15.59:6811/2771486592","cluster_addr":"172.21.15.59:6813/2771486592","heartbeat_back_addr":"172.21.15.59:6817/2771486592","heartbeat_front_addr":"172.21.15.59:6815/2771486592","state":["exists","up"]},{"osd":4,"uuid":"c6e0c7a3-d272-4904-93fa-3eb06fc83324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6809","nonce":1499509480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6811","nonce":1499509480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6815","nonce":1499509480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1499509480},{"type":"v1","addr":"172.21.15.92:6813","nonce":1499509480}]},"public_addr":"172.21.15.92:6809/1499509480","cluster_addr":"172.21.15.92:6811/1499509480","heartbeat_back_addr":"172.21.15.92:6815/1499509480","heartbeat_front_addr":"172.21.15.92:6813/1499509480","state":["exists","up"]},{"osd":5,"uuid":"486b651d-5ecc-4757-8c84-0d0fa61e123a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6809","nonce":2710761573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6811","nonce":2710761573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6815","nonce":2710761573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2710761573},{"type":"v1","addr":"172.21.15.173:6813","nonce":2710761573}]},"public_addr":"172.21.15.173:6809/2710761573","cluster_addr":"172.21.15.173:6811/2710761573","heartbeat_back_addr":"172.21.15.173:6815/2710761573","heartbeat_front_addr":"172.21.15.173:6813/2710761573","state":["exists","up"]},{"osd":6,"uuid":"1e1108a0-dcd5-4a1c-80a3-c9e9271f05e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6819","nonce":4121704527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6821","nonce":4121704527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6825","nonce":4121704527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4121704527},{"type":"v1","addr":"172.21.15.59:6823","nonce":4121704527}]},"public_addr":"172.21.15.59:6819/4121704527","cluster_addr":"172.21.15.59:6821/4121704527","heartbeat_back_addr":"172.21.15.59:6825/4121704527","heartbeat_front_addr":"172.21.15.59:6823/4121704527","state":["exists","up"]},{"osd":7,"uuid":"d05083d7-e1a9-4bfb-947c-2c5533d36805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6817","nonce":2022263685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6819","nonce":2022263685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6823","nonce":2022263685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2022263685},{"type":"v1","addr":"172.21.15.92:6821","nonce":2022263685}]},"public_addr":"172.21.15.92:6817/2022263685","cluster_addr":"172.21.15.92:6819/2022263685","heartbeat_back_addr":"172.21.15.92:6823/2022263685","heartbeat_front_addr":"172.21.15.92:6821/2022263685","state":["exists","up"]},{"osd":8,"uuid":"1865ed29-0774-44e9-bc01-344d59472acc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6817","nonce":993161392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6819","nonce":993161392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6823","nonce":993161392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":993161392},{"type":"v1","addr":"172.21.15.173:6821","nonce":993161392}]},"public_addr":"172.21.15.173:6817/993161392","cluster_addr":"172.21.15.173:6819/993161392","heartbeat_back_addr":"172.21.15.173:6823/993161392","heartbeat_front_addr":"172.21.15.173:6821/993161392","state":["exists","up"]},{"osd":9,"uuid":"d24bf37e-054b-4e73-8d54-9ffd1c8cbaf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6827","nonce":3574607237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6829","nonce":3574607237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6833","nonce":3574607237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3574607237},{"type":"v1","addr":"172.21.15.59:6831","nonce":3574607237}]},"public_addr":"172.21.15.59:6827/3574607237","cluster_addr":"172.21.15.59:6829/3574607237","heartbeat_back_addr":"172.21.15.59:6833/3574607237","heartbeat_front_addr":"172.21.15.59:6831/3574607237","state":["exists","up"]},{"osd":10,"uuid":"d721b22c-e46e-4550-b90f-cdc148a73e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6825","nonce":1729220812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6827","nonce":1729220812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6831","nonce":1729220812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1729220812},{"type":"v1","addr":"172.21.15.92:6829","nonce":1729220812}]},"public_addr":"172.21.15.92:6825/1729220812","cluster_addr":"172.21.15.92:6827/1729220812","heartbeat_back_addr":"172.21.15.92:6831/1729220812","heartbeat_front_addr":"172.21.15.92:6829/1729220812","state":["exists","up"]},{"osd":11,"uuid":"efc98d79-da04-4983-9ba6-929f1024786f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6825","nonce":1114623233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6827","nonce":1114623233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6831","nonce":1114623233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1114623233},{"type":"v1","addr":"172.21.15.173:6829","nonce":1114623233}]},"public_addr":"172.21.15.173:6825/1114623233","cluster_addr":"172.21.15.173:6827/1114623233","heartbeat_back_addr":"172.21.15.173:6831/1114623233","heartbeat_front_addr":"172.21.15.173:6829/1114623233","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:13.161747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:34.975505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:34:55.215357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:22.835348+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:35:44.331057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:04.844822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:32.416278+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:36:53.782445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:14.453654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:37:41.668148+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:03.098474+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:38:23.601786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/1331508923":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6801/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:6800/2617395869":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3230671169":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/333444394":"2023-10-09T12:33:10.699093+0000","172.21.15.59:0/3151805130":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/3634455687":"2023-10-09T12:31:58.782739+0000","172.21.15.59:0/354272646":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6801/815242566":"2023-10-09T12:31:58.782739+0000","172.21.15.59:6800/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/1786512478":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6801/3663319995":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/899027669":"2023-10-09T12:31:30.486951+0000","172.21.15.59:0/4060854750":"2023-10-09T12:31:30.486951+0000","172.21.15.59:6800/815242566":"2023-10-09T12:31:58.782739+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":22,"length":1},{"begin":35,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:01:14.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 -- 172.21.15.59:0/300534884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98b80a15f0 msgr2=0x7f98b80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98b80a15f0 0x7f98b80a3ab0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009be0 tx=0x7f98c8009260 comp rx=0 tx=0).stop 2023-10-08T13:01:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 -- 172.21.15.59:0/300534884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98cc100ff0 msgr2=0x7f98cc19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98cc100ff0 0x7f98cc19ef40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f98bc000c00 tx=0x7f98bc005740 comp rx=0 tx=0).stop 2023-10-08T13:01:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 -- 172.21.15.59:0/300534884 shutdown_connections 2023-10-08T13:01:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f98b80a15f0 0x7f98b80a3ab0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98cc106640 0x7f98cc198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98cc100630 0x7f98cc19ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 --2- 172.21.15.59:0/300534884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98cc100ff0 0x7f98cc19ef40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 -- 172.21.15.59:0/300534884 >> 172.21.15.59:0/300534884 conn(0x7f98cc0fc140 msgr2=0x7f98cc10be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 -- 172.21.15.59:0/300534884 shutdown_connections 2023-10-08T13:01:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.456+0000 7f98d37ff700 1 -- 172.21.15.59:0/300534884 wait complete. 2023-10-08T13:01:14.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:14 smithi173 ceph-mon[135182]: pgmap v942: 97 pgs: 97 active+clean; 849 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 361 KiB/s wr, 26 op/s 2023-10-08T13:01:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:14 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3105392057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:01:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:14 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3331062692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:01:14.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:14 smithi173 ceph-mon[135182]: osdmap e114: 12 total, 12 up, 12 in 2023-10-08T13:01:14.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T13:01:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:14 smithi092 ceph-mon[134093]: pgmap v942: 97 pgs: 97 active+clean; 849 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 361 KiB/s wr, 26 op/s 2023-10-08T13:01:14.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:14 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3105392057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:01:14.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:14 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3331062692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:01:14.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:14 smithi092 ceph-mon[134093]: osdmap e114: 12 total, 12 up, 12 in 2023-10-08T13:01:14.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.686+0000 7faec6dff700 1 -- 172.21.15.59:0/465663203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec0101100 msgr2=0x7faec010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:14.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.686+0000 7faec6dff700 1 --2- 172.21.15.59:0/465663203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec0101100 0x7faec010d610 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faeb800b0a0 tx=0x7faeb800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.687+0000 7faec6dff700 1 -- 172.21.15.59:0/465663203 shutdown_connections 2023-10-08T13:01:14.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.687+0000 7faec6dff700 1 --2- 172.21.15.59:0/465663203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec0106750 0x7faec0106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.687+0000 7faec6dff700 1 --2- 172.21.15.59:0/465663203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec0101100 0x7faec010d610 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.687+0000 7faec6dff700 1 --2- 172.21.15.59:0/465663203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec0100740 0x7faec0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.687+0000 7faec6dff700 1 -- 172.21.15.59:0/465663203 >> 172.21.15.59:0/465663203 conn(0x7faec00fc230 msgr2=0x7faec00fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:14.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.687+0000 7faec6dff700 1 -- 172.21.15.59:0/465663203 shutdown_connections 2023-10-08T13:01:14.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.687+0000 7faec6dff700 1 -- 172.21.15.59:0/465663203 wait complete. 2023-10-08T13:01:14.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.688+0000 7faec6dff700 1 Processor -- start 2023-10-08T13:01:14.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.688+0000 7faec6dff700 1 -- start start 2023-10-08T13:01:14.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.689+0000 7faec6dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec0100740 0x7faec019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:14.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.689+0000 7faec6dff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec0101100 0x7faec019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:14.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.689+0000 7faec6dff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec0106750 0x7faec0196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:14.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.689+0000 7faec6dff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec0197100 con 0x7faec0106750 2023-10-08T13:01:14.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.689+0000 7faec6dff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec0197270 con 0x7faec0101100 2023-10-08T13:01:14.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.689+0000 7faec6dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec0197430 con 0x7faec0100740 2023-10-08T13:01:14.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.689+0000 7faec4b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec0100740 0x7faec019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.689+0000 7faec4b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec0100740 0x7faec019c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.59:35680/0 (socket says 172.21.15.59:35680) 2023-10-08T13:01:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.689+0000 7faec4b9b700 1 -- 172.21.15.59:0/1533984031 learned_addr learned my addr 172.21.15.59:0/1533984031 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.689+0000 7faeb7fff700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec0101100 0x7faec019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.689+0000 7faec539c700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec0106750 0x7faec0196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.690+0000 7faec4b9b700 1 -- 172.21.15.59:0/1533984031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec0101100 msgr2=0x7faec019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.690+0000 7faec4b9b700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec0101100 0x7faec019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.690+0000 7faec4b9b700 1 -- 172.21.15.59:0/1533984031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec0106750 msgr2=0x7faec0196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.690+0000 7faec4b9b700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec0106750 0x7faec0196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.690+0000 7faec4b9b700 1 -- 172.21.15.59:0/1533984031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb8009d00 con 0x7faec0100740 2023-10-08T13:01:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.690+0000 7faec4b9b700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec0100740 0x7faec019c890 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faebc00e9a0 tx=0x7faebc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.690+0000 7faeb5ffb700 1 -- 172.21.15.59:0/1533984031 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc009790 con 0x7faec0100740 2023-10-08T13:01:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.690+0000 7faeb5ffb700 1 -- 172.21.15.59:0/1533984031 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faebc010430 con 0x7faec0100740 2023-10-08T13:01:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.690+0000 7faec6dff700 1 -- 172.21.15.59:0/1533984031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec0197710 con 0x7faec0100740 2023-10-08T13:01:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.690+0000 7faeb5ffb700 1 -- 172.21.15.59:0/1533984031 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc018680 con 0x7faec0100740 2023-10-08T13:01:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.690+0000 7faec6dff700 1 -- 172.21.15.59:0/1533984031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec01a3810 con 0x7faec0100740 2023-10-08T13:01:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.691+0000 7faec6dff700 1 -- 172.21.15.59:0/1533984031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec0108d40 con 0x7faec0100740 2023-10-08T13:01:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.693+0000 7faeb5ffb700 1 -- 172.21.15.59:0/1533984031 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7faebc0105a0 con 0x7faec0100740 2023-10-08T13:01:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.695+0000 7faeb5ffb700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faea80a15f0 0x7faea80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.695+0000 7faeb5ffb700 1 -- 172.21.15.59:0/1533984031 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8441+0+0 (secure 0 0 0) 0x7faebc014070 con 0x7faec0100740 2023-10-08T13:01:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.695+0000 7faeb7fff700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faea80a15f0 0x7faea80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:14.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.696+0000 7faeb7fff700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faea80a15f0 0x7faea80a3ab0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faec01980a0 tx=0x7faeb0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:14.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.697+0000 7faeb5ffb700 1 -- 172.21.15.59:0/1533984031 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faebc096750 con 0x7faec0100740 2023-10-08T13:01:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.957+0000 7faec6dff700 1 -- 172.21.15.59:0/1533984031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faec0101e80 con 0x7faec0100740 2023-10-08T13:01:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.964+0000 7faeb5ffb700 1 -- 172.21.15.59:0/1533984031 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7faebc026090 con 0x7faec0100740 2023-10-08T13:01:14.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 -- 172.21.15.59:0/1533984031 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faea80a15f0 msgr2=0x7faea80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:14.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faea80a15f0 0x7faea80a3ab0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faec01980a0 tx=0x7faeb0009260 comp rx=0 tx=0).stop 2023-10-08T13:01:14.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 -- 172.21.15.59:0/1533984031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec0100740 msgr2=0x7faec019c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:14.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec0100740 0x7faec019c890 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faebc00e9a0 tx=0x7faebc00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 -- 172.21.15.59:0/1533984031 shutdown_connections 2023-10-08T13:01:14.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7faea80a15f0 0x7faea80a3ab0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec0106750 0x7faec0196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec0100740 0x7faec019c890 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 --2- 172.21.15.59:0/1533984031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec0101100 0x7faec019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:14.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 -- 172.21.15.59:0/1533984031 >> 172.21.15.59:0/1533984031 conn(0x7faec00fc230 msgr2=0x7faec00fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:14.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 -- 172.21.15.59:0/1533984031 shutdown_connections 2023-10-08T13:01:14.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:14.967+0000 7faec6dff700 1 -- 172.21.15.59:0/1533984031 wait complete. 2023-10-08T13:01:14.971 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T13:01:14.987 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T13:01:15.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.196+0000 7f19bcdff700 1 -- 172.21.15.59:0/1199552255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b8100740 msgr2=0x7f19b8100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.196+0000 7f19bcdff700 1 --2- 172.21.15.59:0/1199552255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b8100740 0x7f19b8100bc0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009990 tx=0x7f19ac009ca0 comp rx=0 tx=0).stop 2023-10-08T13:01:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.196+0000 7f19bcdff700 1 -- 172.21.15.59:0/1199552255 shutdown_connections 2023-10-08T13:01:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.196+0000 7f19bcdff700 1 --2- 172.21.15.59:0/1199552255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8101100 0x7f19b810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.196+0000 7f19bcdff700 1 --2- 172.21.15.59:0/1199552255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b8106750 0x7f19b8106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.196+0000 7f19bcdff700 1 --2- 172.21.15.59:0/1199552255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b8100740 0x7f19b8100bc0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.196+0000 7f19bcdff700 1 -- 172.21.15.59:0/1199552255 >> 172.21.15.59:0/1199552255 conn(0x7f19b80fc230 msgr2=0x7f19b80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.196+0000 7f19bcdff700 1 -- 172.21.15.59:0/1199552255 shutdown_connections 2023-10-08T13:01:15.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.196+0000 7f19bcdff700 1 -- 172.21.15.59:0/1199552255 wait complete. 2023-10-08T13:01:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.197+0000 7f19bcdff700 1 Processor -- start 2023-10-08T13:01:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.197+0000 7f19bcdff700 1 -- start start 2023-10-08T13:01:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19bcdff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8100740 0x7f19b8198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19bcdff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b8101100 0x7f19b8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19bcdff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b8106750 0x7f19b819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19bcdff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b819dcc0 con 0x7f19b8106750 2023-10-08T13:01:15.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19bcdff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b819de30 con 0x7f19b8100740 2023-10-08T13:01:15.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19bcdff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b819dff0 con 0x7f19b8101100 2023-10-08T13:01:15.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19b659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8100740 0x7f19b8198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:15.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19b659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8100740 0x7f19b8198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44216/0 (socket says 172.21.15.59:44216) 2023-10-08T13:01:15.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19b659c700 1 -- 172.21.15.59:0/1803492000 learned_addr learned my addr 172.21.15.59:0/1803492000 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:15.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19b5d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b8101100 0x7f19b8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:15.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19b6d9d700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b8106750 0x7f19b819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:15.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19b659c700 1 -- 172.21.15.59:0/1803492000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b8101100 msgr2=0x7f19b8199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:15.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19b659c700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b8101100 0x7f19b8199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:15.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19b659c700 1 -- 172.21.15.59:0/1803492000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b8106750 msgr2=0x7f19b819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:15.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19b659c700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b8106750 0x7f19b819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:15.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19b659c700 1 -- 172.21.15.59:0/1803492000 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0095f0 con 0x7f19b8100740 2023-10-08T13:01:15.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.198+0000 7f19b6d9d700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b8106750 0x7f19b819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:01:15.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.199+0000 7f19b659c700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8100740 0x7f19b8198df0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f19a800e9a0 tx=0x7f19a800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:15.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.199+0000 7f19a77fe700 1 -- 172.21.15.59:0/1803492000 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8009790 con 0x7f19b8100740 2023-10-08T13:01:15.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.199+0000 7f19bcdff700 1 -- 172.21.15.59:0/1803492000 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b819e2d0 con 0x7f19b8100740 2023-10-08T13:01:15.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.199+0000 7f19a77fe700 1 -- 172.21.15.59:0/1803492000 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19a800cbd0 con 0x7f19b8100740 2023-10-08T13:01:15.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.199+0000 7f19a77fe700 1 -- 172.21.15.59:0/1803492000 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8018680 con 0x7f19b8100740 2023-10-08T13:01:15.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.199+0000 7f19bcdff700 1 -- 172.21.15.59:0/1803492000 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b81a5b10 con 0x7f19b8100740 2023-10-08T13:01:15.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.200+0000 7f19bcdff700 1 -- 172.21.15.59:0/1803492000 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b8101e80 con 0x7f19b8100740 2023-10-08T13:01:15.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.205+0000 7f19a77fe700 1 -- 172.21.15.59:0/1803492000 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f19a800cd40 con 0x7f19b8100740 2023-10-08T13:01:15.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.206+0000 7f19a77fe700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19a00a1670 0x7f19a00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:15.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.206+0000 7f19a77fe700 1 -- 172.21.15.59:0/1803492000 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8483+0+0 (secure 0 0 0) 0x7f19a8014070 con 0x7f19b8100740 2023-10-08T13:01:15.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.206+0000 7f19b5d9b700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19a00a1670 0x7f19a00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:15.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.207+0000 7f19b5d9b700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19a00a1670 0x7f19a00a3b30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f19b819a2f0 tx=0x7f19ac005a90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:15.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.207+0000 7f19a77fe700 1 -- 172.21.15.59:0/1803492000 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f19a80968a0 con 0x7f19b8100740 2023-10-08T13:01:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-a[98465]: 2023-10-08T13:01:14.958+0000 7fa930893700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:01:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:15 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/300534884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:01:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:15 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1533984031' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:01:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:15 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:01:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:15 smithi059 ceph-mon[98489]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T13:01:15.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:15 smithi059 ceph-mon[98489]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:01:15.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:15 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T13:01:15.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:15 smithi059 ceph-mon[98489]: osdmap e115: 12 total, 12 up, 12 in 2023-10-08T13:01:15.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:15 smithi059 ceph-mon[98489]: fsmap cephfs:0/1 10 up:standby, 1 failed 2023-10-08T13:01:15.378 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-b[173578]: ignoring --setuser ceph since I am not root 2023-10-08T13:01:15.378 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-b[173578]: ignoring --setgroup ceph since I am not root 2023-10-08T13:01:15.378 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-mds[173602]: -- 172.21.15.92:0/1289222544 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f056c051e0 con 0x55f056bdac00 2023-10-08T13:01:15.378 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-b[173578]: starting mds.b at 2023-10-08T13:01:15.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/300534884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:01:15.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1533984031' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:01:15.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:01:15.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-mon[134093]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T13:01:15.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-mon[134093]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:01:15.379 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T13:01:15.380 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-mon[134093]: osdmap e115: 12 total, 12 up, 12 in 2023-10-08T13:01:15.380 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:15 smithi092 ceph-mon[134093]: fsmap cephfs:0/1 10 up:standby, 1 failed 2023-10-08T13:01:15.468 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-i[173476]: ignoring --setuser ceph since I am not root 2023-10-08T13:01:15.468 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-i[173476]: ignoring --setgroup ceph since I am not root 2023-10-08T13:01:15.468 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-mds[173500]: -- 172.21.15.173:0/1627428158 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558d9a53f1e0 con 0x558d9a515000 2023-10-08T13:01:15.468 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-i[173476]: starting mds.i at 2023-10-08T13:01:15.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/300534884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:01:15.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1533984031' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:01:15.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:01:15.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-mon[135182]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T13:01:15.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-mon[135182]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:01:15.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T13:01:15.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-mon[135182]: osdmap e115: 12 total, 12 up, 12 in 2023-10-08T13:01:15.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:15 smithi173 ceph-mon[135182]: fsmap cephfs:0/1 10 up:standby, 1 failed 2023-10-08T13:01:15.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.471+0000 7f19bcdff700 1 -- 172.21.15.59:0/1803492000 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f19b819a0a0 con 0x7f19b8100740 2023-10-08T13:01:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.970+0000 7f19a77fe700 1 -- 172.21.15.59:0/1803492000 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f19a8096070 con 0x7f19b8100740 2023-10-08T13:01:15.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 -- 172.21.15.59:0/1803492000 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19a00a1670 msgr2=0x7f19a00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19a00a1670 0x7f19a00a3b30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f19b819a2f0 tx=0x7f19ac005a90 comp rx=0 tx=0).stop 2023-10-08T13:01:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 -- 172.21.15.59:0/1803492000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8100740 msgr2=0x7f19b8198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8100740 0x7f19b8198df0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f19a800e9a0 tx=0x7f19a800ecb0 comp rx=0 tx=0).stop 2023-10-08T13:01:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 -- 172.21.15.59:0/1803492000 shutdown_connections 2023-10-08T13:01:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f19a00a1670 0x7f19a00a3b30 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b8100740 0x7f19b8198df0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b8106750 0x7f19b819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 --2- 172.21.15.59:0/1803492000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b8101100 0x7f19b8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 -- 172.21.15.59:0/1803492000 >> 172.21.15.59:0/1803492000 conn(0x7f19b80fc230 msgr2=0x7f19b80fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 -- 172.21.15.59:0/1803492000 shutdown_connections 2023-10-08T13:01:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:15.973+0000 7f19bcdff700 1 -- 172.21.15.59:0/1803492000 wait complete. 2023-10-08T13:01:15.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T13:01:16.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.205+0000 7f59e17ff700 1 -- 172.21.15.59:0/2340659217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59dc100740 msgr2=0x7f59dc100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:16.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.205+0000 7f59e17ff700 1 --2- 172.21.15.59:0/2340659217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59dc100740 0x7f59dc100bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0098f0 tx=0x7f59cc009c00 comp rx=0 tx=0).stop 2023-10-08T13:01:16.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.205+0000 7f59e17ff700 1 -- 172.21.15.59:0/2340659217 shutdown_connections 2023-10-08T13:01:16.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.206+0000 7f59e17ff700 1 --2- 172.21.15.59:0/2340659217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc106750 0x7f59dc106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:16.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.206+0000 7f59e17ff700 1 --2- 172.21.15.59:0/2340659217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59dc101100 0x7f59dc10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:16.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.206+0000 7f59e17ff700 1 --2- 172.21.15.59:0/2340659217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59dc100740 0x7f59dc100bc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:16.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.206+0000 7f59e17ff700 1 -- 172.21.15.59:0/2340659217 >> 172.21.15.59:0/2340659217 conn(0x7f59dc0fc230 msgr2=0x7f59dc0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:16.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.206+0000 7f59e17ff700 1 -- 172.21.15.59:0/2340659217 shutdown_connections 2023-10-08T13:01:16.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.206+0000 7f59e17ff700 1 -- 172.21.15.59:0/2340659217 wait complete. 2023-10-08T13:01:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.207+0000 7f59e17ff700 1 Processor -- start 2023-10-08T13:01:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.207+0000 7f59e17ff700 1 -- start start 2023-10-08T13:01:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.207+0000 7f59e17ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc100740 0x7f59dc198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.207+0000 7f59e17ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59dc101100 0x7f59dc199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.207+0000 7f59e17ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59dc106750 0x7f59dc19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.207+0000 7f59e17ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc19dd50 con 0x7f59dc101100 2023-10-08T13:01:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.207+0000 7f59e17ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc19dec0 con 0x7f59dc100740 2023-10-08T13:01:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.207+0000 7f59e17ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc19e080 con 0x7f59dc106750 2023-10-08T13:01:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.207+0000 7f59daffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc100740 0x7f59dc198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.208+0000 7f59daffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc100740 0x7f59dc198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.59:44238/0 (socket says 172.21.15.59:44238) 2023-10-08T13:01:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.208+0000 7f59daffd700 1 -- 172.21.15.59:0/2644807979 learned_addr learned my addr 172.21.15.59:0/2644807979 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.208+0000 7f59db7fe700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59dc106750 0x7f59dc19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.208+0000 7f59da7fc700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59dc101100 0x7f59dc199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.208+0000 7f59daffd700 1 -- 172.21.15.59:0/2644807979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59dc106750 msgr2=0x7f59dc19d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.208+0000 7f59daffd700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59dc106750 0x7f59dc19d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.208+0000 7f59daffd700 1 -- 172.21.15.59:0/2644807979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59dc101100 msgr2=0x7f59dc199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.208+0000 7f59daffd700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59dc101100 0x7f59dc199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.208+0000 7f59daffd700 1 -- 172.21.15.59:0/2644807979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c40095f0 con 0x7f59dc100740 2023-10-08T13:01:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.208+0000 7f59daffd700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc100740 0x7f59dc198e30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f59c400ec10 tx=0x7f59c400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.208+0000 7f59d3fff700 1 -- 172.21.15.59:0/2644807979 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c400cc90 con 0x7f59dc100740 2023-10-08T13:01:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.209+0000 7f59e17ff700 1 -- 172.21.15.59:0/2644807979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59cc009520 con 0x7f59dc100740 2023-10-08T13:01:16.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.209+0000 7f59d3fff700 1 -- 172.21.15.59:0/2644807979 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59c40044e0 con 0x7f59dc100740 2023-10-08T13:01:16.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.209+0000 7f59d3fff700 1 -- 172.21.15.59:0/2644807979 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4010430 con 0x7f59dc100740 2023-10-08T13:01:16.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.209+0000 7f59e17ff700 1 -- 172.21.15.59:0/2644807979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc1a59c0 con 0x7f59dc100740 2023-10-08T13:01:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.210+0000 7f59e17ff700 1 -- 172.21.15.59:0/2644807979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc101e80 con 0x7f59dc100740 2023-10-08T13:01:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.212+0000 7f59d3fff700 1 -- 172.21.15.59:0/2644807979 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f59c4003fb0 con 0x7f59dc100740 2023-10-08T13:01:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.213+0000 7f59d3fff700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59c80a15f0 0x7f59c80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.213+0000 7f59d3fff700 1 -- 172.21.15.59:0/2644807979 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8483+0+0 (secure 0 0 0) 0x7f59c4014070 con 0x7f59dc100740 2023-10-08T13:01:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.213+0000 7f59da7fc700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59c80a15f0 0x7f59c80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:16.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.214+0000 7f59da7fc700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59c80a15f0 0x7f59c80a3ab0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0098c0 tx=0x7f59cc019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:16.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.217+0000 7f59d3fff700 1 -- 172.21.15.59:0/2644807979 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f59c4096910 con 0x7f59dc100740 2023-10-08T13:01:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: pgmap v945: 97 pgs: 97 active+clean; 841 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 484 KiB/s wr, 30 op/s 2023-10-08T13:01:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/1803492000' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:01:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:01:16.265 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T13:01:16.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T13:01:16.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: Cluster is now healthy 2023-10-08T13:01:16.266 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:01:16.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.173:6838/2498916765,v1:172.21.15.173:6839/2498916765] up:boot 2023-10-08T13:01:16.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: mds.? [v2:172.21.15.92:6838/491794711,v1:172.21.15.92:6839/491794711] up:boot 2023-10-08T13:01:16.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: fsmap 12 up:standby 2023-10-08T13:01:16.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:01:16.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:16 smithi059 ceph-mon[98489]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:01:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:16.427+0000 7f59e17ff700 1 -- 172.21.15.59:0/2644807979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f59dc067530 con 0x7f59dc100740 2023-10-08T13:01:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: pgmap v945: 97 pgs: 97 active+clean; 841 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 484 KiB/s wr, 30 op/s 2023-10-08T13:01:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/1803492000' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:01:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:01:16.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T13:01:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T13:01:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: Cluster is now healthy 2023-10-08T13:01:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:01:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.173:6838/2498916765,v1:172.21.15.173:6839/2498916765] up:boot 2023-10-08T13:01:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: mds.? [v2:172.21.15.92:6838/491794711,v1:172.21.15.92:6839/491794711] up:boot 2023-10-08T13:01:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: fsmap 12 up:standby 2023-10-08T13:01:16.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:01:16.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:16 smithi173 ceph-mon[135182]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:01:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: pgmap v945: 97 pgs: 97 active+clean; 841 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 484 KiB/s wr, 30 op/s 2023-10-08T13:01:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/1803492000' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:01:16.627 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:01:16.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T13:01:16.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T13:01:16.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: Cluster is now healthy 2023-10-08T13:01:16.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:01:16.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.173:6838/2498916765,v1:172.21.15.173:6839/2498916765] up:boot 2023-10-08T13:01:16.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: mds.? [v2:172.21.15.92:6838/491794711,v1:172.21.15.92:6839/491794711] up:boot 2023-10-08T13:01:16.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: fsmap 12 up:standby 2023-10-08T13:01:16.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:01:16.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:16 smithi092 ceph-mon[134093]: from='mgr.14214 172.21.15.59:0/2912105887' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:01:17.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.213+0000 7f59d3fff700 1 -- 172.21.15.59:0/2644807979 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v116) v1 ==== 181+0+0 (secure 0 0 0) 0x7f59c4099f30 con 0x7f59dc100740 2023-10-08T13:01:17.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.218+0000 7f59e17ff700 1 -- 172.21.15.59:0/2644807979 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59c80a15f0 msgr2=0x7f59c80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:17.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.218+0000 7f59e17ff700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59c80a15f0 0x7f59c80a3ab0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0098c0 tx=0x7f59cc019040 comp rx=0 tx=0).stop 2023-10-08T13:01:17.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.218+0000 7f59e17ff700 1 -- 172.21.15.59:0/2644807979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc100740 msgr2=0x7f59dc198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:17.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.218+0000 7f59e17ff700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc100740 0x7f59dc198e30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f59c400ec10 tx=0x7f59c400ef20 comp rx=0 tx=0).stop 2023-10-08T13:01:17.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.218+0000 7f59e17ff700 1 -- 172.21.15.59:0/2644807979 shutdown_connections 2023-10-08T13:01:17.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.219+0000 7f59e17ff700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f59c80a15f0 0x7f59c80a3ab0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:17.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.219+0000 7f59e17ff700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc100740 0x7f59dc198e30 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:17.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.219+0000 7f59e17ff700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59dc106750 0x7f59dc19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:17.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.219+0000 7f59e17ff700 1 --2- 172.21.15.59:0/2644807979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59dc101100 0x7f59dc199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:17.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.219+0000 7f59e17ff700 1 -- 172.21.15.59:0/2644807979 >> 172.21.15.59:0/2644807979 conn(0x7f59dc0fc230 msgr2=0x7f59dc0fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:17.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.219+0000 7f59e17ff700 1 -- 172.21.15.59:0/2644807979 shutdown_connections 2023-10-08T13:01:17.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.219+0000 7f59e17ff700 1 -- 172.21.15.59:0/2644807979 wait complete. 2023-10-08T13:01:17.222 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2023-10-08T13:01:17.245 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T13:01:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:17 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/2644807979' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:01:17.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:17 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:01:17.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.469+0000 7f24aa7ff700 1 -- 172.21.15.59:0/2749341071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a4106750 msgr2=0x7f24a4106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.469+0000 7f24aa7ff700 1 --2- 172.21.15.59:0/2749341071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a4106750 0x7f24a4106b30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2494009990 tx=0x7f2494009ca0 comp rx=0 tx=0).stop 2023-10-08T13:01:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.469+0000 7f24aa7ff700 1 -- 172.21.15.59:0/2749341071 shutdown_connections 2023-10-08T13:01:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.469+0000 7f24aa7ff700 1 --2- 172.21.15.59:0/2749341071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a4101100 0x7f24a410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.469+0000 7f24aa7ff700 1 --2- 172.21.15.59:0/2749341071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a4106750 0x7f24a4106b30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.469+0000 7f24aa7ff700 1 --2- 172.21.15.59:0/2749341071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4100740 0x7f24a4100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.469+0000 7f24aa7ff700 1 -- 172.21.15.59:0/2749341071 >> 172.21.15.59:0/2749341071 conn(0x7f24a40fc230 msgr2=0x7f24a40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:17.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.469+0000 7f24aa7ff700 1 -- 172.21.15.59:0/2749341071 shutdown_connections 2023-10-08T13:01:17.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.469+0000 7f24aa7ff700 1 -- 172.21.15.59:0/2749341071 wait complete. 2023-10-08T13:01:17.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.470+0000 7f24aa7ff700 1 Processor -- start 2023-10-08T13:01:17.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.471+0000 7f24aa7ff700 1 -- start start 2023-10-08T13:01:17.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.471+0000 7f24aa7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4100740 0x7f24a4198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.471+0000 7f24aa7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a4101100 0x7f24a41992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.471+0000 7f24aa7ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a4106750 0x7f24a419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.471+0000 7f24aa7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a419dcc0 con 0x7f24a4100740 2023-10-08T13:01:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.471+0000 7f24aa7ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a419de30 con 0x7f24a4106750 2023-10-08T13:01:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.471+0000 7f24aa7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a419dff0 con 0x7f24a4101100 2023-10-08T13:01:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.472+0000 7f24a3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4100740 0x7f24a4198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.472+0000 7f24a3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4100740 0x7f24a4198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55166/0 (socket says 172.21.15.59:55166) 2023-10-08T13:01:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.472+0000 7f24a3fff700 1 -- 172.21.15.59:0/3243079897 learned_addr learned my addr 172.21.15.59:0/3243079897 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-08T13:01:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.472+0000 7f24a37fe700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a4101100 0x7f24a41992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.472+0000 7f24a8d9c700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a4106750 0x7f24a419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.472+0000 7f24a3fff700 1 -- 172.21.15.59:0/3243079897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a4101100 msgr2=0x7f24a41992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.472+0000 7f24a3fff700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a4101100 0x7f24a41992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.472+0000 7f24a3fff700 1 -- 172.21.15.59:0/3243079897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a4106750 msgr2=0x7f24a419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.472+0000 7f24a3fff700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a4106750 0x7f24a419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:17.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.472+0000 7f24a3fff700 1 -- 172.21.15.59:0/3243079897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940095f0 con 0x7f24a4100740 2023-10-08T13:01:17.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.472+0000 7f24a3fff700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4100740 0x7f24a4198da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2494000c00 tx=0x7f2494005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:17.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.473+0000 7f24a17fa700 1 -- 172.21.15.59:0/3243079897 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249401d070 con 0x7f24a4100740 2023-10-08T13:01:17.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.473+0000 7f24aa7ff700 1 -- 172.21.15.59:0/3243079897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a419e270 con 0x7f24a4100740 2023-10-08T13:01:17.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.473+0000 7f24a17fa700 1 -- 172.21.15.59:0/3243079897 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2494022470 con 0x7f24a4100740 2023-10-08T13:01:17.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.473+0000 7f24a17fa700 1 -- 172.21.15.59:0/3243079897 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494017650 con 0x7f24a4100740 2023-10-08T13:01:17.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.473+0000 7f24aa7ff700 1 -- 172.21.15.59:0/3243079897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a41a5b10 con 0x7f24a4100740 2023-10-08T13:01:17.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.474+0000 7f24aa7ff700 1 -- 172.21.15.59:0/3243079897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a4101e80 con 0x7f24a4100740 2023-10-08T13:01:17.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.476+0000 7f24a17fa700 1 -- 172.21.15.59:0/3243079897 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f24940225e0 con 0x7f24a4100740 2023-10-08T13:01:17.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.477+0000 7f24a17fa700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f248c0a1670 0x7f248c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:17.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.477+0000 7f24a17fa700 1 -- 172.21.15.59:0/3243079897 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7987+0+0 (secure 0 0 0) 0x7f24940ce1f0 con 0x7f24a4100740 2023-10-08T13:01:17.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.477+0000 7f24a37fe700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f248c0a1670 0x7f248c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:17.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.478+0000 7f24a37fe700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f248c0a1670 0x7f248c0a3b30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f24a419a2f0 tx=0x7f2498009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:17.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.481+0000 7f24a17fa700 1 -- 172.21.15.59:0/3243079897 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2494097760 con 0x7f24a4100740 2023-10-08T13:01:17.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:17 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/2644807979' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:01:17.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:17 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:01:17.629 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:17 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/2644807979' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:01:17.630 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:17 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:01:17.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:17.728+0000 7f24aa7ff700 1 -- 172.21.15.59:0/3243079897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f24a419a0a0 con 0x7f24a4100740 2023-10-08T13:01:18.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.211+0000 7f24a17fa700 1 -- 172.21.15.59:0/3243079897 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v117) v1 ==== 169+0+0 (secure 0 0 0) 0x7f249409ad80 con 0x7f24a4100740 2023-10-08T13:01:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.213+0000 7f24aa7ff700 1 -- 172.21.15.59:0/3243079897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f248c0a1670 msgr2=0x7f248c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.214+0000 7f24aa7ff700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f248c0a1670 0x7f248c0a3b30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f24a419a2f0 tx=0x7f2498009260 comp rx=0 tx=0).stop 2023-10-08T13:01:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.214+0000 7f24aa7ff700 1 -- 172.21.15.59:0/3243079897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4100740 msgr2=0x7f24a4198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.214+0000 7f24aa7ff700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4100740 0x7f24a4198da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2494000c00 tx=0x7f2494005740 comp rx=0 tx=0).stop 2023-10-08T13:01:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.214+0000 7f24aa7ff700 1 -- 172.21.15.59:0/3243079897 shutdown_connections 2023-10-08T13:01:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.214+0000 7f24aa7ff700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.59:6800/921332174,v1:172.21.15.59:6801/921332174] conn(0x7f248c0a1670 0x7f248c0a3b30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.214+0000 7f24aa7ff700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a4106750 0x7f24a419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.214+0000 7f24aa7ff700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4100740 0x7f24a4198da0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.214+0000 7f24aa7ff700 1 --2- 172.21.15.59:0/3243079897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a4101100 0x7f24a41992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:18.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.214+0000 7f24aa7ff700 1 -- 172.21.15.59:0/3243079897 >> 172.21.15.59:0/3243079897 conn(0x7f24a40fc230 msgr2=0x7f24a410bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:18.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.214+0000 7f24aa7ff700 1 -- 172.21.15.59:0/3243079897 shutdown_connections 2023-10-08T13:01:18.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-08T13:01:18.214+0000 7f24aa7ff700 1 -- 172.21.15.59:0/3243079897 wait complete. 2023-10-08T13:01:18.218 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2023-10-08T13:01:18.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:01:18.324 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:01:18.371 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:01:18.402 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-08T13:01:18.403 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T13:01:18.447 DEBUG:teuthology.orchestra.run.smithi092:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T13:01:18.463 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T13:01:18.480 INFO:tasks.cephadm:Stopping all daemons... 2023-10-08T13:01:18.480 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-08T13:01:18.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.a 2023-10-08T13:01:18.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:18 smithi059 ceph-mon[98489]: pgmap v946: 97 pgs: 97 active+clean; 834 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 928 KiB/s wr, 46 op/s 2023-10-08T13:01:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:18 smithi059 ceph-mon[98489]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:01:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:18 smithi059 ceph-mon[98489]: osdmap e116: 12 total, 12 up, 12 in 2023-10-08T13:01:18.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:18 smithi059 ceph-mon[98489]: from='client.? 172.21.15.59:0/3243079897' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:01:18.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:18 smithi092 ceph-mon[134093]: pgmap v946: 97 pgs: 97 active+clean; 834 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 928 KiB/s wr, 46 op/s 2023-10-08T13:01:18.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:18 smithi092 ceph-mon[134093]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:01:18.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:18 smithi092 ceph-mon[134093]: osdmap e116: 12 total, 12 up, 12 in 2023-10-08T13:01:18.628 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:18 smithi092 ceph-mon[134093]: from='client.? 172.21.15.59:0/3243079897' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:01:18.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:18 smithi173 ceph-mon[135182]: pgmap v946: 97 pgs: 97 active+clean; 834 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 928 KiB/s wr, 46 op/s 2023-10-08T13:01:18.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:18 smithi173 ceph-mon[135182]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:01:18.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:18 smithi173 ceph-mon[135182]: osdmap e116: 12 total, 12 up, 12 in 2023-10-08T13:01:18.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:18 smithi173 ceph-mon[135182]: from='client.? 172.21.15.59:0/3243079897' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:01:19.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:18 smithi059 systemd[1]: Stopping Ceph mon.a for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:19.456 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:19 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-a[98465]: 2023-10-08T13:01:19.072+0000 7fa93609e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:19.456 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:19 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-a[98465]: 2023-10-08T13:01:19.072+0000 7fa93609e700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-08T13:01:19.765 INFO:journalctl@ceph.mon.a.smithi059.stdout:Oct 08 13:01:19 smithi059 bash[188663]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-a 2023-10-08T13:01:20.041 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.a.service' 2023-10-08T13:01:20.181 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:20.182 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-08T13:01:20.182 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-08T13:01:20.182 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.b 2023-10-08T13:01:20.564 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:20 smithi092 systemd[1]: Stopping Ceph mon.b for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:20.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:20 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-b[134069]: 2023-10-08T13:01:20.563+0000 7f3e91307700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:20.815 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:20 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-b[134069]: 2023-10-08T13:01:20.563+0000 7f3e91307700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-08T13:01:21.127 INFO:journalctl@ceph.mon.b.smithi092.stdout:Oct 08 13:01:21 smithi092 bash[179550]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-b 2023-10-08T13:01:21.213 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.b.service' 2023-10-08T13:01:21.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:21.271 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-08T13:01:21.271 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-08T13:01:21.271 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.c 2023-10-08T13:01:21.649 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:21 smithi173 systemd[1]: Stopping Ceph mon.c for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:21.964 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:21 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-c[135143]: 2023-10-08T13:01:21.648+0000 7f6a0182f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:21.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:21 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-c[135143]: 2023-10-08T13:01:21.648+0000 7f6a0182f700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-08T13:01:22.174 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.c.service' 2023-10-08T13:01:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:21 smithi173 bash[180480]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mon-c 2023-10-08T13:01:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:22 smithi173 systemd[1]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mon.c.service: Succeeded. 2023-10-08T13:01:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Oct 08 13:01:22 smithi173 systemd[1]: Stopped Ceph mon.c for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T13:01:22.223 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:22.223 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-08T13:01:22.224 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-08T13:01:22.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.x 2023-10-08T13:01:22.749 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 13:01:22 smithi059 systemd[1]: Stopping Ceph mgr.x for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:23.015 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 13:01:22 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T13:01:22.747+0000 7f06d2c9e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:23.015 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 13:01:22 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x[98735]: 2023-10-08T13:01:22.747+0000 7f06d2c9e700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-08T13:01:23.515 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Oct 08 13:01:23 smithi059 bash[188808]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-x 2023-10-08T13:01:23.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.x.service' 2023-10-08T13:01:23.689 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:23.689 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-08T13:01:23.690 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-08T13:01:23.690 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.y 2023-10-08T13:01:24.127 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 13:01:23 smithi092 systemd[1]: Stopping Ceph mgr.y for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:24.803 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 13:01:24 smithi092 bash[179691]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-y 2023-10-08T13:01:24.985 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Oct 08 13:01:24 smithi092 systemd[1]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-08T13:01:24.989 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.y.service' 2023-10-08T13:01:25.025 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:25.026 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-08T13:01:25.026 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-08T13:01:25.026 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.z 2023-10-08T13:01:25.463 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 13:01:25 smithi173 systemd[1]: Stopping Ceph mgr.z for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:25.718 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 13:01:25 smithi173 bash[180618]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mgr-z 2023-10-08T13:01:25.916 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Oct 08 13:01:25 smithi173 systemd[1]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-08T13:01:25.920 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mgr.z.service' 2023-10-08T13:01:25.955 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:25.956 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-08T13:01:25.956 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-08T13:01:25.956 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.0 2023-10-08T13:01:26.464 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 13:01:26 smithi059 systemd[1]: Stopping Ceph osd.0 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:26.765 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 13:01:26 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-0[123447]: 2023-10-08T13:01:26.463+0000 7fca3f1ec700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:26.765 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 13:01:26 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-0[123447]: 2023-10-08T13:01:26.463+0000 7fca3f1ec700 -1 osd.0 117 *** Got signal Terminated *** 2023-10-08T13:01:26.765 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 13:01:26 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-0[123447]: 2023-10-08T13:01:26.463+0000 7fca3f1ec700 -1 osd.0 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:01:32.765 INFO:journalctl@ceph.osd.0.smithi059.stdout:Oct 08 13:01:32 smithi059 bash[188967]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-0 2023-10-08T13:01:34.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.0.service' 2023-10-08T13:01:34.655 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:34.655 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-08T13:01:34.655 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-08T13:01:34.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.1 2023-10-08T13:01:35.012 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 13:01:34 smithi092 systemd[1]: Stopping Ceph osd.1 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:35.377 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 13:01:35 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-1[140323]: 2023-10-08T13:01:35.010+0000 7fb57fc25700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:35.377 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 13:01:35 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-1[140323]: 2023-10-08T13:01:35.010+0000 7fb57fc25700 -1 osd.1 117 *** Got signal Terminated *** 2023-10-08T13:01:35.377 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 13:01:35 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-1[140323]: 2023-10-08T13:01:35.010+0000 7fb57fc25700 -1 osd.1 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:01:40.877 INFO:journalctl@ceph.osd.1.smithi092.stdout:Oct 08 13:01:40 smithi092 bash[179847]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-1 2023-10-08T13:01:42.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.1.service' 2023-10-08T13:01:42.400 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:42.400 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-08T13:01:42.400 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-08T13:01:42.401 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.2 2023-10-08T13:01:42.718 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 13:01:42 smithi173 systemd[1]: Stopping Ceph osd.2 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:43.218 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 13:01:42 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-2[142189]: 2023-10-08T13:01:42.770+0000 7f2a22fca700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:43.218 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 13:01:42 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-2[142189]: 2023-10-08T13:01:42.770+0000 7f2a22fca700 -1 osd.2 117 *** Got signal Terminated *** 2023-10-08T13:01:43.218 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 13:01:42 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-2[142189]: 2023-10-08T13:01:42.770+0000 7f2a22fca700 -1 osd.2 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:01:48.718 INFO:journalctl@ceph.osd.2.smithi173.stdout:Oct 08 13:01:48 smithi173 bash[180775]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-2 2023-10-08T13:01:50.103 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.2.service' 2023-10-08T13:01:50.143 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:50.144 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-08T13:01:50.144 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-08T13:01:50.144 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.3 2023-10-08T13:01:50.515 INFO:journalctl@ceph.osd.3.smithi059.stdout:Oct 08 13:01:50 smithi059 systemd[1]: Stopping Ceph osd.3 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:51.015 INFO:journalctl@ceph.osd.3.smithi059.stdout:Oct 08 13:01:50 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-3[131406]: 2023-10-08T13:01:50.668+0000 7f13a6664700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:51.015 INFO:journalctl@ceph.osd.3.smithi059.stdout:Oct 08 13:01:50 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-3[131406]: 2023-10-08T13:01:50.668+0000 7f13a6664700 -1 osd.3 117 *** Got signal Terminated *** 2023-10-08T13:01:51.015 INFO:journalctl@ceph.osd.3.smithi059.stdout:Oct 08 13:01:50 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-3[131406]: 2023-10-08T13:01:50.668+0000 7f13a6664700 -1 osd.3 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:01:53.487 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:01:53 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:01:53.078+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:01:53.765 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:01:53 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:01:53.485+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:01:53.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:01:53 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:01:53.509+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:01:54.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:01:54 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:01:54.051+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:01:54.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:01:54 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:01:54.469+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:01:55.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:01:54 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:01:54.531+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:01:55.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:01:54 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:01:54.836+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:01:55.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:01:55 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:01:55.092+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:01:55.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:01:55 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:01:55.477+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:01:56.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:01:55 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:01:55.534+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:01:56.217 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:01:55 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:01:55.795+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:01:56.514 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:01:56 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:01:56.115+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:01:56.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:01:56 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:01:56.430+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:01:57.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:01:56 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:01:56.551+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:01:57.015 INFO:journalctl@ceph.osd.3.smithi059.stdout:Oct 08 13:01:56 smithi059 bash[189243]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-3 2023-10-08T13:01:57.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:01:56 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:01:56.828+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:01:57.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:01:57 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:01:57.101+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:01:57.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:01:57 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:01:57.469+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:01:58.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:01:57 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:01:57.586+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:01:58.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:01:57 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:01:57.854+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:01:58.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:01:58 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:01:58.013+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:01:58.312 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:01:58 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:01:58.060+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:01:58.675 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.3.service' 2023-10-08T13:01:58.766 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:58.767 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-08T13:01:58.767 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-08T13:01:58.767 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.4 2023-10-08T13:01:58.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:01:58 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:01:58.473+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:01:59.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:01:58 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:01:58.613+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:01:59.121 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 08 13:01:58 smithi092 systemd[1]: Stopping Ceph osd.4 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:59.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:01:58 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:01:58.837+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:01:59.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:01:58 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:01:58.984+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:01:59.377 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 08 13:01:59 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-4[148962]: 2023-10-08T13:01:59.121+0000 7fd5efa87700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:59.377 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 08 13:01:59 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-4[148962]: 2023-10-08T13:01:59.121+0000 7fd5efa87700 -1 osd.4 117 *** Got signal Terminated *** 2023-10-08T13:01:59.377 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 08 13:01:59 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-4[148962]: 2023-10-08T13:01:59.121+0000 7fd5efa87700 -1 osd.4 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:01:59.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:01:59 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:01:59.098+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:01:59.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:01:59 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:01:59.472+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:00.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:01:59 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:01:59.625+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:00.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:01:59 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:01:59.853+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:00.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:01:59 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:01:59.949+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:00.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:00 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:00.098+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:00.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:00 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:00.450+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:01.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:00 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:00.601+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:01.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:00 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:00.961+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:01.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:00 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:00.900+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:01.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:01 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:01.142+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:01.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:01 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:01.439+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:01.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:01 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:01.439+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:02.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:01 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:01.635+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:02.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:01 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:01.902+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:02.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:01 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:01.902+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:02.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:01 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:01.937+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:02.219 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:01 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:01.937+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.222392+0000 front 2023-10-08T13:01:37.222264+0000 (oldest deadline 2023-10-08T13:02:01.822900+0000) 2023-10-08T13:02:02.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:02 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:02.178+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:02.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:02 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:02.178+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:02.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:02 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:02.471+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:02.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:02 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:02.471+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:03.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:02 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:02.592+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:03.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:02 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:02.592+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:03.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:02 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:02.918+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:03.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:02 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:02.918+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:03.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:02 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:02.957+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:03.219 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:02 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:02.957+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.222392+0000 front 2023-10-08T13:01:37.222264+0000 (oldest deadline 2023-10-08T13:02:01.822900+0000) 2023-10-08T13:02:03.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:03 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:03.186+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:03.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:03 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:03.186+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:03.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:03 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:03.562+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:03.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:03 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:03.489+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:03.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:03 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:03.489+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:04.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:03 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:03.592+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:04.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:03 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:03.592+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:04.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:03 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:03.985+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:04.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:03 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:03.985+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.222392+0000 front 2023-10-08T13:01:37.222264+0000 (oldest deadline 2023-10-08T13:02:01.822900+0000) 2023-10-08T13:02:04.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:03 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:03.871+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:04.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:03 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:03.871+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:04.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:04 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:04.160+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:04.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:04 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:04.160+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:04.797 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:04 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:04.532+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:04.798 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:04 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:04.488+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:04.798 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:04 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:04.488+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:04.949 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:04 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:04.692+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:04.950 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:04 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:04.916+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:04.950 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:04 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:04.916+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:05.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:04 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:04.636+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:05.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:04 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:04.636+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:05.127 INFO:journalctl@ceph.osd.4.smithi092.stdout:Oct 08 13:02:04 smithi092 bash[180107]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-4 2023-10-08T13:02:05.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:04 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:04.949+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:05.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:04 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:04.949+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.222392+0000 front 2023-10-08T13:01:37.222264+0000 (oldest deadline 2023-10-08T13:02:01.822900+0000) 2023-10-08T13:02:05.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:05 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:05.137+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:05.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:05 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:05.137+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:05.855 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:05 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:05.492+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:05.855 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:05 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:05.457+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:05.855 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:05 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:05.457+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:06.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:05 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:05.675+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:06.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:05 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:05.675+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:06.135 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.4.service' 2023-10-08T13:02:06.217 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:02:06.217 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-08T13:02:06.217 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-08T13:02:06.217 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.5 2023-10-08T13:02:06.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:05 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:05.719+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:06.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:05 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:05.936+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:06.219 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:05 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:05.936+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.222392+0000 front 2023-10-08T13:01:37.222264+0000 (oldest deadline 2023-10-08T13:02:01.822900+0000) 2023-10-08T13:02:06.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:05 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:05.935+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:06.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:05 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:05.935+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:06.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:06.154+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:06.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:06.154+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:06.584 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:06 smithi173 systemd[1]: Stopping Ceph osd.5 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:02:06.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:06 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:06.508+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:06.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:06 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:06.432+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:06.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:06 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:06.432+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:06.903 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:06 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:06.761+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:06.904 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:06 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:06.583+0000 7f8c0f60b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:02:06.904 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:06 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:06.583+0000 7f8c0f60b700 -1 osd.5 117 *** Got signal Terminated *** 2023-10-08T13:02:06.905 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:06 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:06.583+0000 7f8c0f60b700 -1 osd.5 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:02:07.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:06.663+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:07.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:06.663+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:07.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:06 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:06.921+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:07.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:06 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:06.921+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.222392+0000 front 2023-10-08T13:01:37.222264+0000 (oldest deadline 2023-10-08T13:02:01.822900+0000) 2023-10-08T13:02:07.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:06 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:06.903+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:07.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:06 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:06.903+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:07.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:07 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:07.191+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:07.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:07 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:07.191+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:07.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:07 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:07.534+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:07.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:07 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:07.469+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:07.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:07 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:07.469+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:08.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:07 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:07.663+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:08.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:07 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:07.663+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:08.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:07 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:07.737+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:08.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:07 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:07.915+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:08.219 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:07 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:07.915+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.222392+0000 front 2023-10-08T13:01:37.222264+0000 (oldest deadline 2023-10-08T13:02:01.822900+0000) 2023-10-08T13:02:08.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:07 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:07.910+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:08.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:07 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:07.910+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:08.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:08 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:08.213+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:08.533 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:08 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:08.213+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:08.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:08 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:08.511+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:08.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:08 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:08.457+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:08.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:08 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:08.457+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:09.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:08 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:08.676+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:09.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:08 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:08.676+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:09.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:08 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:08.676+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:09.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:08 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:08.767+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:09.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:08 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:08.889+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:09.219 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:08 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:08.889+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.222392+0000 front 2023-10-08T13:01:37.222264+0000 (oldest deadline 2023-10-08T13:02:01.822900+0000) 2023-10-08T13:02:09.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:08 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:08.895+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:09.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:08 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:08.895+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:09.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:09.174+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:09.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:09.174+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:09.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:09.174+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.033518+0000 front 2023-10-08T13:01:46.033617+0000 (oldest deadline 2023-10-08T13:02:08.933721+0000) 2023-10-08T13:02:09.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:09 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:09.531+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:09.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:09 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:09.428+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:09.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:09 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:09.428+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:10.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:09.696+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:10.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:09.696+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:10.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:09.696+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:10.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:09 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:09.777+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:10.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:09 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:09.843+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:10.218 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:09 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:09.843+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.222392+0000 front 2023-10-08T13:01:37.222264+0000 (oldest deadline 2023-10-08T13:02:01.822900+0000) 2023-10-08T13:02:10.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:09 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:09.883+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:10.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:09 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:09.883+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:10.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:09 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:09.883+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:10.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:10 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:10.130+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:10.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:10 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:10.130+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:10.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:10 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:10.130+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.033518+0000 front 2023-10-08T13:01:46.033617+0000 (oldest deadline 2023-10-08T13:02:08.933721+0000) 2023-10-08T13:02:10.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:10 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:10.483+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:10.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:10 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:10.483+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:10.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:10 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:10.405+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:10.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:10 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:10.405+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:10.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:10 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:10.405+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:11.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:10 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:10.679+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:11.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:10 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:10.679+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:11.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:10 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:10.679+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:11.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:10 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:10.779+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:11.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:10 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:10.779+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:11.219 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:10 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:10.879+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:31.321890+0000 front 2023-10-08T13:01:31.321872+0000 (oldest deadline 2023-10-08T13:01:57.221766+0000) 2023-10-08T13:02:11.219 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:10 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:10.879+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.222392+0000 front 2023-10-08T13:01:37.222264+0000 (oldest deadline 2023-10-08T13:02:01.822900+0000) 2023-10-08T13:02:11.219 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:10 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5[150124]: 2023-10-08T13:02:10.879+0000 7f8c0bc01700 -1 osd.5 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:45.824402+0000 front 2023-10-08T13:01:45.824437+0000 (oldest deadline 2023-10-08T13:02:09.924656+0000) 2023-10-08T13:02:11.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:10 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:10.879+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:11.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:10 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:10.879+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:11.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:10 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:10.879+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:11.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:11 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:11.167+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:11.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:11 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:11.167+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:11.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:11 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:11.167+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.033518+0000 front 2023-10-08T13:01:46.033617+0000 (oldest deadline 2023-10-08T13:02:08.933721+0000) 2023-10-08T13:02:11.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:11 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:11.533+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:11.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:11 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:11.533+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:11.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:11 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:11.451+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:11.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:11 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:11.451+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:11.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:11 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:11.451+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:12.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:11 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:11.630+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:12.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:11 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:11.630+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:12.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:11 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:11.630+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:12.203 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:11 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:11.815+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:12.203 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:11 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:11.815+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:12.203 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:11 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:11.864+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:12.204 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:11 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:11.864+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:12.204 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:11 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:11.864+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:12.456 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:12 smithi173 bash[181042]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-5 2023-10-08T13:02:12.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:12 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:12.141+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:12.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:12 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:12.141+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:12.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:12 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:12.141+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.033518+0000 front 2023-10-08T13:01:46.033617+0000 (oldest deadline 2023-10-08T13:02:08.933721+0000) 2023-10-08T13:02:12.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:12 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:12.515+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:12.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:12 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:12.515+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:12.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:12 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:12.461+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:12.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:12 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:12.461+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:12.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:12 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:12.461+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:13.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:12 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:12.584+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:13.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:12 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:12.584+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:13.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:12 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:12.584+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:13.038 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:12 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:12.786+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:13.038 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:12 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:12.786+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:13.038 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:12 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:12.870+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:13.039 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:12 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:12.870+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:13.039 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:12 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:12.870+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:13.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:13 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:13.115+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:13.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:13 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:13.115+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:13.516 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:13 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:13.115+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.033518+0000 front 2023-10-08T13:01:46.033617+0000 (oldest deadline 2023-10-08T13:02:08.933721+0000) 2023-10-08T13:02:13.618 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.5.service' 2023-10-08T13:02:13.644 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:13 smithi173 systemd[1]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.5.service: Succeeded. 2023-10-08T13:02:13.645 INFO:journalctl@ceph.osd.5.smithi173.stdout:Oct 08 13:02:13 smithi173 systemd[1]: Stopped Ceph osd.5 for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T13:02:13.658 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:02:13.659 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-08T13:02:13.659 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-08T13:02:13.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.6 2023-10-08T13:02:13.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:13 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:13.556+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:13.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:13 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:13.556+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:13.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:13 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:13.425+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:13.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:13 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:13.425+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:13.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:13 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:13.425+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:13.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:13 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:13.756+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:13.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:13 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:13.756+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:13.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:13 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:13.835+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:13.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:13 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:13.835+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:13.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:13 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:13.835+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:14.015 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:13 smithi059 systemd[1]: Stopping Ceph osd.6 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:02:14.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:13 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:13.555+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:14.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:13 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:13.555+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:14.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:13 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:13.555+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:14.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:14.122+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:14.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:14.122+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:14.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:14.122+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.033518+0000 front 2023-10-08T13:01:46.033617+0000 (oldest deadline 2023-10-08T13:02:08.933721+0000) 2023-10-08T13:02:14.516 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:14.190+0000 7f32a13df700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:02:14.516 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:14.190+0000 7f32a13df700 -1 osd.6 117 *** Got signal Terminated *** 2023-10-08T13:02:14.516 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:14.190+0000 7f32a13df700 -1 osd.6 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:02:14.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:14 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:14.588+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:14.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:14 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:14.588+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:14.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:14 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:14.460+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:14.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:14 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:14.460+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:14.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:14 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:14.460+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:15.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:14.605+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:15.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:14.605+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:15.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:14 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:14.605+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:15.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:14 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:14.751+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:15.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:14 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:14.751+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:15.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:14 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:14.787+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:15.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:14 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:14.787+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:15.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:14 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:14.787+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:15.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:15 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:15.090+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:15.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:15 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:15.090+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:15.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:15 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:15.090+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.033518+0000 front 2023-10-08T13:01:46.033617+0000 (oldest deadline 2023-10-08T13:02:08.933721+0000) 2023-10-08T13:02:15.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:15 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:15.617+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:15.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:15 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:15.617+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:15.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:15 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:15.454+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:15.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:15 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:15.454+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:15.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:15 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:15.454+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:16.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:15 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:15.587+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:16.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:15 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:15.587+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:16.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:15 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:15.587+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:16.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:15 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:15.768+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:16.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:15 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:15.768+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:16.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:15 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:15.809+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:16.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:15 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:15.809+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:16.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:15 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:15.809+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:16.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:16 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:16.051+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:16.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:16 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:16.051+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:16.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:16 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:16.051+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.033518+0000 front 2023-10-08T13:01:46.033617+0000 (oldest deadline 2023-10-08T13:02:08.933721+0000) 2023-10-08T13:02:16.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:16 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:16.653+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:16.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:16 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:16.653+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:16.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:16 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:16.483+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:16.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:16 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:16.483+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:16.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:16 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:16.483+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:17.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:16 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:16.563+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:17.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:16 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:16.563+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:17.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:16 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:16.563+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:17.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:16 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:16.728+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:17.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:16 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:16.728+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:17.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:16 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:16.796+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:17.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:16 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:16.796+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:17.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:16 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:16.796+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:17.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:16 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:16.796+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:17.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:17 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:17.014+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:17.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:17 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:17.014+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:17.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:17 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:17.014+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.033518+0000 front 2023-10-08T13:01:46.033617+0000 (oldest deadline 2023-10-08T13:02:08.933721+0000) 2023-10-08T13:02:17.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:17 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:17.014+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:55.336347+0000 front 2023-10-08T13:01:55.336273+0000 (oldest deadline 2023-10-08T13:02:16.436279+0000) 2023-10-08T13:02:17.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:17 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:17.623+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:17.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:17 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:17.623+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:17.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:17 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:17.512+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:17.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:17 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:17.512+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:17.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:17 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:17.512+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:17.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:17 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:17.682+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:17.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:17 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:17.682+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:17.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:17 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:17.814+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:17.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:17 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:17.814+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:17.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:17 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:17.814+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:17.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:17 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:17.814+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:18.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:17 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:17.600+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:18.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:17 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:17.600+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:18.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:17 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:17.600+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:18.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:18 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:18.054+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:18.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:18 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:18.054+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:18.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:18 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:18.054+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.033518+0000 front 2023-10-08T13:01:46.033617+0000 (oldest deadline 2023-10-08T13:02:08.933721+0000) 2023-10-08T13:02:18.516 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:18 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:18.054+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:55.336347+0000 front 2023-10-08T13:01:55.336273+0000 (oldest deadline 2023-10-08T13:02:16.436279+0000) 2023-10-08T13:02:18.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:18 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:18.498+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:18.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:18 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:18.498+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:18.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:18 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:18.498+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:18.878 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:18 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:18.583+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:18.878 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:18 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:18.583+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:18.878 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:18 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:18.583+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.221139+0000 front 2023-10-08T13:01:53.221091+0000 (oldest deadline 2023-10-08T13:02:18.521066+0000) 2023-10-08T13:02:18.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:18 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:18.642+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:18.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:18 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:18.642+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:18.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:18 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:18.782+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:18.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:18 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:18.782+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:18.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:18 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:18.782+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:18.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:18 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:18.782+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:19.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:18 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:18.640+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:19.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:18 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:18.640+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:19.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:18 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:18.640+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:19.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:19 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:19.037+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.227047+0000 front 2023-10-08T13:01:28.227138+0000 (oldest deadline 2023-10-08T13:01:52.228160+0000) 2023-10-08T13:02:19.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:19 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:19.037+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.431508+0000 front 2023-10-08T13:01:38.431476+0000 (oldest deadline 2023-10-08T13:02:01.931686+0000) 2023-10-08T13:02:19.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:19 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:19.037+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.033518+0000 front 2023-10-08T13:01:46.033617+0000 (oldest deadline 2023-10-08T13:02:08.933721+0000) 2023-10-08T13:02:19.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:19 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6[139446]: 2023-10-08T13:02:19.037+0000 7f329b1d0700 -1 osd.6 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:55.336347+0000 front 2023-10-08T13:01:55.336273+0000 (oldest deadline 2023-10-08T13:02:16.436279+0000) 2023-10-08T13:02:19.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:19 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:19.607+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:19.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:19 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:19.607+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:19.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:19 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:19.607+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.221139+0000 front 2023-10-08T13:01:53.221091+0000 (oldest deadline 2023-10-08T13:02:18.521066+0000) 2023-10-08T13:02:19.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:19 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:19.507+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:19.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:19 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:19.507+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:19.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:19 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:19.507+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:19.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:19 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:19.507+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:19.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:19 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:19.597+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:19.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:19 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:19.597+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:19.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:19 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:19.597+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:19.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:19 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:19.745+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:19.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:19 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:19.745+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:19.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:19 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:19.745+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:19.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:19 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:19.745+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:20.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:19 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:19.631+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:20.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:19 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:19.631+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:20.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:19 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:19.631+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:20.515 INFO:journalctl@ceph.osd.6.smithi059.stdout:Oct 08 13:02:20 smithi059 bash[189514]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-6 2023-10-08T13:02:20.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:20 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:20.648+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:20.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:20 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:20.648+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:20.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:20 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:20.648+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.221139+0000 front 2023-10-08T13:01:53.221091+0000 (oldest deadline 2023-10-08T13:02:18.521066+0000) 2023-10-08T13:02:20.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:20 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:20.471+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:20.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:20 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:20.471+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:20.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:20 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:20.471+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:20.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:20 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:20.471+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:20.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:20 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:20.629+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:20.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:20 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:20.629+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:20.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:20 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:20.629+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:20.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:20 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:20.696+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:20.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:20 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:20.696+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:20.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:20 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:20.696+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:20.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:20 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:20.696+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:21.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:20 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:20.662+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:21.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:20 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:20.662+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:21.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:20 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:20.662+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:21.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:21 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:21.634+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:21.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:21 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:21.634+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:21.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:21 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:21.634+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.221139+0000 front 2023-10-08T13:01:53.221091+0000 (oldest deadline 2023-10-08T13:02:18.521066+0000) 2023-10-08T13:02:21.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:21 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:21.466+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:21.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:21 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:21.466+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:21.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:21 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:21.466+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:21.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:21 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:21.466+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:21.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:21 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:21.594+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:21.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:21 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:21.594+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:21.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:21 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:21.594+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:21.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:21 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:21.710+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:21.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:21 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:21.710+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:21.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:21 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:21.710+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:21.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:21 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:21.710+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:22.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:21 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:21.619+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:22.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:21 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:21.619+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:22.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:21 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:21.619+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:22.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:21 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:21.619+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:22.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.6.service' 2023-10-08T13:02:22.294 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:02:22.294 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-08T13:02:22.295 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-08T13:02:22.295 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.7 2023-10-08T13:02:22.627 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:22 smithi092 systemd[1]: Stopping Ceph osd.7 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:02:22.627 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:22 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:22.512+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:22.628 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:22 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:22.512+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:22.628 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:22 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:22.512+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:22.628 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:22 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:22.512+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:22.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:22.637+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:22.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:22.637+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:22.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:22.637+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:22.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:22.735+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:22.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:22.735+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:22.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:22.735+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:22.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:22 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:22.735+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:23.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:22 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:22.570+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:23.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:22 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:22.570+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:23.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:22 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:22.570+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:23.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:22 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:22.570+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:23.127 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:22 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:22.648+0000 7fddf477c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:02:23.127 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:22 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:22.648+0000 7fddf477c700 -1 osd.7 117 *** Got signal Terminated *** 2023-10-08T13:02:23.128 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:22 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:22.648+0000 7fddf477c700 -1 osd.7 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:02:23.128 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:22 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:22.675+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:23.128 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:22 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:22.675+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:23.128 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:22 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:22.675+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.221139+0000 front 2023-10-08T13:01:53.221091+0000 (oldest deadline 2023-10-08T13:02:18.521066+0000) 2023-10-08T13:02:23.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:23 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:23.692+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:23.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:23 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:23.692+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:23.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:23 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:23.692+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.221139+0000 front 2023-10-08T13:01:53.221091+0000 (oldest deadline 2023-10-08T13:02:18.521066+0000) 2023-10-08T13:02:23.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:23 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:23.494+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:23.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:23 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:23.494+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:23.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:23 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:23.494+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:23.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:23 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:23.494+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:23.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:23.664+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:23.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:23.664+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:23.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:23.664+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:23.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:23.781+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:23.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:23.781+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:23.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:23.781+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:23.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:23 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:23.781+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:24.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:23 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:23.602+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:24.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:23 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:23.602+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:24.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:23 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:23.602+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:24.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:23 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:23.602+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:24.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:24.701+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:24.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:24.701+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:24.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:24.701+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.221139+0000 front 2023-10-08T13:01:53.221091+0000 (oldest deadline 2023-10-08T13:02:18.521066+0000) 2023-10-08T13:02:24.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:24.470+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:24.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:24.470+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:24.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:24.470+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:24.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:24 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:24.470+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:24.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:24 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:24.623+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:24.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:24 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:24.623+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:24.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:24 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:24.623+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:24.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:24 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:24.768+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:24.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:24 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:24.768+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:24.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:24 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:24.768+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:24.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:24 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:24.768+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:25.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:24 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:24.621+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:25.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:24 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:24.621+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:25.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:24 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:24.621+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:25.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:24 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:24.621+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:25.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:25.682+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:25.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:25.682+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:25.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:25.682+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.221139+0000 front 2023-10-08T13:01:53.221091+0000 (oldest deadline 2023-10-08T13:02:18.521066+0000) 2023-10-08T13:02:25.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:25.682+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:01.422101+0000 front 2023-10-08T13:02:01.422164+0000 (oldest deadline 2023-10-08T13:02:24.922211+0000) 2023-10-08T13:02:25.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:25.482+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:25.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:25.482+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:25.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:25.482+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:25.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:25.482+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:25.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:25 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:25.612+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:25.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:25 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:25.612+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:25.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:25 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:25.612+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:25.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:25 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:25.793+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:25.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:25 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:25.793+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:25.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:25 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:25.793+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:25.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:25 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:25.793+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:26.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:25 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:25.653+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:26.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:25 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:25.653+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:26.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:25 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:25.653+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:26.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:25 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:25.653+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:26.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:26 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:26.691+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:39.317746+0000 front 2023-10-08T13:01:39.317780+0000 (oldest deadline 2023-10-08T13:02:02.818022+0000) 2023-10-08T13:02:26.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:26 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:26.691+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.419466+0000 front 2023-10-08T13:01:47.419572+0000 (oldest deadline 2023-10-08T13:02:10.319593+0000) 2023-10-08T13:02:26.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:26 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:26.691+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.221139+0000 front 2023-10-08T13:01:53.221091+0000 (oldest deadline 2023-10-08T13:02:18.521066+0000) 2023-10-08T13:02:26.877 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:26 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7[157719]: 2023-10-08T13:02:26.691+0000 7fdded56b700 -1 osd.7 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:01.422101+0000 front 2023-10-08T13:02:01.422164+0000 (oldest deadline 2023-10-08T13:02:24.922211+0000) 2023-10-08T13:02:26.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:26 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:26.457+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:26.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:26 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:26.457+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:26.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:26 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:26.457+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:26.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:26 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:26.457+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:26.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:26 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:26.589+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:26.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:26 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:26.589+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:26.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:26 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:26.589+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:26.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:26 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:26.589+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:01.454638+0000 front 2023-10-08T13:02:01.454529+0000 (oldest deadline 2023-10-08T13:02:26.154563+0000) 2023-10-08T13:02:26.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:26 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:26.839+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:26.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:26 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:26.839+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:26.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:26 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:26.839+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:26.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:26 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:26.839+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:27.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:26 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:26.636+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:27.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:26 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:26.636+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:27.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:26 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:26.636+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:27.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:26 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:26.636+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:27.825 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:27.548+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:27.825 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:27.548+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:27.826 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:27.548+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:27.826 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:27.548+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:01.454638+0000 front 2023-10-08T13:02:01.454529+0000 (oldest deadline 2023-10-08T13:02:26.154563+0000) 2023-10-08T13:02:27.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:27 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:27.507+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:27.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:27 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:27.507+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:27.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:27 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:27.507+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:27.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:27 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:27.507+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:28.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:27 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:27.612+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:28.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:27 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:27.612+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:28.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:27 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:27.612+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:28.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:27 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:27.612+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:28.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:27.825+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:28.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:27.825+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:28.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:27.825+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:28.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:27 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:27.825+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:28.533 INFO:journalctl@ceph.osd.7.smithi092.stdout:Oct 08 13:02:28 smithi092 bash[180375]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-7 2023-10-08T13:02:28.533 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:28 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:28.493+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:28.533 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:28 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:28.493+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:28.534 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:28 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:28.493+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:28.534 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:28 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:28.493+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:28.534 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:28 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:28.493+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:28.862 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:28 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:28.577+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:28.862 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:28 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:28.577+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:28.862 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:28 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:28.577+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:28.862 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:28 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:28.577+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:01.454638+0000 front 2023-10-08T13:02:01.454529+0000 (oldest deadline 2023-10-08T13:02:26.154563+0000) 2023-10-08T13:02:29.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:28 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:28.646+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:29.040 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:28 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:28.646+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:29.041 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:28 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:28.646+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:29.041 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:28 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:28.646+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:29.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:28 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:28.860+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:29.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:28 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:28.860+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:29.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:28 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:28.860+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:29.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:28 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:28.860+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:29.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:28 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:28.860+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:29.786 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:29 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:29.538+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:29.786 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:29 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:29.538+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:29.786 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:29 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:29.538+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:29.786 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:29 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:29.538+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:29.786 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:29 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:29.538+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:29.793 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.7.service' 2023-10-08T13:02:29.833 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:02:29.834 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-08T13:02:29.834 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-08T13:02:29.834 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.8 2023-10-08T13:02:29.865 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:29 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:29.608+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:29.866 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:29 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:29.608+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:29.866 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:29 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:29.608+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:29.866 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:29 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:29.608+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:01.454638+0000 front 2023-10-08T13:02:01.454529+0000 (oldest deadline 2023-10-08T13:02:26.154563+0000) 2023-10-08T13:02:30.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:29 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:29.668+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:30.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:29 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:29.668+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:30.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:29 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:29.668+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:30.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:29 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:29.668+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:30.197 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:29 smithi173 systemd[1]: Stopping Ceph osd.8 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:02:30.197 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:29 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:29.872+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:30.197 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:29 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:29.872+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:30.197 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:29 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:29.872+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:30.198 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:29 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:29.872+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:30.198 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:29 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:29.872+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:30.468 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:30.195+0000 7f40aa528700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:02:30.468 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:30.195+0000 7f40aa528700 -1 osd.8 117 *** Got signal Terminated *** 2023-10-08T13:02:30.468 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:30.195+0000 7f40aa528700 -1 osd.8 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:02:30.867 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:30.566+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:30.868 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:30.566+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:30.868 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:30.566+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:30.868 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:30.566+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:01.454638+0000 front 2023-10-08T13:02:01.454529+0000 (oldest deadline 2023-10-08T13:02:26.154563+0000) 2023-10-08T13:02:30.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:30 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:30.567+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:30.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:30 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:30.567+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:30.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:30 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:30.567+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:30.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:30 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:30.567+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:30.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:30 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:30.567+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:31.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:30 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:30.624+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:31.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:30 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:30.624+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:31.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:30 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:30.624+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:31.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:30 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:30.624+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:31.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:30.866+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:31.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:30.866+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:31.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:30.866+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:31.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:30.866+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:31.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:30.866+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:31.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:31 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:31.591+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:31.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:31 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:31.591+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:31.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:31 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:31.591+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:31.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:31 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:31.591+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:31.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:31 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:31.591+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:31.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:31 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:31.612+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:31.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:31 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:31.612+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:31.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:31 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:31.612+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:31.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:31 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:31.612+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:01.454638+0000 front 2023-10-08T13:02:01.454529+0000 (oldest deadline 2023-10-08T13:02:26.154563+0000) 2023-10-08T13:02:31.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:31 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:31.849+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:31.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:31 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:31.849+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:31.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:31 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:31.849+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:31.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:31 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:31.849+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:31.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:31 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:31.849+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:32.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:31 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:31.651+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:32.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:31 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:31.651+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:32.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:31 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:31.651+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:32.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:31 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:31.651+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:32.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:32 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:32.559+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:32.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:32 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:32.559+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:32.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:32 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:32.559+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:32.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:32 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:32.559+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:32.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:32 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:32.559+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:32.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:32 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:32.657+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:32.968 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:32 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:32.657+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:32.969 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:32 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:32.657+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:32.969 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:32 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:32.657+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:01.454638+0000 front 2023-10-08T13:02:01.454529+0000 (oldest deadline 2023-10-08T13:02:26.154563+0000) 2023-10-08T13:02:32.970 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:32 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:32.899+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:32.970 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:32 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:32.899+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:32.970 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:32 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:32.899+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:32.970 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:32 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:32.899+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:32.971 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:32 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:32.899+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:33.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:32 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:32.689+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:33.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:32 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:32.689+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:33.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:32 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:32.689+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:33.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:32 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:32.689+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:33.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:33 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:33.596+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:33.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:33 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:33.596+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:33.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:33 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:33.596+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:33.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:33 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:33.596+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:33.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:33 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:33.596+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:33.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:33 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:33.596+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:33.916 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:33 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:33.639+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:33.917 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:33 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:33.639+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:33.917 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:33 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:33.639+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:33.917 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:33 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:33.639+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:01.454638+0000 front 2023-10-08T13:02:01.454529+0000 (oldest deadline 2023-10-08T13:02:26.154563+0000) 2023-10-08T13:02:33.917 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:33 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:33.639+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:10.255394+0000 front 2023-10-08T13:02:10.255480+0000 (oldest deadline 2023-10-08T13:02:33.056269+0000) 2023-10-08T13:02:34.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:33 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:33.689+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:34.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:33 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:33.689+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:34.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:33 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:33.689+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:34.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:33 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:33.689+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:34.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:33 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:33.915+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:34.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:33 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:33.915+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:34.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:33 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:33.915+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:34.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:33 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:33.915+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:34.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:33 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:33.915+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:34.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:33 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:33.915+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:34.931 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:34 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:34.630+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.849359+0000 front 2023-10-08T13:01:38.849535+0000 (oldest deadline 2023-10-08T13:02:04.149497+0000) 2023-10-08T13:02:34.931 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:34 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:34.630+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:47.650854+0000 front 2023-10-08T13:01:47.650884+0000 (oldest deadline 2023-10-08T13:02:09.951066+0000) 2023-10-08T13:02:34.931 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:34 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:34.630+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.953106+0000 front 2023-10-08T13:01:53.953045+0000 (oldest deadline 2023-10-08T13:02:19.253029+0000) 2023-10-08T13:02:34.931 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:34 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:34.630+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:01.454638+0000 front 2023-10-08T13:02:01.454529+0000 (oldest deadline 2023-10-08T13:02:26.154563+0000) 2023-10-08T13:02:34.931 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:34 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8[158196]: 2023-10-08T13:02:34.630+0000 7f40a4b1a700 -1 osd.8 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:10.255394+0000 front 2023-10-08T13:02:10.255480+0000 (oldest deadline 2023-10-08T13:02:33.056269+0000) 2023-10-08T13:02:35.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:34 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:34.701+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:35.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:34 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:34.701+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:35.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:34 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:34.701+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:35.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:34 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:34.701+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:35.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:34 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:34.627+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:35.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:34 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:34.627+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:35.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:34 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:34.627+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:35.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:34 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:34.627+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:35.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:34 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:34.627+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:35.128 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:34 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:34.627+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:35.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:34 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:34.930+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:35.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:34 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:34.930+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:35.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:34 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:34.930+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:35.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:34 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:34.930+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:35.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:34 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:34.930+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:35.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:34 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:34.930+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:35.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:35 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:35.589+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:35.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:35 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:35.589+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:35.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:35 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:35.589+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:35.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:35 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:35.589+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:35.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:35 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:35.589+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:35.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:35 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:35.589+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:36.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:35.675+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:36.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:35.675+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:36.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:35.675+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:36.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:35.675+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:36.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:35 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:35.675+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:11.212896+0000 front 2023-10-08T13:02:11.212870+0000 (oldest deadline 2023-10-08T13:02:34.713051+0000) 2023-10-08T13:02:36.218 INFO:journalctl@ceph.osd.8.smithi173.stdout:Oct 08 13:02:35 smithi173 bash[181312]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-8 2023-10-08T13:02:36.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:35 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:35.895+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:36.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:35 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:35.895+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:36.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:35 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:35.895+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:36.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:35 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:35.895+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:36.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:35 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:35.895+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:36.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:35 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:35.895+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:36.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:36 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:36.597+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:36.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:36 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:36.597+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:36.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:36 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:36.597+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:36.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:36 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:36.597+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:36.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:36 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:36.597+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:36.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:36 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:36.597+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:37.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:36 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:36.707+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:37.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:36 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:36.707+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:37.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:36 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:36.707+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:37.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:36 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:36.707+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:37.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:36 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:36.707+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:11.212896+0000 front 2023-10-08T13:02:11.212870+0000 (oldest deadline 2023-10-08T13:02:34.713051+0000) 2023-10-08T13:02:37.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:36 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:36.855+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:37.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:36 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:36.855+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:37.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:36 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:36.855+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:37.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:36 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:36.855+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:37.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:36 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:36.855+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:37.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:36 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:36.855+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:37.337 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.8.service' 2023-10-08T13:02:37.415 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:02:37.416 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-08T13:02:37.416 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-08T13:02:37.416 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.9 2023-10-08T13:02:37.765 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:37 smithi059 systemd[1]: Stopping Ceph osd.9 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:02:37.765 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:37 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:37.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:37.765 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:37 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:37.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:37.765 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:37 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:37.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:37.766 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:37 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:37.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:37.766 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:37 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:37.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:11.212896+0000 front 2023-10-08T13:02:11.212870+0000 (oldest deadline 2023-10-08T13:02:34.713051+0000) 2023-10-08T13:02:38.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:37 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:37.636+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:38.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:37 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:37.636+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:38.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:37 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:37.636+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:38.128 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:37 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:37.636+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:38.128 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:37 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:37.636+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:38.128 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:37 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:37.636+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:38.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:37 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:37.900+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:38.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:37 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:37.900+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:38.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:37 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:37.900+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:38.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:37 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:37.900+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:38.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:37 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:37.900+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:38.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:37 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:37.900+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:38.265 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:37 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:37.936+0000 7f4987311700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:02:38.265 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:37 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:37.936+0000 7f4987311700 -1 osd.9 117 *** Got signal Terminated *** 2023-10-08T13:02:38.265 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:37 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:37.936+0000 7f4987311700 -1 osd.9 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:02:38.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:38 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:38.592+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:38.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:38 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:38.592+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:38.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:38 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:38.592+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:38.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:38 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:38.592+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:38.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:38 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:38.592+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:38.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:38 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:38.592+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:39.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:38 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:38.680+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:39.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:38 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:38.680+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:39.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:38 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:38.680+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:39.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:38 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:38.680+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:39.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:38 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:38.680+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:11.212896+0000 front 2023-10-08T13:02:11.212870+0000 (oldest deadline 2023-10-08T13:02:34.713051+0000) 2023-10-08T13:02:39.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:38 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:38.945+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:39.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:38 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:38.945+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:39.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:38 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:38.945+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:39.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:38 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:38.945+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:39.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:38 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:38.945+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:39.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:38 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:38.945+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:39.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:39 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:39.555+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:39.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:39 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:39.555+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:39.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:39 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:39.555+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:39.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:39 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:39.555+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:39.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:39 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:39.555+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:39.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:39 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:39.555+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:40.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:39 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:39.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:40.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:39 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:39.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:40.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:39 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:39.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:40.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:39 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:39.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:40.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:39 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:39.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:11.212896+0000 front 2023-10-08T13:02:11.212870+0000 (oldest deadline 2023-10-08T13:02:34.713051+0000) 2023-10-08T13:02:40.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:39 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:39.935+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:40.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:39 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:39.935+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:40.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:39 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:39.935+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:40.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:39 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:39.935+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:40.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:39 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:39.935+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:40.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:39 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:39.935+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:40.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:40 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:40.588+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:40.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:40 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:40.588+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:40.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:40 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:40.588+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:40.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:40 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:40.588+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:40.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:40 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:40.588+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:40.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:40 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:40.588+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:41.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:40 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:40.718+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:41.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:40 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:40.718+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:41.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:40 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:40.718+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:41.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:40 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:40.718+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:41.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:40 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:40.718+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:11.212896+0000 front 2023-10-08T13:02:11.212870+0000 (oldest deadline 2023-10-08T13:02:34.713051+0000) 2023-10-08T13:02:41.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:40 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:40.917+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:41.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:40 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:40.917+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:41.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:40 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:40.917+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:41.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:40 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:40.918+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:41.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:40 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:40.918+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:41.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:40 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:40.918+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:41.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:41 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:41.552+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:41.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:41 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:41.552+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:41.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:41 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:41.552+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:41.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:41 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:41.552+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:41.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:41 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:41.552+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:41.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:41 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:41.552+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:42.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:41 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:41.690+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:42.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:41 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:41.690+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:42.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:41 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:41.690+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:42.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:41 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:41.690+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:42.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:41 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:41.690+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:11.212896+0000 front 2023-10-08T13:02:11.212870+0000 (oldest deadline 2023-10-08T13:02:34.713051+0000) 2023-10-08T13:02:42.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:41 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:41.875+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:42.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:41 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:41.875+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:42.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:41 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:41.875+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:42.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:41 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:41.875+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:42.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:41 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:41.875+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:42.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:41 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:41.875+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:42.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:42 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:42.596+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:42.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:42 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:42.596+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:42.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:42 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:42.596+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:42.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:42 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:42.596+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:42.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:42 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:42.597+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:42.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:42 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:42.597+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:42.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:42 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:42.597+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2023-10-08T13:02:13.305864+0000 front 2023-10-08T13:02:13.305965+0000 (oldest deadline 2023-10-08T13:02:42.106017+0000) 2023-10-08T13:02:43.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:42 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:42.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.102247+0000 front 2023-10-08T13:01:28.102288+0000 (oldest deadline 2023-10-08T13:01:53.402557+0000) 2023-10-08T13:02:43.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:42 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:42.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:37.503921+0000 front 2023-10-08T13:01:37.503987+0000 (oldest deadline 2023-10-08T13:02:02.203778+0000) 2023-10-08T13:02:43.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:42 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:42.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:42.204405+0000 front 2023-10-08T13:01:42.204689+0000 (oldest deadline 2023-10-08T13:02:08.605407+0000) 2023-10-08T13:02:43.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:42 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:42.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:50.307014+0000 front 2023-10-08T13:01:50.307044+0000 (oldest deadline 2023-10-08T13:02:20.908303+0000) 2023-10-08T13:02:43.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:42 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:42.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:11.212896+0000 front 2023-10-08T13:02:11.212870+0000 (oldest deadline 2023-10-08T13:02:34.713051+0000) 2023-10-08T13:02:43.016 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:42 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9[147376]: 2023-10-08T13:02:42.673+0000 7f4981903700 -1 osd.9 117 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2023-10-08T13:02:17.014433+0000 front 2023-10-08T13:02:17.014456+0000 (oldest deadline 2023-10-08T13:02:42.314609+0000) 2023-10-08T13:02:43.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:42 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:42.835+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:43.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:42 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:42.835+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:43.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:42 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:42.835+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:43.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:42 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:42.835+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:43.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:42 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:42.835+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:43.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:42 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:42.835+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:43.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:43 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:43.587+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:43.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:43 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:43.587+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:43.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:43 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:43.587+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:43.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:43 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:43.587+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:43.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:43 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:43.587+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:43.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:43 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:43.587+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:43.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:43 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:43.587+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2023-10-08T13:02:13.305864+0000 front 2023-10-08T13:02:13.305965+0000 (oldest deadline 2023-10-08T13:02:42.106017+0000) 2023-10-08T13:02:44.015 INFO:journalctl@ceph.osd.9.smithi059.stdout:Oct 08 13:02:43 smithi059 bash[189792]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-9 2023-10-08T13:02:44.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:43 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:43.868+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:44.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:43 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:43.868+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:44.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:43 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:43.868+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:44.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:43 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:43.868+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:44.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:43 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:43.868+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:44.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:43 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:43.868+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:44.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:44 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:44.548+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:44.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:44 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:44.548+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:44.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:44 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:44.548+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:44.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:44 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:44.548+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:44.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:44 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:44.548+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:44.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:44 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:44.548+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:44.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:44 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:44.548+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2023-10-08T13:02:13.305864+0000 front 2023-10-08T13:02:13.305965+0000 (oldest deadline 2023-10-08T13:02:42.106017+0000) 2023-10-08T13:02:45.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:44 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:44.842+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:45.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:44 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:44.842+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:45.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:44 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:44.842+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:45.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:44 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:44.842+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:45.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:44 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:44.842+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:45.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:44 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:44.842+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:45.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.9.service' 2023-10-08T13:02:45.704 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:02:45.705 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-08T13:02:45.705 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-08T13:02:45.705 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.10 2023-10-08T13:02:45.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:45 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:45.558+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:45.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:45 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:45.558+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:45.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:45 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:45.558+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:45.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:45 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:45.558+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:45.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:45 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:45.558+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:45.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:45 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:45.558+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:45.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:45 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:45.558+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2023-10-08T13:02:13.305864+0000 front 2023-10-08T13:02:13.305965+0000 (oldest deadline 2023-10-08T13:02:42.106017+0000) 2023-10-08T13:02:45.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:45 smithi092 systemd[1]: Stopping Ceph osd.10 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:02:46.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:45 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:45.877+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:46.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:45 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:45.877+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:46.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:45 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:45.877+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:46.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:45 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:45.877+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:46.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:45 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:45.877+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:46.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:45 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:45.877+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:46.377 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:46 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:46.085+0000 7f1269bb3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:02:46.377 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:46 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:46.085+0000 7f1269bb3700 -1 osd.10 117 *** Got signal Terminated *** 2023-10-08T13:02:46.377 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:46 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:46.085+0000 7f1269bb3700 -1 osd.10 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:02:46.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:46 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:46.590+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:46.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:46 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:46.590+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:46.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:46 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:46.590+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:46.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:46 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:46.590+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:46.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:46 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:46.590+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:46.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:46 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:46.590+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:46.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:46 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:46.590+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2023-10-08T13:02:13.305864+0000 front 2023-10-08T13:02:13.305965+0000 (oldest deadline 2023-10-08T13:02:42.106017+0000) 2023-10-08T13:02:47.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:46 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:46.834+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:47.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:46 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:46.834+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:47.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:46 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:46.834+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:47.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:46 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:46.834+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:47.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:46 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:46.834+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:47.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:46 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:46.834+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:47.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:47 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:47.574+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:47.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:47 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:47.574+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:47.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:47 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:47.574+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:47.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:47 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:47.574+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:47.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:47 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:47.574+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:47.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:47 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:47.574+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:47.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:47 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:47.574+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2023-10-08T13:02:13.305864+0000 front 2023-10-08T13:02:13.305965+0000 (oldest deadline 2023-10-08T13:02:42.106017+0000) 2023-10-08T13:02:48.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:47 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:47.806+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:48.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:47 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:47.806+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:48.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:47 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:47.806+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:48.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:47 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:47.806+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:48.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:47 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:47.806+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:48.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:47 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:47.806+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:48.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:48 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:48.575+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:48.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:48 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:48.575+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:48.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:48 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:48.575+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:48.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:48 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:48.575+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:48.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:48 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:48.575+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:48.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:48 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:48.575+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:48.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:48 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:48.575+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2023-10-08T13:02:13.305864+0000 front 2023-10-08T13:02:13.305965+0000 (oldest deadline 2023-10-08T13:02:42.106017+0000) 2023-10-08T13:02:49.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:48 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:48.840+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:49.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:48 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:48.840+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:49.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:48 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:48.840+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:49.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:48 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:48.840+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:49.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:48 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:48.840+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:49.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:48 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:48.840+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:49.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:49 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:49.617+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:49.877 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:49 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:49.617+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:49.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:49 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:49.617+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:49.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:49 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:49.617+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:49.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:49 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:49.617+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:49.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:49 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:49.617+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:49.878 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:49 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:49.617+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2023-10-08T13:02:13.305864+0000 front 2023-10-08T13:02:13.305965+0000 (oldest deadline 2023-10-08T13:02:42.106017+0000) 2023-10-08T13:02:50.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:49 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:49.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:50.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:49 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:49.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:50.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:49 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:49.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:50.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:49 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:49.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:50.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:49 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:49.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:50.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:49 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:49.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:51.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:50 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:50.656+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.700229+0000 front 2023-10-08T13:01:28.700266+0000 (oldest deadline 2023-10-08T13:01:52.800315+0000) 2023-10-08T13:02:51.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:50 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:50.656+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:38.701342+0000 front 2023-10-08T13:01:38.701274+0000 (oldest deadline 2023-10-08T13:02:01.001474+0000) 2023-10-08T13:02:51.128 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:50 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:50.656+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:46.902422+0000 front 2023-10-08T13:01:46.902377+0000 (oldest deadline 2023-10-08T13:02:09.802421+0000) 2023-10-08T13:02:51.128 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:50 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:50.656+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:53.303723+0000 front 2023-10-08T13:01:53.303634+0000 (oldest deadline 2023-10-08T13:02:18.603735+0000) 2023-10-08T13:02:51.128 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:50 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:50.656+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.304817+0000 front 2023-10-08T13:02:03.304791+0000 (oldest deadline 2023-10-08T13:02:28.004870+0000) 2023-10-08T13:02:51.129 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:50 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:50.656+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.005462+0000 front 2023-10-08T13:02:08.005648+0000 (oldest deadline 2023-10-08T13:02:33.305291+0000) 2023-10-08T13:02:51.129 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:50 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10[166463]: 2023-10-08T13:02:50.656+0000 7f12621a1700 -1 osd.10 117 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2023-10-08T13:02:13.305864+0000 front 2023-10-08T13:02:13.305965+0000 (oldest deadline 2023-10-08T13:02:42.106017+0000) 2023-10-08T13:02:51.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:50 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:50.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:51.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:50 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:50.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:51.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:50 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:50.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:51.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:50 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:50.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:51.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:50 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:50.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:51.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:50 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:50.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:51.220 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:50 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:50.851+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-08T13:02:26.254469+0000 front 2023-10-08T13:02:26.254436+0000 (oldest deadline 2023-10-08T13:02:50.354309+0000) 2023-10-08T13:02:52.127 INFO:journalctl@ceph.osd.10.smithi092.stdout:Oct 08 13:02:51 smithi092 bash[180647]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-10 2023-10-08T13:02:52.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:51 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:51.824+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:52.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:51 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:51.824+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:52.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:51 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:51.824+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:52.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:51 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:51.824+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:52.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:51 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:51.824+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:52.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:51 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:51.824+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:52.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:51 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:51.824+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-08T13:02:26.254469+0000 front 2023-10-08T13:02:26.254436+0000 (oldest deadline 2023-10-08T13:02:50.354309+0000) 2023-10-08T13:02:53.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:52 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:52.820+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:53.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:52 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:52.820+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:53.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:52 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:52.820+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:53.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:52 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:52.820+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:53.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:52 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:52.820+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:53.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:52 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:52.820+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:53.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:52 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:52.820+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-08T13:02:26.254469+0000 front 2023-10-08T13:02:26.254436+0000 (oldest deadline 2023-10-08T13:02:50.354309+0000) 2023-10-08T13:02:53.294 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.10.service' 2023-10-08T13:02:53.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:02:53.334 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-08T13:02:53.335 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-08T13:02:53.335 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.11 2023-10-08T13:02:53.685 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:53 smithi173 systemd[1]: Stopping Ceph osd.11 for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:02:53.686 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:53 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:53.684+0000 7fbb333af700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:02:53.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:53 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:53.684+0000 7fbb333af700 -1 osd.11 117 *** Got signal Terminated *** 2023-10-08T13:02:53.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:53 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:53.684+0000 7fbb333af700 -1 osd.11 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:02:53.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:53 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:53.841+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:53.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:53 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:53.841+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:53.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:53 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:53.841+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:53.968 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:53 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:53.841+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:53.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:53 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:53.841+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:53.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:53 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:53.841+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:53.969 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:53 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:53.841+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-08T13:02:26.254469+0000 front 2023-10-08T13:02:26.254436+0000 (oldest deadline 2023-10-08T13:02:50.354309+0000) 2023-10-08T13:02:55.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:54 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:54.857+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:55.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:54 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:54.857+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:55.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:54 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:54.857+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:55.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:54 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:54.857+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:55.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:54 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:54.857+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:55.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:54 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:54.857+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:55.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:54 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:54.857+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-08T13:02:26.254469+0000 front 2023-10-08T13:02:26.254436+0000 (oldest deadline 2023-10-08T13:02:50.354309+0000) 2023-10-08T13:02:56.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:55 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:55.874+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:56.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:55 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:55.874+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:56.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:55 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:55.874+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:56.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:55 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:55.874+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:56.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:55 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:55.874+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:56.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:55 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:55.874+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:56.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:55 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:55.874+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-08T13:02:26.254469+0000 front 2023-10-08T13:02:26.254436+0000 (oldest deadline 2023-10-08T13:02:50.354309+0000) 2023-10-08T13:02:57.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:56 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:56.882+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:57.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:56 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:56.882+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:57.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:56 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:56.882+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:57.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:56 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:56.882+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:57.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:56 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:56.882+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:57.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:56 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:56.882+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:57.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:56 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:56.882+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-08T13:02:26.254469+0000 front 2023-10-08T13:02:26.254436+0000 (oldest deadline 2023-10-08T13:02:50.354309+0000) 2023-10-08T13:02:58.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:57 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:57.867+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2023-10-08T13:01:28.945503+0000 front 2023-10-08T13:01:28.945333+0000 (oldest deadline 2023-10-08T13:01:54.245381+0000) 2023-10-08T13:02:58.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:57 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:57.867+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2023-10-08T13:01:35.346977+0000 front 2023-10-08T13:01:35.346626+0000 (oldest deadline 2023-10-08T13:02:01.246709+0000) 2023-10-08T13:02:58.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:57 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:57.867+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2023-10-08T13:01:43.547863+0000 front 2023-10-08T13:01:43.547806+0000 (oldest deadline 2023-10-08T13:02:09.447916+0000) 2023-10-08T13:02:58.218 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:57 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:57.867+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2023-10-08T13:01:51.148967+0000 front 2023-10-08T13:01:51.148903+0000 (oldest deadline 2023-10-08T13:02:16.448979+0000) 2023-10-08T13:02:58.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:57 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:57.867+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2023-10-08T13:02:03.351899+0000 front 2023-10-08T13:02:03.351807+0000 (oldest deadline 2023-10-08T13:02:28.651886+0000) 2023-10-08T13:02:58.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:57 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:57.867+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2023-10-08T13:02:08.652277+0000 front 2023-10-08T13:02:08.652309+0000 (oldest deadline 2023-10-08T13:02:33.352311+0000) 2023-10-08T13:02:58.219 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:57 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:57.867+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2023-10-08T13:02:26.254469+0000 front 2023-10-08T13:02:26.254436+0000 (oldest deadline 2023-10-08T13:02:50.354309+0000) 2023-10-08T13:02:58.222 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:57 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11[166901]: 2023-10-08T13:02:57.867+0000 7fbb2c99f700 -1 osd.11 117 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2023-10-08T13:02:33.155755+0000 front 2023-10-08T13:02:33.155712+0000 (oldest deadline 2023-10-08T13:02:57.255708+0000) 2023-10-08T13:02:59.718 INFO:journalctl@ceph.osd.11.smithi173.stdout:Oct 08 13:02:59 smithi173 bash[181581]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-osd-11 2023-10-08T13:03:00.615 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@osd.11.service' 2023-10-08T13:03:00.655 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:00.655 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-08T13:03:00.655 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-08T13:03:00.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.a 2023-10-08T13:03:01.015 INFO:journalctl@ceph.mds.a.smithi059.stdout:Oct 08 13:03:00 smithi059 systemd[1]: Stopping Ceph mds.a for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:01.515 INFO:journalctl@ceph.mds.a.smithi059.stdout:Oct 08 13:03:01 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-a[155757]: 2023-10-08T13:03:01.176+0000 7fc9bc8b9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:01.515 INFO:journalctl@ceph.mds.a.smithi059.stdout:Oct 08 13:03:01 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-a[155757]: 2023-10-08T13:03:01.176+0000 7fc9bc8b9700 -1 mds.a *** got signal Terminated *** 2023-10-08T13:03:05.765 INFO:journalctl@ceph.mds.a.smithi059.stdout:Oct 08 13:03:05 smithi059 bash[190066]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-a 2023-10-08T13:03:05.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.a.service' 2023-10-08T13:03:05.917 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:05.918 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-08T13:03:05.918 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-08T13:03:05.918 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.d 2023-10-08T13:03:06.265 INFO:journalctl@ceph.mds.d.smithi059.stdout:Oct 08 13:03:06 smithi059 systemd[1]: Stopping Ceph mds.d for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:06.765 INFO:journalctl@ceph.mds.d.smithi059.stdout:Oct 08 13:03:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-d[154753]: 2023-10-08T13:03:06.457+0000 7f123ef3f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:06.765 INFO:journalctl@ceph.mds.d.smithi059.stdout:Oct 08 13:03:06 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-d[154753]: 2023-10-08T13:03:06.457+0000 7f123ef3f700 -1 mds.d *** got signal Terminated *** 2023-10-08T13:03:08.703 INFO:journalctl@ceph.mds.d.smithi059.stdout:Oct 08 13:03:08 smithi059 bash[190212]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-d 2023-10-08T13:03:08.742 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.d.service' 2023-10-08T13:03:08.825 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:08.826 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-08T13:03:08.826 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-08T13:03:08.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.g 2023-10-08T13:03:09.015 INFO:journalctl@ceph.mds.g.smithi059.stdout:Oct 08 13:03:08 smithi059 systemd[1]: Stopping Ceph mds.g for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:09.765 INFO:journalctl@ceph.mds.g.smithi059.stdout:Oct 08 13:03:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-g[155365]: 2023-10-08T13:03:09.324+0000 7f49da0aa700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:09.765 INFO:journalctl@ceph.mds.g.smithi059.stdout:Oct 08 13:03:09 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-g[155365]: 2023-10-08T13:03:09.324+0000 7f49da0aa700 -1 mds.g *** got signal Terminated *** 2023-10-08T13:03:11.265 INFO:journalctl@ceph.mds.g.smithi059.stdout:Oct 08 13:03:10 smithi059 bash[190348]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-g 2023-10-08T13:03:11.354 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.g.service' 2023-10-08T13:03:11.438 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:11.438 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-08T13:03:11.438 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-08T13:03:11.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.j 2023-10-08T13:03:11.765 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 13:03:11 smithi059 systemd[1]: Stopping Ceph mds.j for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:12.515 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 13:03:12 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-j[154369]: 2023-10-08T13:03:12.040+0000 7f10892d1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:12.515 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 13:03:12 smithi059 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-j[154369]: 2023-10-08T13:03:12.040+0000 7f10892d1700 -1 mds.j *** got signal Terminated *** 2023-10-08T13:03:16.515 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 13:03:16 smithi059 bash[190496]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-j 2023-10-08T13:03:16.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.j.service' 2023-10-08T13:03:16.793 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 13:03:16 smithi059 systemd[1]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.j.service: Succeeded. 2023-10-08T13:03:16.794 INFO:journalctl@ceph.mds.j.smithi059.stdout:Oct 08 13:03:16 smithi059 systemd[1]: Stopped Ceph mds.j for 6a005028-65d6-11ee-8db5-212e2dc638e7. 2023-10-08T13:03:16.816 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:16.816 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-08T13:03:16.817 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-08T13:03:16.817 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.b 2023-10-08T13:03:17.127 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 13:03:16 smithi092 systemd[1]: Stopping Ceph mds.b for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:17.627 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 13:03:17 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-b[173578]: 2023-10-08T13:03:17.177+0000 7f0dbbdcf700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:17.627 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 13:03:17 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-b[173578]: 2023-10-08T13:03:17.177+0000 7f0dbbdcf700 -1 mds.b *** got signal Terminated *** 2023-10-08T13:03:19.612 INFO:journalctl@ceph.mds.b.smithi092.stdout:Oct 08 13:03:19 smithi092 bash[180926]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-b 2023-10-08T13:03:19.618 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.b.service' 2023-10-08T13:03:19.654 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:19.654 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-08T13:03:19.654 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-08T13:03:19.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.e 2023-10-08T13:03:19.877 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 08 13:03:19 smithi092 systemd[1]: Stopping Ceph mds.e for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:20.377 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 08 13:03:20 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-e[172899]: 2023-10-08T13:03:20.015+0000 7f36ca043700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:20.377 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 08 13:03:20 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-e[172899]: 2023-10-08T13:03:20.015+0000 7f36ca043700 -1 mds.e *** got signal Terminated *** 2023-10-08T13:03:22.776 INFO:journalctl@ceph.mds.e.smithi092.stdout:Oct 08 13:03:22 smithi092 bash[181071]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-e 2023-10-08T13:03:22.782 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.e.service' 2023-10-08T13:03:22.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:22.815 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-08T13:03:22.816 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-08T13:03:22.816 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.h 2023-10-08T13:03:23.127 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 08 13:03:22 smithi092 systemd[1]: Stopping Ceph mds.h for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:23.627 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 08 13:03:23 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-h[173240]: 2023-10-08T13:03:23.184+0000 7fcab84a6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:23.627 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 08 13:03:23 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-h[173240]: 2023-10-08T13:03:23.184+0000 7fcab84a6700 -1 mds.h *** got signal Terminated *** 2023-10-08T13:03:25.330 INFO:journalctl@ceph.mds.h.smithi092.stdout:Oct 08 13:03:25 smithi092 bash[181213]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-h 2023-10-08T13:03:25.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.h.service' 2023-10-08T13:03:25.369 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:25.370 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-08T13:03:25.370 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-08T13:03:25.371 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.k 2023-10-08T13:03:25.627 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 08 13:03:25 smithi092 systemd[1]: Stopping Ceph mds.k for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:26.127 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 08 13:03:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-k[172558]: 2023-10-08T13:03:25.734+0000 7fd001b27700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:26.127 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 08 13:03:25 smithi092 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-k[172558]: 2023-10-08T13:03:25.734+0000 7fd001b27700 -1 mds.k *** got signal Terminated *** 2023-10-08T13:03:29.918 INFO:journalctl@ceph.mds.k.smithi092.stdout:Oct 08 13:03:29 smithi092 bash[181352]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-k 2023-10-08T13:03:30.122 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.k.service' 2023-10-08T13:03:30.159 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:30.159 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-08T13:03:30.160 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-08T13:03:30.160 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.c 2023-10-08T13:03:30.468 INFO:journalctl@ceph.mds.c.smithi173.stdout:Oct 08 13:03:30 smithi173 systemd[1]: Stopping Ceph mds.c for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:30.967 INFO:journalctl@ceph.mds.c.smithi173.stdout:Oct 08 13:03:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-c[173139]: 2023-10-08T13:03:30.536+0000 7f8a000e2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:30.968 INFO:journalctl@ceph.mds.c.smithi173.stdout:Oct 08 13:03:30 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-c[173139]: 2023-10-08T13:03:30.536+0000 7f8a000e2700 -1 mds.c *** got signal Terminated *** 2023-10-08T13:03:34.968 INFO:journalctl@ceph.mds.c.smithi173.stdout:Oct 08 13:03:34 smithi173 bash[181867]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-c 2023-10-08T13:03:34.981 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.c.service' 2023-10-08T13:03:35.018 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:35.018 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-08T13:03:35.018 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-08T13:03:35.018 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.f 2023-10-08T13:03:35.427 INFO:journalctl@ceph.mds.f.smithi173.stdout:Oct 08 13:03:35 smithi173 systemd[1]: Stopping Ceph mds.f for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:35.717 INFO:journalctl@ceph.mds.f.smithi173.stdout:Oct 08 13:03:35 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-f[172797]: 2023-10-08T13:03:35.427+0000 7f98181c6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:35.718 INFO:journalctl@ceph.mds.f.smithi173.stdout:Oct 08 13:03:35 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-f[172797]: 2023-10-08T13:03:35.427+0000 7f98181c6700 -1 mds.f *** got signal Terminated *** 2023-10-08T13:03:36.954 INFO:journalctl@ceph.mds.f.smithi173.stdout:Oct 08 13:03:36 smithi173 bash[182013]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-f 2023-10-08T13:03:37.142 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.f.service' 2023-10-08T13:03:37.175 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:37.175 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-08T13:03:37.175 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-08T13:03:37.176 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.i 2023-10-08T13:03:37.468 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 13:03:37 smithi173 systemd[1]: Stopping Ceph mds.i for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:37.968 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 13:03:37 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-i[173476]: 2023-10-08T13:03:37.544+0000 7f351a23e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:37.968 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 13:03:37 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-i[173476]: 2023-10-08T13:03:37.544+0000 7f351a23e700 -1 mds.i *** got signal Terminated *** 2023-10-08T13:03:39.468 INFO:journalctl@ceph.mds.i.smithi173.stdout:Oct 08 13:03:39 smithi173 bash[182151]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-i 2023-10-08T13:03:39.597 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.i.service' 2023-10-08T13:03:39.632 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:39.632 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-08T13:03:39.632 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-08T13:03:39.632 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.l 2023-10-08T13:03:39.968 INFO:journalctl@ceph.mds.l.smithi173.stdout:Oct 08 13:03:39 smithi173 systemd[1]: Stopping Ceph mds.l for 6a005028-65d6-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:40.468 INFO:journalctl@ceph.mds.l.smithi173.stdout:Oct 08 13:03:40 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-l[172459]: 2023-10-08T13:03:40.006+0000 7f6fa626a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:03:40.468 INFO:journalctl@ceph.mds.l.smithi173.stdout:Oct 08 13:03:40 smithi173 ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-l[172459]: 2023-10-08T13:03:40.006+0000 7f6fa626a700 -1 mds.l *** got signal Terminated *** 2023-10-08T13:03:43.952 INFO:journalctl@ceph.mds.l.smithi173.stdout:Oct 08 13:03:43 smithi173 bash[182298]: ceph-6a005028-65d6-11ee-8db5-212e2dc638e7-mds-l 2023-10-08T13:03:44.082 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a005028-65d6-11ee-8db5-212e2dc638e7@mds.l.service' 2023-10-08T13:03:44.116 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:03:44.116 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-08T13:03:44.117 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:03:44.521 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T13:03:47.922 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:03:48.299 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T13:03:49.916 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:03:50.220 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T13:03:51.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:03:51.863 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:03:51.899 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:03:51.929 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-08T13:03:51.932 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931/remote/smithi059/crash 2023-10-08T13:03:51.933 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:03:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:03:52.017 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:03:52.020 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931/remote/smithi092/crash 2023-10-08T13:03:52.021 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:03:52.074 INFO:teuthology.orchestra.run.smithi092.stderr:tar: /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:03:52.074 INFO:teuthology.orchestra.run.smithi092.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:03:52.076 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931/remote/smithi173/crash 2023-10-08T13:03:52.077 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:03:52.122 INFO:teuthology.orchestra.run.smithi173.stderr:tar: /var/lib/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:03:52.122 INFO:teuthology.orchestra.run.smithi173.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:03:52.123 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-08T13:03:52.123 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-08T13:03:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:grep: /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph.log: No such file or directory 2023-10-08T13:03:52.211 INFO:tasks.cephadm:Compressing logs... 2023-10-08T13:03:52.211 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:03:52.216 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:03:52.218 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:03:52.245 INFO:teuthology.orchestra.run.smithi173.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:03:52.246 INFO:teuthology.orchestra.run.smithi173.stderr:: No such file or directory 2023-10-08T13:03:52.246 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.5.log 2023-10-08T13:03:52.246 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.2.log 2023-10-08T13:03:52.246 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.11.log 2023-10-08T13:03:52.246 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mgr.z.log 2023-10-08T13:03:52.247 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.8.log 2023-10-08T13:03:52.247 INFO:teuthology.orchestra.run.smithi173.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:03:52.247 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.f.log 2023-10-08T13:03:52.251 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.c.log 2023-10-08T13:03:52.253 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.f.log: /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.c.log: 94.6% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.f.log.gz 2023-10-08T13:03:52.253 INFO:teuthology.orchestra.run.smithi173.stderr: 94.6% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.c.log.gz 2023-10-08T13:03:52.253 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.i.log 2023-10-08T13:03:52.253 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mon.c.log 2023-10-08T13:03:52.254 INFO:teuthology.orchestra.run.smithi092.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:03:52.254 INFO:teuthology.orchestra.run.smithi092.stderr:: No such file or directory 2023-10-08T13:03:52.255 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.i.log: /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mon.c.log: 93.2% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-08T13:03:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:03:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.l.log 2023-10-08T13:03:52.262 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.10.log 2023-10-08T13:03:52.263 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.h.log 2023-10-08T13:03:52.263 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.e.log 2023-10-08T13:03:52.264 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.10.log: /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.4.log 2023-10-08T13:03:52.264 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.1.log 2023-10-08T13:03:52.265 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.k.log 2023-10-08T13:03:52.265 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:03:52.265 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.1.log: /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.7.log 2023-10-08T13:03:52.266 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.l.log: 90.9% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:03:52.266 INFO:teuthology.orchestra.run.smithi173.stderr: 94.5% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.l.log.gz 2023-10-08T13:03:52.267 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mon.b.log 2023-10-08T13:03:52.267 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.7.log: --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.b.log 2023-10-08T13:03:52.267 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mgr.y.log 2023-10-08T13:03:52.268 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.b.log: /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mgr.y.log: 94.5% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.e.log.gz 2023-10-08T13:03:52.269 INFO:teuthology.orchestra.run.smithi092.stderr: 94.6% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.k.log.gz 2023-10-08T13:03:52.269 INFO:teuthology.orchestra.run.smithi092.stderr: 94.6% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.h.log.gz 2023-10-08T13:03:52.273 INFO:teuthology.orchestra.run.smithi092.stderr: 93.1% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-08T13:03:52.279 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2023-10-08T13:03:52.280 INFO:teuthology.orchestra.run.smithi059.stderr:-5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:03:52.280 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.0.log 2023-10-08T13:03:52.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.g.log 2023-10-08T13:03:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.a.log 2023-10-08T13:03:52.284 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.6.log 2023-10-08T13:03:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.a.log: 93.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:03:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.3.log 2023-10-08T13:03:52.287 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.d.log 2023-10-08T13:03:52.289 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mgr.x.log 2023-10-08T13:03:52.289 INFO:teuthology.orchestra.run.smithi059.stderr: 94.6% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.g.log.gz 2023-10-08T13:03:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.a.log.gz 2023-10-08T13:03:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.9.log 2023-10-08T13:03:52.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:03:52.294 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.j.log 2023-10-08T13:03:52.302 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-volume.log: /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.d.log.gz 2023-10-08T13:03:52.303 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mon.a.log 2023-10-08T13:03:52.303 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mon.a.log: 94.4% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.j.log.gz 2023-10-08T13:03:52.303 INFO:teuthology.orchestra.run.smithi059.stderr: 90.9% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:03:52.338 INFO:teuthology.orchestra.run.smithi092.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:03:52.408 INFO:teuthology.orchestra.run.smithi092.stderr: 90.9% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:03:52.739 INFO:teuthology.orchestra.run.smithi059.stderr: 90.1% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-08T13:03:52.925 INFO:teuthology.orchestra.run.smithi173.stderr: 91.9% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mon.c.log.gz 2023-10-08T13:03:54.757 INFO:teuthology.orchestra.run.smithi059.stderr: 91.9% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mon.a.log.gz 2023-10-08T13:03:55.839 INFO:teuthology.orchestra.run.smithi092.stderr: 91.9% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mon.b.log.gz 2023-10-08T13:04:15.197 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.11.log.gz 2023-10-08T13:04:15.804 INFO:teuthology.orchestra.run.smithi173.stderr: 94.9% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.i.log.gz 2023-10-08T13:04:15.859 INFO:teuthology.orchestra.run.smithi059.stderr: 91.4% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.9.log.gz 2023-10-08T13:04:20.303 INFO:teuthology.orchestra.run.smithi059.stderr: 91.7% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.0.log.gz 2023-10-08T13:04:20.342 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.6.log.gz 2023-10-08T13:04:22.215 INFO:teuthology.orchestra.run.smithi173.stderr: 91.8% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.2.log.gz 2023-10-08T13:04:26.172 INFO:teuthology.orchestra.run.smithi059.stderr: 91.5% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.3.log.gz 2023-10-08T13:04:26.175 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-10-08T13:04:26.175 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m33.923s 2023-10-08T13:04:26.175 INFO:teuthology.orchestra.run.smithi059.stderr:user 1m48.301s 2023-10-08T13:04:26.175 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m8.248s 2023-10-08T13:04:30.444 INFO:teuthology.orchestra.run.smithi173.stderr: 90.9% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.8.log.gz 2023-10-08T13:04:35.348 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.5.log.gz 2023-10-08T13:04:35.350 INFO:teuthology.orchestra.run.smithi173.stderr: 2023-10-08T13:04:35.350 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m43.116s 2023-10-08T13:04:35.350 INFO:teuthology.orchestra.run.smithi173.stderr:user 2m33.419s 2023-10-08T13:04:35.350 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m4.724s 2023-10-08T13:04:44.813 INFO:teuthology.orchestra.run.smithi092.stderr: 91.2% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.4.log.gz 2023-10-08T13:04:51.468 INFO:teuthology.orchestra.run.smithi092.stderr: 91.6% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.1.log.gz 2023-10-08T13:05:00.188 INFO:teuthology.orchestra.run.smithi092.stderr: 91.3% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.10.log.gz 2023-10-08T13:05:03.576 INFO:teuthology.orchestra.run.smithi092.stderr: 91.3% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-osd.7.log.gz 2023-10-08T13:12:07.098 INFO:teuthology.orchestra.run.smithi092.stderr: 93.2% -- replaced with /var/log/ceph/6a005028-65d6-11ee-8db5-212e2dc638e7/ceph-mds.b.log.gz 2023-10-08T13:12:07.121 INFO:teuthology.orchestra.run.smithi092.stderr: 2023-10-08T13:12:07.122 INFO:teuthology.orchestra.run.smithi092.stderr:real 8m14.886s 2023-10-08T13:12:07.122 INFO:teuthology.orchestra.run.smithi092.stderr:user 8m31.015s 2023-10-08T13:12:07.122 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m19.771s 2023-10-08T13:12:07.123 INFO:tasks.cephadm:Archiving logs... 2023-10-08T13:12:07.123 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931/remote/smithi059/log 2023-10-08T13:12:07.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:12:24.342 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931/remote/smithi092/log 2023-10-08T13:12:24.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:13:45.708 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931/remote/smithi173/log 2023-10-08T13:13:45.709 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:14:08.703 INFO:tasks.cephadm:Removing cluster... 2023-10-08T13:14:08.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:14:09.109 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T13:14:10.270 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:14:10.888 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T13:14:11.829 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a005028-65d6-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:14:12.133 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: 6a005028-65d6-11ee-8db5-212e2dc638e7 2023-10-08T13:14:12.813 INFO:tasks.cephadm:Removing cephadm ... 2023-10-08T13:14:12.814 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:14:12.863 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:14:12.896 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:14:12.913 INFO:tasks.cephadm:Teardown complete 2023-10-08T13:14:12.914 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T13:14:12.924 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T13:14:12.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:14:12.929 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:14:12.938 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:14:13.078 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T13:14:13.090 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T13:14:13.091 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:14:13.096 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:14:13.099 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:14:13.115 INFO:teuthology.orchestra.run.smithi173.stderr:bash: ntpq: command not found 2023-10-08T13:14:13.115 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-10-08T13:14:13.120 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:14:13.120 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2023-10-08T13:14:13.120 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 5 +442us[ +477us] +/- 71ms 2023-10-08T13:14:13.120 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 +86us[ +122us] +/- 53ms 2023-10-08T13:14:13.120 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -609us[ -573us] +/- 86ms 2023-10-08T13:14:13.121 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:13.134 INFO:teuthology.orchestra.run.smithi059.stderr:bash: ntpq: command not found 2023-10-08T13:14:13.142 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:14:13.142 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2023-10-08T13:14:13.142 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 8 +436us[ +491us] +/- 71ms 2023-10-08T13:14:13.143 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 +78us[ +133us] +/- 53ms 2023-10-08T13:14:13.143 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -618us[ -563us] +/- 86ms 2023-10-08T13:14:13.143 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:13.163 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:14:13.164 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-08T13:14:13.164 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 +450us[ +450us] +/- 71ms 2023-10-08T13:14:13.164 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv02.front.sepia.ceph.com 3 6 377 63 +121us[ +117us] +/- 52ms 2023-10-08T13:14:13.164 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -570us[ -570us] +/- 86ms 2023-10-08T13:14:13.165 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:13.165 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T13:14:13.176 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T13:14:13.176 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T13:14:13.204 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:14:13.391 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:14:13.557 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:14:13.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:14:13.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:14:13.730 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:14:13.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:14:13.769 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:14:13.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:14:13.802 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T13:14:13.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T13:14:13.864 INFO:teuthology.task.internal:Duration was 3699.870821 seconds 2023-10-08T13:14:13.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T13:14:13.914 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T13:14:13.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:14:13.919 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:14:13.922 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:14:13.968 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:14:13.997 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:14:14.034 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:14:14.293 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T13:14:14.293 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2023-10-08T13:14:14.294 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:14:14.353 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2023-10-08T13:14:14.354 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:14:14.395 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2023-10-08T13:14:14.395 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:14:14.418 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T13:14:14.418 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:14:14.423 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:14:14.438 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:14:14.523 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T13:14:14.523 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:14:14.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:14:14.531 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:14:14.708 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T13:14:14.722 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T13:14:14.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:14:14.792 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:14:14.827 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:14:14.854 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T13:14:14.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:14:14.872 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:14:14.874 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:14:14.920 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2023-10-08T13:14:14.922 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2023-10-08T13:14:14.936 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2023-10-08T13:14:15.021 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:14:15.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:14:15.063 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:14:15.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:14:15.082 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:14:15.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:14:15.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T13:14:15.110 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T13:14:15.112 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931/remote/smithi059 2023-10-08T13:14:15.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:14:15.197 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931/remote/smithi092 2023-10-08T13:14:15.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:14:15.242 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931/remote/smithi173 2023-10-08T13:14:15.242 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:14:15.285 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T13:14:15.285 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:14:15.290 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:14:15.292 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:14:15.334 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T13:14:15.351 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T13:14:15.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T13:14:15.374 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T13:14:15.375 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:14:15.381 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:14:15.383 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:14:15.399 INFO:teuthology.orchestra.run.smithi173.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:14 /home/ubuntu/cephtest 2023-10-08T13:14:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:14 /home/ubuntu/cephtest 2023-10-08T13:14:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:14 /home/ubuntu/cephtest 2023-10-08T13:14:15.422 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T13:14:15.434 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T13:14:15.490 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T13:14:15.516 DEBUG:teuthology.nuke:shortname: smithi059 2023-10-08T13:14:15.516 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:14:15.545 DEBUG:teuthology.nuke:shortname: smithi092 2023-10-08T13:14:15.546 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:14:15.551 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:04:14.376255', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:14:15.573 DEBUG:teuthology.nuke:shortname: smithi173 2023-10-08T13:14:15.573 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:14:15.577 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:04:14.379125', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:14:15.607 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-08T13:14:15.608 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:14:15.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417931', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:04:14.377807', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:14:15.632 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-08T13:14:15.632 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:15.652 INFO:teuthology.orchestra.console.smithi092:Power off 2023-10-08T13:14:15.653 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:14:15.668 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-08T13:14:15.678 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-10-08T13:14:15.678 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:15.702 INFO:teuthology.orchestra.console.smithi173:Power off 2023-10-08T13:14:15.702 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:14:15.713 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-08T13:14:15.728 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-10-08T13:14:15.728 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:15.754 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-10-08T13:14:19.669 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:19.714 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:19.755 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:19.781 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-08T13:14:19.826 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-08T13:14:19.866 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-10-08T13:14:23.786 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:23.827 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:23.867 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:23.896 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-08T13:14:23.936 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-08T13:14:23.982 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-10-08T13:14:27.898 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:27.937 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:27.983 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:14:28.011 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-08T13:14:28.046 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-08T13:14:28.096 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-10-08T13:14:28.112 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-08T13:14:28.147 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-10-08T13:14:28.197 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-10-08T13:14:28.305 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/dbench}} duration: 3699.8708214759827 failure_reason: 'Command failed (workunit test suites/dbench.sh) on smithi059 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh''' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=318ddbe23be04754a8f57e2afa19e4c6 status: fail success: false 2023-10-08T13:14:28.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T13:14:28.396 INFO:teuthology.run:FAIL